-- Logs begin at Tue 2022-10-18 12:31:12 UTC, end at Tue 2022-10-18 15:08:49 UTC. -- Oct 18 13:04:59.319923 n-d-858384-13 systemd[1]: Starting Devstack devstack@n-api.service... Oct 18 13:04:59.329204 n-d-858384-13 devstack@n-api.service[104735]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 18 13:04:59 2022] *** Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: nodename: n-d-858384-13 Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: machine: x86_64 Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: clock source: unix Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: pcre jit disabled Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: detected number of CPU cores: 4 Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: current working directory: / Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: detected binary path: /usr/bin/uwsgi-core Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: your processes number limit is 47680 Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: your memory page size is 4096 bytes Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: detected max file descriptor number: 2048 Oct 18 13:04:59.331116 n-d-858384-13 devstack@n-api.service[104735]: lock engine: pthread robust mutexes Oct 18 13:04:59.332614 n-d-858384-13 devstack@n-api.service[104735]: thunder lock: enabled Oct 18 13:04:59.332614 n-d-858384-13 devstack@n-api.service[104735]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 18 13:04:59.332614 n-d-858384-13 devstack@n-api.service[104735]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 18 13:04:59.373678 n-d-858384-13 devstack@n-api.service[104735]: Python main interpreter initialized at 0x55ae9cd6d9c0 Oct 18 13:04:59.373678 n-d-858384-13 devstack@n-api.service[104735]: python threads support enabled Oct 18 13:04:59.373678 n-d-858384-13 devstack@n-api.service[104735]: your server socket listen backlog is limited to 100 connections Oct 18 13:04:59.373678 n-d-858384-13 devstack@n-api.service[104735]: your mercy for graceful operations on workers is 90 seconds Oct 18 13:04:59.374148 n-d-858384-13 devstack@n-api.service[104735]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 13:04:59.374148 n-d-858384-13 devstack@n-api.service[104735]: *** Operational MODE: preforking *** Oct 18 13:04:59.374426 n-d-858384-13 devstack@n-api.service[104735]: *** uWSGI is running in multiple interpreter mode *** Oct 18 13:04:59.374426 n-d-858384-13 devstack@n-api.service[104735]: spawned uWSGI master process (pid: 104735) Oct 18 13:04:59.378277 n-d-858384-13 devstack@n-api.service[104735]: spawned uWSGI worker 1 (pid: 104736, cores: 1) Oct 18 13:04:59.378277 n-d-858384-13 devstack@n-api.service[104735]: spawned uWSGI worker 2 (pid: 104737, cores: 1) Oct 18 13:04:59.378277 n-d-858384-13 devstack@n-api.service[104735]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 13:04:59.374682 n-d-858384-13 systemd[1]: Started Devstack devstack@n-api.service. Oct 18 13:05:00.078160 n-d-858384-13 devstack@n-api.service[104737]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 13:05:00.184732 n-d-858384-13 devstack@n-api.service[104736]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 13:05:01.214127 n-d-858384-13 devstack@n-api.service[104737]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:05:01.214127 n-d-858384-13 devstack@n-api.service[104737]: from cryptography.utils import int_from_bytes Oct 18 13:05:01.214774 n-d-858384-13 devstack@n-api.service[104737]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:05:01.214774 n-d-858384-13 devstack@n-api.service[104737]: from cryptography.utils import int_from_bytes Oct 18 13:05:01.267992 n-d-858384-13 devstack@n-api.service[104736]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:05:01.267992 n-d-858384-13 devstack@n-api.service[104736]: from cryptography.utils import int_from_bytes Oct 18 13:05:01.268572 n-d-858384-13 devstack@n-api.service[104736]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:05:01.268572 n-d-858384-13 devstack@n-api.service[104736]: from cryptography.utils import int_from_bytes Oct 18 13:05:03.826178 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 13:05:03.826890 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 13:05:03.826972 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 13:05:03.827318 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 13:05:03.827577 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 13:05:03.827963 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.828205 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 13:05:03.828571 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.828661 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 13:05:03.828752 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.828923 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.829019 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 13:05:03.829296 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.829387 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 13:05:03.829614 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.829699 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 13:05:03.829939 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.830027 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.830263 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.830349 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.830597 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.830689 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.830862 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.830956 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.831182 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.831275 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.831545 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-13 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.831691 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.831866 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.832121 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.832216 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.832476 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.832561 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.832797 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.832891 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.833099 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.833202 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.833464 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.833560 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.833757 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.833850 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-13 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.834092 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.834259 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.834406 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.834708 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.834843 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.835019 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.835114 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.835329 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.835431 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.835656 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.835770 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.835963 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.836048 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.836273 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.836483 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.836592 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.836791 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.836879 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.837101 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.837237 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.837437 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.837532 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.837777 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.837921 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-13 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.838090 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.838247 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.838400 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.838565 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.838721 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.838876 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.839034 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.839302 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.839396 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.839620 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.839706 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.839936 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.840022 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-13 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.840262 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.840365 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.840604 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.840691 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.840917 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.841001 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.841275 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.841364 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.841602 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.841700 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.841927 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.842013 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.842251 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.842344 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.842559 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.842647 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.842873 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.842967 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.843187 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.843272 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.843511 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.843603 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.843823 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.843915 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.844131 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.844289 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.844375 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.844490 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.844684 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.844778 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.845010 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.845114 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.845354 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.845440 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.845665 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.845797 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.845924 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.846010 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.846177 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.846262 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.846501 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.846588 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.846822 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.846907 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.847243 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.847466 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.847553 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.847735 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.847885 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.848049 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.848197 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.848303 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.848416 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.848624 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.848722 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.848957 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.849077 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.849281 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.849390 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.849594 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.849681 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.849905 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.849998 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.850217 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.850303 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.850527 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.850611 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.850833 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.850928 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.851148 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.851235 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.851459 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.851580 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.851778 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.851890 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.852093 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.852191 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.852415 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.852501 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.852724 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.852811 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.853042 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.853126 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.853393 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.853482 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.853706 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.853794 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.854011 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.854098 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.854325 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.854471 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.854647 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.854815 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.854972 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.855117 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.855248 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.855380 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.855521 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.855654 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.855786 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.855929 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.856158 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.856289 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.856433 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.856575 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.856703 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.856836 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.856978 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.857119 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.857312 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.857468 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.857616 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.857709 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.857919 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.858056 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.858223 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.858309 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.858530 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.858615 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.858837 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.858933 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.859142 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.859227 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.859446 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.859541 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.859747 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.859842 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.860053 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.860144 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.860356 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.860441 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.860659 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.860745 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.860967 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.861052 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.861296 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.861387 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.861604 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.861692 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.861908 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.861992 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.862213 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.862298 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.862514 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.862643 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.863398 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.863490 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.863652 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.863936 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.864044 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.864267 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.864352 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.864573 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.864662 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.864881 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.864974 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.865203 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.865292 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.865513 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.865612 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.865823 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.865921 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.866143 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.866235 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.866448 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.866534 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.866756 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.866853 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.867063 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.867153 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.867369 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.867453 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.867672 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.867773 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.867983 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.868068 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.868291 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.868397 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.868720 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.869160 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.869389 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.869531 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.869667 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.869793 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.870066 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.870312 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.870398 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.870694 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.870818 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.871010 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.871169 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.871306 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.871427 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.871614 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.871793 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.871919 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.872111 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.872224 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.872440 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.872525 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.872788 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.872891 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.873107 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.873222 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.873451 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.873547 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.873774 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.873867 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.874083 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.874168 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.874388 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.874479 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.874693 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.874793 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.875012 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:05:03.875096 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.875351 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.875444 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.875686 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.875848 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.876002 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.876086 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.876319 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.876403 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.876636 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.876757 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.876963 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.877047 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.877318 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.877478 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.877622 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.877761 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.877926 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.878016 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.878256 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.878422 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.879252 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.879371 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.879614 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.879809 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.879947 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.880139 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.880286 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.880465 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.880617 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.880790 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.880936 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.881128 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.881309 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.881485 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.881663 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.881813 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.881985 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.882135 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.882317 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.882449 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.882657 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.882797 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.882999 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.883118 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.883319 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.883441 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.883635 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.883709 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.883984 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.884087 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.884300 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.884382 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.884608 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.884726 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.884931 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.885025 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.885286 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.885367 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.885606 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.885702 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.885915 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.886018 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.886228 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.886303 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.886544 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.886636 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.886862 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.886955 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.887171 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.887255 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.887491 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.887575 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.887803 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.887897 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.888128 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.888213 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.888441 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.888531 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.888755 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.888844 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.889067 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.889152 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.889404 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.889495 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.889717 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.889811 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.890031 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.890152 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.890341 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.890436 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.890651 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.890738 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.890964 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.891051 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.891274 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.891371 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.891581 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.891666 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.891897 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.891983 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.892207 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.892300 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.892518 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.892605 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.892824 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.892926 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.893130 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.893289 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.893462 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.893547 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.893773 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.893857 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.894104 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.894204 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.894410 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.894692 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.894836 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.895024 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.895119 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.895334 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.895420 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.895660 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.895753 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.895973 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.896071 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.896282 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.896370 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.896593 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.896677 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.896903 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.896996 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.897230 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.897318 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.897547 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.897632 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.897860 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.897958 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.898167 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.898251 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.898484 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.898568 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.898796 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.898881 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.899103 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.899188 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.899426 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.899561 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.899737 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.899818 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.900033 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.900125 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.900351 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.900444 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.900666 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.900754 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.900980 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.901064 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.901318 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.901407 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.901641 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.901735 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.901960 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.902045 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.902273 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.902366 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.902581 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.902666 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.902889 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.902981 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.903202 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.903337 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.903512 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.903604 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.903821 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.903908 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.904128 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.904225 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.904435 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.904535 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.904743 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.904845 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.905053 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.905167 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.905399 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.905487 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.905705 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.905802 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.906012 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.906106 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.906323 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.906423 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.906626 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.906728 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.906932 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.907045 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.907237 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.907338 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.907540 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.907633 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.907844 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.907978 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.908179 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.908353 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.908499 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.908695 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.908856 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.909004 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.909150 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.909322 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.909410 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.909491 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.909875 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.909999 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.910193 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.910441 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.910539 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.910815 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.910917 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.911130 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.911241 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.911464 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.911607 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.911771 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.911859 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.912101 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.912246 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.912418 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.912532 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.912729 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.912815 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.913043 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.913307 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.913401 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.913489 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.913683 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.913828 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.914007 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.914119 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.914317 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.914455 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.914646 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.914774 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.914955 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.915043 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.915280 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.915452 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.915587 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.915673 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.915909 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.916056 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.916196 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.916296 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.916517 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.916663 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.916945 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.917074 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.917196 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.917358 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.917512 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.917627 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.917782 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.917968 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.918134 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.918278 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.918425 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.918593 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.918761 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.918904 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.919060 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.919223 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.919366 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.919510 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.919665 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.919802 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.919962 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.920105 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.920242 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.920375 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.920557 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.920781 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.920949 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.921062 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.921211 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.921369 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.921515 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.921722 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.921817 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.921894 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.922126 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.922288 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.922427 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.922524 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.922737 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.923149 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.923305 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.923447 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.923626 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.923757 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.923946 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.924089 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.924250 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.924344 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.924569 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.924727 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.924881 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.924987 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.925692 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.925788 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.926178 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.926283 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.926536 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.926648 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.926864 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.927018 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.927182 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.927306 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.927494 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.927637 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.927793 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.927986 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.928089 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.928261 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.928407 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.928581 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.928738 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.928915 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.929050 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.929264 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.929362 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.929581 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.929683 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.929896 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.930067 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.930211 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.930306 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.930543 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.930629 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.930871 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.931009 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.931187 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.931284 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.931490 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.931578 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.931817 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.931918 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.932123 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.932210 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.932430 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.932526 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.932739 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.932864 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.933048 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.933227 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.933392 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.933482 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.933716 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.933866 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.934009 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.934100 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.934325 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.934424 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.934647 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.934796 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.934953 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.935041 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.935265 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.935366 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.935582 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.935730 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.935889 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.935977 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.936204 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.936418 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.936636 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.936778 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.936913 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.937044 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.937242 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.937469 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.937640 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.937776 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.937909 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.938087 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.938309 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.938484 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.938623 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.938757 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.938886 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.939112 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.939327 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.939486 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.939632 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.939792 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.940006 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.940202 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.940407 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.940580 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.940716 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.940716 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.941602 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.941690 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.941859 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.942049 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.942250 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.942359 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.942571 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.942725 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.942874 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.942979 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.943186 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.943336 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.943504 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.943657 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.943798 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.943934 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.944114 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.944255 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.944431 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.944583 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.944719 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.944869 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.945032 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.945232 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.945382 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.945527 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.945691 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.945845 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.945975 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.946106 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.946295 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.946443 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.946605 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.946756 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.946935 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.947066 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.947256 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.947386 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.947565 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.947713 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.947876 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.948013 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.948184 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.948329 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.948498 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.948640 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.948826 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.949004 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.949124 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.949280 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.949458 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.949585 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.949785 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.949937 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.950099 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.950250 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.950407 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.950560 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.950713 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.950890 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.951020 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.951203 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.951370 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.951513 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.951680 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.951823 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.952023 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.952130 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.952353 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.952453 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.952701 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.952786 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.953010 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.953104 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.953344 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.953477 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.953673 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.953844 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.953976 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.954088 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.954283 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.954411 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.954591 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.954739 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.954892 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.955063 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.955201 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.955343 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.955492 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.955641 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.955809 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.955922 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.956105 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.956203 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.956439 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.956593 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.956758 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.956900 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.957069 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.957386 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.957477 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.957710 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.957816 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.958022 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.958107 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.958330 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.958429 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.958639 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.958735 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.958948 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.959034 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.959259 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.959398 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.959571 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.959658 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.959879 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.959972 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.960185 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.960272 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.960500 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.960587 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.960807 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.960900 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.961114 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.961265 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.961452 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.961541 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.961759 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.961844 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.962078 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.962248 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.962431 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.962582 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.962733 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.962853 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.963013 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.963132 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.963322 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.963416 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.963637 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.963712 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.963948 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.964094 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.964232 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.964374 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.964558 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.964743 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.964896 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.965008 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.965149 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.965283 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.965484 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.965646 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.965795 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.965898 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.966080 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.966170 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.966393 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.966573 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.966708 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.966793 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.967006 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.967114 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.967314 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.967478 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.967667 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.967798 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.967901 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.967971 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.968246 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.968403 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.968560 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.968689 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.968844 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.969061 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.969232 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.969321 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.969528 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.969627 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.969850 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.969938 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.970161 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.970258 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.970469 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.970554 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.970776 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.970866 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.971080 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.971177 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.971397 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.971481 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.971712 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.971797 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.972045 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.972142 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.972359 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.972582 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.972737 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.972977 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.973077 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.973317 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.973409 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.973633 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.973729 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.973959 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.974045 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.974275 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.974371 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.974585 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.974670 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.974906 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.975116 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.975203 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.975459 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.975552 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.975810 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.975956 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.976115 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.976334 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.976427 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.976739 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.976824 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.977052 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.977385 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.977486 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.977717 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.977899 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.978045 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.978239 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.978354 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.978669 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.978766 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.978981 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.979066 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.979294 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.979607 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.979698 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.979917 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.980034 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.980228 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.980493 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.980580 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.980835 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.980920 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.981155 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.981359 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.981491 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.981799 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.981886 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.982111 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.982255 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.982427 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.982733 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.982867 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.983057 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.983158 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.983430 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.983662 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.983800 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.984066 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.984230 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.984373 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.984690 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.984800 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.984991 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.985329 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.985455 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.985753 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.985843 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.986064 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.986199 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.986369 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.986630 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.986723 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.986973 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.987074 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.987297 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.987495 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.988173 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.988467 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.988600 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.989070 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.989238 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.989482 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.989660 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.989833 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.990146 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.990236 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.990461 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.990609 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.990759 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.990969 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.991069 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.991381 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.991527 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.991686 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.991794 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.991973 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.992269 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.992419 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.992581 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.992673 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.992892 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.993234 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.993347 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.993658 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.993868 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.994006 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.994139 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.994296 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.994592 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.994681 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.994979 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.995124 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.995288 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.995594 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.995735 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.995923 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.996146 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.996265 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.996541 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.996843 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.997026 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.997219 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.997402 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.997505 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.997809 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.997957 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.998116 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.998436 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.998598 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.998735 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.999051 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.999200 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.999457 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.999625 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.999742 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:03.999983 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.000186 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.000404 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.000725 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.000845 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.001040 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.001317 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.001445 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.001708 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.001846 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.002018 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.002358 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.002536 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.002723 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.002950 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.003207 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.003207 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.004135 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.004355 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.004663 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.004817 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.005029 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.006097 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.006286 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.008049 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.008284 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.008284 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.008550 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.008938 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.008938 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.009416 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.009648 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.009648 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.010253 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.010485 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.010485 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.011401 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.011470 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.011470 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.011600 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.011673 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.011673 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.011882 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.011972 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.011972 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.012101 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.012168 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.012244 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.012309 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.012309 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.012526 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.012594 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.012594 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.012709 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.012780 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.012914 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.013056 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.013056 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.013234 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.013306 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.013371 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.013457 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.013537 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.013614 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.013614 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.013731 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.013808 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.013951 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.014046 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.014324 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.014426 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.014636 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.014926 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.015013 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.015236 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.015320 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.015543 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.015855 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.015948 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.016160 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.016247 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.016466 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.016696 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.016788 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.017081 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.017221 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.017429 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.017631 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.017789 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.018148 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.018235 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.018456 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.018551 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.018760 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.019067 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.019204 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.019456 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.019803 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.019934 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.020129 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.020346 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.020456 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.020769 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.020863 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.021097 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.021212 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.021453 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.021775 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.021862 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.022097 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.022240 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.022416 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.022736 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.022824 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.023055 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.023213 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.023389 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.023628 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.023731 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.023994 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.024151 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.024333 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.024615 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.024703 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.025108 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.025222 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.025541 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.025673 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.025861 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.026178 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.026297 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.026495 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.026727 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.026814 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.027115 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.027209 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.027431 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.027696 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.027784 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.028047 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.028133 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.028363 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.028560 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.028691 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.028945 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.029044 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.029358 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.029464 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.029699 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.029825 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.030021 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.030340 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.030432 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.030659 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.030745 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.030976 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.031214 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.031341 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.031570 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.031659 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.031953 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.032149 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.032266 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.032506 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.032593 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.032969 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.033068 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.033332 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.033661 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.033760 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.033954 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.034225 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.034325 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.034590 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.034994 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.035155 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.035524 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.035628 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.035816 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.036024 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.036147 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.036382 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.036472 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.036801 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.036969 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.037119 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.037463 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.037553 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.037786 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.037982 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.038322 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.038408 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.038643 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.038859 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.038977 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.039307 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.039433 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.039635 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.039732 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.039958 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.040180 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.040267 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.040592 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.040778 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.040900 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.041152 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.041327 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.041537 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.041728 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.041849 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.042157 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.042242 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.042481 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.042636 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.042791 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.043100 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.043186 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.043420 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.043548 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.043733 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.044001 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.044264 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.044616 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.044776 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.044934 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.045273 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.045364 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.045608 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.045696 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.045928 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.046142 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.046237 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.046511 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.046598 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.046848 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.047035 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.047155 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.047378 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.047472 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.048132 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.048224 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.048442 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.048749 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.048916 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.049056 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.049139 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.049387 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.049633 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.049730 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.049993 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.050080 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.050951 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.051127 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.051497 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.051585 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.051828 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.052117 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.052208 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.052447 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.052645 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.052765 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.053030 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.053157 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.053404 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.053652 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.053746 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.054012 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.054192 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.054360 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.054581 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.054699 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.054913 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.055116 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.055261 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.055451 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.055577 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.055859 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.056015 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.056178 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.056444 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.056551 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.056795 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.056933 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.057103 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.057313 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.057435 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.057754 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.057840 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.058067 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.058165 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.058393 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.058686 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.058810 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.059008 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.059123 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.059356 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.059564 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.059677 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.059980 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.060220 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.060475 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.060576 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.060860 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.061019 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.061217 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.061461 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.061584 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.061982 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.062116 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.062294 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.062464 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.062556 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.062892 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.063082 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.063201 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.063346 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.063513 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.063807 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.064028 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.064189 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.064424 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.064609 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.064781 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.064982 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.065214 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.065353 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.065526 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.065655 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.066500 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.066642 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.067077 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.067222 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.067428 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.067587 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.067741 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.068041 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.068196 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.068341 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.068432 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.068690 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.068962 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.069065 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.069349 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.069439 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.069670 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.069868 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.069992 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.070308 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.070394 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.070624 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.070713 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.070943 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.071238 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.071343 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.071568 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.071666 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.071900 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.072091 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.072204 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.072512 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.072610 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.073255 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.073366 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.073584 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.073825 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.073913 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.074224 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.074309 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.074541 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.074772 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.074867 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.075185 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.075270 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.075506 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.075655 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.075828 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.076147 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.076295 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.076557 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.076647 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.076904 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.077099 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.077262 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.077551 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.077649 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.077894 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.077989 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.078205 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.078506 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.078592 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.078818 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.078903 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.079143 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.079359 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.079456 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.079748 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.079870 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.080055 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.080257 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.080369 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.080674 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.080760 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.080979 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.081236 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.081365 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.084269 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.084430 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.084542 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.084752 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.084752 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.085011 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.085117 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.085251 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.085362 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.085362 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.085569 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.085676 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.085788 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.085892 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.085892 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.086094 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.086224 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.086331 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.086434 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.086434 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.086632 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.086728 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.086809 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.086887 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.086887 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.087037 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.087115 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.087201 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.087280 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.087280 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.087419 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.087496 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.087573 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.087683 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.087995 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.088079 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.088322 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.088497 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.088647 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.088941 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.089029 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.089290 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.089481 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.089630 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.089939 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.090027 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.090251 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.090337 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.090564 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.090857 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.090969 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.091216 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.091339 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.091534 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.091785 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.091900 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.092188 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.092304 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.092499 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.092717 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.092828 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.093135 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.093308 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.093485 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.093703 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.093834 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.094125 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.094290 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.094461 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.094735 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.094998 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.095183 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.095347 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.095533 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.095648 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.095957 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.096074 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.096273 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.096426 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.097607 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.097607 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.097762 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.097842 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.097918 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.098284 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.098416 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.098696 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.098793 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.099034 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.099353 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.099439 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.099687 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.099991 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.100077 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.100366 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.100595 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.100682 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.101023 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.101231 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.101397 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.101692 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.101791 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.102012 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.102322 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.102408 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.102567 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 13:05:04.102957 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.103556 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.104115 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.104704 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.105336 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.105929 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.106526 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.107125 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.107725 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.108334 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.108984 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.109637 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.110050 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.110582 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.111033 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.111459 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.112023 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.112619 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.113039 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.113760 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.114385 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.114783 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.115359 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.116267 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.116826 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.117293 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.117822 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.118304 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.118710 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.119244 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.119747 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.120153 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.120647 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.121167 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.121633 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.122231 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.122689 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.123106 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.123625 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.124064 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.124604 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.125076 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.125607 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.126099 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.126679 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.127166 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.127551 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.128028 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.129092 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.129761 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.130252 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.130743 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.131222 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.131717 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.132193 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.132695 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.133295 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.133732 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.134164 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.134684 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.135246 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.135659 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.136211 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.136695 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.137142 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.137772 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.138177 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.138703 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.139204 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.139800 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.140197 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.140729 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.141291 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.141772 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.142142 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.142727 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.143147 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.143674 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.144732 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.145260 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.145650 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.146268 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.146700 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.147273 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.147718 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.148175 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.148728 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.149130 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.149630 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.150186 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.150628 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.151167 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.151645 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.152039 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.152618 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.153027 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.153571 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.154057 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.154455 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.154983 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.155502 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.155917 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.156416 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.156937 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.157408 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.158029 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.158596 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.159164 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.159698 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.160062 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.160592 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.160975 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:05:04.161397 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 13:05:04.258569 n-d-858384-13 devstack@n-api.service[104737]: INFO dbcounter [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] Registered counter for database nova_api Oct 18 13:05:04.280659 n-d-858384-13 devstack@n-api.service[104737]: DEBUG oslo_db.sqlalchemy.engines [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:05:04.290325 n-d-858384-13 devstack@n-api.service[104737]: DEBUG dbcounter [-] [104737] Writer thread running {{(pid=104737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:05:04.352896 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.context [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8e216eb-ce73-4101-a62e-f9159a9c2bcf(cell1) {{(pid=104737) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 13:05:04.356701 n-d-858384-13 devstack@n-api.service[104737]: DEBUG oslo_concurrency.lockutils [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:05:04.357186 n-d-858384-13 devstack@n-api.service[104737]: DEBUG oslo_concurrency.lockutils [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:05:04.358780 n-d-858384-13 devstack@n-api.service[104737]: DEBUG oslo_concurrency.lockutils [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:05:04.359503 n-d-858384-13 devstack@n-api.service[104737]: DEBUG oslo_concurrency.lockutils [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:05:04.359939 n-d-858384-13 devstack@n-api.service[104737]: DEBUG oslo_concurrency.lockutils [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:05:04.361950 n-d-858384-13 devstack@n-api.service[104737]: DEBUG oslo_concurrency.lockutils [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:05:04.364891 n-d-858384-13 devstack@n-api.service[104737]: INFO dbcounter [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] Registered counter for database nova_cell0 Oct 18 13:05:04.368971 n-d-858384-13 devstack@n-api.service[104737]: INFO dbcounter [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] Registered counter for database nova_cell1 Oct 18 13:05:04.370602 n-d-858384-13 devstack@n-api.service[104736]: INFO dbcounter [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Registered counter for database nova_api Oct 18 13:05:04.376428 n-d-858384-13 devstack@n-api.service[104737]: DEBUG oslo_db.sqlalchemy.engines [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:05:04.378867 n-d-858384-13 devstack@n-api.service[104737]: DEBUG oslo_db.sqlalchemy.engines [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:05:04.384407 n-d-858384-13 devstack@n-api.service[104737]: DEBUG dbcounter [-] [104737] Writer thread running {{(pid=104737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:05:04.386766 n-d-858384-13 devstack@n-api.service[104737]: DEBUG dbcounter [-] [104737] Writer thread running {{(pid=104737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:05:04.397338 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_db.sqlalchemy.engines [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:05:04.409426 n-d-858384-13 devstack@n-api.service[104736]: DEBUG dbcounter [-] [104736] Writer thread running {{(pid=104736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:05:04.497132 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.context [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8e216eb-ce73-4101-a62e-f9159a9c2bcf(cell1) {{(pid=104736) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 13:05:04.503136 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:05:04.503787 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:05:04.506407 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:05:04.507403 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:05:04.508059 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:05:04.511080 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:05:04.513938 n-d-858384-13 devstack@n-api.service[104736]: INFO dbcounter [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Registered counter for database nova_cell0 Oct 18 13:05:04.520778 n-d-858384-13 devstack@n-api.service[104736]: INFO dbcounter [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Registered counter for database nova_cell1 Oct 18 13:05:04.532236 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_db.sqlalchemy.engines [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:05:04.534174 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_db.sqlalchemy.engines [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:05:04.538353 n-d-858384-13 devstack@n-api.service[104737]: INFO dbcounter [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] Registered counter for database nova_cell0 Oct 18 13:05:04.541209 n-d-858384-13 devstack@n-api.service[104736]: DEBUG dbcounter [-] [104736] Writer thread running {{(pid=104736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:05:04.543713 n-d-858384-13 devstack@n-api.service[104736]: DEBUG dbcounter [-] [104736] Writer thread running {{(pid=104736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:05:04.546318 n-d-858384-13 devstack@n-api.service[104737]: DEBUG oslo_db.sqlalchemy.engines [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:05:04.551617 n-d-858384-13 devstack@n-api.service[104737]: DEBUG dbcounter [-] [104737] Writer thread running {{(pid=104737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:05:04.689579 n-d-858384-13 devstack@n-api.service[104736]: INFO dbcounter [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Registered counter for database nova_cell0 Oct 18 13:05:04.698680 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_db.sqlalchemy.engines [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:05:04.703717 n-d-858384-13 devstack@n-api.service[104736]: DEBUG dbcounter [-] [104736] Writer thread running {{(pid=104736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:05:04.977998 n-d-858384-13 devstack@n-api.service[104737]: WARNING keystonemiddleware.auth_token [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:05:04.985675 n-d-858384-13 devstack@n-api.service[104737]: WARNING keystonemiddleware.auth_token [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:05:05.043199 n-d-858384-13 devstack@n-api.service[104736]: WARNING keystonemiddleware.auth_token [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:05:05.051878 n-d-858384-13 devstack@n-api.service[104736]: WARNING keystonemiddleware.auth_token [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:05:05.398685 n-d-858384-13 devstack@n-api.service[104736]: WARNING keystonemiddleware.auth_token [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:05:05.405026 n-d-858384-13 devstack@n-api.service[104736]: WARNING keystonemiddleware.auth_token [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:05:05.411303 n-d-858384-13 devstack@n-api.service[104736]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae9cd6d9c0 pid: 104736 (default app) Oct 18 13:05:05.411975 n-d-858384-13 devstack@n-api.service[104737]: WARNING keystonemiddleware.auth_token [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:05:05.413446 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:05:05.414663 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001804 Oct 18 13:05:05.415340 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Tue Oct 18 13:05:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:05:05.421355 n-d-858384-13 devstack@n-api.service[104737]: WARNING keystonemiddleware.auth_token [None req-a461b303-86ea-4e13-8c1c-3d6147f35f38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:05:05.429994 n-d-858384-13 devstack@n-api.service[104737]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae9cd6d9c0 pid: 104737 (default app) Oct 18 13:06:31.408579 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:06:31.409620 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 18 13:06:31.410004 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:06:31.422978 n-d-858384-13 devstack@n-api.service[104737]: DEBUG dbcounter [-] [104737] Writing DB stats nova_api:SELECT=3 {{(pid=104737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:06:31.424479 n-d-858384-13 devstack@n-api.service[104737]: DEBUG dbcounter [-] [104737] Writing DB stats nova_cell0:SELECT=3 {{(pid=104737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:06:31.425536 n-d-858384-13 devstack@n-api.service[104737]: DEBUG dbcounter [-] [104737] Writing DB stats nova_cell1:SELECT=3 {{(pid=104737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:06:31.426550 n-d-858384-13 devstack@n-api.service[104737]: DEBUG dbcounter [-] [104737] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:06:32.526695 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-a451ca25-7f73-4d5b-8fcf-b9c4de3e9bdf admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:06:32.562209 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-a451ca25-7f73-4d5b-8fcf-b9c4de3e9bdf admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.145014 Oct 18 13:06:32.562982 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 18 13:06:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:06:35.288482 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:06:35.290086 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-9a9a0d2d-3deb-476f-a907-0d4ce547e3c3 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Oct 18 13:06:35.290760 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:06:35.842630 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-8669e8e0-919f-48cb-a0c9-0f7115b95051 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "vcpus": 1, "disk": 1, "id": "c1"}} {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:06:35.894635 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-8669e8e0-919f-48cb-a0c9-0f7115b95051 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.595679 Oct 18 13:06:35.895221 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 18 13:06:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:06:35.910234 n-d-858384-13 devstack@n-api.service[104736]: DEBUG dbcounter [-] [104736] Writing DB stats nova_api:SELECT=3 {{(pid=104736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:06:35.911178 n-d-858384-13 devstack@n-api.service[104736]: DEBUG dbcounter [-] [104736] Writing DB stats nova_cell1:SELECT=3 {{(pid=104736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:06:35.912094 n-d-858384-13 devstack@n-api.service[104736]: DEBUG dbcounter [-] [104736] Writing DB stats nova_cell0:SELECT=3 {{(pid=104736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:06:35.913031 n-d-858384-13 devstack@n-api.service[104736]: DEBUG dbcounter [-] [104736] Writing DB stats nova_cell0:SELECT=3 {{(pid=104736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:06:36.126623 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-d79f8037-4d68-45e7-9e9c-0e601097bedb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:06:36.202745 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-d79f8037-4d68-45e7-9e9c-0e601097bedb admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298656 Oct 18 13:06:36.203415 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1336 bytes} [Tue Oct 18 13:06:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:06:39.064321 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-8669e8e0-919f-48cb-a0c9-0f7115b95051 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:06:39.065486 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-8669e8e0-919f-48cb-a0c9-0f7115b95051 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 18 13:06:39.065968 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:06:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:06:40.098752 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-3649948d-8c93-481f-a9bd-dc631c19ac82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "ram": 512, "swap": 0}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:06:40.166677 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-3649948d-8c93-481f-a9bd-dc631c19ac82 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.094231 Oct 18 13:06:40.167461 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 18 13:06:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:06:40.183892 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-314b65c2-4b77-47b6-9a89-d4b3aed53620 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:06:40.256259 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-314b65c2-4b77-47b6-9a89-d4b3aed53620 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078916 Oct 18 13:06:40.257147 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1336 bytes} [Tue Oct 18 13:06:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:06:43.594074 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-3649948d-8c93-481f-a9bd-dc631c19ac82 admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:06:43.595144 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-3649948d-8c93-481f-a9bd-dc631c19ac82 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Oct 18 13:06:43.602959 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:06:43 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:06:44.195022 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-8b13f953-1fe8-4e40-a87d-1e79e558bf80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 1024, "id": "d2"}} {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:06:44.220118 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-8b13f953-1fe8-4e40-a87d-1e79e558bf80 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.615579 Oct 18 13:06:44.220918 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 18 13:06:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:06:44.233048 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-78411313-9af0-48b8-8858-15f31c48dbd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:06:44.264320 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-78411313-9af0-48b8-8858-15f31c48dbd2 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034571 Oct 18 13:06:44.265565 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1336 bytes} [Tue Oct 18 13:06:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:06:47.483372 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-8b13f953-1fe8-4e40-a87d-1e79e558bf80 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:06:47.484323 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-8b13f953-1fe8-4e40-a87d-1e79e558bf80 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002565 Oct 18 13:06:47.484728 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:06:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:06:47.977967 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-71c4fc93-0ebc-46c9-b3ce-92ece32436bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:06:48.001355 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-71c4fc93-0ebc-46c9-b3ce-92ece32436bc admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.509878 Oct 18 13:06:48.002048 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 18 13:06:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:06:48.014771 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-83c91c87-b82e-4c84-b702-0337c5c8c26f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:06:48.046412 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-83c91c87-b82e-4c84-b702-0337c5c8c26f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035190 Oct 18 13:06:48.049582 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1336 bytes} [Tue Oct 18 13:06:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:06:51.167398 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-71c4fc93-0ebc-46c9-b3ce-92ece32436bc admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:06:51.168417 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-71c4fc93-0ebc-46c9-b3ce-92ece32436bc admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 18 13:06:51.169022 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:06:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:06:51.704941 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-dc6b27e3-71cf-48a6-854f-de3fb2ff0e6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 20, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "name": "ds4G"}} {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:06:51.739594 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-dc6b27e3-71cf-48a6-854f-de3fb2ff0e6e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.562364 Oct 18 13:06:51.740149 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 18 13:06:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:06:51.753770 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-d2be240b-b011-4045-8516-9e585e7beb03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:06:51.800859 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-d2be240b-b011-4045-8516-9e585e7beb03 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051330 Oct 18 13:06:51.801735 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1336 bytes} [Tue Oct 18 13:06:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:06:54.731087 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-dc6b27e3-71cf-48a6-854f-de3fb2ff0e6e admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:06:54.732848 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-dc6b27e3-71cf-48a6-854f-de3fb2ff0e6e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001828 Oct 18 13:06:54.733828 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:06:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:06:55.288760 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-9410a52b-286a-440b-a0e2-b5404fd0167b admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:06:55.330391 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-9410a52b-286a-440b-a0e2-b5404fd0167b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.590211 Oct 18 13:06:55.331698 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 18 13:06:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:06:58.155349 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-dc6b27e3-71cf-48a6-854f-de3fb2ff0e6e admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:06:58.156331 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-dc6b27e3-71cf-48a6-854f-de3fb2ff0e6e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002245 Oct 18 13:06:58.156895 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:06:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:06:58.677231 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-d0a9400f-32bf-4c8f-b02e-69a1bc4b80f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "swap": 0, "id": "1"}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:06:58.701916 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-d0a9400f-32bf-4c8f-b02e-69a1bc4b80f7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.537863 Oct 18 13:06:58.702966 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 18 13:06:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:06:58.720722 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-af58832e-c006-4c8a-9194-50ad62647077 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:06:58.751987 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-af58832e-c006-4c8a-9194-50ad62647077 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036115 Oct 18 13:06:58.753222 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1333 bytes} [Tue Oct 18 13:06:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:07:01.562607 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-d0a9400f-32bf-4c8f-b02e-69a1bc4b80f7 admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:01.563622 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-d0a9400f-32bf-4c8f-b02e-69a1bc4b80f7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 18 13:07:01.564031 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:07:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:07:02.056972 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-52f4af90-81bd-4f9f-95bd-ef6ba52e5d66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "disk": 20}} {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:07:02.063813 n-d-858384-13 devstack@n-api.service[104737]: DEBUG dbcounter [-] [104737] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:02.086836 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-52f4af90-81bd-4f9f-95bd-ef6ba52e5d66 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.515612 Oct 18 13:07:02.091993 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 18 13:07:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:07:02.111841 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-5146c7c5-7f0a-488d-8e6c-efb15e6ba8dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:07:02.153626 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-5146c7c5-7f0a-488d-8e6c-efb15e6ba8dd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049676 Oct 18 13:07:02.155612 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1333 bytes} [Tue Oct 18 13:07:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:07:05.264448 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-52f4af90-81bd-4f9f-95bd-ef6ba52e5d66 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:05.266308 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-52f4af90-81bd-4f9f-95bd-ef6ba52e5d66 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002248 Oct 18 13:07:05.266991 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:07:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:07:05.775297 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-33863c6a-3f4d-4474-9b6b-0d4fecbf79e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:07:05.940186 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-33863c6a-3f4d-4474-9b6b-0d4fecbf79e4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.666306 Oct 18 13:07:05.940859 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 18 13:07:05 2022] POST /compute/v2.1/flavors => generated 406 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:07:05.962934 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-aad81841-fb5f-4973-9e2f-74b43cb303c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:07:06.007771 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-aad81841-fb5f-4973-9e2f-74b43cb303c1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052049 Oct 18 13:07:06.009988 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1333 bytes} [Tue Oct 18 13:07:05 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:07:08.837234 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-33863c6a-3f4d-4474-9b6b-0d4fecbf79e4 admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:08.838994 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-33863c6a-3f4d-4474-9b6b-0d4fecbf79e4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Oct 18 13:07:08.845605 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:07:08 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:07:09.369223 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-33a6c0a3-9565-4b3c-afb1-d7561d2c471f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192}} {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:07:09.396526 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-33a6c0a3-9565-4b3c-afb1-d7561d2c471f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.548633 Oct 18 13:07:09.401460 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 18 13:07:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:07:09.410289 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-cf93739e-a78e-4b1d-a94f-b2b20c26263c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:07:09.415280 n-d-858384-13 devstack@n-api.service[104736]: DEBUG dbcounter [-] [104736] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=104736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:09.445092 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-cf93739e-a78e-4b1d-a94f-b2b20c26263c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038254 Oct 18 13:07:09.456204 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1333 bytes} [Tue Oct 18 13:07:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:07:12.204909 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-33a6c0a3-9565-4b3c-afb1-d7561d2c471f admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:12.207373 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-33a6c0a3-9565-4b3c-afb1-d7561d2c471f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 Oct 18 13:07:12.207373 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:07:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:07:12.692100 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-af8a9579-8030-4848-b9a5-e2f96a517a11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:07:12.717816 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-af8a9579-8030-4848-b9a5-e2f96a517a11 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.504705 Oct 18 13:07:12.719851 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1283 bytes} [Tue Oct 18 13:07:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:07:12.736432 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-b20dcc7b-200f-4921-8c66-35b19faf534b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:07:12.777511 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-b20dcc7b-200f-4921-8c66-35b19faf534b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047961 Oct 18 13:07:12.779987 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1333 bytes} [Tue Oct 18 13:07:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:07:34.134444 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-af8a9579-8030-4848-b9a5-e2f96a517a11 admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:34.135452 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-af8a9579-8030-4848-b9a5-e2f96a517a11 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 18 13:07:34.135856 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:07:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:07:34.147611 n-d-858384-13 devstack@n-api.service[104737]: DEBUG dbcounter [-] [104737] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=104737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:34.559153 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-ad9975f4-f164-4297-a3a9-f5ccc59c4cd8 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:34.579358 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-ad9975f4-f164-4297-a3a9-f5ccc59c4cd8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.436183 Oct 18 13:07:34.579909 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 18 13:07:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:07:35.965390 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-af8a9579-8030-4848-b9a5-e2f96a517a11 admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:35.966735 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-af8a9579-8030-4848-b9a5-e2f96a517a11 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Oct 18 13:07:35.966985 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 18 13:07:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:07:36.614347 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-29707a3d-62b9-4b56-9985-32aa85dc78e8 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:36.623180 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.wsgi [None req-29707a3d-62b9-4b56-9985-32aa85dc78e8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-29707a3d-62b9-4b56-9985-32aa85dc78e8 admin admin] Request method failure captured: Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: Accept: application/json Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: Accept-Encoding: gzip, deflate Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: Connection: keep-alive Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: Content-Length: 0 Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: Host: 10.222.0.40 Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: Openstack-Api-Version: compute 2.92 Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: Openstack-System-Scope: None Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: User-Agent: python-novaclient Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: X-Auth-Token: gAAAAABjTqUXRnj4PBoey0i_9HHgQgVSQDuDTWJ4F_rueeYUTrKhXIcU-ez7RStyVuQ8RW1rpInS1dVh-hMD_UU6DDxEKo3JI7zY1pQ6n9US-VFF7vS4H4rU4VQEHAU71wUzSSCO4dV_kncKwIR8N5C-PyXe2BbVCT0d2KJA2nGE64kevTotQwQ Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: X-Domain-Id: None Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: X-Domain-Name: None Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: X-Identity-Status: Confirmed Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: X-Is-Admin-Project: True Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: X-Project-Domain-Id: default Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: X-Project-Domain-Name: Default Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: X-Project-Id: 5811867ddb0e4f008ed12d2894eaaf82 Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: X-Project-Name: admin Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: X-Role: admin,member,reader Oct 18 13:07:36.627704 n-d-858384-13 devstack@n-api.service[104737]: X-Roles: admin,member,reader Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5811867ddb0e4f008ed12d2894eaaf82"}]}] Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: X-Tenant: admin Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: X-Tenant-Id: 5811867ddb0e4f008ed12d2894eaaf82 Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: X-Tenant-Name: admin Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: X-User: admin Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: X-User-Domain-Id: default Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: X-User-Domain-Name: Default Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: X-User-Id: 183e55f445e845559d6d0ead42aa9be3 Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: X-User-Name: admin Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: method: > Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: exception: Flavor 42 could not be found. Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: action_args: {'id': '42'} Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:07:36.629431 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:07:36.630357 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:36.631511 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-29707a3d-62b9-4b56-9985-32aa85dc78e8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:07:36.632695 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-29707a3d-62b9-4b56-9985-32aa85dc78e8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.449185 Oct 18 13:07:36.632695 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 18 13:07:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:07:36.642145 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-c15ae62a-03e0-4186-a29f-544c2ea53325 admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:36.646258 n-d-858384-13 devstack@n-api.service[104736]: DEBUG dbcounter [-] [104736] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=104736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:07:36.667201 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-c15ae62a-03e0-4186-a29f-544c2ea53325 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028702 Oct 18 13:07:36.667773 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Oct 18 13:07:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:07:36.685913 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-b5957d6d-597a-4145-95b0-c0f73e0a7249 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:36.709117 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-b5957d6d-597a-4145-95b0-c0f73e0a7249 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027951 Oct 18 13:07:36.709719 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Oct 18 13:07:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:07:36.720364 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-7a9883b2-0801-4ba8-9a7d-7da2402274ac admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:36.726637 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.wsgi [None req-7a9883b2-0801-4ba8-9a7d-7da2402274ac admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-7a9883b2-0801-4ba8-9a7d-7da2402274ac admin admin] Request method failure captured: Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: Accept: application/json Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: Accept-Encoding: gzip, deflate Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: Connection: keep-alive Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: Content-Length: 0 Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: Host: 10.222.0.40 Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: Openstack-Api-Version: compute 2.92 Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: Openstack-System-Scope: None Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: User-Agent: python-novaclient Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: X-Auth-Token: gAAAAABjTqUXRnj4PBoey0i_9HHgQgVSQDuDTWJ4F_rueeYUTrKhXIcU-ez7RStyVuQ8RW1rpInS1dVh-hMD_UU6DDxEKo3JI7zY1pQ6n9US-VFF7vS4H4rU4VQEHAU71wUzSSCO4dV_kncKwIR8N5C-PyXe2BbVCT0d2KJA2nGE64kevTotQwQ Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: X-Domain-Id: None Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: X-Domain-Name: None Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: X-Identity-Status: Confirmed Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: X-Is-Admin-Project: True Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: X-Project-Domain-Id: default Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: X-Project-Domain-Name: Default Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: X-Project-Id: 5811867ddb0e4f008ed12d2894eaaf82 Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: X-Project-Name: admin Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: X-Role: admin,member,reader Oct 18 13:07:36.730193 n-d-858384-13 devstack@n-api.service[104736]: X-Roles: admin,member,reader Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5811867ddb0e4f008ed12d2894eaaf82"}]}] Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: X-Tenant: admin Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: X-Tenant-Id: 5811867ddb0e4f008ed12d2894eaaf82 Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: X-Tenant-Name: admin Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: X-User: admin Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: X-User-Domain-Id: default Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: X-User-Domain-Name: Default Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: X-User-Id: 183e55f445e845559d6d0ead42aa9be3 Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: X-User-Name: admin Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: method: > Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: exception: Flavor 42 could not be found. Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: action_args: {'id': '42'} Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:07:36.731540 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:07:36.732938 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:36.734157 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-7a9883b2-0801-4ba8-9a7d-7da2402274ac admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:07:36.735374 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-7a9883b2-0801-4ba8-9a7d-7da2402274ac admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015920 Oct 18 13:07:36.735374 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 18 13:07:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:07:38.021867 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-b5957d6d-597a-4145-95b0-c0f73e0a7249 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:38.022882 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-b5957d6d-597a-4145-95b0-c0f73e0a7249 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 18 13:07:38.023308 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 18 13:07:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:07:38.586882 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-9c921fbd-918d-497b-92b7-049afafba11d admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:38.592692 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.wsgi [None req-9c921fbd-918d-497b-92b7-049afafba11d admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-9c921fbd-918d-497b-92b7-049afafba11d admin admin] Request method failure captured: Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: Accept: application/json Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: Accept-Encoding: gzip, deflate Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: Connection: keep-alive Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: Content-Length: 0 Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: Host: 10.222.0.40 Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: Openstack-Api-Version: compute 2.92 Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: Openstack-System-Scope: None Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: User-Agent: python-novaclient Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: X-Auth-Token: gAAAAABjTqUZ6ANXE2oRBTikdwhnGE3mkdvlwsh8tXv5lrFMxZghvKjP0qw-Kc2pTpbPUypGMuOWf24NiECXqHdtCaqwKDeaMwjWCv5YTI5P64Bs5J2-g3vqXw7nnp3NnU4GVqj23xEeNbdAWr3ZueqEuva2pBY4_QtX6-sxW6pC6Rl8RCUBcxA Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: X-Domain-Id: None Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: X-Domain-Name: None Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: X-Identity-Status: Confirmed Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: X-Is-Admin-Project: True Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: X-Project-Domain-Id: default Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: X-Project-Domain-Name: Default Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: X-Project-Id: 5811867ddb0e4f008ed12d2894eaaf82 Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: X-Project-Name: admin Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: X-Role: admin,member,reader Oct 18 13:07:38.595754 n-d-858384-13 devstack@n-api.service[104736]: X-Roles: admin,member,reader Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5811867ddb0e4f008ed12d2894eaaf82"}]}] Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: X-Tenant: admin Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: X-Tenant-Id: 5811867ddb0e4f008ed12d2894eaaf82 Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: X-Tenant-Name: admin Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: X-User: admin Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: X-User-Domain-Id: default Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: X-User-Domain-Name: Default Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: X-User-Id: 183e55f445e845559d6d0ead42aa9be3 Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: X-User-Name: admin Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: method: > Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: exception: Flavor 84 could not be found. Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: action_args: {'id': '84'} Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:07:38.597350 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:07:38.598782 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:38.600179 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-9c921fbd-918d-497b-92b7-049afafba11d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:07:38.601432 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-9c921fbd-918d-497b-92b7-049afafba11d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.430945 Oct 18 13:07:38.601432 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 18 13:07:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:07:38.605968 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-8747be7c-ad5a-4bf9-9fe2-e6e85fe795b1 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:38.622692 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-8747be7c-ad5a-4bf9-9fe2-e6e85fe795b1 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019765 Oct 18 13:07:38.623643 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Oct 18 13:07:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:07:38.633689 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-80926478-0a14-4082-9ab2-25fd36922f62 admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:38.649776 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-80926478-0a14-4082-9ab2-25fd36922f62 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019603 Oct 18 13:07:38.650333 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Oct 18 13:07:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:07:38.660455 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-9ee8d92b-065e-4448-b881-b64eee23bc95 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:38.665785 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.wsgi [None req-9ee8d92b-065e-4448-b881-b64eee23bc95 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-9ee8d92b-065e-4448-b881-b64eee23bc95 admin admin] Request method failure captured: Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: Accept: application/json Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: Accept-Encoding: gzip, deflate Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: Connection: keep-alive Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: Content-Length: 0 Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: Host: 10.222.0.40 Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: Openstack-Api-Version: compute 2.92 Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: Openstack-System-Scope: None Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: User-Agent: python-novaclient Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: X-Auth-Token: gAAAAABjTqUZ6ANXE2oRBTikdwhnGE3mkdvlwsh8tXv5lrFMxZghvKjP0qw-Kc2pTpbPUypGMuOWf24NiECXqHdtCaqwKDeaMwjWCv5YTI5P64Bs5J2-g3vqXw7nnp3NnU4GVqj23xEeNbdAWr3ZueqEuva2pBY4_QtX6-sxW6pC6Rl8RCUBcxA Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: X-Domain-Id: None Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: X-Domain-Name: None Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: X-Identity-Status: Confirmed Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: X-Is-Admin-Project: True Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: X-Project-Domain-Id: default Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: X-Project-Domain-Name: Default Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: X-Project-Id: 5811867ddb0e4f008ed12d2894eaaf82 Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: X-Project-Name: admin Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: X-Role: admin,member,reader Oct 18 13:07:38.667592 n-d-858384-13 devstack@n-api.service[104737]: X-Roles: admin,member,reader Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5811867ddb0e4f008ed12d2894eaaf82"}]}] Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: X-Tenant: admin Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: X-Tenant-Id: 5811867ddb0e4f008ed12d2894eaaf82 Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: X-Tenant-Name: admin Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: X-User: admin Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: X-User-Domain-Id: default Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: X-User-Domain-Name: Default Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: X-User-Id: 183e55f445e845559d6d0ead42aa9be3 Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: X-User-Name: admin Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: method: > Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: exception: Flavor 84 could not be found. Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: action_args: {'id': '84'} Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:07:38.668897 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:07:38.669925 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:38.670977 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-9ee8d92b-065e-4448-b881-b64eee23bc95 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:07:38.673014 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-9ee8d92b-065e-4448-b881-b64eee23bc95 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012161 Oct 18 13:07:38.673014 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 18 13:07:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:07:39.990633 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-80926478-0a14-4082-9ab2-25fd36922f62 admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:39.991649 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-80926478-0a14-4082-9ab2-25fd36922f62 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 18 13:07:39.992053 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 18 13:07:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:07:40.578333 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-d041d385-7d46-4ab5-8e12-0375dae71b96 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:40.584431 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.wsgi [None req-d041d385-7d46-4ab5-8e12-0375dae71b96 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-d041d385-7d46-4ab5-8e12-0375dae71b96 admin admin] Request method failure captured: Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: Accept: application/json Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: Accept-Encoding: gzip, deflate Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: Connection: keep-alive Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: Content-Length: 0 Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: Host: 10.222.0.40 Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: Openstack-Api-Version: compute 2.92 Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: Openstack-System-Scope: None Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: User-Agent: python-novaclient Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: X-Auth-Token: gAAAAABjTqUbCqzrH1iRW_gD1mLqNPgCIpcVBMs1aajaRtpvYCLw-CMA3KWV63WK7WbkpRcR8ELGFxINUasZ35UpJEPJtDifRDOwIub44TzYV7bnRS7Mg43NQ9zvhUQjk81VUxi2DdlRYNzRDHtSegz4Iew_53V-0qYjTdgitX_dBeP3qZEh1v0 Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: X-Domain-Id: None Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: X-Domain-Name: None Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: X-Identity-Status: Confirmed Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: X-Is-Admin-Project: True Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: X-Project-Domain-Id: default Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: X-Project-Domain-Name: Default Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: X-Project-Id: 5811867ddb0e4f008ed12d2894eaaf82 Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: X-Project-Name: admin Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: X-Role: admin,member,reader Oct 18 13:07:40.585998 n-d-858384-13 devstack@n-api.service[104737]: X-Roles: admin,member,reader Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5811867ddb0e4f008ed12d2894eaaf82"}]}] Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: X-Tenant: admin Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: X-Tenant-Id: 5811867ddb0e4f008ed12d2894eaaf82 Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: X-Tenant-Name: admin Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: X-User: admin Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: X-User-Domain-Id: default Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: X-User-Domain-Name: Default Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: X-User-Id: 183e55f445e845559d6d0ead42aa9be3 Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: X-User-Name: admin Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: method: > Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: exception: Flavor 451 could not be found. Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: action_args: {'id': '451'} Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:07:40.587568 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:07:40.588452 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: ERROR nova.api.openstack.wsgi Oct 18 13:07:40.589732 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-d041d385-7d46-4ab5-8e12-0375dae71b96 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:07:40.591625 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-d041d385-7d46-4ab5-8e12-0375dae71b96 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.457968 Oct 18 13:07:40.591625 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 18 13:07:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 459 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:07:40.599724 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-e61302c5-5619-46a2-9d8b-ac8541327bfb admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:40.614768 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-e61302c5-5619-46a2-9d8b-ac8541327bfb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018611 Oct 18 13:07:40.615327 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Oct 18 13:07:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:07:40.625610 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:40.644723 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022726 Oct 18 13:07:40.645334 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Tue Oct 18 13:07:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:07:40.659532 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-8cea4217-131d-41d0-9a5f-7ae4d62df73d admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:40.667636 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.wsgi [None req-8cea4217-131d-41d0-9a5f-7ae4d62df73d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-8cea4217-131d-41d0-9a5f-7ae4d62df73d admin admin] Request method failure captured: Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: Accept: application/json Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: Accept-Encoding: gzip, deflate Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: Connection: keep-alive Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: Content-Length: 0 Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: Host: 10.222.0.40 Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: Openstack-Api-Version: compute 2.92 Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: Openstack-System-Scope: None Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: User-Agent: python-novaclient Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: X-Auth-Token: gAAAAABjTqUbCqzrH1iRW_gD1mLqNPgCIpcVBMs1aajaRtpvYCLw-CMA3KWV63WK7WbkpRcR8ELGFxINUasZ35UpJEPJtDifRDOwIub44TzYV7bnRS7Mg43NQ9zvhUQjk81VUxi2DdlRYNzRDHtSegz4Iew_53V-0qYjTdgitX_dBeP3qZEh1v0 Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: X-Domain-Id: None Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: X-Domain-Name: None Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: X-Identity-Status: Confirmed Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: X-Is-Admin-Project: True Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: X-Openstack-Nova-Api-Version: 2.92 Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: X-Project-Domain-Id: default Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: X-Project-Domain-Name: Default Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: X-Project-Id: 5811867ddb0e4f008ed12d2894eaaf82 Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: X-Project-Name: admin Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: X-Role: admin,member,reader Oct 18 13:07:40.670422 n-d-858384-13 devstack@n-api.service[104736]: X-Roles: admin,member,reader Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5811867ddb0e4f008ed12d2894eaaf82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5811867ddb0e4f008ed12d2894eaaf82"}]}] Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: X-Tenant: admin Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: X-Tenant-Id: 5811867ddb0e4f008ed12d2894eaaf82 Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: X-Tenant-Name: admin Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: X-User: admin Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: X-User-Domain-Id: default Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: X-User-Domain-Name: Default Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: X-User-Id: 183e55f445e845559d6d0ead42aa9be3 Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: X-User-Name: admin Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: method: > Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: exception: Flavor 451 could not be found. Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: action_args: {'id': '451'} Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:07:40.672008 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:07:40.673212 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: ERROR nova.api.openstack.wsgi Oct 18 13:07:40.674494 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-8cea4217-131d-41d0-9a5f-7ae4d62df73d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:07:40.675721 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-8cea4217-131d-41d0-9a5f-7ae4d62df73d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.019973 Oct 18 13:07:40.675721 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 18 13:07:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:07:42.011413 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:42.013081 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004354 Oct 18 13:07:42.013660 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 18 13:07:42 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:07:42.562828 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-0bb0b87a-a8cc-49b0-8878-e3ffff7fd3fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:07:42.583762 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-0bb0b87a-a8cc-49b0-8878-e3ffff7fd3fe admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.430603 Oct 18 13:07:42.584306 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Tue Oct 18 13:07:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:07:43.984613 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:43.985850 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001693 Oct 18 13:07:43.986295 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 18 13:07:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:07:44.539302 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-61b7dfb1-8109-4070-83fd-c32caa5e03ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:07:44.559154 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-61b7dfb1-8109-4070-83fd-c32caa5e03ff admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.432606 Oct 18 13:07:44.560257 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Tue Oct 18 13:07:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:07:45.860266 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:45.861309 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 18 13:07:45.861716 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 18 13:07:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:07:46.441450 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-554375c6-39c0-4336-89af-73fce5511e21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:07:46.462291 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-554375c6-39c0-4336-89af-73fce5511e21 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.461217 Oct 18 13:07:46.462841 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Tue Oct 18 13:07:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:07:47.731187 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:47.732780 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002045 Oct 18 13:07:47.733276 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 18 13:07:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:07:48.288650 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-21fb299c-7c0c-4654-a685-37aab78503e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:07:48.308392 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-21fb299c-7c0c-4654-a685-37aab78503e6 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.434884 Oct 18 13:07:48.308949 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Tue Oct 18 13:07:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:07:49.637040 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:49.638090 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Oct 18 13:07:49.638503 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 18 13:07:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:07:50.213135 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-474ea511-5bfa-43a7-9e23-4b68b74799fc admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:07:50.234617 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-474ea511-5bfa-43a7-9e23-4b68b74799fc admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.456045 Oct 18 13:07:50.235162 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Tue Oct 18 13:07:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:08:49.021698 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:08:49.022614 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-4be28b31-71a2-4237-8931-ee06df1d8672 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 18 13:08:49.023015 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 931 bytes} [Tue Oct 18 13:08:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:08:49.035215 n-d-858384-13 devstack@n-api.service[104736]: DEBUG dbcounter [-] [104736] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:08:49.446184 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-0cabbafa-6d4b-4206-80b8-6c2114d4c320 admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:08:49.467620 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-0cabbafa-6d4b-4206-80b8-6c2114d4c320 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.436851 Oct 18 13:08:49.468173 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 18 13:08:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:08:49.491119 n-d-858384-13 devstack@n-api.service[104737]: DEBUG dbcounter [-] [104737] Writing DB stats nova_api:SELECT=14 {{(pid=104737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:08:49.495111 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-2b52cd65-b991-44ee-822d-b89f3890cbeb admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:08:49.503406 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-2b52cd65-b991-44ee-822d-b89f3890cbeb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013911 Oct 18 13:08:49.503966 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1283 bytes} [Tue Oct 18 13:08:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:08:49.516049 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-339483b9-12e6-4712-8805-2fee11db8af7 admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:08:49.523477 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-339483b9-12e6-4712-8805-2fee11db8af7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011122 Oct 18 13:08:49.524015 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1286 bytes} [Tue Oct 18 13:08:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:08:49.536201 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-22cbbaeb-93e6-4206-81d2-7296341c57e4 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:08:49.545685 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-22cbbaeb-93e6-4206-81d2-7296341c57e4 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013080 Oct 18 13:08:49.546256 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1286 bytes} [Tue Oct 18 13:08:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:08:49.558849 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-2f949e3e-585b-4e12-8f3b-c5203eb7376f admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:08:49.566852 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-2f949e3e-585b-4e12-8f3b-c5203eb7376f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011795 Oct 18 13:08:49.567402 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1283 bytes} [Tue Oct 18 13:08:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:14:22.561466 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-22cbbaeb-93e6-4206-81d2-7296341c57e4 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:22.562658 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-22cbbaeb-93e6-4206-81d2-7296341c57e4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Oct 18 13:14:22.563067 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 18 13:14:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:14:22.704866 n-d-858384-13 devstack@n-api.service[104736]: DEBUG dbcounter [-] [104736] Writing DB stats nova_api:SELECT=6 {{(pid=104736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:14:22.850830 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-b020d579-8c92-4e3f-8e66-318acd3412b2 admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:22.855565 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-b020d579-8c92-4e3f-8e66-318acd3412b2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:14:22.856033 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-b020d579-8c92-4e3f-8e66-318acd3412b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:14:22.856458 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-b020d579-8c92-4e3f-8e66-318acd3412b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:14:22.857156 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-b020d579-8c92-4e3f-8e66-318acd3412b2 admin admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:14:22.857616 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-b020d579-8c92-4e3f-8e66-318acd3412b2 admin admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:14:22.858026 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-b020d579-8c92-4e3f-8e66-318acd3412b2 admin admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:14:22.896527 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-b020d579-8c92-4e3f-8e66-318acd3412b2 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.192943 Oct 18 13:14:22.897279 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 18 13:14:22 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:14:23.990613 n-d-858384-13 devstack@n-api.service[104737]: DEBUG nova.api.openstack.wsgi [None req-22cbbaeb-93e6-4206-81d2-7296341c57e4 admin admin] Calling method '>' {{(pid=104737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:23.991626 n-d-858384-13 devstack@n-api.service[104737]: INFO nova.api.openstack.requestlog [None req-22cbbaeb-93e6-4206-81d2-7296341c57e4 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 18 13:14:23.992033 n-d-858384-13 devstack@n-api.service[104737]: [pid: 104737|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Tue Oct 18 13:14:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:14:24.184633 n-d-858384-13 devstack@n-api.service[104736]: DEBUG nova.api.openstack.wsgi [None req-39aea708-e061-45f5-90f4-38028fb00179 admin admin] Calling method '>' {{(pid=104736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:14:24.188133 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-39aea708-e061-45f5-90f4-38028fb00179 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:14:24.188599 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-39aea708-e061-45f5-90f4-38028fb00179 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:14:24.189017 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-39aea708-e061-45f5-90f4-38028fb00179 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:14:24.189748 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-39aea708-e061-45f5-90f4-38028fb00179 admin admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:14:24.190185 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-39aea708-e061-45f5-90f4-38028fb00179 admin admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:14:24.190594 n-d-858384-13 devstack@n-api.service[104736]: DEBUG oslo_concurrency.lockutils [None req-39aea708-e061-45f5-90f4-38028fb00179 admin admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:14:24.214814 n-d-858384-13 devstack@n-api.service[104736]: INFO nova.api.openstack.requestlog [None req-39aea708-e061-45f5-90f4-38028fb00179 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.084386 Oct 18 13:14:24.215371 n-d-858384-13 devstack@n-api.service[104736]: [pid: 104736|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 18 13:14:24 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:15:12.581513 n-d-858384-13 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 18 13:15:12.582128 n-d-858384-13 devstack@n-api.service[104735]: Tue Oct 18 13:15:12 2022 - graceful shutdown triggered... Oct 18 13:15:12.582600 n-d-858384-13 devstack@n-api.service[104737]: Gracefully killing worker 2 (pid: 104737)... Oct 18 13:15:12.582966 n-d-858384-13 devstack@n-api.service[104736]: Gracefully killing worker 1 (pid: 104736)... Oct 18 13:15:12.707930 n-d-858384-13 devstack@n-api.service[104737]: DEBUG dbcounter [-] [104737] Writing DB stats nova_api:SELECT=4 {{(pid=104737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:13.582454 n-d-858384-13 devstack@n-api.service[104735]: worker 1 buried after 1 seconds Oct 18 13:15:13.582454 n-d-858384-13 devstack@n-api.service[104735]: worker 2 buried after 1 seconds Oct 18 13:15:13.582454 n-d-858384-13 devstack@n-api.service[104735]: goodbye to uWSGI. Oct 18 13:15:13.583990 n-d-858384-13 systemd[1]: devstack@n-api.service: Succeeded. Oct 18 13:15:13.584557 n-d-858384-13 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 18 13:15:13.587430 n-d-858384-13 systemd[1]: Starting Devstack devstack@n-api.service... Oct 18 13:15:13.600948 n-d-858384-13 devstack@n-api.service[120591]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 18 13:15:13.628645 n-d-858384-13 devstack@n-api.service[120591]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 18 13:15:13 2022] *** Oct 18 13:15:13.630472 n-d-858384-13 devstack@n-api.service[120591]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 13:15:13.630657 n-d-858384-13 devstack@n-api.service[120591]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 13:15:13.630820 n-d-858384-13 devstack@n-api.service[120591]: nodename: n-d-858384-13 Oct 18 13:15:13.630973 n-d-858384-13 devstack@n-api.service[120591]: machine: x86_64 Oct 18 13:15:13.631111 n-d-858384-13 devstack@n-api.service[120591]: clock source: unix Oct 18 13:15:13.631253 n-d-858384-13 devstack@n-api.service[120591]: pcre jit disabled Oct 18 13:15:13.631419 n-d-858384-13 devstack@n-api.service[120591]: detected number of CPU cores: 4 Oct 18 13:15:13.631561 n-d-858384-13 devstack@n-api.service[120591]: current working directory: / Oct 18 13:15:13.631721 n-d-858384-13 devstack@n-api.service[120591]: detected binary path: /usr/bin/uwsgi-core Oct 18 13:15:13.631881 n-d-858384-13 devstack@n-api.service[120591]: your processes number limit is 47680 Oct 18 13:15:13.632031 n-d-858384-13 devstack@n-api.service[120591]: your memory page size is 4096 bytes Oct 18 13:15:13.632173 n-d-858384-13 devstack@n-api.service[120591]: detected max file descriptor number: 2048 Oct 18 13:15:13.632316 n-d-858384-13 devstack@n-api.service[120591]: lock engine: pthread robust mutexes Oct 18 13:15:13.632648 n-d-858384-13 devstack@n-api.service[120591]: thunder lock: enabled Oct 18 13:15:13.633013 n-d-858384-13 devstack@n-api.service[120591]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 18 13:15:13.633274 n-d-858384-13 devstack@n-api.service[120591]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 18 13:15:13.674000 n-d-858384-13 devstack@n-api.service[120591]: Python main interpreter initialized at 0x55d58754e9c0 Oct 18 13:15:13.674000 n-d-858384-13 devstack@n-api.service[120591]: python threads support enabled Oct 18 13:15:13.674000 n-d-858384-13 devstack@n-api.service[120591]: your server socket listen backlog is limited to 100 connections Oct 18 13:15:13.674000 n-d-858384-13 devstack@n-api.service[120591]: your mercy for graceful operations on workers is 90 seconds Oct 18 13:15:13.674771 n-d-858384-13 devstack@n-api.service[120591]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 13:15:13.674771 n-d-858384-13 devstack@n-api.service[120591]: *** Operational MODE: preforking *** Oct 18 13:15:13.674960 n-d-858384-13 devstack@n-api.service[120591]: *** uWSGI is running in multiple interpreter mode *** Oct 18 13:15:13.674960 n-d-858384-13 devstack@n-api.service[120591]: spawned uWSGI master process (pid: 120591) Oct 18 13:15:13.675171 n-d-858384-13 systemd[1]: Started Devstack devstack@n-api.service. Oct 18 13:15:13.675897 n-d-858384-13 devstack@n-api.service[120591]: spawned uWSGI worker 1 (pid: 120611, cores: 1) Oct 18 13:15:13.677025 n-d-858384-13 devstack@n-api.service[120591]: spawned uWSGI worker 2 (pid: 120612, cores: 1) Oct 18 13:15:13.677155 n-d-858384-13 devstack@n-api.service[120591]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 13:15:14.345036 n-d-858384-13 devstack@n-api.service[120612]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 13:15:14.345701 n-d-858384-13 devstack@n-api.service[120611]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 18 13:15:15.514735 n-d-858384-13 devstack@n-api.service[120612]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:15:15.514735 n-d-858384-13 devstack@n-api.service[120612]: from cryptography.utils import int_from_bytes Oct 18 13:15:15.516241 n-d-858384-13 devstack@n-api.service[120612]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:15:15.516241 n-d-858384-13 devstack@n-api.service[120612]: from cryptography.utils import int_from_bytes Oct 18 13:15:15.521772 n-d-858384-13 devstack@n-api.service[120611]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:15:15.521772 n-d-858384-13 devstack@n-api.service[120611]: from cryptography.utils import int_from_bytes Oct 18 13:15:15.522302 n-d-858384-13 devstack@n-api.service[120611]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 13:15:15.522302 n-d-858384-13 devstack@n-api.service[120611]: from cryptography.utils import int_from_bytes Oct 18 13:15:17.992384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 13:15:17.992999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 13:15:17.993198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 13:15:17.993563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 13:15:17.993819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 13:15:17.994206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.994527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.994847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.995320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.995652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.995965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.996287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.996604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.996930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.997209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.997521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.997843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-13 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.998168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.998472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.998777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.999091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.999391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:17.999757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.000074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.000698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.001148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.001489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.001965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.002141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.002436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.002741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.003127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.003363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.003684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.004059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.004464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-13 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.004781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.005087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.005421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.005834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.006144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.006446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.006762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.007080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.007381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.007703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.008020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.008331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.008643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.008941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.009265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.009570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.009881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.010183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.010484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.010730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.011015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 13:15:18.011477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.011675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 13:15:18.011862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.011862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.012123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 13:15:18.012252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.012391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 13:15:18.012529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.012671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 13:15:18.012810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.012810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.013071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.013234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.013378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.013524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.013661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.013800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.013937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.014078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.014223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.014396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.014534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.014675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.014806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.014936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.015074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.015212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.015374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.015556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.015698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.015847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.015986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.016145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.016283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.016411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-13 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.016549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.016693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.016928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.017144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.017341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.017541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.017674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.017819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.017954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.018095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.018238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.018370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.018500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.018650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.018793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.018992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.019147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.019301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.019450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.019604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.019747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.019891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.020023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.020178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.020391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.020610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.020758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.020956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.021098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.021267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.021409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.021549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.021686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.021816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.021954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.022102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.022240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.022383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.022523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-13 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.022661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.022804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.022946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.023077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.023208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.023344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.023475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.023614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.023752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.023910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.024045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.024211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.024354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.024499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.024638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.024875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.025165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.025358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.025503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.025635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.025775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.025906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.026035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.026172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.026313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.026444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.026747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.026899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.027053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.027277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.027425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.027583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.027789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.027929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.028067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.028220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.028365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.028483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.028618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.028765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.028903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.029040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.029153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.029315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.029543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.029684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.029815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.029945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.030074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.030206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.030360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.030360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.030773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.030908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.031629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.031778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.031912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.032042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.032179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.032179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.032453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.032599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.032738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.032870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.032999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.033137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.033294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.033436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.033567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.033698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.033835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.033966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.034102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.034246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.034377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.034520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.034658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.034797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.034936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.035074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.035204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.035369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.035519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.035651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.035651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.035985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.035985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.036240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.036378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.036507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.036507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.036777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.036904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.037034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.037162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.037434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.037654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.037814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.037814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.038144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.038275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.038423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.038563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.038701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.038839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.038978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.039108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.039248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.039389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.039521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.039658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.039795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.039938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.040078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.040208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.040383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.040507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.040776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.041022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.041215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.041424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.041562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.041776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.041911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.042052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.042183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.042313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.042442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.042566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.042704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.042848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.042979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.043118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.043249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.043378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.043516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.043659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.043790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.043921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.044050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.044188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.044328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.044470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.044609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.044740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.044740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.044999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.045142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.045333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.045474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.045605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.045734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.045871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.046016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.046147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.046278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.046415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.046569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.047355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.047594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.047738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.047878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.048043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.048253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.048389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.048530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.048662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.048799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.048986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.049121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.049266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.049669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.049806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.049936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.050075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.050223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.050363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.050495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.050626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.050785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.051001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.051198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.051347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.051490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.051630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.051776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.051982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.052130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.052271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.052402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.052532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.052661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.052800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.052930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.053060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.053250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.053383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.053502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.053649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.053790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.053928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.054058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.054197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.054337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.054481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.054615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.054752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.054891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.055023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.055160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.055299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.055430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.055567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.055698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 13:15:18.055834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.055973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.056104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.056240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.056382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.056522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.056653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.056792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.056923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.057059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.057230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.057370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.057502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.057747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.057892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.058034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.058174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.058391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.058586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.058733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.058875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.059007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.059145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.059276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.059421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.059552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.059683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.059824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.059970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.060101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.060245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.060377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.060507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.060644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.060790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.060931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.061263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.061473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.061616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.061748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.061878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.062113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.062249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.062380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.062511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.062511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.062776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.062922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.063058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.063232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.063368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.063536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.063678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.063858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.063994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.064180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.064315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.064493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.064636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.064781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.064924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.065089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.065321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.065457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.065601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.065733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.065898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.066034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.066212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.066348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.066523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.066658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.066834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.066974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.067139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.067273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.067445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.067580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.067807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.067975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.068116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.068255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.068412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.068606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.068751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.068882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.069011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.069140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.069343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.069476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.069606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.069735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.069871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.070011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.070143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.070272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.070478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.070612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.070787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.070929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.071097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.071314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.071473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.071676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.071811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.071950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.072097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.072294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.072294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.072562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.072700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.072840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.072980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.073108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.073255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.073399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.073547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.073679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.073808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.073945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.074083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.074214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.074396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.074540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.074702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.074828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.075008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.075149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.075309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.075444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.075616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.075749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.075921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.076056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.076233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.076367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.076541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.076685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.076845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.076981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.077160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.077336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.077478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.077618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.077784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.078028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.078218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.078488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.078641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.078840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.078982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.079124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.079259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.079399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.079538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.079669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.079807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.079952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.080097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.080229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.080366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.080505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.080643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.080803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.080998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.081130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.081300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.081491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.081623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.081830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.081949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.082094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.082216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.082428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.082565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.082705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.082825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.083028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.083158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.083333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.083469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.083635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.083753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.083941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.084061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.084244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.084374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.084545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.084665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.084897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.085035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.085161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.085350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.085463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.085595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.085747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.085877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.086030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.086704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.086837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.086959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.087071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.087183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.087183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.087408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.087528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.087639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.087639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.087893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.088039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.088179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.088319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.088450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.088589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.088749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.089037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.089194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.089194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.089444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.089591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.089802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.089937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.090067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.090204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.090336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.090467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.090610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.090749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.090880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.091032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.091648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.091779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.091996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.092115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.092235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.092356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.092564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.092693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.092806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.092924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.093043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.093163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.093350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.094012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.094139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.094394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.094517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.094629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.094746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.094869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.094999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.094999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.095297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.095416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.095528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.095648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.095790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.095922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.096051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.096051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.096304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.096444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.096584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.096584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.096828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.096828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.097095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.097095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.097357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.097500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.097632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.097768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.097908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.098047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.098178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.098316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.098446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.098650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.099560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.099699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.099837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.099975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.100112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.100261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.100393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.100523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.100652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.100784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.100784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.101048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.101214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.101361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.101509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.101663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.101663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.102011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.102220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.102356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.102501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.102714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.102858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.102989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.103128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.103268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.103407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.103538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.103667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.103805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.103945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.104085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.104224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.104355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.104485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.104623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.104761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.104910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.105043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.105203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.105335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.105465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.105594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.105742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.105875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.106014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.106153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.106291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.106432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.106576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.106716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.107412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.107561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.107693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.107844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.107984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.108125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.108255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.108462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.108603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.108743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.108881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.109013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.110212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.110417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.110577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.110726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.110861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.110993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.111132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.111264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.111403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.111541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.111671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.111808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.112048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.112199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.112417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.112570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.112717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.112925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.113057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.113200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.113351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.113482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.113618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.113747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.113889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.114186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.114331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.114471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.114601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.114738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.114867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.115005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.115142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.115272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.115402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.115539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.115677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.115817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.115947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.116088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.116225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.116363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.116494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.116637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.116775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.116905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.117042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.117221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.117369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.117502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.117639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.117777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.117906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.118035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.118172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.118310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.118440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.118569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.118697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.118834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.118834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.119107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.119249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.119380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.119508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.119637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.119775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.119912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.120144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.120144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.120487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.120693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.120836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.120976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.121106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.121263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.121396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.121526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.121669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.121809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.121946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.122171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.122313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.122506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.122648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.122781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.122933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.123143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.123285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.123415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.123542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.123670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.123808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.123937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.124072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.124278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.124420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.124551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.124732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.125004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.125366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.125541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.125686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.125825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.125968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.126099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.126237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.126368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.126506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.126643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.126853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.126988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.127117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.127254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.127391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.127530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.127661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.127798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.127926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.128063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.128193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.128336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.128467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.128604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.128736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.128873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.129004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.129155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.129302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.129436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.129577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.129717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.129856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.129994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.130139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.130354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.130569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.130712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.130852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.130990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.131128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.131259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.131395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.131525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.131672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.131811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.131940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.132076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.132288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.132421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.132565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.132708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.132840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.132976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.133129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.133293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.133434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.133564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.133700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.133830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.133957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.134099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.134229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.134447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.134588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.134718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.134846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.134983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.135127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.135265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.135395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.135523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.135658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.135802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.135939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.136069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.136197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.136325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.136453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.136578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.136716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.136846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.136982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.137126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.137306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.137439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.137567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.137704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.137833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.137962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.138098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.138228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.138366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.138498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.138724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.138859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.138997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.139136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.139266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.139412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.139552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.139764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.139981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.140114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.140244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.140946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.141157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.141343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.141486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.141624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.141765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.141765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.142603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.142603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.142873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.143011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.143153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.143284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.143426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.143556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.143685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.143815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.143944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.144082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.144221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.144351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.144560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.144560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.144819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.144958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.145097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.145279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.145420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.145550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.145679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.145817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.145945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.146073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.146202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.146339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.146469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.146612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.146743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.146872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.147000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.147137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.147266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.147474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.147614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.147753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.147892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.148023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.148152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.148291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.148421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.148552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.148680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.148809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.148935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.149065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.149216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.149360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.149499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.149630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.149768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.149898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.150028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.150164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.150294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.150422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.150562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.150693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.150693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.151030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.151169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.151306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.151445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.151598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.151808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.151942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.152079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.152225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.152380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.152578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.152711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.152840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.152968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.153112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.153112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.153438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.153438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.153671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.153800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.154005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.154137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.154268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.154405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.154550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.154743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.154885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.155015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.155150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.155281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.155408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.155544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.155673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.155808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.156426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.156572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.156772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.157004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.157159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.157342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.157485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.157622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.157763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.157906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.158037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.158155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.158288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.158288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.158539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.158672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.158808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.158936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.159070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.159206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.159343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.159474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.159610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.159752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.159871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.160007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.160136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.160264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.160400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.160530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.160667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.160795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.160937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.161133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.161281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.161412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.161555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.161688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.161832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.162046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.162184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.162329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.162469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.162622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.162822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.162955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.162955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.163207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.163347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.163478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.163614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.163733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.163851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.163962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.163962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.164187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.164299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.164435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.164565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.164717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.164922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.165058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.165217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.165361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.165501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.165640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.165771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.165907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.166037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.166167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.166295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.166436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.166566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.166702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.166928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.167062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.167240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.167357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.167541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.167654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.167850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.167993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.168136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.168276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.168439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.168573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.168738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.168974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.169123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.169347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.169480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.169666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.169787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.170693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.170890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.171052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.171295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.171449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.171660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.172582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.172854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.173105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.173330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.173479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.173624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.173796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.173796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.174080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.174235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.174640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.174787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.174959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.175190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.175342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.175495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.175639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.175783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.175945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.176098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.176251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.176395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.176527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.176727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.176859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.176977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.176977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.177248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.177390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.177530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.177668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.177806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.177936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.178065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.178201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.178331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.178460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.178589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.178725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.178844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.178971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.179112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.179242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.179371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.179500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.179637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.179775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.179906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.180042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.180180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.180317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.180437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.180574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.180712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.180843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.180979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.181108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.181319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.181533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.181668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.181668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.181927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.182067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.182197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.182340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.182471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.182697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.182831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.182969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.183124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.183323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.183464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.183596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.183726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.183855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.183998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.184140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.184271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.184400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.184542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.184685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.184816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.184954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.185090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.185323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.185459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.186064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.186219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.186359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.186498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.186498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.186744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.186886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.187017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.187142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.187447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.187584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.187758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.187894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.188033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.188172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.188313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.188451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.188591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.188721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.188853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.188981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.189110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.189274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.189415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.189545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.189683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.189822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.189954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.189954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.190217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.190355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.190485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.190610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.190745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.190889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.191029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.191167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.191301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.191438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.191649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.191796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.191939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.192079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.192079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.192342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.192474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.192616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.192857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.192992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.193124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.193275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.193489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.193643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.193775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.193911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.194049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.194188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.194327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.194458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.194595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.194733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.194863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.194992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.195120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.195249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.195465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.195660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.195804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.195972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.196114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.196285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.196427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.196591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.196725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.196922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.197063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.197256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.197392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.197565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.197886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.198195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.198357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.198516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.198798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.198961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.199108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.199260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.199415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.199559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.199711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.199941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.200093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.200257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.200412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.200565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.200709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.200863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.201007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.201159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.201346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.201493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.201725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.201924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.202087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.202233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.202378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.202557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.202711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.202907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.203287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.203287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.203746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.203908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.204053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.204198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.204351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.204497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.204651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.204796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.204947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.205229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.205408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.205656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.205656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.205938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.206085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.206242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.206387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.206530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.206676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.206827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.206982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.207136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.207291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.207443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.207587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.207731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.207884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.208035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.208180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.208330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.208475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.208617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.208817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.208963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.209116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.209293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.209454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.209600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.209758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.209911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.210063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.210215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.210369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.210522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.210668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.210812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.210962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.211116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.211260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.211413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.211565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.211718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.211961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.211961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.212243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.212398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.212543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.212694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.212840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.212991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.213147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.213354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.213503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.213646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.213646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.214026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.214183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.214328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.214480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.214632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.214778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.214922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.215094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.215247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.215392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.215535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.215763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.215915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.216080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.216235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.216381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.216531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.216676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.216833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.216980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.217136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.217304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.217462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.217608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.217765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.217911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.217911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.218193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.218339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.218994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.219205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.219442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.219442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.219852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.219852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.220130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.220291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.220437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.220581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.220726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.220870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.221027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.221027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.221345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.221505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.221660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.221660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.221975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.222200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.222359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.222515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.222668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.222821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.222975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.222975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.223265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.223411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.223567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.223731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.223903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.224139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.224298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.224444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.224588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.224747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.224900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.225044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.225208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.225359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.225504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.225676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.225915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.226075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.226221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.226365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.226509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.226663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.226816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.226967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.227176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.227333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.227493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.227640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.227802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.227947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.228091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.228235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.228393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.228545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.228700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.228853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.228998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.229149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.229364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.229512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.229657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.229812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.229965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.230118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.230278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.230430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.230575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.230719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.230874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.231028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.231173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.231173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.231457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.231611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.231756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.231914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.232119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.232354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.232514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.232659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.232803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.232957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.233109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.233276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.233276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.233563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.233726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.233879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.234026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.234869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.235127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.235337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.235576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.235732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.235905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.236057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.236203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.236348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.236502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.236667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.236819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.236971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.237124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.237343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.237506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.237659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.237812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.237964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.238110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.238263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.238416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.238571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.238716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.238868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.239013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.239166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.239319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.239464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.239692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.239843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.239987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.240145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.240300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.240453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.240621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.240782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.240935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.241093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.241261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.241261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.241553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.241706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.241860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.242005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.242150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.242301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.242557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.242709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.242867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.243012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.243156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.243308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.243454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.243598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.243759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.243905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.244049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.244193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.244345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.244510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.244664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.244828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.245057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.245227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.245389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.245551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.245697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.245857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.246003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.246161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.246161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.246469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.246616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.246767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.246911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.247063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.247217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.247371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.247517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.247670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.247822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.247967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.248124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.248280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.248433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.248585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.248731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.248875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.249033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.249218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.249370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.249526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.249705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.249901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.250147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.250147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.250532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.250679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 13:15:18.250832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.250832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.250832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.250832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.250832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.250832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.250832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.251815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.251815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.252095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.252258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.252547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.252989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.253388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.253698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.254041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.254477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.254927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.255130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.255448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.255737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.256042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.256345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.256650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.257098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.257477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.257781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.258114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.258487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.258850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.259282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.259666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.260105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.260504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.260827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.261291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.261654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.262062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.262349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.262655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.262962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.263271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.263578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.263886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.264191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.264514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.264834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.265136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.266008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.266325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.266742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.267065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.267378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.267704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.268011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.268320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.268754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.269069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.269406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.269722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.270031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.270338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.270652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.270964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.271285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.271609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.271915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.272234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.272558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.272905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.273237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.273580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.273907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.274219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.274527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.274830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 13:15:18.275070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 13:15:18.311849 n-d-858384-13 devstack@n-api.service[120612]: INFO dbcounter [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] Registered counter for database nova_api Oct 18 13:15:18.333548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_db.sqlalchemy.engines [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:15:18.338914 n-d-858384-13 devstack@n-api.service[120611]: INFO dbcounter [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] Registered counter for database nova_api Oct 18 13:15:18.340433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writer thread running {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:15:18.359964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_db.sqlalchemy.engines [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:15:18.367037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writer thread running {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:15:18.397084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.context [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8e216eb-ce73-4101-a62e-f9159a9c2bcf(cell1) {{(pid=120612) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 13:15:18.401128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:15:18.401622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:15:18.403194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:15:18.403906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:15:18.404344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:15:18.407002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:15:18.409166 n-d-858384-13 devstack@n-api.service[120612]: INFO dbcounter [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] Registered counter for database nova_cell0 Oct 18 13:15:18.413434 n-d-858384-13 devstack@n-api.service[120612]: INFO dbcounter [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] Registered counter for database nova_cell1 Oct 18 13:15:18.420985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_db.sqlalchemy.engines [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:15:18.425472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.context [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8e216eb-ce73-4101-a62e-f9159a9c2bcf(cell1) {{(pid=120611) load_cells /opt/stack/nova/nova/context.py:464}} Oct 18 13:15:18.429238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writer thread running {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:15:18.429628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:15:18.430106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:15:18.431709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:15:18.432439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:15:18.432878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:15:18.435180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:15:18.437271 n-d-858384-13 devstack@n-api.service[120611]: INFO dbcounter [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] Registered counter for database nova_cell0 Oct 18 13:15:18.442011 n-d-858384-13 devstack@n-api.service[120611]: INFO dbcounter [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] Registered counter for database nova_cell1 Oct 18 13:15:18.450315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_db.sqlalchemy.engines [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:15:18.456642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writer thread running {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:15:18.568604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_db.sqlalchemy.engines [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:15:18.575625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writer thread running {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:15:18.585826 n-d-858384-13 devstack@n-api.service[120612]: INFO dbcounter [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] Registered counter for database nova_cell0 Oct 18 13:15:18.594821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_db.sqlalchemy.engines [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:15:18.601667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writer thread running {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:15:18.623084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_db.sqlalchemy.engines [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:15:18.629541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writer thread running {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:15:18.639098 n-d-858384-13 devstack@n-api.service[120611]: INFO dbcounter [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] Registered counter for database nova_cell0 Oct 18 13:15:18.647578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_db.sqlalchemy.engines [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 13:15:18.653777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writer thread running {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 13:15:18.930913 n-d-858384-13 devstack@n-api.service[120612]: WARNING keystonemiddleware.auth_token [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:15:18.940293 n-d-858384-13 devstack@n-api.service[120612]: WARNING keystonemiddleware.auth_token [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:15:18.993269 n-d-858384-13 devstack@n-api.service[120611]: WARNING keystonemiddleware.auth_token [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:15:19.001465 n-d-858384-13 devstack@n-api.service[120611]: WARNING keystonemiddleware.auth_token [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:15:19.291712 n-d-858384-13 devstack@n-api.service[120612]: WARNING keystonemiddleware.auth_token [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:15:19.298515 n-d-858384-13 devstack@n-api.service[120612]: WARNING keystonemiddleware.auth_token [None req-fca3374d-7c56-4ded-a2ca-62ed2399749c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:15:19.304079 n-d-858384-13 devstack@n-api.service[120612]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d58754e9c0 pid: 120612 (default app) Oct 18 13:15:19.345865 n-d-858384-13 devstack@n-api.service[120611]: WARNING keystonemiddleware.auth_token [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 18 13:15:19.351825 n-d-858384-13 devstack@n-api.service[120611]: WARNING keystonemiddleware.auth_token [None req-236e5587-a339-4fdf-9eab-744a52bc3af5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 18 13:15:19.357120 n-d-858384-13 devstack@n-api.service[120611]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d58754e9c0 pid: 120611 (default app) Oct 18 13:15:58.987399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:58.988391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:58.989346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:15:58.990437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:00.209106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0cf670d4-4ff9-48c5-940e-a2d4921a5fcc tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Calling method '.version_select at 0x7ff61539cd30>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:00.219277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0cf670d4-4ff9-48c5-940e-a2d4921a5fcc tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8e216eb-ce73-4101-a62e-f9159a9c2bcf(cell1) {{(pid=120612) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 18 13:16:00.220040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cf670d4-4ff9-48c5-940e-a2d4921a5fcc tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:00.220512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cf670d4-4ff9-48c5-940e-a2d4921a5fcc tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:00.220944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cf670d4-4ff9-48c5-940e-a2d4921a5fcc tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:00.253059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cf670d4-4ff9-48c5-940e-a2d4921a5fcc tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:00.254068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cf670d4-4ff9-48c5-940e-a2d4921a5fcc tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:00.254891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cf670d4-4ff9-48c5-940e-a2d4921a5fcc tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:00.281028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cf670d4-4ff9-48c5-940e-a2d4921a5fcc tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:00.282000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cf670d4-4ff9-48c5-940e-a2d4921a5fcc tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:00.282598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cf670d4-4ff9-48c5-940e-a2d4921a5fcc tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:00.295138 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0cf670d4-4ff9-48c5-940e-a2d4921a5fcc tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.320711 Oct 18 13:16:00.296307 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1208 bytes} [Tue Oct 18 13:15:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:16:00.527692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e003532c-f111-4a78-8730-2f0280c1a2b1 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-45975284"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:00.547942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.aggregate [None req-e003532c-f111-4a78-8730-2f0280c1a2b1 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Generated uuid fd9f61ea-67bb-452f-8420-53656e191cf5 for aggregate {{(pid=120611) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:00.555977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:00.556887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:00.557549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:00.558174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:00.652254 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e003532c-f111-4a78-8730-2f0280c1a2b1 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.41 time: 0.337429 Oct 18 13:16:00.656573 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1/2] 10.222.0.40 () {62 vars in 1205 bytes} [Tue Oct 18 13:16:00 2022] POST /compute/v2.1/os-aggregates => generated 244 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:16:00.666671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d08f8917-6895-4300-917d-f33b4a5f8847 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1007190473"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:00.839602 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d08f8917-6895-4300-917d-f33b4a5f8847 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.176937 Oct 18 13:16:00.848121 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2/3] 10.222.0.40 () {62 vars in 1210 bytes} [Tue Oct 18 13:16:00 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:16:00.852507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4ba134d1-6147-472b-b063-9cd4df8692a5 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:00.874573 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4ba134d1-6147-472b-b063-9cd4df8692a5 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.025411 Oct 18 13:16:00.875511 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2/4] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 18 13:16:00 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:16:00.893202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-271f66bf-4bce-4b8b-80a4-8d95adf989ca tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-13"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:00.908719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-271f66bf-4bce-4b8b-80a4-8d95adf989ca tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:00.909481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-271f66bf-4bce-4b8b-80a4-8d95adf989ca tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:00.910405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-271f66bf-4bce-4b8b-80a4-8d95adf989ca tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:02.287803 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-271f66bf-4bce-4b8b-80a4-8d95adf989ca tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 1.399616 Oct 18 13:16:02.289245 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3/5] 10.222.0.40 () {62 vars in 1232 bytes} [Tue Oct 18 13:16:00 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:16:02.309306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-04c1416b-7b7b-4632-bfad-421bcb9453c7 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-13"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:02.321835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04c1416b-7b7b-4632-bfad-421bcb9453c7 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:02.322288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04c1416b-7b7b-4632-bfad-421bcb9453c7 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:02.322707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04c1416b-7b7b-4632-bfad-421bcb9453c7 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:02.494182 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-04c1416b-7b7b-4632-bfad-421bcb9453c7 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.189505 Oct 18 13:16:02.495627 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 4/6] 10.222.0.40 () {62 vars in 1232 bytes} [Tue Oct 18 13:16:02 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:16:02.515745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5ad8ef98-ff48-4cb8-bd6b-f4058b3141a9 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:02.551703 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5ad8ef98-ff48-4cb8-bd6b-f4058b3141a9 tempest-AggregatesAdminTestV241-1223133438 tempest-AggregatesAdminTestV241-1223133438-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.044686 Oct 18 13:16:02.552776 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 5/7] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 18 13:16:02 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:02.690995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a4f7d1e4-c0c7-456d-a591-e8bc3615dba9 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:02.694812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f7d1e4-c0c7-456d-a591-e8bc3615dba9 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:02.695298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f7d1e4-c0c7-456d-a591-e8bc3615dba9 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:02.695739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f7d1e4-c0c7-456d-a591-e8bc3615dba9 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:02.696467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f7d1e4-c0c7-456d-a591-e8bc3615dba9 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:02.696923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f7d1e4-c0c7-456d-a591-e8bc3615dba9 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:02.697422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f7d1e4-c0c7-456d-a591-e8bc3615dba9 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:02.738867 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a4f7d1e4-c0c7-456d-a591-e8bc3615dba9 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 1.359688 Oct 18 13:16:02.750633 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3/8] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 18 13:16:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:02.759347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-056771d7-e4a5-4b65-8882-c80a387d8c1f tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1144703175"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:02.787660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.aggregate [None req-056771d7-e4a5-4b65-8882-c80a387d8c1f tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Generated uuid ea4eb06c-fa65-44fd-90ac-56d4a4c96f40 for aggregate {{(pid=120612) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:02.826886 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-056771d7-e4a5-4b65-8882-c80a387d8c1f tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073470 Oct 18 13:16:02.828440 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 6/9] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:02.839466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-48346d2c-642b-4994-9400-229928fce368 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-13"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:02.864477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48346d2c-642b-4994-9400-229928fce368 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:02.865248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48346d2c-642b-4994-9400-229928fce368 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:02.865875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48346d2c-642b-4994-9400-229928fce368 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:03.864482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1653208812", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:04.277110 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-48346d2c-642b-4994-9400-229928fce368 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 1.440858 Oct 18 13:16:04.278277 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4/10] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 18 13:16:02 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:04.443009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1bbe8e8-bf92-41ef-ae93-138d16055629 tempest-FlavorMetadataValidation-1429676878 tempest-FlavorMetadataValidation-1429676878-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1286044111", "id": 1237549380, "os-flavor-access:is_public": "True"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:04.450626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:16:04.491010 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e1bbe8e8-bf92-41ef-ae93-138d16055629 tempest-FlavorMetadataValidation-1429676878 tempest-FlavorMetadataValidation-1429676878-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.209160 Oct 18 13:16:04.492101 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 5/11] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:16:04 2022] POST /compute/v2.1/flavors => generated 471 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:16:04.590579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b2815bb9-f358-4688-bcad-75c4a5548d15 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1067039962", "id": 1214493850, "os-flavor-access:is_public": "True"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:04.614146 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b2815bb9-f358-4688-bcad-75c4a5548d15 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.120590 Oct 18 13:16:04.615091 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 6/12] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:04 2022] POST /compute/v2.1/flavors => generated 430 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:04.837000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-21fa7fb3-df99-4eeb-bd3d-50c59a386a27 tempest-AZAdminNegativeTestJSON-1812620398 tempest-AZAdminNegativeTestJSON-1812620398-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:04.838573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-21fa7fb3-df99-4eeb-bd3d-50c59a386a27 tempest-AZAdminNegativeTestJSON-1812620398 tempest-AZAdminNegativeTestJSON-1812620398-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '796ae963dda64372b12975e4c37316d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9da9f5a89e741aaae0319c2fc3aca25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-21fa7fb3-df99-4eeb-bd3d-50c59a386a27 tempest-AZAdminNegativeTestJSON-1812620398 tempest-AZAdminNegativeTestJSON-1812620398-project] Request method failure captured: Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcQvkgEEHtX1hkW3CS8htOL1EQ07mii5AAw9xyZWtDeKCye7fPs7Z11ZscVybamZvXo14cESoOz-7lDa7KBoqeG29SHQa5Aa5aacGNPFMw1JB_9F12xojLHK4tOh2Auzp8moBqtxZy_sEsMmMkKmc3mrptnHkaFG3H6jWWUmy88m7o Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: f9da9f5a89e741aaae0319c2fc3aca25 Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1812620398 Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:16:04.842942 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:16:04.844280 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9da9f5a89e741aaae0319c2fc3aca25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9da9f5a89e741aaae0319c2fc3aca25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9da9f5a89e741aaae0319c2fc3aca25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9da9f5a89e741aaae0319c2fc3aca25"}]}] Oct 18 13:16:04.844280 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AZAdminNegativeTestJSON-1812620398 Oct 18 13:16:04.844280 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: f9da9f5a89e741aaae0319c2fc3aca25 Oct 18 13:16:04.844280 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1812620398 Oct 18 13:16:04.844280 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AZAdminNegativeTestJSON-1812620398-project Oct 18 13:16:04.844280 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:04.844280 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:04.844280 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 796ae963dda64372b12975e4c37316d3 Oct 18 13:16:04.844280 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AZAdminNegativeTestJSON-1812620398-project Oct 18 13:16:04.844280 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:04.844280 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 18 13:16:04.844280 n-d-858384-13 devstack@n-api.service[120611]: action_args: {} Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:04.844986 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:04.846032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-21fa7fb3-df99-4eeb-bd3d-50c59a386a27 tempest-AZAdminNegativeTestJSON-1812620398 tempest-AZAdminNegativeTestJSON-1812620398-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:04.847062 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-21fa7fb3-df99-4eeb-bd3d-50c59a386a27 tempest-AZAdminNegativeTestJSON-1812620398 tempest-AZAdminNegativeTestJSON-1812620398-project] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.228120 Oct 18 13:16:04.847062 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 18 13:16:04 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 229 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:04.854882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:16:04.855304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:16:04.855778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:16:04.856185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:16:04.856601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:16:04.875710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:04.876301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:04.877922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:04.878814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:04.879361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:04.879858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:04.929800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Getting quotas for project 8e57e4407cc94732a5144972bf546dd2. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:16:04.940833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Getting quotas for user 6c06e155847a4386881f49f26c02dcec and project 8e57e4407cc94732a5144972bf546dd2. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:16:04.958331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:16:04.961116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:16:05.032900 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-78f842a4-56cd-464d-b756-fd841d1675e7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802784 Oct 18 13:16:05.034145 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 7/14] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:16:05.156727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-568c3f08-7deb-432e-a31f-d3885c9a4e09 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '.version_select at 0x7ff61493d550>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:05.176058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-568c3f08-7deb-432e-a31f-d3885c9a4e09 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8e216eb-ce73-4101-a62e-f9159a9c2bcf(cell1) {{(pid=120611) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 18 13:16:05.177580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-568c3f08-7deb-432e-a31f-d3885c9a4e09 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:05.178459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-568c3f08-7deb-432e-a31f-d3885c9a4e09 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:05.179876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-568c3f08-7deb-432e-a31f-d3885c9a4e09 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:05.204280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-568c3f08-7deb-432e-a31f-d3885c9a4e09 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:05.204995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-568c3f08-7deb-432e-a31f-d3885c9a4e09 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:05.205623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-568c3f08-7deb-432e-a31f-d3885c9a4e09 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:05.218919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-568c3f08-7deb-432e-a31f-d3885c9a4e09 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:05.219859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-568c3f08-7deb-432e-a31f-d3885c9a4e09 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:05.220736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-568c3f08-7deb-432e-a31f-d3885c9a4e09 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:05.228424 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-568c3f08-7deb-432e-a31f-d3885c9a4e09 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.382235 Oct 18 13:16:05.229348 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 8/15] 10.222.0.40 () {58 vars in 1167 bytes} [Tue Oct 18 13:16:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:05.235922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5b762f84-8522-4887-b59a-f996f93c7ec8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-13"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:05.250672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b762f84-8522-4887-b59a-f996f93c7ec8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:05.251215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b762f84-8522-4887-b59a-f996f93c7ec8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:05.251930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b762f84-8522-4887-b59a-f996f93c7ec8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:05.299336 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-5b762f84-8522-4887-b59a-f996f93c7ec8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h2-858384-13. Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5b762f84-8522-4887-b59a-f996f93c7ec8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Request method failure captured: Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 40 Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcR7jKojjHnWBH4I647APZ1lAf6DYgLHkOCM9D6uJE_25iFoXIIru7yF3xDqm7dKdOIZgPzpnNHQU27ijmv452tInIFJfDmOyybVc5ZRBcJqeQS-wYrO7hIeMsuptqO2c4b2WvPYb1u74EW3ujR3PGv7Nz07Mhnr95Q_Dg4frWQNgY Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:16:05.316902 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:16:05.318083 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4c9bb0280e95428fac311e7981b31d67"}]}] Oct 18 13:16:05.318083 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:05.318083 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:05.318083 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:05.318083 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:05.318083 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:05.318083 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:05.318083 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 86f3a8f6212a4213b60769dfeb2bb457 Oct 18 13:16:05.318083 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:05.318083 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:16:05.318083 n-d-858384-13 devstack@n-api.service[120611]: {"add_host": {"host": "n-h2-858384-13"}} Oct 18 13:16:05.318083 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:05.318083 n-d-858384-13 devstack@n-api.service[120611]: exception: Aggregate 2 already has host n-h2-858384-13. Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-858384-13'}}} Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result.read() Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:16:05.318682 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-858384-13-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi session.flush() Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:16:05.319581 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 13:16:05.321100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:16:05.321981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result.read() Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-858384-13-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 18, 13, 16, 5, 281427), 'updated_at': None, 'host': 'n-h2-858384-13', 'aggregate_id': 2}] Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:05.323772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6644, in add_host_to_aggregate Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h2-858384-13. Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:05.325470 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h2-858384-13. Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:05.328166 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:05.330861 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h2-858384-13. Oct 18 13:16:05.330861 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:05.330861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5b762f84-8522-4887-b59a-f996f93c7ec8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Returning 409 to user: Aggregate 2 already has host n-h2-858384-13. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:05.330861 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5b762f84-8522-4887-b59a-f996f93c7ec8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 96 microversion: 2.1 time: 0.087894 Oct 18 13:16:05.330861 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 9/16] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 18 13:16:05 2022] POST /compute/v2.1/os-aggregates/2/action => generated 96 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 18 13:16:05.331597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ee709010-b71c-4aa7-ad6d-753c498495ad tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-955397169", "ram": 512, "vcpus": 1, "disk": 10, "id": 595786916, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:05.331957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1669ec8a-38a6-44a7-b951-6a5dc72700b1 tempest-FlavorMetadataValidation-1429676878 tempest-FlavorMetadataValidation-1429676878-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:05.368939 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ee709010-b71c-4aa7-ad6d-753c498495ad tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.332539 Oct 18 13:16:05.380979 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 8/17] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:05 2022] POST /compute/v2.1/flavors => generated 412 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:05.386873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-56ceba3c-1e49-469b-8c63-736f66a5d375 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:05.418562 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-56ceba3c-1e49-469b-8c63-736f66a5d375 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1214493850" status: 202 len: 0 microversion: 2.1 time: 0.036297 Oct 18 13:16:05.419587 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 9/18] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 18 13:16:05 2022] DELETE /compute/v2.1/flavors/1214493850 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:16:05.428999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c9866df-c474-4523-93dd-6db75156bfd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:05.430000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2c9866df-c474-4523-93dd-6db75156bfd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:05.556723 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1669ec8a-38a6-44a7-b951-6a5dc72700b1 tempest-FlavorMetadataValidation-1429676878 tempest-FlavorMetadataValidation-1429676878-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1237549380/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.236024 Oct 18 13:16:05.563522 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 10/19] 10.222.0.40 () {62 vars in 1265 bytes} [Tue Oct 18 13:16:05 2022] POST /compute/v2.1/flavors/1237549380/os-extra_specs => generated 62 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:05.570299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-59116d43-1e31-44a0-891f-a44e9055a53b tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-13"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:05.573122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2c9866df-c474-4523-93dd-6db75156bfd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:05.586379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59116d43-1e31-44a0-891f-a44e9055a53b tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:05.587356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59116d43-1e31-44a0-891f-a44e9055a53b tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:05.588144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59116d43-1e31-44a0-891f-a44e9055a53b tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:05.609897 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2c9866df-c474-4523-93dd-6db75156bfd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1220 microversion: 2.1 time: 0.188514 Oct 18 13:16:05.611050 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 10/20] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:05 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1220 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:05.638546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-72b25821-b669-4e29-abd6-9a0028597a92 tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:05.719656 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-72b25821-b669-4e29-abd6-9a0028597a92 tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/595786916/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.107424 Oct 18 13:16:05.720437 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 11/21] 10.222.0.40 () {60 vars in 1221 bytes} [Tue Oct 18 13:16:05 2022] POST /compute/v2.1/flavors/595786916/os-extra_specs => generated 66 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:16:05.731835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f17fabe6-2076-4ad5-b34e-d3327f632b22 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:05.735352 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-59116d43-1e31-44a0-891f-a44e9055a53b tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.169403 Oct 18 13:16:05.736417 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 11/22] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 18 13:16:05 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:05.751201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-faeae842-2c8c-40b0-af40-c79caf23f25b tempest-FlavorMetadataValidation-1429676878 tempest-FlavorMetadataValidation-1429676878-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:05.788119 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-faeae842-2c8c-40b0-af40-c79caf23f25b tempest-FlavorMetadataValidation-1429676878 tempest-FlavorMetadataValidation-1429676878-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1237549380" status: 202 len: 0 microversion: 2.86 time: 0.050542 Oct 18 13:16:05.789159 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 12/23] 10.222.0.40 () {60 vars in 1202 bytes} [Tue Oct 18 13:16:05 2022] DELETE /compute/v2.1/flavors/1237549380 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:16:05.805215 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f17fabe6-2076-4ad5-b34e-d3327f632b22 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.077238 Oct 18 13:16:05.807247 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 12/24] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:05 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:05.815502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-99dd3ff1-a73c-461d-bdb9-6dfd607dba79 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:05.844627 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-99dd3ff1-a73c-461d-bdb9-6dfd607dba79 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.035955 Oct 18 13:16:05.845195 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 13/25] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:05 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:05.854647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8d1a08a2-ed1e-48ab-9e1c-6a973dab39c5 tempest-FlavorMetadataValidation-1429676878 tempest-FlavorMetadataValidation-1429676878-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:05.909731 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8d1a08a2-ed1e-48ab-9e1c-6a973dab39c5 tempest-FlavorMetadataValidation-1429676878 tempest-FlavorMetadataValidation-1429676878-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6266 microversion: 2.86 time: 0.059007 Oct 18 13:16:05.911710 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 14/26] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 18 13:16:05 2022] GET /compute/v2.1/flavors/detail => generated 6266 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:16:05.929510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0f2213af-fc4b-41c5-9e5c-af438e1bc23e tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1713033361", "id": 984553895, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:05.960379 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0f2213af-fc4b-41c5-9e5c-af438e1bc23e tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.046878 Oct 18 13:16:05.962274 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 15/27] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:05 2022] POST /compute/v2.1/flavors => generated 414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:05.969969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-61def0e0-d5d6-4eca-9e5c-629df78b93a1 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1556836694"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:05.975021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.aggregate [None req-61def0e0-d5d6-4eca-9e5c-629df78b93a1 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Generated uuid 8083f64c-ea59-4086-ba1c-8af0e8e755c7 for aggregate {{(pid=120612) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:06.012493 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-61def0e0-d5d6-4eca-9e5c-629df78b93a1 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048897 Oct 18 13:16:06.013598 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 16/28] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:06.019964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fab9eba1-a995-4e8a-b391-e4b27c1350e1 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-68300975", "name": "tempest-test_aggregate-1540547260"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:06.051432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.aggregate [None req-fab9eba1-a995-4e8a-b391-e4b27c1350e1 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Generated uuid 319112b5-26cf-475b-b705-22a2c0251596 for aggregate {{(pid=120612) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:06.061430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=11,nova_api:DELETE=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:06.108087 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fab9eba1-a995-4e8a-b391-e4b27c1350e1 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.092268 Oct 18 13:16:06.109761 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 17/29] 10.222.0.40 () {60 vars in 1165 bytes} [Tue Oct 18 13:16:06 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:06.115440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-60b1c454-b659-4a0d-8bbc-fc03272dac61 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:06.176676 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-60b1c454-b659-4a0d-8bbc-fc03272dac61 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5797 microversion: 2.1 time: 0.065615 Oct 18 13:16:06.193224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1fff9e58-cb51-4151-ba4f-15a062522a2f tempest-FlavorsExtraSpecsTestJSON-998080245 tempest-FlavorsExtraSpecsTestJSON-998080245-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:06.198500 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 18/30] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:06 2022] GET /compute/v2.1/flavors/detail => generated 5797 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:06.233891 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1fff9e58-cb51-4151-ba4f-15a062522a2f tempest-FlavorsExtraSpecsTestJSON-998080245 tempest-FlavorsExtraSpecsTestJSON-998080245-project] 10.222.0.40 "GET /compute/v2.1/flavors/595786916/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.441547 Oct 18 13:16:06.235894 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 13/31] 10.222.0.40 () {58 vars in 1200 bytes} [Tue Oct 18 13:16:05 2022] GET /compute/v2.1/flavors/595786916/os-extra_specs => generated 66 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:16:06.253886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-144c1c2a-d172-4484-91eb-d02c9d8df07d tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:06.289485 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-144c1c2a-d172-4484-91eb-d02c9d8df07d tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 513 microversion: 2.1 time: 0.050270 Oct 18 13:16:06.291687 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 14/32] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 18 13:16:06 2022] GET /compute/v2.1/os-aggregates => generated 513 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:06.306129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1825497f-c8cc-4be1-8e9b-d9a73f849532 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:06.349043 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1825497f-c8cc-4be1-8e9b-d9a73f849532 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/984553895" status: 202 len: 0 microversion: 2.1 time: 0.051823 Oct 18 13:16:06.350148 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 15/33] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:16:06 2022] DELETE /compute/v2.1/flavors/984553895 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:16:06.356506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-77103976-7aed-4dbf-b70c-6a1a4e06dfdd tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:06.398899 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-77103976-7aed-4dbf-b70c-6a1a4e06dfdd tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/595786916/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047302 Oct 18 13:16:06.399512 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 16/34] 10.222.0.40 () {60 vars in 1221 bytes} [Tue Oct 18 13:16:06 2022] POST /compute/v2.1/flavors/595786916/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:16:06.406847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-10e6387f-8b3b-4215-92a3-5c7aa0e585ad tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-13"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:06.426924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10e6387f-8b3b-4215-92a3-5c7aa0e585ad tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:06.430022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10e6387f-8b3b-4215-92a3-5c7aa0e585ad tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:06.430022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10e6387f-8b3b-4215-92a3-5c7aa0e585ad tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:06.646587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-21f87f9d-d294-49d8-86a4-5bc9079cba82 tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-13"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:06.651716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-21f87f9d-d294-49d8-86a4-5bc9079cba82 tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '38d6c86601ba4077b8bf5c4ee6c74bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89adfb0b21e04a529d26052bbe0581aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-21f87f9d-d294-49d8-86a4-5bc9079cba82 tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Request method failure captured: Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 40 Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcOmsCNGAbZxRz9GocwCRPlyFjvWASEFw_PWLX2PRpkvKRghRuIW5W1oRslMx5eT8aEod6rc77cRhJGaT2vLhC7cHkGO4jJfB53mVtREHHI7Ldp_7IJBumA3bTJjC1bJoWncTyjYaQKB3Euz7vUa_aXkvmFOf2tQvOL7hIohOaMgu4 Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 89adfb0b21e04a529d26052bbe0581aa Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:06.661251 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:06.662369 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_89adfb0b21e04a529d26052bbe0581aa"}]}] Oct 18 13:16:06.662369 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:06.662369 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 89adfb0b21e04a529d26052bbe0581aa Oct 18 13:16:06.662369 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:06.662369 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminNegativeTestJSON-800446552-project Oct 18 13:16:06.662369 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:06.662369 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:06.662369 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 38d6c86601ba4077b8bf5c4ee6c74bb8 Oct 18 13:16:06.662369 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-800446552-project Oct 18 13:16:06.662369 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:16:06.662369 n-d-858384-13 devstack@n-api.service[120612]: {"add_host": {"host": "n-h2-858384-13"}} Oct 18 13:16:06.662369 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:06.662369 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-858384-13'}}} Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:06.663123 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 18 13:16:06.664127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:06.666856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-21f87f9d-d294-49d8-86a4-5bc9079cba82 tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:06.668105 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-21f87f9d-d294-49d8-86a4-5bc9079cba82 tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.468441 Oct 18 13:16:06.669473 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 19/35] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 18 13:16:06 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 470 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:06.675422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7128dec7-a0d3-41bb-9aa3-32b23733ecaf tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:06.707969 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7128dec7-a0d3-41bb-9aa3-32b23733ecaf tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.037012 Oct 18 13:16:06.709104 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 20/36] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:06 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:06.721938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22347e4d-3f38-49ef-8043-7e930f1361e7 tempest-FlavorsExtraSpecsTestJSON-998080245 tempest-FlavorsExtraSpecsTestJSON-998080245-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:06.742044 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-22347e4d-3f38-49ef-8043-7e930f1361e7 tempest-FlavorsExtraSpecsTestJSON-998080245 tempest-FlavorsExtraSpecsTestJSON-998080245-project] 10.222.0.40 "GET /compute/v2.1/flavors/595786916/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.026907 Oct 18 13:16:06.743307 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-10e6387f-8b3b-4215-92a3-5c7aa0e585ad tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 312 microversion: 2.1 time: 0.342273 Oct 18 13:16:06.750088 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 21/37] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 18 13:16:06 2022] GET /compute/v2.1/flavors/595786916/os-extra_specs/hw:numa_nodes => generated 22 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:16:06.755650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cb60afb9-4036-49a0-8b38-4c36e8959b38 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:06.756272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cb60afb9-4036-49a0-8b38-4c36e8959b38 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:06.758052 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 17/38] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 18 13:16:06 2022] POST /compute/v2.1/os-aggregates/4/action => generated 312 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:06.764407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb60afb9-4036-49a0-8b38-4c36e8959b38 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:06.765048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb60afb9-4036-49a0-8b38-4c36e8959b38 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:06.765600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb60afb9-4036-49a0-8b38-4c36e8959b38 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:06.766312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb60afb9-4036-49a0-8b38-4c36e8959b38 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:06.766762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb60afb9-4036-49a0-8b38-4c36e8959b38 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:06.767182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb60afb9-4036-49a0-8b38-4c36e8959b38 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:06.804728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b0ed9bbc-c0f3-4574-846e-8ec31fd045d0 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:06.845848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=7 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:06.870120 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b0ed9bbc-c0f3-4574-846e-8ec31fd045d0 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.110291 Oct 18 13:16:06.876516 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 18/39] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:06 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:06.883464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5cf87394-f58f-4acf-91a3-38421b59d7ff tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-437874645", "id": 457148346, "os-flavor-access:is_public": "True"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:06.937909 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5cf87394-f58f-4acf-91a3-38421b59d7ff tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.059744 Oct 18 13:16:06.938836 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 19/40] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:06 2022] POST /compute/v2.1/flavors => generated 425 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:06.943995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb823bc7-bb8f-46ac-b4d2-9eda55b2ab86 tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:06.972639 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eb823bc7-bb8f-46ac-b4d2-9eda55b2ab86 tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/595786916/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032396 Oct 18 13:16:06.978893 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1221 bytes} [Tue Oct 18 13:16:06 2022] POST /compute/v2.1/flavors/595786916/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:16:06.984879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1a16382-4851-4e14-a03b-fb4f11245b65 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-937996544"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:06.990031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.aggregate [None req-e1a16382-4851-4e14-a03b-fb4f11245b65 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Generated uuid 6f309665-a3f1-4950-abd4-6bdceb09f596 for aggregate {{(pid=120611) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:07.022471 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e1a16382-4851-4e14-a03b-fb4f11245b65 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.042066 Oct 18 13:16:07.032501 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 21/42] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:06 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:07.038012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eac9a4d5-1452-4e0f-8b36-f2f45751e945 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:07.070221 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eac9a4d5-1452-4e0f-8b36-f2f45751e945 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/457148346" status: 202 len: 0 microversion: 2.1 time: 0.036010 Oct 18 13:16:07.072743 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 22/43] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:16:07 2022] DELETE /compute/v2.1/flavors/457148346 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:16:07.080315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7ba2a6f7-3689-472b-a0e7-49f7b7022163 tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:07.090858 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7ba2a6f7-3689-472b-a0e7-49f7b7022163 tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/595786916/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016614 Oct 18 13:16:07.099083 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 23/44] 10.222.0.40 () {58 vars in 1200 bytes} [Tue Oct 18 13:16:07 2022] GET /compute/v2.1/flavors/595786916/os-extra_specs => generated 66 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:16:07.119720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cb60afb9-4036-49a0-8b38-4c36e8959b38 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:07.135641 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cb60afb9-4036-49a0-8b38-4c36e8959b38 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1224 microversion: 2.1 time: 0.384276 Oct 18 13:16:07.137094 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 22/45] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:06 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1224 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:07.143519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8d51207f-9cf9-469d-adb9-8fa5e7e1f5b8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1377380095"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:07.178305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d51207f-9cf9-469d-adb9-8fa5e7e1f5b8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:07.180341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d51207f-9cf9-469d-adb9-8fa5e7e1f5b8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:07.180954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d51207f-9cf9-469d-adb9-8fa5e7e1f5b8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:07.198149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d51207f-9cf9-469d-adb9-8fa5e7e1f5b8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:07.199334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d51207f-9cf9-469d-adb9-8fa5e7e1f5b8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:07.200097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d51207f-9cf9-469d-adb9-8fa5e7e1f5b8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:07.220363 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-8d51207f-9cf9-469d-adb9-8fa5e7e1f5b8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1377380095 could not be found. Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8d51207f-9cf9-469d-adb9-8fa5e7e1f5b8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Request method failure captured: Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 58 Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcR7jKojjHnWBH4I647APZ1lAf6DYgLHkOCM9D6uJE_25iFoXIIru7yF3xDqm7dKdOIZgPzpnNHQU27ijmv452tInIFJfDmOyybVc5ZRBcJqeQS-wYrO7hIeMsuptqO2c4b2WvPYb1u74EW3ujR3PGv7Nz07Mhnr95Q_Dg4frWQNgY Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:07.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:07.230568 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4c9bb0280e95428fac311e7981b31d67"}]}] Oct 18 13:16:07.230568 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:07.230568 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:07.230568 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:07.230568 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:07.230568 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:07.230568 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:07.230568 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 86f3a8f6212a4213b60769dfeb2bb457 Oct 18 13:16:07.230568 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:07.230568 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:16:07.230568 n-d-858384-13 devstack@n-api.service[120612]: {"add_host": {"host": "tempest-nonexist_host-1377380095"}} Oct 18 13:16:07.230568 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:07.230568 n-d-858384-13 devstack@n-api.service[120612]: exception: Compute host tempest-nonexist_host-1377380095 could not be found. Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1377380095'}}} Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1377380095' is not mapped to any cell Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:07.232413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6624, in add_host_to_aggregate Oct 18 13:16:07.233598 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1377380095 could not be found. Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1377380095 could not be found. Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:07.234640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.235691 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:07.235691 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:07.235691 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:07.235691 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:07.235691 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:07.235691 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1377380095 could not be found. Oct 18 13:16:07.235691 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.237890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8d51207f-9cf9-469d-adb9-8fa5e7e1f5b8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1377380095 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:07.239018 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8d51207f-9cf9-469d-adb9-8fa5e7e1f5b8 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.100665 Oct 18 13:16:07.240617 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 23/46] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 18 13:16:07 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:07.247348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bfe71168-6652-4605-9566-fdf3a6fd7ef3 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:07.289277 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bfe71168-6652-4605-9566-fdf3a6fd7ef3 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.047143 Oct 18 13:16:07.302409 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 24/47] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:07 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:07.313281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5fae8d76-7a00-4ba0-a94b-d21923f9be0a tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:07.347421 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5fae8d76-7a00-4ba0-a94b-d21923f9be0a tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/595786916/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.043104 Oct 18 13:16:07.348546 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 25/48] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:16:07 2022] PUT /compute/v2.1/flavors/595786916/os-extra_specs/hw:numa_nodes => generated 22 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:16:07.354849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8578cf50-7236-4cf3-8d9d-ec44fdefec57 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:07.409510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-309360669", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "availability_zone": "tempest-test_az-68300975"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:07.447950 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8578cf50-7236-4cf3-8d9d-ec44fdefec57 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.095368 Oct 18 13:16:07.450221 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 26/49] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:07 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:07.476744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4c8c0e05-3086-403b-9dc4-c76920ea868b tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-502833007", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:07.487333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:07.490596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:07.491392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:07.495179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:07.497129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:07.505073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:07.561043 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4c8c0e05-3086-403b-9dc4-c76920ea868b tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.097695 Oct 18 13:16:07.569289 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 27/50] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:07 2022] POST /compute/v2.1/flavors => generated 506 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:07.572320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fc83afe7-f066-4891-8837-602a961d566e tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:07.587252 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fc83afe7-f066-4891-8837-602a961d566e tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/595786916/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022704 Oct 18 13:16:07.604511 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 28/51] 10.222.0.40 () {58 vars in 1200 bytes} [Tue Oct 18 13:16:07 2022] GET /compute/v2.1/flavors/595786916/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:16:07.617053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-92cc0e1d-0a2e-412b-a564-bf7c1bc1cb0f tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-92cc0e1d-0a2e-412b-a564-bf7c1bc1cb0f tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Request method failure captured: Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 283 Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcR7jKojjHnWBH4I647APZ1lAf6DYgLHkOCM9D6uJE_25iFoXIIru7yF3xDqm7dKdOIZgPzpnNHQU27ijmv452tInIFJfDmOyybVc5ZRBcJqeQS-wYrO7hIeMsuptqO2c4b2WvPYb1u74EW3ujR3PGv7Nz07Mhnr95Q_Dg4frWQNgY Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:07.628773 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:07.632191 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4c9bb0280e95428fac311e7981b31d67"}]}] Oct 18 13:16:07.632191 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:07.632191 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:07.632191 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:07.632191 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:07.632191 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:07.632191 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:07.632191 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 86f3a8f6212a4213b60769dfeb2bb457 Oct 18 13:16:07.632191 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:07.632191 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:16:07.632191 n-d-858384-13 devstack@n-api.service[120612]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 18 13:16:07.634335 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:07.634335 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:16:07.634335 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 18 13:16:07.634335 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:07.634335 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:07.634335 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:16:07.634335 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:16:07.634335 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:16:07.634335 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:16:07.634335 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:16:07.634335 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:16:07.637228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:16:07.639727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:16:07.639727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:16:07.639727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:16:07.639727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:16:07.639727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:16:07.639727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.639727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:07.639727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.639727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:07.639727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:07.639727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:07.639727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:16:07.639727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:16:07.643507 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:16:07.643507 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.645529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-92cc0e1d-0a2e-412b-a564-bf7c1bc1cb0f tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:07.647114 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-92cc0e1d-0a2e-412b-a564-bf7c1bc1cb0f tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.040457 Oct 18 13:16:07.672196 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 29/52] 10.222.0.40 () {60 vars in 1165 bytes} [Tue Oct 18 13:16:07 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:16:07.672196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16f5a349-4f33-4a8b-a03d-9e45c0424c47 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:07.686475 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-16f5a349-4f33-4a8b-a03d-9e45c0424c47 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/a37868f7-2186-4236-b042-dde350335f0e" status: 202 len: 0 microversion: 2.1 time: 0.024355 Oct 18 13:16:07.687323 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 30/53] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:16:07 2022] DELETE /compute/v2.1/flavors/a37868f7-2186-4236-b042-dde350335f0e => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:16:07.693988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad92c837-a7d1-4749-84e3-ad2c68ee3bd8 tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:07.727167 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad92c837-a7d1-4749-84e3-ad2c68ee3bd8 tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/595786916/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.038487 Oct 18 13:16:07.730771 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 31/54] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:16:07 2022] DELETE /compute/v2.1/flavors/595786916/os-extra_specs/hw:numa_nodes => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:07.735201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7d4a0389-2244-4343-a6e1-ada4020b6bdc tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7d4a0389-2244-4343-a6e1-ada4020b6bdc tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Request method failure captured: Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 27 Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcR7jKojjHnWBH4I647APZ1lAf6DYgLHkOCM9D6uJE_25iFoXIIru7yF3xDqm7dKdOIZgPzpnNHQU27ijmv452tInIFJfDmOyybVc5ZRBcJqeQS-wYrO7hIeMsuptqO2c4b2WvPYb1u74EW3ujR3PGv7Nz07Mhnr95Q_Dg4frWQNgY Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:07.740101 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:07.741520 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4c9bb0280e95428fac311e7981b31d67"}]}] Oct 18 13:16:07.741520 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:07.741520 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:07.741520 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:07.741520 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:07.741520 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:07.741520 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:07.741520 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 86f3a8f6212a4213b60769dfeb2bb457 Oct 18 13:16:07.741520 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:07.741520 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:16:07.741520 n-d-858384-13 devstack@n-api.service[120612]: {"aggregate": {"name": ""}} Oct 18 13:16:07.741520 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:07.741520 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi '' Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:07.742162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:16:07.750517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.756352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7d4a0389-2244-4343-a6e1-ada4020b6bdc tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:07.756352 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7d4a0389-2244-4343-a6e1-ada4020b6bdc tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.012492 Oct 18 13:16:07.756352 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 32/55] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:07 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:16:07.756352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c106c15d-b056-435f-84ca-ea0f306f5b36 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:07.770802 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c106c15d-b056-435f-84ca-ea0f306f5b36 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.027601 Oct 18 13:16:07.771401 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 33/56] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:07 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:07.776102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-616c650c-da8b-4beb-af1c-4085a0e527a4 tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:07.800163 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-616c650c-da8b-4beb-af1c-4085a0e527a4 tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/595786916/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.027547 Oct 18 13:16:07.801269 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 34/57] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:16:07 2022] DELETE /compute/v2.1/flavors/595786916/os-extra_specs/hw:cpu_policy => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:07.806271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed361d52-5c57-4b71-840f-66785347de0d tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-116007061"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:07.811312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ed361d52-5c57-4b71-840f-66785347de0d tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '38d6c86601ba4077b8bf5c4ee6c74bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89adfb0b21e04a529d26052bbe0581aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed361d52-5c57-4b71-840f-66785347de0d tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Request method failure captured: Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 59 Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcOmsCNGAbZxRz9GocwCRPlyFjvWASEFw_PWLX2PRpkvKRghRuIW5W1oRslMx5eT8aEod6rc77cRhJGaT2vLhC7cHkGO4jJfB53mVtREHHI7Ldp_7IJBumA3bTJjC1bJoWncTyjYaQKB3Euz7vUa_aXkvmFOf2tQvOL7hIohOaMgu4 Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 89adfb0b21e04a529d26052bbe0581aa Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:07.815490 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:07.817798 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_89adfb0b21e04a529d26052bbe0581aa"}]}] Oct 18 13:16:07.817798 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:07.817798 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 89adfb0b21e04a529d26052bbe0581aa Oct 18 13:16:07.817798 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:07.817798 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminNegativeTestJSON-800446552-project Oct 18 13:16:07.817798 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:07.817798 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:07.817798 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 38d6c86601ba4077b8bf5c4ee6c74bb8 Oct 18 13:16:07.817798 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-800446552-project Oct 18 13:16:07.817798 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:16:07.817798 n-d-858384-13 devstack@n-api.service[120612]: {"aggregate": {"name": "tempest-test_aggregate-116007061"}} Oct 18 13:16:07.817798 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:07.817798 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-116007061'}}} Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:07.819063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:07.820767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 18 13:16:07.822625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:07.822625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed361d52-5c57-4b71-840f-66785347de0d tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:07.822625 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ed361d52-5c57-4b71-840f-66785347de0d tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.016422 Oct 18 13:16:07.822625 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 35/58] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:07 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:07.829065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ef068f80-9b65-41d0-9405-d39fa21c0ff7 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1673322122", "id": "69871f6a-8e36-43a8-9e7a-a6228d2f754d", "os-flavor-access:is_public": "True"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:07.858549 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ef068f80-9b65-41d0-9405-d39fa21c0ff7 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.035315 Oct 18 13:16:07.858549 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 36/59] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:07 2022] POST /compute/v2.1/flavors => generated 507 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:07.864192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-45dcec9b-ee1a-4b24-a2fa-db470421d7ad tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:07.873424 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-45dcec9b-ee1a-4b24-a2fa-db470421d7ad tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/595786916/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013682 Oct 18 13:16:07.881653 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 37/60] 10.222.0.40 () {58 vars in 1200 bytes} [Tue Oct 18 13:16:07 2022] GET /compute/v2.1/flavors/595786916/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:16:07.904504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-56f22471-36b5-4019-aa6f-322828a1b3ed tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-265431421"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:07.909197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.aggregate [None req-56f22471-36b5-4019-aa6f-322828a1b3ed tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Generated uuid 25c60c05-c82c-4b25-82c1-161833a3a23c for aggregate {{(pid=120612) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:07.944845 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-56f22471-36b5-4019-aa6f-322828a1b3ed tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.054668 Oct 18 13:16:07.945492 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 38/61] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:07 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:07.960531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-db34fcf5-eeef-4f94-9b57-488ee9f99289 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:07.999945 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-db34fcf5-eeef-4f94-9b57-488ee9f99289 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/69871f6a-8e36-43a8-9e7a-a6228d2f754d" status: 202 len: 0 microversion: 2.1 time: 0.053327 Oct 18 13:16:08.005156 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 39/62] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:16:07 2022] DELETE /compute/v2.1/flavors/69871f6a-8e36-43a8-9e7a-a6228d2f754d => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:16:08.011233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d4ffa5d-f856-456a-b470-790ac19458bc tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:08.040348 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d4ffa5d-f856-456a-b470-790ac19458bc tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/595786916" status: 202 len: 0 microversion: 2.1 time: 0.033595 Oct 18 13:16:08.041109 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 40/63] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:16:08 2022] DELETE /compute/v2.1/flavors/595786916 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:16:08.050183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-518eae1d-3592-4604-97a4-d77f775d9fef tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-265431421"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:08.054162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.aggregate [None req-518eae1d-3592-4604-97a4-d77f775d9fef tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Generated uuid 7da36603-ea0c-4721-bf35-f7af6e896c1a for aggregate {{(pid=120612) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:08.067612 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-518eae1d-3592-4604-97a4-d77f775d9fef tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-265431421 already exists. Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-518eae1d-3592-4604-97a4-d77f775d9fef tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Request method failure captured: Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 59 Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcR7jKojjHnWBH4I647APZ1lAf6DYgLHkOCM9D6uJE_25iFoXIIru7yF3xDqm7dKdOIZgPzpnNHQU27ijmv452tInIFJfDmOyybVc5ZRBcJqeQS-wYrO7hIeMsuptqO2c4b2WvPYb1u74EW3ujR3PGv7Nz07Mhnr95Q_Dg4frWQNgY Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:08.071720 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:08.073067 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4c9bb0280e95428fac311e7981b31d67"}]}] Oct 18 13:16:08.073067 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:08.073067 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:08.073067 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:08.073067 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:08.073067 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:08.073067 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:08.073067 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 86f3a8f6212a4213b60769dfeb2bb457 Oct 18 13:16:08.073067 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:08.073067 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:16:08.073067 n-d-858384-13 devstack@n-api.service[120612]: {"aggregate": {"name": "tempest-test_aggregate-265431421"}} Oct 18 13:16:08.073067 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:08.073067 n-d-858384-13 devstack@n-api.service[120612]: exception: Aggregate tempest-test_aggregate-265431421 already exists. Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-265431421'}}} Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6461, in create_aggregate Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 18 13:16:08.073894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-265431421 already exists. Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:08.074928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-265431421 already exists. Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-265431421 already exists. Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-518eae1d-3592-4604-97a4-d77f775d9fef tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-265431421 already exists. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:08.076139 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-518eae1d-3592-4604-97a4-d77f775d9fef tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.031811 Oct 18 13:16:08.077003 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 41/64] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:08 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 33 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:16:08.085527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4f78fcc0-3e9d-4be6-a5ca-52e60ac64ab4 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:08.108294 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4f78fcc0-3e9d-4be6-a5ca-52e60ac64ab4 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029809 Oct 18 13:16:08.109655 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 42/65] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:08.126146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2e4a4292-921a-4f36-9442-da10647f3946 tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:08.152303 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2e4a4292-921a-4f36-9442-da10647f3946 tempest-FlavorsExtraSpecsTestJSON-1155114715 tempest-FlavorsExtraSpecsTestJSON-1155114715-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041355 Oct 18 13:16:08.153102 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 43/66] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:08.173021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-731c64d9-45dc-4037-a980-70d0f8a1fa55 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:08.188044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:DELETE=15 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:08.203478 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-731c64d9-45dc-4037-a980-70d0f8a1fa55 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.048583 Oct 18 13:16:08.204801 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 44/67] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:08 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:08.211834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c92b206e-dfd3-4e63-9c44-1e29e2bcea74 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-128052857", "id": 1725519826, "os-flavor-access:is_public": "True"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:08.237390 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c92b206e-dfd3-4e63-9c44-1e29e2bcea74 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.031168 Oct 18 13:16:08.246570 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 45/68] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:08 2022] POST /compute/v2.1/flavors => generated 413 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:08.252610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-681c6d52-dad1-4369-8baf-2db35c6cf486 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:08.253536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-681c6d52-dad1-4369-8baf-2db35c6cf486 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:08.261586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-681c6d52-dad1-4369-8baf-2db35c6cf486 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:08.262342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-681c6d52-dad1-4369-8baf-2db35c6cf486 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:08.262967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-681c6d52-dad1-4369-8baf-2db35c6cf486 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:08.263791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:16:08.264965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-681c6d52-dad1-4369-8baf-2db35c6cf486 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:08.265688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-681c6d52-dad1-4369-8baf-2db35c6cf486 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:08.266328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-681c6d52-dad1-4369-8baf-2db35c6cf486 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:08.390184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-681c6d52-dad1-4369-8baf-2db35c6cf486 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:08.405443 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-681c6d52-dad1-4369-8baf-2db35c6cf486 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1278 microversion: 2.1 time: 0.157597 Oct 18 13:16:08.408146 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 46/69] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:08 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:08.425889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a9887a70-42ce-4687-8777-b8c0c5689a52 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-409100039"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:08.430238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.aggregate [None req-a9887a70-42ce-4687-8777-b8c0c5689a52 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Generated uuid 55af3d1e-c5e5-4959-99ae-390926c12b68 for aggregate {{(pid=120612) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:08.470485 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a9887a70-42ce-4687-8777-b8c0c5689a52 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.059834 Oct 18 13:16:08.477043 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 47/70] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:08 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:08.483455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0fb5ab85-0854-484b-b3ce-46b8e062a907 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:08.501550 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0fb5ab85-0854-484b-b3ce-46b8e062a907 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/1725519826" status: 200 len: 413 microversion: 2.1 time: 0.029386 Oct 18 13:16:08.502361 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 48/71] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:16:08 2022] GET /compute/v2.1/flavors/1725519826 => generated 413 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:08.507255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e75e51f-351d-4fbf-9ffd-00f106f5e7f2 tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:08.508836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4e75e51f-351d-4fbf-9ffd-00f106f5e7f2 tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '38d6c86601ba4077b8bf5c4ee6c74bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89adfb0b21e04a529d26052bbe0581aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e75e51f-351d-4fbf-9ffd-00f106f5e7f2 tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Request method failure captured: Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcOmsCNGAbZxRz9GocwCRPlyFjvWASEFw_PWLX2PRpkvKRghRuIW5W1oRslMx5eT8aEod6rc77cRhJGaT2vLhC7cHkGO4jJfB53mVtREHHI7Ldp_7IJBumA3bTJjC1bJoWncTyjYaQKB3Euz7vUa_aXkvmFOf2tQvOL7hIohOaMgu4 Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 89adfb0b21e04a529d26052bbe0581aa Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:08.510703 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:08.511947 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_89adfb0b21e04a529d26052bbe0581aa"}]}] Oct 18 13:16:08.511947 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:08.511947 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 89adfb0b21e04a529d26052bbe0581aa Oct 18 13:16:08.511947 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:08.511947 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminNegativeTestJSON-800446552-project Oct 18 13:16:08.511947 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:08.511947 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:08.511947 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 38d6c86601ba4077b8bf5c4ee6c74bb8 Oct 18 13:16:08.511947 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-800446552-project Oct 18 13:16:08.511947 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:08.511947 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 18 13:16:08.511947 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '7'} Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:08.512506 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:08.513997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e75e51f-351d-4fbf-9ffd-00f106f5e7f2 tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:08.519692 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4e75e51f-351d-4fbf-9ffd-00f106f5e7f2 tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.016272 Oct 18 13:16:08.523338 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 49/72] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:08 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:08.726487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:16:08.727292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:16:08.727644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:16:08.728206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:16:08.728750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:16:08.749849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:08.750852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:08.751701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:08.753347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:08.754139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:08.754819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:08.793606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Getting quotas for project df5cae9601cd4b40bd657b7304b17fe2. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:16:08.804322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Getting quotas for user 0d0b91312f644348b978e07632259760 and project df5cae9601cd4b40bd657b7304b17fe2. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:16:08.821407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:16:08.827775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:16:08.921958 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f91de544-7e80-4017-821c-9d707270a2d2 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.821014 Oct 18 13:16:08.924976 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 24/73] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:16:08.939088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a1e23754-3b9b-4ddc-9ffb-7508a6990515 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:08.991711 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a1e23754-3b9b-4ddc-9ffb-7508a6990515 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.063952 Oct 18 13:16:08.994069 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 25/74] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:08 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:09.008425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1ff6819c-8f19-4f83-8451-bc81b60d4a20 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:09.009647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1ff6819c-8f19-4f83-8451-bc81b60d4a20 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:09.195992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8d3a1f94-f6cc-42f7-bdf2-21ada920a5f2 tempest-FlavorsAdminTestJSON-1740117854 tempest-FlavorsAdminTestJSON-1740117854-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:09.198643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1ff6819c-8f19-4f83-8451-bc81b60d4a20 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:09.231282 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1ff6819c-8f19-4f83-8451-bc81b60d4a20 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1240 microversion: 2.1 time: 0.233717 Oct 18 13:16:09.234069 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 26/75] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:08 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1240 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:09.248930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-74284d37-c831-4d36-bf64-6c89595806a6 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:09.285308 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-74284d37-c831-4d36-bf64-6c89595806a6 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-74284d37-c831-4d36-bf64-6c89595806a6 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Request method failure captured: Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcR7jKojjHnWBH4I647APZ1lAf6DYgLHkOCM9D6uJE_25iFoXIIru7yF3xDqm7dKdOIZgPzpnNHQU27ijmv452tInIFJfDmOyybVc5ZRBcJqeQS-wYrO7hIeMsuptqO2c4b2WvPYb1u74EW3ujR3PGv7Nz07Mhnr95Q_Dg4frWQNgY Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:16:09.290737 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:16:09.291821 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4c9bb0280e95428fac311e7981b31d67"}]}] Oct 18 13:16:09.291821 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:09.291821 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:09.291821 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:09.291821 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:09.291821 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:09.291821 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:09.291821 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 86f3a8f6212a4213b60769dfeb2bb457 Oct 18 13:16:09.291821 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:09.291821 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:09.291821 n-d-858384-13 devstack@n-api.service[120611]: exception: Aggregate -1 could not be found. Oct 18 13:16:09.291821 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '-1'} Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 13:16:09.292647 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.293917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:09.295003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:09.295003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:09.295003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:09.295003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:09.295003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 18 13:16:09.295003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.295003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-74284d37-c831-4d36-bf64-6c89595806a6 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:09.295003 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-74284d37-c831-4d36-bf64-6c89595806a6 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.057193 Oct 18 13:16:09.295003 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 27/76] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:16:09 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:16:09.310933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0e7b699f-5b1f-4075-b3de-91fa831b66d4 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1162901163"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:09.316432 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8d3a1f94-f6cc-42f7-bdf2-21ada920a5f2 tempest-FlavorsAdminTestJSON-1740117854 tempest-FlavorsAdminTestJSON-1740117854-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.781523 Oct 18 13:16:09.318502 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 50/77] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:08 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:09.319139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.aggregate [None req-0e7b699f-5b1f-4075-b3de-91fa831b66d4 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Generated uuid d2d8b976-dc05-4275-ae3a-e8c042a28883 for aggregate {{(pid=120611) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:09.345417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ca577e44-a00f-4b7c-bc38-c86c80a44e8e tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:09.357994 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0e7b699f-5b1f-4075-b3de-91fa831b66d4 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052120 Oct 18 13:16:09.358605 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 28/78] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:09.375701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6cb1841f-52b7-4ba3-91ca-8f38974a602a tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:09.377443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6cb1841f-52b7-4ba3-91ca-8f38974a602a tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '38d6c86601ba4077b8bf5c4ee6c74bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89adfb0b21e04a529d26052bbe0581aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6cb1841f-52b7-4ba3-91ca-8f38974a602a tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Request method failure captured: Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcOmsCNGAbZxRz9GocwCRPlyFjvWASEFw_PWLX2PRpkvKRghRuIW5W1oRslMx5eT8aEod6rc77cRhJGaT2vLhC7cHkGO4jJfB53mVtREHHI7Ldp_7IJBumA3bTJjC1bJoWncTyjYaQKB3Euz7vUa_aXkvmFOf2tQvOL7hIohOaMgu4 Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 89adfb0b21e04a529d26052bbe0581aa Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:16:09.379009 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:16:09.380159 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_89adfb0b21e04a529d26052bbe0581aa"}]}] Oct 18 13:16:09.380159 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:09.380159 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 89adfb0b21e04a529d26052bbe0581aa Oct 18 13:16:09.380159 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:09.380159 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AggregatesAdminNegativeTestJSON-800446552-project Oct 18 13:16:09.380159 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:09.380159 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:09.380159 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 38d6c86601ba4077b8bf5c4ee6c74bb8 Oct 18 13:16:09.380159 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-800446552-project Oct 18 13:16:09.380159 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:09.380159 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 18 13:16:09.380159 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '8'} Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:09.380741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.381662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6cb1841f-52b7-4ba3-91ca-8f38974a602a tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:09.382552 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6cb1841f-52b7-4ba3-91ca-8f38974a602a tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] 10.222.0.40 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.012362 Oct 18 13:16:09.383732 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 29/79] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 18 13:16:09 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:09.397316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-99158af4-9669-4c33-92ed-ca46654e37f2 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:09.413929 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ca577e44-a00f-4b7c-bc38-c86c80a44e8e tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1725519826" status: 202 len: 0 microversion: 2.1 time: 0.076126 Oct 18 13:16:09.414522 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 51/80] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 18 13:16:09 2022] DELETE /compute/v2.1/flavors/1725519826 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:16:09.430631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c452ea35-58c3-4caf-a6c7-1584fa8a8334 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:09.442239 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-99158af4-9669-4c33-92ed-ca46654e37f2 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.056589 Oct 18 13:16:09.451111 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 30/81] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:09 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:09.461806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b62b21d8-d3f3-4784-898b-d2ae3a6260a9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:09.462436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b62b21d8-d3f3-4784-898b-d2ae3a6260a9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:09.478758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b62b21d8-d3f3-4784-898b-d2ae3a6260a9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:09.479216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b62b21d8-d3f3-4784-898b-d2ae3a6260a9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:09.479722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b62b21d8-d3f3-4784-898b-d2ae3a6260a9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:09.481136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b62b21d8-d3f3-4784-898b-d2ae3a6260a9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:09.481420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b62b21d8-d3f3-4784-898b-d2ae3a6260a9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:09.481896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b62b21d8-d3f3-4784-898b-d2ae3a6260a9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:09.489297 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c452ea35-58c3-4caf-a6c7-1584fa8a8334 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069944 Oct 18 13:16:09.492038 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 52/82] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:09.502232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-de4aaffd-6e20-4df6-b5ac-4369731b9403 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:09.548373 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-de4aaffd-6e20-4df6-b5ac-4369731b9403 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-de4aaffd-6e20-4df6-b5ac-4369731b9403 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Request method failure captured: Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcR7jKojjHnWBH4I647APZ1lAf6DYgLHkOCM9D6uJE_25iFoXIIru7yF3xDqm7dKdOIZgPzpnNHQU27ijmv452tInIFJfDmOyybVc5ZRBcJqeQS-wYrO7hIeMsuptqO2c4b2WvPYb1u74EW3ujR3PGv7Nz07Mhnr95Q_Dg4frWQNgY Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:09.553843 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:09.554954 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4c9bb0280e95428fac311e7981b31d67"}]}] Oct 18 13:16:09.554954 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:09.554954 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:09.554954 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:09.554954 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:09.554954 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:09.554954 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:09.554954 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 86f3a8f6212a4213b60769dfeb2bb457 Oct 18 13:16:09.554954 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:09.554954 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:09.554954 n-d-858384-13 devstack@n-api.service[120612]: exception: Aggregate -1 could not be found. Oct 18 13:16:09.554954 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '-1'} Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:09.555528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 18 13:16:09.556439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.560984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-de4aaffd-6e20-4df6-b5ac-4369731b9403 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:09.562156 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-de4aaffd-6e20-4df6-b5ac-4369731b9403 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.067868 Oct 18 13:16:09.563359 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 53/83] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:09 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:16:09.569046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b198751d-8c5f-4980-b94f-dccc92417333 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1814599576", "id": 1601253561, "os-flavor-access:is_public": "False"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:09.605543 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b198751d-8c5f-4980-b94f-dccc92417333 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.038999 Oct 18 13:16:09.608217 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 54/84] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:09 2022] POST /compute/v2.1/flavors => generated 430 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:09.617434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed3fee37-8601-473b-8156-1308fe0499ee tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:09.621612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ed3fee37-8601-473b-8156-1308fe0499ee tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '38d6c86601ba4077b8bf5c4ee6c74bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89adfb0b21e04a529d26052bbe0581aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed3fee37-8601-473b-8156-1308fe0499ee tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Request method failure captured: Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcOmsCNGAbZxRz9GocwCRPlyFjvWASEFw_PWLX2PRpkvKRghRuIW5W1oRslMx5eT8aEod6rc77cRhJGaT2vLhC7cHkGO4jJfB53mVtREHHI7Ldp_7IJBumA3bTJjC1bJoWncTyjYaQKB3Euz7vUa_aXkvmFOf2tQvOL7hIohOaMgu4 Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 89adfb0b21e04a529d26052bbe0581aa Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:09.626283 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:09.627554 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_89adfb0b21e04a529d26052bbe0581aa"}]}] Oct 18 13:16:09.627554 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:09.627554 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 89adfb0b21e04a529d26052bbe0581aa Oct 18 13:16:09.627554 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:09.627554 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminNegativeTestJSON-800446552-project Oct 18 13:16:09.627554 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:09.627554 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:09.627554 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 38d6c86601ba4077b8bf5c4ee6c74bb8 Oct 18 13:16:09.627554 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-800446552-project Oct 18 13:16:09.627554 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:09.627554 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 18 13:16:09.627554 n-d-858384-13 devstack@n-api.service[120612]: action_args: {} Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:09.628217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 18 13:16:09.629396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.635870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed3fee37-8601-473b-8156-1308fe0499ee tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:09.636728 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ed3fee37-8601-473b-8156-1308fe0499ee tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.026936 Oct 18 13:16:09.637356 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 55/85] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 18 13:16:09 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:09.655385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9d64876b-58fe-4548-97ed-d9c5f09c6cfa tempest-FlavorsAdminTestJSON-1740117854 tempest-FlavorsAdminTestJSON-1740117854-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "1601253561"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:09.679855 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-9d64876b-58fe-4548-97ed-d9c5f09c6cfa tempest-FlavorsAdminTestJSON-1740117854 tempest-FlavorsAdminTestJSON-1740117854-project] HTTP exception thrown: Flavor 1601253561 could not be found. Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9d64876b-58fe-4548-97ed-d9c5f09c6cfa tempest-FlavorsAdminTestJSON-1740117854 tempest-FlavorsAdminTestJSON-1740117854-project] Request method failure captured: Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 107 Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcRPZ2F1Fi03EBoBepS1q8hP0sKa_Ai4tWYXJ6KKKnIQfLxPR41j1U13aogH86fANvSzQdBIwOJwlFPcwNTZNLm12muTzxpTySPIQ1-bwDTfIj3b7fJn_cagGChjqq90TFNTYymYeBobXB2X64MtRS33j-uRfLr7_WCw9UUB4FidGI Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 7c83940380ba4ac085e4d05ab702075b Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FlavorsAdminTestJSON-1740117854 Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:09.685951 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:09.687180 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7c83940380ba4ac085e4d05ab702075b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7c83940380ba4ac085e4d05ab702075b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7c83940380ba4ac085e4d05ab702075b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7c83940380ba4ac085e4d05ab702075b"}]}] Oct 18 13:16:09.687180 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FlavorsAdminTestJSON-1740117854 Oct 18 13:16:09.687180 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 7c83940380ba4ac085e4d05ab702075b Oct 18 13:16:09.687180 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1740117854 Oct 18 13:16:09.687180 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FlavorsAdminTestJSON-1740117854-project Oct 18 13:16:09.687180 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:09.687180 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:09.687180 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: d1bc6c1c3cde49edbd2f0eba06cd5713 Oct 18 13:16:09.687180 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FlavorsAdminTestJSON-1740117854-project Oct 18 13:16:09.687180 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:16:09.687180 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "test", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "1601253561"}} Oct 18 13:16:09.687180 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:09.687180 n-d-858384-13 devstack@n-api.service[120612]: exception: Flavor 1601253561 could not be found. Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '1601253561'}}} Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1601253561 could not be found. Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.687808 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1601253561 could not be found. Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:09.688825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:09.689855 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:09.689855 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:09.689855 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:09.689855 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1601253561 could not be found. Oct 18 13:16:09.689855 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:09.696434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9d64876b-58fe-4548-97ed-d9c5f09c6cfa tempest-FlavorsAdminTestJSON-1740117854 tempest-FlavorsAdminTestJSON-1740117854-project] Returning 400 to user: Flavor 1601253561 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:09.697506 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9d64876b-58fe-4548-97ed-d9c5f09c6cfa tempest-FlavorsAdminTestJSON-1740117854 tempest-FlavorsAdminTestJSON-1740117854-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.059153 Oct 18 13:16:09.698592 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 56/86] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:09 2022] POST /compute/v2.1/servers => generated 81 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:16:09.721670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-320eb753-698b-41da-b5f1-fd8a2b6b3956 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:09.723894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b62b21d8-d3f3-4784-898b-d2ae3a6260a9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:09.748768 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b62b21d8-d3f3-4784-898b-d2ae3a6260a9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1278 microversion: 2.1 time: 0.289960 Oct 18 13:16:09.749966 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 31/87] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:09 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1278 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:09.753274 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-320eb753-698b-41da-b5f1-fd8a2b6b3956 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1601253561" status: 202 len: 0 microversion: 2.1 time: 0.043426 Oct 18 13:16:09.753274 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 57/88] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 18 13:16:09 2022] DELETE /compute/v2.1/flavors/1601253561 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:16:09.760541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0462ff89-7ffa-4d2f-af27-e973f406d32c tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:09.816891 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0462ff89-7ffa-4d2f-af27-e973f406d32c tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059970 Oct 18 13:16:09.820856 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 58/89] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:09.854025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aa26a96b-8cf3-4f43-a17e-4a7c8addac16 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-68265157", "id": 1486775218, "os-flavor-access:is_public": "False"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:09.890477 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aa26a96b-8cf3-4f43-a17e-4a7c8addac16 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.040289 Oct 18 13:16:09.898541 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 32/90] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:09 2022] POST /compute/v2.1/flavors => generated 413 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:09.916356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-56e7d0a1-1223-4628-a9ed-10d4bb5aa415 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-352447268", "id": 2085182070, "os-flavor-access:is_public": "True"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:09.982020 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-56e7d0a1-1223-4628-a9ed-10d4bb5aa415 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.069010 Oct 18 13:16:09.982523 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 59/91] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:09 2022] POST /compute/v2.1/flavors => generated 413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:10.002550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9903466f-5d3b-4e98-a908-01645337b530 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.042541 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9903466f-5d3b-4e98-a908-01645337b530 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 416 microversion: 2.1 time: 0.047139 Oct 18 13:16:10.046784 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 33/92] 10.222.0.40 () {58 vars in 1169 bytes} [Tue Oct 18 13:16:09 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 416 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:10.064322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-63a61286-38b0-48a4-855a-d9cb736904d1 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.131066 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-63a61286-38b0-48a4-855a-d9cb736904d1 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 416 microversion: 2.1 time: 0.071295 Oct 18 13:16:10.140067 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 60/93] 10.222.0.40 () {58 vars in 1177 bytes} [Tue Oct 18 13:16:10 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 416 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:10.151666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ee2d94ad-21fa-4ac9-a490-9e9f453d9796 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.165678 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ee2d94ad-21fa-4ac9-a490-9e9f453d9796 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 416 microversion: 2.1 time: 0.022991 Oct 18 13:16:10.166811 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 34/94] 10.222.0.40 () {58 vars in 1171 bytes} [Tue Oct 18 13:16:10 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 416 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:10.182930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84bd2003-3df0-4101-82e3-95121303dbab tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.203304 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-84bd2003-3df0-4101-82e3-95121303dbab tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 416 microversion: 2.1 time: 0.024675 Oct 18 13:16:10.204972 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 61/95] 10.222.0.40 () {58 vars in 1169 bytes} [Tue Oct 18 13:16:10 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 416 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:10.219408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-76dc8b7f-65d1-4098-99ff-dc4db023d43d tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.261093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c3b1e375-ec74-419a-a98d-6bea1ed42cb3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.261759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c3b1e375-ec74-419a-a98d-6bea1ed42cb3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:10.284333 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-76dc8b7f-65d1-4098-99ff-dc4db023d43d tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.069779 Oct 18 13:16:10.286842 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 35/96] 10.222.0.40 () {58 vars in 1169 bytes} [Tue Oct 18 13:16:10 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:10.309765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-09b0f45a-b446-43f8-9e4d-87deabaff8c0 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.344289 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-09b0f45a-b446-43f8-9e4d-87deabaff8c0 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.041066 Oct 18 13:16:10.357437 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 36/97] 10.222.0.40 () {58 vars in 1175 bytes} [Tue Oct 18 13:16:10 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:10.375119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6a2b7706-28c9-4f9d-9235-fb201d80b2f0 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.427565 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6a2b7706-28c9-4f9d-9235-fb201d80b2f0 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.056530 Oct 18 13:16:10.435608 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 37/98] 10.222.0.40 () {58 vars in 1173 bytes} [Tue Oct 18 13:16:10 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:10.454572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68fa0c1e-8211-4efe-a833-620e589db86d tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.479490 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68fa0c1e-8211-4efe-a833-620e589db86d tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.030038 Oct 18 13:16:10.480486 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 38/99] 10.222.0.40 () {58 vars in 1169 bytes} [Tue Oct 18 13:16:10 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:16:10.509246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a94ed4ad-471a-4e4a-973c-09fa5414ce8e tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.542737 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a94ed4ad-471a-4e4a-973c-09fa5414ce8e tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/2085182070" status: 202 len: 0 microversion: 2.1 time: 0.041523 Oct 18 13:16:10.543709 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 39/100] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 18 13:16:10 2022] DELETE /compute/v2.1/flavors/2085182070 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:16:10.561396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b804ac07-c47d-4689-b712-1d2d522093a8 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.580568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3b1e375-ec74-419a-a98d-6bea1ed42cb3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:10.609385 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c3b1e375-ec74-419a-a98d-6bea1ed42cb3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1240 microversion: 2.1 time: 0.351701 Oct 18 13:16:10.611966 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 62/101] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:10 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1240 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:10.623139 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b804ac07-c47d-4689-b712-1d2d522093a8 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065397 Oct 18 13:16:10.629346 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 40/102] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:10.648861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a3390b7c-9743-42b3-90fb-035e84522978 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.696422 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a3390b7c-9743-42b3-90fb-035e84522978 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1486775218" status: 202 len: 0 microversion: 2.1 time: 0.054174 Oct 18 13:16:10.700753 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 63/103] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 18 13:16:10 2022] DELETE /compute/v2.1/flavors/1486775218 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:16:10.710594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bdd19ae7-d6a4-4787-8b96-827f4778c9aa tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.730375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:DELETE=12,nova_api:SELECT=77,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:10.774731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6562ebf2-adaa-4dfd-bc8c-a790e6f28e68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.775398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6562ebf2-adaa-4dfd-bc8c-a790e6f28e68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:10.797990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6562ebf2-adaa-4dfd-bc8c-a790e6f28e68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:10.804378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6562ebf2-adaa-4dfd-bc8c-a790e6f28e68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:10.805369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6562ebf2-adaa-4dfd-bc8c-a790e6f28e68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:10.806295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6562ebf2-adaa-4dfd-bc8c-a790e6f28e68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:10.806924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6562ebf2-adaa-4dfd-bc8c-a790e6f28e68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:10.810661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6562ebf2-adaa-4dfd-bc8c-a790e6f28e68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:10.814215 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bdd19ae7-d6a4-4787-8b96-827f4778c9aa tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.107672 Oct 18 13:16:10.818400 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 41/104] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:16:10.840997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3bc92d05-ff5d-48c0-b43b-66cf39ae62db tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1272161192", "id": 803003096, "os-flavor-access:is_public": "False"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:10.895563 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3bc92d05-ff5d-48c0-b43b-66cf39ae62db tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.060323 Oct 18 13:16:10.904502 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 42/105] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:10 2022] POST /compute/v2.1/flavors => generated 412 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:10.913468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-914ad226-1ea1-42c4-8d86-fd21298719eb tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:10.992493 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-914ad226-1ea1-42c4-8d86-fd21298719eb tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086219 Oct 18 13:16:10.996320 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 43/106] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:11.022477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fee92e5c-a363-482e-a507-661c3f88b310 tempest-FlavorsAdminTestJSON-1740117854 tempest-FlavorsAdminTestJSON-1740117854-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:11.126627 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fee92e5c-a363-482e-a507-661c3f88b310 tempest-FlavorsAdminTestJSON-1740117854 tempest-FlavorsAdminTestJSON-1740117854-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.116790 Oct 18 13:16:11.147529 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 44/107] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:16:11.158342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-48edcc9a-516a-40db-9f0a-7bca1886112b tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:11.193935 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-48edcc9a-516a-40db-9f0a-7bca1886112b tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/803003096" status: 202 len: 0 microversion: 2.1 time: 0.040487 Oct 18 13:16:11.194984 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 45/108] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:16:11 2022] DELETE /compute/v2.1/flavors/803003096 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:16:11.332526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6562ebf2-adaa-4dfd-bc8c-a790e6f28e68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:11.346561 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6562ebf2-adaa-4dfd-bc8c-a790e6f28e68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 0.577276 Oct 18 13:16:11.347992 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 64/109] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:10 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:11.360979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e3fdbcb4-6a21-48f0-892f-0709f1749e91 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:11.391343 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e3fdbcb4-6a21-48f0-892f-0709f1749e91 tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041557 Oct 18 13:16:11.392383 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 65/110] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:11.422572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41e14c97-2946-42d9-89a7-a608242b1e5a tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1618666644", "id": 1859870980, "os-flavor-access:is_public": "True"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:11.447177 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-41e14c97-2946-42d9-89a7-a608242b1e5a tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.038737 Oct 18 13:16:11.448101 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 66/111] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:11 2022] POST /compute/v2.1/flavors => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:11.463851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-993364a6-c4eb-4d20-a765-396c2c49a81e tempest-FlavorsAdminTestJSON-1740117854 tempest-FlavorsAdminTestJSON-1740117854-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:11.508110 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-993364a6-c4eb-4d20-a765-396c2c49a81e tempest-FlavorsAdminTestJSON-1740117854 tempest-FlavorsAdminTestJSON-1740117854-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.048790 Oct 18 13:16:11.523960 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 67/112] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:11 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:11.529367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ab1dd95c-0624-46b1-8611-198747655fda tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:11.557425 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ab1dd95c-0624-46b1-8611-198747655fda tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1859870980" status: 202 len: 0 microversion: 2.1 time: 0.031695 Oct 18 13:16:11.559088 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 68/113] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 18 13:16:11 2022] DELETE /compute/v2.1/flavors/1859870980 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:16:11.568546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b4610b8d-2612-4934-b554-d03dc06b4f3b tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:11.619391 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b4610b8d-2612-4934-b554-d03dc06b4f3b tempest-FlavorsAdminTestJSON-2099993760 tempest-FlavorsAdminTestJSON-2099993760-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055110 Oct 18 13:16:11.631785 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 69/114] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:11.645486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-91651547-99bd-4d6e-b99b-4ef872cf4354 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:11.646659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-91651547-99bd-4d6e-b99b-4ef872cf4354 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:11.655514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91651547-99bd-4d6e-b99b-4ef872cf4354 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:11.656362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91651547-99bd-4d6e-b99b-4ef872cf4354 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:11.656984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91651547-99bd-4d6e-b99b-4ef872cf4354 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:11.657975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91651547-99bd-4d6e-b99b-4ef872cf4354 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:11.658983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91651547-99bd-4d6e-b99b-4ef872cf4354 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:11.659668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91651547-99bd-4d6e-b99b-4ef872cf4354 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:11.767434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-91651547-99bd-4d6e-b99b-4ef872cf4354 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:11.788955 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-91651547-99bd-4d6e-b99b-4ef872cf4354 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1288 microversion: 2.1 time: 0.147015 Oct 18 13:16:11.802060 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 70/115] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:11 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1288 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:11.922082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bb5308bc-38c4-4c2b-8163-c8d1e3d1c5ab tempest-FlavorsV255TestJSON-852327991 tempest-FlavorsV255TestJSON-852327991-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1732457788", "id": 1478770273, "os-flavor-access:is_public": "True"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:11.958043 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bb5308bc-38c4-4c2b-8163-c8d1e3d1c5ab tempest-FlavorsV255TestJSON-852327991 tempest-FlavorsV255TestJSON-852327991-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.758235 Oct 18 13:16:11.958973 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 46/116] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:16:11 2022] POST /compute/v2.1/flavors => generated 449 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:16:12.375287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-08893127-f58f-4cbf-8362-194e20aa15ab tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:12.375877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-08893127-f58f-4cbf-8362-194e20aa15ab tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:12.392633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08893127-f58f-4cbf-8362-194e20aa15ab tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:12.393371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08893127-f58f-4cbf-8362-194e20aa15ab tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:12.393981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08893127-f58f-4cbf-8362-194e20aa15ab tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:12.395094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08893127-f58f-4cbf-8362-194e20aa15ab tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:12.395706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08893127-f58f-4cbf-8362-194e20aa15ab tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:12.396231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08893127-f58f-4cbf-8362-194e20aa15ab tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:13.192495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-08893127-f58f-4cbf-8362-194e20aa15ab tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:13.208026 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-08893127-f58f-4cbf-8362-194e20aa15ab tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 0.838607 Oct 18 13:16:13.214693 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 47/117] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:12 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:13.236535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-09504a99-6a00-4ed4-afc9-292a88a52840 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:13.237801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-09504a99-6a00-4ed4-afc9-292a88a52840 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:13.258910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09504a99-6a00-4ed4-afc9-292a88a52840 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:13.261902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09504a99-6a00-4ed4-afc9-292a88a52840 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:13.270269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09504a99-6a00-4ed4-afc9-292a88a52840 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:13.271430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09504a99-6a00-4ed4-afc9-292a88a52840 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:13.272063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09504a99-6a00-4ed4-afc9-292a88a52840 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:13.272659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09504a99-6a00-4ed4-afc9-292a88a52840 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:13.306831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8867d9a7-9c73-4152-b851-293b647eb411 tempest-FlavorsV255TestJSON-1418832834 tempest-FlavorsV255TestJSON-1418832834-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:13.325427 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8867d9a7-9c73-4152-b851-293b647eb411 tempest-FlavorsV255TestJSON-1418832834 tempest-FlavorsV255TestJSON-1418832834-project] 10.222.0.40 "GET /compute/v2.1/flavors/1478770273" status: 200 len: 449 microversion: 2.55 time: 1.355588 Oct 18 13:16:13.334882 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 71/118] 10.222.0.40 () {60 vars in 1199 bytes} [Tue Oct 18 13:16:11 2022] GET /compute/v2.1/flavors/1478770273 => generated 449 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:16:13.358472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-24a44f6f-b2b7-47a4-8a4b-1fe83b6cf397 tempest-FlavorsV255TestJSON-852327991 tempest-FlavorsV255TestJSON-852327991-project-admin] Action: 'update', calling method: .version_select at 0x7ff61575c5e0>, body: {"flavor": {"description": "new"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:13.460154 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-24a44f6f-b2b7-47a4-8a4b-1fe83b6cf397 tempest-FlavorsV255TestJSON-852327991 tempest-FlavorsV255TestJSON-852327991-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/1478770273" status: 200 len: 450 microversion: 2.55 time: 0.115544 Oct 18 13:16:13.461672 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 72/119] 10.222.0.40 () {62 vars in 1219 bytes} [Tue Oct 18 13:16:13 2022] PUT /compute/v2.1/flavors/1478770273 => generated 450 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:16:13.502891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0ec64065-ab72-4850-9a5b-35601eb65894 tempest-FlavorsV255TestJSON-1418832834 tempest-FlavorsV255TestJSON-1418832834-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:13.524784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09504a99-6a00-4ed4-afc9-292a88a52840 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:13.537613 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-09504a99-6a00-4ed4-afc9-292a88a52840 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1294 microversion: 2.1 time: 0.319357 Oct 18 13:16:13.538231 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 48/120] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:13 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1294 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:13.548125 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0ec64065-ab72-4850-9a5b-35601eb65894 tempest-FlavorsV255TestJSON-1418832834 tempest-FlavorsV255TestJSON-1418832834-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.067604 Oct 18 13:16:13.550620 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 73/121] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 18 13:16:13 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:16:13.572591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fdf6d380-ce98-4eb7-a9dc-b9f475c11500 tempest-FlavorsV255TestJSON-1418832834 tempest-FlavorsV255TestJSON-1418832834-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:13.628614 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fdf6d380-ce98-4eb7-a9dc-b9f475c11500 tempest-FlavorsV255TestJSON-1418832834 tempest-FlavorsV255TestJSON-1418832834-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.057769 Oct 18 13:16:13.631578 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 49/122] 10.222.0.40 () {60 vars in 1166 bytes} [Tue Oct 18 13:16:13 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:16:13.662965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9e03f52a-f9cb-4c36-a12e-36ab9ce099b5 tempest-FlavorsV255TestJSON-852327991 tempest-FlavorsV255TestJSON-852327991-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:13.732624 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9e03f52a-f9cb-4c36-a12e-36ab9ce099b5 tempest-FlavorsV255TestJSON-852327991 tempest-FlavorsV255TestJSON-852327991-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1478770273" status: 202 len: 0 microversion: 2.55 time: 0.075374 Oct 18 13:16:13.737482 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 74/123] 10.222.0.40 () {60 vars in 1202 bytes} [Tue Oct 18 13:16:13 2022] DELETE /compute/v2.1/flavors/1478770273 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:16:13.743412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-73bfd3a4-cd54-43f9-9fc3-dccb2beeffc3 tempest-FlavorsV255TestJSON-852327991 tempest-FlavorsV255TestJSON-852327991-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:13.788868 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-73bfd3a4-cd54-43f9-9fc3-dccb2beeffc3 tempest-FlavorsV255TestJSON-852327991 tempest-FlavorsV255TestJSON-852327991-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.048411 Oct 18 13:16:13.808511 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 50/124] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 18 13:16:13 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:16:14.245286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ae9e7e38-1d59-49b6-8629-a867579d6344 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:14.246064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ae9e7e38-1d59-49b6-8629-a867579d6344 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:14.248695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5,nova_api:DELETE=15,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:14.289261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e38-1d59-49b6-8629-a867579d6344 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:14.289261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e38-1d59-49b6-8629-a867579d6344 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:14.289261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e38-1d59-49b6-8629-a867579d6344 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:14.289261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e38-1d59-49b6-8629-a867579d6344 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:14.289884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e38-1d59-49b6-8629-a867579d6344 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:14.289884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae9e7e38-1d59-49b6-8629-a867579d6344 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:14.566926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-85207261-451e-460a-87bc-c7ccad7c5542 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:14.569077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-85207261-451e-460a-87bc-c7ccad7c5542 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:14.584022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85207261-451e-460a-87bc-c7ccad7c5542 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:14.589120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85207261-451e-460a-87bc-c7ccad7c5542 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:14.591213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85207261-451e-460a-87bc-c7ccad7c5542 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:14.592497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85207261-451e-460a-87bc-c7ccad7c5542 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:14.599675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85207261-451e-460a-87bc-c7ccad7c5542 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:14.601565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85207261-451e-460a-87bc-c7ccad7c5542 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:15.134468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-85207261-451e-460a-87bc-c7ccad7c5542 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:15.148688 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-85207261-451e-460a-87bc-c7ccad7c5542 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1294 microversion: 2.1 time: 0.585330 Oct 18 13:16:15.161205 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 51/125] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:14 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1294 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:15.465886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ae9e7e38-1d59-49b6-8629-a867579d6344 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:15.529139 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ae9e7e38-1d59-49b6-8629-a867579d6344 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 1.288158 Oct 18 13:16:15.543791 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 75/126] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:14 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:15.875836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-90dddd48-dcb1-4ca4-a6e8-a6b620c4c3ed req-73efbdf2-6105-4f11-bbb5-ae438cef6bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0004e9-bd82-4cf2-b211-924251e95184", "tag": "ea136430-53d3-4c59-9ce6-7e1a5d79d2d0"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:15.946543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-90dddd48-dcb1-4ca4-a6e8-a6b620c4c3ed req-73efbdf2-6105-4f11-bbb5-ae438cef6bbf service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:15.947037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-90dddd48-dcb1-4ca4-a6e8-a6b620c4c3ed req-73efbdf2-6105-4f11-bbb5-ae438cef6bbf service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:15.953406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-90dddd48-dcb1-4ca4-a6e8-a6b620c4c3ed req-73efbdf2-6105-4f11-bbb5-ae438cef6bbf service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:16.054352 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-90dddd48-dcb1-4ca4-a6e8-a6b620c4c3ed req-73efbdf2-6105-4f11-bbb5-ae438cef6bbf service nova] Creating event network-changed:ea136430-53d3-4c59-9ce6-7e1a5d79d2d0 for instance 0d0004e9-bd82-4cf2-b211-924251e95184 on n-h1-858384-13 Oct 18 13:16:16.057690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-90dddd48-dcb1-4ca4-a6e8-a6b620c4c3ed req-73efbdf2-6105-4f11-bbb5-ae438cef6bbf service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:16:16.063880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-90dddd48-dcb1-4ca4-a6e8-a6b620c4c3ed req-73efbdf2-6105-4f11-bbb5-ae438cef6bbf service nova] Acquired lock "compute-rpcapi-router" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:16:16.067735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d1f3596-dbbf-4617-b829-cde150909345 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:16.068658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d1f3596-dbbf-4617-b829-cde150909345 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:16.071668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d1f3596-dbbf-4617-b829-cde150909345 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:16.074553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d1f3596-dbbf-4617-b829-cde150909345 None None] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:16.077978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d1f3596-dbbf-4617-b829-cde150909345 None None] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:16.079649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d1f3596-dbbf-4617-b829-cde150909345 None None] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:16.121899 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.compute.rpcapi [None req-9d1f3596-dbbf-4617-b829-cde150909345 None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 18 13:16:16.127468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d1f3596-dbbf-4617-b829-cde150909345 None None] Releasing lock "compute-rpcapi-router" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:16:16.179187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6fcaf706-14b6-4616-a714-2d4a2b8c54d9 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:16.180764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6fcaf706-14b6-4616-a714-2d4a2b8c54d9 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:16.195876 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d1f3596-dbbf-4617-b829-cde150909345 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.658559 Oct 18 13:16:16.197821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fcaf706-14b6-4616-a714-2d4a2b8c54d9 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:16.200987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fcaf706-14b6-4616-a714-2d4a2b8c54d9 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:16.201825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fcaf706-14b6-4616-a714-2d4a2b8c54d9 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:16.202289 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 52/127] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:16.204216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fcaf706-14b6-4616-a714-2d4a2b8c54d9 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:16.204813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fcaf706-14b6-4616-a714-2d4a2b8c54d9 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:16.207899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fcaf706-14b6-4616-a714-2d4a2b8c54d9 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:16.495173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d1f3596-dbbf-4617-b829-cde150909345 None None] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:16.496228 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d1f3596-dbbf-4617-b829-cde150909345 None None] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001903 Oct 18 13:16:16.496848 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 53/128] 10.222.0.40 () {56 vars in 886 bytes} [Tue Oct 18 13:16:16 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 13:16:16.559823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f3c0ee4c-a5cc-49e8-a09e-ca991de6b529 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:16.560705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f3c0ee4c-a5cc-49e8-a09e-ca991de6b529 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:16.588149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3c0ee4c-a5cc-49e8-a09e-ca991de6b529 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:16.588868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3c0ee4c-a5cc-49e8-a09e-ca991de6b529 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:16.589496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3c0ee4c-a5cc-49e8-a09e-ca991de6b529 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:16.590717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3c0ee4c-a5cc-49e8-a09e-ca991de6b529 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:16.591921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3c0ee4c-a5cc-49e8-a09e-ca991de6b529 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:16.592638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3c0ee4c-a5cc-49e8-a09e-ca991de6b529 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:17.197311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:17.270170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6fcaf706-14b6-4616-a714-2d4a2b8c54d9 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:17.284509 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6fcaf706-14b6-4616-a714-2d4a2b8c54d9 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 1.107013 Oct 18 13:16:17.298289 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 76/129] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:16 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:17.987959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f3c0ee4c-a5cc-49e8-a09e-ca991de6b529 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:18.003906 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f3c0ee4c-a5cc-49e8-a09e-ca991de6b529 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 1.451458 Oct 18 13:16:18.021388 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 54/130] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:16 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:18.312988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-39bfe7c4-d77f-46c2-a5a5-448070a4f922 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:18.314267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-39bfe7c4-d77f-46c2-a5a5-448070a4f922 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:18.321546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39bfe7c4-d77f-46c2-a5a5-448070a4f922 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:18.324211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39bfe7c4-d77f-46c2-a5a5-448070a4f922 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:18.327836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39bfe7c4-d77f-46c2-a5a5-448070a4f922 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:18.330105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39bfe7c4-d77f-46c2-a5a5-448070a4f922 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:18.333149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39bfe7c4-d77f-46c2-a5a5-448070a4f922 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:18.333765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39bfe7c4-d77f-46c2-a5a5-448070a4f922 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:18.820220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-39bfe7c4-d77f-46c2-a5a5-448070a4f922 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:18.833279 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-39bfe7c4-d77f-46c2-a5a5-448070a4f922 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.524998 Oct 18 13:16:18.834281 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 77/131] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:18 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:19.037207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b2e68154-c6c6-40db-9d5c-5c1b55a0be66 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:19.039435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b2e68154-c6c6-40db-9d5c-5c1b55a0be66 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:19.085686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2e68154-c6c6-40db-9d5c-5c1b55a0be66 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:19.086648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2e68154-c6c6-40db-9d5c-5c1b55a0be66 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:19.091599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2e68154-c6c6-40db-9d5c-5c1b55a0be66 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:19.094961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2e68154-c6c6-40db-9d5c-5c1b55a0be66 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:19.095643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2e68154-c6c6-40db-9d5c-5c1b55a0be66 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:19.099571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2e68154-c6c6-40db-9d5c-5c1b55a0be66 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:19.221668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=8 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:19.862124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-727bffb2-2d88-495e-b5d5-061cdea89f34 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:19.863448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-727bffb2-2d88-495e-b5d5-061cdea89f34 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:19.878230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-727bffb2-2d88-495e-b5d5-061cdea89f34 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:19.882456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-727bffb2-2d88-495e-b5d5-061cdea89f34 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:19.883161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-727bffb2-2d88-495e-b5d5-061cdea89f34 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:19.885476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-727bffb2-2d88-495e-b5d5-061cdea89f34 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:19.887668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-727bffb2-2d88-495e-b5d5-061cdea89f34 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:19.888700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-727bffb2-2d88-495e-b5d5-061cdea89f34 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:20.316737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-727bffb2-2d88-495e-b5d5-061cdea89f34 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:20.337031 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-727bffb2-2d88-495e-b5d5-061cdea89f34 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.478704 Oct 18 13:16:20.341659 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 78/132] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:19 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:20.435418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b2e68154-c6c6-40db-9d5c-5c1b55a0be66 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:20.448309 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b2e68154-c6c6-40db-9d5c-5c1b55a0be66 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 1.416049 Oct 18 13:16:20.449165 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 55/133] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:19 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:20.591322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=10 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:21.150406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e1f660f-1ce5-4383-b056-5380b71916f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-192433016", "ram": 512, "vcpus": 1, "disk": 10, "id": 878350409, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:21.185584 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4e1f660f-1ce5-4383-b056-5380b71916f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.840972 Oct 18 13:16:21.188095 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 79/134] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:20 2022] POST /compute/v2.1/flavors => generated 412 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:21.396383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-466924f2-e1f7-40df-8aad-4806b5590579 req-25b35f35-654e-4848-bc11-bfcd11d76515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4749485a-14ea-47b4-a16a-42da495ebb0f", "tag": "47a6d7f0-df4a-470d-94e7-a450badcb884"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:21.415705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-466924f2-e1f7-40df-8aad-4806b5590579 req-25b35f35-654e-4848-bc11-bfcd11d76515 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:21.425714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-466924f2-e1f7-40df-8aad-4806b5590579 req-25b35f35-654e-4848-bc11-bfcd11d76515 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:21.426415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-466924f2-e1f7-40df-8aad-4806b5590579 req-25b35f35-654e-4848-bc11-bfcd11d76515 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:21.469070 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-466924f2-e1f7-40df-8aad-4806b5590579 req-25b35f35-654e-4848-bc11-bfcd11d76515 service nova] Creating event network-changed:47a6d7f0-df4a-470d-94e7-a450badcb884 for instance 4749485a-14ea-47b4-a16a-42da495ebb0f on n-h2-858384-13 Oct 18 13:16:21.516520 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-466924f2-e1f7-40df-8aad-4806b5590579 req-25b35f35-654e-4848-bc11-bfcd11d76515 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.730057 Oct 18 13:16:21.519744 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 56/135] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:21.532205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-63df944d-5786-40e2-a48e-cf8cbf7f5d60 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:21.541821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-63df944d-5786-40e2-a48e-cf8cbf7f5d60 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:21.556720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63df944d-5786-40e2-a48e-cf8cbf7f5d60 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:21.560524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63df944d-5786-40e2-a48e-cf8cbf7f5d60 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:21.561155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63df944d-5786-40e2-a48e-cf8cbf7f5d60 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:21.562114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63df944d-5786-40e2-a48e-cf8cbf7f5d60 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:21.562727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63df944d-5786-40e2-a48e-cf8cbf7f5d60 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:21.565088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63df944d-5786-40e2-a48e-cf8cbf7f5d60 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:22.120374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ee710616-4b66-4a5a-8a55-aaae2967b7e4 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:22.146009 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-ee710616-4b66-4a5a-8a55-aaae2967b7e4 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] HTTP exception thrown: Flavor 878350409 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ee710616-4b66-4a5a-8a55-aaae2967b7e4 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Request method failure captured: Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/flavors/878350409/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqciIaIRjNHonKa3ANVxDP2XT1f1n1CeIqtxs9alx09BvI8ON72GgHh6lt96Xt1hZqxRLJbqnM4CptHTelnixIfO6d9GYKxRCMMNocJRzlIXefBA4NCZLtquBcd6cZI9XsyqDMWRxwQ9dlWO_WeP-u5SqQnfCcBmAgxNUtSpXKVZFW8 Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 9eac650ea0c84f10a2e0cadcbe01ec86 Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:22.148549 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:22.149742 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9eac650ea0c84f10a2e0cadcbe01ec86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9eac650ea0c84f10a2e0cadcbe01ec86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9eac650ea0c84f10a2e0cadcbe01ec86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9eac650ea0c84f10a2e0cadcbe01ec86"}]}] Oct 18 13:16:22.149742 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 Oct 18 13:16:22.149742 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 9eac650ea0c84f10a2e0cadcbe01ec86 Oct 18 13:16:22.149742 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 Oct 18 13:16:22.149742 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project Oct 18 13:16:22.149742 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:22.149742 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:22.149742 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 1d1203de363a4fb4978791b60454e81e Oct 18 13:16:22.149742 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project Oct 18 13:16:22.149742 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:22.149742 n-d-858384-13 devstack@n-api.service[120612]: exception: Flavor 878350409 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'flavor_id': '878350409', 'id': 'hw:cpu_thread_policy'} Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 878350409 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:22.150358 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.152018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.152018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.152018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.152018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:22.152018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:22.152018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 878350409 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:16:22.152018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.164698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ee710616-4b66-4a5a-8a55-aaae2967b7e4 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Returning 404 to user: Flavor 878350409 has no extra specs with key hw:cpu_thread_policy. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:22.166286 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ee710616-4b66-4a5a-8a55-aaae2967b7e4 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] 10.222.0.40 "GET /compute/v2.1/flavors/878350409/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.961493 Oct 18 13:16:22.169278 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 80/136] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:16:21 2022] GET /compute/v2.1/flavors/878350409/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 964 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:16:22.182770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2fde13a6-ce5c-4901-93fa-a05ddb4fdc14 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:22.189050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2fde13a6-ce5c-4901-93fa-a05ddb4fdc14 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:22.209870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fde13a6-ce5c-4901-93fa-a05ddb4fdc14 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:22.212649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fde13a6-ce5c-4901-93fa-a05ddb4fdc14 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:22.216907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fde13a6-ce5c-4901-93fa-a05ddb4fdc14 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:22.219370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fde13a6-ce5c-4901-93fa-a05ddb4fdc14 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:22.221476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fde13a6-ce5c-4901-93fa-a05ddb4fdc14 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:22.224930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fde13a6-ce5c-4901-93fa-a05ddb4fdc14 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:22.246094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-63df944d-5786-40e2-a48e-cf8cbf7f5d60 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:22.263545 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-63df944d-5786-40e2-a48e-cf8cbf7f5d60 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.742299 Oct 18 13:16:22.272613 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 57/137] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:21 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:22.314185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e87371c2-cd76-447c-9176-43cb8188c574 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:22.339916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e87371c2-cd76-447c-9176-43cb8188c574 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '1d1203de363a4fb4978791b60454e81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eac650ea0c84f10a2e0cadcbe01ec86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e87371c2-cd76-447c-9176-43cb8188c574 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Request method failure captured: Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/flavors/878350409/os-extra_specs HTTP/1.1 Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 66 Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqciIaIRjNHonKa3ANVxDP2XT1f1n1CeIqtxs9alx09BvI8ON72GgHh6lt96Xt1hZqxRLJbqnM4CptHTelnixIfO6d9GYKxRCMMNocJRzlIXefBA4NCZLtquBcd6cZI9XsyqDMWRxwQ9dlWO_WeP-u5SqQnfCcBmAgxNUtSpXKVZFW8 Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 9eac650ea0c84f10a2e0cadcbe01ec86 Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:16:22.353920 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:16:22.355319 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9eac650ea0c84f10a2e0cadcbe01ec86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9eac650ea0c84f10a2e0cadcbe01ec86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9eac650ea0c84f10a2e0cadcbe01ec86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9eac650ea0c84f10a2e0cadcbe01ec86"}]}] Oct 18 13:16:22.355319 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 Oct 18 13:16:22.355319 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 9eac650ea0c84f10a2e0cadcbe01ec86 Oct 18 13:16:22.355319 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 Oct 18 13:16:22.355319 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project Oct 18 13:16:22.355319 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:22.355319 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:22.355319 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1d1203de363a4fb4978791b60454e81e Oct 18 13:16:22.355319 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project Oct 18 13:16:22.355319 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:16:22.355319 n-d-858384-13 devstack@n-api.service[120611]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 18 13:16:22.355319 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'flavor_id': '878350409', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:22.356685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 18 13:16:22.357800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.360315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e87371c2-cd76-447c-9176-43cb8188c574 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:22.365908 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e87371c2-cd76-447c-9176-43cb8188c574 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] 10.222.0.40 "POST /compute/v2.1/flavors/878350409/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.080702 Oct 18 13:16:22.369889 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 58/138] 10.222.0.40 () {60 vars in 1221 bytes} [Tue Oct 18 13:16:22 2022] POST /compute/v2.1/flavors/878350409/os-extra_specs => generated 124 bytes in 87 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:22.380747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93f0f152-a3f9-4912-92e9-aca4762f5efe tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:22.475928 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-93f0f152-a3f9-4912-92e9-aca4762f5efe tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/878350409/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.096486 Oct 18 13:16:22.477940 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 59/139] 10.222.0.40 () {60 vars in 1221 bytes} [Tue Oct 18 13:16:22 2022] POST /compute/v2.1/flavors/878350409/os-extra_specs => generated 66 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:16:22.500016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f299e6a9-5aa8-44a8-b0af-98704b207759 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:22.504289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f299e6a9-5aa8-44a8-b0af-98704b207759 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '1d1203de363a4fb4978791b60454e81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eac650ea0c84f10a2e0cadcbe01ec86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f299e6a9-5aa8-44a8-b0af-98704b207759 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Request method failure captured: Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/flavors/878350409/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqciIaIRjNHonKa3ANVxDP2XT1f1n1CeIqtxs9alx09BvI8ON72GgHh6lt96Xt1hZqxRLJbqnM4CptHTelnixIfO6d9GYKxRCMMNocJRzlIXefBA4NCZLtquBcd6cZI9XsyqDMWRxwQ9dlWO_WeP-u5SqQnfCcBmAgxNUtSpXKVZFW8 Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 9eac650ea0c84f10a2e0cadcbe01ec86 Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:16:22.506219 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:16:22.507374 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9eac650ea0c84f10a2e0cadcbe01ec86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9eac650ea0c84f10a2e0cadcbe01ec86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9eac650ea0c84f10a2e0cadcbe01ec86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9eac650ea0c84f10a2e0cadcbe01ec86"}]}] Oct 18 13:16:22.507374 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 Oct 18 13:16:22.507374 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 9eac650ea0c84f10a2e0cadcbe01ec86 Oct 18 13:16:22.507374 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 Oct 18 13:16:22.507374 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project Oct 18 13:16:22.507374 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:22.507374 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:22.507374 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1d1203de363a4fb4978791b60454e81e Oct 18 13:16:22.507374 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project Oct 18 13:16:22.507374 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:22.507374 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'flavor_id': '878350409', 'id': 'hw:numa_nodes'} Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:22.507926 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 18 13:16:22.508875 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.511208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f299e6a9-5aa8-44a8-b0af-98704b207759 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:22.513753 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f299e6a9-5aa8-44a8-b0af-98704b207759 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] 10.222.0.40 "DELETE /compute/v2.1/flavors/878350409/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.029213 Oct 18 13:16:22.515071 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 60/140] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:16:22 2022] DELETE /compute/v2.1/flavors/878350409/os-extra_specs/hw:numa_nodes => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:22.536623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d7049f8-0385-4a9b-bf8b-5367af31c01b tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:22.603609 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d7049f8-0385-4a9b-bf8b-5367af31c01b tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/878350409/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.081123 Oct 18 13:16:22.605243 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 61/141] 10.222.0.40 () {60 vars in 1221 bytes} [Tue Oct 18 13:16:22 2022] POST /compute/v2.1/flavors/878350409/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:16:22.620502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cc1a9263-68b7-4fa9-8a1a-ce31fbb74bf4 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:22.627856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cc1a9263-68b7-4fa9-8a1a-ce31fbb74bf4 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '1d1203de363a4fb4978791b60454e81e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eac650ea0c84f10a2e0cadcbe01ec86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cc1a9263-68b7-4fa9-8a1a-ce31fbb74bf4 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Request method failure captured: Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: request: PUT /compute/v2.1/flavors/878350409/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 22 Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqciIaIRjNHonKa3ANVxDP2XT1f1n1CeIqtxs9alx09BvI8ON72GgHh6lt96Xt1hZqxRLJbqnM4CptHTelnixIfO6d9GYKxRCMMNocJRzlIXefBA4NCZLtquBcd6cZI9XsyqDMWRxwQ9dlWO_WeP-u5SqQnfCcBmAgxNUtSpXKVZFW8 Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 9eac650ea0c84f10a2e0cadcbe01ec86 Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:16:22.636690 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:16:22.638791 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9eac650ea0c84f10a2e0cadcbe01ec86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9eac650ea0c84f10a2e0cadcbe01ec86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9eac650ea0c84f10a2e0cadcbe01ec86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9eac650ea0c84f10a2e0cadcbe01ec86"}]}] Oct 18 13:16:22.638791 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 Oct 18 13:16:22.638791 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 9eac650ea0c84f10a2e0cadcbe01ec86 Oct 18 13:16:22.638791 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 Oct 18 13:16:22.638791 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project Oct 18 13:16:22.638791 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:22.638791 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:22.638791 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1d1203de363a4fb4978791b60454e81e Oct 18 13:16:22.638791 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project Oct 18 13:16:22.638791 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:16:22.638791 n-d-858384-13 devstack@n-api.service[120611]: {"hw:numa_nodes": "1"} Oct 18 13:16:22.638791 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:22.638791 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'flavor_id': '878350409', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:22.639541 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 18 13:16:22.640457 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.648305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cc1a9263-68b7-4fa9-8a1a-ce31fbb74bf4 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:22.650898 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cc1a9263-68b7-4fa9-8a1a-ce31fbb74bf4 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286 tempest-FlavorsExtraSpecsNegativeTestJSON-190698286-project] 10.222.0.40 "PUT /compute/v2.1/flavors/878350409/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.037353 Oct 18 13:16:22.664519 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 62/142] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:16:22 2022] PUT /compute/v2.1/flavors/878350409/os-extra_specs/hw:numa_nodes => generated 124 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:22.676527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8af4baed-e0f2-444f-8b2d-c6cff85f7985 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:22.702288 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-8af4baed-e0f2-444f-8b2d-c6cff85f7985 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] HTTP exception thrown: Flavor 878350409 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8af4baed-e0f2-444f-8b2d-c6cff85f7985 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Request method failure captured: Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/flavors/878350409/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcjQw3Vgpl9GaXmd5ynUU7n0jnoHTWDLz8LuaKyp6c5r2fi4EtQG_WuKDyzYM0BgGuLv7t6ahlXrpax1woEXKkZpTdfYeXhPbipkBbC9Jtn5Ji9U2LwP8fHfXxpjZsRg0AgYqPxvTcnCxlXkJwXuVeOW5y9wDuwJrlWwuYa04J61Vo Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 16bf7c4850d3420e875863ed18bbf6f6 Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:16:22.707000 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:16:22.708326 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/16bf7c4850d3420e875863ed18bbf6f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/16bf7c4850d3420e875863ed18bbf6f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/16bf7c4850d3420e875863ed18bbf6f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_16bf7c4850d3420e875863ed18bbf6f6"}]}] Oct 18 13:16:22.708326 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 Oct 18 13:16:22.708326 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 16bf7c4850d3420e875863ed18bbf6f6 Oct 18 13:16:22.708326 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 Oct 18 13:16:22.708326 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin Oct 18 13:16:22.708326 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:22.708326 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:22.708326 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e3f2f9d192c247a7b328fd84fe1420b5 Oct 18 13:16:22.708326 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin Oct 18 13:16:22.708326 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:22.708326 n-d-858384-13 devstack@n-api.service[120611]: exception: Flavor 878350409 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'flavor_id': '878350409', 'id': 'hw:cpu_thread_policy'} Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 878350409 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:22.709018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.710228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.710228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.710228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.710228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:22.710228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:22.710228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 878350409 has no extra specs with key hw:cpu_thread_policy. Oct 18 13:16:22.710228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.719314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8af4baed-e0f2-444f-8b2d-c6cff85f7985 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Returning 404 to user: Flavor 878350409 has no extra specs with key hw:cpu_thread_policy. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:22.724476 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8af4baed-e0f2-444f-8b2d-c6cff85f7985 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/878350409/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.055051 Oct 18 13:16:22.725813 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 63/143] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 18 13:16:22 2022] DELETE /compute/v2.1/flavors/878350409/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:22.742217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-caf28a01-4776-4fa9-a122-ee0903329484 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:22.760153 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-caf28a01-4776-4fa9-a122-ee0903329484 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-caf28a01-4776-4fa9-a122-ee0903329484 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Request method failure captured: Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: request: PUT /compute/v2.1/flavors/878350409/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 27 Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcjQw3Vgpl9GaXmd5ynUU7n0jnoHTWDLz8LuaKyp6c5r2fi4EtQG_WuKDyzYM0BgGuLv7t6ahlXrpax1woEXKkZpTdfYeXhPbipkBbC9Jtn5Ji9U2LwP8fHfXxpjZsRg0AgYqPxvTcnCxlXkJwXuVeOW5y9wDuwJrlWwuYa04J61Vo Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 16bf7c4850d3420e875863ed18bbf6f6 Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:16:22.765361 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:16:22.766550 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/16bf7c4850d3420e875863ed18bbf6f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/16bf7c4850d3420e875863ed18bbf6f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/16bf7c4850d3420e875863ed18bbf6f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_16bf7c4850d3420e875863ed18bbf6f6"}]}] Oct 18 13:16:22.766550 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 Oct 18 13:16:22.766550 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 16bf7c4850d3420e875863ed18bbf6f6 Oct 18 13:16:22.766550 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 Oct 18 13:16:22.766550 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin Oct 18 13:16:22.766550 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:22.766550 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:22.766550 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e3f2f9d192c247a7b328fd84fe1420b5 Oct 18 13:16:22.766550 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin Oct 18 13:16:22.766550 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:16:22.766550 n-d-858384-13 devstack@n-api.service[120611]: {"hw:cpu_policy": "shared"} Oct 18 13:16:22.766550 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:22.766550 n-d-858384-13 devstack@n-api.service[120611]: exception: Request body and URI mismatch Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'flavor_id': '878350409', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.767502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.768517 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:22.768517 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:22.768517 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 18 13:16:22.768517 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.773164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-caf28a01-4776-4fa9-a122-ee0903329484 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:22.778002 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-caf28a01-4776-4fa9-a122-ee0903329484 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/878350409/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.043788 Oct 18 13:16:22.779173 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 64/144] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:16:22 2022] PUT /compute/v2.1/flavors/878350409/os-extra_specs/hw:numa_nodes => generated 73 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 18 13:16:22.808775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-45166635-55d8-4a9b-897d-a532fc3584d2 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-45166635-55d8-4a9b-897d-a532fc3584d2 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Request method failure captured: Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: request: PUT /compute/v2.1/flavors/878350409/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 49 Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcjQw3Vgpl9GaXmd5ynUU7n0jnoHTWDLz8LuaKyp6c5r2fi4EtQG_WuKDyzYM0BgGuLv7t6ahlXrpax1woEXKkZpTdfYeXhPbipkBbC9Jtn5Ji9U2LwP8fHfXxpjZsRg0AgYqPxvTcnCxlXkJwXuVeOW5y9wDuwJrlWwuYa04J61Vo Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 16bf7c4850d3420e875863ed18bbf6f6 Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:16:22.826969 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:16:22.828366 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/16bf7c4850d3420e875863ed18bbf6f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/16bf7c4850d3420e875863ed18bbf6f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/16bf7c4850d3420e875863ed18bbf6f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_16bf7c4850d3420e875863ed18bbf6f6"}]}] Oct 18 13:16:22.828366 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 Oct 18 13:16:22.828366 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 16bf7c4850d3420e875863ed18bbf6f6 Oct 18 13:16:22.828366 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 Oct 18 13:16:22.828366 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin Oct 18 13:16:22.828366 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:22.828366 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:22.828366 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e3f2f9d192c247a7b328fd84fe1420b5 Oct 18 13:16:22.828366 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin Oct 18 13:16:22.828366 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:16:22.828366 n-d-858384-13 devstack@n-api.service[120611]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 18 13:16:22.828366 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'flavor_id': '878350409', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance: Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 18 13:16:22.829049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.832731 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:22.833835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:22.833835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:22.833835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:16:22.833835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:16:22.833835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 18 13:16:22.833835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:22.836985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-45166635-55d8-4a9b-897d-a532fc3584d2 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:22.838265 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-45166635-55d8-4a9b-897d-a532fc3584d2 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/878350409/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.050468 Oct 18 13:16:22.839263 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 65/145] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:16:22 2022] PUT /compute/v2.1/flavors/878350409/os-extra_specs/hw:numa_nodes => generated 117 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:16:22.855192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-42bb7918-7518-4b80-a272-c444de6bca68 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:22.913445 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-42bb7918-7518-4b80-a272-c444de6bca68 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/878350409" status: 202 len: 0 microversion: 2.1 time: 0.064304 Oct 18 13:16:22.937773 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 66/146] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:16:22 2022] DELETE /compute/v2.1/flavors/878350409 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:16:22.953349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b9abdc8e-6b22-4a23-98a0-7897cca55596 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:23.005719 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b9abdc8e-6b22-4a23-98a0-7897cca55596 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294 tempest-FlavorsExtraSpecsNegativeTestJSON-1702260294-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059325 Oct 18 13:16:23.006324 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 67/147] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:23.299271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8d3bdde2-c045-45fb-b6f9-e5dfa5c9d182 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:23.300193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8d3bdde2-c045-45fb-b6f9-e5dfa5c9d182 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:23.328070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d3bdde2-c045-45fb-b6f9-e5dfa5c9d182 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:23.328573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d3bdde2-c045-45fb-b6f9-e5dfa5c9d182 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:23.329011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d3bdde2-c045-45fb-b6f9-e5dfa5c9d182 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:23.337623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d3bdde2-c045-45fb-b6f9-e5dfa5c9d182 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:23.339703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d3bdde2-c045-45fb-b6f9-e5dfa5c9d182 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:23.340188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d3bdde2-c045-45fb-b6f9-e5dfa5c9d182 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:23.791152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2fde13a6-ce5c-4901-93fa-a05ddb4fdc14 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:23.816002 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2fde13a6-ce5c-4901-93fa-a05ddb4fdc14 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 1.644913 Oct 18 13:16:23.830895 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 81/148] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:22 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:23.967639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8d3bdde2-c045-45fb-b6f9-e5dfa5c9d182 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:23.978820 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8d3bdde2-c045-45fb-b6f9-e5dfa5c9d182 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.687205 Oct 18 13:16:23.983765 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 68/149] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:23 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:24.842963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3db9cc39-b7f8-4096-ae63-906e6a774b50 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:24.844282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3db9cc39-b7f8-4096-ae63-906e6a774b50 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:24.870189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3db9cc39-b7f8-4096-ae63-906e6a774b50 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:24.873119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3db9cc39-b7f8-4096-ae63-906e6a774b50 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:24.873770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3db9cc39-b7f8-4096-ae63-906e6a774b50 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:24.876738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3db9cc39-b7f8-4096-ae63-906e6a774b50 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:24.883386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3db9cc39-b7f8-4096-ae63-906e6a774b50 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:24.884642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3db9cc39-b7f8-4096-ae63-906e6a774b50 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:25.555388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3db9cc39-b7f8-4096-ae63-906e6a774b50 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:25.571134 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3db9cc39-b7f8-4096-ae63-906e6a774b50 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 0.731690 Oct 18 13:16:25.576847 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 82/150] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:24 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:25.597774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d9653d5b-f77f-4454-b90e-2ab8b31ec3e6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:25.599958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d9653d5b-f77f-4454-b90e-2ab8b31ec3e6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:25.638381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9653d5b-f77f-4454-b90e-2ab8b31ec3e6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:25.645245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9653d5b-f77f-4454-b90e-2ab8b31ec3e6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:25.646735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9653d5b-f77f-4454-b90e-2ab8b31ec3e6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:25.655208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9653d5b-f77f-4454-b90e-2ab8b31ec3e6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:25.662579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9653d5b-f77f-4454-b90e-2ab8b31ec3e6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:25.670735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9653d5b-f77f-4454-b90e-2ab8b31ec3e6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:25.916478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Calling method '.version_select at 0x7ff614325f70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:25.926285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:25.926794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:25.927242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:26.024888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:26.028409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:26.031031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:26.166660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=8 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:26.187323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:26.189571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:26.190461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:26.222703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:26.226974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:26.227602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:26.290010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:26.290508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:26.290948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:26.304875 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f2a4c21e-0f97-402e-941e-3f521bb76086 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1761 microversion: 2.53 time: 1.452251 Oct 18 13:16:26.306266 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 69/151] 10.222.0.40 () {60 vars in 1243 bytes} [Tue Oct 18 13:16:24 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1761 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:16:26.329039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Calling method '.version_select at 0x7ff614345a60>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:26.338809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:26.342867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:26.346325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:26.365755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:26.366567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:26.367191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:26.391866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:26.412998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d9653d5b-f77f-4454-b90e-2ab8b31ec3e6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:26.428705 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d9653d5b-f77f-4454-b90e-2ab8b31ec3e6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.848722 Oct 18 13:16:26.438212 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 83/152] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:25 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:26.464839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:26.475973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:26.476995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:26.573875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:26.575320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:26.576159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:26.693203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:26.693763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:26.694208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:26.741617 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-60bc763e-8686-4c35-8017-2d17762030cd tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 451 microversion: 2.53 time: 0.418442 Oct 18 13:16:26.746168 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 70/153] 10.222.0.40 () {60 vars in 1222 bytes} [Tue Oct 18 13:16:26 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 451 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:16:26.767329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-16e295d8-c2a3-49cd-9a73-bbaefca66a68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:26.781576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-16e295d8-c2a3-49cd-9a73-bbaefca66a68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:26.809781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16e295d8-c2a3-49cd-9a73-bbaefca66a68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:26.813436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16e295d8-c2a3-49cd-9a73-bbaefca66a68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:26.816924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16e295d8-c2a3-49cd-9a73-bbaefca66a68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:26.819869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16e295d8-c2a3-49cd-9a73-bbaefca66a68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:26.833446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16e295d8-c2a3-49cd-9a73-bbaefca66a68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:26.836432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16e295d8-c2a3-49cd-9a73-bbaefca66a68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:27.244799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-08732f65-0db2-49a7-87d9-704b6d74e2d5 tempest-FlavorsV261TestJSON-1423170156 tempest-FlavorsV261TestJSON-1423170156-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1497044011", "id": 61836743, "os-flavor-access:is_public": "True"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:27.288389 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-08732f65-0db2-49a7-87d9-704b6d74e2d5 tempest-FlavorsV261TestJSON-1423170156 tempest-FlavorsV261TestJSON-1423170156-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 462 microversion: 2.61 time: 0.818896 Oct 18 13:16:27.290901 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 84/154] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:16:26 2022] POST /compute/v2.1/flavors => generated 462 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:16:27.302772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-16e295d8-c2a3-49cd-9a73-bbaefca66a68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:27.309707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-40508ebc-b1f8-4c44-b2a1-a8397efe0161 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Calling method '.version_select at 0x7ff61462da60>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:27.318046 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-16e295d8-c2a3-49cd-9a73-bbaefca66a68 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 0.568831 Oct 18 13:16:27.319075 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 71/155] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:26 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:27.339999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40508ebc-b1f8-4c44-b2a1-a8397efe0161 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:27.344024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40508ebc-b1f8-4c44-b2a1-a8397efe0161 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:27.344827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40508ebc-b1f8-4c44-b2a1-a8397efe0161 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:27.406939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40508ebc-b1f8-4c44-b2a1-a8397efe0161 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:27.407935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40508ebc-b1f8-4c44-b2a1-a8397efe0161 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:27.408818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40508ebc-b1f8-4c44-b2a1-a8397efe0161 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:27.429317 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-40508ebc-b1f8-4c44-b2a1-a8397efe0161 tempest-HypervisorAdminV253TestBase-321878751 tempest-HypervisorAdminV253TestBase-321878751-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/4d66d6b5-641e-43d8-a6cc-bc3c1f0369e3" status: 200 len: 794 microversion: 2.53 time: 0.121814 Oct 18 13:16:27.432195 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 85/156] 10.222.0.40 () {60 vars in 1298 bytes} [Tue Oct 18 13:16:27 2022] GET /compute/v2.1/os-hypervisors/4d66d6b5-641e-43d8-a6cc-bc3c1f0369e3 => generated 794 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:16:27.463233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-457a8ea3-ecf2-45dd-b7b3-7498149a4907 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:27.464244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-457a8ea3-ecf2-45dd-b7b3-7498149a4907 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:27.474277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-457a8ea3-ecf2-45dd-b7b3-7498149a4907 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:27.480857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-457a8ea3-ecf2-45dd-b7b3-7498149a4907 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:27.482439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-457a8ea3-ecf2-45dd-b7b3-7498149a4907 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:27.487493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-457a8ea3-ecf2-45dd-b7b3-7498149a4907 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:27.488285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-457a8ea3-ecf2-45dd-b7b3-7498149a4907 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:27.489951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-457a8ea3-ecf2-45dd-b7b3-7498149a4907 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:27.838807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04e1e6a3-b9fd-4329-98aa-84ec46ba2e49 tempest-FlavorsV261TestJSON-543186219 tempest-FlavorsV261TestJSON-543186219-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:27.857763 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04e1e6a3-b9fd-4329-98aa-84ec46ba2e49 tempest-FlavorsV261TestJSON-543186219 tempest-FlavorsV261TestJSON-543186219-project] 10.222.0.40 "GET /compute/v2.1/flavors/61836743" status: 200 len: 462 microversion: 2.61 time: 0.534533 Oct 18 13:16:27.863563 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 72/157] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 18 13:16:27 2022] GET /compute/v2.1/flavors/61836743 => generated 462 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:16:27.881432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1c22efc5-9464-4002-9d1f-55407cba277b tempest-FlavorsV261TestJSON-1423170156 tempest-FlavorsV261TestJSON-1423170156-project-admin] Action: 'update', calling method: .version_select at 0x7ff61575e5e0>, body: {"flavor": {"description": "new"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:27.930848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:DELETE=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:27.949945 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1c22efc5-9464-4002-9d1f-55407cba277b tempest-FlavorsV261TestJSON-1423170156 tempest-FlavorsV261TestJSON-1423170156-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/61836743" status: 200 len: 463 microversion: 2.61 time: 0.073063 Oct 18 13:16:27.952962 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 73/158] 10.222.0.40 () {62 vars in 1213 bytes} [Tue Oct 18 13:16:27 2022] PUT /compute/v2.1/flavors/61836743 => generated 463 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:16:27.953527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-457a8ea3-ecf2-45dd-b7b3-7498149a4907 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:27.966487 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-457a8ea3-ecf2-45dd-b7b3-7498149a4907 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.506924 Oct 18 13:16:27.968459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8e9bbdb-0a46-489c-9d53-386766d45e33 tempest-FlavorsV261TestJSON-543186219 tempest-FlavorsV261TestJSON-543186219-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:27.972140 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 86/159] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:27 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:28.039795 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8e9bbdb-0a46-489c-9d53-386766d45e33 tempest-FlavorsV261TestJSON-543186219 tempest-FlavorsV261TestJSON-543186219-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6244 microversion: 2.61 time: 0.076474 Oct 18 13:16:28.048347 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 74/160] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 18 13:16:27 2022] GET /compute/v2.1/flavors/detail => generated 6244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:16:28.075685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a8f60cb4-3761-47fa-bc19-f6f85a4ba956 tempest-FlavorsV261TestJSON-543186219 tempest-FlavorsV261TestJSON-543186219-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:28.118754 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a8f60cb4-3761-47fa-bc19-f6f85a4ba956 tempest-FlavorsV261TestJSON-543186219 tempest-FlavorsV261TestJSON-543186219-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 3151 microversion: 2.61 time: 0.047832 Oct 18 13:16:28.119340 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 87/161] 10.222.0.40 () {60 vars in 1166 bytes} [Tue Oct 18 13:16:28 2022] GET /compute/v2.1/flavors => generated 3151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:16:28.140331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-85ece6c5-9adf-44ce-bad3-c7aca85730b2 tempest-FlavorsV261TestJSON-1423170156 tempest-FlavorsV261TestJSON-1423170156-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:28.200234 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-85ece6c5-9adf-44ce-bad3-c7aca85730b2 tempest-FlavorsV261TestJSON-1423170156 tempest-FlavorsV261TestJSON-1423170156-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/61836743" status: 202 len: 0 microversion: 2.61 time: 0.064368 Oct 18 13:16:28.204314 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 75/162] 10.222.0.40 () {60 vars in 1196 bytes} [Tue Oct 18 13:16:28 2022] DELETE /compute/v2.1/flavors/61836743 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:16:28.212571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-560a844c-e385-49af-a004-a248fcd1383f tempest-FlavorsV261TestJSON-1423170156 tempest-FlavorsV261TestJSON-1423170156-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:28.239111 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-560a844c-e385-49af-a004-a248fcd1383f tempest-FlavorsV261TestJSON-1423170156 tempest-FlavorsV261TestJSON-1423170156-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.030159 Oct 18 13:16:28.240305 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 88/163] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 18 13:16:28 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:16:28.346962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d8adf089-7c6c-42d9-a4c8-1c1c69d57709 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:28.348540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d8adf089-7c6c-42d9-a4c8-1c1c69d57709 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:28.362510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8adf089-7c6c-42d9-a4c8-1c1c69d57709 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:28.364175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8adf089-7c6c-42d9-a4c8-1c1c69d57709 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:28.365811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8adf089-7c6c-42d9-a4c8-1c1c69d57709 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:28.368627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8adf089-7c6c-42d9-a4c8-1c1c69d57709 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:28.371080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8adf089-7c6c-42d9-a4c8-1c1c69d57709 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:28.374335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8adf089-7c6c-42d9-a4c8-1c1c69d57709 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:28.709416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d8adf089-7c6c-42d9-a4c8-1c1c69d57709 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:28.737806 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d8adf089-7c6c-42d9-a4c8-1c1c69d57709 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 0.390331 Oct 18 13:16:28.742113 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 76/164] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:28 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:28.997380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ae431821-275f-419c-8960-7e1ce9729e52 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:28.998011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ae431821-275f-419c-8960-7e1ce9729e52 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:29.014048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae431821-275f-419c-8960-7e1ce9729e52 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:29.014540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae431821-275f-419c-8960-7e1ce9729e52 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:29.017020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae431821-275f-419c-8960-7e1ce9729e52 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:29.019396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae431821-275f-419c-8960-7e1ce9729e52 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:29.021284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae431821-275f-419c-8960-7e1ce9729e52 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:29.024632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae431821-275f-419c-8960-7e1ce9729e52 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:29.035385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:29.735633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ae431821-275f-419c-8960-7e1ce9729e52 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:29.751392 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ae431821-275f-419c-8960-7e1ce9729e52 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.759045 Oct 18 13:16:29.758844 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 89/165] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:28 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:29.776923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ab93ce35-0b8f-4dbb-a31a-76542dd84b08 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:29.777713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ab93ce35-0b8f-4dbb-a31a-76542dd84b08 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:29.800774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab93ce35-0b8f-4dbb-a31a-76542dd84b08 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:29.805219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab93ce35-0b8f-4dbb-a31a-76542dd84b08 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:29.808379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab93ce35-0b8f-4dbb-a31a-76542dd84b08 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:29.811301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab93ce35-0b8f-4dbb-a31a-76542dd84b08 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:29.815608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab93ce35-0b8f-4dbb-a31a-76542dd84b08 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:29.819643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab93ce35-0b8f-4dbb-a31a-76542dd84b08 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:30.557964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ab93ce35-0b8f-4dbb-a31a-76542dd84b08 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:30.574740 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ab93ce35-0b8f-4dbb-a31a-76542dd84b08 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 0.800018 Oct 18 13:16:30.577809 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 77/166] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:29 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:30.785976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d3a28ed-6ff7-472c-a751-4106173a189a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:30.786597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d3a28ed-6ff7-472c-a751-4106173a189a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:30.807618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d3a28ed-6ff7-472c-a751-4106173a189a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:30.810908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d3a28ed-6ff7-472c-a751-4106173a189a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:30.811873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d3a28ed-6ff7-472c-a751-4106173a189a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:30.814482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d3a28ed-6ff7-472c-a751-4106173a189a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:30.815956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d3a28ed-6ff7-472c-a751-4106173a189a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:30.817473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d3a28ed-6ff7-472c-a751-4106173a189a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:31.058007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ca854d7c-5041-4935-a8c3-46991a43365c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Calling method '.version_select at 0x7ff614534ee0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:31.061753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca854d7c-5041-4935-a8c3-46991a43365c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:31.062548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca854d7c-5041-4935-a8c3-46991a43365c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:31.063182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca854d7c-5041-4935-a8c3-46991a43365c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:31.097000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d3a28ed-6ff7-472c-a751-4106173a189a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:31.103933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca854d7c-5041-4935-a8c3-46991a43365c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:31.104707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca854d7c-5041-4935-a8c3-46991a43365c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:31.105416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca854d7c-5041-4935-a8c3-46991a43365c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:31.109606 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d3a28ed-6ff7-472c-a751-4106173a189a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.328357 Oct 18 13:16:31.110209 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 78/167] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:30 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:16:31.119721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca854d7c-5041-4935-a8c3-46991a43365c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:31.120214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca854d7c-5041-4935-a8c3-46991a43365c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:31.120652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca854d7c-5041-4935-a8c3-46991a43365c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:31.128030 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ca854d7c-5041-4935-a8c3-46991a43365c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.866895 Oct 18 13:16:31.128991 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 90/168] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:31.141477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9338d32f-1a62-484a-aabf-090749740fa2 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Calling method '.version_select at 0x7ff614422f70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:31.143618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9338d32f-1a62-484a-aabf-090749740fa2 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:31.144091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9338d32f-1a62-484a-aabf-090749740fa2 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:31.144517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9338d32f-1a62-484a-aabf-090749740fa2 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:31.174038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9338d32f-1a62-484a-aabf-090749740fa2 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:31.174425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9338d32f-1a62-484a-aabf-090749740fa2 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:31.175038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9338d32f-1a62-484a-aabf-090749740fa2 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:31.205724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9338d32f-1a62-484a-aabf-090749740fa2 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:31.206637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9338d32f-1a62-484a-aabf-090749740fa2 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:31.207077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9338d32f-1a62-484a-aabf-090749740fa2 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:31.214577 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9338d32f-1a62-484a-aabf-090749740fa2 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/n-h2-858384-13/servers" status: 200 len: 197 microversion: 2.1 time: 0.077575 Oct 18 13:16:31.216336 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 79/169] 10.222.0.40 () {58 vars in 1215 bytes} [Tue Oct 18 13:16:31 2022] GET /compute/v2.1/os-hypervisors/n-h2-858384-13/servers => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:31.228396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b05df349-5e81-415d-9321-20e610664d9c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Calling method '.version_select at 0x7ff614534af0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:31.230310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b05df349-5e81-415d-9321-20e610664d9c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:31.230923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b05df349-5e81-415d-9321-20e610664d9c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:31.231735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b05df349-5e81-415d-9321-20e610664d9c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:31.254313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b05df349-5e81-415d-9321-20e610664d9c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:31.255440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b05df349-5e81-415d-9321-20e610664d9c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:31.256537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b05df349-5e81-415d-9321-20e610664d9c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:31.274019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b05df349-5e81-415d-9321-20e610664d9c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:31.275256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b05df349-5e81-415d-9321-20e610664d9c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:31.276074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b05df349-5e81-415d-9321-20e610664d9c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:31.285444 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b05df349-5e81-415d-9321-20e610664d9c tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.060571 Oct 18 13:16:31.292426 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 91/170] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:31 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:31.298202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6651f2bc-668a-4c66-835b-5c80781c0d23 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Calling method '.version_select at 0x7ff6144f0af0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:31.301200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6651f2bc-668a-4c66-835b-5c80781c0d23 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:31.302000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6651f2bc-668a-4c66-835b-5c80781c0d23 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:31.302605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6651f2bc-668a-4c66-835b-5c80781c0d23 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:31.318959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6651f2bc-668a-4c66-835b-5c80781c0d23 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:31.319616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6651f2bc-668a-4c66-835b-5c80781c0d23 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:31.320528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6651f2bc-668a-4c66-835b-5c80781c0d23 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:31.372916 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6651f2bc-668a-4c66-835b-5c80781c0d23 tempest-HypervisorAdminUnderV252Test-1307713070 tempest-HypervisorAdminUnderV252Test-1307713070-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/n-h2-858384-13/search" status: 200 len: 105 microversion: 2.1 time: 0.079871 Oct 18 13:16:31.376764 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 80/171] 10.222.0.40 () {58 vars in 1212 bytes} [Tue Oct 18 13:16:31 2022] GET /compute/v2.1/os-hypervisors/n-h2-858384-13/search => generated 105 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:31.626215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-39f20a53-a32d-4f49-88fd-2ac92b859721 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:31.626823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-39f20a53-a32d-4f49-88fd-2ac92b859721 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:31.638535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39f20a53-a32d-4f49-88fd-2ac92b859721 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:31.642576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39f20a53-a32d-4f49-88fd-2ac92b859721 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:31.643030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39f20a53-a32d-4f49-88fd-2ac92b859721 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:31.643939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39f20a53-a32d-4f49-88fd-2ac92b859721 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:31.644397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39f20a53-a32d-4f49-88fd-2ac92b859721 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:31.644817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39f20a53-a32d-4f49-88fd-2ac92b859721 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:32.123278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-39f20a53-a32d-4f49-88fd-2ac92b859721 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:32.134231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-50fc1c70-661d-4046-95be-829b03bb9d22 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:32.134854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-50fc1c70-661d-4046-95be-829b03bb9d22 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:32.136033 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-39f20a53-a32d-4f49-88fd-2ac92b859721 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 0.511930 Oct 18 13:16:32.138689 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 92/172] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:31 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:32.146694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50fc1c70-661d-4046-95be-829b03bb9d22 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:32.147193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50fc1c70-661d-4046-95be-829b03bb9d22 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:32.147625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50fc1c70-661d-4046-95be-829b03bb9d22 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:32.150893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50fc1c70-661d-4046-95be-829b03bb9d22 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:32.153419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50fc1c70-661d-4046-95be-829b03bb9d22 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:32.155396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50fc1c70-661d-4046-95be-829b03bb9d22 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:32.489169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-50fc1c70-661d-4046-95be-829b03bb9d22 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:32.499643 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-50fc1c70-661d-4046-95be-829b03bb9d22 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.371382 Oct 18 13:16:32.503622 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 81/173] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:32 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:16:33.162825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-45b525bc-1dd4-4eaf-b213-44f91339777d tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:33.164019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-45b525bc-1dd4-4eaf-b213-44f91339777d tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:33.173500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45b525bc-1dd4-4eaf-b213-44f91339777d tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:33.174401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45b525bc-1dd4-4eaf-b213-44f91339777d tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:33.175246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45b525bc-1dd4-4eaf-b213-44f91339777d tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:33.176301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45b525bc-1dd4-4eaf-b213-44f91339777d tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:33.177108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45b525bc-1dd4-4eaf-b213-44f91339777d tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:33.177705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45b525bc-1dd4-4eaf-b213-44f91339777d tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:33.378034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-45b525bc-1dd4-4eaf-b213-44f91339777d tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:33.404377 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-45b525bc-1dd4-4eaf-b213-44f91339777d tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 0.247268 Oct 18 13:16:33.411374 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 93/174] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:33 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:33.529212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32892103-8ce9-4e2e-b312-7c2f4e115b8a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:33.530423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-32892103-8ce9-4e2e-b312-7c2f4e115b8a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:33.553697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32892103-8ce9-4e2e-b312-7c2f4e115b8a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:33.554426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32892103-8ce9-4e2e-b312-7c2f4e115b8a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:33.555028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32892103-8ce9-4e2e-b312-7c2f4e115b8a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:33.555992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32892103-8ce9-4e2e-b312-7c2f4e115b8a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:33.556569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32892103-8ce9-4e2e-b312-7c2f4e115b8a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:33.557091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32892103-8ce9-4e2e-b312-7c2f4e115b8a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.004563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-32892103-8ce9-4e2e-b312-7c2f4e115b8a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:34.019720 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-32892103-8ce9-4e2e-b312-7c2f4e115b8a tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.496235 Oct 18 13:16:34.020890 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 82/175] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:33 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:34.301328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bc3ebc5f-dd88-4c25-a0da-2b03b6480ad4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Calling method '.version_select at 0x7ff6145d9310>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:34.311149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc3ebc5f-dd88-4c25-a0da-2b03b6480ad4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.311650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc3ebc5f-dd88-4c25-a0da-2b03b6480ad4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.312091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc3ebc5f-dd88-4c25-a0da-2b03b6480ad4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.329347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc3ebc5f-dd88-4c25-a0da-2b03b6480ad4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.330055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc3ebc5f-dd88-4c25-a0da-2b03b6480ad4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.330724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc3ebc5f-dd88-4c25-a0da-2b03b6480ad4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.344473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc3ebc5f-dd88-4c25-a0da-2b03b6480ad4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.345315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc3ebc5f-dd88-4c25-a0da-2b03b6480ad4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.346337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc3ebc5f-dd88-4c25-a0da-2b03b6480ad4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.354726 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bc3ebc5f-dd88-4c25-a0da-2b03b6480ad4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.609800 Oct 18 13:16:34.357102 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 94/176] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:33 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:34.368530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-41f658a9-17a6-4e46-b87a-1205b76b0a75 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Calling method '.version_select at 0x7ff6143fe160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:34.370999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f658a9-17a6-4e46-b87a-1205b76b0a75 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.371872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f658a9-17a6-4e46-b87a-1205b76b0a75 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.372418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f658a9-17a6-4e46-b87a-1205b76b0a75 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.402395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f658a9-17a6-4e46-b87a-1205b76b0a75 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.403427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f658a9-17a6-4e46-b87a-1205b76b0a75 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.403859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f658a9-17a6-4e46-b87a-1205b76b0a75 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.429220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-294d13d9-25b7-4bc1-848a-e85717649a69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:34.429655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f658a9-17a6-4e46-b87a-1205b76b0a75 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.429842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-294d13d9-25b7-4bc1-848a-e85717649a69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:34.430819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f658a9-17a6-4e46-b87a-1205b76b0a75 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.431836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f658a9-17a6-4e46-b87a-1205b76b0a75 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.442300 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-41f658a9-17a6-4e46-b87a-1205b76b0a75 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.078117 Oct 18 13:16:34.443758 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 83/177] 10.222.0.40 () {58 vars in 1167 bytes} [Tue Oct 18 13:16:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:34.446976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-294d13d9-25b7-4bc1-848a-e85717649a69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.447599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-294d13d9-25b7-4bc1-848a-e85717649a69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.451762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-294d13d9-25b7-4bc1-848a-e85717649a69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.452813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-294d13d9-25b7-4bc1-848a-e85717649a69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.454257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-294d13d9-25b7-4bc1-848a-e85717649a69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.455875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-294d13d9-25b7-4bc1-848a-e85717649a69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.461462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c624376-b67f-49c5-8c28-aeab072b5ce1 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Calling method '.version_select at 0x7ff6142e3700>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:34.463438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c624376-b67f-49c5-8c28-aeab072b5ce1 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.465815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c624376-b67f-49c5-8c28-aeab072b5ce1 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.467660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c624376-b67f-49c5-8c28-aeab072b5ce1 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.502199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c624376-b67f-49c5-8c28-aeab072b5ce1 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.505054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c624376-b67f-49c5-8c28-aeab072b5ce1 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.505893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c624376-b67f-49c5-8c28-aeab072b5ce1 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.543975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c624376-b67f-49c5-8c28-aeab072b5ce1 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.543975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c624376-b67f-49c5-8c28-aeab072b5ce1 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.543975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c624376-b67f-49c5-8c28-aeab072b5ce1 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.567174 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2c624376-b67f-49c5-8c28-aeab072b5ce1 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.109605 Oct 18 13:16:34.568293 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 84/178] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:34.579928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bf50ec1f-eb9a-4830-8821-e056a74a05f4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Calling method '.version_select at 0x7ff6143fed30>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:34.586013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf50ec1f-eb9a-4830-8821-e056a74a05f4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.586513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf50ec1f-eb9a-4830-8821-e056a74a05f4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.587039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf50ec1f-eb9a-4830-8821-e056a74a05f4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.623190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf50ec1f-eb9a-4830-8821-e056a74a05f4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.623740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf50ec1f-eb9a-4830-8821-e056a74a05f4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.625435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf50ec1f-eb9a-4830-8821-e056a74a05f4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.647499 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bf50ec1f-eb9a-4830-8821-e056a74a05f4 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.071529 Oct 18 13:16:34.648382 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 85/179] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:34.670243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-77e70119-fa73-4b5b-9534-b87ef3349680 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Calling method '.version_select at 0x7ff6143fe4c0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:34.680579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77e70119-fa73-4b5b-9534-b87ef3349680 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.681786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77e70119-fa73-4b5b-9534-b87ef3349680 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.682774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77e70119-fa73-4b5b-9534-b87ef3349680 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.720577 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-77e70119-fa73-4b5b-9534-b87ef3349680 tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.060073 Oct 18 13:16:34.728620 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 86/180] 10.222.0.40 () {58 vars in 1179 bytes} [Tue Oct 18 13:16:34 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:34.741531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc22125d-9fc6-4353-9882-e352f38bbb9e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Calling method '.version_select at 0x7ff6144f0af0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:34.743650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc22125d-9fc6-4353-9882-e352f38bbb9e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.744314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc22125d-9fc6-4353-9882-e352f38bbb9e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.744990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc22125d-9fc6-4353-9882-e352f38bbb9e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.788585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc22125d-9fc6-4353-9882-e352f38bbb9e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.795729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc22125d-9fc6-4353-9882-e352f38bbb9e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.796696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc22125d-9fc6-4353-9882-e352f38bbb9e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.837490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc22125d-9fc6-4353-9882-e352f38bbb9e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.839374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc22125d-9fc6-4353-9882-e352f38bbb9e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.840428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc22125d-9fc6-4353-9882-e352f38bbb9e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.847957 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bc22125d-9fc6-4353-9882-e352f38bbb9e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.110380 Oct 18 13:16:34.849234 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 87/181] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:34.873079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-43074d51-8525-4ef2-af87-b9c8da49b77e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Calling method '.version_select at 0x7ff6142e34c0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:34.886135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43074d51-8525-4ef2-af87-b9c8da49b77e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.888867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43074d51-8525-4ef2-af87-b9c8da49b77e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.889604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43074d51-8525-4ef2-af87-b9c8da49b77e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.894505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-294d13d9-25b7-4bc1-848a-e85717649a69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:34.902557 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-294d13d9-25b7-4bc1-848a-e85717649a69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 0.478370 Oct 18 13:16:34.917705 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 95/182] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:34 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:34.928886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43074d51-8525-4ef2-af87-b9c8da49b77e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.930178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43074d51-8525-4ef2-af87-b9c8da49b77e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.932460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43074d51-8525-4ef2-af87-b9c8da49b77e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:34.953481 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-43074d51-8525-4ef2-af87-b9c8da49b77e tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.096178 Oct 18 13:16:34.956850 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 88/183] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:34.982431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-64bf0afa-3b9c-43bc-8ba2-b69bbe1d48ff tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Calling method '.version_select at 0x7ff614572280>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:34.984898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64bf0afa-3b9c-43bc-8ba2-b69bbe1d48ff tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:34.985854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64bf0afa-3b9c-43bc-8ba2-b69bbe1d48ff tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:34.986494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64bf0afa-3b9c-43bc-8ba2-b69bbe1d48ff tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:35.024924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64bf0afa-3b9c-43bc-8ba2-b69bbe1d48ff tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:35.026945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64bf0afa-3b9c-43bc-8ba2-b69bbe1d48ff tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:35.029635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64bf0afa-3b9c-43bc-8ba2-b69bbe1d48ff tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:35.045218 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-64bf0afa-3b9c-43bc-8ba2-b69bbe1d48ff tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.068647 Oct 18 13:16:35.047253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b696b557-8a2e-4393-b9be-b6e59354cdc8 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:35.047909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b696b557-8a2e-4393-b9be-b6e59354cdc8 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:35.054792 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 96/184] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:34 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:35.067116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f966a84b-0485-4d97-9a0c-59587d64d5be tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Calling method '.version_select at 0x7ff61458f0d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:35.069149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f966a84b-0485-4d97-9a0c-59587d64d5be tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:35.069689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f966a84b-0485-4d97-9a0c-59587d64d5be tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:35.070152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f966a84b-0485-4d97-9a0c-59587d64d5be tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:35.074226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b696b557-8a2e-4393-b9be-b6e59354cdc8 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:35.075845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b696b557-8a2e-4393-b9be-b6e59354cdc8 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:35.077420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b696b557-8a2e-4393-b9be-b6e59354cdc8 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:35.079589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b696b557-8a2e-4393-b9be-b6e59354cdc8 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:35.080276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b696b557-8a2e-4393-b9be-b6e59354cdc8 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:35.081740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b696b557-8a2e-4393-b9be-b6e59354cdc8 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:35.117004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f966a84b-0485-4d97-9a0c-59587d64d5be tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:35.117549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f966a84b-0485-4d97-9a0c-59587d64d5be tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:35.122327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f966a84b-0485-4d97-9a0c-59587d64d5be tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:35.146093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f966a84b-0485-4d97-9a0c-59587d64d5be tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:35.147496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f966a84b-0485-4d97-9a0c-59587d64d5be tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:35.147913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f966a84b-0485-4d97-9a0c-59587d64d5be tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:35.171518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f966a84b-0485-4d97-9a0c-59587d64d5be tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:16:35.172019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f966a84b-0485-4d97-9a0c-59587d64d5be tempest-HypervisorAdminTestJSON-569568706 tempest-HypervisorAdminTestJSON-569568706-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:16:35.173124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63ff4a4d-e74c-43be-93d3-19549c85ef1b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:35.173651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63ff4a4d-e74c-43be-93d3-19549c85ef1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:35.174337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63ff4a4d-e74c-43be-93d3-19549c85ef1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:35.175061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63ff4a4d-e74c-43be-93d3-19549c85ef1b None None] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:35.175542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63ff4a4d-e74c-43be-93d3-19549c85ef1b None None] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:35.175966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63ff4a4d-e74c-43be-93d3-19549c85ef1b None None] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:35.201024 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.compute.rpcapi [None req-63ff4a4d-e74c-43be-93d3-19549c85ef1b None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 18 13:16:35.201996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63ff4a4d-e74c-43be-93d3-19549c85ef1b None None] Releasing lock "compute-rpcapi-router" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:16:35.262738 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-63ff4a4d-e74c-43be-93d3-19549c85ef1b None None] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.203707 Oct 18 13:16:35.270624 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 97/185] 10.222.0.40 () {58 vars in 1173 bytes} [Tue Oct 18 13:16:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:35.415366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b696b557-8a2e-4393-b9be-b6e59354cdc8 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:35.426388 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b696b557-8a2e-4393-b9be-b6e59354cdc8 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.386227 Oct 18 13:16:35.431447 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 89/186] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:35 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:35.925497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7cb020ad-4753-48ff-8e7e-55fbd5cf5629 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:35.926198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7cb020ad-4753-48ff-8e7e-55fbd5cf5629 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:35.937980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cb020ad-4753-48ff-8e7e-55fbd5cf5629 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:35.938465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cb020ad-4753-48ff-8e7e-55fbd5cf5629 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:35.941782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cb020ad-4753-48ff-8e7e-55fbd5cf5629 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:35.942548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cb020ad-4753-48ff-8e7e-55fbd5cf5629 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:35.944909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cb020ad-4753-48ff-8e7e-55fbd5cf5629 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:35.945986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cb020ad-4753-48ff-8e7e-55fbd5cf5629 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:36.256218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7cb020ad-4753-48ff-8e7e-55fbd5cf5629 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:36.270379 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7cb020ad-4753-48ff-8e7e-55fbd5cf5629 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 0.349350 Oct 18 13:16:36.271148 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 98/187] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:35 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:36.453063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3cd08e14-d819-49a8-ba68-f6a70fcc94fb tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:36.454863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3cd08e14-d819-49a8-ba68-f6a70fcc94fb tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:36.462070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cd08e14-d819-49a8-ba68-f6a70fcc94fb tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:36.464797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cd08e14-d819-49a8-ba68-f6a70fcc94fb tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:36.469688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cd08e14-d819-49a8-ba68-f6a70fcc94fb tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:36.470757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cd08e14-d819-49a8-ba68-f6a70fcc94fb tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:36.471405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cd08e14-d819-49a8-ba68-f6a70fcc94fb tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:36.472269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cd08e14-d819-49a8-ba68-f6a70fcc94fb tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:36.764372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3cd08e14-d819-49a8-ba68-f6a70fcc94fb tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:36.776846 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3cd08e14-d819-49a8-ba68-f6a70fcc94fb tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.327940 Oct 18 13:16:36.780000 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 90/188] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:36 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:36.898115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-23741432-2a63-4022-a4c6-cdbee64f42b7 req-bb3a1057-b7e3-4a93-b240-49ccfdd35910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0004e9-bd82-4cf2-b211-924251e95184", "name": "network-vif-plugged", "status": "completed", "tag": "ea136430-53d3-4c59-9ce6-7e1a5d79d2d0"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:36.934316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-23741432-2a63-4022-a4c6-cdbee64f42b7 req-bb3a1057-b7e3-4a93-b240-49ccfdd35910 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:36.935028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-23741432-2a63-4022-a4c6-cdbee64f42b7 req-bb3a1057-b7e3-4a93-b240-49ccfdd35910 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:36.935215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-23741432-2a63-4022-a4c6-cdbee64f42b7 req-bb3a1057-b7e3-4a93-b240-49ccfdd35910 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:37.002082 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-23741432-2a63-4022-a4c6-cdbee64f42b7 req-bb3a1057-b7e3-4a93-b240-49ccfdd35910 service nova] Creating event network-vif-plugged:ea136430-53d3-4c59-9ce6-7e1a5d79d2d0 for instance 0d0004e9-bd82-4cf2-b211-924251e95184 on n-h1-858384-13 Oct 18 13:16:37.015360 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-23741432-2a63-4022-a4c6-cdbee64f42b7 req-bb3a1057-b7e3-4a93-b240-49ccfdd35910 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.544661 Oct 18 13:16:37.019357 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 99/189] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:37.303997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b647c34e-8bbc-41ab-841f-213fc48a26f7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:37.304607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b647c34e-8bbc-41ab-841f-213fc48a26f7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:37.323199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b647c34e-8bbc-41ab-841f-213fc48a26f7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:37.326516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b647c34e-8bbc-41ab-841f-213fc48a26f7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:37.328827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b647c34e-8bbc-41ab-841f-213fc48a26f7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:37.331860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b647c34e-8bbc-41ab-841f-213fc48a26f7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:37.332460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b647c34e-8bbc-41ab-841f-213fc48a26f7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:37.332789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b647c34e-8bbc-41ab-841f-213fc48a26f7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:37.388196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:37.610708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b647c34e-8bbc-41ab-841f-213fc48a26f7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:37.621380 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b647c34e-8bbc-41ab-841f-213fc48a26f7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 0.322395 Oct 18 13:16:37.622646 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 91/190] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:37 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:37.805951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d8f8eb01-da76-4314-9ba6-d193d27e0aed tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:37.807160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d8f8eb01-da76-4314-9ba6-d193d27e0aed tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:37.817013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8f8eb01-da76-4314-9ba6-d193d27e0aed tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:37.818723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8f8eb01-da76-4314-9ba6-d193d27e0aed tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:37.819551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8f8eb01-da76-4314-9ba6-d193d27e0aed tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:37.820539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8f8eb01-da76-4314-9ba6-d193d27e0aed tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:37.821436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8f8eb01-da76-4314-9ba6-d193d27e0aed tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:37.822337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8f8eb01-da76-4314-9ba6-d193d27e0aed tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:38.229620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d8f8eb01-da76-4314-9ba6-d193d27e0aed tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:38.245430 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d8f8eb01-da76-4314-9ba6-d193d27e0aed tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.441314 Oct 18 13:16:38.246690 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 100/191] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:37 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:38.607674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b6154f8d-a3a0-49be-9a0c-f5c17cb1717d tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Calling method '.version_select at 0x7ff6143fe4c0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:38.612261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6154f8d-a3a0-49be-9a0c-f5c17cb1717d tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:38.613495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6154f8d-a3a0-49be-9a0c-f5c17cb1717d tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:38.615776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6154f8d-a3a0-49be-9a0c-f5c17cb1717d tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:38.618230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6154f8d-a3a0-49be-9a0c-f5c17cb1717d tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:38.619616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6154f8d-a3a0-49be-9a0c-f5c17cb1717d tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:38.620153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6154f8d-a3a0-49be-9a0c-f5c17cb1717d tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:38.646721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7e232caf-840e-42be-b8ae-b8c5f36ddcac tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:38.647341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7e232caf-840e-42be-b8ae-b8c5f36ddcac tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:38.658005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e232caf-840e-42be-b8ae-b8c5f36ddcac tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:38.660845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e232caf-840e-42be-b8ae-b8c5f36ddcac tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:38.663994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e232caf-840e-42be-b8ae-b8c5f36ddcac tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:38.666489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e232caf-840e-42be-b8ae-b8c5f36ddcac tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:38.666913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e232caf-840e-42be-b8ae-b8c5f36ddcac tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:38.667359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e232caf-840e-42be-b8ae-b8c5f36ddcac tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:38.757939 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b6154f8d-a3a0-49be-9a0c-f5c17cb1717d tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.592798 Oct 18 13:16:38.762925 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 92/192] 10.222.0.40 () {58 vars in 1128 bytes} [Tue Oct 18 13:16:38 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:39.052566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7e232caf-840e-42be-b8ae-b8c5f36ddcac tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:39.063362 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7e232caf-840e-42be-b8ae-b8c5f36ddcac tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1320 microversion: 2.1 time: 0.422610 Oct 18 13:16:39.070924 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 101/193] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:38 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:39.099520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b6243b84-35a8-4443-958e-b2fd23ef4bf8 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Calling method '.version_select at 0x7ff614325430>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:39.747756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2f5760b6-6a8b-4e72-bb66-f646856bb0cb tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Calling method '.version_select at 0x7ff6145d9e50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:39.752957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2f5760b6-6a8b-4e72-bb66-f646856bb0cb tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'f34b7946f9ae4455ba4ae7b31aee8361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2ed9529f246c8860318049fb1ddea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2f5760b6-6a8b-4e72-bb66-f646856bb0cb tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Request method failure captured: Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcz27vsoWDYPxWjmv-CWqpST3KchftESDES8EcwicfqjF5iCE_B4fBa6e1KUZh0uWFPD0vMIP0uGvDxyyA5z9fHWyakAvLyTAE6T5x9_ZWePJcWhpAkUY0RdlNcORWbKZgJlgp3vG6fPQaOX-QHIq3SVUJSkNRfWpioTSQpaZ_5CFM Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 1aa2ed9529f246c8860318049fb1ddea Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:39.762592 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:39.764521 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1aa2ed9529f246c8860318049fb1ddea"}]}] Oct 18 13:16:39.764521 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:39.764521 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 1aa2ed9529f246c8860318049fb1ddea Oct 18 13:16:39.764521 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:39.764521 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-HostsAdminNegativeTestJSON-1802438831-project Oct 18 13:16:39.764521 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:39.764521 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:39.764521 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: f34b7946f9ae4455ba4ae7b31aee8361 Oct 18 13:16:39.764521 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1802438831-project Oct 18 13:16:39.764521 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:16:39.764521 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 18 13:16:39.764521 n-d-858384-13 devstack@n-api.service[120612]: action_args: {} Oct 18 13:16:39.764521 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:39.765404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 18 13:16:39.766806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:39.768135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2f5760b6-6a8b-4e72-bb66-f646856bb0cb tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:39.768135 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2f5760b6-6a8b-4e72-bb66-f646856bb0cb tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.691663 Oct 18 13:16:39.784558 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 102/194] 10.222.0.40 () {58 vars in 1128 bytes} [Tue Oct 18 13:16:39 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 712 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:39.813465 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b6243b84-35a8-4443-958e-b2fd23ef4bf8 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/9e99502102654cb59aa31d05f7fcf2fd" status: 200 len: 371 microversion: 2.1 time: 1.049154 Oct 18 13:16:39.813947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1d57264a-c211-4446-b0bc-b6e5ec315e15 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:39.814338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1d57264a-c211-4446-b0bc-b6e5ec315e15 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:39.817682 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 93/195] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 18 13:16:38 2022] GET /compute/v2.1/os-quota-sets/9e99502102654cb59aa31d05f7fcf2fd => generated 371 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:39.837793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d57264a-c211-4446-b0bc-b6e5ec315e15 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:39.838296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d57264a-c211-4446-b0bc-b6e5ec315e15 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:39.838735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d57264a-c211-4446-b0bc-b6e5ec315e15 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:39.839465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d57264a-c211-4446-b0bc-b6e5ec315e15 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:39.840451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d57264a-c211-4446-b0bc-b6e5ec315e15 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:39.840943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d57264a-c211-4446-b0bc-b6e5ec315e15 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:39.846121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7c9a8e02-0702-44a6-99c0-02964f2120c0 req-28f5b4a3-5eb0-472c-a91e-03331b6de00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4749485a-14ea-47b4-a16a-42da495ebb0f", "name": "network-vif-plugged", "status": "completed", "tag": "47a6d7f0-df4a-470d-94e7-a450badcb884"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:39.898594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7c9a8e02-0702-44a6-99c0-02964f2120c0 req-28f5b4a3-5eb0-472c-a91e-03331b6de00b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:39.899524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7c9a8e02-0702-44a6-99c0-02964f2120c0 req-28f5b4a3-5eb0-472c-a91e-03331b6de00b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:39.901354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7c9a8e02-0702-44a6-99c0-02964f2120c0 req-28f5b4a3-5eb0-472c-a91e-03331b6de00b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:39.937254 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7c9a8e02-0702-44a6-99c0-02964f2120c0 req-28f5b4a3-5eb0-472c-a91e-03331b6de00b service nova] Creating event network-vif-plugged:47a6d7f0-df4a-470d-94e7-a450badcb884 for instance 4749485a-14ea-47b4-a16a-42da495ebb0f on n-h2-858384-13 Oct 18 13:16:39.949471 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7c9a8e02-0702-44a6-99c0-02964f2120c0 req-28f5b4a3-5eb0-472c-a91e-03331b6de00b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126691 Oct 18 13:16:39.953556 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 94/196] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:39.967005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-11a57ddd-2115-4c61-aa84-b67642c2712c tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Calling method '.version_select at 0x7ff6142afb80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:39.971038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-11a57ddd-2115-4c61-aa84-b67642c2712c tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'f34b7946f9ae4455ba4ae7b31aee8361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2ed9529f246c8860318049fb1ddea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-11a57ddd-2115-4c61-aa84-b67642c2712c tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Request method failure captured: Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-hosts/n-d-858384-13/reboot HTTP/1.1 Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcz27vsoWDYPxWjmv-CWqpST3KchftESDES8EcwicfqjF5iCE_B4fBa6e1KUZh0uWFPD0vMIP0uGvDxyyA5z9fHWyakAvLyTAE6T5x9_ZWePJcWhpAkUY0RdlNcORWbKZgJlgp3vG6fPQaOX-QHIq3SVUJSkNRfWpioTSQpaZ_5CFM Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 1aa2ed9529f246c8860318049fb1ddea Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:16:39.983143 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:16:39.984265 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1aa2ed9529f246c8860318049fb1ddea"}]}] Oct 18 13:16:39.984265 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:39.984265 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 1aa2ed9529f246c8860318049fb1ddea Oct 18 13:16:39.984265 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:39.984265 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-HostsAdminNegativeTestJSON-1802438831-project Oct 18 13:16:39.984265 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:39.984265 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:39.984265 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f34b7946f9ae4455ba4ae7b31aee8361 Oct 18 13:16:39.984265 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1802438831-project Oct 18 13:16:39.984265 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:16:39.984265 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 18 13:16:39.984265 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'n-d-858384-13'} Oct 18 13:16:39.984265 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:39.985055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 18 13:16:39.986087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:39.995667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-11a57ddd-2115-4c61-aa84-b67642c2712c tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:39.998048 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-11a57ddd-2115-4c61-aa84-b67642c2712c tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-858384-13/reboot" status: 403 len: 111 microversion: 2.1 time: 0.042804 Oct 18 13:16:40.002627 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 95/197] 10.222.0.40 () {58 vars in 1191 bytes} [Tue Oct 18 13:16:39 2022] GET /compute/v2.1/os-hosts/n-d-858384-13/reboot => generated 111 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:40.023052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5d0e8c0e-3a08-463c-ae98-6ef4e2185adb tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Action: 'update', calling method: .version_select at 0x7ff6142e34c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:40.425354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d0e8c0e-3a08-463c-ae98-6ef4e2185adb tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:40.426676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d0e8c0e-3a08-463c-ae98-6ef4e2185adb tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:40.427398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d0e8c0e-3a08-463c-ae98-6ef4e2185adb tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:40.428460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d0e8c0e-3a08-463c-ae98-6ef4e2185adb tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:40.429312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d0e8c0e-3a08-463c-ae98-6ef4e2185adb tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:40.429892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d0e8c0e-3a08-463c-ae98-6ef4e2185adb tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:40.552896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1d57264a-c211-4446-b0bc-b6e5ec315e15 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:40.565755 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1d57264a-c211-4446-b0bc-b6e5ec315e15 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.779894 Oct 18 13:16:40.582039 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 103/198] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:39 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:40.588352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4942fd92-174c-4f97-afc0-023c4bfe5c8c tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Calling method '.version_select at 0x7ff614572160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:40.602338 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-4942fd92-174c-4f97-afc0-023c4bfe5c8c tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4942fd92-174c-4f97-afc0-023c4bfe5c8c tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Request method failure captured: Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqc1TtgqbOCE9iUEW8hAEFmMzMALaiVXmY6TJ4UsQSfAB48y5RC2F-nEmhPT9vAnJ8i8naqLmmEkArFAMFaTWYJJBvK-EGrIkjXzCjIHO7PE-ECjSmpzbeCm4tjg5ygzy-ArqGkucmRkqZ0WoRkOP44nfh9KeiXH-erpXLqZHByR-J8 Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:40.604628 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:40.607034 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_626a0d61bc88401b99d91bba3e4cae62"}]}] Oct 18 13:16:40.607034 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:40.607034 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:40.607034 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:40.607034 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:40.607034 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:40.607034 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:40.607034 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 08728bc9e2cf42e1a7b33a5616954fd9 Oct 18 13:16:40.607034 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:40.607034 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:16:40.607034 n-d-858384-13 devstack@n-api.service[120612]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:40.607034 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'nonexistent_hostname'} Oct 18 13:16:40.607034 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:40.608052 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 18 13:16:40.610457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:40.611605 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:40.611605 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:40.611605 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:40.611605 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:40.611605 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:40.611605 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:40.611605 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:40.611605 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:40.611605 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:40.611605 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:40.611605 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:40.612337 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5d0e8c0e-3a08-463c-ae98-6ef4e2185adb tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/9e99502102654cb59aa31d05f7fcf2fd" status: 200 len: 328 microversion: 2.1 time: 0.605673 Oct 18 13:16:40.613464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4942fd92-174c-4f97-afc0-023c4bfe5c8c tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:40.614476 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4942fd92-174c-4f97-afc0-023c4bfe5c8c tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.031394 Oct 18 13:16:40.615183 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 104/199] 10.222.0.40 () {58 vars in 1212 bytes} [Tue Oct 18 13:16:40 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:16:40.616860 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 96/200] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:16:40 2022] PUT /compute/v2.1/os-quota-sets/9e99502102654cb59aa31d05f7fcf2fd => generated 328 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:40.622965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4c50b277-ecae-47e3-8629-6947468f4395 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:40.623825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4c50b277-ecae-47e3-8629-6947468f4395 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:40.641929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c50b277-ecae-47e3-8629-6947468f4395 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:40.642705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c50b277-ecae-47e3-8629-6947468f4395 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:40.644912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c50b277-ecae-47e3-8629-6947468f4395 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:40.648278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c50b277-ecae-47e3-8629-6947468f4395 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:40.648968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c50b277-ecae-47e3-8629-6947468f4395 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:40.649574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c50b277-ecae-47e3-8629-6947468f4395 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:41.041407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4c50b277-ecae-47e3-8629-6947468f4395 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:41.056624 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4c50b277-ecae-47e3-8629-6947468f4395 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1469 microversion: 2.1 time: 0.440188 Oct 18 13:16:41.057611 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 105/201] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:40 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1469 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:41.064193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-adc91eac-7c30-4cc3-b7c9-e0031a1b29d6 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:41.108200 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-adc91eac-7c30-4cc3-b7c9-e0031a1b29d6 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-quota-sets/9e99502102654cb59aa31d05f7fcf2fd" status: 202 len: 0 microversion: 2.1 time: 0.047383 Oct 18 13:16:41.109993 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 106/202] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:16:41 2022] DELETE /compute/v2.1/os-quota-sets/9e99502102654cb59aa31d05f7fcf2fd => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:16:41.116950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ebe83973-b757-40fb-8492-2b4b82255642 tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Calling method '.version_select at 0x7ff614572e50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:41.119333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ebe83973-b757-40fb-8492-2b4b82255642 tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'f34b7946f9ae4455ba4ae7b31aee8361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2ed9529f246c8860318049fb1ddea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ebe83973-b757-40fb-8492-2b4b82255642 tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Request method failure captured: Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-hosts/n-d-858384-13 HTTP/1.1 Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcz27vsoWDYPxWjmv-CWqpST3KchftESDES8EcwicfqjF5iCE_B4fBa6e1KUZh0uWFPD0vMIP0uGvDxyyA5z9fHWyakAvLyTAE6T5x9_ZWePJcWhpAkUY0RdlNcORWbKZgJlgp3vG6fPQaOX-QHIq3SVUJSkNRfWpioTSQpaZ_5CFM Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 1aa2ed9529f246c8860318049fb1ddea Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:41.135568 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:41.136838 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1aa2ed9529f246c8860318049fb1ddea"}]}] Oct 18 13:16:41.136838 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:41.136838 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 1aa2ed9529f246c8860318049fb1ddea Oct 18 13:16:41.136838 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:41.136838 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-HostsAdminNegativeTestJSON-1802438831-project Oct 18 13:16:41.136838 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:41.136838 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:41.136838 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: f34b7946f9ae4455ba4ae7b31aee8361 Oct 18 13:16:41.136838 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1802438831-project Oct 18 13:16:41.136838 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:16:41.136838 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 18 13:16:41.136838 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'n-d-858384-13'} Oct 18 13:16:41.136838 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:41.137566 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 18 13:16:41.138524 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:41.146649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ebe83973-b757-40fb-8492-2b4b82255642 tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:41.147897 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ebe83973-b757-40fb-8492-2b4b82255642 tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-858384-13" status: 403 len: 109 microversion: 2.1 time: 0.036885 Oct 18 13:16:41.149280 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 107/203] 10.222.0.40 () {58 vars in 1170 bytes} [Tue Oct 18 13:16:41 2022] GET /compute/v2.1/os-hosts/n-d-858384-13 => generated 109 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:41.210202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5d24d7a5-68f0-4f9d-b561-11ade989343e tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Calling method '.version_select at 0x7ff6142f5ca0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:41.212608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d24d7a5-68f0-4f9d-b561-11ade989343e tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:41.213144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d24d7a5-68f0-4f9d-b561-11ade989343e tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:41.213840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d24d7a5-68f0-4f9d-b561-11ade989343e tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:41.255737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d24d7a5-68f0-4f9d-b561-11ade989343e tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:41.256570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d24d7a5-68f0-4f9d-b561-11ade989343e tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:41.257405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d24d7a5-68f0-4f9d-b561-11ade989343e tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:41.306761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d24d7a5-68f0-4f9d-b561-11ade989343e tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:41.307646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d24d7a5-68f0-4f9d-b561-11ade989343e tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:41.308469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d24d7a5-68f0-4f9d-b561-11ade989343e tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:41.329844 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5d24d7a5-68f0-4f9d-b561-11ade989343e tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.711444 Oct 18 13:16:41.336989 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 97/204] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:41.351367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2623ee5e-16e4-44ab-8db3-b86691e206db tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Calling method '.version_select at 0x7ff614422280>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:41.383254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b2afa965-4e1d-4ee5-b622-52f8fbc9ac2e tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:41.383926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b2afa965-4e1d-4ee5-b622-52f8fbc9ac2e tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:41.396803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2afa965-4e1d-4ee5-b622-52f8fbc9ac2e tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:41.400512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2afa965-4e1d-4ee5-b622-52f8fbc9ac2e tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:41.402373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2afa965-4e1d-4ee5-b622-52f8fbc9ac2e tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:41.404592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2afa965-4e1d-4ee5-b622-52f8fbc9ac2e tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:41.408543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2afa965-4e1d-4ee5-b622-52f8fbc9ac2e tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:41.409319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2afa965-4e1d-4ee5-b622-52f8fbc9ac2e tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:41.665239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b2afa965-4e1d-4ee5-b622-52f8fbc9ac2e tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:16:41.824739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:41.905009 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b2afa965-4e1d-4ee5-b622-52f8fbc9ac2e tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 204 len: 0 microversion: 2.1 time: 0.754035 Oct 18 13:16:41.906761 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 108/205] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:16:41 2022] DELETE /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:16:41.913432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84adda9b-a118-48ab-929f-ebf82971f8c7 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Calling method '.version_select at 0x7ff614572160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:41.923905 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-84adda9b-a118-48ab-929f-ebf82971f8c7 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84adda9b-a118-48ab-929f-ebf82971f8c7 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Request method failure captured: Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqc1TtgqbOCE9iUEW8hAEFmMzMALaiVXmY6TJ4UsQSfAB48y5RC2F-nEmhPT9vAnJ8i8naqLmmEkArFAMFaTWYJJBvK-EGrIkjXzCjIHO7PE-ECjSmpzbeCm4tjg5ygzy-ArqGkucmRkqZ0WoRkOP44nfh9KeiXH-erpXLqZHByR-J8 Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:41.927126 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:41.928427 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_626a0d61bc88401b99d91bba3e4cae62"}]}] Oct 18 13:16:41.928427 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:41.928427 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:41.928427 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:41.928427 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:41.928427 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:41.928427 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:41.928427 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 08728bc9e2cf42e1a7b33a5616954fd9 Oct 18 13:16:41.928427 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:41.928427 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:16:41.928427 n-d-858384-13 devstack@n-api.service[120612]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:41.928427 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'nonexistent_hostname'} Oct 18 13:16:41.928427 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:41.929317 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:41.930351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:41.933616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84adda9b-a118-48ab-929f-ebf82971f8c7 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:41.935160 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-84adda9b-a118-48ab-929f-ebf82971f8c7 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.026623 Oct 18 13:16:41.936645 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 109/206] 10.222.0.40 () {58 vars in 1191 bytes} [Tue Oct 18 13:16:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:16:42.011820 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2623ee5e-16e4-44ab-8db3-b86691e206db tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/9e99502102654cb59aa31d05f7fcf2fd" status: 200 len: 371 microversion: 2.1 time: 0.672982 Oct 18 13:16:42.023769 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 98/207] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 18 13:16:41 2022] GET /compute/v2.1/os-quota-sets/9e99502102654cb59aa31d05f7fcf2fd => generated 371 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:42.039546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13ee285a-d233-4280-a405-a78f3250bab1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:42.040587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-13ee285a-d233-4280-a405-a78f3250bab1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:42.077709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13ee285a-d233-4280-a405-a78f3250bab1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:42.080571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13ee285a-d233-4280-a405-a78f3250bab1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:42.082136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13ee285a-d233-4280-a405-a78f3250bab1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:42.083076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13ee285a-d233-4280-a405-a78f3250bab1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:42.085508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13ee285a-d233-4280-a405-a78f3250bab1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:42.086176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13ee285a-d233-4280-a405-a78f3250bab1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:42.456424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-13ee285a-d233-4280-a405-a78f3250bab1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:42.493815 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13ee285a-d233-4280-a405-a78f3250bab1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1336 microversion: 2.1 time: 0.460653 Oct 18 13:16:42.523473 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 99/208] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:42 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1336 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:42.547732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8a4074aa-d161-488c-bafd-e3df833629d1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:42.548584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8a4074aa-d161-488c-bafd-e3df833629d1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:42.557379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a4074aa-d161-488c-bafd-e3df833629d1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:42.557978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a4074aa-d161-488c-bafd-e3df833629d1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:42.560133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a4074aa-d161-488c-bafd-e3df833629d1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:42.561240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a4074aa-d161-488c-bafd-e3df833629d1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:42.561925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a4074aa-d161-488c-bafd-e3df833629d1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:42.562558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a4074aa-d161-488c-bafd-e3df833629d1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:42.633257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7126deff-30e6-49cb-8ff7-ddbfb700efe8 tempest-HypervisorAdminNegativeUnderV252Test-829564268 tempest-HypervisorAdminNegativeUnderV252Test-829564268-project] Calling method '.version_select at 0x7ff6145724c0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:42.635172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7126deff-30e6-49cb-8ff7-ddbfb700efe8 tempest-HypervisorAdminNegativeUnderV252Test-829564268 tempest-HypervisorAdminNegativeUnderV252Test-829564268-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'a4585349360a46e2b3dbf67b3b71ba51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee766d3dd2e048a29bb44864764ebbdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7126deff-30e6-49cb-8ff7-ddbfb700efe8 tempest-HypervisorAdminNegativeUnderV252Test-829564268 tempest-HypervisorAdminNegativeUnderV252Test-829564268-project] Request method failure captured: Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-hypervisors/n-h2-858384-13/search HTTP/1.1 Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqc0t8_cEIdejBnMVQJPOnx767jqn-bJjAdXZoS2s2O-_UOqnM7KCeqGTOHgQgtMeDl_T6_D8G0xU07JPkJcHAd9lrDSw22uGdgPJyM88EaROCDQNiWG_nIcwVVmFBPxY3ctr2id6hRIsSKUfktTCw7J3Efk5itOfqDkgEsYMyKuId8 Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: ee766d3dd2e048a29bb44864764ebbdd Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-829564268 Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:42.641143 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:42.642409 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ee766d3dd2e048a29bb44864764ebbdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ee766d3dd2e048a29bb44864764ebbdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ee766d3dd2e048a29bb44864764ebbdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ee766d3dd2e048a29bb44864764ebbdd"}]}] Oct 18 13:16:42.642409 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-829564268 Oct 18 13:16:42.642409 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: ee766d3dd2e048a29bb44864764ebbdd Oct 18 13:16:42.642409 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-829564268 Oct 18 13:16:42.642409 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-829564268-project Oct 18 13:16:42.642409 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:42.642409 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:42.642409 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4585349360a46e2b3dbf67b3b71ba51 Oct 18 13:16:42.642409 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-829564268-project Oct 18 13:16:42.642409 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:16:42.642409 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 18 13:16:42.642409 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'n-h2-858384-13'} Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:42.643090 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 18 13:16:42.644134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:42.645049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7126deff-30e6-49cb-8ff7-ddbfb700efe8 tempest-HypervisorAdminNegativeUnderV252Test-829564268 tempest-HypervisorAdminNegativeUnderV252Test-829564268-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:42.645049 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7126deff-30e6-49cb-8ff7-ddbfb700efe8 tempest-HypervisorAdminNegativeUnderV252Test-829564268 tempest-HypervisorAdminNegativeUnderV252Test-829564268-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/n-h2-858384-13/search" status: 403 len: 117 microversion: 2.1 time: 0.704711 Oct 18 13:16:42.645049 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 110/209] 10.222.0.40 () {58 vars in 1212 bytes} [Tue Oct 18 13:16:41 2022] GET /compute/v2.1/os-hypervisors/n-h2-858384-13/search => generated 117 bytes in 706 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:42.659014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ca2509eb-4f5c-4fcf-985b-256b9da0616d tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Calling method '.version_select at 0x7ff61449edc0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:42.671028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ca2509eb-4f5c-4fcf-985b-256b9da0616d tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'f34b7946f9ae4455ba4ae7b31aee8361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2ed9529f246c8860318049fb1ddea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ca2509eb-4f5c-4fcf-985b-256b9da0616d tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Request method failure captured: Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-hosts/n-d-858384-13/shutdown HTTP/1.1 Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcz27vsoWDYPxWjmv-CWqpST3KchftESDES8EcwicfqjF5iCE_B4fBa6e1KUZh0uWFPD0vMIP0uGvDxyyA5z9fHWyakAvLyTAE6T5x9_ZWePJcWhpAkUY0RdlNcORWbKZgJlgp3vG6fPQaOX-QHIq3SVUJSkNRfWpioTSQpaZ_5CFM Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 1aa2ed9529f246c8860318049fb1ddea Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:42.674045 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:42.675457 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1aa2ed9529f246c8860318049fb1ddea"}]}] Oct 18 13:16:42.675457 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:42.675457 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 1aa2ed9529f246c8860318049fb1ddea Oct 18 13:16:42.675457 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:42.675457 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-HostsAdminNegativeTestJSON-1802438831-project Oct 18 13:16:42.675457 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:42.675457 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:42.675457 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: f34b7946f9ae4455ba4ae7b31aee8361 Oct 18 13:16:42.675457 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1802438831-project Oct 18 13:16:42.675457 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:16:42.675457 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 18 13:16:42.675457 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'n-d-858384-13'} Oct 18 13:16:42.675457 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:42.676281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 18 13:16:42.678066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:42.684428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ca2509eb-4f5c-4fcf-985b-256b9da0616d tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:42.685678 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ca2509eb-4f5c-4fcf-985b-256b9da0616d tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-858384-13/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.030607 Oct 18 13:16:42.690112 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 111/210] 10.222.0.40 () {58 vars in 1197 bytes} [Tue Oct 18 13:16:42 2022] GET /compute/v2.1/os-hosts/n-d-858384-13/shutdown => generated 113 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:42.697543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d4c4b897-1536-4569-820e-95ca3e231749 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Calling method '.version_select at 0x7ff6144980d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:42.871638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8a4074aa-d161-488c-bafd-e3df833629d1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:42.880557 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8a4074aa-d161-488c-bafd-e3df833629d1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1475 microversion: 2.1 time: 0.355337 Oct 18 13:16:42.905154 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 100/211] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:42 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1475 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:42.910760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb3c18d9-c621-456f-bf71-06d89fca72c6 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Calling method '.version_select at 0x7ff6142768b0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:42.912739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb3c18d9-c621-456f-bf71-06d89fca72c6 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:42.914201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb3c18d9-c621-456f-bf71-06d89fca72c6 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:42.914811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb3c18d9-c621-456f-bf71-06d89fca72c6 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:42.924211 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-cb3c18d9-c621-456f-bf71-06d89fca72c6 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb3c18d9-c621-456f-bf71-06d89fca72c6 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Request method failure captured: Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqc3BH-Vky5sI8S5-Prhc696woLsjHq1AP5SSrM4dQuIrccPl1uVv2M8NRZLWFvxB4ZBZWjNfy-UomI-ainTOjOU9IG2a4ip735LcAeXf7LBhRSuNlctOL1YpZwgxdEJzrUjowQFD5d0fukgECtI0AjWbvOMXtN_kaG3uGSVjxUQOVQ Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 42c12227f9c6428194304a439aed2e8f Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-776269803 Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:16:42.926164 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:16:42.927294 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/42c12227f9c6428194304a439aed2e8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/42c12227f9c6428194304a439aed2e8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/42c12227f9c6428194304a439aed2e8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_42c12227f9c6428194304a439aed2e8f"}]}] Oct 18 13:16:42.927294 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-776269803 Oct 18 13:16:42.927294 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 42c12227f9c6428194304a439aed2e8f Oct 18 13:16:42.927294 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-776269803 Oct 18 13:16:42.927294 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin Oct 18 13:16:42.927294 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:42.927294 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:42.927294 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7dc8671e9dca49c68df062f1e764bc4d Oct 18 13:16:42.927294 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin Oct 18 13:16:42.927294 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:16:42.927294 n-d-858384-13 devstack@n-api.service[120611]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 13:16:42.927294 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:42.927934 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:42.929030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:42.929030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:42.929030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:42.929030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 18 13:16:42.929030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:42.931146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb3c18d9-c621-456f-bf71-06d89fca72c6 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:42.933291 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cb3c18d9-c621-456f-bf71-06d89fca72c6 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.025666 Oct 18 13:16:42.934416 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 101/212] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 18 13:16:42 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:42.943103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0a039c31-4c52-444e-bcbb-5c1f16d83ccf tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Calling method '.version_select at 0x7ff61422ab80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.143722 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-0a039c31-4c52-444e-bcbb-5c1f16d83ccf tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0a039c31-4c52-444e-bcbb-5c1f16d83ccf tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Request method failure captured: Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqc1TtgqbOCE9iUEW8hAEFmMzMALaiVXmY6TJ4UsQSfAB48y5RC2F-nEmhPT9vAnJ8i8naqLmmEkArFAMFaTWYJJBvK-EGrIkjXzCjIHO7PE-ECjSmpzbeCm4tjg5ygzy-ArqGkucmRkqZ0WoRkOP44nfh9KeiXH-erpXLqZHByR-J8 Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:16:43.145723 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:16:43.147110 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_626a0d61bc88401b99d91bba3e4cae62"}]}] Oct 18 13:16:43.147110 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.147110 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:43.147110 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.147110 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:43.147110 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:43.147110 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:43.147110 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 08728bc9e2cf42e1a7b33a5616954fd9 Oct 18 13:16:43.147110 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:43.147110 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:16:43.147110 n-d-858384-13 devstack@n-api.service[120611]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.147110 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'nonexistent_hostname'} Oct 18 13:16:43.147110 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:43.147970 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 18 13:16:43.149260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:43.150467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.150467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.150467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.150467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.150467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.150467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.150467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.150467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:43.150467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:43.150467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.150467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.153442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0a039c31-4c52-444e-bcbb-5c1f16d83ccf tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:43.154644 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0a039c31-4c52-444e-bcbb-5c1f16d83ccf tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.218906 Oct 18 13:16:43.155519 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 102/213] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 18 13:16:42 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:16:43.215530 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d4c4b897-1536-4569-820e-95ca3e231749 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/311a30b744a14e74a278fd5e2aba51d8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.522865 Oct 18 13:16:43.228168 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 112/214] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:16:42 2022] GET /compute/v2.1/os-quota-sets/311a30b744a14e74a278fd5e2aba51d8/defaults => generated 371 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:43.233731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a9fedd37-a0cc-4057-a58d-6cb87578068c tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Calling method '.version_select at 0x7ff614448ca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.235961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9fedd37-a0cc-4057-a58d-6cb87578068c tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:43.236841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9fedd37-a0cc-4057-a58d-6cb87578068c tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:43.237459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9fedd37-a0cc-4057-a58d-6cb87578068c tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:43.260891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9fedd37-a0cc-4057-a58d-6cb87578068c tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:43.262035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9fedd37-a0cc-4057-a58d-6cb87578068c tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:43.262538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9fedd37-a0cc-4057-a58d-6cb87578068c tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:43.275799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9fedd37-a0cc-4057-a58d-6cb87578068c tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:43.276299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9fedd37-a0cc-4057-a58d-6cb87578068c tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:43.276895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9fedd37-a0cc-4057-a58d-6cb87578068c tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:43.283664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a6607fe7-2d10-4ec4-99e4-e8ffa17570e1 tempest-InstanceUsageAuditLogTestJSON-570960029 tempest-InstanceUsageAuditLogTestJSON-570960029-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.286399 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a9fedd37-a0cc-4057-a58d-6cb87578068c tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.056477 Oct 18 13:16:43.287200 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 113/215] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:16:43 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:43.292414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cd17f97f-728e-4c55-8035-36ae20887160 tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Calling method '.version_select at 0x7ff614498040>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.298348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cd17f97f-728e-4c55-8035-36ae20887160 tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'f34b7946f9ae4455ba4ae7b31aee8361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2ed9529f246c8860318049fb1ddea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cd17f97f-728e-4c55-8035-36ae20887160 tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Request method failure captured: Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-hosts/n-d-858384-13/startup HTTP/1.1 Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcz27vsoWDYPxWjmv-CWqpST3KchftESDES8EcwicfqjF5iCE_B4fBa6e1KUZh0uWFPD0vMIP0uGvDxyyA5z9fHWyakAvLyTAE6T5x9_ZWePJcWhpAkUY0RdlNcORWbKZgJlgp3vG6fPQaOX-QHIq3SVUJSkNRfWpioTSQpaZ_5CFM Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 1aa2ed9529f246c8860318049fb1ddea Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:43.300365 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:43.301571 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1aa2ed9529f246c8860318049fb1ddea"}]}] Oct 18 13:16:43.301571 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:43.301571 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 1aa2ed9529f246c8860318049fb1ddea Oct 18 13:16:43.301571 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:43.301571 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-HostsAdminNegativeTestJSON-1802438831-project Oct 18 13:16:43.301571 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:43.301571 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:43.301571 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: f34b7946f9ae4455ba4ae7b31aee8361 Oct 18 13:16:43.301571 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1802438831-project Oct 18 13:16:43.301571 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:16:43.301571 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 18 13:16:43.301571 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'n-d-858384-13'} Oct 18 13:16:43.301571 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:43.302294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 18 13:16:43.304219 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.305883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cd17f97f-728e-4c55-8035-36ae20887160 tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:43.305883 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cd17f97f-728e-4c55-8035-36ae20887160 tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-d-858384-13/startup" status: 403 len: 110 microversion: 2.1 time: 0.013355 Oct 18 13:16:43.306967 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 114/216] 10.222.0.40 () {58 vars in 1194 bytes} [Tue Oct 18 13:16:43 2022] GET /compute/v2.1/os-hosts/n-d-858384-13/startup => generated 110 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:43.313255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c07e5242-3356-4a4f-b47d-b4502ec2f047 tempest-HypervisorAdminNegativeUnderV252Test-829564268 tempest-HypervisorAdminNegativeUnderV252Test-829564268-project] Calling method '.version_select at 0x7ff614493a60>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.316133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c07e5242-3356-4a4f-b47d-b4502ec2f047 tempest-HypervisorAdminNegativeUnderV252Test-829564268 tempest-HypervisorAdminNegativeUnderV252Test-829564268-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'a4585349360a46e2b3dbf67b3b71ba51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee766d3dd2e048a29bb44864764ebbdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c07e5242-3356-4a4f-b47d-b4502ec2f047 tempest-HypervisorAdminNegativeUnderV252Test-829564268 tempest-HypervisorAdminNegativeUnderV252Test-829564268-project] Request method failure captured: Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqc0t8_cEIdejBnMVQJPOnx767jqn-bJjAdXZoS2s2O-_UOqnM7KCeqGTOHgQgtMeDl_T6_D8G0xU07JPkJcHAd9lrDSw22uGdgPJyM88EaROCDQNiWG_nIcwVVmFBPxY3ctr2id6hRIsSKUfktTCw7J3Efk5itOfqDkgEsYMyKuId8 Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: ee766d3dd2e048a29bb44864764ebbdd Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-829564268 Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:43.317723 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:43.318987 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ee766d3dd2e048a29bb44864764ebbdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ee766d3dd2e048a29bb44864764ebbdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ee766d3dd2e048a29bb44864764ebbdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ee766d3dd2e048a29bb44864764ebbdd"}]}] Oct 18 13:16:43.318987 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-829564268 Oct 18 13:16:43.318987 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: ee766d3dd2e048a29bb44864764ebbdd Oct 18 13:16:43.318987 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-829564268 Oct 18 13:16:43.318987 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-829564268-project Oct 18 13:16:43.318987 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:43.318987 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:43.318987 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4585349360a46e2b3dbf67b3b71ba51 Oct 18 13:16:43.318987 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-829564268-project Oct 18 13:16:43.318987 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:16:43.318987 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 18 13:16:43.318987 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '1'} Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:43.319754 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 18 13:16:43.320718 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.322953 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a6607fe7-2d10-4ec4-99e4-e8ffa17570e1 tempest-InstanceUsageAuditLogTestJSON-570960029 tempest-InstanceUsageAuditLogTestJSON-570960029-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18 13:16:42" status: 200 len: 318 microversion: 2.1 time: 0.165978 Oct 18 13:16:43.332346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c07e5242-3356-4a4f-b47d-b4502ec2f047 tempest-HypervisorAdminNegativeUnderV252Test-829564268 tempest-HypervisorAdminNegativeUnderV252Test-829564268-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:43.332630 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 103/217] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 18 13:16:43 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18%2013%3A16%3A42 => generated 318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:43.332809 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c07e5242-3356-4a4f-b47d-b4502ec2f047 tempest-HypervisorAdminNegativeUnderV252Test-829564268 tempest-HypervisorAdminNegativeUnderV252Test-829564268-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.017770 Oct 18 13:16:43.332809 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 115/218] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 18 13:16:43 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:43.336684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed387b09-3085-4484-8e83-6f588e81b831 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Calling method '.version_select at 0x7ff614493040>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.338366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed387b09-3085-4484-8e83-6f588e81b831 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:43.339019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed387b09-3085-4484-8e83-6f588e81b831 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:43.339422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ea7a202b-ef7d-43d5-b5e0-72b9042bab05 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Calling method '.version_select at 0x7ff6143c2040>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.340853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed387b09-3085-4484-8e83-6f588e81b831 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:43.354943 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-ea7a202b-ef7d-43d5-b5e0-72b9042bab05 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ea7a202b-ef7d-43d5-b5e0-72b9042bab05 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Request method failure captured: Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqc1TtgqbOCE9iUEW8hAEFmMzMALaiVXmY6TJ4UsQSfAB48y5RC2F-nEmhPT9vAnJ8i8naqLmmEkArFAMFaTWYJJBvK-EGrIkjXzCjIHO7PE-ECjSmpzbeCm4tjg5ygzy-ArqGkucmRkqZ0WoRkOP44nfh9KeiXH-erpXLqZHByR-J8 Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:16:43.356801 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:16:43.357964 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_626a0d61bc88401b99d91bba3e4cae62"}]}] Oct 18 13:16:43.357964 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.357964 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:43.357964 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.357964 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:43.357964 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:43.357964 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:43.357964 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 08728bc9e2cf42e1a7b33a5616954fd9 Oct 18 13:16:43.357964 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:43.357964 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:16:43.357964 n-d-858384-13 devstack@n-api.service[120611]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.357964 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'nonexistent_hostname'} Oct 18 13:16:43.357964 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:43.358732 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 18 13:16:43.359687 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ea7a202b-ef7d-43d5-b5e0-72b9042bab05 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ea7a202b-ef7d-43d5-b5e0-72b9042bab05 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.033049 Oct 18 13:16:43.360675 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 104/219] 10.222.0.40 () {58 vars in 1215 bytes} [Tue Oct 18 13:16:43 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:16:43.366559 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-ed387b09-3085-4484-8e83-6f588e81b831 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] HTTP exception thrown: No hypervisor matching 'f1c10311-7a35-417e-9a79-d4d15aac7bf0' could be found. Oct 18 13:16:43.366870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b2d760c2-9d12-44a3-b80d-50cfbf33cd37 tempest-InstanceUsageAuditLogTestJSON-570960029 tempest-InstanceUsageAuditLogTestJSON-570960029-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed387b09-3085-4484-8e83-6f588e81b831 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Request method failure captured: Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-hypervisors/f1c10311-7a35-417e-9a79-d4d15aac7bf0/servers HTTP/1.1 Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqc3BH-Vky5sI8S5-Prhc696woLsjHq1AP5SSrM4dQuIrccPl1uVv2M8NRZLWFvxB4ZBZWjNfy-UomI-ainTOjOU9IG2a4ip735LcAeXf7LBhRSuNlctOL1YpZwgxdEJzrUjowQFD5d0fukgECtI0AjWbvOMXtN_kaG3uGSVjxUQOVQ Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 42c12227f9c6428194304a439aed2e8f Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-776269803 Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:43.368365 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:43.369524 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/42c12227f9c6428194304a439aed2e8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/42c12227f9c6428194304a439aed2e8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/42c12227f9c6428194304a439aed2e8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_42c12227f9c6428194304a439aed2e8f"}]}] Oct 18 13:16:43.369524 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-776269803 Oct 18 13:16:43.369524 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 42c12227f9c6428194304a439aed2e8f Oct 18 13:16:43.369524 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-776269803 Oct 18 13:16:43.369524 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin Oct 18 13:16:43.369524 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:43.369524 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:43.369524 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7dc8671e9dca49c68df062f1e764bc4d Oct 18 13:16:43.369524 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin Oct 18 13:16:43.369524 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:16:43.369524 n-d-858384-13 devstack@n-api.service[120612]: exception: No hypervisor matching 'f1c10311-7a35-417e-9a79-d4d15aac7bf0' could be found. Oct 18 13:16:43.369524 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'f1c10311-7a35-417e-9a79-d4d15aac7bf0'} Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'f1c10311-7a35-417e-9a79-d4d15aac7bf0' could be found. Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.371303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.372752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.372752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.372752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:43.372752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:43.372752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'f1c10311-7a35-417e-9a79-d4d15aac7bf0' could be found. Oct 18 13:16:43.372752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.372752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed387b09-3085-4484-8e83-6f588e81b831 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] Returning 404 to user: No hypervisor matching 'f1c10311-7a35-417e-9a79-d4d15aac7bf0' could be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:43.378446 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ed387b09-3085-4484-8e83-6f588e81b831 tempest-HypervisorAdminNegativeUnderV252Test-776269803 tempest-HypervisorAdminNegativeUnderV252Test-776269803-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/f1c10311-7a35-417e-9a79-d4d15aac7bf0/servers" status: 404 len: 123 microversion: 2.1 time: 0.041217 Oct 18 13:16:43.378446 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 116/220] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 18 13:16:43 2022] GET /compute/v2.1/os-hypervisors/f1c10311-7a35-417e-9a79-d4d15aac7bf0/servers => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:43.381961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e86e415f-b2b9-42cc-bc2a-3c5f8d99ba01 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Action: 'update', calling method: .version_select at 0x7ff61450f9d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:43.396992 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b2d760c2-9d12-44a3-b80d-50cfbf33cd37 tempest-InstanceUsageAuditLogTestJSON-570960029 tempest-InstanceUsageAuditLogTestJSON-570960029-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.036849 Oct 18 13:16:43.397601 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 105/221] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 18 13:16:43 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e86e415f-b2b9-42cc-bc2a-3c5f8d99ba01 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Request method failure captured: Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: request: PUT /compute/v2.1/os-hosts/n-d-858384-13 HTTP/1.1 Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 51 Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqc1TtgqbOCE9iUEW8hAEFmMzMALaiVXmY6TJ4UsQSfAB48y5RC2F-nEmhPT9vAnJ8i8naqLmmEkArFAMFaTWYJJBvK-EGrIkjXzCjIHO7PE-ECjSmpzbeCm4tjg5ygzy-ArqGkucmRkqZ0WoRkOP44nfh9KeiXH-erpXLqZHByR-J8 Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:43.403544 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:43.406573 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_626a0d61bc88401b99d91bba3e4cae62"}]}] Oct 18 13:16:43.406573 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.406573 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:43.406573 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.406573 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:43.406573 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:43.406573 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:43.406573 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 08728bc9e2cf42e1a7b33a5616954fd9 Oct 18 13:16:43.406573 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:43.406573 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:16:43.406573 n-d-858384-13 devstack@n-api.service[120612]: {"status": "enable", "maintenance_mode": "invalid"} Oct 18 13:16:43.406573 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:16:43.406573 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'n-d-858384-13', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'disable', Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'Enable', Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'Disable', Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance: Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.407413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.409009 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.410267 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.410267 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:16:43.410267 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:16:43.410267 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:16:43.410267 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.410267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e86e415f-b2b9-42cc-bc2a-3c5f8d99ba01 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:43.410267 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e86e415f-b2b9-42cc-bc2a-3c5f8d99ba01 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-858384-13" status: 400 len: 199 microversion: 2.1 time: 0.029789 Oct 18 13:16:43.410267 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 117/222] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 18 13:16:43 2022] PUT /compute/v2.1/os-hosts/n-d-858384-13 => generated 199 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:16:43.417098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fbbfe69f-3a7b-4939-ae82-3db95bf980cc tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Action: 'update', calling method: .version_select at 0x7ff6142afee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fbbfe69f-3a7b-4939-ae82-3db95bf980cc tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Request method failure captured: Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: request: PUT /compute/v2.1/os-hosts/n-d-858384-13 HTTP/1.1 Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 51 Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqc1TtgqbOCE9iUEW8hAEFmMzMALaiVXmY6TJ4UsQSfAB48y5RC2F-nEmhPT9vAnJ8i8naqLmmEkArFAMFaTWYJJBvK-EGrIkjXzCjIHO7PE-ECjSmpzbeCm4tjg5ygzy-ArqGkucmRkqZ0WoRkOP44nfh9KeiXH-erpXLqZHByR-J8 Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:16:43.421322 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:16:43.422553 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_626a0d61bc88401b99d91bba3e4cae62"}]}] Oct 18 13:16:43.422553 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.422553 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:43.422553 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.422553 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:43.422553 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:43.422553 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:43.422553 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 08728bc9e2cf42e1a7b33a5616954fd9 Oct 18 13:16:43.422553 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:43.422553 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:16:43.422553 n-d-858384-13 devstack@n-api.service[120611]: {"status": "invalid", "maintenance_mode": "enable"} Oct 18 13:16:43.422553 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:16:43.422553 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'n-d-858384-13', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'disable', Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'Enable', Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'Disable', Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance: Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.423239 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.424809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.425871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.425871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:16:43.425871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:16:43.425871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 18 13:16:43.425871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.425871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fbbfe69f-3a7b-4939-ae82-3db95bf980cc tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:43.425871 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fbbfe69f-3a7b-4939-ae82-3db95bf980cc tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-858384-13" status: 400 len: 189 microversion: 2.1 time: 0.011610 Oct 18 13:16:43.425871 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 106/223] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 18 13:16:43 2022] PUT /compute/v2.1/os-hosts/n-d-858384-13 => generated 189 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:16:43.435428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3b0c20e0-dc42-43c1-82a6-ec6cb716850a tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Action: 'update', calling method: .version_select at 0x7ff6145724c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:43.440204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3b0c20e0-dc42-43c1-82a6-ec6cb716850a tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'f34b7946f9ae4455ba4ae7b31aee8361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa2ed9529f246c8860318049fb1ddea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3b0c20e0-dc42-43c1-82a6-ec6cb716850a tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Request method failure captured: Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: request: PUT /compute/v2.1/os-hosts/n-d-858384-13 HTTP/1.1 Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 50 Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcz27vsoWDYPxWjmv-CWqpST3KchftESDES8EcwicfqjF5iCE_B4fBa6e1KUZh0uWFPD0vMIP0uGvDxyyA5z9fHWyakAvLyTAE6T5x9_ZWePJcWhpAkUY0RdlNcORWbKZgJlgp3vG6fPQaOX-QHIq3SVUJSkNRfWpioTSQpaZ_5CFM Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 1aa2ed9529f246c8860318049fb1ddea Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:43.443042 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1aa2ed9529f246c8860318049fb1ddea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1aa2ed9529f246c8860318049fb1ddea"}]}] Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 1aa2ed9529f246c8860318049fb1ddea Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1802438831 Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-HostsAdminNegativeTestJSON-1802438831-project Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: f34b7946f9ae4455ba4ae7b31aee8361 Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1802438831-project Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: {"status": "enable", "maintenance_mode": "enable"} Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 18 13:16:43.444436 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'n-d-858384-13', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:43.445382 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 18 13:16:43.446662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.447876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3b0c20e0-dc42-43c1-82a6-ec6cb716850a tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:43.447876 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3b0c20e0-dc42-43c1-82a6-ec6cb716850a tempest-HostsAdminNegativeTestJSON-1802438831 tempest-HostsAdminNegativeTestJSON-1802438831-project] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-858384-13" status: 403 len: 111 microversion: 2.1 time: 0.015769 Oct 18 13:16:43.450296 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 118/224] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 18 13:16:43 2022] PUT /compute/v2.1/os-hosts/n-d-858384-13 => generated 111 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:43.460949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c20c683-5bb4-4fc0-b8fc-1447c8a12dec tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Action: 'update', calling method: .version_select at 0x7ff6142768b0>, body: {"status": null, "maintenance_mode": null} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c20c683-5bb4-4fc0-b8fc-1447c8a12dec tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Request method failure captured: Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: request: PUT /compute/v2.1/os-hosts/n-d-858384-13 HTTP/1.1 Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 42 Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqc1TtgqbOCE9iUEW8hAEFmMzMALaiVXmY6TJ4UsQSfAB48y5RC2F-nEmhPT9vAnJ8i8naqLmmEkArFAMFaTWYJJBvK-EGrIkjXzCjIHO7PE-ECjSmpzbeCm4tjg5ygzy-ArqGkucmRkqZ0WoRkOP44nfh9KeiXH-erpXLqZHByR-J8 Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:16:43.467167 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_626a0d61bc88401b99d91bba3e4cae62"}]}] Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 08728bc9e2cf42e1a7b33a5616954fd9 Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: {"status": null, "maintenance_mode": null} Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 18 13:16:43.468727 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'n-d-858384-13', 'body': {'status': None, 'maintenance_mode': None}} Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'disable', Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'Enable', Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'Disable', Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance: Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi None Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.469657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.471369 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.472546 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:16:43.472546 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:16:43.472546 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 18 13:16:43.472546 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.474935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c20c683-5bb4-4fc0-b8fc-1447c8a12dec tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:43.476128 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7c20c683-5bb4-4fc0-b8fc-1447c8a12dec tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/n-d-858384-13" status: 400 len: 127 microversion: 2.1 time: 0.020192 Oct 18 13:16:43.477230 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 107/225] 10.222.0.40 () {60 vars in 1190 bytes} [Tue Oct 18 13:16:43 2022] PUT /compute/v2.1/os-hosts/n-d-858384-13 => generated 127 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:16:43.486940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35bcc469-bbb6-42b4-95fe-35921ddc6869 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Action: 'update', calling method: .version_select at 0x7ff61450f550>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:43.491644 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.hosts [None req-35bcc469-bbb6-42b4-95fe-35921ddc6869 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Enabling host nonexistent_hostname. Oct 18 13:16:43.501966 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-35bcc469-bbb6-42b4-95fe-35921ddc6869 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35bcc469-bbb6-42b4-95fe-35921ddc6869 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Request method failure captured: Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 50 Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqc1TtgqbOCE9iUEW8hAEFmMzMALaiVXmY6TJ4UsQSfAB48y5RC2F-nEmhPT9vAnJ8i8naqLmmEkArFAMFaTWYJJBvK-EGrIkjXzCjIHO7PE-ECjSmpzbeCm4tjg5ygzy-ArqGkucmRkqZ0WoRkOP44nfh9KeiXH-erpXLqZHByR-J8 Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:43.504056 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/626a0d61bc88401b99d91bba3e4cae62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_626a0d61bc88401b99d91bba3e4cae62"}]}] Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 626a0d61bc88401b99d91bba3e4cae62 Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-732541622 Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 08728bc9e2cf42e1a7b33a5616954fd9 Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-HostsAdminNegativeTestJSON-732541622-project-admin Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: {"status": "enable", "maintenance_mode": "enable"} Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.505271 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:16:43.506012 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:43.506914 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 18 13:16:43.507930 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:43.509776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35bcc469-bbb6-42b4-95fe-35921ddc6869 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:43.510803 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-35bcc469-bbb6-42b4-95fe-35921ddc6869 tempest-HostsAdminNegativeTestJSON-732541622 tempest-HostsAdminNegativeTestJSON-732541622-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.027817 Oct 18 13:16:43.512470 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 119/226] 10.222.0.40 () {60 vars in 1211 bytes} [Tue Oct 18 13:16:43 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:16:43.551915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-82a93d69-c14d-4108-9d66-f6e04aca4135 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.552999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-82a93d69-c14d-4108-9d66-f6e04aca4135 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:43.560383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82a93d69-c14d-4108-9d66-f6e04aca4135 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:43.560886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82a93d69-c14d-4108-9d66-f6e04aca4135 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:43.561355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82a93d69-c14d-4108-9d66-f6e04aca4135 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:43.562210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82a93d69-c14d-4108-9d66-f6e04aca4135 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:43.562677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82a93d69-c14d-4108-9d66-f6e04aca4135 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:43.563125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82a93d69-c14d-4108-9d66-f6e04aca4135 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:43.600416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bb13de3d-90f5-4410-96e1-a206d02d2a21 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Action: 'update', calling method: .version_select at 0x7ff61485e3a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:43.763447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-82a93d69-c14d-4108-9d66-f6e04aca4135 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:43.781146 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-82a93d69-c14d-4108-9d66-f6e04aca4135 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1486 microversion: 2.1 time: 0.234462 Oct 18 13:16:43.782836 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 108/227] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:43 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1486 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:43.809042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d5c6ebc-ec6b-4c8f-ada6-db9501b7cfee tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:43.810317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3d5c6ebc-ec6b-4c8f-ada6-db9501b7cfee tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:43.817228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d5c6ebc-ec6b-4c8f-ada6-db9501b7cfee tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:43.817955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d5c6ebc-ec6b-4c8f-ada6-db9501b7cfee tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:43.818712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d5c6ebc-ec6b-4c8f-ada6-db9501b7cfee tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:43.819562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d5c6ebc-ec6b-4c8f-ada6-db9501b7cfee tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:43.820162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d5c6ebc-ec6b-4c8f-ada6-db9501b7cfee tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:43.820729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d5c6ebc-ec6b-4c8f-ada6-db9501b7cfee tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:44.197509 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3d5c6ebc-ec6b-4c8f-ada6-db9501b7cfee tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1639 microversion: 2.1 time: 0.391384 Oct 18 13:16:44.198278 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 109/228] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:43 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1639 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:16:44.206927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cf5582b0-2a62-4acc-9491-8652b176bf01 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:44.211005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cf5582b0-2a62-4acc-9491-8652b176bf01 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:44.226323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf5582b0-2a62-4acc-9491-8652b176bf01 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:44.226918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf5582b0-2a62-4acc-9491-8652b176bf01 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:44.227360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf5582b0-2a62-4acc-9491-8652b176bf01 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:44.228153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf5582b0-2a62-4acc-9491-8652b176bf01 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:44.228522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf5582b0-2a62-4acc-9491-8652b176bf01 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:44.228941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf5582b0-2a62-4acc-9491-8652b176bf01 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:44.419047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cf5582b0-2a62-4acc-9491-8652b176bf01 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:44.428990 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cf5582b0-2a62-4acc-9491-8652b176bf01 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1475 microversion: 2.1 time: 0.228187 Oct 18 13:16:44.430044 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 110/229] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:44 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1475 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:44.435120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f8825189-add7-47f5-b92b-cc43fcb5c4ab tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:44.435870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f8825189-add7-47f5-b92b-cc43fcb5c4ab tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:44.442408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8825189-add7-47f5-b92b-cc43fcb5c4ab tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:44.443111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8825189-add7-47f5-b92b-cc43fcb5c4ab tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:44.444004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8825189-add7-47f5-b92b-cc43fcb5c4ab tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:44.444889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8825189-add7-47f5-b92b-cc43fcb5c4ab tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:44.445543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8825189-add7-47f5-b92b-cc43fcb5c4ab tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:44.446143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8825189-add7-47f5-b92b-cc43fcb5c4ab tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:44.475085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f8825189-add7-47f5-b92b-cc43fcb5c4ab tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:16:44.575863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=2,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:44.589367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb13de3d-90f5-4410-96e1-a206d02d2a21 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:44.590419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb13de3d-90f5-4410-96e1-a206d02d2a21 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:44.590891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb13de3d-90f5-4410-96e1-a206d02d2a21 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:44.591685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb13de3d-90f5-4410-96e1-a206d02d2a21 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:44.592161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb13de3d-90f5-4410-96e1-a206d02d2a21 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:44.592562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb13de3d-90f5-4410-96e1-a206d02d2a21 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:44.684746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:44.693106 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f8825189-add7-47f5-b92b-cc43fcb5c4ab tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 204 len: 0 microversion: 2.1 time: 0.259766 Oct 18 13:16:44.695364 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 111/230] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:16:44 2022] DELETE /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:16:44.710656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-57af5e72-e2f6-4898-8fce-0f110b8c24f3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:44.711560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-57af5e72-e2f6-4898-8fce-0f110b8c24f3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:44.747637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57af5e72-e2f6-4898-8fce-0f110b8c24f3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:44.751793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57af5e72-e2f6-4898-8fce-0f110b8c24f3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:44.753736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57af5e72-e2f6-4898-8fce-0f110b8c24f3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:44.754593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57af5e72-e2f6-4898-8fce-0f110b8c24f3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:44.758091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57af5e72-e2f6-4898-8fce-0f110b8c24f3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:44.761892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57af5e72-e2f6-4898-8fce-0f110b8c24f3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:44.818897 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bb13de3d-90f5-4410-96e1-a206d02d2a21 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/f42bfd7a75da47db876b05ed68c5ca0a" status: 200 len: 328 microversion: 2.1 time: 1.219308 Oct 18 13:16:44.825223 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 120/231] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:16:43 2022] PUT /compute/v2.1/os-quota-sets/f42bfd7a75da47db876b05ed68c5ca0a => generated 328 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:44.839329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-69272564-7f89-4af1-9da0-e99d38b3a4e2 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Calling method '.version_select at 0x7ff614572ca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:45.061207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69272564-7f89-4af1-9da0-e99d38b3a4e2 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:45.061972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69272564-7f89-4af1-9da0-e99d38b3a4e2 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:45.062814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69272564-7f89-4af1-9da0-e99d38b3a4e2 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:45.063837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69272564-7f89-4af1-9da0-e99d38b3a4e2 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:45.064476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69272564-7f89-4af1-9da0-e99d38b3a4e2 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:45.065807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69272564-7f89-4af1-9da0-e99d38b3a4e2 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:45.094563 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-69272564-7f89-4af1-9da0-e99d38b3a4e2 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/f42bfd7a75da47db876b05ed68c5ca0a/detail" status: 200 len: 916 microversion: 2.1 time: 0.261623 Oct 18 13:16:45.111969 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 121/232] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:16:44 2022] GET /compute/v2.1/os-quota-sets/f42bfd7a75da47db876b05ed68c5ca0a/detail => generated 916 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:45.161313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-57af5e72-e2f6-4898-8fce-0f110b8c24f3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:45.169928 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-57af5e72-e2f6-4898-8fce-0f110b8c24f3 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1492 microversion: 2.1 time: 0.469621 Oct 18 13:16:45.170722 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 112/233] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:44 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1492 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:45.325272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Action: 'update', calling method: .version_select at 0x7ff6145349d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:45.335819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-410213cf-1493-40d3-a757-7767b79f5d50 req-5f75e671-5359-4ff2-9265-a4d0b0321cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0004e9-bd82-4cf2-b211-924251e95184", "name": "network-vif-deleted", "tag": "ea136430-53d3-4c59-9ce6-7e1a5d79d2d0"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:45.359933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-410213cf-1493-40d3-a757-7767b79f5d50 req-5f75e671-5359-4ff2-9265-a4d0b0321cc2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:45.360435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-410213cf-1493-40d3-a757-7767b79f5d50 req-5f75e671-5359-4ff2-9265-a4d0b0321cc2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:45.360875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-410213cf-1493-40d3-a757-7767b79f5d50 req-5f75e671-5359-4ff2-9265-a4d0b0321cc2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:45.384311 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-410213cf-1493-40d3-a757-7767b79f5d50 req-5f75e671-5359-4ff2-9265-a4d0b0321cc2 service nova] Creating event network-vif-deleted:ea136430-53d3-4c59-9ce6-7e1a5d79d2d0 for instance 0d0004e9-bd82-4cf2-b211-924251e95184 on n-h1-858384-13 Oct 18 13:16:45.401551 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-410213cf-1493-40d3-a757-7767b79f5d50 req-5f75e671-5359-4ff2-9265-a4d0b0321cc2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069108 Oct 18 13:16:45.405916 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 113/234] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:45.455930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5f57db9a-ff17-4632-8dbb-e880e4104e84 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:45.456736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5f57db9a-ff17-4632-8dbb-e880e4104e84 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:45.471064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f57db9a-ff17-4632-8dbb-e880e4104e84 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:45.471554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f57db9a-ff17-4632-8dbb-e880e4104e84 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:45.471997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f57db9a-ff17-4632-8dbb-e880e4104e84 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:45.472713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f57db9a-ff17-4632-8dbb-e880e4104e84 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:45.473167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f57db9a-ff17-4632-8dbb-e880e4104e84 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:45.475201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f57db9a-ff17-4632-8dbb-e880e4104e84 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:45.504939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:45.506893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:45.508694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:45.510568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:45.513113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:45.513851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:45.585220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5f57db9a-ff17-4632-8dbb-e880e4104e84 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:45.596296 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5f57db9a-ff17-4632-8dbb-e880e4104e84 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 200 len: 1305 microversion: 2.1 time: 0.144538 Oct 18 13:16:45.597348 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 114/235] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:45 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 1305 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:16:45.642389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:45.643534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:45.644038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:45.645667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:45.646375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:45.648161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:45.807175 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aa8d7052-0866-41f1-b0ff-80b25407be0a tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/f42bfd7a75da47db876b05ed68c5ca0a?user_id=c8be9dce444643108a545679be7395e2" status: 200 len: 328 microversion: 2.1 time: 0.486508 Oct 18 13:16:45.807845 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 122/236] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:16:45 2022] PUT /compute/v2.1/os-quota-sets/f42bfd7a75da47db876b05ed68c5ca0a?user_id=c8be9dce444643108a545679be7395e2 => generated 328 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:45.822030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0e636bc4-a2e1-4f10-816d-38ed3d988456 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Calling method '.version_select at 0x7ff6142afdc0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:46.198095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f99225dc-42ee-45ee-8911-f3cf502aeaa6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:46.199431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f99225dc-42ee-45ee-8911-f3cf502aeaa6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:46.213169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f99225dc-42ee-45ee-8911-f3cf502aeaa6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:46.216429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f99225dc-42ee-45ee-8911-f3cf502aeaa6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:46.226397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f99225dc-42ee-45ee-8911-f3cf502aeaa6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:46.227367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f99225dc-42ee-45ee-8911-f3cf502aeaa6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:46.228059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f99225dc-42ee-45ee-8911-f3cf502aeaa6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:46.228641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f99225dc-42ee-45ee-8911-f3cf502aeaa6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:46.596121 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0e636bc4-a2e1-4f10-816d-38ed3d988456 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/f42bfd7a75da47db876b05ed68c5ca0a?user_id=c8be9dce444643108a545679be7395e2" status: 200 len: 370 microversion: 2.1 time: 0.778208 Oct 18 13:16:46.597004 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 115/237] 10.222.0.40 () {58 vars in 1323 bytes} [Tue Oct 18 13:16:45 2022] GET /compute/v2.1/os-quota-sets/f42bfd7a75da47db876b05ed68c5ca0a?user_id=c8be9dce444643108a545679be7395e2 => generated 370 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:46.624471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f99225dc-42ee-45ee-8911-f3cf502aeaa6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:46.624677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f91c1b00-68f9-47da-8e6e-8229f1abd937 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:46.625216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f91c1b00-68f9-47da-8e6e-8229f1abd937 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:46.638477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91c1b00-68f9-47da-8e6e-8229f1abd937 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:46.638972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91c1b00-68f9-47da-8e6e-8229f1abd937 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:46.639406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91c1b00-68f9-47da-8e6e-8229f1abd937 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:46.639724 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f99225dc-42ee-45ee-8911-f3cf502aeaa6 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1492 microversion: 2.1 time: 0.442082 Oct 18 13:16:46.640115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91c1b00-68f9-47da-8e6e-8229f1abd937 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:46.649216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91c1b00-68f9-47da-8e6e-8229f1abd937 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:46.649527 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 123/238] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:46 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1492 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:16:46.650044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f91c1b00-68f9-47da-8e6e-8229f1abd937 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:46.678600 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-f91c1b00-68f9-47da-8e6e-8229f1abd937 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] HTTP exception thrown: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f91c1b00-68f9-47da-8e6e-8229f1abd937 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Request method failure captured: Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 HTTP/1.1 Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcPZXy_4JwNP1a1u4w-1mGU-RfKZ09fExKbZv2llD7jMdtkydI3zE7KkQPaWZzx8tz_zuaWKwU13EwWhzReuMSY2RTLCjxbXFj8_NjF2pWfgKKy4X6hwPmx54ZZM49H9bNMKaBvmbIiEr5zW78O011N3zOpkdzrPgyoU1YX8nwRdY0 Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 8e57e4407cc94732a5144972bf546dd2 Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:16:46.681212 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:16:46.682414 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8e57e4407cc94732a5144972bf546dd2"}]}] Oct 18 13:16:46.682414 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:16:46.682414 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 8e57e4407cc94732a5144972bf546dd2 Oct 18 13:16:46.682414 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:16:46.682414 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersAdminTestJSON-819045708-project Oct 18 13:16:46.682414 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:46.682414 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:46.682414 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6c06e155847a4386881f49f26c02dcec Oct 18 13:16:46.682414 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersAdminTestJSON-819045708-project Oct 18 13:16:46.682414 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:46.682414 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:16:46.682414 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '0d0004e9-bd82-4cf2-b211-924251e95184'} Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:46.683069 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:16:46.686018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:46.696027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f91c1b00-68f9-47da-8e6e-8229f1abd937 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Returning 404 to user: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:46.696910 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f91c1b00-68f9-47da-8e6e-8229f1abd937 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 404 len: 111 microversion: 2.1 time: 0.076735 Oct 18 13:16:46.699402 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 116/239] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:46 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:47.116374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-246966013", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:47.212571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:16:47.671556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3184a34d-0c62-4069-b053-4cc67128458d tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:47.673261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3184a34d-0c62-4069-b053-4cc67128458d tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:47.688979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3184a34d-0c62-4069-b053-4cc67128458d tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:47.693586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3184a34d-0c62-4069-b053-4cc67128458d tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:47.694307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3184a34d-0c62-4069-b053-4cc67128458d tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:47.696835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3184a34d-0c62-4069-b053-4cc67128458d tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:47.702245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3184a34d-0c62-4069-b053-4cc67128458d tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:47.704467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3184a34d-0c62-4069-b053-4cc67128458d tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:47.943912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3184a34d-0c62-4069-b053-4cc67128458d tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0b91312f644348b978e07632259760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5cae9601cd4b40bd657b7304b17fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:47.954613 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3184a34d-0c62-4069-b053-4cc67128458d tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 200 len: 1450 microversion: 2.1 time: 0.290118 Oct 18 13:16:47.973248 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 117/240] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:47 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 1450 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:47.983352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a196aa8d-5ecc-42b9-b0f1-72cfbdf95b69 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Calling method '.version_select at 0x7ff6158774c0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:48.593377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:16:48.595014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:16:48.595655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:16:48.596224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:16:48.596793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:16:48.616314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:48.620147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:48.622488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:48.626313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:48.627240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:48.629686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:48.679424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Getting quotas for project 8e57e4407cc94732a5144972bf546dd2. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:16:48.699521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Getting quotas for user 6c06e155847a4386881f49f26c02dcec and project 8e57e4407cc94732a5144972bf546dd2. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:16:48.722807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:16:48.725577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:16:48.816423 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-99b05610-923a-420d-8f12-be33ddd7c104 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.703396 Oct 18 13:16:48.828015 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 124/241] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:16:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:16:48.843810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e43c8625-43d6-4c8e-846f-0f00b44b9159 req-1c6fa4ba-3612-4b65-a6ac-3be5a7dac39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4749485a-14ea-47b4-a16a-42da495ebb0f", "name": "network-vif-deleted", "tag": "47a6d7f0-df4a-470d-94e7-a450badcb884"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:48.861264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e43c8625-43d6-4c8e-846f-0f00b44b9159 req-1c6fa4ba-3612-4b65-a6ac-3be5a7dac39d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:48.861983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e43c8625-43d6-4c8e-846f-0f00b44b9159 req-1c6fa4ba-3612-4b65-a6ac-3be5a7dac39d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:48.862561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e43c8625-43d6-4c8e-846f-0f00b44b9159 req-1c6fa4ba-3612-4b65-a6ac-3be5a7dac39d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:48.889785 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e43c8625-43d6-4c8e-846f-0f00b44b9159 req-1c6fa4ba-3612-4b65-a6ac-3be5a7dac39d service nova] Creating event network-vif-deleted:47a6d7f0-df4a-470d-94e7-a450badcb884 for instance 4749485a-14ea-47b4-a16a-42da495ebb0f on n-h2-858384-13 Oct 18 13:16:48.903916 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e43c8625-43d6-4c8e-846f-0f00b44b9159 req-1c6fa4ba-3612-4b65-a6ac-3be5a7dac39d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068583 Oct 18 13:16:48.905099 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 125/242] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:48.909117 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a196aa8d-5ecc-42b9-b0f1-72cfbdf95b69 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/311a30b744a14e74a278fd5e2aba51d8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.947444 Oct 18 13:16:48.913491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-924319bb-a6db-4ddf-91ea-41075f3db559 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:48.914286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-924319bb-a6db-4ddf-91ea-41075f3db559 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:48.917010 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 118/243] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:16:47 2022] GET /compute/v2.1/os-quota-sets/311a30b744a14e74a278fd5e2aba51d8/defaults => generated 371 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:48.925244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1223b482-4559-46a1-80bb-9ef9a89b6169 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Action: 'update', calling method: .version_select at 0x7ff6141fe310>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:49.067605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-924319bb-a6db-4ddf-91ea-41075f3db559 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:49.075804 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-924319bb-a6db-4ddf-91ea-41075f3db559 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1219 microversion: 2.1 time: 0.169204 Oct 18 13:16:49.085802 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 126/244] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:48 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1219 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:49.110601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5c05d7e6-4fec-4294-9d4a-f03617d307fd tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:49.114982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5c05d7e6-4fec-4294-9d4a-f03617d307fd tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:49.143998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c05d7e6-4fec-4294-9d4a-f03617d307fd tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:49.149004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c05d7e6-4fec-4294-9d4a-f03617d307fd tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:49.150866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c05d7e6-4fec-4294-9d4a-f03617d307fd tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:49.155619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c05d7e6-4fec-4294-9d4a-f03617d307fd tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:49.157373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c05d7e6-4fec-4294-9d4a-f03617d307fd tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:49.171566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c05d7e6-4fec-4294-9d4a-f03617d307fd tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:49.232955 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-5c05d7e6-4fec-4294-9d4a-f03617d307fd tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] HTTP exception thrown: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5c05d7e6-4fec-4294-9d4a-f03617d307fd tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Request method failure captured: Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f HTTP/1.1 Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcR3AyS3vBT0gto-JnbvjkzYn7p12shzDcujab7KFyjL0h7dQ0bt-WDsMsjE313b2mZZqzW8sEXn9ja7OUg_D6qgZt856eG2CYRGtWPnuVBm8geJM3YqfZmDZihOMB2mG8Nx2VohkD-14SqXOXAPhW7UWqM_r9jR98MCNdyZwLjouM Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: df5cae9601cd4b40bd657b7304b17fe2 Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminTestJSON-957596026 Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:49.242575 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:49.245609 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/df5cae9601cd4b40bd657b7304b17fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/df5cae9601cd4b40bd657b7304b17fe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/df5cae9601cd4b40bd657b7304b17fe2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_df5cae9601cd4b40bd657b7304b17fe2"}]}] Oct 18 13:16:49.245609 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminTestJSON-957596026 Oct 18 13:16:49.245609 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: df5cae9601cd4b40bd657b7304b17fe2 Oct 18 13:16:49.245609 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-957596026 Oct 18 13:16:49.245609 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminTestJSON-957596026-project Oct 18 13:16:49.245609 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:49.245609 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:49.245609 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0d0b91312f644348b978e07632259760 Oct 18 13:16:49.245609 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminTestJSON-957596026-project Oct 18 13:16:49.245609 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:49.245609 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:49.245609 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '4749485a-14ea-47b4-a16a-42da495ebb0f'} Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:49.248245 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:49.253544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:49.260235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5c05d7e6-4fec-4294-9d4a-f03617d307fd tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Returning 404 to user: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:49.260235 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5c05d7e6-4fec-4294-9d4a-f03617d307fd tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 404 len: 111 microversion: 2.1 time: 0.172192 Oct 18 13:16:49.260235 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 127/245] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:49 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:49.293989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-30f031d8-af4b-44f7-84a5-264f9ef49e78 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-13"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:49.351215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30f031d8-af4b-44f7-84a5-264f9ef49e78 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:49.352569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30f031d8-af4b-44f7-84a5-264f9ef49e78 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:49.353015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30f031d8-af4b-44f7-84a5-264f9ef49e78 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:49.795933 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-30f031d8-af4b-44f7-84a5-264f9ef49e78 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 296 microversion: 2.1 time: 0.526410 Oct 18 13:16:49.814658 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 128/246] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 18 13:16:49 2022] POST /compute/v2.1/os-aggregates/4/action => generated 296 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:49.822410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22d17ab4-9b90-464f-9d54-385d1d1a9df8 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:49.880120 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-22d17ab4-9b90-464f-9d54-385d1d1a9df8 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.062826 Oct 18 13:16:49.894973 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 129/247] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:49 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:49.918419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e498eba8-439a-49b8-9c4d-c64e290c59f0 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-356555911"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:49.926519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.aggregate [None req-e498eba8-439a-49b8-9c4d-c64e290c59f0 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Generated uuid 098a8f10-3d31-4051-a72f-3b39904d2352 for aggregate {{(pid=120612) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:50.010394 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e498eba8-439a-49b8-9c4d-c64e290c59f0 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.104656 Oct 18 13:16:50.020015 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 130/248] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:50.031945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6caa75b3-5222-41a8-811d-d8253970c9fc tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-13"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:50.058283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6caa75b3-5222-41a8-811d-d8253970c9fc tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:50.058941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6caa75b3-5222-41a8-811d-d8253970c9fc tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:50.076653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6caa75b3-5222-41a8-811d-d8253970c9fc tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:50.181685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1223b482-4559-46a1-80bb-9ef9a89b6169 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:50.184374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1223b482-4559-46a1-80bb-9ef9a89b6169 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:50.185928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1223b482-4559-46a1-80bb-9ef9a89b6169 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:50.190845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1223b482-4559-46a1-80bb-9ef9a89b6169 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:50.194115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1223b482-4559-46a1-80bb-9ef9a89b6169 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:50.195206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1223b482-4559-46a1-80bb-9ef9a89b6169 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:50.385751 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6caa75b3-5222-41a8-811d-d8253970c9fc tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.362999 Oct 18 13:16:50.386970 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 131/249] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 18 13:16:50 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:50.399351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-916713a5-d40a-47c4-98b9-782dfc18acd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:50.402330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-916713a5-d40a-47c4-98b9-782dfc18acd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:50.417468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-916713a5-d40a-47c4-98b9-782dfc18acd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:50.418515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-916713a5-d40a-47c4-98b9-782dfc18acd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:50.419121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-916713a5-d40a-47c4-98b9-782dfc18acd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:50.420046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-916713a5-d40a-47c4-98b9-782dfc18acd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:50.421033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-916713a5-d40a-47c4-98b9-782dfc18acd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:50.421502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-916713a5-d40a-47c4-98b9-782dfc18acd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:50.698798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-916713a5-d40a-47c4-98b9-782dfc18acd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:50.715431 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-916713a5-d40a-47c4-98b9-782dfc18acd6 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1215 microversion: 2.1 time: 0.326865 Oct 18 13:16:50.730942 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 132/250] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:50 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:50.740237 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1223b482-4559-46a1-80bb-9ef9a89b6169 tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/311a30b744a14e74a278fd5e2aba51d8" status: 200 len: 329 microversion: 2.1 time: 1.820280 Oct 18 13:16:50.742018 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 119/251] 10.222.0.40 () {60 vars in 1263 bytes} [Tue Oct 18 13:16:48 2022] PUT /compute/v2.1/os-quota-sets/311a30b744a14e74a278fd5e2aba51d8 => generated 329 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:50.744639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aa588027-c982-4004-a1f6-36d8f1da0f05 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:50.761243 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aa588027-c982-4004-a1f6-36d8f1da0f05 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.021652 Oct 18 13:16:50.768391 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 133/252] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 18 13:16:50 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:50.796245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a22a61d-8a5d-4907-bd41-eb738fe5923e tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Action: 'update', calling method: .version_select at 0x7ff61412cee0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:50.799748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-382f5766-ba46-4134-ae44-f0489ebe348d tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-13"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:50.828137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:50.843919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-382f5766-ba46-4134-ae44-f0489ebe348d tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:50.845162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-382f5766-ba46-4134-ae44-f0489ebe348d tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:50.845803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-382f5766-ba46-4134-ae44-f0489ebe348d tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:51.110632 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-382f5766-ba46-4134-ae44-f0489ebe348d tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.325994 Oct 18 13:16:51.121371 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 134/253] 10.222.0.40 () {60 vars in 1191 bytes} [Tue Oct 18 13:16:50 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:51.132061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f3d92047-5052-4beb-8672-a4a87debb3ac tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:51.221803 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f3d92047-5052-4beb-8672-a4a87debb3ac tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.098598 Oct 18 13:16:51.225960 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 135/254] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:51 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:51.280308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-493e2d92-4021-4a27-b32b-ac3367679d59 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-699460943"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:51.290143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.aggregate [None req-493e2d92-4021-4a27-b32b-ac3367679d59 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Generated uuid 134493a1-d692-4665-8122-1b59cd85c430 for aggregate {{(pid=120612) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:51.343907 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-493e2d92-4021-4a27-b32b-ac3367679d59 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.104024 Oct 18 13:16:51.345884 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 136/255] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:51.363079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d9649a77-674d-4fab-8199-77ab5c479fe5 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-13"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:51.381015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9649a77-674d-4fab-8199-77ab5c479fe5 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:51.381917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9649a77-674d-4fab-8199-77ab5c479fe5 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:51.382525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9649a77-674d-4fab-8199-77ab5c479fe5 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:51.631273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a22a61d-8a5d-4907-bd41-eb738fe5923e tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:51.635498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a22a61d-8a5d-4907-bd41-eb738fe5923e tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:51.635966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a22a61d-8a5d-4907-bd41-eb738fe5923e tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:51.640812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a22a61d-8a5d-4907-bd41-eb738fe5923e tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:51.642466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a22a61d-8a5d-4907-bd41-eb738fe5923e tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:51.642915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a22a61d-8a5d-4907-bd41-eb738fe5923e tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:51.660300 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d9649a77-674d-4fab-8199-77ab5c479fe5 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.301935 Oct 18 13:16:51.661021 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 137/256] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 18 13:16:51 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:51.678895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3e0bf299-e2b9-48ab-88b2-07c989ccbab6 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:51.702244 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3e0bf299-e2b9-48ab-88b2-07c989ccbab6 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.032471 Oct 18 13:16:51.703793 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 138/257] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 18 13:16:51 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:51.739898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7014c92f-5aa3-4a72-a224-835e31240dba tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-13"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:51.786657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7014c92f-5aa3-4a72-a224-835e31240dba tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:51.790061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7014c92f-5aa3-4a72-a224-835e31240dba tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:51.791989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7014c92f-5aa3-4a72-a224-835e31240dba tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:52.092548 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7014c92f-5aa3-4a72-a224-835e31240dba tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.380588 Oct 18 13:16:52.097472 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 139/258] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 18 13:16:51 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:52.113139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bf6a8883-e240-4377-817b-4ae667f48c69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:52.116895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bf6a8883-e240-4377-817b-4ae667f48c69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:52.128145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:UPDATE=9,nova_api:SELECT=69,nova_api:INSERT=22 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:52.141520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf6a8883-e240-4377-817b-4ae667f48c69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:52.142272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf6a8883-e240-4377-817b-4ae667f48c69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:52.143446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf6a8883-e240-4377-817b-4ae667f48c69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:52.145961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf6a8883-e240-4377-817b-4ae667f48c69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:52.147616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf6a8883-e240-4377-817b-4ae667f48c69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:52.148234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf6a8883-e240-4377-817b-4ae667f48c69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:52.326190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bf6a8883-e240-4377-817b-4ae667f48c69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:52.340881 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bf6a8883-e240-4377-817b-4ae667f48c69 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1277 microversion: 2.1 time: 0.241109 Oct 18 13:16:52.366353 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 140/259] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:52 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1277 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:52.380217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1877e9c2-fc8e-4df1-9a93-ae2b1632c055 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:52.395963 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1a22a61d-8a5d-4907-bd41-eb738fe5923e tempest-QuotasAdminTestJSON-562243858 tempest-QuotasAdminTestJSON-562243858-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/311a30b744a14e74a278fd5e2aba51d8" status: 200 len: 329 microversion: 2.1 time: 1.641418 Oct 18 13:16:52.407153 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 120/260] 10.222.0.40 () {60 vars in 1263 bytes} [Tue Oct 18 13:16:50 2022] PUT /compute/v2.1/os-quota-sets/311a30b744a14e74a278fd5e2aba51d8 => generated 329 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:52.437612 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1877e9c2-fc8e-4df1-9a93-ae2b1632c055 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.068601 Oct 18 13:16:52.444560 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 141/261] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:16:52 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:52.455759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3e6ccb60-7d98-45f2-a001-48313cd17cde tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-683929521"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:52.459506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.aggregate [None req-3e6ccb60-7d98-45f2-a001-48313cd17cde tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Generated uuid a55e0ba3-817a-4109-84a2-67db77a499e2 for aggregate {{(pid=120611) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:52.508093 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3e6ccb60-7d98-45f2-a001-48313cd17cde tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056427 Oct 18 13:16:52.516223 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 121/262] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:52.522283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea849ea2-4c03-41d1-8b00-71c1861048c9 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-13"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:52.561471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea849ea2-4c03-41d1-8b00-71c1861048c9 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:52.564149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea849ea2-4c03-41d1-8b00-71c1861048c9 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:52.566763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea849ea2-4c03-41d1-8b00-71c1861048c9 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:52.840110 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ea849ea2-4c03-41d1-8b00-71c1861048c9 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.322577 Oct 18 13:16:52.840898 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 142/263] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 18 13:16:52 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:52.862066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0a6b6386-ab67-46f6-91b6-e2100d50ac7e tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-13"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:52.885119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a6b6386-ab67-46f6-91b6-e2100d50ac7e tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:52.885609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a6b6386-ab67-46f6-91b6-e2100d50ac7e tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:52.886078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a6b6386-ab67-46f6-91b6-e2100d50ac7e tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:53.056162 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0a6b6386-ab67-46f6-91b6-e2100d50ac7e tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.204966 Oct 18 13:16:53.057631 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 122/264] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 18 13:16:52 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:53.071499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f23c75b2-b6bb-4395-bac7-526fb0009e0f tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:53.123582 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f23c75b2-b6bb-4395-bac7-526fb0009e0f tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.056575 Oct 18 13:16:53.124546 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 143/265] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:16:53 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:53.138860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cbda3fc5-19b3-4bba-8ac0-ab752386a0d2 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2035236299"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:53.149331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.aggregate [None req-cbda3fc5-19b3-4bba-8ac0-ab752386a0d2 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Generated uuid f20e82c0-c51b-4d45-8b79-8eca16f8138a for aggregate {{(pid=120611) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:53.193417 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cbda3fc5-19b3-4bba-8ac0-ab752386a0d2 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060968 Oct 18 13:16:53.203454 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 123/266] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:53.207256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0ced404-30ad-4ce6-ab46-8f69166284a5 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-476374654"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:53.217255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e833f7d7-1242-4bea-8407-b85ddb6e53e3 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:53.218876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.aggregate [None req-c0ced404-30ad-4ce6-ab46-8f69166284a5 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Generated uuid db0bed3a-ea8c-43e2-a127-898f50db2e5f for aggregate {{(pid=120612) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:53.271902 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c0ced404-30ad-4ce6-ab46-8f69166284a5 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.075124 Oct 18 13:16:53.273146 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e833f7d7-1242-4bea-8407-b85ddb6e53e3 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.067501 Oct 18 13:16:53.274080 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 124/267] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:16:53 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:53.287446 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 144/268] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:53.290364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5b5d1bde-66d0-4492-a37c-30e60177119c tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:53.300818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1d449066-e063-4933-aacc-7943f25dd048 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-13"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:53.304620 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-5b5d1bde-66d0-4492-a37c-30e60177119c tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5b5d1bde-66d0-4492-a37c-30e60177119c tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Request method failure captured: Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcTirIGTAMcpI091vVTIHqnbD8jw-a2PR6zs1IMSeku3_Yhl5zGFxh58-hdegCrNLzANMGAUSjdXVDHyHcY0SfE-ixbUJsr_59Ems_PH9hCUMAYOt9bLD35D4lWLEG0VhQsY5sk1kuIgAoG72acCHPBBvdYKo-xdCKEEiL9gWcqCH4 Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 19ef1d658934438c9a16be8454aeab0a Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AggregatesAdminTestJSON-239266093 Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:16:53.306444 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:16:53.308991 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19ef1d658934438c9a16be8454aeab0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19ef1d658934438c9a16be8454aeab0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19ef1d658934438c9a16be8454aeab0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19ef1d658934438c9a16be8454aeab0a"}]}] Oct 18 13:16:53.308991 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AggregatesAdminTestJSON-239266093 Oct 18 13:16:53.308991 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 19ef1d658934438c9a16be8454aeab0a Oct 18 13:16:53.308991 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-239266093 Oct 18 13:16:53.308991 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AggregatesAdminTestJSON-239266093-project-admin Oct 18 13:16:53.308991 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:53.308991 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:53.308991 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 206679b38ce5413bba24d6f64cb7c3bc Oct 18 13:16:53.308991 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AggregatesAdminTestJSON-239266093-project-admin Oct 18 13:16:53.308991 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:53.308991 n-d-858384-13 devstack@n-api.service[120611]: exception: Aggregate 12 could not be found. Oct 18 13:16:53.308991 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '12'} Oct 18 13:16:53.308991 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.310753 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 18 13:16:53.313040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.315212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5b5d1bde-66d0-4492-a37c-30e60177119c tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:53.315212 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5b5d1bde-66d0-4492-a37c-30e60177119c tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.028397 Oct 18 13:16:53.315212 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 125/269] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:53 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:16:53.330138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a607c24-60ca-437a-82da-738787b4b75a tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:53.335275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d449066-e063-4933-aacc-7943f25dd048 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:53.336626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d449066-e063-4933-aacc-7943f25dd048 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:53.337942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d449066-e063-4933-aacc-7943f25dd048 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:53.357388 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-1a607c24-60ca-437a-82da-738787b4b75a tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a607c24-60ca-437a-82da-738787b4b75a tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Request method failure captured: Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcTirIGTAMcpI091vVTIHqnbD8jw-a2PR6zs1IMSeku3_Yhl5zGFxh58-hdegCrNLzANMGAUSjdXVDHyHcY0SfE-ixbUJsr_59Ems_PH9hCUMAYOt9bLD35D4lWLEG0VhQsY5sk1kuIgAoG72acCHPBBvdYKo-xdCKEEiL9gWcqCH4 Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 19ef1d658934438c9a16be8454aeab0a Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AggregatesAdminTestJSON-239266093 Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:16:53.361269 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:16:53.363625 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19ef1d658934438c9a16be8454aeab0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19ef1d658934438c9a16be8454aeab0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19ef1d658934438c9a16be8454aeab0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19ef1d658934438c9a16be8454aeab0a"}]}] Oct 18 13:16:53.363625 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AggregatesAdminTestJSON-239266093 Oct 18 13:16:53.363625 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 19ef1d658934438c9a16be8454aeab0a Oct 18 13:16:53.363625 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-239266093 Oct 18 13:16:53.363625 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AggregatesAdminTestJSON-239266093-project-admin Oct 18 13:16:53.363625 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:53.363625 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:53.363625 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 206679b38ce5413bba24d6f64cb7c3bc Oct 18 13:16:53.363625 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AggregatesAdminTestJSON-239266093-project-admin Oct 18 13:16:53.363625 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:53.363625 n-d-858384-13 devstack@n-api.service[120611]: exception: Aggregate 12 could not be found. Oct 18 13:16:53.363625 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '12'} Oct 18 13:16:53.363625 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:53.365030 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.367051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:53.369016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:53.369016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:53.369016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:53.369016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Oct 18 13:16:53.369016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.369016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a607c24-60ca-437a-82da-738787b4b75a tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:53.369016 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1a607c24-60ca-437a-82da-738787b4b75a tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.044791 Oct 18 13:16:53.370791 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 126/270] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:16:53 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:16:53.387559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-25f1932f-2cd3-4814-a2ed-82135db2a239 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:53.388299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-25f1932f-2cd3-4814-a2ed-82135db2a239 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:53.411651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25f1932f-2cd3-4814-a2ed-82135db2a239 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:53.412204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25f1932f-2cd3-4814-a2ed-82135db2a239 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:53.412644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25f1932f-2cd3-4814-a2ed-82135db2a239 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:53.417938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25f1932f-2cd3-4814-a2ed-82135db2a239 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:53.418449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25f1932f-2cd3-4814-a2ed-82135db2a239 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:53.418883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25f1932f-2cd3-4814-a2ed-82135db2a239 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:53.655598 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1d449066-e063-4933-aacc-7943f25dd048 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.365415 Oct 18 13:16:53.656636 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 145/271] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 18 13:16:53 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:53.658089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-25f1932f-2cd3-4814-a2ed-82135db2a239 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:53.662753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4bb88124-5806-4544-bdbe-17ae8b409232 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-738000585", "name": "tempest-test_aggregate-2086886023"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:53.666456 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-25f1932f-2cd3-4814-a2ed-82135db2a239 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1319 microversion: 2.1 time: 0.294868 Oct 18 13:16:53.671791 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 127/272] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:53 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:53.677279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e2fb31b-f015-4898-8b8a-e0215d5adf2f tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-13"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:53.678965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.aggregate [None req-4bb88124-5806-4544-bdbe-17ae8b409232 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Generated uuid 7785f6c0-fbe4-4548-8e7b-a16cfcb90505 for aggregate {{(pid=120612) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:53.682985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7e2fb31b-f015-4898-8b8a-e0215d5adf2f tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '38d6c86601ba4077b8bf5c4ee6c74bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89adfb0b21e04a529d26052bbe0581aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e2fb31b-f015-4898-8b8a-e0215d5adf2f tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Request method failure captured: Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 43 Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcOmsCNGAbZxRz9GocwCRPlyFjvWASEFw_PWLX2PRpkvKRghRuIW5W1oRslMx5eT8aEod6rc77cRhJGaT2vLhC7cHkGO4jJfB53mVtREHHI7Ldp_7IJBumA3bTJjC1bJoWncTyjYaQKB3Euz7vUa_aXkvmFOf2tQvOL7hIohOaMgu4 Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 89adfb0b21e04a529d26052bbe0581aa Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:16:53.694757 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:16:53.696262 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89adfb0b21e04a529d26052bbe0581aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_89adfb0b21e04a529d26052bbe0581aa"}]}] Oct 18 13:16:53.696262 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:53.696262 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 89adfb0b21e04a529d26052bbe0581aa Oct 18 13:16:53.696262 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-800446552 Oct 18 13:16:53.696262 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AggregatesAdminNegativeTestJSON-800446552-project Oct 18 13:16:53.696262 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:53.696262 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:53.696262 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 38d6c86601ba4077b8bf5c4ee6c74bb8 Oct 18 13:16:53.696262 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-800446552-project Oct 18 13:16:53.696262 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:16:53.696262 n-d-858384-13 devstack@n-api.service[120611]: {"remove_host": {"host": "n-h2-858384-13"}} Oct 18 13:16:53.696262 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:53.696262 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-858384-13'}}} Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:53.697066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 18 13:16:53.698300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.701818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e2fb31b-f015-4898-8b8a-e0215d5adf2f tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:53.703039 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7e2fb31b-f015-4898-8b8a-e0215d5adf2f tempest-AggregatesAdminNegativeTestJSON-800446552 tempest-AggregatesAdminNegativeTestJSON-800446552-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.030040 Oct 18 13:16:53.705045 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 128/273] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 18 13:16:53 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:53.720304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-de4e739a-25ac-4e0a-ab5a-ccd1c6815cb5 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-13"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:53.730239 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4bb88124-5806-4544-bdbe-17ae8b409232 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.071187 Oct 18 13:16:53.731767 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 146/274] 10.222.0.40 () {60 vars in 1165 bytes} [Tue Oct 18 13:16:53 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:53.746726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7a3ec60f-b82a-435d-a93a-4e0fb37e3752 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:53.755843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de4e739a-25ac-4e0a-ab5a-ccd1c6815cb5 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:53.756258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de4e739a-25ac-4e0a-ab5a-ccd1c6815cb5 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:53.757202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de4e739a-25ac-4e0a-ab5a-ccd1c6815cb5 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:53.763036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:53.807376 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7a3ec60f-b82a-435d-a93a-4e0fb37e3752 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.065114 Oct 18 13:16:53.808495 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 147/275] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:16:53 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 18 13:16:53.856611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0dc8d94-c3f7-4096-b14e-5e4faf23adca tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:53.869748 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e0dc8d94-c3f7-4096-b14e-5e4faf23adca tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0dc8d94-c3f7-4096-b14e-5e4faf23adca tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Request method failure captured: Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcTirIGTAMcpI091vVTIHqnbD8jw-a2PR6zs1IMSeku3_Yhl5zGFxh58-hdegCrNLzANMGAUSjdXVDHyHcY0SfE-ixbUJsr_59Ems_PH9hCUMAYOt9bLD35D4lWLEG0VhQsY5sk1kuIgAoG72acCHPBBvdYKo-xdCKEEiL9gWcqCH4 Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 19ef1d658934438c9a16be8454aeab0a Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminTestJSON-239266093 Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:53.872795 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:53.874430 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19ef1d658934438c9a16be8454aeab0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19ef1d658934438c9a16be8454aeab0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19ef1d658934438c9a16be8454aeab0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19ef1d658934438c9a16be8454aeab0a"}]}] Oct 18 13:16:53.874430 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminTestJSON-239266093 Oct 18 13:16:53.874430 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 19ef1d658934438c9a16be8454aeab0a Oct 18 13:16:53.874430 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-239266093 Oct 18 13:16:53.874430 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminTestJSON-239266093-project-admin Oct 18 13:16:53.874430 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:53.874430 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:53.874430 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 206679b38ce5413bba24d6f64cb7c3bc Oct 18 13:16:53.874430 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminTestJSON-239266093-project-admin Oct 18 13:16:53.874430 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:53.874430 n-d-858384-13 devstack@n-api.service[120612]: exception: Aggregate 14 could not be found. Oct 18 13:16:53.874430 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '14'} Oct 18 13:16:53.874430 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.875941 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 18 13:16:53.876975 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.879628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0dc8d94-c3f7-4096-b14e-5e4faf23adca tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:53.880489 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e0dc8d94-c3f7-4096-b14e-5e4faf23adca tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.058612 Oct 18 13:16:53.884135 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 148/276] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:53 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:16:53.892555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-126f8bff-1d31-423f-96ce-d4dc3edd3ecb tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:53.913015 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-126f8bff-1d31-423f-96ce-d4dc3edd3ecb tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-126f8bff-1d31-423f-96ce-d4dc3edd3ecb tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Request method failure captured: Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcTirIGTAMcpI091vVTIHqnbD8jw-a2PR6zs1IMSeku3_Yhl5zGFxh58-hdegCrNLzANMGAUSjdXVDHyHcY0SfE-ixbUJsr_59Ems_PH9hCUMAYOt9bLD35D4lWLEG0VhQsY5sk1kuIgAoG72acCHPBBvdYKo-xdCKEEiL9gWcqCH4 Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 19ef1d658934438c9a16be8454aeab0a Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminTestJSON-239266093 Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:53.915627 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:53.916818 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19ef1d658934438c9a16be8454aeab0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19ef1d658934438c9a16be8454aeab0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19ef1d658934438c9a16be8454aeab0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19ef1d658934438c9a16be8454aeab0a"}]}] Oct 18 13:16:53.916818 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminTestJSON-239266093 Oct 18 13:16:53.916818 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 19ef1d658934438c9a16be8454aeab0a Oct 18 13:16:53.916818 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-239266093 Oct 18 13:16:53.916818 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminTestJSON-239266093-project-admin Oct 18 13:16:53.916818 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:53.916818 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:53.916818 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 206679b38ce5413bba24d6f64cb7c3bc Oct 18 13:16:53.916818 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminTestJSON-239266093-project-admin Oct 18 13:16:53.916818 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:53.916818 n-d-858384-13 devstack@n-api.service[120612]: exception: Aggregate 14 could not be found. Oct 18 13:16:53.916818 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '14'} Oct 18 13:16:53.916818 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:53.917724 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:53.919081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:53.920152 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:53.920152 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:53.920152 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:53.920152 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 18 13:16:53.920152 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:53.945767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-126f8bff-1d31-423f-96ce-d4dc3edd3ecb tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:53.947349 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-126f8bff-1d31-423f-96ce-d4dc3edd3ecb tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.059654 Oct 18 13:16:53.954425 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 149/277] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:16:53 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:16:53.967761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a1e1eec2-53a9-46b9-8351-92ceae1924f2 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-936090957"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:53.983904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.aggregate [None req-a1e1eec2-53a9-46b9-8351-92ceae1924f2 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Generated uuid 8c69d022-a97f-4de1-a6cc-5ed3b93b5866 for aggregate {{(pid=120612) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:54.028133 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-de4e739a-25ac-4e0a-ab5a-ccd1c6815cb5 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.317093 Oct 18 13:16:54.040300 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 129/278] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 18 13:16:53 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:54.044875 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a1e1eec2-53a9-46b9-8351-92ceae1924f2 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082593 Oct 18 13:16:54.049118 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 150/279] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:54.065455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-77f56ebb-86dd-4b06-85cd-12ce5f619271 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:54.071662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9b85b1b5-3317-4e08-a14e-14090a0a3232 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:54.103523 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-77f56ebb-86dd-4b06-85cd-12ce5f619271 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.048494 Oct 18 13:16:54.106632 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 130/280] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:16:54 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:54.111492 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9b85b1b5-3317-4e08-a14e-14090a0a3232 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.042304 Oct 18 13:16:54.111939 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 151/281] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:54 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:16:54.123079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5df6b348-6739-4828-b1ce-d4fe0c5b8d1a tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-737483675"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:54.127568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.aggregate [None req-5df6b348-6739-4828-b1ce-d4fe0c5b8d1a tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Generated uuid 87861e3c-b456-40fe-8d92-17a7c1a3ceac for aggregate {{(pid=120612) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:54.139302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-69680dc6-b410-490e-88d2-29ee5a8298b8 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:54.159464 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5df6b348-6739-4828-b1ce-d4fe0c5b8d1a tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.045010 Oct 18 13:16:54.162381 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 152/282] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:54.184741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-64147d4a-2850-4569-b251-3dffe99933fb tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:54.209474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64147d4a-2850-4569-b251-3dffe99933fb tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:54.211649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64147d4a-2850-4569-b251-3dffe99933fb tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:54.214588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64147d4a-2850-4569-b251-3dffe99933fb tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:54.224637 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-69680dc6-b410-490e-88d2-29ee5a8298b8 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.101237 Oct 18 13:16:54.225428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64147d4a-2850-4569-b251-3dffe99933fb tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:54.226107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64147d4a-2850-4569-b251-3dffe99933fb tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:54.226632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64147d4a-2850-4569-b251-3dffe99933fb tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:54.238406 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 131/283] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 18 13:16:54 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:54.239179 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.compute.aggregates [None req-64147d4a-2850-4569-b251-3dffe99933fb tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 18 13:16:54.240093 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-64147d4a-2850-4569-b251-3dffe99933fb tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-64147d4a-2850-4569-b251-3dffe99933fb tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Request method failure captured: Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 42 Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcR7jKojjHnWBH4I647APZ1lAf6DYgLHkOCM9D6uJE_25iFoXIIru7yF3xDqm7dKdOIZgPzpnNHQU27ijmv452tInIFJfDmOyybVc5ZRBcJqeQS-wYrO7hIeMsuptqO2c4b2WvPYb1u74EW3ujR3PGv7Nz07Mhnr95Q_Dg4frWQNgY Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:54.242936 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:54.244154 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c9bb0280e95428fac311e7981b31d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4c9bb0280e95428fac311e7981b31d67"}]}] Oct 18 13:16:54.244154 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:54.244154 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 4c9bb0280e95428fac311e7981b31d67 Oct 18 13:16:54.244154 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-85875613 Oct 18 13:16:54.244154 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:54.244154 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:54.244154 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:54.244154 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 86f3a8f6212a4213b60769dfeb2bb457 Oct 18 13:16:54.244154 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin Oct 18 13:16:54.244154 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:16:54.244154 n-d-858384-13 devstack@n-api.service[120612]: {"remove_host": {"host": "nonexist_host"}} Oct 18 13:16:54.244154 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:54.244154 n-d-858384-13 devstack@n-api.service[120612]: exception: Cannot remove host nonexist_host in aggregate 16 Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 18 13:16:54.244887 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6686, in remove_host_from_aggregate Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 18 13:16:54.246300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:54.247340 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:54.248412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:54.248412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:54.248412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:54.248412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:54.248412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Oct 18 13:16:54.248412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:54.250311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3b3395f5-d705-49cf-8ea6-b771337ec918 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:54.250469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-64147d4a-2850-4569-b251-3dffe99933fb tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:54.250469 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-64147d4a-2850-4569-b251-3dffe99933fb tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.074510 Oct 18 13:16:54.250469 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 153/284] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 18 13:16:54 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:16:54.258588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4b76c748-8f94-4978-8a10-7a0c5e6e59d0 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:54.259461 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3b3395f5-d705-49cf-8ea6-b771337ec918 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.018910 Oct 18 13:16:54.260040 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 132/285] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:16:54 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:54.279902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-631ad45c-dc8f-4358-a455-48825cff80e5 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:54.310939 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4b76c748-8f94-4978-8a10-7a0c5e6e59d0 tempest-AggregatesAdminNegativeTestJSON-85875613 tempest-AggregatesAdminNegativeTestJSON-85875613-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.055839 Oct 18 13:16:54.313882 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 154/286] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:16:54 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 18 13:16:54.337900 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-631ad45c-dc8f-4358-a455-48825cff80e5 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.067769 Oct 18 13:16:54.338759 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 133/287] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:16:54 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:54.348351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1cb84491-45be-49f8-970c-d5ae613c177e tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-483499975", "availability_zone": "tempest-test_az-1649868178"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:54.395438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.aggregate [None req-1cb84491-45be-49f8-970c-d5ae613c177e tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Generated uuid bccf65e3-c0b1-4f7f-a9ee-373068cc9671 for aggregate {{(pid=120611) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:54.427661 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1cb84491-45be-49f8-970c-d5ae613c177e tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.082842 Oct 18 13:16:54.428324 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 134/288] 10.222.0.40 () {60 vars in 1165 bytes} [Tue Oct 18 13:16:54 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:54.449712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0caf9404-869b-4679-9ed8-a9a8bb4f336f tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-483499975_new", "availability_zone": "tempest-test_az-1649868178_new"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:54.711050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0caf9404-869b-4679-9ed8-a9a8bb4f336f tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:54.712843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0caf9404-869b-4679-9ed8-a9a8bb4f336f tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:54.714520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0caf9404-869b-4679-9ed8-a9a8bb4f336f tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:54.801165 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0caf9404-869b-4679-9ed8-a9a8bb4f336f tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.360234 Oct 18 13:16:54.803050 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 135/289] 10.222.0.40 () {60 vars in 1173 bytes} [Tue Oct 18 13:16:54 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:54.815419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db88fca1-a84c-4394-8feb-a96d14a250f9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:54.819268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db88fca1-a84c-4394-8feb-a96d14a250f9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:54.827089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=11,nova_api:UPDATE=8,nova_api:DELETE=8 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:54.850999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db88fca1-a84c-4394-8feb-a96d14a250f9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:54.852637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db88fca1-a84c-4394-8feb-a96d14a250f9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:54.853764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db88fca1-a84c-4394-8feb-a96d14a250f9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:54.858728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db88fca1-a84c-4394-8feb-a96d14a250f9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:54.860965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db88fca1-a84c-4394-8feb-a96d14a250f9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:54.861548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db88fca1-a84c-4394-8feb-a96d14a250f9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:55.100286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e3682fd7-fc6c-44cb-8695-010b3ab885b6 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Action: 'create', calling method: .version_select at 0x7ff614303670>, body: {"keypair": {"name": "tempest-keypair-1699139542", "type": "ssh", "user_id": "5c0e0e4e2aa94022b49adb52ca196aef", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6I0dFWmkyfmyA88ucsJHTVeveWIZp8QlCxTfx7YGB6uR6GAcs7FGJckdwLdG8bSeHcn5DD36HWmm/aUKj/2+B3NXfy+ghF0iOPyOcYh7Oj7E5+6wPLoBsNHlSbnGm1ZA=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:55.117907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=12,nova_api:INSERT=9 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:16:55.145895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e3682fd7-fc6c-44cb-8695-010b3ab885b6 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Getting quotas for project a2bce9ee232e4c85a7ebc00907da6632. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:16:55.165227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e3682fd7-fc6c-44cb-8695-010b3ab885b6 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Getting quotas for user 17777d4b9478421097c4389209634ed6 and project a2bce9ee232e4c85a7ebc00907da6632. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:16:55.215702 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e3682fd7-fc6c-44cb-8695-010b3ab885b6 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.900035 Oct 18 13:16:55.216457 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 155/290] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 18 13:16:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 902 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 13:16:55.231715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dfd467d1-4765-433e-8f29-f4ed1bb986d2 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:55.246236 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dfd467d1-4765-433e-8f29-f4ed1bb986d2 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.023813 Oct 18 13:16:55.254280 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 156/291] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 18 13:16:55 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:55.260486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-80546860-185f-4327-a3cd-e99f4ca1a473 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Action: 'create', calling method: .version_select at 0x7ff61449e4c0>, body: {"keypair": {"name": "tempest-keypair-986094644", "type": "ssh", "user_id": "5c0e0e4e2aa94022b49adb52ca196aef", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXxGgbCnCGizvCC4GbVYwhiypF3ur7QgKQtuplI/OsnOmkcgMNTt+aok39HsVg5YQy4YWIF5vWYjRQTbk1VXYSfgVkFdS++3cix3AICiPPmbJ4CMINNN7Xaim3dnLmU7w=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:55.300764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-80546860-185f-4327-a3cd-e99f4ca1a473 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Getting quotas for project a2bce9ee232e4c85a7ebc00907da6632. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:16:55.305588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-80546860-185f-4327-a3cd-e99f4ca1a473 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Getting quotas for user 17777d4b9478421097c4389209634ed6 and project a2bce9ee232e4c85a7ebc00907da6632. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:16:55.369301 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-80546860-185f-4327-a3cd-e99f4ca1a473 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.113014 Oct 18 13:16:55.372775 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 157/292] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 18 13:16:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 13:16:55.378853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6e70b826-8db7-44e7-a92b-8e4de65482e3 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:55.408721 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6e70b826-8db7-44e7-a92b-8e4de65482e3 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.033780 Oct 18 13:16:55.409925 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 158/293] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:16:55 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:55.623741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5aad6e38-2672-4799-bdea-6cfb6240f864 tempest-InstanceUsageAuditLogNegativeTestJSON-36837369 tempest-InstanceUsageAuditLogNegativeTestJSON-36837369-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:55.634408 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-5aad6e38-2672-4799-bdea-6cfb6240f864 tempest-InstanceUsageAuditLogNegativeTestJSON-36837369 tempest-InstanceUsageAuditLogNegativeTestJSON-36837369-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 18 13:16:55.637069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db88fca1-a84c-4394-8feb-a96d14a250f9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:55.650966 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db88fca1-a84c-4394-8feb-a96d14a250f9 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1319 microversion: 2.1 time: 0.846197 Oct 18 13:16:55.653282 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 136/294] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:54 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1319 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5aad6e38-2672-4799-bdea-6cfb6240f864 tempest-InstanceUsageAuditLogNegativeTestJSON-36837369 tempest-InstanceUsageAuditLogNegativeTestJSON-36837369-project-admin] Request method failure captured: Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdHfs_VTAd3yvA9H6n4-d3wz4D2WNFwjpWeTtZ30hwEXyNY79DxqDsXeCi8tQtCUxCAWFzcyEUbPlaOiwAzgl47QPd0iRtsxDEHNsrlYqqI8LByIVERPVr50SAl5rCKDoMM_kqlmLDgyh8o1Z6KiKSdE5rHIXc8RfF1-NqV2RP2pec Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 9a882ca3e8a74585be717c6376f4ad0e Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-36837369 Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:16:55.654035 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:16:55.655578 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a882ca3e8a74585be717c6376f4ad0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a882ca3e8a74585be717c6376f4ad0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a882ca3e8a74585be717c6376f4ad0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a882ca3e8a74585be717c6376f4ad0e"}]}] Oct 18 13:16:55.655578 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-36837369 Oct 18 13:16:55.655578 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 9a882ca3e8a74585be717c6376f4ad0e Oct 18 13:16:55.655578 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-36837369 Oct 18 13:16:55.655578 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-36837369-project-admin Oct 18 13:16:55.655578 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:55.655578 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:55.655578 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e74b8ae8a4724f42928e6871aee8f7df Oct 18 13:16:55.655578 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-36837369-project-admin Oct 18 13:16:55.655578 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:55.655578 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid timestamp for date invalid_time Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'invalid_time'} Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:55.656297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5aad6e38-2672-4799-bdea-6cfb6240f864 tempest-InstanceUsageAuditLogNegativeTestJSON-36837369 tempest-InstanceUsageAuditLogNegativeTestJSON-36837369-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:55.657732 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5aad6e38-2672-4799-bdea-6cfb6240f864 tempest-InstanceUsageAuditLogNegativeTestJSON-36837369 tempest-InstanceUsageAuditLogNegativeTestJSON-36837369-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.244388 Oct 18 13:16:55.658691 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 159/295] 10.222.0.40 () {58 vars in 1224 bytes} [Tue Oct 18 13:16:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 245 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:16:55.665404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-111581d2-6c68-4b60-afdb-32bb3234bb1b tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1616076849"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:55.670175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.aggregate [None req-111581d2-6c68-4b60-afdb-32bb3234bb1b tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Generated uuid 12899137-0f0b-452b-a205-d678352ef795 for aggregate {{(pid=120612) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:16:55.677882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-321b5816-e3da-43bc-b03c-91203e0665cc tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Calling method '.version_select at 0x7ff614139820>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:55.712476 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-321b5816-e3da-43bc-b03c-91203e0665cc tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-1699139542?user_id=5c0e0e4e2aa94022b49adb52ca196aef" status: 200 len: 512 microversion: 2.10 time: 0.052649 Oct 18 13:16:55.714859 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-111581d2-6c68-4b60-afdb-32bb3234bb1b tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056662 Oct 18 13:16:55.715282 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 137/296] 10.222.0.40 () {60 vars in 1340 bytes} [Tue Oct 18 13:16:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1699139542?user_id=5c0e0e4e2aa94022b49adb52ca196aef => generated 512 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:16:55.716348 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 160/297] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:16:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:55.733669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0b3509a3-cf18-4ea3-b870-56e8a9d2a589 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Action: 'create', calling method: .version_select at 0x7ff614461700>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1119675022", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQq79Pv6L5TiagvOVJdSYFH4QOo31Y+nTky/TaNsbHi7SRXo/cKR46FQRtXtXptHrQ0QBCRVBELsRlx7LgGc5ms6KO/CF7fDmIfrDXKW6J2lCtFTjKVPaz+23aB44n8bg=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:55.759328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0b3509a3-cf18-4ea3-b870-56e8a9d2a589 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Getting quotas for project a2bce9ee232e4c85a7ebc00907da6632. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:16:55.765792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0b3509a3-cf18-4ea3-b870-56e8a9d2a589 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Getting quotas for user 17777d4b9478421097c4389209634ed6 and project a2bce9ee232e4c85a7ebc00907da6632. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:16:55.799927 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0b3509a3-cf18-4ea3-b870-56e8a9d2a589 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.074120 Oct 18 13:16:55.801911 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 161/298] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 18 13:16:55 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 18 13:16:55.807292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd5c59cf-7ab6-4c00-95bc-d542e0f8629c tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:55.819816 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fd5c59cf-7ab6-4c00-95bc-d542e0f8629c tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.016500 Oct 18 13:16:55.821598 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 162/299] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 18 13:16:55 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:55.845647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ee40b1e2-353c-4a8c-99f2-d35b895c1626 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Calling method '.version_select at 0x7ff614312820>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:55.861040 n-d-858384-13 devstack@n-api.service[120612]: WARNING oslo_db.sqlalchemy.utils [None req-ee40b1e2-353c-4a8c-99f2-d35b895c1626 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 13:16:55.879743 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ee40b1e2-353c-4a8c-99f2-d35b895c1626 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] 10.222.0.40 "GET /compute/v2.1/os-keypairs?user_id=5c0e0e4e2aa94022b49adb52ca196aef" status: 200 len: 725 microversion: 2.10 time: 0.056805 Oct 18 13:16:55.880685 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 163/300] 10.222.0.40 () {60 vars in 1259 bytes} [Tue Oct 18 13:16:55 2022] GET /compute/v2.1/os-keypairs?user_id=5c0e0e4e2aa94022b49adb52ca196aef => generated 725 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:16:55.891002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96409406-1282-45e6-8772-1aba8282fbe4 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:55.971008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-df7519cc-aa16-44a3-92b3-fd4ebf21c802 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:55.975881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-df7519cc-aa16-44a3-92b3-fd4ebf21c802 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'd2431fbdd48c4d498478bcead87ce5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cb19f45c8d400791de5d687f46f114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:55.976024 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-96409406-1282-45e6-8772-1aba8282fbe4 tempest-AggregatesAdminTestJSON-239266093 tempest-AggregatesAdminTestJSON-239266093-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.093660 Oct 18 13:16:55.978077 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 164/301] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:16:55 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-df7519cc-aa16-44a3-92b3-fd4ebf21c802 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project] Request method failure captured: Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdERQPINVnzOj9qyM3BvwRKCZPFnfO0u4Ks0o7H0NRneDaKBLGJHEJfiHOl8uUrxkGoAY1TiLjBu2tktfyOXJJoyRpRKk5GXft4a_m7NJiskiEdUbdR_TmPToafeswh7i3J_rz21FDdN86WS-ICwzvMjFh6wkho1IJvCKVe84Tqnxs Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 80cb19f45c8d400791de5d687f46f114 Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:16:55.988288 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:16:55.989682 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/80cb19f45c8d400791de5d687f46f114"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/80cb19f45c8d400791de5d687f46f114"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/80cb19f45c8d400791de5d687f46f114"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_80cb19f45c8d400791de5d687f46f114"}]}] Oct 18 13:16:55.989682 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 Oct 18 13:16:55.989682 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 80cb19f45c8d400791de5d687f46f114 Oct 18 13:16:55.989682 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 Oct 18 13:16:55.989682 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project Oct 18 13:16:55.989682 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:55.989682 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:55.989682 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: d2431fbdd48c4d498478bcead87ce5bf Oct 18 13:16:55.989682 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project Oct 18 13:16:55.989682 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: action_args: {} Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:55.990274 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 18 13:16:55.991577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:55.993564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a5f2ea41-cc8e-42ea-b00e-6b7af9ab1d69 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Calling method '.version_select at 0x7ff6143128b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:55.994649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-df7519cc-aa16-44a3-92b3-fd4ebf21c802 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:55.999011 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-df7519cc-aa16-44a3-92b3-fd4ebf21c802 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.281777 Oct 18 13:16:55.999849 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 138/302] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 18 13:16:55 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 284 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:56.008033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f87b4286-ae70-4f63-8034-af368bf19305 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:56.008902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f87b4286-ae70-4f63-8034-af368bf19305 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:56.019759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f87b4286-ae70-4f63-8034-af368bf19305 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:56.020519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f87b4286-ae70-4f63-8034-af368bf19305 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:56.021098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f87b4286-ae70-4f63-8034-af368bf19305 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:56.021981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f87b4286-ae70-4f63-8034-af368bf19305 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:56.022569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f87b4286-ae70-4f63-8034-af368bf19305 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:56.023194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f87b4286-ae70-4f63-8034-af368bf19305 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:56.049167 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-f87b4286-ae70-4f63-8034-af368bf19305 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] HTTP exception thrown: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f87b4286-ae70-4f63-8034-af368bf19305 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Request method failure captured: Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f HTTP/1.1 Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcR3AyS3vBT0gto-JnbvjkzYn7p12shzDcujab7KFyjL0h7dQ0bt-WDsMsjE313b2mZZqzW8sEXn9ja7OUg_D6qgZt856eG2CYRGtWPnuVBm8geJM3YqfZmDZihOMB2mG8Nx2VohkD-14SqXOXAPhW7UWqM_r9jR98MCNdyZwLjouM Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: df5cae9601cd4b40bd657b7304b17fe2 Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AggregatesAdminTestJSON-957596026 Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:16:56.052090 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:16:56.053632 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/df5cae9601cd4b40bd657b7304b17fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/df5cae9601cd4b40bd657b7304b17fe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/df5cae9601cd4b40bd657b7304b17fe2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_df5cae9601cd4b40bd657b7304b17fe2"}]}] Oct 18 13:16:56.053632 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AggregatesAdminTestJSON-957596026 Oct 18 13:16:56.053632 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: df5cae9601cd4b40bd657b7304b17fe2 Oct 18 13:16:56.053632 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-957596026 Oct 18 13:16:56.053632 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AggregatesAdminTestJSON-957596026-project Oct 18 13:16:56.053632 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:16:56.053632 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:16:56.053632 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 0d0b91312f644348b978e07632259760 Oct 18 13:16:56.053632 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AggregatesAdminTestJSON-957596026-project Oct 18 13:16:56.053632 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:16:56.053632 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:56.053632 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '4749485a-14ea-47b4-a16a-42da495ebb0f'} Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:56.054500 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:56.055610 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:16:56.056961 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a5f2ea41-cc8e-42ea-b00e-6b7af9ab1d69 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1119675022" status: 204 len: 0 microversion: 2.10 time: 0.075541 Oct 18 13:16:56.057443 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 165/303] 10.222.0.40 () {60 vars in 1325 bytes} [Tue Oct 18 13:16:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1119675022 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:16:56.059305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f87b4286-ae70-4f63-8034-af368bf19305 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Returning 404 to user: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:56.060574 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f87b4286-ae70-4f63-8034-af368bf19305 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 404 len: 111 microversion: 2.1 time: 0.058138 Oct 18 13:16:56.061609 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 139/304] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:16:56 2022] DELETE /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:56.066867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7d1c1efb-988f-4adf-a026-d254d7668711 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Calling method '.version_select at 0x7ff61412c940>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:56.077313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-649473d5-de70-4b5b-9d39-c34d5a0b973d tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:56.082826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-649473d5-de70-4b5b-9d39-c34d5a0b973d tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'd2431fbdd48c4d498478bcead87ce5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80cb19f45c8d400791de5d687f46f114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-649473d5-de70-4b5b-9d39-c34d5a0b973d tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project] Request method failure captured: Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18%2013:16:56 HTTP/1.1 Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdERQPINVnzOj9qyM3BvwRKCZPFnfO0u4Ks0o7H0NRneDaKBLGJHEJfiHOl8uUrxkGoAY1TiLjBu2tktfyOXJJoyRpRKk5GXft4a_m7NJiskiEdUbdR_TmPToafeswh7i3J_rz21FDdN86WS-ICwzvMjFh6wkho1IJvCKVe84Tqnxs Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 80cb19f45c8d400791de5d687f46f114 Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:56.089611 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:56.091214 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/80cb19f45c8d400791de5d687f46f114"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/80cb19f45c8d400791de5d687f46f114"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/80cb19f45c8d400791de5d687f46f114"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_80cb19f45c8d400791de5d687f46f114"}]}] Oct 18 13:16:56.091214 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 Oct 18 13:16:56.091214 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 80cb19f45c8d400791de5d687f46f114 Oct 18 13:16:56.091214 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 Oct 18 13:16:56.091214 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project Oct 18 13:16:56.091214 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:56.091214 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:56.091214 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: d2431fbdd48c4d498478bcead87ce5bf Oct 18 13:16:56.091214 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project Oct 18 13:16:56.091214 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '2022-10-18 13:16:56'} Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:16:56.091860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 18 13:16:56.093328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:56.094442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-649473d5-de70-4b5b-9d39-c34d5a0b973d tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:56.094442 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-649473d5-de70-4b5b-9d39-c34d5a0b973d tempest-InstanceUsageAuditLogNegativeTestJSON-462920604 tempest-InstanceUsageAuditLogNegativeTestJSON-462920604-project] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18 13:16:56" status: 403 len: 128 microversion: 2.1 time: 0.030235 Oct 18 13:16:56.099088 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 166/305] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 18 13:16:56 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-18%2013%3A16%3A56 => generated 128 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:56.127725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fed863a2-3fcb-45ad-82c6-b80c36d873f1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:56.130158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fed863a2-3fcb-45ad-82c6-b80c36d873f1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] [instance: 4749485a-14ea-47b4-a16a-42da495ebb0f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:56.146900 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7d1c1efb-988f-4adf-a026-d254d7668711 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-986094644?user_id=5c0e0e4e2aa94022b49adb52ca196aef" status: 204 len: 0 microversion: 2.10 time: 0.082469 Oct 18 13:16:56.148366 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 140/306] 10.222.0.40 () {60 vars in 1340 bytes} [Tue Oct 18 13:16:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-986094644?user_id=5c0e0e4e2aa94022b49adb52ca196aef => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:16:56.163732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-443144f1-4436-467c-a1cd-3b0ebccaafa0 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] Calling method '.version_select at 0x7ff61408aa60>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:56.174327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fed863a2-3fcb-45ad-82c6-b80c36d873f1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:56.175303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fed863a2-3fcb-45ad-82c6-b80c36d873f1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:56.179615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fed863a2-3fcb-45ad-82c6-b80c36d873f1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:56.180853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fed863a2-3fcb-45ad-82c6-b80c36d873f1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:56.184325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fed863a2-3fcb-45ad-82c6-b80c36d873f1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:56.186445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fed863a2-3fcb-45ad-82c6-b80c36d873f1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:56.238732 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-443144f1-4436-467c-a1cd-3b0ebccaafa0 tempest-KeyPairsV210TestJSON-210182388 tempest-KeyPairsV210TestJSON-210182388-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699139542?user_id=5c0e0e4e2aa94022b49adb52ca196aef" status: 204 len: 0 microversion: 2.10 time: 0.075601 Oct 18 13:16:56.267850 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 141/307] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:16:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699139542?user_id=5c0e0e4e2aa94022b49adb52ca196aef => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:16:56.279905 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-fed863a2-3fcb-45ad-82c6-b80c36d873f1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] HTTP exception thrown: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fed863a2-3fcb-45ad-82c6-b80c36d873f1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Request method failure captured: Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f HTTP/1.1 Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcR3AyS3vBT0gto-JnbvjkzYn7p12shzDcujab7KFyjL0h7dQ0bt-WDsMsjE313b2mZZqzW8sEXn9ja7OUg_D6qgZt856eG2CYRGtWPnuVBm8geJM3YqfZmDZihOMB2mG8Nx2VohkD-14SqXOXAPhW7UWqM_r9jR98MCNdyZwLjouM Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: df5cae9601cd4b40bd657b7304b17fe2 Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AggregatesAdminTestJSON-957596026 Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:16:56.287992 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:16:56.289287 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/df5cae9601cd4b40bd657b7304b17fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/df5cae9601cd4b40bd657b7304b17fe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/df5cae9601cd4b40bd657b7304b17fe2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_df5cae9601cd4b40bd657b7304b17fe2"}]}] Oct 18 13:16:56.289287 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AggregatesAdminTestJSON-957596026 Oct 18 13:16:56.289287 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: df5cae9601cd4b40bd657b7304b17fe2 Oct 18 13:16:56.289287 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-957596026 Oct 18 13:16:56.289287 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AggregatesAdminTestJSON-957596026-project Oct 18 13:16:56.289287 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:16:56.289287 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:16:56.289287 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0d0b91312f644348b978e07632259760 Oct 18 13:16:56.289287 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AggregatesAdminTestJSON-957596026-project Oct 18 13:16:56.289287 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:16:56.289287 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:56.289287 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '4749485a-14ea-47b4-a16a-42da495ebb0f'} Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:16:56.289994 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. Oct 18 13:16:56.291067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:16:56.292068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fed863a2-3fcb-45ad-82c6-b80c36d873f1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] Returning 404 to user: Instance 4749485a-14ea-47b4-a16a-42da495ebb0f could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:16:56.295523 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fed863a2-3fcb-45ad-82c6-b80c36d873f1 tempest-AggregatesAdminTestJSON-957596026 tempest-AggregatesAdminTestJSON-957596026-project] 10.222.0.40 "GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f" status: 404 len: 111 microversion: 2.1 time: 0.194674 Oct 18 13:16:56.298186 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 167/308] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:56 2022] GET /compute/v2.1/servers/4749485a-14ea-47b4-a16a-42da495ebb0f => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:16:56.651035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-5f866a1a-8d6e-40a8-bd8a-cea49737d71e req-59d60373-71a7-4949-8580-8b80e8c462cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a582e4e-0006-4c9a-9ba8-ed39705417e6", "tag": "7daf3ff2-c978-44d5-a5bd-154b1ec4e5c2"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:16:56.669582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5f866a1a-8d6e-40a8-bd8a-cea49737d71e req-59d60373-71a7-4949-8580-8b80e8c462cc service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:56.670629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5f866a1a-8d6e-40a8-bd8a-cea49737d71e req-59d60373-71a7-4949-8580-8b80e8c462cc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:56.671502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5f866a1a-8d6e-40a8-bd8a-cea49737d71e req-59d60373-71a7-4949-8580-8b80e8c462cc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:56.684448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3ea21810-65a1-4577-9776-51b10f2b1def tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:56.685411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3ea21810-65a1-4577-9776-51b10f2b1def tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:56.689565 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-5f866a1a-8d6e-40a8-bd8a-cea49737d71e req-59d60373-71a7-4949-8580-8b80e8c462cc service nova] Creating event network-changed:7daf3ff2-c978-44d5-a5bd-154b1ec4e5c2 for instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 on n-h1-858384-13 Oct 18 13:16:56.702320 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-5f866a1a-8d6e-40a8-bd8a-cea49737d71e req-59d60373-71a7-4949-8580-8b80e8c462cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055900 Oct 18 13:16:56.703677 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 142/309] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:16:56.704365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3ea21810-65a1-4577-9776-51b10f2b1def tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:56.705286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3ea21810-65a1-4577-9776-51b10f2b1def tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:56.706051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3ea21810-65a1-4577-9776-51b10f2b1def tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:56.717708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3ea21810-65a1-4577-9776-51b10f2b1def tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:56.718704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3ea21810-65a1-4577-9776-51b10f2b1def tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:56.719349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3ea21810-65a1-4577-9776-51b10f2b1def tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:57.038783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3ea21810-65a1-4577-9776-51b10f2b1def tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:57.082633 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3ea21810-65a1-4577-9776-51b10f2b1def tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1319 microversion: 2.1 time: 0.406711 Oct 18 13:16:57.123695 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 168/310] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:56 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:16:58.136426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b63a7cfa-0207-42e3-ba6e-fd27a1d421d7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:58.139729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b63a7cfa-0207-42e3-ba6e-fd27a1d421d7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:58.156919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b63a7cfa-0207-42e3-ba6e-fd27a1d421d7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:58.157813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b63a7cfa-0207-42e3-ba6e-fd27a1d421d7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:58.160499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b63a7cfa-0207-42e3-ba6e-fd27a1d421d7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:58.162683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b63a7cfa-0207-42e3-ba6e-fd27a1d421d7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:58.163392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b63a7cfa-0207-42e3-ba6e-fd27a1d421d7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:58.165127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b63a7cfa-0207-42e3-ba6e-fd27a1d421d7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:58.774937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b63a7cfa-0207-42e3-ba6e-fd27a1d421d7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:16:58.787710 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b63a7cfa-0207-42e3-ba6e-fd27a1d421d7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1319 microversion: 2.1 time: 0.664077 Oct 18 13:16:58.789516 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 143/311] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:58 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1319 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:16:59.816343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f2d6c0e4-eb94-4aa0-8cbd-973ff870af8c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:16:59.817821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f2d6c0e4-eb94-4aa0-8cbd-973ff870af8c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:16:59.835117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f2d6c0e4-eb94-4aa0-8cbd-973ff870af8c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:59.836004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f2d6c0e4-eb94-4aa0-8cbd-973ff870af8c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:59.838006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f2d6c0e4-eb94-4aa0-8cbd-973ff870af8c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:16:59.839863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f2d6c0e4-eb94-4aa0-8cbd-973ff870af8c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:16:59.843205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f2d6c0e4-eb94-4aa0-8cbd-973ff870af8c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:16:59.843890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f2d6c0e4-eb94-4aa0-8cbd-973ff870af8c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:00.242547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f2d6c0e4-eb94-4aa0-8cbd-973ff870af8c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:00.269048 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f2d6c0e4-eb94-4aa0-8cbd-973ff870af8c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1319 microversion: 2.1 time: 0.456463 Oct 18 13:17:00.281658 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 169/312] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:16:59 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:01.296818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-00233519-31f5-4f79-a604-6aba5452b0fe tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:01.297540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-00233519-31f5-4f79-a604-6aba5452b0fe tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:01.321223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00233519-31f5-4f79-a604-6aba5452b0fe tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:01.322054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00233519-31f5-4f79-a604-6aba5452b0fe tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:01.322656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00233519-31f5-4f79-a604-6aba5452b0fe tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:01.324902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00233519-31f5-4f79-a604-6aba5452b0fe tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:01.328410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00233519-31f5-4f79-a604-6aba5452b0fe tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:01.330768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00233519-31f5-4f79-a604-6aba5452b0fe tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:01.694778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=8 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:01.888213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-00233519-31f5-4f79-a604-6aba5452b0fe tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:01.910271 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-00233519-31f5-4f79-a604-6aba5452b0fe tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1319 microversion: 2.1 time: 0.619950 Oct 18 13:17:01.910871 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 144/313] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:01 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1319 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:02.936846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-627310b7-2f92-4194-8367-334dc1731eb1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:02.937645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-627310b7-2f92-4194-8367-334dc1731eb1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:02.947564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-627310b7-2f92-4194-8367-334dc1731eb1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:02.953316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-627310b7-2f92-4194-8367-334dc1731eb1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:02.954366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-627310b7-2f92-4194-8367-334dc1731eb1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:02.956336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-627310b7-2f92-4194-8367-334dc1731eb1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:02.958060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-627310b7-2f92-4194-8367-334dc1731eb1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:02.961464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-627310b7-2f92-4194-8367-334dc1731eb1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:03.643902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-627310b7-2f92-4194-8367-334dc1731eb1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:03.656049 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-627310b7-2f92-4194-8367-334dc1731eb1 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1319 microversion: 2.1 time: 0.723875 Oct 18 13:17:03.666392 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 170/314] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:02 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1319 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:04.687626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=92 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:04.692109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b3abefcf-8276-4c0f-8a83-4e370d8069a7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:04.692733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b3abefcf-8276-4c0f-8a83-4e370d8069a7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:04.714810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3abefcf-8276-4c0f-8a83-4e370d8069a7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:04.715385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3abefcf-8276-4c0f-8a83-4e370d8069a7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:04.715863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3abefcf-8276-4c0f-8a83-4e370d8069a7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:04.720939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3abefcf-8276-4c0f-8a83-4e370d8069a7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:04.722228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3abefcf-8276-4c0f-8a83-4e370d8069a7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:04.724589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3abefcf-8276-4c0f-8a83-4e370d8069a7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:05.165121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b3abefcf-8276-4c0f-8a83-4e370d8069a7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:05.180160 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b3abefcf-8276-4c0f-8a83-4e370d8069a7 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1319 microversion: 2.1 time: 0.491302 Oct 18 13:17:05.182924 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 145/315] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:04 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:06.207798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16de86ab-2efa-443e-acf3-56814311dcc3 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:06.209460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-16de86ab-2efa-443e-acf3-56814311dcc3 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:06.220615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=15 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:06.221807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=42 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:06.234074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16de86ab-2efa-443e-acf3-56814311dcc3 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:06.242961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16de86ab-2efa-443e-acf3-56814311dcc3 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:06.243861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16de86ab-2efa-443e-acf3-56814311dcc3 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:06.246501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16de86ab-2efa-443e-acf3-56814311dcc3 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:06.249322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16de86ab-2efa-443e-acf3-56814311dcc3 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:06.250282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16de86ab-2efa-443e-acf3-56814311dcc3 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:06.778499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-16de86ab-2efa-443e-acf3-56814311dcc3 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:06.793724 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-16de86ab-2efa-443e-acf3-56814311dcc3 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1319 microversion: 2.1 time: 0.592617 Oct 18 13:17:06.802524 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 171/316] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:06 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1319 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:07.610329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-695d7a56-6422-45e3-ac64-6380f264bfc6 req-69f52b01-bb79-4750-a68e-57c1d2ee9fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a582e4e-0006-4c9a-9ba8-ed39705417e6", "name": "network-vif-plugged", "status": "completed", "tag": "7daf3ff2-c978-44d5-a5bd-154b1ec4e5c2"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:07.633089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-695d7a56-6422-45e3-ac64-6380f264bfc6 req-69f52b01-bb79-4750-a68e-57c1d2ee9fa3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:07.633698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-695d7a56-6422-45e3-ac64-6380f264bfc6 req-69f52b01-bb79-4750-a68e-57c1d2ee9fa3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:07.634198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-695d7a56-6422-45e3-ac64-6380f264bfc6 req-69f52b01-bb79-4750-a68e-57c1d2ee9fa3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:07.659148 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-695d7a56-6422-45e3-ac64-6380f264bfc6 req-69f52b01-bb79-4750-a68e-57c1d2ee9fa3 service nova] Creating event network-vif-plugged:7daf3ff2-c978-44d5-a5bd-154b1ec4e5c2 for instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 on n-h1-858384-13 Oct 18 13:17:07.671456 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-695d7a56-6422-45e3-ac64-6380f264bfc6 req-69f52b01-bb79-4750-a68e-57c1d2ee9fa3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059557 Oct 18 13:17:07.672826 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 146/317] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:07.831310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b99e96f1-d008-476f-95a1-3456d02195f0 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:07.832305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b99e96f1-d008-476f-95a1-3456d02195f0 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:07.844774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b99e96f1-d008-476f-95a1-3456d02195f0 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:07.847988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b99e96f1-d008-476f-95a1-3456d02195f0 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:07.849629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b99e96f1-d008-476f-95a1-3456d02195f0 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:07.851125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b99e96f1-d008-476f-95a1-3456d02195f0 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:07.853011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b99e96f1-d008-476f-95a1-3456d02195f0 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:07.853830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b99e96f1-d008-476f-95a1-3456d02195f0 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:08.153405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b99e96f1-d008-476f-95a1-3456d02195f0 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:08.165884 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b99e96f1-d008-476f-95a1-3456d02195f0 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1319 microversion: 2.1 time: 0.339084 Oct 18 13:17:08.167637 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 147/318] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:07 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:08.616792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cf06a31a-0b11-4202-8e1e-ee4c6f755498 tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:08.622107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf06a31a-0b11-4202-8e1e-ee4c6f755498 tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:08.622859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf06a31a-0b11-4202-8e1e-ee4c6f755498 tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:08.623541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf06a31a-0b11-4202-8e1e-ee4c6f755498 tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:08.624620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf06a31a-0b11-4202-8e1e-ee4c6f755498 tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:08.626896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf06a31a-0b11-4202-8e1e-ee4c6f755498 tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:08.627570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf06a31a-0b11-4202-8e1e-ee4c6f755498 tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:08.656317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:08.703933 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cf06a31a-0b11-4202-8e1e-ee4c6f755498 tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.991472 Oct 18 13:17:08.704549 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 172/319] 10.222.0.40 () {58 vars in 1164 bytes} [Tue Oct 18 13:17:07 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:17:08.733075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-27c8bd53-975a-47a3-81cf-6af9e52ebd9b tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:08.737986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27c8bd53-975a-47a3-81cf-6af9e52ebd9b tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:08.740165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27c8bd53-975a-47a3-81cf-6af9e52ebd9b tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:08.741592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27c8bd53-975a-47a3-81cf-6af9e52ebd9b tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:08.743029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27c8bd53-975a-47a3-81cf-6af9e52ebd9b tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:08.744130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27c8bd53-975a-47a3-81cf-6af9e52ebd9b tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:08.746856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27c8bd53-975a-47a3-81cf-6af9e52ebd9b tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:08.846286 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-27c8bd53-975a-47a3-81cf-6af9e52ebd9b tempest-AZAdminV2TestJSON-420194120 tempest-AZAdminV2TestJSON-420194120-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.123646 Oct 18 13:17:08.847540 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 148/320] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 18 13:17:08 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:09.191608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bbd74ee2-b279-4b46-9648-58fbc4c10978 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:09.192290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bbd74ee2-b279-4b46-9648-58fbc4c10978 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:09.201118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbd74ee2-b279-4b46-9648-58fbc4c10978 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:09.205686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbd74ee2-b279-4b46-9648-58fbc4c10978 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:09.207996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbd74ee2-b279-4b46-9648-58fbc4c10978 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:09.211342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbd74ee2-b279-4b46-9648-58fbc4c10978 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:09.212252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbd74ee2-b279-4b46-9648-58fbc4c10978 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:09.214434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbd74ee2-b279-4b46-9648-58fbc4c10978 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:10.330749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bbd74ee2-b279-4b46-9648-58fbc4c10978 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:10.342818 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bbd74ee2-b279-4b46-9648-58fbc4c10978 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1319 microversion: 2.1 time: 1.155447 Oct 18 13:17:10.354481 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 173/321] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:09 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1319 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:11.191440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d61da7e-57b3-4f62-aee0-93673753022a tempest-NetworksTest-2086373380 tempest-NetworksTest-2086373380-project-admin] Calling method '.version_select at 0x7ff6140fe9d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:11.378482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b7c57586-c752-4c22-91fb-91c8e2477702 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:11.381881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b7c57586-c752-4c22-91fb-91c8e2477702 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:11.412109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7c57586-c752-4c22-91fb-91c8e2477702 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:11.412959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7c57586-c752-4c22-91fb-91c8e2477702 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:11.413760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7c57586-c752-4c22-91fb-91c8e2477702 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:11.415390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7c57586-c752-4c22-91fb-91c8e2477702 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:11.416924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7c57586-c752-4c22-91fb-91c8e2477702 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:11.418850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7c57586-c752-4c22-91fb-91c8e2477702 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:11.860946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b7c57586-c752-4c22-91fb-91c8e2477702 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:11.895111 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b7c57586-c752-4c22-91fb-91c8e2477702 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1469 microversion: 2.1 time: 0.522001 Oct 18 13:17:11.896662 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 174/322] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:11 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1469 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:17:12.131601 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3d61da7e-57b3-4f62-aee0-93673753022a tempest-NetworksTest-2086373380 tempest-NetworksTest-2086373380-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks" status: 200 len: 4013 microversion: 2.1 time: 1.502329 Oct 18 13:17:12.133064 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 149/323] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:17:10 2022] GET /compute/v2.1/os-networks => generated 4013 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:12.141577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0498d58c-5edf-4305-97cd-f1d142a1be85 tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:12.148698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0498d58c-5edf-4305-97cd-f1d142a1be85 tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:12.194334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0498d58c-5edf-4305-97cd-f1d142a1be85 tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:12.196479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0498d58c-5edf-4305-97cd-f1d142a1be85 tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:12.198875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0498d58c-5edf-4305-97cd-f1d142a1be85 tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:12.206371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0498d58c-5edf-4305-97cd-f1d142a1be85 tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:12.207309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0498d58c-5edf-4305-97cd-f1d142a1be85 tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:12.208346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0498d58c-5edf-4305-97cd-f1d142a1be85 tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:12.558938 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0498d58c-5edf-4305-97cd-f1d142a1be85 tempest-DeleteServersAdminTestJSON-1365014650 tempest-DeleteServersAdminTestJSON-1365014650-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6/action" status: 202 len: 0 microversion: 2.1 time: 0.422474 Oct 18 13:17:12.561013 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 150/324] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:17:12 2022] POST /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:17:12.575693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-394e0d27-5f62-453c-8203-505f08871692 tempest-NetworksTest-2086373380 tempest-NetworksTest-2086373380-project-admin] Calling method '.version_select at 0x7ff6140fea60>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:12.635974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-908702304", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:12.778842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:17:12.993862 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-394e0d27-5f62-453c-8203-505f08871692 tempest-NetworksTest-2086373380 tempest-NetworksTest-2086373380-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks/0886a8ee-8c44-41d8-a6e7-991604b6adb5" status: 200 len: 652 microversion: 2.1 time: 0.430520 Oct 18 13:17:13.000692 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 151/325] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:17:12 2022] GET /compute/v2.1/os-networks/0886a8ee-8c44-41d8-a6e7-991604b6adb5 => generated 652 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:13.007321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:13.011994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:13.031324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:13.031846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:13.032286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:13.036079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:13.040663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:13.042555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:13.173805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:13.178407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:13.180982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:13.182625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lazy-loading 'fault' on Instance uuid 2a582e4e-0006-4c9a-9ba8-ed39705417e6 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:17:13.498999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:17:13.499434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:17:13.499911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:17:13.500319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:17:13.500719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:17:13.517686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:13.518488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:13.519079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:13.522068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:13.523007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:13.523670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:13.558929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Getting quotas for project 7c65a39f96a0450691774ebdf4a4122d. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:17:13.566052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Getting quotas for user 8fdc8cbdac3a4a93bd0a4c8f2a06e579 and project 7c65a39f96a0450691774ebdf4a4122d. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:17:13.586101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:17:13.590198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:17:13.673745 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1b35e4ca-25a9-4983-ad40-aa3c3a3e709f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.774325 Oct 18 13:17:13.678330 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 175/326] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:17:13.690486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6fbf1592-80c9-4517-9b45-bd2ab5df9a09 tempest-NetworksTest-2086373380 tempest-NetworksTest-2086373380-project-admin] Calling method '.version_select at 0x7ff6143123a0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:13.910182 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6fbf1592-80c9-4517-9b45-bd2ab5df9a09 tempest-NetworksTest-2086373380 tempest-NetworksTest-2086373380-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks" status: 200 len: 4013 microversion: 2.1 time: 0.230162 Oct 18 13:17:13.911070 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 176/327] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:17:13 2022] GET /compute/v2.1/os-networks => generated 4013 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:14.222600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:14.237968 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-360ea617-e6f4-450c-abef-09a5c0b12779 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1452 microversion: 2.1 time: 1.239937 Oct 18 13:17:14.241965 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 152/328] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:12 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1452 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:14.267325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-03a683f9-1913-4774-bf5d-343ae65362f4 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:14.269222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-03a683f9-1913-4774-bf5d-343ae65362f4 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:14.601823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1679140626", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:14.736166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:17:14.809412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-03a683f9-1913-4774-bf5d-343ae65362f4 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:14.834344 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-03a683f9-1913-4774-bf5d-343ae65362f4 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1218 microversion: 2.1 time: 0.586335 Oct 18 13:17:14.839855 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 153/329] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:14 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1218 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:14.875148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-da326c9a-5200-4752-8f3c-f65711424497 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:14.875745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-da326c9a-5200-4752-8f3c-f65711424497 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:14.908884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da326c9a-5200-4752-8f3c-f65711424497 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:14.911293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da326c9a-5200-4752-8f3c-f65711424497 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:14.912065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da326c9a-5200-4752-8f3c-f65711424497 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:14.914613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da326c9a-5200-4752-8f3c-f65711424497 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:14.915868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da326c9a-5200-4752-8f3c-f65711424497 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:14.919486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da326c9a-5200-4752-8f3c-f65711424497 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:14.963990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-da326c9a-5200-4752-8f3c-f65711424497 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:17:15.134196 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-da326c9a-5200-4752-8f3c-f65711424497 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 204 len: 0 microversion: 2.1 time: 0.292184 Oct 18 13:17:15.136303 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 154/330] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:17:14 2022] DELETE /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:17:15.340326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:17:15.340844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:17:15.341420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:17:15.342118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:17:15.342845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:17:15.365649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:15.366764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:15.367419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:15.368394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:15.370850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:15.371577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:15.429962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Getting quotas for project 3f136eea39d84b04b5410eb0906c113e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:17:15.435022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=5 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:15.452698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Getting quotas for user e631235f0d0c400981c97d9edb1ea7fe and project 3f136eea39d84b04b5410eb0906c113e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:17:15.483251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:17:15.486583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:17:15.599118 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b587e166-df14-4502-bc49-c396813f366d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.684937 Oct 18 13:17:15.609003 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 177/331] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:17:15.620313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:15.621029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:15.642115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:15.643186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:15.644419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:15.646039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:15.646503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:15.648519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:15.794492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:15.795161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:15.803109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:15.803663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lazy-loading 'fault' on Instance uuid 2a582e4e-0006-4c9a-9ba8-ed39705417e6 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:17:15.874364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1050049486", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "a22da94d-677f-457d-bbf8-95010fd233ef"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:15.955183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] validate_networks() for [('a22da94d-677f-457d-bbf8-95010fd233ef', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:17:16.112571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:16.125776 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0ee5528b-1286-41f0-9d15-c76de13276c2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1458 microversion: 2.1 time: 0.515476 Oct 18 13:17:16.127886 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 178/332] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:15 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1458 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:16.141206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22dbe49e-4bd1-42af-944b-efb284b6b009 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:16.143241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-22dbe49e-4bd1-42af-944b-efb284b6b009 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:16.246581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-22dbe49e-4bd1-42af-944b-efb284b6b009 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:16.281865 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-22dbe49e-4bd1-42af-944b-efb284b6b009 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1213 microversion: 2.1 time: 0.143528 Oct 18 13:17:16.283056 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 179/333] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:16 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:16.289681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-24255332-cbbc-46df-a158-4a2a806e14b9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:16.292821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-24255332-cbbc-46df-a158-4a2a806e14b9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:16.306373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24255332-cbbc-46df-a158-4a2a806e14b9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:16.307616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24255332-cbbc-46df-a158-4a2a806e14b9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:16.308204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24255332-cbbc-46df-a158-4a2a806e14b9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:16.310437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24255332-cbbc-46df-a158-4a2a806e14b9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:16.313566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24255332-cbbc-46df-a158-4a2a806e14b9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:16.314211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24255332-cbbc-46df-a158-4a2a806e14b9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:16.426625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-24255332-cbbc-46df-a158-4a2a806e14b9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:16.437029 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-24255332-cbbc-46df-a158-4a2a806e14b9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1276 microversion: 2.1 time: 0.152724 Oct 18 13:17:16.452620 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 180/334] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:16 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:17.158372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:17.159038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:17.171049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:17.171567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:17.172004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:17.172726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:17.177445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:17.177891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:17.228011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:17.228415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:17.228900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:17.229433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lazy-loading 'fault' on Instance uuid 2a582e4e-0006-4c9a-9ba8-ed39705417e6 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:17:17.513550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:17.534051 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1242d448-8014-4ee1-ab27-6190579b7094 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1458 microversion: 2.1 time: 0.379441 Oct 18 13:17:17.547767 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 181/335] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:17 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1458 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:17.565760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0c4e6943-94ad-4d69-b11d-bf1359958c63 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:17.565760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0c4e6943-94ad-4d69-b11d-bf1359958c63 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:17.606297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c4e6943-94ad-4d69-b11d-bf1359958c63 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:17.606793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c4e6943-94ad-4d69-b11d-bf1359958c63 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:17.607482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c4e6943-94ad-4d69-b11d-bf1359958c63 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:17.608403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c4e6943-94ad-4d69-b11d-bf1359958c63 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:17.609084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c4e6943-94ad-4d69-b11d-bf1359958c63 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:17.610291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c4e6943-94ad-4d69-b11d-bf1359958c63 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:17.881891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0c4e6943-94ad-4d69-b11d-bf1359958c63 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:17.893275 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0c4e6943-94ad-4d69-b11d-bf1359958c63 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1273 microversion: 2.1 time: 0.342743 Oct 18 13:17:17.896685 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 182/336] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:17 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1273 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:18.239978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-015409a8-94d4-4622-988a-ab3902e8dcbf tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1100287036", "id": 656578406, "os-flavor-access:is_public": "False"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:18.272606 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-015409a8-94d4-4622-988a-ab3902e8dcbf tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.374123 Oct 18 13:17:18.273636 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 183/337] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:17 2022] POST /compute/v2.1/flavors => generated 428 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:18.286190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cc76ef1a-76a2-49fb-9c86-809987947017 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:18.287885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cc76ef1a-76a2-49fb-9c86-809987947017 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:18.309822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc76ef1a-76a2-49fb-9c86-809987947017 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:18.310588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc76ef1a-76a2-49fb-9c86-809987947017 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:18.311033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc76ef1a-76a2-49fb-9c86-809987947017 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:18.311746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc76ef1a-76a2-49fb-9c86-809987947017 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:18.312344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc76ef1a-76a2-49fb-9c86-809987947017 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:18.313221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc76ef1a-76a2-49fb-9c86-809987947017 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:18.482744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cc76ef1a-76a2-49fb-9c86-809987947017 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:18.497098 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cc76ef1a-76a2-49fb-9c86-809987947017 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1276 microversion: 2.1 time: 0.222053 Oct 18 13:17:18.499118 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 184/338] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:18 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:18.506851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0995618-b2e8-4bee-85cd-8c2840e65388 tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3a070121b3504e42911d5d08809e0893"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:18.762737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:18.846591 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c0995618-b2e8-4bee-85cd-8c2840e65388 tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/656578406/action" status: 200 len: 96 microversion: 2.1 time: 0.346159 Oct 18 13:17:18.852693 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 185/339] 10.222.0.40 () {60 vars in 1197 bytes} [Tue Oct 18 13:17:18 2022] POST /compute/v2.1/flavors/656578406/action => generated 96 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:17:18.860708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e5a4990d-5691-44ac-8069-848da1c66f71 req-7619a3e5-6e64-4470-8817-0a4997a4883e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a582e4e-0006-4c9a-9ba8-ed39705417e6", "name": "network-vif-deleted", "tag": "7daf3ff2-c978-44d5-a5bd-154b1ec4e5c2"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:18.892621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e5a4990d-5691-44ac-8069-848da1c66f71 req-7619a3e5-6e64-4470-8817-0a4997a4883e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:18.894457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e5a4990d-5691-44ac-8069-848da1c66f71 req-7619a3e5-6e64-4470-8817-0a4997a4883e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:18.895808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e5a4990d-5691-44ac-8069-848da1c66f71 req-7619a3e5-6e64-4470-8817-0a4997a4883e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:18.921906 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e5a4990d-5691-44ac-8069-848da1c66f71 req-7619a3e5-6e64-4470-8817-0a4997a4883e service nova] Creating event network-vif-deleted:7daf3ff2-c978-44d5-a5bd-154b1ec4e5c2 for instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 on n-h1-858384-13 Oct 18 13:17:18.935601 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e5a4990d-5691-44ac-8069-848da1c66f71 req-7619a3e5-6e64-4470-8817-0a4997a4883e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081071 Oct 18 13:17:18.937252 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 186/340] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:18.941595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:18.942209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:18.962751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:18.963779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:18.964324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:18.965042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:18.965523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:18.965943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:19.063063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:19.064110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:19.065002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:19.065942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lazy-loading 'fault' on Instance uuid 2a582e4e-0006-4c9a-9ba8-ed39705417e6 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:17:19.236544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c06e155847a4386881f49f26c02dcec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e57e4407cc94732a5144972bf546dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:19.249997 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5d7c0ec0-dab2-4393-92b8-62b6b3ccf922 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 200 len: 1309 microversion: 2.1 time: 0.312680 Oct 18 13:17:19.268910 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 187/341] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:18 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 1309 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:19.517911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-73d22147-2d33-4826-8851-1ee56d6bdba1 tempest-FlavorsAccessTestJSON-145561255 tempest-FlavorsAccessTestJSON-145561255-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:19.548659 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-73d22147-2d33-4826-8851-1ee56d6bdba1 tempest-FlavorsAccessTestJSON-145561255 tempest-FlavorsAccessTestJSON-145561255-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.289967 Oct 18 13:17:19.550925 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 188/342] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:17:19 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:19.555898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-69fbe6ae-a346-4c23-8657-d2d3f6d5c342 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:19.556850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-69fbe6ae-a346-4c23-8657-d2d3f6d5c342 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:19.565761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69fbe6ae-a346-4c23-8657-d2d3f6d5c342 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:19.566929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69fbe6ae-a346-4c23-8657-d2d3f6d5c342 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:19.567836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69fbe6ae-a346-4c23-8657-d2d3f6d5c342 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:19.569047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69fbe6ae-a346-4c23-8657-d2d3f6d5c342 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:19.569995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69fbe6ae-a346-4c23-8657-d2d3f6d5c342 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:19.570738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69fbe6ae-a346-4c23-8657-d2d3f6d5c342 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:19.872863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:17:19.878046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:17:19.878918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:17:19.879744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:17:19.882420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:17:19.899723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:19.900972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:19.903033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:19.905121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:19.907611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:19.909666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:19.988991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Getting quotas for project a7b9ff58f71c425d8853ec2d0466ee3a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:17:19.994317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Getting quotas for user 9f3dcbdece5d4d4b992f4e9ebf4897d4 and project a7b9ff58f71c425d8853ec2d0466ee3a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:17:20.020208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:17:20.028517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:17:20.111585 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a861167e-f2d8-4e8a-9f48-69648972f9d7 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.973643 Oct 18 13:17:20.113000 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 155/343] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:17:20.118970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6b502212-4a02-46a4-aee4-c7e5911d2295 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:20.120608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6b502212-4a02-46a4-aee4-c7e5911d2295 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:20.128390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b502212-4a02-46a4-aee4-c7e5911d2295 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:20.129131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b502212-4a02-46a4-aee4-c7e5911d2295 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:20.129763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b502212-4a02-46a4-aee4-c7e5911d2295 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:20.130949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b502212-4a02-46a4-aee4-c7e5911d2295 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:20.131564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b502212-4a02-46a4-aee4-c7e5911d2295 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:20.132845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b502212-4a02-46a4-aee4-c7e5911d2295 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:20.214811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-69fbe6ae-a346-4c23-8657-d2d3f6d5c342 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:20.222893 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-69fbe6ae-a346-4c23-8657-d2d3f6d5c342 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1313 microversion: 2.1 time: 0.670702 Oct 18 13:17:20.227130 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 189/344] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:19 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:20.232910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-347ee933-96b5-4222-bfb0-c501207dcacf tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3a070121b3504e42911d5d08809e0893"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:20.344179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6b502212-4a02-46a4-aee4-c7e5911d2295 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:20.355344 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6b502212-4a02-46a4-aee4-c7e5911d2295 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1276 microversion: 2.1 time: 0.238691 Oct 18 13:17:20.357687 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 156/345] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:20 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:20.368402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e5b29b72-4076-404b-acea-b026a07ffc3d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:20.373800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e5b29b72-4076-404b-acea-b026a07ffc3d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:20.423127 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-347ee933-96b5-4222-bfb0-c501207dcacf tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/656578406/action" status: 200 len: 21 microversion: 2.1 time: 0.194806 Oct 18 13:17:20.425538 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 190/346] 10.222.0.40 () {60 vars in 1197 bytes} [Tue Oct 18 13:17:20 2022] POST /compute/v2.1/flavors/656578406/action => generated 21 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:17:20.433942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3aa52135-9900-4c43-8068-e896b6729d35 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:20.434726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3aa52135-9900-4c43-8068-e896b6729d35 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:20.444774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aa52135-9900-4c43-8068-e896b6729d35 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:20.446422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aa52135-9900-4c43-8068-e896b6729d35 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:20.447771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aa52135-9900-4c43-8068-e896b6729d35 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:20.449459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aa52135-9900-4c43-8068-e896b6729d35 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:20.450255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aa52135-9900-4c43-8068-e896b6729d35 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:20.450866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aa52135-9900-4c43-8068-e896b6729d35 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:20.473683 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-3aa52135-9900-4c43-8068-e896b6729d35 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] HTTP exception thrown: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3aa52135-9900-4c43-8068-e896b6729d35 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Request method failure captured: Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 HTTP/1.1 Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcPZXy_4JwNP1a1u4w-1mGU-RfKZ09fExKbZv2llD7jMdtkydI3zE7KkQPaWZzx8tz_zuaWKwU13EwWhzReuMSY2RTLCjxbXFj8_NjF2pWfgKKy4X6hwPmx54ZZM49H9bNMKaBvmbIiEr5zW78O011N3zOpkdzrPgyoU1YX8nwRdY0 Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 8e57e4407cc94732a5144972bf546dd2 Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:17:20.476491 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:17:20.478083 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8e57e4407cc94732a5144972bf546dd2"}]}] Oct 18 13:17:20.478083 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:20.478083 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 8e57e4407cc94732a5144972bf546dd2 Oct 18 13:17:20.478083 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:20.478083 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-DeleteServersAdminTestJSON-819045708-project Oct 18 13:17:20.478083 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:17:20.478083 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:17:20.478083 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 6c06e155847a4386881f49f26c02dcec Oct 18 13:17:20.478083 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-DeleteServersAdminTestJSON-819045708-project Oct 18 13:17:20.478083 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:17:20.478083 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.478083 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '2a582e4e-0006-4c9a-9ba8-ed39705417e6'} Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:20.478954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.480346 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.482877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3aa52135-9900-4c43-8068-e896b6729d35 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Returning 404 to user: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:20.484209 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3aa52135-9900-4c43-8068-e896b6729d35 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 404 len: 111 microversion: 2.1 time: 0.057509 Oct 18 13:17:20.484955 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 191/347] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:20 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:17:20.499015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-da433373-860b-4824-a967-7830a90eb948 tempest-FlavorsAccessTestJSON-145561255 tempest-FlavorsAccessTestJSON-145561255-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:20.523864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e5b29b72-4076-404b-acea-b026a07ffc3d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:20.534992 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e5b29b72-4076-404b-acea-b026a07ffc3d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1224 microversion: 2.1 time: 0.175426 Oct 18 13:17:20.537146 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 157/348] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:20 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1224 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:20.549647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d8cd4cf-1298-431a-bcd0-6df4fc10fbb2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:20.555306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d8cd4cf-1298-431a-bcd0-6df4fc10fbb2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:20.557925 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-da433373-860b-4824-a967-7830a90eb948 tempest-FlavorsAccessTestJSON-145561255 tempest-FlavorsAccessTestJSON-145561255-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069105 Oct 18 13:17:20.559345 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 192/349] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:17:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:20.584693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6232bb84-df6a-44b4-854f-319321fa55a4 tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:20.594797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d8cd4cf-1298-431a-bcd0-6df4fc10fbb2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:20.595357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d8cd4cf-1298-431a-bcd0-6df4fc10fbb2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:20.600579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d8cd4cf-1298-431a-bcd0-6df4fc10fbb2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:20.601488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d8cd4cf-1298-431a-bcd0-6df4fc10fbb2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:20.602195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d8cd4cf-1298-431a-bcd0-6df4fc10fbb2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:20.602651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d8cd4cf-1298-431a-bcd0-6df4fc10fbb2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:20.616211 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6232bb84-df6a-44b4-854f-319321fa55a4 tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/656578406" status: 202 len: 0 microversion: 2.1 time: 0.036131 Oct 18 13:17:20.617945 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 193/350] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:17:20 2022] DELETE /compute/v2.1/flavors/656578406 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:17:20.633153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-71216761-4146-40e5-9f09-6672a22cb72d tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:20.697451 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-9d8cd4cf-1298-431a-bcd0-6df4fc10fbb2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] HTTP exception thrown: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d8cd4cf-1298-431a-bcd0-6df4fc10fbb2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Request method failure captured: Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 HTTP/1.1 Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcPZXy_4JwNP1a1u4w-1mGU-RfKZ09fExKbZv2llD7jMdtkydI3zE7KkQPaWZzx8tz_zuaWKwU13EwWhzReuMSY2RTLCjxbXFj8_NjF2pWfgKKy4X6hwPmx54ZZM49H9bNMKaBvmbIiEr5zW78O011N3zOpkdzrPgyoU1YX8nwRdY0 Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 8e57e4407cc94732a5144972bf546dd2 Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:17:20.699175 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:17:20.700654 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8e57e4407cc94732a5144972bf546dd2"}]}] Oct 18 13:17:20.700654 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:20.700654 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 8e57e4407cc94732a5144972bf546dd2 Oct 18 13:17:20.700654 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:20.700654 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersAdminTestJSON-819045708-project Oct 18 13:17:20.700654 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:17:20.700654 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:17:20.700654 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6c06e155847a4386881f49f26c02dcec Oct 18 13:17:20.700654 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersAdminTestJSON-819045708-project Oct 18 13:17:20.700654 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:17:20.700654 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.700654 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '2a582e4e-0006-4c9a-9ba8-ed39705417e6'} Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:20.701433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.702516 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.703778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d8cd4cf-1298-431a-bcd0-6df4fc10fbb2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Returning 404 to user: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:20.703778 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d8cd4cf-1298-431a-bcd0-6df4fc10fbb2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 404 len: 111 microversion: 2.1 time: 0.162471 Oct 18 13:17:20.713607 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-71216761-4146-40e5-9f09-6672a22cb72d tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.090392 Oct 18 13:17:20.718291 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 194/351] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:17:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:20.725505 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 158/352] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:17:20 2022] DELETE /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:17:20.737442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cbf7d37e-5062-4025-95de-73372f220598 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:20.738118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cbf7d37e-5062-4025-95de-73372f220598 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 2a582e4e-0006-4c9a-9ba8-ed39705417e6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:20.738404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca1d6be5-1db9-4936-87ae-1ce2f0cada65 tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-165974961", "id": 775740892, "os-flavor-access:is_public": "False"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:20.760363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf7d37e-5062-4025-95de-73372f220598 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:20.761045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf7d37e-5062-4025-95de-73372f220598 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:20.761761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf7d37e-5062-4025-95de-73372f220598 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:20.767145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf7d37e-5062-4025-95de-73372f220598 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:20.768845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf7d37e-5062-4025-95de-73372f220598 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:20.769372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf7d37e-5062-4025-95de-73372f220598 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:20.796639 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca1d6be5-1db9-4936-87ae-1ce2f0cada65 tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.062458 Oct 18 13:17:20.800721 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 159/353] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:20 2022] POST /compute/v2.1/flavors => generated 427 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:20.820847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b853266d-45b5-4fad-9575-e33c80d931d8 tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:20.841707 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-cbf7d37e-5062-4025-95de-73372f220598 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] HTTP exception thrown: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cbf7d37e-5062-4025-95de-73372f220598 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Request method failure captured: Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 HTTP/1.1 Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqcPZXy_4JwNP1a1u4w-1mGU-RfKZ09fExKbZv2llD7jMdtkydI3zE7KkQPaWZzx8tz_zuaWKwU13EwWhzReuMSY2RTLCjxbXFj8_NjF2pWfgKKy4X6hwPmx54ZZM49H9bNMKaBvmbIiEr5zW78O011N3zOpkdzrPgyoU1YX8nwRdY0 Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 8e57e4407cc94732a5144972bf546dd2 Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:17:20.845713 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:17:20.847367 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8e57e4407cc94732a5144972bf546dd2"}]}] Oct 18 13:17:20.847367 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:20.847367 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 8e57e4407cc94732a5144972bf546dd2 Oct 18 13:17:20.847367 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:20.847367 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-DeleteServersAdminTestJSON-819045708-project Oct 18 13:17:20.847367 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:17:20.847367 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:17:20.847367 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 6c06e155847a4386881f49f26c02dcec Oct 18 13:17:20.847367 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-DeleteServersAdminTestJSON-819045708-project Oct 18 13:17:20.847367 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:17:20.847367 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.847367 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '2a582e4e-0006-4c9a-9ba8-ed39705417e6'} Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:20.848260 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. Oct 18 13:17:20.849613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.850566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cbf7d37e-5062-4025-95de-73372f220598 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Returning 404 to user: Instance 2a582e4e-0006-4c9a-9ba8-ed39705417e6 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:20.850566 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cbf7d37e-5062-4025-95de-73372f220598 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6" status: 404 len: 111 microversion: 2.1 time: 0.127956 Oct 18 13:17:20.866726 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b853266d-45b5-4fad-9575-e33c80d931d8 tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/775740892/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.050146 Oct 18 13:17:20.867894 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 160/354] 10.222.0.40 () {58 vars in 1206 bytes} [Tue Oct 18 13:17:20 2022] GET /compute/v2.1/flavors/775740892/os-flavor-access => generated 21 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:17:20.868521 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 195/355] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:20 2022] GET /compute/v2.1/servers/2a582e4e-0006-4c9a-9ba8-ed39705417e6 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:17:20.879624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7b36a909-7b9b-4fe9-9827-7275a106d4a7 tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:20.884187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bb7b2adb-6670-4b80-a19a-85670aab809c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:20.885606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bb7b2adb-6670-4b80-a19a-85670aab809c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:20.901260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb7b2adb-6670-4b80-a19a-85670aab809c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:20.913969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb7b2adb-6670-4b80-a19a-85670aab809c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:20.914451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb7b2adb-6670-4b80-a19a-85670aab809c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:20.915244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb7b2adb-6670-4b80-a19a-85670aab809c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:20.915723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb7b2adb-6670-4b80-a19a-85670aab809c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:20.917276 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7b36a909-7b9b-4fe9-9827-7275a106d4a7 tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/775740892" status: 202 len: 0 microversion: 2.1 time: 0.042322 Oct 18 13:17:20.924842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb7b2adb-6670-4b80-a19a-85670aab809c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:20.928329 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 196/356] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:17:20 2022] DELETE /compute/v2.1/flavors/775740892 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:17:20.935604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b64bb374-1f40-4949-8cfb-d5fbe23cd2f0 tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:20.967838 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-bb7b2adb-6670-4b80-a19a-85670aab809c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] HTTP exception thrown: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bb7b2adb-6670-4b80-a19a-85670aab809c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Request method failure captured: Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 HTTP/1.1 Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcPZXy_4JwNP1a1u4w-1mGU-RfKZ09fExKbZv2llD7jMdtkydI3zE7KkQPaWZzx8tz_zuaWKwU13EwWhzReuMSY2RTLCjxbXFj8_NjF2pWfgKKy4X6hwPmx54ZZM49H9bNMKaBvmbIiEr5zW78O011N3zOpkdzrPgyoU1YX8nwRdY0 Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 8e57e4407cc94732a5144972bf546dd2 Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:17:20.969508 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:17:20.970927 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8e57e4407cc94732a5144972bf546dd2"}]}] Oct 18 13:17:20.970927 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:20.970927 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 8e57e4407cc94732a5144972bf546dd2 Oct 18 13:17:20.970927 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:20.970927 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersAdminTestJSON-819045708-project Oct 18 13:17:20.970927 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:17:20.970927 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:17:20.970927 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6c06e155847a4386881f49f26c02dcec Oct 18 13:17:20.970927 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersAdminTestJSON-819045708-project Oct 18 13:17:20.970927 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:17:20.970927 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:17:20.970927 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '0d0004e9-bd82-4cf2-b211-924251e95184'} Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:20.971701 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:17:20.972825 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:20.974034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bb7b2adb-6670-4b80-a19a-85670aab809c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Returning 404 to user: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:20.974111 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b64bb374-1f40-4949-8cfb-d5fbe23cd2f0 tempest-FlavorsAccessTestJSON-498612037 tempest-FlavorsAccessTestJSON-498612037-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040394 Oct 18 13:17:20.974193 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bb7b2adb-6670-4b80-a19a-85670aab809c tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 404 len: 111 microversion: 2.1 time: 0.101414 Oct 18 13:17:20.974193 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 161/357] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:17:20 2022] DELETE /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:17:20.974334 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 197/358] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:17:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:21.001617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-38057ead-5aa1-419e-ad5d-ddfd9f471ed2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:21.002262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-38057ead-5aa1-419e-ad5d-ddfd9f471ed2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] [instance: 0d0004e9-bd82-4cf2-b211-924251e95184] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:21.026741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38057ead-5aa1-419e-ad5d-ddfd9f471ed2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:21.044974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38057ead-5aa1-419e-ad5d-ddfd9f471ed2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:21.053680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38057ead-5aa1-419e-ad5d-ddfd9f471ed2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:21.054547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38057ead-5aa1-419e-ad5d-ddfd9f471ed2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:21.055040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38057ead-5aa1-419e-ad5d-ddfd9f471ed2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:21.055482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38057ead-5aa1-419e-ad5d-ddfd9f471ed2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:21.103096 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-38057ead-5aa1-419e-ad5d-ddfd9f471ed2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] HTTP exception thrown: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-38057ead-5aa1-419e-ad5d-ddfd9f471ed2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Request method failure captured: Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 HTTP/1.1 Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqcPZXy_4JwNP1a1u4w-1mGU-RfKZ09fExKbZv2llD7jMdtkydI3zE7KkQPaWZzx8tz_zuaWKwU13EwWhzReuMSY2RTLCjxbXFj8_NjF2pWfgKKy4X6hwPmx54ZZM49H9bNMKaBvmbIiEr5zW78O011N3zOpkdzrPgyoU1YX8nwRdY0 Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 8e57e4407cc94732a5144972bf546dd2 Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:17:21.110534 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:17:21.112089 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8e57e4407cc94732a5144972bf546dd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8e57e4407cc94732a5144972bf546dd2"}]}] Oct 18 13:17:21.112089 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:21.112089 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 8e57e4407cc94732a5144972bf546dd2 Oct 18 13:17:21.112089 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-819045708 Oct 18 13:17:21.112089 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersAdminTestJSON-819045708-project Oct 18 13:17:21.112089 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:17:21.112089 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:17:21.112089 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6c06e155847a4386881f49f26c02dcec Oct 18 13:17:21.112089 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersAdminTestJSON-819045708-project Oct 18 13:17:21.112089 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:17:21.112089 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:17:21.112089 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '0d0004e9-bd82-4cf2-b211-924251e95184'} Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:21.112848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. Oct 18 13:17:21.114200 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:21.121289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-38057ead-5aa1-419e-ad5d-ddfd9f471ed2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] Returning 404 to user: Instance 0d0004e9-bd82-4cf2-b211-924251e95184 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:21.122175 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-38057ead-5aa1-419e-ad5d-ddfd9f471ed2 tempest-DeleteServersAdminTestJSON-819045708 tempest-DeleteServersAdminTestJSON-819045708-project] 10.222.0.40 "GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184" status: 404 len: 111 microversion: 2.1 time: 0.133762 Oct 18 13:17:21.126443 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 162/359] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:20 2022] GET /compute/v2.1/servers/0d0004e9-bd82-4cf2-b211-924251e95184 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:17:21.247852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-59e4a2d7-21ff-4a0c-8204-6546064a95d6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:21.248466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-59e4a2d7-21ff-4a0c-8204-6546064a95d6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:21.263219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59e4a2d7-21ff-4a0c-8204-6546064a95d6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:21.263753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59e4a2d7-21ff-4a0c-8204-6546064a95d6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:21.264271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59e4a2d7-21ff-4a0c-8204-6546064a95d6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:21.265005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59e4a2d7-21ff-4a0c-8204-6546064a95d6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:21.284519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59e4a2d7-21ff-4a0c-8204-6546064a95d6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:21.285860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59e4a2d7-21ff-4a0c-8204-6546064a95d6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:21.392204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4a2a06a5-1d9b-4d78-85fd-0060ac689f43 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:21.393693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4a2a06a5-1d9b-4d78-85fd-0060ac689f43 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:21.420161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a2a06a5-1d9b-4d78-85fd-0060ac689f43 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:21.420718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a2a06a5-1d9b-4d78-85fd-0060ac689f43 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:21.421172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a2a06a5-1d9b-4d78-85fd-0060ac689f43 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:21.435426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a2a06a5-1d9b-4d78-85fd-0060ac689f43 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:21.436314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a2a06a5-1d9b-4d78-85fd-0060ac689f43 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:21.441110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a2a06a5-1d9b-4d78-85fd-0060ac689f43 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:22.053842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4a2a06a5-1d9b-4d78-85fd-0060ac689f43 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:22.061283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:22.069835 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4a2a06a5-1d9b-4d78-85fd-0060ac689f43 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1318 microversion: 2.1 time: 0.682544 Oct 18 13:17:22.070758 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 163/360] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:21 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:22.077436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cf280d9b-6267-4e01-8ea0-987a885d24e2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:22.078053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cf280d9b-6267-4e01-8ea0-987a885d24e2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:22.109796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf280d9b-6267-4e01-8ea0-987a885d24e2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:22.110317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf280d9b-6267-4e01-8ea0-987a885d24e2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:22.110783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf280d9b-6267-4e01-8ea0-987a885d24e2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:22.111501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf280d9b-6267-4e01-8ea0-987a885d24e2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:22.111958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf280d9b-6267-4e01-8ea0-987a885d24e2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:22.112386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf280d9b-6267-4e01-8ea0-987a885d24e2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:22.259068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cf280d9b-6267-4e01-8ea0-987a885d24e2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:22.267477 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cf280d9b-6267-4e01-8ea0-987a885d24e2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1276 microversion: 2.1 time: 0.195649 Oct 18 13:17:22.268081 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 164/361] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:22 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1276 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:22.310243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-59e4a2d7-21ff-4a0c-8204-6546064a95d6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:22.331993 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-59e4a2d7-21ff-4a0c-8204-6546064a95d6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1313 microversion: 2.1 time: 1.089920 Oct 18 13:17:22.336748 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 198/362] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:21 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1313 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:23.109536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f91e575-0c78-4854-8bb7-f00673325aaf tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:23.110275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9f91e575-0c78-4854-8bb7-f00673325aaf tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:23.123280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f91e575-0c78-4854-8bb7-f00673325aaf tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:23.123774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f91e575-0c78-4854-8bb7-f00673325aaf tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:23.124214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f91e575-0c78-4854-8bb7-f00673325aaf tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:23.124919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f91e575-0c78-4854-8bb7-f00673325aaf tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:23.130887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f91e575-0c78-4854-8bb7-f00673325aaf tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:23.131426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f91e575-0c78-4854-8bb7-f00673325aaf tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:23.294996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0dc2dbe8-8597-418a-aac8-20109379d424 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:23.295602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0dc2dbe8-8597-418a-aac8-20109379d424 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:23.304893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0dc2dbe8-8597-418a-aac8-20109379d424 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:23.309717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0dc2dbe8-8597-418a-aac8-20109379d424 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:23.315687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0dc2dbe8-8597-418a-aac8-20109379d424 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:23.319325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0dc2dbe8-8597-418a-aac8-20109379d424 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:23.319999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0dc2dbe8-8597-418a-aac8-20109379d424 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:23.320594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0dc2dbe8-8597-418a-aac8-20109379d424 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:23.563682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0dc2dbe8-8597-418a-aac8-20109379d424 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:23.581644 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0dc2dbe8-8597-418a-aac8-20109379d424 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1282 microversion: 2.1 time: 0.287026 Oct 18 13:17:23.582534 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 199/363] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:23 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1282 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:17:23.606039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9178b80c-947f-4101-b648-49790252d5fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:23.607308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9178b80c-947f-4101-b648-49790252d5fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:23.614341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9178b80c-947f-4101-b648-49790252d5fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:23.615147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9178b80c-947f-4101-b648-49790252d5fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:23.615792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9178b80c-947f-4101-b648-49790252d5fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:23.616699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9178b80c-947f-4101-b648-49790252d5fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:23.617387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9178b80c-947f-4101-b648-49790252d5fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:23.618021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9178b80c-947f-4101-b648-49790252d5fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:23.700475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9f91e575-0c78-4854-8bb7-f00673325aaf tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:23.714106 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9f91e575-0c78-4854-8bb7-f00673325aaf tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1318 microversion: 2.1 time: 0.605478 Oct 18 13:17:23.715110 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 165/364] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:23 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:24.343950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9178b80c-947f-4101-b648-49790252d5fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:24.366579 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9178b80c-947f-4101-b648-49790252d5fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1313 microversion: 2.1 time: 0.771738 Oct 18 13:17:24.371188 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 200/365] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:23 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1313 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:24.607430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-216ec9f4-6338-45da-b17e-15562b69a44a tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:24.608356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-216ec9f4-6338-45da-b17e-15562b69a44a tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:24.621971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-216ec9f4-6338-45da-b17e-15562b69a44a tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:24.625035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-216ec9f4-6338-45da-b17e-15562b69a44a tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:24.625683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-216ec9f4-6338-45da-b17e-15562b69a44a tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:24.628431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-216ec9f4-6338-45da-b17e-15562b69a44a tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:24.629105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-216ec9f4-6338-45da-b17e-15562b69a44a tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:24.630484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-216ec9f4-6338-45da-b17e-15562b69a44a tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:24.707452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ef91dd0b-fd02-4f6b-b33a-e1b509c06fe9 req-b5c99f46-8dc8-4869-a520-26d4aee20e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f199ac-a7c9-4a5c-929a-f734ea6c3d80", "tag": "0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:24.735594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ef91dd0b-fd02-4f6b-b33a-e1b509c06fe9 req-b5c99f46-8dc8-4869-a520-26d4aee20e1c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:24.736077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ef91dd0b-fd02-4f6b-b33a-e1b509c06fe9 req-b5c99f46-8dc8-4869-a520-26d4aee20e1c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:24.736518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ef91dd0b-fd02-4f6b-b33a-e1b509c06fe9 req-b5c99f46-8dc8-4869-a520-26d4aee20e1c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:24.766093 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ef91dd0b-fd02-4f6b-b33a-e1b509c06fe9 req-b5c99f46-8dc8-4869-a520-26d4aee20e1c service nova] Creating event network-changed:0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1 for instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 on n-h1-858384-13 Oct 18 13:17:24.775481 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ef91dd0b-fd02-4f6b-b33a-e1b509c06fe9 req-b5c99f46-8dc8-4869-a520-26d4aee20e1c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071050 Oct 18 13:17:24.781388 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 201/366] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:17:24.788188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-216ec9f4-6338-45da-b17e-15562b69a44a tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:24.788947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c53dad98-2d57-48fe-a5cd-4896029f376a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:24.789680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c53dad98-2d57-48fe-a5cd-4896029f376a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:24.802917 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-216ec9f4-6338-45da-b17e-15562b69a44a tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1282 microversion: 2.1 time: 0.200616 Oct 18 13:17:24.811776 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 166/367] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:24 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1282 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:24.817003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c53dad98-2d57-48fe-a5cd-4896029f376a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:24.823611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c53dad98-2d57-48fe-a5cd-4896029f376a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:24.824363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c53dad98-2d57-48fe-a5cd-4896029f376a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:24.825457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c53dad98-2d57-48fe-a5cd-4896029f376a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:24.826304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c53dad98-2d57-48fe-a5cd-4896029f376a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:24.827005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c53dad98-2d57-48fe-a5cd-4896029f376a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:25.385984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:25.397597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d532add6-5ae4-41d7-bc96-03dd9fc8be6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:25.398190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d532add6-5ae4-41d7-bc96-03dd9fc8be6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:25.401448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:25.416111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d532add6-5ae4-41d7-bc96-03dd9fc8be6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:25.416708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d532add6-5ae4-41d7-bc96-03dd9fc8be6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:25.417147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d532add6-5ae4-41d7-bc96-03dd9fc8be6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:25.417890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d532add6-5ae4-41d7-bc96-03dd9fc8be6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:25.418346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d532add6-5ae4-41d7-bc96-03dd9fc8be6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:25.418771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d532add6-5ae4-41d7-bc96-03dd9fc8be6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:25.520290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c53dad98-2d57-48fe-a5cd-4896029f376a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:25.533582 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c53dad98-2d57-48fe-a5cd-4896029f376a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1318 microversion: 2.1 time: 0.750785 Oct 18 13:17:25.539057 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 202/368] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:24 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1318 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:25.555261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-cb8634ca-12c4-48ce-bbab-c4f03d30c886 req-af4f4f16-8196-453d-94ec-86c3349a5204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a9f1e5-27ea-466b-84c6-3591332a665b", "tag": "5bba853c-25d6-493e-b05a-9024b8d87698"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:25.584197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cb8634ca-12c4-48ce-bbab-c4f03d30c886 req-af4f4f16-8196-453d-94ec-86c3349a5204 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:25.586219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cb8634ca-12c4-48ce-bbab-c4f03d30c886 req-af4f4f16-8196-453d-94ec-86c3349a5204 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:25.586809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cb8634ca-12c4-48ce-bbab-c4f03d30c886 req-af4f4f16-8196-453d-94ec-86c3349a5204 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:25.614398 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-cb8634ca-12c4-48ce-bbab-c4f03d30c886 req-af4f4f16-8196-453d-94ec-86c3349a5204 service nova] Creating event network-changed:5bba853c-25d6-493e-b05a-9024b8d87698 for instance 32a9f1e5-27ea-466b-84c6-3591332a665b on n-h2-858384-13 Oct 18 13:17:25.623605 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-cb8634ca-12c4-48ce-bbab-c4f03d30c886 req-af4f4f16-8196-453d-94ec-86c3349a5204 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082398 Oct 18 13:17:25.625224 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 203/369] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:25.838927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-94f2b1d9-a438-4f29-8d25-cb780788aa9a tempest-QuotaClassesAdminTestJSON-1638390030 tempest-QuotaClassesAdminTestJSON-1638390030-project-admin] Calling method '.version_select at 0x7ff6144610d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:25.856656 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-94f2b1d9-a438-4f29-8d25-cb780788aa9a tempest-QuotaClassesAdminTestJSON-1638390030 tempest-QuotaClassesAdminTestJSON-1638390030-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.229461 Oct 18 13:17:25.857271 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 204/370] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 18 13:17:25 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:25.869448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c89beb8b-ccd6-4372-9ce7-ff4cf5a71692 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:25.871690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c89beb8b-ccd6-4372-9ce7-ff4cf5a71692 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:25.881757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c89beb8b-ccd6-4372-9ce7-ff4cf5a71692 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:25.882849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c89beb8b-ccd6-4372-9ce7-ff4cf5a71692 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:25.883451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c89beb8b-ccd6-4372-9ce7-ff4cf5a71692 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:25.885002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c89beb8b-ccd6-4372-9ce7-ff4cf5a71692 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:25.885639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c89beb8b-ccd6-4372-9ce7-ff4cf5a71692 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:25.886396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c89beb8b-ccd6-4372-9ce7-ff4cf5a71692 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:25.891726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:26.158203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d532add6-5ae4-41d7-bc96-03dd9fc8be6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:26.188199 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d532add6-5ae4-41d7-bc96-03dd9fc8be6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1313 microversion: 2.1 time: 0.789553 Oct 18 13:17:26.210232 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 167/371] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:25 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1313 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:17:26.225097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-299ffe00-a855-4a98-a8d8-a73ca29b0ee5 tempest-QuotaClassesAdminTestJSON-1638390030 tempest-QuotaClassesAdminTestJSON-1638390030-project-admin] Action: 'update', calling method: .version_select at 0x7ff614139430>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:26.855512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c89beb8b-ccd6-4372-9ce7-ff4cf5a71692 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:26.869690 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c89beb8b-ccd6-4372-9ce7-ff4cf5a71692 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1324 microversion: 2.1 time: 1.008474 Oct 18 13:17:26.870672 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 205/372] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:25 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1324 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:26.895563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3876bdf8-149b-4413-91b3-eabf04b3c855 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:26.896601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3876bdf8-149b-4413-91b3-eabf04b3c855 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:26.907515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3876bdf8-149b-4413-91b3-eabf04b3c855 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:26.908306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3876bdf8-149b-4413-91b3-eabf04b3c855 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:26.909088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3876bdf8-149b-4413-91b3-eabf04b3c855 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:26.910957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3876bdf8-149b-4413-91b3-eabf04b3c855 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:26.912322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3876bdf8-149b-4413-91b3-eabf04b3c855 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:26.912936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3876bdf8-149b-4413-91b3-eabf04b3c855 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:26.944141 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-299ffe00-a855-4a98-a8d8-a73ca29b0ee5 tempest-QuotaClassesAdminTestJSON-1638390030 tempest-QuotaClassesAdminTestJSON-1638390030-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.726921 Oct 18 13:17:26.944753 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 168/373] 10.222.0.40 () {60 vars in 1206 bytes} [Tue Oct 18 13:17:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:26.965918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c644532-183c-49a1-939f-3a17173d20e4 tempest-QuotaClassesAdminTestJSON-1638390030 tempest-QuotaClassesAdminTestJSON-1638390030-project-admin] Calling method '.version_select at 0x7ff614039ee0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:26.998851 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2c644532-183c-49a1-939f-3a17173d20e4 tempest-QuotaClassesAdminTestJSON-1638390030 tempest-QuotaClassesAdminTestJSON-1638390030-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.044509 Oct 18 13:17:27.002997 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 169/374] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 18 13:17:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:27.015759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3806da9c-0a75-48bc-8d86-6c1ce2e608f8 tempest-QuotaClassesAdminTestJSON-1638390030 tempest-QuotaClassesAdminTestJSON-1638390030-project-admin] Action: 'update', calling method: .version_select at 0x7ff614139a60>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:27.198198 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3806da9c-0a75-48bc-8d86-6c1ce2e608f8 tempest-QuotaClassesAdminTestJSON-1638390030 tempest-QuotaClassesAdminTestJSON-1638390030-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.186106 Oct 18 13:17:27.198952 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 170/375] 10.222.0.40 () {60 vars in 1206 bytes} [Tue Oct 18 13:17:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:27.219334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-646a380b-9e26-417b-8709-c1d259d3d201 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:27.220008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-646a380b-9e26-417b-8709-c1d259d3d201 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:27.234946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-646a380b-9e26-417b-8709-c1d259d3d201 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:27.235449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-646a380b-9e26-417b-8709-c1d259d3d201 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:27.237528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-646a380b-9e26-417b-8709-c1d259d3d201 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:27.239706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-646a380b-9e26-417b-8709-c1d259d3d201 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:27.241881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-646a380b-9e26-417b-8709-c1d259d3d201 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:27.242748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-646a380b-9e26-417b-8709-c1d259d3d201 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:27.548703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-646a380b-9e26-417b-8709-c1d259d3d201 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:27.558277 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-646a380b-9e26-417b-8709-c1d259d3d201 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1313 microversion: 2.1 time: 0.344211 Oct 18 13:17:27.565290 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 171/376] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:27 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:27.688965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3876bdf8-149b-4413-91b3-eabf04b3c855 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:27.709117 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3876bdf8-149b-4413-91b3-eabf04b3c855 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1318 microversion: 2.1 time: 0.814479 Oct 18 13:17:27.709842 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 206/377] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:26 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1318 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:27.898617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0afb6e0d-9cdc-43b1-a0e2-8082a445d3f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:27.899347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0afb6e0d-9cdc-43b1-a0e2-8082a445d3f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:27.910293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0afb6e0d-9cdc-43b1-a0e2-8082a445d3f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:27.917848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0afb6e0d-9cdc-43b1-a0e2-8082a445d3f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:27.918464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0afb6e0d-9cdc-43b1-a0e2-8082a445d3f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:27.921953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0afb6e0d-9cdc-43b1-a0e2-8082a445d3f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:27.923969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0afb6e0d-9cdc-43b1-a0e2-8082a445d3f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:27.924614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0afb6e0d-9cdc-43b1-a0e2-8082a445d3f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:28.508046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0afb6e0d-9cdc-43b1-a0e2-8082a445d3f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:28.524213 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0afb6e0d-9cdc-43b1-a0e2-8082a445d3f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1324 microversion: 2.1 time: 0.629759 Oct 18 13:17:28.526815 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 172/378] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:27 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1324 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:28.588476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-63667b69-27e2-427e-9756-0e25574a499a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:28.590202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-63667b69-27e2-427e-9756-0e25574a499a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:28.601071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63667b69-27e2-427e-9756-0e25574a499a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:28.605326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63667b69-27e2-427e-9756-0e25574a499a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:28.606069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63667b69-27e2-427e-9756-0e25574a499a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:28.609285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63667b69-27e2-427e-9756-0e25574a499a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:28.609995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63667b69-27e2-427e-9756-0e25574a499a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:28.611252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63667b69-27e2-427e-9756-0e25574a499a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:28.743129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8e039b6b-b424-4397-82b4-617b1e3caf18 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:28.744881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8e039b6b-b424-4397-82b4-617b1e3caf18 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:28.768352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e039b6b-b424-4397-82b4-617b1e3caf18 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:28.771851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e039b6b-b424-4397-82b4-617b1e3caf18 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:28.774509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e039b6b-b424-4397-82b4-617b1e3caf18 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:28.778189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e039b6b-b424-4397-82b4-617b1e3caf18 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:28.780031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e039b6b-b424-4397-82b4-617b1e3caf18 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:28.783463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e039b6b-b424-4397-82b4-617b1e3caf18 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:29.364613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-63667b69-27e2-427e-9756-0e25574a499a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:29.378570 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-63667b69-27e2-427e-9756-0e25574a499a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1313 microversion: 2.1 time: 0.794653 Oct 18 13:17:29.380339 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 207/379] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:28 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1313 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:29.512115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8e039b6b-b424-4397-82b4-617b1e3caf18 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:29.522696 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8e039b6b-b424-4397-82b4-617b1e3caf18 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1318 microversion: 2.1 time: 0.789457 Oct 18 13:17:29.536421 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 173/380] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:28 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1318 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:17:29.554384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-abcb5929-6380-4ed4-a6e3-bfc43c363c2d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:29.555262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-abcb5929-6380-4ed4-a6e3-bfc43c363c2d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:29.564079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abcb5929-6380-4ed4-a6e3-bfc43c363c2d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:29.564779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abcb5929-6380-4ed4-a6e3-bfc43c363c2d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:29.565398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abcb5929-6380-4ed4-a6e3-bfc43c363c2d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:29.566467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abcb5929-6380-4ed4-a6e3-bfc43c363c2d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:29.567319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abcb5929-6380-4ed4-a6e3-bfc43c363c2d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:29.567896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abcb5929-6380-4ed4-a6e3-bfc43c363c2d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:30.360581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:30.574918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-abcb5929-6380-4ed4-a6e3-bfc43c363c2d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:30.591126 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-abcb5929-6380-4ed4-a6e3-bfc43c363c2d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1324 microversion: 2.1 time: 1.040451 Oct 18 13:17:30.612802 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 208/381] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:29 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1324 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:30.620912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-14d7c745-ded0-4626-91c7-5d8bc35b020f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:30.621941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-14d7c745-ded0-4626-91c7-5d8bc35b020f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:30.632328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:30.647576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14d7c745-ded0-4626-91c7-5d8bc35b020f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:30.648160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14d7c745-ded0-4626-91c7-5d8bc35b020f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:30.648633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14d7c745-ded0-4626-91c7-5d8bc35b020f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:30.649575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14d7c745-ded0-4626-91c7-5d8bc35b020f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:30.650813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14d7c745-ded0-4626-91c7-5d8bc35b020f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:30.651545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14d7c745-ded0-4626-91c7-5d8bc35b020f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:30.941986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-698229308", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "4367ae6a-74b6-4e77-aafe-63e7fdd7f6d6"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:31.113232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] validate_networks() for [('4367ae6a-74b6-4e77-aafe-63e7fdd7f6d6', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:17:31.693273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-14d7c745-ded0-4626-91c7-5d8bc35b020f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:31.706118 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-14d7c745-ded0-4626-91c7-5d8bc35b020f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1313 microversion: 2.1 time: 1.091712 Oct 18 13:17:31.707261 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 209/382] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:30 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1313 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:31.712147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7ef262d5-7036-4b44-8dfe-f5cadf6e245e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:31.717713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7ef262d5-7036-4b44-8dfe-f5cadf6e245e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:31.736006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ef262d5-7036-4b44-8dfe-f5cadf6e245e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:31.739345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ef262d5-7036-4b44-8dfe-f5cadf6e245e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:31.739941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ef262d5-7036-4b44-8dfe-f5cadf6e245e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:31.743874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ef262d5-7036-4b44-8dfe-f5cadf6e245e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:31.744900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ef262d5-7036-4b44-8dfe-f5cadf6e245e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:31.745515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ef262d5-7036-4b44-8dfe-f5cadf6e245e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:32.130181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:17:32.132580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:17:32.134023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:17:32.142638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:17:32.142638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:17:32.144322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=24,nova_api:INSERT=12 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:32.162343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:32.162835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:32.163337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:32.164163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:32.164884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:32.165964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:32.216006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Getting quotas for project e559a35e21d343adab5f772a17b745f9. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:17:32.223170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Getting quotas for user 1bfaa3d005f94cf2a5bdf8e63d20ba3f and project e559a35e21d343adab5f772a17b745f9. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:17:32.251825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:17:32.262857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:17:32.350755 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c1f176ed-378c-41e0-9a7e-0421d79b12e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.990736 Oct 18 13:17:32.351674 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 174/383] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:17:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1992 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:17:32.357569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b92472db-b573-4e2c-9541-7f78f70b11c4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:32.358502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b92472db-b573-4e2c-9541-7f78f70b11c4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:32.365153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b92472db-b573-4e2c-9541-7f78f70b11c4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:32.365687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b92472db-b573-4e2c-9541-7f78f70b11c4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:32.366119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b92472db-b573-4e2c-9541-7f78f70b11c4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:32.366819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b92472db-b573-4e2c-9541-7f78f70b11c4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:32.367270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b92472db-b573-4e2c-9541-7f78f70b11c4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:32.367690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b92472db-b573-4e2c-9541-7f78f70b11c4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:32.472678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ef262d5-7036-4b44-8dfe-f5cadf6e245e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:32.490013 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7ef262d5-7036-4b44-8dfe-f5cadf6e245e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1318 microversion: 2.1 time: 0.781433 Oct 18 13:17:32.490606 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 210/384] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:31 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1318 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:32.676240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b92472db-b573-4e2c-9541-7f78f70b11c4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:32.713942 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b92472db-b573-4e2c-9541-7f78f70b11c4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1324 microversion: 2.1 time: 0.346060 Oct 18 13:17:32.716995 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 175/385] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:32 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1324 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:32.734185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7dd66df1-f45c-41da-bd60-039e53365313 req-bbc418bc-e871-4bf4-a105-c51227200dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97ccda6-c665-4a4f-b099-72b142b143b7", "tag": "7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:32.766686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7dd66df1-f45c-41da-bd60-039e53365313 req-bbc418bc-e871-4bf4-a105-c51227200dd3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:32.767576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7dd66df1-f45c-41da-bd60-039e53365313 req-bbc418bc-e871-4bf4-a105-c51227200dd3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:32.768798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7dd66df1-f45c-41da-bd60-039e53365313 req-bbc418bc-e871-4bf4-a105-c51227200dd3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:32.803904 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7dd66df1-f45c-41da-bd60-039e53365313 req-bbc418bc-e871-4bf4-a105-c51227200dd3 service nova] Creating event network-changed:7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5 for instance f97ccda6-c665-4a4f-b099-72b142b143b7 on n-h1-858384-13 Oct 18 13:17:32.825825 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7dd66df1-f45c-41da-bd60-039e53365313 req-bbc418bc-e871-4bf4-a105-c51227200dd3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107233 Oct 18 13:17:32.839381 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 176/386] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:32.940264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c6a34d88-b302-4013-adc8-abe3ba940b90 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Calling method '.version_select at 0x7ff6143433a0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:32.944092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6a34d88-b302-4013-adc8-abe3ba940b90 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:32.945639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6a34d88-b302-4013-adc8-abe3ba940b90 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:32.954994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6a34d88-b302-4013-adc8-abe3ba940b90 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:32.956795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6a34d88-b302-4013-adc8-abe3ba940b90 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:32.960446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6a34d88-b302-4013-adc8-abe3ba940b90 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:32.961249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6a34d88-b302-4013-adc8-abe3ba940b90 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:33.051204 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c6a34d88-b302-4013-adc8-abe3ba940b90 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.559271 Oct 18 13:17:33.053028 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 211/387] 10.222.0.40 () {58 vars in 1128 bytes} [Tue Oct 18 13:17:32 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:33.070766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-165905df-780f-49a8-a5eb-2516b2f00000 req-c61cc646-6ce3-4a89-a276-6432dcc9333c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a9f1e5-27ea-466b-84c6-3591332a665b", "name": "network-vif-plugged", "status": "completed", "tag": "5bba853c-25d6-493e-b05a-9024b8d87698"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:33.122901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-165905df-780f-49a8-a5eb-2516b2f00000 req-c61cc646-6ce3-4a89-a276-6432dcc9333c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:33.123560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-165905df-780f-49a8-a5eb-2516b2f00000 req-c61cc646-6ce3-4a89-a276-6432dcc9333c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:33.124151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-165905df-780f-49a8-a5eb-2516b2f00000 req-c61cc646-6ce3-4a89-a276-6432dcc9333c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:33.162684 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-165905df-780f-49a8-a5eb-2516b2f00000 req-c61cc646-6ce3-4a89-a276-6432dcc9333c service nova] Creating event network-vif-plugged:5bba853c-25d6-493e-b05a-9024b8d87698 for instance 32a9f1e5-27ea-466b-84c6-3591332a665b on n-h2-858384-13 Oct 18 13:17:33.178549 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-165905df-780f-49a8-a5eb-2516b2f00000 req-c61cc646-6ce3-4a89-a276-6432dcc9333c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119444 Oct 18 13:17:33.187886 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 212/388] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:33.203071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f2c6bfba-0e6e-42fd-9b66-b6a67bcefcc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:33.203772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f2c6bfba-0e6e-42fd-9b66-b6a67bcefcc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:33.422446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f8f56253-90cf-4a19-ae5b-332d2471d11c tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1445240037", "id": 1631021150, "os-flavor-access:is_public": "False"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:33.471518 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f8f56253-90cf-4a19-ae5b-332d2471d11c tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.630661 Oct 18 13:17:33.472128 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 177/389] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:32 2022] POST /compute/v2.1/flavors => generated 439 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:33.489331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0220983d-ba06-4561-836e-290b523a72e8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:33.501421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0220983d-ba06-4561-836e-290b523a72e8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:33.518506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0220983d-ba06-4561-836e-290b523a72e8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:33.519002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0220983d-ba06-4561-836e-290b523a72e8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:33.519444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0220983d-ba06-4561-836e-290b523a72e8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:33.527196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0220983d-ba06-4561-836e-290b523a72e8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:33.527774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0220983d-ba06-4561-836e-290b523a72e8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:33.528223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0220983d-ba06-4561-836e-290b523a72e8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:33.636754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f2c6bfba-0e6e-42fd-9b66-b6a67bcefcc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:33.651158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f2c6bfba-0e6e-42fd-9b66-b6a67bcefcc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:33.659676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f2c6bfba-0e6e-42fd-9b66-b6a67bcefcc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:33.660074 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f2c6bfba-0e6e-42fd-9b66-b6a67bcefcc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1261 microversion: 2.25 time: 0.470708 Oct 18 13:17:33.679374 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 213/390] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:17:33 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1261 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:17:33.693705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3fd7ee92-78c2-49bb-8c38-2f69cad88acd tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Calling method '.version_select at 0x7ff614258ee0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:33.701303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fd7ee92-78c2-49bb-8c38-2f69cad88acd tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:33.701797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fd7ee92-78c2-49bb-8c38-2f69cad88acd tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:33.711741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fd7ee92-78c2-49bb-8c38-2f69cad88acd tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:33.716438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fd7ee92-78c2-49bb-8c38-2f69cad88acd tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:33.718698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fd7ee92-78c2-49bb-8c38-2f69cad88acd tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:33.719191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fd7ee92-78c2-49bb-8c38-2f69cad88acd tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:33.794426 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3fd7ee92-78c2-49bb-8c38-2f69cad88acd tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.118775 Oct 18 13:17:33.796169 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 214/391] 10.222.0.40 () {58 vars in 1139 bytes} [Tue Oct 18 13:17:33 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:33.803519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-39100971-c242-48e7-81a1-b353d56f4f32 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2fb996dd88384aba9257c888c3946fac"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:33.944023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0220983d-ba06-4561-836e-290b523a72e8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:33.956251 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0220983d-ba06-4561-836e-290b523a72e8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1313 microversion: 2.1 time: 0.482306 Oct 18 13:17:33.957884 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 178/392] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:33 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:33.964841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a23773a8-5516-4345-902b-5458fc1c84b7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:33.966652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a23773a8-5516-4345-902b-5458fc1c84b7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:33.981984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a23773a8-5516-4345-902b-5458fc1c84b7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:33.984090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a23773a8-5516-4345-902b-5458fc1c84b7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:33.986273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a23773a8-5516-4345-902b-5458fc1c84b7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:33.998139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a23773a8-5516-4345-902b-5458fc1c84b7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:34.000257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a23773a8-5516-4345-902b-5458fc1c84b7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:34.002110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a23773a8-5516-4345-902b-5458fc1c84b7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:34.382173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a23773a8-5516-4345-902b-5458fc1c84b7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:34.394926 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a23773a8-5516-4345-902b-5458fc1c84b7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1318 microversion: 2.1 time: 0.435138 Oct 18 13:17:34.395511 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 179/393] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:33 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:34.413481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d03e7cc4-c384-4903-bd55-b63ffe76a357 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:34.414383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d03e7cc4-c384-4903-bd55-b63ffe76a357 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:34.425362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03e7cc4-c384-4903-bd55-b63ffe76a357 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:34.426137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03e7cc4-c384-4903-bd55-b63ffe76a357 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:34.426552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03e7cc4-c384-4903-bd55-b63ffe76a357 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:34.427436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03e7cc4-c384-4903-bd55-b63ffe76a357 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:34.428135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03e7cc4-c384-4903-bd55-b63ffe76a357 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:34.429954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03e7cc4-c384-4903-bd55-b63ffe76a357 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:34.500511 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-39100971-c242-48e7-81a1-b353d56f4f32 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1631021150/action" status: 200 len: 97 microversion: 2.1 time: 0.703070 Oct 18 13:17:34.502099 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 215/394] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 18 13:17:33 2022] POST /compute/v2.1/flavors/1631021150/action => generated 97 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:17:34.516399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31dbea3f-443c-470e-ab44-0b969b46aa65 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Calling method '.version_select at 0x7ff614343430>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:34.525477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31dbea3f-443c-470e-ab44-0b969b46aa65 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:34.526809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31dbea3f-443c-470e-ab44-0b969b46aa65 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:34.527474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31dbea3f-443c-470e-ab44-0b969b46aa65 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:34.529070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31dbea3f-443c-470e-ab44-0b969b46aa65 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:34.529973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31dbea3f-443c-470e-ab44-0b969b46aa65 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:34.530818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31dbea3f-443c-470e-ab44-0b969b46aa65 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:34.568335 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31dbea3f-443c-470e-ab44-0b969b46aa65 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.064801 Oct 18 13:17:34.574049 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 216/395] 10.222.0.40 () {58 vars in 1145 bytes} [Tue Oct 18 13:17:34 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:17:34.579132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dc4df6a2-3e81-45bb-9fd0-1de87a45a889 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2fb996dd88384aba9257c888c3946fac"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:34.703704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d03e7cc4-c384-4903-bd55-b63ffe76a357 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:34.730995 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d03e7cc4-c384-4903-bd55-b63ffe76a357 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1324 microversion: 2.1 time: 0.334366 Oct 18 13:17:34.731904 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 180/396] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:34 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:34.745039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6d9e4215-7bd6-415d-a1c8-e2247983a500 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Calling method '.version_select at 0x7ff6140699d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:34.749048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d9e4215-7bd6-415d-a1c8-e2247983a500 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:34.755991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d9e4215-7bd6-415d-a1c8-e2247983a500 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:34.756768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d9e4215-7bd6-415d-a1c8-e2247983a500 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:34.757932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d9e4215-7bd6-415d-a1c8-e2247983a500 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:34.758612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d9e4215-7bd6-415d-a1c8-e2247983a500 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:34.760752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d9e4215-7bd6-415d-a1c8-e2247983a500 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:34.845577 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6d9e4215-7bd6-415d-a1c8-e2247983a500 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.112287 Oct 18 13:17:34.855196 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 181/397] 10.222.0.40 () {58 vars in 1128 bytes} [Tue Oct 18 13:17:34 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:34.860321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1280c29-0928-4c6d-814a-fc93460bb430 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:34.867245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e1280c29-0928-4c6d-814a-fc93460bb430 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:34.885676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1280c29-0928-4c6d-814a-fc93460bb430 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:34.886516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1280c29-0928-4c6d-814a-fc93460bb430 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:34.887289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1280c29-0928-4c6d-814a-fc93460bb430 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:34.888266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1280c29-0928-4c6d-814a-fc93460bb430 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:34.888949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1280c29-0928-4c6d-814a-fc93460bb430 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:34.889648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1280c29-0928-4c6d-814a-fc93460bb430 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:35.196727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e1280c29-0928-4c6d-814a-fc93460bb430 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:35.218338 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-dc4df6a2-3e81-45bb-9fd0-1de87a45a889 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] HTTP exception thrown: Flavor access already exists for flavor 33 and project 2fb996dd88384aba9257c888c3946fac combination. Oct 18 13:17:35.221790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e1280c29-0928-4c6d-814a-fc93460bb430 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:35.223340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e1280c29-0928-4c6d-814a-fc93460bb430 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:35.230354 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e1280c29-0928-4c6d-814a-fc93460bb430 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1313 microversion: 2.25 time: 0.373311 Oct 18 13:17:35.246425 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 182/398] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:17:34 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:17:35.256375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4dacaab3-ff71-4cb6-83a0-0ea78f1c973a tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Calling method '.version_select at 0x7ff60fffb550>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:35.260844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4dacaab3-ff71-4cb6-83a0-0ea78f1c973a tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:35.261619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4dacaab3-ff71-4cb6-83a0-0ea78f1c973a tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:35.262233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4dacaab3-ff71-4cb6-83a0-0ea78f1c973a tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dc4df6a2-3e81-45bb-9fd0-1de87a45a889 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Request method failure captured: Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/flavors/1631021150/action HTTP/1.1 Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 67 Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdqEsduYaWqKllPoko2El6R_scpkY45dWWBtQFKLsrcjad-g-oxKFz_CxRJqxXQ5wHs728euWw_61wSWAAKakL7_14gwJeVjn67-ArAMp1o_LMGPZJ-GWOEx8hLxi5lRqAweA6YvQdi5jRb5JaSyyWg9XxY8Mb0WCg9W_kYdS8n_xk Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 254b1e1fcad147e5b9e5c9457c004f93 Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1535653608 Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:17:35.262638 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:17:35.264196 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/254b1e1fcad147e5b9e5c9457c004f93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/254b1e1fcad147e5b9e5c9457c004f93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/254b1e1fcad147e5b9e5c9457c004f93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_254b1e1fcad147e5b9e5c9457c004f93"}]}] Oct 18 13:17:35.264196 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1535653608 Oct 18 13:17:35.264196 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 254b1e1fcad147e5b9e5c9457c004f93 Oct 18 13:17:35.264196 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1535653608 Oct 18 13:17:35.264196 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin Oct 18 13:17:35.264196 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:17:35.264196 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:17:35.264196 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c8b51dba0ef14ed282d24f406016ecc8 Oct 18 13:17:35.264196 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin Oct 18 13:17:35.264196 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:17:35.264196 n-d-858384-13 devstack@n-api.service[120612]: {"addTenantAccess": {"tenant": "2fb996dd88384aba9257c888c3946fac"}} Oct 18 13:17:35.264196 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: exception: Flavor access already exists for flavor 33 and project 2fb996dd88384aba9257c888c3946fac combination. Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '1631021150', 'body': {'addTenantAccess': {'tenant': '2fb996dd88384aba9257c888c3946fac'}}} Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result.read() Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:17:35.265111 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '33-2fb996dd88384aba9257c888c3946fac' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi session.flush() Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:17:35.266359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 13:17:35.267927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:17:35.269967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result.read() Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '33-2fb996dd88384aba9257c888c3946fac' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 18, 13, 17, 35, 209592), 'updated_at': None, 'flavor_id': 33, 'project_id': '2fb996dd88384aba9257c888c3946fac'}] Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:35.271922 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 33 and project 2fb996dd88384aba9257c888c3946fac combination. Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:35.279389 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 33 and project 2fb996dd88384aba9257c888c3946fac combination. Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:17:35.281613 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:17:35.283829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 33 and project 2fb996dd88384aba9257c888c3946fac combination. Oct 18 13:17:35.283829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:35.283829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dc4df6a2-3e81-45bb-9fd0-1de87a45a889 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Returning 409 to user: Flavor access already exists for flavor 33 and project 2fb996dd88384aba9257c888c3946fac combination. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:35.283829 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dc4df6a2-3e81-45bb-9fd0-1de87a45a889 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1631021150/action" status: 409 len: 152 microversion: 2.1 time: 0.688829 Oct 18 13:17:35.283829 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 217/399] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 18 13:17:34 2022] POST /compute/v2.1/flavors/1631021150/action => generated 152 bytes in 698 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:17:35.284441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4dacaab3-ff71-4cb6-83a0-0ea78f1c973a tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:35.284441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4dacaab3-ff71-4cb6-83a0-0ea78f1c973a tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:35.284441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4dacaab3-ff71-4cb6-83a0-0ea78f1c973a tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:35.320540 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4dacaab3-ff71-4cb6-83a0-0ea78f1c973a tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.072744 Oct 18 13:17:35.322030 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 183/400] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:17:35 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:35.327917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba317787-cedd-48e4-a8a5-7a35d3bf7662 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:35.328934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ba317787-cedd-48e4-a8a5-7a35d3bf7662 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:35.336401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba317787-cedd-48e4-a8a5-7a35d3bf7662 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:35.338097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba317787-cedd-48e4-a8a5-7a35d3bf7662 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:35.338973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba317787-cedd-48e4-a8a5-7a35d3bf7662 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:35.339948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba317787-cedd-48e4-a8a5-7a35d3bf7662 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:35.340602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba317787-cedd-48e4-a8a5-7a35d3bf7662 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:35.341255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba317787-cedd-48e4-a8a5-7a35d3bf7662 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:35.402154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1ce23f24-4da5-43f2-9492-b6bd9aa9efcb tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Action: 'update', calling method: .version_select at 0x7ff6140b9040>, body: {"quota_set": {"ram": "5120"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:35.527111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ce23f24-4da5-43f2-9492-b6bd9aa9efcb tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:35.529466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ce23f24-4da5-43f2-9492-b6bd9aa9efcb tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:35.530608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ce23f24-4da5-43f2-9492-b6bd9aa9efcb tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:35.532149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ce23f24-4da5-43f2-9492-b6bd9aa9efcb tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:35.533161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ce23f24-4da5-43f2-9492-b6bd9aa9efcb tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:35.534161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ce23f24-4da5-43f2-9492-b6bd9aa9efcb tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:35.644819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba317787-cedd-48e4-a8a5-7a35d3bf7662 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:35.657102 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ba317787-cedd-48e4-a8a5-7a35d3bf7662 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1313 microversion: 2.1 time: 0.333526 Oct 18 13:17:35.660368 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 184/401] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:35 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:35.671291 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1ce23f24-4da5-43f2-9492-b6bd9aa9efcb tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/957d2ed756ba4511b2b0dc2c2f63f3d0" status: 200 len: 240 microversion: 2.36 time: 0.382852 Oct 18 13:17:35.682145 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 218/402] 10.222.0.40 () {62 vars in 1303 bytes} [Tue Oct 18 13:17:35 2022] PUT /compute/v2.1/os-quota-sets/957d2ed756ba4511b2b0dc2c2f63f3d0 => generated 240 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:17:35.687691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8567e561-8511-4822-9d96-39bcff7bb32f req-3da8ede3-1d3a-40be-8176-2376bc931985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f199ac-a7c9-4a5c-929a-f734ea6c3d80", "name": "network-vif-plugged", "status": "completed", "tag": "0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:35.701287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c3ef9836-d6ac-4faa-8f13-170bbb1c3f97 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2fb996dd88384aba9257c888c3946fac"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:35.708889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8567e561-8511-4822-9d96-39bcff7bb32f req-3da8ede3-1d3a-40be-8176-2376bc931985 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:35.709407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8567e561-8511-4822-9d96-39bcff7bb32f req-3da8ede3-1d3a-40be-8176-2376bc931985 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:35.709841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8567e561-8511-4822-9d96-39bcff7bb32f req-3da8ede3-1d3a-40be-8176-2376bc931985 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:35.730247 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8567e561-8511-4822-9d96-39bcff7bb32f req-3da8ede3-1d3a-40be-8176-2376bc931985 service nova] Creating event network-vif-plugged:0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1 for instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 on n-h1-858384-13 Oct 18 13:17:35.756307 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8567e561-8511-4822-9d96-39bcff7bb32f req-3da8ede3-1d3a-40be-8176-2376bc931985 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094118 Oct 18 13:17:35.760071 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 185/403] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:35.768874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b4a017b8-317e-498b-925f-108669b5e38f tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Calling method '.version_select at 0x7ff614023160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:35.784756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4a017b8-317e-498b-925f-108669b5e38f tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:35.786753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4a017b8-317e-498b-925f-108669b5e38f tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:35.787296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4a017b8-317e-498b-925f-108669b5e38f tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:35.791854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4a017b8-317e-498b-925f-108669b5e38f tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:35.792435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4a017b8-317e-498b-925f-108669b5e38f tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:35.792869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4a017b8-317e-498b-925f-108669b5e38f tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:35.849915 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b4a017b8-317e-498b-925f-108669b5e38f tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.086912 Oct 18 13:17:35.857364 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 186/404] 10.222.0.40 () {58 vars in 1128 bytes} [Tue Oct 18 13:17:35 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:35.864000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-948bc8e4-9520-4a50-b6dd-22e24ba7c141 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:35.864803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-948bc8e4-9520-4a50-b6dd-22e24ba7c141 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:35.872460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-948bc8e4-9520-4a50-b6dd-22e24ba7c141 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:35.873263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-948bc8e4-9520-4a50-b6dd-22e24ba7c141 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:35.874330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-948bc8e4-9520-4a50-b6dd-22e24ba7c141 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:35.875235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-948bc8e4-9520-4a50-b6dd-22e24ba7c141 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:35.875993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-948bc8e4-9520-4a50-b6dd-22e24ba7c141 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:35.876709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-948bc8e4-9520-4a50-b6dd-22e24ba7c141 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:36.151971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-948bc8e4-9520-4a50-b6dd-22e24ba7c141 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:36.167054 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-948bc8e4-9520-4a50-b6dd-22e24ba7c141 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1466 microversion: 2.1 time: 0.306857 Oct 18 13:17:36.171602 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 187/405] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:35 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1466 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:36.177127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a3599267-667a-484b-b037-0b2bbf263cc5 tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Calling method '.version_select at 0x7ff60fffb940>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:36.316242 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c3ef9836-d6ac-4faa-8f13-170bbb1c3f97 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1631021150/action" status: 200 len: 21 microversion: 2.1 time: 0.642041 Oct 18 13:17:36.323258 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 219/406] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 18 13:17:35 2022] POST /compute/v2.1/flavors/1631021150/action => generated 21 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:17:36.329645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9e37279c-098a-4476-b6f3-5f63fea339e6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:36.330329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9e37279c-098a-4476-b6f3-5f63fea339e6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:36.337798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e37279c-098a-4476-b6f3-5f63fea339e6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:36.338506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e37279c-098a-4476-b6f3-5f63fea339e6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:36.339017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e37279c-098a-4476-b6f3-5f63fea339e6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:36.339826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e37279c-098a-4476-b6f3-5f63fea339e6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:36.341042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e37279c-098a-4476-b6f3-5f63fea339e6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:36.341042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e37279c-098a-4476-b6f3-5f63fea339e6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:36.511317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3599267-667a-484b-b037-0b2bbf263cc5 tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:36.513103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3599267-667a-484b-b037-0b2bbf263cc5 tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:36.513897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3599267-667a-484b-b037-0b2bbf263cc5 tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:36.515133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3599267-667a-484b-b037-0b2bbf263cc5 tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:36.516003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3599267-667a-484b-b037-0b2bbf263cc5 tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:36.517632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3599267-667a-484b-b037-0b2bbf263cc5 tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:36.546452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9e37279c-098a-4476-b6f3-5f63fea339e6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:36.548986 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a3599267-667a-484b-b037-0b2bbf263cc5 tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/957d2ed756ba4511b2b0dc2c2f63f3d0/detail" status: 200 len: 672 microversion: 2.36 time: 0.375515 Oct 18 13:17:36.558572 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 188/407] 10.222.0.40 () {60 vars in 1304 bytes} [Tue Oct 18 13:17:36 2022] GET /compute/v2.1/os-quota-sets/957d2ed756ba4511b2b0dc2c2f63f3d0/detail => generated 672 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:17:36.564453 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9e37279c-098a-4476-b6f3-5f63fea339e6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1324 microversion: 2.1 time: 0.239661 Oct 18 13:17:36.568302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c1ac12af-5555-4644-a244-484ed350aef0 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Calling method '.version_select at 0x7ff614069820>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:36.568490 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 220/408] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:36 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1324 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:36.577937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1ac12af-5555-4644-a244-484ed350aef0 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:36.578431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1ac12af-5555-4644-a244-484ed350aef0 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:36.578899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1ac12af-5555-4644-a244-484ed350aef0 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:36.591722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:36.619927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1ac12af-5555-4644-a244-484ed350aef0 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:36.621820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1ac12af-5555-4644-a244-484ed350aef0 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:36.623979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1ac12af-5555-4644-a244-484ed350aef0 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:36.668678 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c1ac12af-5555-4644-a244-484ed350aef0 tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-h2-858384-13" status: 200 len: 603 microversion: 2.1 time: 0.107955 Oct 18 13:17:36.672636 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 189/409] 10.222.0.40 () {58 vars in 1173 bytes} [Tue Oct 18 13:17:36 2022] GET /compute/v2.1/os-hosts/n-h2-858384-13 => generated 603 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:36.685687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8364fcc5-4c86-47e4-83c9-9cf6e6e74f15 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:36.688824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8364fcc5-4c86-47e4-83c9-9cf6e6e74f15 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:36.697868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8364fcc5-4c86-47e4-83c9-9cf6e6e74f15 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:36.698346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8364fcc5-4c86-47e4-83c9-9cf6e6e74f15 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:36.698836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8364fcc5-4c86-47e4-83c9-9cf6e6e74f15 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:36.699585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8364fcc5-4c86-47e4-83c9-9cf6e6e74f15 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:36.700370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8364fcc5-4c86-47e4-83c9-9cf6e6e74f15 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:36.700798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8364fcc5-4c86-47e4-83c9-9cf6e6e74f15 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:36.817563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2089217153", "block_migration": true, "disk_over_commit": false}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:36.820789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:36.829303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:36.831798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:36.832091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:36.833363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:36.833951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:36.834468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:37.160223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8364fcc5-4c86-47e4-83c9-9cf6e6e74f15 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:37.165859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8364fcc5-4c86-47e4-83c9-9cf6e6e74f15 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:37.167526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8364fcc5-4c86-47e4-83c9-9cf6e6e74f15 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:37.169347 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8364fcc5-4c86-47e4-83c9-9cf6e6e74f15 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1361 microversion: 2.25 time: 0.494726 Oct 18 13:17:37.169347 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 190/410] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:17:36 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1361 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:17:37.184741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9659c18e-8eaf-4faf-868c-b7e04f692705 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:37.185302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lazy-loading 'flavor' on Instance uuid 32a9f1e5-27ea-466b-84c6-3591332a665b {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:17:37.235108 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9659c18e-8eaf-4faf-868c-b7e04f692705 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1631021150" status: 202 len: 0 microversion: 2.1 time: 0.054714 Oct 18 13:17:37.235681 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 191/411] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 18 13:17:37 2022] DELETE /compute/v2.1/flavors/1631021150 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:17:37.244574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-15958fd3-569a-4e88-8222-48c89cce19fe tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Calling method '.version_select at 0x7ff60ff88a60>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:37.262721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15958fd3-569a-4e88-8222-48c89cce19fe tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:37.263588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15958fd3-569a-4e88-8222-48c89cce19fe tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:37.265157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15958fd3-569a-4e88-8222-48c89cce19fe tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:37.274622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Going to try to live migrate instance to tempest-host-2089217153 {{(pid=120612) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:17:37.289046 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] HTTP exception thrown: Compute host tempest-host-2089217153 could not be found. Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Request method failure captured: Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b/action HTTP/1.1 Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 107 Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdWQJdPI6zKLKMWE9kqcljtdPvOvdNKPGQX2yaqrEN8O3Fq7cGZ4g_Y5D4H6YZP9wMx_DLiyEwHh65_eN5kCTSdHml0D8L-VBdf0JIZgK42hlSgZkA8VKTmgfu30SiUcyNffzBqheuWpfVDYUbCDFWW616fK_k0iiynIOzgGAU8E0k Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 3ca62135fda548b09e7885a711a05353 Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-LiveMigrationNegativeTest-1718503709 Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:17:37.299679 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:17:37.302244 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3ca62135fda548b09e7885a711a05353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3ca62135fda548b09e7885a711a05353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3ca62135fda548b09e7885a711a05353"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3ca62135fda548b09e7885a711a05353"}]}] Oct 18 13:17:37.302244 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-LiveMigrationNegativeTest-1718503709 Oct 18 13:17:37.302244 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 3ca62135fda548b09e7885a711a05353 Oct 18 13:17:37.302244 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1718503709 Oct 18 13:17:37.302244 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-LiveMigrationNegativeTest-1718503709-project-admin Oct 18 13:17:37.302244 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:17:37.302244 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:17:37.302244 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7b919ed261cf4e90acf024a630088f4d Oct 18 13:17:37.302244 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-LiveMigrationNegativeTest-1718503709-project-admin Oct 18 13:17:37.302244 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:17:37.302244 n-d-858384-13 devstack@n-api.service[120612]: {"os-migrateLive": {"host": "tempest-host-2089217153", "block_migration": true, "disk_over_commit": false}} Oct 18 13:17:37.302244 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: exception: Compute host tempest-host-2089217153 could not be found. Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '32a9f1e5-27ea-466b-84c6-3591332a665b', 'body': {'os-migrateLive': {'host': 'tempest-host-2089217153', 'block_migration': True, 'disk_over_commit': False}}} Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:17:37.303825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5490, in live_migrate Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2089217153 could not be found. Oct 18 13:17:37.310162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2089217153 could not be found. Oct 18 13:17:37.312625 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:37.315582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:37.315582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:37.315582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:37.315582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:37.315582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:37.315582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:17:37.315582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:17:37.315582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2089217153 could not be found. Oct 18 13:17:37.315582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:37.316699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15958fd3-569a-4e88-8222-48c89cce19fe tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:37.316699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15958fd3-569a-4e88-8222-48c89cce19fe tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:37.316699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15958fd3-569a-4e88-8222-48c89cce19fe tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:37.317140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Returning 400 to user: Compute host tempest-host-2089217153 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:37.317140 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3599aae7-6c38-4854-9dbb-efdee17f13cc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b/action" status: 400 len: 100 microversion: 2.1 time: 0.741717 Oct 18 13:17:37.317140 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 221/412] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Oct 18 13:17:36 2022] POST /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b/action => generated 100 bytes in 743 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:17:37.317140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6d15ccdf-97eb-4fb2-b1e3-f39405e26a89 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:37.317825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6d15ccdf-97eb-4fb2-b1e3-f39405e26a89 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:37.330085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d15ccdf-97eb-4fb2-b1e3-f39405e26a89 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:37.331276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d15ccdf-97eb-4fb2-b1e3-f39405e26a89 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:37.332030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d15ccdf-97eb-4fb2-b1e3-f39405e26a89 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:37.333164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d15ccdf-97eb-4fb2-b1e3-f39405e26a89 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:37.334052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d15ccdf-97eb-4fb2-b1e3-f39405e26a89 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:37.334746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d15ccdf-97eb-4fb2-b1e3-f39405e26a89 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:37.346385 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-15958fd3-569a-4e88-8222-48c89cce19fe tempest-HostsAdminTestJSON-277225975 tempest-HostsAdminTestJSON-277225975-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/n-h1-858384-13" status: 200 len: 603 microversion: 2.1 time: 0.105820 Oct 18 13:17:37.353546 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 192/413] 10.222.0.40 () {58 vars in 1173 bytes} [Tue Oct 18 13:17:37 2022] GET /compute/v2.1/os-hosts/n-h1-858384-13 => generated 603 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:37.358726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Action: 'update', calling method: .version_select at 0x7ff61408a550>, body: {"quota_set": {"ram": "2048"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:37.457710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:37.458206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:37.459288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:37.460224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:37.460696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:37.461125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:37.522876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:37.523550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:37.523990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:37.525031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:37.532219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:37.533860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:37.624925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6d15ccdf-97eb-4fb2-b1e3-f39405e26a89 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:37.643814 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6d15ccdf-97eb-4fb2-b1e3-f39405e26a89 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1313 microversion: 2.1 time: 0.330600 Oct 18 13:17:37.649966 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 222/414] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:37 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:37.674475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3f37aa75-8e4b-48a1-8cdd-dcefe8387c38 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:37.731741 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4aae9997-7c9e-4cfc-b60c-2148da89b8bf tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/957d2ed756ba4511b2b0dc2c2f63f3d0?user_id=0b7a0cfe01d746bb820e15f5ae12e5f7" status: 200 len: 240 microversion: 2.36 time: 0.376984 Oct 18 13:17:37.745536 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 193/415] 10.222.0.40 () {62 vars in 1384 bytes} [Tue Oct 18 13:17:37 2022] PUT /compute/v2.1/os-quota-sets/957d2ed756ba4511b2b0dc2c2f63f3d0?user_id=0b7a0cfe01d746bb820e15f5ae12e5f7 => generated 240 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:17:37.757586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d0685780-103d-4798-841a-7c619253d802 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:37.758539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d0685780-103d-4798-841a-7c619253d802 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:37.763739 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3f37aa75-8e4b-48a1-8cdd-dcefe8387c38 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.109497 Oct 18 13:17:37.770909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0685780-103d-4798-841a-7c619253d802 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:37.774114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0685780-103d-4798-841a-7c619253d802 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:37.775365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0685780-103d-4798-841a-7c619253d802 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:37.778013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0685780-103d-4798-841a-7c619253d802 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:37.778709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0685780-103d-4798-841a-7c619253d802 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:37.780739 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 223/416] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:17:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:37.781118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0685780-103d-4798-841a-7c619253d802 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:37.797159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8ca292e5-f922-44df-bfc2-f3a2e62c16f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:37.797850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8ca292e5-f922-44df-bfc2-f3a2e62c16f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:37.808535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ca292e5-f922-44df-bfc2-f3a2e62c16f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:37.810180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ca292e5-f922-44df-bfc2-f3a2e62c16f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:37.810846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ca292e5-f922-44df-bfc2-f3a2e62c16f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:37.811719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ca292e5-f922-44df-bfc2-f3a2e62c16f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:37.812453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ca292e5-f922-44df-bfc2-f3a2e62c16f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:37.814129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ca292e5-f922-44df-bfc2-f3a2e62c16f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:38.354798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d0685780-103d-4798-841a-7c619253d802 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:38.370320 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d0685780-103d-4798-841a-7c619253d802 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1466 microversion: 2.1 time: 0.622779 Oct 18 13:17:38.371850 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 194/417] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:37 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1466 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:38.378550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-26c154f9-9174-49a6-be39-b958018e761a tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] Calling method '.version_select at 0x7ff614069ee0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:38.421235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8ca292e5-f922-44df-bfc2-f3a2e62c16f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:38.432348 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8ca292e5-f922-44df-bfc2-f3a2e62c16f3 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1324 microversion: 2.1 time: 0.644207 Oct 18 13:17:38.433268 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 224/418] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:37 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1324 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:38.454998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c54ee836-3090-4ace-a020-6666dad57c8c tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-875527340", "id": 618353384, "os-flavor-access:is_public": "True"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:38.488699 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c54ee836-3090-4ace-a020-6666dad57c8c tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.040615 Oct 18 13:17:38.489621 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 225/419] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:38 2022] POST /compute/v2.1/flavors => generated 434 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:38.502847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1be4fff2-d914-43af-8439-02dbe6f739d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:38.504282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1be4fff2-d914-43af-8439-02dbe6f739d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:38.525002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1be4fff2-d914-43af-8439-02dbe6f739d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:38.526096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1be4fff2-d914-43af-8439-02dbe6f739d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:38.527303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1be4fff2-d914-43af-8439-02dbe6f739d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:38.528765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1be4fff2-d914-43af-8439-02dbe6f739d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:38.531689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1be4fff2-d914-43af-8439-02dbe6f739d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:38.533958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1be4fff2-d914-43af-8439-02dbe6f739d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:38.779392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:38.819099 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-26c154f9-9174-49a6-be39-b958018e761a tempest-QuotasAdminTestV236-2005006396 tempest-QuotasAdminTestV236-2005006396-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/957d2ed756ba4511b2b0dc2c2f63f3d0?user_id=0b7a0cfe01d746bb820e15f5ae12e5f7" status: 200 len: 282 microversion: 2.36 time: 0.445872 Oct 18 13:17:38.827436 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 195/420] 10.222.0.40 () {60 vars in 1364 bytes} [Tue Oct 18 13:17:38 2022] GET /compute/v2.1/os-quota-sets/957d2ed756ba4511b2b0dc2c2f63f3d0?user_id=0b7a0cfe01d746bb820e15f5ae12e5f7 => generated 282 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:17:38.847700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e29887ac-9f9b-4427-995b-06b8fd21e50c tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:38.874279 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-e29887ac-9f9b-4427-995b-06b8fd21e50c tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e29887ac-9f9b-4427-995b-06b8fd21e50c tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Request method failure captured: Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/flavors/618353384/os-flavor-access HTTP/1.1 Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdqEsduYaWqKllPoko2El6R_scpkY45dWWBtQFKLsrcjad-g-oxKFz_CxRJqxXQ5wHs728euWw_61wSWAAKakL7_14gwJeVjn67-ArAMp1o_LMGPZJ-GWOEx8hLxi5lRqAweA6YvQdi5jRb5JaSyyWg9XxY8Mb0WCg9W_kYdS8n_xk Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 254b1e1fcad147e5b9e5c9457c004f93 Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1535653608 Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:17:38.880792 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:17:38.882174 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/254b1e1fcad147e5b9e5c9457c004f93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/254b1e1fcad147e5b9e5c9457c004f93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/254b1e1fcad147e5b9e5c9457c004f93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_254b1e1fcad147e5b9e5c9457c004f93"}]}] Oct 18 13:17:38.882174 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1535653608 Oct 18 13:17:38.882174 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 254b1e1fcad147e5b9e5c9457c004f93 Oct 18 13:17:38.882174 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1535653608 Oct 18 13:17:38.882174 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin Oct 18 13:17:38.882174 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:17:38.882174 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:17:38.882174 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c8b51dba0ef14ed282d24f406016ecc8 Oct 18 13:17:38.882174 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin Oct 18 13:17:38.882174 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:17:38.882174 n-d-858384-13 devstack@n-api.service[120611]: exception: Access list not available for public flavors. Oct 18 13:17:38.882174 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'flavor_id': '618353384'} Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 18 13:17:38.882871 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:38.884067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e29887ac-9f9b-4427-995b-06b8fd21e50c tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:38.887070 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e29887ac-9f9b-4427-995b-06b8fd21e50c tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/618353384/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.057913 Oct 18 13:17:38.888839 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 196/421] 10.222.0.40 () {58 vars in 1206 bytes} [Tue Oct 18 13:17:38 2022] GET /compute/v2.1/flavors/618353384/os-flavor-access => generated 91 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:17:38.905391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1171265353", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:38.936743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1be4fff2-d914-43af-8439-02dbe6f739d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:38.946898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1be4fff2-d914-43af-8439-02dbe6f739d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:38.953564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1be4fff2-d914-43af-8439-02dbe6f739d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:38.963679 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1be4fff2-d914-43af-8439-02dbe6f739d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1361 microversion: 2.25 time: 0.473232 Oct 18 13:17:38.964282 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 226/422] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:17:38 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1361 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:17:38.987819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-03891e11-8c2b-41df-8e34-2582e23e738c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:38.992285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-03891e11-8c2b-41df-8e34-2582e23e738c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:39.015646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:17:39.015939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03891e11-8c2b-41df-8e34-2582e23e738c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:39.021992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03891e11-8c2b-41df-8e34-2582e23e738c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:39.022450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03891e11-8c2b-41df-8e34-2582e23e738c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:39.023186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03891e11-8c2b-41df-8e34-2582e23e738c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:39.023641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03891e11-8c2b-41df-8e34-2582e23e738c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:39.024069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03891e11-8c2b-41df-8e34-2582e23e738c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:39.522017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:17:39.522736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:17:39.523435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:17:39.523997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:17:39.525153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:17:39.537783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:39.538757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:39.540107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:39.541805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:39.542517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:39.543687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:39.563316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-03891e11-8c2b-41df-8e34-2582e23e738c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:39.574198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Getting quotas for project 7c65a39f96a0450691774ebdf4a4122d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:17:39.576630 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-03891e11-8c2b-41df-8e34-2582e23e738c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1462 microversion: 2.1 time: 0.599837 Oct 18 13:17:39.580329 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 227/423] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:38 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1462 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:39.582072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Getting quotas for user 8fdc8cbdac3a4a93bd0a4c8f2a06e579 and project 7c65a39f96a0450691774ebdf4a4122d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:17:39.594291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0122bbb7-c91c-4c25-8962-d9249e752835 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:39.621154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:17:39.629754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:17:39.652435 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0122bbb7-c91c-4c25-8962-d9249e752835 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/618353384" status: 202 len: 0 microversion: 2.1 time: 0.070359 Oct 18 13:17:39.654179 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 228/424] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:17:39 2022] DELETE /compute/v2.1/flavors/618353384 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:17:39.660678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7097ee1a-d756-484d-b13f-fc9c39bcc3c6 req-698e170e-ccc7-4859-bdb3-bfd00ad213e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1612cfab-edd0-4df2-90f2-79a1c541ca90", "tag": "7989e920-3ad6-4f7c-9ee5-6755d27b3383"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:39.677293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7097ee1a-d756-484d-b13f-fc9c39bcc3c6 req-698e170e-ccc7-4859-bdb3-bfd00ad213e9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:39.678551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7097ee1a-d756-484d-b13f-fc9c39bcc3c6 req-698e170e-ccc7-4859-bdb3-bfd00ad213e9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:39.682680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7097ee1a-d756-484d-b13f-fc9c39bcc3c6 req-698e170e-ccc7-4859-bdb3-bfd00ad213e9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:39.725840 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7097ee1a-d756-484d-b13f-fc9c39bcc3c6 req-698e170e-ccc7-4859-bdb3-bfd00ad213e9 service nova] Creating event network-changed:7989e920-3ad6-4f7c-9ee5-6755d27b3383 for instance 1612cfab-edd0-4df2-90f2-79a1c541ca90 on n-h2-858384-13 Oct 18 13:17:39.744430 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7097ee1a-d756-484d-b13f-fc9c39bcc3c6 req-698e170e-ccc7-4859-bdb3-bfd00ad213e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087369 Oct 18 13:17:39.747312 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 229/425] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:39.761414 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e5309410-88d5-4239-b090-9ca87da6af2e tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867870 Oct 18 13:17:39.762942 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 197/426] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:17:39.779954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a70e040f-2b86-497a-9811-5c07f622e568 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:39.781155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a70e040f-2b86-497a-9811-5c07f622e568 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:39.817942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a70e040f-2b86-497a-9811-5c07f622e568 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:39.820633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a70e040f-2b86-497a-9811-5c07f622e568 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:39.824483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a70e040f-2b86-497a-9811-5c07f622e568 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:39.826844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a70e040f-2b86-497a-9811-5c07f622e568 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:39.828201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a70e040f-2b86-497a-9811-5c07f622e568 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:39.830337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a70e040f-2b86-497a-9811-5c07f622e568 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:40.086130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e2a0067b-b8bc-48a1-b722-98ec713b70e8 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:40.088092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e2a0067b-b8bc-48a1-b722-98ec713b70e8 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:40.096439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e2a0067b-b8bc-48a1-b722-98ec713b70e8 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:40.097256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e2a0067b-b8bc-48a1-b722-98ec713b70e8 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:40.099124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e2a0067b-b8bc-48a1-b722-98ec713b70e8 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:40.100313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e2a0067b-b8bc-48a1-b722-98ec713b70e8 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:40.101170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e2a0067b-b8bc-48a1-b722-98ec713b70e8 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:40.102462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e2a0067b-b8bc-48a1-b722-98ec713b70e8 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:40.262327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a70e040f-2b86-497a-9811-5c07f622e568 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:40.282174 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a70e040f-2b86-497a-9811-5c07f622e568 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1324 microversion: 2.1 time: 0.530432 Oct 18 13:17:40.287064 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 230/427] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:39 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1324 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:40.291918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ebcb261b-6cff-4cb3-9f60-c36b1ea7e2d8 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:40.339919 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ebcb261b-6cff-4cb3-9f60-c36b1ea7e2d8 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051667 Oct 18 13:17:40.346265 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 231/428] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:17:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:40.352572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ecebc707-b07c-4586-9d52-f2d214bc43b3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:40.360531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ecebc707-b07c-4586-9d52-f2d214bc43b3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:40.581159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ecebc707-b07c-4586-9d52-f2d214bc43b3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:40.583944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=27 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:40.597558 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ecebc707-b07c-4586-9d52-f2d214bc43b3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1219 microversion: 2.1 time: 0.249899 Oct 18 13:17:40.598708 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 232/429] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:40 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1219 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:40.603962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b06cf0fa-0e7c-4315-9de4-c3ba746a0a04 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:40.610159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b06cf0fa-0e7c-4315-9de4-c3ba746a0a04 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:40.635039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b06cf0fa-0e7c-4315-9de4-c3ba746a0a04 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:40.635970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b06cf0fa-0e7c-4315-9de4-c3ba746a0a04 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:40.636663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b06cf0fa-0e7c-4315-9de4-c3ba746a0a04 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:40.638585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b06cf0fa-0e7c-4315-9de4-c3ba746a0a04 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:40.639693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b06cf0fa-0e7c-4315-9de4-c3ba746a0a04 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:40.640410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b06cf0fa-0e7c-4315-9de4-c3ba746a0a04 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:41.092694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b06cf0fa-0e7c-4315-9de4-c3ba746a0a04 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:41.131866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b06cf0fa-0e7c-4315-9de4-c3ba746a0a04 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:41.142853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b06cf0fa-0e7c-4315-9de4-c3ba746a0a04 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:41.143588 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e2a0067b-b8bc-48a1-b722-98ec713b70e8 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1615 microversion: 2.1 time: 1.379087 Oct 18 13:17:41.144263 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b06cf0fa-0e7c-4315-9de4-c3ba746a0a04 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1361 microversion: 2.25 time: 0.544322 Oct 18 13:17:41.144837 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 233/430] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:17:40 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1361 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:17:41.156065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd5ad8a4-cf32-468b-bb8c-15f83daef3bc tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2016230610", "id": 732364900, "os-flavor-access:is_public": "False"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:41.181215 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 198/431] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:39 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1615 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:41.196647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ce1a4698-29f7-40ed-beb3-26f5a7f1cb8c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:41.197374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ce1a4698-29f7-40ed-beb3-26f5a7f1cb8c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:41.212723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce1a4698-29f7-40ed-beb3-26f5a7f1cb8c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:41.213684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce1a4698-29f7-40ed-beb3-26f5a7f1cb8c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:41.216038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce1a4698-29f7-40ed-beb3-26f5a7f1cb8c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:41.217501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce1a4698-29f7-40ed-beb3-26f5a7f1cb8c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:41.218138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce1a4698-29f7-40ed-beb3-26f5a7f1cb8c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:41.219275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce1a4698-29f7-40ed-beb3-26f5a7f1cb8c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:41.223902 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fd5ad8a4-cf32-468b-bb8c-15f83daef3bc tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.075568 Oct 18 13:17:41.225291 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 234/432] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:41 2022] POST /compute/v2.1/flavors => generated 436 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:41.447026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ce1a4698-29f7-40ed-beb3-26f5a7f1cb8c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '95055dd980944f9894c5c5d7263290dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b702f084c24dcc929d400e81eef048', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:41.449098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ce1a4698-29f7-40ed-beb3-26f5a7f1cb8c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] flavor_id is None. Assuming migration. {{(pid=120611) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 18 13:17:41.450795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ce1a4698-29f7-40ed-beb3-26f5a7f1cb8c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120611) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 13:17:41.615487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-406e3c7b-42a6-48be-9544-592ca1128b23 tempest-FlavorsAccessNegativeTestJSON-1457122489 tempest-FlavorsAccessNegativeTestJSON-1457122489-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2fb996dd88384aba9257c888c3946fac"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:41.622884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-406e3c7b-42a6-48be-9544-592ca1128b23 tempest-FlavorsAccessNegativeTestJSON-1457122489 tempest-FlavorsAccessNegativeTestJSON-1457122489-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '339fc1bcded247ae84b2d2af4d197f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb996dd88384aba9257c888c3946fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-406e3c7b-42a6-48be-9544-592ca1128b23 tempest-FlavorsAccessNegativeTestJSON-1457122489 tempest-FlavorsAccessNegativeTestJSON-1457122489-project] Request method failure captured: Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/flavors/732364900/action HTTP/1.1 Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 67 Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdoPxHQS8NVoqlSTqR0M-5Iw57z0YOFPZSTWznkKtMoqiTC7arnlSJLmRX8nmWxmbtS3yukgCMA_Voj5oXHGOg4f_LXKi7I2l2t_OVeqND44aLlXfeDIK5vv2u3nYbMoSTtJF0ErrZV5WsUssmTMTCdR_K71vAcYAeT4zPpRug1Huc Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 2fb996dd88384aba9257c888c3946fac Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1457122489 Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:17:41.628017 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:17:41.629354 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fb996dd88384aba9257c888c3946fac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2fb996dd88384aba9257c888c3946fac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fb996dd88384aba9257c888c3946fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2fb996dd88384aba9257c888c3946fac"}]}] Oct 18 13:17:41.629354 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1457122489 Oct 18 13:17:41.629354 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 2fb996dd88384aba9257c888c3946fac Oct 18 13:17:41.629354 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1457122489 Oct 18 13:17:41.629354 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FlavorsAccessNegativeTestJSON-1457122489-project Oct 18 13:17:41.629354 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:17:41.629354 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:17:41.629354 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 339fc1bcded247ae84b2d2af4d197f3b Oct 18 13:17:41.629354 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1457122489-project Oct 18 13:17:41.629354 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:17:41.629354 n-d-858384-13 devstack@n-api.service[120612]: {"addTenantAccess": {"tenant": "2fb996dd88384aba9257c888c3946fac"}} Oct 18 13:17:41.629354 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '732364900', 'body': {'addTenantAccess': {'tenant': '2fb996dd88384aba9257c888c3946fac'}}} Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:17:41.630059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 18 13:17:41.631098 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:41.632175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-406e3c7b-42a6-48be-9544-592ca1128b23 tempest-FlavorsAccessNegativeTestJSON-1457122489 tempest-FlavorsAccessNegativeTestJSON-1457122489-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:41.633543 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-406e3c7b-42a6-48be-9544-592ca1128b23 tempest-FlavorsAccessNegativeTestJSON-1457122489 tempest-FlavorsAccessNegativeTestJSON-1457122489-project] 10.222.0.40 "POST /compute/v2.1/flavors/732364900/action" status: 403 len: 130 microversion: 2.1 time: 0.397207 Oct 18 13:17:41.635440 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 235/433] 10.222.0.40 () {60 vars in 1197 bytes} [Tue Oct 18 13:17:41 2022] POST /compute/v2.1/flavors/732364900/action => generated 130 bytes in 401 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:17:41.649206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ac29a47b-1802-4e1d-ac38-5f0d9fe9f0ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:41.656300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ac29a47b-1802-4e1d-ac38-5f0d9fe9f0ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:41.667337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac29a47b-1802-4e1d-ac38-5f0d9fe9f0ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:41.668518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac29a47b-1802-4e1d-ac38-5f0d9fe9f0ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:41.672675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac29a47b-1802-4e1d-ac38-5f0d9fe9f0ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:41.674154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac29a47b-1802-4e1d-ac38-5f0d9fe9f0ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:41.674828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac29a47b-1802-4e1d-ac38-5f0d9fe9f0ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:41.675267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac29a47b-1802-4e1d-ac38-5f0d9fe9f0ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:41.721007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:41.803549 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ce1a4698-29f7-40ed-beb3-26f5a7f1cb8c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80/action" status: 202 len: 0 microversion: 2.1 time: 0.611809 Oct 18 13:17:41.804867 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 199/434] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:17:41 2022] POST /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:17:41.817960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-12b62a42-2c20-453b-a77c-f0fc07b82a7a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:41.818944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-12b62a42-2c20-453b-a77c-f0fc07b82a7a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:41.829341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12b62a42-2c20-453b-a77c-f0fc07b82a7a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:41.830131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12b62a42-2c20-453b-a77c-f0fc07b82a7a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:41.830801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12b62a42-2c20-453b-a77c-f0fc07b82a7a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:41.832017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12b62a42-2c20-453b-a77c-f0fc07b82a7a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:41.832861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12b62a42-2c20-453b-a77c-f0fc07b82a7a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:41.833472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12b62a42-2c20-453b-a77c-f0fc07b82a7a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:41.970051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-12b62a42-2c20-453b-a77c-f0fc07b82a7a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:42.006355 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-12b62a42-2c20-453b-a77c-f0fc07b82a7a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1271 microversion: 2.1 time: 0.199246 Oct 18 13:17:42.007337 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 200/435] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:41 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:42.053992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-453a2e77-94dd-497e-b0fd-66e5634a8e26 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:42.099398 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-453a2e77-94dd-497e-b0fd-66e5634a8e26 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/732364900" status: 202 len: 0 microversion: 2.1 time: 0.063893 Oct 18 13:17:42.103555 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 201/436] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:17:42 2022] DELETE /compute/v2.1/flavors/732364900 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:17:42.110145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4789cfb8-6009-46af-a1b6-9bc78b509159 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:42.111013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4789cfb8-6009-46af-a1b6-9bc78b509159 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:42.122733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4789cfb8-6009-46af-a1b6-9bc78b509159 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:42.127359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4789cfb8-6009-46af-a1b6-9bc78b509159 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:42.129788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4789cfb8-6009-46af-a1b6-9bc78b509159 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:42.130946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4789cfb8-6009-46af-a1b6-9bc78b509159 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:42.132334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4789cfb8-6009-46af-a1b6-9bc78b509159 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:42.133556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4789cfb8-6009-46af-a1b6-9bc78b509159 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:42.198937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ac29a47b-1802-4e1d-ac38-5f0d9fe9f0ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:42.213383 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ac29a47b-1802-4e1d-ac38-5f0d9fe9f0ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1324 microversion: 2.1 time: 0.573321 Oct 18 13:17:42.234104 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 236/437] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:41 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1324 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:42.246696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-36ea605b-856a-4e94-a9f0-da301bfff787 req-30f6f417-6cae-4fd4-bd7a-7587d23ff955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97ccda6-c665-4a4f-b099-72b142b143b7", "name": "network-vif-plugged", "status": "completed", "tag": "7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:42.269501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-36ea605b-856a-4e94-a9f0-da301bfff787 req-30f6f417-6cae-4fd4-bd7a-7587d23ff955 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:42.269980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-36ea605b-856a-4e94-a9f0-da301bfff787 req-30f6f417-6cae-4fd4-bd7a-7587d23ff955 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:42.270255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-36ea605b-856a-4e94-a9f0-da301bfff787 req-30f6f417-6cae-4fd4-bd7a-7587d23ff955 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:42.307469 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-36ea605b-856a-4e94-a9f0-da301bfff787 req-30f6f417-6cae-4fd4-bd7a-7587d23ff955 service nova] Creating event network-vif-plugged:7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5 for instance f97ccda6-c665-4a4f-b099-72b142b143b7 on n-h1-858384-13 Oct 18 13:17:42.312758 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-36ea605b-856a-4e94-a9f0-da301bfff787 req-30f6f417-6cae-4fd4-bd7a-7587d23ff955 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076869 Oct 18 13:17:42.314938 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 237/438] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:42.323040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e8b92a11-668d-4fd4-99a6-b9de7d6f8630 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:42.371520 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e8b92a11-668d-4fd4-99a6-b9de7d6f8630 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055080 Oct 18 13:17:42.397132 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 238/439] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:17:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:42.419452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b563989f-07a2-40d5-b89e-f95911ae9fee tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:42.421395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b563989f-07a2-40d5-b89e-f95911ae9fee tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:42.440074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:42.444131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b563989f-07a2-40d5-b89e-f95911ae9fee tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:42.448570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b563989f-07a2-40d5-b89e-f95911ae9fee tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:42.450770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b563989f-07a2-40d5-b89e-f95911ae9fee tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:42.452818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b563989f-07a2-40d5-b89e-f95911ae9fee tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:42.453645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b563989f-07a2-40d5-b89e-f95911ae9fee tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:42.454865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b563989f-07a2-40d5-b89e-f95911ae9fee tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:42.820567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4789cfb8-6009-46af-a1b6-9bc78b509159 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:42.831936 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4789cfb8-6009-46af-a1b6-9bc78b509159 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1471 microversion: 2.1 time: 0.723276 Oct 18 13:17:42.834223 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 202/440] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:42 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1471 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:42.843680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c3d0f7c4-8371-4be3-a2f3-d07437e5a0bb tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-204618402", "id": 1159884702, "os-flavor-access:is_public": "False"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:42.879046 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c3d0f7c4-8371-4be3-a2f3-d07437e5a0bb tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.041653 Oct 18 13:17:42.882531 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 203/441] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:42 2022] POST /compute/v2.1/flavors => generated 438 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:42.898318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f1195d4-0a46-48e3-afa1-c39ba6075f94 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2fb996dd88384aba9257c888c3946fac"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:43.705670 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9f1195d4-0a46-48e3-afa1-c39ba6075f94 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1159884702/action" status: 200 len: 97 microversion: 2.1 time: 0.816315 Oct 18 13:17:43.707636 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 204/442] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 18 13:17:42 2022] POST /compute/v2.1/flavors/1159884702/action => generated 97 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:17:43.719480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cd0c0b6c-ea58-4a4f-bcaa-594dea16e51f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:43.720527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cd0c0b6c-ea58-4a4f-bcaa-594dea16e51f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:43.740570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd0c0b6c-ea58-4a4f-bcaa-594dea16e51f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:43.745999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd0c0b6c-ea58-4a4f-bcaa-594dea16e51f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:43.746739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd0c0b6c-ea58-4a4f-bcaa-594dea16e51f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:43.747705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd0c0b6c-ea58-4a4f-bcaa-594dea16e51f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:43.748348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd0c0b6c-ea58-4a4f-bcaa-594dea16e51f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:43.749093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd0c0b6c-ea58-4a4f-bcaa-594dea16e51f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:43.870206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cd0c0b6c-ea58-4a4f-bcaa-594dea16e51f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:43.886370 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cd0c0b6c-ea58-4a4f-bcaa-594dea16e51f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1277 microversion: 2.1 time: 0.172446 Oct 18 13:17:43.886370 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 205/443] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:43 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:43.896239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3f9fd3a1-c1ba-4fa9-a375-35b30934dbd0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:43.897543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3f9fd3a1-c1ba-4fa9-a375-35b30934dbd0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:43.905094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f9fd3a1-c1ba-4fa9-a375-35b30934dbd0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:43.906145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f9fd3a1-c1ba-4fa9-a375-35b30934dbd0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:43.907640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f9fd3a1-c1ba-4fa9-a375-35b30934dbd0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:43.908614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f9fd3a1-c1ba-4fa9-a375-35b30934dbd0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:43.909286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f9fd3a1-c1ba-4fa9-a375-35b30934dbd0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:43.909929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f9fd3a1-c1ba-4fa9-a375-35b30934dbd0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:44.106731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b563989f-07a2-40d5-b89e-f95911ae9fee tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:44.125036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b563989f-07a2-40d5-b89e-f95911ae9fee tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:44.126825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b563989f-07a2-40d5-b89e-f95911ae9fee tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:44.129329 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b563989f-07a2-40d5-b89e-f95911ae9fee tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1361 microversion: 2.25 time: 1.729607 Oct 18 13:17:44.130245 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 239/444] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:17:42 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1361 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:17:44.135975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-326f5784-7d7b-416f-a01a-4cd5e42ab29e tempest-FlavorsAccessNegativeTestJSON-1457122489 tempest-FlavorsAccessNegativeTestJSON-1457122489-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2fb996dd88384aba9257c888c3946fac"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:44.140958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-326f5784-7d7b-416f-a01a-4cd5e42ab29e tempest-FlavorsAccessNegativeTestJSON-1457122489 tempest-FlavorsAccessNegativeTestJSON-1457122489-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '339fc1bcded247ae84b2d2af4d197f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb996dd88384aba9257c888c3946fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-326f5784-7d7b-416f-a01a-4cd5e42ab29e tempest-FlavorsAccessNegativeTestJSON-1457122489 tempest-FlavorsAccessNegativeTestJSON-1457122489-project] Request method failure captured: Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/flavors/1159884702/action HTTP/1.1 Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 70 Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdoPxHQS8NVoqlSTqR0M-5Iw57z0YOFPZSTWznkKtMoqiTC7arnlSJLmRX8nmWxmbtS3yukgCMA_Voj5oXHGOg4f_LXKi7I2l2t_OVeqND44aLlXfeDIK5vv2u3nYbMoSTtJF0ErrZV5WsUssmTMTCdR_K71vAcYAeT4zPpRug1Huc Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 2fb996dd88384aba9257c888c3946fac Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1457122489 Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:17:44.146402 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:17:44.147874 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fb996dd88384aba9257c888c3946fac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2fb996dd88384aba9257c888c3946fac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2fb996dd88384aba9257c888c3946fac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2fb996dd88384aba9257c888c3946fac"}]}] Oct 18 13:17:44.147874 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1457122489 Oct 18 13:17:44.147874 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 2fb996dd88384aba9257c888c3946fac Oct 18 13:17:44.147874 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1457122489 Oct 18 13:17:44.147874 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FlavorsAccessNegativeTestJSON-1457122489-project Oct 18 13:17:44.147874 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:17:44.147874 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:17:44.147874 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 339fc1bcded247ae84b2d2af4d197f3b Oct 18 13:17:44.147874 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1457122489-project Oct 18 13:17:44.147874 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:17:44.147874 n-d-858384-13 devstack@n-api.service[120612]: {"removeTenantAccess": {"tenant": "2fb996dd88384aba9257c888c3946fac"}} Oct 18 13:17:44.147874 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '1159884702', 'body': {'removeTenantAccess': {'tenant': '2fb996dd88384aba9257c888c3946fac'}}} Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can( Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:17:44.148695 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 18 13:17:44.150699 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:44.153233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-326f5784-7d7b-416f-a01a-4cd5e42ab29e tempest-FlavorsAccessNegativeTestJSON-1457122489 tempest-FlavorsAccessNegativeTestJSON-1457122489-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:44.154080 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-326f5784-7d7b-416f-a01a-4cd5e42ab29e tempest-FlavorsAccessNegativeTestJSON-1457122489 tempest-FlavorsAccessNegativeTestJSON-1457122489-project] 10.222.0.40 "POST /compute/v2.1/flavors/1159884702/action" status: 403 len: 133 microversion: 2.1 time: 0.022551 Oct 18 13:17:44.155259 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 240/445] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 18 13:17:44 2022] POST /compute/v2.1/flavors/1159884702/action => generated 133 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:17:44.161072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9fb9a3dc-7888-4ea2-8623-475e30370d6e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:44.162648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9fb9a3dc-7888-4ea2-8623-475e30370d6e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:44.171220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fb9a3dc-7888-4ea2-8623-475e30370d6e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:44.171864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fb9a3dc-7888-4ea2-8623-475e30370d6e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:44.172702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fb9a3dc-7888-4ea2-8623-475e30370d6e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:44.174243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fb9a3dc-7888-4ea2-8623-475e30370d6e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:44.174879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fb9a3dc-7888-4ea2-8623-475e30370d6e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:44.175458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fb9a3dc-7888-4ea2-8623-475e30370d6e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:44.179750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3f9fd3a1-c1ba-4fa9-a375-35b30934dbd0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:44.191435 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3f9fd3a1-c1ba-4fa9-a375-35b30934dbd0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1324 microversion: 2.1 time: 0.298950 Oct 18 13:17:44.193420 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 206/446] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:43 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1324 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:44.199817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-12c59370-57eb-4073-b0c8-c402c74d65db tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2fb996dd88384aba9257c888c3946fac"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:44.539239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9fb9a3dc-7888-4ea2-8623-475e30370d6e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:44.550602 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9fb9a3dc-7888-4ea2-8623-475e30370d6e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1471 microversion: 2.1 time: 0.394153 Oct 18 13:17:44.553949 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 241/447] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:44 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1471 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:44.704363 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-12c59370-57eb-4073-b0c8-c402c74d65db tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1159884702/action" status: 200 len: 21 microversion: 2.1 time: 0.506579 Oct 18 13:17:44.714164 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 207/448] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 18 13:17:44 2022] POST /compute/v2.1/flavors/1159884702/action => generated 21 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:17:44.714977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8bd15161-99a0-4ebd-9b45-bd1c8b29659f tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:44.746195 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8bd15161-99a0-4ebd-9b45-bd1c8b29659f tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1159884702" status: 202 len: 0 microversion: 2.1 time: 0.034956 Oct 18 13:17:44.747152 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 242/449] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 18 13:17:44 2022] DELETE /compute/v2.1/flavors/1159884702 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:17:44.760523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1d57a58b-32c4-4ff7-a59c-757b0a720568 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:44.793384 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1d57a58b-32c4-4ff7-a59c-757b0a720568 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041368 Oct 18 13:17:44.794257 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 208/450] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:17:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:44.817162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c8a6364-80fd-42b6-a039-bf8e35847342 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-627614219", "id": 1349916819, "os-flavor-access:is_public": "False"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:44.844083 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2c8a6364-80fd-42b6-a039-bf8e35847342 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.033885 Oct 18 13:17:44.845644 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 243/451] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:44 2022] POST /compute/v2.1/flavors => generated 438 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:44.859133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8378a7f1-dabf-48c8-b533-a46b2dae6926 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cf21e2280da94e3e82b213dd747b2c4e"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:45.376950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-15692b68-cd3b-4012-afd7-d7fc9b013b07 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Calling method '.version_select at 0x7ff60ff05160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:45.378753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15692b68-cd3b-4012-afd7-d7fc9b013b07 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:45.379437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15692b68-cd3b-4012-afd7-d7fc9b013b07 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:45.380031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15692b68-cd3b-4012-afd7-d7fc9b013b07 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:45.450247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15692b68-cd3b-4012-afd7-d7fc9b013b07 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:45.457563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15692b68-cd3b-4012-afd7-d7fc9b013b07 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:45.463068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15692b68-cd3b-4012-afd7-d7fc9b013b07 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:45.500618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15692b68-cd3b-4012-afd7-d7fc9b013b07 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:45.501115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15692b68-cd3b-4012-afd7-d7fc9b013b07 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:45.501582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15692b68-cd3b-4012-afd7-d7fc9b013b07 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:45.534643 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-15692b68-cd3b-4012-afd7-d7fc9b013b07 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.722093 Oct 18 13:17:45.542968 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 209/452] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 18 13:17:44 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:17:45.550520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=8 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:45.563120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b693d23a-68de-454c-80ae-1f6ccfb67082 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:45.564124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b693d23a-68de-454c-80ae-1f6ccfb67082 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:45.580494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693d23a-68de-454c-80ae-1f6ccfb67082 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:45.593476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693d23a-68de-454c-80ae-1f6ccfb67082 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:45.594596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693d23a-68de-454c-80ae-1f6ccfb67082 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:45.599669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693d23a-68de-454c-80ae-1f6ccfb67082 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:45.600596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693d23a-68de-454c-80ae-1f6ccfb67082 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:45.600843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693d23a-68de-454c-80ae-1f6ccfb67082 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:45.865111 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-8378a7f1-dabf-48c8-b533-a46b2dae6926 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] HTTP exception thrown: Flavor access not found for 37 / cf21e2280da94e3e82b213dd747b2c4e combination. Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8378a7f1-dabf-48c8-b533-a46b2dae6926 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Request method failure captured: Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/flavors/1349916819/action HTTP/1.1 Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 70 Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdqEsduYaWqKllPoko2El6R_scpkY45dWWBtQFKLsrcjad-g-oxKFz_CxRJqxXQ5wHs728euWw_61wSWAAKakL7_14gwJeVjn67-ArAMp1o_LMGPZJ-GWOEx8hLxi5lRqAweA6YvQdi5jRb5JaSyyWg9XxY8Mb0WCg9W_kYdS8n_xk Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 254b1e1fcad147e5b9e5c9457c004f93 Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1535653608 Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:17:45.866813 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:17:45.868567 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/254b1e1fcad147e5b9e5c9457c004f93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/254b1e1fcad147e5b9e5c9457c004f93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/254b1e1fcad147e5b9e5c9457c004f93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_254b1e1fcad147e5b9e5c9457c004f93"}]}] Oct 18 13:17:45.868567 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1535653608 Oct 18 13:17:45.868567 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 254b1e1fcad147e5b9e5c9457c004f93 Oct 18 13:17:45.868567 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1535653608 Oct 18 13:17:45.868567 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin Oct 18 13:17:45.868567 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:17:45.868567 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:17:45.868567 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c8b51dba0ef14ed282d24f406016ecc8 Oct 18 13:17:45.868567 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin Oct 18 13:17:45.868567 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:17:45.868567 n-d-858384-13 devstack@n-api.service[120612]: {"removeTenantAccess": {"tenant": "cf21e2280da94e3e82b213dd747b2c4e"}} Oct 18 13:17:45.868567 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: exception: Flavor access not found for 37 / cf21e2280da94e3e82b213dd747b2c4e combination. Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '1349916819', 'body': {'removeTenantAccess': {'tenant': 'cf21e2280da94e3e82b213dd747b2c4e'}}} Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 18 13:17:45.869284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 37 / cf21e2280da94e3e82b213dd747b2c4e combination. Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 37 / cf21e2280da94e3e82b213dd747b2c4e combination. Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:45.870435 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:45.871622 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:45.871622 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:45.871622 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:17:45.871622 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:17:45.871622 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 37 / cf21e2280da94e3e82b213dd747b2c4e combination. Oct 18 13:17:45.871622 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:17:45.871622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8378a7f1-dabf-48c8-b533-a46b2dae6926 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Returning 404 to user: Flavor access not found for 37 / cf21e2280da94e3e82b213dd747b2c4e combination. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:45.871622 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8378a7f1-dabf-48c8-b533-a46b2dae6926 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1349916819/action" status: 404 len: 124 microversion: 2.1 time: 1.014423 Oct 18 13:17:45.875689 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 244/453] 10.222.0.40 () {60 vars in 1200 bytes} [Tue Oct 18 13:17:44 2022] POST /compute/v2.1/flavors/1349916819/action => generated 124 bytes in 1022 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:17:45.880660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-942c8875-14cd-4fde-81dd-e44b19bb236e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:45.881307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-942c8875-14cd-4fde-81dd-e44b19bb236e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:45.912909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-942c8875-14cd-4fde-81dd-e44b19bb236e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:45.914232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-942c8875-14cd-4fde-81dd-e44b19bb236e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:45.914897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-942c8875-14cd-4fde-81dd-e44b19bb236e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:45.916061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-942c8875-14cd-4fde-81dd-e44b19bb236e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:45.916865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-942c8875-14cd-4fde-81dd-e44b19bb236e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:45.917674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-942c8875-14cd-4fde-81dd-e44b19bb236e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:46.047750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b693d23a-68de-454c-80ae-1f6ccfb67082 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:46.061639 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b693d23a-68de-454c-80ae-1f6ccfb67082 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1319 microversion: 2.1 time: 0.513431 Oct 18 13:17:46.064338 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 210/454] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:45 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:46.081118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cd31ff63-0ca9-4af9-8887-9400957dd29d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:46.090459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cd31ff63-0ca9-4af9-8887-9400957dd29d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:46.109504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd31ff63-0ca9-4af9-8887-9400957dd29d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:46.110329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd31ff63-0ca9-4af9-8887-9400957dd29d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:46.110987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd31ff63-0ca9-4af9-8887-9400957dd29d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:46.111944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd31ff63-0ca9-4af9-8887-9400957dd29d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:46.112648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd31ff63-0ca9-4af9-8887-9400957dd29d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:46.113358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd31ff63-0ca9-4af9-8887-9400957dd29d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:46.364143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-942c8875-14cd-4fde-81dd-e44b19bb236e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:46.373410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-942c8875-14cd-4fde-81dd-e44b19bb236e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:46.383835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-942c8875-14cd-4fde-81dd-e44b19bb236e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:46.388270 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-942c8875-14cd-4fde-81dd-e44b19bb236e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1361 microversion: 2.25 time: 0.511429 Oct 18 13:17:46.388868 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 245/455] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:17:45 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1361 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:17:46.408110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5609acf3-e7b7-498a-96b1-64cef748c341 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Calling method '.version_select at 0x7ff614056040>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:46.410275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5609acf3-e7b7-498a-96b1-64cef748c341 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:46.410748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5609acf3-e7b7-498a-96b1-64cef748c341 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:46.411228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5609acf3-e7b7-498a-96b1-64cef748c341 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:46.442154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5609acf3-e7b7-498a-96b1-64cef748c341 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:46.442647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5609acf3-e7b7-498a-96b1-64cef748c341 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:46.443274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5609acf3-e7b7-498a-96b1-64cef748c341 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:46.457774 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5609acf3-e7b7-498a-96b1-64cef748c341 tempest-HypervisorAdminV228Test-1743242358 tempest-HypervisorAdminV228Test-1743242358-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.063334 Oct 18 13:17:46.468135 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 246/456] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 18 13:17:46 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:17:46.473829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-67a9052c-c5ee-47fd-aa1f-7dd700169972 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:46.474637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-67a9052c-c5ee-47fd-aa1f-7dd700169972 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:46.502097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67a9052c-c5ee-47fd-aa1f-7dd700169972 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:46.502659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67a9052c-c5ee-47fd-aa1f-7dd700169972 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:46.503350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67a9052c-c5ee-47fd-aa1f-7dd700169972 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:46.504285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67a9052c-c5ee-47fd-aa1f-7dd700169972 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:46.504934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67a9052c-c5ee-47fd-aa1f-7dd700169972 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:46.505569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67a9052c-c5ee-47fd-aa1f-7dd700169972 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:46.634081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cd31ff63-0ca9-4af9-8887-9400957dd29d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:46.646118 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cd31ff63-0ca9-4af9-8887-9400957dd29d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1520 microversion: 2.1 time: 0.579355 Oct 18 13:17:46.648448 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 211/457] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:46 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1520 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:46.666925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9cfe37ee-5809-4111-8311-6d010b54c098 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:46.696932 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9cfe37ee-5809-4111-8311-6d010b54c098 tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1349916819" status: 202 len: 0 microversion: 2.1 time: 0.045332 Oct 18 13:17:46.701838 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 212/458] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 18 13:17:46 2022] DELETE /compute/v2.1/flavors/1349916819 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:17:46.708283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2a3c4ef7-a047-4342-8f04-5d965f1e79e2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Action: 'create', calling method: .version_select at 0x7ff60feb4280>, body: {"pool": null} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:47.628845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-67a9052c-c5ee-47fd-aa1f-7dd700169972 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:47.640023 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-67a9052c-c5ee-47fd-aa1f-7dd700169972 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1471 microversion: 2.1 time: 1.170438 Oct 18 13:17:47.641064 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 247/459] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:46 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1471 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:47.657562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b5974c62-4898-4392-b2f7-95357286160e tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:47.686395 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b5974c62-4898-4392-b2f7-95357286160e tempest-FlavorsAccessNegativeTestJSON-1535653608 tempest-FlavorsAccessNegativeTestJSON-1535653608-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043552 Oct 18 13:17:47.687389 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 248/460] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:17:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:47.710376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42eaa222-af30-47ec-ad97-3d10837d8292 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:47.711301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-42eaa222-af30-47ec-ad97-3d10837d8292 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:47.733592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42eaa222-af30-47ec-ad97-3d10837d8292 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:47.734366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42eaa222-af30-47ec-ad97-3d10837d8292 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:47.734913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42eaa222-af30-47ec-ad97-3d10837d8292 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:47.736066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42eaa222-af30-47ec-ad97-3d10837d8292 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:47.736770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42eaa222-af30-47ec-ad97-3d10837d8292 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:47.737502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42eaa222-af30-47ec-ad97-3d10837d8292 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:48.346767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-42eaa222-af30-47ec-ad97-3d10837d8292 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:48.357357 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-42eaa222-af30-47ec-ad97-3d10837d8292 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1319 microversion: 2.1 time: 0.649848 Oct 18 13:17:48.358148 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 249/461] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:47 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1319 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:48.372215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e1a07b32-72b0-4ddb-a30c-b2d7c1645be6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:48.373158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e1a07b32-72b0-4ddb-a30c-b2d7c1645be6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:48.393745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1a07b32-72b0-4ddb-a30c-b2d7c1645be6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:48.394324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1a07b32-72b0-4ddb-a30c-b2d7c1645be6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:48.394832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1a07b32-72b0-4ddb-a30c-b2d7c1645be6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:48.395605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1a07b32-72b0-4ddb-a30c-b2d7c1645be6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:48.396947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1a07b32-72b0-4ddb-a30c-b2d7c1645be6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:48.401056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1a07b32-72b0-4ddb-a30c-b2d7c1645be6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:48.676439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e1a07b32-72b0-4ddb-a30c-b2d7c1645be6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:48.687180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e1a07b32-72b0-4ddb-a30c-b2d7c1645be6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:48.689334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e1a07b32-72b0-4ddb-a30c-b2d7c1645be6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:48.692100 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e1a07b32-72b0-4ddb-a30c-b2d7c1645be6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1361 microversion: 2.25 time: 0.332100 Oct 18 13:17:48.712641 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 250/462] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:17:48 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1361 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:17:48.718176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-09e62fe6-69af-4ae4-8851-82987d67d9f7 req-41c19530-7c78-44a4-a6b9-acdd5851a374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1612cfab-edd0-4df2-90f2-79a1c541ca90", "name": "network-vif-plugged", "status": "completed", "tag": "7989e920-3ad6-4f7c-9ee5-6755d27b3383"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:48.737516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-09e62fe6-69af-4ae4-8851-82987d67d9f7 req-41c19530-7c78-44a4-a6b9-acdd5851a374 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:48.738268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-09e62fe6-69af-4ae4-8851-82987d67d9f7 req-41c19530-7c78-44a4-a6b9-acdd5851a374 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:48.739004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-09e62fe6-69af-4ae4-8851-82987d67d9f7 req-41c19530-7c78-44a4-a6b9-acdd5851a374 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:48.782739 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-09e62fe6-69af-4ae4-8851-82987d67d9f7 req-41c19530-7c78-44a4-a6b9-acdd5851a374 service nova] Creating event network-vif-plugged:7989e920-3ad6-4f7c-9ee5-6755d27b3383 for instance 1612cfab-edd0-4df2-90f2-79a1c541ca90 on n-h2-858384-13 Oct 18 13:17:48.788424 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-09e62fe6-69af-4ae4-8851-82987d67d9f7 req-41c19530-7c78-44a4-a6b9-acdd5851a374 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074302 Oct 18 13:17:48.789402 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 251/463] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:49.307380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1521127971", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:49.403496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:17:49.559881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=17 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:49.609732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=82,nova_cell0:UPDATE=12 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:49.818012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:17:49.819237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:17:49.819931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:17:49.820563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:17:49.821782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:17:49.834459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:49.835538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:49.836594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:49.838459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:49.839893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:49.841150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:49.903496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Getting quotas for project d15b3d39ec044d9f853b681d5886b622. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:17:49.922402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Getting quotas for user ee57dfe126fa4254b75455250e61d7be and project d15b3d39ec044d9f853b681d5886b622. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:17:49.941366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:17:49.944269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:17:50.006991 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d0bcd14f-65d8-4e18-9503-1c4be285e8d4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215111 Oct 18 13:17:50.008338 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 252/464] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:17:50.013426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1b9d2a6c-9939-4131-b609-f4cc1cf79438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:50.014527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1b9d2a6c-9939-4131-b609-f4cc1cf79438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:50.021733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b9d2a6c-9939-4131-b609-f4cc1cf79438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:50.022592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b9d2a6c-9939-4131-b609-f4cc1cf79438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:50.023259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b9d2a6c-9939-4131-b609-f4cc1cf79438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:50.024225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b9d2a6c-9939-4131-b609-f4cc1cf79438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:50.025044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b9d2a6c-9939-4131-b609-f4cc1cf79438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:50.025709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b9d2a6c-9939-4131-b609-f4cc1cf79438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:50.327658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1b9d2a6c-9939-4131-b609-f4cc1cf79438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:50.341101 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1b9d2a6c-9939-4131-b609-f4cc1cf79438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1476 microversion: 2.1 time: 0.331309 Oct 18 13:17:50.360059 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 253/465] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:50 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1476 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:50.360059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-24817fd3-1ae9-49cc-b3d2-b35acb1a78c2 req-babe39cd-ee76-41ef-b3f8-989622dd741b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e25fedd8-04af-4785-b69e-70ab95bd9649", "tag": "94413581-3b66-42c4-8f27-556772297e7e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:50.364456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-24817fd3-1ae9-49cc-b3d2-b35acb1a78c2 req-babe39cd-ee76-41ef-b3f8-989622dd741b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:50.365019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-24817fd3-1ae9-49cc-b3d2-b35acb1a78c2 req-babe39cd-ee76-41ef-b3f8-989622dd741b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:50.366418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-24817fd3-1ae9-49cc-b3d2-b35acb1a78c2 req-babe39cd-ee76-41ef-b3f8-989622dd741b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:50.383903 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-24817fd3-1ae9-49cc-b3d2-b35acb1a78c2 req-babe39cd-ee76-41ef-b3f8-989622dd741b service nova] Creating event network-changed:94413581-3b66-42c4-8f27-556772297e7e for instance e25fedd8-04af-4785-b69e-70ab95bd9649 on n-h1-858384-13 Oct 18 13:17:50.392463 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-24817fd3-1ae9-49cc-b3d2-b35acb1a78c2 req-babe39cd-ee76-41ef-b3f8-989622dd741b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048170 Oct 18 13:17:50.393611 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 254/466] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:50.403120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96d9234f-5b79-40ca-bcbc-c398a9521fd7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:50.404085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-96d9234f-5b79-40ca-bcbc-c398a9521fd7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:50.413506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96d9234f-5b79-40ca-bcbc-c398a9521fd7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:50.414294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96d9234f-5b79-40ca-bcbc-c398a9521fd7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:50.415093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96d9234f-5b79-40ca-bcbc-c398a9521fd7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:50.416460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96d9234f-5b79-40ca-bcbc-c398a9521fd7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:50.417482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96d9234f-5b79-40ca-bcbc-c398a9521fd7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:50.418166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96d9234f-5b79-40ca-bcbc-c398a9521fd7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:50.715620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-96d9234f-5b79-40ca-bcbc-c398a9521fd7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:50.725309 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-96d9234f-5b79-40ca-bcbc-c398a9521fd7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1319 microversion: 2.1 time: 0.329793 Oct 18 13:17:50.726287 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 255/467] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:50 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:50.732185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-384df4d8-0fe1-490f-8cf1-c653420bce3d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:50.733280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-384df4d8-0fe1-490f-8cf1-c653420bce3d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:50.764456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-384df4d8-0fe1-490f-8cf1-c653420bce3d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:50.765166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-384df4d8-0fe1-490f-8cf1-c653420bce3d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:50.765855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-384df4d8-0fe1-490f-8cf1-c653420bce3d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:50.766807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-384df4d8-0fe1-490f-8cf1-c653420bce3d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:50.767465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-384df4d8-0fe1-490f-8cf1-c653420bce3d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:50.768124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-384df4d8-0fe1-490f-8cf1-c653420bce3d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:51.011012 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2a3c4ef7-a047-4342-8f04-5d965f1e79e2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.307676 Oct 18 13:17:51.026041 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 213/468] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 18 13:17:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:51.029814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6f6ab755-0de0-466c-83a4-5e6bf710af7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:51.035648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6f6ab755-0de0-466c-83a4-5e6bf710af7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:51.155364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6f6ab755-0de0-466c-83a4-5e6bf710af7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:51.168918 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6f6ab755-0de0-466c-83a4-5e6bf710af7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 200 len: 1222 microversion: 2.1 time: 0.149511 Oct 18 13:17:51.182237 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 214/469] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:51 2022] GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 1222 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:51.188129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-384df4d8-0fe1-490f-8cf1-c653420bce3d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:51.205059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-384df4d8-0fe1-490f-8cf1-c653420bce3d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:51.208193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-384df4d8-0fe1-490f-8cf1-c653420bce3d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:51.209734 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-384df4d8-0fe1-490f-8cf1-c653420bce3d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1557 microversion: 2.25 time: 0.481733 Oct 18 13:17:51.228871 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 256/470] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:17:50 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1557 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:17:51.587213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4bebc855-e023-4488-b937-62b2014bcccb tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:51.588366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4bebc855-e023-4488-b937-62b2014bcccb tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:51.608509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bebc855-e023-4488-b937-62b2014bcccb tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:51.609905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bebc855-e023-4488-b937-62b2014bcccb tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:51.615070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bebc855-e023-4488-b937-62b2014bcccb tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:51.615985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bebc855-e023-4488-b937-62b2014bcccb tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:51.616469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bebc855-e023-4488-b937-62b2014bcccb tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:51.616986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bebc855-e023-4488-b937-62b2014bcccb tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:51.673802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fa0e5e13-1ebd-4912-906e-04cf6264a0b4 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:51.699091 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fa0e5e13-1ebd-4912-906e-04cf6264a0b4 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.443008 Oct 18 13:17:51.707972 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 257/471] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:17:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:51.716601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2049270343", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "a22da94d-677f-457d-bbf8-95010fd233ef"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:51.862044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] validate_networks() for [('a22da94d-677f-457d-bbf8-95010fd233ef', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:17:51.926657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:51.940485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-4bebc855-e023-4488-b937-62b2014bcccb tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid 1612cfab-edd0-4df2-90f2-79a1c541ca90 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:17:52.012939 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4bebc855-e023-4488-b937-62b2014bcccb tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 2051 microversion: 2.25 time: 0.779998 Oct 18 13:17:52.013903 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 215/472] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:17:51 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 2051 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:17:52.019170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-11fb7349-28ec-498c-bb33-241174979639 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:52.020109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-11fb7349-28ec-498c-bb33-241174979639 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:52.040844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11fb7349-28ec-498c-bb33-241174979639 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:52.042057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11fb7349-28ec-498c-bb33-241174979639 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:52.042915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11fb7349-28ec-498c-bb33-241174979639 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:52.043816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11fb7349-28ec-498c-bb33-241174979639 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:52.044977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11fb7349-28ec-498c-bb33-241174979639 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:52.045697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11fb7349-28ec-498c-bb33-241174979639 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:52.314842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-11fb7349-28ec-498c-bb33-241174979639 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:52.326157 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-11fb7349-28ec-498c-bb33-241174979639 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1476 microversion: 2.1 time: 0.310881 Oct 18 13:17:52.327373 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 216/473] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:52 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1476 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:52.752129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b2f13bc5-fb34-47f1-b055-ade872f31926 tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1650001484", "id": 1560907670, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:52.786071 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b2f13bc5-fb34-47f1-b055-ade872f31926 tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.457172 Oct 18 13:17:52.786793 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 217/474] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:52 2022] POST /compute/v2.1/flavors => generated 425 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:52.800034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-82c9daf4-3ef5-4ceb-8c9e-4e090913c22a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:52.801096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-82c9daf4-3ef5-4ceb-8c9e-4e090913c22a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:52.812825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82c9daf4-3ef5-4ceb-8c9e-4e090913c22a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:52.813737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82c9daf4-3ef5-4ceb-8c9e-4e090913c22a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:52.814476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82c9daf4-3ef5-4ceb-8c9e-4e090913c22a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:52.815418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82c9daf4-3ef5-4ceb-8c9e-4e090913c22a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:52.816138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82c9daf4-3ef5-4ceb-8c9e-4e090913c22a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:52.816902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82c9daf4-3ef5-4ceb-8c9e-4e090913c22a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:53.064741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-82c9daf4-3ef5-4ceb-8c9e-4e090913c22a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:53.080700 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-82c9daf4-3ef5-4ceb-8c9e-4e090913c22a tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1319 microversion: 2.1 time: 0.292522 Oct 18 13:17:53.089625 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 218/475] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:52 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:53.103364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a8847de2-aaaa-45ac-a925-b3faac714472 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:53.104644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a8847de2-aaaa-45ac-a925-b3faac714472 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:53.115472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8847de2-aaaa-45ac-a925-b3faac714472 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:53.116301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8847de2-aaaa-45ac-a925-b3faac714472 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:53.116917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8847de2-aaaa-45ac-a925-b3faac714472 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:53.119964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8847de2-aaaa-45ac-a925-b3faac714472 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:53.121426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8847de2-aaaa-45ac-a925-b3faac714472 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:53.122074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8847de2-aaaa-45ac-a925-b3faac714472 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:53.364111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-a8847de2-aaaa-45ac-a925-b3faac714472 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid 1612cfab-edd0-4df2-90f2-79a1c541ca90 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:17:53.382431 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a8847de2-aaaa-45ac-a925-b3faac714472 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 2051 microversion: 2.25 time: 0.291017 Oct 18 13:17:53.383443 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 219/476] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:17:53 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 2051 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:17:53.388682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ff8f788e-710c-4522-9d23-393dd9465fa1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:53.389693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ff8f788e-710c-4522-9d23-393dd9465fa1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:53.396533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff8f788e-710c-4522-9d23-393dd9465fa1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:53.397311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff8f788e-710c-4522-9d23-393dd9465fa1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:53.397938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff8f788e-710c-4522-9d23-393dd9465fa1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:53.399401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff8f788e-710c-4522-9d23-393dd9465fa1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:53.400106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff8f788e-710c-4522-9d23-393dd9465fa1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:53.400701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff8f788e-710c-4522-9d23-393dd9465fa1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:53.521677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ff8f788e-710c-4522-9d23-393dd9465fa1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:53.539246 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ff8f788e-710c-4522-9d23-393dd9465fa1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 200 len: 1280 microversion: 2.1 time: 0.154421 Oct 18 13:17:53.539877 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 220/477] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:53 2022] GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 1280 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:53.551933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-534fda1c-f7c8-4f15-9331-77bf0880a7da tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:53.572179 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-534fda1c-f7c8-4f15-9331-77bf0880a7da tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031201 Oct 18 13:17:53.572789 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 221/478] 10.222.0.40 () {58 vars in 1182 bytes} [Tue Oct 18 13:17:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:17:53.588631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2e85a5e2-2b26-47f0-806c-01e658a1dcd7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:53.589317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2e85a5e2-2b26-47f0-806c-01e658a1dcd7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:53.595738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e85a5e2-2b26-47f0-806c-01e658a1dcd7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:53.596229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e85a5e2-2b26-47f0-806c-01e658a1dcd7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:53.596691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e85a5e2-2b26-47f0-806c-01e658a1dcd7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:53.597460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e85a5e2-2b26-47f0-806c-01e658a1dcd7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:53.598075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e85a5e2-2b26-47f0-806c-01e658a1dcd7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:53.598503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e85a5e2-2b26-47f0-806c-01e658a1dcd7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:53.737010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:17:53.738149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:17:53.738801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:17:53.739408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:17:53.740013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:17:53.765446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:53.766227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:53.766820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:53.767732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:53.768356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:53.768935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:53.817765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Getting quotas for project a7b9ff58f71c425d8853ec2d0466ee3a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:17:53.833546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Getting quotas for user 9f3dcbdece5d4d4b992f4e9ebf4897d4 and project a7b9ff58f71c425d8853ec2d0466ee3a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:17:53.839927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2e85a5e2-2b26-47f0-806c-01e658a1dcd7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:53.857571 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2e85a5e2-2b26-47f0-806c-01e658a1dcd7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1476 microversion: 2.1 time: 0.280045 Oct 18 13:17:53.857571 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 222/479] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:53 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1476 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:53.887127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:17:53.890301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:17:53.994689 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7095da58-7217-46e0-93b5-36b1f6a348b6 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.285798 Oct 18 13:17:54.004219 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 258/480] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:17:54.015203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d76c4f26-48b8-45db-bfa3-53c5de303321 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:54.034962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d76c4f26-48b8-45db-bfa3-53c5de303321 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:54.035588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d76c4f26-48b8-45db-bfa3-53c5de303321 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:54.036132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d76c4f26-48b8-45db-bfa3-53c5de303321 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:54.037763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d76c4f26-48b8-45db-bfa3-53c5de303321 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:54.039032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d76c4f26-48b8-45db-bfa3-53c5de303321 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:54.040010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d76c4f26-48b8-45db-bfa3-53c5de303321 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:54.078970 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d76c4f26-48b8-45db-bfa3-53c5de303321 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.073438 Oct 18 13:17:54.079759 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 259/481] 10.222.0.40 () {60 vars in 1217 bytes} [Tue Oct 18 13:17:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:17:54.107405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-380e9916-aa09-4b80-8baf-0e970e9576a8 tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1168867868", "id": 364795411, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:54.143023 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-380e9916-aa09-4b80-8baf-0e970e9576a8 tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.061330 Oct 18 13:17:54.143635 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 260/482] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:54 2022] POST /compute/v2.1/flavors => generated 422 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:54.159662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cdc688c5-6c69-49c0-aa6e-aa86bf9fff0f tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:54.160730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cdc688c5-6c69-49c0-aa6e-aa86bf9fff0f tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:54.328327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cdc688c5-6c69-49c0-aa6e-aa86bf9fff0f tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:54.345705 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cdc688c5-6c69-49c0-aa6e-aa86bf9fff0f tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a" status: 200 len: 1224 microversion: 2.1 time: 0.199517 Oct 18 13:17:54.358070 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 261/483] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:54 2022] GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a => generated 1224 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:54.358070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3a2d754e-fe55-4fdc-8725-a3db85e617da tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-13", "block_migration": "auto"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:54.364025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3a2d754e-fe55-4fdc-8725-a3db85e617da tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:54.378256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a2d754e-fe55-4fdc-8725-a3db85e617da tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:54.380113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a2d754e-fe55-4fdc-8725-a3db85e617da tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:54.386240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a2d754e-fe55-4fdc-8725-a3db85e617da tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:54.387141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a2d754e-fe55-4fdc-8725-a3db85e617da tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:54.388059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a2d754e-fe55-4fdc-8725-a3db85e617da tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:54.388593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a2d754e-fe55-4fdc-8725-a3db85e617da tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:54.442178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-584046731", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:54.476064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-3a2d754e-fe55-4fdc-8725-a3db85e617da tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'flavor' on Instance uuid 1612cfab-edd0-4df2-90f2-79a1c541ca90 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:17:54.496621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3a2d754e-fe55-4fdc-8725-a3db85e617da tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Going to try to live migrate instance to n-h1-858384-13 {{(pid=120612) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:17:54.538996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:17:54.942844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:17:54.943265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:17:54.943743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:17:54.944152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:17:54.945869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:17:54.958838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:54.959520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:54.962323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:54.963500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:54.966685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:54.967461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:55.002609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=7 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:55.012443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Getting quotas for project 4ca31a93e6854a0fa9cc37d0bb89a3c6. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:17:55.033658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Getting quotas for user e8af3705288d46ca94bf973f16aa1bb6 and project 4ca31a93e6854a0fa9cc37d0bb89a3c6. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:17:55.076370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:17:55.081787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:17:55.230073 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fa95c61e-504a-4ce6-b7e6-18fcd01ca7c7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.361125 Oct 18 13:17:55.231169 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 223/484] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:17:55.251163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-365afd83-cf42-41ed-9953-53ee17e165f8 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:55.253461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-365afd83-cf42-41ed-9953-53ee17e165f8 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:55.261271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-365afd83-cf42-41ed-9953-53ee17e165f8 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:55.262641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-365afd83-cf42-41ed-9953-53ee17e165f8 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:55.263541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-365afd83-cf42-41ed-9953-53ee17e165f8 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:55.264740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-365afd83-cf42-41ed-9953-53ee17e165f8 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:55.265464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-365afd83-cf42-41ed-9953-53ee17e165f8 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:55.266339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-365afd83-cf42-41ed-9953-53ee17e165f8 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:55.692426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-365afd83-cf42-41ed-9953-53ee17e165f8 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:55.704544 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-365afd83-cf42-41ed-9953-53ee17e165f8 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1319 microversion: 2.1 time: 0.457741 Oct 18 13:17:55.704955 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 224/485] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:55 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:55.714068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d7c0db02-e669-4d15-9d28-895657652580 tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:55.727048 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d7c0db02-e669-4d15-9d28-895657652580 tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020451 Oct 18 13:17:55.727827 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 225/486] 10.222.0.40 () {58 vars in 1182 bytes} [Tue Oct 18 13:17:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:17:55.734271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-56808a6b-4cd6-4dae-bf1b-9b034c776b83 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:55.735169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-56808a6b-4cd6-4dae-bf1b-9b034c776b83 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:55.747596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56808a6b-4cd6-4dae-bf1b-9b034c776b83 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:55.748400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56808a6b-4cd6-4dae-bf1b-9b034c776b83 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:55.750523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56808a6b-4cd6-4dae-bf1b-9b034c776b83 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:55.752735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56808a6b-4cd6-4dae-bf1b-9b034c776b83 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:55.754059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56808a6b-4cd6-4dae-bf1b-9b034c776b83 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:55.754902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56808a6b-4cd6-4dae-bf1b-9b034c776b83 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:56.013473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-56808a6b-4cd6-4dae-bf1b-9b034c776b83 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:56.046591 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-56808a6b-4cd6-4dae-bf1b-9b034c776b83 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 200 len: 1322 microversion: 2.1 time: 0.317426 Oct 18 13:17:56.048953 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 226/487] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:55 2022] GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:56.054410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9068c32a-114e-4227-a614-ee0e7c9b95ff tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:56.055062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9068c32a-114e-4227-a614-ee0e7c9b95ff tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:56.072730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9068c32a-114e-4227-a614-ee0e7c9b95ff tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:56.073250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9068c32a-114e-4227-a614-ee0e7c9b95ff tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:56.073686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9068c32a-114e-4227-a614-ee0e7c9b95ff tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:56.074395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9068c32a-114e-4227-a614-ee0e7c9b95ff tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:56.074842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9068c32a-114e-4227-a614-ee0e7c9b95ff tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:56.075257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9068c32a-114e-4227-a614-ee0e7c9b95ff tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:56.464016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9068c32a-114e-4227-a614-ee0e7c9b95ff tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:56.479504 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9068c32a-114e-4227-a614-ee0e7c9b95ff tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1476 microversion: 2.1 time: 0.427966 Oct 18 13:17:56.480202 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 227/488] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:56 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1476 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:56.499904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b7b889ab-31d7-4d33-beed-87ff6b8dc5ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:56.500835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7b889ab-31d7-4d33-beed-87ff6b8dc5ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:56.516010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7b889ab-31d7-4d33-beed-87ff6b8dc5ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:56.517135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7b889ab-31d7-4d33-beed-87ff6b8dc5ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:56.518170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7b889ab-31d7-4d33-beed-87ff6b8dc5ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:56.523119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7b889ab-31d7-4d33-beed-87ff6b8dc5ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:56.524414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7b889ab-31d7-4d33-beed-87ff6b8dc5ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:56.525218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7b889ab-31d7-4d33-beed-87ff6b8dc5ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:56.946329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7b889ab-31d7-4d33-beed-87ff6b8dc5ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:56.966866 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b7b889ab-31d7-4d33-beed-87ff6b8dc5ec tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a" status: 200 len: 1294 microversion: 2.1 time: 0.479154 Oct 18 13:17:56.979943 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 228/489] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:56 2022] GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a => generated 1294 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:56.984137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1117611549", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:57.105476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:17:57.628592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:17:57.629012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:17:57.629532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:17:57.629933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:17:57.630343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:17:57.640928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:57.641566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:57.641997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:57.642720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:57.643177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:57.643593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:57.661986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Getting quotas for project 4ca31a93e6854a0fa9cc37d0bb89a3c6. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:17:57.667680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Getting quotas for user e8af3705288d46ca94bf973f16aa1bb6 and project 4ca31a93e6854a0fa9cc37d0bb89a3c6. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:17:57.681575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:17:57.683676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:17:57.754534 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-24181269-b596-4af8-9e7a-637bf228b5dc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783108 Oct 18 13:17:57.755571 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 229/490] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:17:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:17:57.779192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-401328ca-fb6f-40e8-8acb-67e0725d8b15 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Action: 'create', calling method: .version_select at 0x7ff60ff9c160>, body: {"keypair": {"name": "tempest-keypair-597482813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwzHbhmoOF+cnpUQhsm80mGxvRU4EFu+xGCcT64ZwS2Z5KqNNbyIBqastvfN55AXgN9io6rJQwofnnEN2StO1bUbVAbcDYo8DMfgNvKaYgl+gItdQcyOmhsIwXCxsBJgA=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:57.803503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-401328ca-fb6f-40e8-8acb-67e0725d8b15 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Getting quotas for project ef15948e13464e45ba93cb1c5922a872. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:17:57.811110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-401328ca-fb6f-40e8-8acb-67e0725d8b15 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Getting quotas for user 3a42f7285eab4c2cb58d06b302f8f185 and project ef15948e13464e45ba93cb1c5922a872. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:17:57.858770 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-401328ca-fb6f-40e8-8acb-67e0725d8b15 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.098984 Oct 18 13:17:57.860198 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 230/491] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:17:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:58.059610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-770e86d0-055b-4e80-928b-2b207a82748d tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Calling method '.version_select at 0x7ff60fe9c5e0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:58.062958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-770e86d0-055b-4e80-928b-2b207a82748d tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '368db0eafa654789967b6c2903bba22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97a215a36e24add9f3c76fce842ff7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-770e86d0-055b-4e80-928b-2b207a82748d tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Request method failure captured: Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqeCi2LqMVFSjZYg4cje9LVs0ySBmvX6Ryo21kIAtciUSdF707R6Z8OhfnTZJK9coQZOg8Z1sfqFHrjXaGj7ARhX9_lFOioRucper8x-i5qRxf7MYBwDJOyCSnZSD2adpUbuj6TfFs0YcezfMgQ4DDbOfsHHE35wOfnjsMHXFNBm_8s Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: c97a215a36e24add9f3c76fce842ff7f Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:17:58.066579 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:17:58.068294 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c97a215a36e24add9f3c76fce842ff7f"}]}] Oct 18 13:17:58.068294 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:17:58.068294 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: c97a215a36e24add9f3c76fce842ff7f Oct 18 13:17:58.068294 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:17:58.068294 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-HypervisorAdminNegativeTestJSON-562375225-project Oct 18 13:17:58.068294 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:17:58.068294 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:17:58.068294 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 368db0eafa654789967b6c2903bba22b Oct 18 13:17:58.068294 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-562375225-project Oct 18 13:17:58.068294 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:17:58.068294 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 18 13:17:58.068294 n-d-858384-13 devstack@n-api.service[120611]: action_args: {} Oct 18 13:17:58.068294 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:17:58.069238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 18 13:17:58.071131 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:58.074493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-770e86d0-055b-4e80-928b-2b207a82748d tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:58.077645 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-770e86d0-055b-4e80-928b-2b207a82748d tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.214172 Oct 18 13:17:58.079034 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 231/492] 10.222.0.40 () {58 vars in 1167 bytes} [Tue Oct 18 13:17:57 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 218 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:17:58.113721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-79f18f55-65d9-4054-b6ea-8014b881e9c7 req-962c3a05-1309-469a-a516-181d5dbedba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25fedd8-04af-4785-b69e-70ab95bd9649", "name": "network-vif-plugged", "status": "completed", "tag": "94413581-3b66-42c4-8f27-556772297e7e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:58.133275 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3a2d754e-fe55-4fdc-8725-a3db85e617da tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90/action" status: 202 len: 0 microversion: 2.25 time: 3.784373 Oct 18 13:17:58.134231 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 262/493] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:17:54 2022] POST /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90/action => generated 0 bytes in 3786 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:17:58.141921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b18c810b-8dea-49e6-ad4d-e5144654db2d req-a3b13c61-7821-4259-9bb5-9cb1cde7533b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a279ff8b-eb06-4bb1-b9d4-f92566e98422", "tag": "4cfb37b8-4b2c-46de-ab6d-9c082187a0c1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:17:58.161288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-79f18f55-65d9-4054-b6ea-8014b881e9c7 req-962c3a05-1309-469a-a516-181d5dbedba1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:58.161971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-79f18f55-65d9-4054-b6ea-8014b881e9c7 req-962c3a05-1309-469a-a516-181d5dbedba1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:58.167153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-79f18f55-65d9-4054-b6ea-8014b881e9c7 req-962c3a05-1309-469a-a516-181d5dbedba1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:58.193426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b18c810b-8dea-49e6-ad4d-e5144654db2d req-a3b13c61-7821-4259-9bb5-9cb1cde7533b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:58.194193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b18c810b-8dea-49e6-ad4d-e5144654db2d req-a3b13c61-7821-4259-9bb5-9cb1cde7533b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:58.195243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b18c810b-8dea-49e6-ad4d-e5144654db2d req-a3b13c61-7821-4259-9bb5-9cb1cde7533b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:58.221564 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-79f18f55-65d9-4054-b6ea-8014b881e9c7 req-962c3a05-1309-469a-a516-181d5dbedba1 service nova] Creating event network-vif-plugged:94413581-3b66-42c4-8f27-556772297e7e for instance e25fedd8-04af-4785-b69e-70ab95bd9649 on n-h1-858384-13 Oct 18 13:17:58.236991 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-79f18f55-65d9-4054-b6ea-8014b881e9c7 req-962c3a05-1309-469a-a516-181d5dbedba1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148171 Oct 18 13:17:58.238612 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b18c810b-8dea-49e6-ad4d-e5144654db2d req-a3b13c61-7821-4259-9bb5-9cb1cde7533b service nova] Creating event network-changed:4cfb37b8-4b2c-46de-ab6d-9c082187a0c1 for instance a279ff8b-eb06-4bb1-b9d4-f92566e98422 on n-h2-858384-13 Oct 18 13:17:58.239573 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 232/494] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:58.251925 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b18c810b-8dea-49e6-ad4d-e5144654db2d req-a3b13c61-7821-4259-9bb5-9cb1cde7533b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115898 Oct 18 13:17:58.258877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1b8d268-c6c4-4b36-990b-ac93de107333 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:58.259860 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 263/495] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:58.261879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e1b8d268-c6c4-4b36-990b-ac93de107333 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:58.270552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c58e640f-3ad6-49fb-ad76-8cf1b205a4c4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:58.271266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c58e640f-3ad6-49fb-ad76-8cf1b205a4c4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:58.276065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1b8d268-c6c4-4b36-990b-ac93de107333 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:58.276588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1b8d268-c6c4-4b36-990b-ac93de107333 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:58.277053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1b8d268-c6c4-4b36-990b-ac93de107333 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:58.286625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1b8d268-c6c4-4b36-990b-ac93de107333 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:58.288690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1b8d268-c6c4-4b36-990b-ac93de107333 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:58.290819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1b8d268-c6c4-4b36-990b-ac93de107333 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:58.303307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c58e640f-3ad6-49fb-ad76-8cf1b205a4c4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:58.306777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c58e640f-3ad6-49fb-ad76-8cf1b205a4c4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:58.307240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c58e640f-3ad6-49fb-ad76-8cf1b205a4c4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:58.307988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c58e640f-3ad6-49fb-ad76-8cf1b205a4c4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:58.308453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c58e640f-3ad6-49fb-ad76-8cf1b205a4c4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:58.314334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c58e640f-3ad6-49fb-ad76-8cf1b205a4c4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:58.656806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e1b8d268-c6c4-4b36-990b-ac93de107333 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:58.671309 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e1b8d268-c6c4-4b36-990b-ac93de107333 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1319 microversion: 2.1 time: 0.430190 Oct 18 13:17:58.687593 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 233/496] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:58 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1319 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:58.734024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-55cb192a-bad3-4add-a5bd-7fd2b6bfdf81 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:58.736494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-55cb192a-bad3-4add-a5bd-7fd2b6bfdf81 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:58.755646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55cb192a-bad3-4add-a5bd-7fd2b6bfdf81 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:58.756194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55cb192a-bad3-4add-a5bd-7fd2b6bfdf81 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:58.756580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55cb192a-bad3-4add-a5bd-7fd2b6bfdf81 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:58.757724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55cb192a-bad3-4add-a5bd-7fd2b6bfdf81 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:58.759308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55cb192a-bad3-4add-a5bd-7fd2b6bfdf81 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:58.759985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55cb192a-bad3-4add-a5bd-7fd2b6bfdf81 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.146618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-55cb192a-bad3-4add-a5bd-7fd2b6bfdf81 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:59.155900 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-55cb192a-bad3-4add-a5bd-7fd2b6bfdf81 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1476 microversion: 2.1 time: 0.438229 Oct 18 13:17:59.170736 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 234/497] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:58 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1476 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:59.179648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c58e640f-3ad6-49fb-ad76-8cf1b205a4c4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:59.187624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-07888320-1432-45f2-8846-60a7d0afbb9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:59.192445 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c58e640f-3ad6-49fb-ad76-8cf1b205a4c4 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 200 len: 1322 microversion: 2.1 time: 0.931244 Oct 18 13:17:59.193292 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 264/498] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:58 2022] GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 1322 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:59.210548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-07888320-1432-45f2-8846-60a7d0afbb9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:59.218888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9f7a50c3-69f5-4253-b156-078d92848be5 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:59.219513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9f7a50c3-69f5-4253-b156-078d92848be5 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:59.224611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07888320-1432-45f2-8846-60a7d0afbb9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.225754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07888320-1432-45f2-8846-60a7d0afbb9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.227495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07888320-1432-45f2-8846-60a7d0afbb9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.228234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07888320-1432-45f2-8846-60a7d0afbb9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.228701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07888320-1432-45f2-8846-60a7d0afbb9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.229131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07888320-1432-45f2-8846-60a7d0afbb9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.236680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f7a50c3-69f5-4253-b156-078d92848be5 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.240443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f7a50c3-69f5-4253-b156-078d92848be5 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.240903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f7a50c3-69f5-4253-b156-078d92848be5 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.241703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f7a50c3-69f5-4253-b156-078d92848be5 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.242186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f7a50c3-69f5-4253-b156-078d92848be5 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.242704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f7a50c3-69f5-4253-b156-078d92848be5 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.255171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:59.346683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-07888320-1432-45f2-8846-60a7d0afbb9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:59.356395 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-07888320-1432-45f2-8846-60a7d0afbb9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 200 len: 1266 microversion: 2.1 time: 0.184134 Oct 18 13:17:59.357579 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 235/499] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:59 2022] GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:59.377384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5a0cc933-39ad-44ab-b455-e8ccf8b1c6dc tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Calling method '.version_select at 0x7ff60feb4f70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:59.379466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5a0cc933-39ad-44ab-b455-e8ccf8b1c6dc tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '368db0eafa654789967b6c2903bba22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97a215a36e24add9f3c76fce842ff7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5a0cc933-39ad-44ab-b455-e8ccf8b1c6dc tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Request method failure captured: Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqeCi2LqMVFSjZYg4cje9LVs0ySBmvX6Ryo21kIAtciUSdF707R6Z8OhfnTZJK9coQZOg8Z1sfqFHrjXaGj7ARhX9_lFOioRucper8x-i5qRxf7MYBwDJOyCSnZSD2adpUbuj6TfFs0YcezfMgQ4DDbOfsHHE35wOfnjsMHXFNBm_8s Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: c97a215a36e24add9f3c76fce842ff7f Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:17:59.381374 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:17:59.382687 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c97a215a36e24add9f3c76fce842ff7f"}]}] Oct 18 13:17:59.382687 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:17:59.382687 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: c97a215a36e24add9f3c76fce842ff7f Oct 18 13:17:59.382687 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:17:59.382687 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-HypervisorAdminNegativeTestJSON-562375225-project Oct 18 13:17:59.382687 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:17:59.382687 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:17:59.382687 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 368db0eafa654789967b6c2903bba22b Oct 18 13:17:59.382687 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-562375225-project Oct 18 13:17:59.382687 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:17:59.382687 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 18 13:17:59.382687 n-d-858384-13 devstack@n-api.service[120611]: action_args: {} Oct 18 13:17:59.382687 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:17:59.384068 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 18 13:17:59.385126 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.386234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5a0cc933-39ad-44ab-b455-e8ccf8b1c6dc tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:59.386234 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5a0cc933-39ad-44ab-b455-e8ccf8b1c6dc tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.024815 Oct 18 13:17:59.391310 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 236/500] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:17:59 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:17:59.398327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f67e3fe3-470c-40d3-9f11-233922a48cf0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:59.399805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f67e3fe3-470c-40d3-9f11-233922a48cf0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:59.407909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f67e3fe3-470c-40d3-9f11-233922a48cf0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.408712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f67e3fe3-470c-40d3-9f11-233922a48cf0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.409315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f67e3fe3-470c-40d3-9f11-233922a48cf0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.410122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f67e3fe3-470c-40d3-9f11-233922a48cf0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.410642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f67e3fe3-470c-40d3-9f11-233922a48cf0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.411129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f67e3fe3-470c-40d3-9f11-233922a48cf0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.642467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f67e3fe3-470c-40d3-9f11-233922a48cf0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:59.659209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f67e3fe3-470c-40d3-9f11-233922a48cf0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:59.663425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f67e3fe3-470c-40d3-9f11-233922a48cf0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:59.666087 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f67e3fe3-470c-40d3-9f11-233922a48cf0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1567 microversion: 2.25 time: 0.274171 Oct 18 13:17:59.666901 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 237/501] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:17:59 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:17:59.681456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-da387399-8fe5-4981-b82e-ea015162ffef tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Calling method '.version_select at 0x7ff60ffb2a60>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:59.685870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-da387399-8fe5-4981-b82e-ea015162ffef tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '368db0eafa654789967b6c2903bba22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97a215a36e24add9f3c76fce842ff7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-da387399-8fe5-4981-b82e-ea015162ffef tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Request method failure captured: Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqeCi2LqMVFSjZYg4cje9LVs0ySBmvX6Ryo21kIAtciUSdF707R6Z8OhfnTZJK9coQZOg8Z1sfqFHrjXaGj7ARhX9_lFOioRucper8x-i5qRxf7MYBwDJOyCSnZSD2adpUbuj6TfFs0YcezfMgQ4DDbOfsHHE35wOfnjsMHXFNBm_8s Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: c97a215a36e24add9f3c76fce842ff7f Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:17:59.689747 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:17:59.690998 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c97a215a36e24add9f3c76fce842ff7f"}]}] Oct 18 13:17:59.690998 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:17:59.690998 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: c97a215a36e24add9f3c76fce842ff7f Oct 18 13:17:59.690998 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:17:59.690998 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-HypervisorAdminNegativeTestJSON-562375225-project Oct 18 13:17:59.690998 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:17:59.690998 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:17:59.690998 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 368db0eafa654789967b6c2903bba22b Oct 18 13:17:59.690998 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-562375225-project Oct 18 13:17:59.690998 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:17:59.690998 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 18 13:17:59.690998 n-d-858384-13 devstack@n-api.service[120611]: action_args: {} Oct 18 13:17:59.690998 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:17:59.691755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 18 13:17:59.692805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.695908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-da387399-8fe5-4981-b82e-ea015162ffef tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:59.697030 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-da387399-8fe5-4981-b82e-ea015162ffef tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.027659 Oct 18 13:17:59.697710 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 238/502] 10.222.0.40 () {58 vars in 1179 bytes} [Tue Oct 18 13:17:59 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:17:59.709173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9f7a50c3-69f5-4253-b156-078d92848be5 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:59.718514 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9f7a50c3-69f5-4253-b156-078d92848be5 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a" status: 200 len: 1324 microversion: 2.1 time: 0.508969 Oct 18 13:17:59.724739 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 265/503] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:59 2022] GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a => generated 1324 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:17:59.736010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ffa0733c-96ce-402d-a891-758648d232a9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:59.740146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ffa0733c-96ce-402d-a891-758648d232a9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:17:59.749236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa0733c-96ce-402d-a891-758648d232a9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.750081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa0733c-96ce-402d-a891-758648d232a9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.750518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa0733c-96ce-402d-a891-758648d232a9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.751222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa0733c-96ce-402d-a891-758648d232a9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.751957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa0733c-96ce-402d-a891-758648d232a9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.752587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa0733c-96ce-402d-a891-758648d232a9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.803453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68202cf7-f585-4cd0-8136-d6f1ab64a1a2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Calling method '.version_select at 0x7ff60feb45e0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:59.806673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68202cf7-f585-4cd0-8136-d6f1ab64a1a2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.807450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68202cf7-f585-4cd0-8136-d6f1ab64a1a2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.808288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68202cf7-f585-4cd0-8136-d6f1ab64a1a2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.826668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68202cf7-f585-4cd0-8136-d6f1ab64a1a2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.827522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68202cf7-f585-4cd0-8136-d6f1ab64a1a2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.828177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68202cf7-f585-4cd0-8136-d6f1ab64a1a2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.847049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68202cf7-f585-4cd0-8136-d6f1ab64a1a2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.847685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68202cf7-f585-4cd0-8136-d6f1ab64a1a2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.848360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68202cf7-f585-4cd0-8136-d6f1ab64a1a2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.857245 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68202cf7-f585-4cd0-8136-d6f1ab64a1a2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.152816 Oct 18 13:17:59.857922 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 239/504] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:17:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:17:59.871242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d90c579d-7c0e-4ce5-a2f0-5dac559d37b2 tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Calling method '.version_select at 0x7ff60ff05b80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:59.873856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d90c579d-7c0e-4ce5-a2f0-5dac559d37b2 tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '368db0eafa654789967b6c2903bba22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97a215a36e24add9f3c76fce842ff7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d90c579d-7c0e-4ce5-a2f0-5dac559d37b2 tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Request method failure captured: Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqeCi2LqMVFSjZYg4cje9LVs0ySBmvX6Ryo21kIAtciUSdF707R6Z8OhfnTZJK9coQZOg8Z1sfqFHrjXaGj7ARhX9_lFOioRucper8x-i5qRxf7MYBwDJOyCSnZSD2adpUbuj6TfFs0YcezfMgQ4DDbOfsHHE35wOfnjsMHXFNBm_8s Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: c97a215a36e24add9f3c76fce842ff7f Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:17:59.875951 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:17:59.877226 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c97a215a36e24add9f3c76fce842ff7f"}]}] Oct 18 13:17:59.877226 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:17:59.877226 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: c97a215a36e24add9f3c76fce842ff7f Oct 18 13:17:59.877226 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:17:59.877226 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-HypervisorAdminNegativeTestJSON-562375225-project Oct 18 13:17:59.877226 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:17:59.877226 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:17:59.877226 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 368db0eafa654789967b6c2903bba22b Oct 18 13:17:59.877226 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-562375225-project Oct 18 13:17:59.877226 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:17:59.877226 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 18 13:17:59.877226 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '1'} Oct 18 13:17:59.877226 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:17:59.878003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 18 13:17:59.879065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.882037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d90c579d-7c0e-4ce5-a2f0-5dac559d37b2 tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:59.884476 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d90c579d-7c0e-4ce5-a2f0-5dac559d37b2 tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.018404 Oct 18 13:17:59.885676 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 240/505] 10.222.0.40 () {58 vars in 1173 bytes} [Tue Oct 18 13:17:59 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:17:59.896096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-de1cbf8a-202e-4663-a87c-84edbaacdfd2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Calling method '.version_select at 0x7ff60ffb20d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:59.899716 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-de1cbf8a-202e-4663-a87c-84edbaacdfd2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] HTTP exception thrown: Hypervisor with ID '1196ef7b-f092-4c1c-a367-ea2a762111f4' could not be found. Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-de1cbf8a-202e-4663-a87c-84edbaacdfd2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Request method failure captured: Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-hypervisors/1196ef7b-f092-4c1c-a367-ea2a762111f4/uptime HTTP/1.1 Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqeDDmr4rdhQSu7im6trNTNW9cpBlE51vCeSk80VsrHxbDEA1ekMjhcEBXMgCSuPTUTfPuAJDs7IA2dEMnOAIPtsZhOovathUAmkIO_nUb9lUa_dBwFYvXGg4B_z38DfO4r8unwqjEmyQwyG1AGBtmlPkXbqc4giwJPL5waQSL97_kY Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7659731d49204f2ea0c51c20ad477f69 Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-635322195 Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:17:59.918245 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:17:59.919655 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7659731d49204f2ea0c51c20ad477f69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7659731d49204f2ea0c51c20ad477f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7659731d49204f2ea0c51c20ad477f69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7659731d49204f2ea0c51c20ad477f69"}]}] Oct 18 13:17:59.919655 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-635322195 Oct 18 13:17:59.919655 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7659731d49204f2ea0c51c20ad477f69 Oct 18 13:17:59.919655 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-635322195 Oct 18 13:17:59.919655 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin Oct 18 13:17:59.919655 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:17:59.919655 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:17:59.919655 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 53a65e3ef6ff49b78162653f0113bef4 Oct 18 13:17:59.919655 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin Oct 18 13:17:59.919655 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:17:59.919655 n-d-858384-13 devstack@n-api.service[120611]: exception: Hypervisor with ID '1196ef7b-f092-4c1c-a367-ea2a762111f4' could not be found. Oct 18 13:17:59.919655 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '1196ef7b-f092-4c1c-a367-ea2a762111f4'} Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '1196ef7b-f092-4c1c-a367-ea2a762111f4' Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 18 13:17:59.920395 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '1196ef7b-f092-4c1c-a367-ea2a762111f4' could not be found. Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:17:59.921771 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.923562 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:17:59.923562 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:17:59.923562 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:17:59.923562 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:17:59.923562 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:17:59.923562 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '1196ef7b-f092-4c1c-a367-ea2a762111f4' could not be found. Oct 18 13:17:59.923562 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:17:59.923562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-de1cbf8a-202e-4663-a87c-84edbaacdfd2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Returning 404 to user: Hypervisor with ID '1196ef7b-f092-4c1c-a367-ea2a762111f4' could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:17:59.925416 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-de1cbf8a-202e-4663-a87c-84edbaacdfd2 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1196ef7b-f092-4c1c-a367-ea2a762111f4/uptime" status: 404 len: 123 microversion: 2.1 time: 0.033608 Oct 18 13:17:59.930479 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 241/506] 10.222.0.40 () {58 vars in 1278 bytes} [Tue Oct 18 13:17:59 2022] GET /compute/v2.1/os-hypervisors/1196ef7b-f092-4c1c-a367-ea2a762111f4/uptime => generated 123 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:17:59.937994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-63f5cff4-2b4e-46e4-97fb-468b7a747f22 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Calling method '.version_select at 0x7ff60ffb21f0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:17:59.940192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63f5cff4-2b4e-46e4-97fb-468b7a747f22 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.940924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63f5cff4-2b4e-46e4-97fb-468b7a747f22 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.942321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63f5cff4-2b4e-46e4-97fb-468b7a747f22 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.960742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63f5cff4-2b4e-46e4-97fb-468b7a747f22 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.962322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63f5cff4-2b4e-46e4-97fb-468b7a747f22 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.962960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63f5cff4-2b4e-46e4-97fb-468b7a747f22 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.977904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63f5cff4-2b4e-46e4-97fb-468b7a747f22 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:17:59.978578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63f5cff4-2b4e-46e4-97fb-468b7a747f22 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:17:59.979081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63f5cff4-2b4e-46e4-97fb-468b7a747f22 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:17:59.982841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:17:59.987601 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-63f5cff4-2b4e-46e4-97fb-468b7a747f22 tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.055035 Oct 18 13:17:59.988532 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 242/507] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:17:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:00.000751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b86e04d5-95c4-4963-acfe-36d09eaaa34c tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Calling method '.version_select at 0x7ff60ff05ca0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:00.003084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b86e04d5-95c4-4963-acfe-36d09eaaa34c tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '368db0eafa654789967b6c2903bba22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97a215a36e24add9f3c76fce842ff7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b86e04d5-95c4-4963-acfe-36d09eaaa34c tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Request method failure captured: Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqeCi2LqMVFSjZYg4cje9LVs0ySBmvX6Ryo21kIAtciUSdF707R6Z8OhfnTZJK9coQZOg8Z1sfqFHrjXaGj7ARhX9_lFOioRucper8x-i5qRxf7MYBwDJOyCSnZSD2adpUbuj6TfFs0YcezfMgQ4DDbOfsHHE35wOfnjsMHXFNBm_8s Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: c97a215a36e24add9f3c76fce842ff7f Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:18:00.004792 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:18:00.006137 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c97a215a36e24add9f3c76fce842ff7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c97a215a36e24add9f3c76fce842ff7f"}]}] Oct 18 13:18:00.006137 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:18:00.006137 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: c97a215a36e24add9f3c76fce842ff7f Oct 18 13:18:00.006137 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-562375225 Oct 18 13:18:00.006137 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-HypervisorAdminNegativeTestJSON-562375225-project Oct 18 13:18:00.006137 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:00.006137 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:00.006137 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 368db0eafa654789967b6c2903bba22b Oct 18 13:18:00.006137 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-562375225-project Oct 18 13:18:00.006137 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:18:00.006137 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 18 13:18:00.006137 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '1'} Oct 18 13:18:00.006137 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:18:00.006866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 18 13:18:00.007972 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:00.010908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b86e04d5-95c4-4963-acfe-36d09eaaa34c tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:00.010908 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b86e04d5-95c4-4963-acfe-36d09eaaa34c tempest-HypervisorAdminNegativeTestJSON-562375225 tempest-HypervisorAdminNegativeTestJSON-562375225-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.009905 Oct 18 13:18:00.010908 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 243/508] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:17:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:18:00.016701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f06a5f9b-0373-4fe4-8373-235f531c2d9d tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Calling method '.version_select at 0x7ff60fe9ce50>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:00.018738 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-f06a5f9b-0373-4fe4-8373-235f531c2d9d tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] HTTP exception thrown: Hypervisor with ID 'f33a291c-0889-4d45-94d6-4f3f5aac5ea3' could not be found. Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f06a5f9b-0373-4fe4-8373-235f531c2d9d tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Request method failure captured: Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-hypervisors/f33a291c-0889-4d45-94d6-4f3f5aac5ea3 HTTP/1.1 Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqeDDmr4rdhQSu7im6trNTNW9cpBlE51vCeSk80VsrHxbDEA1ekMjhcEBXMgCSuPTUTfPuAJDs7IA2dEMnOAIPtsZhOovathUAmkIO_nUb9lUa_dBwFYvXGg4B_z38DfO4r8unwqjEmyQwyG1AGBtmlPkXbqc4giwJPL5waQSL97_kY Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7659731d49204f2ea0c51c20ad477f69 Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-635322195 Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:18:00.020859 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:18:00.023889 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7659731d49204f2ea0c51c20ad477f69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7659731d49204f2ea0c51c20ad477f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7659731d49204f2ea0c51c20ad477f69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7659731d49204f2ea0c51c20ad477f69"}]}] Oct 18 13:18:00.023889 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-635322195 Oct 18 13:18:00.023889 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7659731d49204f2ea0c51c20ad477f69 Oct 18 13:18:00.023889 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-635322195 Oct 18 13:18:00.023889 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin Oct 18 13:18:00.023889 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:00.023889 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:00.023889 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 53a65e3ef6ff49b78162653f0113bef4 Oct 18 13:18:00.023889 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin Oct 18 13:18:00.023889 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:18:00.023889 n-d-858384-13 devstack@n-api.service[120611]: exception: Hypervisor with ID 'f33a291c-0889-4d45-94d6-4f3f5aac5ea3' could not be found. Oct 18 13:18:00.023889 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f33a291c-0889-4d45-94d6-4f3f5aac5ea3'} Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f33a291c-0889-4d45-94d6-4f3f5aac5ea3' Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 18 13:18:00.024692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:18:00.029664 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f33a291c-0889-4d45-94d6-4f3f5aac5ea3' could not be found. Oct 18 13:18:00.034230 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:00.034230 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:00.034230 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:00.034230 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:00.034230 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:00.034230 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:00.034230 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:00.034230 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:00.034230 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f33a291c-0889-4d45-94d6-4f3f5aac5ea3' could not be found. Oct 18 13:18:00.034230 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:00.034230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f06a5f9b-0373-4fe4-8373-235f531c2d9d tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] Returning 404 to user: Hypervisor with ID 'f33a291c-0889-4d45-94d6-4f3f5aac5ea3' could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:00.034230 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f06a5f9b-0373-4fe4-8373-235f531c2d9d tempest-HypervisorAdminNegativeTestJSON-635322195 tempest-HypervisorAdminNegativeTestJSON-635322195-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/f33a291c-0889-4d45-94d6-4f3f5aac5ea3" status: 404 len: 123 microversion: 2.1 time: 0.009685 Oct 18 13:18:00.034230 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 244/509] 10.222.0.40 () {58 vars in 1257 bytes} [Tue Oct 18 13:18:00 2022] GET /compute/v2.1/os-hypervisors/f33a291c-0889-4d45-94d6-4f3f5aac5ea3 => generated 123 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:18:00.077078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-e63f79bb-9066-43e3-b067-1ced64e91fe7 req-4d9b126f-b0b8-441d-a93a-e74a724c7b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e257aea-4f80-4311-8216-9f3b8481507a", "tag": "c2e5c8e4-7e8d-4b38-9402-17b57d852e09"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:00.098098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e63f79bb-9066-43e3-b067-1ced64e91fe7 req-4d9b126f-b0b8-441d-a93a-e74a724c7b71 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:00.098591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e63f79bb-9066-43e3-b067-1ced64e91fe7 req-4d9b126f-b0b8-441d-a93a-e74a724c7b71 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:00.099028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e63f79bb-9066-43e3-b067-1ced64e91fe7 req-4d9b126f-b0b8-441d-a93a-e74a724c7b71 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:00.126478 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-e63f79bb-9066-43e3-b067-1ced64e91fe7 req-4d9b126f-b0b8-441d-a93a-e74a724c7b71 service nova] Creating event network-changed:c2e5c8e4-7e8d-4b38-9402-17b57d852e09 for instance 4e257aea-4f80-4311-8216-9f3b8481507a on n-h2-858384-13 Oct 18 13:18:00.135989 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-e63f79bb-9066-43e3-b067-1ced64e91fe7 req-4d9b126f-b0b8-441d-a93a-e74a724c7b71 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062627 Oct 18 13:18:00.137974 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 245/510] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:00.189239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9de2b88c-32a4-469d-89d0-e386494931c1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:00.189239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9de2b88c-32a4-469d-89d0-e386494931c1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:00.202854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9de2b88c-32a4-469d-89d0-e386494931c1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:00.204483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9de2b88c-32a4-469d-89d0-e386494931c1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:00.205488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9de2b88c-32a4-469d-89d0-e386494931c1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:00.212027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9de2b88c-32a4-469d-89d0-e386494931c1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:00.212972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9de2b88c-32a4-469d-89d0-e386494931c1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:00.213650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9de2b88c-32a4-469d-89d0-e386494931c1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:00.600203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ffa0733c-96ce-402d-a891-758648d232a9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:00.610776 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ffa0733c-96ce-402d-a891-758648d232a9 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1319 microversion: 2.1 time: 0.881457 Oct 18 13:18:00.611827 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 266/511] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:17:59 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1319 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:00.619632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b46d6af8-1428-4936-b153-b4796c0f3cb1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:00.620881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b46d6af8-1428-4936-b153-b4796c0f3cb1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:00.636390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b46d6af8-1428-4936-b153-b4796c0f3cb1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:00.637645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b46d6af8-1428-4936-b153-b4796c0f3cb1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:00.638339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b46d6af8-1428-4936-b153-b4796c0f3cb1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:00.640008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b46d6af8-1428-4936-b153-b4796c0f3cb1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:00.641388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b46d6af8-1428-4936-b153-b4796c0f3cb1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:00.642108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b46d6af8-1428-4936-b153-b4796c0f3cb1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:01.042564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9de2b88c-32a4-469d-89d0-e386494931c1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:01.059632 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9de2b88c-32a4-469d-89d0-e386494931c1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1476 microversion: 2.1 time: 0.877934 Oct 18 13:18:01.060958 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 246/512] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:00 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1476 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:01.070062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-587a4151-ce77-4105-a1f1-640107747326 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:01.071637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-587a4151-ce77-4105-a1f1-640107747326 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:01.101195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b46d6af8-1428-4936-b153-b4796c0f3cb1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:01.114986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587a4151-ce77-4105-a1f1-640107747326 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:01.116838 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b46d6af8-1428-4936-b153-b4796c0f3cb1 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 200 len: 1322 microversion: 2.1 time: 0.503733 Oct 18 13:18:01.118124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587a4151-ce77-4105-a1f1-640107747326 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:01.119385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587a4151-ce77-4105-a1f1-640107747326 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:01.119611 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 267/513] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:00 2022] GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:01.120966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587a4151-ce77-4105-a1f1-640107747326 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:01.121729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587a4151-ce77-4105-a1f1-640107747326 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:01.122413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587a4151-ce77-4105-a1f1-640107747326 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:01.149450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ec777269-3947-4725-96f2-d9a87ea795b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:01.150198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ec777269-3947-4725-96f2-d9a87ea795b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:01.152193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=4,nova_api:INSERT=8 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:01.160135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec777269-3947-4725-96f2-d9a87ea795b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:01.160791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec777269-3947-4725-96f2-d9a87ea795b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:01.161250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec777269-3947-4725-96f2-d9a87ea795b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:01.162180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec777269-3947-4725-96f2-d9a87ea795b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:01.162887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec777269-3947-4725-96f2-d9a87ea795b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:01.163490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec777269-3947-4725-96f2-d9a87ea795b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:01.324747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-587a4151-ce77-4105-a1f1-640107747326 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:01.333164 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-587a4151-ce77-4105-a1f1-640107747326 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 200 len: 1272 microversion: 2.1 time: 0.270219 Oct 18 13:18:01.339065 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 247/514] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:01 2022] GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:01.344131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bdcd698d-2b5e-4235-bc7e-ee8fe6d41219 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:01.344734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bdcd698d-2b5e-4235-bc7e-ee8fe6d41219 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:01.357855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdcd698d-2b5e-4235-bc7e-ee8fe6d41219 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:01.358344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdcd698d-2b5e-4235-bc7e-ee8fe6d41219 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:01.358778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdcd698d-2b5e-4235-bc7e-ee8fe6d41219 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:01.359484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdcd698d-2b5e-4235-bc7e-ee8fe6d41219 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:01.359918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdcd698d-2b5e-4235-bc7e-ee8fe6d41219 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:01.360338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdcd698d-2b5e-4235-bc7e-ee8fe6d41219 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:01.640752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ec777269-3947-4725-96f2-d9a87ea795b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:01.655855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ec777269-3947-4725-96f2-d9a87ea795b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:01.658338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ec777269-3947-4725-96f2-d9a87ea795b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:01.661107 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ec777269-3947-4725-96f2-d9a87ea795b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1567 microversion: 2.25 time: 0.524876 Oct 18 13:18:01.662341 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 268/515] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:01 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1567 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:01.668316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-463f8059-6e64-421f-a84d-dfa5edfed16f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:01.669128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-463f8059-6e64-421f-a84d-dfa5edfed16f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:01.682600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-463f8059-6e64-421f-a84d-dfa5edfed16f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:01.682600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-463f8059-6e64-421f-a84d-dfa5edfed16f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:01.682973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-463f8059-6e64-421f-a84d-dfa5edfed16f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:01.683878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-463f8059-6e64-421f-a84d-dfa5edfed16f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:01.684338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-463f8059-6e64-421f-a84d-dfa5edfed16f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:01.684844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-463f8059-6e64-421f-a84d-dfa5edfed16f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:01.879283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bdcd698d-2b5e-4235-bc7e-ee8fe6d41219 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:01.902496 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bdcd698d-2b5e-4235-bc7e-ee8fe6d41219 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a" status: 200 len: 1324 microversion: 2.1 time: 0.562180 Oct 18 13:18:01.903339 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 248/516] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:01 2022] GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a => generated 1324 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:02.099611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b16e1d14-03e6-4377-a85f-f778ac9ab475 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:02.101069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b16e1d14-03e6-4377-a85f-f778ac9ab475 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:02.112193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b16e1d14-03e6-4377-a85f-f778ac9ab475 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:02.112970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b16e1d14-03e6-4377-a85f-f778ac9ab475 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:02.113447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b16e1d14-03e6-4377-a85f-f778ac9ab475 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:02.114329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b16e1d14-03e6-4377-a85f-f778ac9ab475 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:02.114783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b16e1d14-03e6-4377-a85f-f778ac9ab475 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:02.115204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b16e1d14-03e6-4377-a85f-f778ac9ab475 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:02.204382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-463f8059-6e64-421f-a84d-dfa5edfed16f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:02.216579 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-463f8059-6e64-421f-a84d-dfa5edfed16f tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1468 microversion: 2.1 time: 0.552531 Oct 18 13:18:02.217220 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 269/517] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:01 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1468 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:02.228547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ba401558-9787-4fb3-a55c-b1f449e3403a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:02.229566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ba401558-9787-4fb3-a55c-b1f449e3403a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:02.244313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba401558-9787-4fb3-a55c-b1f449e3403a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:02.244823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba401558-9787-4fb3-a55c-b1f449e3403a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:02.245297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba401558-9787-4fb3-a55c-b1f449e3403a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:02.246801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba401558-9787-4fb3-a55c-b1f449e3403a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:02.247273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba401558-9787-4fb3-a55c-b1f449e3403a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:02.247735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba401558-9787-4fb3-a55c-b1f449e3403a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:02.485993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b16e1d14-03e6-4377-a85f-f778ac9ab475 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:02.506873 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b16e1d14-03e6-4377-a85f-f778ac9ab475 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1476 microversion: 2.1 time: 0.414897 Oct 18 13:18:02.507479 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 249/518] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:02 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1476 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:02.520062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4c56cc6-d430-44e2-8e08-89f0e5e2cf1b tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:02.520603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e4c56cc6-d430-44e2-8e08-89f0e5e2cf1b tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:02.536199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4c56cc6-d430-44e2-8e08-89f0e5e2cf1b tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:02.540362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4c56cc6-d430-44e2-8e08-89f0e5e2cf1b tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:02.541486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4c56cc6-d430-44e2-8e08-89f0e5e2cf1b tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:02.541614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4c56cc6-d430-44e2-8e08-89f0e5e2cf1b tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:02.544876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4c56cc6-d430-44e2-8e08-89f0e5e2cf1b tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:02.545371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4c56cc6-d430-44e2-8e08-89f0e5e2cf1b tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:02.585343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-e4c56cc6-d430-44e2-8e08-89f0e5e2cf1b tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lazy-loading 'flavor' on Instance uuid e25fedd8-04af-4785-b69e-70ab95bd9649 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:18:02.712819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ba401558-9787-4fb3-a55c-b1f449e3403a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:02.729977 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ba401558-9787-4fb3-a55c-b1f449e3403a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 200 len: 1322 microversion: 2.1 time: 0.505228 Oct 18 13:18:02.730574 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 270/519] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:02 2022] GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:02.750159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c3c9c4aa-1318-41ee-ad9a-96e2e9bbae4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:02.751148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c3c9c4aa-1318-41ee-ad9a-96e2e9bbae4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:02.759482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3c9c4aa-1318-41ee-ad9a-96e2e9bbae4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:02.760253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3c9c4aa-1318-41ee-ad9a-96e2e9bbae4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:02.761859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3c9c4aa-1318-41ee-ad9a-96e2e9bbae4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:02.762879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3c9c4aa-1318-41ee-ad9a-96e2e9bbae4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:02.763856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3c9c4aa-1318-41ee-ad9a-96e2e9bbae4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:02.764523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3c9c4aa-1318-41ee-ad9a-96e2e9bbae4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:02.816223 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e4c56cc6-d430-44e2-8e08-89f0e5e2cf1b tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649/action" status: 202 len: 0 microversion: 2.1 time: 0.305136 Oct 18 13:18:02.819648 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 250/520] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:02 2022] POST /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:18:02.827112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3bb509fe-9840-450f-b4e3-ca66076510d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:02.828234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3bb509fe-9840-450f-b4e3-ca66076510d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:02.837936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bb509fe-9840-450f-b4e3-ca66076510d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:02.838627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bb509fe-9840-450f-b4e3-ca66076510d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:02.839186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bb509fe-9840-450f-b4e3-ca66076510d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:02.840467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bb509fe-9840-450f-b4e3-ca66076510d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:02.841441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bb509fe-9840-450f-b4e3-ca66076510d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:02.842310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bb509fe-9840-450f-b4e3-ca66076510d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:02.933354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3c9c4aa-1318-41ee-ad9a-96e2e9bbae4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:02.947395 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c3c9c4aa-1318-41ee-ad9a-96e2e9bbae4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 200 len: 1272 microversion: 2.1 time: 0.215325 Oct 18 13:18:02.952139 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 271/521] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:02 2022] GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:02.956896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-319ade59-58ec-4bdd-b5be-143404751edd req-9427dbf3-d0c7-4dea-9978-14ea23483780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1612cfab-edd0-4df2-90f2-79a1c541ca90", "name": "network-vif-unplugged", "status": "completed", "tag": "7989e920-3ad6-4f7c-9ee5-6755d27b3383"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:02.974972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-319ade59-58ec-4bdd-b5be-143404751edd req-9427dbf3-d0c7-4dea-9978-14ea23483780 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:02.975441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-319ade59-58ec-4bdd-b5be-143404751edd req-9427dbf3-d0c7-4dea-9978-14ea23483780 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:02.976066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-319ade59-58ec-4bdd-b5be-143404751edd req-9427dbf3-d0c7-4dea-9978-14ea23483780 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:02.992512 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-319ade59-58ec-4bdd-b5be-143404751edd req-9427dbf3-d0c7-4dea-9978-14ea23483780 service nova] Creating event network-vif-unplugged:7989e920-3ad6-4f7c-9ee5-6755d27b3383 for instance 1612cfab-edd0-4df2-90f2-79a1c541ca90 on n-h2-858384-13 Oct 18 13:18:02.998661 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-319ade59-58ec-4bdd-b5be-143404751edd req-9427dbf3-d0c7-4dea-9978-14ea23483780 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045204 Oct 18 13:18:03.000002 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 272/522] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:03.006487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dcef5dc7-9e44-4cfe-ba9b-2475cfbf9dfd tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:03.009065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dcef5dc7-9e44-4cfe-ba9b-2475cfbf9dfd tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:03.016535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcef5dc7-9e44-4cfe-ba9b-2475cfbf9dfd tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:03.017306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcef5dc7-9e44-4cfe-ba9b-2475cfbf9dfd tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:03.018001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcef5dc7-9e44-4cfe-ba9b-2475cfbf9dfd tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:03.018891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcef5dc7-9e44-4cfe-ba9b-2475cfbf9dfd tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:03.020278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcef5dc7-9e44-4cfe-ba9b-2475cfbf9dfd tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:03.020884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcef5dc7-9e44-4cfe-ba9b-2475cfbf9dfd tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:03.291296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3bb509fe-9840-450f-b4e3-ca66076510d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:03.308012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3bb509fe-9840-450f-b4e3-ca66076510d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:03.313404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3bb509fe-9840-450f-b4e3-ca66076510d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:03.314678 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3bb509fe-9840-450f-b4e3-ca66076510d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1567 microversion: 2.25 time: 0.496024 Oct 18 13:18:03.324169 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 251/523] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:02 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1567 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:03.354390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1490890078", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "364795411", "adminPass": "***", "networks": [{"uuid": "f9661cdc-4357-4c90-9eb1-93262edd645f"}], "security_groups": [{"name": "tempest-securitygroup--1295894535"}], "key_name": "tempest-keypair-597482813", "user_data": "}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:03.764196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] validate_networks() for [('f9661cdc-4357-4c90-9eb1-93262edd645f', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:18:04.038147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dcef5dc7-9e44-4cfe-ba9b-2475cfbf9dfd tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:04.051073 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dcef5dc7-9e44-4cfe-ba9b-2475cfbf9dfd tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1476 microversion: 2.1 time: 1.048692 Oct 18 13:18:04.054429 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 273/524] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:03 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1476 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:04.057414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:04.078314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b5f11a6c-b551-4d69-9c7a-88c543001f72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:04.079327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b5f11a6c-b551-4d69-9c7a-88c543001f72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:04.087831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5f11a6c-b551-4d69-9c7a-88c543001f72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:04.088583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5f11a6c-b551-4d69-9c7a-88c543001f72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:04.089168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5f11a6c-b551-4d69-9c7a-88c543001f72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:04.090128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5f11a6c-b551-4d69-9c7a-88c543001f72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:04.090784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5f11a6c-b551-4d69-9c7a-88c543001f72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:04.091352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5f11a6c-b551-4d69-9c7a-88c543001f72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:04.337408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=15 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:04.467442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:18:04.468072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:18:04.468727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:18:04.469897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:18:04.470568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:18:04.483332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:04.483841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:04.484265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:04.485209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:04.485857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:04.486663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:04.517347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Getting quotas for project ef15948e13464e45ba93cb1c5922a872. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:18:04.524338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Getting quotas for user 3a42f7285eab4c2cb58d06b302f8f185 and project ef15948e13464e45ba93cb1c5922a872. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:18:04.543254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:18:04.545785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:18:04.548190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b5f11a6c-b551-4d69-9c7a-88c543001f72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:04.561776 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b5f11a6c-b551-4d69-9c7a-88c543001f72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a" status: 200 len: 1324 microversion: 2.1 time: 0.506037 Oct 18 13:18:04.562362 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 274/525] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:04 2022] GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a => generated 1324 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:04.567934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f83651bc-3ced-471f-b961-03521f2506db tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:04.580538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f83651bc-3ced-471f-b961-03521f2506db tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:04.588532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f83651bc-3ced-471f-b961-03521f2506db tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:04.589024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f83651bc-3ced-471f-b961-03521f2506db tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:04.589520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f83651bc-3ced-471f-b961-03521f2506db tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:04.590228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f83651bc-3ced-471f-b961-03521f2506db tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:04.590675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f83651bc-3ced-471f-b961-03521f2506db tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:04.591105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f83651bc-3ced-471f-b961-03521f2506db tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:04.624064 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4a32f81c-47b9-4d41-9d3b-a2e307f91313 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.298612 Oct 18 13:18:04.626660 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 252/526] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:18:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:18:04.639411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-fedc277a-5fcf-498a-966f-89ad99d9cba5 req-1eb67f0c-d953-4aff-bc70-a752d7f5312b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a279ff8b-eb06-4bb1-b9d4-f92566e98422", "name": "network-vif-plugged", "status": "completed", "tag": "4cfb37b8-4b2c-46de-ab6d-9c082187a0c1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:04.652050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:04.657157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fedc277a-5fcf-498a-966f-89ad99d9cba5 req-1eb67f0c-d953-4aff-bc70-a752d7f5312b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:04.657815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fedc277a-5fcf-498a-966f-89ad99d9cba5 req-1eb67f0c-d953-4aff-bc70-a752d7f5312b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:04.658637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fedc277a-5fcf-498a-966f-89ad99d9cba5 req-1eb67f0c-d953-4aff-bc70-a752d7f5312b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:04.677393 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-fedc277a-5fcf-498a-966f-89ad99d9cba5 req-1eb67f0c-d953-4aff-bc70-a752d7f5312b service nova] Creating event network-vif-plugged:4cfb37b8-4b2c-46de-ab6d-9c082187a0c1 for instance a279ff8b-eb06-4bb1-b9d4-f92566e98422 on n-h2-858384-13 Oct 18 13:18:04.689078 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-fedc277a-5fcf-498a-966f-89ad99d9cba5 req-1eb67f0c-d953-4aff-bc70-a752d7f5312b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060776 Oct 18 13:18:04.689863 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 253/527] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:04.697073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f48af1d3-16ef-4b2b-b11b-8055a99a4938 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:04.697285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f48af1d3-16ef-4b2b-b11b-8055a99a4938 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:04.704169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f48af1d3-16ef-4b2b-b11b-8055a99a4938 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:04.705360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f48af1d3-16ef-4b2b-b11b-8055a99a4938 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:04.705662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f48af1d3-16ef-4b2b-b11b-8055a99a4938 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:04.706835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f48af1d3-16ef-4b2b-b11b-8055a99a4938 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:04.707332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f48af1d3-16ef-4b2b-b11b-8055a99a4938 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:04.708520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f48af1d3-16ef-4b2b-b11b-8055a99a4938 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:04.892743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f48af1d3-16ef-4b2b-b11b-8055a99a4938 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:04.904011 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f48af1d3-16ef-4b2b-b11b-8055a99a4938 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 200 len: 1322 microversion: 2.1 time: 0.212888 Oct 18 13:18:04.905478 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 254/528] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:04 2022] GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:04.910307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a4fffd49-16a1-4d8b-8998-e10143e81d48 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:04.910888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a4fffd49-16a1-4d8b-8998-e10143e81d48 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:04.918722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4fffd49-16a1-4d8b-8998-e10143e81d48 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:04.919185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4fffd49-16a1-4d8b-8998-e10143e81d48 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:04.919612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4fffd49-16a1-4d8b-8998-e10143e81d48 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:04.920312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4fffd49-16a1-4d8b-8998-e10143e81d48 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:04.920762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4fffd49-16a1-4d8b-8998-e10143e81d48 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:04.921241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4fffd49-16a1-4d8b-8998-e10143e81d48 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:04.978914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f83651bc-3ced-471f-b961-03521f2506db tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:04.994046 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f83651bc-3ced-471f-b961-03521f2506db tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1476 microversion: 2.1 time: 0.430386 Oct 18 13:18:04.994659 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 275/529] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:04 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1476 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:04.999792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ec2431db-0bd5-4771-9db2-5db283f77187 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:05.008298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ec2431db-0bd5-4771-9db2-5db283f77187 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:05.017434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec2431db-0bd5-4771-9db2-5db283f77187 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:05.021653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec2431db-0bd5-4771-9db2-5db283f77187 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:05.022582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec2431db-0bd5-4771-9db2-5db283f77187 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:05.027216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec2431db-0bd5-4771-9db2-5db283f77187 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:05.028112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec2431db-0bd5-4771-9db2-5db283f77187 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:05.028809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec2431db-0bd5-4771-9db2-5db283f77187 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:05.210529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a4fffd49-16a1-4d8b-8998-e10143e81d48 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:05.227194 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a4fffd49-16a1-4d8b-8998-e10143e81d48 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 200 len: 1314 microversion: 2.1 time: 0.318509 Oct 18 13:18:05.228022 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 255/530] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:04 2022] GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:05.242808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a20fe747-d4f7-413d-bfca-89362fb05eaa tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:05.244488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a20fe747-d4f7-413d-bfca-89362fb05eaa tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:05.336635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a20fe747-d4f7-413d-bfca-89362fb05eaa tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:05.337840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ec2431db-0bd5-4771-9db2-5db283f77187 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:05.344620 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a20fe747-d4f7-413d-bfca-89362fb05eaa tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1262 microversion: 2.1 time: 0.114984 Oct 18 13:18:05.348567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ec2431db-0bd5-4771-9db2-5db283f77187 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:05.350058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ec2431db-0bd5-4771-9db2-5db283f77187 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:05.351290 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ec2431db-0bd5-4771-9db2-5db283f77187 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1567 microversion: 2.25 time: 0.355384 Oct 18 13:18:05.357956 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 276/531] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:04 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1567 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:05.358234 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 256/532] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:05 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1262 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:05.358234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-63210c78-5bf3-4a7b-870f-d237216837f3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:05.358234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-63210c78-5bf3-4a7b-870f-d237216837f3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:05.376457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63210c78-5bf3-4a7b-870f-d237216837f3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:05.377209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63210c78-5bf3-4a7b-870f-d237216837f3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:05.377854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63210c78-5bf3-4a7b-870f-d237216837f3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:05.379642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63210c78-5bf3-4a7b-870f-d237216837f3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:05.380539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63210c78-5bf3-4a7b-870f-d237216837f3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:05.381123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63210c78-5bf3-4a7b-870f-d237216837f3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:05.391154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-f8db8977-d3eb-4b95-bf60-813aa16647a8 req-e8dead7e-a46c-426e-8dd8-947a99fdd804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a", "tag": "127093c0-7bb4-4851-9d3b-35d03d5712b9"}, {"name": "network-changed", "server_uuid": "1612cfab-edd0-4df2-90f2-79a1c541ca90", "tag": "7989e920-3ad6-4f7c-9ee5-6755d27b3383"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:05.418278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f8db8977-d3eb-4b95-bf60-813aa16647a8 req-e8dead7e-a46c-426e-8dd8-947a99fdd804 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:05.419337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f8db8977-d3eb-4b95-bf60-813aa16647a8 req-e8dead7e-a46c-426e-8dd8-947a99fdd804 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:05.420371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f8db8977-d3eb-4b95-bf60-813aa16647a8 req-e8dead7e-a46c-426e-8dd8-947a99fdd804 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:05.448558 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f8db8977-d3eb-4b95-bf60-813aa16647a8 req-e8dead7e-a46c-426e-8dd8-947a99fdd804 service nova] Creating event network-changed:127093c0-7bb4-4851-9d3b-35d03d5712b9 for instance 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a on n-h1-858384-13 Oct 18 13:18:05.459610 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f8db8977-d3eb-4b95-bf60-813aa16647a8 req-e8dead7e-a46c-426e-8dd8-947a99fdd804 service nova] Creating event network-changed:7989e920-3ad6-4f7c-9ee5-6755d27b3383 for instance 1612cfab-edd0-4df2-90f2-79a1c541ca90 on n-h2-858384-13 Oct 18 13:18:05.471244 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-f8db8977-d3eb-4b95-bf60-813aa16647a8 req-e8dead7e-a46c-426e-8dd8-947a99fdd804 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.098919 Oct 18 13:18:05.472459 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 277/533] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:05.589171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0fadb2cd-2db4-4491-b250-c9e677bd2fba tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:05.589970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0fadb2cd-2db4-4491-b250-c9e677bd2fba tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:05.601806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fadb2cd-2db4-4491-b250-c9e677bd2fba tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:05.602501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fadb2cd-2db4-4491-b250-c9e677bd2fba tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:05.602936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fadb2cd-2db4-4491-b250-c9e677bd2fba tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:05.603649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fadb2cd-2db4-4491-b250-c9e677bd2fba tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:05.604102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fadb2cd-2db4-4491-b250-c9e677bd2fba tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:05.604529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fadb2cd-2db4-4491-b250-c9e677bd2fba tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:05.652246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-63210c78-5bf3-4a7b-870f-d237216837f3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:05.662948 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-63210c78-5bf3-4a7b-870f-d237216837f3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1459 microversion: 2.1 time: 0.303369 Oct 18 13:18:05.663895 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 257/534] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:05 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1459 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:05.688154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dc66259a-6e65-4b56-a301-23d5e370a3a2 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:05.688880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dc66259a-6e65-4b56-a301-23d5e370a3a2 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:05.698091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc66259a-6e65-4b56-a301-23d5e370a3a2 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:05.698347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc66259a-6e65-4b56-a301-23d5e370a3a2 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:05.698618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc66259a-6e65-4b56-a301-23d5e370a3a2 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:05.699317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc66259a-6e65-4b56-a301-23d5e370a3a2 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:05.699827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc66259a-6e65-4b56-a301-23d5e370a3a2 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:05.700259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc66259a-6e65-4b56-a301-23d5e370a3a2 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:05.824409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0fadb2cd-2db4-4491-b250-c9e677bd2fba tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:05.832940 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0fadb2cd-2db4-4491-b250-c9e677bd2fba tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a" status: 200 len: 1324 microversion: 2.1 time: 0.249375 Oct 18 13:18:05.847789 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 278/535] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:05 2022] GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a => generated 1324 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:05.961457 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dc66259a-6e65-4b56-a301-23d5e370a3a2 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1612 microversion: 2.1 time: 0.278228 Oct 18 13:18:05.962236 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 258/536] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:05 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1612 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:05.968088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5814da11-b2f6-4f94-a013-9d085494c4d5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:05.968830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5814da11-b2f6-4f94-a013-9d085494c4d5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:05.985139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96e2751b-3cc1-44eb-99f6-a51d6244656f tempest-QuotaClassesAdmin257Test-1690329830 tempest-QuotaClassesAdmin257Test-1690329830-project-admin] Calling method '.version_select at 0x7ff60ff7af70>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:05.987939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5814da11-b2f6-4f94-a013-9d085494c4d5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:05.988819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5814da11-b2f6-4f94-a013-9d085494c4d5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:05.989655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5814da11-b2f6-4f94-a013-9d085494c4d5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:05.992719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5814da11-b2f6-4f94-a013-9d085494c4d5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:05.993843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5814da11-b2f6-4f94-a013-9d085494c4d5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:05.994602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5814da11-b2f6-4f94-a013-9d085494c4d5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.001246 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-96e2751b-3cc1-44eb-99f6-a51d6244656f tempest-QuotaClassesAdmin257Test-1690329830 tempest-QuotaClassesAdmin257Test-1690329830-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.158455 Oct 18 13:18:06.001848 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 279/537] 10.222.0.40 () {60 vars in 1226 bytes} [Tue Oct 18 13:18:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:18:06.017584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0ff17eac-196a-4a01-b24a-bbfbdc757efc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:06.024333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ff17eac-196a-4a01-b24a-bbfbdc757efc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.030203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ff17eac-196a-4a01-b24a-bbfbdc757efc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.031093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ff17eac-196a-4a01-b24a-bbfbdc757efc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.032035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ff17eac-196a-4a01-b24a-bbfbdc757efc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.032643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ff17eac-196a-4a01-b24a-bbfbdc757efc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.033306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ff17eac-196a-4a01-b24a-bbfbdc757efc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.068552 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0ff17eac-196a-4a01-b24a-bbfbdc757efc tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.063386 Oct 18 13:18:06.069804 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 280/538] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 18 13:18:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:06.077576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9b0c3dde-dbf5-48c1-8d7a-5b0340b7b841 tempest-QuotaClassesAdmin257Test-1690329830 tempest-QuotaClassesAdmin257Test-1690329830-project-admin] Action: 'update', calling method: .version_select at 0x7ff60ff14ca0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:06.226026 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9b0c3dde-dbf5-48c1-8d7a-5b0340b7b841 tempest-QuotaClassesAdmin257Test-1690329830 tempest-QuotaClassesAdmin257Test-1690329830-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.153473 Oct 18 13:18:06.227277 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 281/539] 10.222.0.40 () {62 vars in 1247 bytes} [Tue Oct 18 13:18:06 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:18:06.233169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-43d83933-2680-4def-815f-ff230128233d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:06.234151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-43d83933-2680-4def-815f-ff230128233d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:06.243353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43d83933-2680-4def-815f-ff230128233d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.244252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43d83933-2680-4def-815f-ff230128233d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.245121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43d83933-2680-4def-815f-ff230128233d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.250415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43d83933-2680-4def-815f-ff230128233d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.250908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43d83933-2680-4def-815f-ff230128233d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.252083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43d83933-2680-4def-815f-ff230128233d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.402019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5814da11-b2f6-4f94-a013-9d085494c4d5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:06.415939 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5814da11-b2f6-4f94-a013-9d085494c4d5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 200 len: 1322 microversion: 2.1 time: 0.452324 Oct 18 13:18:06.416933 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 259/540] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:05 2022] GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:06.432633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-532c3b2e-7242-4a22-bfbd-0c87a1c7dc22 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-13", "block_migration": true, "disk_over_commit": false}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:06.437673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-532c3b2e-7242-4a22-bfbd-0c87a1c7dc22 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:06.446723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-43d83933-2680-4def-815f-ff230128233d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:06.448292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-532c3b2e-7242-4a22-bfbd-0c87a1c7dc22 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.449255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-532c3b2e-7242-4a22-bfbd-0c87a1c7dc22 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.450009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-532c3b2e-7242-4a22-bfbd-0c87a1c7dc22 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.451219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-532c3b2e-7242-4a22-bfbd-0c87a1c7dc22 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.452022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-532c3b2e-7242-4a22-bfbd-0c87a1c7dc22 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.452796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-532c3b2e-7242-4a22-bfbd-0c87a1c7dc22 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.455002 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-43d83933-2680-4def-815f-ff230128233d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1476 microversion: 2.1 time: 0.226555 Oct 18 13:18:06.455587 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 282/541] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:06 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:06.465340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-27d8e025-ff25-44d2-a4fb-37380bc31a84 tempest-QuotaClassesAdmin257Test-1690329830 tempest-QuotaClassesAdmin257Test-1690329830-project-admin] Calling method '.version_select at 0x7ff60ff0df70>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:06.486304 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-27d8e025-ff25-44d2-a4fb-37380bc31a84 tempest-QuotaClassesAdmin257Test-1690329830 tempest-QuotaClassesAdmin257Test-1690329830-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.024624 Oct 18 13:18:06.486897 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 283/542] 10.222.0.40 () {60 vars in 1226 bytes} [Tue Oct 18 13:18:06 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:18:06.495786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2a0233ea-7026-4cfe-a601-68bc69cd0977 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:06.497053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2a0233ea-7026-4cfe-a601-68bc69cd0977 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:06.512005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0233ea-7026-4cfe-a601-68bc69cd0977 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.512530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0233ea-7026-4cfe-a601-68bc69cd0977 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.512970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0233ea-7026-4cfe-a601-68bc69cd0977 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.513713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0233ea-7026-4cfe-a601-68bc69cd0977 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.514594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0233ea-7026-4cfe-a601-68bc69cd0977 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.515775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0233ea-7026-4cfe-a601-68bc69cd0977 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.584350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-532c3b2e-7242-4a22-bfbd-0c87a1c7dc22 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Lazy-loading 'flavor' on Instance uuid e25fedd8-04af-4785-b69e-70ab95bd9649 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:18:06.606318 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-532c3b2e-7242-4a22-bfbd-0c87a1c7dc22 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance e25fedd8-04af-4785-b69e-70ab95bd9649 while it is in vm_state suspended Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-532c3b2e-7242-4a22-bfbd-0c87a1c7dc22 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Request method failure captured: Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649/action HTTP/1.1 Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 98 Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdWQJdPI6zKLKMWE9kqcljtdPvOvdNKPGQX2yaqrEN8O3Fq7cGZ4g_Y5D4H6YZP9wMx_DLiyEwHh65_eN5kCTSdHml0D8L-VBdf0JIZgK42hlSgZkA8VKTmgfu30SiUcyNffzBqheuWpfVDYUbCDFWW616fK_k0iiynIOzgGAU8E0k Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 3ca62135fda548b09e7885a711a05353 Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-LiveMigrationNegativeTest-1718503709 Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:18:06.609783 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:18:06.611124 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3ca62135fda548b09e7885a711a05353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3ca62135fda548b09e7885a711a05353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3ca62135fda548b09e7885a711a05353"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3ca62135fda548b09e7885a711a05353"}]}] Oct 18 13:18:06.611124 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-LiveMigrationNegativeTest-1718503709 Oct 18 13:18:06.611124 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 3ca62135fda548b09e7885a711a05353 Oct 18 13:18:06.611124 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1718503709 Oct 18 13:18:06.611124 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-LiveMigrationNegativeTest-1718503709-project-admin Oct 18 13:18:06.611124 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:06.611124 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:06.611124 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7b919ed261cf4e90acf024a630088f4d Oct 18 13:18:06.611124 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-LiveMigrationNegativeTest-1718503709-project-admin Oct 18 13:18:06.611124 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:18:06.611124 n-d-858384-13 devstack@n-api.service[120611]: {"os-migrateLive": {"host": "n-h2-858384-13", "block_migration": true, "disk_over_commit": false}} Oct 18 13:18:06.611124 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: exception: Cannot 'os-migrateLive' instance e25fedd8-04af-4785-b69e-70ab95bd9649 while it is in vm_state suspended Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'e25fedd8-04af-4785-b69e-70ab95bd9649', 'body': {'os-migrateLive': {'host': 'n-h2-858384-13', 'block_migration': True, 'disk_over_commit': False}}} Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 18 13:18:06.611842 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e25fedd8-04af-4785-b69e-70ab95bd9649 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:06.612923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance e25fedd8-04af-4785-b69e-70ab95bd9649 while it is in vm_state suspended Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance e25fedd8-04af-4785-b69e-70ab95bd9649 while it is in vm_state suspended Oct 18 13:18:06.615936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:06.618818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-532c3b2e-7242-4a22-bfbd-0c87a1c7dc22 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance e25fedd8-04af-4785-b69e-70ab95bd9649 while it is in vm_state suspended {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:06.618818 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-532c3b2e-7242-4a22-bfbd-0c87a1c7dc22 tempest-LiveMigrationNegativeTest-1718503709 tempest-LiveMigrationNegativeTest-1718503709-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649/action" status: 409 len: 155 microversion: 2.1 time: 0.193362 Oct 18 13:18:06.618818 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 260/543] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:06 2022] POST /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649/action => generated 155 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:18:06.621679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0c8c4d20-3f1f-47e3-837f-fed8ddeaa72b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:06.622500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0c8c4d20-3f1f-47e3-837f-fed8ddeaa72b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:06.632551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c8c4d20-3f1f-47e3-837f-fed8ddeaa72b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.633437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c8c4d20-3f1f-47e3-837f-fed8ddeaa72b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.634120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c8c4d20-3f1f-47e3-837f-fed8ddeaa72b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.635276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c8c4d20-3f1f-47e3-837f-fed8ddeaa72b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.636010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c8c4d20-3f1f-47e3-837f-fed8ddeaa72b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.636668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c8c4d20-3f1f-47e3-837f-fed8ddeaa72b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.723049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0c8c4d20-3f1f-47e3-837f-fed8ddeaa72b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:06.732370 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0c8c4d20-3f1f-47e3-837f-fed8ddeaa72b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1266 microversion: 2.1 time: 0.117526 Oct 18 13:18:06.733698 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 261/544] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:06 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:06.738495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8af600e8-85b2-45e4-aba6-00775df33e83 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:06.739108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8af600e8-85b2-45e4-aba6-00775df33e83 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:06.746179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af600e8-85b2-45e4-aba6-00775df33e83 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.746674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af600e8-85b2-45e4-aba6-00775df33e83 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.747112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af600e8-85b2-45e4-aba6-00775df33e83 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.747821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af600e8-85b2-45e4-aba6-00775df33e83 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.748277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af600e8-85b2-45e4-aba6-00775df33e83 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.748709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af600e8-85b2-45e4-aba6-00775df33e83 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.912910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2a0233ea-7026-4cfe-a601-68bc69cd0977 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:06.921762 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2a0233ea-7026-4cfe-a601-68bc69cd0977 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 200 len: 1314 microversion: 2.1 time: 0.431180 Oct 18 13:18:06.922352 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 284/545] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:06 2022] GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:06.938544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7b4bb8ea-4a92-44a9-99c2-0b9a18448428 tempest-QuotaClassesAdmin257Test-1690329830 tempest-QuotaClassesAdmin257Test-1690329830-project-admin] Action: 'update', calling method: .version_select at 0x7ff60fee3040>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:06.965082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8af600e8-85b2-45e4-aba6-00775df33e83 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:06.968912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:06.975564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8af600e8-85b2-45e4-aba6-00775df33e83 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:06.977607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8af600e8-85b2-45e4-aba6-00775df33e83 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:06.978788 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8af600e8-85b2-45e4-aba6-00775df33e83 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1567 microversion: 2.25 time: 0.244266 Oct 18 13:18:06.979352 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 262/546] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:06 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:06.984232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-31d4b726-75eb-4fe0-83bf-cd0f1a703e78 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:06.984712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-31d4b726-75eb-4fe0-83bf-cd0f1a703e78 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:06.991761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31d4b726-75eb-4fe0-83bf-cd0f1a703e78 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.992488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31d4b726-75eb-4fe0-83bf-cd0f1a703e78 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.993131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31d4b726-75eb-4fe0-83bf-cd0f1a703e78 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:06.993878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31d4b726-75eb-4fe0-83bf-cd0f1a703e78 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:06.994370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31d4b726-75eb-4fe0-83bf-cd0f1a703e78 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:06.994870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31d4b726-75eb-4fe0-83bf-cd0f1a703e78 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.019523 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7b4bb8ea-4a92-44a9-99c2-0b9a18448428 tempest-QuotaClassesAdmin257Test-1690329830 tempest-QuotaClassesAdmin257Test-1690329830-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.095846 Oct 18 13:18:07.020177 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 285/547] 10.222.0.40 () {62 vars in 1247 bytes} [Tue Oct 18 13:18:06 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:18:07.021853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-31d4b726-75eb-4fe0-83bf-cd0f1a703e78 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:18:07.025311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-51c1204a-2b84-4625-8b87-ceff8b61adbe tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:07.025923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-51c1204a-2b84-4625-8b87-ceff8b61adbe tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:07.032028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51c1204a-2b84-4625-8b87-ceff8b61adbe tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.032519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51c1204a-2b84-4625-8b87-ceff8b61adbe tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.033005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51c1204a-2b84-4625-8b87-ceff8b61adbe tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.033731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51c1204a-2b84-4625-8b87-ceff8b61adbe tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.034183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51c1204a-2b84-4625-8b87-ceff8b61adbe tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.034605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51c1204a-2b84-4625-8b87-ceff8b61adbe tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.137268 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-31d4b726-75eb-4fe0-83bf-cd0f1a703e78 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 204 len: 0 microversion: 2.1 time: 0.156624 Oct 18 13:18:07.138763 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 263/548] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:18:06 2022] DELETE /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:18:07.149050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-214d859d-8a69-4e63-b899-3921a8013450 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:07.149803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-214d859d-8a69-4e63-b899-3921a8013450 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:07.158117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-214d859d-8a69-4e63-b899-3921a8013450 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.158612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-214d859d-8a69-4e63-b899-3921a8013450 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.159054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-214d859d-8a69-4e63-b899-3921a8013450 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.159766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-214d859d-8a69-4e63-b899-3921a8013450 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.160651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-214d859d-8a69-4e63-b899-3921a8013450 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.160651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-214d859d-8a69-4e63-b899-3921a8013450 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.193831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-51c1204a-2b84-4625-8b87-ceff8b61adbe tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:07.207999 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-51c1204a-2b84-4625-8b87-ceff8b61adbe tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a" status: 200 len: 1324 microversion: 2.1 time: 0.186754 Oct 18 13:18:07.209286 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 286/549] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:07 2022] GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a => generated 1324 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:07.329572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-214d859d-8a69-4e63-b899-3921a8013450 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:07.344233 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-214d859d-8a69-4e63-b899-3921a8013450 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1465 microversion: 2.1 time: 0.201807 Oct 18 13:18:07.344834 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 264/550] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:07 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1465 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:07.439759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-df74ceb2-2ca2-43e9-afab-4118984517ed tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:07.440357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-df74ceb2-2ca2-43e9-afab-4118984517ed tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:07.447743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df74ceb2-2ca2-43e9-afab-4118984517ed tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.449294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df74ceb2-2ca2-43e9-afab-4118984517ed tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.449900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df74ceb2-2ca2-43e9-afab-4118984517ed tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.450822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df74ceb2-2ca2-43e9-afab-4118984517ed tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.451438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df74ceb2-2ca2-43e9-afab-4118984517ed tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.452008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df74ceb2-2ca2-43e9-afab-4118984517ed tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.480251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cc30b461-dbf9-4e97-aded-93f399c2f1e1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:07.480864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cc30b461-dbf9-4e97-aded-93f399c2f1e1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:07.500311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc30b461-dbf9-4e97-aded-93f399c2f1e1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.501025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc30b461-dbf9-4e97-aded-93f399c2f1e1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.502242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc30b461-dbf9-4e97-aded-93f399c2f1e1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.503125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc30b461-dbf9-4e97-aded-93f399c2f1e1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.503654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc30b461-dbf9-4e97-aded-93f399c2f1e1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.504303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc30b461-dbf9-4e97-aded-93f399c2f1e1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.661523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-df74ceb2-2ca2-43e9-afab-4118984517ed tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:07.666208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:07.674709 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-df74ceb2-2ca2-43e9-afab-4118984517ed tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 200 len: 1471 microversion: 2.1 time: 0.238534 Oct 18 13:18:07.676241 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 287/551] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:07 2022] GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 1471 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:07.679946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cc30b461-dbf9-4e97-aded-93f399c2f1e1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:07.692074 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cc30b461-dbf9-4e97-aded-93f399c2f1e1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1476 microversion: 2.1 time: 0.215199 Oct 18 13:18:07.693360 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 265/552] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:07 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:07.694558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-1e6bbb6e-a2f2-4ed4-ba7b-a4e8f8f64bff req-cb8e62b0-4194-4c40-9c8f-21f3c5af5b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eecaf364-e10b-44e5-a2f2-a658d052e1e8", "tag": "85e7e852-48c1-497b-b338-b36e1ae6599c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:07.702542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-eb5fe4f7-7232-4d2a-94d5-5789a708b48b req-2ae225a4-2e5d-45c6-b1ac-1279c2e0144b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e257aea-4f80-4311-8216-9f3b8481507a", "name": "network-vif-plugged", "status": "completed", "tag": "c2e5c8e4-7e8d-4b38-9402-17b57d852e09"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:07.709799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1e6bbb6e-a2f2-4ed4-ba7b-a4e8f8f64bff req-cb8e62b0-4194-4c40-9c8f-21f3c5af5b71 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.710755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1e6bbb6e-a2f2-4ed4-ba7b-a4e8f8f64bff req-cb8e62b0-4194-4c40-9c8f-21f3c5af5b71 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.712114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1e6bbb6e-a2f2-4ed4-ba7b-a4e8f8f64bff req-cb8e62b0-4194-4c40-9c8f-21f3c5af5b71 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.721463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-eb5fe4f7-7232-4d2a-94d5-5789a708b48b req-2ae225a4-2e5d-45c6-b1ac-1279c2e0144b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.722229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-eb5fe4f7-7232-4d2a-94d5-5789a708b48b req-2ae225a4-2e5d-45c6-b1ac-1279c2e0144b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.722855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-eb5fe4f7-7232-4d2a-94d5-5789a708b48b req-2ae225a4-2e5d-45c6-b1ac-1279c2e0144b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.727878 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-1e6bbb6e-a2f2-4ed4-ba7b-a4e8f8f64bff req-cb8e62b0-4194-4c40-9c8f-21f3c5af5b71 service nova] Creating event network-changed:85e7e852-48c1-497b-b338-b36e1ae6599c for instance eecaf364-e10b-44e5-a2f2-a658d052e1e8 on n-h2-858384-13 Oct 18 13:18:07.735575 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-1e6bbb6e-a2f2-4ed4-ba7b-a4e8f8f64bff req-cb8e62b0-4194-4c40-9c8f-21f3c5af5b71 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057946 Oct 18 13:18:07.736502 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 288/553] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:07.737741 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-eb5fe4f7-7232-4d2a-94d5-5789a708b48b req-2ae225a4-2e5d-45c6-b1ac-1279c2e0144b service nova] Creating event network-vif-plugged:c2e5c8e4-7e8d-4b38-9402-17b57d852e09 for instance 4e257aea-4f80-4311-8216-9f3b8481507a on n-h2-858384-13 Oct 18 13:18:07.744177 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-eb5fe4f7-7232-4d2a-94d5-5789a708b48b req-2ae225a4-2e5d-45c6-b1ac-1279c2e0144b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049146 Oct 18 13:18:07.745114 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 266/554] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:07.758907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-442a390e-027f-4d11-a278-25f10f7fee81 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:07.760477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-442a390e-027f-4d11-a278-25f10f7fee81 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:07.767331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-442a390e-027f-4d11-a278-25f10f7fee81 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.767730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-442a390e-027f-4d11-a278-25f10f7fee81 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.768113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-442a390e-027f-4d11-a278-25f10f7fee81 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.768816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-442a390e-027f-4d11-a278-25f10f7fee81 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.769316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-442a390e-027f-4d11-a278-25f10f7fee81 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.770247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-442a390e-027f-4d11-a278-25f10f7fee81 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.866700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-442a390e-027f-4d11-a278-25f10f7fee81 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:07.881888 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-442a390e-027f-4d11-a278-25f10f7fee81 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1266 microversion: 2.1 time: 0.129695 Oct 18 13:18:07.885221 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 267/555] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:07 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:07.957611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84167834-0571-4ae1-ba4f-2bdde96c5f02 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:07.958608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-84167834-0571-4ae1-ba4f-2bdde96c5f02 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] [instance: 9f4eee68-0d65-4694-ac64-1d2c06029c8d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:07.960168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-40a7ead9-57fc-4898-a8a7-e2220a9399b0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:07.961514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-40a7ead9-57fc-4898-a8a7-e2220a9399b0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:07.966062 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-84167834-0571-4ae1-ba4f-2bdde96c5f02 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] HTTP exception thrown: Instance 9f4eee68-0d65-4694-ac64-1d2c06029c8d could not be found. Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84167834-0571-4ae1-ba4f-2bdde96c5f02 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Request method failure captured: Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/9f4eee68-0d65-4694-ac64-1d2c06029c8d/action HTTP/1.1 Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 15 Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqd7QAT1Wjs9_FuST2Ws5Q808O3rA7hPlWp3G7XOPRYHl7Mdw6DlrJvHuhWpc4Bmbq5qhxGKOvRcWFiW44i39qY6iBUkikPa3GaEXdKysdhp-_c2yTWRBVnk9_N6rNI2_zWlaxnY1ZEWLEN55Ca_dtW0f_B5AcR6kO540nQtQf2pxpw Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 1d77814d9c494dda889600e521516bd4 Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:18:07.967888 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:18:07.969289 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d77814d9c494dda889600e521516bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1d77814d9c494dda889600e521516bd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d77814d9c494dda889600e521516bd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1d77814d9c494dda889600e521516bd4"}]}] Oct 18 13:18:07.969289 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:07.969289 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 1d77814d9c494dda889600e521516bd4 Oct 18 13:18:07.969289 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:07.969289 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersAdminNegativeTestJSON-1053227917-project-admin Oct 18 13:18:07.969289 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:18:07.969289 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:18:07.969289 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 86155cea59f44350a2cf3b0806fdcef0 Oct 18 13:18:07.969289 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1053227917-project-admin Oct 18 13:18:07.969289 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:18:07.969289 n-d-858384-13 devstack@n-api.service[120612]: {"migrate": {}} Oct 18 13:18:07.969289 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:18:07.969289 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 9f4eee68-0d65-4694-ac64-1d2c06029c8d could not be found. Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '9f4eee68-0d65-4694-ac64-1d2c06029c8d', 'body': {'migrate': {}}} Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f4eee68-0d65-4694-ac64-1d2c06029c8d could not be found. Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:07.973479 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f4eee68-0d65-4694-ac64-1d2c06029c8d could not be found. Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f4eee68-0d65-4694-ac64-1d2c06029c8d could not be found. Oct 18 13:18:07.974836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:07.975949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84167834-0571-4ae1-ba4f-2bdde96c5f02 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Returning 404 to user: Instance 9f4eee68-0d65-4694-ac64-1d2c06029c8d could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:07.975949 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-84167834-0571-4ae1-ba4f-2bdde96c5f02 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/9f4eee68-0d65-4694-ac64-1d2c06029c8d/action" status: 404 len: 111 microversion: 2.1 time: 0.231538 Oct 18 13:18:07.975949 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 289/556] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:07 2022] POST /compute/v2.1/servers/9f4eee68-0d65-4694-ac64-1d2c06029c8d/action => generated 111 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:18:07.976673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a7ead9-57fc-4898-a8a7-e2220a9399b0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.976673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a7ead9-57fc-4898-a8a7-e2220a9399b0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.976673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a7ead9-57fc-4898-a8a7-e2220a9399b0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:07.976673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a7ead9-57fc-4898-a8a7-e2220a9399b0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:07.977843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a7ead9-57fc-4898-a8a7-e2220a9399b0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:07.977843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a7ead9-57fc-4898-a8a7-e2220a9399b0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:08.008192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aff612fe-0493-4887-905a-7143b517e97d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:08.009082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aff612fe-0493-4887-905a-7143b517e97d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:08.027719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aff612fe-0493-4887-905a-7143b517e97d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:08.028313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aff612fe-0493-4887-905a-7143b517e97d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:08.030686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aff612fe-0493-4887-905a-7143b517e97d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:08.031618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aff612fe-0493-4887-905a-7143b517e97d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:08.032985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aff612fe-0493-4887-905a-7143b517e97d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:08.033528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aff612fe-0493-4887-905a-7143b517e97d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:08.288345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aff612fe-0493-4887-905a-7143b517e97d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:08.297385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aff612fe-0493-4887-905a-7143b517e97d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:08.299393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aff612fe-0493-4887-905a-7143b517e97d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:08.302230 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aff612fe-0493-4887-905a-7143b517e97d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1567 microversion: 2.25 time: 0.299843 Oct 18 13:18:08.308036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-40a7ead9-57fc-4898-a8a7-e2220a9399b0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:08.313495 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 290/557] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:07 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1567 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:18:08.322151 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-40a7ead9-57fc-4898-a8a7-e2220a9399b0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 200 len: 1314 microversion: 2.1 time: 0.366338 Oct 18 13:18:08.325923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1277366737", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:08.326101 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 268/558] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:07 2022] GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:08.340322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-905d3a59-1093-4398-b053-e2ddebc019af tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:08.341085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-905d3a59-1093-4398-b053-e2ddebc019af tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:08.347985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-905d3a59-1093-4398-b053-e2ddebc019af tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:08.348388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-905d3a59-1093-4398-b053-e2ddebc019af tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:08.349023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-905d3a59-1093-4398-b053-e2ddebc019af tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:08.349608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-905d3a59-1093-4398-b053-e2ddebc019af tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:08.350202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-905d3a59-1093-4398-b053-e2ddebc019af tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:08.350632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-905d3a59-1093-4398-b053-e2ddebc019af tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:08.386191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:18:08.539803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-905d3a59-1093-4398-b053-e2ddebc019af tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:08.553265 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-905d3a59-1093-4398-b053-e2ddebc019af tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a" status: 200 len: 1324 microversion: 2.1 time: 0.226079 Oct 18 13:18:08.566538 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 269/559] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:08 2022] GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a => generated 1324 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:08.579088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8af66a88-a835-466a-a1d2-c6527e937b0c tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:08.579710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8af66a88-a835-466a-a1d2-c6527e937b0c tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:08.594712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af66a88-a835-466a-a1d2-c6527e937b0c tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:08.595742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af66a88-a835-466a-a1d2-c6527e937b0c tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:08.596696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af66a88-a835-466a-a1d2-c6527e937b0c tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:08.598105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af66a88-a835-466a-a1d2-c6527e937b0c tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:08.598889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af66a88-a835-466a-a1d2-c6527e937b0c tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:08.599747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af66a88-a835-466a-a1d2-c6527e937b0c tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:08.656334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:18:08.656828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:18:08.657564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:18:08.657732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:18:08.658320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:18:08.668773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:08.669383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:08.669892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:08.670689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:08.671214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:08.671835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:08.691167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Getting quotas for project d15b3d39ec044d9f853b681d5886b622. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:18:08.697502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Getting quotas for user ee57dfe126fa4254b75455250e61d7be and project d15b3d39ec044d9f853b681d5886b622. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:18:08.711388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:18:08.713988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:18:08.771056 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b9cf330b-4836-4a5f-8e10-c78792146959 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.455966 Oct 18 13:18:08.778937 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 291/560] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:18:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:18:08.785066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5ac3e9a2-4a39-4b4b-9240-7125aa44567d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:08.785716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5ac3e9a2-4a39-4b4b-9240-7125aa44567d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:08.793532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ac3e9a2-4a39-4b4b-9240-7125aa44567d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:08.794018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ac3e9a2-4a39-4b4b-9240-7125aa44567d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:08.794450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ac3e9a2-4a39-4b4b-9240-7125aa44567d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:08.795178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ac3e9a2-4a39-4b4b-9240-7125aa44567d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:08.795798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ac3e9a2-4a39-4b4b-9240-7125aa44567d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:08.796075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ac3e9a2-4a39-4b4b-9240-7125aa44567d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:08.904217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8af66a88-a835-466a-a1d2-c6527e937b0c tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:08.915104 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8af66a88-a835-466a-a1d2-c6527e937b0c tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1465 microversion: 2.1 time: 0.347004 Oct 18 13:18:08.915709 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 270/561] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:08 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1465 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:08.921444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-af671b15-1248-4931-9f78-7e5d1de74d6e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:08.922253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-af671b15-1248-4931-9f78-7e5d1de74d6e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:08.982375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-af671b15-1248-4931-9f78-7e5d1de74d6e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:08.990341 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-af671b15-1248-4931-9f78-7e5d1de74d6e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1222 microversion: 2.1 time: 0.073529 Oct 18 13:18:08.991376 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 271/562] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:08 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:08.996891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c02efc8-cc4f-454e-a6df-24a03802eddd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:08.997666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7c02efc8-cc4f-454e-a6df-24a03802eddd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:09.003183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5ac3e9a2-4a39-4b4b-9240-7125aa44567d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:09.004471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c02efc8-cc4f-454e-a6df-24a03802eddd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:09.005028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c02efc8-cc4f-454e-a6df-24a03802eddd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:09.005814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c02efc8-cc4f-454e-a6df-24a03802eddd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:09.006656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c02efc8-cc4f-454e-a6df-24a03802eddd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:09.007269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c02efc8-cc4f-454e-a6df-24a03802eddd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:09.007791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c02efc8-cc4f-454e-a6df-24a03802eddd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:09.012378 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5ac3e9a2-4a39-4b4b-9240-7125aa44567d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1476 microversion: 2.1 time: 0.232239 Oct 18 13:18:09.013200 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 292/563] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:08 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1476 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:09.120655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7c02efc8-cc4f-454e-a6df-24a03802eddd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:09.136799 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7c02efc8-cc4f-454e-a6df-24a03802eddd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1266 microversion: 2.1 time: 0.143981 Oct 18 13:18:09.137662 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 272/564] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:08 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:09.338859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-049cd0f8-1fa0-43f7-a9cd-4bb2347aa98a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:09.340476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-049cd0f8-1fa0-43f7-a9cd-4bb2347aa98a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:09.343371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=14,nova_api:INSERT=5 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:09.345793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3424f6e8-53e7-49f2-88c9-8fd9f25ea74f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:09.347050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3424f6e8-53e7-49f2-88c9-8fd9f25ea74f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:09.352718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-049cd0f8-1fa0-43f7-a9cd-4bb2347aa98a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:09.353919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-049cd0f8-1fa0-43f7-a9cd-4bb2347aa98a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:09.355037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-049cd0f8-1fa0-43f7-a9cd-4bb2347aa98a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:09.355939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-049cd0f8-1fa0-43f7-a9cd-4bb2347aa98a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:09.356062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3424f6e8-53e7-49f2-88c9-8fd9f25ea74f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:09.357257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-049cd0f8-1fa0-43f7-a9cd-4bb2347aa98a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:09.357843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-049cd0f8-1fa0-43f7-a9cd-4bb2347aa98a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:09.359111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3424f6e8-53e7-49f2-88c9-8fd9f25ea74f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:09.359597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3424f6e8-53e7-49f2-88c9-8fd9f25ea74f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:09.361775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3424f6e8-53e7-49f2-88c9-8fd9f25ea74f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:09.362414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3424f6e8-53e7-49f2-88c9-8fd9f25ea74f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:09.363944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3424f6e8-53e7-49f2-88c9-8fd9f25ea74f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:09.578256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-049cd0f8-1fa0-43f7-a9cd-4bb2347aa98a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:09.593017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-049cd0f8-1fa0-43f7-a9cd-4bb2347aa98a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:09.595080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-049cd0f8-1fa0-43f7-a9cd-4bb2347aa98a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:09.596777 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-049cd0f8-1fa0-43f7-a9cd-4bb2347aa98a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1567 microversion: 2.25 time: 0.266133 Oct 18 13:18:09.598308 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 293/565] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:09 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:09.604124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bcf26946-b56b-4eb8-921a-713335cddd2e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:09.605083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bcf26946-b56b-4eb8-921a-713335cddd2e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:09.613435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcf26946-b56b-4eb8-921a-713335cddd2e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:09.614235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcf26946-b56b-4eb8-921a-713335cddd2e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:09.614863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcf26946-b56b-4eb8-921a-713335cddd2e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:09.615792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcf26946-b56b-4eb8-921a-713335cddd2e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:09.616490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcf26946-b56b-4eb8-921a-713335cddd2e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:09.617648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcf26946-b56b-4eb8-921a-713335cddd2e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:09.684995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3424f6e8-53e7-49f2-88c9-8fd9f25ea74f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:09.695547 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3424f6e8-53e7-49f2-88c9-8fd9f25ea74f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 200 len: 1314 microversion: 2.1 time: 0.353981 Oct 18 13:18:09.710276 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 273/566] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:09 2022] GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:09.932377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bcf26946-b56b-4eb8-921a-713335cddd2e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:09.942308 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bcf26946-b56b-4eb8-921a-713335cddd2e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a" status: 200 len: 1521 microversion: 2.1 time: 0.342755 Oct 18 13:18:09.943339 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 294/567] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:09 2022] GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:09.947352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-943f1094-05fd-4f9c-bd8b-3b6bf11958c3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:09.948583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-943f1094-05fd-4f9c-bd8b-3b6bf11958c3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:09.961333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-943f1094-05fd-4f9c-bd8b-3b6bf11958c3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:09.962782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-943f1094-05fd-4f9c-bd8b-3b6bf11958c3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:09.963941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-943f1094-05fd-4f9c-bd8b-3b6bf11958c3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:09.977025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Action: 'action', calling method: .version_select at 0x7ff6155ba9d0>, body: {"addFloatingIp": {"address": "172.25.2.128"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:09.979354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-943f1094-05fd-4f9c-bd8b-3b6bf11958c3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:09.980793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:09.982195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-943f1094-05fd-4f9c-bd8b-3b6bf11958c3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:09.982647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-943f1094-05fd-4f9c-bd8b-3b6bf11958c3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:09.990289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:09.991151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:09.991827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:09.993441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:09.996093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:09.997006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:10.117428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "refresh_cache-f97ccda6-c665-4a4f-b099-72b142b143b7" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:18:10.117878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquired lock "refresh_cache-f97ccda6-c665-4a4f-b099-72b142b143b7" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:18:10.162690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-943f1094-05fd-4f9c-bd8b-3b6bf11958c3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:10.175116 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-943f1094-05fd-4f9c-bd8b-3b6bf11958c3 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1465 microversion: 2.1 time: 0.232903 Oct 18 13:18:10.186614 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 274/568] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:09 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1465 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:10.197907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-64170da2-fcb3-4138-ae0a-a4790a2fa797 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:10.203801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-64170da2-fcb3-4138-ae0a-a4790a2fa797 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:10.225910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64170da2-fcb3-4138-ae0a-a4790a2fa797 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:10.227031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64170da2-fcb3-4138-ae0a-a4790a2fa797 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:10.227665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64170da2-fcb3-4138-ae0a-a4790a2fa797 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:10.228383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64170da2-fcb3-4138-ae0a-a4790a2fa797 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:10.237935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64170da2-fcb3-4138-ae0a-a4790a2fa797 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:10.238427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64170da2-fcb3-4138-ae0a-a4790a2fa797 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:10.310085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-64170da2-fcb3-4138-ae0a-a4790a2fa797 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:10.318912 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-64170da2-fcb3-4138-ae0a-a4790a2fa797 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1218 microversion: 2.1 time: 0.128317 Oct 18 13:18:10.319600 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 275/569] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:10 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:10.324505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bbe1f442-c68b-42f6-8b35-d20065f17b90 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:10.325123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bbe1f442-c68b-42f6-8b35-d20065f17b90 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:10.331257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe1f442-c68b-42f6-8b35-d20065f17b90 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:10.331746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe1f442-c68b-42f6-8b35-d20065f17b90 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:10.332181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe1f442-c68b-42f6-8b35-d20065f17b90 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:10.333041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe1f442-c68b-42f6-8b35-d20065f17b90 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:10.333527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe1f442-c68b-42f6-8b35-d20065f17b90 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:10.334182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe1f442-c68b-42f6-8b35-d20065f17b90 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:10.495045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bbe1f442-c68b-42f6-8b35-d20065f17b90 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:10.504519 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bbe1f442-c68b-42f6-8b35-d20065f17b90 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1476 microversion: 2.1 time: 0.183674 Oct 18 13:18:10.505360 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 276/570] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:10 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1476 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:10.510128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e69b826a-05f9-438d-b9f7-06647235861a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:10.510743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e69b826a-05f9-438d-b9f7-06647235861a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:10.517074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e69b826a-05f9-438d-b9f7-06647235861a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:10.517625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e69b826a-05f9-438d-b9f7-06647235861a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:10.518064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e69b826a-05f9-438d-b9f7-06647235861a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:10.518777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e69b826a-05f9-438d-b9f7-06647235861a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:10.519232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e69b826a-05f9-438d-b9f7-06647235861a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:10.519655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e69b826a-05f9-438d-b9f7-06647235861a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:10.595940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e69b826a-05f9-438d-b9f7-06647235861a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:10.608215 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e69b826a-05f9-438d-b9f7-06647235861a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1258 microversion: 2.1 time: 0.101518 Oct 18 13:18:10.608915 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 277/571] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:10 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1258 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:10.627276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d105c3d4-dbb8-4363-aa93-1090d116eaa0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:10.628072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d105c3d4-dbb8-4363-aa93-1090d116eaa0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:10.635259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d105c3d4-dbb8-4363-aa93-1090d116eaa0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:10.635752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d105c3d4-dbb8-4363-aa93-1090d116eaa0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:10.636331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d105c3d4-dbb8-4363-aa93-1090d116eaa0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:10.637405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d105c3d4-dbb8-4363-aa93-1090d116eaa0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:10.638011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d105c3d4-dbb8-4363-aa93-1090d116eaa0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:10.638438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d105c3d4-dbb8-4363-aa93-1090d116eaa0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:10.800713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d105c3d4-dbb8-4363-aa93-1090d116eaa0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:10.811873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d105c3d4-dbb8-4363-aa93-1090d116eaa0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:10.814212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d105c3d4-dbb8-4363-aa93-1090d116eaa0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:10.815790 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d105c3d4-dbb8-4363-aa93-1090d116eaa0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1567 microversion: 2.25 time: 0.193225 Oct 18 13:18:10.817228 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 278/572] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:10 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:10.822745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b3ebdeec-c078-4d92-af2e-a8c718aa8474 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:10.823486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b3ebdeec-c078-4d92-af2e-a8c718aa8474 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:10.829929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3ebdeec-c078-4d92-af2e-a8c718aa8474 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:10.830851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3ebdeec-c078-4d92-af2e-a8c718aa8474 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:10.832096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3ebdeec-c078-4d92-af2e-a8c718aa8474 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:10.833091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3ebdeec-c078-4d92-af2e-a8c718aa8474 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:10.834370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3ebdeec-c078-4d92-af2e-a8c718aa8474 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:10.835113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3ebdeec-c078-4d92-af2e-a8c718aa8474 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:10.865310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:11.034447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b3ebdeec-c078-4d92-af2e-a8c718aa8474 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:11.044280 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b3ebdeec-c078-4d92-af2e-a8c718aa8474 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 200 len: 1314 microversion: 2.1 time: 0.225753 Oct 18 13:18:11.045062 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 279/573] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:10 2022] GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:11.192643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-319416954", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:11.253911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:18:11.623215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:18:11.629557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:18:11.630810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:18:11.632110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:18:11.633557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:18:11.649623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:11.650457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:11.651594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:11.652737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:11.653684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:11.654927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:11.680114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Getting quotas for project 8a528eb6958a44b7b55e3c1ca5b10ccd. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:18:11.687695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Getting quotas for user 52570dac8b2049999a0fb325b26e2be1 and project 8a528eb6958a44b7b55e3c1ca5b10ccd. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:18:11.729775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:18:11.733655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:18:11.837737 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-40a52a84-cdb5-4429-ac00-f4dd02ab9d70 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791339 Oct 18 13:18:11.838802 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 280/574] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:18:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:18:11.843916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-79753831-6752-4e6a-bf14-3e8dd948050b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:11.844860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-79753831-6752-4e6a-bf14-3e8dd948050b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:11.854790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79753831-6752-4e6a-bf14-3e8dd948050b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:11.855600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79753831-6752-4e6a-bf14-3e8dd948050b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:11.856400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79753831-6752-4e6a-bf14-3e8dd948050b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:11.857905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79753831-6752-4e6a-bf14-3e8dd948050b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:11.858530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79753831-6752-4e6a-bf14-3e8dd948050b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:11.859801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79753831-6752-4e6a-bf14-3e8dd948050b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:12.338890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79753831-6752-4e6a-bf14-3e8dd948050b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:12.349934 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-79753831-6752-4e6a-bf14-3e8dd948050b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1465 microversion: 2.1 time: 0.509876 Oct 18 13:18:12.350881 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 281/575] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:11 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1465 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:12.356463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-63239cb5-cb5f-4a8a-95be-020f2763dd86 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:12.357508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-63239cb5-cb5f-4a8a-95be-020f2763dd86 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:12.363815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63239cb5-cb5f-4a8a-95be-020f2763dd86 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:12.364544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63239cb5-cb5f-4a8a-95be-020f2763dd86 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:12.365050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63239cb5-cb5f-4a8a-95be-020f2763dd86 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:12.365866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63239cb5-cb5f-4a8a-95be-020f2763dd86 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:12.366513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63239cb5-cb5f-4a8a-95be-020f2763dd86 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:12.367691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63239cb5-cb5f-4a8a-95be-020f2763dd86 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:12.479268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-63239cb5-cb5f-4a8a-95be-020f2763dd86 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:12.490678 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-63239cb5-cb5f-4a8a-95be-020f2763dd86 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1274 microversion: 2.1 time: 0.137683 Oct 18 13:18:12.506237 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 282/576] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:12 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:12.514743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c0b6cd77-5679-4392-9489-5a2ad4e24501 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:12.516233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c0b6cd77-5679-4392-9489-5a2ad4e24501 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:12.527213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0b6cd77-5679-4392-9489-5a2ad4e24501 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:12.528055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0b6cd77-5679-4392-9489-5a2ad4e24501 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:12.528651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0b6cd77-5679-4392-9489-5a2ad4e24501 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:12.530248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0b6cd77-5679-4392-9489-5a2ad4e24501 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:12.531340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0b6cd77-5679-4392-9489-5a2ad4e24501 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:12.532288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0b6cd77-5679-4392-9489-5a2ad4e24501 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:12.762655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Building network info cache for instance {{(pid=120612) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:18:12.933233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c0b6cd77-5679-4392-9489-5a2ad4e24501 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:12.951126 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c0b6cd77-5679-4392-9489-5a2ad4e24501 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1475 microversion: 2.1 time: 0.442672 Oct 18 13:18:12.952531 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 283/577] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:12 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1475 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:12.972539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aeeaa581-5228-46f2-af0d-2e62a3f85a88 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:12.979018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aeeaa581-5228-46f2-af0d-2e62a3f85a88 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:12.986637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aeeaa581-5228-46f2-af0d-2e62a3f85a88 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:12.987126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aeeaa581-5228-46f2-af0d-2e62a3f85a88 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:12.997984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aeeaa581-5228-46f2-af0d-2e62a3f85a88 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:12.999044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aeeaa581-5228-46f2-af0d-2e62a3f85a88 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:12.999678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aeeaa581-5228-46f2-af0d-2e62a3f85a88 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:13.000285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aeeaa581-5228-46f2-af0d-2e62a3f85a88 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:13.152387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aeeaa581-5228-46f2-af0d-2e62a3f85a88 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:13.160660 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aeeaa581-5228-46f2-af0d-2e62a3f85a88 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1314 microversion: 2.1 time: 0.205427 Oct 18 13:18:13.163896 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 284/578] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:12 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:13.178072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-5d3e4428-b1ca-4844-8b79-3ff99d07e5ba req-b3bd560d-3751-4eeb-929b-ddf3734ac6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecaf364-e10b-44e5-a2f2-a658d052e1e8", "name": "network-vif-plugged", "status": "completed", "tag": "85e7e852-48c1-497b-b338-b36e1ae6599c"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:13.197941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5d3e4428-b1ca-4844-8b79-3ff99d07e5ba req-b3bd560d-3751-4eeb-929b-ddf3734ac6a7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:13.198799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5d3e4428-b1ca-4844-8b79-3ff99d07e5ba req-b3bd560d-3751-4eeb-929b-ddf3734ac6a7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:13.199528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5d3e4428-b1ca-4844-8b79-3ff99d07e5ba req-b3bd560d-3751-4eeb-929b-ddf3734ac6a7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:13.217498 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-5d3e4428-b1ca-4844-8b79-3ff99d07e5ba req-b3bd560d-3751-4eeb-929b-ddf3734ac6a7 service nova] Creating event network-vif-plugged:85e7e852-48c1-497b-b338-b36e1ae6599c for instance eecaf364-e10b-44e5-a2f2-a658d052e1e8 on n-h2-858384-13 Oct 18 13:18:13.224055 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-5d3e4428-b1ca-4844-8b79-3ff99d07e5ba req-b3bd560d-3751-4eeb-929b-ddf3734ac6a7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049286 Oct 18 13:18:13.224982 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 285/579] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:13.244913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7fe2e9e6-8665-4363-881b-47b8fc6273e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:13.247126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7fe2e9e6-8665-4363-881b-47b8fc6273e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:13.267083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fe2e9e6-8665-4363-881b-47b8fc6273e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:13.267884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fe2e9e6-8665-4363-881b-47b8fc6273e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:13.270200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fe2e9e6-8665-4363-881b-47b8fc6273e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:13.271372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fe2e9e6-8665-4363-881b-47b8fc6273e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:13.273788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fe2e9e6-8665-4363-881b-47b8fc6273e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:13.274762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fe2e9e6-8665-4363-881b-47b8fc6273e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:13.777816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7fe2e9e6-8665-4363-881b-47b8fc6273e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:13.786643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7fe2e9e6-8665-4363-881b-47b8fc6273e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:13.788165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7fe2e9e6-8665-4363-881b-47b8fc6273e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:13.789457 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7fe2e9e6-8665-4363-881b-47b8fc6273e3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1567 microversion: 2.25 time: 0.562403 Oct 18 13:18:13.823079 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 286/580] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:13 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1567 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:13.829087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a568608b-d79c-4757-981b-23345b746c4c tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:13.830028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a568608b-d79c-4757-981b-23345b746c4c tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:13.844294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a568608b-d79c-4757-981b-23345b746c4c tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:13.845194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a568608b-d79c-4757-981b-23345b746c4c tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:13.846012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a568608b-d79c-4757-981b-23345b746c4c tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:13.846903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a568608b-d79c-4757-981b-23345b746c4c tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:13.847369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a568608b-d79c-4757-981b-23345b746c4c tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:13.847942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a568608b-d79c-4757-981b-23345b746c4c tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:14.009411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a568608b-d79c-4757-981b-23345b746c4c tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:14.024112 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a568608b-d79c-4757-981b-23345b746c4c tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1218 microversion: 2.1 time: 0.199388 Oct 18 13:18:14.039364 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 287/581] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:13 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:14.055083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-813a75a9-9297-472e-aee2-fa189d277d9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:14.056090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-813a75a9-9297-472e-aee2-fa189d277d9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:14.063734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-813a75a9-9297-472e-aee2-fa189d277d9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:14.064568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-813a75a9-9297-472e-aee2-fa189d277d9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:14.065267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-813a75a9-9297-472e-aee2-fa189d277d9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:14.066188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-813a75a9-9297-472e-aee2-fa189d277d9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:14.066869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-813a75a9-9297-472e-aee2-fa189d277d9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:14.067511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-813a75a9-9297-472e-aee2-fa189d277d9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:14.330247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Updating instance_info_cache with network_info: [{"id": "7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5", "address": "fa:16:3e:39:47:12", "network": {"id": "a22da94d-677f-457d-bbf8-95010fd233ef", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1194878154-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a7b9ff58f71c425d8853ec2d0466ee3a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7f2098ee-ff", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120612) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:18:14.344942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Releasing lock "refresh_cache-f97ccda6-c665-4a4f-b099-72b142b143b7" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:18:14.345858 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-425d484b-bf3d-46b4-81f0-8898f8ad188d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "POST /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7/action" status: 202 len: 0 microversion: 2.1 time: 4.379102 Oct 18 13:18:14.346991 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 295/582] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:09 2022] POST /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7/action => generated 0 bytes in 4381 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:18:14.353075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-4114611e-d7c4-4190-b835-1b575938eaf4 req-17dd9738-a128-4b00-a8a1-0cee14fe643f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97ccda6-c665-4a4f-b099-72b142b143b7", "tag": "7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:14.369634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4114611e-d7c4-4190-b835-1b575938eaf4 req-17dd9738-a128-4b00-a8a1-0cee14fe643f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:14.370118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4114611e-d7c4-4190-b835-1b575938eaf4 req-17dd9738-a128-4b00-a8a1-0cee14fe643f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:14.370554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4114611e-d7c4-4190-b835-1b575938eaf4 req-17dd9738-a128-4b00-a8a1-0cee14fe643f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:14.383364 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4114611e-d7c4-4190-b835-1b575938eaf4 req-17dd9738-a128-4b00-a8a1-0cee14fe643f service nova] Creating event network-changed:7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5 for instance f97ccda6-c665-4a4f-b099-72b142b143b7 on n-h1-858384-13 Oct 18 13:18:14.389000 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-4114611e-d7c4-4190-b835-1b575938eaf4 req-17dd9738-a128-4b00-a8a1-0cee14fe643f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040158 Oct 18 13:18:14.389608 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 296/583] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:14.394938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:14.395636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:14.402663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:14.403383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:14.403921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:14.404729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:14.405382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:14.405882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:14.443123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:14.443728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:14.444167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:14.444697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lazy-loading 'fault' on Instance uuid e25fedd8-04af-4785-b69e-70ab95bd9649 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:18:14.496335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:14.505416 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-82aa110b-8cf2-4c91-a276-9a34ab8dbce7 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 200 len: 1309 microversion: 2.1 time: 0.114497 Oct 18 13:18:14.506012 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 297/584] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:14 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:14.512283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3e5f9680-6ca2-4203-b77f-1331c98b4c56 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:14.513163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3e5f9680-6ca2-4203-b77f-1331c98b4c56 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:14.521228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e5f9680-6ca2-4203-b77f-1331c98b4c56 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:14.521978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e5f9680-6ca2-4203-b77f-1331c98b4c56 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:14.522728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e5f9680-6ca2-4203-b77f-1331c98b4c56 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:14.523781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e5f9680-6ca2-4203-b77f-1331c98b4c56 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:14.524759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e5f9680-6ca2-4203-b77f-1331c98b4c56 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:14.525775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e5f9680-6ca2-4203-b77f-1331c98b4c56 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:14.805641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-813a75a9-9297-472e-aee2-fa189d277d9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:14.818167 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-813a75a9-9297-472e-aee2-fa189d277d9f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 200 len: 1314 microversion: 2.1 time: 0.770242 Oct 18 13:18:14.820320 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 288/585] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:14 2022] GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:14.830596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a7bed3cd-906f-42f8-9800-d491b03b5647 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:14.837076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a7bed3cd-906f-42f8-9800-d491b03b5647 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:14.850057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7bed3cd-906f-42f8-9800-d491b03b5647 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:14.851713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7bed3cd-906f-42f8-9800-d491b03b5647 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:14.856491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7bed3cd-906f-42f8-9800-d491b03b5647 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:14.857608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7bed3cd-906f-42f8-9800-d491b03b5647 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:14.858143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7bed3cd-906f-42f8-9800-d491b03b5647 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:14.858809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7bed3cd-906f-42f8-9800-d491b03b5647 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:14.996346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3e5f9680-6ca2-4203-b77f-1331c98b4c56 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:15.003968 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3e5f9680-6ca2-4203-b77f-1331c98b4c56 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1280 microversion: 2.1 time: 0.496740 Oct 18 13:18:15.004551 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 298/586] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:14 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1280 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:15.023855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-6a054a26-c948-4fdb-b647-78ba8dc21965 req-30e0b775-bbb7-4c9b-abb3-aafb5fffac55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f199ac-a7c9-4a5c-929a-f734ea6c3d80", "name": "network-vif-unplugged", "status": "completed", "tag": "0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:15.040595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6a054a26-c948-4fdb-b647-78ba8dc21965 req-30e0b775-bbb7-4c9b-abb3-aafb5fffac55 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:15.042013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6a054a26-c948-4fdb-b647-78ba8dc21965 req-30e0b775-bbb7-4c9b-abb3-aafb5fffac55 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:15.042523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6a054a26-c948-4fdb-b647-78ba8dc21965 req-30e0b775-bbb7-4c9b-abb3-aafb5fffac55 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:15.092642 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-6a054a26-c948-4fdb-b647-78ba8dc21965 req-30e0b775-bbb7-4c9b-abb3-aafb5fffac55 service nova] Creating event network-vif-unplugged:0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1 for instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 on n-h2-858384-13 Oct 18 13:18:15.113697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-6a054a26-c948-4fdb-b647-78ba8dc21965 req-30e0b775-bbb7-4c9b-abb3-aafb5fffac55 service nova] Instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:18:15.131186 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-6a054a26-c948-4fdb-b647-78ba8dc21965 req-30e0b775-bbb7-4c9b-abb3-aafb5fffac55 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114834 Oct 18 13:18:15.131990 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 299/587] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:15.144932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b5dff913-a69f-4e98-9e7a-48a56ba9e68d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:15.145797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b5dff913-a69f-4e98-9e7a-48a56ba9e68d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:15.155309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5dff913-a69f-4e98-9e7a-48a56ba9e68d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:15.156065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5dff913-a69f-4e98-9e7a-48a56ba9e68d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:15.157738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5dff913-a69f-4e98-9e7a-48a56ba9e68d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:15.158636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5dff913-a69f-4e98-9e7a-48a56ba9e68d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:15.159253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5dff913-a69f-4e98-9e7a-48a56ba9e68d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:15.159776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5dff913-a69f-4e98-9e7a-48a56ba9e68d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:15.366061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b5dff913-a69f-4e98-9e7a-48a56ba9e68d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:15.387867 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b5dff913-a69f-4e98-9e7a-48a56ba9e68d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1320 microversion: 2.1 time: 0.254088 Oct 18 13:18:15.391780 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 300/588] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:15 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1320 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:15.417604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.128"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:15.424800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:15.442913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:15.443983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:15.455351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:15.458969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:15.462985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:15.464504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:15.485635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a7bed3cd-906f-42f8-9800-d491b03b5647 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:15.497617 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a7bed3cd-906f-42f8-9800-d491b03b5647 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1475 microversion: 2.1 time: 0.672190 Oct 18 13:18:15.508249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "refresh_cache-4e257aea-4f80-4311-8216-9f3b8481507a" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:18:15.508897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquired lock "refresh_cache-4e257aea-4f80-4311-8216-9f3b8481507a" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:18:15.515121 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 289/589] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:14 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1475 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:15.526771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a315e646-227b-4f77-a247-fab535a5c99e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:15.527622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a315e646-227b-4f77-a247-fab535a5c99e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:15.536933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a315e646-227b-4f77-a247-fab535a5c99e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:15.538182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a315e646-227b-4f77-a247-fab535a5c99e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:15.538872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a315e646-227b-4f77-a247-fab535a5c99e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:15.540346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a315e646-227b-4f77-a247-fab535a5c99e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:15.541018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a315e646-227b-4f77-a247-fab535a5c99e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:15.543190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a315e646-227b-4f77-a247-fab535a5c99e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:16.070365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a315e646-227b-4f77-a247-fab535a5c99e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:16.080037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a315e646-227b-4f77-a247-fab535a5c99e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:16.084945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a315e646-227b-4f77-a247-fab535a5c99e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:16.093869 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a315e646-227b-4f77-a247-fab535a5c99e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1567 microversion: 2.25 time: 0.576831 Oct 18 13:18:16.096437 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 290/590] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:15 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1567 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:16.108791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ab281c39-0ec7-4dfa-839c-94dae9ae06d2 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:16.113596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ab281c39-0ec7-4dfa-839c-94dae9ae06d2 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:16.115666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:16.127632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab281c39-0ec7-4dfa-839c-94dae9ae06d2 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:16.128785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab281c39-0ec7-4dfa-839c-94dae9ae06d2 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:16.129844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab281c39-0ec7-4dfa-839c-94dae9ae06d2 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:16.131290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab281c39-0ec7-4dfa-839c-94dae9ae06d2 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:16.132887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab281c39-0ec7-4dfa-839c-94dae9ae06d2 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:16.133886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab281c39-0ec7-4dfa-839c-94dae9ae06d2 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:16.275599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ab281c39-0ec7-4dfa-839c-94dae9ae06d2 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:16.286492 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ab281c39-0ec7-4dfa-839c-94dae9ae06d2 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1280 microversion: 2.1 time: 0.184767 Oct 18 13:18:16.287418 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 291/591] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:16 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1280 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:16.293153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-fefee2ab-0066-4a37-b8c5-98d80e77aa58 req-fda4db09-6dcb-4054-915f-a4722783c9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a", "name": "network-vif-plugged", "status": "completed", "tag": "127093c0-7bb4-4851-9d3b-35d03d5712b9"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:16.303363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fefee2ab-0066-4a37-b8c5-98d80e77aa58 req-fda4db09-6dcb-4054-915f-a4722783c9aa service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:16.304239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fefee2ab-0066-4a37-b8c5-98d80e77aa58 req-fda4db09-6dcb-4054-915f-a4722783c9aa service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:16.305157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fefee2ab-0066-4a37-b8c5-98d80e77aa58 req-fda4db09-6dcb-4054-915f-a4722783c9aa service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:16.317663 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-fefee2ab-0066-4a37-b8c5-98d80e77aa58 req-fda4db09-6dcb-4054-915f-a4722783c9aa service nova] Creating event network-vif-plugged:127093c0-7bb4-4851-9d3b-35d03d5712b9 for instance 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a on n-h1-858384-13 Oct 18 13:18:16.324298 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-fefee2ab-0066-4a37-b8c5-98d80e77aa58 req-fda4db09-6dcb-4054-915f-a4722783c9aa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034878 Oct 18 13:18:16.329267 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 292/592] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:16.336214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9ae0dc6b-3411-411a-8d7f-eaf59776b20d tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:16.337292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9ae0dc6b-3411-411a-8d7f-eaf59776b20d tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: e25fedd8-04af-4785-b69e-70ab95bd9649] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:16.345132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ae0dc6b-3411-411a-8d7f-eaf59776b20d tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:16.346003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ae0dc6b-3411-411a-8d7f-eaf59776b20d tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:16.346651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ae0dc6b-3411-411a-8d7f-eaf59776b20d tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:16.347657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ae0dc6b-3411-411a-8d7f-eaf59776b20d tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:16.348325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ae0dc6b-3411-411a-8d7f-eaf59776b20d tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:16.349043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ae0dc6b-3411-411a-8d7f-eaf59776b20d tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:16.363822 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-9ae0dc6b-3411-411a-8d7f-eaf59776b20d tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] HTTP exception thrown: Instance e25fedd8-04af-4785-b69e-70ab95bd9649 could not be found. Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9ae0dc6b-3411-411a-8d7f-eaf59776b20d tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Request method failure captured: Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 HTTP/1.1 Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdSBG6vFtRclXJIlV5_g9zuCY4dFk3M-XKB4n_5aXPWBpeRSgIm3dPnfe2Z-z2U4AqeK6bmx0P4HPFleWeIXsw6oCmTHtwUchFg6PDKe9AXBqX9qbz21d5oYV14eicQtYtGMYMCA7SM0PMXak_EtZtFhtGHq8CzzMLlezhLWutNNr8 Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7c65a39f96a0450691774ebdf4a4122d Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-LiveMigrationNegativeTest-116066920 Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:18:16.365941 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:18:16.367896 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7c65a39f96a0450691774ebdf4a4122d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7c65a39f96a0450691774ebdf4a4122d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7c65a39f96a0450691774ebdf4a4122d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7c65a39f96a0450691774ebdf4a4122d"}]}] Oct 18 13:18:16.367896 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-LiveMigrationNegativeTest-116066920 Oct 18 13:18:16.367896 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7c65a39f96a0450691774ebdf4a4122d Oct 18 13:18:16.367896 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-116066920 Oct 18 13:18:16.367896 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-LiveMigrationNegativeTest-116066920-project Oct 18 13:18:16.367896 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:16.367896 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:16.367896 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 8fdc8cbdac3a4a93bd0a4c8f2a06e579 Oct 18 13:18:16.367896 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-LiveMigrationNegativeTest-116066920-project Oct 18 13:18:16.367896 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:18:16.367896 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance e25fedd8-04af-4785-b69e-70ab95bd9649 could not be found. Oct 18 13:18:16.367896 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'e25fedd8-04af-4785-b69e-70ab95bd9649'} Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e25fedd8-04af-4785-b69e-70ab95bd9649 could not be found. Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:16.368749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e25fedd8-04af-4785-b69e-70ab95bd9649 could not be found. Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e25fedd8-04af-4785-b69e-70ab95bd9649 could not be found. Oct 18 13:18:16.370017 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:16.374292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9ae0dc6b-3411-411a-8d7f-eaf59776b20d tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Returning 404 to user: Instance e25fedd8-04af-4785-b69e-70ab95bd9649 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:16.376495 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9ae0dc6b-3411-411a-8d7f-eaf59776b20d tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649" status: 404 len: 111 microversion: 2.1 time: 0.044273 Oct 18 13:18:16.377496 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 293/593] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:16 2022] GET /compute/v2.1/servers/e25fedd8-04af-4785-b69e-70ab95bd9649 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:18:16.384148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6a27db55-c60a-403e-ade6-c6a995c555b7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:16.385835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6a27db55-c60a-403e-ade6-c6a995c555b7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:16.402110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a27db55-c60a-403e-ade6-c6a995c555b7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:16.403416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a27db55-c60a-403e-ade6-c6a995c555b7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:16.405251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a27db55-c60a-403e-ade6-c6a995c555b7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:16.407819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a27db55-c60a-403e-ade6-c6a995c555b7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:16.408521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a27db55-c60a-403e-ade6-c6a995c555b7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:16.409372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a27db55-c60a-403e-ade6-c6a995c555b7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:16.746727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6a27db55-c60a-403e-ade6-c6a995c555b7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:16.763464 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6a27db55-c60a-403e-ade6-c6a995c555b7 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 200 len: 1464 microversion: 2.1 time: 0.384191 Oct 18 13:18:16.765573 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 294/594] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:16 2022] GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 1464 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:16.775345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-66833b3f-e6bd-4965-9a43-fc9d52923f9c tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:16.776464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-66833b3f-e6bd-4965-9a43-fc9d52923f9c tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:16.789550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66833b3f-e6bd-4965-9a43-fc9d52923f9c tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:16.790571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66833b3f-e6bd-4965-9a43-fc9d52923f9c tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:16.791357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66833b3f-e6bd-4965-9a43-fc9d52923f9c tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:16.792637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66833b3f-e6bd-4965-9a43-fc9d52923f9c tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:16.793379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66833b3f-e6bd-4965-9a43-fc9d52923f9c tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:16.794138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66833b3f-e6bd-4965-9a43-fc9d52923f9c tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:17.138055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-66833b3f-e6bd-4965-9a43-fc9d52923f9c tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:17.146760 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-66833b3f-e6bd-4965-9a43-fc9d52923f9c tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1322 microversion: 2.1 time: 0.379743 Oct 18 13:18:17.147424 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 295/595] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:16 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:17.153133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-08022bce-41b9-4266-a9a8-e85f8a740d99 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:17.154525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-08022bce-41b9-4266-a9a8-e85f8a740d99 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:17.161050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08022bce-41b9-4266-a9a8-e85f8a740d99 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:17.161847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08022bce-41b9-4266-a9a8-e85f8a740d99 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:17.162610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08022bce-41b9-4266-a9a8-e85f8a740d99 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:17.164167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08022bce-41b9-4266-a9a8-e85f8a740d99 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:17.164858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08022bce-41b9-4266-a9a8-e85f8a740d99 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:17.165392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08022bce-41b9-4266-a9a8-e85f8a740d99 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:17.193149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-08022bce-41b9-4266-a9a8-e85f8a740d99 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:18:17.283982 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-08022bce-41b9-4266-a9a8-e85f8a740d99 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 204 len: 0 microversion: 2.1 time: 0.134478 Oct 18 13:18:17.284606 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 296/596] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:18:17 2022] DELETE /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:18:17.291971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-894fb25f-a605-4961-8d33-37001493bd90 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:17.293171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-894fb25f-a605-4961-8d33-37001493bd90 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:17.300697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-894fb25f-a605-4961-8d33-37001493bd90 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:17.301284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-894fb25f-a605-4961-8d33-37001493bd90 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:17.301723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-894fb25f-a605-4961-8d33-37001493bd90 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:17.302558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-894fb25f-a605-4961-8d33-37001493bd90 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:17.303224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-894fb25f-a605-4961-8d33-37001493bd90 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:17.303679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-894fb25f-a605-4961-8d33-37001493bd90 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:17.309218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:17.393217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-894fb25f-a605-4961-8d33-37001493bd90 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:17.402098 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-894fb25f-a605-4961-8d33-37001493bd90 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1320 microversion: 2.1 time: 0.115915 Oct 18 13:18:17.403099 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 297/597] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:17 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1320 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:17.407803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-415892ba-5885-4436-bac7-71abe9c99094 req-6cb62d7d-b3a0-47c6-b9c7-48cdc0cfc553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25fedd8-04af-4785-b69e-70ab95bd9649", "name": "network-vif-deleted", "tag": "94413581-3b66-42c4-8f27-556772297e7e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:17.418306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-415892ba-5885-4436-bac7-71abe9c99094 req-6cb62d7d-b3a0-47c6-b9c7-48cdc0cfc553 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:17.418784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-415892ba-5885-4436-bac7-71abe9c99094 req-6cb62d7d-b3a0-47c6-b9c7-48cdc0cfc553 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:17.419417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-415892ba-5885-4436-bac7-71abe9c99094 req-6cb62d7d-b3a0-47c6-b9c7-48cdc0cfc553 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:17.432300 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-415892ba-5885-4436-bac7-71abe9c99094 req-6cb62d7d-b3a0-47c6-b9c7-48cdc0cfc553 service nova] Creating event network-vif-deleted:94413581-3b66-42c4-8f27-556772297e7e for instance e25fedd8-04af-4785-b69e-70ab95bd9649 on n-h1-858384-13 Oct 18 13:18:17.437412 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-415892ba-5885-4436-bac7-71abe9c99094 req-6cb62d7d-b3a0-47c6-b9c7-48cdc0cfc553 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032851 Oct 18 13:18:17.438580 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 298/598] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:17.443929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-58811060-c726-434d-99be-a80e02dcdd5e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:17.444889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-58811060-c726-434d-99be-a80e02dcdd5e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:17.451849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58811060-c726-434d-99be-a80e02dcdd5e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:17.452338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58811060-c726-434d-99be-a80e02dcdd5e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:17.452774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58811060-c726-434d-99be-a80e02dcdd5e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:17.453541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58811060-c726-434d-99be-a80e02dcdd5e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:17.453979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58811060-c726-434d-99be-a80e02dcdd5e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:17.454400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58811060-c726-434d-99be-a80e02dcdd5e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:17.607142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-58811060-c726-434d-99be-a80e02dcdd5e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:17.620230 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-58811060-c726-434d-99be-a80e02dcdd5e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1473 microversion: 2.1 time: 0.180311 Oct 18 13:18:17.620822 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 299/599] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:17 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1473 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:17.625265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d7d1a9ea-998b-433e-a5a4-9c2ccf3efd7e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:17.626049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d7d1a9ea-998b-433e-a5a4-9c2ccf3efd7e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:17.631703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7d1a9ea-998b-433e-a5a4-9c2ccf3efd7e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:17.633051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7d1a9ea-998b-433e-a5a4-9c2ccf3efd7e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:17.633657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7d1a9ea-998b-433e-a5a4-9c2ccf3efd7e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:17.634345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7d1a9ea-998b-433e-a5a4-9c2ccf3efd7e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:17.634955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7d1a9ea-998b-433e-a5a4-9c2ccf3efd7e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:17.635643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7d1a9ea-998b-433e-a5a4-9c2ccf3efd7e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:17.771609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d7d1a9ea-998b-433e-a5a4-9c2ccf3efd7e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:17.779985 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d7d1a9ea-998b-433e-a5a4-9c2ccf3efd7e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1313 microversion: 2.1 time: 0.158139 Oct 18 13:18:17.781469 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 300/600] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:17 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:17.785901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b18b5147-f3d1-47ea-b7d9-35ad428a3574 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:17.786642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b18b5147-f3d1-47ea-b7d9-35ad428a3574 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:17.793254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b18b5147-f3d1-47ea-b7d9-35ad428a3574 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:17.793742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b18b5147-f3d1-47ea-b7d9-35ad428a3574 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:17.794174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b18b5147-f3d1-47ea-b7d9-35ad428a3574 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:17.794874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b18b5147-f3d1-47ea-b7d9-35ad428a3574 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:17.795328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b18b5147-f3d1-47ea-b7d9-35ad428a3574 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:17.795752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b18b5147-f3d1-47ea-b7d9-35ad428a3574 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:18.030031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b18b5147-f3d1-47ea-b7d9-35ad428a3574 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:18.046681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b18b5147-f3d1-47ea-b7d9-35ad428a3574 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:18.054483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b18b5147-f3d1-47ea-b7d9-35ad428a3574 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:18.055857 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b18b5147-f3d1-47ea-b7d9-35ad428a3574 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1567 microversion: 2.25 time: 0.273516 Oct 18 13:18:18.069406 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 301/601] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:17 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:18.075781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9c1e276f-0b4d-4ffc-b177-2b7d2843afc6 req-a07d50f7-f734-4ec4-a5d4-d57cc7c312fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f199ac-a7c9-4a5c-929a-f734ea6c3d80", "tag": "0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:18.087520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9c1e276f-0b4d-4ffc-b177-2b7d2843afc6 req-a07d50f7-f734-4ec4-a5d4-d57cc7c312fb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:18.088260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9c1e276f-0b4d-4ffc-b177-2b7d2843afc6 req-a07d50f7-f734-4ec4-a5d4-d57cc7c312fb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:18.088853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9c1e276f-0b4d-4ffc-b177-2b7d2843afc6 req-a07d50f7-f734-4ec4-a5d4-d57cc7c312fb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:18.103800 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9c1e276f-0b4d-4ffc-b177-2b7d2843afc6 req-a07d50f7-f734-4ec4-a5d4-d57cc7c312fb service nova] Creating event network-changed:0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1 for instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 on n-h2-858384-13 Oct 18 13:18:18.117760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [req-9c1e276f-0b4d-4ffc-b177-2b7d2843afc6 req-a07d50f7-f734-4ec4-a5d4-d57cc7c312fb service nova] Instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:18:18.129794 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9c1e276f-0b4d-4ffc-b177-2b7d2843afc6 req-a07d50f7-f734-4ec4-a5d4-d57cc7c312fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058449 Oct 18 13:18:18.130393 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 302/602] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:18.139436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-16bbfaef-e795-46f9-871d-57e233004a2b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:18.140873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-16bbfaef-e795-46f9-871d-57e233004a2b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:18.148918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16bbfaef-e795-46f9-871d-57e233004a2b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:18.149746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16bbfaef-e795-46f9-871d-57e233004a2b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:18.150352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16bbfaef-e795-46f9-871d-57e233004a2b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:18.151064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16bbfaef-e795-46f9-871d-57e233004a2b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:18.151671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16bbfaef-e795-46f9-871d-57e233004a2b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:18.152277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16bbfaef-e795-46f9-871d-57e233004a2b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:18.355051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-16bbfaef-e795-46f9-871d-57e233004a2b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:18.364010 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-16bbfaef-e795-46f9-871d-57e233004a2b tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1472 microversion: 2.1 time: 0.228594 Oct 18 13:18:18.377791 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 303/603] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:18 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:18.381224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1729eea0-0ea3-40aa-85aa-687419d3e5ff tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:18.381224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1729eea0-0ea3-40aa-85aa-687419d3e5ff tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:18.389556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1729eea0-0ea3-40aa-85aa-687419d3e5ff tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:18.390170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1729eea0-0ea3-40aa-85aa-687419d3e5ff tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:18.390675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1729eea0-0ea3-40aa-85aa-687419d3e5ff tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:18.391490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1729eea0-0ea3-40aa-85aa-687419d3e5ff tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:18.392033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1729eea0-0ea3-40aa-85aa-687419d3e5ff tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:18.392520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1729eea0-0ea3-40aa-85aa-687419d3e5ff tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:18.474418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1729eea0-0ea3-40aa-85aa-687419d3e5ff tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:18.483172 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1729eea0-0ea3-40aa-85aa-687419d3e5ff tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1280 microversion: 2.1 time: 0.109152 Oct 18 13:18:18.483836 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 304/604] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:18 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1280 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:18.488734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e8905069-4f8d-4a55-8e84-43a34baa5213 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:18.489375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e8905069-4f8d-4a55-8e84-43a34baa5213 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:18.496255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8905069-4f8d-4a55-8e84-43a34baa5213 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:18.496984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8905069-4f8d-4a55-8e84-43a34baa5213 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:18.497631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8905069-4f8d-4a55-8e84-43a34baa5213 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:18.499417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8905069-4f8d-4a55-8e84-43a34baa5213 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:18.500137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8905069-4f8d-4a55-8e84-43a34baa5213 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:18.500697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8905069-4f8d-4a55-8e84-43a34baa5213 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:18.642741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e8905069-4f8d-4a55-8e84-43a34baa5213 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:18.651143 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e8905069-4f8d-4a55-8e84-43a34baa5213 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1322 microversion: 2.1 time: 0.166201 Oct 18 13:18:18.651725 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 305/605] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:18 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:18.656412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-41935463-2df7-4378-a5b5-5b4b6bfce293 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:18.657013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-41935463-2df7-4378-a5b5-5b4b6bfce293 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:18.662944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41935463-2df7-4378-a5b5-5b4b6bfce293 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:18.663988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41935463-2df7-4378-a5b5-5b4b6bfce293 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:18.664598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41935463-2df7-4378-a5b5-5b4b6bfce293 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:18.665544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41935463-2df7-4378-a5b5-5b4b6bfce293 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:18.666148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41935463-2df7-4378-a5b5-5b4b6bfce293 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:18.666836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41935463-2df7-4378-a5b5-5b4b6bfce293 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:18.679734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:18.704568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:18.801656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-41935463-2df7-4378-a5b5-5b4b6bfce293 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:18.810539 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-41935463-2df7-4378-a5b5-5b4b6bfce293 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1388 microversion: 2.1 time: 0.156968 Oct 18 13:18:18.811145 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 306/606] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:18 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1388 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:18.815874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f1f62405-5deb-42a2-9226-f5803cb34ed8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:18.816599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f1f62405-5deb-42a2-9226-f5803cb34ed8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:18.827370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1f62405-5deb-42a2-9226-f5803cb34ed8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:18.828578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1f62405-5deb-42a2-9226-f5803cb34ed8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:18.829358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1f62405-5deb-42a2-9226-f5803cb34ed8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:18.830696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1f62405-5deb-42a2-9226-f5803cb34ed8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:18.831281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1f62405-5deb-42a2-9226-f5803cb34ed8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:18.831866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1f62405-5deb-42a2-9226-f5803cb34ed8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:18.991156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f1f62405-5deb-42a2-9226-f5803cb34ed8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:18.999476 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f1f62405-5deb-42a2-9226-f5803cb34ed8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1473 microversion: 2.1 time: 0.187184 Oct 18 13:18:19.000343 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 307/607] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:18 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1473 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:19.005631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4b461f5a-d280-4e90-8136-25438661095d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:19.006575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4b461f5a-d280-4e90-8136-25438661095d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:19.014335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b461f5a-d280-4e90-8136-25438661095d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:19.015206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b461f5a-d280-4e90-8136-25438661095d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:19.015870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b461f5a-d280-4e90-8136-25438661095d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:19.016794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b461f5a-d280-4e90-8136-25438661095d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:19.017476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b461f5a-d280-4e90-8136-25438661095d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:19.017897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b461f5a-d280-4e90-8136-25438661095d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:19.169801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b461f5a-d280-4e90-8136-25438661095d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:19.180390 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4b461f5a-d280-4e90-8136-25438661095d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1462 microversion: 2.1 time: 0.178306 Oct 18 13:18:19.181208 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 308/608] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:19 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1462 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:19.188023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-778c7b1a-db31-4815-9411-eae1435d8396 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:19.188644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-778c7b1a-db31-4815-9411-eae1435d8396 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:19.195103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-778c7b1a-db31-4815-9411-eae1435d8396 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:19.195587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-778c7b1a-db31-4815-9411-eae1435d8396 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:19.196022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-778c7b1a-db31-4815-9411-eae1435d8396 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:19.196974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-778c7b1a-db31-4815-9411-eae1435d8396 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:19.197322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-778c7b1a-db31-4815-9411-eae1435d8396 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:19.197758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-778c7b1a-db31-4815-9411-eae1435d8396 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:19.366600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-778c7b1a-db31-4815-9411-eae1435d8396 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:19.379229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-778c7b1a-db31-4815-9411-eae1435d8396 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:19.379229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-778c7b1a-db31-4815-9411-eae1435d8396 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:19.379229 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-778c7b1a-db31-4815-9411-eae1435d8396 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1557 microversion: 2.25 time: 0.194450 Oct 18 13:18:19.384054 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 309/609] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:19 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1557 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:19.384450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1974444543", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:19.449748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:18:19.705803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:18:19.706478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:18:19.707173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:18:19.708420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:18:19.709199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:18:19.720795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=35 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:19.724759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:19.728653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:19.729632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:19.730541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:19.731326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:19.731803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:19.746225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=9 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:19.766564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Getting quotas for project 4ca31a93e6854a0fa9cc37d0bb89a3c6. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:18:19.773377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Getting quotas for user e8af3705288d46ca94bf973f16aa1bb6 and project 4ca31a93e6854a0fa9cc37d0bb89a3c6. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:18:19.790166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:18:19.792504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:18:19.874460 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fd9d3c72-8355-44c8-88fc-7a4459e76cb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493267 Oct 18 13:18:19.875368 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 310/610] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:18:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:18:19.880225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ce858e4b-3421-4b10-875b-016f00732a15 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:19.881041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ce858e4b-3421-4b10-875b-016f00732a15 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:19.889607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce858e4b-3421-4b10-875b-016f00732a15 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:19.890820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce858e4b-3421-4b10-875b-016f00732a15 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:19.891262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce858e4b-3421-4b10-875b-016f00732a15 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:19.892087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce858e4b-3421-4b10-875b-016f00732a15 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:19.892542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce858e4b-3421-4b10-875b-016f00732a15 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:19.892963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce858e4b-3421-4b10-875b-016f00732a15 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:20.175632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ce858e4b-3421-4b10-875b-016f00732a15 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fdc8cbdac3a4a93bd0a4c8f2a06e579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65a39f96a0450691774ebdf4a4122d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:20.190928 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ce858e4b-3421-4b10-875b-016f00732a15 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 200 len: 1472 microversion: 2.1 time: 0.314247 Oct 18 13:18:20.193072 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 311/611] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:19 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:20.211051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-103e1ca3-2933-4e8a-a15f-c354b7464159 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '.version_select at 0x7ff60fe59af0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:20.217113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-103e1ca3-2933-4e8a-a15f-c354b7464159 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:20.217950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-103e1ca3-2933-4e8a-a15f-c354b7464159 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:20.219368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-103e1ca3-2933-4e8a-a15f-c354b7464159 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:20.251199 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-103e1ca3-2933-4e8a-a15f-c354b7464159 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1111 microversion: 2.25 time: 0.051948 Oct 18 13:18:20.255029 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 312/612] 10.222.0.40 () {60 vars in 1184 bytes} [Tue Oct 18 13:18:20 2022] GET /compute/v2.1/os-migrations => generated 1111 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:20.266484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4b6345e9-223e-4b7c-923f-38d2cc279d71 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:20.270265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4b6345e9-223e-4b7c-923f-38d2cc279d71 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:20.283224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b6345e9-223e-4b7c-923f-38d2cc279d71 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:20.285081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b6345e9-223e-4b7c-923f-38d2cc279d71 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:20.286694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b6345e9-223e-4b7c-923f-38d2cc279d71 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:20.287461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b6345e9-223e-4b7c-923f-38d2cc279d71 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:20.289414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b6345e9-223e-4b7c-923f-38d2cc279d71 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:20.291264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b6345e9-223e-4b7c-923f-38d2cc279d71 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:20.612725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b6345e9-223e-4b7c-923f-38d2cc279d71 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:20.629164 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4b6345e9-223e-4b7c-923f-38d2cc279d71 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1322 microversion: 2.1 time: 0.371917 Oct 18 13:18:20.647719 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 313/613] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:20 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:20.676381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-df65c381-12d8-47b7-9f51-529a00e67c57 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:20.677709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-df65c381-12d8-47b7-9f51-529a00e67c57 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:20.693651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df65c381-12d8-47b7-9f51-529a00e67c57 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:20.694639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df65c381-12d8-47b7-9f51-529a00e67c57 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:20.695330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df65c381-12d8-47b7-9f51-529a00e67c57 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:20.696331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df65c381-12d8-47b7-9f51-529a00e67c57 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:20.697005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df65c381-12d8-47b7-9f51-529a00e67c57 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:20.697936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df65c381-12d8-47b7-9f51-529a00e67c57 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:21.020422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-df65c381-12d8-47b7-9f51-529a00e67c57 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:21.030270 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-df65c381-12d8-47b7-9f51-529a00e67c57 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1322 microversion: 2.1 time: 0.380534 Oct 18 13:18:21.041615 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 314/614] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:20 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:21.054838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5bae4a4b-56df-42c7-af17-758314e2908e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:21.057502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5bae4a4b-56df-42c7-af17-758314e2908e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:21.069510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5bae4a4b-56df-42c7-af17-758314e2908e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:21.070171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5bae4a4b-56df-42c7-af17-758314e2908e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:21.070898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5bae4a4b-56df-42c7-af17-758314e2908e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:21.071864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5bae4a4b-56df-42c7-af17-758314e2908e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:21.072638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5bae4a4b-56df-42c7-af17-758314e2908e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:21.073327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5bae4a4b-56df-42c7-af17-758314e2908e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:21.333461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5bae4a4b-56df-42c7-af17-758314e2908e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:21.344175 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5bae4a4b-56df-42c7-af17-758314e2908e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1388 microversion: 2.1 time: 0.301209 Oct 18 13:18:21.370704 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 315/615] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:21 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1388 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:21.376307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0af4e7e7-bc48-4823-9e2f-c655e0876c5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:21.377265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0af4e7e7-bc48-4823-9e2f-c655e0876c5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:21.384249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0af4e7e7-bc48-4823-9e2f-c655e0876c5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:21.385589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0af4e7e7-bc48-4823-9e2f-c655e0876c5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:21.386311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0af4e7e7-bc48-4823-9e2f-c655e0876c5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:21.387276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0af4e7e7-bc48-4823-9e2f-c655e0876c5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:21.387973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0af4e7e7-bc48-4823-9e2f-c655e0876c5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:21.388615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0af4e7e7-bc48-4823-9e2f-c655e0876c5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:21.393696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:21.460372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0af4e7e7-bc48-4823-9e2f-c655e0876c5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:21.471658 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0af4e7e7-bc48-4823-9e2f-c655e0876c5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1218 microversion: 2.1 time: 0.099141 Oct 18 13:18:21.488628 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 316/616] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:21 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:21.488628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a309cca8-b3f0-45c4-b06f-6e499158a9ee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:21.488628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a309cca8-b3f0-45c4-b06f-6e499158a9ee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:21.488628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a309cca8-b3f0-45c4-b06f-6e499158a9ee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:21.488628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a309cca8-b3f0-45c4-b06f-6e499158a9ee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:21.489847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a309cca8-b3f0-45c4-b06f-6e499158a9ee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:21.489847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a309cca8-b3f0-45c4-b06f-6e499158a9ee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:21.489847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a309cca8-b3f0-45c4-b06f-6e499158a9ee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:21.490321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a309cca8-b3f0-45c4-b06f-6e499158a9ee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:22.068202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a309cca8-b3f0-45c4-b06f-6e499158a9ee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:22.072004 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.network.neutron [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] re-assign floating IP 172.25.2.128 from instance f97ccda6-c665-4a4f-b099-72b142b143b7 Oct 18 13:18:22.088215 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a309cca8-b3f0-45c4-b06f-6e499158a9ee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1470 microversion: 2.1 time: 0.604283 Oct 18 13:18:22.102209 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 317/617] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:21 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1470 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:22.118437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-da0aff7e-298a-4b0f-bfa3-a6594acc6b36 req-c767a4de-aac1-4649-8846-383e50798ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb9c30c-e278-459f-b11a-78c8fd730b1c", "tag": "6f9b5e79-07f1-431f-a89b-eea54a99b512"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:22.153769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-da0aff7e-298a-4b0f-bfa3-a6594acc6b36 req-c767a4de-aac1-4649-8846-383e50798ba2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:22.154292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-da0aff7e-298a-4b0f-bfa3-a6594acc6b36 req-c767a4de-aac1-4649-8846-383e50798ba2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:22.154764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-da0aff7e-298a-4b0f-bfa3-a6594acc6b36 req-c767a4de-aac1-4649-8846-383e50798ba2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:22.176713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Building network info cache for instance {{(pid=120612) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:18:22.180284 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-da0aff7e-298a-4b0f-bfa3-a6594acc6b36 req-c767a4de-aac1-4649-8846-383e50798ba2 service nova] Creating event network-changed:6f9b5e79-07f1-431f-a89b-eea54a99b512 for instance bdb9c30c-e278-459f-b11a-78c8fd730b1c on n-h1-858384-13 Oct 18 13:18:22.197060 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-da0aff7e-298a-4b0f-bfa3-a6594acc6b36 req-c767a4de-aac1-4649-8846-383e50798ba2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093101 Oct 18 13:18:22.198061 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 318/618] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:22.203537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e535385b-8bae-4c84-a812-8495b235d66e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:22.204292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e535385b-8bae-4c84-a812-8495b235d66e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:22.214143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e535385b-8bae-4c84-a812-8495b235d66e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:22.215485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e535385b-8bae-4c84-a812-8495b235d66e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:22.216137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e535385b-8bae-4c84-a812-8495b235d66e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:22.217060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e535385b-8bae-4c84-a812-8495b235d66e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:22.217800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e535385b-8bae-4c84-a812-8495b235d66e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:22.218385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e535385b-8bae-4c84-a812-8495b235d66e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:22.431735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-e535385b-8bae-4c84-a812-8495b235d66e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid 1612cfab-edd0-4df2-90f2-79a1c541ca90 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:18:22.455804 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e535385b-8bae-4c84-a812-8495b235d66e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 2051 microversion: 2.25 time: 0.256219 Oct 18 13:18:22.517026 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 319/619] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:22 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 2051 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:22.527956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f341d35f-9a55-4879-85f1-08f58bb01481 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:22.529153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f341d35f-9a55-4879-85f1-08f58bb01481 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] [instance: 32a9f1e5-27ea-466b-84c6-3591332a665b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:22.537925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f341d35f-9a55-4879-85f1-08f58bb01481 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:22.539292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f341d35f-9a55-4879-85f1-08f58bb01481 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:22.540105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f341d35f-9a55-4879-85f1-08f58bb01481 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:22.541009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f341d35f-9a55-4879-85f1-08f58bb01481 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:22.541791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f341d35f-9a55-4879-85f1-08f58bb01481 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:22.543099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f341d35f-9a55-4879-85f1-08f58bb01481 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:22.565620 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-f341d35f-9a55-4879-85f1-08f58bb01481 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] HTTP exception thrown: Instance 32a9f1e5-27ea-466b-84c6-3591332a665b could not be found. Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f341d35f-9a55-4879-85f1-08f58bb01481 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Request method failure captured: Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b HTTP/1.1 Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdSBG6vFtRclXJIlV5_g9zuCY4dFk3M-XKB4n_5aXPWBpeRSgIm3dPnfe2Z-z2U4AqeK6bmx0P4HPFleWeIXsw6oCmTHtwUchFg6PDKe9AXBqX9qbz21d5oYV14eicQtYtGMYMCA7SM0PMXak_EtZtFhtGHq8CzzMLlezhLWutNNr8 Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7c65a39f96a0450691774ebdf4a4122d Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-LiveMigrationNegativeTest-116066920 Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:18:22.567670 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:18:22.569026 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7c65a39f96a0450691774ebdf4a4122d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7c65a39f96a0450691774ebdf4a4122d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7c65a39f96a0450691774ebdf4a4122d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7c65a39f96a0450691774ebdf4a4122d"}]}] Oct 18 13:18:22.569026 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-LiveMigrationNegativeTest-116066920 Oct 18 13:18:22.569026 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7c65a39f96a0450691774ebdf4a4122d Oct 18 13:18:22.569026 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-116066920 Oct 18 13:18:22.569026 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-LiveMigrationNegativeTest-116066920-project Oct 18 13:18:22.569026 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:22.569026 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:22.569026 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 8fdc8cbdac3a4a93bd0a4c8f2a06e579 Oct 18 13:18:22.569026 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-LiveMigrationNegativeTest-116066920-project Oct 18 13:18:22.569026 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:18:22.569026 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 32a9f1e5-27ea-466b-84c6-3591332a665b could not be found. Oct 18 13:18:22.569026 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '32a9f1e5-27ea-466b-84c6-3591332a665b'} Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a9f1e5-27ea-466b-84c6-3591332a665b could not be found. Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:22.571515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a9f1e5-27ea-466b-84c6-3591332a665b could not be found. Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a9f1e5-27ea-466b-84c6-3591332a665b could not be found. Oct 18 13:18:22.572850 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:22.577285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f341d35f-9a55-4879-85f1-08f58bb01481 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] Returning 404 to user: Instance 32a9f1e5-27ea-466b-84c6-3591332a665b could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:22.578609 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f341d35f-9a55-4879-85f1-08f58bb01481 tempest-LiveMigrationNegativeTest-116066920 tempest-LiveMigrationNegativeTest-116066920-project] 10.222.0.40 "GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b" status: 404 len: 111 microversion: 2.1 time: 0.059356 Oct 18 13:18:22.579857 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 320/620] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:22 2022] GET /compute/v2.1/servers/32a9f1e5-27ea-466b-84c6-3591332a665b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:18:22.608284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-4f705d8c-0f34-442a-86b8-4f1088325260 req-638f26f6-dea0-4e6b-9d16-09ac630945c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97ccda6-c665-4a4f-b099-72b142b143b7", "tag": "7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:22.630098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4f705d8c-0f34-442a-86b8-4f1088325260 req-638f26f6-dea0-4e6b-9d16-09ac630945c9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:22.632993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4f705d8c-0f34-442a-86b8-4f1088325260 req-638f26f6-dea0-4e6b-9d16-09ac630945c9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:22.635233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4f705d8c-0f34-442a-86b8-4f1088325260 req-638f26f6-dea0-4e6b-9d16-09ac630945c9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:22.662627 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-4f705d8c-0f34-442a-86b8-4f1088325260 req-638f26f6-dea0-4e6b-9d16-09ac630945c9 service nova] Creating event network-changed:7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5 for instance f97ccda6-c665-4a4f-b099-72b142b143b7 on n-h1-858384-13 Oct 18 13:18:22.673271 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-4f705d8c-0f34-442a-86b8-4f1088325260 req-638f26f6-dea0-4e6b-9d16-09ac630945c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090290 Oct 18 13:18:22.674642 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 321/621] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:22.682952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-73ebcfc1-93b3-4989-8889-4ed5ce5c5e41 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:22.683989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-73ebcfc1-93b3-4989-8889-4ed5ce5c5e41 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:22.691909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73ebcfc1-93b3-4989-8889-4ed5ce5c5e41 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:22.692900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73ebcfc1-93b3-4989-8889-4ed5ce5c5e41 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:22.693623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73ebcfc1-93b3-4989-8889-4ed5ce5c5e41 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:22.695340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73ebcfc1-93b3-4989-8889-4ed5ce5c5e41 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:22.697781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73ebcfc1-93b3-4989-8889-4ed5ce5c5e41 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:22.699175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73ebcfc1-93b3-4989-8889-4ed5ce5c5e41 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:23.098031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-73ebcfc1-93b3-4989-8889-4ed5ce5c5e41 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:23.108125 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-73ebcfc1-93b3-4989-8889-4ed5ce5c5e41 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1322 microversion: 2.1 time: 0.431821 Oct 18 13:18:23.109692 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 322/622] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:22 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:23.114954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-de420d4e-8454-4427-8a8d-b6fe44c12450 req-20333147-993b-4627-a772-801eab289b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f199ac-a7c9-4a5c-929a-f734ea6c3d80", "name": "network-vif-plugged", "status": "completed", "tag": "0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:23.127625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-de420d4e-8454-4427-8a8d-b6fe44c12450 req-20333147-993b-4627-a772-801eab289b9c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:23.128101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-de420d4e-8454-4427-8a8d-b6fe44c12450 req-20333147-993b-4627-a772-801eab289b9c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:23.128528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-de420d4e-8454-4427-8a8d-b6fe44c12450 req-20333147-993b-4627-a772-801eab289b9c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:23.153872 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-de420d4e-8454-4427-8a8d-b6fe44c12450 req-20333147-993b-4627-a772-801eab289b9c service nova] Creating event network-vif-plugged:0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1 for instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 on n-h2-858384-13 Oct 18 13:18:23.161528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [req-de420d4e-8454-4427-8a8d-b6fe44c12450 req-20333147-993b-4627-a772-801eab289b9c service nova] Instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:18:23.175289 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-de420d4e-8454-4427-8a8d-b6fe44c12450 req-20333147-993b-4627-a772-801eab289b9c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064192 Oct 18 13:18:23.184076 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 323/623] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:23.190640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ff8e4462-73b6-4bef-bc75-519d38f32e7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:23.191750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ff8e4462-73b6-4bef-bc75-519d38f32e7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:23.199581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff8e4462-73b6-4bef-bc75-519d38f32e7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:23.200451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff8e4462-73b6-4bef-bc75-519d38f32e7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:23.201151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff8e4462-73b6-4bef-bc75-519d38f32e7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:23.202424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff8e4462-73b6-4bef-bc75-519d38f32e7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:23.203122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff8e4462-73b6-4bef-bc75-519d38f32e7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:23.203785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff8e4462-73b6-4bef-bc75-519d38f32e7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:23.659626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ff8e4462-73b6-4bef-bc75-519d38f32e7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:23.673008 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ff8e4462-73b6-4bef-bc75-519d38f32e7a tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1322 microversion: 2.1 time: 0.486298 Oct 18 13:18:23.674431 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 324/624] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:23 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:23.685938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2d3941e5-c500-4fb3-954b-9fce907f9099 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:23.686955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2d3941e5-c500-4fb3-954b-9fce907f9099 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:23.695783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3941e5-c500-4fb3-954b-9fce907f9099 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:23.696433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3941e5-c500-4fb3-954b-9fce907f9099 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:23.697608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3941e5-c500-4fb3-954b-9fce907f9099 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:23.698474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3941e5-c500-4fb3-954b-9fce907f9099 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:23.699077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3941e5-c500-4fb3-954b-9fce907f9099 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:23.699892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3941e5-c500-4fb3-954b-9fce907f9099 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:23.814340 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2d3941e5-c500-4fb3-954b-9fce907f9099 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "POST /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80/action" status: 204 len: 0 microversion: 2.1 time: 0.138373 Oct 18 13:18:23.815235 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 325/625] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:23 2022] POST /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80/action => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:18:23.830881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-06d7f7fc-c95a-4fc0-82be-23e915f16481 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:23.831353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-06d7f7fc-c95a-4fc0-82be-23e915f16481 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:23.838625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06d7f7fc-c95a-4fc0-82be-23e915f16481 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:23.839109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06d7f7fc-c95a-4fc0-82be-23e915f16481 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:23.839536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06d7f7fc-c95a-4fc0-82be-23e915f16481 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:23.840232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06d7f7fc-c95a-4fc0-82be-23e915f16481 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:23.840678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06d7f7fc-c95a-4fc0-82be-23e915f16481 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:23.841093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06d7f7fc-c95a-4fc0-82be-23e915f16481 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:24.410648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-06d7f7fc-c95a-4fc0-82be-23e915f16481 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:24.423108 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-06d7f7fc-c95a-4fc0-82be-23e915f16481 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1388 microversion: 2.1 time: 0.597037 Oct 18 13:18:24.424075 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 326/626] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:23 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1388 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:24.437460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e094bbc3-d4e1-4bd8-8fef-30b3cb334d13 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:24.438459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e094bbc3-d4e1-4bd8-8fef-30b3cb334d13 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:24.444649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e094bbc3-d4e1-4bd8-8fef-30b3cb334d13 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:24.445897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e094bbc3-d4e1-4bd8-8fef-30b3cb334d13 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:24.446529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e094bbc3-d4e1-4bd8-8fef-30b3cb334d13 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:24.447426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e094bbc3-d4e1-4bd8-8fef-30b3cb334d13 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:24.447872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e094bbc3-d4e1-4bd8-8fef-30b3cb334d13 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:24.448481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e094bbc3-d4e1-4bd8-8fef-30b3cb334d13 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:24.550629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e094bbc3-d4e1-4bd8-8fef-30b3cb334d13 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:24.567902 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e094bbc3-d4e1-4bd8-8fef-30b3cb334d13 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1272 microversion: 2.1 time: 0.142293 Oct 18 13:18:24.581686 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 327/627] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:24 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:24.586802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1874478027", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "4367ae6a-74b6-4e77-aafe-63e7fdd7f6d6"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:24.680872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] validate_networks() for [('4367ae6a-74b6-4e77-aafe-63e7fdd7f6d6', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:18:25.090106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Updating instance_info_cache with network_info: [{"id": "7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5", "address": "fa:16:3e:39:47:12", "network": {"id": "a22da94d-677f-457d-bbf8-95010fd233ef", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1194878154-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a7b9ff58f71c425d8853ec2d0466ee3a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7f2098ee-ff", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120612) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:18:25.111852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Building network info cache for instance {{(pid=120612) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:18:25.436715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=19 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:25.548085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:18:25.548085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:18:25.548085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:18:25.548085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:18:25.548085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:18:25.565278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:25.566210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:25.566866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:25.568289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:25.568953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:25.571334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:25.597628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Getting quotas for project e559a35e21d343adab5f772a17b745f9. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:18:25.606290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Getting quotas for user 1bfaa3d005f94cf2a5bdf8e63d20ba3f and project e559a35e21d343adab5f772a17b745f9. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:18:25.610594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:25.627656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:18:25.632741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:18:25.689900 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f5e4afa8-8bf6-4ad7-bd90-f1b99cb8e9e4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.107035 Oct 18 13:18:25.691286 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 328/628] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:18:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:18:25.702814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-946a0b70-c966-4db6-9869-8ae0cd9d3f6f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:25.703579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-946a0b70-c966-4db6-9869-8ae0cd9d3f6f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:25.711089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946a0b70-c966-4db6-9869-8ae0cd9d3f6f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:25.711583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946a0b70-c966-4db6-9869-8ae0cd9d3f6f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:25.712217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946a0b70-c966-4db6-9869-8ae0cd9d3f6f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:25.713248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946a0b70-c966-4db6-9869-8ae0cd9d3f6f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:25.715246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946a0b70-c966-4db6-9869-8ae0cd9d3f6f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:25.716225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946a0b70-c966-4db6-9869-8ae0cd9d3f6f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:25.842610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Updating instance_info_cache with network_info: [{"id": "c2e5c8e4-7e8d-4b38-9402-17b57d852e09", "address": "fa:16:3e:89:0c:e2", "network": {"id": "a22da94d-677f-457d-bbf8-95010fd233ef", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1194878154-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a7b9ff58f71c425d8853ec2d0466ee3a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc2e5c8e4-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120612) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:18:25.856307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Releasing lock "refresh_cache-4e257aea-4f80-4311-8216-9f3b8481507a" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:18:25.859816 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f1fa64ed-4ae6-4f76-ac0c-23cec66ad9a2 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "POST /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a/action" status: 202 len: 0 microversion: 2.1 time: 10.464293 Oct 18 13:18:25.859816 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 301/629] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:15 2022] POST /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a/action => generated 0 bytes in 10466 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:18:25.863814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6cf02cff-822e-4b63-82f8-4bb9f23b3698 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:25.864556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6cf02cff-822e-4b63-82f8-4bb9f23b3698 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:25.873849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cf02cff-822e-4b63-82f8-4bb9f23b3698 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:25.874472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cf02cff-822e-4b63-82f8-4bb9f23b3698 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:25.874977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cf02cff-822e-4b63-82f8-4bb9f23b3698 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:25.875900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cf02cff-822e-4b63-82f8-4bb9f23b3698 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:25.877098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cf02cff-822e-4b63-82f8-4bb9f23b3698 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:25.877564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cf02cff-822e-4b63-82f8-4bb9f23b3698 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:25.972688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-946a0b70-c966-4db6-9869-8ae0cd9d3f6f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:25.982873 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-946a0b70-c966-4db6-9869-8ae0cd9d3f6f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1470 microversion: 2.1 time: 0.289659 Oct 18 13:18:25.983463 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 329/630] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:25 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1470 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:26.001198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-54cfb3fd-2a3c-4a9f-bdaf-126ca83eaa1d req-810ec322-4c43-4ab8-ad44-74c52ebbcc13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a9f1e5-27ea-466b-84c6-3591332a665b", "name": "network-vif-deleted", "tag": "5bba853c-25d6-493e-b05a-9024b8d87698"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:26.013239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-54cfb3fd-2a3c-4a9f-bdaf-126ca83eaa1d req-810ec322-4c43-4ab8-ad44-74c52ebbcc13 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:26.013755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-54cfb3fd-2a3c-4a9f-bdaf-126ca83eaa1d req-810ec322-4c43-4ab8-ad44-74c52ebbcc13 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:26.014158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-54cfb3fd-2a3c-4a9f-bdaf-126ca83eaa1d req-810ec322-4c43-4ab8-ad44-74c52ebbcc13 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:26.029864 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-54cfb3fd-2a3c-4a9f-bdaf-126ca83eaa1d req-810ec322-4c43-4ab8-ad44-74c52ebbcc13 service nova] Creating event network-vif-deleted:5bba853c-25d6-493e-b05a-9024b8d87698 for instance 32a9f1e5-27ea-466b-84c6-3591332a665b on n-h2-858384-13 Oct 18 13:18:26.043644 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-54cfb3fd-2a3c-4a9f-bdaf-126ca83eaa1d req-810ec322-4c43-4ab8-ad44-74c52ebbcc13 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058959 Oct 18 13:18:26.045549 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 330/631] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:26.060586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3e8b061c-b68c-4289-8ab1-c73049a20915 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:26.063386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3e8b061c-b68c-4289-8ab1-c73049a20915 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:26.072805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e8b061c-b68c-4289-8ab1-c73049a20915 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:26.073584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e8b061c-b68c-4289-8ab1-c73049a20915 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:26.073811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e8b061c-b68c-4289-8ab1-c73049a20915 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:26.074462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e8b061c-b68c-4289-8ab1-c73049a20915 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:26.074915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e8b061c-b68c-4289-8ab1-c73049a20915 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:26.075348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e8b061c-b68c-4289-8ab1-c73049a20915 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:26.136231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6cf02cff-822e-4b63-82f8-4bb9f23b3698 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:26.147988 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6cf02cff-822e-4b63-82f8-4bb9f23b3698 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1322 microversion: 2.1 time: 0.287421 Oct 18 13:18:26.159545 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 302/632] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:25 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:26.176835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a90c2317-73ee-43df-a94d-c9407a292a43 req-42fe7062-7d0c-476e-88ed-562a503dfb21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e257aea-4f80-4311-8216-9f3b8481507a", "tag": "c2e5c8e4-7e8d-4b38-9402-17b57d852e09"}, {"name": "network-changed", "server_uuid": "bfe50041-e476-443d-b56f-db9953efda0a", "tag": "c5b4bcad-3d79-462b-a9c7-ff1906e031e9"}, {"name": "network-changed", "server_uuid": "57f9acd7-30d4-4857-b45a-b7c851330c34", "tag": "fb391fe6-f576-4add-b03a-a70be3613588"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:26.212197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a90c2317-73ee-43df-a94d-c9407a292a43 req-42fe7062-7d0c-476e-88ed-562a503dfb21 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:26.213120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a90c2317-73ee-43df-a94d-c9407a292a43 req-42fe7062-7d0c-476e-88ed-562a503dfb21 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:26.213912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a90c2317-73ee-43df-a94d-c9407a292a43 req-42fe7062-7d0c-476e-88ed-562a503dfb21 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:26.244163 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a90c2317-73ee-43df-a94d-c9407a292a43 req-42fe7062-7d0c-476e-88ed-562a503dfb21 service nova] Creating event network-changed:c2e5c8e4-7e8d-4b38-9402-17b57d852e09 for instance 4e257aea-4f80-4311-8216-9f3b8481507a on n-h2-858384-13 Oct 18 13:18:26.244984 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a90c2317-73ee-43df-a94d-c9407a292a43 req-42fe7062-7d0c-476e-88ed-562a503dfb21 service nova] Creating event network-changed:c5b4bcad-3d79-462b-a9c7-ff1906e031e9 for instance bfe50041-e476-443d-b56f-db9953efda0a on n-h1-858384-13 Oct 18 13:18:26.245638 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a90c2317-73ee-43df-a94d-c9407a292a43 req-42fe7062-7d0c-476e-88ed-562a503dfb21 service nova] Creating event network-changed:fb391fe6-f576-4add-b03a-a70be3613588 for instance 57f9acd7-30d4-4857-b45a-b7c851330c34 on n-h1-858384-13 Oct 18 13:18:26.259802 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a90c2317-73ee-43df-a94d-c9407a292a43 req-42fe7062-7d0c-476e-88ed-562a503dfb21 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.098008 Oct 18 13:18:26.260647 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 303/633] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:26.282674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb0f2842-bebe-4bcc-8474-b783ce162859 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:26.283865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eb0f2842-bebe-4bcc-8474-b783ce162859 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:26.296830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb0f2842-bebe-4bcc-8474-b783ce162859 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:26.301702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb0f2842-bebe-4bcc-8474-b783ce162859 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:26.302364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb0f2842-bebe-4bcc-8474-b783ce162859 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:26.303164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb0f2842-bebe-4bcc-8474-b783ce162859 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:26.304516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb0f2842-bebe-4bcc-8474-b783ce162859 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:26.305379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb0f2842-bebe-4bcc-8474-b783ce162859 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:26.387821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3e8b061c-b68c-4289-8ab1-c73049a20915 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:26.402869 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3e8b061c-b68c-4289-8ab1-c73049a20915 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1322 microversion: 2.1 time: 0.348097 Oct 18 13:18:26.403514 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 331/634] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:26 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:26.408751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3405ed39-3897-4735-bfca-4251bb1c2ef0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:26.409786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3405ed39-3897-4735-bfca-4251bb1c2ef0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:26.416941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3405ed39-3897-4735-bfca-4251bb1c2ef0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:26.431257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3405ed39-3897-4735-bfca-4251bb1c2ef0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:26.431710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3405ed39-3897-4735-bfca-4251bb1c2ef0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:26.437421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3405ed39-3897-4735-bfca-4251bb1c2ef0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:26.438123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3405ed39-3897-4735-bfca-4251bb1c2ef0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:26.438950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3405ed39-3897-4735-bfca-4251bb1c2ef0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:26.581883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eb0f2842-bebe-4bcc-8474-b783ce162859 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:26.596061 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eb0f2842-bebe-4bcc-8474-b783ce162859 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1388 microversion: 2.1 time: 0.333609 Oct 18 13:18:26.596657 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 304/635] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:26 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1388 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:26.602268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8ab0c62e-e808-4e8c-bf73-90662371a092 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:26.603079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8ab0c62e-e808-4e8c-bf73-90662371a092 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:26.609493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ab0c62e-e808-4e8c-bf73-90662371a092 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:26.610161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ab0c62e-e808-4e8c-bf73-90662371a092 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:26.610864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ab0c62e-e808-4e8c-bf73-90662371a092 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:26.611727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ab0c62e-e808-4e8c-bf73-90662371a092 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:26.612342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ab0c62e-e808-4e8c-bf73-90662371a092 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:26.612917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ab0c62e-e808-4e8c-bf73-90662371a092 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:26.618434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=2,nova_cell1:RELEASE=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:26.671566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3405ed39-3897-4735-bfca-4251bb1c2ef0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:26.684267 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3405ed39-3897-4735-bfca-4251bb1c2ef0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1314 microversion: 2.1 time: 0.277016 Oct 18 13:18:26.697607 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 332/636] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:26 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:26.697607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0989a016-fbaf-4982-bc7d-6e91736734e4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Action: 'action', calling method: .version_select at 0x7ff6155bc940>, body: {"removeFloatingIp": {"address": "172.25.2.128"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:26.709342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8ab0c62e-e808-4e8c-bf73-90662371a092 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:26.718169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8ab0c62e-e808-4e8c-bf73-90662371a092 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:26.719744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8ab0c62e-e808-4e8c-bf73-90662371a092 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:26.720860 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8ab0c62e-e808-4e8c-bf73-90662371a092 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1266 microversion: 2.25 time: 0.123007 Oct 18 13:18:26.721502 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 305/637] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:26 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:26.726878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-5c2b1e71-fe02-4d73-bd8e-0cada8d393c1 req-ab629032-9120-4b37-ad87-c03ab7875ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb9c30c-e278-459f-b11a-78c8fd730b1c", "name": "network-vif-plugged", "status": "completed", "tag": "6f9b5e79-07f1-431f-a89b-eea54a99b512"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:26.738350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5c2b1e71-fe02-4d73-bd8e-0cada8d393c1 req-ab629032-9120-4b37-ad87-c03ab7875ca9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:26.739058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5c2b1e71-fe02-4d73-bd8e-0cada8d393c1 req-ab629032-9120-4b37-ad87-c03ab7875ca9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:26.739367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5c2b1e71-fe02-4d73-bd8e-0cada8d393c1 req-ab629032-9120-4b37-ad87-c03ab7875ca9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:26.752711 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-5c2b1e71-fe02-4d73-bd8e-0cada8d393c1 req-ab629032-9120-4b37-ad87-c03ab7875ca9 service nova] Creating event network-vif-plugged:6f9b5e79-07f1-431f-a89b-eea54a99b512 for instance bdb9c30c-e278-459f-b11a-78c8fd730b1c on n-h1-858384-13 Oct 18 13:18:26.758172 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-5c2b1e71-fe02-4d73-bd8e-0cada8d393c1 req-ab629032-9120-4b37-ad87-c03ab7875ca9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035482 Oct 18 13:18:26.759556 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 306/638] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:26.923622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0989a016-fbaf-4982-bc7d-6e91736734e4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:26.931388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0989a016-fbaf-4982-bc7d-6e91736734e4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:26.932261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0989a016-fbaf-4982-bc7d-6e91736734e4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:26.932854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0989a016-fbaf-4982-bc7d-6e91736734e4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:26.933750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0989a016-fbaf-4982-bc7d-6e91736734e4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:26.935275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0989a016-fbaf-4982-bc7d-6e91736734e4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:26.935884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0989a016-fbaf-4982-bc7d-6e91736734e4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:27.008817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4fd03ddd-9d29-4a8c-a4a2-7d8d458abb48 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:27.010014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4fd03ddd-9d29-4a8c-a4a2-7d8d458abb48 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:27.018420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fd03ddd-9d29-4a8c-a4a2-7d8d458abb48 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:27.019298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fd03ddd-9d29-4a8c-a4a2-7d8d458abb48 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:27.019929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fd03ddd-9d29-4a8c-a4a2-7d8d458abb48 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:27.020837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fd03ddd-9d29-4a8c-a4a2-7d8d458abb48 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:27.021496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fd03ddd-9d29-4a8c-a4a2-7d8d458abb48 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:27.022600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fd03ddd-9d29-4a8c-a4a2-7d8d458abb48 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:27.218227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4fd03ddd-9d29-4a8c-a4a2-7d8d458abb48 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:27.226259 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4fd03ddd-9d29-4a8c-a4a2-7d8d458abb48 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1470 microversion: 2.1 time: 0.222363 Oct 18 13:18:27.241508 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 307/639] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:27 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:27.246322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-97634713-b960-4a2a-abb0-5e2da9225788 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:27.246912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-97634713-b960-4a2a-abb0-5e2da9225788 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:27.253265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97634713-b960-4a2a-abb0-5e2da9225788 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:27.253982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97634713-b960-4a2a-abb0-5e2da9225788 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:27.254529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97634713-b960-4a2a-abb0-5e2da9225788 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:27.255103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97634713-b960-4a2a-abb0-5e2da9225788 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:27.255547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97634713-b960-4a2a-abb0-5e2da9225788 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:27.255959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97634713-b960-4a2a-abb0-5e2da9225788 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:27.308256 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-0989a016-fbaf-4982-bc7d-6e91736734e4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] HTTP exception thrown: Floating IP 172.25.2.128 is not associated with instance f97ccda6-c665-4a4f-b099-72b142b143b7. Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0989a016-fbaf-4982-bc7d-6e91736734e4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Request method failure captured: Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7/action HTTP/1.1 Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 49 Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdaw5eKFtczjxjzMrR0d_1Gha5NPaIEOZ9ux9rCUNEEusLrElZXrC0CVBXbvhLrufM5CQIBIwH2pFzsmeuqXPx5G-9DwVlF99C011d1O5TJE5baUyLQQO_2QLlCQUwqF9FUjeo0CJiXoJrjVViv_K27QN-0bbUKYjTsIXDPoY0Z_o8 Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: a7b9ff58f71c425d8853ec2d0466ee3a Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-614088941 Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:18:27.312378 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:18:27.314180 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7b9ff58f71c425d8853ec2d0466ee3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7b9ff58f71c425d8853ec2d0466ee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7b9ff58f71c425d8853ec2d0466ee3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7b9ff58f71c425d8853ec2d0466ee3a"}]}] Oct 18 13:18:27.314180 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-614088941 Oct 18 13:18:27.314180 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: a7b9ff58f71c425d8853ec2d0466ee3a Oct 18 13:18:27.314180 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-614088941 Oct 18 13:18:27.314180 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-FloatingIPsAssociationTestJSON-614088941-project Oct 18 13:18:27.314180 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:27.314180 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:27.314180 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 9f3dcbdece5d4d4b992f4e9ebf4897d4 Oct 18 13:18:27.314180 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-614088941-project Oct 18 13:18:27.314180 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:18:27.314180 n-d-858384-13 devstack@n-api.service[120611]: {"removeFloatingIp": {"address": "172.25.2.128"}} Oct 18 13:18:27.314180 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:18:27.314180 n-d-858384-13 devstack@n-api.service[120611]: exception: Floating IP 172.25.2.128 is not associated with instance f97ccda6-c665-4a4f-b099-72b142b143b7. Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f97ccda6-c665-4a4f-b099-72b142b143b7', 'body': {'removeFloatingIp': {'address': '172.25.2.128'}}} Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.128 is not associated with instance f97ccda6-c665-4a4f-b099-72b142b143b7. Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:27.315037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:27.316202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:27.316202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:27.316202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:27.316202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:27.316202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.128 is not associated with instance f97ccda6-c665-4a4f-b099-72b142b143b7. Oct 18 13:18:27.316202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:27.316202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0989a016-fbaf-4982-bc7d-6e91736734e4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Returning 409 to user: Floating IP 172.25.2.128 is not associated with instance f97ccda6-c665-4a4f-b099-72b142b143b7. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:27.316202 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0989a016-fbaf-4982-bc7d-6e91736734e4 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "POST /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7/action" status: 409 len: 146 microversion: 2.1 time: 0.628400 Oct 18 13:18:27.316679 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 333/640] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:26 2022] POST /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7/action => generated 146 bytes in 631 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:18:27.328107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.128"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:27.400954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-97634713-b960-4a2a-abb0-5e2da9225788 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:27.409048 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-97634713-b960-4a2a-abb0-5e2da9225788 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1322 microversion: 2.1 time: 0.166269 Oct 18 13:18:27.427178 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 308/641] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:27 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:27.433295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e8766a6e-5858-461b-84e1-bf4f2057e622 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:27.434159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e8766a6e-5858-461b-84e1-bf4f2057e622 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:27.456499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8766a6e-5858-461b-84e1-bf4f2057e622 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:27.457558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8766a6e-5858-461b-84e1-bf4f2057e622 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:27.458184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8766a6e-5858-461b-84e1-bf4f2057e622 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:27.459296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8766a6e-5858-461b-84e1-bf4f2057e622 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:27.460301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8766a6e-5858-461b-84e1-bf4f2057e622 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:27.461019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8766a6e-5858-461b-84e1-bf4f2057e622 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:27.891576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:27.899930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:27.900785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:27.901549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:27.902704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:27.903384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:27.904031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:28.295503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e8766a6e-5858-461b-84e1-bf4f2057e622 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:28.307951 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e8766a6e-5858-461b-84e1-bf4f2057e622 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1322 microversion: 2.1 time: 0.879071 Oct 18 13:18:28.309043 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 309/642] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:27 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1322 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:28.316674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4166f666-2193-4f85-ab94-494a6c4b232c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:28.317768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4166f666-2193-4f85-ab94-494a6c4b232c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:28.325342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4166f666-2193-4f85-ab94-494a6c4b232c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:28.326050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4166f666-2193-4f85-ab94-494a6c4b232c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:28.326478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4166f666-2193-4f85-ab94-494a6c4b232c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:28.327871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4166f666-2193-4f85-ab94-494a6c4b232c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:28.328326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4166f666-2193-4f85-ab94-494a6c4b232c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:28.328750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4166f666-2193-4f85-ab94-494a6c4b232c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:28.361392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "refresh_cache-4e257aea-4f80-4311-8216-9f3b8481507a" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:18:28.361939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquired lock "refresh_cache-4e257aea-4f80-4311-8216-9f3b8481507a" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:18:28.553130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4166f666-2193-4f85-ab94-494a6c4b232c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:28.562554 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4166f666-2193-4f85-ab94-494a6c4b232c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1388 microversion: 2.1 time: 0.251564 Oct 18 13:18:28.563462 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 310/643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:28 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1388 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:28.575273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a13f617-f6db-4b8c-b483-3a55ccf6f5ee tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:28.576683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4a13f617-f6db-4b8c-b483-3a55ccf6f5ee tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:28.584866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a13f617-f6db-4b8c-b483-3a55ccf6f5ee tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:28.585618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a13f617-f6db-4b8c-b483-3a55ccf6f5ee tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:28.586124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a13f617-f6db-4b8c-b483-3a55ccf6f5ee tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:28.586892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a13f617-f6db-4b8c-b483-3a55ccf6f5ee tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:28.588165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a13f617-f6db-4b8c-b483-3a55ccf6f5ee tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:28.588667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a13f617-f6db-4b8c-b483-3a55ccf6f5ee tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:28.812088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a13f617-f6db-4b8c-b483-3a55ccf6f5ee tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:28.821442 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4a13f617-f6db-4b8c-b483-3a55ccf6f5ee tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1314 microversion: 2.1 time: 0.256462 Oct 18 13:18:28.822438 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 311/644] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:28 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:28.831648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-46e963d3-e1bd-44a1-818c-0940d9bdaccd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:28.832779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-46e963d3-e1bd-44a1-818c-0940d9bdaccd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:28.842669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e963d3-e1bd-44a1-818c-0940d9bdaccd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:28.843498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e963d3-e1bd-44a1-818c-0940d9bdaccd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:28.844366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e963d3-e1bd-44a1-818c-0940d9bdaccd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:28.845826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e963d3-e1bd-44a1-818c-0940d9bdaccd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:28.846590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e963d3-e1bd-44a1-818c-0940d9bdaccd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:28.847333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e963d3-e1bd-44a1-818c-0940d9bdaccd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:29.098817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-46e963d3-e1bd-44a1-818c-0940d9bdaccd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:29.108911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-46e963d3-e1bd-44a1-818c-0940d9bdaccd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:29.111052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-46e963d3-e1bd-44a1-818c-0940d9bdaccd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:29.112836 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-46e963d3-e1bd-44a1-818c-0940d9bdaccd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1362 microversion: 2.25 time: 0.289050 Oct 18 13:18:29.113695 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 312/645] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:28 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:29.347471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9aa2b786-73c8-425a-a9b2-41257016ba3a tempest-SecurityGroupsTestAdminJSON-2126974169 tempest-SecurityGroupsTestAdminJSON-2126974169-project] Action: 'create', calling method: .version_select at 0x7ff60fe1fe50>, body: {"security_group": {"name": "tempest-securitygroup-1563211283", "description": "tempest-description-728015635"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:29.704763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Building network info cache for instance {{(pid=120611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:18:29.926886 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9aa2b786-73c8-425a-a9b2-41257016ba3a tempest-SecurityGroupsTestAdminJSON-2126974169 tempest-SecurityGroupsTestAdminJSON-2126974169-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.811899 Oct 18 13:18:29.936669 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 313/646] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:18:29 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:29.942150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-506af80c-0d81-48f2-8a8c-c81587bf2747 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:29.943109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-506af80c-0d81-48f2-8a8c-c81587bf2747 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:29.952192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-506af80c-0d81-48f2-8a8c-c81587bf2747 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:29.952921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-506af80c-0d81-48f2-8a8c-c81587bf2747 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:29.953826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-506af80c-0d81-48f2-8a8c-c81587bf2747 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:29.954745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-506af80c-0d81-48f2-8a8c-c81587bf2747 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:29.955391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-506af80c-0d81-48f2-8a8c-c81587bf2747 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:29.956016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-506af80c-0d81-48f2-8a8c-c81587bf2747 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:30.243296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-506af80c-0d81-48f2-8a8c-c81587bf2747 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:30.251582 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-506af80c-0d81-48f2-8a8c-c81587bf2747 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1470 microversion: 2.1 time: 0.313182 Oct 18 13:18:30.266109 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 314/647] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:29 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:30.275012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1839ff40-b0da-4e66-9889-2d2c0b2f5096 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:30.276385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1839ff40-b0da-4e66-9889-2d2c0b2f5096 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:30.282725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1839ff40-b0da-4e66-9889-2d2c0b2f5096 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:30.283475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1839ff40-b0da-4e66-9889-2d2c0b2f5096 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:30.283904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1839ff40-b0da-4e66-9889-2d2c0b2f5096 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:30.284795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1839ff40-b0da-4e66-9889-2d2c0b2f5096 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:30.285469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1839ff40-b0da-4e66-9889-2d2c0b2f5096 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:30.286381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1839ff40-b0da-4e66-9889-2d2c0b2f5096 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:30.338018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Updating instance_info_cache with network_info: [{"id": "c2e5c8e4-7e8d-4b38-9402-17b57d852e09", "address": "fa:16:3e:89:0c:e2", "network": {"id": "a22da94d-677f-457d-bbf8-95010fd233ef", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1194878154-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a7b9ff58f71c425d8853ec2d0466ee3a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc2e5c8e4-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:18:30.344066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:30.358432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Releasing lock "refresh_cache-4e257aea-4f80-4311-8216-9f3b8481507a" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:18:30.359994 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3b2cd769-bebc-4829-916b-3d3171bbf9ca tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "POST /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a/action" status: 202 len: 0 microversion: 2.1 time: 3.039041 Oct 18 13:18:30.360916 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 334/648] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:27 2022] POST /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a/action => generated 0 bytes in 3041 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 18 13:18:30.368528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0f738e43-f811-4061-99fc-23e66eef5450 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:30.369576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0f738e43-f811-4061-99fc-23e66eef5450 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:30.377109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f738e43-f811-4061-99fc-23e66eef5450 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:30.377666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f738e43-f811-4061-99fc-23e66eef5450 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:30.378378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f738e43-f811-4061-99fc-23e66eef5450 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:30.379114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f738e43-f811-4061-99fc-23e66eef5450 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:30.380210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f738e43-f811-4061-99fc-23e66eef5450 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:30.380639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f738e43-f811-4061-99fc-23e66eef5450 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:30.536236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1839ff40-b0da-4e66-9889-2d2c0b2f5096 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:30.545980 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1839ff40-b0da-4e66-9889-2d2c0b2f5096 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1322 microversion: 2.1 time: 0.278371 Oct 18 13:18:30.547409 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 315/649] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:30 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:30.559093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0f738e43-f811-4061-99fc-23e66eef5450 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:30.563012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7e787a2a-8c38-4b2d-9d73-069afe23ed09 req-c29ab6c7-b522-4842-b61e-a2fe89310194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d79b32e-7ca5-426c-86a3-53573c97569d", "tag": "a7905246-b174-4f5f-b628-3d969be2fe7f"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:30.575625 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0f738e43-f811-4061-99fc-23e66eef5450 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1322 microversion: 2.1 time: 0.213296 Oct 18 13:18:30.578932 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 335/650] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:30 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:30.584029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-31b4ced0-0677-4f9b-b718-2158bc95f149 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:30.584786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-31b4ced0-0677-4f9b-b718-2158bc95f149 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:30.589431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7e787a2a-8c38-4b2d-9d73-069afe23ed09 req-c29ab6c7-b522-4842-b61e-a2fe89310194 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:30.589818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7e787a2a-8c38-4b2d-9d73-069afe23ed09 req-c29ab6c7-b522-4842-b61e-a2fe89310194 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:30.590230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7e787a2a-8c38-4b2d-9d73-069afe23ed09 req-c29ab6c7-b522-4842-b61e-a2fe89310194 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:30.603693 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7e787a2a-8c38-4b2d-9d73-069afe23ed09 req-c29ab6c7-b522-4842-b61e-a2fe89310194 service nova] Creating event network-changed:a7905246-b174-4f5f-b628-3d969be2fe7f for instance 5d79b32e-7ca5-426c-86a3-53573c97569d on n-h1-858384-13 Oct 18 13:18:30.608086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31b4ced0-0677-4f9b-b718-2158bc95f149 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:30.608578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31b4ced0-0677-4f9b-b718-2158bc95f149 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:30.608798 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7e787a2a-8c38-4b2d-9d73-069afe23ed09 req-c29ab6c7-b522-4842-b61e-a2fe89310194 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059584 Oct 18 13:18:30.609000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31b4ced0-0677-4f9b-b718-2158bc95f149 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:30.609280 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 316/651] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:30.614860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-09d9ff4c-cccc-4d1b-8668-dc3a06377bfc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:30.615475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31b4ced0-0677-4f9b-b718-2158bc95f149 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:30.615740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-09d9ff4c-cccc-4d1b-8668-dc3a06377bfc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:30.619997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31b4ced0-0677-4f9b-b718-2158bc95f149 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:30.622799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31b4ced0-0677-4f9b-b718-2158bc95f149 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:30.624557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09d9ff4c-cccc-4d1b-8668-dc3a06377bfc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:30.625040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09d9ff4c-cccc-4d1b-8668-dc3a06377bfc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:30.625521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09d9ff4c-cccc-4d1b-8668-dc3a06377bfc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:30.626217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09d9ff4c-cccc-4d1b-8668-dc3a06377bfc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:30.626668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09d9ff4c-cccc-4d1b-8668-dc3a06377bfc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:30.627088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09d9ff4c-cccc-4d1b-8668-dc3a06377bfc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:30.820865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-31b4ced0-0677-4f9b-b718-2158bc95f149 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:30.829711 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-31b4ced0-0677-4f9b-b718-2158bc95f149 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1388 microversion: 2.1 time: 0.249455 Oct 18 13:18:30.837233 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 336/652] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:30 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1388 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:30.837233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bf77ada3-c56c-4b0a-a9ec-ddf0227e233b tempest-SecurityGroupsTestAdminJSON-2126974169 tempest-SecurityGroupsTestAdminJSON-2126974169-project] Action: 'create', calling method: .version_select at 0x7ff60fd3e790>, body: {"security_group": {"name": "tempest-securitygroup-95999945", "description": "tempest-description-1187331735"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:30.870093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-09d9ff4c-cccc-4d1b-8668-dc3a06377bfc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:30.881921 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-09d9ff4c-cccc-4d1b-8668-dc3a06377bfc tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1314 microversion: 2.1 time: 0.271190 Oct 18 13:18:30.897989 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 317/653] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:30 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:30.903692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-c44d974f-53b4-4705-847e-64d02e184498 req-9dcc4006-d51e-4484-93f6-e012253fd5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b550c78b-caf6-44ea-a613-978bac95b4fe", "tag": "f691b18b-7542-4132-925b-d3a8fa57fcae"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:30.914385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c44d974f-53b4-4705-847e-64d02e184498 req-9dcc4006-d51e-4484-93f6-e012253fd5f9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:30.915065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c44d974f-53b4-4705-847e-64d02e184498 req-9dcc4006-d51e-4484-93f6-e012253fd5f9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:30.915209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c44d974f-53b4-4705-847e-64d02e184498 req-9dcc4006-d51e-4484-93f6-e012253fd5f9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:30.931570 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-c44d974f-53b4-4705-847e-64d02e184498 req-9dcc4006-d51e-4484-93f6-e012253fd5f9 service nova] Creating event network-changed:f691b18b-7542-4132-925b-d3a8fa57fcae for instance b550c78b-caf6-44ea-a613-978bac95b4fe on n-h2-858384-13 Oct 18 13:18:30.937503 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-c44d974f-53b4-4705-847e-64d02e184498 req-9dcc4006-d51e-4484-93f6-e012253fd5f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037871 Oct 18 13:18:30.938707 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 318/654] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:30.944989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-234cd0c0-40f4-4386-ac62-3e20f81020bc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:30.945930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-234cd0c0-40f4-4386-ac62-3e20f81020bc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:30.953065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-234cd0c0-40f4-4386-ac62-3e20f81020bc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:30.953964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-234cd0c0-40f4-4386-ac62-3e20f81020bc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:30.954415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-234cd0c0-40f4-4386-ac62-3e20f81020bc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:30.955261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-234cd0c0-40f4-4386-ac62-3e20f81020bc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:30.955730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-234cd0c0-40f4-4386-ac62-3e20f81020bc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:30.956149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-234cd0c0-40f4-4386-ac62-3e20f81020bc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:31.151425 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bf77ada3-c56c-4b0a-a9ec-ddf0227e233b tempest-SecurityGroupsTestAdminJSON-2126974169 tempest-SecurityGroupsTestAdminJSON-2126974169-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.319726 Oct 18 13:18:31.154655 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 337/655] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:18:30 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:31.167714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0dd34d1f-c58e-4c68-943c-1bd307a4dd30 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:31.168203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0dd34d1f-c58e-4c68-943c-1bd307a4dd30 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:31.181685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dd34d1f-c58e-4c68-943c-1bd307a4dd30 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:31.182189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dd34d1f-c58e-4c68-943c-1bd307a4dd30 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:31.182630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dd34d1f-c58e-4c68-943c-1bd307a4dd30 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:31.183349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dd34d1f-c58e-4c68-943c-1bd307a4dd30 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:31.183805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dd34d1f-c58e-4c68-943c-1bd307a4dd30 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:31.184224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dd34d1f-c58e-4c68-943c-1bd307a4dd30 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:31.205523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-234cd0c0-40f4-4386-ac62-3e20f81020bc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:31.214045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0dd34d1f-c58e-4c68-943c-1bd307a4dd30 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:18:31.218179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-234cd0c0-40f4-4386-ac62-3e20f81020bc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:31.220626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-234cd0c0-40f4-4386-ac62-3e20f81020bc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:31.221969 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-234cd0c0-40f4-4386-ac62-3e20f81020bc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1362 microversion: 2.25 time: 0.281969 Oct 18 13:18:31.222998 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 319/656] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:30 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:31.290075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4ef75151-0066-4b69-ae79-b6e833024d49 tempest-SecurityGroupsTestAdminJSON-1365261114 tempest-SecurityGroupsTestAdminJSON-1365261114-project-admin] Action: 'create', calling method: .version_select at 0x7ff60fe18310>, body: {"security_group": {"name": "tempest-securitygroup-958233805", "description": "tempest-description-500483363"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:31.329121 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0dd34d1f-c58e-4c68-943c-1bd307a4dd30 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a" status: 204 len: 0 microversion: 2.1 time: 0.165362 Oct 18 13:18:31.329751 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 338/657] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:18:31 2022] DELETE /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:18:31.336713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-303ae90e-ff4c-430c-96b4-e12aea62f3f6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:31.337695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-303ae90e-ff4c-430c-96b4-e12aea62f3f6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:31.344007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-303ae90e-ff4c-430c-96b4-e12aea62f3f6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:31.344489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-303ae90e-ff4c-430c-96b4-e12aea62f3f6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:31.345034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-303ae90e-ff4c-430c-96b4-e12aea62f3f6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:31.345655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-303ae90e-ff4c-430c-96b4-e12aea62f3f6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:31.346111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-303ae90e-ff4c-430c-96b4-e12aea62f3f6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:31.346550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-303ae90e-ff4c-430c-96b4-e12aea62f3f6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:31.488323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-303ae90e-ff4c-430c-96b4-e12aea62f3f6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:31.497394 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-303ae90e-ff4c-430c-96b4-e12aea62f3f6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1470 microversion: 2.1 time: 0.166205 Oct 18 13:18:31.497975 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 339/658] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:31 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:31.502897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Action: 'action', calling method: .version_select at 0x7ff6155bc9d0>, body: {"addFloatingIp": {"address": "172.25.2.128"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:31.505381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:31.512168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:31.512667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:31.513072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:31.514047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:31.514554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:31.515038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:31.543199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "refresh_cache-f97ccda6-c665-4a4f-b099-72b142b143b7" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:18:31.543732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquired lock "refresh_cache-f97ccda6-c665-4a4f-b099-72b142b143b7" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:18:31.549610 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4ef75151-0066-4b69-ae79-b6e833024d49 tempest-SecurityGroupsTestAdminJSON-1365261114 tempest-SecurityGroupsTestAdminJSON-1365261114-project-admin] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.324829 Oct 18 13:18:31.565808 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 320/659] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:18:31 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:31.571213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-06e3ff4c-4128-4cd0-b25f-6e391d5aff9b tempest-SecurityGroupsTestAdminJSON-1365261114 tempest-SecurityGroupsTestAdminJSON-1365261114-project-admin] Action: 'create', calling method: .version_select at 0x7ff60fdf11f0>, body: {"security_group": {"name": "tempest-securitygroup-1848530567", "description": "tempest-description-1294243396"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:31.951755 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-06e3ff4c-4128-4cd0-b25f-6e391d5aff9b tempest-SecurityGroupsTestAdminJSON-1365261114 tempest-SecurityGroupsTestAdminJSON-1365261114-project-admin] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.384730 Oct 18 13:18:31.952359 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 321/660] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:18:31 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:31.957262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2eff51e3-5717-41c2-8a05-c61692196c0e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:31.958063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2eff51e3-5717-41c2-8a05-c61692196c0e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:31.965336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2eff51e3-5717-41c2-8a05-c61692196c0e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:31.966182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2eff51e3-5717-41c2-8a05-c61692196c0e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:31.966853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2eff51e3-5717-41c2-8a05-c61692196c0e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:31.968035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2eff51e3-5717-41c2-8a05-c61692196c0e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:31.968494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2eff51e3-5717-41c2-8a05-c61692196c0e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:31.969343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2eff51e3-5717-41c2-8a05-c61692196c0e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:32.152230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2eff51e3-5717-41c2-8a05-c61692196c0e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:32.160270 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2eff51e3-5717-41c2-8a05-c61692196c0e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1322 microversion: 2.1 time: 0.206679 Oct 18 13:18:32.160888 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 322/661] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:31 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:32.166773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3affd7e2-389f-4b73-97a0-5b89995a14a5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:32.167380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3affd7e2-389f-4b73-97a0-5b89995a14a5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:32.173694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3affd7e2-389f-4b73-97a0-5b89995a14a5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:32.174509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3affd7e2-389f-4b73-97a0-5b89995a14a5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:32.175136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3affd7e2-389f-4b73-97a0-5b89995a14a5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:32.176040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3affd7e2-389f-4b73-97a0-5b89995a14a5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:32.176668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3affd7e2-389f-4b73-97a0-5b89995a14a5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:32.177341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3affd7e2-389f-4b73-97a0-5b89995a14a5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:32.500938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3affd7e2-389f-4b73-97a0-5b89995a14a5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:32.509659 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3affd7e2-389f-4b73-97a0-5b89995a14a5 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1472 microversion: 2.1 time: 0.347521 Oct 18 13:18:32.510242 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 323/662] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:32 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:32.514721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-05048e73-91fa-4a87-82ad-f0a05681001e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:32.515314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-05048e73-91fa-4a87-82ad-f0a05681001e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:32.521800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-05048e73-91fa-4a87-82ad-f0a05681001e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:32.523366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-05048e73-91fa-4a87-82ad-f0a05681001e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:32.523803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-05048e73-91fa-4a87-82ad-f0a05681001e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:32.524496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-05048e73-91fa-4a87-82ad-f0a05681001e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:32.524973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-05048e73-91fa-4a87-82ad-f0a05681001e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:32.525418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-05048e73-91fa-4a87-82ad-f0a05681001e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:32.658378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-05048e73-91fa-4a87-82ad-f0a05681001e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:32.670252 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-05048e73-91fa-4a87-82ad-f0a05681001e tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1388 microversion: 2.1 time: 0.158959 Oct 18 13:18:32.670873 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 324/663] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:32 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1388 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:32.675668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-358b0107-f42c-4b8b-8679-1dbc04a5e31f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:32.676294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-358b0107-f42c-4b8b-8679-1dbc04a5e31f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:32.682238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-358b0107-f42c-4b8b-8679-1dbc04a5e31f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:32.682714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-358b0107-f42c-4b8b-8679-1dbc04a5e31f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:32.683147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-358b0107-f42c-4b8b-8679-1dbc04a5e31f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:32.683832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-358b0107-f42c-4b8b-8679-1dbc04a5e31f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:32.684284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-358b0107-f42c-4b8b-8679-1dbc04a5e31f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:32.684704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-358b0107-f42c-4b8b-8679-1dbc04a5e31f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:32.938413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Building network info cache for instance {{(pid=120611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:18:33.033046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-358b0107-f42c-4b8b-8679-1dbc04a5e31f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:33.044514 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-358b0107-f42c-4b8b-8679-1dbc04a5e31f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1314 microversion: 2.1 time: 0.372551 Oct 18 13:18:33.045395 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 325/664] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:32 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:33.056496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ecb53bfc-c401-4d65-8c31-879be1a04fd2 tempest-SecurityGroupsTestAdminJSON-1365261114 tempest-SecurityGroupsTestAdminJSON-1365261114-project-admin] Calling method '.version_select at 0x7ff60fee3f70>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:34.137227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Updating instance_info_cache with network_info: [{"id": "7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5", "address": "fa:16:3e:39:47:12", "network": {"id": "a22da94d-677f-457d-bbf8-95010fd233ef", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1194878154-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a7b9ff58f71c425d8853ec2d0466ee3a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7f2098ee-ff", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:18:34.162456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Releasing lock "refresh_cache-f97ccda6-c665-4a4f-b099-72b142b143b7" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:18:34.163490 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9943a836-970d-4f1d-a151-e8d1c5e6cf06 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "POST /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7/action" status: 202 len: 0 microversion: 2.1 time: 2.664100 Oct 18 13:18:34.164125 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 340/665] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:31 2022] POST /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7/action => generated 0 bytes in 2665 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:18:34.175942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0522e58a-70ea-44cc-90d1-417964370a93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:34.176570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0522e58a-70ea-44cc-90d1-417964370a93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:34.196152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0522e58a-70ea-44cc-90d1-417964370a93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:34.196649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0522e58a-70ea-44cc-90d1-417964370a93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:34.197093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0522e58a-70ea-44cc-90d1-417964370a93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:34.197831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0522e58a-70ea-44cc-90d1-417964370a93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:34.198330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0522e58a-70ea-44cc-90d1-417964370a93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:34.198757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0522e58a-70ea-44cc-90d1-417964370a93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:34.527942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0522e58a-70ea-44cc-90d1-417964370a93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:34.536886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0522e58a-70ea-44cc-90d1-417964370a93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:34.543601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0522e58a-70ea-44cc-90d1-417964370a93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:34.545789 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0522e58a-70ea-44cc-90d1-417964370a93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1362 microversion: 2.25 time: 0.379864 Oct 18 13:18:34.546358 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 341/666] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:34 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:34.560502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-5e8f7b6c-44c2-4d17-9a22-467cf966817b req-74224038-31d8-412e-bc87-3471d573ae25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfe50041-e476-443d-b56f-db9953efda0a", "name": "network-vif-plugged", "status": "completed", "tag": "c5b4bcad-3d79-462b-a9c7-ff1906e031e9"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:34.575827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5e8f7b6c-44c2-4d17-9a22-467cf966817b req-74224038-31d8-412e-bc87-3471d573ae25 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:34.576316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5e8f7b6c-44c2-4d17-9a22-467cf966817b req-74224038-31d8-412e-bc87-3471d573ae25 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:34.576752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5e8f7b6c-44c2-4d17-9a22-467cf966817b req-74224038-31d8-412e-bc87-3471d573ae25 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:34.604700 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-5e8f7b6c-44c2-4d17-9a22-467cf966817b req-74224038-31d8-412e-bc87-3471d573ae25 service nova] Creating event network-vif-plugged:c5b4bcad-3d79-462b-a9c7-ff1906e031e9 for instance bfe50041-e476-443d-b56f-db9953efda0a on n-h1-858384-13 Oct 18 13:18:34.619897 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-5e8f7b6c-44c2-4d17-9a22-467cf966817b req-74224038-31d8-412e-bc87-3471d573ae25 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068436 Oct 18 13:18:34.621013 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 342/667] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:34.631402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-36a0514b-b853-400d-a443-5b04e5d6cdb5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:34.634651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-36a0514b-b853-400d-a443-5b04e5d6cdb5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:34.651379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36a0514b-b853-400d-a443-5b04e5d6cdb5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:34.651987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36a0514b-b853-400d-a443-5b04e5d6cdb5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:34.653588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36a0514b-b853-400d-a443-5b04e5d6cdb5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:34.654380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36a0514b-b853-400d-a443-5b04e5d6cdb5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:34.654851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36a0514b-b853-400d-a443-5b04e5d6cdb5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:34.655286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36a0514b-b853-400d-a443-5b04e5d6cdb5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:34.967721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-36a0514b-b853-400d-a443-5b04e5d6cdb5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:34.987185 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-36a0514b-b853-400d-a443-5b04e5d6cdb5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1462 microversion: 2.1 time: 0.364767 Oct 18 13:18:34.992429 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 343/668] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:34 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1462 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:35.006565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-126c529c-6590-45c0-b756-631d8ff430f3 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:35.008010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-126c529c-6590-45c0-b756-631d8ff430f3 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:35.024365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-126c529c-6590-45c0-b756-631d8ff430f3 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:35.026280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-126c529c-6590-45c0-b756-631d8ff430f3 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:35.026793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-126c529c-6590-45c0-b756-631d8ff430f3 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:35.027653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-126c529c-6590-45c0-b756-631d8ff430f3 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:35.027980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-126c529c-6590-45c0-b756-631d8ff430f3 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:35.028918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-126c529c-6590-45c0-b756-631d8ff430f3 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:35.065143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-126c529c-6590-45c0-b756-631d8ff430f3 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lazy-loading 'flavor' on Instance uuid bdb9c30c-e278-459f-b11a-78c8fd730b1c {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:18:35.171828 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-126c529c-6590-45c0-b756-631d8ff430f3 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c/action" status: 202 len: 0 microversion: 2.1 time: 0.177544 Oct 18 13:18:35.172842 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 344/669] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:34 2022] POST /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:18:35.179381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-a66b94d4-0aae-4b6a-ae8b-54157e9a327e req-928ac271-e505-49ec-858d-b08ace3f2627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e257aea-4f80-4311-8216-9f3b8481507a", "tag": "c2e5c8e4-7e8d-4b38-9402-17b57d852e09"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:35.189681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a66b94d4-0aae-4b6a-ae8b-54157e9a327e req-928ac271-e505-49ec-858d-b08ace3f2627 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:35.190252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a66b94d4-0aae-4b6a-ae8b-54157e9a327e req-928ac271-e505-49ec-858d-b08ace3f2627 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:35.190714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a66b94d4-0aae-4b6a-ae8b-54157e9a327e req-928ac271-e505-49ec-858d-b08ace3f2627 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:35.202198 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-a66b94d4-0aae-4b6a-ae8b-54157e9a327e req-928ac271-e505-49ec-858d-b08ace3f2627 service nova] Creating event network-changed:c2e5c8e4-7e8d-4b38-9402-17b57d852e09 for instance 4e257aea-4f80-4311-8216-9f3b8481507a on n-h2-858384-13 Oct 18 13:18:35.207644 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-a66b94d4-0aae-4b6a-ae8b-54157e9a327e req-928ac271-e505-49ec-858d-b08ace3f2627 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033186 Oct 18 13:18:35.208417 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 345/670] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:35.218386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aa4b863c-38c7-4da2-8c09-b33479080ae6 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:35.219101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aa4b863c-38c7-4da2-8c09-b33479080ae6 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:35.226079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa4b863c-38c7-4da2-8c09-b33479080ae6 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:35.226559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa4b863c-38c7-4da2-8c09-b33479080ae6 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:35.226982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa4b863c-38c7-4da2-8c09-b33479080ae6 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:35.227720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa4b863c-38c7-4da2-8c09-b33479080ae6 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:35.228098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa4b863c-38c7-4da2-8c09-b33479080ae6 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:35.228511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa4b863c-38c7-4da2-8c09-b33479080ae6 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:35.360741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aa4b863c-38c7-4da2-8c09-b33479080ae6 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:35.369044 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aa4b863c-38c7-4da2-8c09-b33479080ae6 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1322 microversion: 2.1 time: 0.159601 Oct 18 13:18:35.370153 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 346/671] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:35 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:35.375009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68387f16-6f6e-4bd8-84bd-397ad0b82144 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:35.375613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-68387f16-6f6e-4bd8-84bd-397ad0b82144 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:35.381490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68387f16-6f6e-4bd8-84bd-397ad0b82144 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:35.382106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68387f16-6f6e-4bd8-84bd-397ad0b82144 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:35.382502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68387f16-6f6e-4bd8-84bd-397ad0b82144 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:35.383180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68387f16-6f6e-4bd8-84bd-397ad0b82144 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:35.383626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68387f16-6f6e-4bd8-84bd-397ad0b82144 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:35.384040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68387f16-6f6e-4bd8-84bd-397ad0b82144 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:35.587482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:35.620070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=11 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:35.645881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68387f16-6f6e-4bd8-84bd-397ad0b82144 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:35.656410 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68387f16-6f6e-4bd8-84bd-397ad0b82144 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1388 microversion: 2.1 time: 0.285263 Oct 18 13:18:35.661800 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 347/672] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:35 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1388 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:35.668989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-370baf7c-6da1-488a-84d8-5f29ae7a4350 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:35.670425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-370baf7c-6da1-488a-84d8-5f29ae7a4350 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:35.699520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-370baf7c-6da1-488a-84d8-5f29ae7a4350 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:35.701682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-370baf7c-6da1-488a-84d8-5f29ae7a4350 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:35.702763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-370baf7c-6da1-488a-84d8-5f29ae7a4350 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:35.705972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-370baf7c-6da1-488a-84d8-5f29ae7a4350 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:35.706877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-370baf7c-6da1-488a-84d8-5f29ae7a4350 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:35.707735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-370baf7c-6da1-488a-84d8-5f29ae7a4350 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:36.068468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-370baf7c-6da1-488a-84d8-5f29ae7a4350 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:36.087086 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-370baf7c-6da1-488a-84d8-5f29ae7a4350 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1314 microversion: 2.1 time: 0.422860 Oct 18 13:18:36.087690 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 348/673] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:35 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:36.096295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-63a33297-2b9d-41ca-aaef-efc5f301ca50 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '.version_select at 0x7ff60fc2c790>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:36.174963 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ecb53bfc-c401-4d65-8c31-879be1a04fd2 tempest-SecurityGroupsTestAdminJSON-1365261114 tempest-SecurityGroupsTestAdminJSON-1365261114-project-admin] 10.222.0.40 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11740 microversion: 2.1 time: 3.127476 Oct 18 13:18:36.175574 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 326/674] 10.222.0.40 () {58 vars in 1191 bytes} [Tue Oct 18 13:18:33 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11740 bytes in 3129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:18:36.181757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-76e6ae06-d4bd-4606-a91b-cde2d733f452 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:36.182375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-76e6ae06-d4bd-4606-a91b-cde2d733f452 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:36.188766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76e6ae06-d4bd-4606-a91b-cde2d733f452 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:36.189311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76e6ae06-d4bd-4606-a91b-cde2d733f452 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:36.189847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76e6ae06-d4bd-4606-a91b-cde2d733f452 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:36.190562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76e6ae06-d4bd-4606-a91b-cde2d733f452 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:36.191011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76e6ae06-d4bd-4606-a91b-cde2d733f452 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:36.191431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76e6ae06-d4bd-4606-a91b-cde2d733f452 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:36.302291 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-63a33297-2b9d-41ca-aaef-efc5f301ca50 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/592ad8d1-1dfe-49cf-9091-a90be1a1ad2d" status: 200 len: 184 microversion: 2.1 time: 0.213291 Oct 18 13:18:36.302949 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 349/675] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 18 13:18:36 2022] GET /compute/v2.1/os-floating-ips/592ad8d1-1dfe-49cf-9091-a90be1a1ad2d => generated 184 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:36.308206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4eebcec-0b70-47e7-9eb5-b096696fe4a9 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:36.309084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e4eebcec-0b70-47e7-9eb5-b096696fe4a9 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:36.315665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4eebcec-0b70-47e7-9eb5-b096696fe4a9 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:36.316152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4eebcec-0b70-47e7-9eb5-b096696fe4a9 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:36.316587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4eebcec-0b70-47e7-9eb5-b096696fe4a9 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:36.317309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4eebcec-0b70-47e7-9eb5-b096696fe4a9 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:36.317762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4eebcec-0b70-47e7-9eb5-b096696fe4a9 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:36.318213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4eebcec-0b70-47e7-9eb5-b096696fe4a9 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:36.324703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:36.330258 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-76e6ae06-d4bd-4606-a91b-cde2d733f452 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1615 microversion: 2.1 time: 0.153663 Oct 18 13:18:36.330837 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 327/676] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:36 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1615 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:36.335578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8b36640c-870d-4382-bf4d-173aca64bb36 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:36.336032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:RELEASE=2,nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:36.336932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8b36640c-870d-4382-bf4d-173aca64bb36 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:36.343178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b36640c-870d-4382-bf4d-173aca64bb36 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:36.343891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b36640c-870d-4382-bf4d-173aca64bb36 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:36.344519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b36640c-870d-4382-bf4d-173aca64bb36 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:36.345649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b36640c-870d-4382-bf4d-173aca64bb36 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:36.346296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b36640c-870d-4382-bf4d-173aca64bb36 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:36.346905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b36640c-870d-4382-bf4d-173aca64bb36 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:36.495185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8b36640c-870d-4382-bf4d-173aca64bb36 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:36.503995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8b36640c-870d-4382-bf4d-173aca64bb36 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:36.505505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8b36640c-870d-4382-bf4d-173aca64bb36 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:36.506704 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8b36640c-870d-4382-bf4d-173aca64bb36 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1362 microversion: 2.25 time: 0.174918 Oct 18 13:18:36.507238 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 328/677] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:36 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:36.512103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f02736d4-c57c-47c9-981c-7b72e302c490 tempest-SecurityGroupsTestAdminJSON-2126974169 tempest-SecurityGroupsTestAdminJSON-2126974169-project] Calling method '.version_select at 0x7ff60fdb1820>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:36.566501 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e4eebcec-0b70-47e7-9eb5-b096696fe4a9 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1633 microversion: 2.1 time: 0.261902 Oct 18 13:18:36.567186 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 350/678] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:36 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1633 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:36.571880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.128"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:36.699857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:36.706526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:36.707015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:36.707448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:36.708149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:36.708604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:36.709028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:36.786093 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f02736d4-c57c-47c9-981c-7b72e302c490 tempest-SecurityGroupsTestAdminJSON-2126974169 tempest-SecurityGroupsTestAdminJSON-2126974169-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.277534 Oct 18 13:18:36.786685 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 329/679] 10.222.0.40 () {58 vars in 1191 bytes} [Tue Oct 18 13:18:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:36.796183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-20dd4e21-f8de-4eda-b647-4a1ee463d6c1 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Calling method '.version_select at 0x7ff60fd98430>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:36.796183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20dd4e21-f8de-4eda-b647-4a1ee463d6c1 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:36.796183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20dd4e21-f8de-4eda-b647-4a1ee463d6c1 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:36.796550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20dd4e21-f8de-4eda-b647-4a1ee463d6c1 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:36.808244 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-20dd4e21-f8de-4eda-b647-4a1ee463d6c1 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 801 microversion: 2.1 time: 0.020541 Oct 18 13:18:36.813229 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 330/680] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 18 13:18:36 2022] GET /compute/v2.1/os-migrations => generated 801 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:36.813818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f9d935b0-09a5-4414-9ee8-55c386a25e6e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:36.814567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f9d935b0-09a5-4414-9ee8-55c386a25e6e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:36.820671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9d935b0-09a5-4414-9ee8-55c386a25e6e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:36.821145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9d935b0-09a5-4414-9ee8-55c386a25e6e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:36.821612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9d935b0-09a5-4414-9ee8-55c386a25e6e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:36.822296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9d935b0-09a5-4414-9ee8-55c386a25e6e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:36.825080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9d935b0-09a5-4414-9ee8-55c386a25e6e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:36.825080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9d935b0-09a5-4414-9ee8-55c386a25e6e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:36.945288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "refresh_cache-f97ccda6-c665-4a4f-b099-72b142b143b7" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:18:36.945922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquired lock "refresh_cache-f97ccda6-c665-4a4f-b099-72b142b143b7" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:18:36.980921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f9d935b0-09a5-4414-9ee8-55c386a25e6e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:36.989866 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f9d935b0-09a5-4414-9ee8-55c386a25e6e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1322 microversion: 2.1 time: 0.179582 Oct 18 13:18:36.991085 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 331/681] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:36 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:37.004688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-49356a58-4359-4d00-9599-122166abe5d8 req-f8d22b8c-8d04-441a-9171-e5f1065caa25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b550c78b-caf6-44ea-a613-978bac95b4fe", "name": "network-vif-plugged", "status": "completed", "tag": "f691b18b-7542-4132-925b-d3a8fa57fcae"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:37.005786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-49356a58-4359-4d00-9599-122166abe5d8 req-f8d22b8c-8d04-441a-9171-e5f1065caa25 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:37.007049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-49356a58-4359-4d00-9599-122166abe5d8 req-f8d22b8c-8d04-441a-9171-e5f1065caa25 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:37.008013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-49356a58-4359-4d00-9599-122166abe5d8 req-f8d22b8c-8d04-441a-9171-e5f1065caa25 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:37.019288 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-49356a58-4359-4d00-9599-122166abe5d8 req-f8d22b8c-8d04-441a-9171-e5f1065caa25 service nova] Creating event network-vif-plugged:f691b18b-7542-4132-925b-d3a8fa57fcae for instance b550c78b-caf6-44ea-a613-978bac95b4fe on n-h2-858384-13 Oct 18 13:18:37.025296 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-49356a58-4359-4d00-9599-122166abe5d8 req-f8d22b8c-8d04-441a-9171-e5f1065caa25 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032814 Oct 18 13:18:37.026230 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 332/682] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:37.031205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-554f48c8-b7c4-4992-a43a-4815a0d5a084 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:37.031971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-554f48c8-b7c4-4992-a43a-4815a0d5a084 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:37.042627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-554f48c8-b7c4-4992-a43a-4815a0d5a084 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:37.043123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-554f48c8-b7c4-4992-a43a-4815a0d5a084 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:37.043561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-554f48c8-b7c4-4992-a43a-4815a0d5a084 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:37.044258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-554f48c8-b7c4-4992-a43a-4815a0d5a084 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:37.044703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-554f48c8-b7c4-4992-a43a-4815a0d5a084 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:37.045118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-554f48c8-b7c4-4992-a43a-4815a0d5a084 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:37.191022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-554f48c8-b7c4-4992-a43a-4815a0d5a084 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:37.199683 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-554f48c8-b7c4-4992-a43a-4815a0d5a084 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1388 microversion: 2.1 time: 0.172463 Oct 18 13:18:37.200626 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 333/683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:37 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1388 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:37.207393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5fbe334b-da9e-4d9c-8740-ea5c946fbdeb tempest-SecurityGroupsTestAdminJSON-1365261114 tempest-SecurityGroupsTestAdminJSON-1365261114-project-admin] Calling method '.version_select at 0x7ff60fdb1ca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:37.531468 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5fbe334b-da9e-4d9c-8740-ea5c946fbdeb tempest-SecurityGroupsTestAdminJSON-1365261114 tempest-SecurityGroupsTestAdminJSON-1365261114-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/1a357f63-9eb2-40c6-a6a2-b993d80abc65" status: 202 len: 0 microversion: 2.1 time: 0.328676 Oct 18 13:18:37.536158 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 334/684] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:18:37 2022] DELETE /compute/v2.1/os-security-groups/1a357f63-9eb2-40c6-a6a2-b993d80abc65 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:18:37.544978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1684776749", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:37.636544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:18:37.736920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Building network info cache for instance {{(pid=120611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:18:38.007923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:18:38.008357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:18:38.008876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:18:38.010455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:18:38.010924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:18:38.028200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:38.029534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:38.030182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:38.030928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:38.031569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:38.032002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:38.055484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Getting quotas for project 3f136eea39d84b04b5410eb0906c113e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:18:38.062321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Getting quotas for user e631235f0d0c400981c97d9edb1ea7fe and project 3f136eea39d84b04b5410eb0906c113e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:18:38.080572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:18:38.083857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:18:38.138221 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e4add290-8586-4a69-86a9-4c39f3df02cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600170 Oct 18 13:18:38.139569 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 335/685] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:18:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:18:38.149010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-95186377-a727-4fe9-94f2-d43e41e16842 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:38.151232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-95186377-a727-4fe9-94f2-d43e41e16842 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:38.162057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95186377-a727-4fe9-94f2-d43e41e16842 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:38.162843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95186377-a727-4fe9-94f2-d43e41e16842 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:38.163558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95186377-a727-4fe9-94f2-d43e41e16842 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:38.164406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95186377-a727-4fe9-94f2-d43e41e16842 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:38.164868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95186377-a727-4fe9-94f2-d43e41e16842 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:38.165348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95186377-a727-4fe9-94f2-d43e41e16842 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:38.329907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-95186377-a727-4fe9-94f2-d43e41e16842 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:38.342338 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-95186377-a727-4fe9-94f2-d43e41e16842 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1314 microversion: 2.1 time: 0.201438 Oct 18 13:18:38.357471 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 336/686] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:38 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:38.358118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-028a9a27-dc84-44c8-bc0d-eb1103b1ea5c req-6ad96371-eb21-4a16-9dbe-7c9324cc2f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97ccda6-c665-4a4f-b099-72b142b143b7", "tag": "7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5"}, {"server_uuid": "4e257aea-4f80-4311-8216-9f3b8481507a", "name": "network-vif-deleted", "tag": "c2e5c8e4-7e8d-4b38-9402-17b57d852e09"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:38.370695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-028a9a27-dc84-44c8-bc0d-eb1103b1ea5c req-6ad96371-eb21-4a16-9dbe-7c9324cc2f14 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:38.371184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-028a9a27-dc84-44c8-bc0d-eb1103b1ea5c req-6ad96371-eb21-4a16-9dbe-7c9324cc2f14 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:38.371620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-028a9a27-dc84-44c8-bc0d-eb1103b1ea5c req-6ad96371-eb21-4a16-9dbe-7c9324cc2f14 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:38.383402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Updating instance_info_cache with network_info: [{"id": "7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5", "address": "fa:16:3e:39:47:12", "network": {"id": "a22da94d-677f-457d-bbf8-95010fd233ef", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1194878154-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a7b9ff58f71c425d8853ec2d0466ee3a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7f2098ee-ff", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:18:38.392504 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-028a9a27-dc84-44c8-bc0d-eb1103b1ea5c req-6ad96371-eb21-4a16-9dbe-7c9324cc2f14 service nova] Creating event network-changed:7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5 for instance f97ccda6-c665-4a4f-b099-72b142b143b7 on n-h1-858384-13 Oct 18 13:18:38.393471 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-028a9a27-dc84-44c8-bc0d-eb1103b1ea5c req-6ad96371-eb21-4a16-9dbe-7c9324cc2f14 service nova] Creating event network-vif-deleted:c2e5c8e4-7e8d-4b38-9402-17b57d852e09 for instance 4e257aea-4f80-4311-8216-9f3b8481507a on n-h2-858384-13 Oct 18 13:18:38.400075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Releasing lock "refresh_cache-f97ccda6-c665-4a4f-b099-72b142b143b7" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:18:38.402187 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-395efb2c-67c5-484e-90eb-ff5fe808f698 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "POST /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7/action" status: 202 len: 0 microversion: 2.1 time: 1.833176 Oct 18 13:18:38.403296 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-028a9a27-dc84-44c8-bc0d-eb1103b1ea5c req-6ad96371-eb21-4a16-9dbe-7c9324cc2f14 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.056700 Oct 18 13:18:38.403737 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 351/687] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:36 2022] POST /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7/action => generated 0 bytes in 1836 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:18:38.404224 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 337/688] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:38.412058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5df5cb05-0662-44e3-a91c-9ecd2012f759 tempest-SecurityGroupsTestAdminJSON-1365261114 tempest-SecurityGroupsTestAdminJSON-1365261114-project-admin] Calling method '.version_select at 0x7ff60fdb14c0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:38.415267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-21edafd3-dd46-4b46-b343-fde4dcca4c00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:38.416740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-21edafd3-dd46-4b46-b343-fde4dcca4c00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:38.426423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21edafd3-dd46-4b46-b343-fde4dcca4c00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:38.427152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21edafd3-dd46-4b46-b343-fde4dcca4c00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:38.427583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21edafd3-dd46-4b46-b343-fde4dcca4c00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:38.429015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21edafd3-dd46-4b46-b343-fde4dcca4c00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:38.429674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21edafd3-dd46-4b46-b343-fde4dcca4c00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:38.430102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21edafd3-dd46-4b46-b343-fde4dcca4c00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:38.824188 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5df5cb05-0662-44e3-a91c-9ecd2012f759 tempest-SecurityGroupsTestAdminJSON-1365261114 tempest-SecurityGroupsTestAdminJSON-1365261114-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/4053fcd5-5947-4b15-9203-b0866099d029" status: 202 len: 0 microversion: 2.1 time: 0.418716 Oct 18 13:18:38.824951 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 338/689] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:18:38 2022] DELETE /compute/v2.1/os-security-groups/4053fcd5-5947-4b15-9203-b0866099d029 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:18:38.830624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b201bc0f-1e2a-4029-8cae-aba3dcc2d8ed tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:38.831719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b201bc0f-1e2a-4029-8cae-aba3dcc2d8ed tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:38.840816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b201bc0f-1e2a-4029-8cae-aba3dcc2d8ed tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:38.841476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b201bc0f-1e2a-4029-8cae-aba3dcc2d8ed tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:38.841981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b201bc0f-1e2a-4029-8cae-aba3dcc2d8ed tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:38.842875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b201bc0f-1e2a-4029-8cae-aba3dcc2d8ed tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:38.843412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b201bc0f-1e2a-4029-8cae-aba3dcc2d8ed tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:38.844986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b201bc0f-1e2a-4029-8cae-aba3dcc2d8ed tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:38.997550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-21edafd3-dd46-4b46-b343-fde4dcca4c00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:39.008919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-21edafd3-dd46-4b46-b343-fde4dcca4c00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:39.013637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-21edafd3-dd46-4b46-b343-fde4dcca4c00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:39.018005 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-21edafd3-dd46-4b46-b343-fde4dcca4c00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1362 microversion: 2.25 time: 0.608304 Oct 18 13:18:39.019031 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 352/690] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:38 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1362 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:39.045480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f34f92ab-9588-49e9-ba64-880ba6b05e1e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:39.046352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f34f92ab-9588-49e9-ba64-880ba6b05e1e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:39.055823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f34f92ab-9588-49e9-ba64-880ba6b05e1e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.056317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f34f92ab-9588-49e9-ba64-880ba6b05e1e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.056963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f34f92ab-9588-49e9-ba64-880ba6b05e1e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.058327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f34f92ab-9588-49e9-ba64-880ba6b05e1e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.058882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f34f92ab-9588-49e9-ba64-880ba6b05e1e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.059318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f34f92ab-9588-49e9-ba64-880ba6b05e1e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.200489 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b201bc0f-1e2a-4029-8cae-aba3dcc2d8ed tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1616 microversion: 2.1 time: 0.374226 Oct 18 13:18:39.203472 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 339/691] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:38 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1616 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:39.215947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f91631fa-1824-47fe-93c7-a33cb2aa052a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:39.217122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f91631fa-1824-47fe-93c7-a33cb2aa052a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:39.232083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f91631fa-1824-47fe-93c7-a33cb2aa052a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.232897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f91631fa-1824-47fe-93c7-a33cb2aa052a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.233621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f91631fa-1824-47fe-93c7-a33cb2aa052a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.234631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f91631fa-1824-47fe-93c7-a33cb2aa052a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.235193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f91631fa-1824-47fe-93c7-a33cb2aa052a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.236012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f91631fa-1824-47fe-93c7-a33cb2aa052a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.269884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f34f92ab-9588-49e9-ba64-880ba6b05e1e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:39.282969 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f34f92ab-9588-49e9-ba64-880ba6b05e1e tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1322 microversion: 2.1 time: 0.251365 Oct 18 13:18:39.298403 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 353/692] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:39 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:39.306547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-70e010b0-f588-4692-8814-b8ef7a9d384d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:39.310793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-70e010b0-f588-4692-8814-b8ef7a9d384d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:39.320850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70e010b0-f588-4692-8814-b8ef7a9d384d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.321836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70e010b0-f588-4692-8814-b8ef7a9d384d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.322717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70e010b0-f588-4692-8814-b8ef7a9d384d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.323846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70e010b0-f588-4692-8814-b8ef7a9d384d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.324682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70e010b0-f588-4692-8814-b8ef7a9d384d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.325852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70e010b0-f588-4692-8814-b8ef7a9d384d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.333629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f91631fa-1824-47fe-93c7-a33cb2aa052a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:39.346944 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f91631fa-1824-47fe-93c7-a33cb2aa052a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1265 microversion: 2.1 time: 0.136965 Oct 18 13:18:39.348206 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 340/693] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:39 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:39.354227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16f69cc2-37ac-45f3-bd29-9e417296457b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:39.355002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-16f69cc2-37ac-45f3-bd29-9e417296457b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:39.362863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16f69cc2-37ac-45f3-bd29-9e417296457b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.363819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16f69cc2-37ac-45f3-bd29-9e417296457b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.364670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16f69cc2-37ac-45f3-bd29-9e417296457b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.366105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16f69cc2-37ac-45f3-bd29-9e417296457b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.367214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16f69cc2-37ac-45f3-bd29-9e417296457b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.368142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16f69cc2-37ac-45f3-bd29-9e417296457b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.401917 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-16f69cc2-37ac-45f3-bd29-9e417296457b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] HTTP exception thrown: Instance 4e257aea-4f80-4311-8216-9f3b8481507a could not be found. Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16f69cc2-37ac-45f3-bd29-9e417296457b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Request method failure captured: Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a HTTP/1.1 Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdaw5eKFtczjxjzMrR0d_1Gha5NPaIEOZ9ux9rCUNEEusLrElZXrC0CVBXbvhLrufM5CQIBIwH2pFzsmeuqXPx5G-9DwVlF99C011d1O5TJE5baUyLQQO_2QLlCQUwqF9FUjeo0CJiXoJrjVViv_K27QN-0bbUKYjTsIXDPoY0Z_o8 Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a7b9ff58f71c425d8853ec2d0466ee3a Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-614088941 Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:18:39.403623 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:18:39.405016 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7b9ff58f71c425d8853ec2d0466ee3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7b9ff58f71c425d8853ec2d0466ee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7b9ff58f71c425d8853ec2d0466ee3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7b9ff58f71c425d8853ec2d0466ee3a"}]}] Oct 18 13:18:39.405016 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-614088941 Oct 18 13:18:39.405016 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a7b9ff58f71c425d8853ec2d0466ee3a Oct 18 13:18:39.405016 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-614088941 Oct 18 13:18:39.405016 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FloatingIPsAssociationTestJSON-614088941-project Oct 18 13:18:39.405016 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:18:39.405016 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:18:39.405016 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9f3dcbdece5d4d4b992f4e9ebf4897d4 Oct 18 13:18:39.405016 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-614088941-project Oct 18 13:18:39.405016 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:18:39.405016 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4e257aea-4f80-4311-8216-9f3b8481507a could not be found. Oct 18 13:18:39.405016 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '4e257aea-4f80-4311-8216-9f3b8481507a'} Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e257aea-4f80-4311-8216-9f3b8481507a could not be found. Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:39.405773 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e257aea-4f80-4311-8216-9f3b8481507a could not be found. Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e257aea-4f80-4311-8216-9f3b8481507a could not be found. Oct 18 13:18:39.406935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.408110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16f69cc2-37ac-45f3-bd29-9e417296457b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Returning 404 to user: Instance 4e257aea-4f80-4311-8216-9f3b8481507a could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:39.414352 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-16f69cc2-37ac-45f3-bd29-9e417296457b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a" status: 404 len: 111 microversion: 2.1 time: 0.064238 Oct 18 13:18:39.418260 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 341/694] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:18:39 2022] DELETE /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:18:39.420797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d6f01636-671c-4d3a-8cdb-7c574f92a44e tempest-SecurityGroupsTestAdminJSON-2126974169 tempest-SecurityGroupsTestAdminJSON-2126974169-project] Calling method '.version_select at 0x7ff60fdf1ca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:39.515103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-70e010b0-f588-4692-8814-b8ef7a9d384d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:39.526701 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-70e010b0-f588-4692-8814-b8ef7a9d384d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1588 microversion: 2.1 time: 0.226588 Oct 18 13:18:39.527510 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 354/695] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:39 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1588 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:39.532446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-2fe4d631-f086-447e-b90f-6a56bff2d7f8 req-874feebb-d5e3-42d6-8d5d-dff556e6ad54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57f9acd7-30d4-4857-b45a-b7c851330c34", "name": "network-vif-plugged", "status": "completed", "tag": "fb391fe6-f576-4add-b03a-a70be3613588"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:39.548711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2fe4d631-f086-447e-b90f-6a56bff2d7f8 req-874feebb-d5e3-42d6-8d5d-dff556e6ad54 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.549430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2fe4d631-f086-447e-b90f-6a56bff2d7f8 req-874feebb-d5e3-42d6-8d5d-dff556e6ad54 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.550074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2fe4d631-f086-447e-b90f-6a56bff2d7f8 req-874feebb-d5e3-42d6-8d5d-dff556e6ad54 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.571263 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-2fe4d631-f086-447e-b90f-6a56bff2d7f8 req-874feebb-d5e3-42d6-8d5d-dff556e6ad54 service nova] Creating event network-vif-plugged:fb391fe6-f576-4add-b03a-a70be3613588 for instance 57f9acd7-30d4-4857-b45a-b7c851330c34 on n-h1-858384-13 Oct 18 13:18:39.581114 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-2fe4d631-f086-447e-b90f-6a56bff2d7f8 req-874feebb-d5e3-42d6-8d5d-dff556e6ad54 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051672 Oct 18 13:18:39.582239 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 355/696] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:39.594005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1bbeb419-884f-4509-ad8b-8ace577ed036 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:39.595143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1bbeb419-884f-4509-ad8b-8ace577ed036 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:39.605912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bbeb419-884f-4509-ad8b-8ace577ed036 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.606805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bbeb419-884f-4509-ad8b-8ace577ed036 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.607553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bbeb419-884f-4509-ad8b-8ace577ed036 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.608738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bbeb419-884f-4509-ad8b-8ace577ed036 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.609574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bbeb419-884f-4509-ad8b-8ace577ed036 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.610316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bbeb419-884f-4509-ad8b-8ace577ed036 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.644346 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-1bbeb419-884f-4509-ad8b-8ace577ed036 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] HTTP exception thrown: Cannot 'migrate' instance bdb9c30c-e278-459f-b11a-78c8fd730b1c while it is in vm_state suspended Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1bbeb419-884f-4509-ad8b-8ace577ed036 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Request method failure captured: Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c/action HTTP/1.1 Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 15 Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqd7QAT1Wjs9_FuST2Ws5Q808O3rA7hPlWp3G7XOPRYHl7Mdw6DlrJvHuhWpc4Bmbq5qhxGKOvRcWFiW44i39qY6iBUkikPa3GaEXdKysdhp-_c2yTWRBVnk9_N6rNI2_zWlaxnY1ZEWLEN55Ca_dtW0f_B5AcR6kO540nQtQf2pxpw Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 1d77814d9c494dda889600e521516bd4 Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:18:39.646169 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:18:39.647578 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d77814d9c494dda889600e521516bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1d77814d9c494dda889600e521516bd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d77814d9c494dda889600e521516bd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1d77814d9c494dda889600e521516bd4"}]}] Oct 18 13:18:39.647578 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:39.647578 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 1d77814d9c494dda889600e521516bd4 Oct 18 13:18:39.647578 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:39.647578 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersAdminNegativeTestJSON-1053227917-project-admin Oct 18 13:18:39.647578 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:39.647578 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:39.647578 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 86155cea59f44350a2cf3b0806fdcef0 Oct 18 13:18:39.647578 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1053227917-project-admin Oct 18 13:18:39.647578 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:18:39.647578 n-d-858384-13 devstack@n-api.service[120611]: {"migrate": {}} Oct 18 13:18:39.647578 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:18:39.647578 n-d-858384-13 devstack@n-api.service[120611]: exception: Cannot 'migrate' instance bdb9c30c-e278-459f-b11a-78c8fd730b1c while it is in vm_state suspended Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'bdb9c30c-e278-459f-b11a-78c8fd730b1c', 'body': {'migrate': {}}} Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bdb9c30c-e278-459f-b11a-78c8fd730b1c in vm_state suspended. Cannot resize while the instance is in this state. Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.658244 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance bdb9c30c-e278-459f-b11a-78c8fd730b1c while it is in vm_state suspended Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:39.659617 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:39.660979 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:39.660979 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:39.660979 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance bdb9c30c-e278-459f-b11a-78c8fd730b1c while it is in vm_state suspended Oct 18 13:18:39.660979 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.660979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1bbeb419-884f-4509-ad8b-8ace577ed036 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Returning 409 to user: Cannot 'migrate' instance bdb9c30c-e278-459f-b11a-78c8fd730b1c while it is in vm_state suspended {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:39.660979 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1bbeb419-884f-4509-ad8b-8ace577ed036 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c/action" status: 409 len: 148 microversion: 2.1 time: 0.061157 Oct 18 13:18:39.660979 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 356/697] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:39 2022] POST /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c/action => generated 148 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:18:39.660979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-266e0f36-1654-4906-8b09-9c7e992c1fb8 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:39.661626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-266e0f36-1654-4906-8b09-9c7e992c1fb8 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:39.661626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-266e0f36-1654-4906-8b09-9c7e992c1fb8 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.661626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-266e0f36-1654-4906-8b09-9c7e992c1fb8 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.661626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-266e0f36-1654-4906-8b09-9c7e992c1fb8 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.661941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-266e0f36-1654-4906-8b09-9c7e992c1fb8 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.662729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-266e0f36-1654-4906-8b09-9c7e992c1fb8 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.662729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-266e0f36-1654-4906-8b09-9c7e992c1fb8 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.730231 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d6f01636-671c-4d3a-8cdb-7c574f92a44e tempest-SecurityGroupsTestAdminJSON-2126974169 tempest-SecurityGroupsTestAdminJSON-2126974169-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/a99a028c-d996-4436-8a69-84495156712a" status: 202 len: 0 microversion: 2.1 time: 0.313071 Oct 18 13:18:39.732180 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 342/698] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:18:39 2022] DELETE /compute/v2.1/os-security-groups/a99a028c-d996-4436-8a69-84495156712a => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:18:39.739018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c4590b76-4884-47a0-90a8-db8fe4f0f82e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:39.739935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c4590b76-4884-47a0-90a8-db8fe4f0f82e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: 4e257aea-4f80-4311-8216-9f3b8481507a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:39.748211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4590b76-4884-47a0-90a8-db8fe4f0f82e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.748929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4590b76-4884-47a0-90a8-db8fe4f0f82e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.749553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4590b76-4884-47a0-90a8-db8fe4f0f82e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.750418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4590b76-4884-47a0-90a8-db8fe4f0f82e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.751049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4590b76-4884-47a0-90a8-db8fe4f0f82e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.752505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4590b76-4884-47a0-90a8-db8fe4f0f82e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.785940 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-c4590b76-4884-47a0-90a8-db8fe4f0f82e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] HTTP exception thrown: Instance 4e257aea-4f80-4311-8216-9f3b8481507a could not be found. Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c4590b76-4884-47a0-90a8-db8fe4f0f82e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Request method failure captured: Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a HTTP/1.1 Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdaw5eKFtczjxjzMrR0d_1Gha5NPaIEOZ9ux9rCUNEEusLrElZXrC0CVBXbvhLrufM5CQIBIwH2pFzsmeuqXPx5G-9DwVlF99C011d1O5TJE5baUyLQQO_2QLlCQUwqF9FUjeo0CJiXoJrjVViv_K27QN-0bbUKYjTsIXDPoY0Z_o8 Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a7b9ff58f71c425d8853ec2d0466ee3a Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-614088941 Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:18:39.787801 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:18:39.789210 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7b9ff58f71c425d8853ec2d0466ee3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7b9ff58f71c425d8853ec2d0466ee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7b9ff58f71c425d8853ec2d0466ee3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7b9ff58f71c425d8853ec2d0466ee3a"}]}] Oct 18 13:18:39.789210 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-614088941 Oct 18 13:18:39.789210 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a7b9ff58f71c425d8853ec2d0466ee3a Oct 18 13:18:39.789210 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-614088941 Oct 18 13:18:39.789210 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FloatingIPsAssociationTestJSON-614088941-project Oct 18 13:18:39.789210 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:18:39.789210 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:18:39.789210 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9f3dcbdece5d4d4b992f4e9ebf4897d4 Oct 18 13:18:39.789210 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-614088941-project Oct 18 13:18:39.789210 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:18:39.789210 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4e257aea-4f80-4311-8216-9f3b8481507a could not be found. Oct 18 13:18:39.789210 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '4e257aea-4f80-4311-8216-9f3b8481507a'} Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e257aea-4f80-4311-8216-9f3b8481507a could not be found. Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:39.790066 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e257aea-4f80-4311-8216-9f3b8481507a could not be found. Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e257aea-4f80-4311-8216-9f3b8481507a could not be found. Oct 18 13:18:39.791359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.793519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c4590b76-4884-47a0-90a8-db8fe4f0f82e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Returning 404 to user: Instance 4e257aea-4f80-4311-8216-9f3b8481507a could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:39.794601 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c4590b76-4884-47a0-90a8-db8fe4f0f82e tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a" status: 404 len: 111 microversion: 2.1 time: 0.060727 Oct 18 13:18:39.796105 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 343/699] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:39 2022] GET /compute/v2.1/servers/4e257aea-4f80-4311-8216-9f3b8481507a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:18:39.801316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0ddbba2-6504-44b0-ada8-7217701d9ac1 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:39.802010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c0ddbba2-6504-44b0-ada8-7217701d9ac1 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:39.808797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0ddbba2-6504-44b0-ada8-7217701d9ac1 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.809667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0ddbba2-6504-44b0-ada8-7217701d9ac1 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.810266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0ddbba2-6504-44b0-ada8-7217701d9ac1 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.811123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0ddbba2-6504-44b0-ada8-7217701d9ac1 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:39.811736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0ddbba2-6504-44b0-ada8-7217701d9ac1 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:39.812482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0ddbba2-6504-44b0-ada8-7217701d9ac1 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:39.862777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-266e0f36-1654-4906-8b09-9c7e992c1fb8 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:39.876545 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-266e0f36-1654-4906-8b09-9c7e992c1fb8 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1314 microversion: 2.1 time: 0.226475 Oct 18 13:18:39.877602 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 357/700] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:39 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:39.883424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac9e0cd3-cf31-40ba-a6e9-4712a8c38c69 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac9e0cd3-cf31-40ba-a6e9-4712a8c38c69 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Request method failure captured: Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422/action HTTP/1.1 Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 39 Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqd7QAT1Wjs9_FuST2Ws5Q808O3rA7hPlWp3G7XOPRYHl7Mdw6DlrJvHuhWpc4Bmbq5qhxGKOvRcWFiW44i39qY6iBUkikPa3GaEXdKysdhp-_c2yTWRBVnk9_N6rNI2_zWlaxnY1ZEWLEN55Ca_dtW0f_B5AcR6kO540nQtQf2pxpw Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 1d77814d9c494dda889600e521516bd4 Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:18:39.887274 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:18:39.888519 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d77814d9c494dda889600e521516bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1d77814d9c494dda889600e521516bd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d77814d9c494dda889600e521516bd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1d77814d9c494dda889600e521516bd4"}]}] Oct 18 13:18:39.888519 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:39.888519 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 1d77814d9c494dda889600e521516bd4 Oct 18 13:18:39.888519 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:39.888519 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersAdminNegativeTestJSON-1053227917-project-admin Oct 18 13:18:39.888519 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:39.888519 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:39.888519 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 86155cea59f44350a2cf3b0806fdcef0 Oct 18 13:18:39.888519 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1053227917-project-admin Oct 18 13:18:39.888519 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:18:39.888519 n-d-858384-13 devstack@n-api.service[120611]: {"os-resetState": {"state": "invalid"}} Oct 18 13:18:39.888519 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'a279ff8b-eb06-4bb1-b9d4-f92566e98422', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:39.889416 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:18:39.890689 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 18 13:18:39.891899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:39.894135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac9e0cd3-cf31-40ba-a6e9-4712a8c38c69 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:39.895156 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ac9e0cd3-cf31-40ba-a6e9-4712a8c38c69 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422/action" status: 400 len: 144 microversion: 2.1 time: 0.016462 Oct 18 13:18:39.909084 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 358/701] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:39 2022] POST /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422/action => generated 144 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:18:39.916378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-971d3565-4ac7-429d-a9ed-8c2f81d0d207 tempest-SecurityGroupsTestAdminJSON-2126974169 tempest-SecurityGroupsTestAdminJSON-2126974169-project] Calling method '.version_select at 0x7ff60fdb25e0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:39.948586 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c0ddbba2-6504-44b0-ada8-7217701d9ac1 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151166 Oct 18 13:18:39.949293 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 344/702] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:18:39 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:39.954123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b18cbeab-5e26-4d52-b314-2363baa871df tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '.version_select at 0x7ff60fddd9d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:40.301944 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-971d3565-4ac7-429d-a9ed-8c2f81d0d207 tempest-SecurityGroupsTestAdminJSON-2126974169 tempest-SecurityGroupsTestAdminJSON-2126974169-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/cef68478-3fab-47c9-b894-d206d7a6c9ae" status: 202 len: 0 microversion: 2.1 time: 0.391596 Oct 18 13:18:40.305072 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 359/703] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:18:39 2022] DELETE /compute/v2.1/os-security-groups/cef68478-3fab-47c9-b894-d206d7a6c9ae => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:18:40.311205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-15da54fa-8464-4ced-96cc-dfe3cf6ba356 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-15da54fa-8464-4ced-96cc-dfe3cf6ba356 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Request method failure captured: Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422/action HTTP/1.1 Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 31 Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqd7QAT1Wjs9_FuST2Ws5Q808O3rA7hPlWp3G7XOPRYHl7Mdw6DlrJvHuhWpc4Bmbq5qhxGKOvRcWFiW44i39qY6iBUkikPa3GaEXdKysdhp-_c2yTWRBVnk9_N6rNI2_zWlaxnY1ZEWLEN55Ca_dtW0f_B5AcR6kO540nQtQf2pxpw Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 1d77814d9c494dda889600e521516bd4 Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:18:40.332167 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:18:40.333634 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d77814d9c494dda889600e521516bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1d77814d9c494dda889600e521516bd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d77814d9c494dda889600e521516bd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1d77814d9c494dda889600e521516bd4"}]}] Oct 18 13:18:40.333634 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:40.333634 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 1d77814d9c494dda889600e521516bd4 Oct 18 13:18:40.333634 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:40.333634 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersAdminNegativeTestJSON-1053227917-project-admin Oct 18 13:18:40.333634 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:40.333634 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:40.333634 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 86155cea59f44350a2cf3b0806fdcef0 Oct 18 13:18:40.333634 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1053227917-project-admin Oct 18 13:18:40.333634 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:18:40.333634 n-d-858384-13 devstack@n-api.service[120611]: {"os-resetState": {"state": 1}} Oct 18 13:18:40.333634 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:18:40.333634 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'a279ff8b-eb06-4bb1-b9d4-f92566e98422', 'body': {'os-resetState': {'state': 1}}} Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 1 Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:40.334564 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 18 13:18:40.336103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:40.341191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-15da54fa-8464-4ced-96cc-dfe3cf6ba356 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:40.345607 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-15da54fa-8464-4ced-96cc-dfe3cf6ba356 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422/action" status: 400 len: 120 microversion: 2.1 time: 0.039139 Oct 18 13:18:40.346474 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 360/704] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:40 2022] POST /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422/action => generated 120 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:18:40.359802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4b1a7237-2b37-415c-a18b-0dde5f87f244 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:40.363174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4b1a7237-2b37-415c-a18b-0dde5f87f244 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:40.377600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b1a7237-2b37-415c-a18b-0dde5f87f244 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:40.378192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b1a7237-2b37-415c-a18b-0dde5f87f244 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:40.378707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b1a7237-2b37-415c-a18b-0dde5f87f244 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:40.379506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b1a7237-2b37-415c-a18b-0dde5f87f244 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:40.380043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b1a7237-2b37-415c-a18b-0dde5f87f244 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:40.380531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b1a7237-2b37-415c-a18b-0dde5f87f244 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:40.632299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b1a7237-2b37-415c-a18b-0dde5f87f244 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:40.649597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b1a7237-2b37-415c-a18b-0dde5f87f244 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:40.652132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b1a7237-2b37-415c-a18b-0dde5f87f244 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:40.653656 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4b1a7237-2b37-415c-a18b-0dde5f87f244 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1557 microversion: 2.25 time: 0.305893 Oct 18 13:18:40.665240 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 361/705] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:40 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1557 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:40.665240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bbfb1f7b-b093-46da-9b94-71ec9d00997a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:40.665240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bbfb1f7b-b093-46da-9b94-71ec9d00997a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:40.673702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbfb1f7b-b093-46da-9b94-71ec9d00997a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:40.673829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbfb1f7b-b093-46da-9b94-71ec9d00997a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:40.674335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbfb1f7b-b093-46da-9b94-71ec9d00997a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:40.675815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbfb1f7b-b093-46da-9b94-71ec9d00997a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:40.676683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbfb1f7b-b093-46da-9b94-71ec9d00997a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:40.678487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbfb1f7b-b093-46da-9b94-71ec9d00997a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:40.940074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bbfb1f7b-b093-46da-9b94-71ec9d00997a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:40.950205 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bbfb1f7b-b093-46da-9b94-71ec9d00997a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1322 microversion: 2.1 time: 0.293448 Oct 18 13:18:40.951371 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 362/706] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:40 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:40.958353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d445a15-3d5d-4b23-ba68-b34336f33541 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:40.962401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d445a15-3d5d-4b23-ba68-b34336f33541 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Failed to fetch instance by id 999 {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:18:40.963259 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-9d445a15-3d5d-4b23-ba68-b34336f33541 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d445a15-3d5d-4b23-ba68-b34336f33541 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Request method failure captured: Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 37 Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqd7QAT1Wjs9_FuST2Ws5Q808O3rA7hPlWp3G7XOPRYHl7Mdw6DlrJvHuhWpc4Bmbq5qhxGKOvRcWFiW44i39qY6iBUkikPa3GaEXdKysdhp-_c2yTWRBVnk9_N6rNI2_zWlaxnY1ZEWLEN55Ca_dtW0f_B5AcR6kO540nQtQf2pxpw Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 1d77814d9c494dda889600e521516bd4 Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:18:40.965956 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:18:40.967291 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d77814d9c494dda889600e521516bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1d77814d9c494dda889600e521516bd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d77814d9c494dda889600e521516bd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1d77814d9c494dda889600e521516bd4"}]}] Oct 18 13:18:40.967291 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:40.967291 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 1d77814d9c494dda889600e521516bd4 Oct 18 13:18:40.967291 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1053227917 Oct 18 13:18:40.967291 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersAdminNegativeTestJSON-1053227917-project-admin Oct 18 13:18:40.967291 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:40.967291 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:40.967291 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 86155cea59f44350a2cf3b0806fdcef0 Oct 18 13:18:40.967291 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1053227917-project-admin Oct 18 13:18:40.967291 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:18:40.967291 n-d-858384-13 devstack@n-api.service[120611]: {"os-resetState": {"state": "error"}} Oct 18 13:18:40.967291 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:18:40.967291 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 999 could not be found. Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:40.968108 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 18 13:18:40.969340 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:40.971126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d445a15-3d5d-4b23-ba68-b34336f33541 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:40.972031 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d445a15-3d5d-4b23-ba68-b34336f33541 tempest-ServersAdminNegativeTestJSON-1053227917 tempest-ServersAdminNegativeTestJSON-1053227917-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.019376 Oct 18 13:18:40.972600 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 363/707] 10.222.0.40 () {60 vars in 1179 bytes} [Tue Oct 18 13:18:40 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:18:40.993394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c0b9e6f9-e773-4a0f-b12d-eb7bfe73b69e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:40.994326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c0b9e6f9-e773-4a0f-b12d-eb7bfe73b69e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:41.004708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0b9e6f9-e773-4a0f-b12d-eb7bfe73b69e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:41.005222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0b9e6f9-e773-4a0f-b12d-eb7bfe73b69e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:41.018628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0b9e6f9-e773-4a0f-b12d-eb7bfe73b69e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:41.020553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0b9e6f9-e773-4a0f-b12d-eb7bfe73b69e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:41.023361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0b9e6f9-e773-4a0f-b12d-eb7bfe73b69e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:41.024007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0b9e6f9-e773-4a0f-b12d-eb7bfe73b69e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:41.355983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c0b9e6f9-e773-4a0f-b12d-eb7bfe73b69e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:41.369701 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c0b9e6f9-e773-4a0f-b12d-eb7bfe73b69e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1313 microversion: 2.1 time: 0.395573 Oct 18 13:18:41.371131 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 364/708] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:40 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:41.392009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7c0ebfd2-ef13-4965-8f2e-e4e17ed70132 req-32e4eece-6aed-4fec-b569-d01606b8fa61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97ccda6-c665-4a4f-b099-72b142b143b7", "tag": "7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:41.417880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7c0ebfd2-ef13-4965-8f2e-e4e17ed70132 req-32e4eece-6aed-4fec-b569-d01606b8fa61 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:41.419529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7c0ebfd2-ef13-4965-8f2e-e4e17ed70132 req-32e4eece-6aed-4fec-b569-d01606b8fa61 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:41.427422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7c0ebfd2-ef13-4965-8f2e-e4e17ed70132 req-32e4eece-6aed-4fec-b569-d01606b8fa61 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:41.455799 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7c0ebfd2-ef13-4965-8f2e-e4e17ed70132 req-32e4eece-6aed-4fec-b569-d01606b8fa61 service nova] Creating event network-changed:7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5 for instance f97ccda6-c665-4a4f-b099-72b142b143b7 on n-h1-858384-13 Oct 18 13:18:41.479275 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7c0ebfd2-ef13-4965-8f2e-e4e17ed70132 req-32e4eece-6aed-4fec-b569-d01606b8fa61 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098572 Oct 18 13:18:41.482645 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 365/709] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:41.499140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6bfa588c-2714-4ae7-bf58-00fefd9de550 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:41.501880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6bfa588c-2714-4ae7-bf58-00fefd9de550 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:41.528838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bfa588c-2714-4ae7-bf58-00fefd9de550 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:41.529370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bfa588c-2714-4ae7-bf58-00fefd9de550 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:41.529810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bfa588c-2714-4ae7-bf58-00fefd9de550 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:41.530530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bfa588c-2714-4ae7-bf58-00fefd9de550 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:41.530982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bfa588c-2714-4ae7-bf58-00fefd9de550 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:41.531822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bfa588c-2714-4ae7-bf58-00fefd9de550 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:41.812983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-6bfa588c-2714-4ae7-bf58-00fefd9de550 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid b550c78b-caf6-44ea-a613-978bac95b4fe {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:18:41.847952 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6bfa588c-2714-4ae7-bf58-00fefd9de550 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 2052 microversion: 2.25 time: 0.364081 Oct 18 13:18:41.848574 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 366/710] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:41 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 2052 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:41.854518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-185013b0-faec-4430-b776-df2639d4da4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:41.855588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-185013b0-faec-4430-b776-df2639d4da4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:41.861919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-185013b0-faec-4430-b776-df2639d4da4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:41.862604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-185013b0-faec-4430-b776-df2639d4da4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:41.863187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-185013b0-faec-4430-b776-df2639d4da4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:41.864050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-185013b0-faec-4430-b776-df2639d4da4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:41.864648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-185013b0-faec-4430-b776-df2639d4da4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:41.866618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-185013b0-faec-4430-b776-df2639d4da4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:42.098632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-185013b0-faec-4430-b776-df2639d4da4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:42.112097 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-185013b0-faec-4430-b776-df2639d4da4a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1314 microversion: 2.1 time: 0.262270 Oct 18 13:18:42.113532 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 367/711] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:41 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:42.133671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d92b1b9-2a12-40be-9ce9-ef606039738d tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:42.134753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d92b1b9-2a12-40be-9ce9-ef606039738d tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:42.144536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d92b1b9-2a12-40be-9ce9-ef606039738d tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:42.145404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d92b1b9-2a12-40be-9ce9-ef606039738d tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:42.145842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d92b1b9-2a12-40be-9ce9-ef606039738d tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:42.147627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d92b1b9-2a12-40be-9ce9-ef606039738d tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:42.148289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d92b1b9-2a12-40be-9ce9-ef606039738d tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:42.148720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d92b1b9-2a12-40be-9ce9-ef606039738d tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:42.181218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d92b1b9-2a12-40be-9ce9-ef606039738d tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:18:42.242494 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b18cbeab-5e26-4d52-b314-2363baa871df tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/592ad8d1-1dfe-49cf-9091-a90be1a1ad2d" status: 202 len: 0 microversion: 2.1 time: 2.291654 Oct 18 13:18:42.244428 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 345/712] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:18:39 2022] DELETE /compute/v2.1/os-floating-ips/592ad8d1-1dfe-49cf-9091-a90be1a1ad2d => generated 0 bytes in 2294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:18:42.252504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-0d20b8fb-3921-4ed2-adb1-613d1effa7a0 req-d456cd78-ca7e-4643-b054-a03694fd68cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d79b32e-7ca5-426c-86a3-53573c97569d", "name": "network-vif-plugged", "status": "completed", "tag": "a7905246-b174-4f5f-b628-3d969be2fe7f"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:42.271268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0d20b8fb-3921-4ed2-adb1-613d1effa7a0 req-d456cd78-ca7e-4643-b054-a03694fd68cb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:42.272181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0d20b8fb-3921-4ed2-adb1-613d1effa7a0 req-d456cd78-ca7e-4643-b054-a03694fd68cb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:42.272768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0d20b8fb-3921-4ed2-adb1-613d1effa7a0 req-d456cd78-ca7e-4643-b054-a03694fd68cb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:42.299981 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0d20b8fb-3921-4ed2-adb1-613d1effa7a0 req-d456cd78-ca7e-4643-b054-a03694fd68cb service nova] Creating event network-vif-plugged:a7905246-b174-4f5f-b628-3d969be2fe7f for instance 5d79b32e-7ca5-426c-86a3-53573c97569d on n-h1-858384-13 Oct 18 13:18:42.315717 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-0d20b8fb-3921-4ed2-adb1-613d1effa7a0 req-d456cd78-ca7e-4643-b054-a03694fd68cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068637 Oct 18 13:18:42.319194 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 346/713] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:42.326186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bfaafe3e-c3c6-480e-86b9-77e6a4c86e7d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:42.327255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bfaafe3e-c3c6-480e-86b9-77e6a4c86e7d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:42.336610 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d92b1b9-2a12-40be-9ce9-ef606039738d tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 204 len: 0 microversion: 2.1 time: 0.221369 Oct 18 13:18:42.336996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfaafe3e-c3c6-480e-86b9-77e6a4c86e7d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:42.337698 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 368/714] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:18:42 2022] DELETE /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:18:42.338054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfaafe3e-c3c6-480e-86b9-77e6a4c86e7d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:42.338714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfaafe3e-c3c6-480e-86b9-77e6a4c86e7d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:42.339628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfaafe3e-c3c6-480e-86b9-77e6a4c86e7d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:42.340284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfaafe3e-c3c6-480e-86b9-77e6a4c86e7d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:42.340931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfaafe3e-c3c6-480e-86b9-77e6a4c86e7d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:42.345300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed4ca7e2-197d-45fc-b1dc-9028c5abc775 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:42.346023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ed4ca7e2-197d-45fc-b1dc-9028c5abc775 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:42.353989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed4ca7e2-197d-45fc-b1dc-9028c5abc775 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:42.354722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed4ca7e2-197d-45fc-b1dc-9028c5abc775 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:42.355600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed4ca7e2-197d-45fc-b1dc-9028c5abc775 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:42.356319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed4ca7e2-197d-45fc-b1dc-9028c5abc775 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:42.356896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed4ca7e2-197d-45fc-b1dc-9028c5abc775 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:42.357424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed4ca7e2-197d-45fc-b1dc-9028c5abc775 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:42.607932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ed4ca7e2-197d-45fc-b1dc-9028c5abc775 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:42.613019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:42.621863 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ed4ca7e2-197d-45fc-b1dc-9028c5abc775 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1472 microversion: 2.1 time: 0.282445 Oct 18 13:18:42.623701 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 369/715] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:42 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1472 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:42.633053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d080d531-c1ca-4423-883a-8235be2d0e5d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:42.634244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d080d531-c1ca-4423-883a-8235be2d0e5d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:42.644569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d080d531-c1ca-4423-883a-8235be2d0e5d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:42.645463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d080d531-c1ca-4423-883a-8235be2d0e5d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:42.647796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d080d531-c1ca-4423-883a-8235be2d0e5d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:42.649656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d080d531-c1ca-4423-883a-8235be2d0e5d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:42.650208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d080d531-c1ca-4423-883a-8235be2d0e5d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:42.650711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d080d531-c1ca-4423-883a-8235be2d0e5d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:42.698548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d080d531-c1ca-4423-883a-8235be2d0e5d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:18:42.804882 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d080d531-c1ca-4423-883a-8235be2d0e5d tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 204 len: 0 microversion: 2.1 time: 0.179569 Oct 18 13:18:42.805902 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 370/716] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:18:42 2022] DELETE /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:18:42.814190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6e5da4b4-f959-484b-a268-7ab716b3261e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:42.814891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6e5da4b4-f959-484b-a268-7ab716b3261e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:42.823678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e5da4b4-f959-484b-a268-7ab716b3261e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:42.824164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e5da4b4-f959-484b-a268-7ab716b3261e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:42.824612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e5da4b4-f959-484b-a268-7ab716b3261e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:42.825374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e5da4b4-f959-484b-a268-7ab716b3261e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:42.825825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e5da4b4-f959-484b-a268-7ab716b3261e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:42.826241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e5da4b4-f959-484b-a268-7ab716b3261e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.081851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-bfaafe3e-c3c6-480e-86b9-77e6a4c86e7d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid b550c78b-caf6-44ea-a613-978bac95b4fe {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:18:43.133253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6e5da4b4-f959-484b-a268-7ab716b3261e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:43.144469 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6e5da4b4-f959-484b-a268-7ab716b3261e tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1469 microversion: 2.1 time: 0.336725 Oct 18 13:18:43.164311 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 371/717] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:42 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1469 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:43.174711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb627d05-71e4-4921-8c75-0333a770482b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:43.178980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cb627d05-71e4-4921-8c75-0333a770482b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:43.181640 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bfaafe3e-c3c6-480e-86b9-77e6a4c86e7d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 2052 microversion: 2.25 time: 0.861195 Oct 18 13:18:43.182792 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 347/718] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:42 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 2052 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:43.188583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f506dc30-fe3c-4176-b7e1-a325fc4f8307 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:43.189343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f506dc30-fe3c-4176-b7e1-a325fc4f8307 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:43.189857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:43.191325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb627d05-71e4-4921-8c75-0333a770482b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.191835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb627d05-71e4-4921-8c75-0333a770482b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.195487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb627d05-71e4-4921-8c75-0333a770482b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.196218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb627d05-71e4-4921-8c75-0333a770482b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.196706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb627d05-71e4-4921-8c75-0333a770482b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.196828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f506dc30-fe3c-4176-b7e1-a325fc4f8307 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.197335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f506dc30-fe3c-4176-b7e1-a325fc4f8307 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.197941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f506dc30-fe3c-4176-b7e1-a325fc4f8307 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.198796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f506dc30-fe3c-4176-b7e1-a325fc4f8307 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.199429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f506dc30-fe3c-4176-b7e1-a325fc4f8307 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.200034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f506dc30-fe3c-4176-b7e1-a325fc4f8307 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.201100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb627d05-71e4-4921-8c75-0333a770482b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.250448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f506dc30-fe3c-4176-b7e1-a325fc4f8307 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f506dc30-fe3c-4176-b7e1-a325fc4f8307 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Request method failure captured: Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34/diagnostics HTTP/1.1 Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqeSg7eyf0Ndp6P3n_fn2TDCG7TmpjvbUTBVRXqWP950TnADPI5w6v-wdR8QmkNAPoauTdnDWNdD_w1S5QzARFCKKer2rF7dIxN9uN6RKV6-In-G6CSR8wOK_Uq8_UpNZyVbXPpqNwg-TARzki3xyKehTVJJiDvDYhTM4tTwXyO8pbA Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 8a528eb6958a44b7b55e3c1ca5b10ccd Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1875086572 Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:18:43.252376 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:18:43.253796 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a528eb6958a44b7b55e3c1ca5b10ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8a528eb6958a44b7b55e3c1ca5b10ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a528eb6958a44b7b55e3c1ca5b10ccd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8a528eb6958a44b7b55e3c1ca5b10ccd"}]}] Oct 18 13:18:43.253796 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1875086572 Oct 18 13:18:43.253796 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 8a528eb6958a44b7b55e3c1ca5b10ccd Oct 18 13:18:43.253796 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1875086572 Oct 18 13:18:43.253796 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerDiagnosticsNegativeTest-1875086572-project Oct 18 13:18:43.253796 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:18:43.253796 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:18:43.253796 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 52570dac8b2049999a0fb325b26e2be1 Oct 18 13:18:43.253796 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1875086572-project Oct 18 13:18:43.253796 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:18:43.253796 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'server_id': '57f9acd7-30d4-4857-b45a-b7c851330c34'} Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:18:43.254548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:43.256461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f506dc30-fe3c-4176-b7e1-a325fc4f8307 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:43.258738 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f506dc30-fe3c-4176-b7e1-a325fc4f8307 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.069865 Oct 18 13:18:43.258738 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 348/719] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:18:43 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34/diagnostics => generated 117 bytes in 71 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:18:43.261081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-238edadf-df0d-4bd7-b70e-ad3f3972775c tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:43.261946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-238edadf-df0d-4bd7-b70e-ad3f3972775c tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:43.269632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-238edadf-df0d-4bd7-b70e-ad3f3972775c tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.270362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-238edadf-df0d-4bd7-b70e-ad3f3972775c tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.271041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-238edadf-df0d-4bd7-b70e-ad3f3972775c tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.272535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-238edadf-df0d-4bd7-b70e-ad3f3972775c tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.273441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-238edadf-df0d-4bd7-b70e-ad3f3972775c tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.274057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-238edadf-df0d-4bd7-b70e-ad3f3972775c tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.455750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-238edadf-df0d-4bd7-b70e-ad3f3972775c tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:43.459479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cb627d05-71e4-4921-8c75-0333a770482b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:43.465738 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-238edadf-df0d-4bd7-b70e-ad3f3972775c tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1526 microversion: 2.1 time: 0.210031 Oct 18 13:18:43.468700 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cb627d05-71e4-4921-8c75-0333a770482b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1313 microversion: 2.1 time: 0.303070 Oct 18 13:18:43.469864 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 372/720] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:43 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:43.476002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-37922331-be01-4bfa-95cb-a9d418e5a806 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:43.476801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-37922331-be01-4bfa-95cb-a9d418e5a806 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:43.478184 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 349/721] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:43 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1526 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:43.484273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37922331-be01-4bfa-95cb-a9d418e5a806 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.484273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37922331-be01-4bfa-95cb-a9d418e5a806 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.484542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37922331-be01-4bfa-95cb-a9d418e5a806 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.485188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37922331-be01-4bfa-95cb-a9d418e5a806 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.485654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37922331-be01-4bfa-95cb-a9d418e5a806 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.486067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37922331-be01-4bfa-95cb-a9d418e5a806 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.491623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-024db87b-133c-4b18-8494-0084885489d5 req-7ed1a60d-3382-4b29-807a-cf7f0486a5cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfe50041-e476-443d-b56f-db9953efda0a", "tag": "c5b4bcad-3d79-462b-a9c7-ff1906e031e9"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:43.503747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-024db87b-133c-4b18-8494-0084885489d5 req-7ed1a60d-3382-4b29-807a-cf7f0486a5cc service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.504648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-024db87b-133c-4b18-8494-0084885489d5 req-7ed1a60d-3382-4b29-807a-cf7f0486a5cc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.506118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-024db87b-133c-4b18-8494-0084885489d5 req-7ed1a60d-3382-4b29-807a-cf7f0486a5cc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.520292 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-024db87b-133c-4b18-8494-0084885489d5 req-7ed1a60d-3382-4b29-807a-cf7f0486a5cc service nova] Creating event network-changed:c5b4bcad-3d79-462b-a9c7-ff1906e031e9 for instance bfe50041-e476-443d-b56f-db9953efda0a on n-h1-858384-13 Oct 18 13:18:43.526499 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-024db87b-133c-4b18-8494-0084885489d5 req-7ed1a60d-3382-4b29-807a-cf7f0486a5cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039770 Oct 18 13:18:43.527101 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 350/722] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:43.532530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a487876c-d0e0-42a2-89fd-a3944d40ef43 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:43.538283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a487876c-d0e0-42a2-89fd-a3944d40ef43 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:43.554153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a487876c-d0e0-42a2-89fd-a3944d40ef43 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.554655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a487876c-d0e0-42a2-89fd-a3944d40ef43 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.555102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a487876c-d0e0-42a2-89fd-a3944d40ef43 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.555842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a487876c-d0e0-42a2-89fd-a3944d40ef43 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.556334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a487876c-d0e0-42a2-89fd-a3944d40ef43 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.556766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a487876c-d0e0-42a2-89fd-a3944d40ef43 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.674196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-37922331-be01-4bfa-95cb-a9d418e5a806 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:43.684632 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-37922331-be01-4bfa-95cb-a9d418e5a806 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 200 len: 1588 microversion: 2.1 time: 0.213627 Oct 18 13:18:43.702025 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 373/723] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:43 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 1588 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:43.702025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f7452806-00c6-4021-b7bc-91e2160d5fc5 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:43.702025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7452806-00c6-4021-b7bc-91e2160d5fc5 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.702025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7452806-00c6-4021-b7bc-91e2160d5fc5 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.702492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7452806-00c6-4021-b7bc-91e2160d5fc5 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.702492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7452806-00c6-4021-b7bc-91e2160d5fc5 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.702492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7452806-00c6-4021-b7bc-91e2160d5fc5 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.702492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7452806-00c6-4021-b7bc-91e2160d5fc5 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.732686 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f7452806-00c6-4021-b7bc-91e2160d5fc5 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.045601 Oct 18 13:18:43.742947 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 374/724] 10.222.0.40 () {60 vars in 1217 bytes} [Tue Oct 18 13:18:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:18:43.747890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-797a4ec9-7308-412a-a7ec-d1640c89f942 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:43.748460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-797a4ec9-7308-412a-a7ec-d1640c89f942 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:43.759502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-797a4ec9-7308-412a-a7ec-d1640c89f942 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.761062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-797a4ec9-7308-412a-a7ec-d1640c89f942 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.761786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-797a4ec9-7308-412a-a7ec-d1640c89f942 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.764515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-797a4ec9-7308-412a-a7ec-d1640c89f942 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.767835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-797a4ec9-7308-412a-a7ec-d1640c89f942 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.768991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-797a4ec9-7308-412a-a7ec-d1640c89f942 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.807830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-797a4ec9-7308-412a-a7ec-d1640c89f942 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:18:43.825963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a487876c-d0e0-42a2-89fd-a3944d40ef43 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:43.838587 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a487876c-d0e0-42a2-89fd-a3944d40ef43 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1314 microversion: 2.1 time: 0.309794 Oct 18 13:18:43.839655 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 351/725] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:43 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:43.860817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-59797cb5-d5cc-46ba-8a53-f055e0d2aa79 req-23a33196-7a40-4962-b798-70aa0f62b6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37793c0c-d885-4fd3-8e4f-9d051dd8026c", "tag": "dbfe8182-9968-4cde-bd63-b3073fc6f861"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:43.870932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-59797cb5-d5cc-46ba-8a53-f055e0d2aa79 req-23a33196-7a40-4962-b798-70aa0f62b6b0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.871458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-59797cb5-d5cc-46ba-8a53-f055e0d2aa79 req-23a33196-7a40-4962-b798-70aa0f62b6b0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.871928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-59797cb5-d5cc-46ba-8a53-f055e0d2aa79 req-23a33196-7a40-4962-b798-70aa0f62b6b0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.886156 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-59797cb5-d5cc-46ba-8a53-f055e0d2aa79 req-23a33196-7a40-4962-b798-70aa0f62b6b0 service nova] Creating event network-changed:dbfe8182-9968-4cde-bd63-b3073fc6f861 for instance 37793c0c-d885-4fd3-8e4f-9d051dd8026c on n-h2-858384-13 Oct 18 13:18:43.905817 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-59797cb5-d5cc-46ba-8a53-f055e0d2aa79 req-23a33196-7a40-4962-b798-70aa0f62b6b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063772 Oct 18 13:18:43.906435 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 352/726] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:43.914362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af01d38f-e432-4274-8251-35ee530a1979 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:43.915260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-af01d38f-e432-4274-8251-35ee530a1979 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:43.923456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af01d38f-e432-4274-8251-35ee530a1979 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.924136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af01d38f-e432-4274-8251-35ee530a1979 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.925001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af01d38f-e432-4274-8251-35ee530a1979 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.926051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af01d38f-e432-4274-8251-35ee530a1979 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.926705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af01d38f-e432-4274-8251-35ee530a1979 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.927438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af01d38f-e432-4274-8251-35ee530a1979 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.932527 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-797a4ec9-7308-412a-a7ec-d1640c89f942 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "DELETE /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 204 len: 0 microversion: 2.1 time: 0.188138 Oct 18 13:18:43.933471 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 375/727] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:18:43 2022] DELETE /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:18:43.949692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fce3f911-25b5-4e0b-8d52-4f0259bb6d2d tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:43.950396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fce3f911-25b5-4e0b-8d52-4f0259bb6d2d tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:43.957012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce3f911-25b5-4e0b-8d52-4f0259bb6d2d tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.958220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce3f911-25b5-4e0b-8d52-4f0259bb6d2d tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.958874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce3f911-25b5-4e0b-8d52-4f0259bb6d2d tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:43.960466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce3f911-25b5-4e0b-8d52-4f0259bb6d2d tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:43.960956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce3f911-25b5-4e0b-8d52-4f0259bb6d2d tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:43.961384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce3f911-25b5-4e0b-8d52-4f0259bb6d2d tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.020786 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-af01d38f-e432-4274-8251-35ee530a1979 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe/action" status: 202 len: 0 microversion: 2.25 time: 0.112775 Oct 18 13:18:44.022327 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 353/728] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:18:43 2022] POST /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:18:44.035490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-708e05af-e16d-4595-b264-292c4cfcc78a tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:44.036759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-708e05af-e16d-4595-b264-292c4cfcc78a tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:44.046005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:44.048586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-708e05af-e16d-4595-b264-292c4cfcc78a tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.049151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-708e05af-e16d-4595-b264-292c4cfcc78a tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.050079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-708e05af-e16d-4595-b264-292c4cfcc78a tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.050863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-708e05af-e16d-4595-b264-292c4cfcc78a tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.051381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-708e05af-e16d-4595-b264-292c4cfcc78a tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.051869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-708e05af-e16d-4595-b264-292c4cfcc78a tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.163104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fce3f911-25b5-4e0b-8d52-4f0259bb6d2d tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:44.171698 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fce3f911-25b5-4e0b-8d52-4f0259bb6d2d tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1478 microversion: 2.1 time: 0.226189 Oct 18 13:18:44.189499 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 376/729] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:43 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1478 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:44.195105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-69086382-010f-4fbf-b1e7-0d996f60dcb9 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:44.197301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-69086382-010f-4fbf-b1e7-0d996f60dcb9 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:44.205701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69086382-010f-4fbf-b1e7-0d996f60dcb9 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.206707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69086382-010f-4fbf-b1e7-0d996f60dcb9 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.207134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69086382-010f-4fbf-b1e7-0d996f60dcb9 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.207842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69086382-010f-4fbf-b1e7-0d996f60dcb9 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.208402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69086382-010f-4fbf-b1e7-0d996f60dcb9 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.208706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69086382-010f-4fbf-b1e7-0d996f60dcb9 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.242089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:44.248423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-708e05af-e16d-4595-b264-292c4cfcc78a tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid b550c78b-caf6-44ea-a613-978bac95b4fe {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:18:44.266187 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-708e05af-e16d-4595-b264-292c4cfcc78a tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 2057 microversion: 2.25 time: 0.235769 Oct 18 13:18:44.281499 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 354/730] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:44 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 2057 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:44.357131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-69086382-010f-4fbf-b1e7-0d996f60dcb9 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:44.367359 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-69086382-010f-4fbf-b1e7-0d996f60dcb9 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1469 microversion: 2.1 time: 0.179819 Oct 18 13:18:44.368746 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 377/731] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:44 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:44.492832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-18db5bd5-d3ad-40b2-940c-f52efad2fd96 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:44.494270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-18db5bd5-d3ad-40b2-940c-f52efad2fd96 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:44.501263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18db5bd5-d3ad-40b2-940c-f52efad2fd96 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.501735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18db5bd5-d3ad-40b2-940c-f52efad2fd96 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.502172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18db5bd5-d3ad-40b2-940c-f52efad2fd96 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.503080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18db5bd5-d3ad-40b2-940c-f52efad2fd96 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.503704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18db5bd5-d3ad-40b2-940c-f52efad2fd96 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.504194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18db5bd5-d3ad-40b2-940c-f52efad2fd96 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.515151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a6ec505-9c5e-42c6-850d-c0a46e403f3f tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Action: 'update', calling method: .version_select at 0x7ff60feeb8b0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:44.518766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a6ec505-9c5e-42c6-850d-c0a46e403f3f tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.519247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a6ec505-9c5e-42c6-850d-c0a46e403f3f tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.519678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a6ec505-9c5e-42c6-850d-c0a46e403f3f tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.542965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a6ec505-9c5e-42c6-850d-c0a46e403f3f tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.545582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a6ec505-9c5e-42c6-850d-c0a46e403f3f tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.546025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a6ec505-9c5e-42c6-850d-c0a46e403f3f tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.566096 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-4a6ec505-9c5e-42c6-850d-c0a46e403f3f tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] HTTP exception thrown: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a6ec505-9c5e-42c6-850d-c0a46e403f3f tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Request method failure captured: Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: request: PUT /compute/v2.1/os-services/85d6120a-a913-455a-9db3-f80a297740b3 HTTP/1.1 Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 56 Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqe07Js4zaCQyO7vPq4Zdr0_Yld2AASn4Nvm5Hrcr63OewCT2bYWy-Ih9AABDV5xYqANlcD7JiFRd8JTa01SsAKyzckeFiydxFRCRWUJSH9cywSQIRxXYPbK87nKLvcEBhUL4hTvxkLlqEeUG_eIgUqk8u2EU7BwiaYsKTlMa0OxF0c Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 9e35c038d781439bbc365d9c272ff6c8 Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-603705559 Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 13:18:44.571302 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 13:18:44.572894 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9e35c038d781439bbc365d9c272ff6c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9e35c038d781439bbc365d9c272ff6c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9e35c038d781439bbc365d9c272ff6c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9e35c038d781439bbc365d9c272ff6c8"}]}] Oct 18 13:18:44.572894 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-603705559 Oct 18 13:18:44.572894 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 9e35c038d781439bbc365d9c272ff6c8 Oct 18 13:18:44.572894 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-603705559 Oct 18 13:18:44.572894 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin Oct 18 13:18:44.572894 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:18:44.572894 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:18:44.572894 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 31269eb718464fa686163415eb5957b6 Oct 18 13:18:44.572894 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin Oct 18 13:18:44.572894 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:18:44.572894 n-d-858384-13 devstack@n-api.service[120612]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 18 13:18:44.572894 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:18:44.572894 n-d-858384-13 devstack@n-api.service[120612]: exception: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '85d6120a-a913-455a-9db3-f80a297740b3', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.573810 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:44.575079 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:44.576268 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:44.576268 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.576268 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.579160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a6ec505-9c5e-42c6-850d-c0a46e403f3f tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Returning 404 to user: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:44.580058 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4a6ec505-9c5e-42c6-850d-c0a46e403f3f tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/85d6120a-a913-455a-9db3-f80a297740b3" status: 404 len: 110 microversion: 2.53 time: 0.193225 Oct 18 13:18:44.580948 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 355/732] 10.222.0.40 () {62 vars in 1309 bytes} [Tue Oct 18 13:18:44 2022] PUT /compute/v2.1/os-services/85d6120a-a913-455a-9db3-f80a297740b3 => generated 110 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:18:44.586451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dddab90d-bdc7-4acc-84d8-47e8dea37859 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:44.589369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dddab90d-bdc7-4acc-84d8-47e8dea37859 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:44.596222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dddab90d-bdc7-4acc-84d8-47e8dea37859 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.596863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dddab90d-bdc7-4acc-84d8-47e8dea37859 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.597460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dddab90d-bdc7-4acc-84d8-47e8dea37859 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.598142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dddab90d-bdc7-4acc-84d8-47e8dea37859 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.600606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dddab90d-bdc7-4acc-84d8-47e8dea37859 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.600945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dddab90d-bdc7-4acc-84d8-47e8dea37859 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.705930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-18db5bd5-d3ad-40b2-940c-f52efad2fd96 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:44.713930 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-18db5bd5-d3ad-40b2-940c-f52efad2fd96 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1526 microversion: 2.1 time: 0.225924 Oct 18 13:18:44.714506 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 378/733] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:44 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1526 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:44.718915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-acafeb42-075a-4067-813e-ab8d19c811c0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Action: 'update', calling method: .version_select at 0x7ff60fdb25e0>, body: {"status": "disabled"} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:44.722516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acafeb42-075a-4067-813e-ab8d19c811c0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.722991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acafeb42-075a-4067-813e-ab8d19c811c0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.723424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acafeb42-075a-4067-813e-ab8d19c811c0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.731966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acafeb42-075a-4067-813e-ab8d19c811c0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.732447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acafeb42-075a-4067-813e-ab8d19c811c0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.732876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acafeb42-075a-4067-813e-ab8d19c811c0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.736571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dddab90d-bdc7-4acc-84d8-47e8dea37859 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:44.739309 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-acafeb42-075a-4067-813e-ab8d19c811c0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] HTTP exception thrown: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-acafeb42-075a-4067-813e-ab8d19c811c0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Request method failure captured: Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: request: PUT /compute/v2.1/os-services/85d6120a-a913-455a-9db3-f80a297740b3 HTTP/1.1 Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 22 Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqe07Js4zaCQyO7vPq4Zdr0_Yld2AASn4Nvm5Hrcr63OewCT2bYWy-Ih9AABDV5xYqANlcD7JiFRd8JTa01SsAKyzckeFiydxFRCRWUJSH9cywSQIRxXYPbK87nKLvcEBhUL4hTvxkLlqEeUG_eIgUqk8u2EU7BwiaYsKTlMa0OxF0c Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 9e35c038d781439bbc365d9c272ff6c8 Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-603705559 Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:18:44.742072 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9e35c038d781439bbc365d9c272ff6c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9e35c038d781439bbc365d9c272ff6c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9e35c038d781439bbc365d9c272ff6c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9e35c038d781439bbc365d9c272ff6c8"}]}] Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-603705559 Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 9e35c038d781439bbc365d9c272ff6c8 Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-603705559 Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 31269eb718464fa686163415eb5957b6 Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: {"status": "disabled"} Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: exception: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.743639 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '85d6120a-a913-455a-9db3-f80a297740b3', 'body': {'status': 'disabled'}} Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:44.744595 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:44.745865 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:44.747015 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.747015 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.747015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-acafeb42-075a-4067-813e-ab8d19c811c0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Returning 404 to user: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:44.747015 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-acafeb42-075a-4067-813e-ab8d19c811c0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/85d6120a-a913-455a-9db3-f80a297740b3" status: 404 len: 110 microversion: 2.53 time: 0.028040 Oct 18 13:18:44.747015 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 379/734] 10.222.0.40 () {62 vars in 1309 bytes} [Tue Oct 18 13:18:44 2022] PUT /compute/v2.1/os-services/85d6120a-a913-455a-9db3-f80a297740b3 => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:18:44.747378 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dddab90d-bdc7-4acc-84d8-47e8dea37859 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1313 microversion: 2.1 time: 0.163945 Oct 18 13:18:44.747463 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 356/735] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:44 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:44.755753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-25cd51d9-a012-465a-8d55-8dfbb6a17e75 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Action: 'update', calling method: .version_select at 0x7ff60ff05ca0>, body: {"status": "enabled"} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:44.759402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25cd51d9-a012-465a-8d55-8dfbb6a17e75 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.759880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25cd51d9-a012-465a-8d55-8dfbb6a17e75 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.760378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25cd51d9-a012-465a-8d55-8dfbb6a17e75 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.765900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25cd51d9-a012-465a-8d55-8dfbb6a17e75 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.766365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25cd51d9-a012-465a-8d55-8dfbb6a17e75 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.766797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25cd51d9-a012-465a-8d55-8dfbb6a17e75 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.771661 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-25cd51d9-a012-465a-8d55-8dfbb6a17e75 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] HTTP exception thrown: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-25cd51d9-a012-465a-8d55-8dfbb6a17e75 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Request method failure captured: Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: request: PUT /compute/v2.1/os-services/85d6120a-a913-455a-9db3-f80a297740b3 HTTP/1.1 Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 21 Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqe07Js4zaCQyO7vPq4Zdr0_Yld2AASn4Nvm5Hrcr63OewCT2bYWy-Ih9AABDV5xYqANlcD7JiFRd8JTa01SsAKyzckeFiydxFRCRWUJSH9cywSQIRxXYPbK87nKLvcEBhUL4hTvxkLlqEeUG_eIgUqk8u2EU7BwiaYsKTlMa0OxF0c Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 9e35c038d781439bbc365d9c272ff6c8 Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-603705559 Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:18:44.773287 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9e35c038d781439bbc365d9c272ff6c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9e35c038d781439bbc365d9c272ff6c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9e35c038d781439bbc365d9c272ff6c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9e35c038d781439bbc365d9c272ff6c8"}]}] Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-603705559 Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 9e35c038d781439bbc365d9c272ff6c8 Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-603705559 Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 31269eb718464fa686163415eb5957b6 Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: {"status": "enabled"} Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: exception: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.774864 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '85d6120a-a913-455a-9db3-f80a297740b3', 'body': {'status': 'enabled'}} Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:44.775860 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:44.777318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:44.778684 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. Oct 18 13:18:44.778684 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:44.778684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-25cd51d9-a012-465a-8d55-8dfbb6a17e75 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Returning 404 to user: Service 85d6120a-a913-455a-9db3-f80a297740b3 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:44.778684 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-25cd51d9-a012-465a-8d55-8dfbb6a17e75 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/85d6120a-a913-455a-9db3-f80a297740b3" status: 404 len: 110 microversion: 2.53 time: 0.024917 Oct 18 13:18:44.778684 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 380/736] 10.222.0.40 () {62 vars in 1309 bytes} [Tue Oct 18 13:18:44 2022] PUT /compute/v2.1/os-services/85d6120a-a913-455a-9db3-f80a297740b3 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:18:44.783783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-47c40bcb-b409-42d9-a735-ee8833633dd0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:44.788270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47c40bcb-b409-42d9-a735-ee8833633dd0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.788755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47c40bcb-b409-42d9-a735-ee8833633dd0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.789236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47c40bcb-b409-42d9-a735-ee8833633dd0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.789960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47c40bcb-b409-42d9-a735-ee8833633dd0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.790411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47c40bcb-b409-42d9-a735-ee8833633dd0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.790829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47c40bcb-b409-42d9-a735-ee8833633dd0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.816869 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-47c40bcb-b409-42d9-a735-ee8833633dd0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.036599 Oct 18 13:18:44.817408 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 357/737] 10.222.0.40 () {60 vars in 1178 bytes} [Tue Oct 18 13:18:44 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:44.830532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7d5f2f42-4edb-448e-a57a-c8e3faf319d1 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:44.834806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d5f2f42-4edb-448e-a57a-c8e3faf319d1 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.835302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d5f2f42-4edb-448e-a57a-c8e3faf319d1 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.835813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d5f2f42-4edb-448e-a57a-c8e3faf319d1 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.836600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d5f2f42-4edb-448e-a57a-c8e3faf319d1 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.837071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d5f2f42-4edb-448e-a57a-c8e3faf319d1 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.837569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d5f2f42-4edb-448e-a57a-c8e3faf319d1 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.865624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-526f646b-5120-4605-8a8e-2f5c0404357d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:44.866396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-526f646b-5120-4605-8a8e-2f5c0404357d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:44.873552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-526f646b-5120-4605-8a8e-2f5c0404357d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.874141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-526f646b-5120-4605-8a8e-2f5c0404357d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.874643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-526f646b-5120-4605-8a8e-2f5c0404357d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:44.875424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-526f646b-5120-4605-8a8e-2f5c0404357d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:44.875944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-526f646b-5120-4605-8a8e-2f5c0404357d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:44.876439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-526f646b-5120-4605-8a8e-2f5c0404357d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.096864 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7d5f2f42-4edb-448e-a57a-c8e3faf319d1 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.267397 Oct 18 13:18:45.097908 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 381/738] 10.222.0.40 () {60 vars in 1211 bytes} [Tue Oct 18 13:18:44 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:18:45.110799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-591b595f-3132-4f6a-b079-f5389a121d84 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:45.114310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-591b595f-3132-4f6a-b079-f5389a121d84 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.114800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-591b595f-3132-4f6a-b079-f5389a121d84 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.115758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-591b595f-3132-4f6a-b079-f5389a121d84 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.116490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-591b595f-3132-4f6a-b079-f5389a121d84 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.116948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-591b595f-3132-4f6a-b079-f5389a121d84 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.117407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-591b595f-3132-4f6a-b079-f5389a121d84 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.143732 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-591b595f-3132-4f6a-b079-f5389a121d84 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.036551 Oct 18 13:18:45.144345 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 382/739] 10.222.0.40 () {60 vars in 1178 bytes} [Tue Oct 18 13:18:45 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:18:45.159129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2e59923c-afe6-44e1-b46a-cc81933e7a66 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:45.163929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e59923c-afe6-44e1-b46a-cc81933e7a66 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.164833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e59923c-afe6-44e1-b46a-cc81933e7a66 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.165809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e59923c-afe6-44e1-b46a-cc81933e7a66 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.166911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e59923c-afe6-44e1-b46a-cc81933e7a66 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.167630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e59923c-afe6-44e1-b46a-cc81933e7a66 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.168174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e59923c-afe6-44e1-b46a-cc81933e7a66 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.181880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-526f646b-5120-4605-8a8e-2f5c0404357d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:45.191473 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-526f646b-5120-4605-8a8e-2f5c0404357d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1314 microversion: 2.1 time: 0.331098 Oct 18 13:18:45.206218 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2e59923c-afe6-44e1-b46a-cc81933e7a66 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=n-d-858384-13&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.039851 Oct 18 13:18:45.206218 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 383/740] 10.222.0.40 () {60 vars in 1237 bytes} [Tue Oct 18 13:18:45 2022] GET /compute/v2.1/os-services?host=n-d-858384-13&binary=xxx => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:45.209142 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 358/741] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:44 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:45.217781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d2e4896f-9d8d-4bcf-a335-91c972db651a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:45.218974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d2e4896f-9d8d-4bcf-a335-91c972db651a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:45.223238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-21b63756-13b4-4f2c-b35e-36687d2df7d0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:45.230164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21b63756-13b4-4f2c-b35e-36687d2df7d0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.232726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2e4896f-9d8d-4bcf-a335-91c972db651a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.233459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21b63756-13b4-4f2c-b35e-36687d2df7d0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.233914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21b63756-13b4-4f2c-b35e-36687d2df7d0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.234690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21b63756-13b4-4f2c-b35e-36687d2df7d0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.235436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2e4896f-9d8d-4bcf-a335-91c972db651a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.235707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21b63756-13b4-4f2c-b35e-36687d2df7d0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.236142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21b63756-13b4-4f2c-b35e-36687d2df7d0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.238415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2e4896f-9d8d-4bcf-a335-91c972db651a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.239368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2e4896f-9d8d-4bcf-a335-91c972db651a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.239840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2e4896f-9d8d-4bcf-a335-91c972db651a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.243519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2e4896f-9d8d-4bcf-a335-91c972db651a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.275488 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-21b63756-13b4-4f2c-b35e-36687d2df7d0 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.064768 Oct 18 13:18:45.276381 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 359/742] 10.222.0.40 () {60 vars in 1178 bytes} [Tue Oct 18 13:18:45 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:45.288688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-95bf7535-3131-4035-985b-88e813c42e73 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:45.292661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95bf7535-3131-4035-985b-88e813c42e73 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.293140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95bf7535-3131-4035-985b-88e813c42e73 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.293592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95bf7535-3131-4035-985b-88e813c42e73 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.294311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95bf7535-3131-4035-985b-88e813c42e73 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.294755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95bf7535-3131-4035-985b-88e813c42e73 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.295170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95bf7535-3131-4035-985b-88e813c42e73 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.320752 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-95bf7535-3131-4035-985b-88e813c42e73 tempest-ServicesAdminNegativeV253TestJSON-603705559 tempest-ServicesAdminNegativeV253TestJSON-603705559-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.036186 Oct 18 13:18:45.321683 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 360/743] 10.222.0.40 () {60 vars in 1239 bytes} [Tue Oct 18 13:18:45 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:45.332988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6244aa6a-af14-4dcb-9fa8-7e561e8fad8f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:45.333617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6244aa6a-af14-4dcb-9fa8-7e561e8fad8f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:45.339549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6244aa6a-af14-4dcb-9fa8-7e561e8fad8f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.340201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6244aa6a-af14-4dcb-9fa8-7e561e8fad8f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.340663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6244aa6a-af14-4dcb-9fa8-7e561e8fad8f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.341803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6244aa6a-af14-4dcb-9fa8-7e561e8fad8f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.342249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6244aa6a-af14-4dcb-9fa8-7e561e8fad8f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.342665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6244aa6a-af14-4dcb-9fa8-7e561e8fad8f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.468648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d2e4896f-9d8d-4bcf-a335-91c972db651a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:45.483568 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d2e4896f-9d8d-4bcf-a335-91c972db651a tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1478 microversion: 2.1 time: 0.286157 Oct 18 13:18:45.484269 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 384/744] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:45 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1478 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:45.499533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-6244aa6a-af14-4dcb-9fa8-7e561e8fad8f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid b550c78b-caf6-44ea-a613-978bac95b4fe {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:18:45.514897 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6244aa6a-af14-4dcb-9fa8-7e561e8fad8f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 2037 microversion: 2.25 time: 0.185261 Oct 18 13:18:45.516994 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 361/745] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:45 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 2037 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:45.520870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e29e063-a640-4ead-ae51-e14ef0fd652b tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:45.522474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1e29e063-a640-4ead-ae51-e14ef0fd652b tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:45.529556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e29e063-a640-4ead-ae51-e14ef0fd652b tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.530341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e29e063-a640-4ead-ae51-e14ef0fd652b tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.530999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e29e063-a640-4ead-ae51-e14ef0fd652b tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.531917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e29e063-a640-4ead-ae51-e14ef0fd652b tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.532668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e29e063-a640-4ead-ae51-e14ef0fd652b tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.533336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e29e063-a640-4ead-ae51-e14ef0fd652b tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.622967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ec44fcf0-a7de-45a1-8747-71a9c82c3369 tempest-ServicesAdminNegativeV253TestJSON-1186980167 tempest-ServicesAdminNegativeV253TestJSON-1186980167-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:45.626784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ec44fcf0-a7de-45a1-8747-71a9c82c3369 tempest-ServicesAdminNegativeV253TestJSON-1186980167 tempest-ServicesAdminNegativeV253TestJSON-1186980167-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'bce55e676359470bb4f2509168fb61f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665ab7ed6468479f9424f00a4029c165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ec44fcf0-a7de-45a1-8747-71a9c82c3369 tempest-ServicesAdminNegativeV253TestJSON-1186980167 tempest-ServicesAdminNegativeV253TestJSON-1186980167-project] Request method failure captured: Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqez2_Ugh7HYirrLX3ck5RcqDxb_UO3BD5f-80uJcszXB_LIUfOjlUWoyPr7NlH8uu0QkXPHcYWDDWwuVA2endLnnm_wlzls2ayZ2l5b6tmXgjCcZ5w2QOon5anz5C2h52L4n-o_FFUXAS56GLrsOK1ST3hLHZvXWamur0VL90rzMSo Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.53 Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 665ab7ed6468479f9424f00a4029c165 Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1186980167 Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:18:45.628379 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:18:45.629865 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/665ab7ed6468479f9424f00a4029c165"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/665ab7ed6468479f9424f00a4029c165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/665ab7ed6468479f9424f00a4029c165"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_665ab7ed6468479f9424f00a4029c165"}]}] Oct 18 13:18:45.629865 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1186980167 Oct 18 13:18:45.629865 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 665ab7ed6468479f9424f00a4029c165 Oct 18 13:18:45.629865 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1186980167 Oct 18 13:18:45.629865 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1186980167-project Oct 18 13:18:45.629865 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:45.629865 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:45.629865 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: bce55e676359470bb4f2509168fb61f6 Oct 18 13:18:45.629865 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1186980167-project Oct 18 13:18:45.629865 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:18:45.629865 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 13:18:45.629865 n-d-858384-13 devstack@n-api.service[120611]: action_args: {} Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:18:45.631238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 13:18:45.632497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:45.633699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ec44fcf0-a7de-45a1-8747-71a9c82c3369 tempest-ServicesAdminNegativeV253TestJSON-1186980167 tempest-ServicesAdminNegativeV253TestJSON-1186980167-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:45.633699 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ec44fcf0-a7de-45a1-8747-71a9c82c3369 tempest-ServicesAdminNegativeV253TestJSON-1186980167 tempest-ServicesAdminNegativeV253TestJSON-1186980167-project] 10.222.0.40 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.143352 Oct 18 13:18:45.633699 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 385/746] 10.222.0.40 () {60 vars in 1178 bytes} [Tue Oct 18 13:18:45 2022] GET /compute/v2.1/os-services => generated 112 bytes in 146 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:18:45.636561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c6bdd37-a9df-4f49-b084-cec23cf76271 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-13", "block_migration": "auto"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:45.639165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2c6bdd37-a9df-4f49-b084-cec23cf76271 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:45.647802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c6bdd37-a9df-4f49-b084-cec23cf76271 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.648293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c6bdd37-a9df-4f49-b084-cec23cf76271 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.648733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c6bdd37-a9df-4f49-b084-cec23cf76271 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.649479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c6bdd37-a9df-4f49-b084-cec23cf76271 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.650012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c6bdd37-a9df-4f49-b084-cec23cf76271 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.650455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c6bdd37-a9df-4f49-b084-cec23cf76271 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.676835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-2c6bdd37-a9df-4f49-b084-cec23cf76271 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'flavor' on Instance uuid b550c78b-caf6-44ea-a613-978bac95b4fe {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:18:45.696622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2c6bdd37-a9df-4f49-b084-cec23cf76271 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Going to try to live migrate instance to n-h1-858384-13 {{(pid=120611) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:18:45.711291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1e29e063-a640-4ead-ae51-e14ef0fd652b tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:45.720301 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1e29e063-a640-4ead-ae51-e14ef0fd652b tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1469 microversion: 2.1 time: 0.203345 Oct 18 13:18:45.721445 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 362/747] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:45 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1469 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:45.744305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31a34840-7bfb-4af2-a627-a69fa3d3b902 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:45.745355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-31a34840-7bfb-4af2-a627-a69fa3d3b902 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:45.752926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31a34840-7bfb-4af2-a627-a69fa3d3b902 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.753760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31a34840-7bfb-4af2-a627-a69fa3d3b902 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.754533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31a34840-7bfb-4af2-a627-a69fa3d3b902 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.756232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31a34840-7bfb-4af2-a627-a69fa3d3b902 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.757085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31a34840-7bfb-4af2-a627-a69fa3d3b902 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.757754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:45.758226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31a34840-7bfb-4af2-a627-a69fa3d3b902 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.933142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31a34840-7bfb-4af2-a627-a69fa3d3b902 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:45.941537 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31a34840-7bfb-4af2-a627-a69fa3d3b902 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1526 microversion: 2.1 time: 0.207337 Oct 18 13:18:45.942114 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 363/748] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:45 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1526 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:45.964840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6bf4b729-2689-4323-baa4-cfde56d08456 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:45.965487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6bf4b729-2689-4323-baa4-cfde56d08456 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:45.973428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bf4b729-2689-4323-baa4-cfde56d08456 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.974295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bf4b729-2689-4323-baa4-cfde56d08456 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.975518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bf4b729-2689-4323-baa4-cfde56d08456 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:45.976375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bf4b729-2689-4323-baa4-cfde56d08456 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:45.976840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bf4b729-2689-4323-baa4-cfde56d08456 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:45.977538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bf4b729-2689-4323-baa4-cfde56d08456 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:46.154641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6bf4b729-2689-4323-baa4-cfde56d08456 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:46.163163 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6bf4b729-2689-4323-baa4-cfde56d08456 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1313 microversion: 2.1 time: 0.203959 Oct 18 13:18:46.164191 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 364/749] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:45 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:46.223883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4ca13cbc-f15c-400b-83eb-8cd5000b8156 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:46.226246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4ca13cbc-f15c-400b-83eb-8cd5000b8156 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:46.232307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ca13cbc-f15c-400b-83eb-8cd5000b8156 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:46.232792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ca13cbc-f15c-400b-83eb-8cd5000b8156 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:46.233245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ca13cbc-f15c-400b-83eb-8cd5000b8156 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:46.233943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ca13cbc-f15c-400b-83eb-8cd5000b8156 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:46.234390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ca13cbc-f15c-400b-83eb-8cd5000b8156 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:46.234912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ca13cbc-f15c-400b-83eb-8cd5000b8156 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:46.393954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4ca13cbc-f15c-400b-83eb-8cd5000b8156 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:46.403862 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4ca13cbc-f15c-400b-83eb-8cd5000b8156 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1314 microversion: 2.1 time: 0.185080 Oct 18 13:18:46.417622 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 365/750] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:46 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:46.509503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4f95f880-241f-4232-b405-730ed6838287 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:46.510669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4f95f880-241f-4232-b405-730ed6838287 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:46.517896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f95f880-241f-4232-b405-730ed6838287 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:46.519023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f95f880-241f-4232-b405-730ed6838287 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:46.519842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f95f880-241f-4232-b405-730ed6838287 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:46.521773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f95f880-241f-4232-b405-730ed6838287 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:46.522508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f95f880-241f-4232-b405-730ed6838287 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:46.523131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f95f880-241f-4232-b405-730ed6838287 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:46.727263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4f95f880-241f-4232-b405-730ed6838287 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:46.735795 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4f95f880-241f-4232-b405-730ed6838287 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1478 microversion: 2.1 time: 0.232176 Oct 18 13:18:46.736696 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 366/751] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:46 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1478 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:46.751211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8f302a6a-d989-4a31-a6c9-a744da0318de tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:46.751819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8f302a6a-d989-4a31-a6c9-a744da0318de tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:46.758533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f302a6a-d989-4a31-a6c9-a744da0318de tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:46.759057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f302a6a-d989-4a31-a6c9-a744da0318de tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:46.759640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f302a6a-d989-4a31-a6c9-a744da0318de tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:46.760334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f302a6a-d989-4a31-a6c9-a744da0318de tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:46.760876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f302a6a-d989-4a31-a6c9-a744da0318de tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:46.761404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f302a6a-d989-4a31-a6c9-a744da0318de tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:46.900264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8f302a6a-d989-4a31-a6c9-a744da0318de tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:46.908009 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8f302a6a-d989-4a31-a6c9-a744da0318de tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1469 microversion: 2.1 time: 0.165556 Oct 18 13:18:46.908725 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 367/752] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:46 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:46.970696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-53114e9a-552b-4f86-94bf-cdf85b4fc5dd tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:46.971307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-53114e9a-552b-4f86-94bf-cdf85b4fc5dd tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:46.978092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53114e9a-552b-4f86-94bf-cdf85b4fc5dd tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:46.978578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53114e9a-552b-4f86-94bf-cdf85b4fc5dd tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:46.979033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53114e9a-552b-4f86-94bf-cdf85b4fc5dd tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:46.980140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53114e9a-552b-4f86-94bf-cdf85b4fc5dd tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:46.981247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53114e9a-552b-4f86-94bf-cdf85b4fc5dd tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:46.981673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53114e9a-552b-4f86-94bf-cdf85b4fc5dd tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:47.129390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-53114e9a-552b-4f86-94bf-cdf85b4fc5dd tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:47.138471 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-53114e9a-552b-4f86-94bf-cdf85b4fc5dd tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1526 microversion: 2.1 time: 0.172380 Oct 18 13:18:47.139132 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 368/753] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:46 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1526 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:47.186801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-753b5dc1-29f1-4b97-aca9-0efd10f50a68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:47.187512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-753b5dc1-29f1-4b97-aca9-0efd10f50a68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:47.194304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-753b5dc1-29f1-4b97-aca9-0efd10f50a68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:47.194744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-753b5dc1-29f1-4b97-aca9-0efd10f50a68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:47.195183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-753b5dc1-29f1-4b97-aca9-0efd10f50a68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:47.195903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-753b5dc1-29f1-4b97-aca9-0efd10f50a68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:47.196330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-753b5dc1-29f1-4b97-aca9-0efd10f50a68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:47.196757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-753b5dc1-29f1-4b97-aca9-0efd10f50a68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:47.390242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-753b5dc1-29f1-4b97-aca9-0efd10f50a68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:47.399184 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-753b5dc1-29f1-4b97-aca9-0efd10f50a68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1313 microversion: 2.1 time: 0.216136 Oct 18 13:18:47.399821 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 369/754] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:47 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:47.429201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e3781646-23f4-4e5c-afbb-d0fb5e2a17ab tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:47.429942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e3781646-23f4-4e5c-afbb-d0fb5e2a17ab tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:47.436041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3781646-23f4-4e5c-afbb-d0fb5e2a17ab tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:47.436599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3781646-23f4-4e5c-afbb-d0fb5e2a17ab tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:47.437097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3781646-23f4-4e5c-afbb-d0fb5e2a17ab tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:47.437874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3781646-23f4-4e5c-afbb-d0fb5e2a17ab tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:47.438390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3781646-23f4-4e5c-afbb-d0fb5e2a17ab tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:47.438881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3781646-23f4-4e5c-afbb-d0fb5e2a17ab tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:47.572717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e3781646-23f4-4e5c-afbb-d0fb5e2a17ab tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:47.580421 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e3781646-23f4-4e5c-afbb-d0fb5e2a17ab tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1314 microversion: 2.1 time: 0.156107 Oct 18 13:18:47.580987 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 370/755] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:47 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:47.759360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0cefa90f-aaf9-42b3-96d2-3899a94dfdb1 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:47.760362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0cefa90f-aaf9-42b3-96d2-3899a94dfdb1 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:47.766571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cefa90f-aaf9-42b3-96d2-3899a94dfdb1 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:47.767275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cefa90f-aaf9-42b3-96d2-3899a94dfdb1 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:47.767991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cefa90f-aaf9-42b3-96d2-3899a94dfdb1 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:47.768882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cefa90f-aaf9-42b3-96d2-3899a94dfdb1 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:47.769505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cefa90f-aaf9-42b3-96d2-3899a94dfdb1 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:47.770257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cefa90f-aaf9-42b3-96d2-3899a94dfdb1 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:48.074302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:48.156837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0cefa90f-aaf9-42b3-96d2-3899a94dfdb1 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:48.163560 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0cefa90f-aaf9-42b3-96d2-3899a94dfdb1 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1478 microversion: 2.1 time: 0.408059 Oct 18 13:18:48.180327 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 371/756] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:47 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1478 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:48.184922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-82947d16-a335-430f-8655-cfd3c58abf50 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:48.185563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-82947d16-a335-430f-8655-cfd3c58abf50 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:48.191674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82947d16-a335-430f-8655-cfd3c58abf50 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:48.192165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82947d16-a335-430f-8655-cfd3c58abf50 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:48.193427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82947d16-a335-430f-8655-cfd3c58abf50 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:48.193427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82947d16-a335-430f-8655-cfd3c58abf50 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:48.194106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82947d16-a335-430f-8655-cfd3c58abf50 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:48.194538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82947d16-a335-430f-8655-cfd3c58abf50 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:48.827653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-82947d16-a335-430f-8655-cfd3c58abf50 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:48.852253 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-82947d16-a335-430f-8655-cfd3c58abf50 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 200 len: 1469 microversion: 2.1 time: 0.671330 Oct 18 13:18:48.855190 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 372/757] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:48 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 1469 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:48.887136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-01730e10-7d48-4866-af2d-eaee7ab6048c req-3198219c-8728-4b62-a7ef-f6f1919ae915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37793c0c-d885-4fd3-8e4f-9d051dd8026c", "name": "network-vif-plugged", "status": "completed", "tag": "dbfe8182-9968-4cde-bd63-b3073fc6f861"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:48.942530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-01730e10-7d48-4866-af2d-eaee7ab6048c req-3198219c-8728-4b62-a7ef-f6f1919ae915 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:48.944423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-01730e10-7d48-4866-af2d-eaee7ab6048c req-3198219c-8728-4b62-a7ef-f6f1919ae915 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:48.945468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-01730e10-7d48-4866-af2d-eaee7ab6048c req-3198219c-8728-4b62-a7ef-f6f1919ae915 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:48.983117 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-01730e10-7d48-4866-af2d-eaee7ab6048c req-3198219c-8728-4b62-a7ef-f6f1919ae915 service nova] Creating event network-vif-plugged:dbfe8182-9968-4cde-bd63-b3073fc6f861 for instance 37793c0c-d885-4fd3-8e4f-9d051dd8026c on n-h2-858384-13 Oct 18 13:18:49.001667 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-01730e10-7d48-4866-af2d-eaee7ab6048c req-3198219c-8728-4b62-a7ef-f6f1919ae915 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142999 Oct 18 13:18:49.004453 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 373/758] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:49.021194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dc2f21e8-a51b-4cce-b8d4-35a35f98a83b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:49.023372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dc2f21e8-a51b-4cce-b8d4-35a35f98a83b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:49.040534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc2f21e8-a51b-4cce-b8d4-35a35f98a83b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:49.041046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc2f21e8-a51b-4cce-b8d4-35a35f98a83b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:49.041521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc2f21e8-a51b-4cce-b8d4-35a35f98a83b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:49.042223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc2f21e8-a51b-4cce-b8d4-35a35f98a83b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:49.042680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc2f21e8-a51b-4cce-b8d4-35a35f98a83b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:49.050387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc2f21e8-a51b-4cce-b8d4-35a35f98a83b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:49.107629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:49.233001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dc2f21e8-a51b-4cce-b8d4-35a35f98a83b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:49.243246 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dc2f21e8-a51b-4cce-b8d4-35a35f98a83b tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1484 microversion: 2.1 time: 0.234926 Oct 18 13:18:49.254244 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 374/759] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:49 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1484 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:49.264343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-44672a4b-0cee-4ee5-9455-a1f9f0797db8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:49.265003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-44672a4b-0cee-4ee5-9455-a1f9f0797db8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:49.276041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44672a4b-0cee-4ee5-9455-a1f9f0797db8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:49.276880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44672a4b-0cee-4ee5-9455-a1f9f0797db8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:49.277527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44672a4b-0cee-4ee5-9455-a1f9f0797db8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:49.278787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44672a4b-0cee-4ee5-9455-a1f9f0797db8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:49.279606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44672a4b-0cee-4ee5-9455-a1f9f0797db8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:49.280244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44672a4b-0cee-4ee5-9455-a1f9f0797db8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:49.458344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-44672a4b-0cee-4ee5-9455-a1f9f0797db8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:49.468898 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-44672a4b-0cee-4ee5-9455-a1f9f0797db8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1313 microversion: 2.1 time: 0.209397 Oct 18 13:18:49.470116 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 375/760] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:49 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:49.475808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d3871b54-2afa-482f-bcc7-6cdd8b2f0d51 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:49.476515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d3871b54-2afa-482f-bcc7-6cdd8b2f0d51 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:49.483972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3871b54-2afa-482f-bcc7-6cdd8b2f0d51 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:49.484574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3871b54-2afa-482f-bcc7-6cdd8b2f0d51 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:49.485089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3871b54-2afa-482f-bcc7-6cdd8b2f0d51 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:49.486276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3871b54-2afa-482f-bcc7-6cdd8b2f0d51 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:49.487046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3871b54-2afa-482f-bcc7-6cdd8b2f0d51 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:49.487541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3871b54-2afa-482f-bcc7-6cdd8b2f0d51 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:49.632841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d3871b54-2afa-482f-bcc7-6cdd8b2f0d51 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:49.651166 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d3871b54-2afa-482f-bcc7-6cdd8b2f0d51 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1463 microversion: 2.1 time: 0.180108 Oct 18 13:18:49.652032 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 376/761] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:49 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1463 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:49.661682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7bf4fa54-41e6-451f-baaa-7b50293598ae req-671ebaeb-4f30-424a-a515-fccc106d284d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb9c30c-e278-459f-b11a-78c8fd730b1c", "name": "network-vif-deleted", "tag": "6f9b5e79-07f1-431f-a89b-eea54a99b512"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:49.680743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7bf4fa54-41e6-451f-baaa-7b50293598ae req-671ebaeb-4f30-424a-a515-fccc106d284d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:49.681519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7bf4fa54-41e6-451f-baaa-7b50293598ae req-671ebaeb-4f30-424a-a515-fccc106d284d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:49.682062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7bf4fa54-41e6-451f-baaa-7b50293598ae req-671ebaeb-4f30-424a-a515-fccc106d284d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:49.699683 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7bf4fa54-41e6-451f-baaa-7b50293598ae req-671ebaeb-4f30-424a-a515-fccc106d284d service nova] Creating event network-vif-deleted:6f9b5e79-07f1-431f-a89b-eea54a99b512 for instance bdb9c30c-e278-459f-b11a-78c8fd730b1c on n-h1-858384-13 Oct 18 13:18:49.705969 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7bf4fa54-41e6-451f-baaa-7b50293598ae req-671ebaeb-4f30-424a-a515-fccc106d284d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052838 Oct 18 13:18:49.707153 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 377/762] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:49.714003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-8dc25535-ee35-43c3-a0bf-5c57d9c14c27 req-c75bc4ca-e5bd-43cd-9a28-9bd8fb30d80f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97ccda6-c665-4a4f-b099-72b142b143b7", "name": "network-vif-deleted", "tag": "7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:49.723860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8dc25535-ee35-43c3-a0bf-5c57d9c14c27 req-c75bc4ca-e5bd-43cd-9a28-9bd8fb30d80f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:49.725048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8dc25535-ee35-43c3-a0bf-5c57d9c14c27 req-c75bc4ca-e5bd-43cd-9a28-9bd8fb30d80f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:49.725656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8dc25535-ee35-43c3-a0bf-5c57d9c14c27 req-c75bc4ca-e5bd-43cd-9a28-9bd8fb30d80f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:49.740127 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-8dc25535-ee35-43c3-a0bf-5c57d9c14c27 req-c75bc4ca-e5bd-43cd-9a28-9bd8fb30d80f service nova] Creating event network-vif-deleted:7f2098ee-ff71-4b41-a6f5-1e4c6d2600e5 for instance f97ccda6-c665-4a4f-b099-72b142b143b7 on n-h1-858384-13 Oct 18 13:18:49.757892 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-8dc25535-ee35-43c3-a0bf-5c57d9c14c27 req-c75bc4ca-e5bd-43cd-9a28-9bd8fb30d80f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048510 Oct 18 13:18:49.759483 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 378/763] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:49.945128 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a0fe2e68-8e82-4a02-a026-e6e803cf1d29 tempest-TenantUsagesNegativeTestJSON-1782354127 tempest-TenantUsagesNegativeTestJSON-1782354127-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-17T13%3A18%3A49.117163&end=2022-10-19T13%3A18%3A49.117163" status: 404 len: 112 microversion: - time: 0.184411 Oct 18 13:18:49.945876 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 379/764] 10.222.0.40 () {58 vars in 1316 bytes} [Tue Oct 18 13:18:49 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-17T13%3A18%3A49.117163&end=2022-10-19T13%3A18%3A49.117163 => generated 112 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 13:18:49.953767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:49.954635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:49.966178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:49.967269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:49.968207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:49.969310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:49.969938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:49.971882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.005943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.006466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.006901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.007350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lazy-loading 'fault' on Instance uuid 57f9acd7-30d4-4857-b45a-b7c851330c34 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:18:50.055674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52570dac8b2049999a0fb325b26e2be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a528eb6958a44b7b55e3c1ca5b10ccd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:50.066663 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ede3c6ba-6f63-4a68-9516-0d0cd2e9de0b tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 200 len: 1312 microversion: 2.1 time: 0.119920 Oct 18 13:18:50.067262 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 380/765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:49 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:50.166805 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2c6bdd37-a9df-4f49-b084-cec23cf76271 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe/action" status: 202 len: 0 microversion: 2.25 time: 4.534389 Oct 18 13:18:50.168212 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 386/766] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:18:45 2022] POST /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe/action => generated 0 bytes in 4537 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:18:50.177898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-61fcca2e-607a-4ff7-8196-4e9ced7d9337 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:50.178793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-61fcca2e-607a-4ff7-8196-4e9ced7d9337 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: bdb9c30c-e278-459f-b11a-78c8fd730b1c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:50.187582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61fcca2e-607a-4ff7-8196-4e9ced7d9337 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.188710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61fcca2e-607a-4ff7-8196-4e9ced7d9337 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.189715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61fcca2e-607a-4ff7-8196-4e9ced7d9337 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.191079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61fcca2e-607a-4ff7-8196-4e9ced7d9337 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.192054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61fcca2e-607a-4ff7-8196-4e9ced7d9337 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.201025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61fcca2e-607a-4ff7-8196-4e9ced7d9337 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.232074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-04f7125d-cc63-445e-a6d9-661b5f001de1 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:50.238115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-04f7125d-cc63-445e-a6d9-661b5f001de1 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Searching by: {'deleted': False, 'project_id': '4713f7dd82844d61aa11516f86bbc5ed'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:18:50.242772 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-61fcca2e-607a-4ff7-8196-4e9ced7d9337 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] HTTP exception thrown: Instance bdb9c30c-e278-459f-b11a-78c8fd730b1c could not be found. Oct 18 13:18:50.244971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04f7125d-cc63-445e-a6d9-661b5f001de1 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.245540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04f7125d-cc63-445e-a6d9-661b5f001de1 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.246035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04f7125d-cc63-445e-a6d9-661b5f001de1 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.246761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04f7125d-cc63-445e-a6d9-661b5f001de1 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.247299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04f7125d-cc63-445e-a6d9-661b5f001de1 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.248031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04f7125d-cc63-445e-a6d9-661b5f001de1 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-61fcca2e-607a-4ff7-8196-4e9ced7d9337 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Request method failure captured: Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c HTTP/1.1 Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqd6VxhsBeQ03Y2xk7WP-VD9-6EQLvlfBKOqUzdKwmdhwALm5H9e5jLRr40G0z5subiRBWxjTGuTQK6EP3hqhSLab2yYfP2BrhbhwcqdM5TG7Qb8VDxTzcUlIQKaKa5yRxON6Q7JjwDGDmE2PPCahjwIvu7-wc6p3BzEHn9ixjmUVIs Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d15b3d39ec044d9f853b681d5886b622 Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1569643558 Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:18:50.253620 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:18:50.255074 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d15b3d39ec044d9f853b681d5886b622"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d15b3d39ec044d9f853b681d5886b622"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d15b3d39ec044d9f853b681d5886b622"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d15b3d39ec044d9f853b681d5886b622"}]}] Oct 18 13:18:50.255074 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1569643558 Oct 18 13:18:50.255074 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d15b3d39ec044d9f853b681d5886b622 Oct 18 13:18:50.255074 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1569643558 Oct 18 13:18:50.255074 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersAdminNegativeTestJSON-1569643558-project Oct 18 13:18:50.255074 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:50.255074 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:50.255074 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: ee57dfe126fa4254b75455250e61d7be Oct 18 13:18:50.255074 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1569643558-project Oct 18 13:18:50.255074 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:18:50.255074 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance bdb9c30c-e278-459f-b11a-78c8fd730b1c could not be found. Oct 18 13:18:50.255074 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'bdb9c30c-e278-459f-b11a-78c8fd730b1c'} Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb9c30c-e278-459f-b11a-78c8fd730b1c could not be found. Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:50.255924 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb9c30c-e278-459f-b11a-78c8fd730b1c could not be found. Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb9c30c-e278-459f-b11a-78c8fd730b1c could not be found. Oct 18 13:18:50.257334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:50.258460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-61fcca2e-607a-4ff7-8196-4e9ced7d9337 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Returning 404 to user: Instance bdb9c30c-e278-459f-b11a-78c8fd730b1c could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:50.258460 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-61fcca2e-607a-4ff7-8196-4e9ced7d9337 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c" status: 404 len: 111 microversion: 2.1 time: 0.085811 Oct 18 13:18:50.263717 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 387/767] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:50 2022] GET /compute/v2.1/servers/bdb9c30c-e278-459f-b11a-78c8fd730b1c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:18:50.276854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-966ee79a-bf85-45cb-838d-efd8fe49c4ab tempest-TenantUsagesNegativeTestJSON-1782354127 tempest-TenantUsagesNegativeTestJSON-1782354127-project-admin] Calling method '.version_select at 0x7ff60fdb25e0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:50.284704 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-966ee79a-bf85-45cb-838d-efd8fe49c4ab tempest-TenantUsagesNegativeTestJSON-1782354127 tempest-TenantUsagesNegativeTestJSON-1782354127-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-966ee79a-bf85-45cb-838d-efd8fe49c4ab tempest-TenantUsagesNegativeTestJSON-1782354127 tempest-TenantUsagesNegativeTestJSON-1782354127-project-admin] Request method failure captured: Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-simple-tenant-usage/b94ff8343baa4dc9b0c3de04ea6c492c?start=2022-10-19T13%3A18%3A49.117163&end=2022-10-17T13%3A18%3A49.117163 HTTP/1.1 Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqe4CznZxg1zmDqxqDIWQ_dyQqBTg1cfdTM1XhZwMpYSPQDBzxyssaRcLmAQ5LCkCi0Qr9sPK5__gx3Bhl4d7CN64KFRuE5vfh85DYCrDz9OrHlxQqfSRXq_tkcpATNJqQ73DgRPovqT9GFSV5kO_-QpIIxCsUWA5hIwYwj7F6Nn8oY Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: a7e4e130ad46432890b82b49c5e23dc7 Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1782354127 Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:18:50.286501 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:18:50.289530 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7e4e130ad46432890b82b49c5e23dc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7e4e130ad46432890b82b49c5e23dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7e4e130ad46432890b82b49c5e23dc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7e4e130ad46432890b82b49c5e23dc7"}]}] Oct 18 13:18:50.289530 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1782354127 Oct 18 13:18:50.289530 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: a7e4e130ad46432890b82b49c5e23dc7 Oct 18 13:18:50.289530 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1782354127 Oct 18 13:18:50.289530 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TenantUsagesNegativeTestJSON-1782354127-project-admin Oct 18 13:18:50.289530 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:50.289530 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:50.289530 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 4e8aa858338f410685b1e452a6c733b7 Oct 18 13:18:50.289530 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1782354127-project-admin Oct 18 13:18:50.289530 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:18:50.289530 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid start time. The start time cannot occur after the end time. Oct 18 13:18:50.289530 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'b94ff8343baa4dc9b0c3de04ea6c492c'} Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 13:18:50.291408 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 18 13:18:50.295692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:50.295692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:50.295692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:50.295692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:50.295692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:50.295692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:50.295692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:50.295692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:50.295692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 18 13:18:50.295692 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:50.295692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-966ee79a-bf85-45cb-838d-efd8fe49c4ab tempest-TenantUsagesNegativeTestJSON-1782354127 tempest-TenantUsagesNegativeTestJSON-1782354127-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:50.295692 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-966ee79a-bf85-45cb-838d-efd8fe49c4ab tempest-TenantUsagesNegativeTestJSON-1782354127 tempest-TenantUsagesNegativeTestJSON-1782354127-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/b94ff8343baa4dc9b0c3de04ea6c492c?start=2022-10-19T13%3A18%3A49.117163&end=2022-10-17T13%3A18%3A49.117163" status: 400 len: 111 microversion: 2.1 time: 0.023982 Oct 18 13:18:50.296655 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 388/768] 10.222.0.40 () {58 vars in 1412 bytes} [Tue Oct 18 13:18:50 2022] GET /compute/v2.1/os-simple-tenant-usage/b94ff8343baa4dc9b0c3de04ea6c492c?start=2022-10-19T13%3A18%3A49.117163&end=2022-10-17T13%3A18%3A49.117163 => generated 111 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:18:50.304994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bdf049c4-d41a-4fa0-a1ad-db8c4f303869 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:50.306113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bdf049c4-d41a-4fa0-a1ad-db8c4f303869 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:50.316237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdf049c4-d41a-4fa0-a1ad-db8c4f303869 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.317346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdf049c4-d41a-4fa0-a1ad-db8c4f303869 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.317791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdf049c4-d41a-4fa0-a1ad-db8c4f303869 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.319301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdf049c4-d41a-4fa0-a1ad-db8c4f303869 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.320131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdf049c4-d41a-4fa0-a1ad-db8c4f303869 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.321722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdf049c4-d41a-4fa0-a1ad-db8c4f303869 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.386706 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-04f7125d-cc63-445e-a6d9-661b5f001de1 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.318330 Oct 18 13:18:50.387886 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 381/769] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:18:50 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:18:50.407225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6dda70f0-35f4-42e0-bd99-26177b463456 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:50.408170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6dda70f0-35f4-42e0-bd99-26177b463456 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:50.418550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6dda70f0-35f4-42e0-bd99-26177b463456 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.419373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6dda70f0-35f4-42e0-bd99-26177b463456 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.419944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6dda70f0-35f4-42e0-bd99-26177b463456 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.421417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6dda70f0-35f4-42e0-bd99-26177b463456 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.422030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6dda70f0-35f4-42e0-bd99-26177b463456 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.422726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6dda70f0-35f4-42e0-bd99-26177b463456 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.473140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6dda70f0-35f4-42e0-bd99-26177b463456 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:18:50.591940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bdf049c4-d41a-4fa0-a1ad-db8c4f303869 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:50.606996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bdf049c4-d41a-4fa0-a1ad-db8c4f303869 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:50.609154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bdf049c4-d41a-4fa0-a1ad-db8c4f303869 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:50.609636 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6dda70f0-35f4-42e0-bd99-26177b463456 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 204 len: 0 microversion: 2.1 time: 0.220275 Oct 18 13:18:50.610214 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 382/770] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:18:50 2022] DELETE /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:18:50.610371 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bdf049c4-d41a-4fa0-a1ad-db8c4f303869 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1567 microversion: 2.25 time: 0.319587 Oct 18 13:18:50.611178 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 389/771] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:50 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1567 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:50.617088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:50.617884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:50.624280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.624759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.625224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.626143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.626597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.627151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.663753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.664241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.664675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.665320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lazy-loading 'fault' on Instance uuid f97ccda6-c665-4a4f-b099-72b142b143b7 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:18:50.714909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f3dcbdece5d4d4b992f4e9ebf4897d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b9ff58f71c425d8853ec2d0466ee3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:50.728577 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-44f22e57-2e38-4d52-b4f0-9966c4f858a0 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 200 len: 1314 microversion: 2.1 time: 0.116719 Oct 18 13:18:50.729620 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 383/772] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:50 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 1314 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:50.745702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aa3ac4b5-1399-41de-81d0-82fd8b4c7b99 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:50.752149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aa3ac4b5-1399-41de-81d0-82fd8b4c7b99 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Searching by: {'deleted': False} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:18:50.758780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa3ac4b5-1399-41de-81d0-82fd8b4c7b99 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.759392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa3ac4b5-1399-41de-81d0-82fd8b4c7b99 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.759842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa3ac4b5-1399-41de-81d0-82fd8b4c7b99 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.760593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa3ac4b5-1399-41de-81d0-82fd8b4c7b99 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.761053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa3ac4b5-1399-41de-81d0-82fd8b4c7b99 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.761513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa3ac4b5-1399-41de-81d0-82fd8b4c7b99 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.762351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b255a8c6-cd15-4c5a-9552-bb2bd91a1c42 tempest-TenantUsagesNegativeTestJSON-1233457677 tempest-TenantUsagesNegativeTestJSON-1233457677-project] Calling method '.version_select at 0x7ff60fe9c670>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:50.765902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b255a8c6-cd15-4c5a-9552-bb2bd91a1c42 tempest-TenantUsagesNegativeTestJSON-1233457677 tempest-TenantUsagesNegativeTestJSON-1233457677-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '6954cf8d3d274768aea2cf849476596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94ff8343baa4dc9b0c3de04ea6c492c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b255a8c6-cd15-4c5a-9552-bb2bd91a1c42 tempest-TenantUsagesNegativeTestJSON-1233457677 tempest-TenantUsagesNegativeTestJSON-1233457677-project] Request method failure captured: Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T13%3A18%3A49.117163&end=2022-10-19T13%3A18%3A49.117163&detailed=1 HTTP/1.1 Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqe31nxOy2pJvf4D8jL0E7DStxgbLX70ojzGAxC8Jvn2QwD2hPaBclDzVQL7V7oXRgEZqoynLq7Xp49invztvMy78ICjQa9qJYOOySC24Xn3nAWsJTzZGpsNEGTu5qIPOg_b1_FGJC_rB0vu4vBkSwcDF8u3Gjp4n8AMYUKz-zTSuKQ Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: b94ff8343baa4dc9b0c3de04ea6c492c Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1233457677 Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:18:50.767510 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:18:50.769060 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b94ff8343baa4dc9b0c3de04ea6c492c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b94ff8343baa4dc9b0c3de04ea6c492c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b94ff8343baa4dc9b0c3de04ea6c492c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b94ff8343baa4dc9b0c3de04ea6c492c"}]}] Oct 18 13:18:50.769060 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1233457677 Oct 18 13:18:50.769060 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: b94ff8343baa4dc9b0c3de04ea6c492c Oct 18 13:18:50.769060 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1233457677 Oct 18 13:18:50.769060 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TenantUsagesNegativeTestJSON-1233457677-project Oct 18 13:18:50.769060 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:50.769060 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:50.769060 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6954cf8d3d274768aea2cf849476596e Oct 18 13:18:50.769060 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1233457677-project Oct 18 13:18:50.769060 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:18:50.769060 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 18 13:18:50.769060 n-d-858384-13 devstack@n-api.service[120611]: action_args: {} Oct 18 13:18:50.769060 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:18:50.770247 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:18:50.772354 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:18:50.773656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 18 13:18:50.773656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:50.773656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b255a8c6-cd15-4c5a-9552-bb2bd91a1c42 tempest-TenantUsagesNegativeTestJSON-1233457677 tempest-TenantUsagesNegativeTestJSON-1233457677-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:50.773656 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b255a8c6-cd15-4c5a-9552-bb2bd91a1c42 tempest-TenantUsagesNegativeTestJSON-1233457677 tempest-TenantUsagesNegativeTestJSON-1233457677-project] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T13%3A18%3A49.117163&end=2022-10-19T13%3A18%3A49.117163&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.146091 Oct 18 13:18:50.773656 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 390/773] 10.222.0.40 () {58 vars in 1335 bytes} [Tue Oct 18 13:18:50 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T13%3A18%3A49.117163&end=2022-10-19T13%3A18%3A49.117163&detailed=1 => generated 123 bytes in 157 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:18:50.774252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0cd12efa-5576-4eb0-be1e-a210e82558b5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:50.776246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0cd12efa-5576-4eb0-be1e-a210e82558b5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:50.785579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cd12efa-5576-4eb0-be1e-a210e82558b5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.786133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cd12efa-5576-4eb0-be1e-a210e82558b5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.787083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cd12efa-5576-4eb0-be1e-a210e82558b5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.787942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cd12efa-5576-4eb0-be1e-a210e82558b5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.788303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cd12efa-5576-4eb0-be1e-a210e82558b5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.788719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cd12efa-5576-4eb0-be1e-a210e82558b5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.900144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-aa3ac4b5-1399-41de-81d0-82fd8b4c7b99 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:18:50.947908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0cd12efa-5576-4eb0-be1e-a210e82558b5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:50.956849 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0cd12efa-5576-4eb0-be1e-a210e82558b5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1313 microversion: 2.1 time: 0.186288 Oct 18 13:18:50.958023 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 391/774] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:50 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:50.964280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d2faaf80-99ab-427f-acba-5d662b28aa43 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:50.965151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d2faaf80-99ab-427f-acba-5d662b28aa43 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:50.972434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2faaf80-99ab-427f-acba-5d662b28aa43 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.973195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2faaf80-99ab-427f-acba-5d662b28aa43 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.973806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2faaf80-99ab-427f-acba-5d662b28aa43 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:50.974797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2faaf80-99ab-427f-acba-5d662b28aa43 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:50.975343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2faaf80-99ab-427f-acba-5d662b28aa43 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:50.975762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2faaf80-99ab-427f-acba-5d662b28aa43 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:51.204713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d2faaf80-99ab-427f-acba-5d662b28aa43 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:51.214170 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d2faaf80-99ab-427f-acba-5d662b28aa43 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 200 len: 1477 microversion: 2.1 time: 0.253903 Oct 18 13:18:51.224915 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 392/775] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:50 2022] GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 1477 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:51.233761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-25031c49-9997-426b-8439-9435a77bd107 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:51.235261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-25031c49-9997-426b-8439-9435a77bd107 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] [instance: 57f9acd7-30d4-4857-b45a-b7c851330c34] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:51.242049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25031c49-9997-426b-8439-9435a77bd107 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:51.242546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25031c49-9997-426b-8439-9435a77bd107 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:51.242981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25031c49-9997-426b-8439-9435a77bd107 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:51.243676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25031c49-9997-426b-8439-9435a77bd107 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:51.244319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25031c49-9997-426b-8439-9435a77bd107 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:51.245366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25031c49-9997-426b-8439-9435a77bd107 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:51.264235 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-25031c49-9997-426b-8439-9435a77bd107 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] HTTP exception thrown: Instance 57f9acd7-30d4-4857-b45a-b7c851330c34 could not be found. Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-25031c49-9997-426b-8439-9435a77bd107 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Request method failure captured: Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 HTTP/1.1 Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqeSg7eyf0Ndp6P3n_fn2TDCG7TmpjvbUTBVRXqWP950TnADPI5w6v-wdR8QmkNAPoauTdnDWNdD_w1S5QzARFCKKer2rF7dIxN9uN6RKV6-In-G6CSR8wOK_Uq8_UpNZyVbXPpqNwg-TARzki3xyKehTVJJiDvDYhTM4tTwXyO8pbA Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 8a528eb6958a44b7b55e3c1ca5b10ccd Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1875086572 Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:18:51.266461 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:18:51.267790 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a528eb6958a44b7b55e3c1ca5b10ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8a528eb6958a44b7b55e3c1ca5b10ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8a528eb6958a44b7b55e3c1ca5b10ccd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8a528eb6958a44b7b55e3c1ca5b10ccd"}]}] Oct 18 13:18:51.267790 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1875086572 Oct 18 13:18:51.267790 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 8a528eb6958a44b7b55e3c1ca5b10ccd Oct 18 13:18:51.267790 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1875086572 Oct 18 13:18:51.267790 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerDiagnosticsNegativeTest-1875086572-project Oct 18 13:18:51.267790 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:51.267790 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:51.267790 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 52570dac8b2049999a0fb325b26e2be1 Oct 18 13:18:51.267790 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1875086572-project Oct 18 13:18:51.267790 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:18:51.267790 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 57f9acd7-30d4-4857-b45a-b7c851330c34 could not be found. Oct 18 13:18:51.267790 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '57f9acd7-30d4-4857-b45a-b7c851330c34'} Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57f9acd7-30d4-4857-b45a-b7c851330c34 could not be found. Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:51.268548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57f9acd7-30d4-4857-b45a-b7c851330c34 could not be found. Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57f9acd7-30d4-4857-b45a-b7c851330c34 could not be found. Oct 18 13:18:51.269806 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:51.270872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-25031c49-9997-426b-8439-9435a77bd107 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] Returning 404 to user: Instance 57f9acd7-30d4-4857-b45a-b7c851330c34 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:51.270872 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-25031c49-9997-426b-8439-9435a77bd107 tempest-ServerDiagnosticsNegativeTest-1875086572 tempest-ServerDiagnosticsNegativeTest-1875086572-project] 10.222.0.40 "GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34" status: 404 len: 111 microversion: 2.1 time: 0.044040 Oct 18 13:18:51.281339 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 393/776] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:51 2022] GET /compute/v2.1/servers/57f9acd7-30d4-4857-b45a-b7c851330c34 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:18:51.299064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa3ac4b5-1399-41de-81d0-82fd8b4c7b99 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:51.299570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa3ac4b5-1399-41de-81d0-82fd8b4c7b99 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:51.299964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa3ac4b5-1399-41de-81d0-82fd8b4c7b99 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:51.639773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8e43fff8-a8a5-40b9-8251-3b964a67a34f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:51.640470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8e43fff8-a8a5-40b9-8251-3b964a67a34f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:51.647873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e43fff8-a8a5-40b9-8251-3b964a67a34f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:51.648736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e43fff8-a8a5-40b9-8251-3b964a67a34f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:51.649530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e43fff8-a8a5-40b9-8251-3b964a67a34f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:51.650604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e43fff8-a8a5-40b9-8251-3b964a67a34f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:51.651134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e43fff8-a8a5-40b9-8251-3b964a67a34f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:51.651793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e43fff8-a8a5-40b9-8251-3b964a67a34f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:51.893597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8e43fff8-a8a5-40b9-8251-3b964a67a34f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:51.914568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8e43fff8-a8a5-40b9-8251-3b964a67a34f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:51.916043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8e43fff8-a8a5-40b9-8251-3b964a67a34f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:51.923848 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8e43fff8-a8a5-40b9-8251-3b964a67a34f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1567 microversion: 2.25 time: 0.281862 Oct 18 13:18:51.924833 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 394/777] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:51 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1567 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:18:51.932813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-6ed50f9e-ef91-4b4f-883f-639a579a1c10 req-f75ed887-548f-43b0-8f32-127f6490ecef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57f9acd7-30d4-4857-b45a-b7c851330c34", "name": "network-vif-deleted", "tag": "fb391fe6-f576-4add-b03a-a70be3613588"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:51.954758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6ed50f9e-ef91-4b4f-883f-639a579a1c10 req-f75ed887-548f-43b0-8f32-127f6490ecef service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:51.955249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6ed50f9e-ef91-4b4f-883f-639a579a1c10 req-f75ed887-548f-43b0-8f32-127f6490ecef service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:51.956088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6ed50f9e-ef91-4b4f-883f-639a579a1c10 req-f75ed887-548f-43b0-8f32-127f6490ecef service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:51.982732 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-6ed50f9e-ef91-4b4f-883f-639a579a1c10 req-f75ed887-548f-43b0-8f32-127f6490ecef service nova] Creating event network-vif-deleted:fb391fe6-f576-4add-b03a-a70be3613588 for instance 57f9acd7-30d4-4857-b45a-b7c851330c34 on n-h1-858384-13 Oct 18 13:18:51.992791 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-6ed50f9e-ef91-4b4f-883f-639a579a1c10 req-f75ed887-548f-43b0-8f32-127f6490ecef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066441 Oct 18 13:18:51.993558 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 395/778] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:52.001710 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aa3ac4b5-1399-41de-81d0-82fd8b4c7b99 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16153 microversion: 2.1 time: 1.270512 Oct 18 13:18:52.002555 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 384/779] 10.222.0.40 () {58 vars in 1171 bytes} [Tue Oct 18 13:18:50 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16153 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:18:52.007287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1dd2873-72cc-45d4-8a76-c51829b87c72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:52.008020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1dd2873-72cc-45d4-8a76-c51829b87c72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] [instance: f97ccda6-c665-4a4f-b099-72b142b143b7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:52.008896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6e0245c5-1318-48c2-ab15-3636cf6cde26 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:52.011810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6e0245c5-1318-48c2-ab15-3636cf6cde26 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:52.039359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1dd2873-72cc-45d4-8a76-c51829b87c72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:52.039359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1dd2873-72cc-45d4-8a76-c51829b87c72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:52.039726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e0245c5-1318-48c2-ab15-3636cf6cde26 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:52.041339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e0245c5-1318-48c2-ab15-3636cf6cde26 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:52.042024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1dd2873-72cc-45d4-8a76-c51829b87c72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:52.042161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e0245c5-1318-48c2-ab15-3636cf6cde26 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:52.042904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e0245c5-1318-48c2-ab15-3636cf6cde26 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:52.043556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e0245c5-1318-48c2-ab15-3636cf6cde26 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:52.044164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e0245c5-1318-48c2-ab15-3636cf6cde26 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:52.045709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1dd2873-72cc-45d4-8a76-c51829b87c72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:52.046867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1dd2873-72cc-45d4-8a76-c51829b87c72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:52.047334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1dd2873-72cc-45d4-8a76-c51829b87c72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:52.067989 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-d1dd2873-72cc-45d4-8a76-c51829b87c72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] HTTP exception thrown: Instance f97ccda6-c665-4a4f-b099-72b142b143b7 could not be found. Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1dd2873-72cc-45d4-8a76-c51829b87c72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Request method failure captured: Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 HTTP/1.1 Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdaw5eKFtczjxjzMrR0d_1Gha5NPaIEOZ9ux9rCUNEEusLrElZXrC0CVBXbvhLrufM5CQIBIwH2pFzsmeuqXPx5G-9DwVlF99C011d1O5TJE5baUyLQQO_2QLlCQUwqF9FUjeo0CJiXoJrjVViv_K27QN-0bbUKYjTsIXDPoY0Z_o8 Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: a7b9ff58f71c425d8853ec2d0466ee3a Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-614088941 Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:18:52.081075 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:18:52.082700 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7b9ff58f71c425d8853ec2d0466ee3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7b9ff58f71c425d8853ec2d0466ee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7b9ff58f71c425d8853ec2d0466ee3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7b9ff58f71c425d8853ec2d0466ee3a"}]}] Oct 18 13:18:52.082700 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-614088941 Oct 18 13:18:52.082700 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: a7b9ff58f71c425d8853ec2d0466ee3a Oct 18 13:18:52.082700 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-614088941 Oct 18 13:18:52.082700 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-FloatingIPsAssociationTestJSON-614088941-project Oct 18 13:18:52.082700 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:52.082700 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:52.082700 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 9f3dcbdece5d4d4b992f4e9ebf4897d4 Oct 18 13:18:52.082700 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-614088941-project Oct 18 13:18:52.082700 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:18:52.082700 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance f97ccda6-c665-4a4f-b099-72b142b143b7 could not be found. Oct 18 13:18:52.082700 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f97ccda6-c665-4a4f-b099-72b142b143b7'} Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97ccda6-c665-4a4f-b099-72b142b143b7 could not be found. Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:52.084592 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97ccda6-c665-4a4f-b099-72b142b143b7 could not be found. Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97ccda6-c665-4a4f-b099-72b142b143b7 could not be found. Oct 18 13:18:52.086066 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:52.090007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1dd2873-72cc-45d4-8a76-c51829b87c72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] Returning 404 to user: Instance f97ccda6-c665-4a4f-b099-72b142b143b7 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:52.092289 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d1dd2873-72cc-45d4-8a76-c51829b87c72 tempest-FloatingIPsAssociationTestJSON-614088941 tempest-FloatingIPsAssociationTestJSON-614088941-project] 10.222.0.40 "GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7" status: 404 len: 111 microversion: 2.1 time: 0.096884 Oct 18 13:18:52.095798 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 396/780] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:51 2022] GET /compute/v2.1/servers/f97ccda6-c665-4a4f-b099-72b142b143b7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:18:52.105820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e14d91a9-63bb-4fe6-a5de-0ca5c62ae3ea tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:52.141051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e14d91a9-63bb-4fe6-a5de-0ca5c62ae3ea tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Searching by: {'deleted': False, 'project_id': '4713f7dd82844d61aa11516f86bbc5ed'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:18:52.151028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e14d91a9-63bb-4fe6-a5de-0ca5c62ae3ea tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:52.152407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e14d91a9-63bb-4fe6-a5de-0ca5c62ae3ea tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:52.153059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e14d91a9-63bb-4fe6-a5de-0ca5c62ae3ea tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:52.154165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e14d91a9-63bb-4fe6-a5de-0ca5c62ae3ea tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:52.154831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e14d91a9-63bb-4fe6-a5de-0ca5c62ae3ea tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:52.155618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e14d91a9-63bb-4fe6-a5de-0ca5c62ae3ea tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:52.340236 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e14d91a9-63bb-4fe6-a5de-0ca5c62ae3ea tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?tenant_id=4ca31a93e6854a0fa9cc37d0bb89a3c6" status: 200 len: 15 microversion: 2.1 time: 0.242926 Oct 18 13:18:52.341519 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 397/781] 10.222.0.40 () {58 vars in 1231 bytes} [Tue Oct 18 13:18:52 2022] GET /compute/v2.1/servers/detail?tenant_id=4ca31a93e6854a0fa9cc37d0bb89a3c6 => generated 15 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:18:52.361711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-697d5bf0-d097-4243-9113-e3f52421e087 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:52.362343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-697d5bf0-d097-4243-9113-e3f52421e087 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:52.369802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-697d5bf0-d097-4243-9113-e3f52421e087 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:52.370358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-697d5bf0-d097-4243-9113-e3f52421e087 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:52.370933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-697d5bf0-d097-4243-9113-e3f52421e087 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:52.372002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-697d5bf0-d097-4243-9113-e3f52421e087 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:52.372656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-697d5bf0-d097-4243-9113-e3f52421e087 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:52.373305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-697d5bf0-d097-4243-9113-e3f52421e087 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:52.480519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6e0245c5-1318-48c2-ab15-3636cf6cde26 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:52.496030 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6e0245c5-1318-48c2-ab15-3636cf6cde26 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1313 microversion: 2.1 time: 0.492229 Oct 18 13:18:52.507517 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 385/782] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:52 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:52.512601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d500c78-037b-4be5-a9ed-4e066553a51f tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:52.524154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4d500c78-037b-4be5-a9ed-4e066553a51f tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Searching by: {'tenant_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'deleted': False} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:18:52.541017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d500c78-037b-4be5-a9ed-4e066553a51f tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:52.544017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d500c78-037b-4be5-a9ed-4e066553a51f tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:52.547340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d500c78-037b-4be5-a9ed-4e066553a51f tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:52.548684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d500c78-037b-4be5-a9ed-4e066553a51f tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:52.549346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d500c78-037b-4be5-a9ed-4e066553a51f tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:52.550049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d500c78-037b-4be5-a9ed-4e066553a51f tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:52.598988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-4d500c78-037b-4be5-a9ed-4e066553a51f tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:18:52.693767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d500c78-037b-4be5-a9ed-4e066553a51f tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:52.694585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d500c78-037b-4be5-a9ed-4e066553a51f tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:52.695242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d500c78-037b-4be5-a9ed-4e066553a51f tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:52.703743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-697d5bf0-d097-4243-9113-e3f52421e087 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:52.714036 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-697d5bf0-d097-4243-9113-e3f52421e087 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 200 len: 1477 microversion: 2.1 time: 0.359486 Oct 18 13:18:52.718257 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 398/783] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:52 2022] GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 1477 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:52.956339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-76316b7d-cb4b-4524-bdd7-0d5b9a8d2181 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:52.956966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-76316b7d-cb4b-4524-bdd7-0d5b9a8d2181 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:52.964813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76316b7d-cb4b-4524-bdd7-0d5b9a8d2181 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:52.965348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76316b7d-cb4b-4524-bdd7-0d5b9a8d2181 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:52.966072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76316b7d-cb4b-4524-bdd7-0d5b9a8d2181 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:52.967040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76316b7d-cb4b-4524-bdd7-0d5b9a8d2181 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:52.967931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76316b7d-cb4b-4524-bdd7-0d5b9a8d2181 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:52.968596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76316b7d-cb4b-4524-bdd7-0d5b9a8d2181 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:52.997225 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d500c78-037b-4be5-a9ed-4e066553a51f tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4ca31a93e6854a0fa9cc37d0bb89a3c6" status: 200 len: 4831 microversion: 2.1 time: 0.488445 Oct 18 13:18:52.997841 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 386/784] 10.222.0.40 () {58 vars in 1257 bytes} [Tue Oct 18 13:18:52 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4ca31a93e6854a0fa9cc37d0bb89a3c6 => generated 4831 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:53.022991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6fdcef4d-7749-479c-b7ae-bae54c30f248 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:53.028933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6fdcef4d-7749-479c-b7ae-bae54c30f248 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Searching by: {'tenant_id': '4713f7dd82844d61aa11516f86bbc5ed', 'deleted': False} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:18:53.034126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fdcef4d-7749-479c-b7ae-bae54c30f248 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.034617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fdcef4d-7749-479c-b7ae-bae54c30f248 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.035048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fdcef4d-7749-479c-b7ae-bae54c30f248 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.036056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fdcef4d-7749-479c-b7ae-bae54c30f248 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.037133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fdcef4d-7749-479c-b7ae-bae54c30f248 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.038260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fdcef4d-7749-479c-b7ae-bae54c30f248 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.071440 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6fdcef4d-7749-479c-b7ae-bae54c30f248 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4713f7dd82844d61aa11516f86bbc5ed" status: 200 len: 15 microversion: 2.1 time: 0.051986 Oct 18 13:18:53.073309 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 387/785] 10.222.0.40 () {58 vars in 1257 bytes} [Tue Oct 18 13:18:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4713f7dd82844d61aa11516f86bbc5ed => generated 15 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:18:53.080539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-3d1a8a2f-2a57-49b8-a5d5-6d42c259416c req-4effb55c-2a89-4c87-93a6-f3864f217a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b550c78b-caf6-44ea-a613-978bac95b4fe", "name": "network-vif-unplugged", "status": "completed", "tag": "f691b18b-7542-4132-925b-d3a8fa57fcae"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:53.098072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3d1a8a2f-2a57-49b8-a5d5-6d42c259416c req-4effb55c-2a89-4c87-93a6-f3864f217a0b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.098545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3d1a8a2f-2a57-49b8-a5d5-6d42c259416c req-4effb55c-2a89-4c87-93a6-f3864f217a0b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.100088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3d1a8a2f-2a57-49b8-a5d5-6d42c259416c req-4effb55c-2a89-4c87-93a6-f3864f217a0b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.118741 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-3d1a8a2f-2a57-49b8-a5d5-6d42c259416c req-4effb55c-2a89-4c87-93a6-f3864f217a0b service nova] Creating event network-vif-unplugged:f691b18b-7542-4132-925b-d3a8fa57fcae for instance b550c78b-caf6-44ea-a613-978bac95b4fe on n-h2-858384-13 Oct 18 13:18:53.125677 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-3d1a8a2f-2a57-49b8-a5d5-6d42c259416c req-4effb55c-2a89-4c87-93a6-f3864f217a0b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049506 Oct 18 13:18:53.127013 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 388/786] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:53.133527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-59ef7e52-5e9d-458b-bfb7-a1fee9a78368 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:53.139756 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-59ef7e52-5e9d-458b-bfb7-a1fee9a78368 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010997 Oct 18 13:18:53.141540 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 389/787] 10.222.0.40 () {58 vars in 1189 bytes} [Tue Oct 18 13:18:53 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:18:53.167432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-99d29919-64d8-49da-8cfa-243c9a0e4ba7 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:53.170768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-99d29919-64d8-49da-8cfa-243c9a0e4ba7 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:53.179231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99d29919-64d8-49da-8cfa-243c9a0e4ba7 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.180071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99d29919-64d8-49da-8cfa-243c9a0e4ba7 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.180728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99d29919-64d8-49da-8cfa-243c9a0e4ba7 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.181777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99d29919-64d8-49da-8cfa-243c9a0e4ba7 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.182571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99d29919-64d8-49da-8cfa-243c9a0e4ba7 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.183462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99d29919-64d8-49da-8cfa-243c9a0e4ba7 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.278229 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-99d29919-64d8-49da-8cfa-243c9a0e4ba7 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action" status: 202 len: 0 microversion: 2.1 time: 0.118880 Oct 18 13:18:53.281971 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 390/788] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:53 2022] POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:18:53.289225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8f1ffe02-9b7e-4fc1-a6d4-15e1db88e573 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:53.294783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8f1ffe02-9b7e-4fc1-a6d4-15e1db88e573 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:53.295562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8f1ffe02-9b7e-4fc1-a6d4-15e1db88e573 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:18:53.303470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f1ffe02-9b7e-4fc1-a6d4-15e1db88e573 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.303833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f1ffe02-9b7e-4fc1-a6d4-15e1db88e573 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.304205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f1ffe02-9b7e-4fc1-a6d4-15e1db88e573 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.304946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f1ffe02-9b7e-4fc1-a6d4-15e1db88e573 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.305556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f1ffe02-9b7e-4fc1-a6d4-15e1db88e573 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.305858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f1ffe02-9b7e-4fc1-a6d4-15e1db88e573 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.376223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:53.400287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-8f1ffe02-9b7e-4fc1-a6d4-15e1db88e573 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:18:53.443425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-76316b7d-cb4b-4524-bdd7-0d5b9a8d2181 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:53.452709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-76316b7d-cb4b-4524-bdd7-0d5b9a8d2181 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:53.454599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-76316b7d-cb4b-4524-bdd7-0d5b9a8d2181 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:53.456100 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-76316b7d-cb4b-4524-bdd7-0d5b9a8d2181 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1567 microversion: 2.25 time: 0.504117 Oct 18 13:18:53.469213 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8f1ffe02-9b7e-4fc1-a6d4-15e1db88e573 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.185414 Oct 18 13:18:53.469848 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 391/790] 10.222.0.40 () {58 vars in 1150 bytes} [Tue Oct 18 13:18:53 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:18:53.470002 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 399/790] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:52 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1567 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:18:53.485279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-781a3c61-48c6-439c-9fbd-87b334d2f8b0 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:53.488052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-781a3c61-48c6-439c-9fbd-87b334d2f8b0 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:53.495076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-781a3c61-48c6-439c-9fbd-87b334d2f8b0 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.495574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-781a3c61-48c6-439c-9fbd-87b334d2f8b0 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.496172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-781a3c61-48c6-439c-9fbd-87b334d2f8b0 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.497060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-781a3c61-48c6-439c-9fbd-87b334d2f8b0 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.497546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-781a3c61-48c6-439c-9fbd-87b334d2f8b0 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.497972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-781a3c61-48c6-439c-9fbd-87b334d2f8b0 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.522081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-97c4ac3e-e3f4-4fae-8b9f-5db93bc6cabf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:53.523540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-97c4ac3e-e3f4-4fae-8b9f-5db93bc6cabf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:53.537562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97c4ac3e-e3f4-4fae-8b9f-5db93bc6cabf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.539031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97c4ac3e-e3f4-4fae-8b9f-5db93bc6cabf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.539668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97c4ac3e-e3f4-4fae-8b9f-5db93bc6cabf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.540541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97c4ac3e-e3f4-4fae-8b9f-5db93bc6cabf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.541258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97c4ac3e-e3f4-4fae-8b9f-5db93bc6cabf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.541985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97c4ac3e-e3f4-4fae-8b9f-5db93bc6cabf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.635132 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-781a3c61-48c6-439c-9fbd-87b334d2f8b0 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action" status: 202 len: 0 microversion: 2.1 time: 0.154770 Oct 18 13:18:53.640296 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 392/791] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:53 2022] POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:18:53.646426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b7f85e4f-b95a-4a0f-bf8f-32da938f621a tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:53.647520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b7f85e4f-b95a-4a0f-bf8f-32da938f621a tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:53.656787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7f85e4f-b95a-4a0f-bf8f-32da938f621a tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.657705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7f85e4f-b95a-4a0f-bf8f-32da938f621a tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.658964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7f85e4f-b95a-4a0f-bf8f-32da938f621a tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.660930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7f85e4f-b95a-4a0f-bf8f-32da938f621a tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.662435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7f85e4f-b95a-4a0f-bf8f-32da938f621a tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.663326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7f85e4f-b95a-4a0f-bf8f-32da938f621a tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.804478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-97c4ac3e-e3f4-4fae-8b9f-5db93bc6cabf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:53.816955 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-97c4ac3e-e3f4-4fae-8b9f-5db93bc6cabf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1463 microversion: 2.1 time: 0.299109 Oct 18 13:18:53.818414 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 400/792] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:53 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1463 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:18:53.827408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-807ea6cc-9761-4099-ae69-4dd6234af7a6 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:53.829116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-807ea6cc-9761-4099-ae69-4dd6234af7a6 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:53.845518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-807ea6cc-9761-4099-ae69-4dd6234af7a6 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.847056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-807ea6cc-9761-4099-ae69-4dd6234af7a6 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.848131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-807ea6cc-9761-4099-ae69-4dd6234af7a6 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:53.850593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-807ea6cc-9761-4099-ae69-4dd6234af7a6 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:53.852219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-807ea6cc-9761-4099-ae69-4dd6234af7a6 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:53.854272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-807ea6cc-9761-4099-ae69-4dd6234af7a6 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:54.003702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-807ea6cc-9761-4099-ae69-4dd6234af7a6 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee57dfe126fa4254b75455250e61d7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd15b3d39ec044d9f853b681d5886b622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:54.020292 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-807ea6cc-9761-4099-ae69-4dd6234af7a6 tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 200 len: 1435 microversion: 2.1 time: 0.200107 Oct 18 13:18:54.024853 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 401/793] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:53 2022] GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 1435 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:54.053754 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b7f85e4f-b95a-4a0f-bf8f-32da938f621a tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1615 microversion: 2.1 time: 0.411799 Oct 18 13:18:54.059123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:54.064916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:54.066024 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 393/794] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:53 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1615 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:54.080281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-f475a3b3-a38b-4772-8554-1fc24f939d86 req-f5fc33a0-8f97-47fb-8e75-9e3029a3f7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a279ff8b-eb06-4bb1-b9d4-f92566e98422", "name": "network-vif-deleted", "tag": "4cfb37b8-4b2c-46de-ab6d-9c082187a0c1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:54.091332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:54.091652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f475a3b3-a38b-4772-8554-1fc24f939d86 req-f5fc33a0-8f97-47fb-8e75-9e3029a3f7f0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:54.092430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:54.092775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f475a3b3-a38b-4772-8554-1fc24f939d86 req-f5fc33a0-8f97-47fb-8e75-9e3029a3f7f0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:54.093440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f475a3b3-a38b-4772-8554-1fc24f939d86 req-f5fc33a0-8f97-47fb-8e75-9e3029a3f7f0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:54.093968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:54.095433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:54.096443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:54.098779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:54.124186 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f475a3b3-a38b-4772-8554-1fc24f939d86 req-f5fc33a0-8f97-47fb-8e75-9e3029a3f7f0 service nova] Creating event network-vif-deleted:4cfb37b8-4b2c-46de-ab6d-9c082187a0c1 for instance a279ff8b-eb06-4bb1-b9d4-f92566e98422 on n-h2-858384-13 Oct 18 13:18:54.135960 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-f475a3b3-a38b-4772-8554-1fc24f939d86 req-f5fc33a0-8f97-47fb-8e75-9e3029a3f7f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068560 Oct 18 13:18:54.138665 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 394/795] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:54.148336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cea335cd-0585-4c44-9185-15927b219b73 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:54.153594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cea335cd-0585-4c44-9185-15927b219b73 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:54.164003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:54.169254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cea335cd-0585-4c44-9185-15927b219b73 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:54.169695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cea335cd-0585-4c44-9185-15927b219b73 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:54.171614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cea335cd-0585-4c44-9185-15927b219b73 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:54.172639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cea335cd-0585-4c44-9185-15927b219b73 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:54.181811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cea335cd-0585-4c44-9185-15927b219b73 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:54.182398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cea335cd-0585-4c44-9185-15927b219b73 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:54.338498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:54.362957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Old instance type m1.heat2, new instance type m1.heat {{(pid=120611) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 13:18:54.387232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:18:54.387704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:18:54.389713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:18:54.390161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:18:54.391700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:18:54.623961 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cea335cd-0585-4c44-9185-15927b219b73 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1615 microversion: 2.1 time: 0.482241 Oct 18 13:18:54.638158 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 395/796] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:54 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1615 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:54.642158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0cfadb21-327d-45fe-881a-f1682c9909b0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:54.644551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0cfadb21-327d-45fe-881a-f1682c9909b0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:54.648105 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6efbfe91-51ec-4ca6-9370-7bd3e27e38ca tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "POST /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c/action" status: 202 len: 0 microversion: 2.1 time: 0.621206 Oct 18 13:18:54.649790 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 402/797] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:54 2022] POST /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:18:54.655240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7530fd23-2aa6-4747-aa3f-c57bb9d23e46 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:54.663761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7530fd23-2aa6-4747-aa3f-c57bb9d23e46 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Searching by: {'host': 'n-h1-858384-13', 'deleted': False} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:18:54.669848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cfadb21-327d-45fe-881a-f1682c9909b0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:54.670348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cfadb21-327d-45fe-881a-f1682c9909b0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:54.670787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cfadb21-327d-45fe-881a-f1682c9909b0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:54.671542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cfadb21-327d-45fe-881a-f1682c9909b0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:54.671988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cfadb21-327d-45fe-881a-f1682c9909b0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:54.672693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cfadb21-327d-45fe-881a-f1682c9909b0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:54.673053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7530fd23-2aa6-4747-aa3f-c57bb9d23e46 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:54.674499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7530fd23-2aa6-4747-aa3f-c57bb9d23e46 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:54.676141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7530fd23-2aa6-4747-aa3f-c57bb9d23e46 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:54.681327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7530fd23-2aa6-4747-aa3f-c57bb9d23e46 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:54.682034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7530fd23-2aa6-4747-aa3f-c57bb9d23e46 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:54.684845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7530fd23-2aa6-4747-aa3f-c57bb9d23e46 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:54.901764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-7530fd23-2aa6-4747-aa3f-c57bb9d23e46 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:18:54.988713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0cfadb21-327d-45fe-881a-f1682c9909b0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:55.012569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0cfadb21-327d-45fe-881a-f1682c9909b0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:55.017887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0cfadb21-327d-45fe-881a-f1682c9909b0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:55.030019 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0cfadb21-327d-45fe-881a-f1682c9909b0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1567 microversion: 2.25 time: 0.403289 Oct 18 13:18:55.032668 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 396/798] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:54 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1567 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:55.045250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dff8bb91-9839-4e0d-b7a9-3da890a971ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:55.048899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dff8bb91-9839-4e0d-b7a9-3da890a971ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:55.073801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dff8bb91-9839-4e0d-b7a9-3da890a971ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:55.074654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dff8bb91-9839-4e0d-b7a9-3da890a971ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:55.075794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dff8bb91-9839-4e0d-b7a9-3da890a971ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:55.076787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dff8bb91-9839-4e0d-b7a9-3da890a971ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:55.077844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dff8bb91-9839-4e0d-b7a9-3da890a971ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:55.078451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dff8bb91-9839-4e0d-b7a9-3da890a971ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:55.228330 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7530fd23-2aa6-4747-aa3f-c57bb9d23e46 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "GET /compute/v2.1/servers?host=n-h1-858384-13&all_tenants=1" status: 200 len: 1338 microversion: 2.1 time: 0.577149 Oct 18 13:18:55.230338 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 403/799] 10.222.0.40 () {58 vars in 1192 bytes} [Tue Oct 18 13:18:54 2022] GET /compute/v2.1/servers?host=n-h1-858384-13&all_tenants=1 => generated 1338 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:55.245677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f3ec00e-4e6c-48ae-b853-8fdb1cebbabd tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:55.247689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7f3ec00e-4e6c-48ae-b853-8fdb1cebbabd tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] [instance: a279ff8b-eb06-4bb1-b9d4-f92566e98422] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:55.261310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f3ec00e-4e6c-48ae-b853-8fdb1cebbabd tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:55.263521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f3ec00e-4e6c-48ae-b853-8fdb1cebbabd tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:55.265459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f3ec00e-4e6c-48ae-b853-8fdb1cebbabd tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:55.266510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f3ec00e-4e6c-48ae-b853-8fdb1cebbabd tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:55.269135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f3ec00e-4e6c-48ae-b853-8fdb1cebbabd tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:55.271348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f3ec00e-4e6c-48ae-b853-8fdb1cebbabd tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:55.300013 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-7f3ec00e-4e6c-48ae-b853-8fdb1cebbabd tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] HTTP exception thrown: Instance a279ff8b-eb06-4bb1-b9d4-f92566e98422 could not be found. Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f3ec00e-4e6c-48ae-b853-8fdb1cebbabd tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Request method failure captured: Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 HTTP/1.1 Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqd6VxhsBeQ03Y2xk7WP-VD9-6EQLvlfBKOqUzdKwmdhwALm5H9e5jLRr40G0z5subiRBWxjTGuTQK6EP3hqhSLab2yYfP2BrhbhwcqdM5TG7Qb8VDxTzcUlIQKaKa5yRxON6Q7JjwDGDmE2PPCahjwIvu7-wc6p3BzEHn9ixjmUVIs Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d15b3d39ec044d9f853b681d5886b622 Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1569643558 Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:18:55.304685 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:18:55.306177 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d15b3d39ec044d9f853b681d5886b622"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d15b3d39ec044d9f853b681d5886b622"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d15b3d39ec044d9f853b681d5886b622"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d15b3d39ec044d9f853b681d5886b622"}]}] Oct 18 13:18:55.306177 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1569643558 Oct 18 13:18:55.306177 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d15b3d39ec044d9f853b681d5886b622 Oct 18 13:18:55.306177 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1569643558 Oct 18 13:18:55.306177 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersAdminNegativeTestJSON-1569643558-project Oct 18 13:18:55.306177 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:18:55.306177 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:18:55.306177 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: ee57dfe126fa4254b75455250e61d7be Oct 18 13:18:55.306177 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1569643558-project Oct 18 13:18:55.306177 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:18:55.306177 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance a279ff8b-eb06-4bb1-b9d4-f92566e98422 could not be found. Oct 18 13:18:55.306177 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'a279ff8b-eb06-4bb1-b9d4-f92566e98422'} Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a279ff8b-eb06-4bb1-b9d4-f92566e98422 could not be found. Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:18:55.306880 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a279ff8b-eb06-4bb1-b9d4-f92566e98422 could not be found. Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a279ff8b-eb06-4bb1-b9d4-f92566e98422 could not be found. Oct 18 13:18:55.308003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:18:55.310411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f3ec00e-4e6c-48ae-b853-8fdb1cebbabd tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] Returning 404 to user: Instance a279ff8b-eb06-4bb1-b9d4-f92566e98422 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:18:55.314338 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7f3ec00e-4e6c-48ae-b853-8fdb1cebbabd tempest-ServersAdminNegativeTestJSON-1569643558 tempest-ServersAdminNegativeTestJSON-1569643558-project] 10.222.0.40 "GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422" status: 404 len: 111 microversion: 2.1 time: 0.082918 Oct 18 13:18:55.315559 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 404/800] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:55 2022] GET /compute/v2.1/servers/a279ff8b-eb06-4bb1-b9d4-f92566e98422 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:18:55.328827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-968351a3-b947-4b3f-82f5-8d691d1b6171 req-6f386e5b-b8b5-4b88-900b-bf91a86421f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b550c78b-caf6-44ea-a613-978bac95b4fe", "tag": "f691b18b-7542-4132-925b-d3a8fa57fcae"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:55.353845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-968351a3-b947-4b3f-82f5-8d691d1b6171 req-6f386e5b-b8b5-4b88-900b-bf91a86421f7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:55.354543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-968351a3-b947-4b3f-82f5-8d691d1b6171 req-6f386e5b-b8b5-4b88-900b-bf91a86421f7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:55.355563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-968351a3-b947-4b3f-82f5-8d691d1b6171 req-6f386e5b-b8b5-4b88-900b-bf91a86421f7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:55.381143 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-968351a3-b947-4b3f-82f5-8d691d1b6171 req-6f386e5b-b8b5-4b88-900b-bf91a86421f7 service nova] Creating event network-changed:f691b18b-7542-4132-925b-d3a8fa57fcae for instance b550c78b-caf6-44ea-a613-978bac95b4fe on n-h2-858384-13 Oct 18 13:18:55.406549 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-968351a3-b947-4b3f-82f5-8d691d1b6171 req-6f386e5b-b8b5-4b88-900b-bf91a86421f7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086318 Oct 18 13:18:55.407838 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 405/801] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:55.445884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4b8e697-6b7f-4c03-ba5a-d39a69706236 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:55.464562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e4b8e697-6b7f-4c03-ba5a-d39a69706236 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:18:55.470963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dff8bb91-9839-4e0d-b7a9-3da890a971ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:55.479821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b8e697-6b7f-4c03-ba5a-d39a69706236 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:55.480925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b8e697-6b7f-4c03-ba5a-d39a69706236 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:55.481593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b8e697-6b7f-4c03-ba5a-d39a69706236 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:55.482527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b8e697-6b7f-4c03-ba5a-d39a69706236 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:55.482791 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dff8bb91-9839-4e0d-b7a9-3da890a971ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1472 microversion: 2.1 time: 0.444766 Oct 18 13:18:55.483797 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 397/802] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:55 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1472 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:55.484509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b8e697-6b7f-4c03-ba5a-d39a69706236 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:55.484944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b8e697-6b7f-4c03-ba5a-d39a69706236 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:55.529939 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e4b8e697-6b7f-4c03-ba5a-d39a69706236 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.120299 Oct 18 13:18:55.530724 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 406/803] 10.222.0.40 () {58 vars in 1196 bytes} [Tue Oct 18 13:18:55 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:18:55.543869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-51ce4837-f1a7-4826-a4d4-bda313122608 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:55.546647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-51ce4837-f1a7-4826-a4d4-bda313122608 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:55.561595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51ce4837-f1a7-4826-a4d4-bda313122608 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:55.562553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51ce4837-f1a7-4826-a4d4-bda313122608 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:55.563177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51ce4837-f1a7-4826-a4d4-bda313122608 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:55.564085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51ce4837-f1a7-4826-a4d4-bda313122608 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:55.565715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51ce4837-f1a7-4826-a4d4-bda313122608 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:55.569791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51ce4837-f1a7-4826-a4d4-bda313122608 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:55.679465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:55.728509 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-51ce4837-f1a7-4826-a4d4-bda313122608 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action" status: 202 len: 0 microversion: 2.1 time: 0.189078 Oct 18 13:18:55.729341 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 407/804] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:55 2022] POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:18:55.738810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:55.742316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:55.764530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:55.765019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:55.765484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:55.766190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:55.766657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:55.768716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:55.934774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:18:55.935431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:18:55.936057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:18:55.937674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:18:55.938277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:18:55.968414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-381670341", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:18:56.086275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:18:56.087570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:56.099415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:56.100518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:56.101817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:56.103026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:56.106591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:56.107266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:56.235472 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d1a8292c-4533-47c0-9cb0-d2fe91e44529 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action" status: 202 len: 1066 microversion: 2.1 time: 0.500777 Oct 18 13:18:56.246975 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 408/805] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:18:55 2022] POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action => generated 1066 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 13:18:56.278478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-df194524-ad4e-4346-9128-7a0300eac10b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:56.283563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-df194524-ad4e-4346-9128-7a0300eac10b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:56.324655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df194524-ad4e-4346-9128-7a0300eac10b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:56.329441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df194524-ad4e-4346-9128-7a0300eac10b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:56.329941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df194524-ad4e-4346-9128-7a0300eac10b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:56.330680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df194524-ad4e-4346-9128-7a0300eac10b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:56.342207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df194524-ad4e-4346-9128-7a0300eac10b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:56.342463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df194524-ad4e-4346-9128-7a0300eac10b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:57.018475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:18:57.019596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:18:57.022478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:18:57.023271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:18:57.024299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:18:57.042961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:57.043908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:57.044817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:57.045928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:57.046920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:57.048189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:57.078866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Getting quotas for project 8b25d34a33834e5e8861dc30586f56a4. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:18:57.081038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-df194524-ad4e-4346-9128-7a0300eac10b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:57.088694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Getting quotas for user dcacade4c71a4ba9b16b896418771de5 and project 8b25d34a33834e5e8861dc30586f56a4. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:18:57.099820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-df194524-ad4e-4346-9128-7a0300eac10b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:57.101275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-df194524-ad4e-4346-9128-7a0300eac10b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:57.104886 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-df194524-ad4e-4346-9128-7a0300eac10b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1567 microversion: 2.25 time: 0.856178 Oct 18 13:18:57.124654 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 409/806] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:56 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1567 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:57.135138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-acaaef1f-ce2d-4595-aa45-bb2720d08305 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:57.135733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:18:57.138406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-acaaef1f-ce2d-4595-aa45-bb2720d08305 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:57.138718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:18:57.147971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acaaef1f-ce2d-4595-aa45-bb2720d08305 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:57.149172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acaaef1f-ce2d-4595-aa45-bb2720d08305 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:57.150281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acaaef1f-ce2d-4595-aa45-bb2720d08305 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:57.151397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acaaef1f-ce2d-4595-aa45-bb2720d08305 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:57.152168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acaaef1f-ce2d-4595-aa45-bb2720d08305 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:57.152892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acaaef1f-ce2d-4595-aa45-bb2720d08305 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:57.263309 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bc416273-14e2-4e18-9e8d-d7226e0eca40 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.731022 Oct 18 13:18:57.265113 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 398/807] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:18:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:18:57.275739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dc493278-c9b7-4354-9c43-8f115dc375ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:57.286165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dc493278-c9b7-4354-9c43-8f115dc375ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:57.300734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc493278-c9b7-4354-9c43-8f115dc375ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:57.301384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc493278-c9b7-4354-9c43-8f115dc375ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:57.303465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc493278-c9b7-4354-9c43-8f115dc375ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:57.304985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc493278-c9b7-4354-9c43-8f115dc375ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:57.305538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc493278-c9b7-4354-9c43-8f115dc375ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:57.308255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc493278-c9b7-4354-9c43-8f115dc375ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:57.698770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-acaaef1f-ce2d-4595-aa45-bb2720d08305 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:57.708622 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-acaaef1f-ce2d-4595-aa45-bb2720d08305 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1470 microversion: 2.1 time: 0.596840 Oct 18 13:18:57.709238 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 410/808] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:57 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1470 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:57.720091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13d9d158-92a4-43c4-b549-818552e1e864 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:57.720698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-13d9d158-92a4-43c4-b549-818552e1e864 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:57.729213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dc493278-c9b7-4354-9c43-8f115dc375ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:57.740242 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dc493278-c9b7-4354-9c43-8f115dc375ae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1472 microversion: 2.1 time: 0.472100 Oct 18 13:18:57.754391 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 399/809] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:57 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1472 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:58.109376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-13d9d158-92a4-43c4-b549-818552e1e864 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:58.124515 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13d9d158-92a4-43c4-b549-818552e1e864 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1216 microversion: 2.1 time: 0.409102 Oct 18 13:18:58.125655 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 411/810] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:57 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1216 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:58.134261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-62110f19-8a64-4534-b115-6c3bca374c5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:58.135436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-62110f19-8a64-4534-b115-6c3bca374c5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:58.147174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62110f19-8a64-4534-b115-6c3bca374c5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:58.151404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62110f19-8a64-4534-b115-6c3bca374c5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:58.152093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62110f19-8a64-4534-b115-6c3bca374c5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:58.152884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62110f19-8a64-4534-b115-6c3bca374c5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:58.155913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62110f19-8a64-4534-b115-6c3bca374c5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:58.156423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62110f19-8a64-4534-b115-6c3bca374c5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:58.339637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-62110f19-8a64-4534-b115-6c3bca374c5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:58.350419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-62110f19-8a64-4534-b115-6c3bca374c5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:58.352020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-62110f19-8a64-4534-b115-6c3bca374c5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:58.353489 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-62110f19-8a64-4534-b115-6c3bca374c5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1567 microversion: 2.25 time: 0.225093 Oct 18 13:18:58.354443 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 400/811] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:58 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:18:58.738197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-627ee3e0-efe2-456f-9ed0-f867b506cc75 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:58.740452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-627ee3e0-efe2-456f-9ed0-f867b506cc75 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:58.750084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-627ee3e0-efe2-456f-9ed0-f867b506cc75 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:58.755604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-627ee3e0-efe2-456f-9ed0-f867b506cc75 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:58.756299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-627ee3e0-efe2-456f-9ed0-f867b506cc75 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:58.758377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-627ee3e0-efe2-456f-9ed0-f867b506cc75 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:58.759095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-627ee3e0-efe2-456f-9ed0-f867b506cc75 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:58.759769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-627ee3e0-efe2-456f-9ed0-f867b506cc75 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:58.776880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c9b94c44-0757-48ad-8c7f-9ce4133f68a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:58.777438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c9b94c44-0757-48ad-8c7f-9ce4133f68a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:58.784358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9b94c44-0757-48ad-8c7f-9ce4133f68a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:58.784866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9b94c44-0757-48ad-8c7f-9ce4133f68a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:58.790014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9b94c44-0757-48ad-8c7f-9ce4133f68a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:58.794067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9b94c44-0757-48ad-8c7f-9ce4133f68a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:58.794735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9b94c44-0757-48ad-8c7f-9ce4133f68a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:58.795483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9b94c44-0757-48ad-8c7f-9ce4133f68a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:59.340014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-627ee3e0-efe2-456f-9ed0-f867b506cc75 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:59.352165 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-627ee3e0-efe2-456f-9ed0-f867b506cc75 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1470 microversion: 2.1 time: 0.620764 Oct 18 13:18:59.354717 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 412/812] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:58 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1470 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:59.361877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ad65f2a3-e7ac-4c9b-8536-5b3323bdc4fd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:59.362728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ad65f2a3-e7ac-4c9b-8536-5b3323bdc4fd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:59.364817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:18:59.382734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad65f2a3-e7ac-4c9b-8536-5b3323bdc4fd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:59.383912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad65f2a3-e7ac-4c9b-8536-5b3323bdc4fd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:59.384381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad65f2a3-e7ac-4c9b-8536-5b3323bdc4fd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:59.385106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad65f2a3-e7ac-4c9b-8536-5b3323bdc4fd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:59.385827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad65f2a3-e7ac-4c9b-8536-5b3323bdc4fd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:59.386512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad65f2a3-e7ac-4c9b-8536-5b3323bdc4fd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:59.433453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c9b94c44-0757-48ad-8c7f-9ce4133f68a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:59.446871 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c9b94c44-0757-48ad-8c7f-9ce4133f68a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1472 microversion: 2.1 time: 0.670339 Oct 18 13:18:59.447668 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 401/813] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:58 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1472 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:59.459134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c7303030-013f-4707-9f94-f06c311c5dd3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:59.460289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c7303030-013f-4707-9f94-f06c311c5dd3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:18:59.502337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7303030-013f-4707-9f94-f06c311c5dd3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:59.504294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7303030-013f-4707-9f94-f06c311c5dd3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:59.506035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7303030-013f-4707-9f94-f06c311c5dd3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:59.507175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7303030-013f-4707-9f94-f06c311c5dd3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:18:59.507638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7303030-013f-4707-9f94-f06c311c5dd3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:18:59.510306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7303030-013f-4707-9f94-f06c311c5dd3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:18:59.556219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ad65f2a3-e7ac-4c9b-8536-5b3323bdc4fd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:18:59.579714 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ad65f2a3-e7ac-4c9b-8536-5b3323bdc4fd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1268 microversion: 2.1 time: 0.222152 Oct 18 13:18:59.581919 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 413/814] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:18:59 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1268 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:18:59.885221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cc5d8ad6-3fc6-4e0b-9b2a-d91c170357af tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:59.905568 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cc5d8ad6-3fc6-4e0b-9b2a-d91c170357af tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.293139 Oct 18 13:18:59.909399 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 414/815] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:18:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:18:59.949961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2889dd5a-1480-4b38-aed7-373cf8885e88 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:18:59.987457 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2889dd5a-1480-4b38-aed7-373cf8885e88 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 3079 microversion: 2.1 time: 0.064891 Oct 18 13:18:59.988195 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 415/816] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 13:18:59 2022] GET /compute/v2.1/flavors => generated 3079 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:00.012788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-05be5596-ebd6-407c-a112-fb87328077be tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.026159 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-05be5596-ebd6-407c-a112-fb87328077be tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019786 Oct 18 13:19:00.036127 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 416/817] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:00.049725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-80a5498e-67d1-4820-9161-cfe883853744 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.061141 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-80a5498e-67d1-4820-9161-cfe883853744 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022361 Oct 18 13:19:00.071285 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 417/818] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:00.077368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1c460881-5edc-4b06-82ce-08154a0ad742 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.127461 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1c460881-5edc-4b06-82ce-08154a0ad742 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.054648 Oct 18 13:19:00.128284 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 418/819] 10.222.0.40 () {58 vars in 1165 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:00.153861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93336858-4d1a-4458-b37e-014ea87982a8 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.174306 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-93336858-4d1a-4458-b37e-014ea87982a8 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025304 Oct 18 13:19:00.184807 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 419/820] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:00.189600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ce8796ee-75d7-4868-a6bd-32f45129a3a8 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.229855 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ce8796ee-75d7-4868-a6bd-32f45129a3a8 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.043849 Oct 18 13:19:00.230720 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 420/821] 10.222.0.40 () {58 vars in 1169 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:00.246778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d8d314a2-fc24-4162-b7a2-ca5d23f4929e tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.253849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c7303030-013f-4707-9f94-f06c311c5dd3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:00.262819 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d8d314a2-fc24-4162-b7a2-ca5d23f4929e tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.019675 Oct 18 13:19:00.263255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c7303030-013f-4707-9f94-f06c311c5dd3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:00.263723 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 421/822] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:00.265033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c7303030-013f-4707-9f94-f06c311c5dd3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:00.266438 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c7303030-013f-4707-9f94-f06c311c5dd3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1567 microversion: 2.25 time: 0.817825 Oct 18 13:19:00.267346 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 402/823] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:18:59 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1567 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:00.289878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e177f24e-f053-462f-bb85-67c428658d66 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.324032 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e177f24e-f053-462f-bb85-67c428658d66 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044838 Oct 18 13:19:00.324630 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 422/824] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:00.339026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-24839cab-a8e7-4c5b-a56d-14a9dba5e284 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.382104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-859ad8d6-bef3-4051-9832-972af6974bb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.382816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-859ad8d6-bef3-4051-9832-972af6974bb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:00.389507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-859ad8d6-bef3-4051-9832-972af6974bb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:00.390033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-859ad8d6-bef3-4051-9832-972af6974bb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:00.390466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-859ad8d6-bef3-4051-9832-972af6974bb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:00.391167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-859ad8d6-bef3-4051-9832-972af6974bb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:00.391614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-859ad8d6-bef3-4051-9832-972af6974bb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:00.392031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-859ad8d6-bef3-4051-9832-972af6974bb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:00.393150 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-24839cab-a8e7-4c5b-a56d-14a9dba5e284 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.060258 Oct 18 13:19:00.395253 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 403/825] 10.222.0.40 () {58 vars in 1167 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:00.413828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f673d65e-c6d0-4a91-90a2-30c40d49c859 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.424975 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f673d65e-c6d0-4a91-90a2-30c40d49c859 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015371 Oct 18 13:19:00.433471 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 404/826] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:19:00.439018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d192c49a-869e-4cde-b3c5-585db93f1d61 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.474982 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d192c49a-869e-4cde-b3c5-585db93f1d61 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.039516 Oct 18 13:19:00.475593 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 405/827] 10.222.0.40 () {58 vars in 1144 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:00.486753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-248d2d68-17d5-4a35-b39b-f36872138aa6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.487761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-248d2d68-17d5-4a35-b39b-f36872138aa6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:00.494818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-248d2d68-17d5-4a35-b39b-f36872138aa6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:00.495454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-248d2d68-17d5-4a35-b39b-f36872138aa6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:00.495885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-248d2d68-17d5-4a35-b39b-f36872138aa6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:00.496725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-248d2d68-17d5-4a35-b39b-f36872138aa6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:00.497199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-248d2d68-17d5-4a35-b39b-f36872138aa6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:00.497620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-248d2d68-17d5-4a35-b39b-f36872138aa6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:00.564716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-859ad8d6-bef3-4051-9832-972af6974bb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:00.573147 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-859ad8d6-bef3-4051-9832-972af6974bb1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1470 microversion: 2.1 time: 0.195493 Oct 18 13:19:00.573765 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 423/828] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:00.578232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b0fa03eb-8796-47c5-a619-e3595e817e83 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.586310 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b0fa03eb-8796-47c5-a619-e3595e817e83 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011477 Oct 18 13:19:00.587207 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 424/829] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:00.599978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-862abbd4-4def-446a-8d5d-e803d5d5d0bc tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.616755 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-862abbd4-4def-446a-8d5d-e803d5d5d0bc tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.021464 Oct 18 13:19:00.617406 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 425/830] 10.222.0.40 () {58 vars in 1148 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:00.621964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a39fa555-9908-4faa-b190-02904fdc693b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.622569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a39fa555-9908-4faa-b190-02904fdc693b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:00.630905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a39fa555-9908-4faa-b190-02904fdc693b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:00.631383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a39fa555-9908-4faa-b190-02904fdc693b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:00.631813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a39fa555-9908-4faa-b190-02904fdc693b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:00.632501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a39fa555-9908-4faa-b190-02904fdc693b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:00.632946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a39fa555-9908-4faa-b190-02904fdc693b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:00.633399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a39fa555-9908-4faa-b190-02904fdc693b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:00.700832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a39fa555-9908-4faa-b190-02904fdc693b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:00.709155 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a39fa555-9908-4faa-b190-02904fdc693b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1274 microversion: 2.1 time: 0.090726 Oct 18 13:19:00.710348 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 426/831] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:00.715677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0c281e9a-5f81-40b7-84e7-4191a858fb7c tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.728132 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0c281e9a-5f81-40b7-84e7-4191a858fb7c tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.017353 Oct 18 13:19:00.728927 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 427/832] 10.222.0.40 () {58 vars in 1140 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:00.741111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-798264fc-bb46-4b06-a7ef-63fffccf3dd5 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.750263 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-798264fc-bb46-4b06-a7ef-63fffccf3dd5 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012970 Oct 18 13:19:00.750830 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 428/833] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:19:00.763179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f1d443b5-9774-4fc0-aa06-71d3dc2ed663 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.805113 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f1d443b5-9774-4fc0-aa06-71d3dc2ed663 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.045586 Oct 18 13:19:00.805733 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 429/834] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:00.819867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13adde0b-b5d4-4d29-bfaf-1b41abb3cfc7 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.842065 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13adde0b-b5d4-4d29-bfaf-1b41abb3cfc7 tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.026237 Oct 18 13:19:00.842999 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 430/835] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:00.862372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c4f19149-ff69-444b-9bfc-95a3458ee4fa tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:00.870988 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c4f19149-ff69-444b-9bfc-95a3458ee4fa tempest-FlavorsV2TestJSON-1691981146 tempest-FlavorsV2TestJSON-1691981146-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012400 Oct 18 13:19:00.871768 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 431/836] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:19:01.032990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-248d2d68-17d5-4a35-b39b-f36872138aa6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:01.071527 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-248d2d68-17d5-4a35-b39b-f36872138aa6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 0.592904 Oct 18 13:19:01.074094 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 406/837] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:00 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:01.292547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c1e2a58-d884-4dc0-8ba3-0a55d4b346dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:01.293159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4c1e2a58-d884-4dc0-8ba3-0a55d4b346dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:01.301434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c1e2a58-d884-4dc0-8ba3-0a55d4b346dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:01.302963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c1e2a58-d884-4dc0-8ba3-0a55d4b346dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:01.303474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c1e2a58-d884-4dc0-8ba3-0a55d4b346dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:01.304575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c1e2a58-d884-4dc0-8ba3-0a55d4b346dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:01.305761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c1e2a58-d884-4dc0-8ba3-0a55d4b346dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:01.309787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c1e2a58-d884-4dc0-8ba3-0a55d4b346dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:01.531884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c1e2a58-d884-4dc0-8ba3-0a55d4b346dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:01.563736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c1e2a58-d884-4dc0-8ba3-0a55d4b346dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:01.568563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c1e2a58-d884-4dc0-8ba3-0a55d4b346dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:01.570592 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4c1e2a58-d884-4dc0-8ba3-0a55d4b346dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1567 microversion: 2.25 time: 0.282540 Oct 18 13:19:01.589041 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 432/838] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:01 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1567 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:01.603823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d48d0432-8622-4110-aee5-dc0ca6e04bc9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:01.604457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d48d0432-8622-4110-aee5-dc0ca6e04bc9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:01.620800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d48d0432-8622-4110-aee5-dc0ca6e04bc9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:01.621325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d48d0432-8622-4110-aee5-dc0ca6e04bc9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:01.621764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d48d0432-8622-4110-aee5-dc0ca6e04bc9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:01.622467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d48d0432-8622-4110-aee5-dc0ca6e04bc9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:01.622920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d48d0432-8622-4110-aee5-dc0ca6e04bc9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:01.623344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d48d0432-8622-4110-aee5-dc0ca6e04bc9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:01.733579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0cdb4c3d-b41d-4794-a5e3-c459cdd4e0ba tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:01.734203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0cdb4c3d-b41d-4794-a5e3-c459cdd4e0ba tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:01.754537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cdb4c3d-b41d-4794-a5e3-c459cdd4e0ba tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:01.762221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cdb4c3d-b41d-4794-a5e3-c459cdd4e0ba tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:01.762677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cdb4c3d-b41d-4794-a5e3-c459cdd4e0ba tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:01.763689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cdb4c3d-b41d-4794-a5e3-c459cdd4e0ba tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:01.764161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cdb4c3d-b41d-4794-a5e3-c459cdd4e0ba tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:01.764589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cdb4c3d-b41d-4794-a5e3-c459cdd4e0ba tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:01.992416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0cdb4c3d-b41d-4794-a5e3-c459cdd4e0ba tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:02.021604 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0cdb4c3d-b41d-4794-a5e3-c459cdd4e0ba tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1274 microversion: 2.1 time: 0.292407 Oct 18 13:19:02.041594 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 433/839] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:01 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1274 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:02.101356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-999928a8-fd34-4660-9987-4a3c274874b6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:02.102654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-999928a8-fd34-4660-9987-4a3c274874b6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:02.112632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-999928a8-fd34-4660-9987-4a3c274874b6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:02.113462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-999928a8-fd34-4660-9987-4a3c274874b6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:02.114134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-999928a8-fd34-4660-9987-4a3c274874b6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:02.115528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-999928a8-fd34-4660-9987-4a3c274874b6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:02.116103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-999928a8-fd34-4660-9987-4a3c274874b6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:02.116617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-999928a8-fd34-4660-9987-4a3c274874b6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:02.327174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-999928a8-fd34-4660-9987-4a3c274874b6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:02.337354 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-999928a8-fd34-4660-9987-4a3c274874b6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 0.240888 Oct 18 13:19:02.337476 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 434/840] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:02 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:02.449074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d48d0432-8622-4110-aee5-dc0ca6e04bc9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:02.458618 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d48d0432-8622-4110-aee5-dc0ca6e04bc9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1470 microversion: 2.1 time: 0.858900 Oct 18 13:19:02.460158 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 407/841] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:01 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1470 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:02.603765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dc3f0905-e9ae-4f2e-a4ca-b25e74e9c6da tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:02.605311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dc3f0905-e9ae-4f2e-a4ca-b25e74e9c6da tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:02.616021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc3f0905-e9ae-4f2e-a4ca-b25e74e9c6da tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:02.616548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc3f0905-e9ae-4f2e-a4ca-b25e74e9c6da tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:02.616951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc3f0905-e9ae-4f2e-a4ca-b25e74e9c6da tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:02.617957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc3f0905-e9ae-4f2e-a4ca-b25e74e9c6da tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:02.618394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc3f0905-e9ae-4f2e-a4ca-b25e74e9c6da tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:02.618816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc3f0905-e9ae-4f2e-a4ca-b25e74e9c6da tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:02.858846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc3f0905-e9ae-4f2e-a4ca-b25e74e9c6da tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:02.877901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc3f0905-e9ae-4f2e-a4ca-b25e74e9c6da tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:02.879786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc3f0905-e9ae-4f2e-a4ca-b25e74e9c6da tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:02.882119 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dc3f0905-e9ae-4f2e-a4ca-b25e74e9c6da tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1567 microversion: 2.25 time: 0.285191 Oct 18 13:19:02.900198 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 435/842] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:02 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1567 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:03.050681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-251dae2b-77bb-4d65-af1d-a45c54ab1660 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:03.051307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-251dae2b-77bb-4d65-af1d-a45c54ab1660 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:03.079446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-251dae2b-77bb-4d65-af1d-a45c54ab1660 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:03.080383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-251dae2b-77bb-4d65-af1d-a45c54ab1660 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:03.082352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-251dae2b-77bb-4d65-af1d-a45c54ab1660 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:03.085269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-251dae2b-77bb-4d65-af1d-a45c54ab1660 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:03.085919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-251dae2b-77bb-4d65-af1d-a45c54ab1660 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:03.086697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-251dae2b-77bb-4d65-af1d-a45c54ab1660 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:03.361954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3fa75045-0668-4fca-9610-3d88a34cbd42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:03.362772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3fa75045-0668-4fca-9610-3d88a34cbd42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:03.369970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa75045-0668-4fca-9610-3d88a34cbd42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:03.370717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa75045-0668-4fca-9610-3d88a34cbd42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:03.371341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa75045-0668-4fca-9610-3d88a34cbd42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:03.372054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa75045-0668-4fca-9610-3d88a34cbd42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:03.372501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa75045-0668-4fca-9610-3d88a34cbd42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:03.373086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa75045-0668-4fca-9610-3d88a34cbd42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:03.532201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3fa75045-0668-4fca-9610-3d88a34cbd42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:03.542488 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3fa75045-0668-4fca-9610-3d88a34cbd42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 0.185233 Oct 18 13:19:03.543352 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 436/843] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:03 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:03.548714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-66bd21b8-4b21-4f46-a6db-de9cb02cb41a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:03.549738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-66bd21b8-4b21-4f46-a6db-de9cb02cb41a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:03.559903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66bd21b8-4b21-4f46-a6db-de9cb02cb41a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:03.560699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66bd21b8-4b21-4f46-a6db-de9cb02cb41a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:03.561129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66bd21b8-4b21-4f46-a6db-de9cb02cb41a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:03.562177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66bd21b8-4b21-4f46-a6db-de9cb02cb41a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:03.562632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66bd21b8-4b21-4f46-a6db-de9cb02cb41a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:03.563049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66bd21b8-4b21-4f46-a6db-de9cb02cb41a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:03.753627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-66bd21b8-4b21-4f46-a6db-de9cb02cb41a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:03.764391 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-66bd21b8-4b21-4f46-a6db-de9cb02cb41a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1470 microversion: 2.1 time: 0.219448 Oct 18 13:19:03.765720 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 437/844] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:03 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:03.818755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-251dae2b-77bb-4d65-af1d-a45c54ab1660 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:03.826918 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-251dae2b-77bb-4d65-af1d-a45c54ab1660 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1316 microversion: 2.1 time: 0.780805 Oct 18 13:19:03.827994 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 408/845] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:03 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1316 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:03.912967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-af7521fb-7efa-4998-8e08-a322b743016e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:03.913936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-af7521fb-7efa-4998-8e08-a322b743016e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:03.920755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af7521fb-7efa-4998-8e08-a322b743016e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:03.921429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af7521fb-7efa-4998-8e08-a322b743016e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:03.922588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af7521fb-7efa-4998-8e08-a322b743016e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:03.923730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af7521fb-7efa-4998-8e08-a322b743016e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:03.924485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af7521fb-7efa-4998-8e08-a322b743016e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:03.925213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af7521fb-7efa-4998-8e08-a322b743016e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:04.270065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-af7521fb-7efa-4998-8e08-a322b743016e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:04.280889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:04.286360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-af7521fb-7efa-4998-8e08-a322b743016e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:04.288465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-af7521fb-7efa-4998-8e08-a322b743016e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:04.290651 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-af7521fb-7efa-4998-8e08-a322b743016e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1567 microversion: 2.25 time: 0.384600 Oct 18 13:19:04.291813 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 438/846] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:03 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1567 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:04.569339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f785e983-f1ec-40dd-9774-e5709b0690c2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:04.569953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f785e983-f1ec-40dd-9774-e5709b0690c2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:04.586971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f785e983-f1ec-40dd-9774-e5709b0690c2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:04.587659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f785e983-f1ec-40dd-9774-e5709b0690c2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:04.588275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f785e983-f1ec-40dd-9774-e5709b0690c2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:04.589146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f785e983-f1ec-40dd-9774-e5709b0690c2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:04.589871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f785e983-f1ec-40dd-9774-e5709b0690c2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:04.590294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f785e983-f1ec-40dd-9774-e5709b0690c2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:04.790886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fe31b8ae-93ee-47c0-8a59-5ce17accb2f5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:04.791511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fe31b8ae-93ee-47c0-8a59-5ce17accb2f5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:04.802462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe31b8ae-93ee-47c0-8a59-5ce17accb2f5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:04.803597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe31b8ae-93ee-47c0-8a59-5ce17accb2f5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:04.804207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe31b8ae-93ee-47c0-8a59-5ce17accb2f5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:04.805071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe31b8ae-93ee-47c0-8a59-5ce17accb2f5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:04.805693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe31b8ae-93ee-47c0-8a59-5ce17accb2f5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:04.806267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe31b8ae-93ee-47c0-8a59-5ce17accb2f5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:05.018057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f785e983-f1ec-40dd-9774-e5709b0690c2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:05.028945 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f785e983-f1ec-40dd-9774-e5709b0690c2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 0.465126 Oct 18 13:19:05.032203 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 409/847] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:04 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:05.037750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-52e89799-2b87-4c71-b351-01b549997508 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:05.045346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-52e89799-2b87-4c71-b351-01b549997508 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:05.057483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52e89799-2b87-4c71-b351-01b549997508 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:05.057970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52e89799-2b87-4c71-b351-01b549997508 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:05.058407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52e89799-2b87-4c71-b351-01b549997508 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:05.059649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52e89799-2b87-4c71-b351-01b549997508 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:05.059649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52e89799-2b87-4c71-b351-01b549997508 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:05.059969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52e89799-2b87-4c71-b351-01b549997508 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:05.064350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:05.322230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-52e89799-2b87-4c71-b351-01b549997508 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:05.336580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fe31b8ae-93ee-47c0-8a59-5ce17accb2f5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:05.353967 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fe31b8ae-93ee-47c0-8a59-5ce17accb2f5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1470 microversion: 2.1 time: 0.567899 Oct 18 13:19:05.356114 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-52e89799-2b87-4c71-b351-01b549997508 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1316 microversion: 2.1 time: 0.322569 Oct 18 13:19:05.356823 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 410/848] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:05 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:05.361647 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 439/849] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:04 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1470 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:05.366128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-525f988e-c111-4137-aac9-b37a67b7d577 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:05.367214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-525f988e-c111-4137-aac9-b37a67b7d577 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:05.376765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-525f988e-c111-4137-aac9-b37a67b7d577 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:05.377614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-525f988e-c111-4137-aac9-b37a67b7d577 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:05.378299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-525f988e-c111-4137-aac9-b37a67b7d577 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:05.379218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-525f988e-c111-4137-aac9-b37a67b7d577 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:05.381044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-525f988e-c111-4137-aac9-b37a67b7d577 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:05.382026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-525f988e-c111-4137-aac9-b37a67b7d577 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:05.497683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-0f7a31b7-6a66-48f3-8833-d387828946c9 req-4be6e52a-5db8-423b-bb15-83f84df3d282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "938746d4-6297-49a5-811f-89814a1e182b", "tag": "a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:05.511658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=18 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:05.516183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0f7a31b7-6a66-48f3-8833-d387828946c9 req-4be6e52a-5db8-423b-bb15-83f84df3d282 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:05.518291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0f7a31b7-6a66-48f3-8833-d387828946c9 req-4be6e52a-5db8-423b-bb15-83f84df3d282 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:05.521642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0f7a31b7-6a66-48f3-8833-d387828946c9 req-4be6e52a-5db8-423b-bb15-83f84df3d282 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:05.562881 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-0f7a31b7-6a66-48f3-8833-d387828946c9 req-4be6e52a-5db8-423b-bb15-83f84df3d282 service nova] Creating event network-changed:a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1 for instance 938746d4-6297-49a5-811f-89814a1e182b on n-h2-858384-13 Oct 18 13:19:05.575031 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-0f7a31b7-6a66-48f3-8833-d387828946c9 req-4be6e52a-5db8-423b-bb15-83f84df3d282 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080855 Oct 18 13:19:05.578579 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 440/850] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:05.789436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-525f988e-c111-4137-aac9-b37a67b7d577 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:05.805131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-525f988e-c111-4137-aac9-b37a67b7d577 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:05.807861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-525f988e-c111-4137-aac9-b37a67b7d577 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:05.836378 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-525f988e-c111-4137-aac9-b37a67b7d577 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1567 microversion: 2.25 time: 0.452374 Oct 18 13:19:05.853117 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 411/851] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:05 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1567 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:06.058327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba5f9d5e-99fb-4999-ba49-be8942dc5b6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:06.059061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ba5f9d5e-99fb-4999-ba49-be8942dc5b6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:06.070750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba5f9d5e-99fb-4999-ba49-be8942dc5b6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:06.074709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba5f9d5e-99fb-4999-ba49-be8942dc5b6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:06.076776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba5f9d5e-99fb-4999-ba49-be8942dc5b6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:06.080552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba5f9d5e-99fb-4999-ba49-be8942dc5b6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:06.112542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba5f9d5e-99fb-4999-ba49-be8942dc5b6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:06.114405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba5f9d5e-99fb-4999-ba49-be8942dc5b6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:06.387645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cdf16938-435d-4b4c-b9e8-c5b545d371d0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:06.388512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cdf16938-435d-4b4c-b9e8-c5b545d371d0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:06.405170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cdf16938-435d-4b4c-b9e8-c5b545d371d0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:06.407450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cdf16938-435d-4b4c-b9e8-c5b545d371d0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:06.408123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cdf16938-435d-4b4c-b9e8-c5b545d371d0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:06.410128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cdf16938-435d-4b4c-b9e8-c5b545d371d0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:06.411218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cdf16938-435d-4b4c-b9e8-c5b545d371d0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:06.413279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cdf16938-435d-4b4c-b9e8-c5b545d371d0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:06.488729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba5f9d5e-99fb-4999-ba49-be8942dc5b6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:06.500550 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ba5f9d5e-99fb-4999-ba49-be8942dc5b6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 0.447617 Oct 18 13:19:06.501733 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 441/852] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:06 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:06.522770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3af2e523-64c5-4c52-b23d-55b5650623b7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:06.523598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3af2e523-64c5-4c52-b23d-55b5650623b7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:06.534731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3af2e523-64c5-4c52-b23d-55b5650623b7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:06.539955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3af2e523-64c5-4c52-b23d-55b5650623b7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:06.540776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3af2e523-64c5-4c52-b23d-55b5650623b7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:06.541717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3af2e523-64c5-4c52-b23d-55b5650623b7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:06.542363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3af2e523-64c5-4c52-b23d-55b5650623b7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:06.542944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3af2e523-64c5-4c52-b23d-55b5650623b7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:06.773108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cdf16938-435d-4b4c-b9e8-c5b545d371d0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:06.781071 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cdf16938-435d-4b4c-b9e8-c5b545d371d0 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1470 microversion: 2.1 time: 0.403742 Oct 18 13:19:06.781773 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 412/853] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:06 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1470 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:06.865025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-85b99609-7d61-40d4-81cd-3855046459c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:06.866421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-85b99609-7d61-40d4-81cd-3855046459c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:06.876412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85b99609-7d61-40d4-81cd-3855046459c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:06.882230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85b99609-7d61-40d4-81cd-3855046459c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:06.883114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85b99609-7d61-40d4-81cd-3855046459c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:06.884086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85b99609-7d61-40d4-81cd-3855046459c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:06.886804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85b99609-7d61-40d4-81cd-3855046459c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:06.887440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85b99609-7d61-40d4-81cd-3855046459c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:06.954949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3af2e523-64c5-4c52-b23d-55b5650623b7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:06.967805 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3af2e523-64c5-4c52-b23d-55b5650623b7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1316 microversion: 2.1 time: 0.464644 Oct 18 13:19:06.974121 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 442/854] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:06 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:07.064213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=22 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:07.111783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=10 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:07.526840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-301fa0cd-179b-4d7e-a6dc-8bdba7966f02 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:07.528688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-301fa0cd-179b-4d7e-a6dc-8bdba7966f02 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:07.544138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-301fa0cd-179b-4d7e-a6dc-8bdba7966f02 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:07.545920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-301fa0cd-179b-4d7e-a6dc-8bdba7966f02 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:07.546929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-301fa0cd-179b-4d7e-a6dc-8bdba7966f02 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:07.551077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-301fa0cd-179b-4d7e-a6dc-8bdba7966f02 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:07.552588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-301fa0cd-179b-4d7e-a6dc-8bdba7966f02 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:07.553737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-301fa0cd-179b-4d7e-a6dc-8bdba7966f02 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:07.888601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-301fa0cd-179b-4d7e-a6dc-8bdba7966f02 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:07.897326 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-301fa0cd-179b-4d7e-a6dc-8bdba7966f02 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 0.374234 Oct 18 13:19:07.898565 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 443/855] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:07 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:07.903292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e30160a-f4c2-4946-9174-369ca62be339 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:07.904058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4e30160a-f4c2-4946-9174-369ca62be339 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:07.920715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e30160a-f4c2-4946-9174-369ca62be339 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:07.921641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e30160a-f4c2-4946-9174-369ca62be339 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:07.922491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e30160a-f4c2-4946-9174-369ca62be339 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:07.923386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e30160a-f4c2-4946-9174-369ca62be339 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:07.924065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e30160a-f4c2-4946-9174-369ca62be339 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:07.924833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e30160a-f4c2-4946-9174-369ca62be339 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:07.987558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-85b99609-7d61-40d4-81cd-3855046459c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:08.007150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-85b99609-7d61-40d4-81cd-3855046459c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:08.008795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-85b99609-7d61-40d4-81cd-3855046459c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:08.010238 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-85b99609-7d61-40d4-81cd-3855046459c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1542 microversion: 2.25 time: 1.149823 Oct 18 13:19:08.010823 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 413/856] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:06 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1542 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:08.023781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-03fe4f5c-af2d-418e-94d8-eb7043c06632 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:08.029242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-03fe4f5c-af2d-418e-94d8-eb7043c06632 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:08.044057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03fe4f5c-af2d-418e-94d8-eb7043c06632 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:08.044544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03fe4f5c-af2d-418e-94d8-eb7043c06632 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:08.044973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03fe4f5c-af2d-418e-94d8-eb7043c06632 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:08.045694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03fe4f5c-af2d-418e-94d8-eb7043c06632 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:08.046141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03fe4f5c-af2d-418e-94d8-eb7043c06632 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:08.046552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03fe4f5c-af2d-418e-94d8-eb7043c06632 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:08.115679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:08.189524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4e30160a-f4c2-4946-9174-369ca62be339 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:08.206106 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4e30160a-f4c2-4946-9174-369ca62be339 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1470 microversion: 2.1 time: 0.301000 Oct 18 13:19:08.206797 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 444/857] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:07 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1470 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:08.211540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-51faf82d-25a2-46ee-91f4-f35e305c0be0 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '.version_select at 0x7ff60fa75430>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:08.215020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51faf82d-25a2-46ee-91f4-f35e305c0be0 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:08.215513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51faf82d-25a2-46ee-91f4-f35e305c0be0 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:08.215946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51faf82d-25a2-46ee-91f4-f35e305c0be0 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:08.251135 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-51faf82d-25a2-46ee-91f4-f35e305c0be0 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1717 microversion: 2.25 time: 0.043196 Oct 18 13:19:08.251731 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 445/858] 10.222.0.40 () {60 vars in 1184 bytes} [Tue Oct 18 13:19:08 2022] GET /compute/v2.1/os-migrations => generated 1717 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:08.423605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-26da669d-eb0b-4bce-b3f4-626769491880 tempest-FloatingIPsNegativeTestJSON-1569309781 tempest-FloatingIPsNegativeTestJSON-1569309781-project] Calling method '.version_select at 0x7ff60f918ee0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:08.534407 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-26da669d-eb0b-4bce-b3f4-626769491880 tempest-FloatingIPsNegativeTestJSON-1569309781 tempest-FloatingIPsNegativeTestJSON-1569309781-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.280700 Oct 18 13:19:08.545112 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 446/859] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 18 13:19:08 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:19:08.551487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c5558ea5-d9a4-4a68-b46b-b216fa895f30 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:08.560646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c5558ea5-d9a4-4a68-b46b-b216fa895f30 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:08.589213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5558ea5-d9a4-4a68-b46b-b216fa895f30 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:08.590204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5558ea5-d9a4-4a68-b46b-b216fa895f30 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:08.591668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5558ea5-d9a4-4a68-b46b-b216fa895f30 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:08.592499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5558ea5-d9a4-4a68-b46b-b216fa895f30 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:08.593043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5558ea5-d9a4-4a68-b46b-b216fa895f30 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:08.595677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5558ea5-d9a4-4a68-b46b-b216fa895f30 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:08.618342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-03fe4f5c-af2d-418e-94d8-eb7043c06632 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:08.634146 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-03fe4f5c-af2d-418e-94d8-eb7043c06632 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1316 microversion: 2.1 time: 0.622195 Oct 18 13:19:08.635404 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 414/860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:08 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1316 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:08.642683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9ad88d7d-1f7c-4b0b-a6a8-62bef4a0e4ce tempest-FloatingIPsNegativeTestJSON-1569309781 tempest-FloatingIPsNegativeTestJSON-1569309781-project] Action: 'create', calling method: .version_select at 0x7ff60ff479d0>, body: {"pool": "non_exist_pool"} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:08.781591 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-9ad88d7d-1f7c-4b0b-a6a8-62bef4a0e4ce tempest-FloatingIPsNegativeTestJSON-1569309781 tempest-FloatingIPsNegativeTestJSON-1569309781-project] HTTP exception thrown: Floating IP pool not found. Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9ad88d7d-1f7c-4b0b-a6a8-62bef4a0e4ce tempest-FloatingIPsNegativeTestJSON-1569309781 tempest-FloatingIPsNegativeTestJSON-1569309781-project] Request method failure captured: Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 26 Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqfMCrwobwUJWtag9vZt-dL9I2dd0ahAWyG-M3idl0kv_dhQDCpEPVjlO1gtFRwH2JKuVg0YMhAa_1hVRsdhEzPWKTRs8vXELdO3kbxJjmvxmWRupXzH6O1empppMjqd5nT5AFp-n2owvmX0ypKejgN80TOItWhmhxO9JWzS0_rHa2Y Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: ec5539cff8dc4453966579dd99566e5b Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1569309781 Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:19:08.811549 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec5539cff8dc4453966579dd99566e5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ec5539cff8dc4453966579dd99566e5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec5539cff8dc4453966579dd99566e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ec5539cff8dc4453966579dd99566e5b"}]}] Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1569309781 Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: ec5539cff8dc4453966579dd99566e5b Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1569309781 Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FloatingIPsNegativeTestJSON-1569309781-project Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: b2713e2e804d4480bb7a6b06b2116423 Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1569309781-project Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: {"pool": "non_exist_pool"} Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: exception: Floating IP pool not found. Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 18 13:19:08.813143 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:19:08.815368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:08.817132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9ad88d7d-1f7c-4b0b-a6a8-62bef4a0e4ce tempest-FloatingIPsNegativeTestJSON-1569309781 tempest-FloatingIPsNegativeTestJSON-1569309781-project] Returning 404 to user: Floating IP pool not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:19:08.819157 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9ad88d7d-1f7c-4b0b-a6a8-62bef4a0e4ce tempest-FloatingIPsNegativeTestJSON-1569309781 tempest-FloatingIPsNegativeTestJSON-1569309781-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.181531 Oct 18 13:19:08.821957 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 415/861] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 18 13:19:08 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:19:08.835100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1586b7df-8d23-4e95-a8dc-8806a1b770c5 tempest-FloatingIPsNegativeTestJSON-1569309781 tempest-FloatingIPsNegativeTestJSON-1569309781-project] Calling method '.version_select at 0x7ff6143304c0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:08.864425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-c5558ea5-d9a4-4a68-b46b-b216fa895f30 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid b550c78b-caf6-44ea-a613-978bac95b4fe {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:19:08.892867 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c5558ea5-d9a4-4a68-b46b-b216fa895f30 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 2037 microversion: 2.25 time: 0.346384 Oct 18 13:19:08.894049 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 447/862] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:08 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 2037 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:08.934342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5c4914e9-8060-4967-86f2-f7cb6b47d594 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:08.934902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5c4914e9-8060-4967-86f2-f7cb6b47d594 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:08.941260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c4914e9-8060-4967-86f2-f7cb6b47d594 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:08.947057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c4914e9-8060-4967-86f2-f7cb6b47d594 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:08.947507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c4914e9-8060-4967-86f2-f7cb6b47d594 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:08.948257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c4914e9-8060-4967-86f2-f7cb6b47d594 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:08.948716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c4914e9-8060-4967-86f2-f7cb6b47d594 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:08.949145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c4914e9-8060-4967-86f2-f7cb6b47d594 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:08.964491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-1586b7df-8d23-4e95-a8dc-8806a1b770c5 tempest-FloatingIPsNegativeTestJSON-1569309781 tempest-FloatingIPsNegativeTestJSON-1569309781-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP fbd9365f-b307-4287-a0ab-a8580fffa423 could not be found", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:19:08.968284 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-1586b7df-8d23-4e95-a8dc-8806a1b770c5 tempest-FloatingIPsNegativeTestJSON-1569309781 tempest-FloatingIPsNegativeTestJSON-1569309781-project] HTTP exception thrown: Floating IP not found for ID fbd9365f-b307-4287-a0ab-a8580fffa423 Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1586b7df-8d23-4e95-a8dc-8806a1b770c5 tempest-FloatingIPsNegativeTestJSON-1569309781 tempest-FloatingIPsNegativeTestJSON-1569309781-project] Request method failure captured: Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-floating-ips/fbd9365f-b307-4287-a0ab-a8580fffa423 HTTP/1.1 Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqfMCrwobwUJWtag9vZt-dL9I2dd0ahAWyG-M3idl0kv_dhQDCpEPVjlO1gtFRwH2JKuVg0YMhAa_1hVRsdhEzPWKTRs8vXELdO3kbxJjmvxmWRupXzH6O1empppMjqd5nT5AFp-n2owvmX0ypKejgN80TOItWhmhxO9JWzS0_rHa2Y Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: ec5539cff8dc4453966579dd99566e5b Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1569309781 Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:19:08.980451 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:19:08.981893 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec5539cff8dc4453966579dd99566e5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ec5539cff8dc4453966579dd99566e5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ec5539cff8dc4453966579dd99566e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ec5539cff8dc4453966579dd99566e5b"}]}] Oct 18 13:19:08.981893 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1569309781 Oct 18 13:19:08.981893 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: ec5539cff8dc4453966579dd99566e5b Oct 18 13:19:08.981893 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1569309781 Oct 18 13:19:08.981893 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FloatingIPsNegativeTestJSON-1569309781-project Oct 18 13:19:08.981893 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:19:08.981893 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:19:08.981893 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: b2713e2e804d4480bb7a6b06b2116423 Oct 18 13:19:08.981893 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1569309781-project Oct 18 13:19:08.981893 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:19:08.981893 n-d-858384-13 devstack@n-api.service[120612]: exception: Floating IP not found for ID fbd9365f-b307-4287-a0ab-a8580fffa423 Oct 18 13:19:08.981893 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'fbd9365f-b307-4287-a0ab-a8580fffa423'} Oct 18 13:19:08.981893 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:19:08.982642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP fbd9365f-b307-4287-a0ab-a8580fffa423 could not be found Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec839820-244f-498f-981a-1a04d96e4753'] Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID fbd9365f-b307-4287-a0ab-a8580fffa423. Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:08.983753 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID fbd9365f-b307-4287-a0ab-a8580fffa423 Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:19:08.986281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:19:08.988251 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID fbd9365f-b307-4287-a0ab-a8580fffa423 Oct 18 13:19:08.988251 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:08.990440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1586b7df-8d23-4e95-a8dc-8806a1b770c5 tempest-FloatingIPsNegativeTestJSON-1569309781 tempest-FloatingIPsNegativeTestJSON-1569309781-project] Returning 404 to user: Floating IP not found for ID fbd9365f-b307-4287-a0ab-a8580fffa423 {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:19:08.991883 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1586b7df-8d23-4e95-a8dc-8806a1b770c5 tempest-FloatingIPsNegativeTestJSON-1569309781 tempest-FloatingIPsNegativeTestJSON-1569309781-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/fbd9365f-b307-4287-a0ab-a8580fffa423" status: 404 len: 111 microversion: 2.1 time: 0.164954 Oct 18 13:19:08.997819 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 416/863] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:19:08 2022] DELETE /compute/v2.1/os-floating-ips/fbd9365f-b307-4287-a0ab-a8580fffa423 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:19:09.011258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-47daf2d1-65ad-4447-9ae4-751325d359e0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Action: 'create', calling method: .version_select at 0x7ff614258700>, body: {"keypair": {"name": "tempest-keypair-997676696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD2PJRD+3j+r5JEJL4XQ2HCOEGNSjvxcblkilkAhTYtm0N7TNh05rt4dJ3b2Iagc1001mWCs0qtT+RYykfy5PecOfZSwIY3HQoBBQCiWg2jbzbF93Ye5XfYZuapxW3HaQ=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:09.048720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-47daf2d1-65ad-4447-9ae4-751325d359e0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Getting quotas for project e559a35e21d343adab5f772a17b745f9. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:09.065869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-47daf2d1-65ad-4447-9ae4-751325d359e0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Getting quotas for user 1bfaa3d005f94cf2a5bdf8e63d20ba3f and project e559a35e21d343adab5f772a17b745f9. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:09.104405 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-47daf2d1-65ad-4447-9ae4-751325d359e0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 13:19:09.201165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5c4914e9-8060-4967-86f2-f7cb6b47d594 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:09.211222 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5c4914e9-8060-4967-86f2-f7cb6b47d594 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 0.280722 Oct 18 13:19:09.212312 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 448/864] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:08 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:09.240490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0bf0d66f-af92-4d4d-bb3c-b9845d543e93 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:09.245343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0bf0d66f-af92-4d4d-bb3c-b9845d543e93 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:09.253138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0bf0d66f-af92-4d4d-bb3c-b9845d543e93 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:09.254119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0bf0d66f-af92-4d4d-bb3c-b9845d543e93 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:09.255434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0bf0d66f-af92-4d4d-bb3c-b9845d543e93 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:09.256682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0bf0d66f-af92-4d4d-bb3c-b9845d543e93 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:09.258961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0bf0d66f-af92-4d4d-bb3c-b9845d543e93 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:09.260615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0bf0d66f-af92-4d4d-bb3c-b9845d543e93 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:09.446700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0bf0d66f-af92-4d4d-bb3c-b9845d543e93 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:09.458232 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0bf0d66f-af92-4d4d-bb3c-b9845d543e93 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1476 microversion: 2.1 time: 0.230333 Oct 18 13:19:09.470969 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 449/865] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:09 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1476 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:09.661489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-925e75ac-085b-45b8-9af5-e6e16022999f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:09.662130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-925e75ac-085b-45b8-9af5-e6e16022999f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:09.673406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-925e75ac-085b-45b8-9af5-e6e16022999f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:09.674194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-925e75ac-085b-45b8-9af5-e6e16022999f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:09.674874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-925e75ac-085b-45b8-9af5-e6e16022999f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:09.675828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-925e75ac-085b-45b8-9af5-e6e16022999f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:09.677048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-925e75ac-085b-45b8-9af5-e6e16022999f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:09.677692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-925e75ac-085b-45b8-9af5-e6e16022999f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:09.867569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-925e75ac-085b-45b8-9af5-e6e16022999f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:09.878768 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-925e75ac-085b-45b8-9af5-e6e16022999f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1316 microversion: 2.1 time: 0.220957 Oct 18 13:19:09.882949 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 450/866] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:09 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:10.117087 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [None req-47daf2d1-65ad-4447-9ae4-751325d359e0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 35820. Oct 18 13:19:10.138959 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-47daf2d1-65ad-4447-9ae4-751325d359e0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 1.132327 Oct 18 13:19:10.140243 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 417/867] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 18 13:19:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1142 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 13:19:10.238654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-50584181-3e7c-43c4-a065-0a9d756fbb1f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:10.239884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-50584181-3e7c-43c4-a065-0a9d756fbb1f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:10.252446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50584181-3e7c-43c4-a065-0a9d756fbb1f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:10.254293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50584181-3e7c-43c4-a065-0a9d756fbb1f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:10.254885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50584181-3e7c-43c4-a065-0a9d756fbb1f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:10.255648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50584181-3e7c-43c4-a065-0a9d756fbb1f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:10.256104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50584181-3e7c-43c4-a065-0a9d756fbb1f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:10.256530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50584181-3e7c-43c4-a065-0a9d756fbb1f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:10.484604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-faa3e321-4eea-43c8-9dbb-fd63806f1b55 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:10.485585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-faa3e321-4eea-43c8-9dbb-fd63806f1b55 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:10.526415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-50584181-3e7c-43c4-a065-0a9d756fbb1f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:10.541313 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-50584181-3e7c-43c4-a065-0a9d756fbb1f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 0.306509 Oct 18 13:19:10.542516 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 451/868] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:10 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:10.546416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faa3e321-4eea-43c8-9dbb-fd63806f1b55 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:10.548805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faa3e321-4eea-43c8-9dbb-fd63806f1b55 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:10.549379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faa3e321-4eea-43c8-9dbb-fd63806f1b55 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:10.550110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faa3e321-4eea-43c8-9dbb-fd63806f1b55 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:10.550742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faa3e321-4eea-43c8-9dbb-fd63806f1b55 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:10.551368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faa3e321-4eea-43c8-9dbb-fd63806f1b55 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:10.902669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bdad40dc-af60-4cbf-9693-94fcf4039e99 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:10.904024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bdad40dc-af60-4cbf-9693-94fcf4039e99 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:10.911300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdad40dc-af60-4cbf-9693-94fcf4039e99 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:10.912244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdad40dc-af60-4cbf-9693-94fcf4039e99 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:10.912999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdad40dc-af60-4cbf-9693-94fcf4039e99 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:10.914078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdad40dc-af60-4cbf-9693-94fcf4039e99 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:10.914830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdad40dc-af60-4cbf-9693-94fcf4039e99 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:10.915598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdad40dc-af60-4cbf-9693-94fcf4039e99 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:11.171421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-faa3e321-4eea-43c8-9dbb-fd63806f1b55 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:11.191621 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-faa3e321-4eea-43c8-9dbb-fd63806f1b55 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1476 microversion: 2.1 time: 0.710528 Oct 18 13:19:11.196567 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 418/869] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:10 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1476 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:11.252921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bdad40dc-af60-4cbf-9693-94fcf4039e99 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:11.265338 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bdad40dc-af60-4cbf-9693-94fcf4039e99 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1316 microversion: 2.1 time: 0.366419 Oct 18 13:19:11.293510 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 452/870] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:10 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1316 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:11.567532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2e52d4ae-585d-4ecb-89db-2cf7a4a219a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:11.568464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2e52d4ae-585d-4ecb-89db-2cf7a4a219a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:11.575694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e52d4ae-585d-4ecb-89db-2cf7a4a219a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:11.576569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e52d4ae-585d-4ecb-89db-2cf7a4a219a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:11.577162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e52d4ae-585d-4ecb-89db-2cf7a4a219a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:11.578085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e52d4ae-585d-4ecb-89db-2cf7a4a219a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:11.578711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e52d4ae-585d-4ecb-89db-2cf7a4a219a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:11.579288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e52d4ae-585d-4ecb-89db-2cf7a4a219a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:12.120982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2e52d4ae-585d-4ecb-89db-2cf7a4a219a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:12.138499 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2e52d4ae-585d-4ecb-89db-2cf7a4a219a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 0.576067 Oct 18 13:19:12.140467 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 419/871] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:11 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:12.239141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5a54ce42-0010-45ae-88fd-9e5889732365 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:12.240005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5a54ce42-0010-45ae-88fd-9e5889732365 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:12.259155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a54ce42-0010-45ae-88fd-9e5889732365 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:12.261355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a54ce42-0010-45ae-88fd-9e5889732365 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:12.263054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a54ce42-0010-45ae-88fd-9e5889732365 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:12.263971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a54ce42-0010-45ae-88fd-9e5889732365 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:12.264587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a54ce42-0010-45ae-88fd-9e5889732365 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:12.265348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a54ce42-0010-45ae-88fd-9e5889732365 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:12.281955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-513949550", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "4367ae6a-74b6-4e77-aafe-63e7fdd7f6d6"}], "security_groups": [{"name": "tempest-securitygroup--1348020007"}], "key_name": "tempest-keypair-997676696", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:12.550198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5a54ce42-0010-45ae-88fd-9e5889732365 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:12.560428 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5a54ce42-0010-45ae-88fd-9e5889732365 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1476 microversion: 2.1 time: 0.344643 Oct 18 13:19:12.561278 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 453/872] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:12 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1476 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:12.575218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1f3ceadf-af58-4004-88c9-d4990cfe117b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:12.576251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1f3ceadf-af58-4004-88c9-d4990cfe117b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:12.583793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f3ceadf-af58-4004-88c9-d4990cfe117b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:12.584576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f3ceadf-af58-4004-88c9-d4990cfe117b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:12.585203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f3ceadf-af58-4004-88c9-d4990cfe117b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:12.586350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f3ceadf-af58-4004-88c9-d4990cfe117b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:12.586970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f3ceadf-af58-4004-88c9-d4990cfe117b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:12.587555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f3ceadf-af58-4004-88c9-d4990cfe117b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:12.705377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] validate_networks() for [('4367ae6a-74b6-4e77-aafe-63e7fdd7f6d6', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:19:12.797895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1f3ceadf-af58-4004-88c9-d4990cfe117b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:12.810137 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1f3ceadf-af58-4004-88c9-d4990cfe117b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1316 microversion: 2.1 time: 0.246277 Oct 18 13:19:12.826989 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 454/873] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:12 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:13.168061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-42c1a93a-ec4f-4b0e-a7e0-cc0c2ca923e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:13.169277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-42c1a93a-ec4f-4b0e-a7e0-cc0c2ca923e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:13.182009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42c1a93a-ec4f-4b0e-a7e0-cc0c2ca923e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:13.184643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42c1a93a-ec4f-4b0e-a7e0-cc0c2ca923e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:13.185485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42c1a93a-ec4f-4b0e-a7e0-cc0c2ca923e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:13.187727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42c1a93a-ec4f-4b0e-a7e0-cc0c2ca923e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:13.188381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42c1a93a-ec4f-4b0e-a7e0-cc0c2ca923e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:13.188967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42c1a93a-ec4f-4b0e-a7e0-cc0c2ca923e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:13.485297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-42c1a93a-ec4f-4b0e-a7e0-cc0c2ca923e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:13.497558 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-42c1a93a-ec4f-4b0e-a7e0-cc0c2ca923e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 0.336885 Oct 18 13:19:13.503611 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 455/874] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:13 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:13.584379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ff92444e-0692-4a4b-b8e6-fe0332b7fa5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:13.584996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ff92444e-0692-4a4b-b8e6-fe0332b7fa5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:13.603032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff92444e-0692-4a4b-b8e6-fe0332b7fa5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:13.603502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff92444e-0692-4a4b-b8e6-fe0332b7fa5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:13.603938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff92444e-0692-4a4b-b8e6-fe0332b7fa5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:13.604799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff92444e-0692-4a4b-b8e6-fe0332b7fa5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:13.605107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff92444e-0692-4a4b-b8e6-fe0332b7fa5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:13.605574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff92444e-0692-4a4b-b8e6-fe0332b7fa5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:13.831692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ff92444e-0692-4a4b-b8e6-fe0332b7fa5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:13.847162 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ff92444e-0692-4a4b-b8e6-fe0332b7fa5e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1476 microversion: 2.1 time: 0.265805 Oct 18 13:19:13.848602 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 456/875] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:13 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1476 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:13.860721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-52482ef1-1dfd-4704-aeb1-b70452d97a09 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:13.861107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-52482ef1-1dfd-4704-aeb1-b70452d97a09 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:13.868530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52482ef1-1dfd-4704-aeb1-b70452d97a09 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:13.869403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52482ef1-1dfd-4704-aeb1-b70452d97a09 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:13.869933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52482ef1-1dfd-4704-aeb1-b70452d97a09 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:13.870856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52482ef1-1dfd-4704-aeb1-b70452d97a09 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:13.871424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52482ef1-1dfd-4704-aeb1-b70452d97a09 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:13.871958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52482ef1-1dfd-4704-aeb1-b70452d97a09 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:13.901551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:14.101562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-52482ef1-1dfd-4704-aeb1-b70452d97a09 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:14.114784 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-52482ef1-1dfd-4704-aeb1-b70452d97a09 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1316 microversion: 2.1 time: 0.264139 Oct 18 13:19:14.115302 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 457/876] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:13 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:14.527996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-198e2f7b-6e7c-4dc4-851a-45543da8c910 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:14.529307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-198e2f7b-6e7c-4dc4-851a-45543da8c910 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:14.537282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-198e2f7b-6e7c-4dc4-851a-45543da8c910 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:14.539161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-198e2f7b-6e7c-4dc4-851a-45543da8c910 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:14.539929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-198e2f7b-6e7c-4dc4-851a-45543da8c910 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:14.540806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-198e2f7b-6e7c-4dc4-851a-45543da8c910 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:14.541445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-198e2f7b-6e7c-4dc4-851a-45543da8c910 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:14.542017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-198e2f7b-6e7c-4dc4-851a-45543da8c910 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:14.764940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-198e2f7b-6e7c-4dc4-851a-45543da8c910 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:14.782154 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-198e2f7b-6e7c-4dc4-851a-45543da8c910 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 0.258529 Oct 18 13:19:14.783476 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 458/877] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:14 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:14.803125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-932c672d-0485-4943-a509-8bfb380982b7 req-26b7c038-e6eb-445a-ad8b-1ac9250d197b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a", "name": "network-vif-unplugged", "status": "completed", "tag": "127093c0-7bb4-4851-9d3b-35d03d5712b9"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:14.819371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-932c672d-0485-4943-a509-8bfb380982b7 req-26b7c038-e6eb-445a-ad8b-1ac9250d197b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:14.820449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-932c672d-0485-4943-a509-8bfb380982b7 req-26b7c038-e6eb-445a-ad8b-1ac9250d197b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:14.822426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-932c672d-0485-4943-a509-8bfb380982b7 req-26b7c038-e6eb-445a-ad8b-1ac9250d197b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:14.836206 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-932c672d-0485-4943-a509-8bfb380982b7 req-26b7c038-e6eb-445a-ad8b-1ac9250d197b service nova] Creating event network-vif-unplugged:127093c0-7bb4-4851-9d3b-35d03d5712b9 for instance 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a on n-h1-858384-13 Oct 18 13:19:14.844619 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-932c672d-0485-4943-a509-8bfb380982b7 req-26b7c038-e6eb-445a-ad8b-1ac9250d197b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058867 Oct 18 13:19:14.846146 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 459/878] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:14.875594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13f122c0-88d4-4a7b-a69a-12106f0e131b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:14.876558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-13f122c0-88d4-4a7b-a69a-12106f0e131b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:14.884751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13f122c0-88d4-4a7b-a69a-12106f0e131b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:14.885555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13f122c0-88d4-4a7b-a69a-12106f0e131b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:14.886935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13f122c0-88d4-4a7b-a69a-12106f0e131b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:14.888134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13f122c0-88d4-4a7b-a69a-12106f0e131b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:14.888854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13f122c0-88d4-4a7b-a69a-12106f0e131b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:14.889673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13f122c0-88d4-4a7b-a69a-12106f0e131b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:14.952208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:19:14.955593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:19:14.958169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:19:14.958808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:19:14.959347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:19:14.978476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:14.978967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:14.979679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:14.981349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:14.982088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:14.982800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:15.029626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Getting quotas for project e559a35e21d343adab5f772a17b745f9. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:15.035917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Getting quotas for user 1bfaa3d005f94cf2a5bdf8e63d20ba3f and project e559a35e21d343adab5f772a17b745f9. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:15.053988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:19:15.056488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:19:15.135827 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3aeb220d-cf89-4486-ae03-b47f0ae28364 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.857893 Oct 18 13:19:15.137068 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 420/879] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:19:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 2860 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 18 13:19:15.155436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a32ba5c0-df49-40c6-8392-97b3465b52dd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:15.156336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a32ba5c0-df49-40c6-8392-97b3465b52dd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:15.179111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-13f122c0-88d4-4a7b-a69a-12106f0e131b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:15.188803 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13f122c0-88d4-4a7b-a69a-12106f0e131b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1476 microversion: 2.1 time: 0.317735 Oct 18 13:19:15.210696 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 460/880] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:14 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1476 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:15.223040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-94ea6d90-63c8-422e-b580-1769c44352bb tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:15.223665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-94ea6d90-63c8-422e-b580-1769c44352bb tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:15.244660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94ea6d90-63c8-422e-b580-1769c44352bb tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:15.245479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94ea6d90-63c8-422e-b580-1769c44352bb tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:15.246107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94ea6d90-63c8-422e-b580-1769c44352bb tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:15.248427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94ea6d90-63c8-422e-b580-1769c44352bb tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:15.249090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94ea6d90-63c8-422e-b580-1769c44352bb tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:15.249722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94ea6d90-63c8-422e-b580-1769c44352bb tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:15.329006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a32ba5c0-df49-40c6-8392-97b3465b52dd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:15.337144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a32ba5c0-df49-40c6-8392-97b3465b52dd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:15.338753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a32ba5c0-df49-40c6-8392-97b3465b52dd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:15.339927 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a32ba5c0-df49-40c6-8392-97b3465b52dd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1284 microversion: 2.25 time: 0.189102 Oct 18 13:19:15.340507 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 421/881] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:15 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:19:15.610383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-94ea6d90-63c8-422e-b580-1769c44352bb tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:15.619765 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-94ea6d90-63c8-422e-b580-1769c44352bb tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1316 microversion: 2.1 time: 0.407452 Oct 18 13:19:15.635078 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 461/882] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:15 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:15.818995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3fc54dee-bf63-482d-9de8-00d28bb343d3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:15.818995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3fc54dee-bf63-482d-9de8-00d28bb343d3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:15.840051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc54dee-bf63-482d-9de8-00d28bb343d3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:15.843409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc54dee-bf63-482d-9de8-00d28bb343d3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:15.854328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc54dee-bf63-482d-9de8-00d28bb343d3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:15.856434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc54dee-bf63-482d-9de8-00d28bb343d3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:15.857049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc54dee-bf63-482d-9de8-00d28bb343d3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:15.857523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc54dee-bf63-482d-9de8-00d28bb343d3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:16.229942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3db5b5e6-e8ef-4c2b-9f28-2be7ad076769 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:16.230628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3db5b5e6-e8ef-4c2b-9f28-2be7ad076769 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:16.250837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3db5b5e6-e8ef-4c2b-9f28-2be7ad076769 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:16.251351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3db5b5e6-e8ef-4c2b-9f28-2be7ad076769 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:16.251791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3db5b5e6-e8ef-4c2b-9f28-2be7ad076769 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:16.259224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3db5b5e6-e8ef-4c2b-9f28-2be7ad076769 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:16.259732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3db5b5e6-e8ef-4c2b-9f28-2be7ad076769 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:16.260171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3db5b5e6-e8ef-4c2b-9f28-2be7ad076769 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:16.925509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3db5b5e6-e8ef-4c2b-9f28-2be7ad076769 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:16.944948 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3db5b5e6-e8ef-4c2b-9f28-2be7ad076769 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1476 microversion: 2.1 time: 0.721289 Oct 18 13:19:16.947373 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 462/883] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:16 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1476 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:16.955115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e8d23a88-e8ac-41b0-894b-349a0db578d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:16.960504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e8d23a88-e8ac-41b0-894b-349a0db578d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:16.978231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8d23a88-e8ac-41b0-894b-349a0db578d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:16.979097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8d23a88-e8ac-41b0-894b-349a0db578d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:16.979846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8d23a88-e8ac-41b0-894b-349a0db578d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:16.981076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8d23a88-e8ac-41b0-894b-349a0db578d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:16.982591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8d23a88-e8ac-41b0-894b-349a0db578d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:16.984339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8d23a88-e8ac-41b0-894b-349a0db578d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:17.110391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e8d23a88-e8ac-41b0-894b-349a0db578d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:17.119227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3fc54dee-bf63-482d-9de8-00d28bb343d3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:17.125839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e8d23a88-e8ac-41b0-894b-349a0db578d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:17.127312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e8d23a88-e8ac-41b0-894b-349a0db578d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:17.128459 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e8d23a88-e8ac-41b0-894b-349a0db578d5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1336 microversion: 2.25 time: 0.178410 Oct 18 13:19:17.133919 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3fc54dee-bf63-482d-9de8-00d28bb343d3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 1.323306 Oct 18 13:19:17.135338 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 422/884] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:15 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:17.147351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6496a739-3a66-4412-9837-7c65fb934b9e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:17.148440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6496a739-3a66-4412-9837-7c65fb934b9e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:17.151365 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 463/885] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:16 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1336 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:17.163919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6496a739-3a66-4412-9837-7c65fb934b9e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:17.166852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6496a739-3a66-4412-9837-7c65fb934b9e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:17.169963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6496a739-3a66-4412-9837-7c65fb934b9e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:17.170952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6496a739-3a66-4412-9837-7c65fb934b9e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:17.173312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6496a739-3a66-4412-9837-7c65fb934b9e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:17.174146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6496a739-3a66-4412-9837-7c65fb934b9e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:17.177270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-543662c1-267c-4861-91de-2d0ca58dced4 req-9a9c1fa2-6769-4605-843e-85afb734b18a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938746d4-6297-49a5-811f-89814a1e182b", "name": "network-vif-plugged", "status": "completed", "tag": "a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:17.211947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:17.225973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-543662c1-267c-4861-91de-2d0ca58dced4 req-9a9c1fa2-6769-4605-843e-85afb734b18a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:17.226463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-543662c1-267c-4861-91de-2d0ca58dced4 req-9a9c1fa2-6769-4605-843e-85afb734b18a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:17.234142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-543662c1-267c-4861-91de-2d0ca58dced4 req-9a9c1fa2-6769-4605-843e-85afb734b18a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:17.272136 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-543662c1-267c-4861-91de-2d0ca58dced4 req-9a9c1fa2-6769-4605-843e-85afb734b18a service nova] Creating event network-vif-plugged:a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1 for instance 938746d4-6297-49a5-811f-89814a1e182b on n-h2-858384-13 Oct 18 13:19:17.288085 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-543662c1-267c-4861-91de-2d0ca58dced4 req-9a9c1fa2-6769-4605-843e-85afb734b18a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124066 Oct 18 13:19:17.289262 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 464/886] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:17.636651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6496a739-3a66-4412-9837-7c65fb934b9e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:17.648068 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6496a739-3a66-4412-9837-7c65fb934b9e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1316 microversion: 2.1 time: 0.510781 Oct 18 13:19:17.663716 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 423/887] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:17 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:17.975123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-be3764ea-b94e-448e-95bc-2b312948b223 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:17.976488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-be3764ea-b94e-448e-95bc-2b312948b223 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:17.991367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3764ea-b94e-448e-95bc-2b312948b223 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:17.996971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3764ea-b94e-448e-95bc-2b312948b223 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:17.997987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3764ea-b94e-448e-95bc-2b312948b223 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:17.998901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3764ea-b94e-448e-95bc-2b312948b223 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:18.000952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3764ea-b94e-448e-95bc-2b312948b223 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:18.001697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3764ea-b94e-448e-95bc-2b312948b223 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:18.157845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b50d2632-f781-4300-97bc-08fa8d097644 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:18.158458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b50d2632-f781-4300-97bc-08fa8d097644 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:18.170420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b50d2632-f781-4300-97bc-08fa8d097644 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:18.170420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b50d2632-f781-4300-97bc-08fa8d097644 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:18.170420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b50d2632-f781-4300-97bc-08fa8d097644 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:18.170420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b50d2632-f781-4300-97bc-08fa8d097644 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:18.170768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b50d2632-f781-4300-97bc-08fa8d097644 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:18.173515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b50d2632-f781-4300-97bc-08fa8d097644 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:18.356238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b50d2632-f781-4300-97bc-08fa8d097644 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:18.375949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b50d2632-f781-4300-97bc-08fa8d097644 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:18.377443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b50d2632-f781-4300-97bc-08fa8d097644 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:18.378618 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b50d2632-f781-4300-97bc-08fa8d097644 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1344 microversion: 2.25 time: 0.224737 Oct 18 13:19:18.379241 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 424/888] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:18 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1344 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:18.386330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-625731dc-0d18-4ff9-9812-ed88b432e27c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:18.395291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-625731dc-0d18-4ff9-9812-ed88b432e27c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:18.402845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-625731dc-0d18-4ff9-9812-ed88b432e27c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:18.405054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-625731dc-0d18-4ff9-9812-ed88b432e27c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:18.408821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-625731dc-0d18-4ff9-9812-ed88b432e27c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:18.409822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-625731dc-0d18-4ff9-9812-ed88b432e27c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:18.411012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-625731dc-0d18-4ff9-9812-ed88b432e27c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:18.413039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-be3764ea-b94e-448e-95bc-2b312948b223 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:18.413951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-625731dc-0d18-4ff9-9812-ed88b432e27c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:18.452836 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-be3764ea-b94e-448e-95bc-2b312948b223 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1476 microversion: 2.1 time: 0.481985 Oct 18 13:19:18.473392 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 465/889] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:17 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1476 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:18.676997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0ba25b1e-7c2f-40b0-a99c-e93379314421 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:18.677904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0ba25b1e-7c2f-40b0-a99c-e93379314421 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:18.691488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ba25b1e-7c2f-40b0-a99c-e93379314421 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:18.692938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ba25b1e-7c2f-40b0-a99c-e93379314421 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:18.701112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ba25b1e-7c2f-40b0-a99c-e93379314421 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:18.702217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ba25b1e-7c2f-40b0-a99c-e93379314421 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:18.702795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ba25b1e-7c2f-40b0-a99c-e93379314421 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:18.703291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ba25b1e-7c2f-40b0-a99c-e93379314421 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:19.026733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-625731dc-0d18-4ff9-9812-ed88b432e27c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:19.042903 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-625731dc-0d18-4ff9-9812-ed88b432e27c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 0.662507 Oct 18 13:19:19.043668 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 425/890] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:18 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:19.066206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0ba25b1e-7c2f-40b0-a99c-e93379314421 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:19.088834 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0ba25b1e-7c2f-40b0-a99c-e93379314421 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1316 microversion: 2.1 time: 0.414839 Oct 18 13:19:19.090034 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 466/891] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:18 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:19.338165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-9ed0df8f-cd56-400f-963d-76224061487e req-a875a753-544d-4db4-a556-bce7a57a3f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a", "name": "network-vif-plugged", "status": "completed", "tag": "127093c0-7bb4-4851-9d3b-35d03d5712b9"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:19.344228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:19.354184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9ed0df8f-cd56-400f-963d-76224061487e req-a875a753-544d-4db4-a556-bce7a57a3f38 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:19.356100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9ed0df8f-cd56-400f-963d-76224061487e req-a875a753-544d-4db4-a556-bce7a57a3f38 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:19.356713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9ed0df8f-cd56-400f-963d-76224061487e req-a875a753-544d-4db4-a556-bce7a57a3f38 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:19.374012 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-9ed0df8f-cd56-400f-963d-76224061487e req-a875a753-544d-4db4-a556-bce7a57a3f38 service nova] Creating event network-vif-plugged:127093c0-7bb4-4851-9d3b-35d03d5712b9 for instance 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a on n-h1-858384-13 Oct 18 13:19:19.380902 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-9ed0df8f-cd56-400f-963d-76224061487e req-a875a753-544d-4db4-a556-bce7a57a3f38 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046489 Oct 18 13:19:19.382370 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 426/892] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:19.414809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d99f2239-8c3a-4e4a-9c4c-6a9fc898df85 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:19.415641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d99f2239-8c3a-4e4a-9c4c-6a9fc898df85 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:19.424139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d99f2239-8c3a-4e4a-9c4c-6a9fc898df85 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:19.424889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d99f2239-8c3a-4e4a-9c4c-6a9fc898df85 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:19.427444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d99f2239-8c3a-4e4a-9c4c-6a9fc898df85 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:19.428816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d99f2239-8c3a-4e4a-9c4c-6a9fc898df85 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:19.429496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d99f2239-8c3a-4e4a-9c4c-6a9fc898df85 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:19.430231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d99f2239-8c3a-4e4a-9c4c-6a9fc898df85 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:19.483913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-30a6b76e-95da-425d-b4e0-0b5999479917 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:19.485078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-30a6b76e-95da-425d-b4e0-0b5999479917 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:19.498406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30a6b76e-95da-425d-b4e0-0b5999479917 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:19.499461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30a6b76e-95da-425d-b4e0-0b5999479917 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:19.500061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30a6b76e-95da-425d-b4e0-0b5999479917 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:19.501538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30a6b76e-95da-425d-b4e0-0b5999479917 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:19.503576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30a6b76e-95da-425d-b4e0-0b5999479917 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:19.505277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30a6b76e-95da-425d-b4e0-0b5999479917 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:19.717034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d99f2239-8c3a-4e4a-9c4c-6a9fc898df85 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:19.726659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d99f2239-8c3a-4e4a-9c4c-6a9fc898df85 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:19.734443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d99f2239-8c3a-4e4a-9c4c-6a9fc898df85 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:19.735818 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d99f2239-8c3a-4e4a-9c4c-6a9fc898df85 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1342 microversion: 2.25 time: 0.326566 Oct 18 13:19:19.743340 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 467/893] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:19 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1342 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:20.081019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1478d649-f05d-4a0d-8a45-9d1a11420d46 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:20.110532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1478d649-f05d-4a0d-8a45-9d1a11420d46 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:20.153724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1478d649-f05d-4a0d-8a45-9d1a11420d46 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:20.154560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1478d649-f05d-4a0d-8a45-9d1a11420d46 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:20.163371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1478d649-f05d-4a0d-8a45-9d1a11420d46 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:20.164977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1478d649-f05d-4a0d-8a45-9d1a11420d46 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:20.166954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1478d649-f05d-4a0d-8a45-9d1a11420d46 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:20.167618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1478d649-f05d-4a0d-8a45-9d1a11420d46 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:20.191121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-30a6b76e-95da-425d-b4e0-0b5999479917 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:20.236078 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-30a6b76e-95da-425d-b4e0-0b5999479917 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1476 microversion: 2.1 time: 0.743521 Oct 18 13:19:20.255824 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 427/894] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:19 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1476 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:20.283968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-77adc21d-7dce-43c4-b893-36d2252f1511 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:20.288038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-77adc21d-7dce-43c4-b893-36d2252f1511 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:20.331327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77adc21d-7dce-43c4-b893-36d2252f1511 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:20.333676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77adc21d-7dce-43c4-b893-36d2252f1511 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:20.339173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77adc21d-7dce-43c4-b893-36d2252f1511 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:20.343494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77adc21d-7dce-43c4-b893-36d2252f1511 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:20.344203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77adc21d-7dce-43c4-b893-36d2252f1511 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:20.347715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77adc21d-7dce-43c4-b893-36d2252f1511 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:20.548273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1478d649-f05d-4a0d-8a45-9d1a11420d46 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:20.569776 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1478d649-f05d-4a0d-8a45-9d1a11420d46 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1477 microversion: 2.1 time: 0.497226 Oct 18 13:19:20.572146 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 468/895] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:20 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1477 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:21.004844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-909c0ecd-ade2-46d8-afc7-6a02d1f5829d tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] Action: 'create', calling method: .version_select at 0x7ff60ffb21f0>, body: {"pool": null} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:21.159227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-77adc21d-7dce-43c4-b893-36d2252f1511 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:21.181984 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-77adc21d-7dce-43c4-b893-36d2252f1511 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1466 microversion: 2.1 time: 0.924680 Oct 18 13:19:21.217324 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 428/896] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:20 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1466 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:21.224111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d7d3cac2-8a4a-43a9-9f29-55762672abe1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:21.225005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d7d3cac2-8a4a-43a9-9f29-55762672abe1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:21.234405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7d3cac2-8a4a-43a9-9f29-55762672abe1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:21.235196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7d3cac2-8a4a-43a9-9f29-55762672abe1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:21.235968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7d3cac2-8a4a-43a9-9f29-55762672abe1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:21.236908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7d3cac2-8a4a-43a9-9f29-55762672abe1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:21.237570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7d3cac2-8a4a-43a9-9f29-55762672abe1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:21.238866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7d3cac2-8a4a-43a9-9f29-55762672abe1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:21.676598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d7d3cac2-8a4a-43a9-9f29-55762672abe1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:21.711742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d7d3cac2-8a4a-43a9-9f29-55762672abe1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:21.719570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d7d3cac2-8a4a-43a9-9f29-55762672abe1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:21.729115 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d7d3cac2-8a4a-43a9-9f29-55762672abe1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1410 microversion: 2.25 time: 0.502793 Oct 18 13:19:21.731062 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 429/897] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:21 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1410 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:21.742409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e5d29b4-423a-4955-bedb-c9db3534835f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-109411071", "metadata": {"image_type": "test"}}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:21.745918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0e5d29b4-423a-4955-bedb-c9db3534835f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:21.754849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e5d29b4-423a-4955-bedb-c9db3534835f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:21.756190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e5d29b4-423a-4955-bedb-c9db3534835f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:21.756928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e5d29b4-423a-4955-bedb-c9db3534835f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:21.759205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e5d29b4-423a-4955-bedb-c9db3534835f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:21.761247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e5d29b4-423a-4955-bedb-c9db3534835f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:21.762479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e5d29b4-423a-4955-bedb-c9db3534835f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:21.880228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0e5d29b4-423a-4955-bedb-c9db3534835f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Getting quotas for project 8b25d34a33834e5e8861dc30586f56a4. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:21.896263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0e5d29b4-423a-4955-bedb-c9db3534835f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Getting quotas for user dcacade4c71a4ba9b16b896418771de5 and project 8b25d34a33834e5e8861dc30586f56a4. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:22.365202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:22.454261 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e5d29b4-423a-4955-bedb-c9db3534835f tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "POST /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b/action" status: 202 len: 0 microversion: 2.1 time: 0.716345 Oct 18 13:19:22.455669 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 430/898] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:19:21 2022] POST /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b/action => generated 0 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:19:22.475057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-519e8e6c-d9c8-48df-974b-83221a8f966f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:22.476054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-519e8e6c-d9c8-48df-974b-83221a8f966f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:22.492918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-519e8e6c-d9c8-48df-974b-83221a8f966f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:22.498413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-519e8e6c-d9c8-48df-974b-83221a8f966f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:22.499354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-519e8e6c-d9c8-48df-974b-83221a8f966f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:22.502693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-519e8e6c-d9c8-48df-974b-83221a8f966f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:22.505057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-519e8e6c-d9c8-48df-974b-83221a8f966f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:22.506616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-519e8e6c-d9c8-48df-974b-83221a8f966f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:22.975805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-519e8e6c-d9c8-48df-974b-83221a8f966f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:22.996930 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-519e8e6c-d9c8-48df-974b-83221a8f966f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1462 microversion: 2.1 time: 0.533953 Oct 18 13:19:23.013216 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 431/899] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:22 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1462 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:23.391544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41357c31-b5a1-4848-885a-c2723e740acc tempest-FloatingIPDetailsNegativeTestJSON-1263133381 tempest-FloatingIPDetailsNegativeTestJSON-1263133381-project] Calling method '.version_select at 0x7ff614448940>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:23.434722 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-909c0ecd-ade2-46d8-afc7-6a02d1f5829d tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.861081 Oct 18 13:19:23.435588 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 469/900] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 18 13:19:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:23.448969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cc0820c9-cea0-45a3-979f-ce0f8591415f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:23.449681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cc0820c9-cea0-45a3-979f-ce0f8591415f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:23.467694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc0820c9-cea0-45a3-979f-ce0f8591415f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:23.468221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc0820c9-cea0-45a3-979f-ce0f8591415f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:23.468687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc0820c9-cea0-45a3-979f-ce0f8591415f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:23.469452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc0820c9-cea0-45a3-979f-ce0f8591415f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:23.473616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc0820c9-cea0-45a3-979f-ce0f8591415f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:23.474336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc0820c9-cea0-45a3-979f-ce0f8591415f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:23.642933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-41357c31-b5a1-4848-885a-c2723e740acc tempest-FloatingIPDetailsNegativeTestJSON-1263133381 tempest-FloatingIPDetailsNegativeTestJSON-1263133381-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f306274b-76f0-461d-be71-6bbf32575e03 could not be found", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:19:23.645312 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-41357c31-b5a1-4848-885a-c2723e740acc tempest-FloatingIPDetailsNegativeTestJSON-1263133381 tempest-FloatingIPDetailsNegativeTestJSON-1263133381-project] HTTP exception thrown: Floating IP not found for ID f306274b-76f0-461d-be71-6bbf32575e03 Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41357c31-b5a1-4848-885a-c2723e740acc tempest-FloatingIPDetailsNegativeTestJSON-1263133381 tempest-FloatingIPDetailsNegativeTestJSON-1263133381-project] Request method failure captured: Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-floating-ips/f306274b-76f0-461d-be71-6bbf32575e03 HTTP/1.1 Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqfZbhXYj8ZGaJ0Z_9UHQui60ZlyIvaKrOu1o6kFRBbLXgVscP2AyeK_g5U3c0-fpfaelRNy7MXb1UfBiA4uJRlbVUJQ_8r6fF9fqA3W7kyT2Xj0Ywp8J6j-M4NSn_JnpwYB0VjIPX95ZN_3oQCtEakcYGm7BDPA_SPOSFeNYs59wmQ Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 321d37bc58064d639ab77a920d9cf550 Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1263133381 Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:19:23.652001 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:19:23.653647 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/321d37bc58064d639ab77a920d9cf550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/321d37bc58064d639ab77a920d9cf550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/321d37bc58064d639ab77a920d9cf550"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_321d37bc58064d639ab77a920d9cf550"}]}] Oct 18 13:19:23.653647 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1263133381 Oct 18 13:19:23.653647 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 321d37bc58064d639ab77a920d9cf550 Oct 18 13:19:23.653647 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1263133381 Oct 18 13:19:23.653647 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1263133381-project Oct 18 13:19:23.653647 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:19:23.653647 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:19:23.653647 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c4b64a2efdba445fac0f133d89a271b6 Oct 18 13:19:23.653647 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1263133381-project Oct 18 13:19:23.653647 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:19:23.653647 n-d-858384-13 devstack@n-api.service[120612]: exception: Floating IP not found for ID f306274b-76f0-461d-be71-6bbf32575e03 Oct 18 13:19:23.653647 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'f306274b-76f0-461d-be71-6bbf32575e03'} Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:19:23.654542 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f306274b-76f0-461d-be71-6bbf32575e03 could not be found Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ceebff52-8edc-4dac-84fc-c6d935104ee7'] Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f306274b-76f0-461d-be71-6bbf32575e03. Oct 18 13:19:23.656081 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f306274b-76f0-461d-be71-6bbf32575e03 Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:23.657486 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:19:23.659035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:19:23.659035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f306274b-76f0-461d-be71-6bbf32575e03 Oct 18 13:19:23.659035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:23.659035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41357c31-b5a1-4848-885a-c2723e740acc tempest-FloatingIPDetailsNegativeTestJSON-1263133381 tempest-FloatingIPDetailsNegativeTestJSON-1263133381-project] Returning 404 to user: Floating IP not found for ID f306274b-76f0-461d-be71-6bbf32575e03 {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:19:23.671062 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-41357c31-b5a1-4848-885a-c2723e740acc tempest-FloatingIPDetailsNegativeTestJSON-1263133381 tempest-FloatingIPDetailsNegativeTestJSON-1263133381-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/f306274b-76f0-461d-be71-6bbf32575e03" status: 404 len: 111 microversion: 2.1 time: 0.668673 Oct 18 13:19:23.672476 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 432/901] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 18 13:19:23 2022] GET /compute/v2.1/os-floating-ips/f306274b-76f0-461d-be71-6bbf32575e03 => generated 111 bytes in 671 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:19:23.684362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c8168765-0f21-47aa-9bbd-4a2a4f93e0c1 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff61449ea60>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:23.780193 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c8168765-0f21-47aa-9bbd-4a2a4f93e0c1 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.106332 Oct 18 13:19:23.794844 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 433/902] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:23 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:23.806300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b97c9ebd-38a1-4b17-9a70-4336c196c292 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:23.807188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b97c9ebd-38a1-4b17-9a70-4336c196c292 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:23.815537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b97c9ebd-38a1-4b17-9a70-4336c196c292 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:23.816511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b97c9ebd-38a1-4b17-9a70-4336c196c292 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:23.817327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b97c9ebd-38a1-4b17-9a70-4336c196c292 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:23.818333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b97c9ebd-38a1-4b17-9a70-4336c196c292 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:23.822507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cc0820c9-cea0-45a3-979f-ce0f8591415f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:23.832366 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cc0820c9-cea0-45a3-979f-ce0f8591415f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1476 microversion: 2.1 time: 0.387581 Oct 18 13:19:23.833503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b97c9ebd-38a1-4b17-9a70-4336c196c292 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:23.834815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b97c9ebd-38a1-4b17-9a70-4336c196c292 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:23.840135 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 470/903] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:23 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1476 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:23.852170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a4b383f4-0219-43ef-b3ef-713966678b28 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:23.856797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a4b383f4-0219-43ef-b3ef-713966678b28 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:23.874565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4b383f4-0219-43ef-b3ef-713966678b28 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:23.876245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4b383f4-0219-43ef-b3ef-713966678b28 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:23.876950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4b383f4-0219-43ef-b3ef-713966678b28 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:23.883140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4b383f4-0219-43ef-b3ef-713966678b28 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:23.883898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4b383f4-0219-43ef-b3ef-713966678b28 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:23.884626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4b383f4-0219-43ef-b3ef-713966678b28 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:24.173303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a4b383f4-0219-43ef-b3ef-713966678b28 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:24.185020 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a4b383f4-0219-43ef-b3ef-713966678b28 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1462 microversion: 2.1 time: 0.343446 Oct 18 13:19:24.201752 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 471/904] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:23 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1462 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:24.211536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bffdd525-8701-44c5-91fc-7c9d60e24bef tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] Action: 'create', calling method: .version_select at 0x7ff60f918b80>, body: {"pool": null} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:24.437804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b97c9ebd-38a1-4b17-9a70-4336c196c292 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:24.457485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b97c9ebd-38a1-4b17-9a70-4336c196c292 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:24.460775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b97c9ebd-38a1-4b17-9a70-4336c196c292 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:24.462596 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b97c9ebd-38a1-4b17-9a70-4336c196c292 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1410 microversion: 2.25 time: 0.666366 Oct 18 13:19:24.464246 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 434/905] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:23 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1410 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:24.482895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96a92fd0-d2b3-4e6f-bf37-832f2c388472 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Calling method '.version_select at 0x7ff61449e940>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:24.553797 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-96a92fd0-d2b3-4e6f-bf37-832f2c388472 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc" status: 200 len: 637 microversion: 2.1 time: 0.084820 Oct 18 13:19:24.555207 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 435/906] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:24 2022] GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc => generated 637 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:24.563372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:24.567608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:24.585920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:24.592337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:24.593092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:24.594023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:24.595128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:24.595733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:24.721077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:19:24.721734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:19:24.722832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:19:24.723832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:19:24.724789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:19:24.841309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:24.849432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:24.850296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:24.850987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:24.851928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:24.854311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:24.854994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:24.891600 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-41fc0602-dcbd-47b5-9325-52f0eb91b269 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action" status: 202 len: 1066 microversion: 2.1 time: 0.334977 Oct 18 13:19:24.905228 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 436/907] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:19:24 2022] POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action => generated 1066 bytes in 338 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 13:19:24.905228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e12f88ea-b595-40c0-abf6-b7d634ea0073 req-c2e412f7-d6d7-4146-bcbb-054f3f1d1c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925c4106-eafb-486f-8846-ff04eea11eb3", "tag": "764246b4-ac2a-4fc1-ad53-12db75a818b1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:24.910815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e12f88ea-b595-40c0-abf6-b7d634ea0073 req-c2e412f7-d6d7-4146-bcbb-054f3f1d1c98 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:24.910815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e12f88ea-b595-40c0-abf6-b7d634ea0073 req-c2e412f7-d6d7-4146-bcbb-054f3f1d1c98 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:24.910815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e12f88ea-b595-40c0-abf6-b7d634ea0073 req-c2e412f7-d6d7-4146-bcbb-054f3f1d1c98 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:24.933790 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e12f88ea-b595-40c0-abf6-b7d634ea0073 req-c2e412f7-d6d7-4146-bcbb-054f3f1d1c98 service nova] Creating event network-changed:764246b4-ac2a-4fc1-ad53-12db75a818b1 for instance 925c4106-eafb-486f-8846-ff04eea11eb3 on n-h1-858384-13 Oct 18 13:19:24.944885 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e12f88ea-b595-40c0-abf6-b7d634ea0073 req-c2e412f7-d6d7-4146-bcbb-054f3f1d1c98 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049962 Oct 18 13:19:24.946637 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 437/908] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:24.953502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-041b04c8-b058-4c83-95ea-be64a05974ab tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Action: 'update_all', calling method: .version_select at 0x7ff614330ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:25.004274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:25.029325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-041b04c8-b058-4c83-95ea-be64a05974ab tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:25.035874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-041b04c8-b058-4c83-95ea-be64a05974ab tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for user 612aec555d0a44978fea7c99effaeb21 and project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:25.499150 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-041b04c8-b058-4c83-95ea-be64a05974ab tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.551051 Oct 18 13:19:25.500223 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 438/909] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:19:24 2022] PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata => generated 61 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:25.506586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a830a4d1-05f2-48c4-ae8f-c54ea134fa2e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60fdb1700>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:25.562089 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a830a4d1-05f2-48c4-ae8f-c54ea134fa2e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.060521 Oct 18 13:19:25.562713 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 439/910] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:25 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:25.575269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a4c8aac-a5a0-4ca5-970a-90d612084bb2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:25.576568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4a4c8aac-a5a0-4ca5-970a-90d612084bb2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:25.585775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a4c8aac-a5a0-4ca5-970a-90d612084bb2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:25.586254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a4c8aac-a5a0-4ca5-970a-90d612084bb2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:25.586695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a4c8aac-a5a0-4ca5-970a-90d612084bb2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:25.587411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a4c8aac-a5a0-4ca5-970a-90d612084bb2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:25.587863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a4c8aac-a5a0-4ca5-970a-90d612084bb2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:25.588792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a4c8aac-a5a0-4ca5-970a-90d612084bb2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:25.743325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a4c8aac-a5a0-4ca5-970a-90d612084bb2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:25.755745 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4a4c8aac-a5a0-4ca5-970a-90d612084bb2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1474 microversion: 2.1 time: 0.184697 Oct 18 13:19:25.756557 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 440/911] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:25 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1474 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:25.764003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-265a8f72-07d0-4824-b3cf-149cf646c91e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:25.765261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-265a8f72-07d0-4824-b3cf-149cf646c91e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:25.773738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-265a8f72-07d0-4824-b3cf-149cf646c91e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:25.774231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-265a8f72-07d0-4824-b3cf-149cf646c91e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:25.774669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-265a8f72-07d0-4824-b3cf-149cf646c91e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:25.775379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-265a8f72-07d0-4824-b3cf-149cf646c91e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:25.775833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-265a8f72-07d0-4824-b3cf-149cf646c91e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:25.776260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-265a8f72-07d0-4824-b3cf-149cf646c91e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:25.979011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-265a8f72-07d0-4824-b3cf-149cf646c91e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:25.991947 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-265a8f72-07d0-4824-b3cf-149cf646c91e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1471 microversion: 2.1 time: 0.234533 Oct 18 13:19:25.993029 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 441/912] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:25 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:26.000282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-913344ce-f0c7-41d4-a215-c50d8df979cd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:26.000947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-913344ce-f0c7-41d4-a215-c50d8df979cd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:26.026460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-913344ce-f0c7-41d4-a215-c50d8df979cd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:26.026957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-913344ce-f0c7-41d4-a215-c50d8df979cd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:26.027505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-913344ce-f0c7-41d4-a215-c50d8df979cd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:26.029347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-913344ce-f0c7-41d4-a215-c50d8df979cd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:26.029347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-913344ce-f0c7-41d4-a215-c50d8df979cd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:26.029563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-913344ce-f0c7-41d4-a215-c50d8df979cd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:26.318794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-913344ce-f0c7-41d4-a215-c50d8df979cd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:26.332327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-913344ce-f0c7-41d4-a215-c50d8df979cd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:26.334242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-913344ce-f0c7-41d4-a215-c50d8df979cd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:26.335731 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-913344ce-f0c7-41d4-a215-c50d8df979cd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1410 microversion: 2.25 time: 0.341351 Oct 18 13:19:26.353621 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 442/913] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:25 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1410 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:26.367234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7db9c28f-0269-4f33-aaab-eaf4380acfb7 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Calling method '.version_select at 0x7ff6142e8430>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:26.861295 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7db9c28f-0269-4f33-aaab-eaf4380acfb7 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "DELETE /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.506404 Oct 18 13:19:26.864323 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 443/914] 10.222.0.40 () {58 vars in 1296 bytes} [Tue Oct 18 13:19:26 2022] DELETE /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata/os_version => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:19:26.874492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea52c959-ad14-434d-ad4e-c2cc77b5cccf tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60fccc790>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:26.958217 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ea52c959-ad14-434d-ad4e-c2cc77b5cccf tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.092078 Oct 18 13:19:26.958835 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 444/915] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:26 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:26.964532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-1fd62aa1-18f0-4094-acd8-1597f28837d7 req-8d7de8ed-78e7-4317-bb62-5f8f6f749b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37793c0c-d885-4fd3-8e4f-9d051dd8026c", "name": "network-vif-unplugged", "status": "completed", "tag": "dbfe8182-9968-4cde-bd63-b3073fc6f861"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:26.995644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1fd62aa1-18f0-4094-acd8-1597f28837d7 req-8d7de8ed-78e7-4317-bb62-5f8f6f749b56 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:26.996170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1fd62aa1-18f0-4094-acd8-1597f28837d7 req-8d7de8ed-78e7-4317-bb62-5f8f6f749b56 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:26.996868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1fd62aa1-18f0-4094-acd8-1597f28837d7 req-8d7de8ed-78e7-4317-bb62-5f8f6f749b56 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:27.017564 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-1fd62aa1-18f0-4094-acd8-1597f28837d7 req-8d7de8ed-78e7-4317-bb62-5f8f6f749b56 service nova] Creating event network-vif-unplugged:dbfe8182-9968-4cde-bd63-b3073fc6f861 for instance 37793c0c-d885-4fd3-8e4f-9d051dd8026c on n-h2-858384-13 Oct 18 13:19:27.025227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-1fd62aa1-18f0-4094-acd8-1597f28837d7 req-8d7de8ed-78e7-4317-bb62-5f8f6f749b56 service nova] Instance 37793c0c-d885-4fd3-8e4f-9d051dd8026c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:19:27.033840 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-1fd62aa1-18f0-4094-acd8-1597f28837d7 req-8d7de8ed-78e7-4317-bb62-5f8f6f749b56 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072366 Oct 18 13:19:27.034601 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 445/916] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:27.041034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b609d79a-5b97-4eb1-810e-9b133fb9d3fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:27.042110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b609d79a-5b97-4eb1-810e-9b133fb9d3fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:27.050009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b609d79a-5b97-4eb1-810e-9b133fb9d3fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:27.051162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b609d79a-5b97-4eb1-810e-9b133fb9d3fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:27.051936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b609d79a-5b97-4eb1-810e-9b133fb9d3fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:27.052895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b609d79a-5b97-4eb1-810e-9b133fb9d3fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:27.053797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b609d79a-5b97-4eb1-810e-9b133fb9d3fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:27.054230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b609d79a-5b97-4eb1-810e-9b133fb9d3fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:27.268164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b609d79a-5b97-4eb1-810e-9b133fb9d3fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:27.277581 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b609d79a-5b97-4eb1-810e-9b133fb9d3fa tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1471 microversion: 2.1 time: 0.240944 Oct 18 13:19:27.295879 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 446/917] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:27 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1471 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:27.307441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9cc3a51c-e41f-4397-b867-0d4a73e5cbb2 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Calling method '.version_select at 0x7ff60fbcb8b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:27.453197 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9cc3a51c-e41f-4397-b867-0d4a73e5cbb2 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata" status: 200 len: 37 microversion: 2.1 time: 0.155874 Oct 18 13:19:27.460293 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 447/918] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 18 13:19:27 2022] GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata => generated 37 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:27.471437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-82275cc7-7d95-4b38-ae9a-47fd94b6545a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:27.480879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-82275cc7-7d95-4b38-ae9a-47fd94b6545a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:27.521762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82275cc7-7d95-4b38-ae9a-47fd94b6545a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:27.536100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82275cc7-7d95-4b38-ae9a-47fd94b6545a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:27.538499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82275cc7-7d95-4b38-ae9a-47fd94b6545a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:27.539292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82275cc7-7d95-4b38-ae9a-47fd94b6545a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:27.541768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82275cc7-7d95-4b38-ae9a-47fd94b6545a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:27.543625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82275cc7-7d95-4b38-ae9a-47fd94b6545a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:27.967023 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bffdd525-8701-44c5-91fc-7c9d60e24bef tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.763755 Oct 18 13:19:27.969709 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 472/919] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 18 13:19:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:27.987550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-34f31390-f9ec-439f-ac1c-4a947fc011c3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:27.988787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-34f31390-f9ec-439f-ac1c-4a947fc011c3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:28.004116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34f31390-f9ec-439f-ac1c-4a947fc011c3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:28.005966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34f31390-f9ec-439f-ac1c-4a947fc011c3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:28.006733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34f31390-f9ec-439f-ac1c-4a947fc011c3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:28.007728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34f31390-f9ec-439f-ac1c-4a947fc011c3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:28.011119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34f31390-f9ec-439f-ac1c-4a947fc011c3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:28.015337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34f31390-f9ec-439f-ac1c-4a947fc011c3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:28.162668 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-34f31390-f9ec-439f-ac1c-4a947fc011c3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "POST /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c/action" status: 204 len: 0 microversion: 2.1 time: 0.180504 Oct 18 13:19:28.165379 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 473/920] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:19:27 2022] POST /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c/action => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:19:28.194296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9b25adbe-3ad4-41e3-a8b4-b26f9baf250e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:28.195019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9b25adbe-3ad4-41e3-a8b4-b26f9baf250e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:28.211077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b25adbe-3ad4-41e3-a8b4-b26f9baf250e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:28.211566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b25adbe-3ad4-41e3-a8b4-b26f9baf250e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:28.212301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b25adbe-3ad4-41e3-a8b4-b26f9baf250e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:28.219736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b25adbe-3ad4-41e3-a8b4-b26f9baf250e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:28.220766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b25adbe-3ad4-41e3-a8b4-b26f9baf250e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:28.221821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b25adbe-3ad4-41e3-a8b4-b26f9baf250e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:28.236125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-82275cc7-7d95-4b38-ae9a-47fd94b6545a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:28.261613 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-82275cc7-7d95-4b38-ae9a-47fd94b6545a tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1471 microversion: 2.1 time: 0.798188 Oct 18 13:19:28.264069 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 448/921] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:27 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1471 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:28.277848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3a55a296-8cfa-40e3-b6c1-f76b4ac93bce tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Action: 'update_all', calling method: .version_select at 0x7ff60ff47b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:28.374258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-3a55a296-8cfa-40e3-b6c1-f76b4ac93bce tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:28.396216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-3a55a296-8cfa-40e3-b6c1-f76b4ac93bce tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for user 612aec555d0a44978fea7c99effaeb21 and project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:28.540050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b25adbe-3ad4-41e3-a8b4-b26f9baf250e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:28.560386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b25adbe-3ad4-41e3-a8b4-b26f9baf250e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:28.575507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b25adbe-3ad4-41e3-a8b4-b26f9baf250e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:28.579298 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9b25adbe-3ad4-41e3-a8b4-b26f9baf250e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1410 microversion: 2.25 time: 0.400661 Oct 18 13:19:28.583064 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 474/922] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:28 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1410 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:28.590770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7eb022e2-61cb-4996-9679-4be51615fda9 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f9c2550>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:28.686930 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7eb022e2-61cb-4996-9679-4be51615fda9 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.102752 Oct 18 13:19:28.687797 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 475/923] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:28 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:28.699693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-303336fe-0254-45d8-b424-b05ffdb4e6fc tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] Action: 'create', calling method: .version_select at 0x7ff60fcc33a0>, body: {"pool": null} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:29.109624 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3a55a296-8cfa-40e3-b6c1-f76b4ac93bce tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.843474 Oct 18 13:19:29.110806 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 449/924] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:19:28 2022] PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata => generated 61 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:29.119381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-26dd9072-4557-44d1-be9f-46ab0e53d82f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:29.120271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-26dd9072-4557-44d1-be9f-46ab0e53d82f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:29.129632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26dd9072-4557-44d1-be9f-46ab0e53d82f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:29.130510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26dd9072-4557-44d1-be9f-46ab0e53d82f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:29.131706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26dd9072-4557-44d1-be9f-46ab0e53d82f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:29.133267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26dd9072-4557-44d1-be9f-46ab0e53d82f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:29.134001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26dd9072-4557-44d1-be9f-46ab0e53d82f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:29.135202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26dd9072-4557-44d1-be9f-46ab0e53d82f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:29.693319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-26dd9072-4557-44d1-be9f-46ab0e53d82f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:29.702114 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-26dd9072-4557-44d1-be9f-46ab0e53d82f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1471 microversion: 2.1 time: 0.589930 Oct 18 13:19:29.702718 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 450/925] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:29 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1471 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:29.716652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6a70f31b-8cb3-42e8-9019-7c8517887e99 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Calling method '.version_select at 0x7ff60fce5dc0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:29.817622 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6a70f31b-8cb3-42e8-9019-7c8517887e99 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.112965 Oct 18 13:19:29.824063 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 451/926] 10.222.0.40 () {58 vars in 1290 bytes} [Tue Oct 18 13:19:29 2022] GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata/os_distro => generated 33 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:29.864140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a63de83a-04d8-451c-b636-b011636d728e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:29.870311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a63de83a-04d8-451c-b636-b011636d728e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:29.890619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a63de83a-04d8-451c-b636-b011636d728e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:29.895202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a63de83a-04d8-451c-b636-b011636d728e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:29.895709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a63de83a-04d8-451c-b636-b011636d728e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:29.899648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a63de83a-04d8-451c-b636-b011636d728e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:29.900613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a63de83a-04d8-451c-b636-b011636d728e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:29.907198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a63de83a-04d8-451c-b636-b011636d728e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:30.727425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a63de83a-04d8-451c-b636-b011636d728e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:30.736461 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a63de83a-04d8-451c-b636-b011636d728e tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1471 microversion: 2.1 time: 0.910919 Oct 18 13:19:30.744496 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 452/927] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:29 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1471 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:30.763067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-3dd76cea-2d32-4124-abc7-e8958a076a4b req-a4860e3d-6edf-469f-b497-7612e0d9bfac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938746d4-6297-49a5-811f-89814a1e182b", "name": "network-vif-plugged", "status": "completed", "tag": "a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:30.781625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3dd76cea-2d32-4124-abc7-e8958a076a4b req-a4860e3d-6edf-469f-b497-7612e0d9bfac service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:30.787653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3dd76cea-2d32-4124-abc7-e8958a076a4b req-a4860e3d-6edf-469f-b497-7612e0d9bfac service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:30.792543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3dd76cea-2d32-4124-abc7-e8958a076a4b req-a4860e3d-6edf-469f-b497-7612e0d9bfac service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:30.815767 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-3dd76cea-2d32-4124-abc7-e8958a076a4b req-a4860e3d-6edf-469f-b497-7612e0d9bfac service nova] Creating event network-vif-plugged:a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1 for instance 938746d4-6297-49a5-811f-89814a1e182b on n-h2-858384-13 Oct 18 13:19:30.829388 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-3dd76cea-2d32-4124-abc7-e8958a076a4b req-a4860e3d-6edf-469f-b497-7612e0d9bfac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083033 Oct 18 13:19:30.830755 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 453/928] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:30.837565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-151b6ce4-b60c-4b22-ab3e-95b236ac6dbd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:30.838678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-151b6ce4-b60c-4b22-ab3e-95b236ac6dbd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:30.845898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-151b6ce4-b60c-4b22-ab3e-95b236ac6dbd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:30.846766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-151b6ce4-b60c-4b22-ab3e-95b236ac6dbd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:30.847471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-151b6ce4-b60c-4b22-ab3e-95b236ac6dbd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:30.848725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-151b6ce4-b60c-4b22-ab3e-95b236ac6dbd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:30.849721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-151b6ce4-b60c-4b22-ab3e-95b236ac6dbd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:30.850551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-151b6ce4-b60c-4b22-ab3e-95b236ac6dbd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:30.868976 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-303336fe-0254-45d8-b424-b05ffdb4e6fc tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.179878 Oct 18 13:19:30.870011 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 476/929] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 18 13:19:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:30.874888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32790582-c651-4c88-987a-d6d05fd20a53 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f97c3a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:30.953962 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-32790582-c651-4c88-987a-d6d05fd20a53 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.082593 Oct 18 13:19:30.962303 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 477/930] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:30 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:30.962303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f30271e5-00b0-463b-a26a-e067faf9bdbe tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Action: 'update_all', calling method: .version_select at 0x7ff60fcc3160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:31.037474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f30271e5-00b0-463b-a26a-e067faf9bdbe tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:31.043845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f30271e5-00b0-463b-a26a-e067faf9bdbe tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for user 612aec555d0a44978fea7c99effaeb21 and project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:31.263288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-151b6ce4-b60c-4b22-ab3e-95b236ac6dbd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:31.289500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-151b6ce4-b60c-4b22-ab3e-95b236ac6dbd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:31.290992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-151b6ce4-b60c-4b22-ab3e-95b236ac6dbd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:31.292345 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-151b6ce4-b60c-4b22-ab3e-95b236ac6dbd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1410 microversion: 2.25 time: 0.460137 Oct 18 13:19:31.298023 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 454/931] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:30 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1410 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:31.303797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-df557868-8f68-4a91-99c2-45a5a99fdff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:31.304421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-df557868-8f68-4a91-99c2-45a5a99fdff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:31.327548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df557868-8f68-4a91-99c2-45a5a99fdff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:31.328327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df557868-8f68-4a91-99c2-45a5a99fdff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:31.329112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df557868-8f68-4a91-99c2-45a5a99fdff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:31.330165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df557868-8f68-4a91-99c2-45a5a99fdff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:31.330879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df557868-8f68-4a91-99c2-45a5a99fdff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:31.332636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df557868-8f68-4a91-99c2-45a5a99fdff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:31.390423 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f30271e5-00b0-463b-a26a-e067faf9bdbe tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.433721 Oct 18 13:19:31.391750 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 478/932] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:19:30 2022] PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata => generated 61 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:31.400648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1ecb933d-da4b-4c88-b704-4a1409e23796 tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] Action: 'create', calling method: .version_select at 0x7ff60f8c51f0>, body: {"pool": null} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:31.767241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-df557868-8f68-4a91-99c2-45a5a99fdff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:31.780628 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-df557868-8f68-4a91-99c2-45a5a99fdff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1471 microversion: 2.1 time: 0.481396 Oct 18 13:19:31.783400 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 455/933] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:31 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1471 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:31.803008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5b70d689-5b94-452b-b37b-4a90abf8e9d5 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Calling method '.version_select at 0x7ff60fcccd30>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:31.902002 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5b70d689-5b94-452b-b37b-4a90abf8e9d5 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.109933 Oct 18 13:19:31.902933 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 456/934] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 18 13:19:31 2022] GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata => generated 61 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:31.914026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1a96cf03-d459-462b-ae02-0846d5e511e6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:31.914905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1a96cf03-d459-462b-ae02-0846d5e511e6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:31.928651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a96cf03-d459-462b-ae02-0846d5e511e6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:31.928911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a96cf03-d459-462b-ae02-0846d5e511e6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:31.929162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a96cf03-d459-462b-ae02-0846d5e511e6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:31.930335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a96cf03-d459-462b-ae02-0846d5e511e6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:31.944350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a96cf03-d459-462b-ae02-0846d5e511e6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:31.944807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a96cf03-d459-462b-ae02-0846d5e511e6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:31.985734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:32.351739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1a96cf03-d459-462b-ae02-0846d5e511e6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:32.370375 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1a96cf03-d459-462b-ae02-0846d5e511e6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1471 microversion: 2.1 time: 0.466156 Oct 18 13:19:32.382581 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 457/935] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:31 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1471 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:32.388840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5dc8b302-0400-4c36-9c9b-917dbfcd0a48 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Action: 'update_all', calling method: .version_select at 0x7ff60f8e21f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:32.497796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5dc8b302-0400-4c36-9c9b-917dbfcd0a48 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:32.520974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5dc8b302-0400-4c36-9c9b-917dbfcd0a48 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for user 612aec555d0a44978fea7c99effaeb21 and project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:32.818077 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5dc8b302-0400-4c36-9c9b-917dbfcd0a48 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.433461 Oct 18 13:19:32.818958 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 458/936] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:19:32 2022] PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata => generated 61 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:32.826677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-72be3538-367f-4b77-b351-83db014e9968 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60fe07550>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:32.908401 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-72be3538-367f-4b77-b351-83db014e9968 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.088319 Oct 18 13:19:32.918374 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 459/937] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:32 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:32.926770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4b70d83f-2ada-4221-a142-fb092d6d4b1d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:32.927959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4b70d83f-2ada-4221-a142-fb092d6d4b1d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:32.938232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b70d83f-2ada-4221-a142-fb092d6d4b1d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:32.940310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b70d83f-2ada-4221-a142-fb092d6d4b1d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:32.941777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b70d83f-2ada-4221-a142-fb092d6d4b1d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:32.943294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b70d83f-2ada-4221-a142-fb092d6d4b1d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:32.943969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b70d83f-2ada-4221-a142-fb092d6d4b1d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:32.944708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b70d83f-2ada-4221-a142-fb092d6d4b1d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:33.244238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4b70d83f-2ada-4221-a142-fb092d6d4b1d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:33.262840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4b70d83f-2ada-4221-a142-fb092d6d4b1d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:33.264577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4b70d83f-2ada-4221-a142-fb092d6d4b1d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:33.266548 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4b70d83f-2ada-4221-a142-fb092d6d4b1d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1410 microversion: 2.25 time: 0.346839 Oct 18 13:19:33.273070 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 460/938] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:32 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1410 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:33.278732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3c187e23-8149-4139-82f8-54c65d273adc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:33.282317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3c187e23-8149-4139-82f8-54c65d273adc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:33.297565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c187e23-8149-4139-82f8-54c65d273adc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:33.301692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c187e23-8149-4139-82f8-54c65d273adc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:33.307858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c187e23-8149-4139-82f8-54c65d273adc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:33.308907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c187e23-8149-4139-82f8-54c65d273adc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:33.309606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c187e23-8149-4139-82f8-54c65d273adc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:33.310219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c187e23-8149-4139-82f8-54c65d273adc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:33.745442 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1ecb933d-da4b-4c88-b704-4a1409e23796 tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.351980 Oct 18 13:19:33.746380 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 479/939] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 18 13:19:31 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:33.754317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-80b64733-f58e-4209-8f75-c132b73864c5 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Action: 'update_all', calling method: .version_select at 0x7ff60f964a60>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:33.858040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-80b64733-f58e-4209-8f75-c132b73864c5 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:33.864920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-80b64733-f58e-4209-8f75-c132b73864c5 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for user 612aec555d0a44978fea7c99effaeb21 and project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:33.894590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3c187e23-8149-4139-82f8-54c65d273adc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:33.914694 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3c187e23-8149-4139-82f8-54c65d273adc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1463 microversion: 2.1 time: 0.639940 Oct 18 13:19:33.918981 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 461/940] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:33 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1463 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:33.936151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-cba77e23-a1ff-4cc1-a6ba-d4994038b90f req-2cde6916-2f5d-4dab-9508-b4423d6441f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37793c0c-d885-4fd3-8e4f-9d051dd8026c", "name": "network-vif-plugged", "status": "completed", "tag": "dbfe8182-9968-4cde-bd63-b3073fc6f861"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:33.981927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cba77e23-a1ff-4cc1-a6ba-d4994038b90f req-2cde6916-2f5d-4dab-9508-b4423d6441f7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:33.985203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cba77e23-a1ff-4cc1-a6ba-d4994038b90f req-2cde6916-2f5d-4dab-9508-b4423d6441f7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:33.986052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cba77e23-a1ff-4cc1-a6ba-d4994038b90f req-2cde6916-2f5d-4dab-9508-b4423d6441f7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:34.017326 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-cba77e23-a1ff-4cc1-a6ba-d4994038b90f req-2cde6916-2f5d-4dab-9508-b4423d6441f7 service nova] Creating event network-vif-plugged:dbfe8182-9968-4cde-bd63-b3073fc6f861 for instance 37793c0c-d885-4fd3-8e4f-9d051dd8026c on n-h2-858384-13 Oct 18 13:19:34.023822 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-cba77e23-a1ff-4cc1-a6ba-d4994038b90f req-2cde6916-2f5d-4dab-9508-b4423d6441f7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103180 Oct 18 13:19:34.025213 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 462/941] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:34.033386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a2aba6ae-5ee8-4da0-bb54-74eb0d6feb37 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:34.035187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a2aba6ae-5ee8-4da0-bb54-74eb0d6feb37 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:34.055988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2aba6ae-5ee8-4da0-bb54-74eb0d6feb37 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:34.056822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2aba6ae-5ee8-4da0-bb54-74eb0d6feb37 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:34.057504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2aba6ae-5ee8-4da0-bb54-74eb0d6feb37 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:34.058638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2aba6ae-5ee8-4da0-bb54-74eb0d6feb37 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:34.060046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2aba6ae-5ee8-4da0-bb54-74eb0d6feb37 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:34.061057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2aba6ae-5ee8-4da0-bb54-74eb0d6feb37 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:34.444838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a2aba6ae-5ee8-4da0-bb54-74eb0d6feb37 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:34.459969 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a2aba6ae-5ee8-4da0-bb54-74eb0d6feb37 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1471 microversion: 2.1 time: 0.433256 Oct 18 13:19:34.474737 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 463/942] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:34 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1471 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:34.501285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9e558e37-03bd-4381-af3c-e55a0c0712b5 tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] Calling method '.version_select at 0x7ff60fc19700>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:34.594813 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-80b64733-f58e-4209-8f75-c132b73864c5 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata" status: 200 len: 64 microversion: 2.1 time: 0.845304 Oct 18 13:19:34.595746 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 480/943] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:19:33 2022] PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata => generated 64 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:34.613293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-70c98aef-647f-4615-9807-8340f63264aa tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f9c2160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:34.703336 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-70c98aef-647f-4615-9807-8340f63264aa tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.106311 Oct 18 13:19:34.708008 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 481/944] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:34 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:34.714121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9eb1cf26-2d78-4fd2-85e7-9920b0424bc4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:34.714982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9eb1cf26-2d78-4fd2-85e7-9920b0424bc4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:34.727276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9eb1cf26-2d78-4fd2-85e7-9920b0424bc4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:34.728027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9eb1cf26-2d78-4fd2-85e7-9920b0424bc4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:34.728620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9eb1cf26-2d78-4fd2-85e7-9920b0424bc4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:34.730009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9eb1cf26-2d78-4fd2-85e7-9920b0424bc4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:34.730639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9eb1cf26-2d78-4fd2-85e7-9920b0424bc4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:34.731228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9eb1cf26-2d78-4fd2-85e7-9920b0424bc4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:34.951784 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9e558e37-03bd-4381-af3c-e55a0c0712b5 tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/a1c4df85-12a3-4613-9c2a-b22617a0cc52" status: 200 len: 141 microversion: 2.1 time: 0.472737 Oct 18 13:19:34.953024 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 464/945] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 18 13:19:34 2022] GET /compute/v2.1/os-floating-ips/a1c4df85-12a3-4613-9c2a-b22617a0cc52 => generated 141 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:34.970131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e8b4a2f4-d0f9-4fe8-81c8-65e0abb9f38b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:34.970757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e8b4a2f4-d0f9-4fe8-81c8-65e0abb9f38b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:34.982156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8b4a2f4-d0f9-4fe8-81c8-65e0abb9f38b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:34.984513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8b4a2f4-d0f9-4fe8-81c8-65e0abb9f38b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:34.985256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8b4a2f4-d0f9-4fe8-81c8-65e0abb9f38b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:34.986217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8b4a2f4-d0f9-4fe8-81c8-65e0abb9f38b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:34.990284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8b4a2f4-d0f9-4fe8-81c8-65e0abb9f38b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:34.992937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8b4a2f4-d0f9-4fe8-81c8-65e0abb9f38b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:35.027540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9eb1cf26-2d78-4fd2-85e7-9920b0424bc4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:35.042523 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9eb1cf26-2d78-4fd2-85e7-9920b0424bc4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1463 microversion: 2.1 time: 0.331029 Oct 18 13:19:35.044790 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 482/946] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:34 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1463 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:35.062272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7a504c79-b46a-4388-a7a7-d0f3b0e25917 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Calling method '.version_select at 0x7ff60f8c53a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:35.135850 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7a504c79-b46a-4388-a7a7-d0f3b0e25917 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata" status: 200 len: 64 microversion: 2.1 time: 0.089673 Oct 18 13:19:35.136716 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 483/947] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 18 13:19:35 2022] GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata => generated 64 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:35.151159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb8e85c0-d7b6-48a6-aba0-f16dd955877f tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] Calling method '.version_select at 0x7ff60f964700>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:35.287067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e8b4a2f4-d0f9-4fe8-81c8-65e0abb9f38b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:35.302583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e8b4a2f4-d0f9-4fe8-81c8-65e0abb9f38b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:35.304615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e8b4a2f4-d0f9-4fe8-81c8-65e0abb9f38b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:35.306728 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e8b4a2f4-d0f9-4fe8-81c8-65e0abb9f38b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1410 microversion: 2.25 time: 0.345064 Oct 18 13:19:35.308310 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 465/948] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:34 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1410 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:35.315050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0379fd8c-c91c-45a6-9e81-e72e8360fb74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Action: 'create', calling method: .version_select at 0x7ff60f8edc10>, body: {"keypair": {"name": "tempest-keypair-850283987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq0HWl/OiZxrGkKIB8AB0GvBHXjf9MohT7rhyiwG4sBTA7juk2zPJGOGSFjAP6f7KPP1kj4w2Zt6BXzHMm0855r6LSXJtVtSGj/5W3/ZqUNsknxZiKnpsQJ2zQISLCulQ=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:35.332758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0379fd8c-c91c-45a6-9e81-e72e8360fb74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Getting quotas for project 3f136eea39d84b04b5410eb0906c113e. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:35.338847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0379fd8c-c91c-45a6-9e81-e72e8360fb74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Getting quotas for user e631235f0d0c400981c97d9edb1ea7fe and project 3f136eea39d84b04b5410eb0906c113e. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:35.372704 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0379fd8c-c91c-45a6-9e81-e72e8360fb74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062270 Oct 18 13:19:35.374042 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 466/949] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:19:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:35.384425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5b3b2286-6b0d-4216-a6ad-21d5e4091ef9 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Action: 'update_all', calling method: .version_select at 0x7ff60fce5a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:35.508407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:35.523431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5b3b2286-6b0d-4216-a6ad-21d5e4091ef9 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:35.538839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5b3b2286-6b0d-4216-a6ad-21d5e4091ef9 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for user 612aec555d0a44978fea7c99effaeb21 and project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:36.145213 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5b3b2286-6b0d-4216-a6ad-21d5e4091ef9 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.769117 Oct 18 13:19:36.146522 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 467/950] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:19:35 2022] PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata => generated 61 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:36.157024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dcae3105-fc16-4b04-81e4-7332f9000dff tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:36.158410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dcae3105-fc16-4b04-81e4-7332f9000dff tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:36.167949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcae3105-fc16-4b04-81e4-7332f9000dff tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:36.168719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcae3105-fc16-4b04-81e4-7332f9000dff tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:36.170273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcae3105-fc16-4b04-81e4-7332f9000dff tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:36.171711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcae3105-fc16-4b04-81e4-7332f9000dff tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:36.172543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcae3105-fc16-4b04-81e4-7332f9000dff tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:36.173076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcae3105-fc16-4b04-81e4-7332f9000dff tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:36.495851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dcae3105-fc16-4b04-81e4-7332f9000dff tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:36.514323 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dcae3105-fc16-4b04-81e4-7332f9000dff tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1471 microversion: 2.1 time: 0.366540 Oct 18 13:19:36.519618 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 468/951] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:36 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1471 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:36.530335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ee508d3c-48a4-45aa-8f3c-f721ee1285d5 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60ff7aee0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:36.642105 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ee508d3c-48a4-45aa-8f3c-f721ee1285d5 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.113425 Oct 18 13:19:36.643054 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 469/952] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:36 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:36.663431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b75aba25-ff03-4603-8b38-6790f380ad34 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Action: 'update', calling method: .version_select at 0x7ff60fce5ca0>, body: {"meta": {"os_version": "alt"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:36.732871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b75aba25-ff03-4603-8b38-6790f380ad34 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:36.743687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b75aba25-ff03-4603-8b38-6790f380ad34 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for user 612aec555d0a44978fea7c99effaeb21 and project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:36.782411 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eb8e85c0-d7b6-48a6-aba0-f16dd955877f tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/a1c4df85-12a3-4613-9c2a-b22617a0cc52" status: 202 len: 0 microversion: 2.1 time: 1.644443 Oct 18 13:19:36.791037 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 484/953] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:19:35 2022] DELETE /compute/v2.1/os-floating-ips/a1c4df85-12a3-4613-9c2a-b22617a0cc52 => generated 0 bytes in 1653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:19:36.803206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-744a607a-f0f9-42ab-b021-90d66c3ba8ca req-e61907d3-93f8-4536-b3bb-925420a562dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925c4106-eafb-486f-8846-ff04eea11eb3", "name": "network-vif-plugged", "status": "completed", "tag": "764246b4-ac2a-4fc1-ad53-12db75a818b1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:36.818643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-744a607a-f0f9-42ab-b021-90d66c3ba8ca req-e61907d3-93f8-4536-b3bb-925420a562dc service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:36.819940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-744a607a-f0f9-42ab-b021-90d66c3ba8ca req-e61907d3-93f8-4536-b3bb-925420a562dc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:36.821303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-744a607a-f0f9-42ab-b021-90d66c3ba8ca req-e61907d3-93f8-4536-b3bb-925420a562dc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:36.829560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:36.842704 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-744a607a-f0f9-42ab-b021-90d66c3ba8ca req-e61907d3-93f8-4536-b3bb-925420a562dc service nova] Creating event network-vif-plugged:764246b4-ac2a-4fc1-ad53-12db75a818b1 for instance 925c4106-eafb-486f-8846-ff04eea11eb3 on n-h1-858384-13 Oct 18 13:19:36.851560 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-744a607a-f0f9-42ab-b021-90d66c3ba8ca req-e61907d3-93f8-4536-b3bb-925420a562dc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057872 Oct 18 13:19:36.854543 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 485/954] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:36.862637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a57426f0-1d5a-474d-a7b9-ac57cc209c1a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:36.863658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a57426f0-1d5a-474d-a7b9-ac57cc209c1a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:36.874969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a57426f0-1d5a-474d-a7b9-ac57cc209c1a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:36.876971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a57426f0-1d5a-474d-a7b9-ac57cc209c1a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:36.878085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a57426f0-1d5a-474d-a7b9-ac57cc209c1a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:36.880339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a57426f0-1d5a-474d-a7b9-ac57cc209c1a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:36.881570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a57426f0-1d5a-474d-a7b9-ac57cc209c1a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:36.882552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a57426f0-1d5a-474d-a7b9-ac57cc209c1a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:37.107453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a57426f0-1d5a-474d-a7b9-ac57cc209c1a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:37.117360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a57426f0-1d5a-474d-a7b9-ac57cc209c1a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:37.119974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a57426f0-1d5a-474d-a7b9-ac57cc209c1a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:37.121478 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a57426f0-1d5a-474d-a7b9-ac57cc209c1a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1410 microversion: 2.25 time: 0.265253 Oct 18 13:19:37.122065 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 486/955] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:36 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1410 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:37.127120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3fab8608-b758-4852-99c3-661eb8923ed6 tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] Calling method '.version_select at 0x7ff60f8c2d30>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:37.295176 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b75aba25-ff03-4603-8b38-6790f380ad34 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.650088 Oct 18 13:19:37.296410 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 470/956] 10.222.0.40 () {60 vars in 1313 bytes} [Tue Oct 18 13:19:36 2022] PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata/os_version => generated 31 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:37.306618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7e6b330b-2f73-46eb-bc4d-81578015baee tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Calling method '.version_select at 0x7ff60fe07550>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:37.383370 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7e6b330b-2f73-46eb-bc4d-81578015baee tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata" status: 200 len: 58 microversion: 2.1 time: 0.080343 Oct 18 13:19:37.384442 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 471/957] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 18 13:19:37 2022] GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata => generated 58 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:19:37.404995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5d7e1482-2468-49e4-8863-daf199ca28f8 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Action: 'update_all', calling method: .version_select at 0x7ff60ff7aee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:37.494930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=37 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:37.499001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5d7e1482-2468-49e4-8863-daf199ca28f8 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:37.501766 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3fab8608-b758-4852-99c3-661eb8923ed6 tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.378288 Oct 18 13:19:37.502772 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 487/958] 10.222.0.40 () {58 vars in 1164 bytes} [Tue Oct 18 13:19:37 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:37.509486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5d7e1482-2468-49e4-8863-daf199ca28f8 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for user 612aec555d0a44978fea7c99effaeb21 and project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:37.514299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b4d0f6d9-3a89-47b2-9eac-8fc4e10ef2c9 tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] Calling method '.version_select at 0x7ff60f9c2160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:37.770846 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b4d0f6d9-3a89-47b2-9eac-8fc4e10ef2c9 tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.260634 Oct 18 13:19:37.772015 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 488/959] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 18 13:19:37 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:19:37.786054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc2a4a15-fd58-4ef0-8254-e43cc8075846 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:37.787492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc2a4a15-fd58-4ef0-8254-e43cc8075846 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:37.814295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc2a4a15-fd58-4ef0-8254-e43cc8075846 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:37.815076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc2a4a15-fd58-4ef0-8254-e43cc8075846 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:37.816400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc2a4a15-fd58-4ef0-8254-e43cc8075846 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:37.818034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc2a4a15-fd58-4ef0-8254-e43cc8075846 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:37.818684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc2a4a15-fd58-4ef0-8254-e43cc8075846 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:37.820000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc2a4a15-fd58-4ef0-8254-e43cc8075846 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:38.006672 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5d7e1482-2468-49e4-8863-daf199ca28f8 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.610037 Oct 18 13:19:38.009647 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 472/960] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:19:37 2022] PUT /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata => generated 61 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:38.017512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-20e9872a-a214-4c2a-ad67-46fdc051ca31 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff6142c60d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:38.087823 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-20e9872a-a214-4c2a-ad67-46fdc051ca31 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.074157 Oct 18 13:19:38.102104 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 473/961] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:38 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:38.117075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-07461bdb-664f-481e-a8aa-08966bf69fbe tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] Calling method '.version_select at 0x7ff60fc80e50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:38.424464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc2a4a15-fd58-4ef0-8254-e43cc8075846 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:38.437271 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc2a4a15-fd58-4ef0-8254-e43cc8075846 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1471 microversion: 2.1 time: 0.659842 Oct 18 13:19:38.453244 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 489/962] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:37 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1471 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:38.453244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0d31e117-1a68-4d7a-b0be-32f06c715662 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Action: 'create', calling method: .version_select at 0x7ff60f8c50d0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:38.578938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-0d31e117-1a68-4d7a-b0be-32f06c715662 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:38.587040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-0d31e117-1a68-4d7a-b0be-32f06c715662 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Getting quotas for user 612aec555d0a44978fea7c99effaeb21 and project 3c41df84c0eb4c5d854d37fbb7a9b633. Resources: dict_keys(['metadata_items']) {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:39.241548 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0d31e117-1a68-4d7a-b0be-32f06c715662 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "POST /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata" status: 200 len: 85 microversion: 2.1 time: 0.802061 Oct 18 13:19:39.242247 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 490/963] 10.222.0.40 () {60 vars in 1281 bytes} [Tue Oct 18 13:19:38 2022] POST /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata => generated 85 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:39.250636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c2a36ab1-c06e-4eba-ba09-867b30bb28d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:39.251522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c2a36ab1-c06e-4eba-ba09-867b30bb28d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:39.267597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2a36ab1-c06e-4eba-ba09-867b30bb28d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:39.275557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2a36ab1-c06e-4eba-ba09-867b30bb28d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:39.276287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2a36ab1-c06e-4eba-ba09-867b30bb28d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:39.277539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2a36ab1-c06e-4eba-ba09-867b30bb28d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:39.278444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2a36ab1-c06e-4eba-ba09-867b30bb28d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:39.279095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2a36ab1-c06e-4eba-ba09-867b30bb28d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:39.543931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c2a36ab1-c06e-4eba-ba09-867b30bb28d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:39.560382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c2a36ab1-c06e-4eba-ba09-867b30bb28d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:39.562664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c2a36ab1-c06e-4eba-ba09-867b30bb28d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:39.570580 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c2a36ab1-c06e-4eba-ba09-867b30bb28d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1410 microversion: 2.25 time: 0.327016 Oct 18 13:19:39.585539 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 491/964] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:39 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1410 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:39.594798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-806783d9-9dc4-4da3-be8d-d4f06c6e0c01 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f8c5dc0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:39.680808 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-806783d9-9dc4-4da3-be8d-d4f06c6e0c01 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.090612 Oct 18 13:19:39.682895 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 492/965] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:39 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:39.698587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cddc1197-b981-4072-aba1-eb4a69eb6601 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] Calling method '.version_select at 0x7ff60fa75e50>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:39.785328 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cddc1197-b981-4072-aba1-eb4a69eb6601 tempest-ImagesMetadataTestJSON-1061138956 tempest-ImagesMetadataTestJSON-1061138956-project] 10.222.0.40 "GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata" status: 200 len: 85 microversion: 2.1 time: 0.100646 Oct 18 13:19:39.786053 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 493/966] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 18 13:19:39 2022] GET /compute/v2.1/images/0dce9d42-2bd8-48dd-ae9f-86a9d1152fdc/metadata => generated 85 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:39.802477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b7ceeebf-5e4d-420f-ba3d-d86e0f3daade tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:39.804618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7ceeebf-5e4d-420f-ba3d-d86e0f3daade tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:39.828790 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-07461bdb-664f-481e-a8aa-08966bf69fbe tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/1847d16f-5f1e-43d3-a693-42512399e8d3" status: 202 len: 0 microversion: 2.1 time: 1.723106 Oct 18 13:19:39.829986 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 474/967] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:19:38 2022] DELETE /compute/v2.1/os-floating-ips/1847d16f-5f1e-43d3-a693-42512399e8d3 => generated 0 bytes in 1727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:19:39.838677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e7fd7c04-d0fb-41b9-b312-dbc8952bd2e3 tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] Calling method '.version_select at 0x7ff60fccc940>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:39.856551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7ceeebf-5e4d-420f-ba3d-d86e0f3daade tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:39.857054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7ceeebf-5e4d-420f-ba3d-d86e0f3daade tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:39.857878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7ceeebf-5e4d-420f-ba3d-d86e0f3daade tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:39.863478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7ceeebf-5e4d-420f-ba3d-d86e0f3daade tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:39.864203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7ceeebf-5e4d-420f-ba3d-d86e0f3daade tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:39.865228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7ceeebf-5e4d-420f-ba3d-d86e0f3daade tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:40.959728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7ceeebf-5e4d-420f-ba3d-d86e0f3daade tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:40.970432 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b7ceeebf-5e4d-420f-ba3d-d86e0f3daade tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1471 microversion: 2.1 time: 1.182657 Oct 18 13:19:40.988288 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 494/968] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:39 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1471 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:41.008928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a7070808-9ea1-45c8-b9b8-cfd111f2b684 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Calling method '.version_select at 0x7ff60f9c2040>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:41.012843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7070808-9ea1-45c8-b9b8-cfd111f2b684 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:41.024231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7070808-9ea1-45c8-b9b8-cfd111f2b684 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:41.024958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7070808-9ea1-45c8-b9b8-cfd111f2b684 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:41.045079 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a7070808-9ea1-45c8-b9b8-cfd111f2b684 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1586 microversion: 2.1 time: 0.053474 Oct 18 13:19:41.058873 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 495/969] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 18 13:19:40 2022] GET /compute/v2.1/os-migrations => generated 1586 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:41.068547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5beeee89-f511-4560-8739-4bb3c054545b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:41.080183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5beeee89-f511-4560-8739-4bb3c054545b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:41.119284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5beeee89-f511-4560-8739-4bb3c054545b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:41.124062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5beeee89-f511-4560-8739-4bb3c054545b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:41.126831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5beeee89-f511-4560-8739-4bb3c054545b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:41.130139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5beeee89-f511-4560-8739-4bb3c054545b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:41.132353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5beeee89-f511-4560-8739-4bb3c054545b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:41.136397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5beeee89-f511-4560-8739-4bb3c054545b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:41.469758 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e7fd7c04-d0fb-41b9-b312-dbc8952bd2e3 tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/552e83d4-88ee-49de-9c41-5f6f18a04a6a" status: 202 len: 0 microversion: 2.1 time: 1.635378 Oct 18 13:19:41.470813 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 475/970] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:19:39 2022] DELETE /compute/v2.1/os-floating-ips/552e83d4-88ee-49de-9c41-5f6f18a04a6a => generated 0 bytes in 1637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:19:41.478212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1fc2ee3b-1f0c-4c15-b60c-c45f4a914af0 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff61428cdc0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:41.563589 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1fc2ee3b-1f0c-4c15-b60c-c45f4a914af0 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.091555 Oct 18 13:19:41.564360 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 476/971] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:41 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:41.570361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-909d91cc-0e9d-4841-b90a-f3d344b095c3 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:41.580698 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-909d91cc-0e9d-4841-b90a-f3d344b095c3 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014513 Oct 18 13:19:41.584741 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 477/972] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:19:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:41.593096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-539bef78-3f8a-46c1-810f-f236696e7610 tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] Calling method '.version_select at 0x7ff60fc80940>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:41.741940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5beeee89-f511-4560-8739-4bb3c054545b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:41.765613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5beeee89-f511-4560-8739-4bb3c054545b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:41.773152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5beeee89-f511-4560-8739-4bb3c054545b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:41.778005 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5beeee89-f511-4560-8739-4bb3c054545b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1606 microversion: 2.25 time: 0.717851 Oct 18 13:19:41.781248 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 496/973] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:19:41 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1606 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:19:41.801784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6224ca87-418a-42d5-9c54-235d7c6aa094 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-192546977", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:41.855627 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6224ca87-418a-42d5-9c54-235d7c6aa094 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.072927 Oct 18 13:19:41.862119 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 497/974] 10.222.0.40 () {60 vars in 1146 bytes} [Tue Oct 18 13:19:41 2022] POST /compute/v2.1/flavors => generated 498 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:41.874856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cdf61a3c-37bb-408a-8024-3c8d35ed8275 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:41.875929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cdf61a3c-37bb-408a-8024-3c8d35ed8275 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:41.897468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf61a3c-37bb-408a-8024-3c8d35ed8275 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:41.898427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf61a3c-37bb-408a-8024-3c8d35ed8275 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:41.899452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf61a3c-37bb-408a-8024-3c8d35ed8275 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:41.902077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf61a3c-37bb-408a-8024-3c8d35ed8275 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:41.904479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf61a3c-37bb-408a-8024-3c8d35ed8275 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:41.906647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf61a3c-37bb-408a-8024-3c8d35ed8275 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:42.164390 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cdf61a3c-37bb-408a-8024-3c8d35ed8275 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.302285 Oct 18 13:19:42.165725 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 498/975] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 18 13:19:41 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-interface => generated 285 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:19:42.170599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1b819775-4fe4-40b4-bdbd-5d02574bfc4f tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:42.189348 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1b819775-4fe4-40b4-bdbd-5d02574bfc4f tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022195 Oct 18 13:19:42.190445 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 499/976] 10.222.0.40 () {58 vars in 1182 bytes} [Tue Oct 18 13:19:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:19:42.200306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-794b7240-097b-4683-9e35-88eff62f8970 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:42.209612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-794b7240-097b-4683-9e35-88eff62f8970 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:42.220659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-794b7240-097b-4683-9e35-88eff62f8970 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:42.221609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-794b7240-097b-4683-9e35-88eff62f8970 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:42.222485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-794b7240-097b-4683-9e35-88eff62f8970 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:42.223889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-794b7240-097b-4683-9e35-88eff62f8970 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:42.224678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-794b7240-097b-4683-9e35-88eff62f8970 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:42.225430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-794b7240-097b-4683-9e35-88eff62f8970 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:42.767541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-794b7240-097b-4683-9e35-88eff62f8970 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:42.786514 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-794b7240-097b-4683-9e35-88eff62f8970 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1471 microversion: 2.1 time: 0.594684 Oct 18 13:19:42.801388 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 500/977] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:42 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1471 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:42.801388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-485694089", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "76f7ef46-02d1-45c9-9ac9-be7813cc2bb9"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:42.898816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:19:43.645160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:19:43.645965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:19:43.646248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:19:43.647144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:19:43.647773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:19:43.667959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:43.668449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:43.668883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:43.669650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:43.675905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:43.676473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:43.722684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Getting quotas for project 3f136eea39d84b04b5410eb0906c113e. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:43.738995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Getting quotas for user e631235f0d0c400981c97d9edb1ea7fe and project 3f136eea39d84b04b5410eb0906c113e. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:43.777999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:19:43.780442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:19:43.907861 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9222496e-2713-489e-87d5-74d7acb1ce1c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.114511 Oct 18 13:19:43.908621 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 501/978] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:19:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:19:43.921347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e00d5b0e-6332-4a7e-a1aa-44b071b48070 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f8c5e50>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:44.032326 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e00d5b0e-6332-4a7e-a1aa-44b071b48070 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.115506 Oct 18 13:19:44.037489 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 502/979] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:43 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:44.052090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-46bfc5a3-dc45-46c1-801f-71d808c251b3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:44.052961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-46bfc5a3-dc45-46c1-801f-71d808c251b3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:44.071348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46bfc5a3-dc45-46c1-801f-71d808c251b3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:44.074636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46bfc5a3-dc45-46c1-801f-71d808c251b3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:44.075637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46bfc5a3-dc45-46c1-801f-71d808c251b3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:44.077615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46bfc5a3-dc45-46c1-801f-71d808c251b3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:44.078156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46bfc5a3-dc45-46c1-801f-71d808c251b3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:44.078602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46bfc5a3-dc45-46c1-801f-71d808c251b3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:44.735041 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-539bef78-3f8a-46c1-810f-f236696e7610 tempest-FloatingIPDetailsTestJSON-1540451238 tempest-FloatingIPDetailsTestJSON-1540451238-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/def8ec93-ae5b-40f9-aca6-649a589956e9" status: 202 len: 0 microversion: 2.1 time: 3.146874 Oct 18 13:19:44.738044 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 478/980] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:19:41 2022] DELETE /compute/v2.1/os-floating-ips/def8ec93-ae5b-40f9-aca6-649a589956e9 => generated 0 bytes in 3152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:19:44.756484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1339d916-9f42-48ce-a200-76ef23868917 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:44.759985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1339d916-9f42-48ce-a200-76ef23868917 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:44.986415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1339d916-9f42-48ce-a200-76ef23868917 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:44.998956 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1339d916-9f42-48ce-a200-76ef23868917 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1278 microversion: 2.1 time: 0.257878 Oct 18 13:19:44.999562 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 479/981] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:44 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1278 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:45.053455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6177596d-2bef-4411-becc-3238768f499d tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f888040>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:45.201707 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6177596d-2bef-4411-becc-3238768f499d tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.153184 Oct 18 13:19:45.202300 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 480/982] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:45 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:45.412771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-46bfc5a3-dc45-46c1-801f-71d808c251b3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:45.438400 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-46bfc5a3-dc45-46c1-801f-71d808c251b3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1471 microversion: 2.1 time: 1.399356 Oct 18 13:19:45.440833 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 503/983] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:44 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1471 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:46.026738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-caa4d0da-55f3-4d00-8bf3-4e51ca896787 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:46.027350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-caa4d0da-55f3-4d00-8bf3-4e51ca896787 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:46.041076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-caa4d0da-55f3-4d00-8bf3-4e51ca896787 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:46.042125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-caa4d0da-55f3-4d00-8bf3-4e51ca896787 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:46.042783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-caa4d0da-55f3-4d00-8bf3-4e51ca896787 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:46.043742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-caa4d0da-55f3-4d00-8bf3-4e51ca896787 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:46.044427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-caa4d0da-55f3-4d00-8bf3-4e51ca896787 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:46.045234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-caa4d0da-55f3-4d00-8bf3-4e51ca896787 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:46.225200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bd8bd728-7922-4353-8066-1ca7ea33ec30 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Calling method '.version_select at 0x7ff6142c6310>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:46.274719 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-bd8bd728-7922-4353-8066-1ca7ea33ec30 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] HTTP exception thrown: Image not found. Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bd8bd728-7922-4353-8066-1ca7ea33ec30 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Request method failure captured: Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/images/6d5dde2f-e916-4161-a439-4adbdccf098a/metadata/os_distro HTTP/1.1 Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqfxDne5W4fQz4_ewd4GxoXPD1Qq1h_0WiW4sykRy7O4Z5n48tg5o6u9IucolN6rfUcm2vmNOW1UO6b79I-QHwC7NIuWbOSX_8Zqd9q3UxpT-nBseuFHd5zo4Lt2Jh5Kfhi8Y9FtvxXDbcOs6jc1EzST-f1ESm1LAFXbAvAUVMlB0a4 Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aeddb0fe754a4bbea19515b112f991d1 Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:19:46.287995 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:19:46.290664 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aeddb0fe754a4bbea19515b112f991d1"}]}] Oct 18 13:19:46.290664 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.290664 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aeddb0fe754a4bbea19515b112f991d1 Oct 18 13:19:46.290664 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.290664 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesMetadataNegativeTestJSON-945453260-project Oct 18 13:19:46.290664 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:19:46.290664 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:19:46.290664 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 156ede8b11df47bfb33ea9e9a5400d69 Oct 18 13:19:46.290664 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-945453260-project Oct 18 13:19:46.290664 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:19:46.290664 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:19:46.290664 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'image_id': '6d5dde2f-e916-4161-a439-4adbdccf098a', 'id': 'os_distro'} Oct 18 13:19:46.290664 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:46.292114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6d5dde2f-e916-4161-a439-4adbdccf098a Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:46.294258 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6d5dde2f-e916-4161-a439-4adbdccf098a could not be found. Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:19:46.301756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.306234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bd8bd728-7922-4353-8066-1ca7ea33ec30 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:19:46.310493 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bd8bd728-7922-4353-8066-1ca7ea33ec30 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] 10.222.0.40 "DELETE /compute/v2.1/images/6d5dde2f-e916-4161-a439-4adbdccf098a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.448490 Oct 18 13:19:46.310493 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 481/984] 10.222.0.40 () {58 vars in 1293 bytes} [Tue Oct 18 13:19:45 2022] DELETE /compute/v2.1/images/6d5dde2f-e916-4161-a439-4adbdccf098a/metadata/os_distro => generated 62 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:19:46.310493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-76085a5f-61c4-4c3f-b2b2-0d631ad67662 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff614534f70>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:46.334969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-caa4d0da-55f3-4d00-8bf3-4e51ca896787 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:46.356285 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-caa4d0da-55f3-4d00-8bf3-4e51ca896787 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1330 microversion: 2.1 time: 0.333818 Oct 18 13:19:46.361706 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 504/985] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:46 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1330 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:46.379629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-813fc475-c28f-4deb-9f58-a8fa012f4088 req-6a9deda2-c0ac-43e2-ba32-b274d6769eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925c4106-eafb-486f-8846-ff04eea11eb3", "tag": "764246b4-ac2a-4fc1-ad53-12db75a818b1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:46.412429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-813fc475-c28f-4deb-9f58-a8fa012f4088 req-6a9deda2-c0ac-43e2-ba32-b274d6769eab service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:46.413096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-813fc475-c28f-4deb-9f58-a8fa012f4088 req-6a9deda2-c0ac-43e2-ba32-b274d6769eab service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:46.420690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-813fc475-c28f-4deb-9f58-a8fa012f4088 req-6a9deda2-c0ac-43e2-ba32-b274d6769eab service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:46.429721 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-76085a5f-61c4-4c3f-b2b2-0d631ad67662 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.137973 Oct 18 13:19:46.433318 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 482/986] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:46 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:46.446568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0de711fc-89c7-4e4e-8754-d32a367aacc8 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Calling method '.version_select at 0x7ff60f8a0dc0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:46.472876 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-813fc475-c28f-4deb-9f58-a8fa012f4088 req-6a9deda2-c0ac-43e2-ba32-b274d6769eab service nova] Creating event network-changed:764246b4-ac2a-4fc1-ad53-12db75a818b1 for instance 925c4106-eafb-486f-8846-ff04eea11eb3 on n-h1-858384-13 Oct 18 13:19:46.492071 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-813fc475-c28f-4deb-9f58-a8fa012f4088 req-6a9deda2-c0ac-43e2-ba32-b274d6769eab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123566 Oct 18 13:19:46.495749 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 505/987] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:46.497671 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-0de711fc-89c7-4e4e-8754-d32a367aacc8 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] HTTP exception thrown: Image not found. Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0de711fc-89c7-4e4e-8754-d32a367aacc8 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Request method failure captured: Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/images/afda0c5d-4bfd-48f8-9fac-451139cc61fc/metadata/os_version HTTP/1.1 Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqfxDne5W4fQz4_ewd4GxoXPD1Qq1h_0WiW4sykRy7O4Z5n48tg5o6u9IucolN6rfUcm2vmNOW1UO6b79I-QHwC7NIuWbOSX_8Zqd9q3UxpT-nBseuFHd5zo4Lt2Jh5Kfhi8Y9FtvxXDbcOs6jc1EzST-f1ESm1LAFXbAvAUVMlB0a4 Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aeddb0fe754a4bbea19515b112f991d1 Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:19:46.499895 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:19:46.501672 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aeddb0fe754a4bbea19515b112f991d1"}]}] Oct 18 13:19:46.501672 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.501672 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aeddb0fe754a4bbea19515b112f991d1 Oct 18 13:19:46.501672 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.501672 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesMetadataNegativeTestJSON-945453260-project Oct 18 13:19:46.501672 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:19:46.501672 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:19:46.501672 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 156ede8b11df47bfb33ea9e9a5400d69 Oct 18 13:19:46.501672 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-945453260-project Oct 18 13:19:46.501672 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:19:46.501672 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:19:46.501672 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'image_id': 'afda0c5d-4bfd-48f8-9fac-451139cc61fc', 'id': 'os_version'} Oct 18 13:19:46.501672 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:46.502910 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID afda0c5d-4bfd-48f8-9fac-451139cc61fc Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:46.504487 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image afda0c5d-4bfd-48f8-9fac-451139cc61fc could not be found. Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:19:46.505806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.507165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0de711fc-89c7-4e4e-8754-d32a367aacc8 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:19:46.509114 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0de711fc-89c7-4e4e-8754-d32a367aacc8 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] 10.222.0.40 "GET /compute/v2.1/images/afda0c5d-4bfd-48f8-9fac-451139cc61fc/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.066848 Oct 18 13:19:46.509114 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 483/988] 10.222.0.40 () {58 vars in 1293 bytes} [Tue Oct 18 13:19:46 2022] GET /compute/v2.1/images/afda0c5d-4bfd-48f8-9fac-451139cc61fc/metadata/os_version => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:19:46.511029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=34 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:46.514907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2cff8231-a946-4fe7-8f85-a4bf1224e346 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:46.515622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2cff8231-a946-4fe7-8f85-a4bf1224e346 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:46.517434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-02dffd11-e8f8-468c-bc99-d6afb23886fd tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Calling method '.version_select at 0x7ff60f87f1f0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:46.524567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2cff8231-a946-4fe7-8f85-a4bf1224e346 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:46.525289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2cff8231-a946-4fe7-8f85-a4bf1224e346 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:46.525916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2cff8231-a946-4fe7-8f85-a4bf1224e346 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:46.526892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2cff8231-a946-4fe7-8f85-a4bf1224e346 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:46.527518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2cff8231-a946-4fe7-8f85-a4bf1224e346 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:46.528210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2cff8231-a946-4fe7-8f85-a4bf1224e346 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:46.587198 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-02dffd11-e8f8-468c-bc99-d6afb23886fd tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] HTTP exception thrown: Image not found. Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-02dffd11-e8f8-468c-bc99-d6afb23886fd tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Request method failure captured: Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/images/b5c23902-4fe2-4d94-9b16-4807e5229dea/metadata HTTP/1.1 Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqfxDne5W4fQz4_ewd4GxoXPD1Qq1h_0WiW4sykRy7O4Z5n48tg5o6u9IucolN6rfUcm2vmNOW1UO6b79I-QHwC7NIuWbOSX_8Zqd9q3UxpT-nBseuFHd5zo4Lt2Jh5Kfhi8Y9FtvxXDbcOs6jc1EzST-f1ESm1LAFXbAvAUVMlB0a4 Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aeddb0fe754a4bbea19515b112f991d1 Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:19:46.590601 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:19:46.591947 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aeddb0fe754a4bbea19515b112f991d1"}]}] Oct 18 13:19:46.591947 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.591947 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aeddb0fe754a4bbea19515b112f991d1 Oct 18 13:19:46.591947 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.591947 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesMetadataNegativeTestJSON-945453260-project Oct 18 13:19:46.591947 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:19:46.591947 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:19:46.591947 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 156ede8b11df47bfb33ea9e9a5400d69 Oct 18 13:19:46.591947 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-945453260-project Oct 18 13:19:46.591947 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:19:46.591947 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:19:46.591947 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'image_id': 'b5c23902-4fe2-4d94-9b16-4807e5229dea'} Oct 18 13:19:46.591947 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:46.592800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b5c23902-4fe2-4d94-9b16-4807e5229dea Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:46.594011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b5c23902-4fe2-4d94-9b16-4807e5229dea could not be found. Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:19:46.595360 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.596599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-02dffd11-e8f8-468c-bc99-d6afb23886fd tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:19:46.598040 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-02dffd11-e8f8-468c-bc99-d6afb23886fd tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] 10.222.0.40 "GET /compute/v2.1/images/b5c23902-4fe2-4d94-9b16-4807e5229dea/metadata" status: 404 len: 62 microversion: 2.1 time: 0.082123 Oct 18 13:19:46.600215 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 484/989] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 18 13:19:46 2022] GET /compute/v2.1/images/b5c23902-4fe2-4d94-9b16-4807e5229dea/metadata => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:19:46.621511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6aa35852-dad4-4c6c-98c8-16af2d96aff3 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Action: 'update_all', calling method: .version_select at 0x7ff60f8880d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:46.673892 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-6aa35852-dad4-4c6c-98c8-16af2d96aff3 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] HTTP exception thrown: Image not found. Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6aa35852-dad4-4c6c-98c8-16af2d96aff3 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Request method failure captured: Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: request: PUT /compute/v2.1/images/44618e33-75f4-45c6-867c-f3ce74c3400e/metadata HTTP/1.1 Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 57 Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqfxDne5W4fQz4_ewd4GxoXPD1Qq1h_0WiW4sykRy7O4Z5n48tg5o6u9IucolN6rfUcm2vmNOW1UO6b79I-QHwC7NIuWbOSX_8Zqd9q3UxpT-nBseuFHd5zo4Lt2Jh5Kfhi8Y9FtvxXDbcOs6jc1EzST-f1ESm1LAFXbAvAUVMlB0a4 Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aeddb0fe754a4bbea19515b112f991d1 Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:19:46.678813 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aeddb0fe754a4bbea19515b112f991d1"}]}] Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aeddb0fe754a4bbea19515b112f991d1 Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesMetadataNegativeTestJSON-945453260-project Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 156ede8b11df47bfb33ea9e9a5400d69 Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-945453260-project Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:19:46.680549 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'image_id': '44618e33-75f4-45c6-867c-f3ce74c3400e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:46.687913 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 44618e33-75f4-45c6-867c-f3ce74c3400e Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:46.689228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 44618e33-75f4-45c6-867c-f3ce74c3400e could not be found. Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:19:46.690722 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:19:46.692234 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.695539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6aa35852-dad4-4c6c-98c8-16af2d96aff3 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:19:46.695539 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6aa35852-dad4-4c6c-98c8-16af2d96aff3 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] 10.222.0.40 "PUT /compute/v2.1/images/44618e33-75f4-45c6-867c-f3ce74c3400e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.071788 Oct 18 13:19:46.695539 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 485/990] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:19:46 2022] PUT /compute/v2.1/images/44618e33-75f4-45c6-867c-f3ce74c3400e/metadata => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:19:46.709828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f08539cd-c1db-46a6-967b-94219bc574a5 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Action: 'update', calling method: .version_select at 0x7ff614534f70>, body: {"meta": {"os_distro": "alt"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:46.771948 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-f08539cd-c1db-46a6-967b-94219bc574a5 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] HTTP exception thrown: Image not found. Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f08539cd-c1db-46a6-967b-94219bc574a5 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Request method failure captured: Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: request: PUT /compute/v2.1/images/50386d92-8a33-40b1-9e96-d19b338433b5/metadata/os_distro HTTP/1.1 Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 30 Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqfxDne5W4fQz4_ewd4GxoXPD1Qq1h_0WiW4sykRy7O4Z5n48tg5o6u9IucolN6rfUcm2vmNOW1UO6b79I-QHwC7NIuWbOSX_8Zqd9q3UxpT-nBseuFHd5zo4Lt2Jh5Kfhi8Y9FtvxXDbcOs6jc1EzST-f1ESm1LAFXbAvAUVMlB0a4 Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aeddb0fe754a4bbea19515b112f991d1 Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:19:46.774593 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aeddb0fe754a4bbea19515b112f991d1"}]}] Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aeddb0fe754a4bbea19515b112f991d1 Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesMetadataNegativeTestJSON-945453260-project Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 156ede8b11df47bfb33ea9e9a5400d69 Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-945453260-project Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: {"meta": {"os_distro": "alt"}} Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:19:46.776017 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'image_id': '50386d92-8a33-40b1-9e96-d19b338433b5', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:46.776919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 50386d92-8a33-40b1-9e96-d19b338433b5 Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:46.778134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50386d92-8a33-40b1-9e96-d19b338433b5 could not be found. Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:19:46.779364 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:19:46.780532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.782728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f08539cd-c1db-46a6-967b-94219bc574a5 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:19:46.783780 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f08539cd-c1db-46a6-967b-94219bc574a5 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] 10.222.0.40 "PUT /compute/v2.1/images/50386d92-8a33-40b1-9e96-d19b338433b5/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.093770 Oct 18 13:19:46.785435 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 486/991] 10.222.0.40 () {60 vars in 1310 bytes} [Tue Oct 18 13:19:46 2022] PUT /compute/v2.1/images/50386d92-8a33-40b1-9e96-d19b338433b5/metadata/os_distro => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:19:46.796367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5a338ec7-bc8a-4b97-834e-ce9c09adea98 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Action: 'create', calling method: .version_select at 0x7ff60f89a5e0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:46.858484 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-5a338ec7-bc8a-4b97-834e-ce9c09adea98 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] HTTP exception thrown: Image not found. Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5a338ec7-bc8a-4b97-834e-ce9c09adea98 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Request method failure captured: Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/images/83f38ead-768b-482b-b753-a55dbed77eee/metadata HTTP/1.1 Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 57 Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqfxDne5W4fQz4_ewd4GxoXPD1Qq1h_0WiW4sykRy7O4Z5n48tg5o6u9IucolN6rfUcm2vmNOW1UO6b79I-QHwC7NIuWbOSX_8Zqd9q3UxpT-nBseuFHd5zo4Lt2Jh5Kfhi8Y9FtvxXDbcOs6jc1EzST-f1ESm1LAFXbAvAUVMlB0a4 Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aeddb0fe754a4bbea19515b112f991d1 Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:19:46.862413 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aeddb0fe754a4bbea19515b112f991d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aeddb0fe754a4bbea19515b112f991d1"}]}] Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aeddb0fe754a4bbea19515b112f991d1 Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-945453260 Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesMetadataNegativeTestJSON-945453260-project Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 156ede8b11df47bfb33ea9e9a5400d69 Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-945453260-project Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:19:46.864002 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'image_id': '83f38ead-768b-482b-b753-a55dbed77eee', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:46.865024 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 83f38ead-768b-482b-b753-a55dbed77eee Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:46.866351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 83f38ead-768b-482b-b753-a55dbed77eee could not be found. Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:19:46.867954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:19:46.869309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:46.873132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5a338ec7-bc8a-4b97-834e-ce9c09adea98 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:19:46.873132 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5a338ec7-bc8a-4b97-834e-ce9c09adea98 tempest-ImagesMetadataNegativeTestJSON-945453260 tempest-ImagesMetadataNegativeTestJSON-945453260-project] 10.222.0.40 "POST /compute/v2.1/images/83f38ead-768b-482b-b753-a55dbed77eee/metadata" status: 404 len: 62 microversion: 2.1 time: 0.080268 Oct 18 13:19:46.873132 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 487/992] 10.222.0.40 () {60 vars in 1281 bytes} [Tue Oct 18 13:19:46 2022] POST /compute/v2.1/images/83f38ead-768b-482b-b753-a55dbed77eee/metadata => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:19:47.213560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2cff8231-a946-4fe7-8f85-a4bf1224e346 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:47.236176 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2cff8231-a946-4fe7-8f85-a4bf1224e346 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1477 microversion: 2.1 time: 0.737827 Oct 18 13:19:47.252574 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 506/993] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:46 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1477 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:47.389810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-87c597a3-ddef-47d7-8d4f-291c131efcae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:47.391054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-87c597a3-ddef-47d7-8d4f-291c131efcae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:47.403913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87c597a3-ddef-47d7-8d4f-291c131efcae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:47.408226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87c597a3-ddef-47d7-8d4f-291c131efcae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:47.413998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87c597a3-ddef-47d7-8d4f-291c131efcae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:47.420614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87c597a3-ddef-47d7-8d4f-291c131efcae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:47.428572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87c597a3-ddef-47d7-8d4f-291c131efcae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:47.431519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87c597a3-ddef-47d7-8d4f-291c131efcae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:47.449682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-44529d88-a084-424d-876d-8c8d78bab7a0 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f933ca0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:47.579928 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-44529d88-a084-424d-876d-8c8d78bab7a0 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.137143 Oct 18 13:19:47.581489 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 507/994] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:47 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:47.801988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-87c597a3-ddef-47d7-8d4f-291c131efcae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:47.816546 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-87c597a3-ddef-47d7-8d4f-291c131efcae tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1336 microversion: 2.1 time: 0.430990 Oct 18 13:19:47.821339 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 488/995] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:47 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1336 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:47.967288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3c7cf67b-9560-47a7-81cd-c3ec35622b9e req-8ff4cf41-9e4d-49a8-9085-a1fbbb73cd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a", "name": "network-vif-unplugged", "status": "completed", "tag": "127093c0-7bb4-4851-9d3b-35d03d5712b9"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:47.980826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:48.014291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3c7cf67b-9560-47a7-81cd-c3ec35622b9e req-8ff4cf41-9e4d-49a8-9085-a1fbbb73cd56 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:48.018862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3c7cf67b-9560-47a7-81cd-c3ec35622b9e req-8ff4cf41-9e4d-49a8-9085-a1fbbb73cd56 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:48.021449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3c7cf67b-9560-47a7-81cd-c3ec35622b9e req-8ff4cf41-9e4d-49a8-9085-a1fbbb73cd56 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:48.067024 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3c7cf67b-9560-47a7-81cd-c3ec35622b9e req-8ff4cf41-9e4d-49a8-9085-a1fbbb73cd56 service nova] Creating event network-vif-unplugged:127093c0-7bb4-4851-9d3b-35d03d5712b9 for instance 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a on n-h1-858384-13 Oct 18 13:19:48.078703 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3c7cf67b-9560-47a7-81cd-c3ec35622b9e req-8ff4cf41-9e4d-49a8-9085-a1fbbb73cd56 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116118 Oct 18 13:19:48.079956 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 508/996] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:48.270854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3c21fe9f-392b-4a98-b052-38a387e9b224 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:48.271653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3c21fe9f-392b-4a98-b052-38a387e9b224 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:48.288289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c21fe9f-392b-4a98-b052-38a387e9b224 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:48.290319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c21fe9f-392b-4a98-b052-38a387e9b224 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:48.290764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c21fe9f-392b-4a98-b052-38a387e9b224 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:48.291486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c21fe9f-392b-4a98-b052-38a387e9b224 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:48.291937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c21fe9f-392b-4a98-b052-38a387e9b224 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:48.292358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c21fe9f-392b-4a98-b052-38a387e9b224 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:48.602073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a0be80fe-7117-40e0-81df-cd6f69d71943 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f97ca60>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:48.680222 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a0be80fe-7117-40e0-81df-cd6f69d71943 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.086678 Oct 18 13:19:48.682469 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 509/997] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:48 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:48.844575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bb6daf8e-8abf-4269-91c4-7945c07b27cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:48.845344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bb6daf8e-8abf-4269-91c4-7945c07b27cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:48.861689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb6daf8e-8abf-4269-91c4-7945c07b27cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:48.866241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb6daf8e-8abf-4269-91c4-7945c07b27cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:48.869636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb6daf8e-8abf-4269-91c4-7945c07b27cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:48.872053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb6daf8e-8abf-4269-91c4-7945c07b27cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:48.875378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb6daf8e-8abf-4269-91c4-7945c07b27cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:48.876559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb6daf8e-8abf-4269-91c4-7945c07b27cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:49.327865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bb6daf8e-8abf-4269-91c4-7945c07b27cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:49.341023 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bb6daf8e-8abf-4269-91c4-7945c07b27cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1336 microversion: 2.1 time: 0.500257 Oct 18 13:19:49.343031 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 510/998] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:48 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1336 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:49.387339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3c21fe9f-392b-4a98-b052-38a387e9b224 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:49.413490 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3c21fe9f-392b-4a98-b052-38a387e9b224 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1477 microversion: 2.1 time: 1.153738 Oct 18 13:19:49.417935 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 489/999] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:48 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1477 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:49.696744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-169ffc41-3cdc-4440-9994-99779d33cdf6 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f8c5310>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:49.765486 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-169ffc41-3cdc-4440-9994-99779d33cdf6 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1423 microversion: 2.1 time: 0.072474 Oct 18 13:19:49.773876 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 511/1000] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:49 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:50.370402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1eb4f918-4df0-4206-8bcd-19b60e3dba68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:50.371434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1eb4f918-4df0-4206-8bcd-19b60e3dba68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:50.390258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1eb4f918-4df0-4206-8bcd-19b60e3dba68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:50.390965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1eb4f918-4df0-4206-8bcd-19b60e3dba68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:50.392661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1eb4f918-4df0-4206-8bcd-19b60e3dba68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:50.396932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1eb4f918-4df0-4206-8bcd-19b60e3dba68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:50.397665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1eb4f918-4df0-4206-8bcd-19b60e3dba68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:50.398969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1eb4f918-4df0-4206-8bcd-19b60e3dba68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:50.446506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-501322fa-b8b7-4172-9a1f-e0096d576f86 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:50.447134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-501322fa-b8b7-4172-9a1f-e0096d576f86 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:50.475545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-501322fa-b8b7-4172-9a1f-e0096d576f86 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:50.476067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-501322fa-b8b7-4172-9a1f-e0096d576f86 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:50.476519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-501322fa-b8b7-4172-9a1f-e0096d576f86 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:50.477285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-501322fa-b8b7-4172-9a1f-e0096d576f86 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:50.477950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-501322fa-b8b7-4172-9a1f-e0096d576f86 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:50.479437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-501322fa-b8b7-4172-9a1f-e0096d576f86 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:50.875199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-501322fa-b8b7-4172-9a1f-e0096d576f86 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:50.889769 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-501322fa-b8b7-4172-9a1f-e0096d576f86 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1477 microversion: 2.1 time: 0.446835 Oct 18 13:19:50.893741 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 512/1001] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:50 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1477 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:51.381552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1eb4f918-4df0-4206-8bcd-19b60e3dba68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:51.389813 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1eb4f918-4df0-4206-8bcd-19b60e3dba68 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1378 microversion: 2.1 time: 1.025273 Oct 18 13:19:51.397663 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 490/1002] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:50 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1378 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:51.427750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5b89cc4c-4deb-46f7-82a1-1fa468ac6216 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f8010d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:51.502056 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5b89cc4c-4deb-46f7-82a1-1fa468ac6216 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1432 microversion: 2.1 time: 0.087026 Oct 18 13:19:51.512379 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 491/1003] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:51 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1432 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:51.517487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-491c8153-3755-4d2f-9be8-18b27008bb5d tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f89a550>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:51.552326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1686277833", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "8ce69409-c2ff-4e41-b66f-2e55cf4d54f2"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:51.589759 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-491c8153-3755-4d2f-9be8-18b27008bb5d tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 200 len: 1432 microversion: 2.1 time: 0.076181 Oct 18 13:19:51.601744 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 492/1004] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:51 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 1432 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:51.607191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a0619f30-cab1-4e55-a413-3f6d18484251 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:51.608153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a0619f30-cab1-4e55-a413-3f6d18484251 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:51.617149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0619f30-cab1-4e55-a413-3f6d18484251 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:51.618066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0619f30-cab1-4e55-a413-3f6d18484251 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:51.618714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0619f30-cab1-4e55-a413-3f6d18484251 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:51.619667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0619f30-cab1-4e55-a413-3f6d18484251 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:51.620342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0619f30-cab1-4e55-a413-3f6d18484251 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:51.620984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0619f30-cab1-4e55-a413-3f6d18484251 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:51.656291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] validate_networks() for [('8ce69409-c2ff-4e41-b66f-2e55cf4d54f2', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:19:52.110425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a0619f30-cab1-4e55-a413-3f6d18484251 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:52.186673 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a0619f30-cab1-4e55-a413-3f6d18484251 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1466 microversion: 2.1 time: 0.580841 Oct 18 13:19:52.189081 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 493/1005] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:51 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1466 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:52.215048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cb464f49-f5bb-4e42-ba21-b12fd3560ffa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:52.217454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cb464f49-f5bb-4e42-ba21-b12fd3560ffa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:52.236800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb464f49-f5bb-4e42-ba21-b12fd3560ffa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:52.237440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb464f49-f5bb-4e42-ba21-b12fd3560ffa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:52.238332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb464f49-f5bb-4e42-ba21-b12fd3560ffa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:52.239396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb464f49-f5bb-4e42-ba21-b12fd3560ffa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:52.240506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb464f49-f5bb-4e42-ba21-b12fd3560ffa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:52.241298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb464f49-f5bb-4e42-ba21-b12fd3560ffa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:52.373701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:19:52.374585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:19:52.374585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:19:52.374929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:19:52.375351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:19:52.412313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:52.413121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:52.415900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:52.421240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:52.422832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:52.429045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:52.486334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Getting quotas for project 1201ae2b82b744e9a05b575beefa8ed5. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:19:52.509041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Getting quotas for user 0359db25df844b92a88adb1798695be2 and project 1201ae2b82b744e9a05b575beefa8ed5. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:19:52.541540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:19:52.550276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:19:52.672696 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-be6f6e3c-cd45-433c-a9b5-469c0f4a563b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.776689 Oct 18 13:19:52.673782 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 513/1006] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:19:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:19:52.683985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa1942fd-2699-4ccc-83da-b2ad46d96134 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f9184c0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:52.779041 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fa1942fd-2699-4ccc-83da-b2ad46d96134 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/c5f2027d-2f76-420c-95a8-7bb70182af23" status: 200 len: 784 microversion: 2.1 time: 0.103231 Oct 18 13:19:52.781722 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 514/1007] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:52 2022] GET /compute/v2.1/images/c5f2027d-2f76-420c-95a8-7bb70182af23 => generated 784 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:52.789454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d4d7b197-2559-4bc2-88f9-ff87a934aae7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:52.790838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d4d7b197-2559-4bc2-88f9-ff87a934aae7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:52.798672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4d7b197-2559-4bc2-88f9-ff87a934aae7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:52.801527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4d7b197-2559-4bc2-88f9-ff87a934aae7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:52.802168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4d7b197-2559-4bc2-88f9-ff87a934aae7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:52.804794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4d7b197-2559-4bc2-88f9-ff87a934aae7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:52.805665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4d7b197-2559-4bc2-88f9-ff87a934aae7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:52.806282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4d7b197-2559-4bc2-88f9-ff87a934aae7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:52.885870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cb464f49-f5bb-4e42-ba21-b12fd3560ffa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:52.908170 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cb464f49-f5bb-4e42-ba21-b12fd3560ffa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1477 microversion: 2.1 time: 0.716389 Oct 18 13:19:52.910966 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 494/1008] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:52 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1477 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:52.923768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-65f465b1-1420-432b-b5b6-78a766ea5e35 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:52.924797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-65f465b1-1420-432b-b5b6-78a766ea5e35 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:53.132494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-65f465b1-1420-432b-b5b6-78a766ea5e35 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:53.137220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d4d7b197-2559-4bc2-88f9-ff87a934aae7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:53.152071 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-65f465b1-1420-432b-b5b6-78a766ea5e35 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1216 microversion: 2.1 time: 0.231506 Oct 18 13:19:53.154127 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 495/1009] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:52 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1216 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:53.155194 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d4d7b197-2559-4bc2-88f9-ff87a934aae7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1378 microversion: 2.1 time: 0.371628 Oct 18 13:19:53.165540 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 515/1010] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:52 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1378 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:53.180107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9841ee58-b506-4067-85c0-c2fafea357f5 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:53.224010 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9841ee58-b506-4067-85c0-c2fafea357f5 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.063936 Oct 18 13:19:53.231710 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 496/1011] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:19:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:53.237564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aac0f7ba-ff4e-4ebd-b8de-f815a570a691 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f918280>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:53.945607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-40a5e98b-01d0-4426-9283-7b7513c8ca4b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:53.947958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-40a5e98b-01d0-4426-9283-7b7513c8ca4b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:53.997784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40a5e98b-01d0-4426-9283-7b7513c8ca4b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:54.000186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40a5e98b-01d0-4426-9283-7b7513c8ca4b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:54.005304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40a5e98b-01d0-4426-9283-7b7513c8ca4b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:54.021775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40a5e98b-01d0-4426-9283-7b7513c8ca4b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:54.025339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40a5e98b-01d0-4426-9283-7b7513c8ca4b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:54.026314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40a5e98b-01d0-4426-9283-7b7513c8ca4b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:54.539449 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aac0f7ba-ff4e-4ebd-b8de-f815a570a691 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "DELETE /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 204 len: 0 microversion: 2.1 time: 1.306255 Oct 18 13:19:54.540338 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 516/1012] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:53 2022] DELETE /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 0 bytes in 1308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:19:54.545367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ee325644-ddca-4f1f-bbf8-f8e22dd90f8b req-36990a60-ef58-48d4-9afa-8f636f154a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea85e7d-02ff-4fc3-bc01-720e7de9de87", "tag": "d3e28fd2-a20a-403c-adde-3da5ff496840"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:54.570669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ee325644-ddca-4f1f-bbf8-f8e22dd90f8b req-36990a60-ef58-48d4-9afa-8f636f154a58 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:54.571493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ee325644-ddca-4f1f-bbf8-f8e22dd90f8b req-36990a60-ef58-48d4-9afa-8f636f154a58 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:54.573442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ee325644-ddca-4f1f-bbf8-f8e22dd90f8b req-36990a60-ef58-48d4-9afa-8f636f154a58 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:54.599377 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ee325644-ddca-4f1f-bbf8-f8e22dd90f8b req-36990a60-ef58-48d4-9afa-8f636f154a58 service nova] Creating event network-changed:d3e28fd2-a20a-403c-adde-3da5ff496840 for instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 on n-h2-858384-13 Oct 18 13:19:54.608557 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ee325644-ddca-4f1f-bbf8-f8e22dd90f8b req-36990a60-ef58-48d4-9afa-8f636f154a58 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066526 Oct 18 13:19:54.609640 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 517/1013] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:54.617040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ad9839f1-d0c5-41d2-a297-a800e695411b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:54.618160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ad9839f1-d0c5-41d2-a297-a800e695411b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:54.626747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad9839f1-d0c5-41d2-a297-a800e695411b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:54.628581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad9839f1-d0c5-41d2-a297-a800e695411b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:54.629461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad9839f1-d0c5-41d2-a297-a800e695411b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:54.631200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad9839f1-d0c5-41d2-a297-a800e695411b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:54.632073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad9839f1-d0c5-41d2-a297-a800e695411b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:54.633403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad9839f1-d0c5-41d2-a297-a800e695411b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:54.775850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ad9839f1-d0c5-41d2-a297-a800e695411b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:54.786557 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ad9839f1-d0c5-41d2-a297-a800e695411b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1268 microversion: 2.1 time: 0.174763 Oct 18 13:19:54.788100 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 518/1014] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:54 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:54.805840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-76b29595-2a34-41b3-8090-a128b8200644 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:54.806631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-76b29595-2a34-41b3-8090-a128b8200644 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:54.816397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76b29595-2a34-41b3-8090-a128b8200644 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:54.817415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76b29595-2a34-41b3-8090-a128b8200644 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:54.818988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76b29595-2a34-41b3-8090-a128b8200644 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:54.820059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76b29595-2a34-41b3-8090-a128b8200644 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:54.820823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76b29595-2a34-41b3-8090-a128b8200644 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:54.822100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76b29595-2a34-41b3-8090-a128b8200644 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:54.992305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-40a5e98b-01d0-4426-9283-7b7513c8ca4b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:55.014349 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-40a5e98b-01d0-4426-9283-7b7513c8ca4b tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1477 microversion: 2.1 time: 1.075446 Oct 18 13:19:55.015037 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 497/1015] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:53 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1477 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:55.020009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-24bb062e-b991-43cc-a359-4def8171f3e6 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f806e50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:55.071593 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-24bb062e-b991-43cc-a359-4def8171f3e6 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] HTTP exception thrown: Image not found. Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-24bb062e-b991-43cc-a359-4def8171f3e6 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Request method failure captured: Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 HTTP/1.1 Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqe_erGAWJZ0V394ftD4p-tEpy8MDcH_xx4M-TtjDD4HiDuYEvzYWsXXceDvSxnQCsJH-e9rFw5a51TASP9lyXPafpm1dwK4mhu6FSo1oqcMEtgNb-qRrksw9hv2hpF0gbs5wv9PzhRsDNvi5ArAvRtmNeG-epmjwv0QrVVnvyCIBYk Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 8b25d34a33834e5e8861dc30586f56a4 Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesOneServerTestJSON-1298298477 Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:19:55.077949 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:19:55.079673 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8b25d34a33834e5e8861dc30586f56a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8b25d34a33834e5e8861dc30586f56a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8b25d34a33834e5e8861dc30586f56a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8b25d34a33834e5e8861dc30586f56a4"}]}] Oct 18 13:19:55.079673 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesOneServerTestJSON-1298298477 Oct 18 13:19:55.079673 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 8b25d34a33834e5e8861dc30586f56a4 Oct 18 13:19:55.079673 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1298298477 Oct 18 13:19:55.079673 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesOneServerTestJSON-1298298477-project Oct 18 13:19:55.079673 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:19:55.079673 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:19:55.079673 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: dcacade4c71a4ba9b16b896418771de5 Oct 18 13:19:55.079673 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesOneServerTestJSON-1298298477-project Oct 18 13:19:55.079673 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:19:55.079673 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:19:55.079673 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '7f42e3c2-0e83-4396-9a5f-431a71fcf3b0'} Oct 18 13:19:55.079673 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:55.080881 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:19:55.082432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 could not be found. Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:19:55.083645 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-24bb062e-b991-43cc-a359-4def8171f3e6 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:19:55.084783 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-24bb062e-b991-43cc-a359-4def8171f3e6 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 404 len: 62 microversion: 2.1 time: 0.063946 Oct 18 13:19:55.085901 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 498/1016] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:55 2022] GET /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:19:55.091061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-938f5a91-5a44-434c-b437-d5d32051514d req-db0b6f66-2b5f-400f-8859-9eb86d546ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a", "name": "network-vif-plugged", "status": "completed", "tag": "127093c0-7bb4-4851-9d3b-35d03d5712b9"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:55.119745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-938f5a91-5a44-434c-b437-d5d32051514d req-db0b6f66-2b5f-400f-8859-9eb86d546ef8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:55.120511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-938f5a91-5a44-434c-b437-d5d32051514d req-db0b6f66-2b5f-400f-8859-9eb86d546ef8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:55.120675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-938f5a91-5a44-434c-b437-d5d32051514d req-db0b6f66-2b5f-400f-8859-9eb86d546ef8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:55.190894 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-938f5a91-5a44-434c-b437-d5d32051514d req-db0b6f66-2b5f-400f-8859-9eb86d546ef8 service nova] Creating event network-vif-plugged:127093c0-7bb4-4851-9d3b-35d03d5712b9 for instance 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a on n-h1-858384-13 Oct 18 13:19:55.220283 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-938f5a91-5a44-434c-b437-d5d32051514d req-db0b6f66-2b5f-400f-8859-9eb86d546ef8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136343 Oct 18 13:19:55.221874 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 499/1017] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:55.258831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4c971ba9-964d-426c-b800-7031c40f7754 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1488106680"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:55.270390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4c971ba9-964d-426c-b800-7031c40f7754 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:55.288123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c971ba9-964d-426c-b800-7031c40f7754 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:55.289585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c971ba9-964d-426c-b800-7031c40f7754 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:55.291188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c971ba9-964d-426c-b800-7031c40f7754 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:55.295183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c971ba9-964d-426c-b800-7031c40f7754 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:55.298921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c971ba9-964d-426c-b800-7031c40f7754 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:55.301666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c971ba9-964d-426c-b800-7031c40f7754 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:55.658186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-76b29595-2a34-41b3-8090-a128b8200644 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:55.666365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:55.670402 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-76b29595-2a34-41b3-8090-a128b8200644 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1378 microversion: 2.1 time: 0.880947 Oct 18 13:19:55.671234 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 519/1018] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:54 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1378 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:55.694074 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4c971ba9-964d-426c-b800-7031c40f7754 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "POST /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b/action" status: 202 len: 0 microversion: 2.1 time: 0.464606 Oct 18 13:19:55.695669 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 500/1019] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:19:55 2022] POST /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:19:55.707717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9a51a788-50a4-4a1e-abd8-2b488a462f67 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f9a51f0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:55.804262 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9a51a788-50a4-4a1e-abd8-2b488a462f67 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.101666 Oct 18 13:19:55.806031 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 520/1020] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:55 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:55.824625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5e2f8898-2b9f-4bc6-8328-9b5995aa41c9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:55.825603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5e2f8898-2b9f-4bc6-8328-9b5995aa41c9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:55.838710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e2f8898-2b9f-4bc6-8328-9b5995aa41c9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:55.839607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e2f8898-2b9f-4bc6-8328-9b5995aa41c9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:55.840714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e2f8898-2b9f-4bc6-8328-9b5995aa41c9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:55.841980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e2f8898-2b9f-4bc6-8328-9b5995aa41c9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:55.842559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e2f8898-2b9f-4bc6-8328-9b5995aa41c9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:55.843030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e2f8898-2b9f-4bc6-8328-9b5995aa41c9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:56.043539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5403a922-2b27-4893-83e8-7c2764b4f36f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:56.044167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5403a922-2b27-4893-83e8-7c2764b4f36f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:56.054930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5403a922-2b27-4893-83e8-7c2764b4f36f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:56.055852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5403a922-2b27-4893-83e8-7c2764b4f36f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:56.056561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5403a922-2b27-4893-83e8-7c2764b4f36f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:56.057861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5403a922-2b27-4893-83e8-7c2764b4f36f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:56.058742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5403a922-2b27-4893-83e8-7c2764b4f36f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:56.067009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5403a922-2b27-4893-83e8-7c2764b4f36f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:56.161243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5e2f8898-2b9f-4bc6-8328-9b5995aa41c9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:56.182473 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5e2f8898-2b9f-4bc6-8328-9b5995aa41c9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1274 microversion: 2.1 time: 0.363145 Oct 18 13:19:56.183099 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 501/1021] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:55 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1274 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:56.458860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5403a922-2b27-4893-83e8-7c2764b4f36f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:56.472587 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5403a922-2b27-4893-83e8-7c2764b4f36f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1477 microversion: 2.1 time: 0.430796 Oct 18 13:19:56.472587 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 521/1022] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:56 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1477 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:56.711170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cbd97f5c-257b-4dfb-9aeb-8e054790f54a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:56.711795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cbd97f5c-257b-4dfb-9aeb-8e054790f54a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:56.719515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbd97f5c-257b-4dfb-9aeb-8e054790f54a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:56.720017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbd97f5c-257b-4dfb-9aeb-8e054790f54a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:56.720448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbd97f5c-257b-4dfb-9aeb-8e054790f54a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:56.728781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbd97f5c-257b-4dfb-9aeb-8e054790f54a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:56.729328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbd97f5c-257b-4dfb-9aeb-8e054790f54a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:56.737308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbd97f5c-257b-4dfb-9aeb-8e054790f54a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:56.820601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68b87cbe-f694-44c9-8e12-63af10d443ab tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f964160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:56.886924 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68b87cbe-f694-44c9-8e12-63af10d443ab tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.069942 Oct 18 13:19:56.896180 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 522/1023] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:56 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:57.213030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-093d0c79-785e-4340-b1b4-24da6a821fdc tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:57.213826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-093d0c79-785e-4340-b1b4-24da6a821fdc tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:57.240695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-093d0c79-785e-4340-b1b4-24da6a821fdc tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:57.241311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-093d0c79-785e-4340-b1b4-24da6a821fdc tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:57.241781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-093d0c79-785e-4340-b1b4-24da6a821fdc tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:57.242507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-093d0c79-785e-4340-b1b4-24da6a821fdc tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:57.242964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-093d0c79-785e-4340-b1b4-24da6a821fdc tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:57.243591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-093d0c79-785e-4340-b1b4-24da6a821fdc tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:57.343728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cbd97f5c-257b-4dfb-9aeb-8e054790f54a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:57.358721 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cbd97f5c-257b-4dfb-9aeb-8e054790f54a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1378 microversion: 2.1 time: 0.652632 Oct 18 13:19:57.360827 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 502/1024] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:56 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1378 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:57.371309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ceab2aa2-0afd-43ae-858c-edb7d8f6e6b3 req-f5fe1742-7005-47b0-9713-623ac8ace260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938746d4-6297-49a5-811f-89814a1e182b", "name": "network-vif-unplugged", "status": "completed", "tag": "a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:57.404807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ceab2aa2-0afd-43ae-858c-edb7d8f6e6b3 req-f5fe1742-7005-47b0-9713-623ac8ace260 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:57.405430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ceab2aa2-0afd-43ae-858c-edb7d8f6e6b3 req-f5fe1742-7005-47b0-9713-623ac8ace260 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:57.409154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ceab2aa2-0afd-43ae-858c-edb7d8f6e6b3 req-f5fe1742-7005-47b0-9713-623ac8ace260 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:57.436416 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ceab2aa2-0afd-43ae-858c-edb7d8f6e6b3 req-f5fe1742-7005-47b0-9713-623ac8ace260 service nova] Creating event network-vif-unplugged:a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1 for instance 938746d4-6297-49a5-811f-89814a1e182b on n-h2-858384-13 Oct 18 13:19:57.445001 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ceab2aa2-0afd-43ae-858c-edb7d8f6e6b3 req-f5fe1742-7005-47b0-9713-623ac8ace260 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080056 Oct 18 13:19:57.449608 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 503/1025] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:19:57.463981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-093d0c79-785e-4340-b1b4-24da6a821fdc tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:57.495353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e1085361-2aac-4efb-9001-bed3292958fa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:57.496942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e1085361-2aac-4efb-9001-bed3292958fa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:57.508045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1085361-2aac-4efb-9001-bed3292958fa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:57.510272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1085361-2aac-4efb-9001-bed3292958fa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:57.510420 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-093d0c79-785e-4340-b1b4-24da6a821fdc tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1274 microversion: 2.1 time: 0.297956 Oct 18 13:19:57.511021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1085361-2aac-4efb-9001-bed3292958fa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:57.511975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1085361-2aac-4efb-9001-bed3292958fa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:57.512676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1085361-2aac-4efb-9001-bed3292958fa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:57.513359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1085361-2aac-4efb-9001-bed3292958fa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:57.518565 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 523/1026] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:57 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1274 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:19:57.904336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e147e578-b534-415b-80ac-be4ef5de3084 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f8dcdc0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:57.988932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e1085361-2aac-4efb-9001-bed3292958fa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:57.996720 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e147e578-b534-415b-80ac-be4ef5de3084 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.096969 Oct 18 13:19:58.008452 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e1085361-2aac-4efb-9001-bed3292958fa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1477 microversion: 2.1 time: 0.514054 Oct 18 13:19:58.021597 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 524/1027] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:57 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:58.027493 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 504/1028] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:57 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1477 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:58.389273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fb2a0c26-4a23-4fae-83f1-47ed66298a42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:58.390139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb2a0c26-4a23-4fae-83f1-47ed66298a42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:58.399608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb2a0c26-4a23-4fae-83f1-47ed66298a42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:58.400718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb2a0c26-4a23-4fae-83f1-47ed66298a42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:58.401673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb2a0c26-4a23-4fae-83f1-47ed66298a42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:58.404408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb2a0c26-4a23-4fae-83f1-47ed66298a42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:58.414205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb2a0c26-4a23-4fae-83f1-47ed66298a42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:58.415514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb2a0c26-4a23-4fae-83f1-47ed66298a42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:58.540451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-745e6d0d-9bea-4e17-9e0d-affa36534ce9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:58.541057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-745e6d0d-9bea-4e17-9e0d-affa36534ce9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:58.550362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-745e6d0d-9bea-4e17-9e0d-affa36534ce9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:58.551795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-745e6d0d-9bea-4e17-9e0d-affa36534ce9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:58.552624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-745e6d0d-9bea-4e17-9e0d-affa36534ce9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:58.553640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-745e6d0d-9bea-4e17-9e0d-affa36534ce9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:58.554546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-745e6d0d-9bea-4e17-9e0d-affa36534ce9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:58.555791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-745e6d0d-9bea-4e17-9e0d-affa36534ce9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:58.826227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fb2a0c26-4a23-4fae-83f1-47ed66298a42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:58.839928 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fb2a0c26-4a23-4fae-83f1-47ed66298a42 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1378 microversion: 2.1 time: 0.454565 Oct 18 13:19:58.841311 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 525/1029] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:58 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1378 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:58.938485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-745e6d0d-9bea-4e17-9e0d-affa36534ce9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:58.952083 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-745e6d0d-9bea-4e17-9e0d-affa36534ce9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1316 microversion: 2.1 time: 0.418087 Oct 18 13:19:58.953267 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 505/1030] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:58 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:58.954473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-918014cb-549a-4a0c-a98c-32c9305117bd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:58.954968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-918014cb-549a-4a0c-a98c-32c9305117bd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:58.969652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-918014cb-549a-4a0c-a98c-32c9305117bd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:58.970167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-918014cb-549a-4a0c-a98c-32c9305117bd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:58.972074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-918014cb-549a-4a0c-a98c-32c9305117bd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:58.975134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-918014cb-549a-4a0c-a98c-32c9305117bd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:58.975644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-918014cb-549a-4a0c-a98c-32c9305117bd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:58.976090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-918014cb-549a-4a0c-a98c-32c9305117bd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:59.036608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d4e88f71-5102-47cc-b4ae-1f62036aec39 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:59.037365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d4e88f71-5102-47cc-b4ae-1f62036aec39 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:59.042314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-918014cb-549a-4a0c-a98c-32c9305117bd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:19:59.050218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4e88f71-5102-47cc-b4ae-1f62036aec39 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:59.050728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4e88f71-5102-47cc-b4ae-1f62036aec39 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:59.051162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4e88f71-5102-47cc-b4ae-1f62036aec39 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:59.055492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4e88f71-5102-47cc-b4ae-1f62036aec39 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:59.056150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4e88f71-5102-47cc-b4ae-1f62036aec39 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:59.057691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4e88f71-5102-47cc-b4ae-1f62036aec39 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:59.256841 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-918014cb-549a-4a0c-a98c-32c9305117bd tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 204 len: 0 microversion: 2.1 time: 0.306190 Oct 18 13:19:59.257473 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 526/1031] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:19:58 2022] DELETE /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:19:59.270753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-19af9150-e7ae-478e-9366-9a34bf4aae04 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f8c28b0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:59.331800 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-19af9150-e7ae-478e-9366-9a34bf4aae04 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.072876 Oct 18 13:19:59.340498 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 527/1032] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:19:59 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:59.449046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-667519940", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "1560907670", "adminPass": "***", "networks": [{"uuid": "f9661cdc-4357-4c90-9eb1-93262edd645f"}], "security_groups": [{"name": "tempest-securitygroup--1295894535"}], "key_name": "tempest-keypair-597482813", "user_data": "}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:59.532008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d4e88f71-5102-47cc-b4ae-1f62036aec39 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:19:59.555246 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d4e88f71-5102-47cc-b4ae-1f62036aec39 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1462 microversion: 2.1 time: 0.520953 Oct 18 13:19:59.565145 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 506/1033] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:59 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1462 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:19:59.596371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-772bb371-a3d7-4a56-a724-391f9c7192cd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:19:59.599228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-772bb371-a3d7-4a56-a724-391f9c7192cd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:59.606659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-772bb371-a3d7-4a56-a724-391f9c7192cd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:59.607909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-772bb371-a3d7-4a56-a724-391f9c7192cd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:59.608926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-772bb371-a3d7-4a56-a724-391f9c7192cd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:59.610188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-772bb371-a3d7-4a56-a724-391f9c7192cd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:59.610863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-772bb371-a3d7-4a56-a724-391f9c7192cd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:59.611495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-772bb371-a3d7-4a56-a724-391f9c7192cd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:59.718626 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-772bb371-a3d7-4a56-a724-391f9c7192cd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action" status: 202 len: 0 microversion: 2.1 time: 0.125561 Oct 18 13:19:59.720718 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 507/1034] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:19:59 2022] POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:19:59.733321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5880fb14-bc56-4291-8064-cee948715665 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:19:59.734558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5880fb14-bc56-4291-8064-cee948715665 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:19:59.744531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5880fb14-bc56-4291-8064-cee948715665 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:59.745330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5880fb14-bc56-4291-8064-cee948715665 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:59.746036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5880fb14-bc56-4291-8064-cee948715665 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:59.747087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5880fb14-bc56-4291-8064-cee948715665 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:59.747795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5880fb14-bc56-4291-8064-cee948715665 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:59.748538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5880fb14-bc56-4291-8064-cee948715665 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:59.778396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:19:59.792114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5880fb14-bc56-4291-8064-cee948715665 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:19:59.792761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5880fb14-bc56-4291-8064-cee948715665 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:19:59.793366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5880fb14-bc56-4291-8064-cee948715665 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:19:59.794200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-5880fb14-bc56-4291-8064-cee948715665 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lazy-loading 'fault' on Instance uuid 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:19:59.902012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] validate_networks() for [('f9661cdc-4357-4c90-9eb1-93262edd645f', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:20:00.294363 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5880fb14-bc56-4291-8064-cee948715665 tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1598 microversion: 2.1 time: 0.568891 Oct 18 13:20:00.311582 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 508/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:19:59 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1598 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:00.322480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-562e43a2-6c1e-400e-820f-fa2296e723f4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:00.323098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-562e43a2-6c1e-400e-820f-fa2296e723f4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:00.343468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-562e43a2-6c1e-400e-820f-fa2296e723f4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:00.344310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-562e43a2-6c1e-400e-820f-fa2296e723f4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:00.346831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-562e43a2-6c1e-400e-820f-fa2296e723f4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:00.347931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-562e43a2-6c1e-400e-820f-fa2296e723f4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:00.348593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-562e43a2-6c1e-400e-820f-fa2296e723f4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:00.349966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-562e43a2-6c1e-400e-820f-fa2296e723f4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:00.639727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:20:00.640257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:20:00.640930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:20:00.641475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:20:00.642099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:20:00.653874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=25 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:00.662561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:00.664828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:00.667128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:00.668059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:00.672199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:00.672827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:00.713147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Getting quotas for project ef15948e13464e45ba93cb1c5922a872. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:20:00.725835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Getting quotas for user 3a42f7285eab4c2cb58d06b302f8f185 and project ef15948e13464e45ba93cb1c5922a872. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:20:00.757066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:20:00.765247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:20:00.820591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-562e43a2-6c1e-400e-820f-fa2296e723f4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:00.862877 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-562e43a2-6c1e-400e-820f-fa2296e723f4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1378 microversion: 2.1 time: 0.550048 Oct 18 13:20:00.869620 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 509/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:00 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1378 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:00.884814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a44c4080-5ecb-4ef3-814e-10131f5da549 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:00.884814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a44c4080-5ecb-4ef3-814e-10131f5da549 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:00.904477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a44c4080-5ecb-4ef3-814e-10131f5da549 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:00.905310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a44c4080-5ecb-4ef3-814e-10131f5da549 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:00.905970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a44c4080-5ecb-4ef3-814e-10131f5da549 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:00.906983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a44c4080-5ecb-4ef3-814e-10131f5da549 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:00.907628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a44c4080-5ecb-4ef3-814e-10131f5da549 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:00.908868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a44c4080-5ecb-4ef3-814e-10131f5da549 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:00.938661 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a45d5b08-da6e-4e0c-a063-461e77f3164b tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.493936 Oct 18 13:20:00.944188 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 528/1037] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:19:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:20:00.962155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-0c946c67-df33-46bc-809b-3fba23171d9b req-dde88316-2dfc-497a-b190-d88ab546897c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d4784d-11ed-46a8-ab37-4dd797beb30a", "tag": "932fabd8-90dd-4fb2-b707-55c3c3d89f3e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:00.997982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0c946c67-df33-46bc-809b-3fba23171d9b req-dde88316-2dfc-497a-b190-d88ab546897c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:00.998751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0c946c67-df33-46bc-809b-3fba23171d9b req-dde88316-2dfc-497a-b190-d88ab546897c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:00.999397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0c946c67-df33-46bc-809b-3fba23171d9b req-dde88316-2dfc-497a-b190-d88ab546897c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:01.036587 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-0c946c67-df33-46bc-809b-3fba23171d9b req-dde88316-2dfc-497a-b190-d88ab546897c service nova] Creating event network-changed:932fabd8-90dd-4fb2-b707-55c3c3d89f3e for instance a8d4784d-11ed-46a8-ab37-4dd797beb30a on n-h2-858384-13 Oct 18 13:20:01.068140 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-0c946c67-df33-46bc-809b-3fba23171d9b req-dde88316-2dfc-497a-b190-d88ab546897c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121852 Oct 18 13:20:01.071632 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 529/1038] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:01.091985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e0a1a13f-0ef5-4359-aa7c-531bf7cd1fbd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:01.099484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e0a1a13f-0ef5-4359-aa7c-531bf7cd1fbd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:01.115196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0a1a13f-0ef5-4359-aa7c-531bf7cd1fbd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:01.115888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0a1a13f-0ef5-4359-aa7c-531bf7cd1fbd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:01.116656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0a1a13f-0ef5-4359-aa7c-531bf7cd1fbd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:01.117774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0a1a13f-0ef5-4359-aa7c-531bf7cd1fbd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:01.120178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0a1a13f-0ef5-4359-aa7c-531bf7cd1fbd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:01.120816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0a1a13f-0ef5-4359-aa7c-531bf7cd1fbd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:01.343651 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e0a1a13f-0ef5-4359-aa7c-531bf7cd1fbd tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action" status: 202 len: 0 microversion: 2.1 time: 0.265481 Oct 18 13:20:01.345877 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 530/1039] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:20:01 2022] POST /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:20:01.364282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e456ceda-f03a-46e7-9bd0-f0b298abe51b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60fc9f160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:01.499540 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e456ceda-f03a-46e7-9bd0-f0b298abe51b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.149650 Oct 18 13:20:01.500169 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 531/1040] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:01 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:01.512342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-989d2273-ef8d-43ef-bfc3-acbd8d8b7658 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:01.515544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-989d2273-ef8d-43ef-bfc3-acbd8d8b7658 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:01.920721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a44c4080-5ecb-4ef3-814e-10131f5da549 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:01.974544 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a44c4080-5ecb-4ef3-814e-10131f5da549 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1316 microversion: 2.1 time: 1.103021 Oct 18 13:20:01.975070 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 510/1041] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:00 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1316 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:01.993362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-989d2273-ef8d-43ef-bfc3-acbd8d8b7658 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:02.005133 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-989d2273-ef8d-43ef-bfc3-acbd8d8b7658 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1263 microversion: 2.1 time: 0.503693 Oct 18 13:20:02.008871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-26ba9b67-df91-45fd-8e4c-07c4b7fe9c9c tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:02.009564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-26ba9b67-df91-45fd-8e4c-07c4b7fe9c9c tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:02.010914 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 532/1042] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:01 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1263 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:02.024255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26ba9b67-df91-45fd-8e4c-07c4b7fe9c9c tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:02.025048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26ba9b67-df91-45fd-8e4c-07c4b7fe9c9c tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:02.025691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26ba9b67-df91-45fd-8e4c-07c4b7fe9c9c tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:02.026641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26ba9b67-df91-45fd-8e4c-07c4b7fe9c9c tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:02.027260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26ba9b67-df91-45fd-8e4c-07c4b7fe9c9c tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:02.028596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-489a2ee9-449e-47cb-b860-81d434e8cc11 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:02.029346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26ba9b67-df91-45fd-8e4c-07c4b7fe9c9c tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:02.030588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-489a2ee9-449e-47cb-b860-81d434e8cc11 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:02.053249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-489a2ee9-449e-47cb-b860-81d434e8cc11 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:02.053742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-489a2ee9-449e-47cb-b860-81d434e8cc11 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:02.054176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-489a2ee9-449e-47cb-b860-81d434e8cc11 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:02.065698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-489a2ee9-449e-47cb-b860-81d434e8cc11 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:02.065977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-489a2ee9-449e-47cb-b860-81d434e8cc11 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:02.066416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-489a2ee9-449e-47cb-b860-81d434e8cc11 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:03.145321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=7 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:03.391565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-489a2ee9-449e-47cb-b860-81d434e8cc11 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:03.406513 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-489a2ee9-449e-47cb-b860-81d434e8cc11 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1378 microversion: 2.1 time: 1.393550 Oct 18 13:20:03.407629 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 533/1043] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:02 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1378 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:03.412608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9e0286aa-0969-4c85-998c-0d5a37f122d0 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f9640d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:03.516778 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-26ba9b67-df91-45fd-8e4c-07c4b7fe9c9c tempest-ServersAdminTestJSON-2122514609 tempest-ServersAdminTestJSON-2122514609-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1615 microversion: 2.1 time: 1.514019 Oct 18 13:20:03.519899 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 511/1044] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:01 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1615 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:03.532946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f87aeca1-8b5c-4b1b-9019-d3fb8f8d51fd tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:03.535560 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9e0286aa-0969-4c85-998c-0d5a37f122d0 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.126606 Oct 18 13:20:03.536984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f87aeca1-8b5c-4b1b-9019-d3fb8f8d51fd tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:03.544796 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 534/1045] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:03 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:03.551953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-255111f9-7890-4560-a70d-d4c4536d6a84 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:03.559464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f87aeca1-8b5c-4b1b-9019-d3fb8f8d51fd tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:03.560016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-255111f9-7890-4560-a70d-d4c4536d6a84 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:03.562023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f87aeca1-8b5c-4b1b-9019-d3fb8f8d51fd tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:03.563086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f87aeca1-8b5c-4b1b-9019-d3fb8f8d51fd tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:03.567043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f87aeca1-8b5c-4b1b-9019-d3fb8f8d51fd tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:03.569674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f87aeca1-8b5c-4b1b-9019-d3fb8f8d51fd tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:03.570798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f87aeca1-8b5c-4b1b-9019-d3fb8f8d51fd tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:03.585912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-255111f9-7890-4560-a70d-d4c4536d6a84 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:03.588776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-255111f9-7890-4560-a70d-d4c4536d6a84 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:03.589444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-255111f9-7890-4560-a70d-d4c4536d6a84 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:03.590078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-255111f9-7890-4560-a70d-d4c4536d6a84 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:03.595885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-255111f9-7890-4560-a70d-d4c4536d6a84 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:03.600086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-255111f9-7890-4560-a70d-d4c4536d6a84 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:03.808153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-255111f9-7890-4560-a70d-d4c4536d6a84 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:03.845040 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-255111f9-7890-4560-a70d-d4c4536d6a84 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1315 microversion: 2.1 time: 0.288434 Oct 18 13:20:03.847725 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 535/1046] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:03 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:03.886613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8ab88605-e650-440a-80b3-7008b5ad3bac tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:03.894536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8ab88605-e650-440a-80b3-7008b5ad3bac tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:03.907092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ab88605-e650-440a-80b3-7008b5ad3bac tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:03.908078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ab88605-e650-440a-80b3-7008b5ad3bac tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:03.909701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ab88605-e650-440a-80b3-7008b5ad3bac tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:03.910896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ab88605-e650-440a-80b3-7008b5ad3bac tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:03.914697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ab88605-e650-440a-80b3-7008b5ad3bac tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:03.919315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ab88605-e650-440a-80b3-7008b5ad3bac tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:03.987638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8ab88605-e650-440a-80b3-7008b5ad3bac tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:20:04.179388 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8ab88605-e650-440a-80b3-7008b5ad3bac tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 204 len: 0 microversion: 2.1 time: 0.328655 Oct 18 13:20:04.180864 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 536/1047] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:20:03 2022] DELETE /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:20:04.550345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-465246015", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "0b58d9a8-4835-4530-9695-a2f702e82ee6"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:04.707699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] validate_networks() for [('0b58d9a8-4835-4530-9695-a2f702e82ee6', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:20:05.011374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f87aeca1-8b5c-4b1b-9019-d3fb8f8d51fd tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:05.033615 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f87aeca1-8b5c-4b1b-9019-d3fb8f8d51fd tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1316 microversion: 2.1 time: 1.511495 Oct 18 13:20:05.052727 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 512/1048] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:03 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1316 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:05.076633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ae38bc6b-6580-4ae5-869e-1e425acb0d83 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:05.078031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ae38bc6b-6580-4ae5-869e-1e425acb0d83 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:05.090108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae38bc6b-6580-4ae5-869e-1e425acb0d83 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:05.091057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae38bc6b-6580-4ae5-869e-1e425acb0d83 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:05.091951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae38bc6b-6580-4ae5-869e-1e425acb0d83 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:05.092982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae38bc6b-6580-4ae5-869e-1e425acb0d83 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:05.093720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae38bc6b-6580-4ae5-869e-1e425acb0d83 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:05.094447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae38bc6b-6580-4ae5-869e-1e425acb0d83 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:05.837711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:20:05.839193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:20:05.839941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:20:05.840902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:20:05.846435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:20:05.873270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:05.883685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:05.884520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:05.885609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:05.886330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:05.887013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:05.925840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=7 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:05.950768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Getting quotas for project 472fc8535c504953a8f14a24f9d22260. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:20:05.962532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Getting quotas for user f896caa4caa0472db9198f7795401df2 and project 472fc8535c504953a8f14a24f9d22260. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:20:06.010557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:20:06.013080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:20:06.165768 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9854896b-8662-4336-9e21-6c8fb3b2635a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.977024 Oct 18 13:20:06.166420 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 537/1049] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:20:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:20:06.184077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4b5c7ada-a647-4f78-a24f-33e6c65b00a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:06.184731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4b5c7ada-a647-4f78-a24f-33e6c65b00a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:06.212916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b5c7ada-a647-4f78-a24f-33e6c65b00a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:06.213461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b5c7ada-a647-4f78-a24f-33e6c65b00a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:06.217929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b5c7ada-a647-4f78-a24f-33e6c65b00a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:06.218827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b5c7ada-a647-4f78-a24f-33e6c65b00a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:06.219313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b5c7ada-a647-4f78-a24f-33e6c65b00a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:06.219747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b5c7ada-a647-4f78-a24f-33e6c65b00a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:06.661008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ae38bc6b-6580-4ae5-869e-1e425acb0d83 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:06.676700 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ae38bc6b-6580-4ae5-869e-1e425acb0d83 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1469 microversion: 2.1 time: 1.620737 Oct 18 13:20:06.701082 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 513/1050] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:05 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1469 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:06.713856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1b7ca74b-8fb8-449d-b8d8-d440fb7d2c28 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f80adc0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:06.826103 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1b7ca74b-8fb8-449d-b8d8-d440fb7d2c28 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.120409 Oct 18 13:20:06.826743 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 514/1051] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:06 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:06.860369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c8010cb-1760-44c6-8280-b88bf97929c5 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:06.864071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2c8010cb-1760-44c6-8280-b88bf97929c5 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:06.872686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=82 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:06.895529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c8010cb-1760-44c6-8280-b88bf97929c5 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:06.905480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c8010cb-1760-44c6-8280-b88bf97929c5 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:06.906680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c8010cb-1760-44c6-8280-b88bf97929c5 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:06.909583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c8010cb-1760-44c6-8280-b88bf97929c5 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:06.915476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c8010cb-1760-44c6-8280-b88bf97929c5 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:06.916490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c8010cb-1760-44c6-8280-b88bf97929c5 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:07.287657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b5c7ada-a647-4f78-a24f-33e6c65b00a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:07.296940 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4b5c7ada-a647-4f78-a24f-33e6c65b00a7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1378 microversion: 2.1 time: 1.129112 Oct 18 13:20:07.297596 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 538/1052] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:06 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1378 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:07.327072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8c4a4eae-4518-4480-a405-9d33a3414c66 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:07.327697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8c4a4eae-4518-4480-a405-9d33a3414c66 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:07.340842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:07.345009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c4a4eae-4518-4480-a405-9d33a3414c66 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:07.350632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c4a4eae-4518-4480-a405-9d33a3414c66 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:07.351372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c4a4eae-4518-4480-a405-9d33a3414c66 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:07.352320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c4a4eae-4518-4480-a405-9d33a3414c66 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:07.352974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c4a4eae-4518-4480-a405-9d33a3414c66 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:07.353638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c4a4eae-4518-4480-a405-9d33a3414c66 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:07.838258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2c8010cb-1760-44c6-8280-b88bf97929c5 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:07.895637 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2c8010cb-1760-44c6-8280-b88bf97929c5 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1321 microversion: 2.1 time: 1.064403 Oct 18 13:20:07.896142 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 515/1053] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:06 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1321 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:07.911446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8c4a4eae-4518-4480-a405-9d33a3414c66 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:07.924667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c55f1c2c-26b8-4035-a4fd-94ce21d3f208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:07.925319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c55f1c2c-26b8-4035-a4fd-94ce21d3f208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:07.957417 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8c4a4eae-4518-4480-a405-9d33a3414c66 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1316 microversion: 2.1 time: 0.638893 Oct 18 13:20:07.958083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c55f1c2c-26b8-4035-a4fd-94ce21d3f208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:07.963098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c55f1c2c-26b8-4035-a4fd-94ce21d3f208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:07.966413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c55f1c2c-26b8-4035-a4fd-94ce21d3f208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:07.969309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c55f1c2c-26b8-4035-a4fd-94ce21d3f208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:07.970559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c55f1c2c-26b8-4035-a4fd-94ce21d3f208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:07.973364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c55f1c2c-26b8-4035-a4fd-94ce21d3f208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:07.975028 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 539/1054] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:07 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1316 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:07.981780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-bcc14378-10bc-44fe-a938-2e967f54c931 req-886463d6-fdf7-4bb6-b886-cc818ae968d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea85e7d-02ff-4fc3-bc01-720e7de9de87", "name": "network-vif-plugged", "status": "completed", "tag": "d3e28fd2-a20a-403c-adde-3da5ff496840"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:07.995657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bcc14378-10bc-44fe-a938-2e967f54c931 req-886463d6-fdf7-4bb6-b886-cc818ae968d3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:07.996440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bcc14378-10bc-44fe-a938-2e967f54c931 req-886463d6-fdf7-4bb6-b886-cc818ae968d3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:07.997094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bcc14378-10bc-44fe-a938-2e967f54c931 req-886463d6-fdf7-4bb6-b886-cc818ae968d3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:08.019337 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-bcc14378-10bc-44fe-a938-2e967f54c931 req-886463d6-fdf7-4bb6-b886-cc818ae968d3 service nova] Creating event network-vif-plugged:d3e28fd2-a20a-403c-adde-3da5ff496840 for instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 on n-h2-858384-13 Oct 18 13:20:08.026526 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-bcc14378-10bc-44fe-a938-2e967f54c931 req-886463d6-fdf7-4bb6-b886-cc818ae968d3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049842 Oct 18 13:20:08.027752 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 540/1055] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:08.036516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-af292b06-4b48-417d-b942-1ba1218d92ac req-606a0e80-cc48-4f43-bde9-e05e6f81a7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d79b32e-7ca5-426c-86a3-53573c97569d", "name": "network-vif-deleted", "tag": "a7905246-b174-4f5f-b628-3d969be2fe7f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:08.056059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-af292b06-4b48-417d-b942-1ba1218d92ac req-606a0e80-cc48-4f43-bde9-e05e6f81a7d7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:08.056747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-af292b06-4b48-417d-b942-1ba1218d92ac req-606a0e80-cc48-4f43-bde9-e05e6f81a7d7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:08.057585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-af292b06-4b48-417d-b942-1ba1218d92ac req-606a0e80-cc48-4f43-bde9-e05e6f81a7d7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:08.074918 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-af292b06-4b48-417d-b942-1ba1218d92ac req-606a0e80-cc48-4f43-bde9-e05e6f81a7d7 service nova] Creating event network-vif-deleted:a7905246-b174-4f5f-b628-3d969be2fe7f for instance 5d79b32e-7ca5-426c-86a3-53573c97569d on n-h1-858384-13 Oct 18 13:20:08.115996 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-af292b06-4b48-417d-b942-1ba1218d92ac req-606a0e80-cc48-4f43-bde9-e05e6f81a7d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081153 Oct 18 13:20:08.117221 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 541/1056] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:08.127774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:08.128618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:08.150953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:08.151840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:08.153368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:08.154370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:08.154851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:08.155285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:08.159286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:08.254526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:08.255615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:08.256542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:08.257197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lazy-loading 'fault' on Instance uuid 5d79b32e-7ca5-426c-86a3-53573c97569d {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:20:08.487732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c55f1c2c-26b8-4035-a4fd-94ce21d3f208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:08.500138 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c55f1c2c-26b8-4035-a4fd-94ce21d3f208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1259 microversion: 2.1 time: 0.593113 Oct 18 13:20:08.502728 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 516/1057] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:07 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1259 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:08.523253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eaccac2e-0f0d-4122-9a47-6858b10b2f51 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f80a8b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:08.599771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:08.617461 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0105cd68-77cb-48a7-bd04-ee8ce83c0528 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1304 microversion: 2.1 time: 0.498930 Oct 18 13:20:08.618043 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 542/1058] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:08 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1304 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:08.623970 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eaccac2e-0f0d-4122-9a47-6858b10b2f51 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.120109 Oct 18 13:20:08.624548 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 517/1059] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:08 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:08.694712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c08473d-5add-4568-a336-3acab50e0cee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:08.703675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2c08473d-5add-4568-a336-3acab50e0cee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:08.765269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-4bfd7ef6-5b1f-4b7a-9680-cd4aeb0748bd req-c250e3bb-f15f-49bb-9874-e8ec14f98d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfe50041-e476-443d-b56f-db9953efda0a", "name": "network-vif-deleted", "tag": "c5b4bcad-3d79-462b-a9c7-ff1906e031e9"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:08.772883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c08473d-5add-4568-a336-3acab50e0cee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:08.776811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c08473d-5add-4568-a336-3acab50e0cee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:08.777594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c08473d-5add-4568-a336-3acab50e0cee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:08.778816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c08473d-5add-4568-a336-3acab50e0cee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:08.781826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c08473d-5add-4568-a336-3acab50e0cee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:08.783814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c08473d-5add-4568-a336-3acab50e0cee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:08.810098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4bfd7ef6-5b1f-4b7a-9680-cd4aeb0748bd req-c250e3bb-f15f-49bb-9874-e8ec14f98d9d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:08.810620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4bfd7ef6-5b1f-4b7a-9680-cd4aeb0748bd req-c250e3bb-f15f-49bb-9874-e8ec14f98d9d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:08.811063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4bfd7ef6-5b1f-4b7a-9680-cd4aeb0748bd req-c250e3bb-f15f-49bb-9874-e8ec14f98d9d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:08.844450 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4bfd7ef6-5b1f-4b7a-9680-cd4aeb0748bd req-c250e3bb-f15f-49bb-9874-e8ec14f98d9d service nova] Creating event network-vif-deleted:c5b4bcad-3d79-462b-a9c7-ff1906e031e9 for instance bfe50041-e476-443d-b56f-db9953efda0a on n-h1-858384-13 Oct 18 13:20:08.851902 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-4bfd7ef6-5b1f-4b7a-9680-cd4aeb0748bd req-c250e3bb-f15f-49bb-9874-e8ec14f98d9d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093411 Oct 18 13:20:08.865055 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 518/1060] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:08.930202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9b283b1d-ce8e-4411-acf2-c4b112b03965 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:08.931180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9b283b1d-ce8e-4411-acf2-c4b112b03965 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:08.952304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b283b1d-ce8e-4411-acf2-c4b112b03965 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:08.955116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b283b1d-ce8e-4411-acf2-c4b112b03965 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:08.956078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b283b1d-ce8e-4411-acf2-c4b112b03965 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:08.958163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b283b1d-ce8e-4411-acf2-c4b112b03965 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:08.963131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b283b1d-ce8e-4411-acf2-c4b112b03965 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:08.964054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b283b1d-ce8e-4411-acf2-c4b112b03965 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:09.217975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9b283b1d-ce8e-4411-acf2-c4b112b03965 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:09.245732 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9b283b1d-ce8e-4411-acf2-c4b112b03965 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1321 microversion: 2.1 time: 0.319591 Oct 18 13:20:09.247162 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 519/1061] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:08 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:09.257977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5e0c94c0-80b6-4038-af66-ca8a68cfce40 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:09.262019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5e0c94c0-80b6-4038-af66-ca8a68cfce40 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:09.319696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e0c94c0-80b6-4038-af66-ca8a68cfce40 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:09.320194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e0c94c0-80b6-4038-af66-ca8a68cfce40 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:09.320630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e0c94c0-80b6-4038-af66-ca8a68cfce40 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:09.321400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e0c94c0-80b6-4038-af66-ca8a68cfce40 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:09.321827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e0c94c0-80b6-4038-af66-ca8a68cfce40 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:09.322246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e0c94c0-80b6-4038-af66-ca8a68cfce40 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:09.732301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2c08473d-5add-4568-a336-3acab50e0cee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:09.747696 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2c08473d-5add-4568-a336-3acab50e0cee tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1378 microversion: 2.1 time: 1.108347 Oct 18 13:20:09.750685 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 543/1062] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:08 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1378 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:09.778311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-09ea527b-823a-48a4-ac91-e0e08d46e05c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:09.779491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-09ea527b-823a-48a4-ac91-e0e08d46e05c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:09.801152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09ea527b-823a-48a4-ac91-e0e08d46e05c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:09.802262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09ea527b-823a-48a4-ac91-e0e08d46e05c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:09.803008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09ea527b-823a-48a4-ac91-e0e08d46e05c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:09.808597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09ea527b-823a-48a4-ac91-e0e08d46e05c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:09.811793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09ea527b-823a-48a4-ac91-e0e08d46e05c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:09.812495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09ea527b-823a-48a4-ac91-e0e08d46e05c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:09.968027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09ea527b-823a-48a4-ac91-e0e08d46e05c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:09.996229 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-09ea527b-823a-48a4-ac91-e0e08d46e05c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1265 microversion: 2.1 time: 0.237284 Oct 18 13:20:10.000930 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 544/1063] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:09 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:10.015500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9ea02f3e-d8b2-4f3e-aec1-569e9cb26365 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f964ee0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:10.030867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5e0c94c0-80b6-4038-af66-ca8a68cfce40 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:10.060022 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5e0c94c0-80b6-4038-af66-ca8a68cfce40 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1316 microversion: 2.1 time: 0.809549 Oct 18 13:20:10.063341 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 520/1064] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:09 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1316 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:10.086464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:10.103757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:10.144396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:10.145549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:10.147148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:10.148661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:10.151633 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9ea02f3e-d8b2-4f3e-aec1-569e9cb26365 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.143065 Oct 18 13:20:10.153115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:10.153885 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 545/1065] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:10 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:10.154675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:10.270468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-05a0254e-2082-44a1-9677-0fb0f4b2ce14 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:10.271309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-05a0254e-2082-44a1-9677-0fb0f4b2ce14 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:10.273485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:10.274281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:10.279606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:10.280460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lazy-loading 'fault' on Instance uuid 5d79b32e-7ca5-426c-86a3-53573c97569d {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:20:10.296173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05a0254e-2082-44a1-9677-0fb0f4b2ce14 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:10.302567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05a0254e-2082-44a1-9677-0fb0f4b2ce14 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:10.307087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05a0254e-2082-44a1-9677-0fb0f4b2ce14 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:10.313436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05a0254e-2082-44a1-9677-0fb0f4b2ce14 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:10.317648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05a0254e-2082-44a1-9677-0fb0f4b2ce14 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:10.320218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05a0254e-2082-44a1-9677-0fb0f4b2ce14 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:10.630155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-05a0254e-2082-44a1-9677-0fb0f4b2ce14 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:10.646913 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-05a0254e-2082-44a1-9677-0fb0f4b2ce14 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1321 microversion: 2.1 time: 0.380602 Oct 18 13:20:10.649514 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 546/1066] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:10 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:10.656521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-0c28eaff-adea-4795-8365-70564a968793 req-c031b175-4e55-46e4-9042-58c4e94251e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938746d4-6297-49a5-811f-89814a1e182b", "name": "network-vif-plugged", "status": "completed", "tag": "a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:10.695648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:10.705128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0c28eaff-adea-4795-8365-70564a968793 req-c031b175-4e55-46e4-9042-58c4e94251e3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:10.705983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0c28eaff-adea-4795-8365-70564a968793 req-c031b175-4e55-46e4-9042-58c4e94251e3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:10.706680 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b979b0d2-6bff-445d-87a9-50af5ec31d01 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 200 len: 1304 microversion: 2.1 time: 0.638028 Oct 18 13:20:10.709014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0c28eaff-adea-4795-8365-70564a968793 req-c031b175-4e55-46e4-9042-58c4e94251e3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:10.733910 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 521/1067] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:10 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 1304 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:10.770139 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-0c28eaff-adea-4795-8365-70564a968793 req-c031b175-4e55-46e4-9042-58c4e94251e3 service nova] Creating event network-vif-plugged:a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1 for instance 938746d4-6297-49a5-811f-89814a1e182b on n-h2-858384-13 Oct 18 13:20:10.780853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b9fe4b4f-9a0c-4bb4-9476-3cc340179c29 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:10.781512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b9fe4b4f-9a0c-4bb4-9476-3cc340179c29 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:10.803177 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-0c28eaff-adea-4795-8365-70564a968793 req-c031b175-4e55-46e4-9042-58c4e94251e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149677 Oct 18 13:20:10.804888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9fe4b4f-9a0c-4bb4-9476-3cc340179c29 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:10.806239 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 547/1068] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:10.806426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9fe4b4f-9a0c-4bb4-9476-3cc340179c29 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:10.806897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9fe4b4f-9a0c-4bb4-9476-3cc340179c29 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:10.807638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9fe4b4f-9a0c-4bb4-9476-3cc340179c29 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:10.811796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9fe4b4f-9a0c-4bb4-9476-3cc340179c29 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:10.812846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9fe4b4f-9a0c-4bb4-9476-3cc340179c29 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:11.032215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0b509f26-58cf-4eec-a112-6c6fea9fe190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:11.033660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0b509f26-58cf-4eec-a112-6c6fea9fe190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:11.062012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b509f26-58cf-4eec-a112-6c6fea9fe190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:11.062633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b509f26-58cf-4eec-a112-6c6fea9fe190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:11.064217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b509f26-58cf-4eec-a112-6c6fea9fe190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:11.065610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b509f26-58cf-4eec-a112-6c6fea9fe190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:11.068329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b509f26-58cf-4eec-a112-6c6fea9fe190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:11.072260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b509f26-58cf-4eec-a112-6c6fea9fe190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:11.339997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0b509f26-58cf-4eec-a112-6c6fea9fe190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:11.360411 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0b509f26-58cf-4eec-a112-6c6fea9fe190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1265 microversion: 2.1 time: 0.328678 Oct 18 13:20:11.361505 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 548/1069] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:11 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1265 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:11.371076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8336ac64-1ca1-49d2-a7b4-7a44fe9805f5 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:11.373619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8336ac64-1ca1-49d2-a7b4-7a44fe9805f5 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:11.390138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8336ac64-1ca1-49d2-a7b4-7a44fe9805f5 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:11.392586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8336ac64-1ca1-49d2-a7b4-7a44fe9805f5 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:11.396458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8336ac64-1ca1-49d2-a7b4-7a44fe9805f5 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:11.397766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8336ac64-1ca1-49d2-a7b4-7a44fe9805f5 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:11.405670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8336ac64-1ca1-49d2-a7b4-7a44fe9805f5 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:11.406486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8336ac64-1ca1-49d2-a7b4-7a44fe9805f5 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:11.883892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8336ac64-1ca1-49d2-a7b4-7a44fe9805f5 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:11.915290 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8336ac64-1ca1-49d2-a7b4-7a44fe9805f5 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1316 microversion: 2.1 time: 0.552605 Oct 18 13:20:11.921228 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 549/1070] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:11 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:11.939376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-50aca63c-b4bc-4387-8113-d2292dde0d87 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f8b5b80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:12.067617 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-50aca63c-b4bc-4387-8113-d2292dde0d87 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.134562 Oct 18 13:20:12.067617 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 550/1071] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:11 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:12.071792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-813568fe-0a39-4d4b-80dc-49e667d28a11 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:12.072420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-813568fe-0a39-4d4b-80dc-49e667d28a11 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:12.085480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-813568fe-0a39-4d4b-80dc-49e667d28a11 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:12.085914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-813568fe-0a39-4d4b-80dc-49e667d28a11 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:12.086350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-813568fe-0a39-4d4b-80dc-49e667d28a11 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:12.087085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-813568fe-0a39-4d4b-80dc-49e667d28a11 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:12.087946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-813568fe-0a39-4d4b-80dc-49e667d28a11 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:12.087946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-813568fe-0a39-4d4b-80dc-49e667d28a11 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:12.583797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b9fe4b4f-9a0c-4bb4-9476-3cc340179c29 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:12.596985 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b9fe4b4f-9a0c-4bb4-9476-3cc340179c29 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1527 microversion: 2.1 time: 1.816992 Oct 18 13:20:12.598258 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 522/1072] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:10 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1527 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:12.615332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b892f5f9-84e5-4d7e-8bec-7274bf2e9ce6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:12.630632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b892f5f9-84e5-4d7e-8bec-7274bf2e9ce6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 5d79b32e-7ca5-426c-86a3-53573c97569d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:12.657421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b892f5f9-84e5-4d7e-8bec-7274bf2e9ce6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:12.658400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b892f5f9-84e5-4d7e-8bec-7274bf2e9ce6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:12.658883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b892f5f9-84e5-4d7e-8bec-7274bf2e9ce6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:12.660328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b892f5f9-84e5-4d7e-8bec-7274bf2e9ce6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:12.661321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b892f5f9-84e5-4d7e-8bec-7274bf2e9ce6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:12.662048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b892f5f9-84e5-4d7e-8bec-7274bf2e9ce6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:12.716073 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-b892f5f9-84e5-4d7e-8bec-7274bf2e9ce6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] HTTP exception thrown: Instance 5d79b32e-7ca5-426c-86a3-53573c97569d could not be found. Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b892f5f9-84e5-4d7e-8bec-7274bf2e9ce6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Request method failure captured: Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d HTTP/1.1 Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqeA6wYslji_2kKcrLFU2Mn9qSHxPDYkorn2oavMI1Xr9-7UM2gLwlhGeWRDqPGVzJmUQLfl_ZaaIWb7zDLF-skkc3aa_qj8OBynMm9b8VY6rN_B934FXb0GneW_bkK98R3rLXRKcbepX0HwB-A9sUoI5QFkE-HBCSk56tYZ84BZOlY Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 4ca31a93e6854a0fa9cc37d0bb89a3c6 Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersAdminTestJSON-1704955637 Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:20:12.723051 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:20:12.726068 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4ca31a93e6854a0fa9cc37d0bb89a3c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4ca31a93e6854a0fa9cc37d0bb89a3c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4ca31a93e6854a0fa9cc37d0bb89a3c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4ca31a93e6854a0fa9cc37d0bb89a3c6"}]}] Oct 18 13:20:12.726068 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersAdminTestJSON-1704955637 Oct 18 13:20:12.726068 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 4ca31a93e6854a0fa9cc37d0bb89a3c6 Oct 18 13:20:12.726068 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersAdminTestJSON-1704955637 Oct 18 13:20:12.726068 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersAdminTestJSON-1704955637-project Oct 18 13:20:12.726068 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:20:12.726068 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:20:12.726068 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e8af3705288d46ca94bf973f16aa1bb6 Oct 18 13:20:12.726068 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersAdminTestJSON-1704955637-project Oct 18 13:20:12.726068 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:20:12.726068 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 5d79b32e-7ca5-426c-86a3-53573c97569d could not be found. Oct 18 13:20:12.726068 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '5d79b32e-7ca5-426c-86a3-53573c97569d'} Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d79b32e-7ca5-426c-86a3-53573c97569d could not be found. Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:20:12.727637 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d79b32e-7ca5-426c-86a3-53573c97569d could not be found. Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d79b32e-7ca5-426c-86a3-53573c97569d could not be found. Oct 18 13:20:12.730207 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:12.758752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b892f5f9-84e5-4d7e-8bec-7274bf2e9ce6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Returning 404 to user: Instance 5d79b32e-7ca5-426c-86a3-53573c97569d could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:20:12.758752 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b892f5f9-84e5-4d7e-8bec-7274bf2e9ce6 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d" status: 404 len: 111 microversion: 2.1 time: 0.157480 Oct 18 13:20:12.769007 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 523/1073] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:12 2022] GET /compute/v2.1/servers/5d79b32e-7ca5-426c-86a3-53573c97569d => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:20:12.771485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84983c17-0d5c-49ce-9f2c-1c913e9b2017 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:12.772099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-84983c17-0d5c-49ce-9f2c-1c913e9b2017 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:12.807370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84983c17-0d5c-49ce-9f2c-1c913e9b2017 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:12.822021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84983c17-0d5c-49ce-9f2c-1c913e9b2017 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:12.822943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84983c17-0d5c-49ce-9f2c-1c913e9b2017 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:12.823986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84983c17-0d5c-49ce-9f2c-1c913e9b2017 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:12.824769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84983c17-0d5c-49ce-9f2c-1c913e9b2017 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:12.829331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84983c17-0d5c-49ce-9f2c-1c913e9b2017 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:13.247590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-813568fe-0a39-4d4b-80dc-49e667d28a11 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:13.260830 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-813568fe-0a39-4d4b-80dc-49e667d28a11 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1389 microversion: 2.1 time: 1.200835 Oct 18 13:20:13.284373 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 551/1074] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:12 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1389 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:13.309768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bebdaa8b-f980-4ad9-baba-dbaf66664652 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:13.310763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bebdaa8b-f980-4ad9-baba-dbaf66664652 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:13.327918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bebdaa8b-f980-4ad9-baba-dbaf66664652 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:13.330340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bebdaa8b-f980-4ad9-baba-dbaf66664652 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:13.331393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bebdaa8b-f980-4ad9-baba-dbaf66664652 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:13.334714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bebdaa8b-f980-4ad9-baba-dbaf66664652 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:13.335467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bebdaa8b-f980-4ad9-baba-dbaf66664652 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:13.336070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bebdaa8b-f980-4ad9-baba-dbaf66664652 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:13.627934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-84983c17-0d5c-49ce-9f2c-1c913e9b2017 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:13.639660 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-84983c17-0d5c-49ce-9f2c-1c913e9b2017 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1307 microversion: 2.1 time: 0.877576 Oct 18 13:20:13.643627 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 524/1075] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:12 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1307 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:13.653167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e77c8c8b-b667-4673-8d8d-462ff53fce02 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:13.657036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e77c8c8b-b667-4673-8d8d-462ff53fce02 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:13.674751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e77c8c8b-b667-4673-8d8d-462ff53fce02 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:13.675274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e77c8c8b-b667-4673-8d8d-462ff53fce02 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:13.677656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e77c8c8b-b667-4673-8d8d-462ff53fce02 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:13.682269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e77c8c8b-b667-4673-8d8d-462ff53fce02 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:13.682838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e77c8c8b-b667-4673-8d8d-462ff53fce02 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:13.683296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e77c8c8b-b667-4673-8d8d-462ff53fce02 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:13.784754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e77c8c8b-b667-4673-8d8d-462ff53fce02 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:20:13.867172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bebdaa8b-f980-4ad9-baba-dbaf66664652 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:13.881882 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bebdaa8b-f980-4ad9-baba-dbaf66664652 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1527 microversion: 2.1 time: 0.592116 Oct 18 13:20:13.882924 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 552/1076] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:13 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1527 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:13.903517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8ff50829-0969-4c54-91cd-205cbbc974c7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:13.911674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8ff50829-0969-4c54-91cd-205cbbc974c7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:13.937794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff50829-0969-4c54-91cd-205cbbc974c7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:13.939491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:13.940004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff50829-0969-4c54-91cd-205cbbc974c7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:13.940636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff50829-0969-4c54-91cd-205cbbc974c7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:13.942349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff50829-0969-4c54-91cd-205cbbc974c7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:13.944196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff50829-0969-4c54-91cd-205cbbc974c7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:13.944867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff50829-0969-4c54-91cd-205cbbc974c7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:14.052682 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e77c8c8b-b667-4673-8d8d-462ff53fce02 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "DELETE /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 204 len: 0 microversion: 2.1 time: 0.407492 Oct 18 13:20:14.054063 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 525/1077] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:20:13 2022] DELETE /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:20:14.062508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-10dad988-d254-439a-bf67-727ace3f3cac tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f89aee0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:14.150723 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-10dad988-d254-439a-bf67-727ace3f3cac tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.095050 Oct 18 13:20:14.152364 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 526/1078] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:14 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:14.158465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-312350eb-bb14-4eff-9d76-187285fb055b req-2b9876cb-7d9b-4e99-9999-4df43fd03f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d4784d-11ed-46a8-ab37-4dd797beb30a", "name": "network-vif-plugged", "status": "completed", "tag": "932fabd8-90dd-4fb2-b707-55c3c3d89f3e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:14.169929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-312350eb-bb14-4eff-9d76-187285fb055b req-2b9876cb-7d9b-4e99-9999-4df43fd03f87 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:14.170645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-312350eb-bb14-4eff-9d76-187285fb055b req-2b9876cb-7d9b-4e99-9999-4df43fd03f87 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:14.171287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-312350eb-bb14-4eff-9d76-187285fb055b req-2b9876cb-7d9b-4e99-9999-4df43fd03f87 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:14.187845 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-312350eb-bb14-4eff-9d76-187285fb055b req-2b9876cb-7d9b-4e99-9999-4df43fd03f87 service nova] Creating event network-vif-plugged:932fabd8-90dd-4fb2-b707-55c3c3d89f3e for instance a8d4784d-11ed-46a8-ab37-4dd797beb30a on n-h2-858384-13 Oct 18 13:20:14.201867 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-312350eb-bb14-4eff-9d76-187285fb055b req-2b9876cb-7d9b-4e99-9999-4df43fd03f87 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047719 Oct 18 13:20:14.211319 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 527/1079] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:14.217292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bd9f3ba9-7139-4b35-9db9-0fab8e5ac49b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:14.267752 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bd9f3ba9-7139-4b35-9db9-0fab8e5ac49b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/76f7ef46-02d1-45c9-9ac9-be7813cc2bb9" status: 202 len: 0 microversion: 2.1 time: 0.054320 Oct 18 13:20:14.271833 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 528/1080] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:20:14 2022] DELETE /compute/v2.1/flavors/76f7ef46-02d1-45c9-9ac9-be7813cc2bb9 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:20:14.285620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a2f8b2f6-202c-46f3-bcde-e7d8d9174cc5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:14.288110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a2f8b2f6-202c-46f3-bcde-e7d8d9174cc5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:14.305860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f8b2f6-202c-46f3-bcde-e7d8d9174cc5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:14.306636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f8b2f6-202c-46f3-bcde-e7d8d9174cc5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:14.307420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f8b2f6-202c-46f3-bcde-e7d8d9174cc5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:14.308730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f8b2f6-202c-46f3-bcde-e7d8d9174cc5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:14.309636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f8b2f6-202c-46f3-bcde-e7d8d9174cc5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:14.314053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f8b2f6-202c-46f3-bcde-e7d8d9174cc5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:14.735654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a2f8b2f6-202c-46f3-bcde-e7d8d9174cc5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:14.746844 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a2f8b2f6-202c-46f3-bcde-e7d8d9174cc5 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 200 len: 1470 microversion: 2.1 time: 0.473519 Oct 18 13:20:14.775117 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 529/1081] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:14 2022] GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 1470 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:14.793164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1cf4e79f-5487-4698-bddb-0d483959d6b2 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:14.873626 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1cf4e79f-5487-4698-bddb-0d483959d6b2 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.089754 Oct 18 13:20:14.879451 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 530/1082] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:20:14 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:14.894198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2908f901-a706-41ac-9471-641680fb5810 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:14.896844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2908f901-a706-41ac-9471-641680fb5810 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:14.926417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8ff50829-0969-4c54-91cd-205cbbc974c7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:14.938781 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8ff50829-0969-4c54-91cd-205cbbc974c7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1316 microversion: 2.1 time: 1.054259 Oct 18 13:20:14.948080 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 553/1083] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:13 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1316 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:14.954373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2908f901-a706-41ac-9471-641680fb5810 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:14.955079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2908f901-a706-41ac-9471-641680fb5810 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:14.955779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2908f901-a706-41ac-9471-641680fb5810 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:14.957013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2908f901-a706-41ac-9471-641680fb5810 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:14.963695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2908f901-a706-41ac-9471-641680fb5810 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:14.964766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2908f901-a706-41ac-9471-641680fb5810 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:14.971774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-517e18cf-06b3-48e3-a44e-b9d4bed2c6ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:14.974639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-517e18cf-06b3-48e3-a44e-b9d4bed2c6ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:15.000373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-517e18cf-06b3-48e3-a44e-b9d4bed2c6ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:15.001295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-517e18cf-06b3-48e3-a44e-b9d4bed2c6ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:15.007451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-517e18cf-06b3-48e3-a44e-b9d4bed2c6ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:15.008401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-517e18cf-06b3-48e3-a44e-b9d4bed2c6ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:15.009517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-517e18cf-06b3-48e3-a44e-b9d4bed2c6ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:15.010067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-517e18cf-06b3-48e3-a44e-b9d4bed2c6ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:15.581104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-517e18cf-06b3-48e3-a44e-b9d4bed2c6ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:15.600233 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-517e18cf-06b3-48e3-a44e-b9d4bed2c6ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1307 microversion: 2.1 time: 0.640227 Oct 18 13:20:15.601361 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 554/1084] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:14 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1307 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:15.608019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:15.624296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:15.638438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:15.642641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:15.643316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:15.644171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:15.650205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:15.650811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:15.732630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:15.763441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Old instance type tempest-test_resize_flavor_-192546977, new instance type m1.heat {{(pid=120611) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 13:20:15.772753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:20:15.773469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:20:15.774182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:20:15.781916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:20:15.783099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:20:15.936005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:15.973636 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-51228b89-b0c3-45cd-a44b-cc562eb71d57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "POST /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87/action" status: 202 len: 0 microversion: 2.1 time: 0.368897 Oct 18 13:20:15.974560 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 555/1085] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:20:15 2022] POST /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:20:15.979666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bb1703d7-8517-40bd-a599-3d092d4894ee tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f8c5b80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:15.990588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2908f901-a706-41ac-9471-641680fb5810 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:16.012448 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2908f901-a706-41ac-9471-641680fb5810 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1389 microversion: 2.1 time: 1.130739 Oct 18 13:20:16.013582 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 531/1086] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:14 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1389 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:16.020061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-67d52854-3b42-4960-bab6-81e8b97cf8b4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:16.020910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-67d52854-3b42-4960-bab6-81e8b97cf8b4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:16.025745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=13 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:16.037465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67d52854-3b42-4960-bab6-81e8b97cf8b4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:16.042630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67d52854-3b42-4960-bab6-81e8b97cf8b4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:16.043460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67d52854-3b42-4960-bab6-81e8b97cf8b4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:16.044478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67d52854-3b42-4960-bab6-81e8b97cf8b4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:16.045846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67d52854-3b42-4960-bab6-81e8b97cf8b4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:16.047114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67d52854-3b42-4960-bab6-81e8b97cf8b4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:16.082631 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bb1703d7-8517-40bd-a599-3d092d4894ee tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.106625 Oct 18 13:20:16.092880 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 556/1087] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:15 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:16.104934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7374ae08-95a6-4ae2-9f79-25a491311d96 req-c5f295be-90b7-4bbd-8eb8-e34c67df4ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14965255-1b8d-4094-84de-1e81599640fb", "tag": "66f6f9e9-bc02-4b17-a7e1-a5fede1227a3"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:16.128905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7374ae08-95a6-4ae2-9f79-25a491311d96 req-c5f295be-90b7-4bbd-8eb8-e34c67df4ae7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:16.129674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7374ae08-95a6-4ae2-9f79-25a491311d96 req-c5f295be-90b7-4bbd-8eb8-e34c67df4ae7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:16.130266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7374ae08-95a6-4ae2-9f79-25a491311d96 req-c5f295be-90b7-4bbd-8eb8-e34c67df4ae7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:16.165149 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7374ae08-95a6-4ae2-9f79-25a491311d96 req-c5f295be-90b7-4bbd-8eb8-e34c67df4ae7 service nova] Creating event network-changed:66f6f9e9-bc02-4b17-a7e1-a5fede1227a3 for instance 14965255-1b8d-4094-84de-1e81599640fb on n-h2-858384-13 Oct 18 13:20:16.181371 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7374ae08-95a6-4ae2-9f79-25a491311d96 req-c5f295be-90b7-4bbd-8eb8-e34c67df4ae7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085867 Oct 18 13:20:16.182959 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 557/1088] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:16.189278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-175bacbc-02f5-4061-856b-d9ce422ac829 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:16.195671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-175bacbc-02f5-4061-856b-d9ce422ac829 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:16.219135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-175bacbc-02f5-4061-856b-d9ce422ac829 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:16.220172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-175bacbc-02f5-4061-856b-d9ce422ac829 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:16.221142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-175bacbc-02f5-4061-856b-d9ce422ac829 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:16.222162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-175bacbc-02f5-4061-856b-d9ce422ac829 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:16.224291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-175bacbc-02f5-4061-856b-d9ce422ac829 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:16.224981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-175bacbc-02f5-4061-856b-d9ce422ac829 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:16.750710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-175bacbc-02f5-4061-856b-d9ce422ac829 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:16.787045 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-175bacbc-02f5-4061-856b-d9ce422ac829 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1316 microversion: 2.1 time: 0.602497 Oct 18 13:20:16.791595 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 558/1089] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:16 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1316 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:16.807983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-199c250b-1052-411e-8050-eb829f5df4f0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:16.808959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-199c250b-1052-411e-8050-eb829f5df4f0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:16.834265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-199c250b-1052-411e-8050-eb829f5df4f0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:16.835564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-199c250b-1052-411e-8050-eb829f5df4f0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:16.836116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-199c250b-1052-411e-8050-eb829f5df4f0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:16.838583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-199c250b-1052-411e-8050-eb829f5df4f0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:16.840587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-199c250b-1052-411e-8050-eb829f5df4f0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:16.841453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-199c250b-1052-411e-8050-eb829f5df4f0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:17.167273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-199c250b-1052-411e-8050-eb829f5df4f0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:17.181064 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-199c250b-1052-411e-8050-eb829f5df4f0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1536 microversion: 2.1 time: 0.387410 Oct 18 13:20:17.181685 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 559/1090] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:16 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1536 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:17.193755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dc16f4e6-feab-4fa9-a6b3-7d4f6c38438d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:17.196492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dc16f4e6-feab-4fa9-a6b3-7d4f6c38438d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:17.211814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc16f4e6-feab-4fa9-a6b3-7d4f6c38438d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:17.214232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc16f4e6-feab-4fa9-a6b3-7d4f6c38438d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:17.215157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc16f4e6-feab-4fa9-a6b3-7d4f6c38438d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:17.217097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc16f4e6-feab-4fa9-a6b3-7d4f6c38438d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:17.218905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc16f4e6-feab-4fa9-a6b3-7d4f6c38438d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:17.219769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc16f4e6-feab-4fa9-a6b3-7d4f6c38438d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:17.685038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc16f4e6-feab-4fa9-a6b3-7d4f6c38438d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:17.697822 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dc16f4e6-feab-4fa9-a6b3-7d4f6c38438d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1307 microversion: 2.1 time: 0.510184 Oct 18 13:20:17.725652 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 560/1091] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:17 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1307 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:17.733444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87a7a4e6-cde6-4cb7-a881-15ffe672bda6 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:17.737512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-87a7a4e6-cde6-4cb7-a881-15ffe672bda6 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:17.762945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87a7a4e6-cde6-4cb7-a881-15ffe672bda6 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:17.768422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87a7a4e6-cde6-4cb7-a881-15ffe672bda6 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:17.768575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87a7a4e6-cde6-4cb7-a881-15ffe672bda6 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:17.769474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87a7a4e6-cde6-4cb7-a881-15ffe672bda6 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:17.773142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87a7a4e6-cde6-4cb7-a881-15ffe672bda6 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:17.775895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87a7a4e6-cde6-4cb7-a881-15ffe672bda6 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:17.823724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:18.217541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-67d52854-3b42-4960-bab6-81e8b97cf8b4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:18.231668 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-67d52854-3b42-4960-bab6-81e8b97cf8b4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 200 len: 1470 microversion: 2.1 time: 2.216780 Oct 18 13:20:18.232285 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 532/1092] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:16 2022] GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 1470 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:18.253111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e96c5f8-7fef-4103-8b62-d7dade8afe8e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff6142c60d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:18.396809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-87a7a4e6-cde6-4cb7-a881-15ffe672bda6 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:18.398894 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1e96c5f8-7fef-4103-8b62-d7dade8afe8e tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.164384 Oct 18 13:20:18.399482 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 533/1093] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:18 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:18.412883 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-87a7a4e6-cde6-4cb7-a881-15ffe672bda6 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1389 microversion: 2.1 time: 0.682707 Oct 18 13:20:18.427246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1860d3df-e3f4-4227-8a4c-13449818056f tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:18.440644 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 561/1094] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:17 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1389 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:18.444641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1860d3df-e3f4-4227-8a4c-13449818056f tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:18.462978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c9003de5-d321-4090-9f93-e272e51f4302 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:18.471470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c9003de5-d321-4090-9f93-e272e51f4302 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:18.479030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1860d3df-e3f4-4227-8a4c-13449818056f tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:18.483066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1860d3df-e3f4-4227-8a4c-13449818056f tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:18.483515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1860d3df-e3f4-4227-8a4c-13449818056f tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:18.484250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1860d3df-e3f4-4227-8a4c-13449818056f tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:18.484702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1860d3df-e3f4-4227-8a4c-13449818056f tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:18.485123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1860d3df-e3f4-4227-8a4c-13449818056f tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:18.502159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9003de5-d321-4090-9f93-e272e51f4302 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:18.502677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9003de5-d321-4090-9f93-e272e51f4302 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:18.503112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9003de5-d321-4090-9f93-e272e51f4302 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:18.507894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9003de5-d321-4090-9f93-e272e51f4302 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:18.508378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9003de5-d321-4090-9f93-e272e51f4302 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:18.514472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9003de5-d321-4090-9f93-e272e51f4302 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:18.976038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c9003de5-d321-4090-9f93-e272e51f4302 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:18.987388 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c9003de5-d321-4090-9f93-e272e51f4302 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1536 microversion: 2.1 time: 0.545168 Oct 18 13:20:18.997698 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 562/1095] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:18 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1536 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:19.006771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7290b241-d03d-45ca-8728-e5e0f39e19db req-13c5ac66-6152-46b3-b9b7-f8aaf1879c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecaf364-e10b-44e5-a2f2-a658d052e1e8", "name": "network-vif-deleted", "tag": "85e7e852-48c1-497b-b338-b36e1ae6599c"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:19.046042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7290b241-d03d-45ca-8728-e5e0f39e19db req-13c5ac66-6152-46b3-b9b7-f8aaf1879c39 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:19.058000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7290b241-d03d-45ca-8728-e5e0f39e19db req-13c5ac66-6152-46b3-b9b7-f8aaf1879c39 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:19.058704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7290b241-d03d-45ca-8728-e5e0f39e19db req-13c5ac66-6152-46b3-b9b7-f8aaf1879c39 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:19.095213 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7290b241-d03d-45ca-8728-e5e0f39e19db req-13c5ac66-6152-46b3-b9b7-f8aaf1879c39 service nova] Creating event network-vif-deleted:85e7e852-48c1-497b-b338-b36e1ae6599c for instance eecaf364-e10b-44e5-a2f2-a658d052e1e8 on n-h2-858384-13 Oct 18 13:20:19.114864 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7290b241-d03d-45ca-8728-e5e0f39e19db req-13c5ac66-6152-46b3-b9b7-f8aaf1879c39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113409 Oct 18 13:20:19.117453 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 563/1096] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:19.158113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1860d3df-e3f4-4227-8a4c-13449818056f tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:19.171303 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1860d3df-e3f4-4227-8a4c-13449818056f tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1504 microversion: 2.1 time: 0.757812 Oct 18 13:20:19.185208 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 534/1097] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:18 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1504 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:19.191310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7050616b-6ef7-4ad3-a6fb-b80c272dd856 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:19.192628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7050616b-6ef7-4ad3-a6fb-b80c272dd856 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:19.214558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7050616b-6ef7-4ad3-a6fb-b80c272dd856 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:19.215049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7050616b-6ef7-4ad3-a6fb-b80c272dd856 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:19.217741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7050616b-6ef7-4ad3-a6fb-b80c272dd856 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:19.218573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7050616b-6ef7-4ad3-a6fb-b80c272dd856 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:19.218972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7050616b-6ef7-4ad3-a6fb-b80c272dd856 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:19.219431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7050616b-6ef7-4ad3-a6fb-b80c272dd856 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:19.246690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e9a1335d-cfe0-40ce-b9e3-95109bded764 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'create', calling method: .version_select at 0x7ff60f8acee0>, body: {"keypair": {"name": "tempest-keypair-1554421635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnr6XkIEZycIok8Qn55kP5q6qfT+WPLUN7JBQwaMb6lakklDiuSzATUKkn39hbC51/FsQ902QKNUd/OeaKcda88e4flEMBqCpC5a0NWAGCWH5NIg1lNzgIyPanQGMxK0A=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:19.287456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-e9a1335d-cfe0-40ce-b9e3-95109bded764 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Getting quotas for project 452e5b77db474cf9a2b7f6b2abcb6115. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:20:19.307550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-e9a1335d-cfe0-40ce-b9e3-95109bded764 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Getting quotas for user 2878f8de95694fe1a9a17ed27b6ba40b and project 452e5b77db474cf9a2b7f6b2abcb6115. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:20:19.382360 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e9a1335d-cfe0-40ce-b9e3-95109bded764 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [0135da17-52a6-4f3f-bf9a-8d65ee41392a] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 13:20:19.940726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7050616b-6ef7-4ad3-a6fb-b80c272dd856 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:19.952598 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7050616b-6ef7-4ad3-a6fb-b80c272dd856 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1307 microversion: 2.1 time: 0.776366 Oct 18 13:20:19.953602 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 535/1098] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:19 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1307 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:19.978146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4bf779e7-0219-4be0-951b-42aa5da4fe32 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:19.979009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4bf779e7-0219-4be0-951b-42aa5da4fe32 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:19.987488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4bf779e7-0219-4be0-951b-42aa5da4fe32 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:19.988710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4bf779e7-0219-4be0-951b-42aa5da4fe32 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:19.989509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4bf779e7-0219-4be0-951b-42aa5da4fe32 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:19.993334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4bf779e7-0219-4be0-951b-42aa5da4fe32 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:19.994199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4bf779e7-0219-4be0-951b-42aa5da4fe32 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:19.994982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4bf779e7-0219-4be0-951b-42aa5da4fe32 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:20.050786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4bf779e7-0219-4be0-951b-42aa5da4fe32 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:20:20.188961 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4bf779e7-0219-4be0-951b-42aa5da4fe32 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 204 len: 0 microversion: 2.1 time: 0.221737 Oct 18 13:20:20.190042 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 536/1099] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:20:19 2022] DELETE /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:20:20.196185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4af5e3f5-09b7-4eb3-9e1b-fb11930d71a4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:20.197217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4af5e3f5-09b7-4eb3-9e1b-fb11930d71a4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: eecaf364-e10b-44e5-a2f2-a658d052e1e8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:20.207741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4af5e3f5-09b7-4eb3-9e1b-fb11930d71a4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:20.208568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4af5e3f5-09b7-4eb3-9e1b-fb11930d71a4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:20.209266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4af5e3f5-09b7-4eb3-9e1b-fb11930d71a4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:20.210229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4af5e3f5-09b7-4eb3-9e1b-fb11930d71a4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:20.210916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4af5e3f5-09b7-4eb3-9e1b-fb11930d71a4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:20.211375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4af5e3f5-09b7-4eb3-9e1b-fb11930d71a4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:20.226997 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-4af5e3f5-09b7-4eb3-9e1b-fb11930d71a4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] HTTP exception thrown: Instance eecaf364-e10b-44e5-a2f2-a658d052e1e8 could not be found. Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4af5e3f5-09b7-4eb3-9e1b-fb11930d71a4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Request method failure captured: Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 HTTP/1.1 Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqeA6wYslji_2kKcrLFU2Mn9qSHxPDYkorn2oavMI1Xr9-7UM2gLwlhGeWRDqPGVzJmUQLfl_ZaaIWb7zDLF-skkc3aa_qj8OBynMm9b8VY6rN_B934FXb0GneW_bkK98R3rLXRKcbepX0HwB-A9sUoI5QFkE-HBCSk56tYZ84BZOlY Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 4ca31a93e6854a0fa9cc37d0bb89a3c6 Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersAdminTestJSON-1704955637 Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:20:20.228783 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:20:20.231692 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4ca31a93e6854a0fa9cc37d0bb89a3c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4ca31a93e6854a0fa9cc37d0bb89a3c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4ca31a93e6854a0fa9cc37d0bb89a3c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4ca31a93e6854a0fa9cc37d0bb89a3c6"}]}] Oct 18 13:20:20.231692 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersAdminTestJSON-1704955637 Oct 18 13:20:20.231692 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 4ca31a93e6854a0fa9cc37d0bb89a3c6 Oct 18 13:20:20.231692 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersAdminTestJSON-1704955637 Oct 18 13:20:20.231692 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersAdminTestJSON-1704955637-project Oct 18 13:20:20.231692 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:20:20.231692 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:20:20.231692 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e8af3705288d46ca94bf973f16aa1bb6 Oct 18 13:20:20.231692 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersAdminTestJSON-1704955637-project Oct 18 13:20:20.231692 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:20:20.231692 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance eecaf364-e10b-44e5-a2f2-a658d052e1e8 could not be found. Oct 18 13:20:20.231692 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'eecaf364-e10b-44e5-a2f2-a658d052e1e8'} Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eecaf364-e10b-44e5-a2f2-a658d052e1e8 could not be found. Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:20:20.233374 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eecaf364-e10b-44e5-a2f2-a658d052e1e8 could not be found. Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eecaf364-e10b-44e5-a2f2-a658d052e1e8 could not be found. Oct 18 13:20:20.236469 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:20.237997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4af5e3f5-09b7-4eb3-9e1b-fb11930d71a4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Returning 404 to user: Instance eecaf364-e10b-44e5-a2f2-a658d052e1e8 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:20:20.237997 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4af5e3f5-09b7-4eb3-9e1b-fb11930d71a4 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8" status: 404 len: 111 microversion: 2.1 time: 0.038729 Oct 18 13:20:20.237997 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 537/1100] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:20 2022] GET /compute/v2.1/servers/eecaf364-e10b-44e5-a2f2-a658d052e1e8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:20:20.237997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a531ebab-c809-40fa-acf2-7ccee0ed8bd7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f80aee0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:20.295393 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a531ebab-c809-40fa-acf2-7ccee0ed8bd7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.063098 Oct 18 13:20:20.297127 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 538/1101] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:20 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:20.302333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2a7e0f51-9ba0-45ae-b680-d5c06f80bab3 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:20.303278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2a7e0f51-9ba0-45ae-b680-d5c06f80bab3 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:20.313055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a7e0f51-9ba0-45ae-b680-d5c06f80bab3 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:20.313925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a7e0f51-9ba0-45ae-b680-d5c06f80bab3 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:20.314426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a7e0f51-9ba0-45ae-b680-d5c06f80bab3 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:20.319059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a7e0f51-9ba0-45ae-b680-d5c06f80bab3 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:20.319059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a7e0f51-9ba0-45ae-b680-d5c06f80bab3 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:20.319059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a7e0f51-9ba0-45ae-b680-d5c06f80bab3 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:20.399776 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [None req-e9a1335d-cfe0-40ce-b9e3-95109bded764 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [0135da17-52a6-4f3f-bf9a-8d65ee41392a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 37580. Oct 18 13:20:20.420556 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e9a1335d-cfe0-40ce-b9e3-95109bded764 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.298236 Oct 18 13:20:20.421982 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 564/1102] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:20:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:20.440045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8fba8c73-a9c5-47e8-8ea7-af8348cc554b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:20.440833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8fba8c73-a9c5-47e8-8ea7-af8348cc554b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:20.463254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8fba8c73-a9c5-47e8-8ea7-af8348cc554b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:20.466054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8fba8c73-a9c5-47e8-8ea7-af8348cc554b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:20.467927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8fba8c73-a9c5-47e8-8ea7-af8348cc554b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:20.469369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8fba8c73-a9c5-47e8-8ea7-af8348cc554b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:20.472311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8fba8c73-a9c5-47e8-8ea7-af8348cc554b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:20.474203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8fba8c73-a9c5-47e8-8ea7-af8348cc554b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:20.553416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2a7e0f51-9ba0-45ae-b680-d5c06f80bab3 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:20.569857 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2a7e0f51-9ba0-45ae-b680-d5c06f80bab3 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1389 microversion: 2.1 time: 0.271186 Oct 18 13:20:20.590113 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 539/1103] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:20 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1389 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:20.606899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7e3fd676-60e9-4cd6-af2f-eda5befd2bbf tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:20.607823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7e3fd676-60e9-4cd6-af2f-eda5befd2bbf tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:20.617781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e3fd676-60e9-4cd6-af2f-eda5befd2bbf tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:20.618589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e3fd676-60e9-4cd6-af2f-eda5befd2bbf tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:20.619213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e3fd676-60e9-4cd6-af2f-eda5befd2bbf tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:20.620970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e3fd676-60e9-4cd6-af2f-eda5befd2bbf tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:20.621890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e3fd676-60e9-4cd6-af2f-eda5befd2bbf tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:20.622489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e3fd676-60e9-4cd6-af2f-eda5befd2bbf tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:20.856985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8fba8c73-a9c5-47e8-8ea7-af8348cc554b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:20.881094 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8fba8c73-a9c5-47e8-8ea7-af8348cc554b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1536 microversion: 2.1 time: 0.457106 Oct 18 13:20:20.896470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7e3fd676-60e9-4cd6-af2f-eda5befd2bbf tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:20.902412 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 565/1104] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:20 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1536 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:20.919514 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7e3fd676-60e9-4cd6-af2f-eda5befd2bbf tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1510 microversion: 2.1 time: 0.326372 Oct 18 13:20:20.926324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5e71b571-c857-4daa-940c-fb85254a764f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:20.927293 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 540/1105] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:20 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1510 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:20.931770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e71b571-c857-4daa-940c-fb85254a764f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:20.948297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e71b571-c857-4daa-940c-fb85254a764f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:20.949303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e71b571-c857-4daa-940c-fb85254a764f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:20.950012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e71b571-c857-4daa-940c-fb85254a764f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:20.951046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e71b571-c857-4daa-940c-fb85254a764f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:20.951806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e71b571-c857-4daa-940c-fb85254a764f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:20.952466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e71b571-c857-4daa-940c-fb85254a764f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:20.977224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-87450f3b-cd47-4a1d-9342-e8cb9c381de0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:20.978203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-87450f3b-cd47-4a1d-9342-e8cb9c381de0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:20.997025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87450f3b-cd47-4a1d-9342-e8cb9c381de0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:20.997624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87450f3b-cd47-4a1d-9342-e8cb9c381de0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:20.998056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87450f3b-cd47-4a1d-9342-e8cb9c381de0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:20.998759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87450f3b-cd47-4a1d-9342-e8cb9c381de0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:20.999447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87450f3b-cd47-4a1d-9342-e8cb9c381de0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:20.999904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87450f3b-cd47-4a1d-9342-e8cb9c381de0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:21.012282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e71b571-c857-4daa-940c-fb85254a764f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:20:21.195813 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5e71b571-c857-4daa-940c-fb85254a764f tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 204 len: 0 microversion: 2.1 time: 0.290285 Oct 18 13:20:21.196961 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 566/1106] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:20:20 2022] DELETE /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:20:21.217280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e78a7842-618d-4cdf-950f-5adff0698cdb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:21.219110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e78a7842-618d-4cdf-950f-5adff0698cdb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:21.231828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e78a7842-618d-4cdf-950f-5adff0698cdb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:21.233624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e78a7842-618d-4cdf-950f-5adff0698cdb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:21.234342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e78a7842-618d-4cdf-950f-5adff0698cdb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:21.235831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e78a7842-618d-4cdf-950f-5adff0698cdb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:21.236530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e78a7842-618d-4cdf-950f-5adff0698cdb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:21.237230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e78a7842-618d-4cdf-950f-5adff0698cdb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:21.400735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-87450f3b-cd47-4a1d-9342-e8cb9c381de0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:21.411980 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-87450f3b-cd47-4a1d-9342-e8cb9c381de0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1307 microversion: 2.1 time: 0.439417 Oct 18 13:20:21.436086 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 541/1107] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:20 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1307 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:21.444541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-c08ede10-2be0-42bf-a13b-2319b6ab4056 req-b4be438e-b44f-4206-bf56-9443736cfc12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f0df27-75cd-4ece-b3e8-91174239e3a9", "tag": "3d6790df-75bb-427a-86ec-809a4c3e5c9f"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:21.481779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c08ede10-2be0-42bf-a13b-2319b6ab4056 req-b4be438e-b44f-4206-bf56-9443736cfc12 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:21.493984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c08ede10-2be0-42bf-a13b-2319b6ab4056 req-b4be438e-b44f-4206-bf56-9443736cfc12 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:21.494717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c08ede10-2be0-42bf-a13b-2319b6ab4056 req-b4be438e-b44f-4206-bf56-9443736cfc12 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:21.506793 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-c08ede10-2be0-42bf-a13b-2319b6ab4056 req-b4be438e-b44f-4206-bf56-9443736cfc12 service nova] Creating event network-changed:3d6790df-75bb-427a-86ec-809a4c3e5c9f for instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 on n-h1-858384-13 Oct 18 13:20:21.522971 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-c08ede10-2be0-42bf-a13b-2319b6ab4056 req-b4be438e-b44f-4206-bf56-9443736cfc12 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085506 Oct 18 13:20:21.525371 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 542/1108] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:21.535549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8ef6e5e0-9dbc-46ed-982d-d13b3048c4cd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f89a160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:21.653613 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8ef6e5e0-9dbc-46ed-982d-d13b3048c4cd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.125526 Oct 18 13:20:21.654204 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 543/1109] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:21 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:21.665306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e78a7842-618d-4cdf-950f-5adff0698cdb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:21.669787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b6318096-42da-47a2-a50d-3a45ea66b270 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:21.675639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b6318096-42da-47a2-a50d-3a45ea66b270 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:21.676432 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e78a7842-618d-4cdf-950f-5adff0698cdb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1468 microversion: 2.1 time: 0.472887 Oct 18 13:20:21.685975 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 567/1110] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:21 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1468 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:21.716965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6318096-42da-47a2-a50d-3a45ea66b270 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:21.718270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6318096-42da-47a2-a50d-3a45ea66b270 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:21.720257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6318096-42da-47a2-a50d-3a45ea66b270 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:21.722348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6318096-42da-47a2-a50d-3a45ea66b270 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:21.723504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6318096-42da-47a2-a50d-3a45ea66b270 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:21.726420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6318096-42da-47a2-a50d-3a45ea66b270 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:21.935862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-63259b91-c457-4b82-95d0-0b817a319f6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:21.936489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-63259b91-c457-4b82-95d0-0b817a319f6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:21.945855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63259b91-c457-4b82-95d0-0b817a319f6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:21.952282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63259b91-c457-4b82-95d0-0b817a319f6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:21.952735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63259b91-c457-4b82-95d0-0b817a319f6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:21.953514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63259b91-c457-4b82-95d0-0b817a319f6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:21.964149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63259b91-c457-4b82-95d0-0b817a319f6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:21.965069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63259b91-c457-4b82-95d0-0b817a319f6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:22.055910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b6318096-42da-47a2-a50d-3a45ea66b270 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:22.070217 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b6318096-42da-47a2-a50d-3a45ea66b270 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1389 microversion: 2.1 time: 0.413738 Oct 18 13:20:22.091178 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 544/1111] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:21 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1389 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:22.100649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2f3d8a5-0f3c-4a13-8d00-1d66406ed816 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:22.114694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d2f3d8a5-0f3c-4a13-8d00-1d66406ed816 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:22.132672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2f3d8a5-0f3c-4a13-8d00-1d66406ed816 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:22.134620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2f3d8a5-0f3c-4a13-8d00-1d66406ed816 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:22.136979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2f3d8a5-0f3c-4a13-8d00-1d66406ed816 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:22.137979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2f3d8a5-0f3c-4a13-8d00-1d66406ed816 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:22.141382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2f3d8a5-0f3c-4a13-8d00-1d66406ed816 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:22.142747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2f3d8a5-0f3c-4a13-8d00-1d66406ed816 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:22.265170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-63259b91-c457-4b82-95d0-0b817a319f6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:22.281365 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-63259b91-c457-4b82-95d0-0b817a319f6c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1536 microversion: 2.1 time: 0.350979 Oct 18 13:20:22.283173 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 568/1112] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:21 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1536 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:22.460518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9e600b4a-4339-446d-80ac-fe0152388176 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:22.461137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9e600b4a-4339-446d-80ac-fe0152388176 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:22.468227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e600b4a-4339-446d-80ac-fe0152388176 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:22.468716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e600b4a-4339-446d-80ac-fe0152388176 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:22.469532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e600b4a-4339-446d-80ac-fe0152388176 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:22.470603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e600b4a-4339-446d-80ac-fe0152388176 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:22.471300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e600b4a-4339-446d-80ac-fe0152388176 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:22.471959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e600b4a-4339-446d-80ac-fe0152388176 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:22.790624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d2f3d8a5-0f3c-4a13-8d00-1d66406ed816 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:22.799687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9e600b4a-4339-446d-80ac-fe0152388176 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:22.816551 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d2f3d8a5-0f3c-4a13-8d00-1d66406ed816 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1510 microversion: 2.1 time: 0.723939 Oct 18 13:20:22.819513 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9e600b4a-4339-446d-80ac-fe0152388176 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1307 microversion: 2.1 time: 0.362886 Oct 18 13:20:22.836764 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 569/1113] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:22 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1307 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:22.847683 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 545/1114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:22 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1510 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:22.852961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5310e437-03d8-42e7-b7c0-0f23925d39f9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:22.854054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87a3e7a0-deee-44fc-bd12-a04d9eafeb20 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f8c5b80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:22.862478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5310e437-03d8-42e7-b7c0-0f23925d39f9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:22.878067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5310e437-03d8-42e7-b7c0-0f23925d39f9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:22.878960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5310e437-03d8-42e7-b7c0-0f23925d39f9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:22.879619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5310e437-03d8-42e7-b7c0-0f23925d39f9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:22.880569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5310e437-03d8-42e7-b7c0-0f23925d39f9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:22.881285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5310e437-03d8-42e7-b7c0-0f23925d39f9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:22.881954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5310e437-03d8-42e7-b7c0-0f23925d39f9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:22.992071 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-87a3e7a0-deee-44fc-bd12-a04d9eafeb20 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.153811 Oct 18 13:20:22.992731 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 570/1115] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:22 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:23.098717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7ace12ed-151b-4c39-af9b-d5be65665dce tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:23.099651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7ace12ed-151b-4c39-af9b-d5be65665dce tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:23.112640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ace12ed-151b-4c39-af9b-d5be65665dce tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:23.115243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ace12ed-151b-4c39-af9b-d5be65665dce tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:23.116815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ace12ed-151b-4c39-af9b-d5be65665dce tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:23.118260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ace12ed-151b-4c39-af9b-d5be65665dce tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:23.130007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ace12ed-151b-4c39-af9b-d5be65665dce tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:23.131862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ace12ed-151b-4c39-af9b-d5be65665dce tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:23.193802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5310e437-03d8-42e7-b7c0-0f23925d39f9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:23.212908 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5310e437-03d8-42e7-b7c0-0f23925d39f9 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1468 microversion: 2.1 time: 0.359638 Oct 18 13:20:23.214328 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 546/1116] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:22 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1468 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:23.312883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bdde8626-fede-4ca0-be06-86333e44ce6a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:23.313990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bdde8626-fede-4ca0-be06-86333e44ce6a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:23.330408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdde8626-fede-4ca0-be06-86333e44ce6a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:23.333236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdde8626-fede-4ca0-be06-86333e44ce6a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:23.334886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdde8626-fede-4ca0-be06-86333e44ce6a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:23.337220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdde8626-fede-4ca0-be06-86333e44ce6a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:23.339262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdde8626-fede-4ca0-be06-86333e44ce6a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:23.341992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdde8626-fede-4ca0-be06-86333e44ce6a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:23.667948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7ace12ed-151b-4c39-af9b-d5be65665dce tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:23.678090 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7ace12ed-151b-4c39-af9b-d5be65665dce tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1389 microversion: 2.1 time: 0.583232 Oct 18 13:20:23.683348 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 571/1117] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:23 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1389 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:23.708846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-da8438b3-ce67-4519-9bdd-6193f722da42 req-13a31d1a-7d31-48a7-b739-f137d759a4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d4784d-11ed-46a8-ab37-4dd797beb30a", "name": "network-vif-deleted", "tag": "932fabd8-90dd-4fb2-b707-55c3c3d89f3e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:23.725166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-da8438b3-ce67-4519-9bdd-6193f722da42 req-13a31d1a-7d31-48a7-b739-f137d759a4df service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:23.728223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-da8438b3-ce67-4519-9bdd-6193f722da42 req-13a31d1a-7d31-48a7-b739-f137d759a4df service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:23.729446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-da8438b3-ce67-4519-9bdd-6193f722da42 req-13a31d1a-7d31-48a7-b739-f137d759a4df service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:23.751079 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-da8438b3-ce67-4519-9bdd-6193f722da42 req-13a31d1a-7d31-48a7-b739-f137d759a4df service nova] Creating event network-vif-deleted:932fabd8-90dd-4fb2-b707-55c3c3d89f3e for instance a8d4784d-11ed-46a8-ab37-4dd797beb30a on n-h2-858384-13 Oct 18 13:20:23.756957 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-da8438b3-ce67-4519-9bdd-6193f722da42 req-13a31d1a-7d31-48a7-b739-f137d759a4df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052283 Oct 18 13:20:23.762631 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 572/1118] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:20:23.847426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aa5adbae-b722-4c2f-b625-7a2f221a9f43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:23.849262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aa5adbae-b722-4c2f-b625-7a2f221a9f43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:23.869389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa5adbae-b722-4c2f-b625-7a2f221a9f43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:23.870357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa5adbae-b722-4c2f-b625-7a2f221a9f43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:23.871036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa5adbae-b722-4c2f-b625-7a2f221a9f43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:23.872082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa5adbae-b722-4c2f-b625-7a2f221a9f43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:23.872791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa5adbae-b722-4c2f-b625-7a2f221a9f43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:23.874623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa5adbae-b722-4c2f-b625-7a2f221a9f43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:24.029528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bdde8626-fede-4ca0-be06-86333e44ce6a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:24.046054 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bdde8626-fede-4ca0-be06-86333e44ce6a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1536 microversion: 2.1 time: 0.739126 Oct 18 13:20:24.062744 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 547/1119] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:23 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1536 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:24.070408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:24.081325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:24.101964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:24.102732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:24.103481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:24.104589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:24.105378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:24.106160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:24.195312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:24.195312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:24.195633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:24.196037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lazy-loading 'fault' on Instance uuid a8d4784d-11ed-46a8-ab37-4dd797beb30a {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:20:24.199417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:24.294766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aa5adbae-b722-4c2f-b625-7a2f221a9f43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:24.299724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0359db25df844b92a88adb1798695be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1201ae2b82b744e9a05b575beefa8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:24.318854 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cbf29f89-7892-44d5-8d3b-21120ae9aba9 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 200 len: 1306 microversion: 2.1 time: 0.254339 Oct 18 13:20:24.333323 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aa5adbae-b722-4c2f-b625-7a2f221a9f43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1307 microversion: 2.1 time: 0.479991 Oct 18 13:20:24.333721 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 548/1120] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:24 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 1306 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:24.333721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-f760d40c-cba6-4160-a337-10c402713593 req-14ab4c94-dd44-4257-81e7-a47a495f480b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14965255-1b8d-4094-84de-1e81599640fb", "name": "network-vif-plugged", "status": "completed", "tag": "66f6f9e9-bc02-4b17-a7e1-a5fede1227a3"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:24.333913 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 573/1121] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:23 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1307 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:24.362087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3829fc0d-d0e2-4bd2-822f-39fbd586e547 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f9c2160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:24.363601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f760d40c-cba6-4160-a337-10c402713593 req-14ab4c94-dd44-4257-81e7-a47a495f480b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:24.364369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f760d40c-cba6-4160-a337-10c402713593 req-14ab4c94-dd44-4257-81e7-a47a495f480b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:24.365060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f760d40c-cba6-4160-a337-10c402713593 req-14ab4c94-dd44-4257-81e7-a47a495f480b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:24.383386 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f760d40c-cba6-4160-a337-10c402713593 req-14ab4c94-dd44-4257-81e7-a47a495f480b service nova] Creating event network-vif-plugged:66f6f9e9-bc02-4b17-a7e1-a5fede1227a3 for instance 14965255-1b8d-4094-84de-1e81599640fb on n-h2-858384-13 Oct 18 13:20:24.388782 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-f760d40c-cba6-4160-a337-10c402713593 req-14ab4c94-dd44-4257-81e7-a47a495f480b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065179 Oct 18 13:20:24.389849 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 549/1122] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:24.395729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe43eead-f25a-412c-aa00-dc51d7f559fb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:24.396423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe43eead-f25a-412c-aa00-dc51d7f559fb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:24.419504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe43eead-f25a-412c-aa00-dc51d7f559fb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:24.420007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe43eead-f25a-412c-aa00-dc51d7f559fb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:24.420446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe43eead-f25a-412c-aa00-dc51d7f559fb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:24.421311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe43eead-f25a-412c-aa00-dc51d7f559fb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:24.422191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe43eead-f25a-412c-aa00-dc51d7f559fb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:24.423146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe43eead-f25a-412c-aa00-dc51d7f559fb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:24.482422 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3829fc0d-d0e2-4bd2-822f-39fbd586e547 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.145661 Oct 18 13:20:24.483716 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 574/1123] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:24 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:24.713413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c9f5553a-978c-4116-89d5-9d40c4506b51 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:24.714433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c9f5553a-978c-4116-89d5-9d40c4506b51 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:24.731578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9f5553a-978c-4116-89d5-9d40c4506b51 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:24.732083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9f5553a-978c-4116-89d5-9d40c4506b51 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:24.737495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9f5553a-978c-4116-89d5-9d40c4506b51 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:24.738313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9f5553a-978c-4116-89d5-9d40c4506b51 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:24.738790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9f5553a-978c-4116-89d5-9d40c4506b51 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:24.739215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9f5553a-978c-4116-89d5-9d40c4506b51 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:25.066443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c9f5553a-978c-4116-89d5-9d40c4506b51 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:25.077661 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c9f5553a-978c-4116-89d5-9d40c4506b51 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1389 microversion: 2.1 time: 0.369183 Oct 18 13:20:25.089220 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 575/1124] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:24 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1389 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:25.093804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-90b15171-8fc4-4b72-a816-4a260f34eb49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:25.094709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-90b15171-8fc4-4b72-a816-4a260f34eb49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:25.106870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90b15171-8fc4-4b72-a816-4a260f34eb49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:25.114517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90b15171-8fc4-4b72-a816-4a260f34eb49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:25.115255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90b15171-8fc4-4b72-a816-4a260f34eb49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:25.116176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90b15171-8fc4-4b72-a816-4a260f34eb49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:25.116808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90b15171-8fc4-4b72-a816-4a260f34eb49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:25.117447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90b15171-8fc4-4b72-a816-4a260f34eb49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:25.204527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe43eead-f25a-412c-aa00-dc51d7f559fb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:25.219048 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fe43eead-f25a-412c-aa00-dc51d7f559fb tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1468 microversion: 2.1 time: 0.827798 Oct 18 13:20:25.220145 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 550/1125] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:24 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1468 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:25.347885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f4335526-f22c-4326-b620-e3188a1214b0 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:25.349025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f4335526-f22c-4326-b620-e3188a1214b0 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:25.366100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4335526-f22c-4326-b620-e3188a1214b0 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:25.366883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4335526-f22c-4326-b620-e3188a1214b0 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:25.367560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4335526-f22c-4326-b620-e3188a1214b0 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:25.368552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4335526-f22c-4326-b620-e3188a1214b0 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:25.369299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4335526-f22c-4326-b620-e3188a1214b0 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:25.369958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4335526-f22c-4326-b620-e3188a1214b0 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:25.373848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-90b15171-8fc4-4b72-a816-4a260f34eb49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:25.386440 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-90b15171-8fc4-4b72-a816-4a260f34eb49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1541 microversion: 2.1 time: 0.305898 Oct 18 13:20:25.389538 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 576/1126] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:25 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1541 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:25.398947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-61824d39-fdc4-4145-bcf4-4ad0c6c5c82c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:25.399638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-61824d39-fdc4-4145-bcf4-4ad0c6c5c82c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:25.410938 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-f4335526-f22c-4326-b620-e3188a1214b0 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] HTTP exception thrown: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.412953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61824d39-fdc4-4145-bcf4-4ad0c6c5c82c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f4335526-f22c-4326-b620-e3188a1214b0 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Request method failure captured: Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a HTTP/1.1 Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqf13OEs0wVyB_-RctyuhChEUpG-Ig6lpPvtkau9BS42jVzpSbFo_L5-D8vZGoEdRTdyHFRVsmPEjplNjh6QQTddHRupWO6gqkE8oWH0ZGzEhuBFtaiPr9b-Fv0vGEPnwwXXtCEFH2SrLXXXYwcI4-Z-SyZNPmftiY2CzuupLYufP1M Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:20:25.413326 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:20:25.414616 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1201ae2b82b744e9a05b575beefa8ed5"}]}] Oct 18 13:20:25.414616 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.414616 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.414616 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.414616 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.414616 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:20:25.414616 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:20:25.414616 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0359db25df844b92a88adb1798695be2 Oct 18 13:20:25.414616 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.414616 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:20:25.414616 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.414616 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'a8d4784d-11ed-46a8-ab37-4dd797beb30a'} Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:20:25.415412 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.416595 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.417721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61824d39-fdc4-4145-bcf4-4ad0c6c5c82c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:25.417721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61824d39-fdc4-4145-bcf4-4ad0c6c5c82c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:25.417721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61824d39-fdc4-4145-bcf4-4ad0c6c5c82c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:25.417721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61824d39-fdc4-4145-bcf4-4ad0c6c5c82c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:25.418022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61824d39-fdc4-4145-bcf4-4ad0c6c5c82c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:25.419172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f4335526-f22c-4326-b620-e3188a1214b0 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Returning 404 to user: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:20:25.420221 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f4335526-f22c-4326-b620-e3188a1214b0 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 404 len: 111 microversion: 2.1 time: 0.077458 Oct 18 13:20:25.421575 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 551/1127] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:25 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:20:25.430189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1c0bb903-93dc-4d97-be69-b626f7e777f1 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1817301063", "metadata": {"image_type": "test"}}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:25.439153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1c0bb903-93dc-4d97-be69-b626f7e777f1 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:25.448868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c0bb903-93dc-4d97-be69-b626f7e777f1 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:25.449414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c0bb903-93dc-4d97-be69-b626f7e777f1 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:25.449918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c0bb903-93dc-4d97-be69-b626f7e777f1 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:25.450770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c0bb903-93dc-4d97-be69-b626f7e777f1 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:25.451291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c0bb903-93dc-4d97-be69-b626f7e777f1 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:25.451783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c0bb903-93dc-4d97-be69-b626f7e777f1 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:25.474863 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-1c0bb903-93dc-4d97-be69-b626f7e777f1 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] HTTP exception thrown: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1c0bb903-93dc-4d97-be69-b626f7e777f1 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Request method failure captured: Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a/action HTTP/1.1 Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 112 Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqf13OEs0wVyB_-RctyuhChEUpG-Ig6lpPvtkau9BS42jVzpSbFo_L5-D8vZGoEdRTdyHFRVsmPEjplNjh6QQTddHRupWO6gqkE8oWH0ZGzEhuBFtaiPr9b-Fv0vGEPnwwXXtCEFH2SrLXXXYwcI4-Z-SyZNPmftiY2CzuupLYufP1M Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:20:25.477037 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:20:25.478520 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1201ae2b82b744e9a05b575beefa8ed5"}]}] Oct 18 13:20:25.478520 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.478520 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.478520 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.478520 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.478520 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:20:25.478520 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:20:25.478520 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0359db25df844b92a88adb1798695be2 Oct 18 13:20:25.478520 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.478520 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:20:25.478520 n-d-858384-13 devstack@n-api.service[120612]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1817301063", "metadata": {"image_type": "test"}}} Oct 18 13:20:25.478520 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'a8d4784d-11ed-46a8-ab37-4dd797beb30a', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1817301063', 'metadata': {'image_type': 'test'}}}} Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.479282 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.480907 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.482155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.482155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:20:25.482155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:20:25.482155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.482155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.482155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1c0bb903-93dc-4d97-be69-b626f7e777f1 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Returning 404 to user: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:20:25.482155 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1c0bb903-93dc-4d97-be69-b626f7e777f1 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "POST /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a/action" status: 404 len: 111 microversion: 2.1 time: 0.052941 Oct 18 13:20:25.485422 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 552/1128] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Oct 18 13:20:25 2022] POST /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:20:25.492122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e5b8346c-5294-4fc7-8697-951db9c5c07b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-84042844", "metadata": {"image_type": "test"}}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:25.496186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e5b8346c-5294-4fc7-8697-951db9c5c07b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Failed to fetch instance by id tempest-invalid-1895411901 {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:20:25.496706 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e5b8346c-5294-4fc7-8697-951db9c5c07b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] HTTP exception thrown: Instance tempest-invalid-1895411901 could not be found. Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e5b8346c-5294-4fc7-8697-951db9c5c07b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Request method failure captured: Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/tempest-invalid-1895411901/action HTTP/1.1 Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 110 Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqf13OEs0wVyB_-RctyuhChEUpG-Ig6lpPvtkau9BS42jVzpSbFo_L5-D8vZGoEdRTdyHFRVsmPEjplNjh6QQTddHRupWO6gqkE8oWH0ZGzEhuBFtaiPr9b-Fv0vGEPnwwXXtCEFH2SrLXXXYwcI4-Z-SyZNPmftiY2CzuupLYufP1M Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:20:25.500027 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:20:25.502222 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1201ae2b82b744e9a05b575beefa8ed5"}]}] Oct 18 13:20:25.502222 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.502222 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.502222 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.502222 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.502222 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:20:25.502222 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:20:25.502222 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0359db25df844b92a88adb1798695be2 Oct 18 13:20:25.502222 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.502222 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:20:25.502222 n-d-858384-13 devstack@n-api.service[120612]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-84042844", "metadata": {"image_type": "test"}}} Oct 18 13:20:25.502222 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:20:25.502222 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance tempest-invalid-1895411901 could not be found. Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'tempest-invalid-1895411901', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-84042844', 'metadata': {'image_type': 'test'}}}} Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1895411901 could not be found. Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:20:25.503019 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1895411901 could not be found. Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1895411901 could not be found. Oct 18 13:20:25.504365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.505529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e5b8346c-5294-4fc7-8697-951db9c5c07b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Returning 404 to user: Instance tempest-invalid-1895411901 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:20:25.505529 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e5b8346c-5294-4fc7-8697-951db9c5c07b tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "POST /compute/v2.1/servers/tempest-invalid-1895411901/action" status: 404 len: 101 microversion: 2.1 time: 0.015254 Oct 18 13:20:25.506949 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 553/1129] 10.222.0.40 () {60 vars in 1249 bytes} [Tue Oct 18 13:20:25 2022] POST /compute/v2.1/servers/tempest-invalid-1895411901/action => generated 101 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:20:25.515854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1eff6f27-122d-4afe-b9d4-655265cfc2a5 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f7ffe50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:25.580883 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1eff6f27-122d-4afe-b9d4-655265cfc2a5 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.071394 Oct 18 13:20:25.589597 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 554/1130] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:25 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:25.597063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6a54275c-4fca-48fc-bfb5-7aa097213f33 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1945393628"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:25.599530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6a54275c-4fca-48fc-bfb5-7aa097213f33 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:20:25.600057 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-6a54275c-4fca-48fc-bfb5-7aa097213f33 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6a54275c-4fca-48fc-bfb5-7aa097213f33 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Request method failure captured: Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 57 Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqf13OEs0wVyB_-RctyuhChEUpG-Ig6lpPvtkau9BS42jVzpSbFo_L5-D8vZGoEdRTdyHFRVsmPEjplNjh6QQTddHRupWO6gqkE8oWH0ZGzEhuBFtaiPr9b-Fv0vGEPnwwXXtCEFH2SrLXXXYwcI4-Z-SyZNPmftiY2CzuupLYufP1M Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:20:25.602260 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:20:25.603618 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1201ae2b82b744e9a05b575beefa8ed5"}]}] Oct 18 13:20:25.603618 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.603618 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.603618 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.603618 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.603618 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:20:25.603618 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:20:25.603618 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0359db25df844b92a88adb1798695be2 Oct 18 13:20:25.603618 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.603618 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:20:25.603618 n-d-858384-13 devstack@n-api.service[120612]: {"createImage": {"name": "tempest-test-snap-1945393628"}} Oct 18 13:20:25.603618 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:20:25.603618 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1945393628'}}} Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:20:25.604413 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:20:25.606035 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.607345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6a54275c-4fca-48fc-bfb5-7aa097213f33 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:20:25.607345 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6a54275c-4fca-48fc-bfb5-7aa097213f33 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.012584 Oct 18 13:20:25.607345 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 555/1131] 10.222.0.40 () {60 vars in 1275 bytes} [Tue Oct 18 13:20:25 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:20:25.614151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5f385369-f51a-4536-af99-4a8726d3713c tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-809758239"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:25.616421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5f385369-f51a-4536-af99-4a8726d3713c tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:20:25.616931 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-5f385369-f51a-4536-af99-4a8726d3713c tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5f385369-f51a-4536-af99-4a8726d3713c tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Request method failure captured: Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 56 Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqf13OEs0wVyB_-RctyuhChEUpG-Ig6lpPvtkau9BS42jVzpSbFo_L5-D8vZGoEdRTdyHFRVsmPEjplNjh6QQTddHRupWO6gqkE8oWH0ZGzEhuBFtaiPr9b-Fv0vGEPnwwXXtCEFH2SrLXXXYwcI4-Z-SyZNPmftiY2CzuupLYufP1M Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:20:25.618490 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:20:25.619986 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1201ae2b82b744e9a05b575beefa8ed5"}]}] Oct 18 13:20:25.619986 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.619986 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.619986 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.619986 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.619986 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:20:25.619986 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:20:25.619986 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0359db25df844b92a88adb1798695be2 Oct 18 13:20:25.619986 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.619986 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:20:25.619986 n-d-858384-13 devstack@n-api.service[120612]: {"createImage": {"name": "tempest-test-snap-809758239"}} Oct 18 13:20:25.619986 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:20:25.619986 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-809758239'}}} Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:20:25.620799 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 18 13:20:25.622315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.623532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5f385369-f51a-4536-af99-4a8726d3713c tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:20:25.623532 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5f385369-f51a-4536-af99-4a8726d3713c tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010063 Oct 18 13:20:25.625609 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 556/1132] 10.222.0.40 () {60 vars in 1281 bytes} [Tue Oct 18 13:20:25 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:20:25.627877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-61824d39-fdc4-4145-bcf4-4ad0c6c5c82c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:25.633724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af546169-480b-4e96-8f98-0c790ded9ca7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:25.634228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-af546169-480b-4e96-8f98-0c790ded9ca7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:25.640231 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-61824d39-fdc4-4145-bcf4-4ad0c6c5c82c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1307 microversion: 2.1 time: 0.246813 Oct 18 13:20:25.640942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af546169-480b-4e96-8f98-0c790ded9ca7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:25.642124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af546169-480b-4e96-8f98-0c790ded9ca7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:25.642608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af546169-480b-4e96-8f98-0c790ded9ca7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:25.642803 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 577/1133] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:25 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1307 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:25.643281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af546169-480b-4e96-8f98-0c790ded9ca7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:25.643745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af546169-480b-4e96-8f98-0c790ded9ca7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:25.644157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af546169-480b-4e96-8f98-0c790ded9ca7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:25.661809 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-af546169-480b-4e96-8f98-0c790ded9ca7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] HTTP exception thrown: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af546169-480b-4e96-8f98-0c790ded9ca7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Request method failure captured: Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a HTTP/1.1 Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqf13OEs0wVyB_-RctyuhChEUpG-Ig6lpPvtkau9BS42jVzpSbFo_L5-D8vZGoEdRTdyHFRVsmPEjplNjh6QQTddHRupWO6gqkE8oWH0ZGzEhuBFtaiPr9b-Fv0vGEPnwwXXtCEFH2SrLXXXYwcI4-Z-SyZNPmftiY2CzuupLYufP1M Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:20:25.663403 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:20:25.664731 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1201ae2b82b744e9a05b575beefa8ed5"}]}] Oct 18 13:20:25.664731 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.664731 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.664731 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.664731 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.664731 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:20:25.664731 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:20:25.664731 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0359db25df844b92a88adb1798695be2 Oct 18 13:20:25.664731 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.664731 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:20:25.664731 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.664731 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'a8d4784d-11ed-46a8-ab37-4dd797beb30a'} Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:20:25.665527 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.666781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.668180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af546169-480b-4e96-8f98-0c790ded9ca7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Returning 404 to user: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:20:25.668180 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-af546169-480b-4e96-8f98-0c790ded9ca7 tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 404 len: 111 microversion: 2.1 time: 0.038114 Oct 18 13:20:25.669510 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 557/1134] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:20:25 2022] DELETE /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:20:25.679779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d298827e-9d76-449a-a890-0dcbf2b75c3a tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:25.681833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d298827e-9d76-449a-a890-0dcbf2b75c3a tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] [instance: a8d4784d-11ed-46a8-ab37-4dd797beb30a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:25.689509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d298827e-9d76-449a-a890-0dcbf2b75c3a tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:25.690293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d298827e-9d76-449a-a890-0dcbf2b75c3a tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:25.691073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d298827e-9d76-449a-a890-0dcbf2b75c3a tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:25.691805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d298827e-9d76-449a-a890-0dcbf2b75c3a tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:25.692268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d298827e-9d76-449a-a890-0dcbf2b75c3a tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:25.692694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d298827e-9d76-449a-a890-0dcbf2b75c3a tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:25.724169 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-d298827e-9d76-449a-a890-0dcbf2b75c3a tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] HTTP exception thrown: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d298827e-9d76-449a-a890-0dcbf2b75c3a tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Request method failure captured: Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a HTTP/1.1 Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqf13OEs0wVyB_-RctyuhChEUpG-Ig6lpPvtkau9BS42jVzpSbFo_L5-D8vZGoEdRTdyHFRVsmPEjplNjh6QQTddHRupWO6gqkE8oWH0ZGzEhuBFtaiPr9b-Fv0vGEPnwwXXtCEFH2SrLXXXYwcI4-Z-SyZNPmftiY2CzuupLYufP1M Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:20:25.725787 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:20:25.729127 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1201ae2b82b744e9a05b575beefa8ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1201ae2b82b744e9a05b575beefa8ed5"}]}] Oct 18 13:20:25.729127 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.729127 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 1201ae2b82b744e9a05b575beefa8ed5 Oct 18 13:20:25.729127 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-584392650 Oct 18 13:20:25.729127 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.729127 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:20:25.729127 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:20:25.729127 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 0359db25df844b92a88adb1798695be2 Oct 18 13:20:25.729127 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesNegativeTestJSON-584392650-project Oct 18 13:20:25.729127 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:20:25.729127 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.729127 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'a8d4784d-11ed-46a8-ab37-4dd797beb30a'} Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:20:25.734379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. Oct 18 13:20:25.736540 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:20:25.743701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d298827e-9d76-449a-a890-0dcbf2b75c3a tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] Returning 404 to user: Instance a8d4784d-11ed-46a8-ab37-4dd797beb30a could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:20:25.743701 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d298827e-9d76-449a-a890-0dcbf2b75c3a tempest-ImagesNegativeTestJSON-584392650 tempest-ImagesNegativeTestJSON-584392650-project] 10.222.0.40 "GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a" status: 404 len: 111 microversion: 2.1 time: 0.059009 Oct 18 13:20:25.743701 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 578/1135] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:25 2022] GET /compute/v2.1/servers/a8d4784d-11ed-46a8-ab37-4dd797beb30a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:20:26.108457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-74842573-636d-4cb6-95e2-869020cdb82c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:26.109072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-74842573-636d-4cb6-95e2-869020cdb82c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:26.117231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74842573-636d-4cb6-95e2-869020cdb82c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:26.118336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74842573-636d-4cb6-95e2-869020cdb82c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:26.118802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74842573-636d-4cb6-95e2-869020cdb82c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:26.119732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74842573-636d-4cb6-95e2-869020cdb82c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:26.120026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74842573-636d-4cb6-95e2-869020cdb82c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:26.120424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74842573-636d-4cb6-95e2-869020cdb82c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:26.247969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d4bc6991-70a3-42c1-a4f4-f64f4c01a2a1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:26.250742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d4bc6991-70a3-42c1-a4f4-f64f4c01a2a1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:26.295659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bc6991-70a3-42c1-a4f4-f64f4c01a2a1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:26.297428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bc6991-70a3-42c1-a4f4-f64f4c01a2a1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:26.300176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bc6991-70a3-42c1-a4f4-f64f4c01a2a1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:26.302318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bc6991-70a3-42c1-a4f4-f64f4c01a2a1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:26.303144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bc6991-70a3-42c1-a4f4-f64f4c01a2a1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:26.305770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bc6991-70a3-42c1-a4f4-f64f4c01a2a1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:26.502972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d4bc6991-70a3-42c1-a4f4-f64f4c01a2a1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:26.520768 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d4bc6991-70a3-42c1-a4f4-f64f4c01a2a1 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1426 microversion: 2.1 time: 0.273769 Oct 18 13:20:26.522410 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 579/1136] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:26 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1426 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:26.554100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2851937f-3ae7-4775-b0d6-f065df690d24 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:26.561830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2851937f-3ae7-4775-b0d6-f065df690d24 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:26.575637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2851937f-3ae7-4775-b0d6-f065df690d24 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:26.576159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2851937f-3ae7-4775-b0d6-f065df690d24 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:26.576609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2851937f-3ae7-4775-b0d6-f065df690d24 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:26.577392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2851937f-3ae7-4775-b0d6-f065df690d24 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:26.578678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2851937f-3ae7-4775-b0d6-f065df690d24 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:26.579974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2851937f-3ae7-4775-b0d6-f065df690d24 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:26.821773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2851937f-3ae7-4775-b0d6-f065df690d24 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:26.834215 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2851937f-3ae7-4775-b0d6-f065df690d24 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1541 microversion: 2.1 time: 0.290433 Oct 18 13:20:26.850850 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 580/1137] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:26 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1541 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:26.858937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1171226496", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa5737e5-8161-4ff1-a109-dbc177bf4e3a"}], "security_groups": [{"name": "tempest-securitygroup--1776872548"}], "key_name": "tempest-keypair-1554421635", "user_data": "}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:26.938279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-74842573-636d-4cb6-95e2-869020cdb82c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:26.951826 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-74842573-636d-4cb6-95e2-869020cdb82c tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1389 microversion: 2.1 time: 0.849373 Oct 18 13:20:26.952406 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 558/1138] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:26 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1389 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:26.973860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bbaea865-2ef1-40dc-aa88-bde17aa38d55 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60fc19e50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:27.043393 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bbaea865-2ef1-40dc-aa88-bde17aa38d55 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1429 microversion: 2.1 time: 0.089297 Oct 18 13:20:27.058207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] validate_networks() for [('fa5737e5-8161-4ff1-a109-dbc177bf4e3a', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:20:27.064276 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 559/1139] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:26 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1429 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:27.076643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-69ad222c-2961-4d92-b642-0e41f6b49401 req-5057e8d6-1a13-4c32-ab36-f522cc540224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f0df27-75cd-4ece-b3e8-91174239e3a9", "name": "network-vif-plugged", "status": "completed", "tag": "3d6790df-75bb-427a-86ec-809a4c3e5c9f"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:27.103297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-69ad222c-2961-4d92-b642-0e41f6b49401 req-5057e8d6-1a13-4c32-ab36-f522cc540224 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:27.103871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-69ad222c-2961-4d92-b642-0e41f6b49401 req-5057e8d6-1a13-4c32-ab36-f522cc540224 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:27.104311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-69ad222c-2961-4d92-b642-0e41f6b49401 req-5057e8d6-1a13-4c32-ab36-f522cc540224 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:27.138366 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-69ad222c-2961-4d92-b642-0e41f6b49401 req-5057e8d6-1a13-4c32-ab36-f522cc540224 service nova] Creating event network-vif-plugged:3d6790df-75bb-427a-86ec-809a4c3e5c9f for instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 on n-h1-858384-13 Oct 18 13:20:27.143868 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-69ad222c-2961-4d92-b642-0e41f6b49401 req-5057e8d6-1a13-4c32-ab36-f522cc540224 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078104 Oct 18 13:20:27.145113 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 560/1140] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:27.153250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-88bd0f59-7805-40b9-a2e0-3d6fcf681a0c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:27.159635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-88bd0f59-7805-40b9-a2e0-3d6fcf681a0c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:27.179941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88bd0f59-7805-40b9-a2e0-3d6fcf681a0c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:27.180706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88bd0f59-7805-40b9-a2e0-3d6fcf681a0c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:27.181464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88bd0f59-7805-40b9-a2e0-3d6fcf681a0c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:27.182357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88bd0f59-7805-40b9-a2e0-3d6fcf681a0c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:27.182965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88bd0f59-7805-40b9-a2e0-3d6fcf681a0c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:27.183540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88bd0f59-7805-40b9-a2e0-3d6fcf681a0c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:27.576430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-88bd0f59-7805-40b9-a2e0-3d6fcf681a0c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:27.585617 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-88bd0f59-7805-40b9-a2e0-3d6fcf681a0c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1307 microversion: 2.1 time: 0.438943 Oct 18 13:20:27.586280 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 561/1141] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:27 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1307 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:27.603743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-900ae466-f877-4f64-a849-65056dcd351e req-ea8e8752-d3b1-4787-8874-8de96f113a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a", "name": "network-vif-deleted", "tag": "127093c0-7bb4-4851-9d3b-35d03d5712b9"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:27.627170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-900ae466-f877-4f64-a849-65056dcd351e req-ea8e8752-d3b1-4787-8874-8de96f113a41 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:27.629893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-900ae466-f877-4f64-a849-65056dcd351e req-ea8e8752-d3b1-4787-8874-8de96f113a41 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:27.630513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-900ae466-f877-4f64-a849-65056dcd351e req-ea8e8752-d3b1-4787-8874-8de96f113a41 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:27.658809 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-900ae466-f877-4f64-a849-65056dcd351e req-ea8e8752-d3b1-4787-8874-8de96f113a41 service nova] Creating event network-vif-deleted:127093c0-7bb4-4851-9d3b-35d03d5712b9 for instance 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a on n-h1-858384-13 Oct 18 13:20:27.675173 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-900ae466-f877-4f64-a849-65056dcd351e req-ea8e8752-d3b1-4787-8874-8de96f113a41 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087650 Oct 18 13:20:27.677725 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 562/1142] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:27.683373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:27.684507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:27.691788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:27.692554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:27.693200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:27.694263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:27.694901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:27.695586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:27.751091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:27.752969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:27.753489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:27.753937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:27.754389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lazy-loading 'fault' on Instance uuid 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:20:27.812838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:27.821669 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-66db147f-3f16-4bf2-ab74-1c8a388b52aa tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1303 microversion: 2.1 time: 0.142302 Oct 18 13:20:27.822847 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 563/1143] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:27 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:27.835826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:20:27.836630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:20:27.836846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:20:27.837567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:20:27.838150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:20:27.840470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:27.850449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:27.851437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:27.851881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:27.852827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:27.853968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:27.854414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:27.864557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e14252ef-49d7-4bb3-9143-b02603811e57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:27.865510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e14252ef-49d7-4bb3-9143-b02603811e57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:27.874163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e14252ef-49d7-4bb3-9143-b02603811e57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:27.874657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e14252ef-49d7-4bb3-9143-b02603811e57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:27.875330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e14252ef-49d7-4bb3-9143-b02603811e57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:27.876814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e14252ef-49d7-4bb3-9143-b02603811e57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:27.877650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e14252ef-49d7-4bb3-9143-b02603811e57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:27.878422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e14252ef-49d7-4bb3-9143-b02603811e57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:27.888584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Getting quotas for project 452e5b77db474cf9a2b7f6b2abcb6115. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:20:27.895866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Getting quotas for user 2878f8de95694fe1a9a17ed27b6ba40b and project 452e5b77db474cf9a2b7f6b2abcb6115. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:20:27.916317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:20:27.919742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:20:27.979118 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-00b3e926-75b5-48c5-a446-1095bce4717b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.126628 Oct 18 13:20:27.979871 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 581/1144] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:20:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:20:27.986452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-12c667e1-2277-4ec0-8abb-2dbbfe6ec81d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:27.987154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-12c667e1-2277-4ec0-8abb-2dbbfe6ec81d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:27.994087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c667e1-2277-4ec0-8abb-2dbbfe6ec81d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:27.994652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c667e1-2277-4ec0-8abb-2dbbfe6ec81d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:27.995149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c667e1-2277-4ec0-8abb-2dbbfe6ec81d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:27.995916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c667e1-2277-4ec0-8abb-2dbbfe6ec81d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:27.996469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c667e1-2277-4ec0-8abb-2dbbfe6ec81d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:27.996992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c667e1-2277-4ec0-8abb-2dbbfe6ec81d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:28.001288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:28.140968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e14252ef-49d7-4bb3-9143-b02603811e57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:28.150846 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e14252ef-49d7-4bb3-9143-b02603811e57 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1541 microversion: 2.1 time: 0.291054 Oct 18 13:20:28.166327 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 564/1145] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:27 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1541 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:28.175320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5695c900-322e-4816-b3bb-80d47f53a83d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:28.176172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5695c900-322e-4816-b3bb-80d47f53a83d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:28.204618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-12c667e1-2277-4ec0-8abb-2dbbfe6ec81d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:28.213427 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-12c667e1-2277-4ec0-8abb-2dbbfe6ec81d tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1588 microversion: 2.1 time: 0.231994 Oct 18 13:20:28.214429 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 582/1146] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:27 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1588 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:28.219102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-45896b5f-f268-4b5b-9d38-1c9e3128e99d tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f933790>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:28.264890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5695c900-322e-4816-b3bb-80d47f53a83d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:28.293440 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5695c900-322e-4816-b3bb-80d47f53a83d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1239 microversion: 2.1 time: 0.125279 Oct 18 13:20:28.298747 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 565/1147] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:28 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1239 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:28.302454 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-45896b5f-f268-4b5b-9d38-1c9e3128e99d tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1438 microversion: 2.1 time: 0.086723 Oct 18 13:20:28.305214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6e8374c8-59c4-482b-b33e-2a0b039d9c39 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:28.305963 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 583/1148] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:28 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1438 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:28.322021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6e8374c8-59c4-482b-b33e-2a0b039d9c39 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:28.329897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e8374c8-59c4-482b-b33e-2a0b039d9c39 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:28.330494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e8374c8-59c4-482b-b33e-2a0b039d9c39 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:28.331040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e8374c8-59c4-482b-b33e-2a0b039d9c39 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:28.331847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e8374c8-59c4-482b-b33e-2a0b039d9c39 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:28.332376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e8374c8-59c4-482b-b33e-2a0b039d9c39 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:28.332874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e8374c8-59c4-482b-b33e-2a0b039d9c39 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:28.334805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a52a6637-8709-4878-9ff2-67c5c76fc763 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f8b5a60>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:28.432783 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a52a6637-8709-4878-9ff2-67c5c76fc763 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 200 len: 1438 microversion: 2.1 time: 0.112721 Oct 18 13:20:28.433695 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 584/1149] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:28 2022] GET /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:28.452538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7151f154-7b5a-44f8-8ef5-73c1be79286b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:28.453547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7151f154-7b5a-44f8-8ef5-73c1be79286b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:28.462437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7151f154-7b5a-44f8-8ef5-73c1be79286b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:28.463005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7151f154-7b5a-44f8-8ef5-73c1be79286b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:28.463610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7151f154-7b5a-44f8-8ef5-73c1be79286b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:28.464366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7151f154-7b5a-44f8-8ef5-73c1be79286b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:28.464867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7151f154-7b5a-44f8-8ef5-73c1be79286b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:28.465339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7151f154-7b5a-44f8-8ef5-73c1be79286b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:28.480691 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6e8374c8-59c4-482b-b33e-2a0b039d9c39 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180507 Oct 18 13:20:28.481397 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 566/1150] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:20:28 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:28.610934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-409bab6c-1f40-481c-9a64-af2f58cdf8fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:28.612385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-409bab6c-1f40-481c-9a64-af2f58cdf8fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:28.621556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-409bab6c-1f40-481c-9a64-af2f58cdf8fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:28.622312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-409bab6c-1f40-481c-9a64-af2f58cdf8fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:28.623023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-409bab6c-1f40-481c-9a64-af2f58cdf8fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:28.625885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-409bab6c-1f40-481c-9a64-af2f58cdf8fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:28.626597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-409bab6c-1f40-481c-9a64-af2f58cdf8fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:28.627217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-409bab6c-1f40-481c-9a64-af2f58cdf8fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:28.827022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7151f154-7b5a-44f8-8ef5-73c1be79286b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:28.845705 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7151f154-7b5a-44f8-8ef5-73c1be79286b tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1466 microversion: 2.1 time: 0.398321 Oct 18 13:20:28.861212 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 585/1151] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:28 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1466 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:28.861212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:28.861212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:28.891229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:28.891743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:28.892177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:28.892882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:28.893357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:28.893777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:28.985977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:28.986607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:28.986953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:28.987448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lazy-loading 'fault' on Instance uuid 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:20:29.011734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-409bab6c-1f40-481c-9a64-af2f58cdf8fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:29.022978 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-409bab6c-1f40-481c-9a64-af2f58cdf8fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1307 microversion: 2.1 time: 0.416408 Oct 18 13:20:29.029241 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 567/1152] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:28 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1307 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:29.050041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-60e5c306-96a0-464f-bb31-79bdb63869cd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff6140b9700>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:29.599570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8af3705288d46ca94bf973f16aa1bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca31a93e6854a0fa9cc37d0bb89a3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:29.611976 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ae749115-ae47-4baa-ad33-fdc994add8c3 tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 200 len: 1303 microversion: 2.1 time: 0.757827 Oct 18 13:20:29.626218 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 586/1153] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:28 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 1303 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:29.626218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8f04be14-fa49-4dbd-b2a5-e7bb75c1f79d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:29.626218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8f04be14-fa49-4dbd-b2a5-e7bb75c1f79d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:29.646996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f04be14-fa49-4dbd-b2a5-e7bb75c1f79d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:29.647501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f04be14-fa49-4dbd-b2a5-e7bb75c1f79d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:29.647937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f04be14-fa49-4dbd-b2a5-e7bb75c1f79d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:29.648654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f04be14-fa49-4dbd-b2a5-e7bb75c1f79d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:29.649113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f04be14-fa49-4dbd-b2a5-e7bb75c1f79d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:29.651024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f04be14-fa49-4dbd-b2a5-e7bb75c1f79d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.084996 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-60e5c306-96a0-464f-bb31-79bdb63869cd tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "DELETE /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438" status: 204 len: 0 microversion: 2.1 time: 1.053174 Oct 18 13:20:30.088719 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 568/1154] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:29 2022] DELETE /compute/v2.1/images/b6fb1962-2784-4cfd-8728-5b48ae737438 => generated 0 bytes in 1056 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:20:30.090319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8f04be14-fa49-4dbd-b2a5-e7bb75c1f79d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:30.093589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6cf07486-7b12-4cfe-9a0a-c3c3f6978872 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:30.094562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6cf07486-7b12-4cfe-9a0a-c3c3f6978872 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:30.103500 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8f04be14-fa49-4dbd-b2a5-e7bb75c1f79d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1541 microversion: 2.1 time: 0.487307 Oct 18 13:20:30.105727 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 587/1155] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:29 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1541 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:30.123925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa1e7fa1-4359-4250-9045-32d43fbf56c7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:30.126529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fa1e7fa1-4359-4250-9045-32d43fbf56c7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:30.134287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cf07486-7b12-4cfe-9a0a-c3c3f6978872 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.135144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cf07486-7b12-4cfe-9a0a-c3c3f6978872 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.135829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cf07486-7b12-4cfe-9a0a-c3c3f6978872 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.136785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cf07486-7b12-4cfe-9a0a-c3c3f6978872 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.137510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cf07486-7b12-4cfe-9a0a-c3c3f6978872 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.138767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cf07486-7b12-4cfe-9a0a-c3c3f6978872 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.151761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1e7fa1-4359-4250-9045-32d43fbf56c7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.154796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1e7fa1-4359-4250-9045-32d43fbf56c7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.155502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1e7fa1-4359-4250-9045-32d43fbf56c7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.156259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1e7fa1-4359-4250-9045-32d43fbf56c7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.156762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1e7fa1-4359-4250-9045-32d43fbf56c7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.157574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1e7fa1-4359-4250-9045-32d43fbf56c7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.347095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6cf07486-7b12-4cfe-9a0a-c3c3f6978872 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:30.363404 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6cf07486-7b12-4cfe-9a0a-c3c3f6978872 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1299 microversion: 2.1 time: 0.276092 Oct 18 13:20:30.364027 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 569/1156] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:30 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1299 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:30.368756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9cc20e4b-044f-4f4a-9ad9-033e8b8874c9 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '.version_select at 0x7ff60f7ffc10>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:30.428899 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-9cc20e4b-044f-4f4a-9ad9-033e8b8874c9 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] HTTP exception thrown: Image not found. Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9cc20e4b-044f-4f4a-9ad9-033e8b8874c9 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Request method failure captured: Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 HTTP/1.1 Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqe_erGAWJZ0V394ftD4p-tEpy8MDcH_xx4M-TtjDD4HiDuYEvzYWsXXceDvSxnQCsJH-e9rFw5a51TASP9lyXPafpm1dwK4mhu6FSo1oqcMEtgNb-qRrksw9hv2hpF0gbs5wv9PzhRsDNvi5ArAvRtmNeG-epmjwv0QrVVnvyCIBYk Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 8b25d34a33834e5e8861dc30586f56a4 Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesOneServerTestJSON-1298298477 Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:20:30.431100 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:20:30.432676 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8b25d34a33834e5e8861dc30586f56a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8b25d34a33834e5e8861dc30586f56a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8b25d34a33834e5e8861dc30586f56a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8b25d34a33834e5e8861dc30586f56a4"}]}] Oct 18 13:20:30.432676 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesOneServerTestJSON-1298298477 Oct 18 13:20:30.432676 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 8b25d34a33834e5e8861dc30586f56a4 Oct 18 13:20:30.432676 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1298298477 Oct 18 13:20:30.432676 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesOneServerTestJSON-1298298477-project Oct 18 13:20:30.432676 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:20:30.432676 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:20:30.432676 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: dcacade4c71a4ba9b16b896418771de5 Oct 18 13:20:30.432676 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesOneServerTestJSON-1298298477-project Oct 18 13:20:30.432676 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:20:30.432676 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:20:30.432676 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '7f42e3c2-0e83-4396-9a5f-431a71fcf3b0'} Oct 18 13:20:30.432676 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 to delete Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:30.433632 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 could not be found. Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:20:30.436203 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9cc20e4b-044f-4f4a-9ad9-033e8b8874c9 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:20:30.437477 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9cc20e4b-044f-4f4a-9ad9-033e8b8874c9 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "DELETE /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0" status: 404 len: 62 microversion: 2.1 time: 0.068182 Oct 18 13:20:30.441963 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 570/1157] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:30 2022] DELETE /compute/v2.1/images/7f42e3c2-0e83-4396-9a5f-431a71fcf3b0 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:20:30.444306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-01b5cc8a-9f9f-45f3-ba0f-ea5f39015659 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:30.444984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-01b5cc8a-9f9f-45f3-ba0f-ea5f39015659 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:30.453121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01b5cc8a-9f9f-45f3-ba0f-ea5f39015659 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.454569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01b5cc8a-9f9f-45f3-ba0f-ea5f39015659 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.455234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01b5cc8a-9f9f-45f3-ba0f-ea5f39015659 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.456204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01b5cc8a-9f9f-45f3-ba0f-ea5f39015659 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.456913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01b5cc8a-9f9f-45f3-ba0f-ea5f39015659 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.457999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01b5cc8a-9f9f-45f3-ba0f-ea5f39015659 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.468690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fa1e7fa1-4359-4250-9045-32d43fbf56c7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:30.480404 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fa1e7fa1-4359-4250-9045-32d43fbf56c7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1487 microversion: 2.1 time: 0.372708 Oct 18 13:20:30.480938 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 588/1158] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:30 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1487 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:30.491211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-01b5cc8a-9f9f-45f3-ba0f-ea5f39015659 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:20:30.505575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c8c1ad90-f1e0-4ea7-9c65-57187be70341 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:30.506118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c8c1ad90-f1e0-4ea7-9c65-57187be70341 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:30.516986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8c1ad90-f1e0-4ea7-9c65-57187be70341 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.517517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8c1ad90-f1e0-4ea7-9c65-57187be70341 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.517955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8c1ad90-f1e0-4ea7-9c65-57187be70341 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.518678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8c1ad90-f1e0-4ea7-9c65-57187be70341 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.519166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8c1ad90-f1e0-4ea7-9c65-57187be70341 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.519595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8c1ad90-f1e0-4ea7-9c65-57187be70341 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.604791 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-01b5cc8a-9f9f-45f3-ba0f-ea5f39015659 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "DELETE /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 204 len: 0 microversion: 2.1 time: 0.164292 Oct 18 13:20:30.607071 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 571/1159] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:20:30 2022] DELETE /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:20:30.621598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-12b48fb6-91db-40f8-9065-21ea6a5572e2 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:30.623210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-12b48fb6-91db-40f8-9065-21ea6a5572e2 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:30.639799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12b48fb6-91db-40f8-9065-21ea6a5572e2 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.642768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12b48fb6-91db-40f8-9065-21ea6a5572e2 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.643215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12b48fb6-91db-40f8-9065-21ea6a5572e2 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.643987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12b48fb6-91db-40f8-9065-21ea6a5572e2 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.644447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12b48fb6-91db-40f8-9065-21ea6a5572e2 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.644872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12b48fb6-91db-40f8-9065-21ea6a5572e2 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.705276 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c8c1ad90-f1e0-4ea7-9c65-57187be70341 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9/action" status: 202 len: 0 microversion: 2.1 time: 0.205239 Oct 18 13:20:30.706610 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 589/1160] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:20:30 2022] POST /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:20:30.733648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d99c926d-7f0a-4dbb-a075-7855a4b4392d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:30.741839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d99c926d-7f0a-4dbb-a075-7855a4b4392d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] [instance: 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:30.749402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d99c926d-7f0a-4dbb-a075-7855a4b4392d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.751317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d99c926d-7f0a-4dbb-a075-7855a4b4392d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.751860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d99c926d-7f0a-4dbb-a075-7855a4b4392d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.752612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d99c926d-7f0a-4dbb-a075-7855a4b4392d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.753146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d99c926d-7f0a-4dbb-a075-7855a4b4392d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.753662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d99c926d-7f0a-4dbb-a075-7855a4b4392d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.809057 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-d99c926d-7f0a-4dbb-a075-7855a4b4392d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] HTTP exception thrown: Instance 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a could not be found. Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d99c926d-7f0a-4dbb-a075-7855a4b4392d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Request method failure captured: Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a HTTP/1.1 Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqeA6wYslji_2kKcrLFU2Mn9qSHxPDYkorn2oavMI1Xr9-7UM2gLwlhGeWRDqPGVzJmUQLfl_ZaaIWb7zDLF-skkc3aa_qj8OBynMm9b8VY6rN_B934FXb0GneW_bkK98R3rLXRKcbepX0HwB-A9sUoI5QFkE-HBCSk56tYZ84BZOlY Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 4ca31a93e6854a0fa9cc37d0bb89a3c6 Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersAdminTestJSON-1704955637 Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:20:30.811067 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:20:30.812695 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4ca31a93e6854a0fa9cc37d0bb89a3c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4ca31a93e6854a0fa9cc37d0bb89a3c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4ca31a93e6854a0fa9cc37d0bb89a3c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4ca31a93e6854a0fa9cc37d0bb89a3c6"}]}] Oct 18 13:20:30.812695 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersAdminTestJSON-1704955637 Oct 18 13:20:30.812695 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 4ca31a93e6854a0fa9cc37d0bb89a3c6 Oct 18 13:20:30.812695 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersAdminTestJSON-1704955637 Oct 18 13:20:30.812695 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersAdminTestJSON-1704955637-project Oct 18 13:20:30.812695 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:20:30.812695 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:20:30.812695 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e8af3705288d46ca94bf973f16aa1bb6 Oct 18 13:20:30.812695 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersAdminTestJSON-1704955637-project Oct 18 13:20:30.812695 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:20:30.812695 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a could not be found. Oct 18 13:20:30.812695 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a'} Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a could not be found. Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:20:30.814976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a could not be found. Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a could not be found. Oct 18 13:20:30.816577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:20:30.822157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d99c926d-7f0a-4dbb-a075-7855a4b4392d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] Returning 404 to user: Instance 9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:20:30.823306 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d99c926d-7f0a-4dbb-a075-7855a4b4392d tempest-ServersAdminTestJSON-1704955637 tempest-ServersAdminTestJSON-1704955637-project] 10.222.0.40 "GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a" status: 404 len: 111 microversion: 2.1 time: 0.115418 Oct 18 13:20:30.824098 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 590/1161] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:30 2022] GET /compute/v2.1/servers/9bc280bc-c47e-4a7a-a8a6-4e70aa2f889a => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:20:30.847320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2ccf7928-4e19-425c-87f8-0a853bb726bb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:30.851094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2ccf7928-4e19-425c-87f8-0a853bb726bb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:30.866133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ccf7928-4e19-425c-87f8-0a853bb726bb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.871308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ccf7928-4e19-425c-87f8-0a853bb726bb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.873024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ccf7928-4e19-425c-87f8-0a853bb726bb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:30.882985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ccf7928-4e19-425c-87f8-0a853bb726bb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:30.883782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ccf7928-4e19-425c-87f8-0a853bb726bb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:30.884312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ccf7928-4e19-425c-87f8-0a853bb726bb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:31.113263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-12b48fb6-91db-40f8-9065-21ea6a5572e2 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:31.132342 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-12b48fb6-91db-40f8-9065-21ea6a5572e2 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1472 microversion: 2.1 time: 0.520153 Oct 18 13:20:31.157868 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 572/1162] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:30 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1472 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:31.182295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4de83d0a-9684-4a69-a5bb-119653762ba5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:31.185203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4de83d0a-9684-4a69-a5bb-119653762ba5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:31.208166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4de83d0a-9684-4a69-a5bb-119653762ba5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:31.208787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4de83d0a-9684-4a69-a5bb-119653762ba5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:31.209089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4de83d0a-9684-4a69-a5bb-119653762ba5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:31.209847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4de83d0a-9684-4a69-a5bb-119653762ba5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:31.210301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4de83d0a-9684-4a69-a5bb-119653762ba5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:31.210725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4de83d0a-9684-4a69-a5bb-119653762ba5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:31.218186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2ccf7928-4e19-425c-87f8-0a853bb726bb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:31.229649 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2ccf7928-4e19-425c-87f8-0a853bb726bb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1492 microversion: 2.1 time: 0.402486 Oct 18 13:20:31.242773 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 591/1163] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:30 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1492 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:31.255385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2688ef1c-3c4d-4882-b27c-6922b2f33d30 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:31.256528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2688ef1c-3c4d-4882-b27c-6922b2f33d30 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:31.264953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2688ef1c-3c4d-4882-b27c-6922b2f33d30 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:31.265727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2688ef1c-3c4d-4882-b27c-6922b2f33d30 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:31.267262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2688ef1c-3c4d-4882-b27c-6922b2f33d30 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:31.268176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2688ef1c-3c4d-4882-b27c-6922b2f33d30 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:31.268798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2688ef1c-3c4d-4882-b27c-6922b2f33d30 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:31.269468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2688ef1c-3c4d-4882-b27c-6922b2f33d30 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:31.461620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2688ef1c-3c4d-4882-b27c-6922b2f33d30 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:31.472179 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2688ef1c-3c4d-4882-b27c-6922b2f33d30 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1588 microversion: 2.1 time: 0.228043 Oct 18 13:20:31.475733 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 592/1164] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:31 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1588 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:31.480915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-59d8c88b-8095-47b1-82ae-49a8598d12f4 req-196d8209-0935-433f-b567-a01c8743e489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14965255-1b8d-4094-84de-1e81599640fb", "tag": "66f6f9e9-bc02-4b17-a7e1-a5fede1227a3"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:31.502666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-59d8c88b-8095-47b1-82ae-49a8598d12f4 req-196d8209-0935-433f-b567-a01c8743e489 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:31.503648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-59d8c88b-8095-47b1-82ae-49a8598d12f4 req-196d8209-0935-433f-b567-a01c8743e489 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:31.504330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-59d8c88b-8095-47b1-82ae-49a8598d12f4 req-196d8209-0935-433f-b567-a01c8743e489 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:31.524718 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-59d8c88b-8095-47b1-82ae-49a8598d12f4 req-196d8209-0935-433f-b567-a01c8743e489 service nova] Creating event network-changed:66f6f9e9-bc02-4b17-a7e1-a5fede1227a3 for instance 14965255-1b8d-4094-84de-1e81599640fb on n-h2-858384-13 Oct 18 13:20:31.531427 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-59d8c88b-8095-47b1-82ae-49a8598d12f4 req-196d8209-0935-433f-b567-a01c8743e489 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054148 Oct 18 13:20:31.535066 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 593/1165] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:31.545797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-76ec9456-204b-4e6f-9c86-83e5df21c25e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:31.546854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-76ec9456-204b-4e6f-9c86-83e5df21c25e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:31.559631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76ec9456-204b-4e6f-9c86-83e5df21c25e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:31.560273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76ec9456-204b-4e6f-9c86-83e5df21c25e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:31.560768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76ec9456-204b-4e6f-9c86-83e5df21c25e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:31.561602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76ec9456-204b-4e6f-9c86-83e5df21c25e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:31.562146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76ec9456-204b-4e6f-9c86-83e5df21c25e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:31.562824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76ec9456-204b-4e6f-9c86-83e5df21c25e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:31.783279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4de83d0a-9684-4a69-a5bb-119653762ba5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:31.784029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-76ec9456-204b-4e6f-9c86-83e5df21c25e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:31.794716 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-76ec9456-204b-4e6f-9c86-83e5df21c25e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1297 microversion: 2.1 time: 0.257904 Oct 18 13:20:31.796043 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4de83d0a-9684-4a69-a5bb-119653762ba5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1541 microversion: 2.1 time: 0.635374 Oct 18 13:20:31.799283 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 573/1166] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:31 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1541 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:31.805479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b777933c-7e19-47c7-88d8-af053431b432 req-09a962c4-c331-4371-a170-facd9e4188e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938746d4-6297-49a5-811f-89814a1e182b", "name": "network-vif-unplugged", "status": "completed", "tag": "a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:31.807306 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 594/1167] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:31 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1297 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:31.840089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b777933c-7e19-47c7-88d8-af053431b432 req-09a962c4-c331-4371-a170-facd9e4188e4 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:31.841014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b777933c-7e19-47c7-88d8-af053431b432 req-09a962c4-c331-4371-a170-facd9e4188e4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:31.841897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b777933c-7e19-47c7-88d8-af053431b432 req-09a962c4-c331-4371-a170-facd9e4188e4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:31.871881 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b777933c-7e19-47c7-88d8-af053431b432 req-09a962c4-c331-4371-a170-facd9e4188e4 service nova] Creating event network-vif-unplugged:a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1 for instance 938746d4-6297-49a5-811f-89814a1e182b on n-h2-858384-13 Oct 18 13:20:31.880759 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b777933c-7e19-47c7-88d8-af053431b432 req-09a962c4-c331-4371-a170-facd9e4188e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079529 Oct 18 13:20:31.882227 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 574/1168] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:32.175570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e8935312-ac56-486c-b56f-34a727f7cd29 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:32.179338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e8935312-ac56-486c-b56f-34a727f7cd29 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:32.193484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8935312-ac56-486c-b56f-34a727f7cd29 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:32.195313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8935312-ac56-486c-b56f-34a727f7cd29 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:32.210617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8935312-ac56-486c-b56f-34a727f7cd29 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:32.214640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8935312-ac56-486c-b56f-34a727f7cd29 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:32.215803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8935312-ac56-486c-b56f-34a727f7cd29 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:32.220848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8935312-ac56-486c-b56f-34a727f7cd29 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:32.258312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-476dad2b-3c5e-4531-a9cd-d44766d7e8c8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:32.259034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-476dad2b-3c5e-4531-a9cd-d44766d7e8c8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:32.270598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-476dad2b-3c5e-4531-a9cd-d44766d7e8c8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:32.271092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-476dad2b-3c5e-4531-a9cd-d44766d7e8c8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:32.271530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-476dad2b-3c5e-4531-a9cd-d44766d7e8c8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:32.278629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-476dad2b-3c5e-4531-a9cd-d44766d7e8c8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:32.281163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-476dad2b-3c5e-4531-a9cd-d44766d7e8c8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:32.282454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-476dad2b-3c5e-4531-a9cd-d44766d7e8c8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:32.631789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e8935312-ac56-486c-b56f-34a727f7cd29 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:32.646928 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e8935312-ac56-486c-b56f-34a727f7cd29 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1472 microversion: 2.1 time: 0.487107 Oct 18 13:20:32.648317 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 595/1169] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:32 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1472 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:32.823848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c14890ec-b457-4851-9c44-effed60a5553 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:32.824472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c14890ec-b457-4851-9c44-effed60a5553 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:32.842202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c14890ec-b457-4851-9c44-effed60a5553 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:32.843086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c14890ec-b457-4851-9c44-effed60a5553 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:32.843528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c14890ec-b457-4851-9c44-effed60a5553 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:32.846065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c14890ec-b457-4851-9c44-effed60a5553 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:32.846554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c14890ec-b457-4851-9c44-effed60a5553 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:32.846983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c14890ec-b457-4851-9c44-effed60a5553 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:33.061739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c14890ec-b457-4851-9c44-effed60a5553 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:33.076948 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c14890ec-b457-4851-9c44-effed60a5553 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1541 microversion: 2.1 time: 0.256834 Oct 18 13:20:33.080226 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 596/1170] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:32 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1541 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:33.106328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fba6031c-98b6-47bc-aed2-ff8bbe1b9dce tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:33.107965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fba6031c-98b6-47bc-aed2-ff8bbe1b9dce tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:33.120185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba6031c-98b6-47bc-aed2-ff8bbe1b9dce tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:33.121316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba6031c-98b6-47bc-aed2-ff8bbe1b9dce tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:33.122169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba6031c-98b6-47bc-aed2-ff8bbe1b9dce tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:33.123163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba6031c-98b6-47bc-aed2-ff8bbe1b9dce tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:33.123919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba6031c-98b6-47bc-aed2-ff8bbe1b9dce tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:33.125091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba6031c-98b6-47bc-aed2-ff8bbe1b9dce tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:33.225565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-476dad2b-3c5e-4531-a9cd-d44766d7e8c8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:33.243091 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-476dad2b-3c5e-4531-a9cd-d44766d7e8c8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 200 len: 1472 microversion: 2.1 time: 0.989959 Oct 18 13:20:33.244992 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 575/1171] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:32 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 1472 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:33.273321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1d239e13-9020-45d9-af60-c69599bbcf23 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-622600418"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:33.276889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1d239e13-9020-45d9-af60-c69599bbcf23 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:33.294480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d239e13-9020-45d9-af60-c69599bbcf23 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:33.295070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d239e13-9020-45d9-af60-c69599bbcf23 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:33.295542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d239e13-9020-45d9-af60-c69599bbcf23 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:33.296570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d239e13-9020-45d9-af60-c69599bbcf23 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:33.297165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d239e13-9020-45d9-af60-c69599bbcf23 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:33.297496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d239e13-9020-45d9-af60-c69599bbcf23 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:33.310393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:33.629606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fba6031c-98b6-47bc-aed2-ff8bbe1b9dce tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:33.644912 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fba6031c-98b6-47bc-aed2-ff8bbe1b9dce tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1365 microversion: 2.1 time: 0.545980 Oct 18 13:20:33.652557 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 597/1172] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:33 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1365 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:33.676113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5e2b438f-f833-446b-87fb-11b0f521cf54 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:33.678325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e2b438f-f833-446b-87fb-11b0f521cf54 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:33.691754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e2b438f-f833-446b-87fb-11b0f521cf54 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:33.695999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e2b438f-f833-446b-87fb-11b0f521cf54 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:33.696908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e2b438f-f833-446b-87fb-11b0f521cf54 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:33.700316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e2b438f-f833-446b-87fb-11b0f521cf54 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:33.700924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e2b438f-f833-446b-87fb-11b0f521cf54 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:33.701441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e2b438f-f833-446b-87fb-11b0f521cf54 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:33.739314 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1d239e13-9020-45d9-af60-c69599bbcf23 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9/action" status: 202 len: 0 microversion: 2.1 time: 0.467430 Oct 18 13:20:33.743296 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 576/1173] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:20:33 2022] POST /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 18 13:20:33.758319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1f39e9da-e7c9-4623-869c-2c9c99f2ee39 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f79b5e0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:33.846628 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1f39e9da-e7c9-4623-869c-2c9c99f2ee39 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.096437 Oct 18 13:20:33.847730 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 577/1174] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:33 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:33.951145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5e2b438f-f833-446b-87fb-11b0f521cf54 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:33.963643 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5e2b438f-f833-446b-87fb-11b0f521cf54 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1472 microversion: 2.1 time: 0.295671 Oct 18 13:20:33.965020 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 598/1175] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:33 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:34.105049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8f7af18a-7b66-4a7a-9a5b-735105670377 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:34.108049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8f7af18a-7b66-4a7a-9a5b-735105670377 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:34.120409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f7af18a-7b66-4a7a-9a5b-735105670377 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:34.121273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f7af18a-7b66-4a7a-9a5b-735105670377 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:34.122072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f7af18a-7b66-4a7a-9a5b-735105670377 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:34.122832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f7af18a-7b66-4a7a-9a5b-735105670377 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:34.123273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f7af18a-7b66-4a7a-9a5b-735105670377 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:34.123696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f7af18a-7b66-4a7a-9a5b-735105670377 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:34.637455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8f7af18a-7b66-4a7a-9a5b-735105670377 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:34.654312 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8f7af18a-7b66-4a7a-9a5b-735105670377 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1541 microversion: 2.1 time: 0.553817 Oct 18 13:20:34.671656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-17b3e957-48ac-410c-9c42-39a554afcd2a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:34.673810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-17b3e957-48ac-410c-9c42-39a554afcd2a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:34.678136 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 578/1176] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:34 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1541 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:34.693687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17b3e957-48ac-410c-9c42-39a554afcd2a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:34.695276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17b3e957-48ac-410c-9c42-39a554afcd2a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:34.697427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17b3e957-48ac-410c-9c42-39a554afcd2a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:34.698377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17b3e957-48ac-410c-9c42-39a554afcd2a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:34.699040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17b3e957-48ac-410c-9c42-39a554afcd2a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:34.699642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17b3e957-48ac-410c-9c42-39a554afcd2a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:34.864292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bc4c06d2-30a8-424c-b508-ce52644a4a9a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7fff70>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:34.944067 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bc4c06d2-30a8-424c-b508-ce52644a4a9a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.084900 Oct 18 13:20:34.945079 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 579/1177] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:34 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:34.990061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-969ca158-6767-4cd1-ab5e-0723d8337ba7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:34.990684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-969ca158-6767-4cd1-ab5e-0723d8337ba7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:34.997301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-969ca158-6767-4cd1-ab5e-0723d8337ba7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:34.998001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-969ca158-6767-4cd1-ab5e-0723d8337ba7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:34.998596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-969ca158-6767-4cd1-ab5e-0723d8337ba7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:34.999737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-969ca158-6767-4cd1-ab5e-0723d8337ba7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:35.000711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-969ca158-6767-4cd1-ab5e-0723d8337ba7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:35.001389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-969ca158-6767-4cd1-ab5e-0723d8337ba7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:35.103051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-969ca158-6767-4cd1-ab5e-0723d8337ba7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcacade4c71a4ba9b16b896418771de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b25d34a33834e5e8861dc30586f56a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:35.108489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-17b3e957-48ac-410c-9c42-39a554afcd2a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:35.116498 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-969ca158-6767-4cd1-ab5e-0723d8337ba7 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 200 len: 1430 microversion: 2.1 time: 0.129799 Oct 18 13:20:35.133573 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 580/1178] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:34 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 1430 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:35.139042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b9fe8ebc-df30-47d2-9d8f-244e9d6e89c6 req-35f0c5e1-18d3-4d41-afdb-72e62568aaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938746d4-6297-49a5-811f-89814a1e182b", "name": "network-vif-deleted", "tag": "a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:35.140221 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-17b3e957-48ac-410c-9c42-39a554afcd2a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1365 microversion: 2.1 time: 0.475766 Oct 18 13:20:35.142117 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 599/1179] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:34 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1365 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:35.151823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b9fe8ebc-df30-47d2-9d8f-244e9d6e89c6 req-35f0c5e1-18d3-4d41-afdb-72e62568aaeb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:35.153730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b9fe8ebc-df30-47d2-9d8f-244e9d6e89c6 req-35f0c5e1-18d3-4d41-afdb-72e62568aaeb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:35.154635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b9fe8ebc-df30-47d2-9d8f-244e9d6e89c6 req-35f0c5e1-18d3-4d41-afdb-72e62568aaeb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:35.180085 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b9fe8ebc-df30-47d2-9d8f-244e9d6e89c6 req-35f0c5e1-18d3-4d41-afdb-72e62568aaeb service nova] Creating event network-vif-deleted:a799a2e8-87e5-4fd4-a32e-4398c9f7d7c1 for instance 938746d4-6297-49a5-811f-89814a1e182b on n-h2-858384-13 Oct 18 13:20:35.190368 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b9fe8ebc-df30-47d2-9d8f-244e9d6e89c6 req-35f0c5e1-18d3-4d41-afdb-72e62568aaeb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054307 Oct 18 13:20:35.194796 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 581/1180] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:35.689559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-51c31d68-10d5-4bb4-b8f0-cd6fc9a43c74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:35.692039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-51c31d68-10d5-4bb4-b8f0-cd6fc9a43c74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:35.709493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51c31d68-10d5-4bb4-b8f0-cd6fc9a43c74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:35.710928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51c31d68-10d5-4bb4-b8f0-cd6fc9a43c74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:35.713397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51c31d68-10d5-4bb4-b8f0-cd6fc9a43c74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:35.714769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51c31d68-10d5-4bb4-b8f0-cd6fc9a43c74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:35.716565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51c31d68-10d5-4bb4-b8f0-cd6fc9a43c74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:35.717987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51c31d68-10d5-4bb4-b8f0-cd6fc9a43c74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:35.961682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-060f8d59-e5e5-4f73-a161-a352a8b4b843 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f789f70>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:36.037690 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-060f8d59-e5e5-4f73-a161-a352a8b4b843 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.081012 Oct 18 13:20:36.038631 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 582/1181] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:35 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:36.112164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-51c31d68-10d5-4bb4-b8f0-cd6fc9a43c74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:36.123977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:36.135640 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-51c31d68-10d5-4bb4-b8f0-cd6fc9a43c74 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1541 microversion: 2.1 time: 0.455305 Oct 18 13:20:36.139003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35384250-0f81-41df-b1d6-84d099ab0b85 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:36.139177 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 600/1182] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:35 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1541 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:36.142438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-35384250-0f81-41df-b1d6-84d099ab0b85 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] [instance: 938746d4-6297-49a5-811f-89814a1e182b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:36.150810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35384250-0f81-41df-b1d6-84d099ab0b85 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:36.151303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35384250-0f81-41df-b1d6-84d099ab0b85 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:36.151741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35384250-0f81-41df-b1d6-84d099ab0b85 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:36.152443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35384250-0f81-41df-b1d6-84d099ab0b85 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:36.152898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35384250-0f81-41df-b1d6-84d099ab0b85 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:36.153353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35384250-0f81-41df-b1d6-84d099ab0b85 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:36.188711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7eceb644-b4ee-4a47-91b5-896398425ddf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:36.189367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7eceb644-b4ee-4a47-91b5-896398425ddf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:36.198434 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-35384250-0f81-41df-b1d6-84d099ab0b85 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] HTTP exception thrown: Instance 938746d4-6297-49a5-811f-89814a1e182b could not be found. Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35384250-0f81-41df-b1d6-84d099ab0b85 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Request method failure captured: Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b HTTP/1.1 Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqe_erGAWJZ0V394ftD4p-tEpy8MDcH_xx4M-TtjDD4HiDuYEvzYWsXXceDvSxnQCsJH-e9rFw5a51TASP9lyXPafpm1dwK4mhu6FSo1oqcMEtgNb-qRrksw9hv2hpF0gbs5wv9PzhRsDNvi5ArAvRtmNeG-epmjwv0QrVVnvyCIBYk Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 8b25d34a33834e5e8861dc30586f56a4 Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesOneServerTestJSON-1298298477 Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:20:36.200094 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:20:36.201520 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8b25d34a33834e5e8861dc30586f56a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8b25d34a33834e5e8861dc30586f56a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8b25d34a33834e5e8861dc30586f56a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8b25d34a33834e5e8861dc30586f56a4"}]}] Oct 18 13:20:36.201520 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesOneServerTestJSON-1298298477 Oct 18 13:20:36.201520 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 8b25d34a33834e5e8861dc30586f56a4 Oct 18 13:20:36.201520 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1298298477 Oct 18 13:20:36.201520 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesOneServerTestJSON-1298298477-project Oct 18 13:20:36.201520 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:20:36.201520 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:20:36.201520 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: dcacade4c71a4ba9b16b896418771de5 Oct 18 13:20:36.201520 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesOneServerTestJSON-1298298477-project Oct 18 13:20:36.201520 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:20:36.201520 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 938746d4-6297-49a5-811f-89814a1e182b could not be found. Oct 18 13:20:36.201520 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '938746d4-6297-49a5-811f-89814a1e182b'} Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938746d4-6297-49a5-811f-89814a1e182b could not be found. Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:20:36.202324 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938746d4-6297-49a5-811f-89814a1e182b could not be found. Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938746d4-6297-49a5-811f-89814a1e182b could not be found. Oct 18 13:20:36.204354 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:20:36.205725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35384250-0f81-41df-b1d6-84d099ab0b85 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] Returning 404 to user: Instance 938746d4-6297-49a5-811f-89814a1e182b could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:20:36.205940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7eceb644-b4ee-4a47-91b5-896398425ddf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:36.213930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7eceb644-b4ee-4a47-91b5-896398425ddf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:36.214402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7eceb644-b4ee-4a47-91b5-896398425ddf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:36.215654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7eceb644-b4ee-4a47-91b5-896398425ddf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:36.215654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7eceb644-b4ee-4a47-91b5-896398425ddf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:36.216100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7eceb644-b4ee-4a47-91b5-896398425ddf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:36.221717 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-35384250-0f81-41df-b1d6-84d099ab0b85 tempest-ImagesOneServerTestJSON-1298298477 tempest-ImagesOneServerTestJSON-1298298477-project] 10.222.0.40 "GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b" status: 404 len: 111 microversion: 2.1 time: 0.066399 Oct 18 13:20:36.222632 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 583/1183] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:36 2022] GET /compute/v2.1/servers/938746d4-6297-49a5-811f-89814a1e182b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:20:36.545281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7eceb644-b4ee-4a47-91b5-896398425ddf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:36.559448 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7eceb644-b4ee-4a47-91b5-896398425ddf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1365 microversion: 2.1 time: 0.375232 Oct 18 13:20:36.560367 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 601/1184] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:36 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1365 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:37.057325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1ecb2da3-71e8-4da2-a551-4ea430eeb070 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7d05e0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:37.174885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32d122b8-5087-45a9-ae36-a03e7d3a2190 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:37.176233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-32d122b8-5087-45a9-ae36-a03e7d3a2190 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:37.187725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32d122b8-5087-45a9-ae36-a03e7d3a2190 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:37.188593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32d122b8-5087-45a9-ae36-a03e7d3a2190 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:37.189475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32d122b8-5087-45a9-ae36-a03e7d3a2190 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:37.191027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32d122b8-5087-45a9-ae36-a03e7d3a2190 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:37.191325 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1ecb2da3-71e8-4da2-a551-4ea430eeb070 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.139630 Oct 18 13:20:37.191919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32d122b8-5087-45a9-ae36-a03e7d3a2190 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:37.192552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32d122b8-5087-45a9-ae36-a03e7d3a2190 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:37.200739 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 584/1185] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:37 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:37.218095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e399190d-5deb-41cf-b587-a7984dcb9ebd req-cfa72b1d-da33-4456-b200-39939ba71b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aad90b5-28fb-44b2-89da-33bc1b2889f2", "tag": "516c3ad3-1e31-4bde-b674-c0c367989f56"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:37.233379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e399190d-5deb-41cf-b587-a7984dcb9ebd req-cfa72b1d-da33-4456-b200-39939ba71b37 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:37.234116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e399190d-5deb-41cf-b587-a7984dcb9ebd req-cfa72b1d-da33-4456-b200-39939ba71b37 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:37.235556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e399190d-5deb-41cf-b587-a7984dcb9ebd req-cfa72b1d-da33-4456-b200-39939ba71b37 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:37.252594 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e399190d-5deb-41cf-b587-a7984dcb9ebd req-cfa72b1d-da33-4456-b200-39939ba71b37 service nova] Creating event network-changed:516c3ad3-1e31-4bde-b674-c0c367989f56 for instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 on n-h1-858384-13 Oct 18 13:20:37.258339 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e399190d-5deb-41cf-b587-a7984dcb9ebd req-cfa72b1d-da33-4456-b200-39939ba71b37 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044244 Oct 18 13:20:37.259236 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 585/1186] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:20:37.566422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-32d122b8-5087-45a9-ae36-a03e7d3a2190 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:37.576708 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-32d122b8-5087-45a9-ae36-a03e7d3a2190 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1541 microversion: 2.1 time: 0.415793 Oct 18 13:20:37.577723 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 602/1187] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:37 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1541 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:37.589221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9d2cfa3d-3287-40e3-9322-7ac445d3c1f3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:37.590386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9d2cfa3d-3287-40e3-9322-7ac445d3c1f3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:37.603602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d2cfa3d-3287-40e3-9322-7ac445d3c1f3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:37.604375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d2cfa3d-3287-40e3-9322-7ac445d3c1f3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:37.604809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d2cfa3d-3287-40e3-9322-7ac445d3c1f3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:37.605799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d2cfa3d-3287-40e3-9322-7ac445d3c1f3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:37.606466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d2cfa3d-3287-40e3-9322-7ac445d3c1f3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:37.606896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d2cfa3d-3287-40e3-9322-7ac445d3c1f3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:37.801593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9d2cfa3d-3287-40e3-9322-7ac445d3c1f3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:37.810796 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9d2cfa3d-3287-40e3-9322-7ac445d3c1f3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1365 microversion: 2.1 time: 0.231116 Oct 18 13:20:37.811391 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 586/1188] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:37 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:38.208643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4b20d695-8176-4b45-8ca4-457d6f98e5cb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f817e50>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:38.231656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:38.233545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=10 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:38.275422 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4b20d695-8176-4b45-8ca4-457d6f98e5cb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.070973 Oct 18 13:20:38.285277 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 603/1189] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:38 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:38.605487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-968ec836-59ca-4fe8-ae90-b77f6b47569e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:38.610219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-968ec836-59ca-4fe8-ae90-b77f6b47569e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:38.613889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:38.628189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-968ec836-59ca-4fe8-ae90-b77f6b47569e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:38.629206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-968ec836-59ca-4fe8-ae90-b77f6b47569e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:38.629995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-968ec836-59ca-4fe8-ae90-b77f6b47569e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:38.631367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-968ec836-59ca-4fe8-ae90-b77f6b47569e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:38.632337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-968ec836-59ca-4fe8-ae90-b77f6b47569e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:38.633127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-968ec836-59ca-4fe8-ae90-b77f6b47569e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:38.835653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d0054e9c-e448-4434-9987-964612bfa9e1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:38.836603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d0054e9c-e448-4434-9987-964612bfa9e1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:38.848269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0054e9c-e448-4434-9987-964612bfa9e1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:38.852144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0054e9c-e448-4434-9987-964612bfa9e1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:38.852963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0054e9c-e448-4434-9987-964612bfa9e1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:38.854961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0054e9c-e448-4434-9987-964612bfa9e1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:38.857559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0054e9c-e448-4434-9987-964612bfa9e1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:38.861978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0054e9c-e448-4434-9987-964612bfa9e1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:39.260784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d0054e9c-e448-4434-9987-964612bfa9e1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:39.280376 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d0054e9c-e448-4434-9987-964612bfa9e1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1365 microversion: 2.1 time: 0.449340 Oct 18 13:20:39.282712 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 604/1190] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:38 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1365 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:39.303626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-524bf8d0-de81-4a25-bc76-9d8b549d7bb2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f97caf0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:39.394583 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-524bf8d0-de81-4a25-bc76-9d8b549d7bb2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.094755 Oct 18 13:20:39.397155 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 605/1191] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:39 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:40.028472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-968ec836-59ca-4fe8-ae90-b77f6b47569e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:40.048089 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-968ec836-59ca-4fe8-ae90-b77f6b47569e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1541 microversion: 2.1 time: 1.444520 Oct 18 13:20:40.048794 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 587/1192] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:38 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1541 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:40.314587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8e3aa4f0-3932-43f3-a62d-e5c7f8c9c411 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:40.324709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8e3aa4f0-3932-43f3-a62d-e5c7f8c9c411 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:40.343754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e3aa4f0-3932-43f3-a62d-e5c7f8c9c411 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:40.345011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e3aa4f0-3932-43f3-a62d-e5c7f8c9c411 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:40.346179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e3aa4f0-3932-43f3-a62d-e5c7f8c9c411 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:40.347832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e3aa4f0-3932-43f3-a62d-e5c7f8c9c411 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:40.349087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e3aa4f0-3932-43f3-a62d-e5c7f8c9c411 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:40.350291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e3aa4f0-3932-43f3-a62d-e5c7f8c9c411 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:40.430251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0d9d163c-7139-492b-915b-25f2c07e3c64 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff6143301f0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:40.519263 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0d9d163c-7139-492b-915b-25f2c07e3c64 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.111273 Oct 18 13:20:40.520658 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 588/1193] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:40 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:41.070098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8e3aa4f0-3932-43f3-a62d-e5c7f8c9c411 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:41.080224 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8e3aa4f0-3932-43f3-a62d-e5c7f8c9c411 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1365 microversion: 2.1 time: 0.779124 Oct 18 13:20:41.094489 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 606/1194] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:40 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1365 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:41.094914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3054c4d1-b59b-4b5c-83f9-bd2b28956289 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:41.095985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3054c4d1-b59b-4b5c-83f9-bd2b28956289 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:41.139667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3054c4d1-b59b-4b5c-83f9-bd2b28956289 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:41.141348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3054c4d1-b59b-4b5c-83f9-bd2b28956289 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:41.142914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3054c4d1-b59b-4b5c-83f9-bd2b28956289 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:41.143858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3054c4d1-b59b-4b5c-83f9-bd2b28956289 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:41.144656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3054c4d1-b59b-4b5c-83f9-bd2b28956289 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:41.145839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3054c4d1-b59b-4b5c-83f9-bd2b28956289 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:41.546988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d080f42d-988f-45ca-ae1c-21ef971b5478 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f872d30>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:41.677083 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d080f42d-988f-45ca-ae1c-21ef971b5478 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.134724 Oct 18 13:20:41.679907 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 607/1195] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:41 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:41.712384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3e335e33-dfc4-4691-bd1d-b3491517cf3f req-9f19fccd-d118-49e5-81d2-03cc304899ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f0df27-75cd-4ece-b3e8-91174239e3a9", "name": "network-vif-plugged", "status": "completed", "tag": "3d6790df-75bb-427a-86ec-809a4c3e5c9f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:41.758752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3e335e33-dfc4-4691-bd1d-b3491517cf3f req-9f19fccd-d118-49e5-81d2-03cc304899ad service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:41.759511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3e335e33-dfc4-4691-bd1d-b3491517cf3f req-9f19fccd-d118-49e5-81d2-03cc304899ad service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:41.760158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3e335e33-dfc4-4691-bd1d-b3491517cf3f req-9f19fccd-d118-49e5-81d2-03cc304899ad service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:41.787639 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3e335e33-dfc4-4691-bd1d-b3491517cf3f req-9f19fccd-d118-49e5-81d2-03cc304899ad service nova] Creating event network-vif-plugged:3d6790df-75bb-427a-86ec-809a4c3e5c9f for instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 on n-h1-858384-13 Oct 18 13:20:41.802128 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3e335e33-dfc4-4691-bd1d-b3491517cf3f req-9f19fccd-d118-49e5-81d2-03cc304899ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099636 Oct 18 13:20:41.802673 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 608/1196] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:42.081417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3054c4d1-b59b-4b5c-83f9-bd2b28956289 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:42.179538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1e564c42-a08d-4bf0-bc9e-54c694add7d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:42.182174 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3054c4d1-b59b-4b5c-83f9-bd2b28956289 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1541 microversion: 2.1 time: 1.097723 Oct 18 13:20:42.183483 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 589/1197] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:41 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1541 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:42.184458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1e564c42-a08d-4bf0-bc9e-54c694add7d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:42.237808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e564c42-a08d-4bf0-bc9e-54c694add7d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:42.239609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e564c42-a08d-4bf0-bc9e-54c694add7d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:42.243897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e564c42-a08d-4bf0-bc9e-54c694add7d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:42.246908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e564c42-a08d-4bf0-bc9e-54c694add7d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:42.248197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e564c42-a08d-4bf0-bc9e-54c694add7d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:42.249440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e564c42-a08d-4bf0-bc9e-54c694add7d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:42.582991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1e564c42-a08d-4bf0-bc9e-54c694add7d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:42.591375 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1e564c42-a08d-4bf0-bc9e-54c694add7d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1365 microversion: 2.1 time: 0.486012 Oct 18 13:20:42.593234 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 609/1198] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:42 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1365 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:42.697331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f9e65f69-54e2-4f57-80e7-50fffa0e7f68 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7df670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:42.803944 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f9e65f69-54e2-4f57-80e7-50fffa0e7f68 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.110823 Oct 18 13:20:42.804639 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 590/1199] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:42 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:43.212833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-487935a4-6e46-4c08-a96c-dd4057c034cf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:43.213567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-487935a4-6e46-4c08-a96c-dd4057c034cf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:43.229681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-487935a4-6e46-4c08-a96c-dd4057c034cf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:43.230179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-487935a4-6e46-4c08-a96c-dd4057c034cf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:43.230618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-487935a4-6e46-4c08-a96c-dd4057c034cf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:43.231343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-487935a4-6e46-4c08-a96c-dd4057c034cf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:43.239771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-487935a4-6e46-4c08-a96c-dd4057c034cf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:43.242633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-487935a4-6e46-4c08-a96c-dd4057c034cf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:43.567823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7957463b-a547-4c57-a19c-5f9ffb1e3518 req-02a4dd0e-945f-476f-8f1c-67feab784bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea85e7d-02ff-4fc3-bc01-720e7de9de87", "name": "network-vif-unplugged", "status": "completed", "tag": "d3e28fd2-a20a-403c-adde-3da5ff496840"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:43.604274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7957463b-a547-4c57-a19c-5f9ffb1e3518 req-02a4dd0e-945f-476f-8f1c-67feab784bdb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:43.605759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7957463b-a547-4c57-a19c-5f9ffb1e3518 req-02a4dd0e-945f-476f-8f1c-67feab784bdb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:43.606556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7957463b-a547-4c57-a19c-5f9ffb1e3518 req-02a4dd0e-945f-476f-8f1c-67feab784bdb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:43.640062 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7957463b-a547-4c57-a19c-5f9ffb1e3518 req-02a4dd0e-945f-476f-8f1c-67feab784bdb service nova] Creating event network-vif-unplugged:d3e28fd2-a20a-403c-adde-3da5ff496840 for instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 on n-h1-858384-13 Oct 18 13:20:43.665117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-7957463b-a547-4c57-a19c-5f9ffb1e3518 req-02a4dd0e-945f-476f-8f1c-67feab784bdb service nova] Instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:20:43.691599 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7957463b-a547-4c57-a19c-5f9ffb1e3518 req-02a4dd0e-945f-476f-8f1c-67feab784bdb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127784 Oct 18 13:20:43.693639 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 591/1200] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:43.702532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b4606f09-83b1-401a-af43-b46b5fed437d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:43.706540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b4606f09-83b1-401a-af43-b46b5fed437d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:43.714218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4606f09-83b1-401a-af43-b46b5fed437d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:43.715011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4606f09-83b1-401a-af43-b46b5fed437d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:43.715632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4606f09-83b1-401a-af43-b46b5fed437d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:43.717022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4606f09-83b1-401a-af43-b46b5fed437d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:43.717675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4606f09-83b1-401a-af43-b46b5fed437d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:43.718273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4606f09-83b1-401a-af43-b46b5fed437d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:44.236811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-487935a4-6e46-4c08-a96c-dd4057c034cf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:44.245732 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-487935a4-6e46-4c08-a96c-dd4057c034cf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1540 microversion: 2.1 time: 1.038902 Oct 18 13:20:44.249634 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 610/1201] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:43 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1540 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:44.265307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e5b5e596-6964-4846-8604-b9ed1208b618 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f88c5e0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:44.401437 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e5b5e596-6964-4846-8604-b9ed1208b618 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.150232 Oct 18 13:20:44.417659 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 611/1202] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:44 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:44.472102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b4606f09-83b1-401a-af43-b46b5fed437d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:44.484418 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b4606f09-83b1-401a-af43-b46b5fed437d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1365 microversion: 2.1 time: 0.787514 Oct 18 13:20:44.497287 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 592/1203] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:43 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1365 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:45.271962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-705ba215-caed-40a8-afcb-bfb620d121b4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:45.272876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-705ba215-caed-40a8-afcb-bfb620d121b4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:45.294058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-705ba215-caed-40a8-afcb-bfb620d121b4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:45.294716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-705ba215-caed-40a8-afcb-bfb620d121b4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:45.295264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-705ba215-caed-40a8-afcb-bfb620d121b4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:45.296364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-705ba215-caed-40a8-afcb-bfb620d121b4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:45.297681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-705ba215-caed-40a8-afcb-bfb620d121b4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:45.305503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-705ba215-caed-40a8-afcb-bfb620d121b4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:45.427702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4b267a0a-a6ba-47e3-af10-ff036d520a3c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f89a9d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:45.542847 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4b267a0a-a6ba-47e3-af10-ff036d520a3c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.119286 Oct 18 13:20:45.556640 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 593/1204] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:45 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:45.559168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-be26df89-298d-40f5-9b34-6048afff9e45 req-ba98d58f-aac9-4089-ae18-e95aa5b0cce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aad90b5-28fb-44b2-89da-33bc1b2889f2", "name": "network-vif-plugged", "status": "completed", "tag": "516c3ad3-1e31-4bde-b674-c0c367989f56"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:45.583111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-be26df89-298d-40f5-9b34-6048afff9e45 req-ba98d58f-aac9-4089-ae18-e95aa5b0cce7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:45.588980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-be26df89-298d-40f5-9b34-6048afff9e45 req-ba98d58f-aac9-4089-ae18-e95aa5b0cce7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:45.591537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-be26df89-298d-40f5-9b34-6048afff9e45 req-ba98d58f-aac9-4089-ae18-e95aa5b0cce7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:45.616654 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-be26df89-298d-40f5-9b34-6048afff9e45 req-ba98d58f-aac9-4089-ae18-e95aa5b0cce7 service nova] Creating event network-vif-plugged:516c3ad3-1e31-4bde-b674-c0c367989f56 for instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 on n-h1-858384-13 Oct 18 13:20:45.631923 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-be26df89-298d-40f5-9b34-6048afff9e45 req-ba98d58f-aac9-4089-ae18-e95aa5b0cce7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080876 Oct 18 13:20:45.632710 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 594/1205] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:45.648867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9f860d84-c68f-462f-815c-7af18a3d8a03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:45.649778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9f860d84-c68f-462f-815c-7af18a3d8a03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:45.656736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f860d84-c68f-462f-815c-7af18a3d8a03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:45.659839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f860d84-c68f-462f-815c-7af18a3d8a03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:45.659839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f860d84-c68f-462f-815c-7af18a3d8a03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:45.664328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f860d84-c68f-462f-815c-7af18a3d8a03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:45.664328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f860d84-c68f-462f-815c-7af18a3d8a03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:45.665412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f860d84-c68f-462f-815c-7af18a3d8a03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:45.857705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-705ba215-caed-40a8-afcb-bfb620d121b4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:45.870501 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-705ba215-caed-40a8-afcb-bfb620d121b4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1540 microversion: 2.1 time: 0.602914 Oct 18 13:20:45.871091 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 612/1206] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:45 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1540 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:45.886294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-430c7f75-f8c5-474f-97b9-786e74ce6662 req-4dec6d6e-8465-40f2-a0ae-494063d6ad44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea85e7d-02ff-4fc3-bc01-720e7de9de87", "tag": "d3e28fd2-a20a-403c-adde-3da5ff496840"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:45.920428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-430c7f75-f8c5-474f-97b9-786e74ce6662 req-4dec6d6e-8465-40f2-a0ae-494063d6ad44 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:45.926419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-430c7f75-f8c5-474f-97b9-786e74ce6662 req-4dec6d6e-8465-40f2-a0ae-494063d6ad44 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:45.927266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-430c7f75-f8c5-474f-97b9-786e74ce6662 req-4dec6d6e-8465-40f2-a0ae-494063d6ad44 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:45.951904 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-430c7f75-f8c5-474f-97b9-786e74ce6662 req-4dec6d6e-8465-40f2-a0ae-494063d6ad44 service nova] Creating event network-changed:d3e28fd2-a20a-403c-adde-3da5ff496840 for instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 on n-h1-858384-13 Oct 18 13:20:45.970957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [req-430c7f75-f8c5-474f-97b9-786e74ce6662 req-4dec6d6e-8465-40f2-a0ae-494063d6ad44 service nova] Instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:20:45.999093 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-430c7f75-f8c5-474f-97b9-786e74ce6662 req-4dec6d6e-8465-40f2-a0ae-494063d6ad44 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123603 Oct 18 13:20:46.003466 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 613/1207] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:46.565960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e74e0532-4f61-460e-921c-f690759f0dfb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f8173a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:46.650272 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e74e0532-4f61-460e-921c-f690759f0dfb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.089018 Oct 18 13:20:46.650867 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 614/1208] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:46 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:46.752282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9f860d84-c68f-462f-815c-7af18a3d8a03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:46.771729 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9f860d84-c68f-462f-815c-7af18a3d8a03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1365 microversion: 2.1 time: 1.137578 Oct 18 13:20:46.786482 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 595/1209] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:45 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1365 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:46.904055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4511aea8-580a-4e89-bbcb-818c4060bdad tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:46.904815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4511aea8-580a-4e89-bbcb-818c4060bdad tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:46.922537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4511aea8-580a-4e89-bbcb-818c4060bdad tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:46.923099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4511aea8-580a-4e89-bbcb-818c4060bdad tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:46.923541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4511aea8-580a-4e89-bbcb-818c4060bdad tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:46.924264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4511aea8-580a-4e89-bbcb-818c4060bdad tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:46.924721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4511aea8-580a-4e89-bbcb-818c4060bdad tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:46.925140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4511aea8-580a-4e89-bbcb-818c4060bdad tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:47.645731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4511aea8-580a-4e89-bbcb-818c4060bdad tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:47.654412 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4511aea8-580a-4e89-bbcb-818c4060bdad tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1540 microversion: 2.1 time: 0.759840 Oct 18 13:20:47.655007 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 615/1210] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:46 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1540 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:47.681538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-89714a0c-16f7-48d4-9ba7-702d55d2415a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f89a9d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:47.751486 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-89714a0c-16f7-48d4-9ba7-702d55d2415a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.088323 Oct 18 13:20:47.752088 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 596/1211] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:47 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:47.800103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ae83f021-b7e8-413d-b6e3-30f6f2968e4e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:47.801050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ae83f021-b7e8-413d-b6e3-30f6f2968e4e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:47.818264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae83f021-b7e8-413d-b6e3-30f6f2968e4e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:47.826475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae83f021-b7e8-413d-b6e3-30f6f2968e4e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:47.830140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae83f021-b7e8-413d-b6e3-30f6f2968e4e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:47.831169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae83f021-b7e8-413d-b6e3-30f6f2968e4e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:47.834400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae83f021-b7e8-413d-b6e3-30f6f2968e4e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:47.837627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae83f021-b7e8-413d-b6e3-30f6f2968e4e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:48.570957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ae83f021-b7e8-413d-b6e3-30f6f2968e4e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:48.582024 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ae83f021-b7e8-413d-b6e3-30f6f2968e4e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1365 microversion: 2.1 time: 0.787641 Oct 18 13:20:48.591208 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 616/1212] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:47 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1365 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:48.682969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bb332860-9339-4943-98fd-647508ce2127 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:48.684333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bb332860-9339-4943-98fd-647508ce2127 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:48.697279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb332860-9339-4943-98fd-647508ce2127 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:48.705923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb332860-9339-4943-98fd-647508ce2127 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:48.706584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb332860-9339-4943-98fd-647508ce2127 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:48.707521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb332860-9339-4943-98fd-647508ce2127 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:48.708148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb332860-9339-4943-98fd-647508ce2127 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:48.708741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb332860-9339-4943-98fd-647508ce2127 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:48.771093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-33cbf9ba-f71f-49a7-adc9-c18c6fe8f5c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f829af0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:48.881832 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-33cbf9ba-f71f-49a7-adc9-c18c6fe8f5c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.113708 Oct 18 13:20:48.883297 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 617/1213] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:48 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:49.190732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bb332860-9339-4943-98fd-647508ce2127 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:49.200954 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bb332860-9339-4943-98fd-647508ce2127 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1472 microversion: 2.1 time: 0.522958 Oct 18 13:20:49.205658 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 597/1214] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:48 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1472 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:49.640472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-67792314-69ac-4576-92dc-2b60f4803bd5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:49.641924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-67792314-69ac-4576-92dc-2b60f4803bd5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:49.652744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67792314-69ac-4576-92dc-2b60f4803bd5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:49.653686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67792314-69ac-4576-92dc-2b60f4803bd5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:49.654292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67792314-69ac-4576-92dc-2b60f4803bd5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:49.655375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67792314-69ac-4576-92dc-2b60f4803bd5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:49.656326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67792314-69ac-4576-92dc-2b60f4803bd5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:49.657045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67792314-69ac-4576-92dc-2b60f4803bd5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:49.903622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed6b4abb-2b64-441c-b5ae-74fdd7b7a2b3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f79f820>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:50.106808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-67792314-69ac-4576-92dc-2b60f4803bd5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:50.109576 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ed6b4abb-2b64-441c-b5ae-74fdd7b7a2b3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.208688 Oct 18 13:20:50.119306 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 598/1215] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:49 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:50.121561 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-67792314-69ac-4576-92dc-2b60f4803bd5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1365 microversion: 2.1 time: 0.505497 Oct 18 13:20:50.122188 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 618/1216] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:49 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1365 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:50.236261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f82b868d-1738-4d29-b380-0c78e58f35a8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:50.236979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f82b868d-1738-4d29-b380-0c78e58f35a8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:50.248381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f82b868d-1738-4d29-b380-0c78e58f35a8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:50.252943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f82b868d-1738-4d29-b380-0c78e58f35a8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:50.253737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f82b868d-1738-4d29-b380-0c78e58f35a8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:50.256910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f82b868d-1738-4d29-b380-0c78e58f35a8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:50.257718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f82b868d-1738-4d29-b380-0c78e58f35a8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:50.258380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f82b868d-1738-4d29-b380-0c78e58f35a8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:51.134408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6906c121-797a-4aec-8891-b225cfd521ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f8299d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:51.226719 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6906c121-797a-4aec-8891-b225cfd521ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.096370 Oct 18 13:20:51.228877 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 619/1217] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:51 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:51.235441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-27f5fd6d-0277-460a-8676-38e2e1848436 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:51.236332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-27f5fd6d-0277-460a-8676-38e2e1848436 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:51.244582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27f5fd6d-0277-460a-8676-38e2e1848436 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:51.245476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27f5fd6d-0277-460a-8676-38e2e1848436 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:51.246095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27f5fd6d-0277-460a-8676-38e2e1848436 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:51.247016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27f5fd6d-0277-460a-8676-38e2e1848436 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:51.247699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27f5fd6d-0277-460a-8676-38e2e1848436 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:51.248293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27f5fd6d-0277-460a-8676-38e2e1848436 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:51.725955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f82b868d-1738-4d29-b380-0c78e58f35a8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:51.751276 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f82b868d-1738-4d29-b380-0c78e58f35a8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1472 microversion: 2.1 time: 1.522089 Oct 18 13:20:51.766404 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 599/1218] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:50 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1472 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:52.247914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3c5eeefa-81ab-474d-86e5-ca7f467969dc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7b9670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:52.324680 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3c5eeefa-81ab-474d-86e5-ca7f467969dc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.080951 Oct 18 13:20:52.325293 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 600/1219] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:52 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:52.777484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bce29949-9173-4219-ae46-53a1b1b845cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:52.778157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bce29949-9173-4219-ae46-53a1b1b845cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:52.790886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bce29949-9173-4219-ae46-53a1b1b845cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:52.797383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bce29949-9173-4219-ae46-53a1b1b845cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:52.798426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bce29949-9173-4219-ae46-53a1b1b845cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:52.799429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bce29949-9173-4219-ae46-53a1b1b845cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:52.800062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bce29949-9173-4219-ae46-53a1b1b845cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:52.800674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bce29949-9173-4219-ae46-53a1b1b845cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:52.846952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-27f5fd6d-0277-460a-8676-38e2e1848436 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:52.880168 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-27f5fd6d-0277-460a-8676-38e2e1848436 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1551 microversion: 2.1 time: 1.633555 Oct 18 13:20:52.880168 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 620/1220] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:51 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1551 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:52.904928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-78b26dd3-2483-4f4a-809c-ba5c71c1bc2f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:52.909338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-78b26dd3-2483-4f4a-809c-ba5c71c1bc2f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:52.924112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78b26dd3-2483-4f4a-809c-ba5c71c1bc2f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:52.924891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78b26dd3-2483-4f4a-809c-ba5c71c1bc2f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:52.925560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78b26dd3-2483-4f4a-809c-ba5c71c1bc2f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:52.926470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78b26dd3-2483-4f4a-809c-ba5c71c1bc2f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:52.927888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78b26dd3-2483-4f4a-809c-ba5c71c1bc2f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:52.928524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78b26dd3-2483-4f4a-809c-ba5c71c1bc2f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:53.246721 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-78b26dd3-2483-4f4a-809c-ba5c71c1bc2f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.359311 Oct 18 13:20:53.247887 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 621/1221] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:20:52 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/os-interface => generated 284 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:53.345523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-29e938c1-ef96-44b8-a0df-595e4974fab6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f8c2820>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:53.417163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bce29949-9173-4219-ae46-53a1b1b845cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:53.419160 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-29e938c1-ef96-44b8-a0df-595e4974fab6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.079167 Oct 18 13:20:53.426710 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 622/1222] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:53 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:53.428308 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bce29949-9173-4219-ae46-53a1b1b845cb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1469 microversion: 2.1 time: 0.655524 Oct 18 13:20:53.440854 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 601/1223] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:52 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1469 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:53.478411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:53.480769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:53.537870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:53.543808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:53.545952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:53.552726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:53.556352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:53.557067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:53.667748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:53.668242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:53.676912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:53.680192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:53.680766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:53.681238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:53.784893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Getting quotas for project 3f136eea39d84b04b5410eb0906c113e. Resources: {'ram', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:20:53.803861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Getting quotas for user e631235f0d0c400981c97d9edb1ea7fe and project 3f136eea39d84b04b5410eb0906c113e. Resources: {'ram', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:20:54.043406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:54.083065 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-41abfae8-c36c-434f-aeda-8679dfd76f0a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "POST /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87/action" status: 202 len: 0 microversion: 2.1 time: 0.616669 Oct 18 13:20:54.091004 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 623/1224] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:20:53 2022] POST /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:20:54.101973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e5934258-cc42-4101-bfd8-23db5b10b232 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:54.105973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e5934258-cc42-4101-bfd8-23db5b10b232 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:54.124018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5934258-cc42-4101-bfd8-23db5b10b232 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:54.131702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5934258-cc42-4101-bfd8-23db5b10b232 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:54.132509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5934258-cc42-4101-bfd8-23db5b10b232 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:54.134668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5934258-cc42-4101-bfd8-23db5b10b232 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:54.137629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5934258-cc42-4101-bfd8-23db5b10b232 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:54.138557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5934258-cc42-4101-bfd8-23db5b10b232 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:54.237493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ac6be28d-3ae7-4511-9bd1-301513cb76d3 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Action: 'create', calling method: .version_select at 0x7ff60f817310>, body: {"keypair": {"name": "tempest-keypair-872407589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC7FxQ3NOFtrjQBTgXwfqRPVsQ2jG+aER7ELOQumxNGnc9w0iWo3OVHw7RdRopf1UebD/5NLBEYAjtCQlm+YWCPLRNXa1kb+n74lnci3gCaQ8D6bJbalo9fgdrPMI+CEQ=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:54.285830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ac6be28d-3ae7-4511-9bd1-301513cb76d3 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Getting quotas for project 76780439ae344b2998c1312a36ca9046. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:20:54.304226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ac6be28d-3ae7-4511-9bd1-301513cb76d3 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Getting quotas for user cacdec453dad4705a904f057930aa7af and project 76780439ae344b2998c1312a36ca9046. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:20:54.374706 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ac6be28d-3ae7-4511-9bd1-301513cb76d3 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.616220 Oct 18 13:20:54.375494 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 602/1225] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:20:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:20:54.441466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8f27aae4-12fb-4a10-b90d-2781ecd72c35 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7a2a60>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:54.545321 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8f27aae4-12fb-4a10-b90d-2781ecd72c35 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.107708 Oct 18 13:20:54.548405 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 603/1226] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:54 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:55.627228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5be31501-1a51-4a96-971c-71cfa518d906 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f79f8b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:55.818981 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5be31501-1a51-4a96-971c-71cfa518d906 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.259839 Oct 18 13:20:55.820047 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 604/1227] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:55 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:56.194657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e5934258-cc42-4101-bfd8-23db5b10b232 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:56.219602 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e5934258-cc42-4101-bfd8-23db5b10b232 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1468 microversion: 2.1 time: 2.124213 Oct 18 13:20:56.220203 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 624/1228] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:54 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1468 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:56.836808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-712210b8-7665-42d2-ac43-d38713c940c3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7df670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:56.920240 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-712210b8-7665-42d2-ac43-d38713c940c3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.088836 Oct 18 13:20:56.920916 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 605/1229] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:56 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:57.243927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-022fbc90-f6e6-45b1-be73-0e0966457cc0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:57.244594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-022fbc90-f6e6-45b1-be73-0e0966457cc0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:57.258632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-022fbc90-f6e6-45b1-be73-0e0966457cc0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:57.259222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-022fbc90-f6e6-45b1-be73-0e0966457cc0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:57.259654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-022fbc90-f6e6-45b1-be73-0e0966457cc0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:57.260373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-022fbc90-f6e6-45b1-be73-0e0966457cc0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:57.263645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-022fbc90-f6e6-45b1-be73-0e0966457cc0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:57.264431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-022fbc90-f6e6-45b1-be73-0e0966457cc0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:57.938775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-21e9c246-b1eb-4a96-8a93-dabdc0224844 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f789c10>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:58.078043 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-21e9c246-b1eb-4a96-8a93-dabdc0224844 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.143814 Oct 18 13:20:58.078846 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 606/1230] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:57 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:20:58.326710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-075bb14f-cd11-4c4b-a67d-3c23bbdccdb8 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:58.328234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-075bb14f-cd11-4c4b-a67d-3c23bbdccdb8 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:20:58.332219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:58.348758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-075bb14f-cd11-4c4b-a67d-3c23bbdccdb8 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:58.350871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-075bb14f-cd11-4c4b-a67d-3c23bbdccdb8 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:58.355035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-075bb14f-cd11-4c4b-a67d-3c23bbdccdb8 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:58.357439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-075bb14f-cd11-4c4b-a67d-3c23bbdccdb8 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:58.360459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-075bb14f-cd11-4c4b-a67d-3c23bbdccdb8 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:58.360923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-075bb14f-cd11-4c4b-a67d-3c23bbdccdb8 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:58.857433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-075bb14f-cd11-4c4b-a67d-3c23bbdccdb8 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid 925c4106-eafb-486f-8846-ff04eea11eb3 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:20:58.899604 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-075bb14f-cd11-4c4b-a67d-3c23bbdccdb8 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 2345 microversion: 2.25 time: 0.578341 Oct 18 13:20:58.933526 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 607/1231] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:20:58 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 2345 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:20:58.944559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-354027131", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "62cfd658-0476-49f3-90c5-47acfa5143fa"}], "security_groups": [{"name": "tempest-securitygroup--1387750522"}], "key_name": "tempest-keypair-872407589", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:59.250712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] validate_networks() for [('62cfd658-0476-49f3-90c5-47acfa5143fa', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:20:59.298635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-022fbc90-f6e6-45b1-be73-0e0966457cc0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:20:59.346280 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-022fbc90-f6e6-45b1-be73-0e0966457cc0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1468 microversion: 2.1 time: 2.106200 Oct 18 13:20:59.361417 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 625/1232] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:20:57 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1468 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:59.372353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-308c900a-c7f3-4e0c-9805-42d33842068d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:59.379140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-308c900a-c7f3-4e0c-9805-42d33842068d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:59.380202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-308c900a-c7f3-4e0c-9805-42d33842068d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:59.380891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-308c900a-c7f3-4e0c-9805-42d33842068d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:59.382798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-308c900a-c7f3-4e0c-9805-42d33842068d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:59.383471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-308c900a-c7f3-4e0c-9805-42d33842068d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:59.384115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-308c900a-c7f3-4e0c-9805-42d33842068d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:59.405223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:20:59.427380 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-308c900a-c7f3-4e0c-9805-42d33842068d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.064433 Oct 18 13:20:59.430478 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 626/1233] 10.222.0.40 () {60 vars in 1217 bytes} [Tue Oct 18 13:20:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:20:59.436266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d9eed0f6-c490-4bd0-8dbe-edc4c206799e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f872af0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:20:59.558718 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d9eed0f6-c490-4bd0-8dbe-edc4c206799e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.126132 Oct 18 13:20:59.563469 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 627/1234] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:20:59 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:20:59.846489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-652d67e2-111b-4f0c-83b4-872538abc14e req-6737369f-8f8f-4369-be3b-f1895b31b584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aad90b5-28fb-44b2-89da-33bc1b2889f2", "tag": "516c3ad3-1e31-4bde-b674-c0c367989f56"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:20:59.893018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-652d67e2-111b-4f0c-83b4-872538abc14e req-6737369f-8f8f-4369-be3b-f1895b31b584 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:20:59.894008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-652d67e2-111b-4f0c-83b4-872538abc14e req-6737369f-8f8f-4369-be3b-f1895b31b584 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:20:59.894707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-652d67e2-111b-4f0c-83b4-872538abc14e req-6737369f-8f8f-4369-be3b-f1895b31b584 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:20:59.947837 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-652d67e2-111b-4f0c-83b4-872538abc14e req-6737369f-8f8f-4369-be3b-f1895b31b584 service nova] Creating event network-changed:516c3ad3-1e31-4bde-b674-c0c367989f56 for instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 on n-h1-858384-13 Oct 18 13:20:59.963013 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-652d67e2-111b-4f0c-83b4-872538abc14e req-6737369f-8f8f-4369-be3b-f1895b31b584 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123728 Oct 18 13:20:59.964583 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 628/1235] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:21:00.382698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b32a432e-2283-404c-8d52-1c9c46841dd5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:00.383629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b32a432e-2283-404c-8d52-1c9c46841dd5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:00.400897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b32a432e-2283-404c-8d52-1c9c46841dd5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:00.401727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b32a432e-2283-404c-8d52-1c9c46841dd5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:00.402422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b32a432e-2283-404c-8d52-1c9c46841dd5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:00.403663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b32a432e-2283-404c-8d52-1c9c46841dd5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:00.404444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b32a432e-2283-404c-8d52-1c9c46841dd5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:00.411007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b32a432e-2283-404c-8d52-1c9c46841dd5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:00.853456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b32a432e-2283-404c-8d52-1c9c46841dd5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:00.878644 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b32a432e-2283-404c-8d52-1c9c46841dd5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1534 microversion: 2.1 time: 0.502798 Oct 18 13:21:00.881392 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 629/1236] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:00 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1534 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:01.037547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1313013310", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "955c68c9-f0d3-40dc-b2d8-bfb2a09e53c8"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:01.216938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] validate_networks() for [('955c68c9-f0d3-40dc-b2d8-bfb2a09e53c8', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:21:02.366668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Getting quotas for project 76780439ae344b2998c1312a36ca9046. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:21:02.409582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Getting quotas for user cacdec453dad4705a904f057930aa7af and project 76780439ae344b2998c1312a36ca9046. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:21:02.458709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:21:02.461605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:21:02.462453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:21:02.463729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:21:02.464547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:21:02.517707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:02.518740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:02.519433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:02.522220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:02.522972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:02.525121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:02.635431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Getting quotas for project 76780439ae344b2998c1312a36ca9046. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:21:02.676549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Getting quotas for user cacdec453dad4705a904f057930aa7af and project 76780439ae344b2998c1312a36ca9046. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:21:02.749464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:21:02.759668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:21:02.851128 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b0caebdd-083f-44f1-b272-a8e36aa7d779 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.916159 Oct 18 13:21:02.855546 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 608/1237] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:20:58 2022] POST /compute/v2.1/servers => generated 407 bytes in 3921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:21:02.870187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-807a35fc-3241-4503-b510-413be1d6d09c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7a2670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:02.876420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:21:02.877150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:21:02.877750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:21:02.878126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:21:02.878741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:21:02.920561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:02.928595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:02.929060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:02.929908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:02.930377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:02.930808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:02.974625 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-807a35fc-3241-4503-b510-413be1d6d09c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.110620 Oct 18 13:21:02.975333 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 609/1238] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:21:02 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:02.982691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2137d5f8-5246-4abf-adf9-800c990a1e7e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:02.983857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2137d5f8-5246-4abf-adf9-800c990a1e7e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:02.991533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2137d5f8-5246-4abf-adf9-800c990a1e7e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:02.992288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2137d5f8-5246-4abf-adf9-800c990a1e7e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:02.992485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2137d5f8-5246-4abf-adf9-800c990a1e7e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:02.993274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2137d5f8-5246-4abf-adf9-800c990a1e7e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:02.993745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2137d5f8-5246-4abf-adf9-800c990a1e7e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:02.994176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2137d5f8-5246-4abf-adf9-800c990a1e7e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:03.050438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Getting quotas for project 754e6b0adc07474caa392caa39c0e963. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:21:03.072640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Getting quotas for user 0eeec944a5054ba9b7cd6ae3055230e7 and project 754e6b0adc07474caa392caa39c0e963. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:21:03.123038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:21:03.138915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:21:03.338477 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4bd32e88-d451-40c1-97da-3b4dd935890e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.453638 Oct 18 13:21:03.344042 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 630/1239] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:21:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:21:03.371381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8cd3dbda-7e2c-4d36-8bb5-206e6cc052f6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:03.371911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8cd3dbda-7e2c-4d36-8bb5-206e6cc052f6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:03.651670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8cd3dbda-7e2c-4d36-8bb5-206e6cc052f6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:03.671841 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8cd3dbda-7e2c-4d36-8bb5-206e6cc052f6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1268 microversion: 2.1 time: 0.326094 Oct 18 13:21:03.688374 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 631/1240] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:03 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1268 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:03.703509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c87dd9a2-e53a-4c61-87ed-2e5a4795bba9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:03.704223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c87dd9a2-e53a-4c61-87ed-2e5a4795bba9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:03.946297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c87dd9a2-e53a-4c61-87ed-2e5a4795bba9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:04.010820 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c87dd9a2-e53a-4c61-87ed-2e5a4795bba9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1225 microversion: 2.1 time: 0.321092 Oct 18 13:21:04.016007 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 632/1241] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:03 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1225 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:04.039432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ad8a4cbd-5089-47a6-885f-bf67693c9978 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f829c10>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:05.250138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2137d5f8-5246-4abf-adf9-800c990a1e7e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:05.259137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:05.334173 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2137d5f8-5246-4abf-adf9-800c990a1e7e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1534 microversion: 2.1 time: 2.330896 Oct 18 13:21:05.341877 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 610/1242] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:02 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1534 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:05.356416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8b31d0e4-20df-4bdc-a1e9-e2b1651e2abc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:05.374419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8b31d0e4-20df-4bdc-a1e9-e2b1651e2abc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:05.398180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b31d0e4-20df-4bdc-a1e9-e2b1651e2abc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:05.400909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b31d0e4-20df-4bdc-a1e9-e2b1651e2abc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:05.404068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b31d0e4-20df-4bdc-a1e9-e2b1651e2abc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:05.408967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b31d0e4-20df-4bdc-a1e9-e2b1651e2abc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:05.412009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b31d0e4-20df-4bdc-a1e9-e2b1651e2abc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:05.414512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b31d0e4-20df-4bdc-a1e9-e2b1651e2abc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:05.762318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8b31d0e4-20df-4bdc-a1e9-e2b1651e2abc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:05.784735 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8b31d0e4-20df-4bdc-a1e9-e2b1651e2abc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1264 microversion: 2.1 time: 0.434682 Oct 18 13:21:05.800598 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 611/1243] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:05 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1264 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:05.826221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-388d345b-f1ba-4dba-8e15-87b6c6cedf69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:05.829245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-388d345b-f1ba-4dba-8e15-87b6c6cedf69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:05.844059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-388d345b-f1ba-4dba-8e15-87b6c6cedf69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:05.844840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-388d345b-f1ba-4dba-8e15-87b6c6cedf69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:05.845524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-388d345b-f1ba-4dba-8e15-87b6c6cedf69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:05.847931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-388d345b-f1ba-4dba-8e15-87b6c6cedf69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:05.849938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-388d345b-f1ba-4dba-8e15-87b6c6cedf69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:05.851243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-388d345b-f1ba-4dba-8e15-87b6c6cedf69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:05.921942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-388d345b-f1ba-4dba-8e15-87b6c6cedf69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:21:06.227747 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-388d345b-f1ba-4dba-8e15-87b6c6cedf69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "DELETE /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 204 len: 0 microversion: 2.1 time: 0.421991 Oct 18 13:21:06.230692 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 612/1244] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:21:05 2022] DELETE /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:21:06.259585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e087a6c8-1c79-4185-bc5d-5a071fb342ff tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:06.260283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e087a6c8-1c79-4185-bc5d-5a071fb342ff tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:06.291048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e087a6c8-1c79-4185-bc5d-5a071fb342ff tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:06.300589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e087a6c8-1c79-4185-bc5d-5a071fb342ff tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:06.301874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e087a6c8-1c79-4185-bc5d-5a071fb342ff tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:06.304159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e087a6c8-1c79-4185-bc5d-5a071fb342ff tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:06.309491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e087a6c8-1c79-4185-bc5d-5a071fb342ff tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:06.310035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e087a6c8-1c79-4185-bc5d-5a071fb342ff tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:06.611420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e087a6c8-1c79-4185-bc5d-5a071fb342ff tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:06.621597 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e087a6c8-1c79-4185-bc5d-5a071fb342ff tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1221 microversion: 2.1 time: 0.386546 Oct 18 13:21:06.645727 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 613/1245] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:06 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1221 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:06.656743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-13ad7b11-4e9c-41f2-a0b9-d80f8029b234 req-0748c370-6e5f-49f6-8a79-e1bd98715760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea85e7d-02ff-4fc3-bc01-720e7de9de87", "tag": "d3e28fd2-a20a-403c-adde-3da5ff496840"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:06.683958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-13ad7b11-4e9c-41f2-a0b9-d80f8029b234 req-0748c370-6e5f-49f6-8a79-e1bd98715760 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:06.688279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-13ad7b11-4e9c-41f2-a0b9-d80f8029b234 req-0748c370-6e5f-49f6-8a79-e1bd98715760 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:06.691438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-13ad7b11-4e9c-41f2-a0b9-d80f8029b234 req-0748c370-6e5f-49f6-8a79-e1bd98715760 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:06.734850 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-13ad7b11-4e9c-41f2-a0b9-d80f8029b234 req-0748c370-6e5f-49f6-8a79-e1bd98715760 service nova] Creating event network-changed:d3e28fd2-a20a-403c-adde-3da5ff496840 for instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 on n-h2-858384-13 Oct 18 13:21:06.748409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-13ad7b11-4e9c-41f2-a0b9-d80f8029b234 req-0748c370-6e5f-49f6-8a79-e1bd98715760 service nova] Instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:21:06.785540 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-13ad7b11-4e9c-41f2-a0b9-d80f8029b234 req-0748c370-6e5f-49f6-8a79-e1bd98715760 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133785 Oct 18 13:21:06.786768 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 614/1246] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:06.794948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-74894fa4-1e8b-40c6-8747-b97b8612e7cb tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cd00d5b-96e3-4bc0-a425-e92cd20c499b", "device": "/dev/xvdb"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:06.799407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-74894fa4-1e8b-40c6-8747-b97b8612e7cb tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:06.807216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74894fa4-1e8b-40c6-8747-b97b8612e7cb tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:06.808284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74894fa4-1e8b-40c6-8747-b97b8612e7cb tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:06.808896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74894fa4-1e8b-40c6-8747-b97b8612e7cb tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:06.809877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74894fa4-1e8b-40c6-8747-b97b8612e7cb tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:06.810615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74894fa4-1e8b-40c6-8747-b97b8612e7cb tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:06.811352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74894fa4-1e8b-40c6-8747-b97b8612e7cb tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:07.812594 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-74894fa4-1e8b-40c6-8747-b97b8612e7cb tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "POST /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.018136 Oct 18 13:21:07.825015 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 615/1247] 10.222.0.40 () {62 vars in 1364 bytes} [Tue Oct 18 13:21:06 2022] POST /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments => generated 194 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:21:07.863602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c2c58ab7-d9f1-432a-aef2-849a6edd2e69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:07.868966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c2c58ab7-d9f1-432a-aef2-849a6edd2e69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:07.950629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2c58ab7-d9f1-432a-aef2-849a6edd2e69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:07.952456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2c58ab7-d9f1-432a-aef2-849a6edd2e69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:07.953525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2c58ab7-d9f1-432a-aef2-849a6edd2e69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:07.958477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2c58ab7-d9f1-432a-aef2-849a6edd2e69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:07.960934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2c58ab7-d9f1-432a-aef2-849a6edd2e69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:07.961675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2c58ab7-d9f1-432a-aef2-849a6edd2e69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:10.127879 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ad8a4cbd-5089-47a6-885f-bf67693c9978 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 6.110190 Oct 18 13:21:10.137231 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 633/1248] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:21:04 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 6120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:10.162297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-85a0a302-e236-4cf9-b639-de7e2b0b8a2d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:10.166089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-85a0a302-e236-4cf9-b639-de7e2b0b8a2d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:10.198519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85a0a302-e236-4cf9-b639-de7e2b0b8a2d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:10.199418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85a0a302-e236-4cf9-b639-de7e2b0b8a2d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:10.200082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85a0a302-e236-4cf9-b639-de7e2b0b8a2d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:10.208965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85a0a302-e236-4cf9-b639-de7e2b0b8a2d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:10.209892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85a0a302-e236-4cf9-b639-de7e2b0b8a2d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:10.210683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85a0a302-e236-4cf9-b639-de7e2b0b8a2d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:11.214200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-85a0a302-e236-4cf9-b639-de7e2b0b8a2d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:11.223336 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-85a0a302-e236-4cf9-b639-de7e2b0b8a2d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1534 microversion: 2.1 time: 1.080858 Oct 18 13:21:11.234865 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 634/1249] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:10 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1534 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:11.241504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7977d4be-22b2-41e5-bba0-e642c3a57682 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:11.247751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7977d4be-22b2-41e5-bba0-e642c3a57682 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:11.277519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7977d4be-22b2-41e5-bba0-e642c3a57682 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:11.285486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7977d4be-22b2-41e5-bba0-e642c3a57682 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:11.286331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7977d4be-22b2-41e5-bba0-e642c3a57682 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:11.287329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7977d4be-22b2-41e5-bba0-e642c3a57682 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:11.288064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7977d4be-22b2-41e5-bba0-e642c3a57682 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:11.288751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7977d4be-22b2-41e5-bba0-e642c3a57682 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:11.934520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7977d4be-22b2-41e5-bba0-e642c3a57682 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:11.956432 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7977d4be-22b2-41e5-bba0-e642c3a57682 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1326 microversion: 2.1 time: 0.718554 Oct 18 13:21:11.957154 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 635/1250] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:11 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1326 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:11.968939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-70ebe6bb-ea20-487f-80cf-e5d873d5108b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:11.979059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-70ebe6bb-ea20-487f-80cf-e5d873d5108b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:11.996659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70ebe6bb-ea20-487f-80cf-e5d873d5108b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:12.002204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70ebe6bb-ea20-487f-80cf-e5d873d5108b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:12.005598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70ebe6bb-ea20-487f-80cf-e5d873d5108b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:12.008718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70ebe6bb-ea20-487f-80cf-e5d873d5108b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:12.009501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70ebe6bb-ea20-487f-80cf-e5d873d5108b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:12.010188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70ebe6bb-ea20-487f-80cf-e5d873d5108b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:12.356026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-70ebe6bb-ea20-487f-80cf-e5d873d5108b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:12.374989 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-70ebe6bb-ea20-487f-80cf-e5d873d5108b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1283 microversion: 2.1 time: 0.413121 Oct 18 13:21:12.393690 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 636/1251] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:11 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1283 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:12.424596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-042cb952-b488-408b-a01f-d0f7b085775a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7f6550>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:12.527982 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-042cb952-b488-408b-a01f-d0f7b085775a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.132272 Oct 18 13:21:12.536754 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 637/1252] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:21:12 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:12.560447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8934766d-6dd4-4486-88a1-400c97bc138a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:12.560447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8934766d-6dd4-4486-88a1-400c97bc138a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:12.568631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:12.575895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8934766d-6dd4-4486-88a1-400c97bc138a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:12.578984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8934766d-6dd4-4486-88a1-400c97bc138a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:12.589827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8934766d-6dd4-4486-88a1-400c97bc138a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:12.590765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8934766d-6dd4-4486-88a1-400c97bc138a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:12.591597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8934766d-6dd4-4486-88a1-400c97bc138a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:12.593735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8934766d-6dd4-4486-88a1-400c97bc138a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:12.723308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=14 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:13.007072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=7 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:13.186436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c2c58ab7-d9f1-432a-aef2-849a6edd2e69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:13.218449 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c2c58ab7-d9f1-432a-aef2-849a6edd2e69 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1713 microversion: 2.1 time: 5.388574 Oct 18 13:21:13.223142 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 616/1253] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:07 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1713 bytes in 5397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:13.235707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-73836e99-685e-480f-b65c-a3ba03789221 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:13.243255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-73836e99-685e-480f-b65c-a3ba03789221 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:13.283223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73836e99-685e-480f-b65c-a3ba03789221 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:13.284933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73836e99-685e-480f-b65c-a3ba03789221 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:13.288016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73836e99-685e-480f-b65c-a3ba03789221 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:13.294048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73836e99-685e-480f-b65c-a3ba03789221 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:13.298796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73836e99-685e-480f-b65c-a3ba03789221 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:13.303366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73836e99-685e-480f-b65c-a3ba03789221 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:13.607999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8934766d-6dd4-4486-88a1-400c97bc138a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:13.616780 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8934766d-6dd4-4486-88a1-400c97bc138a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1534 microversion: 2.1 time: 1.078649 Oct 18 13:21:13.629462 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 638/1254] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:12 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1534 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:13.636578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5d31d042-ba11-4e97-a1ed-e8f67f2de2ef tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:13.640674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5d31d042-ba11-4e97-a1ed-e8f67f2de2ef tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:13.676972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d31d042-ba11-4e97-a1ed-e8f67f2de2ef tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:13.677618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d31d042-ba11-4e97-a1ed-e8f67f2de2ef tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:13.678166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d31d042-ba11-4e97-a1ed-e8f67f2de2ef tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:13.679172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d31d042-ba11-4e97-a1ed-e8f67f2de2ef tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:13.679748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d31d042-ba11-4e97-a1ed-e8f67f2de2ef tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:13.680353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d31d042-ba11-4e97-a1ed-e8f67f2de2ef tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:13.993327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=10 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:14.315205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5d31d042-ba11-4e97-a1ed-e8f67f2de2ef tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:14.325037 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5d31d042-ba11-4e97-a1ed-e8f67f2de2ef tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1283 microversion: 2.1 time: 0.694061 Oct 18 13:21:14.343793 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 639/1255] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:13 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1283 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:14.349018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cd3acb19-25a7-410f-b646-970ec5278b37 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7f61f0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:14.506565 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cd3acb19-25a7-410f-b646-970ec5278b37 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.161295 Oct 18 13:21:14.526937 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 640/1256] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:21:14 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:14.526937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e84e48a7-85f1-4d28-89b5-a79c5a57f324 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:14.526937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e84e48a7-85f1-4d28-89b5-a79c5a57f324 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:14.604660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e84e48a7-85f1-4d28-89b5-a79c5a57f324 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:14.605190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e84e48a7-85f1-4d28-89b5-a79c5a57f324 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:14.611872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e84e48a7-85f1-4d28-89b5-a79c5a57f324 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:14.617484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e84e48a7-85f1-4d28-89b5-a79c5a57f324 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:14.628125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e84e48a7-85f1-4d28-89b5-a79c5a57f324 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:14.630281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e84e48a7-85f1-4d28-89b5-a79c5a57f324 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:14.942512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-73836e99-685e-480f-b65c-a3ba03789221 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:14.953171 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-73836e99-685e-480f-b65c-a3ba03789221 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1394 microversion: 2.1 time: 1.726791 Oct 18 13:21:14.985916 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 617/1257] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:13 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1394 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:15.037734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e7cf3444-db6e-40e5-a1b9-de0d33198dd6 req-86df310c-d17a-4b50-8d37-5768feae8632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14965255-1b8d-4094-84de-1e81599640fb", "name": "network-vif-deleted", "tag": "66f6f9e9-bc02-4b17-a7e1-a5fede1227a3"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:15.068807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e7cf3444-db6e-40e5-a1b9-de0d33198dd6 req-86df310c-d17a-4b50-8d37-5768feae8632 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:15.079148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e7cf3444-db6e-40e5-a1b9-de0d33198dd6 req-86df310c-d17a-4b50-8d37-5768feae8632 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:15.079860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e7cf3444-db6e-40e5-a1b9-de0d33198dd6 req-86df310c-d17a-4b50-8d37-5768feae8632 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:15.129083 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e7cf3444-db6e-40e5-a1b9-de0d33198dd6 req-86df310c-d17a-4b50-8d37-5768feae8632 service nova] Creating event network-vif-deleted:66f6f9e9-bc02-4b17-a7e1-a5fede1227a3 for instance 14965255-1b8d-4094-84de-1e81599640fb on n-h2-858384-13 Oct 18 13:21:15.145238 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e7cf3444-db6e-40e5-a1b9-de0d33198dd6 req-86df310c-d17a-4b50-8d37-5768feae8632 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156964 Oct 18 13:21:15.150634 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 618/1258] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:15.158450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-30859434-eff5-4c69-9c18-d3e44bd69f1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:15.162658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-30859434-eff5-4c69-9c18-d3e44bd69f1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:15.180106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30859434-eff5-4c69-9c18-d3e44bd69f1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:15.180902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30859434-eff5-4c69-9c18-d3e44bd69f1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:15.181538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30859434-eff5-4c69-9c18-d3e44bd69f1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:15.182450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30859434-eff5-4c69-9c18-d3e44bd69f1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:15.186698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30859434-eff5-4c69-9c18-d3e44bd69f1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:15.187430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30859434-eff5-4c69-9c18-d3e44bd69f1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:15.517502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-30859434-eff5-4c69-9c18-d3e44bd69f1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:15.525540 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-30859434-eff5-4c69-9c18-d3e44bd69f1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1534 microversion: 2.1 time: 0.373343 Oct 18 13:21:15.526134 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 619/1259] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:15 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1534 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:15.545547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b73e15b5-e87a-4f94-b9a1-0592f2d30740 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:15.570551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b73e15b5-e87a-4f94-b9a1-0592f2d30740 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:15.603087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b73e15b5-e87a-4f94-b9a1-0592f2d30740 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:15.603877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b73e15b5-e87a-4f94-b9a1-0592f2d30740 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:15.605716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b73e15b5-e87a-4f94-b9a1-0592f2d30740 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:15.606643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b73e15b5-e87a-4f94-b9a1-0592f2d30740 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:15.613887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b73e15b5-e87a-4f94-b9a1-0592f2d30740 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:15.614604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b73e15b5-e87a-4f94-b9a1-0592f2d30740 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:15.758580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b73e15b5-e87a-4f94-b9a1-0592f2d30740 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:15.774312 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b73e15b5-e87a-4f94-b9a1-0592f2d30740 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1283 microversion: 2.1 time: 0.247014 Oct 18 13:21:15.775542 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 620/1260] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:15 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1283 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:15.786258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cfc0171a-9ea4-4334-82a0-2977b0073c40 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f732e50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:15.910764 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cfc0171a-9ea4-4334-82a0-2977b0073c40 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.114419 Oct 18 13:21:15.919188 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 621/1261] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:21:15 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:16.010766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f1f4b106-5158-42d9-be27-ee9f75d3cefd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:16.011531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f1f4b106-5158-42d9-be27-ee9f75d3cefd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:16.022305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1f4b106-5158-42d9-be27-ee9f75d3cefd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:16.024494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1f4b106-5158-42d9-be27-ee9f75d3cefd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:16.025057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1f4b106-5158-42d9-be27-ee9f75d3cefd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:16.030484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1f4b106-5158-42d9-be27-ee9f75d3cefd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:16.031302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1f4b106-5158-42d9-be27-ee9f75d3cefd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:16.037304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1f4b106-5158-42d9-be27-ee9f75d3cefd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:16.525498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f1f4b106-5158-42d9-be27-ee9f75d3cefd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:16.545560 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f1f4b106-5158-42d9-be27-ee9f75d3cefd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1394 microversion: 2.1 time: 0.539216 Oct 18 13:21:16.550936 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 622/1262] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:16 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1394 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:16.581371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-29e995a7-4aa7-4c2f-bb0a-fbaccf345c6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:16.594934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-29e995a7-4aa7-4c2f-bb0a-fbaccf345c6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:16.658147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29e995a7-4aa7-4c2f-bb0a-fbaccf345c6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:16.661864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29e995a7-4aa7-4c2f-bb0a-fbaccf345c6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:16.662345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29e995a7-4aa7-4c2f-bb0a-fbaccf345c6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:16.663083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29e995a7-4aa7-4c2f-bb0a-fbaccf345c6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:16.663541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29e995a7-4aa7-4c2f-bb0a-fbaccf345c6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:16.663969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29e995a7-4aa7-4c2f-bb0a-fbaccf345c6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:17.651321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e84e48a7-85f1-4d28-89b5-a79c5a57f324 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a42f7285eab4c2cb58d06b302f8f185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef15948e13464e45ba93cb1c5922a872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:17.662973 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e84e48a7-85f1-4d28-89b5-a79c5a57f324 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 200 len: 1348 microversion: 2.1 time: 3.154741 Oct 18 13:21:17.663834 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 641/1263] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:14 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 1348 bytes in 3156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:17.697664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c5c1ce61-8dd3-474a-800b-2d65037e66e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:17.698405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c5c1ce61-8dd3-474a-800b-2d65037e66e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:17.726577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5c1ce61-8dd3-474a-800b-2d65037e66e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:17.730519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5c1ce61-8dd3-474a-800b-2d65037e66e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:17.734146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5c1ce61-8dd3-474a-800b-2d65037e66e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:17.738399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5c1ce61-8dd3-474a-800b-2d65037e66e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:17.747306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5c1ce61-8dd3-474a-800b-2d65037e66e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:17.748651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5c1ce61-8dd3-474a-800b-2d65037e66e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:18.258449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-29e995a7-4aa7-4c2f-bb0a-fbaccf345c6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:18.271902 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-29e995a7-4aa7-4c2f-bb0a-fbaccf345c6d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1534 microversion: 2.1 time: 1.709310 Oct 18 13:21:18.276783 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 623/1264] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:16 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1534 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:18.328424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-df88ac27-cf5e-43f5-9d04-9a8630ad02ba tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f77a430>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:18.484301 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-df88ac27-cf5e-43f5-9d04-9a8630ad02ba tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1409 microversion: 2.1 time: 0.206179 Oct 18 13:21:18.493522 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 624/1265] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:21:18 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1409 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:18.520639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-348bc43a-059e-4247-9752-fd5a525a58ee tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:18.524129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-348bc43a-059e-4247-9752-fd5a525a58ee tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:18.556487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-348bc43a-059e-4247-9752-fd5a525a58ee tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:18.558456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-348bc43a-059e-4247-9752-fd5a525a58ee tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:18.568342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-348bc43a-059e-4247-9752-fd5a525a58ee tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:18.571815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-348bc43a-059e-4247-9752-fd5a525a58ee tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:18.577147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-348bc43a-059e-4247-9752-fd5a525a58ee tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:18.593792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-348bc43a-059e-4247-9752-fd5a525a58ee tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:19.148945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-348bc43a-059e-4247-9752-fd5a525a58ee tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:19.166320 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-348bc43a-059e-4247-9752-fd5a525a58ee tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1394 microversion: 2.1 time: 0.668790 Oct 18 13:21:19.167190 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 625/1266] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:18 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1394 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:19.216441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4b5c8d9f-f692-4d45-8166-2413109ffd43 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:19.233844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4b5c8d9f-f692-4d45-8166-2413109ffd43 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:19.258191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c5c1ce61-8dd3-474a-800b-2d65037e66e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:19.264860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b5c8d9f-f692-4d45-8166-2413109ffd43 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:19.265490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b5c8d9f-f692-4d45-8166-2413109ffd43 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:19.265819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b5c8d9f-f692-4d45-8166-2413109ffd43 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:19.266533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b5c8d9f-f692-4d45-8166-2413109ffd43 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:19.268564 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c5c1ce61-8dd3-474a-800b-2d65037e66e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1325 microversion: 2.1 time: 1.593160 Oct 18 13:21:19.275681 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 642/1267] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:17 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1325 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:19.276942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b5c8d9f-f692-4d45-8166-2413109ffd43 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:19.276942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b5c8d9f-f692-4d45-8166-2413109ffd43 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:19.293958 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-4b5c8d9f-f692-4d45-8166-2413109ffd43 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] HTTP exception thrown: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:19.307615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b5599279-e399-410e-a8ad-e8451f0093f1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:19.308480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b5599279-e399-410e-a8ad-e8451f0093f1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4b5c8d9f-f692-4d45-8166-2413109ffd43 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Request method failure captured: Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb HTTP/1.1 Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdvU1koZzimq_OqhahVwIHHjz3OOGfBvUyvcbrY0FEq5EUPNx5X0M6YVkMt-IXhKfa-dEEFZkxHyEy84aZmQ2ZIt7hoGV8nBPLeM8Mnj1INOAtOEvfrWAlbM5qM5rlpik45nNf-xo_KwFb35x0n7B9O8MS2bRKY9ZHofMYNAFqDShE Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:21:19.309987 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:21:19.311721 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ef15948e13464e45ba93cb1c5922a872"}]}] Oct 18 13:21:19.311721 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:19.311721 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:19.311721 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:19.311721 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:19.311721 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:21:19.311721 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:21:19.311721 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 3a42f7285eab4c2cb58d06b302f8f185 Oct 18 13:21:19.311721 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:19.311721 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:21:19.311721 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:19.311721 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '14965255-1b8d-4094-84de-1e81599640fb'} Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:21:19.312616 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:19.313998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:19.316094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4b5c8d9f-f692-4d45-8166-2413109ffd43 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Returning 404 to user: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:21:19.317130 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4b5c8d9f-f692-4d45-8166-2413109ffd43 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 404 len: 111 microversion: 2.1 time: 0.121229 Oct 18 13:21:19.318400 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 626/1268] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:19 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:21:19.328094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5599279-e399-410e-a8ad-e8451f0093f1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:19.328792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5599279-e399-410e-a8ad-e8451f0093f1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:19.329530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5599279-e399-410e-a8ad-e8451f0093f1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:19.330413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5599279-e399-410e-a8ad-e8451f0093f1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:19.330982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5599279-e399-410e-a8ad-e8451f0093f1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:19.331542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5599279-e399-410e-a8ad-e8451f0093f1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:19.371875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3e1165fd-30eb-4c47-88eb-c25c542f7fff tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:19.372406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3e1165fd-30eb-4c47-88eb-c25c542f7fff tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:19.403925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e1165fd-30eb-4c47-88eb-c25c542f7fff tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:19.412167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e1165fd-30eb-4c47-88eb-c25c542f7fff tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:19.415646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e1165fd-30eb-4c47-88eb-c25c542f7fff tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:19.416466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e1165fd-30eb-4c47-88eb-c25c542f7fff tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:19.416946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e1165fd-30eb-4c47-88eb-c25c542f7fff tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:19.428771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e1165fd-30eb-4c47-88eb-c25c542f7fff tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:19.486777 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-3e1165fd-30eb-4c47-88eb-c25c542f7fff tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] HTTP exception thrown: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3e1165fd-30eb-4c47-88eb-c25c542f7fff tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Request method failure captured: Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a HTTP/1.1 Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdvU1koZzimq_OqhahVwIHHjz3OOGfBvUyvcbrY0FEq5EUPNx5X0M6YVkMt-IXhKfa-dEEFZkxHyEy84aZmQ2ZIt7hoGV8nBPLeM8Mnj1INOAtOEvfrWAlbM5qM5rlpik45nNf-xo_KwFb35x0n7B9O8MS2bRKY9ZHofMYNAFqDShE Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:21:19.488815 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:21:19.490571 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ef15948e13464e45ba93cb1c5922a872"}]}] Oct 18 13:21:19.490571 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:19.490571 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:19.490571 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:19.490571 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:19.490571 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:21:19.490571 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:21:19.490571 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 3a42f7285eab4c2cb58d06b302f8f185 Oct 18 13:21:19.490571 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:19.490571 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:21:19.490571 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:19.490571 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'bfe50041-e476-443d-b56f-db9953efda0a'} Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:21:19.491490 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:19.494113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:19.503454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3e1165fd-30eb-4c47-88eb-c25c542f7fff tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Returning 404 to user: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:21:19.507799 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3e1165fd-30eb-4c47-88eb-c25c542f7fff tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 404 len: 111 microversion: 2.1 time: 0.177586 Oct 18 13:21:19.509566 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 627/1269] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:21:19 2022] DELETE /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:21:19.521555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d5ffd172-f2e9-48bd-b122-5325ccb49590 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f727670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:19.980711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b5599279-e399-410e-a8ad-e8451f0093f1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:19.994331 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b5599279-e399-410e-a8ad-e8451f0093f1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1527 microversion: 2.1 time: 0.690387 Oct 18 13:21:19.995055 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 643/1270] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:19 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1527 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:20.013621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-02e8f03e-8d8b-4eb6-b5a5-4dedee5455a8 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:20.015635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-02e8f03e-8d8b-4eb6-b5a5-4dedee5455a8 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:20.038656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e8f03e-8d8b-4eb6-b5a5-4dedee5455a8 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:20.039305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e8f03e-8d8b-4eb6-b5a5-4dedee5455a8 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:20.039855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e8f03e-8d8b-4eb6-b5a5-4dedee5455a8 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:20.040677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e8f03e-8d8b-4eb6-b5a5-4dedee5455a8 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:20.043071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e8f03e-8d8b-4eb6-b5a5-4dedee5455a8 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:20.043711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e8f03e-8d8b-4eb6-b5a5-4dedee5455a8 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:20.113014 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-02e8f03e-8d8b-4eb6-b5a5-4dedee5455a8 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] HTTP exception thrown: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-02e8f03e-8d8b-4eb6-b5a5-4dedee5455a8 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Request method failure captured: Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a HTTP/1.1 Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdvU1koZzimq_OqhahVwIHHjz3OOGfBvUyvcbrY0FEq5EUPNx5X0M6YVkMt-IXhKfa-dEEFZkxHyEy84aZmQ2ZIt7hoGV8nBPLeM8Mnj1INOAtOEvfrWAlbM5qM5rlpik45nNf-xo_KwFb35x0n7B9O8MS2bRKY9ZHofMYNAFqDShE Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:21:20.135217 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:21:20.136941 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ef15948e13464e45ba93cb1c5922a872"}]}] Oct 18 13:21:20.136941 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:20.136941 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:20.136941 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:20.136941 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:20.136941 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:21:20.136941 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:21:20.136941 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3a42f7285eab4c2cb58d06b302f8f185 Oct 18 13:21:20.136941 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:20.136941 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:21:20.136941 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:20.136941 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'bfe50041-e476-443d-b56f-db9953efda0a'} Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:21:20.137954 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:20.139495 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:20.141019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-02e8f03e-8d8b-4eb6-b5a5-4dedee5455a8 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Returning 404 to user: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:21:20.141019 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-02e8f03e-8d8b-4eb6-b5a5-4dedee5455a8 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 404 len: 111 microversion: 2.1 time: 0.141703 Oct 18 13:21:20.141019 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 644/1271] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:19 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:21:20.149692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b5e36204-70d1-4f06-8c26-9801a3ab216a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:20.163312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b5e36204-70d1-4f06-8c26-9801a3ab216a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:20.179765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5e36204-70d1-4f06-8c26-9801a3ab216a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:20.180626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5e36204-70d1-4f06-8c26-9801a3ab216a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:20.181271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5e36204-70d1-4f06-8c26-9801a3ab216a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:20.182190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5e36204-70d1-4f06-8c26-9801a3ab216a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:20.189273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5e36204-70d1-4f06-8c26-9801a3ab216a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:20.191860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5e36204-70d1-4f06-8c26-9801a3ab216a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:20.954023 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d5ffd172-f2e9-48bd-b122-5325ccb49590 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1418 microversion: 2.1 time: 1.441851 Oct 18 13:21:20.956710 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 628/1272] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:21:19 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1418 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:20.967817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c5533de2-e632-4554-8c6b-3b68d15be929 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '.version_select at 0x7ff60f77ac10>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:21.011434 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c5533de2-e632-4554-8c6b-3b68d15be929 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-597482813" status: 202 len: 0 microversion: 2.1 time: 0.052276 Oct 18 13:21:21.011780 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 629/1273] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 18 13:21:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-597482813 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:21:21.016919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b5e36204-70d1-4f06-8c26-9801a3ab216a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:21.020315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-668969ff-2f69-4daf-ae61-2148fb30a606 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:21.021227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-668969ff-2f69-4daf-ae61-2148fb30a606 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:21.028981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-668969ff-2f69-4daf-ae61-2148fb30a606 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:21.030879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-668969ff-2f69-4daf-ae61-2148fb30a606 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:21.031574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-668969ff-2f69-4daf-ae61-2148fb30a606 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:21.031937 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b5e36204-70d1-4f06-8c26-9801a3ab216a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1527 microversion: 2.1 time: 0.888774 Oct 18 13:21:21.032863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-668969ff-2f69-4daf-ae61-2148fb30a606 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:21.033713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-668969ff-2f69-4daf-ae61-2148fb30a606 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:21.033899 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 645/1274] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:20 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1527 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:21.034524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-668969ff-2f69-4daf-ae61-2148fb30a606 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:21.050023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-28ca1d65-237d-49ab-a9a2-3cd2ab059dcd tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:21.051058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-28ca1d65-237d-49ab-a9a2-3cd2ab059dcd tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:21.062336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28ca1d65-237d-49ab-a9a2-3cd2ab059dcd tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:21.066148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28ca1d65-237d-49ab-a9a2-3cd2ab059dcd tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:21.066823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28ca1d65-237d-49ab-a9a2-3cd2ab059dcd tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:21.067989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28ca1d65-237d-49ab-a9a2-3cd2ab059dcd tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:21.071781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28ca1d65-237d-49ab-a9a2-3cd2ab059dcd tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:21.073779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28ca1d65-237d-49ab-a9a2-3cd2ab059dcd tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:21.521549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-28ca1d65-237d-49ab-a9a2-3cd2ab059dcd tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:21.529912 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-28ca1d65-237d-49ab-a9a2-3cd2ab059dcd tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1325 microversion: 2.1 time: 0.491138 Oct 18 13:21:21.532443 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 646/1275] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:21 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1325 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:21.643961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-668969ff-2f69-4daf-ae61-2148fb30a606 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:21.644280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-36a37488-5c01-43de-89ab-0f754333e8aa req-aa35d4af-8a9d-4085-b6a6-47650435a70f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e81ebf6-fc21-4c54-b484-7235c8056f98", "tag": "a9b38269-97be-4c12-a550-aeb900bacef2"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:21.650958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:21.658031 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-668969ff-2f69-4daf-ae61-2148fb30a606 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1394 microversion: 2.1 time: 0.644784 Oct 18 13:21:21.658701 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 630/1276] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:21 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1394 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:21.667003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-36a37488-5c01-43de-89ab-0f754333e8aa req-aa35d4af-8a9d-4085-b6a6-47650435a70f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:21.667755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-36a37488-5c01-43de-89ab-0f754333e8aa req-aa35d4af-8a9d-4085-b6a6-47650435a70f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:21.668857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-36a37488-5c01-43de-89ab-0f754333e8aa req-aa35d4af-8a9d-4085-b6a6-47650435a70f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:21.681870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0cd73535-84f0-47c0-8a20-b4686ef2705c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f77aaf0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:21.717100 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-36a37488-5c01-43de-89ab-0f754333e8aa req-aa35d4af-8a9d-4085-b6a6-47650435a70f service nova] Creating event network-changed:a9b38269-97be-4c12-a550-aeb900bacef2 for instance 8e81ebf6-fc21-4c54-b484-7235c8056f98 on n-h2-858384-13 Oct 18 13:21:21.735077 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-36a37488-5c01-43de-89ab-0f754333e8aa req-aa35d4af-8a9d-4085-b6a6-47650435a70f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191815 Oct 18 13:21:21.735970 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 647/1277] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:21.741439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93fedf1e-c35b-4c60-9d2b-8f5365042b1c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:21.756074 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-93fedf1e-c35b-4c60-9d2b-8f5365042b1c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] HTTP exception thrown: Flavor 76f7ef46-02d1-45c9-9ac9-be7813cc2bb9 could not be found. Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93fedf1e-c35b-4c60-9d2b-8f5365042b1c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Request method failure captured: Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/flavors/76f7ef46-02d1-45c9-9ac9-be7813cc2bb9 HTTP/1.1 Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdZX9A1ckcybaKMgbzFKvvce88U518EjX0ZZ2PBTnzhMZHZzQVzuWVjlg3vwW-OrhM4MWV0u8SvSLr--T8XlISTz09vcZNiukqxBAx5t4TqktIFm11N54mkEt7QjCB47orQjFcxnGQpTCSHdimOFaKPAwUblwK3IEAz8NM29xTp2XI Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 64b702f084c24dcc929d400e81eef048 Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-MigrationsAdminTest-700113762 Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:21:21.767919 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:21:21.769933 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64b702f084c24dcc929d400e81eef048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/64b702f084c24dcc929d400e81eef048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64b702f084c24dcc929d400e81eef048"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_64b702f084c24dcc929d400e81eef048"}]}] Oct 18 13:21:21.769933 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-MigrationsAdminTest-700113762 Oct 18 13:21:21.769933 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 64b702f084c24dcc929d400e81eef048 Oct 18 13:21:21.769933 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-MigrationsAdminTest-700113762 Oct 18 13:21:21.769933 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-MigrationsAdminTest-700113762-project-admin Oct 18 13:21:21.769933 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:21:21.769933 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:21:21.769933 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 95055dd980944f9894c5c5d7263290dd Oct 18 13:21:21.769933 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-MigrationsAdminTest-700113762-project-admin Oct 18 13:21:21.769933 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:21:21.769933 n-d-858384-13 devstack@n-api.service[120611]: exception: Flavor 76f7ef46-02d1-45c9-9ac9-be7813cc2bb9 could not be found. Oct 18 13:21:21.769933 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '76f7ef46-02d1-45c9-9ac9-be7813cc2bb9'} Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 76f7ef46-02d1-45c9-9ac9-be7813cc2bb9 could not be found. Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:21.774487 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 76f7ef46-02d1-45c9-9ac9-be7813cc2bb9 could not be found. Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 76f7ef46-02d1-45c9-9ac9-be7813cc2bb9 could not be found. Oct 18 13:21:21.776045 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:21.777556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93fedf1e-c35b-4c60-9d2b-8f5365042b1c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Returning 404 to user: Flavor 76f7ef46-02d1-45c9-9ac9-be7813cc2bb9 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:21:21.777556 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-93fedf1e-c35b-4c60-9d2b-8f5365042b1c tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/76f7ef46-02d1-45c9-9ac9-be7813cc2bb9" status: 404 len: 109 microversion: 2.1 time: 0.032231 Oct 18 13:21:21.777556 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 648/1278] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:21:21 2022] DELETE /compute/v2.1/flavors/76f7ef46-02d1-45c9-9ac9-be7813cc2bb9 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:21:21.812809 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0cd73535-84f0-47c0-8a20-b4686ef2705c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 200 len: 1418 microversion: 2.1 time: 0.129537 Oct 18 13:21:21.815263 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 631/1279] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:21:21 2022] GET /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 1418 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:21.827978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0459d160-954c-4cec-b3d8-3ace359cb819 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7d1b80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:21.944461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-174550859", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:22.844345 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0459d160-954c-4cec-b3d8-3ace359cb819 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 204 len: 0 microversion: 2.1 time: 1.020370 Oct 18 13:21:22.844994 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 649/1280] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:21 2022] DELETE /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 0 bytes in 1022 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:21:22.860351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-34de4395-d61c-40d9-899e-715be78b6699 req-780556d3-e21d-49ca-8c94-d5fefb276efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea85e7d-02ff-4fc3-bc01-720e7de9de87", "name": "network-vif-plugged", "status": "completed", "tag": "d3e28fd2-a20a-403c-adde-3da5ff496840"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:22.893417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:21:22.908278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-34de4395-d61c-40d9-899e-715be78b6699 req-780556d3-e21d-49ca-8c94-d5fefb276efe service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:22.911133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-34de4395-d61c-40d9-899e-715be78b6699 req-780556d3-e21d-49ca-8c94-d5fefb276efe service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:22.911917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-34de4395-d61c-40d9-899e-715be78b6699 req-780556d3-e21d-49ca-8c94-d5fefb276efe service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:22.927381 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-34de4395-d61c-40d9-899e-715be78b6699 req-780556d3-e21d-49ca-8c94-d5fefb276efe service nova] Creating event network-vif-plugged:d3e28fd2-a20a-403c-adde-3da5ff496840 for instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 on n-h2-858384-13 Oct 18 13:21:22.933508 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-34de4395-d61c-40d9-899e-715be78b6699 req-780556d3-e21d-49ca-8c94-d5fefb276efe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086225 Oct 18 13:21:22.934777 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 650/1281] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:22.942858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-308fdb60-8c78-4544-ad49-3ada25034d58 tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:22.968120 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-308fdb60-8c78-4544-ad49-3ada25034d58 tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/364795411" status: 202 len: 0 microversion: 2.1 time: 0.031419 Oct 18 13:21:22.970186 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 651/1282] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:21:22 2022] DELETE /compute/v2.1/flavors/364795411 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:21:22.978890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3cebe025-119d-40ae-a7cd-b2becef41c9b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:22.979908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3cebe025-119d-40ae-a7cd-b2becef41c9b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:22.988654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cebe025-119d-40ae-a7cd-b2becef41c9b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:22.990375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cebe025-119d-40ae-a7cd-b2becef41c9b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:22.991099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cebe025-119d-40ae-a7cd-b2becef41c9b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:22.992017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cebe025-119d-40ae-a7cd-b2becef41c9b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:22.992652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cebe025-119d-40ae-a7cd-b2becef41c9b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:22.993998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cebe025-119d-40ae-a7cd-b2becef41c9b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:23.276295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:21:23.277940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:21:23.279945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:21:23.281145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:21:23.282875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:21:23.306311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:23.315171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:23.315788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:23.316989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:23.319603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:23.320357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:23.361922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Getting quotas for project 3f136eea39d84b04b5410eb0906c113e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:21:23.368870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Getting quotas for user e631235f0d0c400981c97d9edb1ea7fe and project 3f136eea39d84b04b5410eb0906c113e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:21:23.383779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:21:23.386464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:21:23.440673 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-baee652e-8641-4f00-be5b-d2adbd6ba267 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.501275 Oct 18 13:21:23.442086 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 632/1283] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:21:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:21:23.446856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35fbd77c-529d-404c-a567-9c4ccadbfbf5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:23.447762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-35fbd77c-529d-404c-a567-9c4ccadbfbf5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:23.455149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35fbd77c-529d-404c-a567-9c4ccadbfbf5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:23.456021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35fbd77c-529d-404c-a567-9c4ccadbfbf5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:23.456529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35fbd77c-529d-404c-a567-9c4ccadbfbf5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:23.457332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35fbd77c-529d-404c-a567-9c4ccadbfbf5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:23.457984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35fbd77c-529d-404c-a567-9c4ccadbfbf5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:23.458605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35fbd77c-529d-404c-a567-9c4ccadbfbf5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:23.662269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3cebe025-119d-40ae-a7cd-b2becef41c9b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:23.671550 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3cebe025-119d-40ae-a7cd-b2becef41c9b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1325 microversion: 2.1 time: 0.699625 Oct 18 13:21:23.672155 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 652/1284] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:22 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1325 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:23.682190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5a61a7d0-66b0-4603-aa3b-e3069efce02c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:23.682699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5a61a7d0-66b0-4603-aa3b-e3069efce02c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:23.703677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a61a7d0-66b0-4603-aa3b-e3069efce02c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:23.704181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a61a7d0-66b0-4603-aa3b-e3069efce02c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:23.704620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a61a7d0-66b0-4603-aa3b-e3069efce02c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:23.705365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a61a7d0-66b0-4603-aa3b-e3069efce02c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:23.705816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a61a7d0-66b0-4603-aa3b-e3069efce02c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:23.706243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a61a7d0-66b0-4603-aa3b-e3069efce02c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:23.736917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:23.769255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5a61a7d0-66b0-4603-aa3b-e3069efce02c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:21:24.030069 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5a61a7d0-66b0-4603-aa3b-e3069efce02c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 204 len: 0 microversion: 2.1 time: 0.349963 Oct 18 13:21:24.032237 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 653/1285] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:21:23 2022] DELETE /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:21:24.045920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-576edb6e-d255-47cd-92dc-ba0fb1460169 tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:24.129033 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-576edb6e-d255-47cd-92dc-ba0fb1460169 tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.091977 Oct 18 13:21:24.130697 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 654/1286] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:21:24 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:24.137791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-22c73271-f822-4b9e-a20b-60bc79fb050d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:24.139371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-22c73271-f822-4b9e-a20b-60bc79fb050d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:24.311221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-35fbd77c-529d-404c-a567-9c4ccadbfbf5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:24.323394 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-35fbd77c-529d-404c-a567-9c4ccadbfbf5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1394 microversion: 2.1 time: 0.879919 Oct 18 13:21:24.330821 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 633/1287] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:23 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1394 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:24.338733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-22c73271-f822-4b9e-a20b-60bc79fb050d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:24.342319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-881494be-83f4-4211-90cd-b65afaf27464 req-d2823838-8522-4789-b379-1e643a3b2406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dfa9249-2680-4175-8114-fc18cdb0c117", "tag": "5fc3300f-70ef-46dd-9666-925c4793e0a2"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:24.355134 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-22c73271-f822-4b9e-a20b-60bc79fb050d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1212 microversion: 2.1 time: 0.212831 Oct 18 13:21:24.355803 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 655/1288] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:24 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1212 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:24.367208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dcfa2d73-7698-40ab-8963-967b7a567b82 tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:24.381074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-881494be-83f4-4211-90cd-b65afaf27464 req-d2823838-8522-4789-b379-1e643a3b2406 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:24.381926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-881494be-83f4-4211-90cd-b65afaf27464 req-d2823838-8522-4789-b379-1e643a3b2406 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:24.382597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-881494be-83f4-4211-90cd-b65afaf27464 req-d2823838-8522-4789-b379-1e643a3b2406 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:24.404254 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-881494be-83f4-4211-90cd-b65afaf27464 req-d2823838-8522-4789-b379-1e643a3b2406 service nova] Creating event network-changed:5fc3300f-70ef-46dd-9666-925c4793e0a2 for instance 8dfa9249-2680-4175-8114-fc18cdb0c117 on n-h2-858384-13 Oct 18 13:21:24.415114 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-881494be-83f4-4211-90cd-b65afaf27464 req-d2823838-8522-4789-b379-1e643a3b2406 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080935 Oct 18 13:21:24.416137 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 634/1289] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:24.428638 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dcfa2d73-7698-40ab-8963-967b7a567b82 tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1560907670" status: 202 len: 0 microversion: 2.1 time: 0.067412 Oct 18 13:21:24.429267 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 656/1290] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 18 13:21:24 2022] DELETE /compute/v2.1/flavors/1560907670 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:21:24.431455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-70658057", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "0b58d9a8-4835-4530-9695-a2f702e82ee6"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:24.438395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d88adfc-91f7-4287-81a1-1341675fc3db tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:24.477807 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d88adfc-91f7-4287-81a1-1341675fc3db tempest-ServersWithSpecificFlavorTestJSON-1893208967 tempest-ServersWithSpecificFlavorTestJSON-1893208967-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044149 Oct 18 13:21:24.497344 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 657/1291] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:21:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:24.520235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-02e4dfed-622f-4b8d-a284-e66a36da4a4a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:24.521260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-02e4dfed-622f-4b8d-a284-e66a36da4a4a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:24.529657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e4dfed-622f-4b8d-a284-e66a36da4a4a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:24.530373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e4dfed-622f-4b8d-a284-e66a36da4a4a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:24.531143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e4dfed-622f-4b8d-a284-e66a36da4a4a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:24.532074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e4dfed-622f-4b8d-a284-e66a36da4a4a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:24.532722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e4dfed-622f-4b8d-a284-e66a36da4a4a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:24.533379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e4dfed-622f-4b8d-a284-e66a36da4a4a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:24.539687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] validate_networks() for [('0b58d9a8-4835-4530-9695-a2f702e82ee6', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:21:24.554883 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-02e4dfed-622f-4b8d-a284-e66a36da4a4a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] HTTP exception thrown: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-02e4dfed-622f-4b8d-a284-e66a36da4a4a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Request method failure captured: Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb HTTP/1.1 Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdvU1koZzimq_OqhahVwIHHjz3OOGfBvUyvcbrY0FEq5EUPNx5X0M6YVkMt-IXhKfa-dEEFZkxHyEy84aZmQ2ZIt7hoGV8nBPLeM8Mnj1INOAtOEvfrWAlbM5qM5rlpik45nNf-xo_KwFb35x0n7B9O8MS2bRKY9ZHofMYNAFqDShE Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:21:24.559636 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:21:24.561508 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ef15948e13464e45ba93cb1c5922a872"}]}] Oct 18 13:21:24.561508 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:24.561508 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:24.561508 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:24.561508 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:24.561508 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:21:24.561508 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:21:24.561508 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3a42f7285eab4c2cb58d06b302f8f185 Oct 18 13:21:24.561508 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:24.561508 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:21:24.561508 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:24.561508 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '14965255-1b8d-4094-84de-1e81599640fb'} Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:21:24.562377 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:24.563598 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.564926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-02e4dfed-622f-4b8d-a284-e66a36da4a4a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Returning 404 to user: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:21:24.564926 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-02e4dfed-622f-4b8d-a284-e66a36da4a4a tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "DELETE /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 404 len: 111 microversion: 2.1 time: 0.048876 Oct 18 13:21:24.568555 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 658/1292] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:21:24 2022] DELETE /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:21:24.579801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32ef0656-6a8a-4bff-a6f6-c228c4334170 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:24.580510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-32ef0656-6a8a-4bff-a6f6-c228c4334170 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: 14965255-1b8d-4094-84de-1e81599640fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:24.590170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32ef0656-6a8a-4bff-a6f6-c228c4334170 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:24.602840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32ef0656-6a8a-4bff-a6f6-c228c4334170 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:24.604066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32ef0656-6a8a-4bff-a6f6-c228c4334170 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:24.618271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32ef0656-6a8a-4bff-a6f6-c228c4334170 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:24.622101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32ef0656-6a8a-4bff-a6f6-c228c4334170 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:24.622859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32ef0656-6a8a-4bff-a6f6-c228c4334170 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:24.663820 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-32ef0656-6a8a-4bff-a6f6-c228c4334170 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] HTTP exception thrown: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32ef0656-6a8a-4bff-a6f6-c228c4334170 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Request method failure captured: Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb HTTP/1.1 Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdvU1koZzimq_OqhahVwIHHjz3OOGfBvUyvcbrY0FEq5EUPNx5X0M6YVkMt-IXhKfa-dEEFZkxHyEy84aZmQ2ZIt7hoGV8nBPLeM8Mnj1INOAtOEvfrWAlbM5qM5rlpik45nNf-xo_KwFb35x0n7B9O8MS2bRKY9ZHofMYNAFqDShE Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:21:24.668380 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:21:24.669982 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ef15948e13464e45ba93cb1c5922a872"}]}] Oct 18 13:21:24.669982 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:24.669982 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:24.669982 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:24.669982 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:24.669982 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:21:24.669982 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:21:24.669982 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3a42f7285eab4c2cb58d06b302f8f185 Oct 18 13:21:24.669982 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:24.669982 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:21:24.669982 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:24.669982 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '14965255-1b8d-4094-84de-1e81599640fb'} Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:21:24.671179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. Oct 18 13:21:24.672530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.673696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32ef0656-6a8a-4bff-a6f6-c228c4334170 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Returning 404 to user: Instance 14965255-1b8d-4094-84de-1e81599640fb could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:21:24.673696 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-32ef0656-6a8a-4bff-a6f6-c228c4334170 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb" status: 404 len: 111 microversion: 2.1 time: 0.094326 Oct 18 13:21:24.676081 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 659/1293] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:24 2022] GET /compute/v2.1/servers/14965255-1b8d-4094-84de-1e81599640fb => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:21:24.681044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb61b765-97c3-48d0-9592-de03fa44acc9 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:24.684185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eb61b765-97c3-48d0-9592-de03fa44acc9 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:24.698745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb61b765-97c3-48d0-9592-de03fa44acc9 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:24.701628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb61b765-97c3-48d0-9592-de03fa44acc9 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:24.705794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb61b765-97c3-48d0-9592-de03fa44acc9 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:24.706752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb61b765-97c3-48d0-9592-de03fa44acc9 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:24.708524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb61b765-97c3-48d0-9592-de03fa44acc9 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:24.709072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb61b765-97c3-48d0-9592-de03fa44acc9 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:24.735393 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-eb61b765-97c3-48d0-9592-de03fa44acc9 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] HTTP exception thrown: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb61b765-97c3-48d0-9592-de03fa44acc9 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Request method failure captured: Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a HTTP/1.1 Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdvU1koZzimq_OqhahVwIHHjz3OOGfBvUyvcbrY0FEq5EUPNx5X0M6YVkMt-IXhKfa-dEEFZkxHyEy84aZmQ2ZIt7hoGV8nBPLeM8Mnj1INOAtOEvfrWAlbM5qM5rlpik45nNf-xo_KwFb35x0n7B9O8MS2bRKY9ZHofMYNAFqDShE Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:21:24.737022 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:21:24.738669 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ef15948e13464e45ba93cb1c5922a872"}]}] Oct 18 13:21:24.738669 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:24.738669 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:24.738669 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:24.738669 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:24.738669 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:21:24.738669 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:21:24.738669 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3a42f7285eab4c2cb58d06b302f8f185 Oct 18 13:21:24.738669 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:24.738669 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:21:24.738669 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:24.738669 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'bfe50041-e476-443d-b56f-db9953efda0a'} Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:21:24.739576 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:24.740894 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:24.742993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb61b765-97c3-48d0-9592-de03fa44acc9 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Returning 404 to user: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:21:24.744019 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eb61b765-97c3-48d0-9592-de03fa44acc9 tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 404 len: 111 microversion: 2.1 time: 0.066854 Oct 18 13:21:24.747998 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 660/1294] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:21:24 2022] DELETE /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:21:24.753591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f944e155-5abf-48e5-95c1-69e93677c0e9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:24.754448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f944e155-5abf-48e5-95c1-69e93677c0e9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:24.762181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f944e155-5abf-48e5-95c1-69e93677c0e9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:24.762679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f944e155-5abf-48e5-95c1-69e93677c0e9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:24.763112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f944e155-5abf-48e5-95c1-69e93677c0e9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:24.764409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f944e155-5abf-48e5-95c1-69e93677c0e9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:24.764868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f944e155-5abf-48e5-95c1-69e93677c0e9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:24.765320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f944e155-5abf-48e5-95c1-69e93677c0e9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:24.959041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f944e155-5abf-48e5-95c1-69e93677c0e9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:24.969861 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f944e155-5abf-48e5-95c1-69e93677c0e9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1325 microversion: 2.1 time: 0.219854 Oct 18 13:21:24.970839 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 661/1295] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:24 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1325 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:24.976662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-965cd71a-9d72-4f32-9c3c-d60d56d525ef tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:24.977740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-965cd71a-9d72-4f32-9c3c-d60d56d525ef tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] [instance: bfe50041-e476-443d-b56f-db9953efda0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:24.983556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:24.985600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-965cd71a-9d72-4f32-9c3c-d60d56d525ef tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:24.986092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-965cd71a-9d72-4f32-9c3c-d60d56d525ef tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:24.987079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-965cd71a-9d72-4f32-9c3c-d60d56d525ef tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:24.987968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-965cd71a-9d72-4f32-9c3c-d60d56d525ef tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:24.988425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-965cd71a-9d72-4f32-9c3c-d60d56d525ef tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:24.988846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-965cd71a-9d72-4f32-9c3c-d60d56d525ef tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:25.021494 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-965cd71a-9d72-4f32-9c3c-d60d56d525ef tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] HTTP exception thrown: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-965cd71a-9d72-4f32-9c3c-d60d56d525ef tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Request method failure captured: Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a HTTP/1.1 Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdvU1koZzimq_OqhahVwIHHjz3OOGfBvUyvcbrY0FEq5EUPNx5X0M6YVkMt-IXhKfa-dEEFZkxHyEy84aZmQ2ZIt7hoGV8nBPLeM8Mnj1INOAtOEvfrWAlbM5qM5rlpik45nNf-xo_KwFb35x0n7B9O8MS2bRKY9ZHofMYNAFqDShE Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:21:25.023079 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:21:25.024596 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef15948e13464e45ba93cb1c5922a872"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ef15948e13464e45ba93cb1c5922a872"}]}] Oct 18 13:21:25.024596 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:25.024596 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: ef15948e13464e45ba93cb1c5922a872 Oct 18 13:21:25.024596 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704 Oct 18 13:21:25.024596 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:25.024596 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:21:25.024596 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:21:25.024596 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3a42f7285eab4c2cb58d06b302f8f185 Oct 18 13:21:25.024596 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1975104704-project Oct 18 13:21:25.024596 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:21:25.024596 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:25.024596 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'bfe50041-e476-443d-b56f-db9953efda0a'} Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:21:25.025513 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. Oct 18 13:21:25.026994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:25.028300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-965cd71a-9d72-4f32-9c3c-d60d56d525ef tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] Returning 404 to user: Instance bfe50041-e476-443d-b56f-db9953efda0a could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:21:25.028300 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-965cd71a-9d72-4f32-9c3c-d60d56d525ef tempest-ServersWithSpecificFlavorTestJSON-1975104704 tempest-ServersWithSpecificFlavorTestJSON-1975104704-project] 10.222.0.40 "GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a" status: 404 len: 111 microversion: 2.1 time: 0.052632 Oct 18 13:21:25.028300 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 662/1296] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:24 2022] GET /compute/v2.1/servers/bfe50041-e476-443d-b56f-db9953efda0a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:21:25.042384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-89d719d0-60f5-42c9-a7ec-291aca8802d1 req-9b73970c-c5bd-492b-994a-c57237f7fbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f0df27-75cd-4ece-b3e8-91174239e3a9", "name": "network-vif-unplugged", "status": "completed", "tag": "3d6790df-75bb-427a-86ec-809a4c3e5c9f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:25.054549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-89d719d0-60f5-42c9-a7ec-291aca8802d1 req-9b73970c-c5bd-492b-994a-c57237f7fbc1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:25.055380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-89d719d0-60f5-42c9-a7ec-291aca8802d1 req-9b73970c-c5bd-492b-994a-c57237f7fbc1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:25.055969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-89d719d0-60f5-42c9-a7ec-291aca8802d1 req-9b73970c-c5bd-492b-994a-c57237f7fbc1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:25.080497 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-89d719d0-60f5-42c9-a7ec-291aca8802d1 req-9b73970c-c5bd-492b-994a-c57237f7fbc1 service nova] Creating event network-vif-unplugged:3d6790df-75bb-427a-86ec-809a4c3e5c9f for instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 on n-h1-858384-13 Oct 18 13:21:25.086233 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-89d719d0-60f5-42c9-a7ec-291aca8802d1 req-9b73970c-c5bd-492b-994a-c57237f7fbc1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059421 Oct 18 13:21:25.089486 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 663/1297] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:25.159447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:21:25.159869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:21:25.160800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:21:25.161904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:21:25.162935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:21:25.201824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:25.202934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:25.203587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:25.204417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:25.205328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:25.205653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:25.226519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Getting quotas for project 472fc8535c504953a8f14a24f9d22260. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:21:25.232394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Getting quotas for user f896caa4caa0472db9198f7795401df2 and project 472fc8535c504953a8f14a24f9d22260. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:21:25.237224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:25.249910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:21:25.252564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:21:25.327697 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7f5abffa-57a1-4723-86c0-1f72d8f49268 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909999 Oct 18 13:21:25.340085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5b1e2772-3635-42f8-b0dd-02a01915623d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:25.340793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5b1e2772-3635-42f8-b0dd-02a01915623d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:25.346724 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 635/1298] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:21:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:21:25.369064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a9ed8768-b852-4d6b-a164-b2a1336feb77 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:25.369717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a9ed8768-b852-4d6b-a164-b2a1336feb77 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:25.387827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9ed8768-b852-4d6b-a164-b2a1336feb77 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:25.388829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9ed8768-b852-4d6b-a164-b2a1336feb77 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:25.389308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9ed8768-b852-4d6b-a164-b2a1336feb77 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:25.390005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9ed8768-b852-4d6b-a164-b2a1336feb77 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:25.390456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9ed8768-b852-4d6b-a164-b2a1336feb77 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:25.390873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9ed8768-b852-4d6b-a164-b2a1336feb77 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:25.470366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5b1e2772-3635-42f8-b0dd-02a01915623d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:25.490947 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5b1e2772-3635-42f8-b0dd-02a01915623d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1206 microversion: 2.1 time: 0.144354 Oct 18 13:21:25.494498 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 664/1299] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:25 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1206 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:25.505641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d8a4a95-bd2a-4b9a-b5f1-ddbf08c254a0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:25.506359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d8a4a95-bd2a-4b9a-b5f1-ddbf08c254a0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:25.528888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8a4a95-bd2a-4b9a-b5f1-ddbf08c254a0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:25.532831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8a4a95-bd2a-4b9a-b5f1-ddbf08c254a0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:25.534461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8a4a95-bd2a-4b9a-b5f1-ddbf08c254a0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:25.537087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8a4a95-bd2a-4b9a-b5f1-ddbf08c254a0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:25.537672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8a4a95-bd2a-4b9a-b5f1-ddbf08c254a0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:25.538204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8a4a95-bd2a-4b9a-b5f1-ddbf08c254a0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:25.699943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a9ed8768-b852-4d6b-a164-b2a1336feb77 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:25.714723 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a9ed8768-b852-4d6b-a164-b2a1336feb77 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1394 microversion: 2.1 time: 0.350226 Oct 18 13:21:25.718083 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 636/1300] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:25 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1394 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:25.993486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-20541d0f-0479-48f8-a246-f6bd865659dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:25.994334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-20541d0f-0479-48f8-a246-f6bd865659dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:26.009851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20541d0f-0479-48f8-a246-f6bd865659dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:26.012233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20541d0f-0479-48f8-a246-f6bd865659dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:26.016868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20541d0f-0479-48f8-a246-f6bd865659dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:26.020245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20541d0f-0479-48f8-a246-f6bd865659dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:26.024848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20541d0f-0479-48f8-a246-f6bd865659dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:26.025637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20541d0f-0479-48f8-a246-f6bd865659dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:26.195357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d8a4a95-bd2a-4b9a-b5f1-ddbf08c254a0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:26.217165 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d8a4a95-bd2a-4b9a-b5f1-ddbf08c254a0 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1216 microversion: 2.1 time: 0.720667 Oct 18 13:21:26.238042 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 665/1301] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:25 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1216 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:26.485163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-20541d0f-0479-48f8-a246-f6bd865659dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:26.499900 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-20541d0f-0479-48f8-a246-f6bd865659dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1325 microversion: 2.1 time: 0.510486 Oct 18 13:21:26.506957 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 637/1302] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:25 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1325 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:26.533803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-673cac97-78fd-44f4-b0e5-166d950e5b86 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:26.534874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-673cac97-78fd-44f4-b0e5-166d950e5b86 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:26.547339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-673cac97-78fd-44f4-b0e5-166d950e5b86 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:26.548304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-673cac97-78fd-44f4-b0e5-166d950e5b86 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:26.549890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-673cac97-78fd-44f4-b0e5-166d950e5b86 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:26.552428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-673cac97-78fd-44f4-b0e5-166d950e5b86 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:26.553041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-673cac97-78fd-44f4-b0e5-166d950e5b86 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:26.553610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-673cac97-78fd-44f4-b0e5-166d950e5b86 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:26.731060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-673cac97-78fd-44f4-b0e5-166d950e5b86 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:26.741228 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-673cac97-78fd-44f4-b0e5-166d950e5b86 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1202 microversion: 2.1 time: 0.214343 Oct 18 13:21:26.742075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c38525bc-32a4-4516-9c9d-6b9693400e4d tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:26.742876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c38525bc-32a4-4516-9c9d-6b9693400e4d tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:26.745041 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 666/1303] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:26 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1202 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:26.758946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c38525bc-32a4-4516-9c9d-6b9693400e4d tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:26.759858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c38525bc-32a4-4516-9c9d-6b9693400e4d tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:26.762339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c38525bc-32a4-4516-9c9d-6b9693400e4d tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:26.764506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c38525bc-32a4-4516-9c9d-6b9693400e4d tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:26.769488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c38525bc-32a4-4516-9c9d-6b9693400e4d tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:26.772836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c38525bc-32a4-4516-9c9d-6b9693400e4d tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:27.128275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-6dc08573-bcc4-4ff7-bdff-b7b6a56abfff req-2e2fed21-fd84-4c53-9533-2b5d45d743a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e81ebf6-fc21-4c54-b484-7235c8056f98", "name": "network-vif-plugged", "status": "completed", "tag": "a9b38269-97be-4c12-a550-aeb900bacef2"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:27.149856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c38525bc-32a4-4516-9c9d-6b9693400e4d tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:27.167090 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c38525bc-32a4-4516-9c9d-6b9693400e4d tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1394 microversion: 2.1 time: 0.428760 Oct 18 13:21:27.189977 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 638/1304] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:26 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1394 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:27.193074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6dc08573-bcc4-4ff7-bdff-b7b6a56abfff req-2e2fed21-fd84-4c53-9533-2b5d45d743a3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:27.197765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6dc08573-bcc4-4ff7-bdff-b7b6a56abfff req-2e2fed21-fd84-4c53-9533-2b5d45d743a3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:27.206288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6dc08573-bcc4-4ff7-bdff-b7b6a56abfff req-2e2fed21-fd84-4c53-9533-2b5d45d743a3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:27.250497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-863c05bb-bcc5-49c4-bc34-c08592d2ec44 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:27.251365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-863c05bb-bcc5-49c4-bc34-c08592d2ec44 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:27.257022 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-6dc08573-bcc4-4ff7-bdff-b7b6a56abfff req-2e2fed21-fd84-4c53-9533-2b5d45d743a3 service nova] Creating event network-vif-plugged:a9b38269-97be-4c12-a550-aeb900bacef2 for instance 8e81ebf6-fc21-4c54-b484-7235c8056f98 on n-h2-858384-13 Oct 18 13:21:27.281603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-863c05bb-bcc5-49c4-bc34-c08592d2ec44 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:27.290057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-863c05bb-bcc5-49c4-bc34-c08592d2ec44 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:27.291553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-863c05bb-bcc5-49c4-bc34-c08592d2ec44 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:27.293043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-863c05bb-bcc5-49c4-bc34-c08592d2ec44 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:27.295099 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-6dc08573-bcc4-4ff7-bdff-b7b6a56abfff req-2e2fed21-fd84-4c53-9533-2b5d45d743a3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171613 Oct 18 13:21:27.296379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-863c05bb-bcc5-49c4-bc34-c08592d2ec44 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:27.298372 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 667/1305] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:27.298958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-863c05bb-bcc5-49c4-bc34-c08592d2ec44 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:27.559187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-863c05bb-bcc5-49c4-bc34-c08592d2ec44 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:27.575366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ae0c72d9-821a-4a80-bf12-dbbef7230625 req-43bd950e-c183-41bd-b169-7cd8b1b0dc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f0df27-75cd-4ece-b3e8-91174239e3a9", "name": "network-vif-deleted", "tag": "3d6790df-75bb-427a-86ec-809a4c3e5c9f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:27.577458 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-863c05bb-bcc5-49c4-bc34-c08592d2ec44 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1272 microversion: 2.1 time: 0.333928 Oct 18 13:21:27.578407 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 639/1306] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:27 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1272 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:27.600494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ce02c787-146a-4145-9cf1-09c24e1ed58f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:27.601541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ae0c72d9-821a-4a80-bf12-dbbef7230625 req-43bd950e-c183-41bd-b169-7cd8b1b0dc4b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:27.603690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ae0c72d9-821a-4a80-bf12-dbbef7230625 req-43bd950e-c183-41bd-b169-7cd8b1b0dc4b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:27.604136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ae0c72d9-821a-4a80-bf12-dbbef7230625 req-43bd950e-c183-41bd-b169-7cd8b1b0dc4b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:27.605646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ce02c787-146a-4145-9cf1-09c24e1ed58f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:27.616718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce02c787-146a-4145-9cf1-09c24e1ed58f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:27.622540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce02c787-146a-4145-9cf1-09c24e1ed58f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:27.623521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce02c787-146a-4145-9cf1-09c24e1ed58f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:27.624506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce02c787-146a-4145-9cf1-09c24e1ed58f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:27.625309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce02c787-146a-4145-9cf1-09c24e1ed58f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:27.625997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce02c787-146a-4145-9cf1-09c24e1ed58f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:27.626269 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ae0c72d9-821a-4a80-bf12-dbbef7230625 req-43bd950e-c183-41bd-b169-7cd8b1b0dc4b service nova] Creating event network-vif-deleted:3d6790df-75bb-427a-86ec-809a4c3e5c9f for instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 on n-h1-858384-13 Oct 18 13:21:27.632147 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ae0c72d9-821a-4a80-bf12-dbbef7230625 req-43bd950e-c183-41bd-b169-7cd8b1b0dc4b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228337 Oct 18 13:21:27.633344 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 668/1307] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:27.770981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5a49783a-1492-4dad-8f79-23e63aae92d1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:27.771812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5a49783a-1492-4dad-8f79-23e63aae92d1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:27.785263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a49783a-1492-4dad-8f79-23e63aae92d1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:27.785758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a49783a-1492-4dad-8f79-23e63aae92d1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:27.786191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a49783a-1492-4dad-8f79-23e63aae92d1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:27.786882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a49783a-1492-4dad-8f79-23e63aae92d1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:27.787330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a49783a-1492-4dad-8f79-23e63aae92d1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:27.794319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a49783a-1492-4dad-8f79-23e63aae92d1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:27.939883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ce02c787-146a-4145-9cf1-09c24e1ed58f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:27.954632 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ce02c787-146a-4145-9cf1-09c24e1ed58f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1325 microversion: 2.1 time: 0.371822 Oct 18 13:21:27.955502 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 640/1308] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:27 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1325 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:28.017107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5a49783a-1492-4dad-8f79-23e63aae92d1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:28.043237 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5a49783a-1492-4dad-8f79-23e63aae92d1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1258 microversion: 2.1 time: 0.276870 Oct 18 13:21:28.043829 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 669/1309] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:27 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1258 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:28.221889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4ac78da0-b403-42fa-a6db-4277697ed8b5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:28.223870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4ac78da0-b403-42fa-a6db-4277697ed8b5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:28.244453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ac78da0-b403-42fa-a6db-4277697ed8b5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:28.246556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ac78da0-b403-42fa-a6db-4277697ed8b5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:28.247710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ac78da0-b403-42fa-a6db-4277697ed8b5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:28.249339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ac78da0-b403-42fa-a6db-4277697ed8b5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:28.251422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ac78da0-b403-42fa-a6db-4277697ed8b5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:28.253518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ac78da0-b403-42fa-a6db-4277697ed8b5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:28.602195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-02bf294d-c6ae-4696-b7e4-903ec6a4b236 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:28.602951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-02bf294d-c6ae-4696-b7e4-903ec6a4b236 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:28.611664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02bf294d-c6ae-4696-b7e4-903ec6a4b236 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:28.612153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02bf294d-c6ae-4696-b7e4-903ec6a4b236 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:28.612578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02bf294d-c6ae-4696-b7e4-903ec6a4b236 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:28.618694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02bf294d-c6ae-4696-b7e4-903ec6a4b236 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:28.619298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02bf294d-c6ae-4696-b7e4-903ec6a4b236 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:28.619735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02bf294d-c6ae-4696-b7e4-903ec6a4b236 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:28.770987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-02bf294d-c6ae-4696-b7e4-903ec6a4b236 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:28.779458 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-02bf294d-c6ae-4696-b7e4-903ec6a4b236 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1270 microversion: 2.1 time: 0.181471 Oct 18 13:21:28.780159 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 670/1310] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:28 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:28.924357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4ac78da0-b403-42fa-a6db-4277697ed8b5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:28.933216 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4ac78da0-b403-42fa-a6db-4277697ed8b5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1394 microversion: 2.1 time: 0.720237 Oct 18 13:21:28.943147 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 641/1311] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:28 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1394 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:28.980575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c3f2a01f-7a88-4bc5-94ac-be6f51e0744a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:28.981700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c3f2a01f-7a88-4bc5-94ac-be6f51e0744a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:28.988762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3f2a01f-7a88-4bc5-94ac-be6f51e0744a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:28.989681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3f2a01f-7a88-4bc5-94ac-be6f51e0744a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:28.990508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3f2a01f-7a88-4bc5-94ac-be6f51e0744a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:28.991569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3f2a01f-7a88-4bc5-94ac-be6f51e0744a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:28.992216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3f2a01f-7a88-4bc5-94ac-be6f51e0744a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:28.996569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3f2a01f-7a88-4bc5-94ac-be6f51e0744a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:29.072155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2995cab9-83c1-47cf-b634-7c306f330566 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:29.073223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2995cab9-83c1-47cf-b634-7c306f330566 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:29.095725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2995cab9-83c1-47cf-b634-7c306f330566 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:29.101200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2995cab9-83c1-47cf-b634-7c306f330566 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:29.102568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2995cab9-83c1-47cf-b634-7c306f330566 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:29.106332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2995cab9-83c1-47cf-b634-7c306f330566 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:29.110767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2995cab9-83c1-47cf-b634-7c306f330566 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:29.113332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2995cab9-83c1-47cf-b634-7c306f330566 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:29.338764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2995cab9-83c1-47cf-b634-7c306f330566 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:29.351967 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2995cab9-83c1-47cf-b634-7c306f330566 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1264 microversion: 2.1 time: 0.285033 Oct 18 13:21:29.352551 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 642/1312] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:29 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1264 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:29.369304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e2bdd7b6-c5d6-4c8b-a0aa-bc1a07f48aed req-ecbc3c53-1867-4bab-bc74-a5db92987c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfa9249-2680-4175-8114-fc18cdb0c117", "name": "network-vif-plugged", "status": "completed", "tag": "5fc3300f-70ef-46dd-9666-925c4793e0a2"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:29.385581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e2bdd7b6-c5d6-4c8b-a0aa-bc1a07f48aed req-ecbc3c53-1867-4bab-bc74-a5db92987c29 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:29.386060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e2bdd7b6-c5d6-4c8b-a0aa-bc1a07f48aed req-ecbc3c53-1867-4bab-bc74-a5db92987c29 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:29.386486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e2bdd7b6-c5d6-4c8b-a0aa-bc1a07f48aed req-ecbc3c53-1867-4bab-bc74-a5db92987c29 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:29.417451 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e2bdd7b6-c5d6-4c8b-a0aa-bc1a07f48aed req-ecbc3c53-1867-4bab-bc74-a5db92987c29 service nova] Creating event network-vif-plugged:5fc3300f-70ef-46dd-9666-925c4793e0a2 for instance 8dfa9249-2680-4175-8114-fc18cdb0c117 on n-h2-858384-13 Oct 18 13:21:29.429053 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e2bdd7b6-c5d6-4c8b-a0aa-bc1a07f48aed req-ecbc3c53-1867-4bab-bc74-a5db92987c29 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074149 Oct 18 13:21:29.429709 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 643/1313] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:29.433944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c3f2a01f-7a88-4bc5-94ac-be6f51e0744a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:29.445866 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c3f2a01f-7a88-4bc5-94ac-be6f51e0744a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1325 microversion: 2.1 time: 0.469624 Oct 18 13:21:29.449404 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 671/1314] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:28 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1325 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:29.804083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ff7ce6c9-7b96-411e-9c8e-78aa7824c32a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:29.804920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ff7ce6c9-7b96-411e-9c8e-78aa7824c32a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:29.817208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff7ce6c9-7b96-411e-9c8e-78aa7824c32a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:29.818191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff7ce6c9-7b96-411e-9c8e-78aa7824c32a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:29.818782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff7ce6c9-7b96-411e-9c8e-78aa7824c32a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:29.819663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff7ce6c9-7b96-411e-9c8e-78aa7824c32a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:29.820330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff7ce6c9-7b96-411e-9c8e-78aa7824c32a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:29.821199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff7ce6c9-7b96-411e-9c8e-78aa7824c32a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:29.975509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ec559cab-54be-4b20-87fa-d62d5f730be6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:29.976147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ec559cab-54be-4b20-87fa-d62d5f730be6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:29.986097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec559cab-54be-4b20-87fa-d62d5f730be6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:29.986893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec559cab-54be-4b20-87fa-d62d5f730be6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:29.987557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec559cab-54be-4b20-87fa-d62d5f730be6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:29.988506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec559cab-54be-4b20-87fa-d62d5f730be6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:29.990286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec559cab-54be-4b20-87fa-d62d5f730be6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:29.990946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec559cab-54be-4b20-87fa-d62d5f730be6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:30.122508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ff7ce6c9-7b96-411e-9c8e-78aa7824c32a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:30.136077 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ff7ce6c9-7b96-411e-9c8e-78aa7824c32a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1270 microversion: 2.1 time: 0.336211 Oct 18 13:21:30.136910 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 644/1315] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:29 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1270 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:30.211090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ec559cab-54be-4b20-87fa-d62d5f730be6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:30.223396 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ec559cab-54be-4b20-87fa-d62d5f730be6 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1575 microversion: 2.1 time: 0.251251 Oct 18 13:21:30.224497 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 672/1316] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:29 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1575 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:30.267282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-635e8c44-82eb-4dd2-b495-02edcbda0f36 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:30.267790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-635e8c44-82eb-4dd2-b495-02edcbda0f36 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:30.293881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-635e8c44-82eb-4dd2-b495-02edcbda0f36 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:30.294751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-635e8c44-82eb-4dd2-b495-02edcbda0f36 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:30.295514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-635e8c44-82eb-4dd2-b495-02edcbda0f36 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:30.296927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-635e8c44-82eb-4dd2-b495-02edcbda0f36 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:30.324444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-635e8c44-82eb-4dd2-b495-02edcbda0f36 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:30.326893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-635e8c44-82eb-4dd2-b495-02edcbda0f36 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:30.378907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-946e62c6-e35b-4cef-ade7-837b4ce9b2ee tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:30.379516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-946e62c6-e35b-4cef-ade7-837b4ce9b2ee tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:30.395711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946e62c6-e35b-4cef-ade7-837b4ce9b2ee tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:30.396073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946e62c6-e35b-4cef-ade7-837b4ce9b2ee tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:30.396559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946e62c6-e35b-4cef-ade7-837b4ce9b2ee tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:30.397422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946e62c6-e35b-4cef-ade7-837b4ce9b2ee tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:30.397872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946e62c6-e35b-4cef-ade7-837b4ce9b2ee tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:30.424234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946e62c6-e35b-4cef-ade7-837b4ce9b2ee tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:30.596295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-946e62c6-e35b-4cef-ade7-837b4ce9b2ee tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:30.604781 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-946e62c6-e35b-4cef-ade7-837b4ce9b2ee tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1264 microversion: 2.1 time: 0.230425 Oct 18 13:21:30.605565 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 673/1317] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:30 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:30.623870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d59258c9-f22b-4e98-ae61-5e6999c15cae tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:30.630088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d59258c9-f22b-4e98-ae61-5e6999c15cae tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:30.647411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d59258c9-f22b-4e98-ae61-5e6999c15cae tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:30.647909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d59258c9-f22b-4e98-ae61-5e6999c15cae tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:30.648615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d59258c9-f22b-4e98-ae61-5e6999c15cae tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:30.653425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d59258c9-f22b-4e98-ae61-5e6999c15cae tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:30.653942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d59258c9-f22b-4e98-ae61-5e6999c15cae tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:30.654377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d59258c9-f22b-4e98-ae61-5e6999c15cae tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:31.015957 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-635e8c44-82eb-4dd2-b495-02edcbda0f36 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.753664 Oct 18 13:21:31.016865 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 645/1318] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:21:30 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98/os-interface => generated 284 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:31.164204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96ff4ed3-11c2-4e9a-8e99-0cdc65198fa7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:31.166213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-96ff4ed3-11c2-4e9a-8e99-0cdc65198fa7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:31.190709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96ff4ed3-11c2-4e9a-8e99-0cdc65198fa7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:31.194221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96ff4ed3-11c2-4e9a-8e99-0cdc65198fa7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:31.194659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96ff4ed3-11c2-4e9a-8e99-0cdc65198fa7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:31.195395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96ff4ed3-11c2-4e9a-8e99-0cdc65198fa7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:31.195851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96ff4ed3-11c2-4e9a-8e99-0cdc65198fa7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:31.196290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96ff4ed3-11c2-4e9a-8e99-0cdc65198fa7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:31.292614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d59258c9-f22b-4e98-ae61-5e6999c15cae tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:31.302746 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d59258c9-f22b-4e98-ae61-5e6999c15cae tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1325 microversion: 2.1 time: 0.695781 Oct 18 13:21:31.308083 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 674/1319] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:30 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1325 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:31.631736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-62f3c66a-39af-4e98-827c-974b0efc1c83 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:31.633321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-62f3c66a-39af-4e98-827c-974b0efc1c83 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:31.655466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62f3c66a-39af-4e98-827c-974b0efc1c83 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:31.657164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62f3c66a-39af-4e98-827c-974b0efc1c83 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:31.657803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62f3c66a-39af-4e98-827c-974b0efc1c83 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:31.659221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62f3c66a-39af-4e98-827c-974b0efc1c83 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:31.660417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62f3c66a-39af-4e98-827c-974b0efc1c83 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:31.661041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62f3c66a-39af-4e98-827c-974b0efc1c83 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:32.045204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-62f3c66a-39af-4e98-827c-974b0efc1c83 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:32.061750 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-62f3c66a-39af-4e98-827c-974b0efc1c83 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1306 microversion: 2.1 time: 0.430753 Oct 18 13:21:32.062965 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 675/1320] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:31 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1306 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:32.076771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-80297d0c-11c2-4069-991c-8b3ae36c5dd6 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:32.081232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-80297d0c-11c2-4069-991c-8b3ae36c5dd6 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:32.115110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80297d0c-11c2-4069-991c-8b3ae36c5dd6 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:32.115607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80297d0c-11c2-4069-991c-8b3ae36c5dd6 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:32.116051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80297d0c-11c2-4069-991c-8b3ae36c5dd6 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:32.116754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80297d0c-11c2-4069-991c-8b3ae36c5dd6 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:32.117229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80297d0c-11c2-4069-991c-8b3ae36c5dd6 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:32.117661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80297d0c-11c2-4069-991c-8b3ae36c5dd6 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:32.346788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-96ff4ed3-11c2-4e9a-8e99-0cdc65198fa7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:32.355612 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-96ff4ed3-11c2-4e9a-8e99-0cdc65198fa7 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1312 microversion: 2.1 time: 1.199505 Oct 18 13:21:32.359444 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 646/1321] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:31 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1312 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:32.371492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6bc59bf1-f45d-4c47-bced-9fa46af9b285 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:32.372363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6bc59bf1-f45d-4c47-bced-9fa46af9b285 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:32.390323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bc59bf1-f45d-4c47-bced-9fa46af9b285 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:32.391080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bc59bf1-f45d-4c47-bced-9fa46af9b285 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:32.391684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bc59bf1-f45d-4c47-bced-9fa46af9b285 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:32.393648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bc59bf1-f45d-4c47-bced-9fa46af9b285 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:32.394273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bc59bf1-f45d-4c47-bced-9fa46af9b285 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:32.394974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bc59bf1-f45d-4c47-bced-9fa46af9b285 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:32.573463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-80297d0c-11c2-4069-991c-8b3ae36c5dd6 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid 925c4106-eafb-486f-8846-ff04eea11eb3 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:21:32.599233 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-80297d0c-11c2-4069-991c-8b3ae36c5dd6 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 2423 microversion: 2.25 time: 0.534902 Oct 18 13:21:32.610528 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 676/1322] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:32 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 2423 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:21:32.628686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-665791cc-e389-4056-8752-d4e05d64cd6e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-13", "block_migration": "auto"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:32.632242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-665791cc-e389-4056-8752-d4e05d64cd6e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:32.652435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-665791cc-e389-4056-8752-d4e05d64cd6e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:32.653220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-665791cc-e389-4056-8752-d4e05d64cd6e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:32.654422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-665791cc-e389-4056-8752-d4e05d64cd6e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:32.656087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-665791cc-e389-4056-8752-d4e05d64cd6e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:32.656757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-665791cc-e389-4056-8752-d4e05d64cd6e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:32.657974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-665791cc-e389-4056-8752-d4e05d64cd6e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:32.697815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-665791cc-e389-4056-8752-d4e05d64cd6e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'flavor' on Instance uuid 925c4106-eafb-486f-8846-ff04eea11eb3 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:21:32.703757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:32.718085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-665791cc-e389-4056-8752-d4e05d64cd6e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Going to try to live migrate instance to n-h2-858384-13 {{(pid=120611) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:21:32.905288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6bc59bf1-f45d-4c47-bced-9fa46af9b285 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:32.918609 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6bc59bf1-f45d-4c47-bced-9fa46af9b285 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1522 microversion: 2.1 time: 0.557356 Oct 18 13:21:32.921430 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 647/1323] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:32 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:32.945799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-89300264-2a2a-48e3-a819-c22ee37555c2 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:32.946746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-89300264-2a2a-48e3-a819-c22ee37555c2 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:32.955193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89300264-2a2a-48e3-a819-c22ee37555c2 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:32.955957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89300264-2a2a-48e3-a819-c22ee37555c2 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:32.956603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89300264-2a2a-48e3-a819-c22ee37555c2 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:32.957962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89300264-2a2a-48e3-a819-c22ee37555c2 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:32.958594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89300264-2a2a-48e3-a819-c22ee37555c2 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:32.959221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89300264-2a2a-48e3-a819-c22ee37555c2 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:33.756392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-89300264-2a2a-48e3-a819-c22ee37555c2 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:33.767514 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-89300264-2a2a-48e3-a819-c22ee37555c2 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1522 microversion: 2.1 time: 0.826645 Oct 18 13:21:33.771543 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 648/1324] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:32 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1522 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:33.781988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-07a2451f-cf49-48d3-a472-9fc2460efd7e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:33.789309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-07a2451f-cf49-48d3-a472-9fc2460efd7e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:33.800506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07a2451f-cf49-48d3-a472-9fc2460efd7e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:33.802824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07a2451f-cf49-48d3-a472-9fc2460efd7e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:33.803273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07a2451f-cf49-48d3-a472-9fc2460efd7e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:33.804001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07a2451f-cf49-48d3-a472-9fc2460efd7e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:33.804453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07a2451f-cf49-48d3-a472-9fc2460efd7e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:33.804873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07a2451f-cf49-48d3-a472-9fc2460efd7e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:34.313027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-07a2451f-cf49-48d3-a472-9fc2460efd7e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:34.329703 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-07a2451f-cf49-48d3-a472-9fc2460efd7e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1306 microversion: 2.1 time: 0.556475 Oct 18 13:21:34.330737 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 649/1325] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:33 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1306 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:34.336664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5d10b311-fe7d-4ed2-860e-fc6a228a6193 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:34.337521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5d10b311-fe7d-4ed2-860e-fc6a228a6193 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:34.358879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d10b311-fe7d-4ed2-860e-fc6a228a6193 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:34.359896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d10b311-fe7d-4ed2-860e-fc6a228a6193 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:34.362155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d10b311-fe7d-4ed2-860e-fc6a228a6193 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:34.362893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d10b311-fe7d-4ed2-860e-fc6a228a6193 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:34.363349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d10b311-fe7d-4ed2-860e-fc6a228a6193 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:34.363771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d10b311-fe7d-4ed2-860e-fc6a228a6193 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:35.040829 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-665791cc-e389-4056-8752-d4e05d64cd6e tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/action" status: 202 len: 0 microversion: 2.25 time: 2.417127 Oct 18 13:21:35.046556 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 677/1326] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:21:32 2022] POST /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/action => generated 0 bytes in 2424 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:21:35.055818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-dbfe7479-650b-49c3-a51c-310e982a96ce req-8d04b896-105d-4384-80bc-06de1745a9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e81ebf6-fc21-4c54-b484-7235c8056f98", "tag": "a9b38269-97be-4c12-a550-aeb900bacef2"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:35.149475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dbfe7479-650b-49c3-a51c-310e982a96ce req-8d04b896-105d-4384-80bc-06de1745a9f6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:35.152661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dbfe7479-650b-49c3-a51c-310e982a96ce req-8d04b896-105d-4384-80bc-06de1745a9f6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:35.155701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dbfe7479-650b-49c3-a51c-310e982a96ce req-8d04b896-105d-4384-80bc-06de1745a9f6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:35.215783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:35.226563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5d10b311-fe7d-4ed2-860e-fc6a228a6193 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:35.241658 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-dbfe7479-650b-49c3-a51c-310e982a96ce req-8d04b896-105d-4384-80bc-06de1745a9f6 service nova] Creating event network-changed:a9b38269-97be-4c12-a550-aeb900bacef2 for instance 8e81ebf6-fc21-4c54-b484-7235c8056f98 on n-h2-858384-13 Oct 18 13:21:35.243703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=12 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:35.258143 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5d10b311-fe7d-4ed2-860e-fc6a228a6193 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1575 microversion: 2.1 time: 0.918529 Oct 18 13:21:35.259107 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 650/1327] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:34 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1575 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:35.269300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-74e5547c-9e3f-4f8b-af9b-162c07291d58 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:35.272049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-74e5547c-9e3f-4f8b-af9b-162c07291d58 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:35.278623 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-dbfe7479-650b-49c3-a51c-310e982a96ce req-8d04b896-105d-4384-80bc-06de1745a9f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229936 Oct 18 13:21:35.282413 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 678/1328] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:35.294568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74e5547c-9e3f-4f8b-af9b-162c07291d58 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:35.295452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74e5547c-9e3f-4f8b-af9b-162c07291d58 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:35.296148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74e5547c-9e3f-4f8b-af9b-162c07291d58 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:35.296872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74e5547c-9e3f-4f8b-af9b-162c07291d58 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:35.297368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74e5547c-9e3f-4f8b-af9b-162c07291d58 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:35.313497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74e5547c-9e3f-4f8b-af9b-162c07291d58 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:35.314572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e41a18e-1157-4bc1-9041-7dace6010008 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-7281543", "metadata": {"": ""}}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e41a18e-1157-4bc1-9041-7dace6010008 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action HTTP/1.1 Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 104 Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:21:35.346602 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:21:35.348235 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:21:35.348235 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:35.348235 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:21:35.348235 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:35.348235 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:21:35.348235 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:21:35.348235 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:21:35.348235 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:21:35.348235 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:21:35.348235 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:21:35.348235 n-d-858384-13 devstack@n-api.service[120611]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-7281543", "metadata": {"": ""}}} Oct 18 13:21:35.348235 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '8dfa9249-2680-4175-8114-fc18cdb0c117', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-7281543', 'metadata': {'': ''}}}} Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'': ''} Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:35.349107 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:35.350529 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:35.351866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:35.351866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:35.351866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:21:35.351866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:21:35.351866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:21:35.351866 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:35.359431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e41a18e-1157-4bc1-9041-7dace6010008 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:21:35.360811 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4e41a18e-1157-4bc1-9041-7dace6010008 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action" status: 400 len: 170 microversion: 2.1 time: 0.073930 Oct 18 13:21:35.362036 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 679/1329] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Oct 18 13:21:35 2022] POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action => generated 170 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:21:35.384169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3e72125d-e4be-4bd7-a792-49170b41da39 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:35.385320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3e72125d-e4be-4bd7-a792-49170b41da39 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:35.399069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e72125d-e4be-4bd7-a792-49170b41da39 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:35.399590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e72125d-e4be-4bd7-a792-49170b41da39 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:35.405611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e72125d-e4be-4bd7-a792-49170b41da39 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:35.415109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e72125d-e4be-4bd7-a792-49170b41da39 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:35.415936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e72125d-e4be-4bd7-a792-49170b41da39 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:35.417240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e72125d-e4be-4bd7-a792-49170b41da39 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:35.421113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:35.481468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:35.765019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3e72125d-e4be-4bd7-a792-49170b41da39 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:35.836813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3e72125d-e4be-4bd7-a792-49170b41da39 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:35.844653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3e72125d-e4be-4bd7-a792-49170b41da39 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:35.847385 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3e72125d-e4be-4bd7-a792-49170b41da39 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.483738 Oct 18 13:21:35.874070 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 680/1330] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:35 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:21:35.887919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-74e5547c-9e3f-4f8b-af9b-162c07291d58 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:35.897295 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-74e5547c-9e3f-4f8b-af9b-162c07291d58 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1312 microversion: 2.1 time: 0.636897 Oct 18 13:21:35.908945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f9d3268a-b8a0-423b-a899-cdc12df546ed req-6176d5aa-f067-4088-b6d7-f34003b8fb12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d3172e-d216-47ef-a447-ef91d43bba4f", "tag": "6d3bfbc9-e165-4403-af03-a04bc52c63e5"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:35.913734 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 651/1331] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:35 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1312 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:35.930096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f43b7db0-77ef-4ebd-b518-4ef99d820558 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:35.930704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f43b7db0-77ef-4ebd-b518-4ef99d820558 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:35.933532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f9d3268a-b8a0-423b-a899-cdc12df546ed req-6176d5aa-f067-4088-b6d7-f34003b8fb12 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:35.935353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f9d3268a-b8a0-423b-a899-cdc12df546ed req-6176d5aa-f067-4088-b6d7-f34003b8fb12 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:35.936435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f9d3268a-b8a0-423b-a899-cdc12df546ed req-6176d5aa-f067-4088-b6d7-f34003b8fb12 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:35.954726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f43b7db0-77ef-4ebd-b518-4ef99d820558 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:35.955214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f43b7db0-77ef-4ebd-b518-4ef99d820558 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:35.963717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f43b7db0-77ef-4ebd-b518-4ef99d820558 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:35.964753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f43b7db0-77ef-4ebd-b518-4ef99d820558 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:35.965435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f43b7db0-77ef-4ebd-b518-4ef99d820558 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:35.966071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f43b7db0-77ef-4ebd-b518-4ef99d820558 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:35.969498 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f9d3268a-b8a0-423b-a899-cdc12df546ed req-6176d5aa-f067-4088-b6d7-f34003b8fb12 service nova] Creating event network-changed:6d3bfbc9-e165-4403-af03-a04bc52c63e5 for instance 96d3172e-d216-47ef-a447-ef91d43bba4f on n-h1-858384-13 Oct 18 13:21:35.979580 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f9d3268a-b8a0-423b-a899-cdc12df546ed req-6176d5aa-f067-4088-b6d7-f34003b8fb12 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078790 Oct 18 13:21:35.982403 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 681/1332] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:35.999708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d10d0f32-0ee4-4422-af56-4828df8a97e4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:36.001525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d10d0f32-0ee4-4422-af56-4828df8a97e4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:36.018057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10d0f32-0ee4-4422-af56-4828df8a97e4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:36.019396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10d0f32-0ee4-4422-af56-4828df8a97e4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:36.020454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10d0f32-0ee4-4422-af56-4828df8a97e4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:36.022143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10d0f32-0ee4-4422-af56-4828df8a97e4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:36.023486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10d0f32-0ee4-4422-af56-4828df8a97e4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:36.025515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10d0f32-0ee4-4422-af56-4828df8a97e4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:36.429562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f43b7db0-77ef-4ebd-b518-4ef99d820558 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:36.438227 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f43b7db0-77ef-4ebd-b518-4ef99d820558 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1306 microversion: 2.1 time: 0.523182 Oct 18 13:21:36.438826 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 652/1333] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:35 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1306 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:36.908518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e1730051-510f-476a-b4f0-e048376a0f18 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:36.909988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e1730051-510f-476a-b4f0-e048376a0f18 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:36.928631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1730051-510f-476a-b4f0-e048376a0f18 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:36.939694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1730051-510f-476a-b4f0-e048376a0f18 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:36.940468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1730051-510f-476a-b4f0-e048376a0f18 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:36.944985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1730051-510f-476a-b4f0-e048376a0f18 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:36.945602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1730051-510f-476a-b4f0-e048376a0f18 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:36.946337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1730051-510f-476a-b4f0-e048376a0f18 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:37.057140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d10d0f32-0ee4-4422-af56-4828df8a97e4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:37.080086 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d10d0f32-0ee4-4422-af56-4828df8a97e4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1522 microversion: 2.1 time: 1.085329 Oct 18 13:21:37.093746 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 682/1334] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:35 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1522 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:37.105580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-81f2fdd7-367e-4199-8685-286bc9307d1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:37.106212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-81f2fdd7-367e-4199-8685-286bc9307d1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:37.122678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81f2fdd7-367e-4199-8685-286bc9307d1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:37.123684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81f2fdd7-367e-4199-8685-286bc9307d1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:37.124741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81f2fdd7-367e-4199-8685-286bc9307d1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:37.131846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81f2fdd7-367e-4199-8685-286bc9307d1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:37.133305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81f2fdd7-367e-4199-8685-286bc9307d1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:37.133980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81f2fdd7-367e-4199-8685-286bc9307d1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:37.260411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e1730051-510f-476a-b4f0-e048376a0f18 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:37.272744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e1730051-510f-476a-b4f0-e048376a0f18 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:37.292040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e1730051-510f-476a-b4f0-e048376a0f18 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:37.293315 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e1730051-510f-476a-b4f0-e048376a0f18 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.391726 Oct 18 13:21:37.293896 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 653/1335] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:36 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:21:37.304070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-318480f6-9689-4965-a57c-42ed02c0a380 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:37.304681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-318480f6-9689-4965-a57c-42ed02c0a380 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:37.317857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-318480f6-9689-4965-a57c-42ed02c0a380 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:37.319057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-318480f6-9689-4965-a57c-42ed02c0a380 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:37.320406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-318480f6-9689-4965-a57c-42ed02c0a380 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:37.321592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-318480f6-9689-4965-a57c-42ed02c0a380 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:37.322339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-318480f6-9689-4965-a57c-42ed02c0a380 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:37.323119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-318480f6-9689-4965-a57c-42ed02c0a380 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:37.493680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-318480f6-9689-4965-a57c-42ed02c0a380 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:37.502326 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-318480f6-9689-4965-a57c-42ed02c0a380 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1522 microversion: 2.1 time: 0.206825 Oct 18 13:21:37.502921 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 654/1336] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:37 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:37.527332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16454603-e44e-4e39-a631-d569c9cc8766 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:37.528100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-16454603-e44e-4e39-a631-d569c9cc8766 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:37.547894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16454603-e44e-4e39-a631-d569c9cc8766 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:37.548468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16454603-e44e-4e39-a631-d569c9cc8766 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:37.550406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16454603-e44e-4e39-a631-d569c9cc8766 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:37.551360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16454603-e44e-4e39-a631-d569c9cc8766 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:37.552406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16454603-e44e-4e39-a631-d569c9cc8766 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:37.552651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16454603-e44e-4e39-a631-d569c9cc8766 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:37.694741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-81f2fdd7-367e-4199-8685-286bc9307d1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:37.706161 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-81f2fdd7-367e-4199-8685-286bc9307d1e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1312 microversion: 2.1 time: 0.610959 Oct 18 13:21:37.707274 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 683/1337] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:37 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1312 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:37.713648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-102150a4-12e7-410c-b24d-f5741997f870 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-614582943", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-102150a4-12e7-410c-b24d-f5741997f870 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action HTTP/1.1 Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 618 Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:21:37.720402 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:21:37.721978 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:21:37.721978 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:37.721978 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:21:37.721978 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:37.721978 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:21:37.721978 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:21:37.721978 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:21:37.721978 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:21:37.721978 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:21:37.721978 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:21:37.722609 n-d-858384-13 devstack@n-api.service[120611]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-614582943", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 18 13:21:37.722609 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:21:37.722609 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:21:37.722839 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '8dfa9249-2680-4175-8114-fc18cdb0c117', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-614582943', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 18 13:21:37.722839 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:21:37.722839 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:37.722839 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:21:37.722839 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:21:37.722839 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:21:37.722839 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:21:37.722839 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:21:37.722839 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:37.722839 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 18 13:21:37.722839 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:21:37.723547 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:21:37.724624 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:21:37.724624 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:21:37.724624 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:21:37.724624 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:21:37.724624 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:21:37.724624 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:21:37.724624 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:21:37.724624 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:21:37.724624 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:37.724624 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:37.724624 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:37.724624 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:37.726343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:37.726343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:37.726343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:21:37.726343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:21:37.726343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:21:37.726343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:37.730908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-102150a4-12e7-410c-b24d-f5741997f870 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:21:37.732868 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-102150a4-12e7-410c-b24d-f5741997f870 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action" status: 400 len: 938 microversion: 2.1 time: 0.024361 Oct 18 13:21:37.734255 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 684/1338] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Oct 18 13:21:37 2022] POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action => generated 938 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:21:37.759856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-62157f22-cf58-495c-ad83-20d822ecb222 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:37.761540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-62157f22-cf58-495c-ad83-20d822ecb222 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:37.772183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62157f22-cf58-495c-ad83-20d822ecb222 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:37.773231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62157f22-cf58-495c-ad83-20d822ecb222 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:37.773889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62157f22-cf58-495c-ad83-20d822ecb222 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:37.774911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62157f22-cf58-495c-ad83-20d822ecb222 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:37.775586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62157f22-cf58-495c-ad83-20d822ecb222 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:37.776242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62157f22-cf58-495c-ad83-20d822ecb222 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:37.870352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-16454603-e44e-4e39-a631-d569c9cc8766 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:37.888146 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-16454603-e44e-4e39-a631-d569c9cc8766 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1306 microversion: 2.1 time: 0.365644 Oct 18 13:21:37.889483 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 655/1339] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:37 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1306 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:38.009197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-189fedcf-dee2-4f5d-9197-483a300a60e0 req-46a30f53-c804-479b-8ea1-a26c0aee55cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3683577-0991-4e03-b8c5-b3519335935c", "tag": "9f0071a2-f26a-4b60-9753-c1efc5a5abd8"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:38.027225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-189fedcf-dee2-4f5d-9197-483a300a60e0 req-46a30f53-c804-479b-8ea1-a26c0aee55cd service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:38.029451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-189fedcf-dee2-4f5d-9197-483a300a60e0 req-46a30f53-c804-479b-8ea1-a26c0aee55cd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:38.030953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-189fedcf-dee2-4f5d-9197-483a300a60e0 req-46a30f53-c804-479b-8ea1-a26c0aee55cd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:38.050194 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-189fedcf-dee2-4f5d-9197-483a300a60e0 req-46a30f53-c804-479b-8ea1-a26c0aee55cd service nova] Creating event network-changed:9f0071a2-f26a-4b60-9753-c1efc5a5abd8 for instance c3683577-0991-4e03-b8c5-b3519335935c on n-h1-858384-13 Oct 18 13:21:38.056480 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-189fedcf-dee2-4f5d-9197-483a300a60e0 req-46a30f53-c804-479b-8ea1-a26c0aee55cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051122 Oct 18 13:21:38.057990 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 656/1340] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:21:38.160698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-62157f22-cf58-495c-ad83-20d822ecb222 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:38.171457 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-62157f22-cf58-495c-ad83-20d822ecb222 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1522 microversion: 2.1 time: 0.431917 Oct 18 13:21:38.172371 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 685/1341] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:37 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:38.199522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a8b3e606-cf13-4b5b-b5e6-3f27df4a1387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:38.201151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a8b3e606-cf13-4b5b-b5e6-3f27df4a1387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:38.208534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8b3e606-cf13-4b5b-b5e6-3f27df4a1387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:38.209424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8b3e606-cf13-4b5b-b5e6-3f27df4a1387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:38.210128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8b3e606-cf13-4b5b-b5e6-3f27df4a1387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:38.211064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8b3e606-cf13-4b5b-b5e6-3f27df4a1387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:38.211754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8b3e606-cf13-4b5b-b5e6-3f27df4a1387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:38.212450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8b3e606-cf13-4b5b-b5e6-3f27df4a1387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:38.324560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2b389b80-066f-4fef-8f71-0744a05badb2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:38.326646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2b389b80-066f-4fef-8f71-0744a05badb2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:38.333773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b389b80-066f-4fef-8f71-0744a05badb2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:38.334637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b389b80-066f-4fef-8f71-0744a05badb2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:38.335330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b389b80-066f-4fef-8f71-0744a05badb2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:38.339149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b389b80-066f-4fef-8f71-0744a05badb2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:38.339962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b389b80-066f-4fef-8f71-0744a05badb2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:38.340611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b389b80-066f-4fef-8f71-0744a05badb2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:38.445794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a8b3e606-cf13-4b5b-b5e6-3f27df4a1387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:38.457371 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a8b3e606-cf13-4b5b-b5e6-3f27df4a1387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1522 microversion: 2.1 time: 0.264280 Oct 18 13:21:38.457973 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 657/1342] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:38 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:38.485370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d77d25df-508a-43e1-b5d0-5766f0bd080b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d77d25df-508a-43e1-b5d0-5766f0bd080b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action HTTP/1.1 Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 285 Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:21:38.500485 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:21:38.502410 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:21:38.502410 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:38.502410 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:21:38.502410 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:38.502410 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:21:38.502410 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:21:38.502410 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:21:38.502410 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:21:38.502410 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:21:38.502410 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:21:38.502410 n-d-858384-13 devstack@n-api.service[120612]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 18 13:21:38.503127 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:21:38.503127 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:21:38.503127 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '8dfa9249-2680-4175-8114-fc18cdb0c117', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 18 13:21:38.503127 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:21:38.503127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:38.503127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:21:38.503127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:21:38.503127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:21:38.503127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:21:38.503127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:21:38.503756 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:21:38.504989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:21:38.504989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:21:38.504989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:21:38.504989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:21:38.504989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:21:38.504989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:38.504989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:38.504989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:38.504989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:38.504989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:38.504989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:38.504989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:21:38.504989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:21:38.505848 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:21:38.505848 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:21:38.507615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d77d25df-508a-43e1-b5d0-5766f0bd080b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:21:38.514386 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d77d25df-508a-43e1-b5d0-5766f0bd080b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action" status: 400 len: 619 microversion: 2.1 time: 0.036972 Oct 18 13:21:38.515362 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 658/1343] 10.222.0.40 () {60 vars in 1279 bytes} [Tue Oct 18 13:21:38 2022] POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:21:38.527378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e56124bc-8c41-4f23-b55b-1e936d5c2584 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:38.528463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e56124bc-8c41-4f23-b55b-1e936d5c2584 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:38.538676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2b389b80-066f-4fef-8f71-0744a05badb2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:38.549842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e56124bc-8c41-4f23-b55b-1e936d5c2584 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:38.550581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e56124bc-8c41-4f23-b55b-1e936d5c2584 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:38.551143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2b389b80-066f-4fef-8f71-0744a05badb2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:38.551525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e56124bc-8c41-4f23-b55b-1e936d5c2584 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:38.552452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e56124bc-8c41-4f23-b55b-1e936d5c2584 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:38.552796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2b389b80-066f-4fef-8f71-0744a05badb2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:38.553413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e56124bc-8c41-4f23-b55b-1e936d5c2584 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:38.554288 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2b389b80-066f-4fef-8f71-0744a05badb2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.233995 Oct 18 13:21:38.554982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e56124bc-8c41-4f23-b55b-1e936d5c2584 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:38.558094 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 686/1344] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:38 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:21:38.734904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8d49a5a0-d9a8-489c-b407-60ae322e39e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:38.735108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8d49a5a0-d9a8-489c-b407-60ae322e39e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:38.748213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d49a5a0-d9a8-489c-b407-60ae322e39e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:38.748535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d49a5a0-d9a8-489c-b407-60ae322e39e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:38.748935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d49a5a0-d9a8-489c-b407-60ae322e39e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:38.749672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d49a5a0-d9a8-489c-b407-60ae322e39e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:38.750126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d49a5a0-d9a8-489c-b407-60ae322e39e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:38.750638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d49a5a0-d9a8-489c-b407-60ae322e39e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:38.945024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8d49a5a0-d9a8-489c-b407-60ae322e39e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:38.946948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e56124bc-8c41-4f23-b55b-1e936d5c2584 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:38.958045 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8d49a5a0-d9a8-489c-b407-60ae322e39e9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1312 microversion: 2.1 time: 0.227860 Oct 18 13:21:38.958972 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 687/1345] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:38 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1312 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:38.959323 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e56124bc-8c41-4f23-b55b-1e936d5c2584 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1522 microversion: 2.1 time: 0.439234 Oct 18 13:21:38.960978 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 659/1346] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:38 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:38.982910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9e41e9d1-f7ea-41a6-b2d6-771ca165e93e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:38.983444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9e41e9d1-f7ea-41a6-b2d6-771ca165e93e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:38.987190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-10ac4974-32c8-4598-9056-d487d934ea74 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:38.990335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e41e9d1-f7ea-41a6-b2d6-771ca165e93e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:38.990821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e41e9d1-f7ea-41a6-b2d6-771ca165e93e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:38.991251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e41e9d1-f7ea-41a6-b2d6-771ca165e93e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:38.992244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-10ac4974-32c8-4598-9056-d487d934ea74 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:38.995295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e41e9d1-f7ea-41a6-b2d6-771ca165e93e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:38.996067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e41e9d1-f7ea-41a6-b2d6-771ca165e93e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:38.996667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e41e9d1-f7ea-41a6-b2d6-771ca165e93e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:39.005315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10ac4974-32c8-4598-9056-d487d934ea74 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:39.006076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10ac4974-32c8-4598-9056-d487d934ea74 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:39.006684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10ac4974-32c8-4598-9056-d487d934ea74 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:39.013126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10ac4974-32c8-4598-9056-d487d934ea74 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:39.014071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10ac4974-32c8-4598-9056-d487d934ea74 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:39.014686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10ac4974-32c8-4598-9056-d487d934ea74 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:39.193950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9e41e9d1-f7ea-41a6-b2d6-771ca165e93e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:39.205847 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9e41e9d1-f7ea-41a6-b2d6-771ca165e93e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1306 microversion: 2.1 time: 0.245749 Oct 18 13:21:39.206957 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 688/1347] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:38 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1306 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:39.546595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-10ac4974-32c8-4598-9056-d487d934ea74 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:39.557753 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-10ac4974-32c8-4598-9056-d487d934ea74 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1522 microversion: 2.1 time: 0.574358 Oct 18 13:21:39.558465 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 660/1348] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:38 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1522 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:39.585153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-77eafa0d-fc7f-4680-8d7e-b9886f695c72 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1227155230"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:39.589010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-09a0f45f-03c3-4466-bc70-195ebef7884d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:39.590226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-09a0f45f-03c3-4466-bc70-195ebef7884d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:39.590702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-77eafa0d-fc7f-4680-8d7e-b9886f695c72 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:39.598166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77eafa0d-fc7f-4680-8d7e-b9886f695c72 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:39.598662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77eafa0d-fc7f-4680-8d7e-b9886f695c72 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:39.599373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77eafa0d-fc7f-4680-8d7e-b9886f695c72 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:39.599805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77eafa0d-fc7f-4680-8d7e-b9886f695c72 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:39.600261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77eafa0d-fc7f-4680-8d7e-b9886f695c72 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:39.600949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77eafa0d-fc7f-4680-8d7e-b9886f695c72 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:39.601354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09a0f45f-03c3-4466-bc70-195ebef7884d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:39.625588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09a0f45f-03c3-4466-bc70-195ebef7884d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:39.626538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09a0f45f-03c3-4466-bc70-195ebef7884d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:39.627521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09a0f45f-03c3-4466-bc70-195ebef7884d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:39.634297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09a0f45f-03c3-4466-bc70-195ebef7884d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:39.636561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09a0f45f-03c3-4466-bc70-195ebef7884d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:39.837829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09a0f45f-03c3-4466-bc70-195ebef7884d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:39.848989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09a0f45f-03c3-4466-bc70-195ebef7884d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:39.850554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09a0f45f-03c3-4466-bc70-195ebef7884d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:39.851761 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-09a0f45f-03c3-4466-bc70-195ebef7884d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.273100 Oct 18 13:21:39.852656 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 689/1349] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:39 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:21:39.965614 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-77eafa0d-fc7f-4680-8d7e-b9886f695c72 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action" status: 202 len: 0 microversion: 2.1 time: 0.384527 Oct 18 13:21:39.968387 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 661/1350] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:21:39 2022] POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:21:39.978924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d36581ea-6467-4629-8f33-3d322d885019 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-688127014"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:39.981449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d36581ea-6467-4629-8f33-3d322d885019 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:39.983629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0bf04d60-b746-45fb-8625-189d7a16bdeb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:39.985302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0bf04d60-b746-45fb-8625-189d7a16bdeb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:39.999483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0bf04d60-b746-45fb-8625-189d7a16bdeb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:40.000162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0bf04d60-b746-45fb-8625-189d7a16bdeb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:40.000513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d36581ea-6467-4629-8f33-3d322d885019 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:40.001088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0bf04d60-b746-45fb-8625-189d7a16bdeb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:40.001367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d36581ea-6467-4629-8f33-3d322d885019 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:40.001581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d36581ea-6467-4629-8f33-3d322d885019 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:40.001955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0bf04d60-b746-45fb-8625-189d7a16bdeb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:40.002310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d36581ea-6467-4629-8f33-3d322d885019 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:40.002492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0bf04d60-b746-45fb-8625-189d7a16bdeb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:40.003282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0bf04d60-b746-45fb-8625-189d7a16bdeb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:40.009263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d36581ea-6467-4629-8f33-3d322d885019 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:40.009741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d36581ea-6467-4629-8f33-3d322d885019 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:40.105131 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-d36581ea-6467-4629-8f33-3d322d885019 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] HTTP exception thrown: Cannot 'createImage' instance 8dfa9249-2680-4175-8114-fc18cdb0c117 while it is in task_state image_snapshot_pending Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d36581ea-6467-4629-8f33-3d322d885019 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action HTTP/1.1 Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 84 Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:21:40.107061 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:21:40.108831 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:21:40.108831 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:40.108831 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:21:40.108831 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:40.108831 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:21:40.108831 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:21:40.108831 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:21:40.108831 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:21:40.108831 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:21:40.108831 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:21:40.108831 n-d-858384-13 devstack@n-api.service[120611]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-688127014"}} Oct 18 13:21:40.108831 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: exception: Cannot 'createImage' instance 8dfa9249-2680-4175-8114-fc18cdb0c117 while it is in task_state image_snapshot_pending Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '8dfa9249-2680-4175-8114-fc18cdb0c117', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-688127014'}}} Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:21:40.109774 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 8dfa9249-2680-4175-8114-fc18cdb0c117 while it is in task_state image_snapshot_pending Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 8dfa9249-2680-4175-8114-fc18cdb0c117 while it is in task_state image_snapshot_pending Oct 18 13:21:40.111923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:40.123204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d36581ea-6467-4629-8f33-3d322d885019 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 409 to user: Cannot 'createImage' instance 8dfa9249-2680-4175-8114-fc18cdb0c117 while it is in task_state image_snapshot_pending {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:21:40.124501 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d36581ea-6467-4629-8f33-3d322d885019 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action" status: 409 len: 167 microversion: 2.1 time: 0.149665 Oct 18 13:21:40.126150 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 690/1351] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:21:39 2022] POST /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117/action => generated 167 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:21:40.139805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-65245315-0bff-492a-811e-0fdfa5580f4f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '.version_select at 0x7ff60f7a8940>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:40.387005 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-65245315-0bff-492a-811e-0fdfa5580f4f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "DELETE /compute/v2.1/images/897eb6f6-557d-4bed-9045-65ba9d72bbed" status: 204 len: 0 microversion: 2.1 time: 0.256822 Oct 18 13:21:40.391770 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 691/1352] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:40 2022] DELETE /compute/v2.1/images/897eb6f6-557d-4bed-9045-65ba9d72bbed => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:21:40.397141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cd046d92-0053-4e0a-a1e5-69db4a1273e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:40.398275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cd046d92-0053-4e0a-a1e5-69db4a1273e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:40.412270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd046d92-0053-4e0a-a1e5-69db4a1273e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:40.413546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd046d92-0053-4e0a-a1e5-69db4a1273e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:40.414798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd046d92-0053-4e0a-a1e5-69db4a1273e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:40.421159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd046d92-0053-4e0a-a1e5-69db4a1273e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:40.421980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd046d92-0053-4e0a-a1e5-69db4a1273e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:40.422658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd046d92-0053-4e0a-a1e5-69db4a1273e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:40.463239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0bf04d60-b746-45fb-8625-189d7a16bdeb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:40.477658 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0bf04d60-b746-45fb-8625-189d7a16bdeb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1312 microversion: 2.1 time: 0.499298 Oct 18 13:21:40.500008 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 662/1353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:39 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1312 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:40.507689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bde10577-ddb7-4ee8-a353-0e2c3df089fe tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:40.508675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bde10577-ddb7-4ee8-a353-0e2c3df089fe tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:40.518233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bde10577-ddb7-4ee8-a353-0e2c3df089fe tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:40.519163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bde10577-ddb7-4ee8-a353-0e2c3df089fe tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:40.520055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bde10577-ddb7-4ee8-a353-0e2c3df089fe tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:40.521027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bde10577-ddb7-4ee8-a353-0e2c3df089fe tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:40.521732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bde10577-ddb7-4ee8-a353-0e2c3df089fe tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:40.523205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bde10577-ddb7-4ee8-a353-0e2c3df089fe tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:40.715288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cd046d92-0053-4e0a-a1e5-69db4a1273e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:40.730428 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cd046d92-0053-4e0a-a1e5-69db4a1273e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1306 microversion: 2.1 time: 0.337068 Oct 18 13:21:40.731752 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 692/1354] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:40 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1306 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:40.867680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bde10577-ddb7-4ee8-a353-0e2c3df089fe tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:40.883954 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bde10577-ddb7-4ee8-a353-0e2c3df089fe tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1534 microversion: 2.1 time: 0.382325 Oct 18 13:21:40.901858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5975767b-85b4-48c2-859d-a0d58dd24749 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Action: 'create', calling method: .version_select at 0x7ff60f7a80d0>, body: {"keypair": {"name": "tempest-keypair-1146475713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIKlly+VVBMG6YpP6nW7L5Rd+0kWRPujKi9SSIWnQICaUmkn80rkPkV6opUTOhmjfe3KwhnY5R7UrMtFxJ4NqAVt8Nu6+7Pc3vzYbVZDATSKScZicyLNFtnVxrDBGZsNg=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:40.910169 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 663/1355] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:40 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1534 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:40.915277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c5e43eb7-625c-4f6b-b150-9d480fa80fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:40.920265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c5e43eb7-625c-4f6b-b150-9d480fa80fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:40.937240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5e43eb7-625c-4f6b-b150-9d480fa80fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:40.939804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-5975767b-85b4-48c2-859d-a0d58dd24749 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Getting quotas for project bbe4fe5608ed40079ecd55a948937103. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:21:40.940696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5e43eb7-625c-4f6b-b150-9d480fa80fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:40.943371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5e43eb7-625c-4f6b-b150-9d480fa80fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:40.944650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5e43eb7-625c-4f6b-b150-9d480fa80fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:40.948082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5e43eb7-625c-4f6b-b150-9d480fa80fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:40.949978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5e43eb7-625c-4f6b-b150-9d480fa80fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:40.959312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-5975767b-85b4-48c2-859d-a0d58dd24749 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Getting quotas for user 4ec522b9bfa0455084d74f7bfabe183c and project bbe4fe5608ed40079ecd55a948937103. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:21:41.025806 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5975767b-85b4-48c2-859d-a0d58dd24749 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.288007 Oct 18 13:21:41.034022 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 693/1356] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:21:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:41.510261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a91c8fd-99f5-4c01-8d68-8f05496030a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:41.511613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1a91c8fd-99f5-4c01-8d68-8f05496030a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:41.540373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a91c8fd-99f5-4c01-8d68-8f05496030a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:41.540873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a91c8fd-99f5-4c01-8d68-8f05496030a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:41.541518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a91c8fd-99f5-4c01-8d68-8f05496030a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:41.542599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a91c8fd-99f5-4c01-8d68-8f05496030a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:41.543076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a91c8fd-99f5-4c01-8d68-8f05496030a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:41.543507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a91c8fd-99f5-4c01-8d68-8f05496030a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:41.687983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c5e43eb7-625c-4f6b-b150-9d480fa80fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:41.709590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c5e43eb7-625c-4f6b-b150-9d480fa80fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:41.714465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c5e43eb7-625c-4f6b-b150-9d480fa80fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:41.719332 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c5e43eb7-625c-4f6b-b150-9d480fa80fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.807232 Oct 18 13:21:41.720625 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 664/1357] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:40 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:21:41.762573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b1ed9287-2e25-4974-b885-ae2012e19991 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:41.763747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b1ed9287-2e25-4974-b885-ae2012e19991 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:41.790265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1ed9287-2e25-4974-b885-ae2012e19991 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:41.791168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1ed9287-2e25-4974-b885-ae2012e19991 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:41.791970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1ed9287-2e25-4974-b885-ae2012e19991 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:41.793271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1ed9287-2e25-4974-b885-ae2012e19991 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:41.794659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1ed9287-2e25-4974-b885-ae2012e19991 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:41.810912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1ed9287-2e25-4974-b885-ae2012e19991 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:42.460095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b1ed9287-2e25-4974-b885-ae2012e19991 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:42.478156 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b1ed9287-2e25-4974-b885-ae2012e19991 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1306 microversion: 2.1 time: 0.722867 Oct 18 13:21:42.493211 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 665/1358] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:41 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1306 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:42.493211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7e0508dc-59ed-4c69-9f89-802116c97e47 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:42.493211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7e0508dc-59ed-4c69-9f89-802116c97e47 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:42.503916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e0508dc-59ed-4c69-9f89-802116c97e47 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:42.504410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e0508dc-59ed-4c69-9f89-802116c97e47 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:42.504848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e0508dc-59ed-4c69-9f89-802116c97e47 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:42.505591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e0508dc-59ed-4c69-9f89-802116c97e47 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:42.506039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e0508dc-59ed-4c69-9f89-802116c97e47 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:42.506455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e0508dc-59ed-4c69-9f89-802116c97e47 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:42.608395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1a91c8fd-99f5-4c01-8d68-8f05496030a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:42.619927 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1a91c8fd-99f5-4c01-8d68-8f05496030a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1312 microversion: 2.1 time: 1.113680 Oct 18 13:21:42.620546 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 694/1359] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:41 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1312 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:42.752891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9036d3a0-0b8a-414a-911e-853bf3683c20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:42.756686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9036d3a0-0b8a-414a-911e-853bf3683c20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:42.769161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9036d3a0-0b8a-414a-911e-853bf3683c20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:42.769661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9036d3a0-0b8a-414a-911e-853bf3683c20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:42.770316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9036d3a0-0b8a-414a-911e-853bf3683c20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:42.771202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9036d3a0-0b8a-414a-911e-853bf3683c20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:42.772689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9036d3a0-0b8a-414a-911e-853bf3683c20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:42.775408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9036d3a0-0b8a-414a-911e-853bf3683c20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:43.241160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7e0508dc-59ed-4c69-9f89-802116c97e47 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:43.257129 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7e0508dc-59ed-4c69-9f89-802116c97e47 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1540 microversion: 2.1 time: 0.776936 Oct 18 13:21:43.288645 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 666/1360] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:42 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1540 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:43.328674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9036d3a0-0b8a-414a-911e-853bf3683c20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:43.340267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9036d3a0-0b8a-414a-911e-853bf3683c20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:43.342743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9036d3a0-0b8a-414a-911e-853bf3683c20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:43.344205 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9036d3a0-0b8a-414a-911e-853bf3683c20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.595598 Oct 18 13:21:43.360328 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 695/1361] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:42 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:21:43.505419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8aec4410-e661-4e6a-b97b-d72d891368fa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:43.506992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8aec4410-e661-4e6a-b97b-d72d891368fa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:43.514482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8aec4410-e661-4e6a-b97b-d72d891368fa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:43.517502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8aec4410-e661-4e6a-b97b-d72d891368fa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:43.518053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8aec4410-e661-4e6a-b97b-d72d891368fa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:43.518870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8aec4410-e661-4e6a-b97b-d72d891368fa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:43.519392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8aec4410-e661-4e6a-b97b-d72d891368fa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:43.519874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8aec4410-e661-4e6a-b97b-d72d891368fa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:43.647320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-55ef3a1a-9261-499a-9b99-94918dc00c5a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:43.647954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-55ef3a1a-9261-499a-9b99-94918dc00c5a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:43.665321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55ef3a1a-9261-499a-9b99-94918dc00c5a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:43.666237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55ef3a1a-9261-499a-9b99-94918dc00c5a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:43.667549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55ef3a1a-9261-499a-9b99-94918dc00c5a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:43.669559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55ef3a1a-9261-499a-9b99-94918dc00c5a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:43.670273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55ef3a1a-9261-499a-9b99-94918dc00c5a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:43.670809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55ef3a1a-9261-499a-9b99-94918dc00c5a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:43.925601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8aec4410-e661-4e6a-b97b-d72d891368fa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:43.954558 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8aec4410-e661-4e6a-b97b-d72d891368fa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1306 microversion: 2.1 time: 0.452927 Oct 18 13:21:43.972034 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 667/1362] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:43 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1306 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:44.284795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-65af66b8-316b-4082-8376-a5f096dfafcc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:44.286906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-65af66b8-316b-4082-8376-a5f096dfafcc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:44.302684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65af66b8-316b-4082-8376-a5f096dfafcc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:44.306189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65af66b8-316b-4082-8376-a5f096dfafcc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:44.306890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65af66b8-316b-4082-8376-a5f096dfafcc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:44.311415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65af66b8-316b-4082-8376-a5f096dfafcc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:44.312225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65af66b8-316b-4082-8376-a5f096dfafcc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:44.314708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65af66b8-316b-4082-8376-a5f096dfafcc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:44.382020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:44.416552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-55ef3a1a-9261-499a-9b99-94918dc00c5a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:44.432612 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-55ef3a1a-9261-499a-9b99-94918dc00c5a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1312 microversion: 2.1 time: 0.789481 Oct 18 13:21:44.450156 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 696/1363] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:43 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1312 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:44.457968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8841311e-6968-4187-a9e5-b962bde356fc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:44.458831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8841311e-6968-4187-a9e5-b962bde356fc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:44.465567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8841311e-6968-4187-a9e5-b962bde356fc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:44.466341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8841311e-6968-4187-a9e5-b962bde356fc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:44.467140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8841311e-6968-4187-a9e5-b962bde356fc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:44.468039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8841311e-6968-4187-a9e5-b962bde356fc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:44.468660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8841311e-6968-4187-a9e5-b962bde356fc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:44.469290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8841311e-6968-4187-a9e5-b962bde356fc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:44.778714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-65af66b8-316b-4082-8376-a5f096dfafcc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:44.794753 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-65af66b8-316b-4082-8376-a5f096dfafcc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1522 microversion: 2.1 time: 0.514357 Oct 18 13:21:44.796075 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 668/1364] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:44 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:44.847187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8841311e-6968-4187-a9e5-b962bde356fc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:44.849577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:44.866685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8841311e-6968-4187-a9e5-b962bde356fc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:44.868309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8841311e-6968-4187-a9e5-b962bde356fc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:44.869577 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8841311e-6968-4187-a9e5-b962bde356fc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.418285 Oct 18 13:21:44.870268 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 697/1365] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:44 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:21:44.886076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-172171385", "imageRef": "4dcb6f75-89ca-4390-a376-6609c76ecfa3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ae0423fe-24d5-4927-9bb0-f2c75dfe7b7a"}], "security_groups": [{"name": "tempest-securitygroup--394840246"}], "key_name": "tempest-keypair-1146475713", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:44.901699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d1709631-a139-4ba8-b178-77787a17ac72 req-89a3c154-5727-4480-9d9f-431ca0e3ff1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfa9249-2680-4175-8114-fc18cdb0c117", "name": "network-vif-plugged", "status": "completed", "tag": "5fc3300f-70ef-46dd-9666-925c4793e0a2"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:44.918675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d1709631-a139-4ba8-b178-77787a17ac72 req-89a3c154-5727-4480-9d9f-431ca0e3ff1e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:44.918836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d1709631-a139-4ba8-b178-77787a17ac72 req-89a3c154-5727-4480-9d9f-431ca0e3ff1e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:44.919282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d1709631-a139-4ba8-b178-77787a17ac72 req-89a3c154-5727-4480-9d9f-431ca0e3ff1e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:44.936311 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d1709631-a139-4ba8-b178-77787a17ac72 req-89a3c154-5727-4480-9d9f-431ca0e3ff1e service nova] Creating event network-vif-plugged:5fc3300f-70ef-46dd-9666-925c4793e0a2 for instance 8dfa9249-2680-4175-8114-fc18cdb0c117 on n-h2-858384-13 Oct 18 13:21:44.944893 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d1709631-a139-4ba8-b178-77787a17ac72 req-89a3c154-5727-4480-9d9f-431ca0e3ff1e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147249 Oct 18 13:21:44.948636 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 669/1366] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:44.964356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1d703670-7fde-44c9-a843-6241390641e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:44.965026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1d703670-7fde-44c9-a843-6241390641e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:44.980322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d703670-7fde-44c9-a843-6241390641e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:44.981823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d703670-7fde-44c9-a843-6241390641e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:44.982441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d703670-7fde-44c9-a843-6241390641e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:44.985532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d703670-7fde-44c9-a843-6241390641e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:44.986165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d703670-7fde-44c9-a843-6241390641e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:44.989354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d703670-7fde-44c9-a843-6241390641e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:45.023533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1d703670-7fde-44c9-a843-6241390641e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:21:45.103786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] validate_networks() for [('ae0423fe-24d5-4927-9bb0-f2c75dfe7b7a', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:21:45.147472 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1d703670-7fde-44c9-a843-6241390641e0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 204 len: 0 microversion: 2.1 time: 0.196768 Oct 18 13:21:45.148758 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 670/1367] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:21:44 2022] DELETE /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:21:45.161008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe65e81a-ffb0-4628-b925-7bfee7e6953d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:45.162339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe65e81a-ffb0-4628-b925-7bfee7e6953d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:45.170198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe65e81a-ffb0-4628-b925-7bfee7e6953d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:45.173098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe65e81a-ffb0-4628-b925-7bfee7e6953d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:45.173971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe65e81a-ffb0-4628-b925-7bfee7e6953d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:45.176242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe65e81a-ffb0-4628-b925-7bfee7e6953d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:45.177877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe65e81a-ffb0-4628-b925-7bfee7e6953d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:45.178505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe65e81a-ffb0-4628-b925-7bfee7e6953d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:45.395916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe65e81a-ffb0-4628-b925-7bfee7e6953d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:45.406812 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fe65e81a-ffb0-4628-b925-7bfee7e6953d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1306 microversion: 2.1 time: 0.255059 Oct 18 13:21:45.407422 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 671/1368] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:45 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1306 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:45.421475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3bcbf036-c9f8-4680-bb1f-593a0c620560 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:45.422083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3bcbf036-c9f8-4680-bb1f-593a0c620560 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:45.433808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3bcbf036-c9f8-4680-bb1f-593a0c620560 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:45.434803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3bcbf036-c9f8-4680-bb1f-593a0c620560 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:45.435371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3bcbf036-c9f8-4680-bb1f-593a0c620560 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:45.436066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3bcbf036-c9f8-4680-bb1f-593a0c620560 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:45.436513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3bcbf036-c9f8-4680-bb1f-593a0c620560 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:45.440976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3bcbf036-c9f8-4680-bb1f-593a0c620560 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:45.627792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3bcbf036-c9f8-4680-bb1f-593a0c620560 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:45.645884 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3bcbf036-c9f8-4680-bb1f-593a0c620560 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1528 microversion: 2.1 time: 0.233722 Oct 18 13:21:45.663326 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 672/1369] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:45 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1528 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:45.670105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e16fa271-1f9d-4307-b152-bfe29daae025 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:45.671438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e16fa271-1f9d-4307-b152-bfe29daae025 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:45.680475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e16fa271-1f9d-4307-b152-bfe29daae025 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:45.681323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e16fa271-1f9d-4307-b152-bfe29daae025 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:45.682144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e16fa271-1f9d-4307-b152-bfe29daae025 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:45.683242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e16fa271-1f9d-4307-b152-bfe29daae025 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:45.683917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e16fa271-1f9d-4307-b152-bfe29daae025 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:45.685154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e16fa271-1f9d-4307-b152-bfe29daae025 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:45.717668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:21:45.718743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:21:45.719432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:21:45.720104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:21:45.720686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:21:45.737672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:45.738464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:45.739204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:45.740122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:45.742848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:45.743516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:45.763618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Getting quotas for project bbe4fe5608ed40079ecd55a948937103. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:21:45.771946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Getting quotas for user 4ec522b9bfa0455084d74f7bfabe183c and project bbe4fe5608ed40079ecd55a948937103. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:21:45.790307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:21:45.792987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4dcb6f75-89ca-4390-a376-6609c76ecfa3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:21:45.863856 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1a070d6b-b2d6-43ff-8c0a-89363beebff2 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.992438 Oct 18 13:21:45.866031 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 698/1370] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:21:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:21:45.882082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e16fa271-1f9d-4307-b152-bfe29daae025 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:45.883425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-65cf54b1-5c83-4f50-bc7b-2e5fbaa64215 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:45.884454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-65cf54b1-5c83-4f50-bc7b-2e5fbaa64215 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:45.895855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:45.902801 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e16fa271-1f9d-4307-b152-bfe29daae025 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1312 microversion: 2.1 time: 0.237511 Oct 18 13:21:45.926281 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 673/1371] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:45 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1312 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:45.957540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-61b4806b-085c-465b-a009-3b176f5fb549 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:45.959398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-61b4806b-085c-465b-a009-3b176f5fb549 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:45.972477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61b4806b-085c-465b-a009-3b176f5fb549 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:45.973428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61b4806b-085c-465b-a009-3b176f5fb549 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:45.976046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61b4806b-085c-465b-a009-3b176f5fb549 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:45.977029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61b4806b-085c-465b-a009-3b176f5fb549 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:45.977674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61b4806b-085c-465b-a009-3b176f5fb549 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:45.979430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61b4806b-085c-465b-a009-3b176f5fb549 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:45.998579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-65cf54b1-5c83-4f50-bc7b-2e5fbaa64215 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:46.010002 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-65cf54b1-5c83-4f50-bc7b-2e5fbaa64215 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1245 microversion: 2.1 time: 0.134406 Oct 18 13:21:46.017355 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 699/1372] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:45 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1245 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:46.263040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-61b4806b-085c-465b-a009-3b176f5fb549 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:46.276477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-61b4806b-085c-465b-a009-3b176f5fb549 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:46.279058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-61b4806b-085c-465b-a009-3b176f5fb549 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:46.281045 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-61b4806b-085c-465b-a009-3b176f5fb549 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.353695 Oct 18 13:21:46.302542 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 674/1373] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:45 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:21:46.433383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cd5fb521-630e-42f8-8ceb-7a47be87b585 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:46.434132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cd5fb521-630e-42f8-8ceb-7a47be87b585 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:46.443545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd5fb521-630e-42f8-8ceb-7a47be87b585 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:46.444356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd5fb521-630e-42f8-8ceb-7a47be87b585 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:46.445442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd5fb521-630e-42f8-8ceb-7a47be87b585 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:46.448434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd5fb521-630e-42f8-8ceb-7a47be87b585 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:46.449347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd5fb521-630e-42f8-8ceb-7a47be87b585 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:46.450532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd5fb521-630e-42f8-8ceb-7a47be87b585 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:46.635702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cd5fb521-630e-42f8-8ceb-7a47be87b585 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:46.648944 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cd5fb521-630e-42f8-8ceb-7a47be87b585 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1306 microversion: 2.1 time: 0.221232 Oct 18 13:21:46.661998 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 700/1374] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:46 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1306 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:46.673333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31c41a6a-66ae-4c80-be29-c13886f439f3 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:46.674230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-31c41a6a-66ae-4c80-be29-c13886f439f3 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:46.682149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c41a6a-66ae-4c80-be29-c13886f439f3 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:46.683634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c41a6a-66ae-4c80-be29-c13886f439f3 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:46.685090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c41a6a-66ae-4c80-be29-c13886f439f3 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:46.687112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c41a6a-66ae-4c80-be29-c13886f439f3 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:46.687750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c41a6a-66ae-4c80-be29-c13886f439f3 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:46.688345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c41a6a-66ae-4c80-be29-c13886f439f3 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:46.897804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31c41a6a-66ae-4c80-be29-c13886f439f3 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:46.910140 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31c41a6a-66ae-4c80-be29-c13886f439f3 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1528 microversion: 2.1 time: 0.242340 Oct 18 13:21:46.927717 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 675/1375] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:46 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1528 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:46.945033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c4f60ea0-2949-408e-8bef-0b1beacdcc28 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:46.945782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c4f60ea0-2949-408e-8bef-0b1beacdcc28 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:46.956126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f60ea0-2949-408e-8bef-0b1beacdcc28 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:46.956616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f60ea0-2949-408e-8bef-0b1beacdcc28 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:46.957448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f60ea0-2949-408e-8bef-0b1beacdcc28 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:46.958890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f60ea0-2949-408e-8bef-0b1beacdcc28 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:46.959354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f60ea0-2949-408e-8bef-0b1beacdcc28 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:46.959784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f60ea0-2949-408e-8bef-0b1beacdcc28 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:46.985974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-32523d6e-0c92-48c3-b428-f7f98718d03a req-bffa35c3-ae39-4625-ac36-d70ee31a193c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d3172e-d216-47ef-a447-ef91d43bba4f", "name": "network-vif-plugged", "status": "completed", "tag": "6d3bfbc9-e165-4403-af03-a04bc52c63e5"}, {"server_uuid": "8dfa9249-2680-4175-8114-fc18cdb0c117", "name": "network-vif-unplugged", "status": "completed", "tag": "5fc3300f-70ef-46dd-9666-925c4793e0a2"}, {"server_uuid": "c3683577-0991-4e03-b8c5-b3519335935c", "name": "network-vif-plugged", "status": "completed", "tag": "9f0071a2-f26a-4b60-9753-c1efc5a5abd8"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:47.000271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-32523d6e-0c92-48c3-b428-f7f98718d03a req-bffa35c3-ae39-4625-ac36-d70ee31a193c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:47.000870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-32523d6e-0c92-48c3-b428-f7f98718d03a req-bffa35c3-ae39-4625-ac36-d70ee31a193c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:47.001295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-32523d6e-0c92-48c3-b428-f7f98718d03a req-bffa35c3-ae39-4625-ac36-d70ee31a193c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:47.030141 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-32523d6e-0c92-48c3-b428-f7f98718d03a req-bffa35c3-ae39-4625-ac36-d70ee31a193c service nova] Creating event network-vif-plugged:6d3bfbc9-e165-4403-af03-a04bc52c63e5 for instance 96d3172e-d216-47ef-a447-ef91d43bba4f on n-h1-858384-13 Oct 18 13:21:47.038386 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-32523d6e-0c92-48c3-b428-f7f98718d03a req-bffa35c3-ae39-4625-ac36-d70ee31a193c service nova] Creating event network-vif-unplugged:5fc3300f-70ef-46dd-9666-925c4793e0a2 for instance 8dfa9249-2680-4175-8114-fc18cdb0c117 on n-h2-858384-13 Oct 18 13:21:47.039517 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-32523d6e-0c92-48c3-b428-f7f98718d03a req-bffa35c3-ae39-4625-ac36-d70ee31a193c service nova] Creating event network-vif-plugged:9f0071a2-f26a-4b60-9753-c1efc5a5abd8 for instance c3683577-0991-4e03-b8c5-b3519335935c on n-h1-858384-13 Oct 18 13:21:47.057162 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-32523d6e-0c92-48c3-b428-f7f98718d03a req-bffa35c3-ae39-4625-ac36-d70ee31a193c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.076129 Oct 18 13:21:47.058767 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 676/1376] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:47.067196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-acf8970a-dd30-4854-ae65-a8ea86770fa8 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:47.068492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-acf8970a-dd30-4854-ae65-a8ea86770fa8 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:47.078777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acf8970a-dd30-4854-ae65-a8ea86770fa8 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:47.079333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acf8970a-dd30-4854-ae65-a8ea86770fa8 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:47.080126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acf8970a-dd30-4854-ae65-a8ea86770fa8 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:47.081046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acf8970a-dd30-4854-ae65-a8ea86770fa8 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:47.085479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acf8970a-dd30-4854-ae65-a8ea86770fa8 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:47.086981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acf8970a-dd30-4854-ae65-a8ea86770fa8 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:47.200526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-acf8970a-dd30-4854-ae65-a8ea86770fa8 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:47.211465 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-acf8970a-dd30-4854-ae65-a8ea86770fa8 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1297 microversion: 2.1 time: 0.150835 Oct 18 13:21:47.212735 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 677/1377] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:47 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1297 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:47.264963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c4f60ea0-2949-408e-8bef-0b1beacdcc28 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:47.275993 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c4f60ea0-2949-408e-8bef-0b1beacdcc28 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1312 microversion: 2.1 time: 0.337127 Oct 18 13:21:47.276625 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 701/1378] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:46 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1312 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:47.308738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f6b83fdf-f059-4a53-ad0d-292d41b84614 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:47.310052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f6b83fdf-f059-4a53-ad0d-292d41b84614 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:47.318202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6b83fdf-f059-4a53-ad0d-292d41b84614 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:47.318892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6b83fdf-f059-4a53-ad0d-292d41b84614 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:47.319517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6b83fdf-f059-4a53-ad0d-292d41b84614 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:47.320702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6b83fdf-f059-4a53-ad0d-292d41b84614 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:47.321422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6b83fdf-f059-4a53-ad0d-292d41b84614 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:47.322346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6b83fdf-f059-4a53-ad0d-292d41b84614 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:47.578808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f6b83fdf-f059-4a53-ad0d-292d41b84614 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:47.600640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f6b83fdf-f059-4a53-ad0d-292d41b84614 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:47.600640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f6b83fdf-f059-4a53-ad0d-292d41b84614 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:47.601186 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f6b83fdf-f059-4a53-ad0d-292d41b84614 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.296365 Oct 18 13:21:47.602201 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 678/1379] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:47 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:21:47.675804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca5da2f7-a9b9-40f2-b1e7-56734cbfe668 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:47.676486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca5da2f7-a9b9-40f2-b1e7-56734cbfe668 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:47.685721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca5da2f7-a9b9-40f2-b1e7-56734cbfe668 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:47.688735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca5da2f7-a9b9-40f2-b1e7-56734cbfe668 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:47.689412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca5da2f7-a9b9-40f2-b1e7-56734cbfe668 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:47.690692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca5da2f7-a9b9-40f2-b1e7-56734cbfe668 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:47.692922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca5da2f7-a9b9-40f2-b1e7-56734cbfe668 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:47.694553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca5da2f7-a9b9-40f2-b1e7-56734cbfe668 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:47.730570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-25567da2-7d33-4c5d-812b-5a36413a62d9 req-44417170-6f34-46ff-ac2c-bdfbc1d33471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfa9249-2680-4175-8114-fc18cdb0c117", "name": "network-vif-deleted", "tag": "5fc3300f-70ef-46dd-9666-925c4793e0a2"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:47.741896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-25567da2-7d33-4c5d-812b-5a36413a62d9 req-44417170-6f34-46ff-ac2c-bdfbc1d33471 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:47.742372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-25567da2-7d33-4c5d-812b-5a36413a62d9 req-44417170-6f34-46ff-ac2c-bdfbc1d33471 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:47.742982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-25567da2-7d33-4c5d-812b-5a36413a62d9 req-44417170-6f34-46ff-ac2c-bdfbc1d33471 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:47.763600 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-25567da2-7d33-4c5d-812b-5a36413a62d9 req-44417170-6f34-46ff-ac2c-bdfbc1d33471 service nova] Creating event network-vif-deleted:5fc3300f-70ef-46dd-9666-925c4793e0a2 for instance 8dfa9249-2680-4175-8114-fc18cdb0c117 on n-h2-858384-13 Oct 18 13:21:47.769105 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-25567da2-7d33-4c5d-812b-5a36413a62d9 req-44417170-6f34-46ff-ac2c-bdfbc1d33471 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042105 Oct 18 13:21:47.770442 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 679/1380] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:21:47.942859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:47.944297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:47.947057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:47.951567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ca5da2f7-a9b9-40f2-b1e7-56734cbfe668 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:47.958993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:47.959739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:47.960393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:47.961722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:47.962577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:47.963214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:47.964330 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca5da2f7-a9b9-40f2-b1e7-56734cbfe668 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1306 microversion: 2.1 time: 0.294339 Oct 18 13:21:47.968405 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 702/1381] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:47 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1306 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:48.002981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:48.003942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:48.004535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:48.005314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lazy-loading 'fault' on Instance uuid 8dfa9249-2680-4175-8114-fc18cdb0c117 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:21:48.071789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:48.082226 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-91c5682c-122d-4f6c-a461-559b15a4979b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 200 len: 1315 microversion: 2.1 time: 0.150484 Oct 18 13:21:48.097836 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 680/1382] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:47 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:48.236999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-372f2c50-e832-4e3e-8f45-e5b15cc6c180 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:48.238341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-372f2c50-e832-4e3e-8f45-e5b15cc6c180 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:48.251134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-372f2c50-e832-4e3e-8f45-e5b15cc6c180 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:48.254068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-372f2c50-e832-4e3e-8f45-e5b15cc6c180 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:48.254720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-372f2c50-e832-4e3e-8f45-e5b15cc6c180 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:48.256274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-372f2c50-e832-4e3e-8f45-e5b15cc6c180 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:48.257791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-372f2c50-e832-4e3e-8f45-e5b15cc6c180 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:48.258733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-372f2c50-e832-4e3e-8f45-e5b15cc6c180 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:48.299259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0f62320b-fcaf-4fa6-879a-bd45c6fa95a9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:48.299872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0f62320b-fcaf-4fa6-879a-bd45c6fa95a9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:48.314668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f62320b-fcaf-4fa6-879a-bd45c6fa95a9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:48.315369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f62320b-fcaf-4fa6-879a-bd45c6fa95a9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:48.316002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f62320b-fcaf-4fa6-879a-bd45c6fa95a9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:48.316878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f62320b-fcaf-4fa6-879a-bd45c6fa95a9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:48.317520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f62320b-fcaf-4fa6-879a-bd45c6fa95a9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:48.318099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f62320b-fcaf-4fa6-879a-bd45c6fa95a9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:48.408454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-372f2c50-e832-4e3e-8f45-e5b15cc6c180 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:48.421716 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-372f2c50-e832-4e3e-8f45-e5b15cc6c180 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1303 microversion: 2.1 time: 0.189373 Oct 18 13:21:48.422850 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 703/1383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:48 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1303 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:48.631900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f0dc3dc8-06d0-47e2-bf5e-2ba290369200 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:48.635381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f0dc3dc8-06d0-47e2-bf5e-2ba290369200 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:48.654634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0f62320b-fcaf-4fa6-879a-bd45c6fa95a9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:48.662975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0dc3dc8-06d0-47e2-bf5e-2ba290369200 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:48.666695 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0f62320b-fcaf-4fa6-879a-bd45c6fa95a9 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1312 microversion: 2.1 time: 0.371391 Oct 18 13:21:48.668015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0dc3dc8-06d0-47e2-bf5e-2ba290369200 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:48.669582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0dc3dc8-06d0-47e2-bf5e-2ba290369200 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:48.672987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0dc3dc8-06d0-47e2-bf5e-2ba290369200 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:48.674123 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 681/1384] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:48 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1312 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:48.677022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0dc3dc8-06d0-47e2-bf5e-2ba290369200 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:48.677956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0dc3dc8-06d0-47e2-bf5e-2ba290369200 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:48.992838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2ef7600-2861-4a57-ab5c-25314a7735ae tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:48.994158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d2ef7600-2861-4a57-ab5c-25314a7735ae tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:49.003266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2ef7600-2861-4a57-ab5c-25314a7735ae tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:49.004141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2ef7600-2861-4a57-ab5c-25314a7735ae tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:49.004911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2ef7600-2861-4a57-ab5c-25314a7735ae tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:49.006419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2ef7600-2861-4a57-ab5c-25314a7735ae tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:49.007400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2ef7600-2861-4a57-ab5c-25314a7735ae tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:49.008509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2ef7600-2861-4a57-ab5c-25314a7735ae tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:49.157466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f0dc3dc8-06d0-47e2-bf5e-2ba290369200 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:49.167709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f0dc3dc8-06d0-47e2-bf5e-2ba290369200 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:49.175050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f0dc3dc8-06d0-47e2-bf5e-2ba290369200 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:49.176322 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f0dc3dc8-06d0-47e2-bf5e-2ba290369200 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.552167 Oct 18 13:21:49.179233 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 704/1385] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:48 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:21:49.185960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-76b7d21c-54ee-441a-a86e-35f7e7c3f50e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:49.186770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-76b7d21c-54ee-441a-a86e-35f7e7c3f50e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:49.223668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76b7d21c-54ee-441a-a86e-35f7e7c3f50e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:49.224186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76b7d21c-54ee-441a-a86e-35f7e7c3f50e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:49.224744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76b7d21c-54ee-441a-a86e-35f7e7c3f50e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:49.225793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76b7d21c-54ee-441a-a86e-35f7e7c3f50e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:49.226638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76b7d21c-54ee-441a-a86e-35f7e7c3f50e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:49.241447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76b7d21c-54ee-441a-a86e-35f7e7c3f50e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:49.274243 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-76b7d21c-54ee-441a-a86e-35f7e7c3f50e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] HTTP exception thrown: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-76b7d21c-54ee-441a-a86e-35f7e7c3f50e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 HTTP/1.1 Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:21:49.275961 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:21:49.277759 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:21:49.277759 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:49.277759 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:21:49.277759 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:21:49.277759 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:21:49.277759 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:21:49.277759 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:21:49.277759 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:21:49.277759 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:21:49.277759 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:21:49.277759 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:21:49.277759 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '8dfa9249-2680-4175-8114-fc18cdb0c117'} Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:21:49.278778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:21:49.280508 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:21:49.282110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-76b7d21c-54ee-441a-a86e-35f7e7c3f50e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 404 to user: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:21:49.282110 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-76b7d21c-54ee-441a-a86e-35f7e7c3f50e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 404 len: 111 microversion: 2.1 time: 0.096841 Oct 18 13:21:49.289592 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 705/1386] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:49 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:21:49.305621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0dfb2487-cb8d-4027-b9e3-a7577029c1dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Action: 'create', calling method: .version_select at 0x7ff60f8171f0>, body: {"keypair": {"name": "tempest-keypair-1935182285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcX9z5RdAlOUat5m3c7eR1yKgFIL7COsdhx+QMGE2j6XZengTv238U6T7bijm42eRbFbSBuf4HceWSesXYGy+V+wHlrBbyGP1F2T/iEEVYXlPWfeXwAU5eltnZAcwi6DQ=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:49.349780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-0dfb2487-cb8d-4027-b9e3-a7577029c1dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Getting quotas for project 754e6b0adc07474caa392caa39c0e963. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:21:49.370220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-0dfb2487-cb8d-4027-b9e3-a7577029c1dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Getting quotas for user 0eeec944a5054ba9b7cd6ae3055230e7 and project 754e6b0adc07474caa392caa39c0e963. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:21:49.405218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d2ef7600-2861-4a57-ab5c-25314a7735ae tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:49.418949 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d2ef7600-2861-4a57-ab5c-25314a7735ae tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1306 microversion: 2.1 time: 0.429770 Oct 18 13:21:49.419914 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 682/1387] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:48 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1306 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:49.443837 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0dfb2487-cb8d-4027-b9e3-a7577029c1dc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.150636 Oct 18 13:21:49.446717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d301f8a-4e3b-483b-9b38-6efc54ff1504 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:49.447426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4d301f8a-4e3b-483b-9b38-6efc54ff1504 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:49.447735 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 706/1388] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:21:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:49.483602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d301f8a-4e3b-483b-9b38-6efc54ff1504 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:49.485531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d301f8a-4e3b-483b-9b38-6efc54ff1504 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:49.487727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d301f8a-4e3b-483b-9b38-6efc54ff1504 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:49.490319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d301f8a-4e3b-483b-9b38-6efc54ff1504 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:49.493880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d301f8a-4e3b-483b-9b38-6efc54ff1504 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:49.497088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d301f8a-4e3b-483b-9b38-6efc54ff1504 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:49.708969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac2a4c5a-7040-4878-aa07-90bb1ad8a804 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:49.712206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ac2a4c5a-7040-4878-aa07-90bb1ad8a804 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:49.743558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac2a4c5a-7040-4878-aa07-90bb1ad8a804 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:49.752215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac2a4c5a-7040-4878-aa07-90bb1ad8a804 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:49.753502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac2a4c5a-7040-4878-aa07-90bb1ad8a804 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:49.756981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac2a4c5a-7040-4878-aa07-90bb1ad8a804 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:49.758444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac2a4c5a-7040-4878-aa07-90bb1ad8a804 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:49.759861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac2a4c5a-7040-4878-aa07-90bb1ad8a804 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:50.058020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4d301f8a-4e3b-483b-9b38-6efc54ff1504 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:50.073632 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d301f8a-4e3b-483b-9b38-6efc54ff1504 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1370 microversion: 2.1 time: 0.628489 Oct 18 13:21:50.100701 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 683/1389] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:49 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1370 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:50.213072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f779d194-efc3-4fac-8ceb-f819c91bd7b2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:50.214167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f779d194-efc3-4fac-8ceb-f819c91bd7b2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:50.220817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f779d194-efc3-4fac-8ceb-f819c91bd7b2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:50.221653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f779d194-efc3-4fac-8ceb-f819c91bd7b2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:50.222414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f779d194-efc3-4fac-8ceb-f819c91bd7b2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:50.223349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f779d194-efc3-4fac-8ceb-f819c91bd7b2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:50.224843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f779d194-efc3-4fac-8ceb-f819c91bd7b2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:50.225664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f779d194-efc3-4fac-8ceb-f819c91bd7b2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:50.333587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ac2a4c5a-7040-4878-aa07-90bb1ad8a804 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:50.347394 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ac2a4c5a-7040-4878-aa07-90bb1ad8a804 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1312 microversion: 2.1 time: 0.648657 Oct 18 13:21:50.351234 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 707/1390] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:49 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1312 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:50.448120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-51aef02d-7c4c-4690-b84c-eea030cfffc9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:50.449142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-51aef02d-7c4c-4690-b84c-eea030cfffc9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:50.464094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51aef02d-7c4c-4690-b84c-eea030cfffc9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:50.464932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51aef02d-7c4c-4690-b84c-eea030cfffc9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:50.465638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51aef02d-7c4c-4690-b84c-eea030cfffc9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:50.468214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51aef02d-7c4c-4690-b84c-eea030cfffc9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:50.470146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51aef02d-7c4c-4690-b84c-eea030cfffc9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:50.470874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51aef02d-7c4c-4690-b84c-eea030cfffc9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:50.782998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-51aef02d-7c4c-4690-b84c-eea030cfffc9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:50.792582 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-51aef02d-7c4c-4690-b84c-eea030cfffc9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1486 microversion: 2.1 time: 0.349970 Oct 18 13:21:50.798047 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 708/1391] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:50 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1486 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:50.823741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fde25845-13e6-4bbc-ad03-f51d91660588 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:50.834067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fde25845-13e6-4bbc-ad03-f51d91660588 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:50.837885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fde25845-13e6-4bbc-ad03-f51d91660588 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:50.838607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fde25845-13e6-4bbc-ad03-f51d91660588 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:51.005135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fde25845-13e6-4bbc-ad03-f51d91660588 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Going to try to stop instance {{(pid=120611) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:21:51.151065 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fde25845-13e6-4bbc-ad03-f51d91660588 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c/action" status: 202 len: 0 microversion: 2.1 time: 0.328308 Oct 18 13:21:51.153738 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 709/1392] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:21:50 2022] POST /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:21:51.169226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5cabb797-eeae-4fe2-ac23-593f56a0ed9d tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:51.174608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5cabb797-eeae-4fe2-ac23-593f56a0ed9d tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:51.199321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5cabb797-eeae-4fe2-ac23-593f56a0ed9d tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:51.200704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5cabb797-eeae-4fe2-ac23-593f56a0ed9d tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:51.206971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5cabb797-eeae-4fe2-ac23-593f56a0ed9d tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:51.207898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5cabb797-eeae-4fe2-ac23-593f56a0ed9d tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:51.208481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5cabb797-eeae-4fe2-ac23-593f56a0ed9d tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:51.209054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5cabb797-eeae-4fe2-ac23-593f56a0ed9d tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:51.648118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5cabb797-eeae-4fe2-ac23-593f56a0ed9d tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:51.685803 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5cabb797-eeae-4fe2-ac23-593f56a0ed9d tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1370 microversion: 2.1 time: 0.526851 Oct 18 13:21:51.689314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f779d194-efc3-4fac-8ceb-f819c91bd7b2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:51.705705 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 710/1393] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:51 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1370 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:51.730365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-57fed71d-d76e-4cf0-a10c-e7fa3197f651 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:51.735786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-57fed71d-d76e-4cf0-a10c-e7fa3197f651 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:51.740071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f779d194-efc3-4fac-8ceb-f819c91bd7b2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:51.742047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f779d194-efc3-4fac-8ceb-f819c91bd7b2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:51.743447 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f779d194-efc3-4fac-8ceb-f819c91bd7b2 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 1.534522 Oct 18 13:21:51.757346 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 684/1394] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:50 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:21:51.770977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7fb409f2-c8e8-4bff-a71d-aac7ed381cf7 req-628aee21-dfe6-41ce-b83c-58229cf5c767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5", "tag": "c3e8ef87-af4e-4090-bad2-4230866897d8"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:51.776979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57fed71d-d76e-4cf0-a10c-e7fa3197f651 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:51.777790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57fed71d-d76e-4cf0-a10c-e7fa3197f651 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:51.778724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57fed71d-d76e-4cf0-a10c-e7fa3197f651 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:51.779780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57fed71d-d76e-4cf0-a10c-e7fa3197f651 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:51.780458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57fed71d-d76e-4cf0-a10c-e7fa3197f651 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:51.781084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57fed71d-d76e-4cf0-a10c-e7fa3197f651 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:51.812452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7fb409f2-c8e8-4bff-a71d-aac7ed381cf7 req-628aee21-dfe6-41ce-b83c-58229cf5c767 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:51.814389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7fb409f2-c8e8-4bff-a71d-aac7ed381cf7 req-628aee21-dfe6-41ce-b83c-58229cf5c767 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:51.822547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7fb409f2-c8e8-4bff-a71d-aac7ed381cf7 req-628aee21-dfe6-41ce-b83c-58229cf5c767 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:51.850582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:51.878960 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7fb409f2-c8e8-4bff-a71d-aac7ed381cf7 req-628aee21-dfe6-41ce-b83c-58229cf5c767 service nova] Creating event network-changed:c3e8ef87-af4e-4090-bad2-4230866897d8 for instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 on n-h2-858384-13 Oct 18 13:21:51.898892 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7fb409f2-c8e8-4bff-a71d-aac7ed381cf7 req-628aee21-dfe6-41ce-b83c-58229cf5c767 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145237 Oct 18 13:21:51.900008 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 685/1395] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:21:51.914561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f41fc2dd-b4d9-4517-aa8c-6c8f0066457a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:51.918950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f41fc2dd-b4d9-4517-aa8c-6c8f0066457a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:51.943590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f41fc2dd-b4d9-4517-aa8c-6c8f0066457a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:51.945228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f41fc2dd-b4d9-4517-aa8c-6c8f0066457a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:51.946921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f41fc2dd-b4d9-4517-aa8c-6c8f0066457a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:51.950213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f41fc2dd-b4d9-4517-aa8c-6c8f0066457a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:51.959227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f41fc2dd-b4d9-4517-aa8c-6c8f0066457a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:51.959896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f41fc2dd-b4d9-4517-aa8c-6c8f0066457a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:52.129952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-57fed71d-d76e-4cf0-a10c-e7fa3197f651 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:52.151077 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-57fed71d-d76e-4cf0-a10c-e7fa3197f651 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.429773 Oct 18 13:21:52.166367 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 711/1396] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:51 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:52.411001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f41fc2dd-b4d9-4517-aa8c-6c8f0066457a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:52.425985 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f41fc2dd-b4d9-4517-aa8c-6c8f0066457a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1461 microversion: 2.1 time: 0.522748 Oct 18 13:21:52.434423 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 686/1397] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:51 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1461 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:52.475557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f94445ea-9dba-4e3a-a885-bd960c3f1633 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:52.476381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f94445ea-9dba-4e3a-a885-bd960c3f1633 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:52.495583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f94445ea-9dba-4e3a-a885-bd960c3f1633 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:52.496533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f94445ea-9dba-4e3a-a885-bd960c3f1633 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:52.499909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f94445ea-9dba-4e3a-a885-bd960c3f1633 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:52.500938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f94445ea-9dba-4e3a-a885-bd960c3f1633 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:52.501646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f94445ea-9dba-4e3a-a885-bd960c3f1633 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:52.503212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f94445ea-9dba-4e3a-a885-bd960c3f1633 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:52.720985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-05e3b0f4-0df4-4ffc-9713-9693bdbd6a87 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:52.721807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-05e3b0f4-0df4-4ffc-9713-9693bdbd6a87 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:52.742056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-05e3b0f4-0df4-4ffc-9713-9693bdbd6a87 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:52.742967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-05e3b0f4-0df4-4ffc-9713-9693bdbd6a87 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:52.748282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-05e3b0f4-0df4-4ffc-9713-9693bdbd6a87 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:52.749518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-05e3b0f4-0df4-4ffc-9713-9693bdbd6a87 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:52.750226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-05e3b0f4-0df4-4ffc-9713-9693bdbd6a87 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:52.750744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-05e3b0f4-0df4-4ffc-9713-9693bdbd6a87 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:53.131957 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f94445ea-9dba-4e3a-a885-bd960c3f1633 tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1614 microversion: 2.1 time: 0.663665 Oct 18 13:21:53.143231 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 712/1398] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:52 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1614 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:53.153869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb631946-29e0-47e4-894d-e2eb88256705 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:53.156848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eb631946-29e0-47e4-894d-e2eb88256705 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:53.174956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb631946-29e0-47e4-894d-e2eb88256705 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:53.179052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb631946-29e0-47e4-894d-e2eb88256705 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:53.179722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb631946-29e0-47e4-894d-e2eb88256705 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:53.180690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb631946-29e0-47e4-894d-e2eb88256705 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:53.181443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb631946-29e0-47e4-894d-e2eb88256705 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:53.182035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb631946-29e0-47e4-894d-e2eb88256705 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:53.325245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-05e3b0f4-0df4-4ffc-9713-9693bdbd6a87 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:53.338093 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-05e3b0f4-0df4-4ffc-9713-9693bdbd6a87 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1370 microversion: 2.1 time: 0.621751 Oct 18 13:21:53.339359 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 687/1399] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:52 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1370 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:53.361423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-db7c0c1d-0187-4748-968f-976c86c8174b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:53.362516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-db7c0c1d-0187-4748-968f-976c86c8174b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:53.374734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db7c0c1d-0187-4748-968f-976c86c8174b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:53.377629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db7c0c1d-0187-4748-968f-976c86c8174b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:53.378290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db7c0c1d-0187-4748-968f-976c86c8174b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:53.390238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db7c0c1d-0187-4748-968f-976c86c8174b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:53.391156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db7c0c1d-0187-4748-968f-976c86c8174b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:53.391787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db7c0c1d-0187-4748-968f-976c86c8174b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:53.593151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-db7c0c1d-0187-4748-968f-976c86c8174b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '95055dd980944f9894c5c5d7263290dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b702f084c24dcc929d400e81eef048', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:53.596478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-db7c0c1d-0187-4748-968f-976c86c8174b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] flavor_id is None. Assuming migration. {{(pid=120612) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 18 13:21:53.596918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-db7c0c1d-0187-4748-968f-976c86c8174b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120612) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 13:21:53.619748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eb631946-29e0-47e4-894d-e2eb88256705 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:53.645006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eb631946-29e0-47e4-894d-e2eb88256705 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:53.655630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eb631946-29e0-47e4-894d-e2eb88256705 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:53.656732 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eb631946-29e0-47e4-894d-e2eb88256705 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.512044 Oct 18 13:21:53.657357 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 713/1400] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:53 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:21:53.678642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-052106c4-38c6-492c-937e-5325d9062472 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:53.684383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-052106c4-38c6-492c-937e-5325d9062472 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:53.696781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-052106c4-38c6-492c-937e-5325d9062472 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:53.709728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-052106c4-38c6-492c-937e-5325d9062472 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:53.710852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-052106c4-38c6-492c-937e-5325d9062472 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:53.712299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-052106c4-38c6-492c-937e-5325d9062472 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:53.713217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-052106c4-38c6-492c-937e-5325d9062472 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:53.713806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-052106c4-38c6-492c-937e-5325d9062472 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:54.040155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-052106c4-38c6-492c-937e-5325d9062472 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:54.064494 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-052106c4-38c6-492c-937e-5325d9062472 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.403085 Oct 18 13:21:54.065417 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 714/1401] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:53 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:54.101795 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-db7c0c1d-0187-4748-968f-976c86c8174b tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f/action" status: 202 len: 0 microversion: 2.1 time: 0.760654 Oct 18 13:21:54.103223 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 688/1402] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:21:53 2022] POST /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:21:54.111892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-149e3ff3-abf0-426b-820b-747932f8377b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:54.112502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-149e3ff3-abf0-426b-820b-747932f8377b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:54.120964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-149e3ff3-abf0-426b-820b-747932f8377b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:54.122093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-149e3ff3-abf0-426b-820b-747932f8377b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:54.122711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-149e3ff3-abf0-426b-820b-747932f8377b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:54.123431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-149e3ff3-abf0-426b-820b-747932f8377b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:54.123893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-149e3ff3-abf0-426b-820b-747932f8377b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:54.124313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-149e3ff3-abf0-426b-820b-747932f8377b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:54.383720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c7d4e69b-e060-44b6-9839-59a1b2ccf1b5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:54.384341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c7d4e69b-e060-44b6-9839-59a1b2ccf1b5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:54.405592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7d4e69b-e060-44b6-9839-59a1b2ccf1b5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:54.405592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7d4e69b-e060-44b6-9839-59a1b2ccf1b5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:54.405592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7d4e69b-e060-44b6-9839-59a1b2ccf1b5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:54.405933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7d4e69b-e060-44b6-9839-59a1b2ccf1b5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:54.406369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7d4e69b-e060-44b6-9839-59a1b2ccf1b5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:54.406795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7d4e69b-e060-44b6-9839-59a1b2ccf1b5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:54.483844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-149e3ff3-abf0-426b-820b-747932f8377b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:54.518291 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-149e3ff3-abf0-426b-820b-747932f8377b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1470 microversion: 2.1 time: 0.410131 Oct 18 13:21:54.520185 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 715/1403] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:54 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1470 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:54.689914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-518cc713-60f2-4062-9c6f-23bf1e73ab93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:54.690544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-518cc713-60f2-4062-9c6f-23bf1e73ab93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:54.710964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-518cc713-60f2-4062-9c6f-23bf1e73ab93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:54.711482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-518cc713-60f2-4062-9c6f-23bf1e73ab93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:54.711924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-518cc713-60f2-4062-9c6f-23bf1e73ab93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:54.712685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-518cc713-60f2-4062-9c6f-23bf1e73ab93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:54.717401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-518cc713-60f2-4062-9c6f-23bf1e73ab93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:54.719265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-518cc713-60f2-4062-9c6f-23bf1e73ab93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:54.865778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c7d4e69b-e060-44b6-9839-59a1b2ccf1b5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:54.879028 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c7d4e69b-e060-44b6-9839-59a1b2ccf1b5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1370 microversion: 2.1 time: 0.500973 Oct 18 13:21:54.899370 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 689/1404] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:54 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1370 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:55.050841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-924278305", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:21:55.058172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-518cc713-60f2-4062-9c6f-23bf1e73ab93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:55.065588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:55.069947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-518cc713-60f2-4062-9c6f-23bf1e73ab93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:55.071387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-518cc713-60f2-4062-9c6f-23bf1e73ab93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:55.072764 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-518cc713-60f2-4062-9c6f-23bf1e73ab93 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.388584 Oct 18 13:21:55.073987 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 716/1405] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:54 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:21:55.093728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-673f9755-8d9b-44e7-beca-d3123b816208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:55.095342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-673f9755-8d9b-44e7-beca-d3123b816208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:55.111141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-673f9755-8d9b-44e7-beca-d3123b816208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:55.111937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-673f9755-8d9b-44e7-beca-d3123b816208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:55.113271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-673f9755-8d9b-44e7-beca-d3123b816208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:55.114570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-673f9755-8d9b-44e7-beca-d3123b816208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:55.116066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-673f9755-8d9b-44e7-beca-d3123b816208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:55.116527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-673f9755-8d9b-44e7-beca-d3123b816208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:55.135659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] validate_networks() for [('955c68c9-f0d3-40dc-b2d8-bfb2a09e53c8', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:21:55.288325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-673f9755-8d9b-44e7-beca-d3123b816208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:55.304985 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-673f9755-8d9b-44e7-beca-d3123b816208 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.220674 Oct 18 13:21:55.336295 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 717/1406] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:55 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:55.551418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1b7ece9c-7cdc-434f-a23f-a1c0092a6f0b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:55.552330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1b7ece9c-7cdc-434f-a23f-a1c0092a6f0b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:55.571095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b7ece9c-7cdc-434f-a23f-a1c0092a6f0b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:55.574024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b7ece9c-7cdc-434f-a23f-a1c0092a6f0b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:55.575404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b7ece9c-7cdc-434f-a23f-a1c0092a6f0b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:55.578435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b7ece9c-7cdc-434f-a23f-a1c0092a6f0b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:55.580062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b7ece9c-7cdc-434f-a23f-a1c0092a6f0b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:55.581533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b7ece9c-7cdc-434f-a23f-a1c0092a6f0b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:55.752944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:21:55.912391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1b7ece9c-7cdc-434f-a23f-a1c0092a6f0b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:55.926425 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1b7ece9c-7cdc-434f-a23f-a1c0092a6f0b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1470 microversion: 2.1 time: 0.379654 Oct 18 13:21:55.936114 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 718/1407] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:55 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1470 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:55.952498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-73f9a344-feef-4753-8369-faa85823ab19 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:55.953549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-73f9a344-feef-4753-8369-faa85823ab19 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:55.962159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73f9a344-feef-4753-8369-faa85823ab19 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:55.962944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73f9a344-feef-4753-8369-faa85823ab19 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:55.963624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73f9a344-feef-4753-8369-faa85823ab19 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:55.964980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73f9a344-feef-4753-8369-faa85823ab19 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:55.965912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73f9a344-feef-4753-8369-faa85823ab19 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:55.966570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73f9a344-feef-4753-8369-faa85823ab19 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:56.011506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:21:56.012538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:21:56.012955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:21:56.013664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:21:56.014074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:21:56.025892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:56.026689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:56.027490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:56.028740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:56.029415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:56.030038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:56.061841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Getting quotas for project 754e6b0adc07474caa392caa39c0e963. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:21:56.071478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Getting quotas for user 0eeec944a5054ba9b7cd6ae3055230e7 and project 754e6b0adc07474caa392caa39c0e963. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:21:56.164189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:21:56.174676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:21:56.321462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-73f9a344-feef-4753-8369-faa85823ab19 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:56.341696 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-73f9a344-feef-4753-8369-faa85823ab19 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1370 microversion: 2.1 time: 0.401698 Oct 18 13:21:56.342501 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fc613632-6a31-41c1-a79c-e7629673d785 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.296772 Oct 18 13:21:56.343206 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 690/1408] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:21:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:21:56.344076 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 719/1409] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:55 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1370 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:56.352755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e4d60c0-b142-40bf-abd6-4f4c486d1353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:56.353409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4e4d60c0-b142-40bf-abd6-4f4c486d1353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:56.359855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3bac439c-6d61-4afd-bf53-f7b08b420076 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:56.361102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3bac439c-6d61-4afd-bf53-f7b08b420076 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:56.368327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bac439c-6d61-4afd-bf53-f7b08b420076 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:56.370292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bac439c-6d61-4afd-bf53-f7b08b420076 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:56.371528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bac439c-6d61-4afd-bf53-f7b08b420076 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:56.372474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bac439c-6d61-4afd-bf53-f7b08b420076 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:56.373100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bac439c-6d61-4afd-bf53-f7b08b420076 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:56.373727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bac439c-6d61-4afd-bf53-f7b08b420076 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:56.390897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e4d60c0-b142-40bf-abd6-4f4c486d1353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:56.395899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e4d60c0-b142-40bf-abd6-4f4c486d1353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:56.396711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e4d60c0-b142-40bf-abd6-4f4c486d1353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:56.397777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e4d60c0-b142-40bf-abd6-4f4c486d1353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:56.399392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e4d60c0-b142-40bf-abd6-4f4c486d1353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:56.400021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e4d60c0-b142-40bf-abd6-4f4c486d1353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:56.819846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3bac439c-6d61-4afd-bf53-f7b08b420076 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:56.830562 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3bac439c-6d61-4afd-bf53-f7b08b420076 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.484981 Oct 18 13:21:56.833921 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 720/1410] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:56 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:56.839197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c492e1cd-72be-4169-bb29-ac9614bb9a64 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:56.839793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c492e1cd-72be-4169-bb29-ac9614bb9a64 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:56.902416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c492e1cd-72be-4169-bb29-ac9614bb9a64 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:56.911522 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c492e1cd-72be-4169-bb29-ac9614bb9a64 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1224 microversion: 2.1 time: 0.075939 Oct 18 13:21:56.925501 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 721/1411] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:56 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:56.932181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4e4d60c0-b142-40bf-abd6-4f4c486d1353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:56.951728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8e73ca74-f561-4703-a085-4777b40d2049 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:56.952397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8e73ca74-f561-4703-a085-4777b40d2049 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:56.958083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4e4d60c0-b142-40bf-abd6-4f4c486d1353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:56.959530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4e4d60c0-b142-40bf-abd6-4f4c486d1353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:56.961137 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4e4d60c0-b142-40bf-abd6-4f4c486d1353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.616849 Oct 18 13:21:56.961892 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 691/1412] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:56 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:21:56.976598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e73ca74-f561-4703-a085-4777b40d2049 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:56.978831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e73ca74-f561-4703-a085-4777b40d2049 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:56.979563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e73ca74-f561-4703-a085-4777b40d2049 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:56.986577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e73ca74-f561-4703-a085-4777b40d2049 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:56.987308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e73ca74-f561-4703-a085-4777b40d2049 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:56.988007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e73ca74-f561-4703-a085-4777b40d2049 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:57.268760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8e73ca74-f561-4703-a085-4777b40d2049 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:57.285097 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8e73ca74-f561-4703-a085-4777b40d2049 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1470 microversion: 2.1 time: 0.337380 Oct 18 13:21:57.302752 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 722/1413] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:56 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1470 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:57.372236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6aaf3233-3343-49bf-8612-d08bdf114ed1 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:57.373105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6aaf3233-3343-49bf-8612-d08bdf114ed1 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:57.385748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6aaf3233-3343-49bf-8612-d08bdf114ed1 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:57.386538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6aaf3233-3343-49bf-8612-d08bdf114ed1 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:57.387759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6aaf3233-3343-49bf-8612-d08bdf114ed1 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:57.388831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6aaf3233-3343-49bf-8612-d08bdf114ed1 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:57.389742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6aaf3233-3343-49bf-8612-d08bdf114ed1 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:57.390623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6aaf3233-3343-49bf-8612-d08bdf114ed1 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:57.860702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b5942251-d584-4c75-98a3-c837068bd60b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:57.861888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b5942251-d584-4c75-98a3-c837068bd60b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:57.874906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5942251-d584-4c75-98a3-c837068bd60b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:57.879957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5942251-d584-4c75-98a3-c837068bd60b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:57.880805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5942251-d584-4c75-98a3-c837068bd60b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:57.882922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5942251-d584-4c75-98a3-c837068bd60b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:57.884203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5942251-d584-4c75-98a3-c837068bd60b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:57.884872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5942251-d584-4c75-98a3-c837068bd60b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:58.149614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b5942251-d584-4c75-98a3-c837068bd60b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:58.162613 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b5942251-d584-4c75-98a3-c837068bd60b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.305911 Oct 18 13:21:58.177226 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 723/1414] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:57 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:21:58.177226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-de8c1fb5-f5ac-491d-b8c8-02cac130cf80 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:58.177226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-de8c1fb5-f5ac-491d-b8c8-02cac130cf80 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:58.186894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de8c1fb5-f5ac-491d-b8c8-02cac130cf80 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:58.187975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de8c1fb5-f5ac-491d-b8c8-02cac130cf80 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:58.189638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de8c1fb5-f5ac-491d-b8c8-02cac130cf80 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:58.190681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de8c1fb5-f5ac-491d-b8c8-02cac130cf80 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:58.191389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de8c1fb5-f5ac-491d-b8c8-02cac130cf80 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:58.192035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de8c1fb5-f5ac-491d-b8c8-02cac130cf80 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:58.303826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6aaf3233-3343-49bf-8612-d08bdf114ed1 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:58.315244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-de8c1fb5-f5ac-491d-b8c8-02cac130cf80 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:58.315939 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6aaf3233-3343-49bf-8612-d08bdf114ed1 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1370 microversion: 2.1 time: 0.948831 Oct 18 13:21:58.326948 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 692/1415] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:57 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1370 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:58.328423 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-de8c1fb5-f5ac-491d-b8c8-02cac130cf80 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1228 microversion: 2.1 time: 0.158314 Oct 18 13:21:58.341041 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 724/1416] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:58 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1228 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:58.343865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-959ffeea-6742-4c66-8815-625579e8227d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:58.347889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-959ffeea-6742-4c66-8815-625579e8227d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:58.361573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e638044d-04c1-40e5-bd3e-c3565bbd3ce3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:58.366754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e638044d-04c1-40e5-bd3e-c3565bbd3ce3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:58.372708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-959ffeea-6742-4c66-8815-625579e8227d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:58.373623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-959ffeea-6742-4c66-8815-625579e8227d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:58.373623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-959ffeea-6742-4c66-8815-625579e8227d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:58.374291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-959ffeea-6742-4c66-8815-625579e8227d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:58.374723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-959ffeea-6742-4c66-8815-625579e8227d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:58.375146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-959ffeea-6742-4c66-8815-625579e8227d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:58.403763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e638044d-04c1-40e5-bd3e-c3565bbd3ce3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:58.404738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e638044d-04c1-40e5-bd3e-c3565bbd3ce3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:58.405570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e638044d-04c1-40e5-bd3e-c3565bbd3ce3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:58.416064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e638044d-04c1-40e5-bd3e-c3565bbd3ce3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:58.416813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e638044d-04c1-40e5-bd3e-c3565bbd3ce3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:58.421400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e638044d-04c1-40e5-bd3e-c3565bbd3ce3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:58.757399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e638044d-04c1-40e5-bd3e-c3565bbd3ce3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:58.767066 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e638044d-04c1-40e5-bd3e-c3565bbd3ce3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1470 microversion: 2.1 time: 0.424750 Oct 18 13:21:58.773990 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 725/1417] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:58 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1470 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:58.888504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-959ffeea-6742-4c66-8815-625579e8227d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:58.916478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-959ffeea-6742-4c66-8815-625579e8227d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:58.923656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-959ffeea-6742-4c66-8815-625579e8227d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:58.926317 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-959ffeea-6742-4c66-8815-625579e8227d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.598272 Oct 18 13:21:58.937781 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 693/1418] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:58 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:21:59.192686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6bbd1e86-057e-46ec-b864-22139aa4bce0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:59.194581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6bbd1e86-057e-46ec-b864-22139aa4bce0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:59.203987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bbd1e86-057e-46ec-b864-22139aa4bce0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:59.204795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bbd1e86-057e-46ec-b864-22139aa4bce0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:59.205513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bbd1e86-057e-46ec-b864-22139aa4bce0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:59.206478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bbd1e86-057e-46ec-b864-22139aa4bce0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:59.207173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bbd1e86-057e-46ec-b864-22139aa4bce0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:59.207821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bbd1e86-057e-46ec-b864-22139aa4bce0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:59.343694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a7e73dde-ce0a-475e-a13c-a60461efae2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:59.344935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a7e73dde-ce0a-475e-a13c-a60461efae2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:59.351467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7e73dde-ce0a-475e-a13c-a60461efae2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:59.351944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7e73dde-ce0a-475e-a13c-a60461efae2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:59.352602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7e73dde-ce0a-475e-a13c-a60461efae2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:59.353486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7e73dde-ce0a-475e-a13c-a60461efae2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:59.354215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7e73dde-ce0a-475e-a13c-a60461efae2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:59.354816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7e73dde-ce0a-475e-a13c-a60461efae2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:59.373030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6bbd1e86-057e-46ec-b864-22139aa4bce0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:59.398924 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6bbd1e86-057e-46ec-b864-22139aa4bce0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.210706 Oct 18 13:21:59.400462 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 726/1419] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:59 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:59.413142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-79cb5369-a324-4b88-a0b6-3bb6eaa8fe3b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:59.413814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-79cb5369-a324-4b88-a0b6-3bb6eaa8fe3b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:59.426812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79cb5369-a324-4b88-a0b6-3bb6eaa8fe3b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:59.427336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79cb5369-a324-4b88-a0b6-3bb6eaa8fe3b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:59.431004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79cb5369-a324-4b88-a0b6-3bb6eaa8fe3b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:59.432459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79cb5369-a324-4b88-a0b6-3bb6eaa8fe3b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:59.435602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79cb5369-a324-4b88-a0b6-3bb6eaa8fe3b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:59.436245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79cb5369-a324-4b88-a0b6-3bb6eaa8fe3b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:59.599419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79cb5369-a324-4b88-a0b6-3bb6eaa8fe3b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:59.607946 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-79cb5369-a324-4b88-a0b6-3bb6eaa8fe3b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1228 microversion: 2.1 time: 0.206377 Oct 18 13:21:59.608558 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 727/1420] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:59 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1228 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:59.657721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a7e73dde-ce0a-475e-a13c-a60461efae2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:21:59.667802 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a7e73dde-ce0a-475e-a13c-a60461efae2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1370 microversion: 2.1 time: 0.328860 Oct 18 13:21:59.669342 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 694/1421] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:59 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1370 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:21:59.797129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-03b209dd-d936-458a-b2c4-4f4ce6df03eb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:59.797987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-03b209dd-d936-458a-b2c4-4f4ce6df03eb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:59.805420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03b209dd-d936-458a-b2c4-4f4ce6df03eb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:59.806430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03b209dd-d936-458a-b2c4-4f4ce6df03eb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:59.806430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03b209dd-d936-458a-b2c4-4f4ce6df03eb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:59.807540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03b209dd-d936-458a-b2c4-4f4ce6df03eb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:59.808118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03b209dd-d936-458a-b2c4-4f4ce6df03eb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:59.808966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03b209dd-d936-458a-b2c4-4f4ce6df03eb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:59.956127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-91312b59-6da1-4229-b120-4169fc6525ab tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:21:59.956879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-91312b59-6da1-4229-b120-4169fc6525ab tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:21:59.981447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91312b59-6da1-4229-b120-4169fc6525ab tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:59.981953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91312b59-6da1-4229-b120-4169fc6525ab tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:59.982392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91312b59-6da1-4229-b120-4169fc6525ab tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:21:59.995278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91312b59-6da1-4229-b120-4169fc6525ab tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:21:59.997742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91312b59-6da1-4229-b120-4169fc6525ab tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:21:59.998457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91312b59-6da1-4229-b120-4169fc6525ab tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:00.347862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-91312b59-6da1-4229-b120-4169fc6525ab tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:00.363432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-91312b59-6da1-4229-b120-4169fc6525ab tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:00.364884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-91312b59-6da1-4229-b120-4169fc6525ab tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:00.367878 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-91312b59-6da1-4229-b120-4169fc6525ab tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.419083 Oct 18 13:22:00.386818 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 695/1422] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:21:59 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:22:00.428962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-58ff8d01-cb48-4b98-935c-feec5d1e03ab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:00.430050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-58ff8d01-cb48-4b98-935c-feec5d1e03ab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:00.440404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58ff8d01-cb48-4b98-935c-feec5d1e03ab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:00.441418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58ff8d01-cb48-4b98-935c-feec5d1e03ab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:00.442222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58ff8d01-cb48-4b98-935c-feec5d1e03ab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:00.443256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58ff8d01-cb48-4b98-935c-feec5d1e03ab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:00.444441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58ff8d01-cb48-4b98-935c-feec5d1e03ab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:00.445073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58ff8d01-cb48-4b98-935c-feec5d1e03ab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:00.535102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-03b209dd-d936-458a-b2c4-4f4ce6df03eb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:00.543450 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-03b209dd-d936-458a-b2c4-4f4ce6df03eb tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1470 microversion: 2.1 time: 0.751037 Oct 18 13:22:00.544943 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 728/1423] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:21:59 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1470 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:00.634323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc44c26a-8855-43a6-a3a9-d518f2baee86 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:00.634994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc44c26a-8855-43a6-a3a9-d518f2baee86 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:00.644636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc44c26a-8855-43a6-a3a9-d518f2baee86 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:00.644636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc44c26a-8855-43a6-a3a9-d518f2baee86 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:00.644636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc44c26a-8855-43a6-a3a9-d518f2baee86 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:00.644636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc44c26a-8855-43a6-a3a9-d518f2baee86 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:00.646681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc44c26a-8855-43a6-a3a9-d518f2baee86 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:00.650095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc44c26a-8855-43a6-a3a9-d518f2baee86 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:00.706826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-58ff8d01-cb48-4b98-935c-feec5d1e03ab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:00.716464 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-58ff8d01-cb48-4b98-935c-feec5d1e03ab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.292542 Oct 18 13:22:00.717721 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 696/1424] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:00 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:00.723516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f6725ed3-affb-4e0e-8252-272435003c8a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:00.724302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f6725ed3-affb-4e0e-8252-272435003c8a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:00.731369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6725ed3-affb-4e0e-8252-272435003c8a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:00.734204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6725ed3-affb-4e0e-8252-272435003c8a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:00.734204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6725ed3-affb-4e0e-8252-272435003c8a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:00.734204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6725ed3-affb-4e0e-8252-272435003c8a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:00.734204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6725ed3-affb-4e0e-8252-272435003c8a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:00.734600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6725ed3-affb-4e0e-8252-272435003c8a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:00.863835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc44c26a-8855-43a6-a3a9-d518f2baee86 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:00.876221 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc44c26a-8855-43a6-a3a9-d518f2baee86 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1228 microversion: 2.1 time: 0.247022 Oct 18 13:22:00.876824 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 729/1425] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:00 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1228 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:00.892133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e8ecc26-f1a0-4bb0-bddc-9fca803665d3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:00.895872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7e8ecc26-f1a0-4bb0-bddc-9fca803665d3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:00.912240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e8ecc26-f1a0-4bb0-bddc-9fca803665d3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:00.912732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e8ecc26-f1a0-4bb0-bddc-9fca803665d3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:00.920772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e8ecc26-f1a0-4bb0-bddc-9fca803665d3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:00.921030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e8ecc26-f1a0-4bb0-bddc-9fca803665d3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:00.926658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e8ecc26-f1a0-4bb0-bddc-9fca803665d3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:00.940150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f6725ed3-affb-4e0e-8252-272435003c8a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:00.940468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e8ecc26-f1a0-4bb0-bddc-9fca803665d3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:00.957773 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f6725ed3-affb-4e0e-8252-272435003c8a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1370 microversion: 2.1 time: 0.238763 Oct 18 13:22:00.962339 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 697/1426] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:00 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:01.395986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eee61e3e-6a06-45fe-86c2-2eef378d1a30 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:01.396609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eee61e3e-6a06-45fe-86c2-2eef378d1a30 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:01.396971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7e8ecc26-f1a0-4bb0-bddc-9fca803665d3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:01.405078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eee61e3e-6a06-45fe-86c2-2eef378d1a30 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:01.405860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eee61e3e-6a06-45fe-86c2-2eef378d1a30 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:01.406498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eee61e3e-6a06-45fe-86c2-2eef378d1a30 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:01.407396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eee61e3e-6a06-45fe-86c2-2eef378d1a30 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:01.408020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eee61e3e-6a06-45fe-86c2-2eef378d1a30 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:01.408616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eee61e3e-6a06-45fe-86c2-2eef378d1a30 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:01.410980 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7e8ecc26-f1a0-4bb0-bddc-9fca803665d3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.528104 Oct 18 13:22:01.411721 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 730/1427] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:00 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:01.441493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cf990267-2a15-47d6-a62b-953122bde8df tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:01.443629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cf990267-2a15-47d6-a62b-953122bde8df tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:01.453856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf990267-2a15-47d6-a62b-953122bde8df tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:01.454671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf990267-2a15-47d6-a62b-953122bde8df tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:01.455283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf990267-2a15-47d6-a62b-953122bde8df tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:01.456182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf990267-2a15-47d6-a62b-953122bde8df tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:01.456801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf990267-2a15-47d6-a62b-953122bde8df tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:01.457501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf990267-2a15-47d6-a62b-953122bde8df tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:01.574953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eee61e3e-6a06-45fe-86c2-2eef378d1a30 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:01.587609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eee61e3e-6a06-45fe-86c2-2eef378d1a30 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:01.591125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eee61e3e-6a06-45fe-86c2-2eef378d1a30 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:01.592512 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eee61e3e-6a06-45fe-86c2-2eef378d1a30 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.200458 Oct 18 13:22:01.605868 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 698/1428] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:01 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:22:01.618731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3c2a658e-4ef9-424a-adca-cab2e6cdcaaf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:01.619685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3c2a658e-4ef9-424a-adca-cab2e6cdcaaf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:01.627131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c2a658e-4ef9-424a-adca-cab2e6cdcaaf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:01.628651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c2a658e-4ef9-424a-adca-cab2e6cdcaaf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:01.629220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c2a658e-4ef9-424a-adca-cab2e6cdcaaf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:01.630243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c2a658e-4ef9-424a-adca-cab2e6cdcaaf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:01.630923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c2a658e-4ef9-424a-adca-cab2e6cdcaaf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:01.631561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c2a658e-4ef9-424a-adca-cab2e6cdcaaf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:01.903591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cf990267-2a15-47d6-a62b-953122bde8df tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:01.921818 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cf990267-2a15-47d6-a62b-953122bde8df tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.487886 Oct 18 13:22:01.937208 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 731/1429] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:01 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:01.950752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0a070f96-f75c-401c-b3fb-6e5379c6f320 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:01.953845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0a070f96-f75c-401c-b3fb-6e5379c6f320 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:01.969373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a070f96-f75c-401c-b3fb-6e5379c6f320 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:01.969930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a070f96-f75c-401c-b3fb-6e5379c6f320 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:01.970536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a070f96-f75c-401c-b3fb-6e5379c6f320 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:01.971519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a070f96-f75c-401c-b3fb-6e5379c6f320 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:01.972322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a070f96-f75c-401c-b3fb-6e5379c6f320 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:01.973003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a070f96-f75c-401c-b3fb-6e5379c6f320 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:02.056037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3c2a658e-4ef9-424a-adca-cab2e6cdcaaf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:02.073004 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3c2a658e-4ef9-424a-adca-cab2e6cdcaaf tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1470 microversion: 2.1 time: 0.465697 Oct 18 13:22:02.089206 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 699/1430] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:01 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1470 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:02.089206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bf07c6bd-1460-4dfe-a493-eccad5458cd0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:02.089735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bf07c6bd-1460-4dfe-a493-eccad5458cd0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:02.106354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf07c6bd-1460-4dfe-a493-eccad5458cd0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:02.107372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf07c6bd-1460-4dfe-a493-eccad5458cd0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:02.108082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf07c6bd-1460-4dfe-a493-eccad5458cd0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:02.109006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf07c6bd-1460-4dfe-a493-eccad5458cd0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:02.109693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf07c6bd-1460-4dfe-a493-eccad5458cd0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:02.110349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf07c6bd-1460-4dfe-a493-eccad5458cd0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:02.273714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bf07c6bd-1460-4dfe-a493-eccad5458cd0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:02.285474 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bf07c6bd-1460-4dfe-a493-eccad5458cd0 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1276 microversion: 2.1 time: 0.205929 Oct 18 13:22:02.286341 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 700/1431] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:02 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:02.293522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d22c4da6-daa7-4b52-9d0e-b0c16ebb857e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:02.294907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d22c4da6-daa7-4b52-9d0e-b0c16ebb857e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:02.302494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d22c4da6-daa7-4b52-9d0e-b0c16ebb857e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:02.303230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d22c4da6-daa7-4b52-9d0e-b0c16ebb857e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:02.303975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d22c4da6-daa7-4b52-9d0e-b0c16ebb857e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:02.305094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d22c4da6-daa7-4b52-9d0e-b0c16ebb857e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:02.317660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d22c4da6-daa7-4b52-9d0e-b0c16ebb857e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:02.318741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d22c4da6-daa7-4b52-9d0e-b0c16ebb857e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:02.353062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:02.591581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0a070f96-f75c-401c-b3fb-6e5379c6f320 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:02.607324 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0a070f96-f75c-401c-b3fb-6e5379c6f320 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.677884 Oct 18 13:22:02.608345 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 732/1432] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:01 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:02.620417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a591ae70-5d41-45a9-b142-2460adba583f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:02.621670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a591ae70-5d41-45a9-b142-2460adba583f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:02.634923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a591ae70-5d41-45a9-b142-2460adba583f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:02.635774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a591ae70-5d41-45a9-b142-2460adba583f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:02.636591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a591ae70-5d41-45a9-b142-2460adba583f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:02.637899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a591ae70-5d41-45a9-b142-2460adba583f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:02.638538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a591ae70-5d41-45a9-b142-2460adba583f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:02.640086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a591ae70-5d41-45a9-b142-2460adba583f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:02.850197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d22c4da6-daa7-4b52-9d0e-b0c16ebb857e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:02.859938 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d22c4da6-daa7-4b52-9d0e-b0c16ebb857e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.572356 Oct 18 13:22:02.865860 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 701/1433] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:02 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:02.871303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-bcc6059d-6805-4106-ac94-e0ad1700c1fc req-7dfec70a-ffe7-47c1-b848-d5e26ae35ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925c4106-eafb-486f-8846-ff04eea11eb3", "name": "network-vif-unplugged", "status": "completed", "tag": "764246b4-ac2a-4fc1-ad53-12db75a818b1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:02.897617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bcc6059d-6805-4106-ac94-e0ad1700c1fc req-7dfec70a-ffe7-47c1-b848-d5e26ae35ae5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:02.898530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bcc6059d-6805-4106-ac94-e0ad1700c1fc req-7dfec70a-ffe7-47c1-b848-d5e26ae35ae5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:02.900463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bcc6059d-6805-4106-ac94-e0ad1700c1fc req-7dfec70a-ffe7-47c1-b848-d5e26ae35ae5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:02.913833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a591ae70-5d41-45a9-b142-2460adba583f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:02.923699 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a591ae70-5d41-45a9-b142-2460adba583f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1370 microversion: 2.1 time: 0.313991 Oct 18 13:22:02.924312 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 733/1434] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:02 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1370 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:02.930941 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-bcc6059d-6805-4106-ac94-e0ad1700c1fc req-7dfec70a-ffe7-47c1-b848-d5e26ae35ae5 service nova] Creating event network-vif-unplugged:764246b4-ac2a-4fc1-ad53-12db75a818b1 for instance 925c4106-eafb-486f-8846-ff04eea11eb3 on n-h1-858384-13 Oct 18 13:22:02.932832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6ec2168f-5c3b-46d0-9242-014d8dfe0c35 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:02.938400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6ec2168f-5c3b-46d0-9242-014d8dfe0c35 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:02.945205 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-bcc6059d-6805-4106-ac94-e0ad1700c1fc req-7dfec70a-ffe7-47c1-b848-d5e26ae35ae5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077429 Oct 18 13:22:02.948888 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 702/1435] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:02.951510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ec2168f-5c3b-46d0-9242-014d8dfe0c35 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:02.957673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ec2168f-5c3b-46d0-9242-014d8dfe0c35 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:02.958172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ec2168f-5c3b-46d0-9242-014d8dfe0c35 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:02.964311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f23e204c-f896-432b-8f36-1694af1f12c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-787030130"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:02.967974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f23e204c-f896-432b-8f36-1694af1f12c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:02.970730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ec2168f-5c3b-46d0-9242-014d8dfe0c35 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:02.971245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ec2168f-5c3b-46d0-9242-014d8dfe0c35 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:02.971691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ec2168f-5c3b-46d0-9242-014d8dfe0c35 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:02.985695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f23e204c-f896-432b-8f36-1694af1f12c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:02.988823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f23e204c-f896-432b-8f36-1694af1f12c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:02.989647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f23e204c-f896-432b-8f36-1694af1f12c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:02.990663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f23e204c-f896-432b-8f36-1694af1f12c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:02.991347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f23e204c-f896-432b-8f36-1694af1f12c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:02.992260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f23e204c-f896-432b-8f36-1694af1f12c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:03.000609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:03.282297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ec2168f-5c3b-46d0-9242-014d8dfe0c35 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:03.317044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ec2168f-5c3b-46d0-9242-014d8dfe0c35 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:03.322055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ec2168f-5c3b-46d0-9242-014d8dfe0c35 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:03.325739 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6ec2168f-5c3b-46d0-9242-014d8dfe0c35 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.398947 Oct 18 13:22:03.328799 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 734/1436] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:02 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:22:03.339093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5ea861be-0884-4b1e-b712-649869a12801 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:03.341291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5ea861be-0884-4b1e-b712-649869a12801 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:03.384944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ea861be-0884-4b1e-b712-649869a12801 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:03.390028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ea861be-0884-4b1e-b712-649869a12801 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:03.392395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ea861be-0884-4b1e-b712-649869a12801 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:03.396024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ea861be-0884-4b1e-b712-649869a12801 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:03.399615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ea861be-0884-4b1e-b712-649869a12801 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:03.400753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ea861be-0884-4b1e-b712-649869a12801 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:03.591113 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f23e204c-f896-432b-8f36-1694af1f12c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.639712 Oct 18 13:22:03.599039 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 703/1437] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:22:02 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 18 13:22:03.633627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-db87ee40-1af4-423a-aa34-8415fafd666c tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:03.638424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-db87ee40-1af4-423a-aa34-8415fafd666c tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:03.657638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db87ee40-1af4-423a-aa34-8415fafd666c tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:03.661695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db87ee40-1af4-423a-aa34-8415fafd666c tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:03.662971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db87ee40-1af4-423a-aa34-8415fafd666c tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:03.663981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db87ee40-1af4-423a-aa34-8415fafd666c tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:03.665123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db87ee40-1af4-423a-aa34-8415fafd666c tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:03.672809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db87ee40-1af4-423a-aa34-8415fafd666c tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:04.015956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-db87ee40-1af4-423a-aa34-8415fafd666c tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:04.025969 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-db87ee40-1af4-423a-aa34-8415fafd666c tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1284 microversion: 2.1 time: 0.425348 Oct 18 13:22:04.028050 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 704/1438] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:03 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1284 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:04.050699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c43b6ccc-2f4b-4501-b070-50776b19c785 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:04.051319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c43b6ccc-2f4b-4501-b070-50776b19c785 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:04.060464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c43b6ccc-2f4b-4501-b070-50776b19c785 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:04.061263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c43b6ccc-2f4b-4501-b070-50776b19c785 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:04.061958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c43b6ccc-2f4b-4501-b070-50776b19c785 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:04.063274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c43b6ccc-2f4b-4501-b070-50776b19c785 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:04.065079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c43b6ccc-2f4b-4501-b070-50776b19c785 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:04.065710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c43b6ccc-2f4b-4501-b070-50776b19c785 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:04.145431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5ea861be-0884-4b1e-b712-649869a12801 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:04.159303 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5ea861be-0884-4b1e-b712-649869a12801 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1470 microversion: 2.1 time: 0.828019 Oct 18 13:22:04.160697 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 735/1439] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:03 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1470 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:04.166699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-768cf03c-c92c-4239-9a18-f5dd5660680e tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:04.167577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-768cf03c-c92c-4239-9a18-f5dd5660680e tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:04.183936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768cf03c-c92c-4239-9a18-f5dd5660680e tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:04.185626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768cf03c-c92c-4239-9a18-f5dd5660680e tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:04.187050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768cf03c-c92c-4239-9a18-f5dd5660680e tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:04.190434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768cf03c-c92c-4239-9a18-f5dd5660680e tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:04.190955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768cf03c-c92c-4239-9a18-f5dd5660680e tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:04.191403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768cf03c-c92c-4239-9a18-f5dd5660680e tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:04.487855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c43b6ccc-2f4b-4501-b070-50776b19c785 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:04.505087 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c43b6ccc-2f4b-4501-b070-50776b19c785 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.475716 Oct 18 13:22:04.518264 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 705/1440] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:04 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:04.535168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6be85efb-8db8-4590-8a93-31950a39c860 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:04.535897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6be85efb-8db8-4590-8a93-31950a39c860 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:04.550313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6be85efb-8db8-4590-8a93-31950a39c860 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:04.552824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6be85efb-8db8-4590-8a93-31950a39c860 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:04.553590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6be85efb-8db8-4590-8a93-31950a39c860 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:04.556247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6be85efb-8db8-4590-8a93-31950a39c860 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:04.578597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6be85efb-8db8-4590-8a93-31950a39c860 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:04.580853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6be85efb-8db8-4590-8a93-31950a39c860 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:04.587751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-768cf03c-c92c-4239-9a18-f5dd5660680e tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:04.620628 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-768cf03c-c92c-4239-9a18-f5dd5660680e tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1370 microversion: 2.1 time: 0.457967 Oct 18 13:22:04.622201 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 736/1441] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:04 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1370 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:05.001100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f05443d4-1bca-4a1c-b0e8-2d96b6831cda req-3fd2f993-9f55-41bc-a963-520c7e98cf3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925c4106-eafb-486f-8846-ff04eea11eb3", "tag": "764246b4-ac2a-4fc1-ad53-12db75a818b1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:05.023764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f05443d4-1bca-4a1c-b0e8-2d96b6831cda req-3fd2f993-9f55-41bc-a963-520c7e98cf3a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:05.024553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f05443d4-1bca-4a1c-b0e8-2d96b6831cda req-3fd2f993-9f55-41bc-a963-520c7e98cf3a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:05.025207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f05443d4-1bca-4a1c-b0e8-2d96b6831cda req-3fd2f993-9f55-41bc-a963-520c7e98cf3a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:05.042055 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f05443d4-1bca-4a1c-b0e8-2d96b6831cda req-3fd2f993-9f55-41bc-a963-520c7e98cf3a service nova] Creating event network-changed:764246b4-ac2a-4fc1-ad53-12db75a818b1 for instance 925c4106-eafb-486f-8846-ff04eea11eb3 on n-h1-858384-13 Oct 18 13:22:05.053000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6be85efb-8db8-4590-8a93-31950a39c860 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:05.063768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6be85efb-8db8-4590-8a93-31950a39c860 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:05.065935 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f05443d4-1bca-4a1c-b0e8-2d96b6831cda req-3fd2f993-9f55-41bc-a963-520c7e98cf3a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070021 Oct 18 13:22:05.067855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6be85efb-8db8-4590-8a93-31950a39c860 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:05.069089 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 737/1442] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:05.074401 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6be85efb-8db8-4590-8a93-31950a39c860 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.551533 Oct 18 13:22:05.075324 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 706/1443] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:04 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:22:05.078486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1830b186-3686-4911-893a-09fa7a2502c5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:05.079472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1830b186-3686-4911-893a-09fa7a2502c5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:05.086742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1830b186-3686-4911-893a-09fa7a2502c5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:05.090443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1830b186-3686-4911-893a-09fa7a2502c5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:05.091235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1830b186-3686-4911-893a-09fa7a2502c5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:05.092230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1830b186-3686-4911-893a-09fa7a2502c5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:05.092909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1830b186-3686-4911-893a-09fa7a2502c5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:05.093601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1830b186-3686-4911-893a-09fa7a2502c5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:05.175034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1830b186-3686-4911-893a-09fa7a2502c5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:05.187556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-52f1d21a-5b4d-4d95-9bf9-331f5abe5e9e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:05.188552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-52f1d21a-5b4d-4d95-9bf9-331f5abe5e9e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:05.202511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52f1d21a-5b4d-4d95-9bf9-331f5abe5e9e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:05.204129 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1830b186-3686-4911-893a-09fa7a2502c5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1282 microversion: 2.1 time: 0.133103 Oct 18 13:22:05.220433 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 738/1444] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:05 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:05.220674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52f1d21a-5b4d-4d95-9bf9-331f5abe5e9e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:05.220674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52f1d21a-5b4d-4d95-9bf9-331f5abe5e9e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:05.220674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52f1d21a-5b4d-4d95-9bf9-331f5abe5e9e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:05.220674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52f1d21a-5b4d-4d95-9bf9-331f5abe5e9e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:05.221006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52f1d21a-5b4d-4d95-9bf9-331f5abe5e9e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:05.531776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f4d242b5-13fb-4293-a384-96a99195510f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:05.532981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f4d242b5-13fb-4293-a384-96a99195510f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:05.540677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4d242b5-13fb-4293-a384-96a99195510f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:05.541488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4d242b5-13fb-4293-a384-96a99195510f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:05.542104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4d242b5-13fb-4293-a384-96a99195510f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:05.543036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4d242b5-13fb-4293-a384-96a99195510f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:05.543666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4d242b5-13fb-4293-a384-96a99195510f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:05.544098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4d242b5-13fb-4293-a384-96a99195510f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:05.733689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f4d242b5-13fb-4293-a384-96a99195510f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:05.743748 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f4d242b5-13fb-4293-a384-96a99195510f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.216126 Oct 18 13:22:05.744342 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 739/1445] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:05 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:05.751563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-51175079-389b-4450-ab61-122e80ac3f2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:05.752427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-51175079-389b-4450-ab61-122e80ac3f2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:05.760894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51175079-389b-4450-ab61-122e80ac3f2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:05.761742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51175079-389b-4450-ab61-122e80ac3f2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:05.762382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51175079-389b-4450-ab61-122e80ac3f2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:05.764198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51175079-389b-4450-ab61-122e80ac3f2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:05.764857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51175079-389b-4450-ab61-122e80ac3f2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:05.765492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51175079-389b-4450-ab61-122e80ac3f2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:05.942603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-51175079-389b-4450-ab61-122e80ac3f2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:05.953705 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-51175079-389b-4450-ab61-122e80ac3f2f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1370 microversion: 2.1 time: 0.207657 Oct 18 13:22:05.954433 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 740/1446] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:05 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:06.040934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:06.104620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-84f87e3e-497a-4ccb-a4ed-26f38487e7c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:06.104930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-84f87e3e-497a-4ccb-a4ed-26f38487e7c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:06.111739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84f87e3e-497a-4ccb-a4ed-26f38487e7c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:06.112217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84f87e3e-497a-4ccb-a4ed-26f38487e7c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:06.112919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84f87e3e-497a-4ccb-a4ed-26f38487e7c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:06.113669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84f87e3e-497a-4ccb-a4ed-26f38487e7c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:06.114126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84f87e3e-497a-4ccb-a4ed-26f38487e7c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:06.114550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84f87e3e-497a-4ccb-a4ed-26f38487e7c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:06.143701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:06.284342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-84f87e3e-497a-4ccb-a4ed-26f38487e7c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:06.294619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-52f1d21a-5b4d-4d95-9bf9-331f5abe5e9e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:06.316076 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-52f1d21a-5b4d-4d95-9bf9-331f5abe5e9e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 1.133142 Oct 18 13:22:06.329510 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 707/1447] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:05 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:06.332400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-84f87e3e-497a-4ccb-a4ed-26f38487e7c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:06.338714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-84f87e3e-497a-4ccb-a4ed-26f38487e7c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:06.340002 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-84f87e3e-497a-4ccb-a4ed-26f38487e7c5 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.239630 Oct 18 13:22:06.340951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-749eddf5-62d2-4529-b306-550b42ac9035 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:06.341173 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 741/1448] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:06 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:22:06.342121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-749eddf5-62d2-4529-b306-550b42ac9035 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:06.350815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-749eddf5-62d2-4529-b306-550b42ac9035 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:06.351313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-749eddf5-62d2-4529-b306-550b42ac9035 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:06.351751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-749eddf5-62d2-4529-b306-550b42ac9035 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:06.352940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-749eddf5-62d2-4529-b306-550b42ac9035 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:06.353074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-749eddf5-62d2-4529-b306-550b42ac9035 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:06.353590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-749eddf5-62d2-4529-b306-550b42ac9035 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:06.755064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8757d697-0f64-40d7-bb4c-031d2e5b11c5 req-21ccc61f-8b06-479e-b90b-7d07e3fb8dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5", "name": "network-vif-plugged", "status": "completed", "tag": "c3e8ef87-af4e-4090-bad2-4230866897d8"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:06.772027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8757d697-0f64-40d7-bb4c-031d2e5b11c5 req-21ccc61f-8b06-479e-b90b-7d07e3fb8dc3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:06.773149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8757d697-0f64-40d7-bb4c-031d2e5b11c5 req-21ccc61f-8b06-479e-b90b-7d07e3fb8dc3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:06.775811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8757d697-0f64-40d7-bb4c-031d2e5b11c5 req-21ccc61f-8b06-479e-b90b-7d07e3fb8dc3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:06.778883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-749eddf5-62d2-4529-b306-550b42ac9035 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:06.794969 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-749eddf5-62d2-4529-b306-550b42ac9035 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1324 microversion: 2.1 time: 0.461545 Oct 18 13:22:06.796549 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 708/1449] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:06 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:06.802283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-330af1bf-5fb6-4fd8-a47e-6b13abe40cb6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:06.803322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-330af1bf-5fb6-4fd8-a47e-6b13abe40cb6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:06.811261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-330af1bf-5fb6-4fd8-a47e-6b13abe40cb6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:06.812084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-330af1bf-5fb6-4fd8-a47e-6b13abe40cb6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:06.812775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-330af1bf-5fb6-4fd8-a47e-6b13abe40cb6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:06.813885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-330af1bf-5fb6-4fd8-a47e-6b13abe40cb6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:06.814548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-330af1bf-5fb6-4fd8-a47e-6b13abe40cb6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:06.815184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-330af1bf-5fb6-4fd8-a47e-6b13abe40cb6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:06.817774 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8757d697-0f64-40d7-bb4c-031d2e5b11c5 req-21ccc61f-8b06-479e-b90b-7d07e3fb8dc3 service nova] Creating event network-vif-plugged:c3e8ef87-af4e-4090-bad2-4230866897d8 for instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 on n-h2-858384-13 Oct 18 13:22:06.827102 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8757d697-0f64-40d7-bb4c-031d2e5b11c5 req-21ccc61f-8b06-479e-b90b-7d07e3fb8dc3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075591 Oct 18 13:22:06.828567 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 742/1450] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:22:06.979619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ffde4c0a-725e-480f-97cd-62b07be28249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:06.981314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ffde4c0a-725e-480f-97cd-62b07be28249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:06.987181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=18 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:06.990465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:06.992390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffde4c0a-725e-480f-97cd-62b07be28249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:06.992966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffde4c0a-725e-480f-97cd-62b07be28249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:06.993473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffde4c0a-725e-480f-97cd-62b07be28249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:06.994218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffde4c0a-725e-480f-97cd-62b07be28249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:06.994663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffde4c0a-725e-480f-97cd-62b07be28249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:06.995081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffde4c0a-725e-480f-97cd-62b07be28249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:07.136652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ffde4c0a-725e-480f-97cd-62b07be28249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:07.144642 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ffde4c0a-725e-480f-97cd-62b07be28249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1370 microversion: 2.1 time: 0.169773 Oct 18 13:22:07.145252 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 743/1451] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:06 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:07.279908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-330af1bf-5fb6-4fd8-a47e-6b13abe40cb6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:07.288507 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-330af1bf-5fb6-4fd8-a47e-6b13abe40cb6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.490682 Oct 18 13:22:07.289086 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 709/1452] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:06 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:07.342150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1f7d1cdf-2084-487c-bfc8-ed3b27a3c3a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:07.342714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1f7d1cdf-2084-487c-bfc8-ed3b27a3c3a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:07.348703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f7d1cdf-2084-487c-bfc8-ed3b27a3c3a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:07.349697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f7d1cdf-2084-487c-bfc8-ed3b27a3c3a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:07.349854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f7d1cdf-2084-487c-bfc8-ed3b27a3c3a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:07.350562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f7d1cdf-2084-487c-bfc8-ed3b27a3c3a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:07.351018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f7d1cdf-2084-487c-bfc8-ed3b27a3c3a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:07.351445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f7d1cdf-2084-487c-bfc8-ed3b27a3c3a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:07.372344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-89871779-0f30-4880-a990-c5fd92c361b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:07.373461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-89871779-0f30-4880-a990-c5fd92c361b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:07.379963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89871779-0f30-4880-a990-c5fd92c361b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:07.380454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89871779-0f30-4880-a990-c5fd92c361b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:07.380889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89871779-0f30-4880-a990-c5fd92c361b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:07.381645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89871779-0f30-4880-a990-c5fd92c361b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:07.382270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89871779-0f30-4880-a990-c5fd92c361b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:07.382897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89871779-0f30-4880-a990-c5fd92c361b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:07.492765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1f7d1cdf-2084-487c-bfc8-ed3b27a3c3a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:07.500604 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1f7d1cdf-2084-487c-bfc8-ed3b27a3c3a5 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 0.162963 Oct 18 13:22:07.501211 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 744/1453] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:07 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:07.825358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2d0bc7d2-3332-4935-9fc2-98ba6e1ce021 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:07.826130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2d0bc7d2-3332-4935-9fc2-98ba6e1ce021 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:07.832579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0bc7d2-3332-4935-9fc2-98ba6e1ce021 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:07.833225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0bc7d2-3332-4935-9fc2-98ba6e1ce021 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:07.833764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0bc7d2-3332-4935-9fc2-98ba6e1ce021 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:07.834673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0bc7d2-3332-4935-9fc2-98ba6e1ce021 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:07.835429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0bc7d2-3332-4935-9fc2-98ba6e1ce021 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:07.835979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0bc7d2-3332-4935-9fc2-98ba6e1ce021 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:07.983269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2d0bc7d2-3332-4935-9fc2-98ba6e1ce021 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:07.991741 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2d0bc7d2-3332-4935-9fc2-98ba6e1ce021 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1324 microversion: 2.1 time: 0.171852 Oct 18 13:22:07.992338 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 745/1454] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:07 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1324 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:08.050892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-89871779-0f30-4880-a990-c5fd92c361b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:08.061874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-89871779-0f30-4880-a990-c5fd92c361b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:08.063371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-89871779-0f30-4880-a990-c5fd92c361b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:08.064584 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-89871779-0f30-4880-a990-c5fd92c361b6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.696257 Oct 18 13:22:08.065147 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 710/1455] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:07 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:22:08.168776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fd25e066-354b-46ef-a436-f0ad5cdfc583 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:08.169430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fd25e066-354b-46ef-a436-f0ad5cdfc583 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:08.176153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25e066-354b-46ef-a436-f0ad5cdfc583 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:08.176568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25e066-354b-46ef-a436-f0ad5cdfc583 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:08.177007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25e066-354b-46ef-a436-f0ad5cdfc583 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:08.177738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25e066-354b-46ef-a436-f0ad5cdfc583 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:08.178303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25e066-354b-46ef-a436-f0ad5cdfc583 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:08.178731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25e066-354b-46ef-a436-f0ad5cdfc583 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:08.314520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d410ad5e-90dc-4a57-99d1-4495e5252a9a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:08.315327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d410ad5e-90dc-4a57-99d1-4495e5252a9a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:08.326846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d410ad5e-90dc-4a57-99d1-4495e5252a9a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:08.327891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d410ad5e-90dc-4a57-99d1-4495e5252a9a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:08.328673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d410ad5e-90dc-4a57-99d1-4495e5252a9a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:08.329793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d410ad5e-90dc-4a57-99d1-4495e5252a9a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:08.330768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d410ad5e-90dc-4a57-99d1-4495e5252a9a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:08.331460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d410ad5e-90dc-4a57-99d1-4495e5252a9a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:08.446626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fd25e066-354b-46ef-a436-f0ad5cdfc583 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:08.458093 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fd25e066-354b-46ef-a436-f0ad5cdfc583 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1370 microversion: 2.1 time: 0.293640 Oct 18 13:22:08.460262 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 746/1456] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:08 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1370 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:08.524367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b2994812-b1e8-4559-9c21-5b3930cb4ff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:08.528343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b2994812-b1e8-4559-9c21-5b3930cb4ff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:08.538389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2994812-b1e8-4559-9c21-5b3930cb4ff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:08.540097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2994812-b1e8-4559-9c21-5b3930cb4ff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:08.540755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2994812-b1e8-4559-9c21-5b3930cb4ff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:08.542291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2994812-b1e8-4559-9c21-5b3930cb4ff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:08.543658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2994812-b1e8-4559-9c21-5b3930cb4ff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:08.544318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2994812-b1e8-4559-9c21-5b3930cb4ff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:08.702944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d410ad5e-90dc-4a57-99d1-4495e5252a9a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:08.711597 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d410ad5e-90dc-4a57-99d1-4495e5252a9a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.401252 Oct 18 13:22:08.712487 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 711/1457] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:08 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:08.735196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e841fdf0-6774-4292-975b-198ad678c42c req-2271f3aa-c8d5-453e-bd18-f8a2686cb0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a0d527-5f2f-4c84-a99f-d22d143edb5d", "tag": "b3e787be-e21b-45a4-8719-31555d6cc6ad"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:08.746525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e841fdf0-6774-4292-975b-198ad678c42c req-2271f3aa-c8d5-453e-bd18-f8a2686cb0f0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:08.747014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e841fdf0-6774-4292-975b-198ad678c42c req-2271f3aa-c8d5-453e-bd18-f8a2686cb0f0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:08.747455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e841fdf0-6774-4292-975b-198ad678c42c req-2271f3aa-c8d5-453e-bd18-f8a2686cb0f0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:08.760940 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e841fdf0-6774-4292-975b-198ad678c42c req-2271f3aa-c8d5-453e-bd18-f8a2686cb0f0 service nova] Creating event network-changed:b3e787be-e21b-45a4-8719-31555d6cc6ad for instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d on n-h2-858384-13 Oct 18 13:22:08.767740 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e841fdf0-6774-4292-975b-198ad678c42c req-2271f3aa-c8d5-453e-bd18-f8a2686cb0f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038176 Oct 18 13:22:08.769166 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 712/1458] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:09.018212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bfbdb70b-5e17-42c6-a3ee-685daa99be05 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:09.018978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bfbdb70b-5e17-42c6-a3ee-685daa99be05 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:09.030413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfbdb70b-5e17-42c6-a3ee-685daa99be05 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:09.030913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfbdb70b-5e17-42c6-a3ee-685daa99be05 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:09.031355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfbdb70b-5e17-42c6-a3ee-685daa99be05 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:09.032089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfbdb70b-5e17-42c6-a3ee-685daa99be05 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:09.036909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfbdb70b-5e17-42c6-a3ee-685daa99be05 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:09.037402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfbdb70b-5e17-42c6-a3ee-685daa99be05 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:09.280758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b2994812-b1e8-4559-9c21-5b3930cb4ff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:09.295056 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b2994812-b1e8-4559-9c21-5b3930cb4ff1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 0.774909 Oct 18 13:22:09.295906 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 747/1459] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:08 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:09.327786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-19e9abad-5ecf-434e-bfe5-2f6d675202bf tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:09.330344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-19e9abad-5ecf-434e-bfe5-2f6d675202bf tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:09.354595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19e9abad-5ecf-434e-bfe5-2f6d675202bf tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:09.355960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19e9abad-5ecf-434e-bfe5-2f6d675202bf tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:09.356588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19e9abad-5ecf-434e-bfe5-2f6d675202bf tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:09.357533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19e9abad-5ecf-434e-bfe5-2f6d675202bf tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:09.358149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19e9abad-5ecf-434e-bfe5-2f6d675202bf tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:09.358743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19e9abad-5ecf-434e-bfe5-2f6d675202bf tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:09.387740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bfbdb70b-5e17-42c6-a3ee-685daa99be05 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:09.400255 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bfbdb70b-5e17-42c6-a3ee-685daa99be05 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1324 microversion: 2.1 time: 0.387642 Oct 18 13:22:09.422993 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 713/1460] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:09 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1324 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:09.498361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0c02dea6-8d97-464a-8729-14233a273621 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:09.499420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0c02dea6-8d97-464a-8729-14233a273621 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:09.511233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c02dea6-8d97-464a-8729-14233a273621 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:09.514255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c02dea6-8d97-464a-8729-14233a273621 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:09.516951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c02dea6-8d97-464a-8729-14233a273621 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:09.517999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c02dea6-8d97-464a-8729-14233a273621 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:09.518714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c02dea6-8d97-464a-8729-14233a273621 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:09.521370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c02dea6-8d97-464a-8729-14233a273621 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:09.633332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-19e9abad-5ecf-434e-bfe5-2f6d675202bf tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:09.643371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-19e9abad-5ecf-434e-bfe5-2f6d675202bf tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:09.650353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-19e9abad-5ecf-434e-bfe5-2f6d675202bf tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:09.651579 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-19e9abad-5ecf-434e-bfe5-2f6d675202bf tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.340457 Oct 18 13:22:09.662818 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 748/1461] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:09 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:22:09.737412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-58ee4df5-d3be-4f96-b1fe-9ef35dcd3285 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:09.738697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-58ee4df5-d3be-4f96-b1fe-9ef35dcd3285 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:09.749858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58ee4df5-d3be-4f96-b1fe-9ef35dcd3285 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:09.750612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58ee4df5-d3be-4f96-b1fe-9ef35dcd3285 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:09.753669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58ee4df5-d3be-4f96-b1fe-9ef35dcd3285 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:09.754819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58ee4df5-d3be-4f96-b1fe-9ef35dcd3285 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:09.755303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58ee4df5-d3be-4f96-b1fe-9ef35dcd3285 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:09.755744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0c02dea6-8d97-464a-8729-14233a273621 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:09.756785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58ee4df5-d3be-4f96-b1fe-9ef35dcd3285 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:09.770040 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0c02dea6-8d97-464a-8729-14233a273621 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1556 microversion: 2.1 time: 0.276517 Oct 18 13:22:09.777794 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 714/1462] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:09 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1556 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:09.800636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b9153c2f-df2e-4a05-bfec-78c4923db93f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:09.801485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b9153c2f-df2e-4a05-bfec-78c4923db93f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:09.811907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9153c2f-df2e-4a05-bfec-78c4923db93f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:09.812484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9153c2f-df2e-4a05-bfec-78c4923db93f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:09.812994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9153c2f-df2e-4a05-bfec-78c4923db93f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:09.813810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9153c2f-df2e-4a05-bfec-78c4923db93f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:09.814696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9153c2f-df2e-4a05-bfec-78c4923db93f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:09.815515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9153c2f-df2e-4a05-bfec-78c4923db93f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:09.948951 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b9153c2f-df2e-4a05-bfec-78c4923db93f tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154098 Oct 18 13:22:09.957514 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 715/1463] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:22:09 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:10.144067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-58ee4df5-d3be-4f96-b1fe-9ef35dcd3285 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:10.158093 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-58ee4df5-d3be-4f96-b1fe-9ef35dcd3285 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.424582 Oct 18 13:22:10.159100 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 749/1464] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:09 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:10.322622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2139a860-877a-48c2-8758-bce98d19d20d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:10.323528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2139a860-877a-48c2-8758-bce98d19d20d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:10.330061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2139a860-877a-48c2-8758-bce98d19d20d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:10.330894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2139a860-877a-48c2-8758-bce98d19d20d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:10.331540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2139a860-877a-48c2-8758-bce98d19d20d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:10.332450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2139a860-877a-48c2-8758-bce98d19d20d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:10.333127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2139a860-877a-48c2-8758-bce98d19d20d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:10.333823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2139a860-877a-48c2-8758-bce98d19d20d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:10.427259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04cce6bc-5384-4b9d-a099-1c75397ade88 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:10.427889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04cce6bc-5384-4b9d-a099-1c75397ade88 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:10.439089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04cce6bc-5384-4b9d-a099-1c75397ade88 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:10.439585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04cce6bc-5384-4b9d-a099-1c75397ade88 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:10.440247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04cce6bc-5384-4b9d-a099-1c75397ade88 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:10.440728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04cce6bc-5384-4b9d-a099-1c75397ade88 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:10.441216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04cce6bc-5384-4b9d-a099-1c75397ade88 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:10.441635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04cce6bc-5384-4b9d-a099-1c75397ade88 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:10.566597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2139a860-877a-48c2-8758-bce98d19d20d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:10.578249 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2139a860-877a-48c2-8758-bce98d19d20d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 0.260281 Oct 18 13:22:10.579932 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 716/1465] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:10 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:10.682466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8b63a4ed-bfe3-42d8-a491-9c082a82a317 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:10.683746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8b63a4ed-bfe3-42d8-a491-9c082a82a317 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:10.693114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b63a4ed-bfe3-42d8-a491-9c082a82a317 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:10.707154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b63a4ed-bfe3-42d8-a491-9c082a82a317 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:10.708301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b63a4ed-bfe3-42d8-a491-9c082a82a317 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:10.722224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b63a4ed-bfe3-42d8-a491-9c082a82a317 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:10.722911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b63a4ed-bfe3-42d8-a491-9c082a82a317 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:10.723510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b63a4ed-bfe3-42d8-a491-9c082a82a317 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:10.866073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04cce6bc-5384-4b9d-a099-1c75397ade88 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:10.897121 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04cce6bc-5384-4b9d-a099-1c75397ade88 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1324 microversion: 2.1 time: 0.471370 Oct 18 13:22:10.898646 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 750/1466] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:10 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1324 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:11.077789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d4bcaf80-6a5d-4856-8e5f-6886635821f2 req-1ee0a8c4-7860-4ea4-805c-3d90551fb6ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aad90b5-28fb-44b2-89da-33bc1b2889f2", "name": "network-vif-plugged", "status": "completed", "tag": "516c3ad3-1e31-4bde-b674-c0c367989f56"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:11.103628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d4bcaf80-6a5d-4856-8e5f-6886635821f2 req-1ee0a8c4-7860-4ea4-805c-3d90551fb6ce service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:11.104328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d4bcaf80-6a5d-4856-8e5f-6886635821f2 req-1ee0a8c4-7860-4ea4-805c-3d90551fb6ce service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:11.104994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d4bcaf80-6a5d-4856-8e5f-6886635821f2 req-1ee0a8c4-7860-4ea4-805c-3d90551fb6ce service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:11.118049 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d4bcaf80-6a5d-4856-8e5f-6886635821f2 req-1ee0a8c4-7860-4ea4-805c-3d90551fb6ce service nova] Creating event network-vif-plugged:516c3ad3-1e31-4bde-b674-c0c367989f56 for instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 on n-h1-858384-13 Oct 18 13:22:11.123728 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d4bcaf80-6a5d-4856-8e5f-6886635821f2 req-1ee0a8c4-7860-4ea4-805c-3d90551fb6ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049690 Oct 18 13:22:11.124660 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 751/1467] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:22:11.148111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8b63a4ed-bfe3-42d8-a491-9c082a82a317 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:11.158128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8b63a4ed-bfe3-42d8-a491-9c082a82a317 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:11.159595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8b63a4ed-bfe3-42d8-a491-9c082a82a317 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:11.160842 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8b63a4ed-bfe3-42d8-a491-9c082a82a317 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.482444 Oct 18 13:22:11.165279 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 717/1468] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:10 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:22:11.185678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc097271-e266-4daf-b5dd-4b74669e9063 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:11.186692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc097271-e266-4daf-b5dd-4b74669e9063 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:11.195593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc097271-e266-4daf-b5dd-4b74669e9063 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:11.196522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc097271-e266-4daf-b5dd-4b74669e9063 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:11.197360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc097271-e266-4daf-b5dd-4b74669e9063 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:11.198331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc097271-e266-4daf-b5dd-4b74669e9063 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:11.199534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc097271-e266-4daf-b5dd-4b74669e9063 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:11.200147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc097271-e266-4daf-b5dd-4b74669e9063 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:11.581486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc097271-e266-4daf-b5dd-4b74669e9063 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:11.591267 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc097271-e266-4daf-b5dd-4b74669e9063 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.410760 Oct 18 13:22:11.592225 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 752/1469] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:11 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:11.607834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe2a54de-af8c-4076-a937-17de9d34d7dd tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:11.609368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe2a54de-af8c-4076-a937-17de9d34d7dd tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:11.622654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe2a54de-af8c-4076-a937-17de9d34d7dd tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:11.623485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe2a54de-af8c-4076-a937-17de9d34d7dd tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:11.624390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe2a54de-af8c-4076-a937-17de9d34d7dd tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:11.625685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe2a54de-af8c-4076-a937-17de9d34d7dd tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:11.626446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe2a54de-af8c-4076-a937-17de9d34d7dd tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:11.627174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe2a54de-af8c-4076-a937-17de9d34d7dd tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:11.657833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:11.874894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe2a54de-af8c-4076-a937-17de9d34d7dd tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:11.883747 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fe2a54de-af8c-4076-a937-17de9d34d7dd tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 0.283594 Oct 18 13:22:11.884745 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 718/1470] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:11 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:11.941803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e984a6e8-3279-4fdc-8712-e5b8a041075d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:11.943131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e984a6e8-3279-4fdc-8712-e5b8a041075d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:11.951930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e984a6e8-3279-4fdc-8712-e5b8a041075d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:11.952863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e984a6e8-3279-4fdc-8712-e5b8a041075d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:11.953592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e984a6e8-3279-4fdc-8712-e5b8a041075d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:11.954516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e984a6e8-3279-4fdc-8712-e5b8a041075d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:11.955347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e984a6e8-3279-4fdc-8712-e5b8a041075d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:11.956127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e984a6e8-3279-4fdc-8712-e5b8a041075d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:11.966655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:12.188041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41327a4d-57f5-47f5-aa51-cef1ee318511 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:12.188652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-41327a4d-57f5-47f5-aa51-cef1ee318511 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:12.195139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41327a4d-57f5-47f5-aa51-cef1ee318511 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:12.195901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41327a4d-57f5-47f5-aa51-cef1ee318511 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:12.196332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41327a4d-57f5-47f5-aa51-cef1ee318511 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:12.197486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41327a4d-57f5-47f5-aa51-cef1ee318511 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:12.198168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41327a4d-57f5-47f5-aa51-cef1ee318511 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:12.198722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41327a4d-57f5-47f5-aa51-cef1ee318511 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:12.295852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e984a6e8-3279-4fdc-8712-e5b8a041075d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:12.307477 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e984a6e8-3279-4fdc-8712-e5b8a041075d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1324 microversion: 2.1 time: 0.371469 Oct 18 13:22:12.351514 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 753/1471] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:11 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1324 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:12.406343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1016b317-9ccf-4fa3-b698-0282268b5b7a req-c39ec8ff-1a97-482e-a676-25aed25784a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5", "tag": "c3e8ef87-af4e-4090-bad2-4230866897d8"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:12.428392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1016b317-9ccf-4fa3-b698-0282268b5b7a req-c39ec8ff-1a97-482e-a676-25aed25784a9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:12.434503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1016b317-9ccf-4fa3-b698-0282268b5b7a req-c39ec8ff-1a97-482e-a676-25aed25784a9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:12.435082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1016b317-9ccf-4fa3-b698-0282268b5b7a req-c39ec8ff-1a97-482e-a676-25aed25784a9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:12.463350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-41327a4d-57f5-47f5-aa51-cef1ee318511 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:12.472570 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1016b317-9ccf-4fa3-b698-0282268b5b7a req-c39ec8ff-1a97-482e-a676-25aed25784a9 service nova] Creating event network-changed:c3e8ef87-af4e-4090-bad2-4230866897d8 for instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 on n-h2-858384-13 Oct 18 13:22:12.475964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-41327a4d-57f5-47f5-aa51-cef1ee318511 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:12.478020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-41327a4d-57f5-47f5-aa51-cef1ee318511 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:12.479621 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-41327a4d-57f5-47f5-aa51-cef1ee318511 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.296463 Oct 18 13:22:12.481338 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 719/1472] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:12 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:22:12.498533 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1016b317-9ccf-4fa3-b698-0282268b5b7a req-c39ec8ff-1a97-482e-a676-25aed25784a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098404 Oct 18 13:22:12.499600 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 754/1473] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:12.615649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c9a0491c-5111-494f-b601-e1017fae0c7c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:12.617485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c9a0491c-5111-494f-b601-e1017fae0c7c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:12.631529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9a0491c-5111-494f-b601-e1017fae0c7c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:12.645436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9a0491c-5111-494f-b601-e1017fae0c7c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:12.646073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9a0491c-5111-494f-b601-e1017fae0c7c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:12.646964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9a0491c-5111-494f-b601-e1017fae0c7c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:12.647532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9a0491c-5111-494f-b601-e1017fae0c7c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:12.657452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9a0491c-5111-494f-b601-e1017fae0c7c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:12.986671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c9a0491c-5111-494f-b601-e1017fae0c7c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:13.011495 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c9a0491c-5111-494f-b601-e1017fae0c7c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.399213 Oct 18 13:22:13.018288 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 720/1474] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:12 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:13.035345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7a8563b3-81fe-4eb0-bf67-5ed9ce146157 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:13.038300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7a8563b3-81fe-4eb0-bf67-5ed9ce146157 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:13.059042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:13.060977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a8563b3-81fe-4eb0-bf67-5ed9ce146157 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:13.061770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a8563b3-81fe-4eb0-bf67-5ed9ce146157 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:13.062483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a8563b3-81fe-4eb0-bf67-5ed9ce146157 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:13.063572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a8563b3-81fe-4eb0-bf67-5ed9ce146157 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:13.064264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a8563b3-81fe-4eb0-bf67-5ed9ce146157 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:13.064900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a8563b3-81fe-4eb0-bf67-5ed9ce146157 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:13.124458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1993299939", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "f61d9dd3-2d30-4077-83fd-6cb55fe03a9c"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:13.223559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] validate_networks() for [('f61d9dd3-2d30-4077-83fd-6cb55fe03a9c', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:22:13.543617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7a8563b3-81fe-4eb0-bf67-5ed9ce146157 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:13.559845 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7a8563b3-81fe-4eb0-bf67-5ed9ce146157 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 0.539427 Oct 18 13:22:13.562857 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 721/1475] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:13 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:13.584977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2aeef556-3f1f-4942-a36d-4a4eef75bd6e tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:13.598988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2aeef556-3f1f-4942-a36d-4a4eef75bd6e tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:13.600175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2aeef556-3f1f-4942-a36d-4a4eef75bd6e tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Searching by: {'deleted': False, 'project_id': '76780439ae344b2998c1312a36ca9046'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:22:13.611551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2aeef556-3f1f-4942-a36d-4a4eef75bd6e tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:13.614339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2aeef556-3f1f-4942-a36d-4a4eef75bd6e tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:13.616189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2aeef556-3f1f-4942-a36d-4a4eef75bd6e tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:13.617775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2aeef556-3f1f-4942-a36d-4a4eef75bd6e tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:13.619490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2aeef556-3f1f-4942-a36d-4a4eef75bd6e tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:13.620158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2aeef556-3f1f-4942-a36d-4a4eef75bd6e tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:13.821141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-2aeef556-3f1f-4942-a36d-4a4eef75bd6e tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:22:13.895978 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2aeef556-3f1f-4942-a36d-4a4eef75bd6e tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.317314 Oct 18 13:22:13.905679 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 722/1476] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 13:22:13 2022] GET /compute/v2.1/servers => generated 333 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:13.914226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a11cd940-75ee-4e86-af67-82064d5e0691 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:13.915130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a11cd940-75ee-4e86-af67-82064d5e0691 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:13.922584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a11cd940-75ee-4e86-af67-82064d5e0691 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:13.923314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a11cd940-75ee-4e86-af67-82064d5e0691 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:13.924618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a11cd940-75ee-4e86-af67-82064d5e0691 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:13.925724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a11cd940-75ee-4e86-af67-82064d5e0691 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:13.927019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a11cd940-75ee-4e86-af67-82064d5e0691 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:13.927688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a11cd940-75ee-4e86-af67-82064d5e0691 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:13.960381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:22:13.961205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:22:13.961917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:22:13.962485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:22:13.963063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:22:13.989539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:13.990206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:13.990638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:13.991888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:13.992551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:13.993055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:14.093100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Getting quotas for project cf7c744c508342f5947ae08743ccc6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:22:14.115175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Getting quotas for user 2b3d9555419845cc9bc9f650e676d776 and project cf7c744c508342f5947ae08743ccc6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:22:14.146265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:22:14.153662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:22:14.208608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a11cd940-75ee-4e86-af67-82064d5e0691 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:14.216585 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a11cd940-75ee-4e86-af67-82064d5e0691 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1324 microversion: 2.1 time: 0.308911 Oct 18 13:22:14.218139 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 723/1477] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:13 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1324 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:14.234906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-038940ed-7ae7-4d4d-a835-a78a6b4a6906 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:14.235870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-038940ed-7ae7-4d4d-a835-a78a6b4a6906 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:14.255110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-038940ed-7ae7-4d4d-a835-a78a6b4a6906 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:14.255875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-038940ed-7ae7-4d4d-a835-a78a6b4a6906 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:14.256514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-038940ed-7ae7-4d4d-a835-a78a6b4a6906 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:14.257547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-038940ed-7ae7-4d4d-a835-a78a6b4a6906 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:14.258179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-038940ed-7ae7-4d4d-a835-a78a6b4a6906 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:14.258602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-038940ed-7ae7-4d4d-a835-a78a6b4a6906 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:14.279698 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0c295342-c7a2-4942-93da-08dde69f1393 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.442527 Oct 18 13:22:14.280754 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 755/1478] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:22:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:22:14.293684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:14.327507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:14.330776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Searching by: {'deleted': False, 'project_id': '76780439ae344b2998c1312a36ca9046'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:22:14.340969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:14.341758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:14.342340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:14.343377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:14.344685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:14.345161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:14.399465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:22:14.627749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:14.649425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:14.651260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:14.652269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:14.738360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-038940ed-7ae7-4d4d-a835-a78a6b4a6906 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:14.761977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-038940ed-7ae7-4d4d-a835-a78a6b4a6906 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:14.771028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-038940ed-7ae7-4d4d-a835-a78a6b4a6906 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:14.775948 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-038940ed-7ae7-4d4d-a835-a78a6b4a6906 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.556719 Oct 18 13:22:14.793324 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 724/1479] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:14 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:22:14.795617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0f16912-e777-4376-b4d0-c0a82f7f9ded tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:14.797128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e0f16912-e777-4376-b4d0-c0a82f7f9ded tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:14.813451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f16912-e777-4376-b4d0-c0a82f7f9ded tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:14.815736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f16912-e777-4376-b4d0-c0a82f7f9ded tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:14.819174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f16912-e777-4376-b4d0-c0a82f7f9ded tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:14.821127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f16912-e777-4376-b4d0-c0a82f7f9ded tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:14.821889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f16912-e777-4376-b4d0-c0a82f7f9ded tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:14.825607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f16912-e777-4376-b4d0-c0a82f7f9ded tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:14.874328 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-afcecb9d-2401-494f-ab8a-0f29ca4ab3bf tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.592370 Oct 18 13:22:14.875596 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 756/1480] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:22:14 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:14.883925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13c6e2d7-096f-43a6-ae34-1459429750ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:14.884926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-13c6e2d7-096f-43a6-ae34-1459429750ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:15.024942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-13c6e2d7-096f-43a6-ae34-1459429750ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:15.042425 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13c6e2d7-096f-43a6-ae34-1459429750ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1211 microversion: 2.1 time: 0.164127 Oct 18 13:22:15.043469 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 757/1481] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:14 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1211 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:15.287510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f7c12010-5cec-4710-a59c-d8144c8a0291 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:15.288200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f7c12010-5cec-4710-a59c-d8144c8a0291 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:15.297834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7c12010-5cec-4710-a59c-d8144c8a0291 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:15.298755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7c12010-5cec-4710-a59c-d8144c8a0291 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:15.299409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7c12010-5cec-4710-a59c-d8144c8a0291 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:15.300316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7c12010-5cec-4710-a59c-d8144c8a0291 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:15.300957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7c12010-5cec-4710-a59c-d8144c8a0291 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:15.301663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7c12010-5cec-4710-a59c-d8144c8a0291 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:15.649221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e0f16912-e777-4376-b4d0-c0a82f7f9ded tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:15.662010 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e0f16912-e777-4376-b4d0-c0a82f7f9ded tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.877274 Oct 18 13:22:15.663489 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 725/1482] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:14 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:15.677693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a3453f2d-0a52-4b30-90d2-5167020d04b5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:15.693462 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a3453f2d-0a52-4b30-90d2-5167020d04b5 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028071 Oct 18 13:22:15.694623 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 726/1483] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:22:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:15.708587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-70857c2c-dfe8-4022-8322-62a0e75abf97 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:15.710555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-70857c2c-dfe8-4022-8322-62a0e75abf97 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:15.722880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70857c2c-dfe8-4022-8322-62a0e75abf97 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:15.727722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70857c2c-dfe8-4022-8322-62a0e75abf97 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:15.728440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70857c2c-dfe8-4022-8322-62a0e75abf97 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:15.729414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70857c2c-dfe8-4022-8322-62a0e75abf97 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:15.730881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70857c2c-dfe8-4022-8322-62a0e75abf97 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:15.731675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70857c2c-dfe8-4022-8322-62a0e75abf97 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:15.740600 n-d-858384-13 devstack@n-api.service[120612]: Exception ignored in: . at 0x7ff60f6830d0> Oct 18 13:22:15.741358 n-d-858384-13 devstack@n-api.service[120612]: Traceback (most recent call last): Oct 18 13:22:15.741531 n-d-858384-13 devstack@n-api.service[120612]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 18 13:22:15.748557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f7c12010-5cec-4710-a59c-d8144c8a0291 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:15.753526 n-d-858384-13 devstack@n-api.service[120612]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 18 13:22:15.753761 n-d-858384-13 devstack@n-api.service[120612]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 18 13:22:15.757968 n-d-858384-13 devstack@n-api.service[120612]: connection_record.checkin() Oct 18 13:22:15.758141 n-d-858384-13 devstack@n-api.service[120612]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 18 13:22:15.758573 n-d-858384-13 devstack@n-api.service[120612]: pool.dispatch.checkin(connection, self) Oct 18 13:22:15.758769 n-d-858384-13 devstack@n-api.service[120612]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 18 13:22:15.761795 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f7c12010-5cec-4710-a59c-d8144c8a0291 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 0.717092 Oct 18 13:22:15.767189 n-d-858384-13 devstack@n-api.service[120612]: fn(*args, **kw) Oct 18 13:22:15.767420 n-d-858384-13 devstack@n-api.service[120612]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 18 13:22:15.770448 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 758/1484] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:15 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:15.773201 n-d-858384-13 devstack@n-api.service[120612]: time.sleep(0) Oct 18 13:22:15.773201 n-d-858384-13 devstack@n-api.service[120612]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 18 13:22:15.773201 n-d-858384-13 devstack@n-api.service[120612]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 18 13:22:15.773201 n-d-858384-13 devstack@n-api.service[120612]: AssertionError: do not call blocking functions from the mainloop Oct 18 13:22:15.813825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d0f3145-1f55-4623-84b7-7730e57db25b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:15.814315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d0f3145-1f55-4623-84b7-7730e57db25b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:15.830663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d0f3145-1f55-4623-84b7-7730e57db25b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:15.832209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d0f3145-1f55-4623-84b7-7730e57db25b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:15.832854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d0f3145-1f55-4623-84b7-7730e57db25b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:15.834366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d0f3145-1f55-4623-84b7-7730e57db25b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:15.836695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d0f3145-1f55-4623-84b7-7730e57db25b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:15.837388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d0f3145-1f55-4623-84b7-7730e57db25b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:16.343327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d0f3145-1f55-4623-84b7-7730e57db25b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:16.359211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d0f3145-1f55-4623-84b7-7730e57db25b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:16.360728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d0f3145-1f55-4623-84b7-7730e57db25b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:16.365828 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d0f3145-1f55-4623-84b7-7730e57db25b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.553699 Oct 18 13:22:16.381896 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 759/1485] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:15 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:22:16.394728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-96f07f02-1ac2-4af0-a2b8-0b45dc70dbb2 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:16.395746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-96f07f02-1ac2-4af0-a2b8-0b45dc70dbb2 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:16.409841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96f07f02-1ac2-4af0-a2b8-0b45dc70dbb2 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:16.413707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96f07f02-1ac2-4af0-a2b8-0b45dc70dbb2 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:16.415775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96f07f02-1ac2-4af0-a2b8-0b45dc70dbb2 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:16.416693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96f07f02-1ac2-4af0-a2b8-0b45dc70dbb2 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:16.418701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96f07f02-1ac2-4af0-a2b8-0b45dc70dbb2 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:16.422608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96f07f02-1ac2-4af0-a2b8-0b45dc70dbb2 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:16.477722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-96f07f02-1ac2-4af0-a2b8-0b45dc70dbb2 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:22:16.677751 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-96f07f02-1ac2-4af0-a2b8-0b45dc70dbb2 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 204 len: 0 microversion: 2.1 time: 0.294354 Oct 18 13:22:16.680256 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 760/1486] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:22:16 2022] DELETE /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:22:16.692659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3236f486-1796-4373-99db-062d7dba08a4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:16.693966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3236f486-1796-4373-99db-062d7dba08a4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:16.705684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3236f486-1796-4373-99db-062d7dba08a4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:16.706636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3236f486-1796-4373-99db-062d7dba08a4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:16.707463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3236f486-1796-4373-99db-062d7dba08a4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:16.708506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3236f486-1796-4373-99db-062d7dba08a4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:16.709552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3236f486-1796-4373-99db-062d7dba08a4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:16.710827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3236f486-1796-4373-99db-062d7dba08a4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:16.816248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3236f486-1796-4373-99db-062d7dba08a4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:16.830640 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3236f486-1796-4373-99db-062d7dba08a4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1263 microversion: 2.1 time: 0.148555 Oct 18 13:22:16.831625 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 761/1487] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:16 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:16.839206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a7bfe59a-a565-47a6-ac48-973205f19def tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:16.840164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a7bfe59a-a565-47a6-ac48-973205f19def tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:16.848713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7bfe59a-a565-47a6-ac48-973205f19def tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:16.849615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7bfe59a-a565-47a6-ac48-973205f19def tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:16.850218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7bfe59a-a565-47a6-ac48-973205f19def tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:16.851245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7bfe59a-a565-47a6-ac48-973205f19def tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:16.851854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7bfe59a-a565-47a6-ac48-973205f19def tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:16.852449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7bfe59a-a565-47a6-ac48-973205f19def tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:16.986620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-70857c2c-dfe8-4022-8322-62a0e75abf97 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:17.007377 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-70857c2c-dfe8-4022-8322-62a0e75abf97 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1324 microversion: 2.1 time: 1.311371 Oct 18 13:22:17.009511 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 727/1488] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:15 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1324 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:17.018290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b43972b4-1107-4dbf-affc-b6c4f353c13a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:17.019221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b43972b4-1107-4dbf-affc-b6c4f353c13a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:17.033384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b43972b4-1107-4dbf-affc-b6c4f353c13a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:17.034214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b43972b4-1107-4dbf-affc-b6c4f353c13a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:17.034909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b43972b4-1107-4dbf-affc-b6c4f353c13a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:17.037350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b43972b4-1107-4dbf-affc-b6c4f353c13a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:17.038797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b43972b4-1107-4dbf-affc-b6c4f353c13a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:17.040241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b43972b4-1107-4dbf-affc-b6c4f353c13a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:17.144482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a7bfe59a-a565-47a6-ac48-973205f19def tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:17.153774 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a7bfe59a-a565-47a6-ac48-973205f19def tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1699 microversion: 2.1 time: 0.320760 Oct 18 13:22:17.165595 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 762/1489] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:16 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1699 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:17.181075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-037c627c-f201-41db-b513-fd72bf856c67 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:17.183146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-037c627c-f201-41db-b513-fd72bf856c67 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:17.194393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-037c627c-f201-41db-b513-fd72bf856c67 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:17.195790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-037c627c-f201-41db-b513-fd72bf856c67 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:17.197267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-037c627c-f201-41db-b513-fd72bf856c67 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:17.198900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-037c627c-f201-41db-b513-fd72bf856c67 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:17.199535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-037c627c-f201-41db-b513-fd72bf856c67 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:17.200452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-037c627c-f201-41db-b513-fd72bf856c67 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:17.490139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b43972b4-1107-4dbf-affc-b6c4f353c13a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:17.503465 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b43972b4-1107-4dbf-affc-b6c4f353c13a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.491967 Oct 18 13:22:17.510137 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 728/1490] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:17 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:17.527183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-037c627c-f201-41db-b513-fd72bf856c67 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:17.533017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-269dde76-1b7e-4f7f-9158-b5d29323d8cd req-63409c47-5ca1-4f24-9164-beabf4a3c26a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a0d527-5f2f-4c84-a99f-d22d143edb5d", "name": "network-vif-plugged", "status": "completed", "tag": "b3e787be-e21b-45a4-8719-31555d6cc6ad"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:17.545996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-269dde76-1b7e-4f7f-9158-b5d29323d8cd req-63409c47-5ca1-4f24-9164-beabf4a3c26a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:17.546782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-269dde76-1b7e-4f7f-9158-b5d29323d8cd req-63409c47-5ca1-4f24-9164-beabf4a3c26a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:17.551898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-269dde76-1b7e-4f7f-9158-b5d29323d8cd req-63409c47-5ca1-4f24-9164-beabf4a3c26a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:17.552442 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-037c627c-f201-41db-b513-fd72bf856c67 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 0.382801 Oct 18 13:22:17.571680 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-269dde76-1b7e-4f7f-9158-b5d29323d8cd req-63409c47-5ca1-4f24-9164-beabf4a3c26a service nova] Creating event network-vif-plugged:b3e787be-e21b-45a4-8719-31555d6cc6ad for instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d on n-h2-858384-13 Oct 18 13:22:17.574699 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 763/1491] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:17 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:17.583187 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-269dde76-1b7e-4f7f-9158-b5d29323d8cd req-63409c47-5ca1-4f24-9164-beabf4a3c26a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070478 Oct 18 13:22:17.588328 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 729/1492] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:17.594277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b55236f4-68a6-4391-9c2d-19e902b71661 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:17.595017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b55236f4-68a6-4391-9c2d-19e902b71661 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:17.612177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b55236f4-68a6-4391-9c2d-19e902b71661 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:17.613266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b55236f4-68a6-4391-9c2d-19e902b71661 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:17.613932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b55236f4-68a6-4391-9c2d-19e902b71661 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:17.615326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b55236f4-68a6-4391-9c2d-19e902b71661 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:17.616392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b55236f4-68a6-4391-9c2d-19e902b71661 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:17.617095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b55236f4-68a6-4391-9c2d-19e902b71661 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:17.872854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c034ab0b-fc7f-4a82-a6e3-e58bdbe99492 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:17.874861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c034ab0b-fc7f-4a82-a6e3-e58bdbe99492 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:17.903215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c034ab0b-fc7f-4a82-a6e3-e58bdbe99492 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:17.903840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c034ab0b-fc7f-4a82-a6e3-e58bdbe99492 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:17.904592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c034ab0b-fc7f-4a82-a6e3-e58bdbe99492 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:17.909590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c034ab0b-fc7f-4a82-a6e3-e58bdbe99492 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:17.910171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c034ab0b-fc7f-4a82-a6e3-e58bdbe99492 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:17.910624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c034ab0b-fc7f-4a82-a6e3-e58bdbe99492 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:17.969931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b55236f4-68a6-4391-9c2d-19e902b71661 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:17.980689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b55236f4-68a6-4391-9c2d-19e902b71661 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:17.982844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b55236f4-68a6-4391-9c2d-19e902b71661 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:17.984075 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b55236f4-68a6-4391-9c2d-19e902b71661 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.408313 Oct 18 13:22:17.985044 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 764/1493] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:17 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:22:18.038012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-be3940af-48fd-43fc-a48a-a427926a2481 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:18.038913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-be3940af-48fd-43fc-a48a-a427926a2481 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:18.057693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3940af-48fd-43fc-a48a-a427926a2481 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:18.060418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3940af-48fd-43fc-a48a-a427926a2481 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:18.060947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3940af-48fd-43fc-a48a-a427926a2481 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:18.062459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3940af-48fd-43fc-a48a-a427926a2481 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:18.064694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3940af-48fd-43fc-a48a-a427926a2481 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:18.065132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3940af-48fd-43fc-a48a-a427926a2481 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:18.091944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c034ab0b-fc7f-4a82-a6e3-e58bdbe99492 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:18.107597 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c034ab0b-fc7f-4a82-a6e3-e58bdbe99492 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1269 microversion: 2.1 time: 0.255227 Oct 18 13:22:18.108367 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 730/1494] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:17 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1269 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:18.182013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e9b39b4b-c547-45f4-9974-e5f4de300bcd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:18.182671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e9b39b4b-c547-45f4-9974-e5f4de300bcd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:18.189815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9b39b4b-c547-45f4-9974-e5f4de300bcd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:18.190592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9b39b4b-c547-45f4-9974-e5f4de300bcd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:18.191414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9b39b4b-c547-45f4-9974-e5f4de300bcd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:18.192449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9b39b4b-c547-45f4-9974-e5f4de300bcd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:18.193072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9b39b4b-c547-45f4-9974-e5f4de300bcd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:18.193686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9b39b4b-c547-45f4-9974-e5f4de300bcd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:18.251677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-be3940af-48fd-43fc-a48a-a427926a2481 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:18.268260 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-be3940af-48fd-43fc-a48a-a427926a2481 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1324 microversion: 2.1 time: 0.234663 Oct 18 13:22:18.270017 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 765/1495] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:18 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1324 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:18.530891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f615459a-87b7-4589-82d2-86c2c4b26cc1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:18.531571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f615459a-87b7-4589-82d2-86c2c4b26cc1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:18.544462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f615459a-87b7-4589-82d2-86c2c4b26cc1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:18.544929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f615459a-87b7-4589-82d2-86c2c4b26cc1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:18.545664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f615459a-87b7-4589-82d2-86c2c4b26cc1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:18.546381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f615459a-87b7-4589-82d2-86c2c4b26cc1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:18.546837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f615459a-87b7-4589-82d2-86c2c4b26cc1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:18.547269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f615459a-87b7-4589-82d2-86c2c4b26cc1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:18.658195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e9b39b4b-c547-45f4-9974-e5f4de300bcd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:18.666431 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e9b39b4b-c547-45f4-9974-e5f4de300bcd tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1699 microversion: 2.1 time: 0.488478 Oct 18 13:22:18.667596 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 731/1496] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:18 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1699 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:18.672894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0567be4-f9c4-4b78-946d-a3aa14fad991 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:18.685700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c0567be4-f9c4-4b78-946d-a3aa14fad991 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:18.694533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0567be4-f9c4-4b78-946d-a3aa14fad991 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:18.696730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0567be4-f9c4-4b78-946d-a3aa14fad991 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:18.697428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0567be4-f9c4-4b78-946d-a3aa14fad991 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:18.698215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0567be4-f9c4-4b78-946d-a3aa14fad991 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:18.698800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0567be4-f9c4-4b78-946d-a3aa14fad991 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:18.699331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0567be4-f9c4-4b78-946d-a3aa14fad991 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:18.803686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f615459a-87b7-4589-82d2-86c2c4b26cc1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:18.826041 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f615459a-87b7-4589-82d2-86c2c4b26cc1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.298630 Oct 18 13:22:18.828121 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 766/1497] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:18 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:19.011544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-08c646d4-48c5-4f3b-9d30-31a1a7ed0cd4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:19.012377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-08c646d4-48c5-4f3b-9d30-31a1a7ed0cd4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:19.025225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c646d4-48c5-4f3b-9d30-31a1a7ed0cd4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:19.026003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c646d4-48c5-4f3b-9d30-31a1a7ed0cd4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:19.031940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c646d4-48c5-4f3b-9d30-31a1a7ed0cd4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:19.031940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c646d4-48c5-4f3b-9d30-31a1a7ed0cd4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:19.031940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c646d4-48c5-4f3b-9d30-31a1a7ed0cd4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:19.031940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c646d4-48c5-4f3b-9d30-31a1a7ed0cd4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:19.155918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c0567be4-f9c4-4b78-946d-a3aa14fad991 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:19.178558 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c0567be4-f9c4-4b78-946d-a3aa14fad991 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 0.509625 Oct 18 13:22:19.179153 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 732/1498] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:18 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:19.197505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad85c625-a1bf-4063-9a99-d34eea0f33e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:19.203407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ad85c625-a1bf-4063-9a99-d34eea0f33e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:19.230250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad85c625-a1bf-4063-9a99-d34eea0f33e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:19.231970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad85c625-a1bf-4063-9a99-d34eea0f33e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:19.233347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad85c625-a1bf-4063-9a99-d34eea0f33e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:19.237878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad85c625-a1bf-4063-9a99-d34eea0f33e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:19.238598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad85c625-a1bf-4063-9a99-d34eea0f33e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:19.239224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad85c625-a1bf-4063-9a99-d34eea0f33e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:19.455614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-08c646d4-48c5-4f3b-9d30-31a1a7ed0cd4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:19.474239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-08c646d4-48c5-4f3b-9d30-31a1a7ed0cd4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:19.475688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-08c646d4-48c5-4f3b-9d30-31a1a7ed0cd4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:19.476894 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-08c646d4-48c5-4f3b-9d30-31a1a7ed0cd4 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1813 microversion: 2.25 time: 0.469980 Oct 18 13:22:19.477634 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 767/1499] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:19 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1813 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:22:19.493629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5a6bac65-ef4a-4a76-a741-6336d5291b6b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:19.494918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5a6bac65-ef4a-4a76-a741-6336d5291b6b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:19.509015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a6bac65-ef4a-4a76-a741-6336d5291b6b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:19.509666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a6bac65-ef4a-4a76-a741-6336d5291b6b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:19.510109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a6bac65-ef4a-4a76-a741-6336d5291b6b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:19.514852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a6bac65-ef4a-4a76-a741-6336d5291b6b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:19.515512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a6bac65-ef4a-4a76-a741-6336d5291b6b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:19.516139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a6bac65-ef4a-4a76-a741-6336d5291b6b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:19.736106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad85c625-a1bf-4063-9a99-d34eea0f33e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:19.745999 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad85c625-a1bf-4063-9a99-d34eea0f33e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1311 microversion: 2.1 time: 0.559249 Oct 18 13:22:19.750180 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 733/1500] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:19 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1311 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:19.782841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6c169ffd-7ac6-4a2d-846f-762ee5278c67 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:19.785964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6c169ffd-7ac6-4a2d-846f-762ee5278c67 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:19.796917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c169ffd-7ac6-4a2d-846f-762ee5278c67 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:19.797461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c169ffd-7ac6-4a2d-846f-762ee5278c67 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:19.797897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c169ffd-7ac6-4a2d-846f-762ee5278c67 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:19.806137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c169ffd-7ac6-4a2d-846f-762ee5278c67 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:19.808031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c169ffd-7ac6-4a2d-846f-762ee5278c67 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:19.809696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c169ffd-7ac6-4a2d-846f-762ee5278c67 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:19.842253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5a6bac65-ef4a-4a76-a741-6336d5291b6b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:19.851584 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5a6bac65-ef4a-4a76-a741-6336d5291b6b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1521 microversion: 2.1 time: 0.366272 Oct 18 13:22:19.866158 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 768/1501] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:19 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:19.892085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e158cc45-bfd7-4241-9d64-2cfe2e8ab2d3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:19.892717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e158cc45-bfd7-4241-9d64-2cfe2e8ab2d3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:19.899951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e158cc45-bfd7-4241-9d64-2cfe2e8ab2d3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:19.901620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e158cc45-bfd7-4241-9d64-2cfe2e8ab2d3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:19.902766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e158cc45-bfd7-4241-9d64-2cfe2e8ab2d3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:19.909366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e158cc45-bfd7-4241-9d64-2cfe2e8ab2d3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:19.910452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e158cc45-bfd7-4241-9d64-2cfe2e8ab2d3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:19.911399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e158cc45-bfd7-4241-9d64-2cfe2e8ab2d3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:20.164594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e158cc45-bfd7-4241-9d64-2cfe2e8ab2d3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:20.168058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:20.186041 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e158cc45-bfd7-4241-9d64-2cfe2e8ab2d3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.312630 Oct 18 13:22:20.201248 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 769/1502] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:19 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:20.201248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fe983f98-b103-4bdb-9f04-50d4aa3f831b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:20.201248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fe983f98-b103-4bdb-9f04-50d4aa3f831b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:20.217261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe983f98-b103-4bdb-9f04-50d4aa3f831b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:20.217261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe983f98-b103-4bdb-9f04-50d4aa3f831b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:20.217261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe983f98-b103-4bdb-9f04-50d4aa3f831b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:20.217261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe983f98-b103-4bdb-9f04-50d4aa3f831b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:20.217956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe983f98-b103-4bdb-9f04-50d4aa3f831b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:20.218365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe983f98-b103-4bdb-9f04-50d4aa3f831b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:20.304606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6c169ffd-7ac6-4a2d-846f-762ee5278c67 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:20.355909 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6c169ffd-7ac6-4a2d-846f-762ee5278c67 tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1699 microversion: 2.1 time: 0.596991 Oct 18 13:22:20.359276 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 734/1503] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:19 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1699 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:20.364208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-70ba06b5-4246-436f-ae7f-bdb4c299723b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:20.374397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-70ba06b5-4246-436f-ae7f-bdb4c299723b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:20.385712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70ba06b5-4246-436f-ae7f-bdb4c299723b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:20.391020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70ba06b5-4246-436f-ae7f-bdb4c299723b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:20.409930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70ba06b5-4246-436f-ae7f-bdb4c299723b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:20.410806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70ba06b5-4246-436f-ae7f-bdb4c299723b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:20.413873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70ba06b5-4246-436f-ae7f-bdb4c299723b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:20.414327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70ba06b5-4246-436f-ae7f-bdb4c299723b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:20.479254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fe983f98-b103-4bdb-9f04-50d4aa3f831b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:20.489523 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fe983f98-b103-4bdb-9f04-50d4aa3f831b tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1521 microversion: 2.1 time: 0.301228 Oct 18 13:22:20.505487 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 770/1504] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:20 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:20.507011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb171c60-4a39-4be6-a799-56b92a20414f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:20.507668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eb171c60-4a39-4be6-a799-56b92a20414f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:20.515318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb171c60-4a39-4be6-a799-56b92a20414f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:20.515948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb171c60-4a39-4be6-a799-56b92a20414f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:20.516623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb171c60-4a39-4be6-a799-56b92a20414f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:20.517456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb171c60-4a39-4be6-a799-56b92a20414f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:20.518005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb171c60-4a39-4be6-a799-56b92a20414f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:20.518615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb171c60-4a39-4be6-a799-56b92a20414f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:20.706966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eb171c60-4a39-4be6-a799-56b92a20414f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:20.726967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eb171c60-4a39-4be6-a799-56b92a20414f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:20.738831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eb171c60-4a39-4be6-a799-56b92a20414f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:20.738831 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eb171c60-4a39-4be6-a799-56b92a20414f tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1803 microversion: 2.25 time: 0.236182 Oct 18 13:22:20.739809 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 771/1505] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:20 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1803 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:22:20.749029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e9bbdd6-921a-412f-a940-6802aee183af tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-445823812"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:20.756713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7e9bbdd6-921a-412f-a940-6802aee183af tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:20.779424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e9bbdd6-921a-412f-a940-6802aee183af tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:20.784513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e9bbdd6-921a-412f-a940-6802aee183af tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:20.785981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e9bbdd6-921a-412f-a940-6802aee183af tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:20.787095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e9bbdd6-921a-412f-a940-6802aee183af tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:20.787897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e9bbdd6-921a-412f-a940-6802aee183af tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:20.788632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e9bbdd6-921a-412f-a940-6802aee183af tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:20.976869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-70ba06b5-4246-436f-ae7f-bdb4c299723b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:20.991955 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-70ba06b5-4246-436f-ae7f-bdb4c299723b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 0.630365 Oct 18 13:22:20.994401 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 735/1506] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:20 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:21.014349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-321af143-4e5c-45e6-ac71-1753d8fd8f10 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '.version_select at 0x7ff60f693ee0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:21.027832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-321af143-4e5c-45e6-ac71-1753d8fd8f10 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:21.029778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-321af143-4e5c-45e6-ac71-1753d8fd8f10 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:21.030504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-321af143-4e5c-45e6-ac71-1753d8fd8f10 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:21.063223 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-321af143-4e5c-45e6-ac71-1753d8fd8f10 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 3237 microversion: 2.25 time: 0.064696 Oct 18 13:22:21.065915 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 736/1507] 10.222.0.40 () {60 vars in 1184 bytes} [Tue Oct 18 13:22:20 2022] GET /compute/v2.1/os-migrations => generated 3237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:22:21.099151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ff78fb98-548d-49df-8c3b-4739e521e103 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:21.099774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ff78fb98-548d-49df-8c3b-4739e521e103 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:21.123257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff78fb98-548d-49df-8c3b-4739e521e103 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:21.123896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff78fb98-548d-49df-8c3b-4739e521e103 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:21.126764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff78fb98-548d-49df-8c3b-4739e521e103 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:21.127557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff78fb98-548d-49df-8c3b-4739e521e103 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:21.130893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff78fb98-548d-49df-8c3b-4739e521e103 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:21.131324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff78fb98-548d-49df-8c3b-4739e521e103 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:21.173512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:21.195226 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7e9bbdd6-921a-412f-a940-6802aee183af tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "POST /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d/action" status: 202 len: 0 microversion: 2.1 time: 0.453801 Oct 18 13:22:21.199412 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 772/1508] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:22:20 2022] POST /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:22:21.217321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8cdaa6b9-b332-488c-a444-b2d421f9ede4 req-239f4c33-ad47-4edf-a549-5f4d8ecd708b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e81ebf6-fc21-4c54-b484-7235c8056f98", "name": "network-vif-deleted", "tag": "a9b38269-97be-4c12-a550-aeb900bacef2"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:21.250141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8cdaa6b9-b332-488c-a444-b2d421f9ede4 req-239f4c33-ad47-4edf-a549-5f4d8ecd708b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:21.250951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8cdaa6b9-b332-488c-a444-b2d421f9ede4 req-239f4c33-ad47-4edf-a549-5f4d8ecd708b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:21.251564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8cdaa6b9-b332-488c-a444-b2d421f9ede4 req-239f4c33-ad47-4edf-a549-5f4d8ecd708b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:21.284167 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8cdaa6b9-b332-488c-a444-b2d421f9ede4 req-239f4c33-ad47-4edf-a549-5f4d8ecd708b service nova] Creating event network-vif-deleted:a9b38269-97be-4c12-a550-aeb900bacef2 for instance 8e81ebf6-fc21-4c54-b484-7235c8056f98 on n-h2-858384-13 Oct 18 13:22:21.297937 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8cdaa6b9-b332-488c-a444-b2d421f9ede4 req-239f4c33-ad47-4edf-a549-5f4d8ecd708b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096358 Oct 18 13:22:21.299123 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 773/1509] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:21.312454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-831927b8-e1b8-4424-b3c6-431495bc9ef1 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:21.314722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-831927b8-e1b8-4424-b3c6-431495bc9ef1 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:21.331145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-831927b8-e1b8-4424-b3c6-431495bc9ef1 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:21.334441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-831927b8-e1b8-4424-b3c6-431495bc9ef1 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:21.335667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-831927b8-e1b8-4424-b3c6-431495bc9ef1 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:21.337492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-831927b8-e1b8-4424-b3c6-431495bc9ef1 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:21.341566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-831927b8-e1b8-4424-b3c6-431495bc9ef1 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:21.344562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-831927b8-e1b8-4424-b3c6-431495bc9ef1 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:21.453555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ff78fb98-548d-49df-8c3b-4739e521e103 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:21.469676 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ff78fb98-548d-49df-8c3b-4739e521e103 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1311 microversion: 2.1 time: 0.402691 Oct 18 13:22:21.470273 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 737/1510] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:21 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1311 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:21.501215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-65fb10bb-6b83-402e-99e8-d844f4d388a5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '.version_select at 0x7ff60f5db280>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:21.634943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-831927b8-e1b8-4424-b3c6-431495bc9ef1 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid 925c4106-eafb-486f-8846-ff04eea11eb3 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:22:21.664761 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-831927b8-e1b8-4424-b3c6-431495bc9ef1 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 2423 microversion: 2.25 time: 0.360997 Oct 18 13:22:21.666205 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 774/1511] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:21 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 2423 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:22:21.672453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6f8574cc-b200-49fd-b1cd-3c47e7ebc881 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:21.673493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6f8574cc-b200-49fd-b1cd-3c47e7ebc881 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:21.680180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f8574cc-b200-49fd-b1cd-3c47e7ebc881 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:21.681056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f8574cc-b200-49fd-b1cd-3c47e7ebc881 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:21.681753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f8574cc-b200-49fd-b1cd-3c47e7ebc881 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:21.682987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f8574cc-b200-49fd-b1cd-3c47e7ebc881 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:21.683729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f8574cc-b200-49fd-b1cd-3c47e7ebc881 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:21.684388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f8574cc-b200-49fd-b1cd-3c47e7ebc881 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:21.791016 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-65fb10bb-6b83-402e-99e8-d844f4d388a5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "DELETE /compute/v2.1/images/f2c90986-2d5d-493a-aaf9-cbc66c777099" status: 204 len: 0 microversion: 2.1 time: 0.309280 Oct 18 13:22:21.794412 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 738/1512] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:21 2022] DELETE /compute/v2.1/images/f2c90986-2d5d-493a-aaf9-cbc66c777099 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:22:21.801476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:21.802250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:21.826273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:21.826796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:21.827248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:21.833451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:21.834015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:21.837075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:21.921629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:21.922182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:21.922688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:21.923870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lazy-loading 'fault' on Instance uuid 8e81ebf6-fc21-4c54-b484-7235c8056f98 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:22:21.944090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6f8574cc-b200-49fd-b1cd-3c47e7ebc881 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:21.955889 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6f8574cc-b200-49fd-b1cd-3c47e7ebc881 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1496 microversion: 2.1 time: 0.287275 Oct 18 13:22:21.957266 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 775/1513] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:21 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1496 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:21.963214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bbaaa36a-efbf-4363-98ef-745ed6b3a627 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:21.965612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bbaaa36a-efbf-4363-98ef-745ed6b3a627 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:21.977554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbaaa36a-efbf-4363-98ef-745ed6b3a627 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:21.978452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbaaa36a-efbf-4363-98ef-745ed6b3a627 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:21.978988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbaaa36a-efbf-4363-98ef-745ed6b3a627 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:21.980459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbaaa36a-efbf-4363-98ef-745ed6b3a627 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:21.980609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbaaa36a-efbf-4363-98ef-745ed6b3a627 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:21.981207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbaaa36a-efbf-4363-98ef-745ed6b3a627 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:22.129858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacdec453dad4705a904f057930aa7af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76780439ae344b2998c1312a36ca9046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:22.139691 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-112e3d70-2544-411a-bd8a-7fac29929dcc tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 200 len: 1358 microversion: 2.1 time: 0.343709 Oct 18 13:22:22.140288 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 739/1514] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:21 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:22.155261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5bbe1dd7-5674-44fb-a851-82e3647cba2a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '.version_select at 0x7ff60f693940>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:22.217002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-bbaaa36a-efbf-4363-98ef-745ed6b3a627 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid 925c4106-eafb-486f-8846-ff04eea11eb3 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:22:22.223401 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-5bbe1dd7-5674-44fb-a851-82e3647cba2a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] HTTP exception thrown: Image not found. Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5bbe1dd7-5674-44fb-a851-82e3647cba2a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/images/f2c90986-2d5d-493a-aaf9-cbc66c777099 HTTP/1.1 Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:22:22.225665 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:22:22.227429 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:22:22.227429 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:22:22.227429 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:22:22.227429 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:22:22.227429 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:22:22.227429 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:22:22.227429 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:22:22.227429 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:22:22.227429 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:22:22.227429 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:22:22.227429 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:22:22.227429 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'f2c90986-2d5d-493a-aaf9-cbc66c777099'} Oct 18 13:22:22.227429 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:22:22.228464 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f2c90986-2d5d-493a-aaf9-cbc66c777099 Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:22:22.229740 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f2c90986-2d5d-493a-aaf9-cbc66c777099 could not be found. Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:22:22.230993 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:22:22.233255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5bbe1dd7-5674-44fb-a851-82e3647cba2a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:22:22.234566 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5bbe1dd7-5674-44fb-a851-82e3647cba2a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/images/f2c90986-2d5d-493a-aaf9-cbc66c777099" status: 404 len: 62 microversion: 2.1 time: 0.083297 Oct 18 13:22:22.234566 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 740/1515] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:22 2022] GET /compute/v2.1/images/f2c90986-2d5d-493a-aaf9-cbc66c777099 => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:22:22.236848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f8be6617-6c76-490d-aed8-58106a545be4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:22.242210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f8be6617-6c76-490d-aed8-58106a545be4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:22.244763 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bbaaa36a-efbf-4363-98ef-745ed6b3a627 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 2423 microversion: 2.25 time: 0.285269 Oct 18 13:22:22.258934 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 776/1516] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:22:21 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 2423 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:22:22.269156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8be6617-6c76-490d-aed8-58106a545be4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:22.272670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8be6617-6c76-490d-aed8-58106a545be4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:22.279256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8be6617-6c76-490d-aed8-58106a545be4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:22.281787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5b7f55a4-4910-489d-9365-1a33abc65513 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:22.282624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8be6617-6c76-490d-aed8-58106a545be4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:22.282946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8be6617-6c76-490d-aed8-58106a545be4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:22.284137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8be6617-6c76-490d-aed8-58106a545be4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:22.284760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5b7f55a4-4910-489d-9365-1a33abc65513 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:22.304635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b7f55a4-4910-489d-9365-1a33abc65513 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:22.305783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b7f55a4-4910-489d-9365-1a33abc65513 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:22.307871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b7f55a4-4910-489d-9365-1a33abc65513 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:22.312467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b7f55a4-4910-489d-9365-1a33abc65513 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:22.315245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b7f55a4-4910-489d-9365-1a33abc65513 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:22.316422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b7f55a4-4910-489d-9365-1a33abc65513 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:22.584427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5b7f55a4-4910-489d-9365-1a33abc65513 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:22.599663 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5b7f55a4-4910-489d-9365-1a33abc65513 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1533 microversion: 2.1 time: 0.338919 Oct 18 13:22:22.613021 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 777/1517] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:22 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1533 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:22.618839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8eb5914-48a1-47ed-b880-76860afb095d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:22.619277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8eb5914-48a1-47ed-b880-76860afb095d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:22.627126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8eb5914-48a1-47ed-b880-76860afb095d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:22.627614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8eb5914-48a1-47ed-b880-76860afb095d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:22.628100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8eb5914-48a1-47ed-b880-76860afb095d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:22.628806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8eb5914-48a1-47ed-b880-76860afb095d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:22.629279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8eb5914-48a1-47ed-b880-76860afb095d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:22.629785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8eb5914-48a1-47ed-b880-76860afb095d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:22.646573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f8be6617-6c76-490d-aed8-58106a545be4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:22.662724 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f8be6617-6c76-490d-aed8-58106a545be4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 0.426635 Oct 18 13:22:22.677214 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 741/1518] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:22 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:22.677214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-934ed4b9-f92d-466c-8ef7-f4ac771c8521 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:22.677214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-934ed4b9-f92d-466c-8ef7-f4ac771c8521 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:22.680949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-934ed4b9-f92d-466c-8ef7-f4ac771c8521 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:22.681508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-934ed4b9-f92d-466c-8ef7-f4ac771c8521 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:22.681942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-934ed4b9-f92d-466c-8ef7-f4ac771c8521 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:22.682672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-934ed4b9-f92d-466c-8ef7-f4ac771c8521 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:22.683122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-934ed4b9-f92d-466c-8ef7-f4ac771c8521 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:22.683543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-934ed4b9-f92d-466c-8ef7-f4ac771c8521 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:22.832930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-b8eb5914-48a1-47ed-b880-76860afb095d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lazy-loading 'services' on Instance uuid 925c4106-eafb-486f-8846-ff04eea11eb3 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:22:22.956817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-934ed4b9-f92d-466c-8ef7-f4ac771c8521 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:22.965234 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-934ed4b9-f92d-466c-8ef7-f4ac771c8521 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1311 microversion: 2.1 time: 0.300397 Oct 18 13:22:22.968890 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 742/1519] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:22 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1311 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:22.980357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ccc250bc-1109-4986-afc7-1c8a79335c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:22.986434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ccc250bc-1109-4986-afc7-1c8a79335c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:23.000926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ccc250bc-1109-4986-afc7-1c8a79335c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:23.001454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ccc250bc-1109-4986-afc7-1c8a79335c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:23.002103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ccc250bc-1109-4986-afc7-1c8a79335c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:23.002808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ccc250bc-1109-4986-afc7-1c8a79335c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:23.003262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ccc250bc-1109-4986-afc7-1c8a79335c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:23.003683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ccc250bc-1109-4986-afc7-1c8a79335c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:23.007433 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8eb5914-48a1-47ed-b880-76860afb095d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "DELETE /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments/9cd00d5b-96e3-4bc0-a425-e92cd20c499b" status: 202 len: 0 microversion: 2.25 time: 0.392571 Oct 18 13:22:23.017600 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 778/1520] 10.222.0.40 () {60 vars in 1457 bytes} [Tue Oct 18 13:22:22 2022] DELETE /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments/9cd00d5b-96e3-4bc0-a425-e92cd20c499b => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:22:23.039262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8d28d17e-6b16-4a5a-bf54-861ec1e7dc8d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:23.047677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8d28d17e-6b16-4a5a-bf54-861ec1e7dc8d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:23.059581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d28d17e-6b16-4a5a-bf54-861ec1e7dc8d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:23.060098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d28d17e-6b16-4a5a-bf54-861ec1e7dc8d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:23.060542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d28d17e-6b16-4a5a-bf54-861ec1e7dc8d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:23.061284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d28d17e-6b16-4a5a-bf54-861ec1e7dc8d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:23.061744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d28d17e-6b16-4a5a-bf54-861ec1e7dc8d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:23.062176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d28d17e-6b16-4a5a-bf54-861ec1e7dc8d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:23.137619 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8d28d17e-6b16-4a5a-bf54-861ec1e7dc8d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118385 Oct 18 13:22:23.145044 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 779/1521] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:22:23 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:22:23.164566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b094ee83-4b75-434e-b12d-a3278ddd0c8b tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:23.165207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b094ee83-4b75-434e-b12d-a3278ddd0c8b tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] [instance: 8e81ebf6-fc21-4c54-b484-7235c8056f98] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:23.175154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b094ee83-4b75-434e-b12d-a3278ddd0c8b tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:23.175639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b094ee83-4b75-434e-b12d-a3278ddd0c8b tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:23.175963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b094ee83-4b75-434e-b12d-a3278ddd0c8b tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:23.176666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b094ee83-4b75-434e-b12d-a3278ddd0c8b tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:23.177110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b094ee83-4b75-434e-b12d-a3278ddd0c8b tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:23.177697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b094ee83-4b75-434e-b12d-a3278ddd0c8b tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:23.196676 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-b094ee83-4b75-434e-b12d-a3278ddd0c8b tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] HTTP exception thrown: Instance 8e81ebf6-fc21-4c54-b484-7235c8056f98 could not be found. Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b094ee83-4b75-434e-b12d-a3278ddd0c8b tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Request method failure captured: Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 HTTP/1.1 Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqg1fa5EgUMj-XEG9Dms7QfgnQXIGvV30xbknIxgyowOmTW5lGSQYmWYFp-eXTcox_e2TItBnCFtXb5JmL0-mlvRp1vFAFHaVv0s7JSS6SssjNGJt4z5w8LZUNSdUD6HPwDuO1kbS4AZgC5UZyoO7XvJ7Towd5NokxE1STGs13_ZrAs Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 76780439ae344b2998c1312a36ca9046 Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersTestJSON-61216061 Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:22:23.197850 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:22:23.199998 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76780439ae344b2998c1312a36ca9046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/76780439ae344b2998c1312a36ca9046"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76780439ae344b2998c1312a36ca9046"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_76780439ae344b2998c1312a36ca9046"}]}] Oct 18 13:22:23.199998 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersTestJSON-61216061 Oct 18 13:22:23.199998 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 76780439ae344b2998c1312a36ca9046 Oct 18 13:22:23.199998 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersTestJSON-61216061 Oct 18 13:22:23.199998 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersTestJSON-61216061-project Oct 18 13:22:23.199998 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:22:23.199998 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:22:23.199998 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: cacdec453dad4705a904f057930aa7af Oct 18 13:22:23.199998 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersTestJSON-61216061-project Oct 18 13:22:23.199998 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:22:23.199998 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 8e81ebf6-fc21-4c54-b484-7235c8056f98 could not be found. Oct 18 13:22:23.199998 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '8e81ebf6-fc21-4c54-b484-7235c8056f98'} Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e81ebf6-fc21-4c54-b484-7235c8056f98 could not be found. Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:22:23.201594 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e81ebf6-fc21-4c54-b484-7235c8056f98 could not be found. Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e81ebf6-fc21-4c54-b484-7235c8056f98 could not be found. Oct 18 13:22:23.203902 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:22:23.206172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b094ee83-4b75-434e-b12d-a3278ddd0c8b tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Returning 404 to user: Instance 8e81ebf6-fc21-4c54-b484-7235c8056f98 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:22:23.206172 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b094ee83-4b75-434e-b12d-a3278ddd0c8b tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98" status: 404 len: 111 microversion: 2.1 time: 0.039975 Oct 18 13:22:23.206172 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 780/1522] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:23 2022] GET /compute/v2.1/servers/8e81ebf6-fc21-4c54-b484-7235c8056f98 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:22:23.210484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6118b5a5-91c2-4ad0-ac14-b1bf3b1c847d tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] Calling method '.version_select at 0x7ff60fc34310>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:23.218081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:23.221969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ccc250bc-1109-4986-afc7-1c8a79335c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:23.239271 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ccc250bc-1109-4986-afc7-1c8a79335c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 200 len: 1473 microversion: 2.1 time: 0.263346 Oct 18 13:22:23.240247 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 743/1523] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:22 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 1473 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:23.240365 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6118b5a5-91c2-4ad0-ac14-b1bf3b1c847d tempest-ServersTestJSON-61216061 tempest-ServersTestJSON-61216061-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-872407589" status: 202 len: 0 microversion: 2.1 time: 0.034776 Oct 18 13:22:23.244058 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 781/1524] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 18 13:22:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-872407589 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:22:23.265140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-50fe5dd2-3295-4811-8e79-61313efcb36b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-543628594"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:23.268361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-50fe5dd2-3295-4811-8e79-61313efcb36b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:23.284601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50fe5dd2-3295-4811-8e79-61313efcb36b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:23.285425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50fe5dd2-3295-4811-8e79-61313efcb36b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:23.285992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50fe5dd2-3295-4811-8e79-61313efcb36b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:23.286631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50fe5dd2-3295-4811-8e79-61313efcb36b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:23.287289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50fe5dd2-3295-4811-8e79-61313efcb36b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:23.287737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50fe5dd2-3295-4811-8e79-61313efcb36b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:23.327289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-5a38e1ed-f255-4b07-a179-a092e2b640e0 req-ee33e856-2502-4156-a192-b0f76e2e15af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f29db8-d1db-4c86-b2a2-aa699fa80532", "tag": "a6e78562-1d84-4cfc-b01a-bfe734a39542"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:23.338905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5a38e1ed-f255-4b07-a179-a092e2b640e0 req-ee33e856-2502-4156-a192-b0f76e2e15af service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:23.339632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5a38e1ed-f255-4b07-a179-a092e2b640e0 req-ee33e856-2502-4156-a192-b0f76e2e15af service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:23.340714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5a38e1ed-f255-4b07-a179-a092e2b640e0 req-ee33e856-2502-4156-a192-b0f76e2e15af service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:23.360195 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-5a38e1ed-f255-4b07-a179-a092e2b640e0 req-ee33e856-2502-4156-a192-b0f76e2e15af service nova] Creating event network-changed:a6e78562-1d84-4cfc-b01a-bfe734a39542 for instance 80f29db8-d1db-4c86-b2a2-aa699fa80532 on n-h1-858384-13 Oct 18 13:22:23.365940 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-5a38e1ed-f255-4b07-a179-a092e2b640e0 req-ee33e856-2502-4156-a192-b0f76e2e15af service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042951 Oct 18 13:22:23.367164 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 782/1525] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:22:23.625477 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-50fe5dd2-3295-4811-8e79-61313efcb36b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c/action" status: 202 len: 0 microversion: 2.1 time: 0.362644 Oct 18 13:22:23.626833 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 744/1526] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:22:23 2022] POST /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:22:23.638419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-189fc431-4227-4ce1-9ab9-6790e0039de1 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:23.639460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-189fc431-4227-4ce1-9ab9-6790e0039de1 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:23.642127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6354518e-c563-4603-8710-9ef3ce124da8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f770b80>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:23.647478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-189fc431-4227-4ce1-9ab9-6790e0039de1 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:23.648217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-189fc431-4227-4ce1-9ab9-6790e0039de1 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:23.648831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-189fc431-4227-4ce1-9ab9-6790e0039de1 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:23.649742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-189fc431-4227-4ce1-9ab9-6790e0039de1 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:23.650347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-189fc431-4227-4ce1-9ab9-6790e0039de1 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:23.650929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-189fc431-4227-4ce1-9ab9-6790e0039de1 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:23.719062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:23.743140 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6354518e-c563-4603-8710-9ef3ce124da8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 200 len: 1409 microversion: 2.1 time: 0.108397 Oct 18 13:22:23.744308 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 745/1527] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:23 2022] GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 1409 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:23.750953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-34e3916f-0a94-4961-ba56-48a8a7add0e2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:23.751981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-34e3916f-0a94-4961-ba56-48a8a7add0e2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:23.762474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34e3916f-0a94-4961-ba56-48a8a7add0e2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:23.763702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34e3916f-0a94-4961-ba56-48a8a7add0e2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:23.764416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34e3916f-0a94-4961-ba56-48a8a7add0e2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:23.765423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34e3916f-0a94-4961-ba56-48a8a7add0e2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:23.766125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34e3916f-0a94-4961-ba56-48a8a7add0e2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:23.767103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34e3916f-0a94-4961-ba56-48a8a7add0e2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:23.915134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-189fc431-4227-4ce1-9ab9-6790e0039de1 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:23.925967 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-189fc431-4227-4ce1-9ab9-6790e0039de1 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1539 microversion: 2.1 time: 0.303930 Oct 18 13:22:23.926926 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 783/1528] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:23 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1539 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:23.997518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-065b31b3-1140-4738-8a8f-1358c8308c96 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:23.998092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-065b31b3-1140-4738-8a8f-1358c8308c96 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:24.007910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-065b31b3-1140-4738-8a8f-1358c8308c96 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:24.008397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-065b31b3-1140-4738-8a8f-1358c8308c96 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:24.008841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-065b31b3-1140-4738-8a8f-1358c8308c96 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:24.009559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-065b31b3-1140-4738-8a8f-1358c8308c96 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:24.010015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-065b31b3-1140-4738-8a8f-1358c8308c96 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:24.010470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-065b31b3-1140-4738-8a8f-1358c8308c96 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:24.171521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-34e3916f-0a94-4961-ba56-48a8a7add0e2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:24.188265 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-34e3916f-0a94-4961-ba56-48a8a7add0e2 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 0.442011 Oct 18 13:22:24.192068 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 746/1529] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:23 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:24.203388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-456fdce9-3494-43eb-9e19-d9687973f57c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:24.207133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-065b31b3-1140-4738-8a8f-1358c8308c96 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:24.210069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-456fdce9-3494-43eb-9e19-d9687973f57c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:24.217668 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-065b31b3-1140-4738-8a8f-1358c8308c96 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1311 microversion: 2.1 time: 0.225785 Oct 18 13:22:24.223148 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 784/1530] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:23 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1311 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:24.225824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-456fdce9-3494-43eb-9e19-d9687973f57c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:24.227835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-456fdce9-3494-43eb-9e19-d9687973f57c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:24.228606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-456fdce9-3494-43eb-9e19-d9687973f57c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:24.230319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-456fdce9-3494-43eb-9e19-d9687973f57c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:24.231313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-456fdce9-3494-43eb-9e19-d9687973f57c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:24.232059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-456fdce9-3494-43eb-9e19-d9687973f57c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:24.290606 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-456fdce9-3494-43eb-9e19-d9687973f57c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.095970 Oct 18 13:22:24.296923 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 747/1531] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:22:24 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:22:24.759853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f97482ba-b810-4a1b-a50a-9ad8d5f815fd tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60fdb25e0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:24.775070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:24.873850 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f97482ba-b810-4a1b-a50a-9ad8d5f815fd tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 200 len: 1409 microversion: 2.1 time: 0.116318 Oct 18 13:22:24.875105 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 785/1532] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:24 2022] GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 1409 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:24.953739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d3732893-0fe2-4009-ad99-81aeb3b6782d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:24.954279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d3732893-0fe2-4009-ad99-81aeb3b6782d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:24.968038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3732893-0fe2-4009-ad99-81aeb3b6782d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:24.968741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3732893-0fe2-4009-ad99-81aeb3b6782d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:24.968943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3732893-0fe2-4009-ad99-81aeb3b6782d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:24.969665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3732893-0fe2-4009-ad99-81aeb3b6782d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:24.970110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3732893-0fe2-4009-ad99-81aeb3b6782d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:24.973605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3732893-0fe2-4009-ad99-81aeb3b6782d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:25.212561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=10 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:25.219009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-141c916b-07ce-4d69-aa6b-dc2ba364ef7a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:25.219863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-141c916b-07ce-4d69-aa6b-dc2ba364ef7a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:25.237831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-141c916b-07ce-4d69-aa6b-dc2ba364ef7a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:25.238711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-141c916b-07ce-4d69-aa6b-dc2ba364ef7a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:25.239639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-141c916b-07ce-4d69-aa6b-dc2ba364ef7a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:25.243067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-141c916b-07ce-4d69-aa6b-dc2ba364ef7a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:25.244946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-141c916b-07ce-4d69-aa6b-dc2ba364ef7a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:25.245672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-141c916b-07ce-4d69-aa6b-dc2ba364ef7a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:25.576047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-141c916b-07ce-4d69-aa6b-dc2ba364ef7a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:25.586109 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-141c916b-07ce-4d69-aa6b-dc2ba364ef7a tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 0.373718 Oct 18 13:22:25.601050 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 786/1533] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:25 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:25.601050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-211500ef-ff02-4fc1-9d33-0e662dcc651d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:25.601050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-211500ef-ff02-4fc1-9d33-0e662dcc651d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:25.604232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-211500ef-ff02-4fc1-9d33-0e662dcc651d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:25.605135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-211500ef-ff02-4fc1-9d33-0e662dcc651d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:25.607663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-211500ef-ff02-4fc1-9d33-0e662dcc651d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:25.608884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-211500ef-ff02-4fc1-9d33-0e662dcc651d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:25.610926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-211500ef-ff02-4fc1-9d33-0e662dcc651d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:25.611677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-211500ef-ff02-4fc1-9d33-0e662dcc651d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:25.744544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d3732893-0fe2-4009-ad99-81aeb3b6782d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:25.754468 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d3732893-0fe2-4009-ad99-81aeb3b6782d tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1521 microversion: 2.1 time: 0.804844 Oct 18 13:22:25.755754 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 748/1534] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:24 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1521 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:25.764640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5d59f9a5-0534-4e40-9259-a813437ed747 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:25.768402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5d59f9a5-0534-4e40-9259-a813437ed747 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:25.776827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d59f9a5-0534-4e40-9259-a813437ed747 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:25.777681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d59f9a5-0534-4e40-9259-a813437ed747 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:25.778548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d59f9a5-0534-4e40-9259-a813437ed747 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:25.780480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d59f9a5-0534-4e40-9259-a813437ed747 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:25.781729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d59f9a5-0534-4e40-9259-a813437ed747 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:25.783156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d59f9a5-0534-4e40-9259-a813437ed747 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:25.828400 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5d59f9a5-0534-4e40-9259-a813437ed747 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071266 Oct 18 13:22:25.829491 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 749/1535] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:22:25 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:22:25.835420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-76a005ce-2f8a-46e7-8e18-e881dcafc114 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:25.836492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-76a005ce-2f8a-46e7-8e18-e881dcafc114 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:25.846790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76a005ce-2f8a-46e7-8e18-e881dcafc114 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:25.847847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76a005ce-2f8a-46e7-8e18-e881dcafc114 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:25.848535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76a005ce-2f8a-46e7-8e18-e881dcafc114 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:25.849873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76a005ce-2f8a-46e7-8e18-e881dcafc114 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:25.850624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76a005ce-2f8a-46e7-8e18-e881dcafc114 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:25.851515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76a005ce-2f8a-46e7-8e18-e881dcafc114 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:25.891518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-76a005ce-2f8a-46e7-8e18-e881dcafc114 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:22:25.914475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-211500ef-ff02-4fc1-9d33-0e662dcc651d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:25.918574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:25.929128 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-211500ef-ff02-4fc1-9d33-0e662dcc651d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1311 microversion: 2.1 time: 0.340827 Oct 18 13:22:25.934329 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 787/1536] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:25 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1311 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:25.951083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-81149c75-fda5-4616-9e7e-e5e55afed4f9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f8291f0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:26.023573 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-81149c75-fda5-4616-9e7e-e5e55afed4f9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 200 len: 1409 microversion: 2.1 time: 0.087700 Oct 18 13:22:26.025715 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 788/1537] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:25 2022] GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 1409 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:26.054787 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-76a005ce-2f8a-46e7-8e18-e881dcafc114 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 204 len: 0 microversion: 2.1 time: 0.223610 Oct 18 13:22:26.056156 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 750/1538] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:22:25 2022] DELETE /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:22:26.065839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed38d84f-9361-450c-93d7-c75ea79a4ae5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:26.066882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ed38d84f-9361-450c-93d7-c75ea79a4ae5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:26.074264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed38d84f-9361-450c-93d7-c75ea79a4ae5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:26.075141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed38d84f-9361-450c-93d7-c75ea79a4ae5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:26.075968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed38d84f-9361-450c-93d7-c75ea79a4ae5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:26.076934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed38d84f-9361-450c-93d7-c75ea79a4ae5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:26.077646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed38d84f-9361-450c-93d7-c75ea79a4ae5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:26.078297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed38d84f-9361-450c-93d7-c75ea79a4ae5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:26.283901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ed38d84f-9361-450c-93d7-c75ea79a4ae5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:26.295243 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ed38d84f-9361-450c-93d7-c75ea79a4ae5 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1527 microversion: 2.1 time: 0.233400 Oct 18 13:22:26.296958 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 789/1539] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:26 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1527 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:26.620296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6c2252bd-d4e8-4a8c-9bc0-ad247bcc18ef tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:26.621427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6c2252bd-d4e8-4a8c-9bc0-ad247bcc18ef tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:26.632915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c2252bd-d4e8-4a8c-9bc0-ad247bcc18ef tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:26.633451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c2252bd-d4e8-4a8c-9bc0-ad247bcc18ef tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:26.634115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c2252bd-d4e8-4a8c-9bc0-ad247bcc18ef tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:26.634588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c2252bd-d4e8-4a8c-9bc0-ad247bcc18ef tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:26.635048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c2252bd-d4e8-4a8c-9bc0-ad247bcc18ef tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:26.636052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c2252bd-d4e8-4a8c-9bc0-ad247bcc18ef tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:26.842089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0014d989-0345-45a5-a2b9-4706442b164e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:26.844526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0014d989-0345-45a5-a2b9-4706442b164e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:26.856883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0014d989-0345-45a5-a2b9-4706442b164e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:26.860680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0014d989-0345-45a5-a2b9-4706442b164e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:26.861375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0014d989-0345-45a5-a2b9-4706442b164e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:26.863428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0014d989-0345-45a5-a2b9-4706442b164e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:26.865424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0014d989-0345-45a5-a2b9-4706442b164e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:26.866766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0014d989-0345-45a5-a2b9-4706442b164e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:26.965512 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0014d989-0345-45a5-a2b9-4706442b164e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.126284 Oct 18 13:22:26.968114 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 790/1540] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:22:26 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:22:26.985576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-0ba06222-ac79-48b4-a58f-13e5fd0b89ea req-5feb7a4d-4499-46f1-ad8b-30942e437d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a0d527-5f2f-4c84-a99f-d22d143edb5d", "name": "network-vif-plugged", "status": "completed", "tag": "b3e787be-e21b-45a4-8719-31555d6cc6ad"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:27.016709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0ba06222-ac79-48b4-a58f-13e5fd0b89ea req-5feb7a4d-4499-46f1-ad8b-30942e437d9c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:27.018128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0ba06222-ac79-48b4-a58f-13e5fd0b89ea req-5feb7a4d-4499-46f1-ad8b-30942e437d9c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:27.018727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0ba06222-ac79-48b4-a58f-13e5fd0b89ea req-5feb7a4d-4499-46f1-ad8b-30942e437d9c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:27.033125 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-0ba06222-ac79-48b4-a58f-13e5fd0b89ea req-5feb7a4d-4499-46f1-ad8b-30942e437d9c service nova] Creating event network-vif-plugged:b3e787be-e21b-45a4-8719-31555d6cc6ad for instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d on n-h2-858384-13 Oct 18 13:22:27.041340 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-0ba06222-ac79-48b4-a58f-13e5fd0b89ea req-5feb7a4d-4499-46f1-ad8b-30942e437d9c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069853 Oct 18 13:22:27.045794 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 791/1541] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:27.063001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-108af096-0ec9-4714-b616-f9016758c315 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:27.068366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-108af096-0ec9-4714-b616-f9016758c315 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:27.108403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-108af096-0ec9-4714-b616-f9016758c315 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:27.109512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-108af096-0ec9-4714-b616-f9016758c315 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:27.111122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-108af096-0ec9-4714-b616-f9016758c315 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:27.114728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-108af096-0ec9-4714-b616-f9016758c315 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:27.117463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-108af096-0ec9-4714-b616-f9016758c315 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:27.121204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-108af096-0ec9-4714-b616-f9016758c315 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:27.419733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-108af096-0ec9-4714-b616-f9016758c315 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:27.432804 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-108af096-0ec9-4714-b616-f9016758c315 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1311 microversion: 2.1 time: 0.385281 Oct 18 13:22:27.436070 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 792/1542] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:27 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1311 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:27.452443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aa14792a-d13d-4dcd-9851-0ffedb712d8b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff6140feaf0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:27.470192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6c2252bd-d4e8-4a8c-9bc0-ad247bcc18ef tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:27.480403 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6c2252bd-d4e8-4a8c-9bc0-ad247bcc18ef tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1475 microversion: 2.1 time: 0.864750 Oct 18 13:22:27.481007 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 751/1543] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:26 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1475 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:27.494701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd187df1-7ab2-439b-a3a3-229ccc3d3575 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:27.495395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fd187df1-7ab2-439b-a3a3-229ccc3d3575 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:27.506707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd187df1-7ab2-439b-a3a3-229ccc3d3575 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:27.507822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd187df1-7ab2-439b-a3a3-229ccc3d3575 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:27.508432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd187df1-7ab2-439b-a3a3-229ccc3d3575 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:27.509402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd187df1-7ab2-439b-a3a3-229ccc3d3575 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:27.510017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd187df1-7ab2-439b-a3a3-229ccc3d3575 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:27.510879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd187df1-7ab2-439b-a3a3-229ccc3d3575 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:27.521908 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aa14792a-d13d-4dcd-9851-0ffedb712d8b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 200 len: 1409 microversion: 2.1 time: 0.084437 Oct 18 13:22:27.522495 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 793/1544] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:27 2022] GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 1409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:27.983238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-10e7cd48-127a-44c3-aed6-f12ebf67ea95 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:27.985831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-10e7cd48-127a-44c3-aed6-f12ebf67ea95 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:28.002158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fd187df1-7ab2-439b-a3a3-229ccc3d3575 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:28.004782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10e7cd48-127a-44c3-aed6-f12ebf67ea95 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:28.005314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10e7cd48-127a-44c3-aed6-f12ebf67ea95 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:28.005766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10e7cd48-127a-44c3-aed6-f12ebf67ea95 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:28.006461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10e7cd48-127a-44c3-aed6-f12ebf67ea95 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:28.006913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10e7cd48-127a-44c3-aed6-f12ebf67ea95 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:28.017062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10e7cd48-127a-44c3-aed6-f12ebf67ea95 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:28.026399 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fd187df1-7ab2-439b-a3a3-229ccc3d3575 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1527 microversion: 2.1 time: 0.543867 Oct 18 13:22:28.038392 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 752/1545] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:27 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1527 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:28.127984 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-10e7cd48-127a-44c3-aed6-f12ebf67ea95 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.149998 Oct 18 13:22:28.129250 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 794/1546] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:22:27 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:22:28.459848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-93adcd04-e4df-46ef-97f8-3cbe245aff5b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:28.460469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-93adcd04-e4df-46ef-97f8-3cbe245aff5b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:28.472997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93adcd04-e4df-46ef-97f8-3cbe245aff5b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:28.474073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93adcd04-e4df-46ef-97f8-3cbe245aff5b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:28.478602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93adcd04-e4df-46ef-97f8-3cbe245aff5b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:28.480053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93adcd04-e4df-46ef-97f8-3cbe245aff5b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:28.480745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93adcd04-e4df-46ef-97f8-3cbe245aff5b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:28.481212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93adcd04-e4df-46ef-97f8-3cbe245aff5b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:28.504778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba3abade-64ae-460f-9d04-d0992321325f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:28.505683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ba3abade-64ae-460f-9d04-d0992321325f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:28.529665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba3abade-64ae-460f-9d04-d0992321325f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:28.530542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba3abade-64ae-460f-9d04-d0992321325f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:28.531234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba3abade-64ae-460f-9d04-d0992321325f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:28.532505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba3abade-64ae-460f-9d04-d0992321325f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:28.559470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba3abade-64ae-460f-9d04-d0992321325f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:28.560430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba3abade-64ae-460f-9d04-d0992321325f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:28.578973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:29.752975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba3abade-64ae-460f-9d04-d0992321325f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:29.761703 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ba3abade-64ae-460f-9d04-d0992321325f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1474 microversion: 2.1 time: 1.260700 Oct 18 13:22:29.764966 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 795/1547] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:28 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1474 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:29.769709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e131d47-02bf-4d56-9bb3-ec2fc7c2cc08 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff6145b8040>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:29.858928 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4e131d47-02bf-4d56-9bb3-ec2fc7c2cc08 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 200 len: 1409 microversion: 2.1 time: 0.092796 Oct 18 13:22:29.866652 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 796/1548] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:29 2022] GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 1409 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:29.883457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa02bfb4-353c-4c3b-a557-719418391865 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:29.886783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fa02bfb4-353c-4c3b-a557-719418391865 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:29.903208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa02bfb4-353c-4c3b-a557-719418391865 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:29.909321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa02bfb4-353c-4c3b-a557-719418391865 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:29.910445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa02bfb4-353c-4c3b-a557-719418391865 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:29.911455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa02bfb4-353c-4c3b-a557-719418391865 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:29.913878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa02bfb4-353c-4c3b-a557-719418391865 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:29.914580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa02bfb4-353c-4c3b-a557-719418391865 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:30.367974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-93adcd04-e4df-46ef-97f8-3cbe245aff5b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:30.376761 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-93adcd04-e4df-46ef-97f8-3cbe245aff5b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1311 microversion: 2.1 time: 1.920657 Oct 18 13:22:30.388910 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 753/1549] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:28 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1311 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:30.660484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-67aebf15-2660-40f9-b975-2cff7d247cb8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:30.663250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-67aebf15-2660-40f9-b975-2cff7d247cb8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:30.688150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67aebf15-2660-40f9-b975-2cff7d247cb8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:30.689092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67aebf15-2660-40f9-b975-2cff7d247cb8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:30.690868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67aebf15-2660-40f9-b975-2cff7d247cb8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:30.694346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67aebf15-2660-40f9-b975-2cff7d247cb8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:30.696751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67aebf15-2660-40f9-b975-2cff7d247cb8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:30.697414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67aebf15-2660-40f9-b975-2cff7d247cb8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:30.744373 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-67aebf15-2660-40f9-b975-2cff7d247cb8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.352696 Oct 18 13:22:30.752808 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 754/1550] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:22:30 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3/os-volume_attachments => generated 25 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:30.760940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b9c72cf5-e381-4bef-9ae4-3e9bd2bc0c62 req-e316e1bb-7b2b-454b-adfa-a76f7602f204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d3172e-d216-47ef-a447-ef91d43bba4f", "name": "network-vif-unplugged", "status": "completed", "tag": "6d3bfbc9-e165-4403-af03-a04bc52c63e5"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:30.782102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b9c72cf5-e381-4bef-9ae4-3e9bd2bc0c62 req-e316e1bb-7b2b-454b-adfa-a76f7602f204 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:30.782785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b9c72cf5-e381-4bef-9ae4-3e9bd2bc0c62 req-e316e1bb-7b2b-454b-adfa-a76f7602f204 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:30.783454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b9c72cf5-e381-4bef-9ae4-3e9bd2bc0c62 req-e316e1bb-7b2b-454b-adfa-a76f7602f204 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:30.802728 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b9c72cf5-e381-4bef-9ae4-3e9bd2bc0c62 req-e316e1bb-7b2b-454b-adfa-a76f7602f204 service nova] Creating event network-vif-unplugged:6d3bfbc9-e165-4403-af03-a04bc52c63e5 for instance 96d3172e-d216-47ef-a447-ef91d43bba4f on n-h2-858384-13 Oct 18 13:22:30.811258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-b9c72cf5-e381-4bef-9ae4-3e9bd2bc0c62 req-e316e1bb-7b2b-454b-adfa-a76f7602f204 service nova] Instance 96d3172e-d216-47ef-a447-ef91d43bba4f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:22:30.821847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fa02bfb4-353c-4c3b-a557-719418391865 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:30.828703 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b9c72cf5-e381-4bef-9ae4-3e9bd2bc0c62 req-e316e1bb-7b2b-454b-adfa-a76f7602f204 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073165 Oct 18 13:22:30.831605 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fa02bfb4-353c-4c3b-a557-719418391865 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1527 microversion: 2.1 time: 0.962653 Oct 18 13:22:30.831819 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 755/1551] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:30.841243 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 797/1552] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:29 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1527 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:30.846146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eebf3d01-b405-4ad7-836e-b17b2e9f3e49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:30.846751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eebf3d01-b405-4ad7-836e-b17b2e9f3e49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:30.848406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-8666d74e-f00a-4ca1-94e1-5dc019aa0a31 req-d4748adf-e321-46b0-87a7-56491c1c8de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a0d527-5f2f-4c84-a99f-d22d143edb5d", "name": "network-vif-unplugged", "status": "completed", "tag": "b3e787be-e21b-45a4-8719-31555d6cc6ad"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:30.874198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eebf3d01-b405-4ad7-836e-b17b2e9f3e49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:30.874688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eebf3d01-b405-4ad7-836e-b17b2e9f3e49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:30.875118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eebf3d01-b405-4ad7-836e-b17b2e9f3e49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:30.875817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eebf3d01-b405-4ad7-836e-b17b2e9f3e49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:30.880272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eebf3d01-b405-4ad7-836e-b17b2e9f3e49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:30.883039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eebf3d01-b405-4ad7-836e-b17b2e9f3e49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:30.887721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8666d74e-f00a-4ca1-94e1-5dc019aa0a31 req-d4748adf-e321-46b0-87a7-56491c1c8de1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:30.888268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8666d74e-f00a-4ca1-94e1-5dc019aa0a31 req-d4748adf-e321-46b0-87a7-56491c1c8de1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:30.888939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8666d74e-f00a-4ca1-94e1-5dc019aa0a31 req-d4748adf-e321-46b0-87a7-56491c1c8de1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:30.935646 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-8666d74e-f00a-4ca1-94e1-5dc019aa0a31 req-d4748adf-e321-46b0-87a7-56491c1c8de1 service nova] Creating event network-vif-unplugged:b3e787be-e21b-45a4-8719-31555d6cc6ad for instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d on n-h2-858384-13 Oct 18 13:22:30.962648 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-8666d74e-f00a-4ca1-94e1-5dc019aa0a31 req-d4748adf-e321-46b0-87a7-56491c1c8de1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128774 Oct 18 13:22:30.965590 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 756/1553] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:30.984185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1390b530-e97d-414b-8d94-42d2577075e6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7d0c10>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:31.090604 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1390b530-e97d-414b-8d94-42d2577075e6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 200 len: 1409 microversion: 2.1 time: 0.122724 Oct 18 13:22:31.093643 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 757/1554] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:30 2022] GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 1409 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:31.414670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0c25e43a-2ca9-4609-8f08-1ca0a3ee42b0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:31.415556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0c25e43a-2ca9-4609-8f08-1ca0a3ee42b0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:31.435018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c25e43a-2ca9-4609-8f08-1ca0a3ee42b0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:31.437461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c25e43a-2ca9-4609-8f08-1ca0a3ee42b0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:31.440985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c25e43a-2ca9-4609-8f08-1ca0a3ee42b0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:31.443075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c25e43a-2ca9-4609-8f08-1ca0a3ee42b0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:31.452197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c25e43a-2ca9-4609-8f08-1ca0a3ee42b0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:31.452676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c25e43a-2ca9-4609-8f08-1ca0a3ee42b0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:31.536747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eebf3d01-b405-4ad7-836e-b17b2e9f3e49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:31.551082 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eebf3d01-b405-4ad7-836e-b17b2e9f3e49 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1474 microversion: 2.1 time: 0.708326 Oct 18 13:22:31.562604 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 798/1555] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:30 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1474 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:31.606051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-bbb0795d-c33a-4d91-8f55-3b8b6553fc09 req-c2ce0bc0-1870-4cfc-8e5d-4aef58c17e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a0d527-5f2f-4c84-a99f-d22d143edb5d", "name": "network-vif-deleted", "tag": "b3e787be-e21b-45a4-8719-31555d6cc6ad"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:31.647344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bbb0795d-c33a-4d91-8f55-3b8b6553fc09 req-c2ce0bc0-1870-4cfc-8e5d-4aef58c17e5f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:31.648187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bbb0795d-c33a-4d91-8f55-3b8b6553fc09 req-c2ce0bc0-1870-4cfc-8e5d-4aef58c17e5f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:31.652403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bbb0795d-c33a-4d91-8f55-3b8b6553fc09 req-c2ce0bc0-1870-4cfc-8e5d-4aef58c17e5f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:31.695336 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-bbb0795d-c33a-4d91-8f55-3b8b6553fc09 req-c2ce0bc0-1870-4cfc-8e5d-4aef58c17e5f service nova] Creating event network-vif-deleted:b3e787be-e21b-45a4-8719-31555d6cc6ad for instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d on n-h2-858384-13 Oct 18 13:22:31.726368 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-bbb0795d-c33a-4d91-8f55-3b8b6553fc09 req-c2ce0bc0-1870-4cfc-8e5d-4aef58c17e5f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123047 Oct 18 13:22:31.732145 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 799/1556] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:22:31.868175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:31.869080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:31.876672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:31.877703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:31.878374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:31.879560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:31.880227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:31.884146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:31.923145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0c25e43a-2ca9-4609-8f08-1ca0a3ee42b0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:31.936842 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0c25e43a-2ca9-4609-8f08-1ca0a3ee42b0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1311 microversion: 2.1 time: 0.524656 Oct 18 13:22:31.939225 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 758/1557] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:31 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1311 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:22:31.940858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:31.941493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:31.942031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:31.942680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lazy-loading 'fault' on Instance uuid 01a0d527-5f2f-4c84-a99f-d22d143edb5d {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:22:32.116425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-44036c1d-5218-4993-b8ea-97da8c8692e9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f79fd30>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:32.128532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:32.158821 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ebfb70a8-a340-4dc6-84ca-fd09d0f644fb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 200 len: 1314 microversion: 2.1 time: 0.285359 Oct 18 13:22:32.159463 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 800/1558] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:31 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:32.236010 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-44036c1d-5218-4993-b8ea-97da8c8692e9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 200 len: 1409 microversion: 2.1 time: 0.126174 Oct 18 13:22:32.237601 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 759/1559] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:32 2022] GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 1409 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:32.592328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ade6fa4e-0cc1-4990-9bb5-fa1358984912 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:32.592880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ade6fa4e-0cc1-4990-9bb5-fa1358984912 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:32.621348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ade6fa4e-0cc1-4990-9bb5-fa1358984912 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:32.621867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ade6fa4e-0cc1-4990-9bb5-fa1358984912 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:32.622315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ade6fa4e-0cc1-4990-9bb5-fa1358984912 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:32.623222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ade6fa4e-0cc1-4990-9bb5-fa1358984912 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:32.623560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ade6fa4e-0cc1-4990-9bb5-fa1358984912 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:32.629246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ade6fa4e-0cc1-4990-9bb5-fa1358984912 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:32.967972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-95d0e413-7983-49e3-b1e2-82cba814b2b8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:32.971177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-95d0e413-7983-49e3-b1e2-82cba814b2b8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:32.987461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95d0e413-7983-49e3-b1e2-82cba814b2b8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:32.988269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95d0e413-7983-49e3-b1e2-82cba814b2b8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:32.988917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95d0e413-7983-49e3-b1e2-82cba814b2b8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:32.990054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95d0e413-7983-49e3-b1e2-82cba814b2b8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:32.990710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95d0e413-7983-49e3-b1e2-82cba814b2b8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:32.991307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95d0e413-7983-49e3-b1e2-82cba814b2b8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:33.188042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-95d0e413-7983-49e3-b1e2-82cba814b2b8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:33.205751 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-95d0e413-7983-49e3-b1e2-82cba814b2b8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1311 microversion: 2.1 time: 0.243102 Oct 18 13:22:33.210875 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 760/1560] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:32 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1311 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:33.248388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-2bdb898e-7ec1-400a-a5c4-64cf39ecb6b4 req-5e40cb3a-cc4c-49cb-8c5c-70b751c4256a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d3172e-d216-47ef-a447-ef91d43bba4f", "tag": "6d3bfbc9-e165-4403-af03-a04bc52c63e5"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:33.294243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2bdb898e-7ec1-400a-a5c4-64cf39ecb6b4 req-5e40cb3a-cc4c-49cb-8c5c-70b751c4256a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:33.298039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2bdb898e-7ec1-400a-a5c4-64cf39ecb6b4 req-5e40cb3a-cc4c-49cb-8c5c-70b751c4256a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:33.305424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2bdb898e-7ec1-400a-a5c4-64cf39ecb6b4 req-5e40cb3a-cc4c-49cb-8c5c-70b751c4256a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:33.354401 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-2bdb898e-7ec1-400a-a5c4-64cf39ecb6b4 req-5e40cb3a-cc4c-49cb-8c5c-70b751c4256a service nova] Creating event network-changed:6d3bfbc9-e165-4403-af03-a04bc52c63e5 for instance 96d3172e-d216-47ef-a447-ef91d43bba4f on n-h2-858384-13 Oct 18 13:22:33.375633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-2bdb898e-7ec1-400a-a5c4-64cf39ecb6b4 req-5e40cb3a-cc4c-49cb-8c5c-70b751c4256a service nova] Instance 96d3172e-d216-47ef-a447-ef91d43bba4f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:22:33.389214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ade6fa4e-0cc1-4990-9bb5-fa1358984912 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:33.402275 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ade6fa4e-0cc1-4990-9bb5-fa1358984912 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1472 microversion: 2.1 time: 0.823057 Oct 18 13:22:33.403908 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-2bdb898e-7ec1-400a-a5c4-64cf39ecb6b4 req-5e40cb3a-cc4c-49cb-8c5c-70b751c4256a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161106 Oct 18 13:22:33.406296 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 761/1561] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:33.414119 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 801/1562] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:32 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1472 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:33.422355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-44d1d02e-fc43-4ed1-a66f-ad63bcfbcc83 req-e1c2f39f-1292-434b-99ba-0ab8fe69f5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f29db8-d1db-4c86-b2a2-aa699fa80532", "name": "network-vif-plugged", "status": "completed", "tag": "a6e78562-1d84-4cfc-b01a-bfe734a39542"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:33.442679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-427a9ed2-8c16-4855-adfa-039d79e5b421 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:33.443924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-427a9ed2-8c16-4855-adfa-039d79e5b421 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:33.446947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-44d1d02e-fc43-4ed1-a66f-ad63bcfbcc83 req-e1c2f39f-1292-434b-99ba-0ab8fe69f5c8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:33.449662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-44d1d02e-fc43-4ed1-a66f-ad63bcfbcc83 req-e1c2f39f-1292-434b-99ba-0ab8fe69f5c8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:33.452262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-44d1d02e-fc43-4ed1-a66f-ad63bcfbcc83 req-e1c2f39f-1292-434b-99ba-0ab8fe69f5c8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:33.459118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-427a9ed2-8c16-4855-adfa-039d79e5b421 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:33.459919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-427a9ed2-8c16-4855-adfa-039d79e5b421 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:33.469966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-427a9ed2-8c16-4855-adfa-039d79e5b421 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:33.471126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-427a9ed2-8c16-4855-adfa-039d79e5b421 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:33.471848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-427a9ed2-8c16-4855-adfa-039d79e5b421 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:33.472509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-427a9ed2-8c16-4855-adfa-039d79e5b421 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:33.492911 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-44d1d02e-fc43-4ed1-a66f-ad63bcfbcc83 req-e1c2f39f-1292-434b-99ba-0ab8fe69f5c8 service nova] Creating event network-vif-plugged:a6e78562-1d84-4cfc-b01a-bfe734a39542 for instance 80f29db8-d1db-4c86-b2a2-aa699fa80532 on n-h1-858384-13 Oct 18 13:22:33.512544 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-44d1d02e-fc43-4ed1-a66f-ad63bcfbcc83 req-e1c2f39f-1292-434b-99ba-0ab8fe69f5c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102423 Oct 18 13:22:33.514235 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-427a9ed2-8c16-4855-adfa-039d79e5b421 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] HTTP exception thrown: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-427a9ed2-8c16-4855-adfa-039d79e5b421 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d HTTP/1.1 Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:22:33.517480 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:22:33.519189 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:22:33.519189 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:22:33.519189 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:22:33.519189 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:22:33.519189 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:22:33.519189 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:22:33.519189 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:22:33.519189 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:22:33.519189 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:22:33.519189 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:22:33.519189 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:22:33.519189 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '01a0d527-5f2f-4c84-a99f-d22d143edb5d'} Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:22:33.520080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:22:33.521726 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:22:33.524921 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 762/1563] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:33.530961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-427a9ed2-8c16-4855-adfa-039d79e5b421 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 404 to user: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:22:33.532274 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-427a9ed2-8c16-4855-adfa-039d79e5b421 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 404 len: 111 microversion: 2.1 time: 0.117000 Oct 18 13:22:33.533148 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 802/1564] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:33 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:22:33.537749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7caf6eb0-89c2-4877-bc52-2689737e495d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f79f4c0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:33.745465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-723255731", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:37.096404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] validate_networks() for [('955c68c9-f0d3-40dc-b2d8-bfb2a09e53c8', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:22:37.100736 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7caf6eb0-89c2-4877-bc52-2689737e495d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 200 len: 1409 microversion: 2.1 time: 3.580128 Oct 18 13:22:37.105711 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 763/1565] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:33 2022] GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 1409 bytes in 3586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:37.110844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4114ca1e-f3e4-40f6-b2e8-33d53ed5223a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:37.113352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4114ca1e-f3e4-40f6-b2e8-33d53ed5223a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:37.120407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4114ca1e-f3e4-40f6-b2e8-33d53ed5223a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:37.120896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4114ca1e-f3e4-40f6-b2e8-33d53ed5223a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:37.121763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4114ca1e-f3e4-40f6-b2e8-33d53ed5223a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:37.122473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4114ca1e-f3e4-40f6-b2e8-33d53ed5223a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:37.122926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4114ca1e-f3e4-40f6-b2e8-33d53ed5223a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:37.123396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4114ca1e-f3e4-40f6-b2e8-33d53ed5223a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:37.344099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4114ca1e-f3e4-40f6-b2e8-33d53ed5223a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:37.363900 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4114ca1e-f3e4-40f6-b2e8-33d53ed5223a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1494 microversion: 2.1 time: 0.253267 Oct 18 13:22:37.364667 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 764/1566] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:37 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1494 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:37.390766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-928600d3-ab9c-4f20-b4ec-5724ab1c60cc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:37.391416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-928600d3-ab9c-4f20-b4ec-5724ab1c60cc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:37.406022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-928600d3-ab9c-4f20-b4ec-5724ab1c60cc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:37.406532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-928600d3-ab9c-4f20-b4ec-5724ab1c60cc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:37.406965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-928600d3-ab9c-4f20-b4ec-5724ab1c60cc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:37.407682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-928600d3-ab9c-4f20-b4ec-5724ab1c60cc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:37.408139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-928600d3-ab9c-4f20-b4ec-5724ab1c60cc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:37.408566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-928600d3-ab9c-4f20-b4ec-5724ab1c60cc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:37.826462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-928600d3-ab9c-4f20-b4ec-5724ab1c60cc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:37.840387 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-928600d3-ab9c-4f20-b4ec-5724ab1c60cc tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1469 microversion: 2.1 time: 0.474084 Oct 18 13:22:37.853568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:22:37.853568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:22:37.854304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:22:37.855388 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 765/1567] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:37 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1469 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:37.862843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:22:37.862843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:22:37.872321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-461de4a8-9ffa-4552-a53e-54588c632be5 req-f6b09acb-c4fb-4b9b-b127-025f6c526ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3683577-0991-4e03-b8c5-b3519335935c", "name": "network-vif-plugged", "status": "completed", "tag": "9f0071a2-f26a-4b60-9753-c1efc5a5abd8"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:37.884329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-461de4a8-9ffa-4552-a53e-54588c632be5 req-f6b09acb-c4fb-4b9b-b127-025f6c526ed1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:37.886211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-461de4a8-9ffa-4552-a53e-54588c632be5 req-f6b09acb-c4fb-4b9b-b127-025f6c526ed1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:37.886654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-461de4a8-9ffa-4552-a53e-54588c632be5 req-f6b09acb-c4fb-4b9b-b127-025f6c526ed1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:37.894131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:37.894934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:37.897811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:37.899734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:37.901956 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-461de4a8-9ffa-4552-a53e-54588c632be5 req-f6b09acb-c4fb-4b9b-b127-025f6c526ed1 service nova] Creating event network-vif-plugged:9f0071a2-f26a-4b60-9753-c1efc5a5abd8 for instance c3683577-0991-4e03-b8c5-b3519335935c on n-h1-858384-13 Oct 18 13:22:37.902910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:37.903600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:37.907093 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-461de4a8-9ffa-4552-a53e-54588c632be5 req-f6b09acb-c4fb-4b9b-b127-025f6c526ed1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050039 Oct 18 13:22:37.908074 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 766/1568] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:37.914150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a1a9ca5d-2746-4888-8bce-b10295b07718 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:37.915557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a1a9ca5d-2746-4888-8bce-b10295b07718 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:37.929900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1a9ca5d-2746-4888-8bce-b10295b07718 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:37.930952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1a9ca5d-2746-4888-8bce-b10295b07718 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:37.932167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1a9ca5d-2746-4888-8bce-b10295b07718 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:37.934232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1a9ca5d-2746-4888-8bce-b10295b07718 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:37.934947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1a9ca5d-2746-4888-8bce-b10295b07718 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:37.936495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1a9ca5d-2746-4888-8bce-b10295b07718 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:37.991901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Getting quotas for project 754e6b0adc07474caa392caa39c0e963. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:22:38.002507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Getting quotas for user 0eeec944a5054ba9b7cd6ae3055230e7 and project 754e6b0adc07474caa392caa39c0e963. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:22:38.017619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:22:38.022052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 1e4740ad-0220-47c0-82a7-3318881b8b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:22:38.107115 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cc828444-8ac6-4332-9303-20ba3f5a2ad4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.367305 Oct 18 13:22:38.116184 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 803/1569] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:22:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 4377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:22:38.343969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a1a9ca5d-2746-4888-8bce-b10295b07718 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:38.367933 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a1a9ca5d-2746-4888-8bce-b10295b07718 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.458597 Oct 18 13:22:38.368541 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 767/1570] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:37 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:38.394607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c6f4baee-78bc-4fb6-8828-2e16f02acb8b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:38.395484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c6f4baee-78bc-4fb6-8828-2e16f02acb8b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:38.413086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6f4baee-78bc-4fb6-8828-2e16f02acb8b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:38.414513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6f4baee-78bc-4fb6-8828-2e16f02acb8b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:38.418074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6f4baee-78bc-4fb6-8828-2e16f02acb8b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:38.421197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6f4baee-78bc-4fb6-8828-2e16f02acb8b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:38.426956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6f4baee-78bc-4fb6-8828-2e16f02acb8b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:38.428589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6f4baee-78bc-4fb6-8828-2e16f02acb8b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:38.673020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68a38254-3b70-41f9-9519-9de44a567a88 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:38.674028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-68a38254-3b70-41f9-9519-9de44a567a88 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:38.699956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68a38254-3b70-41f9-9519-9de44a567a88 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:38.700537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68a38254-3b70-41f9-9519-9de44a567a88 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:38.709946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68a38254-3b70-41f9-9519-9de44a567a88 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:38.712533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68a38254-3b70-41f9-9519-9de44a567a88 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:38.713143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68a38254-3b70-41f9-9519-9de44a567a88 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:38.715941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68a38254-3b70-41f9-9519-9de44a567a88 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:38.728621 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c6f4baee-78bc-4fb6-8828-2e16f02acb8b tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "POST /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f/action" status: 202 len: 0 microversion: 2.1 time: 0.358715 Oct 18 13:22:38.729570 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 768/1571] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:22:38 2022] POST /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:22:38.751291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a9639b26-eda9-42cc-b17f-7f9a508f551e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:38.757106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a9639b26-eda9-42cc-b17f-7f9a508f551e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 1e4740ad-0220-47c0-82a7-3318881b8b23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:38.862870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a9639b26-eda9-42cc-b17f-7f9a508f551e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:38.876703 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a9639b26-eda9-42cc-b17f-7f9a508f551e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23" status: 200 len: 1224 microversion: 2.1 time: 0.145399 Oct 18 13:22:38.889269 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 769/1572] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:38 2022] GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23 => generated 1224 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:38.889269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6767b626-8334-4a8a-a284-fbfe2672aa6b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7dfe50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:39.863425 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68a38254-3b70-41f9-9519-9de44a567a88 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1647 microversion: 2.1 time: 1.745679 Oct 18 13:22:39.864032 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 804/1573] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:38 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1647 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:39.890548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-20c3be75-a297-4e36-8ae1-f47a038b9780 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1021651086"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:39.899227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-20c3be75-a297-4e36-8ae1-f47a038b9780 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:39.912139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20c3be75-a297-4e36-8ae1-f47a038b9780 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:39.915476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20c3be75-a297-4e36-8ae1-f47a038b9780 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:39.918375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20c3be75-a297-4e36-8ae1-f47a038b9780 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:39.921511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20c3be75-a297-4e36-8ae1-f47a038b9780 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:39.922677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20c3be75-a297-4e36-8ae1-f47a038b9780 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:39.925683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20c3be75-a297-4e36-8ae1-f47a038b9780 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:47.938636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:48.011950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:48.709348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:48.780539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:48.875450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:49.917043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:50.012613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=77 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:22:54.628212 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6767b626-8334-4a8a-a284-fbfe2672aa6b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 200 len: 1409 microversion: 2.1 time: 15.748746 Oct 18 13:22:54.629133 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 770/1574] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:38 2022] GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 1409 bytes in 15750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:54.650644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fbbbf042-8e9f-4326-8811-a7566d227ae6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:54.655324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fbbbf042-8e9f-4326-8811-a7566d227ae6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:54.667326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbbbf042-8e9f-4326-8811-a7566d227ae6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:54.667828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbbbf042-8e9f-4326-8811-a7566d227ae6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:54.668272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbbbf042-8e9f-4326-8811-a7566d227ae6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:54.669132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbbbf042-8e9f-4326-8811-a7566d227ae6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:54.671324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbbbf042-8e9f-4326-8811-a7566d227ae6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:54.671805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbbbf042-8e9f-4326-8811-a7566d227ae6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:54.894976 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-20c3be75-a297-4e36-8ae1-f47a038b9780 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 15.017690 Oct 18 13:22:54.897703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fbbbf042-8e9f-4326-8811-a7566d227ae6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:54.902907 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 805/1575] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:22:39 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 15028 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 18 13:22:54.912155 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fbbbf042-8e9f-4326-8811-a7566d227ae6 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1461 microversion: 2.1 time: 0.274547 Oct 18 13:22:54.913649 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 771/1576] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:54 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1461 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:54.914987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d40754f7-1231-4bd6-8658-7dc63a4fa694 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:54.916523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d40754f7-1231-4bd6-8658-7dc63a4fa694 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:54.920762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ffa2538d-a935-49a2-8eff-e0d0833101bf tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:54.921754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ffa2538d-a935-49a2-8eff-e0d0833101bf tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 1e4740ad-0220-47c0-82a7-3318881b8b23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:54.923976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d40754f7-1231-4bd6-8658-7dc63a4fa694 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:54.924518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d40754f7-1231-4bd6-8658-7dc63a4fa694 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:54.925152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d40754f7-1231-4bd6-8658-7dc63a4fa694 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:54.928174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa2538d-a935-49a2-8eff-e0d0833101bf tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:54.928672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa2538d-a935-49a2-8eff-e0d0833101bf tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:54.929113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa2538d-a935-49a2-8eff-e0d0833101bf tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:54.929869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa2538d-a935-49a2-8eff-e0d0833101bf tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:54.930327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa2538d-a935-49a2-8eff-e0d0833101bf tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:54.930805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa2538d-a935-49a2-8eff-e0d0833101bf tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:54.931592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d40754f7-1231-4bd6-8658-7dc63a4fa694 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:54.932385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d40754f7-1231-4bd6-8658-7dc63a4fa694 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:54.933198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d40754f7-1231-4bd6-8658-7dc63a4fa694 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:55.152312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ffa2538d-a935-49a2-8eff-e0d0833101bf tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:55.162029 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ffa2538d-a935-49a2-8eff-e0d0833101bf tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23" status: 200 len: 1324 microversion: 2.1 time: 0.247043 Oct 18 13:22:55.163740 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 772/1577] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:54 2022] GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23 => generated 1324 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:55.169209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-361e0797-1945-49f8-a134-83f8d256f70c req-4ab41fd0-fee0-4d61-997d-cd1e1d2aa1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d3172e-d216-47ef-a447-ef91d43bba4f", "name": "network-vif-plugged", "status": "completed", "tag": "6d3bfbc9-e165-4403-af03-a04bc52c63e5"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:55.181762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-361e0797-1945-49f8-a134-83f8d256f70c req-4ab41fd0-fee0-4d61-997d-cd1e1d2aa1f7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:55.183518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-361e0797-1945-49f8-a134-83f8d256f70c req-4ab41fd0-fee0-4d61-997d-cd1e1d2aa1f7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:55.184249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-361e0797-1945-49f8-a134-83f8d256f70c req-4ab41fd0-fee0-4d61-997d-cd1e1d2aa1f7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:55.194995 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d40754f7-1231-4bd6-8658-7dc63a4fa694 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1647 microversion: 2.1 time: 0.289562 Oct 18 13:22:55.195600 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 806/1578] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:54 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1647 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:55.199760 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-361e0797-1945-49f8-a134-83f8d256f70c req-4ab41fd0-fee0-4d61-997d-cd1e1d2aa1f7 service nova] Creating event network-vif-plugged:6d3bfbc9-e165-4403-af03-a04bc52c63e5 for instance 96d3172e-d216-47ef-a447-ef91d43bba4f on n-h1-858384-13 Oct 18 13:22:55.200926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f4455c4d-8733-4cda-89a3-a7f445015688 req-89993a7f-1ac4-4238-b044-af5343a783a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4740ad-0220-47c0-82a7-3318881b8b23", "tag": "1dc75b63-7884-4f8a-adbb-daa672d25a3f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:55.207312 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-361e0797-1945-49f8-a134-83f8d256f70c req-4ab41fd0-fee0-4d61-997d-cd1e1d2aa1f7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042108 Oct 18 13:22:55.208280 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 773/1579] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:55.215586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f4455c4d-8733-4cda-89a3-a7f445015688 req-89993a7f-1ac4-4238-b044-af5343a783a8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:55.219437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f4455c4d-8733-4cda-89a3-a7f445015688 req-89993a7f-1ac4-4238-b044-af5343a783a8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:55.220003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f4455c4d-8733-4cda-89a3-a7f445015688 req-89993a7f-1ac4-4238-b044-af5343a783a8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:55.261577 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f4455c4d-8733-4cda-89a3-a7f445015688 req-89993a7f-1ac4-4238-b044-af5343a783a8 service nova] Creating event network-changed:1dc75b63-7884-4f8a-adbb-daa672d25a3f for instance 1e4740ad-0220-47c0-82a7-3318881b8b23 on n-h2-858384-13 Oct 18 13:22:55.273680 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f4455c4d-8733-4cda-89a3-a7f445015688 req-89993a7f-1ac4-4238-b044-af5343a783a8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076811 Oct 18 13:22:55.284461 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 807/1580] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:55.293545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f727bd53-7af4-4046-badf-9c943f052811 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f274c8c5-7736-4958-b79a-44d3fffd2589"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:55.296902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f727bd53-7af4-4046-badf-9c943f052811 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:55.304544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f727bd53-7af4-4046-badf-9c943f052811 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:55.305518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f727bd53-7af4-4046-badf-9c943f052811 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:55.306431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f727bd53-7af4-4046-badf-9c943f052811 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:55.307599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f727bd53-7af4-4046-badf-9c943f052811 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:55.308327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f727bd53-7af4-4046-badf-9c943f052811 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:55.309056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f727bd53-7af4-4046-badf-9c943f052811 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:55.344906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2111666103", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "b5cc8010-ea63-4e1f-9434-bf4391452206"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:55.446268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] validate_networks() for [('b5cc8010-ea63-4e1f-9434-bf4391452206', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:22:55.815563 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f727bd53-7af4-4046-badf-9c943f052811 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "POST /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.528643 Oct 18 13:22:55.833546 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 808/1581] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:22:55 2022] POST /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5/os-volume_attachments => generated 194 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:56.266633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7b693302-2328-4c7c-97b8-0409ccf6c66d tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:56.273360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7b693302-2328-4c7c-97b8-0409ccf6c66d tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:56.357598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b693302-2328-4c7c-97b8-0409ccf6c66d tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:56.359491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b693302-2328-4c7c-97b8-0409ccf6c66d tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:56.360615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b693302-2328-4c7c-97b8-0409ccf6c66d tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:56.363954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b693302-2328-4c7c-97b8-0409ccf6c66d tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:56.385579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b693302-2328-4c7c-97b8-0409ccf6c66d tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:56.398482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b693302-2328-4c7c-97b8-0409ccf6c66d tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:56.633209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:22:56.634319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:22:56.635286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:22:56.636294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:22:56.637246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:22:56.665252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:56.666280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:56.667141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:56.668741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:56.679126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:56.681387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:56.775086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:22:56.782601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for user c0a722d1dc7c4e05b8cc8dc98b5cb619 and project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:22:56.790328 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7b693302-2328-4c7c-97b8-0409ccf6c66d tempest-MigrationsAdminTest-700113762 tempest-MigrationsAdminTest-700113762-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1614 microversion: 2.1 time: 0.957572 Oct 18 13:22:56.801590 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 809/1582] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:55 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1614 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:56.801590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-faed14d2-604b-4ea9-b734-2806ea94264c tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:56.801590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faed14d2-604b-4ea9-b734-2806ea94264c tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:56.802094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faed14d2-604b-4ea9-b734-2806ea94264c tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:56.802530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faed14d2-604b-4ea9-b734-2806ea94264c tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:56.803704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faed14d2-604b-4ea9-b734-2806ea94264c tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:56.804273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faed14d2-604b-4ea9-b734-2806ea94264c tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:56.804787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faed14d2-604b-4ea9-b734-2806ea94264c tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:56.828673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:22:56.832329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:22:56.850771 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-faed14d2-604b-4ea9-b734-2806ea94264c tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.056811 Oct 18 13:22:56.851164 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 810/1583] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 18 13:22:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:56.857125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a77aa3f8-427e-4227-870a-ed537a522562 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617be65e0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:56.923338 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a77aa3f8-427e-4227-870a-ed537a522562 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 200 len: 1409 microversion: 2.1 time: 0.070974 Oct 18 13:22:56.927043 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5753c12b-e956-40d4-81ab-39b4df08ea6e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.717122 Oct 18 13:22:56.933397 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 811/1584] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:56 2022] GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 1409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:56.938788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f6315e43-6ccc-4e64-8bc2-1bdfcea03855 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:56.939668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f6315e43-6ccc-4e64-8bc2-1bdfcea03855 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 1e4740ad-0220-47c0-82a7-3318881b8b23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:56.940045 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 774/1585] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:22:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:22:56.952744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ca9b7d73-fdf1-4575-887f-7721a743111c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:56.957392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6315e43-6ccc-4e64-8bc2-1bdfcea03855 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:56.957727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ca9b7d73-fdf1-4575-887f-7721a743111c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:56.958215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6315e43-6ccc-4e64-8bc2-1bdfcea03855 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:56.958946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6315e43-6ccc-4e64-8bc2-1bdfcea03855 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:56.961477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6315e43-6ccc-4e64-8bc2-1bdfcea03855 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:56.962469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6315e43-6ccc-4e64-8bc2-1bdfcea03855 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:56.963297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6315e43-6ccc-4e64-8bc2-1bdfcea03855 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:56.971323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca9b7d73-fdf1-4575-887f-7721a743111c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:56.981749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca9b7d73-fdf1-4575-887f-7721a743111c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:56.982293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca9b7d73-fdf1-4575-887f-7721a743111c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:56.983182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca9b7d73-fdf1-4575-887f-7721a743111c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:56.983660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca9b7d73-fdf1-4575-887f-7721a743111c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:56.984089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca9b7d73-fdf1-4575-887f-7721a743111c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:57.041810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ca9b7d73-fdf1-4575-887f-7721a743111c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:22:57.218411 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ca9b7d73-fdf1-4575-887f-7721a743111c tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "DELETE /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 204 len: 0 microversion: 2.1 time: 0.276445 Oct 18 13:22:57.219656 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 775/1586] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:22:56 2022] DELETE /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:22:57.233935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5fe8483b-2adb-4ef5-995c-42aa0ecabf9d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-13", "block_migration": true, "disk_over_commit": false}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:57.238315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5fe8483b-2adb-4ef5-995c-42aa0ecabf9d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:57.256848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fe8483b-2adb-4ef5-995c-42aa0ecabf9d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:57.260692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fe8483b-2adb-4ef5-995c-42aa0ecabf9d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:57.261662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fe8483b-2adb-4ef5-995c-42aa0ecabf9d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:57.262618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fe8483b-2adb-4ef5-995c-42aa0ecabf9d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:57.263322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fe8483b-2adb-4ef5-995c-42aa0ecabf9d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:57.263934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fe8483b-2adb-4ef5-995c-42aa0ecabf9d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:57.312082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-5fe8483b-2adb-4ef5-995c-42aa0ecabf9d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lazy-loading 'flavor' on Instance uuid 80f29db8-d1db-4c86-b2a2-aa699fa80532 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:22:57.326931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5fe8483b-2adb-4ef5-995c-42aa0ecabf9d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Going to try to live migrate instance to n-h2-858384-13 {{(pid=120612) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:22:57.346910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f6315e43-6ccc-4e64-8bc2-1bdfcea03855 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:57.401905 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f6315e43-6ccc-4e64-8bc2-1bdfcea03855 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23" status: 200 len: 1324 microversion: 2.1 time: 0.463743 Oct 18 13:22:57.404492 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 812/1587] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:56 2022] GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23 => generated 1324 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:57.421162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9b65ad5b-b1a9-4432-b5fd-856ac07f2b93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:57.427705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9b65ad5b-b1a9-4432-b5fd-856ac07f2b93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:57.558589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b65ad5b-b1a9-4432-b5fd-856ac07f2b93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:57.574997 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9b65ad5b-b1a9-4432-b5fd-856ac07f2b93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1215 microversion: 2.1 time: 0.168486 Oct 18 13:22:57.575950 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 813/1588] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:57 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:57.580911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-129ddb36-d851-4dd0-9bca-61759d807fd4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:57.594320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-129ddb36-d851-4dd0-9bca-61759d807fd4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:57.601486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-129ddb36-d851-4dd0-9bca-61759d807fd4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:57.602305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-129ddb36-d851-4dd0-9bca-61759d807fd4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:57.603596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-129ddb36-d851-4dd0-9bca-61759d807fd4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:57.604578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-129ddb36-d851-4dd0-9bca-61759d807fd4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:57.605071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-129ddb36-d851-4dd0-9bca-61759d807fd4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:57.605528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-129ddb36-d851-4dd0-9bca-61759d807fd4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:57.923926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-129ddb36-d851-4dd0-9bca-61759d807fd4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:57.944395 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-129ddb36-d851-4dd0-9bca-61759d807fd4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1467 microversion: 2.1 time: 0.360995 Oct 18 13:22:57.948069 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 814/1589] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:57 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1467 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:57.959848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-122a1a95-a7eb-4b5f-94b2-3f2168bf8dee req-a0e616a1-a673-4a4c-9b9d-32afc53c0635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aad90b5-28fb-44b2-89da-33bc1b2889f2", "name": "network-vif-unplugged", "status": "completed", "tag": "516c3ad3-1e31-4bde-b674-c0c367989f56"}, {"server_uuid": "1e4740ad-0220-47c0-82a7-3318881b8b23", "name": "network-vif-plugged", "status": "completed", "tag": "1dc75b63-7884-4f8a-adbb-daa672d25a3f"}, {"server_uuid": "96d3172e-d216-47ef-a447-ef91d43bba4f", "name": "network-vif-plugged", "status": "completed", "tag": "6d3bfbc9-e165-4403-af03-a04bc52c63e5"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:57.990504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-122a1a95-a7eb-4b5f-94b2-3f2168bf8dee req-a0e616a1-a673-4a4c-9b9d-32afc53c0635 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:57.994733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-122a1a95-a7eb-4b5f-94b2-3f2168bf8dee req-a0e616a1-a673-4a4c-9b9d-32afc53c0635 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:57.995913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-122a1a95-a7eb-4b5f-94b2-3f2168bf8dee req-a0e616a1-a673-4a4c-9b9d-32afc53c0635 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:58.035314 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-122a1a95-a7eb-4b5f-94b2-3f2168bf8dee req-a0e616a1-a673-4a4c-9b9d-32afc53c0635 service nova] Creating event network-vif-unplugged:516c3ad3-1e31-4bde-b674-c0c367989f56 for instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 on n-h1-858384-13 Oct 18 13:22:58.036116 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-122a1a95-a7eb-4b5f-94b2-3f2168bf8dee req-a0e616a1-a673-4a4c-9b9d-32afc53c0635 service nova] Creating event network-vif-plugged:1dc75b63-7884-4f8a-adbb-daa672d25a3f for instance 1e4740ad-0220-47c0-82a7-3318881b8b23 on n-h2-858384-13 Oct 18 13:22:58.037086 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-122a1a95-a7eb-4b5f-94b2-3f2168bf8dee req-a0e616a1-a673-4a4c-9b9d-32afc53c0635 service nova] Creating event network-vif-plugged:6d3bfbc9-e165-4403-af03-a04bc52c63e5 for instance 96d3172e-d216-47ef-a447-ef91d43bba4f on n-h1-858384-13 Oct 18 13:22:58.055138 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-122a1a95-a7eb-4b5f-94b2-3f2168bf8dee req-a0e616a1-a673-4a4c-9b9d-32afc53c0635 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.104193 Oct 18 13:22:58.056047 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 815/1590] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:58.066844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-cf5c2a19-c94e-4731-8e8c-1a6e96e97268 req-0af747ba-6666-4c35-ae08-8c37ccf9881f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d3172e-d216-47ef-a447-ef91d43bba4f", "name": "network-vif-unplugged", "status": "completed", "tag": "6d3bfbc9-e165-4403-af03-a04bc52c63e5"}, {"name": "network-changed", "server_uuid": "96d3172e-d216-47ef-a447-ef91d43bba4f", "tag": "6d3bfbc9-e165-4403-af03-a04bc52c63e5"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:22:58.104077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-cf5c2a19-c94e-4731-8e8c-1a6e96e97268 req-0af747ba-6666-4c35-ae08-8c37ccf9881f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:58.104678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-cf5c2a19-c94e-4731-8e8c-1a6e96e97268 req-0af747ba-6666-4c35-ae08-8c37ccf9881f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:58.105141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-cf5c2a19-c94e-4731-8e8c-1a6e96e97268 req-0af747ba-6666-4c35-ae08-8c37ccf9881f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:58.119802 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-cf5c2a19-c94e-4731-8e8c-1a6e96e97268 req-0af747ba-6666-4c35-ae08-8c37ccf9881f service nova] Creating event network-vif-unplugged:6d3bfbc9-e165-4403-af03-a04bc52c63e5 for instance 96d3172e-d216-47ef-a447-ef91d43bba4f on n-h1-858384-13 Oct 18 13:22:58.122705 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-cf5c2a19-c94e-4731-8e8c-1a6e96e97268 req-0af747ba-6666-4c35-ae08-8c37ccf9881f service nova] Creating event network-changed:6d3bfbc9-e165-4403-af03-a04bc52c63e5 for instance 96d3172e-d216-47ef-a447-ef91d43bba4f on n-h1-858384-13 Oct 18 13:22:58.129474 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-cf5c2a19-c94e-4731-8e8c-1a6e96e97268 req-0af747ba-6666-4c35-ae08-8c37ccf9881f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.070873 Oct 18 13:22:58.130797 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 816/1591] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:22:58.139756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b99308b2-588c-4b96-8a76-22389a3439fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617be6f70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:58.224395 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b99308b2-588c-4b96-8a76-22389a3439fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 200 len: 1409 microversion: 2.1 time: 0.090283 Oct 18 13:22:58.238976 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 817/1592] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:58 2022] GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 1409 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:58.450256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-293f9fb8-821f-4d58-b059-3744a914c6d9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:58.451250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-293f9fb8-821f-4d58-b059-3744a914c6d9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 1e4740ad-0220-47c0-82a7-3318881b8b23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:58.467578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-293f9fb8-821f-4d58-b059-3744a914c6d9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:58.470812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-293f9fb8-821f-4d58-b059-3744a914c6d9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:58.471764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-293f9fb8-821f-4d58-b059-3744a914c6d9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:58.475353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-293f9fb8-821f-4d58-b059-3744a914c6d9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:58.476578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-293f9fb8-821f-4d58-b059-3744a914c6d9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:58.479069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-293f9fb8-821f-4d58-b059-3744a914c6d9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:58.917037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-293f9fb8-821f-4d58-b059-3744a914c6d9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:58.926554 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-293f9fb8-821f-4d58-b059-3744a914c6d9 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23" status: 200 len: 1324 microversion: 2.1 time: 0.483674 Oct 18 13:22:58.927712 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 818/1593] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:58 2022] GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23 => generated 1324 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:58.934979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4023e6da-5d8e-4dcf-8352-5cc0868b4e3e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:58.935905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4023e6da-5d8e-4dcf-8352-5cc0868b4e3e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:58.942512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4023e6da-5d8e-4dcf-8352-5cc0868b4e3e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:58.943291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4023e6da-5d8e-4dcf-8352-5cc0868b4e3e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:58.943903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4023e6da-5d8e-4dcf-8352-5cc0868b4e3e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:58.944863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4023e6da-5d8e-4dcf-8352-5cc0868b4e3e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:58.945353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4023e6da-5d8e-4dcf-8352-5cc0868b4e3e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:58.946049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4023e6da-5d8e-4dcf-8352-5cc0868b4e3e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:59.050716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4023e6da-5d8e-4dcf-8352-5cc0868b4e3e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:59.067538 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4023e6da-5d8e-4dcf-8352-5cc0868b4e3e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1211 microversion: 2.1 time: 0.138232 Oct 18 13:22:59.068530 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 819/1594] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:58 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1211 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:59.111496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f89b572-53dc-441a-b538-16e01c9a0473 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:59.112280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7f89b572-53dc-441a-b538-16e01c9a0473 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:22:59.129530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f89b572-53dc-441a-b538-16e01c9a0473 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:59.141680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f89b572-53dc-441a-b538-16e01c9a0473 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:59.142100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f89b572-53dc-441a-b538-16e01c9a0473 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:59.143354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f89b572-53dc-441a-b538-16e01c9a0473 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:22:59.145342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f89b572-53dc-441a-b538-16e01c9a0473 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:22:59.146153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f89b572-53dc-441a-b538-16e01c9a0473 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:22:59.368669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7f89b572-53dc-441a-b538-16e01c9a0473 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:22:59.383342 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7f89b572-53dc-441a-b538-16e01c9a0473 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1467 microversion: 2.1 time: 0.311223 Oct 18 13:22:59.385123 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 820/1595] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:59 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1467 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:59.404575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7ece9a98-7bb1-48ab-9d2d-108126ee3838 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60fcbef70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:59.467691 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7ece9a98-7bb1-48ab-9d2d-108126ee3838 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 200 len: 1418 microversion: 2.1 time: 0.081189 Oct 18 13:22:59.478486 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 821/1596] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:59 2022] GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 1418 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:59.488814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2d2fe99c-d2ef-4c78-8c78-0448e7e700d0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617c5b4c0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:22:59.554462 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2d2fe99c-d2ef-4c78-8c78-0448e7e700d0 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 200 len: 1418 microversion: 2.1 time: 0.073998 Oct 18 13:22:59.555446 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 822/1597] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:22:59 2022] GET /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 1418 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:22:59.576654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8f2b0917-5c83-44f4-9d55-339c8fef15aa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7eb4c0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:00.584494 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8f2b0917-5c83-44f4-9d55-339c8fef15aa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 204 len: 0 microversion: 2.1 time: 1.015422 Oct 18 13:23:00.585150 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 823/1598] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:22:59 2022] DELETE /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:23:00.593777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a711ff11-3efc-48dd-9313-bb273cc87dfc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:00.594393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a711ff11-3efc-48dd-9313-bb273cc87dfc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 1e4740ad-0220-47c0-82a7-3318881b8b23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:00.616808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a711ff11-3efc-48dd-9313-bb273cc87dfc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:00.617528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a711ff11-3efc-48dd-9313-bb273cc87dfc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:00.618117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a711ff11-3efc-48dd-9313-bb273cc87dfc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:00.619087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a711ff11-3efc-48dd-9313-bb273cc87dfc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:00.619670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a711ff11-3efc-48dd-9313-bb273cc87dfc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:00.620104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a711ff11-3efc-48dd-9313-bb273cc87dfc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:00.734458 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5fe8483b-2adb-4ef5-995c-42aa0ecabf9d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532/action" status: 202 len: 0 microversion: 2.1 time: 3.513267 Oct 18 13:23:00.735837 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 776/1599] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:22:57 2022] POST /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532/action => generated 0 bytes in 3515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:23:00.742443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1d848256-95bc-4a1d-bc2a-7b676f06a4a7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:00.743536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1d848256-95bc-4a1d-bc2a-7b676f06a4a7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:00.776715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d848256-95bc-4a1d-bc2a-7b676f06a4a7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:00.778400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d848256-95bc-4a1d-bc2a-7b676f06a4a7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:00.793787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d848256-95bc-4a1d-bc2a-7b676f06a4a7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:00.795637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d848256-95bc-4a1d-bc2a-7b676f06a4a7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:00.802076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d848256-95bc-4a1d-bc2a-7b676f06a4a7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:00.803098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d848256-95bc-4a1d-bc2a-7b676f06a4a7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:01.051017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1d848256-95bc-4a1d-bc2a-7b676f06a4a7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:01.061314 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1d848256-95bc-4a1d-bc2a-7b676f06a4a7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1285 microversion: 2.1 time: 0.323397 Oct 18 13:23:01.068257 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 777/1600] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:00 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1285 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:01.077776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-13c3d398-ba94-495c-9f5e-7ee665647c70 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:01.086999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-13c3d398-ba94-495c-9f5e-7ee665647c70 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:01.109497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13c3d398-ba94-495c-9f5e-7ee665647c70 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:01.109997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13c3d398-ba94-495c-9f5e-7ee665647c70 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:01.110473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13c3d398-ba94-495c-9f5e-7ee665647c70 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:01.111270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13c3d398-ba94-495c-9f5e-7ee665647c70 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:01.111724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13c3d398-ba94-495c-9f5e-7ee665647c70 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:01.112147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13c3d398-ba94-495c-9f5e-7ee665647c70 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:01.145393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a711ff11-3efc-48dd-9313-bb273cc87dfc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:01.158574 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a711ff11-3efc-48dd-9313-bb273cc87dfc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23" status: 200 len: 1520 microversion: 2.1 time: 0.571820 Oct 18 13:23:01.163092 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 824/1601] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:00 2022] GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23 => generated 1520 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:01.183342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c26eadc7-4bff-4b7b-b1d4-9fb7eb8cea58 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:01.184127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c26eadc7-4bff-4b7b-b1d4-9fb7eb8cea58 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:01.200647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c26eadc7-4bff-4b7b-b1d4-9fb7eb8cea58 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:01.201577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c26eadc7-4bff-4b7b-b1d4-9fb7eb8cea58 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:01.207482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c26eadc7-4bff-4b7b-b1d4-9fb7eb8cea58 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:01.211081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c26eadc7-4bff-4b7b-b1d4-9fb7eb8cea58 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:01.216131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c26eadc7-4bff-4b7b-b1d4-9fb7eb8cea58 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:01.217026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c26eadc7-4bff-4b7b-b1d4-9fb7eb8cea58 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:01.327454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c26eadc7-4bff-4b7b-b1d4-9fb7eb8cea58 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:23:01.359450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-13c3d398-ba94-495c-9f5e-7ee665647c70 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:01.370400 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-13c3d398-ba94-495c-9f5e-7ee665647c70 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1297 microversion: 2.1 time: 0.300701 Oct 18 13:23:01.370960 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 778/1602] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:01 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1297 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:01.405350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f0e66dc-0ca5-45da-b9c9-e1f95555af4e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:01.406961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7f0e66dc-0ca5-45da-b9c9-e1f95555af4e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:01.427996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f0e66dc-0ca5-45da-b9c9-e1f95555af4e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:01.428788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f0e66dc-0ca5-45da-b9c9-e1f95555af4e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:01.429619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f0e66dc-0ca5-45da-b9c9-e1f95555af4e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:01.430931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f0e66dc-0ca5-45da-b9c9-e1f95555af4e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:01.434546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f0e66dc-0ca5-45da-b9c9-e1f95555af4e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:01.435773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f0e66dc-0ca5-45da-b9c9-e1f95555af4e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:01.495962 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c26eadc7-4bff-4b7b-b1d4-9fb7eb8cea58 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 204 len: 0 microversion: 2.1 time: 0.331266 Oct 18 13:23:01.499096 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 825/1603] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:23:01 2022] DELETE /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:23:01.509228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-53de2985-5d7d-4a1c-822e-eeb295a36dac req-11d9b0c4-ac58-444c-b3aa-3706151e42fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d3172e-d216-47ef-a447-ef91d43bba4f", "name": "network-vif-deleted", "tag": "6d3bfbc9-e165-4403-af03-a04bc52c63e5"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:01.553140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-53de2985-5d7d-4a1c-822e-eeb295a36dac req-11d9b0c4-ac58-444c-b3aa-3706151e42fe service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:01.559696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-53de2985-5d7d-4a1c-822e-eeb295a36dac req-11d9b0c4-ac58-444c-b3aa-3706151e42fe service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:01.566593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-53de2985-5d7d-4a1c-822e-eeb295a36dac req-11d9b0c4-ac58-444c-b3aa-3706151e42fe service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:01.595348 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-53de2985-5d7d-4a1c-822e-eeb295a36dac req-11d9b0c4-ac58-444c-b3aa-3706151e42fe service nova] Creating event network-vif-deleted:6d3bfbc9-e165-4403-af03-a04bc52c63e5 for instance 96d3172e-d216-47ef-a447-ef91d43bba4f on n-h1-858384-13 Oct 18 13:23:01.619453 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-53de2985-5d7d-4a1c-822e-eeb295a36dac req-11d9b0c4-ac58-444c-b3aa-3706151e42fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118733 Oct 18 13:23:01.620131 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 826/1604] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:01.641606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc080e23-b068-43d5-b4ad-030fb2abe07e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:01.642213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc080e23-b068-43d5-b4ad-030fb2abe07e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 1e4740ad-0220-47c0-82a7-3318881b8b23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:01.665572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc080e23-b068-43d5-b4ad-030fb2abe07e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:01.666066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc080e23-b068-43d5-b4ad-030fb2abe07e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:01.666512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc080e23-b068-43d5-b4ad-030fb2abe07e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:01.677116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc080e23-b068-43d5-b4ad-030fb2abe07e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:01.678986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc080e23-b068-43d5-b4ad-030fb2abe07e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:01.681728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc080e23-b068-43d5-b4ad-030fb2abe07e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:01.750503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:01.771276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc080e23-b068-43d5-b4ad-030fb2abe07e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 1e4740ad-0220-47c0-82a7-3318881b8b23] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:23:01.976379 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc080e23-b068-43d5-b4ad-030fb2abe07e tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23" status: 204 len: 0 microversion: 2.1 time: 0.347565 Oct 18 13:23:01.977416 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 827/1605] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:23:01 2022] DELETE /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:23:01.987672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1776606602", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "0b58d9a8-4835-4530-9695-a2f702e82ee6"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:02.011404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7f0e66dc-0ca5-45da-b9c9-e1f95555af4e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:02.022389 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7f0e66dc-0ca5-45da-b9c9-e1f95555af4e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1504 microversion: 2.1 time: 0.633128 Oct 18 13:23:02.046404 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 779/1606] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:01 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1504 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:02.060101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c9ac43ae-2236-49ae-89a0-8831725c56f4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:02.066202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c9ac43ae-2236-49ae-89a0-8831725c56f4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 1e4740ad-0220-47c0-82a7-3318881b8b23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:02.077090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9ac43ae-2236-49ae-89a0-8831725c56f4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:02.089737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9ac43ae-2236-49ae-89a0-8831725c56f4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:02.090424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9ac43ae-2236-49ae-89a0-8831725c56f4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:02.091377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9ac43ae-2236-49ae-89a0-8831725c56f4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:02.092026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9ac43ae-2236-49ae-89a0-8831725c56f4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:02.092654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9ac43ae-2236-49ae-89a0-8831725c56f4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:02.120762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] validate_networks() for [('0b58d9a8-4835-4530-9695-a2f702e82ee6', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:23:02.479482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c9ac43ae-2236-49ae-89a0-8831725c56f4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:02.495168 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c9ac43ae-2236-49ae-89a0-8831725c56f4 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23" status: 200 len: 1526 microversion: 2.1 time: 0.447174 Oct 18 13:23:02.495829 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 780/1607] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:02 2022] GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23 => generated 1526 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:02.506860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a21fbfc0-0122-44bd-966a-9933367390e9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:02.507485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a21fbfc0-0122-44bd-966a-9933367390e9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:02.527150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a21fbfc0-0122-44bd-966a-9933367390e9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:02.527633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a21fbfc0-0122-44bd-966a-9933367390e9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:02.528074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a21fbfc0-0122-44bd-966a-9933367390e9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:02.528787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a21fbfc0-0122-44bd-966a-9933367390e9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:02.534545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a21fbfc0-0122-44bd-966a-9933367390e9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:02.535263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a21fbfc0-0122-44bd-966a-9933367390e9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:02.815803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a21fbfc0-0122-44bd-966a-9933367390e9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:02.826433 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a21fbfc0-0122-44bd-966a-9933367390e9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1315 microversion: 2.1 time: 0.329492 Oct 18 13:23:02.827025 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 781/1608] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:02 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:02.827174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:23:02.828272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:23:02.828929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:23:02.829880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:23:02.830930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:23:02.848982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:02.849825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:02.850456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:02.851693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:02.852088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:02.853057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:02.854041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:02.854672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:02.860002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:02.860618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:02.861154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:02.862106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:02.862657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:02.863195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:02.886330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Getting quotas for project 472fc8535c504953a8f14a24f9d22260. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:23:02.915271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:02.916043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:02.916976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:02.917150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Getting quotas for user f896caa4caa0472db9198f7795401df2 and project 472fc8535c504953a8f14a24f9d22260. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:23:02.918175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lazy-loading 'fault' on Instance uuid 96d3172e-d216-47ef-a447-ef91d43bba4f {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:23:02.960942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:23:02.965085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:23:03.015924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:03.043593 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b8b1f8ca-3c09-4923-9acb-96757c162675 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 200 len: 1302 microversion: 2.1 time: 0.196541 Oct 18 13:23:03.049273 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 782/1609] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:02 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 1302 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:03.058062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-c4454db9-ee92-44cb-80d2-2d896bdf7b45 req-bd4f999c-9853-4261-9e4b-f23a1093fcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3683577-0991-4e03-b8c5-b3519335935c", "name": "network-vif-unplugged", "status": "completed", "tag": "9f0071a2-f26a-4b60-9753-c1efc5a5abd8"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:03.076322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c4454db9-ee92-44cb-80d2-2d896bdf7b45 req-bd4f999c-9853-4261-9e4b-f23a1093fcdc service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:03.077119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c4454db9-ee92-44cb-80d2-2d896bdf7b45 req-bd4f999c-9853-4261-9e4b-f23a1093fcdc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:03.078176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c4454db9-ee92-44cb-80d2-2d896bdf7b45 req-bd4f999c-9853-4261-9e4b-f23a1093fcdc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:03.106593 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-c4454db9-ee92-44cb-80d2-2d896bdf7b45 req-bd4f999c-9853-4261-9e4b-f23a1093fcdc service nova] Creating event network-vif-unplugged:9f0071a2-f26a-4b60-9753-c1efc5a5abd8 for instance c3683577-0991-4e03-b8c5-b3519335935c on n-h1-858384-13 Oct 18 13:23:03.116921 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4c340c09-70ed-4a90-a5c1-5e298ccdec5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.134150 Oct 18 13:23:03.117148 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-c4454db9-ee92-44cb-80d2-2d896bdf7b45 req-bd4f999c-9853-4261-9e4b-f23a1093fcdc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065356 Oct 18 13:23:03.117857 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 783/1610] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:03.120291 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 828/1611] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:23:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:23:03.125733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-34d44c2b-1ddd-4402-9527-e321dcf53ea3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:03.127130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-34d44c2b-1ddd-4402-9527-e321dcf53ea3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:03.137609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d3a325e6-9629-46ff-a407-f4a5134ab6d9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:03.138483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d3a325e6-9629-46ff-a407-f4a5134ab6d9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:03.165614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34d44c2b-1ddd-4402-9527-e321dcf53ea3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:03.174305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34d44c2b-1ddd-4402-9527-e321dcf53ea3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:03.175013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34d44c2b-1ddd-4402-9527-e321dcf53ea3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:03.175943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34d44c2b-1ddd-4402-9527-e321dcf53ea3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:03.176568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34d44c2b-1ddd-4402-9527-e321dcf53ea3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:03.177222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34d44c2b-1ddd-4402-9527-e321dcf53ea3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:03.233341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d3a325e6-9629-46ff-a407-f4a5134ab6d9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:03.265759 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d3a325e6-9629-46ff-a407-f4a5134ab6d9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1208 microversion: 2.1 time: 0.133692 Oct 18 13:23:03.266360 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 829/1612] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:03 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1208 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:03.527612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0615cc02-11c1-4757-b9c0-c2adac7124bb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:03.534364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0615cc02-11c1-4757-b9c0-c2adac7124bb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 1e4740ad-0220-47c0-82a7-3318881b8b23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:03.549497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0615cc02-11c1-4757-b9c0-c2adac7124bb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:03.550331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0615cc02-11c1-4757-b9c0-c2adac7124bb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:03.554366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0615cc02-11c1-4757-b9c0-c2adac7124bb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:03.555641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0615cc02-11c1-4757-b9c0-c2adac7124bb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:03.556370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0615cc02-11c1-4757-b9c0-c2adac7124bb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:03.556981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0615cc02-11c1-4757-b9c0-c2adac7124bb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:04.046777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-34d44c2b-1ddd-4402-9527-e321dcf53ea3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:04.109453 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-34d44c2b-1ddd-4402-9527-e321dcf53ea3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1504 microversion: 2.1 time: 0.988983 Oct 18 13:23:04.118452 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 784/1613] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:03 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1504 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:04.131760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d8138da6-bb96-42ec-b543-2f841310f528 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:04.135329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d8138da6-bb96-42ec-b543-2f841310f528 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:04.153862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8138da6-bb96-42ec-b543-2f841310f528 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:04.154665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8138da6-bb96-42ec-b543-2f841310f528 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:04.155300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8138da6-bb96-42ec-b543-2f841310f528 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:04.156417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8138da6-bb96-42ec-b543-2f841310f528 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:04.157059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8138da6-bb96-42ec-b543-2f841310f528 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:04.157689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8138da6-bb96-42ec-b543-2f841310f528 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:04.188239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:04.379946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0615cc02-11c1-4757-b9c0-c2adac7124bb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:04.405231 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0615cc02-11c1-4757-b9c0-c2adac7124bb tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23" status: 200 len: 1526 microversion: 2.1 time: 0.885451 Oct 18 13:23:04.406207 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 830/1614] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:03 2022] GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23 => generated 1526 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:04.422871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac458ee8-3878-4cda-81ef-54e913117664 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:04.423497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ac458ee8-3878-4cda-81ef-54e913117664 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 96d3172e-d216-47ef-a447-ef91d43bba4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:04.459374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac458ee8-3878-4cda-81ef-54e913117664 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:04.464076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac458ee8-3878-4cda-81ef-54e913117664 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:04.464704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac458ee8-3878-4cda-81ef-54e913117664 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:04.465496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac458ee8-3878-4cda-81ef-54e913117664 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:04.465976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac458ee8-3878-4cda-81ef-54e913117664 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:04.483907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac458ee8-3878-4cda-81ef-54e913117664 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:04.533007 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-ac458ee8-3878-4cda-81ef-54e913117664 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] HTTP exception thrown: Instance 96d3172e-d216-47ef-a447-ef91d43bba4f could not be found. Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac458ee8-3878-4cda-81ef-54e913117664 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Request method failure captured: Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f HTTP/1.1 Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdX8yQuJt5IFSJD3aOvsWYs90nenULvdIoLlk8lIBbo-326hbxTW7vKPLz1QBvDHOysWrT6gNCKKiE0GP8iFjFnEy84OU4KRZuY0ARUrcFZRLKBxA1Q3fbVxq3qS8t71wC8kMawkrMDiwJi8jfpLmO3lsiOD6DFHHK_nxe6ut-1w4o Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 3f136eea39d84b04b5410eb0906c113e Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-MigrationsAdminTest-772254388 Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:23:04.534960 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:23:04.536836 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f136eea39d84b04b5410eb0906c113e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f136eea39d84b04b5410eb0906c113e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f136eea39d84b04b5410eb0906c113e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f136eea39d84b04b5410eb0906c113e"}]}] Oct 18 13:23:04.536836 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-MigrationsAdminTest-772254388 Oct 18 13:23:04.536836 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 3f136eea39d84b04b5410eb0906c113e Oct 18 13:23:04.536836 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-MigrationsAdminTest-772254388 Oct 18 13:23:04.536836 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-MigrationsAdminTest-772254388-project Oct 18 13:23:04.536836 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:23:04.536836 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:23:04.536836 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e631235f0d0c400981c97d9edb1ea7fe Oct 18 13:23:04.536836 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-MigrationsAdminTest-772254388-project Oct 18 13:23:04.536836 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:23:04.536836 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 96d3172e-d216-47ef-a447-ef91d43bba4f could not be found. Oct 18 13:23:04.536836 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '96d3172e-d216-47ef-a447-ef91d43bba4f'} Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d3172e-d216-47ef-a447-ef91d43bba4f could not be found. Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:04.537962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d3172e-d216-47ef-a447-ef91d43bba4f could not be found. Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d3172e-d216-47ef-a447-ef91d43bba4f could not be found. Oct 18 13:23:04.539939 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:04.541723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac458ee8-3878-4cda-81ef-54e913117664 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Returning 404 to user: Instance 96d3172e-d216-47ef-a447-ef91d43bba4f could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:04.541723 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ac458ee8-3878-4cda-81ef-54e913117664 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f" status: 404 len: 111 microversion: 2.1 time: 0.117784 Oct 18 13:23:04.541723 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 831/1615] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:04 2022] GET /compute/v2.1/servers/96d3172e-d216-47ef-a447-ef91d43bba4f => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:04.543870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8975a05-b04f-4450-8b11-c44e910b2f1e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:04.544734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8975a05-b04f-4450-8b11-c44e910b2f1e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:04.567977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8975a05-b04f-4450-8b11-c44e910b2f1e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:04.570114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8975a05-b04f-4450-8b11-c44e910b2f1e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:04.575048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8975a05-b04f-4450-8b11-c44e910b2f1e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:04.576320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8975a05-b04f-4450-8b11-c44e910b2f1e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:04.577141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8975a05-b04f-4450-8b11-c44e910b2f1e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:04.577926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8975a05-b04f-4450-8b11-c44e910b2f1e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:04.776902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d8138da6-bb96-42ec-b543-2f841310f528 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:04.801285 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d8138da6-bb96-42ec-b543-2f841310f528 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1315 microversion: 2.1 time: 0.680936 Oct 18 13:23:04.802468 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 785/1616] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:04 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:04.813456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8732b967-412d-41ed-9cc3-a124694e4af3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:04.819324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8732b967-412d-41ed-9cc3-a124694e4af3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:04.852417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8732b967-412d-41ed-9cc3-a124694e4af3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:04.857761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8732b967-412d-41ed-9cc3-a124694e4af3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:04.866581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8732b967-412d-41ed-9cc3-a124694e4af3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:04.867498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8732b967-412d-41ed-9cc3-a124694e4af3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:04.868765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8732b967-412d-41ed-9cc3-a124694e4af3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:04.869337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8732b967-412d-41ed-9cc3-a124694e4af3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:04.941479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b8975a05-b04f-4450-8b11-c44e910b2f1e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:04.956957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8732b967-412d-41ed-9cc3-a124694e4af3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:23:04.959130 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8975a05-b04f-4450-8b11-c44e910b2f1e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1204 microversion: 2.1 time: 0.420203 Oct 18 13:23:04.965373 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 832/1617] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:04 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1204 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:05.121131 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8732b967-412d-41ed-9cc3-a124694e4af3 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 204 len: 0 microversion: 2.1 time: 0.315516 Oct 18 13:23:05.151059 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 786/1618] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:23:04 2022] DELETE /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:23:05.154781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aa346a30-4e12-4369-922e-b448c9e54ef3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:05.156615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aa346a30-4e12-4369-922e-b448c9e54ef3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:05.161321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aa03a5a9-697d-4e52-a186-defd0fa35147 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:05.162042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aa03a5a9-697d-4e52-a186-defd0fa35147 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:05.169952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa346a30-4e12-4369-922e-b448c9e54ef3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:05.171714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa346a30-4e12-4369-922e-b448c9e54ef3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:05.173822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa346a30-4e12-4369-922e-b448c9e54ef3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:05.175430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa346a30-4e12-4369-922e-b448c9e54ef3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:05.176214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa03a5a9-697d-4e52-a186-defd0fa35147 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:05.176621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa346a30-4e12-4369-922e-b448c9e54ef3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:05.176763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa03a5a9-697d-4e52-a186-defd0fa35147 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:05.177569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa346a30-4e12-4369-922e-b448c9e54ef3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:05.178743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa03a5a9-697d-4e52-a186-defd0fa35147 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:05.183059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa03a5a9-697d-4e52-a186-defd0fa35147 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:05.183587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa03a5a9-697d-4e52-a186-defd0fa35147 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:05.185663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa03a5a9-697d-4e52-a186-defd0fa35147 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:06.060052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aa03a5a9-697d-4e52-a186-defd0fa35147 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:06.104527 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aa03a5a9-697d-4e52-a186-defd0fa35147 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1533 microversion: 2.1 time: 0.948264 Oct 18 13:23:06.106246 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 787/1619] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:05 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1533 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:06.124891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-508707a5-ab8d-420c-8cb1-48d8db1e20ab req-57e6bed2-e271-49df-bc90-fbaf050d51bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aad90b5-28fb-44b2-89da-33bc1b2889f2", "name": "network-vif-plugged", "status": "completed", "tag": "516c3ad3-1e31-4bde-b674-c0c367989f56"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:06.146581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-508707a5-ab8d-420c-8cb1-48d8db1e20ab req-57e6bed2-e271-49df-bc90-fbaf050d51bb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:06.147072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-508707a5-ab8d-420c-8cb1-48d8db1e20ab req-57e6bed2-e271-49df-bc90-fbaf050d51bb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:06.147509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-508707a5-ab8d-420c-8cb1-48d8db1e20ab req-57e6bed2-e271-49df-bc90-fbaf050d51bb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:06.194965 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-508707a5-ab8d-420c-8cb1-48d8db1e20ab req-57e6bed2-e271-49df-bc90-fbaf050d51bb service nova] Creating event network-vif-plugged:516c3ad3-1e31-4bde-b674-c0c367989f56 for instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 on n-h1-858384-13 Oct 18 13:23:06.204180 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-508707a5-ab8d-420c-8cb1-48d8db1e20ab req-57e6bed2-e271-49df-bc90-fbaf050d51bb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097030 Oct 18 13:23:06.211287 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 788/1620] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:06.223406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a5309799-0b8d-4995-8f43-9263e3ede25f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:06.224546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a5309799-0b8d-4995-8f43-9263e3ede25f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 1e4740ad-0220-47c0-82a7-3318881b8b23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:06.240003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5309799-0b8d-4995-8f43-9263e3ede25f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:06.245735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5309799-0b8d-4995-8f43-9263e3ede25f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:06.257895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5309799-0b8d-4995-8f43-9263e3ede25f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:06.260821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5309799-0b8d-4995-8f43-9263e3ede25f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:06.262960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5309799-0b8d-4995-8f43-9263e3ede25f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:06.264956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5309799-0b8d-4995-8f43-9263e3ede25f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:06.709074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aa346a30-4e12-4369-922e-b448c9e54ef3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:06.729079 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aa346a30-4e12-4369-922e-b448c9e54ef3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1504 microversion: 2.1 time: 1.583960 Oct 18 13:23:06.737254 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 833/1621] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:05 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1504 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:06.750357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:06.761505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-539e30be-f668-4d3e-830d-68f911c17740 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:06.765770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-539e30be-f668-4d3e-830d-68f911c17740 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:06.792196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:06.821315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-539e30be-f668-4d3e-830d-68f911c17740 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:06.822000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-539e30be-f668-4d3e-830d-68f911c17740 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:06.829066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-539e30be-f668-4d3e-830d-68f911c17740 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:06.833778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-539e30be-f668-4d3e-830d-68f911c17740 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:06.834781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-539e30be-f668-4d3e-830d-68f911c17740 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:06.841022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-539e30be-f668-4d3e-830d-68f911c17740 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:06.994828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a5309799-0b8d-4995-8f43-9263e3ede25f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eeec944a5054ba9b7cd6ae3055230e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e6b0adc07474caa392caa39c0e963', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:07.009683 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a5309799-0b8d-4995-8f43-9263e3ede25f tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23" status: 200 len: 1484 microversion: 2.1 time: 0.796774 Oct 18 13:23:07.015515 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 789/1622] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:06 2022] GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23 => generated 1484 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:07.034727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-3697d9d2-c042-46aa-810f-d6b9b10a6349 req-393bc335-efd7-49f4-b79d-eeb82364f243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f29db8-d1db-4c86-b2a2-aa699fa80532", "name": "network-vif-unplugged", "status": "completed", "tag": "a6e78562-1d84-4cfc-b01a-bfe734a39542"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:07.065799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3697d9d2-c042-46aa-810f-d6b9b10a6349 req-393bc335-efd7-49f4-b79d-eeb82364f243 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:07.066384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3697d9d2-c042-46aa-810f-d6b9b10a6349 req-393bc335-efd7-49f4-b79d-eeb82364f243 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:07.066942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3697d9d2-c042-46aa-810f-d6b9b10a6349 req-393bc335-efd7-49f4-b79d-eeb82364f243 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:07.097743 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-3697d9d2-c042-46aa-810f-d6b9b10a6349 req-393bc335-efd7-49f4-b79d-eeb82364f243 service nova] Creating event network-vif-unplugged:a6e78562-1d84-4cfc-b01a-bfe734a39542 for instance 80f29db8-d1db-4c86-b2a2-aa699fa80532 on n-h1-858384-13 Oct 18 13:23:07.106061 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-3697d9d2-c042-46aa-810f-d6b9b10a6349 req-393bc335-efd7-49f4-b79d-eeb82364f243 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085873 Oct 18 13:23:07.108363 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 790/1623] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:07.120113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-88ce0d84-877a-4a17-8ae3-39edb4011a97 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:07.125297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-88ce0d84-877a-4a17-8ae3-39edb4011a97 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:07.152481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88ce0d84-877a-4a17-8ae3-39edb4011a97 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:07.153776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88ce0d84-877a-4a17-8ae3-39edb4011a97 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:07.156289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88ce0d84-877a-4a17-8ae3-39edb4011a97 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:07.158871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88ce0d84-877a-4a17-8ae3-39edb4011a97 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:07.159357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88ce0d84-877a-4a17-8ae3-39edb4011a97 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:07.159891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88ce0d84-877a-4a17-8ae3-39edb4011a97 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:07.753620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-88ce0d84-877a-4a17-8ae3-39edb4011a97 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:07.779317 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-88ce0d84-877a-4a17-8ae3-39edb4011a97 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1266 microversion: 2.1 time: 0.666372 Oct 18 13:23:07.780582 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 791/1624] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:07 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1266 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:07.785511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-75213ebc-f897-4752-9dd8-f70daa902831 req-38ab7756-0afe-425d-a5f7-e757dbf2fdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4740ad-0220-47c0-82a7-3318881b8b23", "name": "network-vif-deleted", "tag": "1dc75b63-7884-4f8a-adbb-daa672d25a3f"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:07.813064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-75213ebc-f897-4752-9dd8-f70daa902831 req-38ab7756-0afe-425d-a5f7-e757dbf2fdf0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:07.813869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-75213ebc-f897-4752-9dd8-f70daa902831 req-38ab7756-0afe-425d-a5f7-e757dbf2fdf0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:07.814717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-75213ebc-f897-4752-9dd8-f70daa902831 req-38ab7756-0afe-425d-a5f7-e757dbf2fdf0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:07.847451 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-75213ebc-f897-4752-9dd8-f70daa902831 req-38ab7756-0afe-425d-a5f7-e757dbf2fdf0 service nova] Creating event network-vif-deleted:1dc75b63-7884-4f8a-adbb-daa672d25a3f for instance 1e4740ad-0220-47c0-82a7-3318881b8b23 on n-h2-858384-13 Oct 18 13:23:07.859474 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-75213ebc-f897-4752-9dd8-f70daa902831 req-38ab7756-0afe-425d-a5f7-e757dbf2fdf0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077389 Oct 18 13:23:07.865847 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 792/1625] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:07.881033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ff99849e-531b-4301-9bb0-99d95e7e3f71 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:07.883885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ff99849e-531b-4301-9bb0-99d95e7e3f71 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:07.898221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff99849e-531b-4301-9bb0-99d95e7e3f71 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:07.904547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff99849e-531b-4301-9bb0-99d95e7e3f71 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:07.905338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff99849e-531b-4301-9bb0-99d95e7e3f71 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:07.906440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff99849e-531b-4301-9bb0-99d95e7e3f71 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:07.907235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff99849e-531b-4301-9bb0-99d95e7e3f71 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:07.907939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff99849e-531b-4301-9bb0-99d95e7e3f71 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:08.172904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-539e30be-f668-4d3e-830d-68f911c17740 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:08.184115 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-539e30be-f668-4d3e-830d-68f911c17740 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1315 microversion: 2.1 time: 1.443458 Oct 18 13:23:08.188252 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 834/1626] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:06 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1315 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:08.205997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2bd62e80-526c-4c7c-8e17-c359b6faac49 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:08.207275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2bd62e80-526c-4c7c-8e17-c359b6faac49 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:08.220211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bd62e80-526c-4c7c-8e17-c359b6faac49 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:08.223308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bd62e80-526c-4c7c-8e17-c359b6faac49 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:08.224090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bd62e80-526c-4c7c-8e17-c359b6faac49 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:08.225502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bd62e80-526c-4c7c-8e17-c359b6faac49 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:08.227895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bd62e80-526c-4c7c-8e17-c359b6faac49 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:08.233630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bd62e80-526c-4c7c-8e17-c359b6faac49 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:08.406714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ff99849e-531b-4301-9bb0-99d95e7e3f71 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:08.427671 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ff99849e-531b-4301-9bb0-99d95e7e3f71 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1491 microversion: 2.1 time: 0.556777 Oct 18 13:23:08.428706 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 793/1627] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:07 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1491 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:08.464991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-25a71e02-3b70-4d3c-b912-bfc51df24439 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:08.465937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-25a71e02-3b70-4d3c-b912-bfc51df24439 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 1e4740ad-0220-47c0-82a7-3318881b8b23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:08.480319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25a71e02-3b70-4d3c-b912-bfc51df24439 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:08.482054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25a71e02-3b70-4d3c-b912-bfc51df24439 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:08.482931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25a71e02-3b70-4d3c-b912-bfc51df24439 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:08.483839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25a71e02-3b70-4d3c-b912-bfc51df24439 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:08.484485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25a71e02-3b70-4d3c-b912-bfc51df24439 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:08.485087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25a71e02-3b70-4d3c-b912-bfc51df24439 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:08.509462 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-25a71e02-3b70-4d3c-b912-bfc51df24439 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] HTTP exception thrown: Instance 1e4740ad-0220-47c0-82a7-3318881b8b23 could not be found. Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-25a71e02-3b70-4d3c-b912-bfc51df24439 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23 HTTP/1.1 Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:23:08.511478 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:23:08.513323 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:23:08.513323 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:08.513323 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:08.513323 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:08.513323 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:08.513323 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:23:08.513323 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:23:08.513323 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:23:08.513323 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:08.513323 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:23:08.513323 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 1e4740ad-0220-47c0-82a7-3318881b8b23 could not be found. Oct 18 13:23:08.513323 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '1e4740ad-0220-47c0-82a7-3318881b8b23'} Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e4740ad-0220-47c0-82a7-3318881b8b23 could not be found. Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:08.514537 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e4740ad-0220-47c0-82a7-3318881b8b23 could not be found. Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e4740ad-0220-47c0-82a7-3318881b8b23 could not be found. Oct 18 13:23:08.516976 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.521382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-25a71e02-3b70-4d3c-b912-bfc51df24439 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 404 to user: Instance 1e4740ad-0220-47c0-82a7-3318881b8b23 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:08.522562 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-25a71e02-3b70-4d3c-b912-bfc51df24439 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23" status: 404 len: 111 microversion: 2.1 time: 0.067489 Oct 18 13:23:08.527352 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 794/1628] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:08 2022] GET /compute/v2.1/servers/1e4740ad-0220-47c0-82a7-3318881b8b23 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:08.532651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb99fd3e-c642-4e0d-8ce6-afded4140a0a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '.version_select at 0x7ff60f89a040>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:08.594160 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-fb99fd3e-c642-4e0d-8ce6-afded4140a0a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] HTTP exception thrown: Image not found. Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb99fd3e-c642-4e0d-8ce6-afded4140a0a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/images/f2c90986-2d5d-493a-aaf9-cbc66c777099 HTTP/1.1 Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:23:08.596238 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:23:08.598015 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:23:08.598015 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:08.598015 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:08.598015 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:08.598015 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:08.598015 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:23:08.598015 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:23:08.598015 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:23:08.598015 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:08.598015 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:23:08.598015 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:23:08.598015 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'f2c90986-2d5d-493a-aaf9-cbc66c777099'} Oct 18 13:23:08.598015 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f2c90986-2d5d-493a-aaf9-cbc66c777099 to delete Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:08.599067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f2c90986-2d5d-493a-aaf9-cbc66c777099 could not be found. Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:08.600618 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.602325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb99fd3e-c642-4e0d-8ce6-afded4140a0a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:08.603852 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb99fd3e-c642-4e0d-8ce6-afded4140a0a tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "DELETE /compute/v2.1/images/f2c90986-2d5d-493a-aaf9-cbc66c777099" status: 404 len: 62 microversion: 2.1 time: 0.073105 Oct 18 13:23:08.607710 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 795/1629] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:08 2022] DELETE /compute/v2.1/images/f2c90986-2d5d-493a-aaf9-cbc66c777099 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:23:08.616993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2fa9c420-3f81-411d-9323-7c925c9d8d19 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:08.618580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2fa9c420-3f81-411d-9323-7c925c9d8d19 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:08.663298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fa9c420-3f81-411d-9323-7c925c9d8d19 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:08.668507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fa9c420-3f81-411d-9323-7c925c9d8d19 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:08.672742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fa9c420-3f81-411d-9323-7c925c9d8d19 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:08.673869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fa9c420-3f81-411d-9323-7c925c9d8d19 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:08.674566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fa9c420-3f81-411d-9323-7c925c9d8d19 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:08.675512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fa9c420-3f81-411d-9323-7c925c9d8d19 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:08.752342 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-2fa9c420-3f81-411d-9323-7c925c9d8d19 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] HTTP exception thrown: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2fa9c420-3f81-411d-9323-7c925c9d8d19 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d HTTP/1.1 Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:23:08.765283 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:23:08.766815 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:23:08.766815 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:08.766815 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:08.766815 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:08.766815 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:08.766815 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:23:08.766815 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:23:08.766815 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:23:08.766815 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:08.766815 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:23:08.766815 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:23:08.766815 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '01a0d527-5f2f-4c84-a99f-d22d143edb5d'} Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:08.767640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:23:08.769550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.770897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2fa9c420-3f81-411d-9323-7c925c9d8d19 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 404 to user: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:08.770897 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2fa9c420-3f81-411d-9323-7c925c9d8d19 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 404 len: 111 microversion: 2.1 time: 0.159408 Oct 18 13:23:08.774039 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 796/1630] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:23:08 2022] DELETE /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:08.800477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a2be1811-70a9-4706-aad0-908bbc8daac7 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:08.804602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a2be1811-70a9-4706-aad0-908bbc8daac7 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 01a0d527-5f2f-4c84-a99f-d22d143edb5d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:08.824302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2be1811-70a9-4706-aad0-908bbc8daac7 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:08.825078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2be1811-70a9-4706-aad0-908bbc8daac7 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:08.825906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2be1811-70a9-4706-aad0-908bbc8daac7 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:08.826935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2be1811-70a9-4706-aad0-908bbc8daac7 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:08.828534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2be1811-70a9-4706-aad0-908bbc8daac7 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:08.829162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2be1811-70a9-4706-aad0-908bbc8daac7 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:08.871788 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-a2be1811-70a9-4706-aad0-908bbc8daac7 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] HTTP exception thrown: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a2be1811-70a9-4706-aad0-908bbc8daac7 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d HTTP/1.1 Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:23:08.880372 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:23:08.882271 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:23:08.882271 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:08.882271 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:08.882271 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:08.882271 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:08.882271 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:23:08.882271 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:23:08.882271 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:23:08.882271 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:08.882271 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:23:08.882271 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:23:08.882271 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '01a0d527-5f2f-4c84-a99f-d22d143edb5d'} Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:08.883155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. Oct 18 13:23:08.884790 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:08.891012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a2be1811-70a9-4706-aad0-908bbc8daac7 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 404 to user: Instance 01a0d527-5f2f-4c84-a99f-d22d143edb5d could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:08.892770 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a2be1811-70a9-4706-aad0-908bbc8daac7 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d" status: 404 len: 111 microversion: 2.1 time: 0.117573 Oct 18 13:23:08.901427 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 797/1631] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:08 2022] GET /compute/v2.1/servers/01a0d527-5f2f-4c84-a99f-d22d143edb5d => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:08.917949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-07368ef9-96ed-49f7-9432-21fce6f85f84 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:08.918600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-07368ef9-96ed-49f7-9432-21fce6f85f84 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:08.939346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07368ef9-96ed-49f7-9432-21fce6f85f84 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:08.939893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07368ef9-96ed-49f7-9432-21fce6f85f84 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:08.942264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07368ef9-96ed-49f7-9432-21fce6f85f84 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:08.944263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07368ef9-96ed-49f7-9432-21fce6f85f84 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:08.945674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07368ef9-96ed-49f7-9432-21fce6f85f84 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:08.946151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07368ef9-96ed-49f7-9432-21fce6f85f84 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:09.106583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2bd62e80-526c-4c7c-8e17-c359b6faac49 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:09.117869 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2bd62e80-526c-4c7c-8e17-c359b6faac49 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1504 microversion: 2.1 time: 0.925518 Oct 18 13:23:09.140588 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 835/1632] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:08 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1504 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:09.158929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-92412240-88a7-488d-a406-6f5e2945eb63 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '.version_select at 0x7ff617ba8ca0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:09.211042 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-92412240-88a7-488d-a406-6f5e2945eb63 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1935182285" status: 202 len: 0 microversion: 2.1 time: 0.069718 Oct 18 13:23:09.215396 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 836/1633] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:23:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1935182285 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:23:09.221782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-4ab1946a-1f86-4d6d-bb9e-8c67a396726d req-b5e50002-50bf-4310-96fb-5499c33f59f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3683577-0991-4e03-b8c5-b3519335935c", "name": "network-vif-deleted", "tag": "9f0071a2-f26a-4b60-9753-c1efc5a5abd8"}, {"name": "network-changed", "server_uuid": "80f29db8-d1db-4c86-b2a2-aa699fa80532", "tag": "a6e78562-1d84-4cfc-b01a-bfe734a39542"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:09.254294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4ab1946a-1f86-4d6d-bb9e-8c67a396726d req-b5e50002-50bf-4310-96fb-5499c33f59f9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:09.255271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4ab1946a-1f86-4d6d-bb9e-8c67a396726d req-b5e50002-50bf-4310-96fb-5499c33f59f9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:09.259737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4ab1946a-1f86-4d6d-bb9e-8c67a396726d req-b5e50002-50bf-4310-96fb-5499c33f59f9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:09.279182 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-4ab1946a-1f86-4d6d-bb9e-8c67a396726d req-b5e50002-50bf-4310-96fb-5499c33f59f9 service nova] Creating event network-vif-deleted:9f0071a2-f26a-4b60-9753-c1efc5a5abd8 for instance c3683577-0991-4e03-b8c5-b3519335935c on n-h1-858384-13 Oct 18 13:23:09.279719 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-4ab1946a-1f86-4d6d-bb9e-8c67a396726d req-b5e50002-50bf-4310-96fb-5499c33f59f9 service nova] Creating event network-changed:a6e78562-1d84-4cfc-b01a-bfe734a39542 for instance 80f29db8-d1db-4c86-b2a2-aa699fa80532 on n-h1-858384-13 Oct 18 13:23:09.286748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-07368ef9-96ed-49f7-9432-21fce6f85f84 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:09.288199 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-4ab1946a-1f86-4d6d-bb9e-8c67a396726d req-b5e50002-50bf-4310-96fb-5499c33f59f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.072754 Oct 18 13:23:09.289842 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 837/1634] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:09.297035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b805d51a-bdae-4d5b-86e4-7efee9799236 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:09.297992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b805d51a-bdae-4d5b-86e4-7efee9799236 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:09.303756 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-07368ef9-96ed-49f7-9432-21fce6f85f84 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1266 microversion: 2.1 time: 0.396124 Oct 18 13:23:09.304421 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 798/1635] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:08 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1266 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:09.311698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b805d51a-bdae-4d5b-86e4-7efee9799236 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:09.311698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b805d51a-bdae-4d5b-86e4-7efee9799236 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:09.311698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b805d51a-bdae-4d5b-86e4-7efee9799236 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:09.312102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b805d51a-bdae-4d5b-86e4-7efee9799236 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:09.312417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b805d51a-bdae-4d5b-86e4-7efee9799236 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:09.313048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b805d51a-bdae-4d5b-86e4-7efee9799236 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:09.352658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1941322819", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4367ae6a-74b6-4e77-aafe-63e7fdd7f6d6"}], "block_device_mapping_v2": [{"uuid": "2d19b70c-43b0-48d5-a971-f644c8a061c1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:09.495219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] validate_networks() for [('4367ae6a-74b6-4e77-aafe-63e7fdd7f6d6', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:23:09.890544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b805d51a-bdae-4d5b-86e4-7efee9799236 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:09.903460 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b805d51a-bdae-4d5b-86e4-7efee9799236 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1315 microversion: 2.1 time: 0.611844 Oct 18 13:23:09.906054 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 838/1636] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:09 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:09.917143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:09.918562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:09.936656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:09.938308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:09.938964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:09.939868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:09.941784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:09.943369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:09.997207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:09.997777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:09.998430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:09.999079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lazy-loading 'fault' on Instance uuid 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:23:10.171796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:10.184373 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-46fe7131-b904-4f6a-8091-b1d01ced53d8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 200 len: 1368 microversion: 2.1 time: 0.276071 Oct 18 13:23:10.188543 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 839/1637] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:09 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 1368 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:10.195793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-0376214a-9d9b-44e4-a15b-f3668e655546 req-c029db98-c763-4f32-a3f8-6c16894bd7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee65c386-9550-4e41-99e6-509acdb08f70", "tag": "f3489cc2-3514-4522-82e3-8e3dc059f392"}, {"server_uuid": "5ea85e7d-02ff-4fc3-bc01-720e7de9de87", "name": "network-vif-deleted", "tag": "d3e28fd2-a20a-403c-adde-3da5ff496840"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:10.219236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0376214a-9d9b-44e4-a15b-f3668e655546 req-c029db98-c763-4f32-a3f8-6c16894bd7b9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:10.220945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0376214a-9d9b-44e4-a15b-f3668e655546 req-c029db98-c763-4f32-a3f8-6c16894bd7b9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:10.223602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0376214a-9d9b-44e4-a15b-f3668e655546 req-c029db98-c763-4f32-a3f8-6c16894bd7b9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:10.268523 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-0376214a-9d9b-44e4-a15b-f3668e655546 req-c029db98-c763-4f32-a3f8-6c16894bd7b9 service nova] Creating event network-changed:f3489cc2-3514-4522-82e3-8e3dc059f392 for instance ee65c386-9550-4e41-99e6-509acdb08f70 on n-h2-858384-13 Oct 18 13:23:10.275382 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-0376214a-9d9b-44e4-a15b-f3668e655546 req-c029db98-c763-4f32-a3f8-6c16894bd7b9 service nova] Creating event network-vif-deleted:d3e28fd2-a20a-403c-adde-3da5ff496840 for instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 on n-h2-858384-13 Oct 18 13:23:10.291725 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-0376214a-9d9b-44e4-a15b-f3668e655546 req-c029db98-c763-4f32-a3f8-6c16894bd7b9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.101623 Oct 18 13:23:10.296963 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 840/1638] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:10.338072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-03b2e466-3cc4-4804-8c04-0d8762aadda7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:10.341625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-03b2e466-3cc4-4804-8c04-0d8762aadda7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:10.370919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03b2e466-3cc4-4804-8c04-0d8762aadda7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:10.372467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03b2e466-3cc4-4804-8c04-0d8762aadda7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:10.385690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03b2e466-3cc4-4804-8c04-0d8762aadda7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:10.387699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03b2e466-3cc4-4804-8c04-0d8762aadda7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:10.388826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03b2e466-3cc4-4804-8c04-0d8762aadda7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:10.389999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03b2e466-3cc4-4804-8c04-0d8762aadda7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:10.416703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:23:10.417295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:23:10.418129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:23:10.418645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:23:10.419751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:23:10.442747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:10.443283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:10.443698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:10.444690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:10.446835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:10.449855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:10.496890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Getting quotas for project e559a35e21d343adab5f772a17b745f9. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:23:10.505577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Getting quotas for user 1bfaa3d005f94cf2a5bdf8e63d20ba3f and project e559a35e21d343adab5f772a17b745f9. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:23:10.636904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:23:10.639451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d19b70c-43b0-48d5-a971-f644c8a061c1',volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:23:10.705784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-03b2e466-3cc4-4804-8c04-0d8762aadda7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:10.763480 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-03b2e466-3cc4-4804-8c04-0d8762aadda7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1504 microversion: 2.1 time: 0.461505 Oct 18 13:23:10.766535 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 841/1639] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:10 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:10.815814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a9f792e1-e504-4907-86bc-0ba395d0c106 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:10.816445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a9f792e1-e504-4907-86bc-0ba395d0c106 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:10.854483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:10.856121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9f792e1-e504-4907-86bc-0ba395d0c106 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:10.856608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9f792e1-e504-4907-86bc-0ba395d0c106 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:10.857453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9f792e1-e504-4907-86bc-0ba395d0c106 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:10.858176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9f792e1-e504-4907-86bc-0ba395d0c106 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:10.858633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9f792e1-e504-4907-86bc-0ba395d0c106 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:10.859058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9f792e1-e504-4907-86bc-0ba395d0c106 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:10.914526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:10.974046 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a3defb26-791e-4cef-9fc2-f67ce301b053 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.647104 Oct 18 13:23:10.974723 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 799/1640] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:23:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:23:11.002458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d9553299-f09c-4cc6-95b5-c37717d88585 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:11.003203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d9553299-f09c-4cc6-95b5-c37717d88585 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:11.028818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9553299-f09c-4cc6-95b5-c37717d88585 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:11.029403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9553299-f09c-4cc6-95b5-c37717d88585 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:11.030370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9553299-f09c-4cc6-95b5-c37717d88585 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:11.032191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9553299-f09c-4cc6-95b5-c37717d88585 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:11.035848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9553299-f09c-4cc6-95b5-c37717d88585 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:11.036586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9553299-f09c-4cc6-95b5-c37717d88585 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:11.538910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a9f792e1-e504-4907-86bc-0ba395d0c106 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:11.552920 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a9f792e1-e504-4907-86bc-0ba395d0c106 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1308 microversion: 2.1 time: 0.761335 Oct 18 13:23:11.558272 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 842/1641] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:10 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1308 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:11.570961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e0715ca8-30da-457d-916f-8d69d30a5836 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:11.572014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e0715ca8-30da-457d-916f-8d69d30a5836 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:11.582736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d9553299-f09c-4cc6-95b5-c37717d88585 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:11.598082 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d9553299-f09c-4cc6-95b5-c37717d88585 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1315 microversion: 2.1 time: 0.622210 Oct 18 13:23:11.598694 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 800/1642] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:10 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:11.615684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-29e63f5c-d3d6-4595-9e4c-f08c39e6cae1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:11.616614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-29e63f5c-d3d6-4595-9e4c-f08c39e6cae1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 5ea85e7d-02ff-4fc3-bc01-720e7de9de87] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:11.630429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29e63f5c-d3d6-4595-9e4c-f08c39e6cae1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:11.631239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29e63f5c-d3d6-4595-9e4c-f08c39e6cae1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:11.631878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29e63f5c-d3d6-4595-9e4c-f08c39e6cae1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:11.634041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29e63f5c-d3d6-4595-9e4c-f08c39e6cae1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:11.635392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29e63f5c-d3d6-4595-9e4c-f08c39e6cae1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:11.637239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29e63f5c-d3d6-4595-9e4c-f08c39e6cae1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:11.677470 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-29e63f5c-d3d6-4595-9e4c-f08c39e6cae1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] HTTP exception thrown: Instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 could not be found. Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-29e63f5c-d3d6-4595-9e4c-f08c39e6cae1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Request method failure captured: Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 HTTP/1.1 Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdX8yQuJt5IFSJD3aOvsWYs90nenULvdIoLlk8lIBbo-326hbxTW7vKPLz1QBvDHOysWrT6gNCKKiE0GP8iFjFnEy84OU4KRZuY0ARUrcFZRLKBxA1Q3fbVxq3qS8t71wC8kMawkrMDiwJi8jfpLmO3lsiOD6DFHHK_nxe6ut-1w4o Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 3f136eea39d84b04b5410eb0906c113e Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-MigrationsAdminTest-772254388 Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:23:11.679429 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:23:11.681613 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f136eea39d84b04b5410eb0906c113e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f136eea39d84b04b5410eb0906c113e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f136eea39d84b04b5410eb0906c113e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f136eea39d84b04b5410eb0906c113e"}]}] Oct 18 13:23:11.681613 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-MigrationsAdminTest-772254388 Oct 18 13:23:11.681613 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 3f136eea39d84b04b5410eb0906c113e Oct 18 13:23:11.681613 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-MigrationsAdminTest-772254388 Oct 18 13:23:11.681613 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-MigrationsAdminTest-772254388-project Oct 18 13:23:11.681613 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:23:11.681613 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:23:11.681613 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e631235f0d0c400981c97d9edb1ea7fe Oct 18 13:23:11.681613 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-MigrationsAdminTest-772254388-project Oct 18 13:23:11.681613 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:23:11.681613 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 could not be found. Oct 18 13:23:11.681613 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '5ea85e7d-02ff-4fc3-bc01-720e7de9de87'} Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 could not be found. Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:11.682530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 could not be found. Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 could not be found. Oct 18 13:23:11.684155 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:11.692265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-29e63f5c-d3d6-4595-9e4c-f08c39e6cae1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Returning 404 to user: Instance 5ea85e7d-02ff-4fc3-bc01-720e7de9de87 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:11.693602 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-29e63f5c-d3d6-4595-9e4c-f08c39e6cae1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87" status: 404 len: 111 microversion: 2.1 time: 0.081896 Oct 18 13:23:11.694479 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 801/1643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:11 2022] GET /compute/v2.1/servers/5ea85e7d-02ff-4fc3-bc01-720e7de9de87 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:11.707039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe703ebc-8df8-42e6-9049-4ebeae1569ff tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '.version_select at 0x7ff60f801820>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:11.754712 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fe703ebc-8df8-42e6-9049-4ebeae1569ff tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-850283987" status: 202 len: 0 microversion: 2.1 time: 0.054102 Oct 18 13:23:11.755977 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 802/1644] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 18 13:23:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-850283987 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:23:11.793465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2d15fc12-d37d-4a58-8670-8a43c7eb2a9a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:11.795074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2d15fc12-d37d-4a58-8670-8a43c7eb2a9a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:11.809137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d15fc12-d37d-4a58-8670-8a43c7eb2a9a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:11.812370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d15fc12-d37d-4a58-8670-8a43c7eb2a9a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:11.814427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d15fc12-d37d-4a58-8670-8a43c7eb2a9a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:11.815605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d15fc12-d37d-4a58-8670-8a43c7eb2a9a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:11.818223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d15fc12-d37d-4a58-8670-8a43c7eb2a9a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:11.819450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d15fc12-d37d-4a58-8670-8a43c7eb2a9a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:12.034563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e0715ca8-30da-457d-916f-8d69d30a5836 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:12.050163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e0715ca8-30da-457d-916f-8d69d30a5836 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:12.058030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e0715ca8-30da-457d-916f-8d69d30a5836 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:12.065349 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e0715ca8-30da-457d-916f-8d69d30a5836 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1104 microversion: 2.25 time: 0.500123 Oct 18 13:23:12.067483 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 843/1645] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:11 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1104 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:12.310098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2d15fc12-d37d-4a58-8670-8a43c7eb2a9a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:12.324232 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2d15fc12-d37d-4a58-8670-8a43c7eb2a9a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1504 microversion: 2.1 time: 0.535393 Oct 18 13:23:12.325204 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 803/1646] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:11 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1504 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:12.579947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9a54d78f-ecd5-4dfd-ad0c-af56751a25e4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:12.580545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9a54d78f-ecd5-4dfd-ad0c-af56751a25e4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:12.596346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a54d78f-ecd5-4dfd-ad0c-af56751a25e4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:12.596838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a54d78f-ecd5-4dfd-ad0c-af56751a25e4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:12.597302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a54d78f-ecd5-4dfd-ad0c-af56751a25e4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:12.598246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a54d78f-ecd5-4dfd-ad0c-af56751a25e4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:12.599064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a54d78f-ecd5-4dfd-ad0c-af56751a25e4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:12.599655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a54d78f-ecd5-4dfd-ad0c-af56751a25e4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:12.647000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-518693a6-e55e-4128-91bb-0f9ea96df2b1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:12.648021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-518693a6-e55e-4128-91bb-0f9ea96df2b1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:12.663354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-518693a6-e55e-4128-91bb-0f9ea96df2b1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:12.665190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-518693a6-e55e-4128-91bb-0f9ea96df2b1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:12.667390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-518693a6-e55e-4128-91bb-0f9ea96df2b1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:12.670560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-518693a6-e55e-4128-91bb-0f9ea96df2b1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:12.671501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-518693a6-e55e-4128-91bb-0f9ea96df2b1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:12.672222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-518693a6-e55e-4128-91bb-0f9ea96df2b1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:12.876822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:13.016151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9a54d78f-ecd5-4dfd-ad0c-af56751a25e4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:13.032928 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9a54d78f-ecd5-4dfd-ad0c-af56751a25e4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1308 microversion: 2.1 time: 0.453445 Oct 18 13:23:13.041066 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 844/1647] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:12 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:13.052763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-538ab146-e315-4d47-8bee-4e65e281e7f6 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '.version_select at 0x7ff60fcc3f70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:13.104621 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-538ab146-e315-4d47-8bee-4e65e281e7f6 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] HTTP exception thrown: Image not found. Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-538ab146-e315-4d47-8bee-4e65e281e7f6 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/images/897eb6f6-557d-4bed-9045-65ba9d72bbed HTTP/1.1 Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:23:13.132034 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:23:13.133958 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:23:13.133958 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:13.133958 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:13.133958 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:13.133958 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:13.133958 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:23:13.133958 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:23:13.133958 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:23:13.133958 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:13.133958 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:23:13.133958 n-d-858384-13 devstack@n-api.service[120611]: exception: Image not found. Oct 18 13:23:13.133958 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '897eb6f6-557d-4bed-9045-65ba9d72bbed'} Oct 18 13:23:13.133958 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 897eb6f6-557d-4bed-9045-65ba9d72bbed to delete Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:13.134981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 897eb6f6-557d-4bed-9045-65ba9d72bbed could not be found. Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:13.136366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-538ab146-e315-4d47-8bee-4e65e281e7f6 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 404 to user: Image not found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:13.137833 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-538ab146-e315-4d47-8bee-4e65e281e7f6 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "DELETE /compute/v2.1/images/897eb6f6-557d-4bed-9045-65ba9d72bbed" status: 404 len: 62 microversion: 2.1 time: 0.090742 Oct 18 13:23:13.145096 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 845/1648] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:13 2022] DELETE /compute/v2.1/images/897eb6f6-557d-4bed-9045-65ba9d72bbed => generated 62 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:23:13.161260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c95c527b-a501-4005-a4e5-a6f439e1eda1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:13.165283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c95c527b-a501-4005-a4e5-a6f439e1eda1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:13.189513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c95c527b-a501-4005-a4e5-a6f439e1eda1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:13.191648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c95c527b-a501-4005-a4e5-a6f439e1eda1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:13.192931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c95c527b-a501-4005-a4e5-a6f439e1eda1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:13.195060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c95c527b-a501-4005-a4e5-a6f439e1eda1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:13.196259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c95c527b-a501-4005-a4e5-a6f439e1eda1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:13.198194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c95c527b-a501-4005-a4e5-a6f439e1eda1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:13.346638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c95c527b-a501-4005-a4e5-a6f439e1eda1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:13.367448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c95c527b-a501-4005-a4e5-a6f439e1eda1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:13.371052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c95c527b-a501-4005-a4e5-a6f439e1eda1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:13.374524 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c95c527b-a501-4005-a4e5-a6f439e1eda1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1233 microversion: 2.25 time: 0.227538 Oct 18 13:23:13.378600 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 846/1649] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:13 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1233 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:13.389892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c8408d7-0886-41bb-9784-f04e7890e387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:13.395775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2c8408d7-0886-41bb-9784-f04e7890e387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:13.410026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c8408d7-0886-41bb-9784-f04e7890e387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:13.410542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c8408d7-0886-41bb-9784-f04e7890e387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:13.414274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c8408d7-0886-41bb-9784-f04e7890e387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:13.415505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c8408d7-0886-41bb-9784-f04e7890e387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:13.419021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c8408d7-0886-41bb-9784-f04e7890e387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:13.420085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c8408d7-0886-41bb-9784-f04e7890e387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:13.456171 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-2c8408d7-0886-41bb-9784-f04e7890e387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] HTTP exception thrown: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c8408d7-0886-41bb-9784-f04e7890e387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 HTTP/1.1 Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:23:13.460115 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:23:13.462247 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:23:13.462247 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:13.462247 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:13.462247 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:13.462247 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:13.462247 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:23:13.462247 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:23:13.462247 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:23:13.462247 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:13.462247 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:23:13.462247 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:23:13.462247 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '8dfa9249-2680-4175-8114-fc18cdb0c117'} Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:13.463076 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:23:13.464454 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.465991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c8408d7-0886-41bb-9784-f04e7890e387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 404 to user: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:13.465991 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2c8408d7-0886-41bb-9784-f04e7890e387 tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 404 len: 111 microversion: 2.1 time: 0.082511 Oct 18 13:23:13.465991 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 847/1650] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:23:13 2022] DELETE /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:13.475702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a431350f-c11e-4c4c-b6f2-5dbf3070c0a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:13.476830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a431350f-c11e-4c4c-b6f2-5dbf3070c0a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:13.522849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a431350f-c11e-4c4c-b6f2-5dbf3070c0a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:13.526004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a431350f-c11e-4c4c-b6f2-5dbf3070c0a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:13.530611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a431350f-c11e-4c4c-b6f2-5dbf3070c0a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:13.534447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a431350f-c11e-4c4c-b6f2-5dbf3070c0a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:13.535135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a431350f-c11e-4c4c-b6f2-5dbf3070c0a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:13.536264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a431350f-c11e-4c4c-b6f2-5dbf3070c0a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:13.641389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-518693a6-e55e-4128-91bb-0f9ea96df2b1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:13.704802 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-518693a6-e55e-4128-91bb-0f9ea96df2b1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1315 microversion: 2.1 time: 1.064164 Oct 18 13:23:13.705620 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 804/1651] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:12 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1315 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:13.721750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-46052079-dfab-4b60-9894-8980125cd5bc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:13.722543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-46052079-dfab-4b60-9894-8980125cd5bc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] [instance: 8dfa9249-2680-4175-8114-fc18cdb0c117] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:13.735308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46052079-dfab-4b60-9894-8980125cd5bc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:13.736935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46052079-dfab-4b60-9894-8980125cd5bc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:13.738215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46052079-dfab-4b60-9894-8980125cd5bc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:13.739362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46052079-dfab-4b60-9894-8980125cd5bc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:13.740062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46052079-dfab-4b60-9894-8980125cd5bc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:13.740738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46052079-dfab-4b60-9894-8980125cd5bc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:13.762663 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-46052079-dfab-4b60-9894-8980125cd5bc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] HTTP exception thrown: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-46052079-dfab-4b60-9894-8980125cd5bc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Request method failure captured: Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 HTTP/1.1 Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqg8s0a5tC1RN0PxVa-aeZMnKDhhGMmCBvOcJzoiBV2wPBfvx46tw4zrpxX8dDPrO-76_yUOk8ceyaD1W21wcsKwSdpY1_SPF1HCALFax3GWG51jhygxZnsNQs0M1HutH66AUAO0Oa64gfEvBnjPnAaaipEvn7AYrYBgshYtWjXJq8g Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:23:13.764538 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:23:13.766903 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/754e6b0adc07474caa392caa39c0e963"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_754e6b0adc07474caa392caa39c0e963"}]}] Oct 18 13:23:13.766903 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:13.766903 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 754e6b0adc07474caa392caa39c0e963 Oct 18 13:23:13.766903 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478 Oct 18 13:23:13.766903 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:13.766903 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:23:13.766903 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:23:13.766903 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 0eeec944a5054ba9b7cd6ae3055230e7 Oct 18 13:23:13.766903 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2106316478-project Oct 18 13:23:13.766903 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:23:13.766903 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:23:13.766903 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '8dfa9249-2680-4175-8114-fc18cdb0c117'} Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:13.768694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. Oct 18 13:23:13.770627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:13.775003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-46052079-dfab-4b60-9894-8980125cd5bc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] Returning 404 to user: Instance 8dfa9249-2680-4175-8114-fc18cdb0c117 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:13.776074 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-46052079-dfab-4b60-9894-8980125cd5bc tempest-ImagesOneServerNegativeTestJSON-2106316478 tempest-ImagesOneServerNegativeTestJSON-2106316478-project] 10.222.0.40 "GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117" status: 404 len: 111 microversion: 2.1 time: 0.061352 Oct 18 13:23:13.776829 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 805/1652] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:13 2022] GET /compute/v2.1/servers/8dfa9249-2680-4175-8114-fc18cdb0c117 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:13.782623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-0f17a0fd-0b33-4abb-ba03-c14b63752a99 req-6ca5946a-1e21-4865-9a76-55349ca0f32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee65c386-9550-4e41-99e6-509acdb08f70", "name": "network-vif-plugged", "status": "completed", "tag": "f3489cc2-3514-4522-82e3-8e3dc059f392"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:13.799388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0f17a0fd-0b33-4abb-ba03-c14b63752a99 req-6ca5946a-1e21-4865-9a76-55349ca0f32d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:13.800169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0f17a0fd-0b33-4abb-ba03-c14b63752a99 req-6ca5946a-1e21-4865-9a76-55349ca0f32d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:13.800817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0f17a0fd-0b33-4abb-ba03-c14b63752a99 req-6ca5946a-1e21-4865-9a76-55349ca0f32d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:13.819437 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0f17a0fd-0b33-4abb-ba03-c14b63752a99 req-6ca5946a-1e21-4865-9a76-55349ca0f32d service nova] Creating event network-vif-plugged:f3489cc2-3514-4522-82e3-8e3dc059f392 for instance ee65c386-9550-4e41-99e6-509acdb08f70 on n-h2-858384-13 Oct 18 13:23:13.828175 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-0f17a0fd-0b33-4abb-ba03-c14b63752a99 req-6ca5946a-1e21-4865-9a76-55349ca0f32d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049496 Oct 18 13:23:13.829633 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 806/1653] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:13.838908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-28ec8443-9718-4acd-b01e-a16f9210b064 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:13.842303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-28ec8443-9718-4acd-b01e-a16f9210b064 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:13.849975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28ec8443-9718-4acd-b01e-a16f9210b064 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:13.850460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28ec8443-9718-4acd-b01e-a16f9210b064 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:13.850887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28ec8443-9718-4acd-b01e-a16f9210b064 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:13.851749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28ec8443-9718-4acd-b01e-a16f9210b064 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:13.852567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28ec8443-9718-4acd-b01e-a16f9210b064 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:13.852987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28ec8443-9718-4acd-b01e-a16f9210b064 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:13.928020 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-28ec8443-9718-4acd-b01e-a16f9210b064 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096224 Oct 18 13:23:13.928668 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 807/1654] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:23:13 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:13.965699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8a4cd370-cb09-4f86-a0a4-5f1028fb9bcb tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:13.966790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8a4cd370-cb09-4f86-a0a4-5f1028fb9bcb tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:14.004262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a4cd370-cb09-4f86-a0a4-5f1028fb9bcb tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:14.005386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a4cd370-cb09-4f86-a0a4-5f1028fb9bcb tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:14.006612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a4cd370-cb09-4f86-a0a4-5f1028fb9bcb tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:14.007530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a4cd370-cb09-4f86-a0a4-5f1028fb9bcb tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:14.009523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a4cd370-cb09-4f86-a0a4-5f1028fb9bcb tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:14.012247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a4cd370-cb09-4f86-a0a4-5f1028fb9bcb tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:14.033469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a431350f-c11e-4c4c-b6f2-5dbf3070c0a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:14.047038 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a431350f-c11e-4c4c-b6f2-5dbf3070c0a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1504 microversion: 2.1 time: 0.577126 Oct 18 13:23:14.065939 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 848/1655] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:13 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1504 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:14.072668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c1015f87-c575-4ba6-aaee-c1a823b613d7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:14.074376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c1015f87-c575-4ba6-aaee-c1a823b613d7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:14.081062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1015f87-c575-4ba6-aaee-c1a823b613d7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:14.083542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1015f87-c575-4ba6-aaee-c1a823b613d7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:14.084323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1015f87-c575-4ba6-aaee-c1a823b613d7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:14.085334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1015f87-c575-4ba6-aaee-c1a823b613d7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:14.086551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1015f87-c575-4ba6-aaee-c1a823b613d7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:14.087263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1015f87-c575-4ba6-aaee-c1a823b613d7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:14.164357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:14.318469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-8a4cd370-cb09-4f86-a0a4-5f1028fb9bcb tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lazy-loading 'services' on Instance uuid b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:23:14.386655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:14.567466 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8a4cd370-cb09-4f86-a0a4-5f1028fb9bcb tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5/os-volume_attachments/f274c8c5-7736-4958-b79a-44d3fffd2589" status: 202 len: 0 microversion: 2.1 time: 0.624646 Oct 18 13:23:14.568030 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 808/1656] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:23:13 2022] DELETE /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5/os-volume_attachments/f274c8c5-7736-4958-b79a-44d3fffd2589 => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:23:14.582967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3e74bc8d-c1d2-4306-b711-0616b9a1a438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:14.592529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3e74bc8d-c1d2-4306-b711-0616b9a1a438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:14.639503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e74bc8d-c1d2-4306-b711-0616b9a1a438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:14.642661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e74bc8d-c1d2-4306-b711-0616b9a1a438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:14.645207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e74bc8d-c1d2-4306-b711-0616b9a1a438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:14.646985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e74bc8d-c1d2-4306-b711-0616b9a1a438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:14.651878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e74bc8d-c1d2-4306-b711-0616b9a1a438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:14.654473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3e74bc8d-c1d2-4306-b711-0616b9a1a438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:14.747218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3e74bc8d-c1d2-4306-b711-0616b9a1a438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:23:14.910852 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3e74bc8d-c1d2-4306-b711-0616b9a1a438 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "DELETE /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 204 len: 0 microversion: 2.1 time: 0.340492 Oct 18 13:23:14.912515 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 809/1657] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:23:14 2022] DELETE /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:23:14.920994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c1015f87-c575-4ba6-aaee-c1a823b613d7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:14.923871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c772b568-d9f3-497b-a5f5-dd68974e0797 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:14.925454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c772b568-d9f3-497b-a5f5-dd68974e0797 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:14.930609 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c1015f87-c575-4ba6-aaee-c1a823b613d7 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1308 microversion: 2.1 time: 0.862720 Oct 18 13:23:14.933639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c772b568-d9f3-497b-a5f5-dd68974e0797 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:14.949208 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 849/1658] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:14 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1308 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:14.951284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c772b568-d9f3-497b-a5f5-dd68974e0797 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:14.952301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c772b568-d9f3-497b-a5f5-dd68974e0797 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:14.953542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c772b568-d9f3-497b-a5f5-dd68974e0797 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:14.954465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c772b568-d9f3-497b-a5f5-dd68974e0797 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:14.955582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c772b568-d9f3-497b-a5f5-dd68974e0797 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:14.967147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7ba34da3-6bd2-4a6d-b9a6-f51db8844fa9 req-76029f97-677e-44c7-8617-c8ffb28045f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2403d808-adf4-45f0-a631-cdc6fad44b76", "tag": "43a6f3fa-36dd-4b00-b299-1037fb97ee80"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:14.986077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7ba34da3-6bd2-4a6d-b9a6-f51db8844fa9 req-76029f97-677e-44c7-8617-c8ffb28045f0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:14.987115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7ba34da3-6bd2-4a6d-b9a6-f51db8844fa9 req-76029f97-677e-44c7-8617-c8ffb28045f0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:14.987570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7ba34da3-6bd2-4a6d-b9a6-f51db8844fa9 req-76029f97-677e-44c7-8617-c8ffb28045f0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:15.007042 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7ba34da3-6bd2-4a6d-b9a6-f51db8844fa9 req-76029f97-677e-44c7-8617-c8ffb28045f0 service nova] Creating event network-changed:43a6f3fa-36dd-4b00-b299-1037fb97ee80 for instance 2403d808-adf4-45f0-a631-cdc6fad44b76 on n-h1-858384-13 Oct 18 13:23:15.013605 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7ba34da3-6bd2-4a6d-b9a6-f51db8844fa9 req-76029f97-677e-44c7-8617-c8ffb28045f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076624 Oct 18 13:23:15.014594 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 850/1659] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:15.021572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-249f1bde-acc8-446b-a4b1-c31f9aa7bddc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:15.022285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-249f1bde-acc8-446b-a4b1-c31f9aa7bddc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:15.053069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-249f1bde-acc8-446b-a4b1-c31f9aa7bddc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:15.053801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-249f1bde-acc8-446b-a4b1-c31f9aa7bddc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:15.054211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-249f1bde-acc8-446b-a4b1-c31f9aa7bddc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:15.055011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-249f1bde-acc8-446b-a4b1-c31f9aa7bddc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:15.055478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-249f1bde-acc8-446b-a4b1-c31f9aa7bddc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:15.056025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-249f1bde-acc8-446b-a4b1-c31f9aa7bddc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:15.125285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c772b568-d9f3-497b-a5f5-dd68974e0797 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:15.137448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c772b568-d9f3-497b-a5f5-dd68974e0797 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:15.144694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c772b568-d9f3-497b-a5f5-dd68974e0797 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:15.147100 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c772b568-d9f3-497b-a5f5-dd68974e0797 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1251 microversion: 2.25 time: 0.231627 Oct 18 13:23:15.147897 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 810/1660] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:14 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1251 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:15.160122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c3b630b8-146c-43cf-8bc5-428acb376da8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:15.162715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c3b630b8-146c-43cf-8bc5-428acb376da8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:15.176928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3b630b8-146c-43cf-8bc5-428acb376da8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:15.177832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3b630b8-146c-43cf-8bc5-428acb376da8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:15.178556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3b630b8-146c-43cf-8bc5-428acb376da8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:15.181641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3b630b8-146c-43cf-8bc5-428acb376da8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:15.182550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3b630b8-146c-43cf-8bc5-428acb376da8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:15.183207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3b630b8-146c-43cf-8bc5-428acb376da8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:15.390140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-249f1bde-acc8-446b-a4b1-c31f9aa7bddc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:15.407157 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-249f1bde-acc8-446b-a4b1-c31f9aa7bddc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1315 microversion: 2.1 time: 0.390485 Oct 18 13:23:15.408044 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 851/1661] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:15 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:15.418941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-28e40e39-8f94-4331-ba0d-551cf9292a54 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:15.420082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-28e40e39-8f94-4331-ba0d-551cf9292a54 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:15.436513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28e40e39-8f94-4331-ba0d-551cf9292a54 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:15.439214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28e40e39-8f94-4331-ba0d-551cf9292a54 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:15.440846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28e40e39-8f94-4331-ba0d-551cf9292a54 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:15.441597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28e40e39-8f94-4331-ba0d-551cf9292a54 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:15.442064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28e40e39-8f94-4331-ba0d-551cf9292a54 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:15.442486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28e40e39-8f94-4331-ba0d-551cf9292a54 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:15.806843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3b630b8-146c-43cf-8bc5-428acb376da8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:15.841738 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c3b630b8-146c-43cf-8bc5-428acb376da8 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1469 microversion: 2.1 time: 0.677308 Oct 18 13:23:15.841738 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 811/1662] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:15 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1469 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:15.964611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-db2f204e-f880-410c-bd88-9550c9e3ce48 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:15.965251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-db2f204e-f880-410c-bd88-9550c9e3ce48 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:15.979058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db2f204e-f880-410c-bd88-9550c9e3ce48 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:15.979618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db2f204e-f880-410c-bd88-9550c9e3ce48 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:15.980227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db2f204e-f880-410c-bd88-9550c9e3ce48 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:15.980782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db2f204e-f880-410c-bd88-9550c9e3ce48 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:15.981280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db2f204e-f880-410c-bd88-9550c9e3ce48 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:15.981710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db2f204e-f880-410c-bd88-9550c9e3ce48 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:16.407864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-28e40e39-8f94-4331-ba0d-551cf9292a54 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:16.418749 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-28e40e39-8f94-4331-ba0d-551cf9292a54 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1504 microversion: 2.1 time: 1.009273 Oct 18 13:23:16.438753 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 852/1663] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:15 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1504 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:16.459561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fe6d6b08-ad64-4cfb-9fb4-c1f1697a521e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:16.460186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fe6d6b08-ad64-4cfb-9fb4-c1f1697a521e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:16.469698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe6d6b08-ad64-4cfb-9fb4-c1f1697a521e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:16.470470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe6d6b08-ad64-4cfb-9fb4-c1f1697a521e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:16.471100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe6d6b08-ad64-4cfb-9fb4-c1f1697a521e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:16.472049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe6d6b08-ad64-4cfb-9fb4-c1f1697a521e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:16.472688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe6d6b08-ad64-4cfb-9fb4-c1f1697a521e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:16.473578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe6d6b08-ad64-4cfb-9fb4-c1f1697a521e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:16.637559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fe6d6b08-ad64-4cfb-9fb4-c1f1697a521e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:16.650012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fe6d6b08-ad64-4cfb-9fb4-c1f1697a521e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:16.651935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fe6d6b08-ad64-4cfb-9fb4-c1f1697a521e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:16.653745 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fe6d6b08-ad64-4cfb-9fb4-c1f1697a521e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1293 microversion: 2.25 time: 0.213376 Oct 18 13:23:16.654826 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 853/1664] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:16 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1293 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:16.660079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cf6fc408-ce0d-40a5-8fb9-5eb0acb9dec2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:16.661041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cf6fc408-ce0d-40a5-8fb9-5eb0acb9dec2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:16.669819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf6fc408-ce0d-40a5-8fb9-5eb0acb9dec2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:16.670489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf6fc408-ce0d-40a5-8fb9-5eb0acb9dec2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:16.672038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf6fc408-ce0d-40a5-8fb9-5eb0acb9dec2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:16.672897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf6fc408-ce0d-40a5-8fb9-5eb0acb9dec2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:16.673510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf6fc408-ce0d-40a5-8fb9-5eb0acb9dec2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:16.674535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf6fc408-ce0d-40a5-8fb9-5eb0acb9dec2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:16.707898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-db2f204e-f880-410c-bd88-9550c9e3ce48 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:16.720432 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-db2f204e-f880-410c-bd88-9550c9e3ce48 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1308 microversion: 2.1 time: 0.761314 Oct 18 13:23:16.721387 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 812/1665] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:15 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1308 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:16.853970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42e95d0d-8a28-4f66-80b4-da8cb6a93a8d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:16.855254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-42e95d0d-8a28-4f66-80b4-da8cb6a93a8d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:16.866593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42e95d0d-8a28-4f66-80b4-da8cb6a93a8d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:16.867765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42e95d0d-8a28-4f66-80b4-da8cb6a93a8d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:16.869021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42e95d0d-8a28-4f66-80b4-da8cb6a93a8d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:16.870482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42e95d0d-8a28-4f66-80b4-da8cb6a93a8d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:16.873083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42e95d0d-8a28-4f66-80b4-da8cb6a93a8d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:16.873786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42e95d0d-8a28-4f66-80b4-da8cb6a93a8d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:16.997673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cf6fc408-ce0d-40a5-8fb9-5eb0acb9dec2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:17.013336 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cf6fc408-ce0d-40a5-8fb9-5eb0acb9dec2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1315 microversion: 2.1 time: 0.357084 Oct 18 13:23:17.031734 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 854/1666] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:16 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:17.446191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c8d3c57a-5e3f-4ba6-9037-7aba404a6307 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:17.446983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c8d3c57a-5e3f-4ba6-9037-7aba404a6307 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:17.467119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8d3c57a-5e3f-4ba6-9037-7aba404a6307 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:17.467660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8d3c57a-5e3f-4ba6-9037-7aba404a6307 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:17.472062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8d3c57a-5e3f-4ba6-9037-7aba404a6307 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:17.481013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8d3c57a-5e3f-4ba6-9037-7aba404a6307 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:17.481709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8d3c57a-5e3f-4ba6-9037-7aba404a6307 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:17.487863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8d3c57a-5e3f-4ba6-9037-7aba404a6307 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:17.556804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-42e95d0d-8a28-4f66-80b4-da8cb6a93a8d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:17.575491 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-42e95d0d-8a28-4f66-80b4-da8cb6a93a8d tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1469 microversion: 2.1 time: 0.727254 Oct 18 13:23:17.594003 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 813/1667] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:16 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1469 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:17.690238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7ba0a339-a03a-4ab6-a50f-a64106b757f7 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:17.690842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7ba0a339-a03a-4ab6-a50f-a64106b757f7 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:17.709080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ba0a339-a03a-4ab6-a50f-a64106b757f7 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:17.709990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ba0a339-a03a-4ab6-a50f-a64106b757f7 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:17.710682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ba0a339-a03a-4ab6-a50f-a64106b757f7 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:17.711875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ba0a339-a03a-4ab6-a50f-a64106b757f7 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:17.712621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ba0a339-a03a-4ab6-a50f-a64106b757f7 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:17.713342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ba0a339-a03a-4ab6-a50f-a64106b757f7 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:17.895308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c8d3c57a-5e3f-4ba6-9037-7aba404a6307 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:17.909661 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c8d3c57a-5e3f-4ba6-9037-7aba404a6307 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1504 microversion: 2.1 time: 0.468626 Oct 18 13:23:17.910875 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 855/1668] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:17 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1504 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:17.926024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-22882367-0c78-47d3-b2d8-1cba17ed1e69 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:17.926989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-22882367-0c78-47d3-b2d8-1cba17ed1e69 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:17.942868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22882367-0c78-47d3-b2d8-1cba17ed1e69 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:17.943642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22882367-0c78-47d3-b2d8-1cba17ed1e69 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:17.956365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22882367-0c78-47d3-b2d8-1cba17ed1e69 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:17.960424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22882367-0c78-47d3-b2d8-1cba17ed1e69 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:17.961222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22882367-0c78-47d3-b2d8-1cba17ed1e69 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:17.961840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22882367-0c78-47d3-b2d8-1cba17ed1e69 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:18.416420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-22882367-0c78-47d3-b2d8-1cba17ed1e69 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:18.431867 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-22882367-0c78-47d3-b2d8-1cba17ed1e69 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1308 microversion: 2.1 time: 0.519708 Oct 18 13:23:18.434737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ba0a339-a03a-4ab6-a50f-a64106b757f7 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:18.436720 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 856/1669] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:17 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:18.444315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bbe217e5-bf7c-461b-9aed-9a1ecd1a7b82 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:18.446129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bbe217e5-bf7c-461b-9aed-9a1ecd1a7b82 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:18.466971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe217e5-bf7c-461b-9aed-9a1ecd1a7b82 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:18.468250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ba0a339-a03a-4ab6-a50f-a64106b757f7 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:18.468397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe217e5-bf7c-461b-9aed-9a1ecd1a7b82 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:18.468397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe217e5-bf7c-461b-9aed-9a1ecd1a7b82 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:18.468953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ba0a339-a03a-4ab6-a50f-a64106b757f7 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:18.469104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe217e5-bf7c-461b-9aed-9a1ecd1a7b82 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:18.469590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe217e5-bf7c-461b-9aed-9a1ecd1a7b82 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:18.470161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe217e5-bf7c-461b-9aed-9a1ecd1a7b82 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:18.480739 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7ba0a339-a03a-4ab6-a50f-a64106b757f7 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1293 microversion: 2.25 time: 0.794343 Oct 18 13:23:18.481382 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 814/1670] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:17 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1293 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:23:18.612064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a4430315-c83e-4563-afa6-525f37b4e17f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:18.613122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a4430315-c83e-4563-afa6-525f37b4e17f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:18.652911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4430315-c83e-4563-afa6-525f37b4e17f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:18.654742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4430315-c83e-4563-afa6-525f37b4e17f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:18.655762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4430315-c83e-4563-afa6-525f37b4e17f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:18.657650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4430315-c83e-4563-afa6-525f37b4e17f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:18.660250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4430315-c83e-4563-afa6-525f37b4e17f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:18.667870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4430315-c83e-4563-afa6-525f37b4e17f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:18.919697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a4430315-c83e-4563-afa6-525f37b4e17f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:18.940001 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a4430315-c83e-4563-afa6-525f37b4e17f tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1427 microversion: 2.1 time: 0.335310 Oct 18 13:23:18.973364 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 815/1671] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:18 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1427 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:18.994382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-edfc5776-db88-47eb-a0a3-501350b563d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:19.006357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-edfc5776-db88-47eb-a0a3-501350b563d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:19.023078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edfc5776-db88-47eb-a0a3-501350b563d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:19.025446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edfc5776-db88-47eb-a0a3-501350b563d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:19.028909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edfc5776-db88-47eb-a0a3-501350b563d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:19.031643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edfc5776-db88-47eb-a0a3-501350b563d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:19.033837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edfc5776-db88-47eb-a0a3-501350b563d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:19.034556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edfc5776-db88-47eb-a0a3-501350b563d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:19.349906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bbe217e5-bf7c-461b-9aed-9a1ecd1a7b82 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:19.380432 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bbe217e5-bf7c-461b-9aed-9a1ecd1a7b82 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1502 microversion: 2.1 time: 0.942114 Oct 18 13:23:19.382008 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 857/1672] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:18 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1502 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:19.389884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-5ad96a55-1a90-4f4d-9c6b-d1581e6db8cd req-8268f810-4411-4cd8-aa89-2849a5c52998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37793c0c-d885-4fd3-8e4f-9d051dd8026c", "name": "network-vif-deleted", "tag": "dbfe8182-9968-4cde-bd63-b3073fc6f861"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:19.410643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5ad96a55-1a90-4f4d-9c6b-d1581e6db8cd req-8268f810-4411-4cd8-aa89-2849a5c52998 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:19.412113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5ad96a55-1a90-4f4d-9c6b-d1581e6db8cd req-8268f810-4411-4cd8-aa89-2849a5c52998 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:19.412955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5ad96a55-1a90-4f4d-9c6b-d1581e6db8cd req-8268f810-4411-4cd8-aa89-2849a5c52998 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:19.435866 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-5ad96a55-1a90-4f4d-9c6b-d1581e6db8cd req-8268f810-4411-4cd8-aa89-2849a5c52998 service nova] Creating event network-vif-deleted:dbfe8182-9968-4cde-bd63-b3073fc6f861 for instance 37793c0c-d885-4fd3-8e4f-9d051dd8026c on n-h2-858384-13 Oct 18 13:23:19.444075 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-5ad96a55-1a90-4f4d-9c6b-d1581e6db8cd req-8268f810-4411-4cd8-aa89-2849a5c52998 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059927 Oct 18 13:23:19.446764 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 858/1673] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:19.460726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53406d5c-e8c9-46a2-9dcc-522d72ef74bf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:19.461896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53406d5c-e8c9-46a2-9dcc-522d72ef74bf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:19.470174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53406d5c-e8c9-46a2-9dcc-522d72ef74bf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:19.471512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53406d5c-e8c9-46a2-9dcc-522d72ef74bf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:19.472229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53406d5c-e8c9-46a2-9dcc-522d72ef74bf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:19.474017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53406d5c-e8c9-46a2-9dcc-522d72ef74bf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:19.474775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53406d5c-e8c9-46a2-9dcc-522d72ef74bf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:19.475443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53406d5c-e8c9-46a2-9dcc-522d72ef74bf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:19.541552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53406d5c-e8c9-46a2-9dcc-522d72ef74bf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:23:19.738060 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53406d5c-e8c9-46a2-9dcc-522d72ef74bf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 204 len: 0 microversion: 2.1 time: 0.289342 Oct 18 13:23:19.743085 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 859/1674] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:23:19 2022] DELETE /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:23:19.750546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ae68904d-9477-45ea-9940-19bc1f3edabc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:19.751696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ae68904d-9477-45ea-9940-19bc1f3edabc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:19.759366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae68904d-9477-45ea-9940-19bc1f3edabc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:19.760255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae68904d-9477-45ea-9940-19bc1f3edabc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:19.761817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae68904d-9477-45ea-9940-19bc1f3edabc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:19.762847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae68904d-9477-45ea-9940-19bc1f3edabc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:19.763555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae68904d-9477-45ea-9940-19bc1f3edabc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:19.764256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae68904d-9477-45ea-9940-19bc1f3edabc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:19.940051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-edfc5776-db88-47eb-a0a3-501350b563d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:19.968937 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-edfc5776-db88-47eb-a0a3-501350b563d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1504 microversion: 2.1 time: 0.993709 Oct 18 13:23:20.012768 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 816/1675] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:18 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1504 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:20.022886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-67ba00e2-d464-4879-a4eb-efa73acc5868 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:20.024756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-67ba00e2-d464-4879-a4eb-efa73acc5868 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:20.037682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67ba00e2-d464-4879-a4eb-efa73acc5868 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:20.044966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67ba00e2-d464-4879-a4eb-efa73acc5868 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:20.045736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67ba00e2-d464-4879-a4eb-efa73acc5868 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:20.046727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67ba00e2-d464-4879-a4eb-efa73acc5868 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:20.047366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67ba00e2-d464-4879-a4eb-efa73acc5868 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:20.047976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67ba00e2-d464-4879-a4eb-efa73acc5868 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:20.096235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ae68904d-9477-45ea-9940-19bc1f3edabc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:20.118325 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ae68904d-9477-45ea-9940-19bc1f3edabc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1308 microversion: 2.1 time: 0.369590 Oct 18 13:23:20.119108 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 860/1676] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:19 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1308 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:20.131870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-091f5b3d-c01d-46e6-a5f9-492bfb531fa3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:20.135451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-091f5b3d-c01d-46e6-a5f9-492bfb531fa3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:20.150041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-091f5b3d-c01d-46e6-a5f9-492bfb531fa3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:20.150558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-091f5b3d-c01d-46e6-a5f9-492bfb531fa3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:20.151011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-091f5b3d-c01d-46e6-a5f9-492bfb531fa3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:20.151914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-091f5b3d-c01d-46e6-a5f9-492bfb531fa3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:20.152380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-091f5b3d-c01d-46e6-a5f9-492bfb531fa3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:20.152814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-091f5b3d-c01d-46e6-a5f9-492bfb531fa3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:20.422786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-091f5b3d-c01d-46e6-a5f9-492bfb531fa3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:20.437954 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-091f5b3d-c01d-46e6-a5f9-492bfb531fa3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1508 microversion: 2.1 time: 0.315999 Oct 18 13:23:20.454714 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 861/1677] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:20 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1508 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:20.459965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:20.460591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:20.470829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:20.471395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:20.471806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:20.472542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:20.472991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:20.473522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:20.477535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:20.518606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:20.526481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:20.526964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:20.527396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:20.527848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lazy-loading 'fault' on Instance uuid 37793c0c-d885-4fd3-8e4f-9d051dd8026c {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:23:20.619549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:20.628437 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0ca63946-d3ed-466c-9743-48f3d3c9c560 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 200 len: 1303 microversion: 2.1 time: 0.172440 Oct 18 13:23:20.629048 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 862/1678] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:20 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 1303 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:20.843250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-67ba00e2-d464-4879-a4eb-efa73acc5868 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:20.857624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-67ba00e2-d464-4879-a4eb-efa73acc5868 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:20.863746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-67ba00e2-d464-4879-a4eb-efa73acc5868 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:20.865472 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-67ba00e2-d464-4879-a4eb-efa73acc5868 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1293 microversion: 2.25 time: 0.848355 Oct 18 13:23:20.891070 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 817/1679] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:20 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1293 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:21.037726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-29a2b9c9-8672-432c-9137-99586eddd401 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:21.038722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-29a2b9c9-8672-432c-9137-99586eddd401 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:21.052464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29a2b9c9-8672-432c-9137-99586eddd401 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:21.053956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29a2b9c9-8672-432c-9137-99586eddd401 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:21.054764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29a2b9c9-8672-432c-9137-99586eddd401 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:21.056035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29a2b9c9-8672-432c-9137-99586eddd401 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:21.057081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29a2b9c9-8672-432c-9137-99586eddd401 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:21.057840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29a2b9c9-8672-432c-9137-99586eddd401 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:21.143635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c710628d-456d-44d1-bd49-c1aacb7bacf3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:21.148149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c710628d-456d-44d1-bd49-c1aacb7bacf3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:21.168704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c710628d-456d-44d1-bd49-c1aacb7bacf3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:21.171353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c710628d-456d-44d1-bd49-c1aacb7bacf3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:21.173227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c710628d-456d-44d1-bd49-c1aacb7bacf3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:21.178159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c710628d-456d-44d1-bd49-c1aacb7bacf3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:21.181160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c710628d-456d-44d1-bd49-c1aacb7bacf3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:21.181832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c710628d-456d-44d1-bd49-c1aacb7bacf3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:21.839079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-29a2b9c9-8672-432c-9137-99586eddd401 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:21.865788 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-29a2b9c9-8672-432c-9137-99586eddd401 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1504 microversion: 2.1 time: 0.845500 Oct 18 13:23:21.870939 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 863/1680] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:21 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1504 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:21.890682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-797d1196-a756-4dda-8014-120341091511 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:21.893125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-797d1196-a756-4dda-8014-120341091511 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:21.920505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-797d1196-a756-4dda-8014-120341091511 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:21.921799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-797d1196-a756-4dda-8014-120341091511 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:21.924538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-797d1196-a756-4dda-8014-120341091511 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:21.924814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c710628d-456d-44d1-bd49-c1aacb7bacf3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:21.926299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-797d1196-a756-4dda-8014-120341091511 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:21.931438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-797d1196-a756-4dda-8014-120341091511 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:21.932387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-797d1196-a756-4dda-8014-120341091511 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:21.937505 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c710628d-456d-44d1-bd49-c1aacb7bacf3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1308 microversion: 2.1 time: 0.797566 Oct 18 13:23:21.941867 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 818/1681] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:21 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1308 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:21.950649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-946d7e94-3c19-4901-9025-f41f0558f53c req-ed994a17-9297-4a3c-ae95-da8b5ebe5dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67746251-6df7-43e6-9a3d-c45f1fb662ae", "tag": "06704eb6-7b35-42a7-a441-0dd307106054"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:21.973847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-946d7e94-3c19-4901-9025-f41f0558f53c req-ed994a17-9297-4a3c-ae95-da8b5ebe5dc2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:21.974534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-946d7e94-3c19-4901-9025-f41f0558f53c req-ed994a17-9297-4a3c-ae95-da8b5ebe5dc2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:21.977575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-946d7e94-3c19-4901-9025-f41f0558f53c req-ed994a17-9297-4a3c-ae95-da8b5ebe5dc2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:22.014776 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-946d7e94-3c19-4901-9025-f41f0558f53c req-ed994a17-9297-4a3c-ae95-da8b5ebe5dc2 service nova] Creating event network-changed:06704eb6-7b35-42a7-a441-0dd307106054 for instance 67746251-6df7-43e6-9a3d-c45f1fb662ae on n-h2-858384-13 Oct 18 13:23:22.021747 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-946d7e94-3c19-4901-9025-f41f0558f53c req-ed994a17-9297-4a3c-ae95-da8b5ebe5dc2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078440 Oct 18 13:23:22.029375 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 819/1682] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:22.035067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4486101-d45b-4998-bee8-c5dd978bd779 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:22.040134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e4486101-d45b-4998-bee8-c5dd978bd779 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 37793c0c-d885-4fd3-8e4f-9d051dd8026c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:22.046521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=12 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:22.055789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4486101-d45b-4998-bee8-c5dd978bd779 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:22.055789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4486101-d45b-4998-bee8-c5dd978bd779 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:22.055789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4486101-d45b-4998-bee8-c5dd978bd779 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:22.059882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4486101-d45b-4998-bee8-c5dd978bd779 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:22.065914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4486101-d45b-4998-bee8-c5dd978bd779 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:22.066534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4486101-d45b-4998-bee8-c5dd978bd779 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:22.106401 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e4486101-d45b-4998-bee8-c5dd978bd779 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] HTTP exception thrown: Instance 37793c0c-d885-4fd3-8e4f-9d051dd8026c could not be found. Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4486101-d45b-4998-bee8-c5dd978bd779 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Request method failure captured: Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c HTTP/1.1 Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdX8yQuJt5IFSJD3aOvsWYs90nenULvdIoLlk8lIBbo-326hbxTW7vKPLz1QBvDHOysWrT6gNCKKiE0GP8iFjFnEy84OU4KRZuY0ARUrcFZRLKBxA1Q3fbVxq3qS8t71wC8kMawkrMDiwJi8jfpLmO3lsiOD6DFHHK_nxe6ut-1w4o Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 3f136eea39d84b04b5410eb0906c113e Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-MigrationsAdminTest-772254388 Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:23:22.108325 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:23:22.110909 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f136eea39d84b04b5410eb0906c113e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f136eea39d84b04b5410eb0906c113e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f136eea39d84b04b5410eb0906c113e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f136eea39d84b04b5410eb0906c113e"}]}] Oct 18 13:23:22.110909 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-MigrationsAdminTest-772254388 Oct 18 13:23:22.110909 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 3f136eea39d84b04b5410eb0906c113e Oct 18 13:23:22.110909 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-MigrationsAdminTest-772254388 Oct 18 13:23:22.110909 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-MigrationsAdminTest-772254388-project Oct 18 13:23:22.110909 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:23:22.110909 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:23:22.110909 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e631235f0d0c400981c97d9edb1ea7fe Oct 18 13:23:22.110909 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-MigrationsAdminTest-772254388-project Oct 18 13:23:22.110909 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:23:22.110909 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 37793c0c-d885-4fd3-8e4f-9d051dd8026c could not be found. Oct 18 13:23:22.110909 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '37793c0c-d885-4fd3-8e4f-9d051dd8026c'} Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37793c0c-d885-4fd3-8e4f-9d051dd8026c could not be found. Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:22.112306 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37793c0c-d885-4fd3-8e4f-9d051dd8026c could not be found. Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37793c0c-d885-4fd3-8e4f-9d051dd8026c could not be found. Oct 18 13:23:22.114667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:22.117583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4486101-d45b-4998-bee8-c5dd978bd779 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Returning 404 to user: Instance 37793c0c-d885-4fd3-8e4f-9d051dd8026c could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:22.117583 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e4486101-d45b-4998-bee8-c5dd978bd779 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c" status: 404 len: 111 microversion: 2.1 time: 0.079127 Oct 18 13:23:22.122775 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 820/1683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:22 2022] GET /compute/v2.1/servers/37793c0c-d885-4fd3-8e4f-9d051dd8026c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:22.141211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ffa46ca3-9d18-4ec9-825d-943ea1ad758c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:22.142046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ffa46ca3-9d18-4ec9-825d-943ea1ad758c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:22.163650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa46ca3-9d18-4ec9-825d-943ea1ad758c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:22.164926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa46ca3-9d18-4ec9-825d-943ea1ad758c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:22.173494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa46ca3-9d18-4ec9-825d-943ea1ad758c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:22.174413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa46ca3-9d18-4ec9-825d-943ea1ad758c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:22.175035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa46ca3-9d18-4ec9-825d-943ea1ad758c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:22.175565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa46ca3-9d18-4ec9-825d-943ea1ad758c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:22.549136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-797d1196-a756-4dda-8014-120341091511 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:22.558436 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-797d1196-a756-4dda-8014-120341091511 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1508 microversion: 2.1 time: 0.685677 Oct 18 13:23:22.571503 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 864/1684] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:21 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1508 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:22.576803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-08c724f2-c738-4e39-a2b3-59fc9f5cc418 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:22.580065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-08c724f2-c738-4e39-a2b3-59fc9f5cc418 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:22.595598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c724f2-c738-4e39-a2b3-59fc9f5cc418 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:22.596084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c724f2-c738-4e39-a2b3-59fc9f5cc418 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:22.596520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c724f2-c738-4e39-a2b3-59fc9f5cc418 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:22.597613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c724f2-c738-4e39-a2b3-59fc9f5cc418 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:22.597744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c724f2-c738-4e39-a2b3-59fc9f5cc418 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:22.598110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c724f2-c738-4e39-a2b3-59fc9f5cc418 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:22.651697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:22.670022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-08c724f2-c738-4e39-a2b3-59fc9f5cc418 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:23:22.903803 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-08c724f2-c738-4e39-a2b3-59fc9f5cc418 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "DELETE /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 204 len: 0 microversion: 2.1 time: 0.336641 Oct 18 13:23:22.904569 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 865/1685] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:23:22 2022] DELETE /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:23:22.910403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-46135daf-e1bb-44a1-8c28-396c3b54abb0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:22.916241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-46135daf-e1bb-44a1-8c28-396c3b54abb0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:22.938724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46135daf-e1bb-44a1-8c28-396c3b54abb0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:22.939228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46135daf-e1bb-44a1-8c28-396c3b54abb0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:22.939676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46135daf-e1bb-44a1-8c28-396c3b54abb0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:22.940397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46135daf-e1bb-44a1-8c28-396c3b54abb0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:22.940858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46135daf-e1bb-44a1-8c28-396c3b54abb0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:22.941320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46135daf-e1bb-44a1-8c28-396c3b54abb0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:23.857077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ffa46ca3-9d18-4ec9-825d-943ea1ad758c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:23.875960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ffa46ca3-9d18-4ec9-825d-943ea1ad758c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:23.879000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ffa46ca3-9d18-4ec9-825d-943ea1ad758c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:23.885026 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ffa46ca3-9d18-4ec9-825d-943ea1ad758c tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1293 microversion: 2.25 time: 1.758029 Oct 18 13:23:23.886214 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 821/1686] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:22 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1293 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:23.902691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b1132c6d-0a32-43bd-9db2-0740b56c78b1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:23.909008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b1132c6d-0a32-43bd-9db2-0740b56c78b1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:23.936545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1132c6d-0a32-43bd-9db2-0740b56c78b1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:23.937295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1132c6d-0a32-43bd-9db2-0740b56c78b1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:23.937930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1132c6d-0a32-43bd-9db2-0740b56c78b1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:23.938829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1132c6d-0a32-43bd-9db2-0740b56c78b1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:23.939453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1132c6d-0a32-43bd-9db2-0740b56c78b1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:23.942704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1132c6d-0a32-43bd-9db2-0740b56c78b1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:24.009627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-46135daf-e1bb-44a1-8c28-396c3b54abb0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:24.036237 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-46135daf-e1bb-44a1-8c28-396c3b54abb0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1504 microversion: 2.1 time: 1.118004 Oct 18 13:23:24.036936 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 866/1687] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:22 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1504 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:24.052559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b689e87a-8b08-4c75-a1e5-7f366c2c4a43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:24.053209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b689e87a-8b08-4c75-a1e5-7f366c2c4a43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:24.087665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b689e87a-8b08-4c75-a1e5-7f366c2c4a43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:24.088627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b689e87a-8b08-4c75-a1e5-7f366c2c4a43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:24.089285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b689e87a-8b08-4c75-a1e5-7f366c2c4a43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:24.090203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b689e87a-8b08-4c75-a1e5-7f366c2c4a43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:24.090838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b689e87a-8b08-4c75-a1e5-7f366c2c4a43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:24.097936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b689e87a-8b08-4c75-a1e5-7f366c2c4a43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:24.477955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b689e87a-8b08-4c75-a1e5-7f366c2c4a43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:24.496282 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b689e87a-8b08-4c75-a1e5-7f366c2c4a43 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1308 microversion: 2.1 time: 0.458194 Oct 18 13:23:24.496883 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 867/1688] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:24 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1308 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:24.513343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:24.514276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:24.523680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:24.542667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:24.549153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:24.553029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:24.553833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:24.559797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:24.573756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b1132c6d-0a32-43bd-9db2-0740b56c78b1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:24.594214 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b1132c6d-0a32-43bd-9db2-0740b56c78b1 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1468 microversion: 2.1 time: 0.705042 Oct 18 13:23:24.618373 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 822/1689] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:23 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1468 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:24.631201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-16472bf6-9d0b-46b8-b6ff-a744ea2de287 req-41617230-ecc6-4a64-95a5-2e9931f97225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee65c386-9550-4e41-99e6-509acdb08f70", "name": "network-vif-deleted", "tag": "f3489cc2-3514-4522-82e3-8e3dc059f392"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:24.667432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:24.668232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:24.668855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:24.673947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lazy-loading 'fault' on Instance uuid ee65c386-9550-4e41-99e6-509acdb08f70 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:23:24.683079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-16472bf6-9d0b-46b8-b6ff-a744ea2de287 req-41617230-ecc6-4a64-95a5-2e9931f97225 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:24.683563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-16472bf6-9d0b-46b8-b6ff-a744ea2de287 req-41617230-ecc6-4a64-95a5-2e9931f97225 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:24.683996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-16472bf6-9d0b-46b8-b6ff-a744ea2de287 req-41617230-ecc6-4a64-95a5-2e9931f97225 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:24.735430 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-16472bf6-9d0b-46b8-b6ff-a744ea2de287 req-41617230-ecc6-4a64-95a5-2e9931f97225 service nova] Creating event network-vif-deleted:f3489cc2-3514-4522-82e3-8e3dc059f392 for instance ee65c386-9550-4e41-99e6-509acdb08f70 on n-h2-858384-13 Oct 18 13:23:24.748758 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-16472bf6-9d0b-46b8-b6ff-a744ea2de287 req-41617230-ecc6-4a64-95a5-2e9931f97225 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128937 Oct 18 13:23:24.754357 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 823/1690] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:24.898012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:24.911195 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bfd1e818-f84c-4623-a56c-4da91923b3ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 200 len: 1305 microversion: 2.1 time: 0.412709 Oct 18 13:23:24.918743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bbcd289c-6b9e-45a3-a869-73c0f7e65892 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:24.920477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bbcd289c-6b9e-45a3-a869-73c0f7e65892 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:24.921012 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 868/1691] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:24 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 1305 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:24.944368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbcd289c-6b9e-45a3-a869-73c0f7e65892 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:24.946248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbcd289c-6b9e-45a3-a869-73c0f7e65892 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:24.947748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbcd289c-6b9e-45a3-a869-73c0f7e65892 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:24.948889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbcd289c-6b9e-45a3-a869-73c0f7e65892 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:24.957296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbcd289c-6b9e-45a3-a869-73c0f7e65892 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:24.957915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbcd289c-6b9e-45a3-a869-73c0f7e65892 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:25.066990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-099cc143-ea61-476d-ab5d-0011f1112666 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:25.068400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-099cc143-ea61-476d-ab5d-0011f1112666 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:25.089036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-099cc143-ea61-476d-ab5d-0011f1112666 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:25.101987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-099cc143-ea61-476d-ab5d-0011f1112666 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:25.102540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-099cc143-ea61-476d-ab5d-0011f1112666 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:25.103650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-099cc143-ea61-476d-ab5d-0011f1112666 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:25.104415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-099cc143-ea61-476d-ab5d-0011f1112666 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:25.105196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-099cc143-ea61-476d-ab5d-0011f1112666 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:25.376145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-099cc143-ea61-476d-ab5d-0011f1112666 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:25.392979 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-099cc143-ea61-476d-ab5d-0011f1112666 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1494 microversion: 2.1 time: 0.331653 Oct 18 13:23:25.395246 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 869/1692] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:25 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1494 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:25.426050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c2f767ff-cfec-4977-b97a-18df1b67d1fb tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '.version_select at 0x7ff60fcbe550>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:25.439903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2f767ff-cfec-4977-b97a-18df1b67d1fb tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:25.440438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2f767ff-cfec-4977-b97a-18df1b67d1fb tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:25.442099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2f767ff-cfec-4977-b97a-18df1b67d1fb tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:25.466136 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c2f767ff-cfec-4977-b97a-18df1b67d1fb tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1963 microversion: 2.1 time: 0.044327 Oct 18 13:23:25.467038 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 870/1693] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 18 13:23:25 2022] GET /compute/v2.1/os-migrations => generated 1963 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:25.471863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-02b772d9-dd2b-42d1-ad29-8c2cf25024a5 req-6435d055-7cca-4a38-ac95-0fa9d3d851ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f199ac-a7c9-4a5c-929a-f734ea6c3d80", "name": "network-vif-unplugged", "status": "completed", "tag": "0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:25.491244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-02b772d9-dd2b-42d1-ad29-8c2cf25024a5 req-6435d055-7cca-4a38-ac95-0fa9d3d851ca service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:25.492322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-02b772d9-dd2b-42d1-ad29-8c2cf25024a5 req-6435d055-7cca-4a38-ac95-0fa9d3d851ca service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:25.493143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-02b772d9-dd2b-42d1-ad29-8c2cf25024a5 req-6435d055-7cca-4a38-ac95-0fa9d3d851ca service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:25.522635 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-02b772d9-dd2b-42d1-ad29-8c2cf25024a5 req-6435d055-7cca-4a38-ac95-0fa9d3d851ca service nova] Creating event network-vif-unplugged:0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1 for instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 on n-h2-858384-13 Oct 18 13:23:25.533408 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-02b772d9-dd2b-42d1-ad29-8c2cf25024a5 req-6435d055-7cca-4a38-ac95-0fa9d3d851ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064825 Oct 18 13:23:25.537877 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 871/1694] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:25.552559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-46a7aec5-0eab-40f9-976e-9bc877d630d7 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:25.555289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-46a7aec5-0eab-40f9-976e-9bc877d630d7 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:25.564531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46a7aec5-0eab-40f9-976e-9bc877d630d7 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:25.565845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46a7aec5-0eab-40f9-976e-9bc877d630d7 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:25.566659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46a7aec5-0eab-40f9-976e-9bc877d630d7 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:25.568451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46a7aec5-0eab-40f9-976e-9bc877d630d7 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:25.569577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46a7aec5-0eab-40f9-976e-9bc877d630d7 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:25.582617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46a7aec5-0eab-40f9-976e-9bc877d630d7 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:25.615346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bbcd289c-6b9e-45a3-a869-73c0f7e65892 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:25.629320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bbcd289c-6b9e-45a3-a869-73c0f7e65892 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:25.630796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bbcd289c-6b9e-45a3-a869-73c0f7e65892 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:25.646720 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bbcd289c-6b9e-45a3-a869-73c0f7e65892 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1293 microversion: 2.25 time: 0.734570 Oct 18 13:23:25.647333 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 824/1695] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:24 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1293 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:25.670919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a408a42-9d0c-45ab-8607-ad7230eb585f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:25.671927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4a408a42-9d0c-45ab-8607-ad7230eb585f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:25.678858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a408a42-9d0c-45ab-8607-ad7230eb585f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:25.680014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a408a42-9d0c-45ab-8607-ad7230eb585f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:25.680698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a408a42-9d0c-45ab-8607-ad7230eb585f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:25.681716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a408a42-9d0c-45ab-8607-ad7230eb585f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:25.682429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a408a42-9d0c-45ab-8607-ad7230eb585f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:25.683096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a408a42-9d0c-45ab-8607-ad7230eb585f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:25.729437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:25.907146 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-46a7aec5-0eab-40f9-976e-9bc877d630d7 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1647 microversion: 2.1 time: 0.365528 Oct 18 13:23:25.909872 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 872/1696] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:25 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1647 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:25.918022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-58d2f06b-0199-4683-b41b-052645fe38c4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:25.918771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-58d2f06b-0199-4683-b41b-052645fe38c4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:25.929291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58d2f06b-0199-4683-b41b-052645fe38c4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:25.929291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58d2f06b-0199-4683-b41b-052645fe38c4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:25.929291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58d2f06b-0199-4683-b41b-052645fe38c4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:25.931516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58d2f06b-0199-4683-b41b-052645fe38c4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:25.931516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58d2f06b-0199-4683-b41b-052645fe38c4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:25.931516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58d2f06b-0199-4683-b41b-052645fe38c4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:26.185817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a408a42-9d0c-45ab-8607-ad7230eb585f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:26.198600 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4a408a42-9d0c-45ab-8607-ad7230eb585f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1308 microversion: 2.1 time: 0.532070 Oct 18 13:23:26.199933 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 825/1697] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:25 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1308 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:26.221038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7e43c4bb-b7e2-4b81-9517-1315a474d073 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:26.222810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7e43c4bb-b7e2-4b81-9517-1315a474d073 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:26.230776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e43c4bb-b7e2-4b81-9517-1315a474d073 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:26.231639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e43c4bb-b7e2-4b81-9517-1315a474d073 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:26.233917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e43c4bb-b7e2-4b81-9517-1315a474d073 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:26.237106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e43c4bb-b7e2-4b81-9517-1315a474d073 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:26.237934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e43c4bb-b7e2-4b81-9517-1315a474d073 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:26.238691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e43c4bb-b7e2-4b81-9517-1315a474d073 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:26.276167 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-7e43c4bb-b7e2-4b81-9517-1315a474d073 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7e43c4bb-b7e2-4b81-9517-1315a474d073 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 HTTP/1.1 Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:23:26.283387 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:23:26.286697 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:23:26.286697 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:23:26.286697 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:23:26.286697 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:23:26.286697 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:23:26.286697 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:23:26.286697 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:23:26.286697 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:23:26.286697 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:23:26.286697 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:23:26.286697 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:23:26.286697 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'ee65c386-9550-4e41-99e6-509acdb08f70'} Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:26.288002 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:23:26.289825 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:26.295478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7e43c4bb-b7e2-4b81-9517-1315a474d073 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:26.295478 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7e43c4bb-b7e2-4b81-9517-1315a474d073 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 404 len: 111 microversion: 2.1 time: 0.084250 Oct 18 13:23:26.295478 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 826/1698] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:26 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:26.297263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-276434474", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "f61d9dd3-2d30-4077-83fd-6cb55fe03a9c"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:26.346921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-58d2f06b-0199-4683-b41b-052645fe38c4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e631235f0d0c400981c97d9edb1ea7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f136eea39d84b04b5410eb0906c113e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:26.361032 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-58d2f06b-0199-4683-b41b-052645fe38c4 tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 200 len: 1468 microversion: 2.1 time: 0.449435 Oct 18 13:23:26.364718 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 873/1699] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:25 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 1468 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:26.411814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1270633853", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "b5cc8010-ea63-4e1f-9434-bf4391452206"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:26.478474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] validate_networks() for [('f61d9dd3-2d30-4077-83fd-6cb55fe03a9c', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:23:26.629922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] validate_networks() for [('b5cc8010-ea63-4e1f-9434-bf4391452206', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:23:27.466401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:23:27.466975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:23:27.467172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:23:27.467860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:23:27.468777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:23:27.512420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:27.513930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:27.514558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:27.518538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:27.521089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:27.522782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:27.568980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Getting quotas for project cf7c744c508342f5947ae08743ccc6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:23:27.577331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Getting quotas for user 2b3d9555419845cc9bc9f650e676d776 and project cf7c744c508342f5947ae08743ccc6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:23:27.595767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:23:27.600300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:23:27.635161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:23:27.635811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:23:27.637014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:23:27.637900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:23:27.638605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:23:27.656486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:27.658239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:27.662431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:27.664223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:27.665129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:27.667768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:27.705574 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bfde3c48-cf16-4e9c-9014-c12dc8b81388 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.416226 Oct 18 13:23:27.709270 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 827/1700] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:23:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:23:27.721600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-0fd1e9c6-c277-4ab7-a5dd-cf5009ea18f9 req-205341e3-4cf8-4140-a198-2bac399bb708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f199ac-a7c9-4a5c-929a-f734ea6c3d80", "name": "network-vif-deleted", "tag": "0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:27.722735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:23:27.736531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for user c0a722d1dc7c4e05b8cc8dc98b5cb619 and project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:23:27.756133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0fd1e9c6-c277-4ab7-a5dd-cf5009ea18f9 req-205341e3-4cf8-4140-a198-2bac399bb708 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:27.756619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0fd1e9c6-c277-4ab7-a5dd-cf5009ea18f9 req-205341e3-4cf8-4140-a198-2bac399bb708 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:27.757055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0fd1e9c6-c277-4ab7-a5dd-cf5009ea18f9 req-205341e3-4cf8-4140-a198-2bac399bb708 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:27.779090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:23:27.787605 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0fd1e9c6-c277-4ab7-a5dd-cf5009ea18f9 req-205341e3-4cf8-4140-a198-2bac399bb708 service nova] Creating event network-vif-deleted:0b1423cf-f5e3-48d7-a6e9-ce002fdd33d1 for instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 on n-h2-858384-13 Oct 18 13:23:27.788351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:23:27.796177 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-0fd1e9c6-c277-4ab7-a5dd-cf5009ea18f9 req-205341e3-4cf8-4140-a198-2bac399bb708 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085430 Oct 18 13:23:27.797678 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 828/1701] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:27.809601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-38a29a53-9b0c-4aba-8848-aba4eb87e989 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:27.810319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-38a29a53-9b0c-4aba-8848-aba4eb87e989 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:27.829928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38a29a53-9b0c-4aba-8848-aba4eb87e989 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:27.830439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38a29a53-9b0c-4aba-8848-aba4eb87e989 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:27.830881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38a29a53-9b0c-4aba-8848-aba4eb87e989 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:27.831604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38a29a53-9b0c-4aba-8848-aba4eb87e989 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:27.832056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38a29a53-9b0c-4aba-8848-aba4eb87e989 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:27.832684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38a29a53-9b0c-4aba-8848-aba4eb87e989 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:27.973523 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-32ba0127-5dee-4e34-a9e9-5d5af3dfadf9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.567538 Oct 18 13:23:27.978883 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 874/1702] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:23:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:23:27.989875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c80680cc-4617-4bc4-8eab-d73aac87ac94 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:27.996284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c80680cc-4617-4bc4-8eab-d73aac87ac94 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:28.030656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c80680cc-4617-4bc4-8eab-d73aac87ac94 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:28.031195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c80680cc-4617-4bc4-8eab-d73aac87ac94 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:28.035953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c80680cc-4617-4bc4-8eab-d73aac87ac94 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:28.039950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c80680cc-4617-4bc4-8eab-d73aac87ac94 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:28.044006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c80680cc-4617-4bc4-8eab-d73aac87ac94 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:28.046568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c80680cc-4617-4bc4-8eab-d73aac87ac94 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:28.566358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-38a29a53-9b0c-4aba-8848-aba4eb87e989 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:28.574605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c80680cc-4617-4bc4-8eab-d73aac87ac94 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:28.579071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-38a29a53-9b0c-4aba-8848-aba4eb87e989 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:28.582776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-38a29a53-9b0c-4aba-8848-aba4eb87e989 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:28.583983 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-38a29a53-9b0c-4aba-8848-aba4eb87e989 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1293 microversion: 2.25 time: 0.781765 Oct 18 13:23:28.584571 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 829/1703] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:27 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1293 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:28.588615 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c80680cc-4617-4bc4-8eab-d73aac87ac94 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1308 microversion: 2.1 time: 0.608509 Oct 18 13:23:28.590242 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 875/1704] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:27 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1308 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:28.596224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-310fdefe-2428-4846-aaad-6b7f9d472502 req-8bb903a2-d9db-473a-9736-a18bcf1aeccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2403d808-adf4-45f0-a631-cdc6fad44b76", "name": "network-vif-plugged", "status": "completed", "tag": "43a6f3fa-36dd-4b00-b299-1037fb97ee80"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:28.608400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-577e8c31-e454-437b-ba21-cc8d4e90d38e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:28.609387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-577e8c31-e454-437b-ba21-cc8d4e90d38e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] [instance: 89f199ac-a7c9-4a5c-929a-f734ea6c3d80] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:28.612010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-310fdefe-2428-4846-aaad-6b7f9d472502 req-8bb903a2-d9db-473a-9736-a18bcf1aeccb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:28.613138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-310fdefe-2428-4846-aaad-6b7f9d472502 req-8bb903a2-d9db-473a-9736-a18bcf1aeccb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:28.615111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-310fdefe-2428-4846-aaad-6b7f9d472502 req-8bb903a2-d9db-473a-9736-a18bcf1aeccb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:28.628012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-577e8c31-e454-437b-ba21-cc8d4e90d38e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:28.628513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-577e8c31-e454-437b-ba21-cc8d4e90d38e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:28.629202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-577e8c31-e454-437b-ba21-cc8d4e90d38e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:28.634197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-577e8c31-e454-437b-ba21-cc8d4e90d38e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:28.641746 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-310fdefe-2428-4846-aaad-6b7f9d472502 req-8bb903a2-d9db-473a-9736-a18bcf1aeccb service nova] Creating event network-vif-plugged:43a6f3fa-36dd-4b00-b299-1037fb97ee80 for instance 2403d808-adf4-45f0-a631-cdc6fad44b76 on n-h1-858384-13 Oct 18 13:23:28.642235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-577e8c31-e454-437b-ba21-cc8d4e90d38e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:28.642596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-577e8c31-e454-437b-ba21-cc8d4e90d38e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:28.651975 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-310fdefe-2428-4846-aaad-6b7f9d472502 req-8bb903a2-d9db-473a-9736-a18bcf1aeccb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060095 Oct 18 13:23:28.668109 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 876/1705] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:28.685050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d2cecddf-2769-4be0-b5cb-8ad0ff604af3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:28.687071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d2cecddf-2769-4be0-b5cb-8ad0ff604af3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:28.693297 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-577e8c31-e454-437b-ba21-cc8d4e90d38e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] HTTP exception thrown: Instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 could not be found. Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-577e8c31-e454-437b-ba21-cc8d4e90d38e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Request method failure captured: Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 HTTP/1.1 Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdX8yQuJt5IFSJD3aOvsWYs90nenULvdIoLlk8lIBbo-326hbxTW7vKPLz1QBvDHOysWrT6gNCKKiE0GP8iFjFnEy84OU4KRZuY0ARUrcFZRLKBxA1Q3fbVxq3qS8t71wC8kMawkrMDiwJi8jfpLmO3lsiOD6DFHHK_nxe6ut-1w4o Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 3f136eea39d84b04b5410eb0906c113e Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-MigrationsAdminTest-772254388 Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:23:28.695839 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:23:28.697600 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f136eea39d84b04b5410eb0906c113e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3f136eea39d84b04b5410eb0906c113e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3f136eea39d84b04b5410eb0906c113e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3f136eea39d84b04b5410eb0906c113e"}]}] Oct 18 13:23:28.697600 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-MigrationsAdminTest-772254388 Oct 18 13:23:28.697600 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 3f136eea39d84b04b5410eb0906c113e Oct 18 13:23:28.697600 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-MigrationsAdminTest-772254388 Oct 18 13:23:28.697600 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-MigrationsAdminTest-772254388-project Oct 18 13:23:28.697600 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:23:28.697600 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:23:28.697600 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e631235f0d0c400981c97d9edb1ea7fe Oct 18 13:23:28.697600 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-MigrationsAdminTest-772254388-project Oct 18 13:23:28.697600 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:23:28.697600 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 could not be found. Oct 18 13:23:28.697600 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '89f199ac-a7c9-4a5c-929a-f734ea6c3d80'} Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 could not be found. Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:28.698554 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 could not be found. Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 could not be found. Oct 18 13:23:28.699901 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:23:28.704219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-577e8c31-e454-437b-ba21-cc8d4e90d38e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] Returning 404 to user: Instance 89f199ac-a7c9-4a5c-929a-f734ea6c3d80 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:28.706686 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-577e8c31-e454-437b-ba21-cc8d4e90d38e tempest-MigrationsAdminTest-772254388 tempest-MigrationsAdminTest-772254388-project] 10.222.0.40 "GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80" status: 404 len: 111 microversion: 2.1 time: 0.121078 Oct 18 13:23:28.708785 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 830/1706] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:28 2022] GET /compute/v2.1/servers/89f199ac-a7c9-4a5c-929a-f734ea6c3d80 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:28.728791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-54fd8869-501e-4128-97a7-bbb3c596eee5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:28.729804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-54fd8869-501e-4128-97a7-bbb3c596eee5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:28.739723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:28.849474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d2cecddf-2769-4be0-b5cb-8ad0ff604af3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:28.861364 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d2cecddf-2769-4be0-b5cb-8ad0ff604af3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1210 microversion: 2.1 time: 0.188374 Oct 18 13:23:28.864222 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 877/1707] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:28 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1210 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:28.938316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-54fd8869-501e-4128-97a7-bbb3c596eee5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:28.964401 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-54fd8869-501e-4128-97a7-bbb3c596eee5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1215 microversion: 2.1 time: 0.242132 Oct 18 13:23:28.966510 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 831/1708] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:28 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1215 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:29.611167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e10ea74b-35a2-4106-acf4-5a6e66177b2b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:29.612808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e10ea74b-35a2-4106-acf4-5a6e66177b2b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:29.629333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e10ea74b-35a2-4106-acf4-5a6e66177b2b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:29.629834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e10ea74b-35a2-4106-acf4-5a6e66177b2b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:29.630282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e10ea74b-35a2-4106-acf4-5a6e66177b2b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:29.636940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e10ea74b-35a2-4106-acf4-5a6e66177b2b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:29.639487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e10ea74b-35a2-4106-acf4-5a6e66177b2b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:29.640401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e10ea74b-35a2-4106-acf4-5a6e66177b2b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:29.646517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6f836855-5855-4803-b35e-70c46cf036a2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:29.648362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6f836855-5855-4803-b35e-70c46cf036a2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:29.697028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f836855-5855-4803-b35e-70c46cf036a2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:29.697654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f836855-5855-4803-b35e-70c46cf036a2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:29.698980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f836855-5855-4803-b35e-70c46cf036a2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:29.702997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f836855-5855-4803-b35e-70c46cf036a2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:29.703664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f836855-5855-4803-b35e-70c46cf036a2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:29.706046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f836855-5855-4803-b35e-70c46cf036a2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:30.044976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6f836855-5855-4803-b35e-70c46cf036a2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:30.062018 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6f836855-5855-4803-b35e-70c46cf036a2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1308 microversion: 2.1 time: 0.422455 Oct 18 13:23:30.066862 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 832/1709] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:29 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:30.089346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-55ffe6c6-c933-42c8-a33a-afea897356da tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:30.090742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-55ffe6c6-c933-42c8-a33a-afea897356da tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:30.114980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55ffe6c6-c933-42c8-a33a-afea897356da tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:30.115800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55ffe6c6-c933-42c8-a33a-afea897356da tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:30.120479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55ffe6c6-c933-42c8-a33a-afea897356da tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:30.121869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55ffe6c6-c933-42c8-a33a-afea897356da tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:30.122530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55ffe6c6-c933-42c8-a33a-afea897356da tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:30.123138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55ffe6c6-c933-42c8-a33a-afea897356da tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:30.223450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e10ea74b-35a2-4106-acf4-5a6e66177b2b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:30.247944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e10ea74b-35a2-4106-acf4-5a6e66177b2b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:30.250055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e10ea74b-35a2-4106-acf4-5a6e66177b2b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:30.256953 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e10ea74b-35a2-4106-acf4-5a6e66177b2b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1293 microversion: 2.25 time: 0.649986 Oct 18 13:23:30.260777 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 878/1710] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:29 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1293 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:30.278565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6ae2dd01-d193-49c5-b477-769e80f6b8d1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:30.279526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6ae2dd01-d193-49c5-b477-769e80f6b8d1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:30.300416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ae2dd01-d193-49c5-b477-769e80f6b8d1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:30.305996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ae2dd01-d193-49c5-b477-769e80f6b8d1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:30.307680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ae2dd01-d193-49c5-b477-769e80f6b8d1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:30.314386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ae2dd01-d193-49c5-b477-769e80f6b8d1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:30.319344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ae2dd01-d193-49c5-b477-769e80f6b8d1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:30.322101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ae2dd01-d193-49c5-b477-769e80f6b8d1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:30.348863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-55ffe6c6-c933-42c8-a33a-afea897356da tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:30.360970 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-55ffe6c6-c933-42c8-a33a-afea897356da tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1262 microversion: 2.1 time: 0.289064 Oct 18 13:23:30.361713 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 833/1711] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:30 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1262 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:30.370174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5fce791b-b956-4310-966f-844a54ae29f5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:30.372693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5fce791b-b956-4310-966f-844a54ae29f5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:30.400631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fce791b-b956-4310-966f-844a54ae29f5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:30.401167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fce791b-b956-4310-966f-844a54ae29f5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:30.401656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fce791b-b956-4310-966f-844a54ae29f5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:30.402442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fce791b-b956-4310-966f-844a54ae29f5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:30.402945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fce791b-b956-4310-966f-844a54ae29f5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:30.403379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fce791b-b956-4310-966f-844a54ae29f5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:30.576314 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5fce791b-b956-4310-966f-844a54ae29f5 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.213254 Oct 18 13:23:30.582193 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 834/1712] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:23:30 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5/os-volume_attachments => generated 25 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:23:30.656785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ae2dd01-d193-49c5-b477-769e80f6b8d1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:30.668667 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6ae2dd01-d193-49c5-b477-769e80f6b8d1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1267 microversion: 2.1 time: 0.406461 Oct 18 13:23:30.685878 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 879/1713] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:30 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1267 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:30.776839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6bf8ea28-b66c-4f86-92fa-7474da030346 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:30.779382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6bf8ea28-b66c-4f86-92fa-7474da030346 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:30.797064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bf8ea28-b66c-4f86-92fa-7474da030346 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:30.797842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bf8ea28-b66c-4f86-92fa-7474da030346 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:30.799973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bf8ea28-b66c-4f86-92fa-7474da030346 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:30.800978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bf8ea28-b66c-4f86-92fa-7474da030346 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:30.803775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bf8ea28-b66c-4f86-92fa-7474da030346 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:30.804795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bf8ea28-b66c-4f86-92fa-7474da030346 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:30.896539 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6bf8ea28-b66c-4f86-92fa-7474da030346 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127821 Oct 18 13:23:30.924597 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 835/1714] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:23:30 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5/os-volume_attachments => generated 25 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:23:31.055816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c1e895b-f5f8-42a2-bfa5-9cf8266fa3a9 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:31.056235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7c1e895b-f5f8-42a2-bfa5-9cf8266fa3a9 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:31.069347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c1e895b-f5f8-42a2-bfa5-9cf8266fa3a9 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:31.070825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c1e895b-f5f8-42a2-bfa5-9cf8266fa3a9 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:31.071338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c1e895b-f5f8-42a2-bfa5-9cf8266fa3a9 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:31.072082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c1e895b-f5f8-42a2-bfa5-9cf8266fa3a9 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:31.077125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c1e895b-f5f8-42a2-bfa5-9cf8266fa3a9 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:31.077639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c1e895b-f5f8-42a2-bfa5-9cf8266fa3a9 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:31.090644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a002856f-af54-4165-b2ac-04b587a75984 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:31.091414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a002856f-af54-4165-b2ac-04b587a75984 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:31.130521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a002856f-af54-4165-b2ac-04b587a75984 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:31.146197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a002856f-af54-4165-b2ac-04b587a75984 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:31.149795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a002856f-af54-4165-b2ac-04b587a75984 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:31.154255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a002856f-af54-4165-b2ac-04b587a75984 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:31.157065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a002856f-af54-4165-b2ac-04b587a75984 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:31.167809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a002856f-af54-4165-b2ac-04b587a75984 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:31.171554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7c1e895b-f5f8-42a2-bfa5-9cf8266fa3a9 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:23:31.415099 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7c1e895b-f5f8-42a2-bfa5-9cf8266fa3a9 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 204 len: 0 microversion: 2.1 time: 0.362671 Oct 18 13:23:31.416223 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 880/1715] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:23:31 2022] DELETE /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:23:31.438759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3ff9db53-d69c-4994-b5d4-db2448344fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:31.440134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3ff9db53-d69c-4994-b5d4-db2448344fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:31.459256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ff9db53-d69c-4994-b5d4-db2448344fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:31.460627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ff9db53-d69c-4994-b5d4-db2448344fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:31.462811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ff9db53-d69c-4994-b5d4-db2448344fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:31.465898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ff9db53-d69c-4994-b5d4-db2448344fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:31.468105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ff9db53-d69c-4994-b5d4-db2448344fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:31.468936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ff9db53-d69c-4994-b5d4-db2448344fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:31.821458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a002856f-af54-4165-b2ac-04b587a75984 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:31.834924 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a002856f-af54-4165-b2ac-04b587a75984 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1489 microversion: 2.1 time: 0.748417 Oct 18 13:23:31.856849 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 836/1716] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:31 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1489 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:31.871088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f32e7628-07cf-46f4-9810-24e3749910ee tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:31.871701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f32e7628-07cf-46f4-9810-24e3749910ee tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:31.892374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ff9db53-d69c-4994-b5d4-db2448344fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:31.895402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:31.901926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f32e7628-07cf-46f4-9810-24e3749910ee tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:31.902305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f32e7628-07cf-46f4-9810-24e3749910ee tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:31.902923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f32e7628-07cf-46f4-9810-24e3749910ee tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:31.912888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ff9db53-d69c-4994-b5d4-db2448344fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:31.916735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ff9db53-d69c-4994-b5d4-db2448344fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:31.918715 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3ff9db53-d69c-4994-b5d4-db2448344fc8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1293 microversion: 2.25 time: 0.495543 Oct 18 13:23:31.935230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f32e7628-07cf-46f4-9810-24e3749910ee tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:31.935230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f32e7628-07cf-46f4-9810-24e3749910ee tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:31.935230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f32e7628-07cf-46f4-9810-24e3749910ee tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:31.949269 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 881/1717] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:31 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1293 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:31.967665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2e727788-fc21-46db-9395-4cc673654ba7 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:31.976272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2e727788-fc21-46db-9395-4cc673654ba7 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:32.017537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e727788-fc21-46db-9395-4cc673654ba7 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:32.018221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e727788-fc21-46db-9395-4cc673654ba7 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:32.018679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e727788-fc21-46db-9395-4cc673654ba7 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:32.025369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e727788-fc21-46db-9395-4cc673654ba7 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:32.026108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e727788-fc21-46db-9395-4cc673654ba7 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:32.026557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e727788-fc21-46db-9395-4cc673654ba7 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:32.038273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:32.152611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f32e7628-07cf-46f4-9810-24e3749910ee tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:32.166466 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f32e7628-07cf-46f4-9810-24e3749910ee tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1268 microversion: 2.1 time: 0.299105 Oct 18 13:23:32.182011 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 837/1718] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:31 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1268 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:32.195902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ab4855cc-5daf-4735-881f-6e0e2f522106 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:32.197731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ab4855cc-5daf-4735-881f-6e0e2f522106 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:32.208932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab4855cc-5daf-4735-881f-6e0e2f522106 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:32.209833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab4855cc-5daf-4735-881f-6e0e2f522106 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:32.211186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab4855cc-5daf-4735-881f-6e0e2f522106 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:32.212410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab4855cc-5daf-4735-881f-6e0e2f522106 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:32.213213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab4855cc-5daf-4735-881f-6e0e2f522106 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:32.213909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab4855cc-5daf-4735-881f-6e0e2f522106 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:32.340742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ab4855cc-5daf-4735-881f-6e0e2f522106 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:32.356554 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ab4855cc-5daf-4735-881f-6e0e2f522106 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1273 microversion: 2.1 time: 0.171741 Oct 18 13:23:32.358792 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 838/1719] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:32 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:32.377303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0b8ae6df-06c3-4372-bb57-d319199af749 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:32.378922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0b8ae6df-06c3-4372-bb57-d319199af749 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:32.396799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b8ae6df-06c3-4372-bb57-d319199af749 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:32.398909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b8ae6df-06c3-4372-bb57-d319199af749 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:32.399618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b8ae6df-06c3-4372-bb57-d319199af749 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:32.402318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b8ae6df-06c3-4372-bb57-d319199af749 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:32.403128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b8ae6df-06c3-4372-bb57-d319199af749 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:32.404897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b8ae6df-06c3-4372-bb57-d319199af749 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:32.441030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2e727788-fc21-46db-9395-4cc673654ba7 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:32.459626 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2e727788-fc21-46db-9395-4cc673654ba7 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1679 microversion: 2.1 time: 0.506004 Oct 18 13:23:32.460391 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 882/1720] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:31 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1679 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:32.498844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-0b8ae6df-06c3-4372-bb57-d319199af749 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lazy-loading 'flavor' on Instance uuid 2403d808-adf4-45f0-a631-cdc6fad44b76 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:23:32.796310 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0b8ae6df-06c3-4372-bb57-d319199af749 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76/action" status: 202 len: 0 microversion: 2.1 time: 0.432312 Oct 18 13:23:32.799228 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 839/1721] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:23:32 2022] POST /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:23:32.808699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-af17ff7a-9fdc-4eda-ad7d-a6f76a1afdac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:32.809355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-af17ff7a-9fdc-4eda-ad7d-a6f76a1afdac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:32.831597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af17ff7a-9fdc-4eda-ad7d-a6f76a1afdac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:32.832254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af17ff7a-9fdc-4eda-ad7d-a6f76a1afdac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:32.838300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af17ff7a-9fdc-4eda-ad7d-a6f76a1afdac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:32.839271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af17ff7a-9fdc-4eda-ad7d-a6f76a1afdac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:32.839765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af17ff7a-9fdc-4eda-ad7d-a6f76a1afdac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:32.840202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af17ff7a-9fdc-4eda-ad7d-a6f76a1afdac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:32.958369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5f2fc3c6-ecb2-4507-b8e2-8ac9f41c7a5b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:32.959202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5f2fc3c6-ecb2-4507-b8e2-8ac9f41c7a5b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:33.003719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f2fc3c6-ecb2-4507-b8e2-8ac9f41c7a5b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:33.008541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f2fc3c6-ecb2-4507-b8e2-8ac9f41c7a5b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:33.011262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f2fc3c6-ecb2-4507-b8e2-8ac9f41c7a5b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:33.016099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f2fc3c6-ecb2-4507-b8e2-8ac9f41c7a5b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:33.017072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f2fc3c6-ecb2-4507-b8e2-8ac9f41c7a5b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:33.021123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f2fc3c6-ecb2-4507-b8e2-8ac9f41c7a5b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:33.902932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5f2fc3c6-ecb2-4507-b8e2-8ac9f41c7a5b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:33.920455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5f2fc3c6-ecb2-4507-b8e2-8ac9f41c7a5b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:33.923548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5f2fc3c6-ecb2-4507-b8e2-8ac9f41c7a5b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:33.929588 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5f2fc3c6-ecb2-4507-b8e2-8ac9f41c7a5b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1293 microversion: 2.25 time: 0.987618 Oct 18 13:23:33.933935 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 840/1722] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:32 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1293 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:33.945483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f69cc243-3c44-4fe1-8bba-7cc47453610b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:33.946358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f69cc243-3c44-4fe1-8bba-7cc47453610b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:33.965905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f69cc243-3c44-4fe1-8bba-7cc47453610b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:33.967157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f69cc243-3c44-4fe1-8bba-7cc47453610b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:33.967974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f69cc243-3c44-4fe1-8bba-7cc47453610b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:33.969004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f69cc243-3c44-4fe1-8bba-7cc47453610b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:33.969513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f69cc243-3c44-4fe1-8bba-7cc47453610b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:33.969949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f69cc243-3c44-4fe1-8bba-7cc47453610b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:34.451847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-af17ff7a-9fdc-4eda-ad7d-a6f76a1afdac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:34.465737 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-af17ff7a-9fdc-4eda-ad7d-a6f76a1afdac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1497 microversion: 2.1 time: 1.656701 Oct 18 13:23:34.466718 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 883/1723] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:32 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1497 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:34.484969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5921a3e6-dd04-4868-b6ff-9ff0116e0895 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:34.490969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5921a3e6-dd04-4868-b6ff-9ff0116e0895 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:34.517651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5921a3e6-dd04-4868-b6ff-9ff0116e0895 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:34.518247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5921a3e6-dd04-4868-b6ff-9ff0116e0895 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:34.519005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5921a3e6-dd04-4868-b6ff-9ff0116e0895 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:34.520048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5921a3e6-dd04-4868-b6ff-9ff0116e0895 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:34.521318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5921a3e6-dd04-4868-b6ff-9ff0116e0895 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:34.524627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5921a3e6-dd04-4868-b6ff-9ff0116e0895 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:34.563889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f69cc243-3c44-4fe1-8bba-7cc47453610b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:34.574737 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f69cc243-3c44-4fe1-8bba-7cc47453610b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1310 microversion: 2.1 time: 0.638966 Oct 18 13:23:34.575526 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 841/1724] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:33 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1310 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:34.584568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-52b9f46f-e2f7-4863-a721-3dbf34869c7a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:34.586120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-52b9f46f-e2f7-4863-a721-3dbf34869c7a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:34.594471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52b9f46f-e2f7-4863-a721-3dbf34869c7a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:34.595106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52b9f46f-e2f7-4863-a721-3dbf34869c7a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:34.600991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52b9f46f-e2f7-4863-a721-3dbf34869c7a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:34.602347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52b9f46f-e2f7-4863-a721-3dbf34869c7a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:34.602929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52b9f46f-e2f7-4863-a721-3dbf34869c7a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:34.603599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52b9f46f-e2f7-4863-a721-3dbf34869c7a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:34.892669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-52b9f46f-e2f7-4863-a721-3dbf34869c7a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:34.912879 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-52b9f46f-e2f7-4863-a721-3dbf34869c7a tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1679 microversion: 2.1 time: 0.334298 Oct 18 13:23:34.915269 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 842/1725] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:34 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1679 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:34.967260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8a4e2f3c-ea48-407a-9f88-357945bbe29a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:34.968874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8a4e2f3c-ea48-407a-9f88-357945bbe29a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:34.986227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a4e2f3c-ea48-407a-9f88-357945bbe29a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:34.987259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a4e2f3c-ea48-407a-9f88-357945bbe29a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:34.987878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a4e2f3c-ea48-407a-9f88-357945bbe29a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:34.988970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a4e2f3c-ea48-407a-9f88-357945bbe29a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:34.989659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a4e2f3c-ea48-407a-9f88-357945bbe29a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:34.991605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a4e2f3c-ea48-407a-9f88-357945bbe29a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:35.024546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5921a3e6-dd04-4868-b6ff-9ff0116e0895 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:35.044639 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5921a3e6-dd04-4868-b6ff-9ff0116e0895 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1315 microversion: 2.1 time: 0.574984 Oct 18 13:23:35.050101 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 884/1726] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:34 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:35.392686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1c65e6e-d2d6-49cc-adb8-e15c70c284ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:35.394259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1c65e6e-d2d6-49cc-adb8-e15c70c284ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:35.404127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1c65e6e-d2d6-49cc-adb8-e15c70c284ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:35.405058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1c65e6e-d2d6-49cc-adb8-e15c70c284ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:35.405839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1c65e6e-d2d6-49cc-adb8-e15c70c284ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:35.406838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1c65e6e-d2d6-49cc-adb8-e15c70c284ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:35.407504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1c65e6e-d2d6-49cc-adb8-e15c70c284ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:35.408225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1c65e6e-d2d6-49cc-adb8-e15c70c284ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:35.768214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8a4e2f3c-ea48-407a-9f88-357945bbe29a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:35.783783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8a4e2f3c-ea48-407a-9f88-357945bbe29a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:35.786118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8a4e2f3c-ea48-407a-9f88-357945bbe29a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:35.787573 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8a4e2f3c-ea48-407a-9f88-357945bbe29a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1281 microversion: 2.25 time: 0.824954 Oct 18 13:23:35.814612 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 843/1727] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:34 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1281 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:23:35.828155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7d044b2-106d-4074-808a-833e4e07d0fd tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:35.829916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f7d044b2-106d-4074-808a-833e4e07d0fd tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:35.851795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7d044b2-106d-4074-808a-833e4e07d0fd tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:35.852292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7d044b2-106d-4074-808a-833e4e07d0fd tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:35.852728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7d044b2-106d-4074-808a-833e4e07d0fd tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:35.858071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7d044b2-106d-4074-808a-833e4e07d0fd tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:35.861114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7d044b2-106d-4074-808a-833e4e07d0fd tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:35.863608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7d044b2-106d-4074-808a-833e4e07d0fd tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:35.903644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:36.000343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d1c65e6e-d2d6-49cc-adb8-e15c70c284ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:36.019682 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d1c65e6e-d2d6-49cc-adb8-e15c70c284ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.630846 Oct 18 13:23:36.020689 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 885/1728] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:35 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:36.041096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5b9ea6f1-3c63-41ff-bf38-55e39a843b99 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:36.042375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5b9ea6f1-3c63-41ff-bf38-55e39a843b99 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:36.056082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b9ea6f1-3c63-41ff-bf38-55e39a843b99 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:36.056979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b9ea6f1-3c63-41ff-bf38-55e39a843b99 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:36.057979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b9ea6f1-3c63-41ff-bf38-55e39a843b99 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:36.060233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b9ea6f1-3c63-41ff-bf38-55e39a843b99 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:36.061483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b9ea6f1-3c63-41ff-bf38-55e39a843b99 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:36.062415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b9ea6f1-3c63-41ff-bf38-55e39a843b99 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:36.381316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f7d044b2-106d-4074-808a-833e4e07d0fd tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:36.390166 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f7d044b2-106d-4074-808a-833e4e07d0fd tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 200 len: 1480 microversion: 2.1 time: 0.571880 Oct 18 13:23:36.393617 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 844/1729] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:35 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 1480 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:36.400157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:36.400880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:36.408062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:36.408637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:36.409105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:36.410176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:36.410785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:36.411861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:36.416555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5b9ea6f1-3c63-41ff-bf38-55e39a843b99 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:36.430691 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5b9ea6f1-3c63-41ff-bf38-55e39a843b99 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1310 microversion: 2.1 time: 0.408600 Oct 18 13:23:36.442457 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 886/1730] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:36 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1310 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:36.447669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-92fd3f18-1b61-41a4-aa41-bf9eaaf64a30 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1523730248"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:36.456136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-92fd3f18-1b61-41a4-aa41-bf9eaaf64a30 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:36.493240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92fd3f18-1b61-41a4-aa41-bf9eaaf64a30 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:36.493796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92fd3f18-1b61-41a4-aa41-bf9eaaf64a30 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:36.494256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92fd3f18-1b61-41a4-aa41-bf9eaaf64a30 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:36.494981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92fd3f18-1b61-41a4-aa41-bf9eaaf64a30 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:36.495444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92fd3f18-1b61-41a4-aa41-bf9eaaf64a30 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:36.496090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92fd3f18-1b61-41a4-aa41-bf9eaaf64a30 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:36.525556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:36.526495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:36.532685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:36.535883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lazy-loading 'fault' on Instance uuid b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:23:36.866012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec522b9bfa0455084d74f7bfabe183c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4fe5608ed40079ecd55a948937103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:36.878333 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e3a94557-bc0c-41d5-a690-90dcccab89a3 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 200 len: 1331 microversion: 2.1 time: 0.483510 Oct 18 13:23:36.879846 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 845/1731] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:36 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 1331 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:36.887238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-69be9c29-db5b-43bf-8121-10f04658daf2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:36.888739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-69be9c29-db5b-43bf-8121-10f04658daf2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:36.898169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69be9c29-db5b-43bf-8121-10f04658daf2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:36.899098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69be9c29-db5b-43bf-8121-10f04658daf2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:36.900919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69be9c29-db5b-43bf-8121-10f04658daf2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:36.902297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69be9c29-db5b-43bf-8121-10f04658daf2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:36.904584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69be9c29-db5b-43bf-8121-10f04658daf2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:36.905512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69be9c29-db5b-43bf-8121-10f04658daf2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:36.972936 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-92fd3f18-1b61-41a4-aa41-bf9eaaf64a30 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.529026 Oct 18 13:23:36.985538 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 887/1732] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:23:36 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 18 13:23:37.221645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b4be0c1c-3d7c-4e11-8099-b7ad27769108 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Action: 'update', calling method: .version_select at 0x7ff60f7ad040>, body: {"quota_set": {"ram": "5120"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:37.338058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4be0c1c-3d7c-4e11-8099-b7ad27769108 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:37.338550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4be0c1c-3d7c-4e11-8099-b7ad27769108 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:37.344489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4be0c1c-3d7c-4e11-8099-b7ad27769108 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:37.346008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4be0c1c-3d7c-4e11-8099-b7ad27769108 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:37.346786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4be0c1c-3d7c-4e11-8099-b7ad27769108 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:37.347486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4be0c1c-3d7c-4e11-8099-b7ad27769108 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:37.477772 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b4be0c1c-3d7c-4e11-8099-b7ad27769108 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/256fbc3f21ad430f838e45c35fb536d2" status: 200 len: 148 microversion: 2.57 time: 0.490631 Oct 18 13:23:37.485608 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 888/1733] 10.222.0.40 () {62 vars in 1303 bytes} [Tue Oct 18 13:23:36 2022] PUT /compute/v2.1/os-quota-sets/256fbc3f21ad430f838e45c35fb536d2 => generated 148 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:23:37.491619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-a60b4359-250c-4331-9d52-8c0e9d0b40e6 req-72533adf-6ca8-4e94-8129-1c6ffedc3bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5", "name": "network-vif-deleted", "tag": "c3e8ef87-af4e-4090-bad2-4230866897d8"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:37.502853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a60b4359-250c-4331-9d52-8c0e9d0b40e6 req-72533adf-6ca8-4e94-8129-1c6ffedc3bd1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:37.503727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a60b4359-250c-4331-9d52-8c0e9d0b40e6 req-72533adf-6ca8-4e94-8129-1c6ffedc3bd1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:37.504397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a60b4359-250c-4331-9d52-8c0e9d0b40e6 req-72533adf-6ca8-4e94-8129-1c6ffedc3bd1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:37.520034 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-a60b4359-250c-4331-9d52-8c0e9d0b40e6 req-72533adf-6ca8-4e94-8129-1c6ffedc3bd1 service nova] Creating event network-vif-deleted:c3e8ef87-af4e-4090-bad2-4230866897d8 for instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 on n-h2-858384-13 Oct 18 13:23:37.527114 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-a60b4359-250c-4331-9d52-8c0e9d0b40e6 req-72533adf-6ca8-4e94-8129-1c6ffedc3bd1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039632 Oct 18 13:23:37.528173 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 889/1734] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:37.536516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a700a534-4109-4ec2-b2ab-aa41495ff70a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1188694957"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:37.539822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a700a534-4109-4ec2-b2ab-aa41495ff70a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:37.548950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a700a534-4109-4ec2-b2ab-aa41495ff70a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:37.549871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a700a534-4109-4ec2-b2ab-aa41495ff70a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:37.550611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a700a534-4109-4ec2-b2ab-aa41495ff70a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:37.551577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a700a534-4109-4ec2-b2ab-aa41495ff70a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:37.551828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:37.552937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a700a534-4109-4ec2-b2ab-aa41495ff70a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:37.553672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a700a534-4109-4ec2-b2ab-aa41495ff70a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:37.565676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-69be9c29-db5b-43bf-8121-10f04658daf2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:37.588226 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-69be9c29-db5b-43bf-8121-10f04658daf2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1315 microversion: 2.1 time: 0.706647 Oct 18 13:23:37.589627 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 846/1735] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:36 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:37.594650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-59138ad8-dd30-4f90-bbb3-314ac94991f0 req-d714fb72-3c52-47da-abaa-1a3ba6433fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0e67b4b-fc1a-4c86-80bc-afaddef3d664", "tag": "4701da41-d271-440c-847d-ed6212bf8189"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:37.608702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-59138ad8-dd30-4f90-bbb3-314ac94991f0 req-d714fb72-3c52-47da-abaa-1a3ba6433fed service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:37.610149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-59138ad8-dd30-4f90-bbb3-314ac94991f0 req-d714fb72-3c52-47da-abaa-1a3ba6433fed service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:37.610864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-59138ad8-dd30-4f90-bbb3-314ac94991f0 req-d714fb72-3c52-47da-abaa-1a3ba6433fed service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:37.633706 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-59138ad8-dd30-4f90-bbb3-314ac94991f0 req-d714fb72-3c52-47da-abaa-1a3ba6433fed service nova] Creating event network-changed:4701da41-d271-440c-847d-ed6212bf8189 for instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 on n-h2-858384-13 Oct 18 13:23:37.640531 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-59138ad8-dd30-4f90-bbb3-314ac94991f0 req-d714fb72-3c52-47da-abaa-1a3ba6433fed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049288 Oct 18 13:23:37.641666 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 847/1736] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:37.656323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d7b5710-f917-48a5-a2a3-638846ef4338 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:37.657157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4d7b5710-f917-48a5-a2a3-638846ef4338 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:37.668467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7b5710-f917-48a5-a2a3-638846ef4338 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:37.677686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7b5710-f917-48a5-a2a3-638846ef4338 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:37.678580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7b5710-f917-48a5-a2a3-638846ef4338 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:37.679904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7b5710-f917-48a5-a2a3-638846ef4338 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:37.680739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7b5710-f917-48a5-a2a3-638846ef4338 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:37.684908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7b5710-f917-48a5-a2a3-638846ef4338 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:37.964580 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a700a534-4109-4ec2-b2ab-aa41495ff70a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76/action" status: 202 len: 0 microversion: 2.1 time: 0.434544 Oct 18 13:23:37.971288 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 890/1737] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:23:37 2022] POST /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:23:37.982465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2322144c-f6f7-40b6-ad3a-34305ae7e39f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:37.983433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2322144c-f6f7-40b6-ad3a-34305ae7e39f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:37.992511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4d7b5710-f917-48a5-a2a3-638846ef4338 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:38.003929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2322144c-f6f7-40b6-ad3a-34305ae7e39f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:38.004431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2322144c-f6f7-40b6-ad3a-34305ae7e39f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:38.004865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2322144c-f6f7-40b6-ad3a-34305ae7e39f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:38.005610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2322144c-f6f7-40b6-ad3a-34305ae7e39f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:38.006063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2322144c-f6f7-40b6-ad3a-34305ae7e39f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:38.006483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2322144c-f6f7-40b6-ad3a-34305ae7e39f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:38.007923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4d7b5710-f917-48a5-a2a3-638846ef4338 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:38.010257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4d7b5710-f917-48a5-a2a3-638846ef4338 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:38.011463 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d7b5710-f917-48a5-a2a3-638846ef4338 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1281 microversion: 2.25 time: 0.368602 Oct 18 13:23:38.012365 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 848/1738] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:37 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1281 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:38.024644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0b43894d-23c4-4ee9-a267-e3d255060569 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:38.025298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0b43894d-23c4-4ee9-a267-e3d255060569 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:38.041224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b43894d-23c4-4ee9-a267-e3d255060569 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:38.041721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b43894d-23c4-4ee9-a267-e3d255060569 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:38.042157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b43894d-23c4-4ee9-a267-e3d255060569 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:38.042870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b43894d-23c4-4ee9-a267-e3d255060569 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:38.043321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b43894d-23c4-4ee9-a267-e3d255060569 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:38.043747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b43894d-23c4-4ee9-a267-e3d255060569 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:38.217235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0b43894d-23c4-4ee9-a267-e3d255060569 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:38.232886 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0b43894d-23c4-4ee9-a267-e3d255060569 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1310 microversion: 2.1 time: 0.219257 Oct 18 13:23:38.235094 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 849/1739] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:38 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1310 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:38.239956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6d38b07d-8594-4d9a-a12d-95e5d6e4c026 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Calling method '.version_select at 0x7ff61449e8b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:38.316157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2322144c-f6f7-40b6-ad3a-34305ae7e39f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:38.326747 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2322144c-f6f7-40b6-ad3a-34305ae7e39f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.350824 Oct 18 13:23:38.327851 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 891/1740] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:37 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:38.349134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-80c1dfa5-eb3f-41c0-a715-a4a51baf9458 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:38.349766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-80c1dfa5-eb3f-41c0-a715-a4a51baf9458 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:38.368955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d38b07d-8594-4d9a-a12d-95e5d6e4c026 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:38.369471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d38b07d-8594-4d9a-a12d-95e5d6e4c026 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:38.369905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d38b07d-8594-4d9a-a12d-95e5d6e4c026 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:38.371650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80c1dfa5-eb3f-41c0-a715-a4a51baf9458 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:38.373330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80c1dfa5-eb3f-41c0-a715-a4a51baf9458 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:38.373831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80c1dfa5-eb3f-41c0-a715-a4a51baf9458 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:38.374272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d38b07d-8594-4d9a-a12d-95e5d6e4c026 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:38.375007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d38b07d-8594-4d9a-a12d-95e5d6e4c026 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:38.376005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80c1dfa5-eb3f-41c0-a715-a4a51baf9458 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:38.376657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d38b07d-8594-4d9a-a12d-95e5d6e4c026 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:38.377824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80c1dfa5-eb3f-41c0-a715-a4a51baf9458 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:38.381300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80c1dfa5-eb3f-41c0-a715-a4a51baf9458 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:38.403020 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-80c1dfa5-eb3f-41c0-a715-a4a51baf9458 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] HTTP exception thrown: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-80c1dfa5-eb3f-41c0-a715-a4a51baf9458 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Request method failure captured: Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 HTTP/1.1 Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgp-XynwA5fnh8xfo_e1Xez3ZQrpG2OZ2GDDOdeClVeE25Fp5cOJMRxUiV1HzbvILVx8bRSGavI4tbbWcVNvOMFaq4eDX9KmcP_22Mt4VErL5m8Z1U6Lg1enDnMCF4vMq6A--nGrIqOVVzjrFJCgnSyzr7o7zk7_sYuDBHWvuqaUEA Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: bbe4fe5608ed40079ecd55a948937103 Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2000558643 Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:23:38.404971 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:23:38.406881 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbe4fe5608ed40079ecd55a948937103"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bbe4fe5608ed40079ecd55a948937103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbe4fe5608ed40079ecd55a948937103"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bbe4fe5608ed40079ecd55a948937103"}]}] Oct 18 13:23:38.406881 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2000558643 Oct 18 13:23:38.406881 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: bbe4fe5608ed40079ecd55a948937103 Oct 18 13:23:38.406881 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2000558643 Oct 18 13:23:38.406881 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachSCSIVolumeTestJSON-2000558643-project Oct 18 13:23:38.406881 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:23:38.406881 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:23:38.406881 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 4ec522b9bfa0455084d74f7bfabe183c Oct 18 13:23:38.406881 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2000558643-project Oct 18 13:23:38.406881 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:23:38.406881 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:38.406881 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5'} Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:38.407862 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:38.409641 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:38.411154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-80c1dfa5-eb3f-41c0-a715-a4a51baf9458 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Returning 404 to user: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:38.411154 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-80c1dfa5-eb3f-41c0-a715-a4a51baf9458 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 404 len: 111 microversion: 2.1 time: 0.077723 Oct 18 13:23:38.412031 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 892/1741] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:38 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:38.417755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0862e088-146a-4e3b-a208-5de017309d62 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617bbee50>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:38.432546 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6d38b07d-8594-4d9a-a12d-95e5d6e4c026 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/256fbc3f21ad430f838e45c35fb536d2/detail" status: 200 len: 463 microversion: 2.57 time: 0.197362 Oct 18 13:23:38.441021 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 850/1742] 10.222.0.40 () {60 vars in 1304 bytes} [Tue Oct 18 13:23:38 2022] GET /compute/v2.1/os-quota-sets/256fbc3f21ad430f838e45c35fb536d2/detail => generated 463 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:23:38.457326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b5bc928d-b51d-4261-9757-06bb7640ec19 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '.version_select at 0x7ff60fce5e50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:38.504354 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0862e088-146a-4e3b-a208-5de017309d62 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8" status: 200 len: 1436 microversion: 2.1 time: 0.091407 Oct 18 13:23:38.507544 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 893/1743] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:38 2022] GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8 => generated 1436 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:38.528768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-28f681ea-b51c-4aab-a607-cd6d0152e2e5 req-1d1fcb1a-49a2-461b-ba8e-f29087d7a419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aad90b5-28fb-44b2-89da-33bc1b2889f2", "name": "network-vif-unplugged", "status": "completed", "tag": "516c3ad3-1e31-4bde-b674-c0c367989f56"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:38.539795 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b5bc928d-b51d-4261-9757-06bb7640ec19 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146475713" status: 202 len: 0 microversion: 2.1 time: 0.096452 Oct 18 13:23:38.544712 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 851/1744] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:23:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146475713 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:23:38.558946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-28f681ea-b51c-4aab-a607-cd6d0152e2e5 req-1d1fcb1a-49a2-461b-ba8e-f29087d7a419 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:38.559481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-28f681ea-b51c-4aab-a607-cd6d0152e2e5 req-1d1fcb1a-49a2-461b-ba8e-f29087d7a419 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:38.560284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-28f681ea-b51c-4aab-a607-cd6d0152e2e5 req-1d1fcb1a-49a2-461b-ba8e-f29087d7a419 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:38.583649 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-28f681ea-b51c-4aab-a607-cd6d0152e2e5 req-1d1fcb1a-49a2-461b-ba8e-f29087d7a419 service nova] Creating event network-vif-unplugged:516c3ad3-1e31-4bde-b674-c0c367989f56 for instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 on n-h1-858384-13 Oct 18 13:23:38.591602 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-28f681ea-b51c-4aab-a607-cd6d0152e2e5 req-1d1fcb1a-49a2-461b-ba8e-f29087d7a419 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078593 Oct 18 13:23:38.593197 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 894/1745] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:38.614382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0fe939c3-fcf2-4fca-ba4f-bbc8886b626a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:38.618588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0fe939c3-fcf2-4fca-ba4f-bbc8886b626a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:38.638649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fe939c3-fcf2-4fca-ba4f-bbc8886b626a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:38.642540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fe939c3-fcf2-4fca-ba4f-bbc8886b626a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:38.644327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fe939c3-fcf2-4fca-ba4f-bbc8886b626a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:38.645537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fe939c3-fcf2-4fca-ba4f-bbc8886b626a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:38.651649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fe939c3-fcf2-4fca-ba4f-bbc8886b626a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:38.656594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fe939c3-fcf2-4fca-ba4f-bbc8886b626a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:38.863912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Action: 'update', calling method: .version_select at 0x7ff617b81550>, body: {"quota_set": {"ram": "2048"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:38.985330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0fe939c3-fcf2-4fca-ba4f-bbc8886b626a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:38.997395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:39.000373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:39.002478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:39.003387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:39.005698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:39.007403 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0fe939c3-fcf2-4fca-ba4f-bbc8886b626a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1315 microversion: 2.1 time: 0.397604 Oct 18 13:23:39.008189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:39.012342 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 852/1746] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:38 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:39.040644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-92d7e244-9205-4916-965f-daa3ce5a5014 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:39.042282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-92d7e244-9205-4916-965f-daa3ce5a5014 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:39.050319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92d7e244-9205-4916-965f-daa3ce5a5014 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:39.050758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92d7e244-9205-4916-965f-daa3ce5a5014 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:39.051422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92d7e244-9205-4916-965f-daa3ce5a5014 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:39.052625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92d7e244-9205-4916-965f-daa3ce5a5014 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:39.053560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92d7e244-9205-4916-965f-daa3ce5a5014 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:39.054944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92d7e244-9205-4916-965f-daa3ce5a5014 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:39.068968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:39.070300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:39.071297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:39.072914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:39.073559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:39.074239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:39.141806 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f4b4e2f8-6cda-4733-91f1-9ed967f90f19 tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/256fbc3f21ad430f838e45c35fb536d2?user_id=f4b69fe9891c466aafa622ae15340653" status: 200 len: 148 microversion: 2.57 time: 0.282821 Oct 18 13:23:39.142941 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 895/1747] 10.222.0.40 () {62 vars in 1384 bytes} [Tue Oct 18 13:23:38 2022] PUT /compute/v2.1/os-quota-sets/256fbc3f21ad430f838e45c35fb536d2?user_id=f4b69fe9891c466aafa622ae15340653 => generated 148 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:23:39.157526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-48acb2bf-8aa9-4232-be76-4ee506eecacb tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] Calling method '.version_select at 0x7ff617b2ff70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:39.295011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-92d7e244-9205-4916-965f-daa3ce5a5014 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:39.300431 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-48acb2bf-8aa9-4232-be76-4ee506eecacb tempest-QuotasAdminTestV257-261027060 tempest-QuotasAdminTestV257-261027060-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/256fbc3f21ad430f838e45c35fb536d2?user_id=f4b69fe9891c466aafa622ae15340653" status: 200 len: 190 microversion: 2.57 time: 0.148916 Oct 18 13:23:39.301628 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 896/1748] 10.222.0.40 () {60 vars in 1364 bytes} [Tue Oct 18 13:23:39 2022] GET /compute/v2.1/os-quota-sets/256fbc3f21ad430f838e45c35fb536d2?user_id=f4b69fe9891c466aafa622ae15340653 => generated 190 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:23:39.307210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f06d94a2-d312-4f4d-9752-fc2cc3c6e803 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:39.308184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f06d94a2-d312-4f4d-9752-fc2cc3c6e803 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:39.312178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-92d7e244-9205-4916-965f-daa3ce5a5014 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:39.314365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-92d7e244-9205-4916-965f-daa3ce5a5014 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:39.315717 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-92d7e244-9205-4916-965f-daa3ce5a5014 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1281 microversion: 2.25 time: 0.280207 Oct 18 13:23:39.315931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f06d94a2-d312-4f4d-9752-fc2cc3c6e803 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:39.316770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f06d94a2-d312-4f4d-9752-fc2cc3c6e803 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:39.317333 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 853/1749] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:39 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1281 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:23:39.318008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f06d94a2-d312-4f4d-9752-fc2cc3c6e803 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:39.319088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f06d94a2-d312-4f4d-9752-fc2cc3c6e803 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:39.320271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f06d94a2-d312-4f4d-9752-fc2cc3c6e803 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:39.320824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f06d94a2-d312-4f4d-9752-fc2cc3c6e803 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:39.363378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fc53b938-8e63-47b5-ab54-17dfd2f3d050 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:39.365142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fc53b938-8e63-47b5-ab54-17dfd2f3d050 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:39.374961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc53b938-8e63-47b5-ab54-17dfd2f3d050 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:39.375735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc53b938-8e63-47b5-ab54-17dfd2f3d050 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:39.376534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc53b938-8e63-47b5-ab54-17dfd2f3d050 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:39.377971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc53b938-8e63-47b5-ab54-17dfd2f3d050 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:39.378796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc53b938-8e63-47b5-ab54-17dfd2f3d050 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:39.379417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc53b938-8e63-47b5-ab54-17dfd2f3d050 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:39.566421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f06d94a2-d312-4f4d-9752-fc2cc3c6e803 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:39.576016 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f06d94a2-d312-4f4d-9752-fc2cc3c6e803 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1310 microversion: 2.1 time: 0.273149 Oct 18 13:23:39.576933 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 897/1750] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:39 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1310 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:39.582181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c5411808-4367-4ec5-8a0e-4886a2e563f4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617ac4f70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:39.670306 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c5411808-4367-4ec5-8a0e-4886a2e563f4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8" status: 200 len: 1436 microversion: 2.1 time: 0.091033 Oct 18 13:23:39.672006 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 898/1751] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:39 2022] GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8 => generated 1436 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:39.682324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-970e0365-28d0-44ed-84a5-be951692e432 req-13ac1266-6268-4fad-af4e-836ee4538a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0797de-276a-489b-aab7-16391ac1d0d3", "tag": "e9a57904-7800-46a5-9a77-79c987e77696"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:39.708042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fc53b938-8e63-47b5-ab54-17dfd2f3d050 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:39.708552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-970e0365-28d0-44ed-84a5-be951692e432 req-13ac1266-6268-4fad-af4e-836ee4538a79 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:39.709555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-970e0365-28d0-44ed-84a5-be951692e432 req-13ac1266-6268-4fad-af4e-836ee4538a79 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:39.710247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-970e0365-28d0-44ed-84a5-be951692e432 req-13ac1266-6268-4fad-af4e-836ee4538a79 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:39.721813 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fc53b938-8e63-47b5-ab54-17dfd2f3d050 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.373303 Oct 18 13:23:39.724948 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 854/1752] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:39 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:39.726574 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-970e0365-28d0-44ed-84a5-be951692e432 req-13ac1266-6268-4fad-af4e-836ee4538a79 service nova] Creating event network-changed:e9a57904-7800-46a5-9a77-79c987e77696 for instance 3a0797de-276a-489b-aab7-16391ac1d0d3 on n-h2-858384-13 Oct 18 13:23:39.744222 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-970e0365-28d0-44ed-84a5-be951692e432 req-13ac1266-6268-4fad-af4e-836ee4538a79 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070507 Oct 18 13:23:39.745667 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 899/1753] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:40.037142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d404033-b9e3-4320-adb1-dcc724c75fe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:40.038531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4d404033-b9e3-4320-adb1-dcc724c75fe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:40.054783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d404033-b9e3-4320-adb1-dcc724c75fe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:40.058315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d404033-b9e3-4320-adb1-dcc724c75fe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:40.058886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d404033-b9e3-4320-adb1-dcc724c75fe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:40.059626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d404033-b9e3-4320-adb1-dcc724c75fe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:40.060285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d404033-b9e3-4320-adb1-dcc724c75fe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:40.062031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d404033-b9e3-4320-adb1-dcc724c75fe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:40.351660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4b3ad06d-917f-4fee-b772-e190a6dfc105 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:40.352448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4b3ad06d-917f-4fee-b772-e190a6dfc105 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:40.377169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b3ad06d-917f-4fee-b772-e190a6dfc105 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:40.378491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b3ad06d-917f-4fee-b772-e190a6dfc105 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:40.379684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b3ad06d-917f-4fee-b772-e190a6dfc105 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:40.384207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b3ad06d-917f-4fee-b772-e190a6dfc105 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:40.384712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b3ad06d-917f-4fee-b772-e190a6dfc105 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:40.389486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b3ad06d-917f-4fee-b772-e190a6dfc105 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:40.643428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4d404033-b9e3-4320-adb1-dcc724c75fe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:40.660531 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d404033-b9e3-4320-adb1-dcc724c75fe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1315 microversion: 2.1 time: 0.626168 Oct 18 13:23:40.662385 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 855/1754] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:40 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:40.680585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a3487fb5-2d28-4b6e-ae39-de4894fd3a51 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:40.696573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a3487fb5-2d28-4b6e-ae39-de4894fd3a51 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:40.728650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3487fb5-2d28-4b6e-ae39-de4894fd3a51 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:40.729946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3487fb5-2d28-4b6e-ae39-de4894fd3a51 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:40.730411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3487fb5-2d28-4b6e-ae39-de4894fd3a51 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:40.732421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3487fb5-2d28-4b6e-ae39-de4894fd3a51 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:40.737986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3487fb5-2d28-4b6e-ae39-de4894fd3a51 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:40.738634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3487fb5-2d28-4b6e-ae39-de4894fd3a51 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:41.059220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a3487fb5-2d28-4b6e-ae39-de4894fd3a51 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:41.093956 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a3487fb5-2d28-4b6e-ae39-de4894fd3a51 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1310 microversion: 2.1 time: 0.415013 Oct 18 13:23:41.104362 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 856/1755] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:40 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1310 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:41.115379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-98bb64f6-cbfc-4ca5-898d-6f6c8860a7a2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60ff145e0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:41.173968 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-98bb64f6-cbfc-4ca5-898d-6f6c8860a7a2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8" status: 200 len: 1436 microversion: 2.1 time: 0.067446 Oct 18 13:23:41.180145 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 857/1756] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:41 2022] GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8 => generated 1436 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:41.193515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb10437a-ced6-4979-a71d-959b650f353f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:41.198178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eb10437a-ced6-4979-a71d-959b650f353f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:41.215459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb10437a-ced6-4979-a71d-959b650f353f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:41.221507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb10437a-ced6-4979-a71d-959b650f353f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:41.222377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb10437a-ced6-4979-a71d-959b650f353f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:41.223967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb10437a-ced6-4979-a71d-959b650f353f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:41.224971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb10437a-ced6-4979-a71d-959b650f353f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:41.226637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb10437a-ced6-4979-a71d-959b650f353f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:41.478684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b3ad06d-917f-4fee-b772-e190a6dfc105 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:41.497048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b3ad06d-917f-4fee-b772-e190a6dfc105 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:41.502992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b3ad06d-917f-4fee-b772-e190a6dfc105 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:41.506733 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4b3ad06d-917f-4fee-b772-e190a6dfc105 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1281 microversion: 2.25 time: 1.162820 Oct 18 13:23:41.509469 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 900/1757] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:40 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1281 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:41.705710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2fb00661-ba8a-48ff-8a95-471bd34ab327 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:41.706337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2fb00661-ba8a-48ff-8a95-471bd34ab327 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:41.721282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb00661-ba8a-48ff-8a95-471bd34ab327 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:41.721786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb00661-ba8a-48ff-8a95-471bd34ab327 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:41.722230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb00661-ba8a-48ff-8a95-471bd34ab327 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:41.722943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb00661-ba8a-48ff-8a95-471bd34ab327 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:41.723713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb00661-ba8a-48ff-8a95-471bd34ab327 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:41.724228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb00661-ba8a-48ff-8a95-471bd34ab327 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:42.045730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eb10437a-ced6-4979-a71d-959b650f353f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:42.055375 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eb10437a-ced6-4979-a71d-959b650f353f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1688 microversion: 2.1 time: 0.871211 Oct 18 13:23:42.056330 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 858/1758] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:41 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1688 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:42.131250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b2f51671-7603-4e03-9fa4-d0abf03290e3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:42.132387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b2f51671-7603-4e03-9fa4-d0abf03290e3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:42.147085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2f51671-7603-4e03-9fa4-d0abf03290e3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:42.148079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2f51671-7603-4e03-9fa4-d0abf03290e3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:42.149655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2f51671-7603-4e03-9fa4-d0abf03290e3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:42.152653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2f51671-7603-4e03-9fa4-d0abf03290e3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:42.154522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2f51671-7603-4e03-9fa4-d0abf03290e3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:42.160014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2f51671-7603-4e03-9fa4-d0abf03290e3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:42.207666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2fb00661-ba8a-48ff-8a95-471bd34ab327 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:42.221483 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2fb00661-ba8a-48ff-8a95-471bd34ab327 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1315 microversion: 2.1 time: 0.520463 Oct 18 13:23:42.239469 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 901/1759] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:41 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:42.269360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9b740912-4596-462f-ab77-f43080a7d1c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617b7f310>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:42.364539 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9b740912-4596-462f-ab77-f43080a7d1c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8" status: 200 len: 1436 microversion: 2.1 time: 0.120598 Oct 18 13:23:42.377639 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 902/1760] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:42 2022] GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8 => generated 1436 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:42.541792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-365adc4c-9b91-4b63-94e2-b4381e148b9d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:42.542449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-365adc4c-9b91-4b63-94e2-b4381e148b9d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:42.573942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-365adc4c-9b91-4b63-94e2-b4381e148b9d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:42.574664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-365adc4c-9b91-4b63-94e2-b4381e148b9d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:42.580876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-365adc4c-9b91-4b63-94e2-b4381e148b9d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:42.586227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-365adc4c-9b91-4b63-94e2-b4381e148b9d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:42.591055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-365adc4c-9b91-4b63-94e2-b4381e148b9d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:42.605569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-365adc4c-9b91-4b63-94e2-b4381e148b9d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:42.623191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b2f51671-7603-4e03-9fa4-d0abf03290e3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:42.646657 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b2f51671-7603-4e03-9fa4-d0abf03290e3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1310 microversion: 2.1 time: 0.516499 Oct 18 13:23:42.651477 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 859/1761] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:42 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1310 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:43.021989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-365adc4c-9b91-4b63-94e2-b4381e148b9d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:43.025968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:43.054855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-365adc4c-9b91-4b63-94e2-b4381e148b9d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:43.060013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-365adc4c-9b91-4b63-94e2-b4381e148b9d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:43.061314 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-365adc4c-9b91-4b63-94e2-b4381e148b9d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1281 microversion: 2.25 time: 0.529829 Oct 18 13:23:43.061805 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 903/1762] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:42 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1281 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:43.079654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1f3019b1-c091-4084-b53d-a15785509503 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:43.080266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1f3019b1-c091-4084-b53d-a15785509503 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:43.119999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f3019b1-c091-4084-b53d-a15785509503 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:43.121482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f3019b1-c091-4084-b53d-a15785509503 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:43.122099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f3019b1-c091-4084-b53d-a15785509503 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:43.123173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f3019b1-c091-4084-b53d-a15785509503 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:43.124301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f3019b1-c091-4084-b53d-a15785509503 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:43.124893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f3019b1-c091-4084-b53d-a15785509503 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:43.248628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d4ac4226-43ad-4f39-bc08-2d891c3c6ecc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:43.249925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d4ac4226-43ad-4f39-bc08-2d891c3c6ecc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:43.265135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ac4226-43ad-4f39-bc08-2d891c3c6ecc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:43.265948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ac4226-43ad-4f39-bc08-2d891c3c6ecc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:43.268684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ac4226-43ad-4f39-bc08-2d891c3c6ecc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:43.269821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ac4226-43ad-4f39-bc08-2d891c3c6ecc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:43.270494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ac4226-43ad-4f39-bc08-2d891c3c6ecc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:43.273132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ac4226-43ad-4f39-bc08-2d891c3c6ecc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:43.406475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1f3019b1-c091-4084-b53d-a15785509503 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:43.422969 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1f3019b1-c091-4084-b53d-a15785509503 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1688 microversion: 2.1 time: 0.346974 Oct 18 13:23:43.423572 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 860/1763] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:43 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1688 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:43.433502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d259d454-b652-40ca-8661-f22893ae2e5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60fee2310>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:43.551584 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d259d454-b652-40ca-8661-f22893ae2e5a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8" status: 200 len: 1436 microversion: 2.1 time: 0.124564 Oct 18 13:23:43.556108 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 861/1764] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:43 2022] GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8 => generated 1436 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:43.679580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b1a0d6a7-b9c7-49fe-95a6-78173cc3e1ff tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:43.680656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b1a0d6a7-b9c7-49fe-95a6-78173cc3e1ff tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:43.689667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1a0d6a7-b9c7-49fe-95a6-78173cc3e1ff tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:43.690664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1a0d6a7-b9c7-49fe-95a6-78173cc3e1ff tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:43.692099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1a0d6a7-b9c7-49fe-95a6-78173cc3e1ff tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:43.693574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1a0d6a7-b9c7-49fe-95a6-78173cc3e1ff tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:43.694496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1a0d6a7-b9c7-49fe-95a6-78173cc3e1ff tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:43.695447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1a0d6a7-b9c7-49fe-95a6-78173cc3e1ff tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:43.780220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d4ac4226-43ad-4f39-bc08-2d891c3c6ecc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:43.791134 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d4ac4226-43ad-4f39-bc08-2d891c3c6ecc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1315 microversion: 2.1 time: 0.547607 Oct 18 13:23:43.793251 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 904/1765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:43 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:43.970190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b1a0d6a7-b9c7-49fe-95a6-78173cc3e1ff tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:43.979612 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b1a0d6a7-b9c7-49fe-95a6-78173cc3e1ff tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1310 microversion: 2.1 time: 0.305545 Oct 18 13:23:43.980175 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 862/1766] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:43 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1310 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:44.090877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b2f5d78f-c4cd-414f-8ec0-bcd55e969045 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:44.091751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b2f5d78f-c4cd-414f-8ec0-bcd55e969045 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:44.109920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2f5d78f-c4cd-414f-8ec0-bcd55e969045 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:44.111296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2f5d78f-c4cd-414f-8ec0-bcd55e969045 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:44.111923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2f5d78f-c4cd-414f-8ec0-bcd55e969045 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:44.112853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2f5d78f-c4cd-414f-8ec0-bcd55e969045 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:44.113509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2f5d78f-c4cd-414f-8ec0-bcd55e969045 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:44.114130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2f5d78f-c4cd-414f-8ec0-bcd55e969045 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:44.451464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-07ad3216-dcd5-43c5-8f1e-a3fde04be48b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:44.452026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-07ad3216-dcd5-43c5-8f1e-a3fde04be48b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:44.461596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07ad3216-dcd5-43c5-8f1e-a3fde04be48b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:44.462085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07ad3216-dcd5-43c5-8f1e-a3fde04be48b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:44.462515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07ad3216-dcd5-43c5-8f1e-a3fde04be48b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:44.468637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07ad3216-dcd5-43c5-8f1e-a3fde04be48b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:44.469114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07ad3216-dcd5-43c5-8f1e-a3fde04be48b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:44.469579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07ad3216-dcd5-43c5-8f1e-a3fde04be48b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:44.611574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b2f5d78f-c4cd-414f-8ec0-bcd55e969045 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:44.628300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b2f5d78f-c4cd-414f-8ec0-bcd55e969045 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:44.632533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b2f5d78f-c4cd-414f-8ec0-bcd55e969045 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:44.638390 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b2f5d78f-c4cd-414f-8ec0-bcd55e969045 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1281 microversion: 2.25 time: 0.550607 Oct 18 13:23:44.639984 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 905/1767] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:44 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1281 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:44.662927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-268bcc0a-73f2-4bfc-9754-9416c70e49d3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617ac4d30>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:44.768899 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-268bcc0a-73f2-4bfc-9754-9416c70e49d3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8" status: 200 len: 1436 microversion: 2.1 time: 0.124583 Oct 18 13:23:44.769574 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 906/1768] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:44 2022] GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8 => generated 1436 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:44.819484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cafefcd8-4833-4fd7-8c8f-c8656c10bc21 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:44.821018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cafefcd8-4833-4fd7-8c8f-c8656c10bc21 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:44.834279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cafefcd8-4833-4fd7-8c8f-c8656c10bc21 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:44.836112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cafefcd8-4833-4fd7-8c8f-c8656c10bc21 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:44.838627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cafefcd8-4833-4fd7-8c8f-c8656c10bc21 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:44.839597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cafefcd8-4833-4fd7-8c8f-c8656c10bc21 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:44.845928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cafefcd8-4833-4fd7-8c8f-c8656c10bc21 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:44.846593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cafefcd8-4833-4fd7-8c8f-c8656c10bc21 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:44.860886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-07ad3216-dcd5-43c5-8f1e-a3fde04be48b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:44.882793 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-07ad3216-dcd5-43c5-8f1e-a3fde04be48b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1688 microversion: 2.1 time: 0.434764 Oct 18 13:23:44.898957 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 863/1769] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:44 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1688 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:45.007370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-454d7820-8520-4ef9-a065-70783eefe2c0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:45.008256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-454d7820-8520-4ef9-a065-70783eefe2c0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:45.032751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-454d7820-8520-4ef9-a065-70783eefe2c0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:45.033306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-454d7820-8520-4ef9-a065-70783eefe2c0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:45.033755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-454d7820-8520-4ef9-a065-70783eefe2c0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:45.034494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-454d7820-8520-4ef9-a065-70783eefe2c0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:45.034949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-454d7820-8520-4ef9-a065-70783eefe2c0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:45.035381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-454d7820-8520-4ef9-a065-70783eefe2c0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:45.337098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-454d7820-8520-4ef9-a065-70783eefe2c0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:45.343030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:45.351385 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-454d7820-8520-4ef9-a065-70783eefe2c0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1310 microversion: 2.1 time: 0.348113 Oct 18 13:23:45.352337 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 864/1770] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:45 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1310 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:45.409058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cafefcd8-4833-4fd7-8c8f-c8656c10bc21 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:45.417489 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cafefcd8-4833-4fd7-8c8f-c8656c10bc21 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1315 microversion: 2.1 time: 0.602994 Oct 18 13:23:45.437934 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 907/1771] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:44 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:45.668511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-277a134d-550e-48c0-87a4-5fe21a712576 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:45.669480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-277a134d-550e-48c0-87a4-5fe21a712576 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:45.686499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-277a134d-550e-48c0-87a4-5fe21a712576 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:45.687572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-277a134d-550e-48c0-87a4-5fe21a712576 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:45.688287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-277a134d-550e-48c0-87a4-5fe21a712576 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:45.689320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-277a134d-550e-48c0-87a4-5fe21a712576 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:45.690033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-277a134d-550e-48c0-87a4-5fe21a712576 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:45.690695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-277a134d-550e-48c0-87a4-5fe21a712576 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:45.786609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-715bbf6d-0fa2-4267-85d6-a6650d413380 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617b7ff70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:45.882565 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-715bbf6d-0fa2-4267-85d6-a6650d413380 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8" status: 200 len: 1436 microversion: 2.1 time: 0.101654 Oct 18 13:23:45.891473 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 908/1772] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:45 2022] GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8 => generated 1436 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:23:46.048951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-277a134d-550e-48c0-87a4-5fe21a712576 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:46.060682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-277a134d-550e-48c0-87a4-5fe21a712576 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:46.066056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-277a134d-550e-48c0-87a4-5fe21a712576 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:46.067405 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-277a134d-550e-48c0-87a4-5fe21a712576 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1281 microversion: 2.25 time: 0.403364 Oct 18 13:23:46.068589 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 865/1773] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:45 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1281 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:46.082263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4ebd269-a282-4b52-aca0-952882de08af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:46.083290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e4ebd269-a282-4b52-aca0-952882de08af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:46.101732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4ebd269-a282-4b52-aca0-952882de08af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:46.102531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4ebd269-a282-4b52-aca0-952882de08af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:46.103232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4ebd269-a282-4b52-aca0-952882de08af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:46.104148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4ebd269-a282-4b52-aca0-952882de08af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:46.104796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4ebd269-a282-4b52-aca0-952882de08af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:46.105466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4ebd269-a282-4b52-aca0-952882de08af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:46.371094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-17acc9ed-dff5-46dd-a869-eab1d30d59d9 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Calling method '.version_select at 0x7ff617a85670>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:46.431915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG neutronclient.v2_0.client [None req-17acc9ed-dff5-46dd-a869-eab1d30d59d9 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6621bd83-5786-4024-8622-3876d464ac8d does not exist", "detail": ""}} {{(pid=120611) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:23:46.433377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.security_group_api [None req-17acc9ed-dff5-46dd-a869-eab1d30d59d9 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Neutron security group 6621bd83-5786-4024-8622-3876d464ac8d not found {{(pid=120611) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:23:46.434465 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-17acc9ed-dff5-46dd-a869-eab1d30d59d9 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] HTTP exception thrown: Security group 6621bd83-5786-4024-8622-3876d464ac8d does not exist Oct 18 13:23:46.434465 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-7b607ff4-648d-454f-8b5c-f201b3321f76'] Oct 18 13:23:46.446367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e4ebd269-a282-4b52-aca0-952882de08af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-17acc9ed-dff5-46dd-a869-eab1d30d59d9 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Request method failure captured: Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/os-security-groups/6621bd83-5786-4024-8622-3876d464ac8d HTTP/1.1 Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqjhQvgbYpXfNNOhgq3AJCeLWQS5OjoPbX0nnTyT3xJoQwuMqOa50eL28q70B5ndY0Wfv8jnnjhtDn2T9N51YFc8Mk7-pT1XnToW9Db0MtXc4373yuqcmMa4e2qdYPyfYz2_EQZFw9CMjSc4VAPrVsynJjm-iSPwi-T_EO0fupiGfok Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: dc31dc61a0124088bded79c1e39415ea Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-205131837 Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:23:46.453058 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:23:46.454712 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc31dc61a0124088bded79c1e39415ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc31dc61a0124088bded79c1e39415ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc31dc61a0124088bded79c1e39415ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc31dc61a0124088bded79c1e39415ea"}]}] Oct 18 13:23:46.454712 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-205131837 Oct 18 13:23:46.454712 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: dc31dc61a0124088bded79c1e39415ea Oct 18 13:23:46.454712 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-205131837 Oct 18 13:23:46.454712 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupsNegativeTestJSON-205131837-project Oct 18 13:23:46.454712 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:23:46.454712 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:23:46.454712 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6610c06cbb234589b380275b3a3b1cd8 Oct 18 13:23:46.454712 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-205131837-project Oct 18 13:23:46.454712 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:23:46.454712 n-d-858384-13 devstack@n-api.service[120611]: exception: Security group 6621bd83-5786-4024-8622-3876d464ac8d does not exist Oct 18 13:23:46.454712 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-7b607ff4-648d-454f-8b5c-f201b3321f76'] Oct 18 13:23:46.454712 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '6621bd83-5786-4024-8622-3876d464ac8d'} Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:46.455900 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6621bd83-5786-4024-8622-3876d464ac8d does not exist Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b607ff4-648d-454f-8b5c-f201b3321f76'] Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:23:46.457273 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6621bd83-5786-4024-8622-3876d464ac8d does not exist Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b607ff4-648d-454f-8b5c-f201b3321f76'] Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6621bd83-5786-4024-8622-3876d464ac8d does not exist Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b607ff4-648d-454f-8b5c-f201b3321f76'] Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:46.458950 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:46.462292 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:46.462292 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:46.462292 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:46.462292 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:46.462292 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6621bd83-5786-4024-8622-3876d464ac8d does not exist Oct 18 13:23:46.462292 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b607ff4-648d-454f-8b5c-f201b3321f76'] Oct 18 13:23:46.462292 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:46.462292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-17acc9ed-dff5-46dd-a869-eab1d30d59d9 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Returning 404 to user: Security group 6621bd83-5786-4024-8622-3876d464ac8d does not exist Oct 18 13:23:46.462292 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-7b607ff4-648d-454f-8b5c-f201b3321f76'] {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:46.462292 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-17acc9ed-dff5-46dd-a869-eab1d30d59d9 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/6621bd83-5786-4024-8622-3876d464ac8d" status: 404 len: 194 microversion: 2.1 time: 0.568221 Oct 18 13:23:46.465656 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e4ebd269-a282-4b52-aca0-952882de08af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1688 microversion: 2.1 time: 0.394570 Oct 18 13:23:46.465656 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 866/1774] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:46 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1688 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:46.467712 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 909/1775] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:23:45 2022] DELETE /compute/v2.1/os-security-groups/6621bd83-5786-4024-8622-3876d464ac8d => generated 194 bytes in 575 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:46.473252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e1279747-d7f3-4f6a-9658-76237b1b8c4a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:46.478715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e1279747-d7f3-4f6a-9658-76237b1b8c4a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:46.486901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0b4c05bd-b02b-4e42-9b5b-cca0a4d5b394 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:46.487526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0b4c05bd-b02b-4e42-9b5b-cca0a4d5b394 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:46.490229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1279747-d7f3-4f6a-9658-76237b1b8c4a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:46.490821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1279747-d7f3-4f6a-9658-76237b1b8c4a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:46.491310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1279747-d7f3-4f6a-9658-76237b1b8c4a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:46.492012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1279747-d7f3-4f6a-9658-76237b1b8c4a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:46.492465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1279747-d7f3-4f6a-9658-76237b1b8c4a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:46.492876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1279747-d7f3-4f6a-9658-76237b1b8c4a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:46.497735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b4c05bd-b02b-4e42-9b5b-cca0a4d5b394 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:46.498301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b4c05bd-b02b-4e42-9b5b-cca0a4d5b394 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:46.498673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b4c05bd-b02b-4e42-9b5b-cca0a4d5b394 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:46.499376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b4c05bd-b02b-4e42-9b5b-cca0a4d5b394 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:46.500052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b4c05bd-b02b-4e42-9b5b-cca0a4d5b394 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:46.500683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b4c05bd-b02b-4e42-9b5b-cca0a4d5b394 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:46.692140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0b4c05bd-b02b-4e42-9b5b-cca0a4d5b394 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:46.704712 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0b4c05bd-b02b-4e42-9b5b-cca0a4d5b394 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1315 microversion: 2.1 time: 0.228482 Oct 18 13:23:46.706634 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 910/1776] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:46 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:46.712197 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-117e51d9-b3df-438e-84b9-c2f78894e1dc tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004755 Oct 18 13:23:46.713144 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 911/1777] 10.222.0.40 () {58 vars in 1164 bytes} [Tue Oct 18 13:23:46 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 13:23:46.722766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-41e34f60-972b-4393-b831-f75fa26ebd6e tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Calling method '.version_select at 0x7ff617aedb80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:46.871726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e1279747-d7f3-4f6a-9658-76237b1b8c4a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:46.884945 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e1279747-d7f3-4f6a-9658-76237b1b8c4a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1310 microversion: 2.1 time: 0.416799 Oct 18 13:23:46.886130 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 867/1778] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:46 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1310 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:47.030862 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-41e34f60-972b-4393-b831-f75fa26ebd6e tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.312362 Oct 18 13:23:47.032970 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 912/1779] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:23:46 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:47.041564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cbaab3d7-54d8-489f-986a-52d381aaa0ed tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617b7f1f0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:47.120895 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cbaab3d7-54d8-489f-986a-52d381aaa0ed tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8" status: 200 len: 1436 microversion: 2.1 time: 0.086342 Oct 18 13:23:47.123686 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 913/1780] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:47 2022] GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8 => generated 1436 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:47.133811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d27c7af-ed7c-4da1-8bbc-9e346539f249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:47.136429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d27c7af-ed7c-4da1-8bbc-9e346539f249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:47.142210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-838664896", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": "none"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:47.145128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d27c7af-ed7c-4da1-8bbc-9e346539f249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:47.145761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d27c7af-ed7c-4da1-8bbc-9e346539f249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:47.146305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d27c7af-ed7c-4da1-8bbc-9e346539f249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:47.147145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d27c7af-ed7c-4da1-8bbc-9e346539f249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:47.147720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d27c7af-ed7c-4da1-8bbc-9e346539f249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:47.148235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d27c7af-ed7c-4da1-8bbc-9e346539f249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:47.173379 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-9d27c7af-ed7c-4da1-8bbc-9e346539f249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] HTTP exception thrown: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d27c7af-ed7c-4da1-8bbc-9e346539f249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Request method failure captured: Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 HTTP/1.1 Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgp-XynwA5fnh8xfo_e1Xez3ZQrpG2OZ2GDDOdeClVeE25Fp5cOJMRxUiV1HzbvILVx8bRSGavI4tbbWcVNvOMFaq4eDX9KmcP_22Mt4VErL5m8Z1U6Lg1enDnMCF4vMq6A--nGrIqOVVzjrFJCgnSyzr7o7zk7_sYuDBHWvuqaUEA Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: bbe4fe5608ed40079ecd55a948937103 Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2000558643 Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:23:47.175177 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:23:47.177036 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbe4fe5608ed40079ecd55a948937103"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bbe4fe5608ed40079ecd55a948937103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbe4fe5608ed40079ecd55a948937103"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bbe4fe5608ed40079ecd55a948937103"}]}] Oct 18 13:23:47.177036 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2000558643 Oct 18 13:23:47.177036 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: bbe4fe5608ed40079ecd55a948937103 Oct 18 13:23:47.177036 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2000558643 Oct 18 13:23:47.177036 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachSCSIVolumeTestJSON-2000558643-project Oct 18 13:23:47.177036 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:23:47.177036 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:23:47.177036 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 4ec522b9bfa0455084d74f7bfabe183c Oct 18 13:23:47.177036 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2000558643-project Oct 18 13:23:47.177036 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:23:47.177036 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:47.177036 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5'} Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:47.178087 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:47.180355 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.206161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d27c7af-ed7c-4da1-8bbc-9e346539f249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Returning 404 to user: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:47.207063 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d27c7af-ed7c-4da1-8bbc-9e346539f249 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 404 len: 111 microversion: 2.1 time: 0.081906 Oct 18 13:23:47.211271 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 914/1781] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:23:47 2022] DELETE /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:47.216442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c51e2f17-03c1-4824-9543-58d9b179bddd tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Calling method '.version_select at 0x7ff617aedc10>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:47.224579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:23:47.225930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:23:47.226771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:23:47.227661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:23:47.228307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:23:47.238493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:47.239567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:47.240303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:47.242235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:47.243405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:47.244283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:47.270289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Getting quotas for project 135f8cfe9940417b9518dcceb6f6f78f. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:23:47.277052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Getting quotas for user 498b9c14314948998ec1502e9cfe95ce and project 135f8cfe9940417b9518dcceb6f6f78f. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:23:47.293718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:23:47.296998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:23:47.380482 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9404f8e0-b4f7-4bf7-b70e-fd8cf96ab757 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.491731 Oct 18 13:23:47.381198 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 868/1782] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:23:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:23:47.392902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35e4c2cc-e228-4310-9c48-1271e2af6709 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:47.395596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-35e4c2cc-e228-4310-9c48-1271e2af6709 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:47.407381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35e4c2cc-e228-4310-9c48-1271e2af6709 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:47.408139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35e4c2cc-e228-4310-9c48-1271e2af6709 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:47.408754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35e4c2cc-e228-4310-9c48-1271e2af6709 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:47.409861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35e4c2cc-e228-4310-9c48-1271e2af6709 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:47.411145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35e4c2cc-e228-4310-9c48-1271e2af6709 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:47.413486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35e4c2cc-e228-4310-9c48-1271e2af6709 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:47.490001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG neutronclient.v2_0.client [None req-c51e2f17-03c1-4824-9543-58d9b179bddd tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120611) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:23:47.491616 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-c51e2f17-03c1-4824-9543-58d9b179bddd tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 18 13:23:47.491616 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-75f03fd3-fbbe-4983-857a-2d292abcecee'] Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c51e2f17-03c1-4824-9543-58d9b179bddd tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Request method failure captured: Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/os-security-groups/d3bc2f3a-14fd-4a2b-81bd-de056913fe29 HTTP/1.1 Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqjhQvgbYpXfNNOhgq3AJCeLWQS5OjoPbX0nnTyT3xJoQwuMqOa50eL28q70B5ndY0Wfv8jnnjhtDn2T9N51YFc8Mk7-pT1XnToW9Db0MtXc4373yuqcmMa4e2qdYPyfYz2_EQZFw9CMjSc4VAPrVsynJjm-iSPwi-T_EO0fupiGfok Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: dc31dc61a0124088bded79c1e39415ea Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-205131837 Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:23:47.493936 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:23:47.495494 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc31dc61a0124088bded79c1e39415ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc31dc61a0124088bded79c1e39415ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc31dc61a0124088bded79c1e39415ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc31dc61a0124088bded79c1e39415ea"}]}] Oct 18 13:23:47.495494 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-205131837 Oct 18 13:23:47.495494 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: dc31dc61a0124088bded79c1e39415ea Oct 18 13:23:47.495494 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-205131837 Oct 18 13:23:47.495494 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupsNegativeTestJSON-205131837-project Oct 18 13:23:47.495494 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:23:47.495494 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:23:47.495494 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6610c06cbb234589b380275b3a3b1cd8 Oct 18 13:23:47.495494 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-205131837-project Oct 18 13:23:47.495494 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:23:47.495494 n-d-858384-13 devstack@n-api.service[120611]: exception: Insufficient rights for removing default security group. Oct 18 13:23:47.495494 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-75f03fd3-fbbe-4983-857a-2d292abcecee'] Oct 18 13:23:47.495494 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'd3bc2f3a-14fd-4a2b-81bd-de056913fe29'} Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:47.496442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75f03fd3-fbbe-4983-857a-2d292abcecee'] Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 18 13:23:47.499560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75f03fd3-fbbe-4983-857a-2d292abcecee'] Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75f03fd3-fbbe-4983-857a-2d292abcecee'] Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:47.502628 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:47.506365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:47.506365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:47.506365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:47.506365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 18 13:23:47.506365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75f03fd3-fbbe-4983-857a-2d292abcecee'] Oct 18 13:23:47.506365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.508932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c51e2f17-03c1-4824-9543-58d9b179bddd tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 18 13:23:47.508932 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-75f03fd3-fbbe-4983-857a-2d292abcecee'] {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:47.510320 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c51e2f17-03c1-4824-9543-58d9b179bddd tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/d3bc2f3a-14fd-4a2b-81bd-de056913fe29" status: 400 len: 182 microversion: 2.1 time: 0.297929 Oct 18 13:23:47.517896 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 915/1783] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:23:47 2022] DELETE /compute/v2.1/os-security-groups/d3bc2f3a-14fd-4a2b-81bd-de056913fe29 => generated 182 bytes in 306 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:23:47.525603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fe27b41f-7c30-46c2-a474-35cdb2b7d788 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:47.526629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fe27b41f-7c30-46c2-a474-35cdb2b7d788 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] [instance: b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:47.534756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:47.536973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe27b41f-7c30-46c2-a474-35cdb2b7d788 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:47.538350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe27b41f-7c30-46c2-a474-35cdb2b7d788 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:47.539138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe27b41f-7c30-46c2-a474-35cdb2b7d788 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:47.540282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe27b41f-7c30-46c2-a474-35cdb2b7d788 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:47.541657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe27b41f-7c30-46c2-a474-35cdb2b7d788 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:47.542465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe27b41f-7c30-46c2-a474-35cdb2b7d788 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:47.561567 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-fe27b41f-7c30-46c2-a474-35cdb2b7d788 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] HTTP exception thrown: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fe27b41f-7c30-46c2-a474-35cdb2b7d788 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Request method failure captured: Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 HTTP/1.1 Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgp-XynwA5fnh8xfo_e1Xez3ZQrpG2OZ2GDDOdeClVeE25Fp5cOJMRxUiV1HzbvILVx8bRSGavI4tbbWcVNvOMFaq4eDX9KmcP_22Mt4VErL5m8Z1U6Lg1enDnMCF4vMq6A--nGrIqOVVzjrFJCgnSyzr7o7zk7_sYuDBHWvuqaUEA Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: bbe4fe5608ed40079ecd55a948937103 Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2000558643 Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:23:47.564156 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:23:47.566500 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbe4fe5608ed40079ecd55a948937103"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bbe4fe5608ed40079ecd55a948937103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bbe4fe5608ed40079ecd55a948937103"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bbe4fe5608ed40079ecd55a948937103"}]}] Oct 18 13:23:47.566500 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2000558643 Oct 18 13:23:47.566500 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: bbe4fe5608ed40079ecd55a948937103 Oct 18 13:23:47.566500 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2000558643 Oct 18 13:23:47.566500 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachSCSIVolumeTestJSON-2000558643-project Oct 18 13:23:47.566500 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:23:47.566500 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:23:47.566500 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 4ec522b9bfa0455084d74f7bfabe183c Oct 18 13:23:47.566500 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2000558643-project Oct 18 13:23:47.566500 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:23:47.566500 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:47.566500 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5'} Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:47.567485 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. Oct 18 13:23:47.569128 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:47.574371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fe27b41f-7c30-46c2-a474-35cdb2b7d788 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] Returning 404 to user: Instance b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:47.576105 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fe27b41f-7c30-46c2-a474-35cdb2b7d788 tempest-AttachSCSIVolumeTestJSON-2000558643 tempest-AttachSCSIVolumeTestJSON-2000558643-project] 10.222.0.40 "GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5" status: 404 len: 111 microversion: 2.1 time: 0.056241 Oct 18 13:23:47.577276 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 916/1784] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:47 2022] GET /compute/v2.1/servers/b70a99ba-120b-4546-8ad4-b9eb2d9f1fa5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:47.592785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-83e21e95-d97b-44ca-9ebd-b119519248e4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:47.615085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-83e21e95-d97b-44ca-9ebd-b119519248e4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:47.775033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-35e4c2cc-e228-4310-9c48-1271e2af6709 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:47.784158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-35e4c2cc-e228-4310-9c48-1271e2af6709 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:47.805270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-35e4c2cc-e228-4310-9c48-1271e2af6709 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:47.806735 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-35e4c2cc-e228-4310-9c48-1271e2af6709 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1281 microversion: 2.25 time: 0.423331 Oct 18 13:23:47.810970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-83e21e95-d97b-44ca-9ebd-b119519248e4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:47.825098 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 869/1785] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:47 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1281 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:47.831192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-83e21e95-d97b-44ca-9ebd-b119519248e4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:47.832745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-83e21e95-d97b-44ca-9ebd-b119519248e4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:47.846166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b5d3ba5b-bfcf-4889-bca4-d6d01a1b462c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:47.847193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b5d3ba5b-bfcf-4889-bca4-d6d01a1b462c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:47.853011 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-83e21e95-d97b-44ca-9ebd-b119519248e4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1452 microversion: 2.91 time: 0.273941 Oct 18 13:23:47.856116 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 917/1786] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:47 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1452 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:47.870442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5d3ba5b-bfcf-4889-bca4-d6d01a1b462c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:47.871098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5d3ba5b-bfcf-4889-bca4-d6d01a1b462c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:47.871633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5d3ba5b-bfcf-4889-bca4-d6d01a1b462c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:47.872700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8db6c0d1-5c44-47d4-b74a-dc3c5a14264b req-867e5e07-da7e-4fa7-8848-aaf25c0aca9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2403d808-adf4-45f0-a631-cdc6fad44b76", "name": "network-vif-plugged", "status": "completed", "tag": "43a6f3fa-36dd-4b00-b299-1037fb97ee80"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:47.872883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5d3ba5b-bfcf-4889-bca4-d6d01a1b462c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:47.873664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5d3ba5b-bfcf-4889-bca4-d6d01a1b462c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:47.875534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5d3ba5b-bfcf-4889-bca4-d6d01a1b462c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:47.895464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8db6c0d1-5c44-47d4-b74a-dc3c5a14264b req-867e5e07-da7e-4fa7-8848-aaf25c0aca9d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:47.898272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8db6c0d1-5c44-47d4-b74a-dc3c5a14264b req-867e5e07-da7e-4fa7-8848-aaf25c0aca9d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:47.901824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8db6c0d1-5c44-47d4-b74a-dc3c5a14264b req-867e5e07-da7e-4fa7-8848-aaf25c0aca9d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:47.925810 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8db6c0d1-5c44-47d4-b74a-dc3c5a14264b req-867e5e07-da7e-4fa7-8848-aaf25c0aca9d service nova] Creating event network-vif-plugged:43a6f3fa-36dd-4b00-b299-1037fb97ee80 for instance 2403d808-adf4-45f0-a631-cdc6fad44b76 on n-h1-858384-13 Oct 18 13:23:47.951226 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8db6c0d1-5c44-47d4-b74a-dc3c5a14264b req-867e5e07-da7e-4fa7-8848-aaf25c0aca9d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093373 Oct 18 13:23:47.958277 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 918/1787] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:47.968673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-36ac568c-8e30-4d57-87ed-8144957ca166 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Calling method '.version_select at 0x7ff617b81820>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:48.064725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG neutronclient.v2_0.client [None req-36ac568c-8e30-4d57-87ed-8144957ca166 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2957d2d8-2cd2-4495-9941-85fef30b95f3 does not exist", "detail": ""}} {{(pid=120611) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:23:48.066161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.security_group_api [None req-36ac568c-8e30-4d57-87ed-8144957ca166 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Neutron security group 2957d2d8-2cd2-4495-9941-85fef30b95f3 not found {{(pid=120611) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:23:48.067086 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-36ac568c-8e30-4d57-87ed-8144957ca166 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] HTTP exception thrown: Security group 2957d2d8-2cd2-4495-9941-85fef30b95f3 does not exist Oct 18 13:23:48.067086 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-b827efdc-143e-4f9c-ad4b-fb5cb2888db9'] Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-36ac568c-8e30-4d57-87ed-8144957ca166 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Request method failure captured: Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-security-groups/2957d2d8-2cd2-4495-9941-85fef30b95f3 HTTP/1.1 Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqjhQvgbYpXfNNOhgq3AJCeLWQS5OjoPbX0nnTyT3xJoQwuMqOa50eL28q70B5ndY0Wfv8jnnjhtDn2T9N51YFc8Mk7-pT1XnToW9Db0MtXc4373yuqcmMa4e2qdYPyfYz2_EQZFw9CMjSc4VAPrVsynJjm-iSPwi-T_EO0fupiGfok Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: dc31dc61a0124088bded79c1e39415ea Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-205131837 Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:23:48.070079 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:23:48.071610 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc31dc61a0124088bded79c1e39415ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc31dc61a0124088bded79c1e39415ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc31dc61a0124088bded79c1e39415ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc31dc61a0124088bded79c1e39415ea"}]}] Oct 18 13:23:48.071610 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-205131837 Oct 18 13:23:48.071610 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: dc31dc61a0124088bded79c1e39415ea Oct 18 13:23:48.071610 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-205131837 Oct 18 13:23:48.071610 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupsNegativeTestJSON-205131837-project Oct 18 13:23:48.071610 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:23:48.071610 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:23:48.071610 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6610c06cbb234589b380275b3a3b1cd8 Oct 18 13:23:48.071610 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-205131837-project Oct 18 13:23:48.071610 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:23:48.071610 n-d-858384-13 devstack@n-api.service[120611]: exception: Security group 2957d2d8-2cd2-4495-9941-85fef30b95f3 does not exist Oct 18 13:23:48.071610 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-b827efdc-143e-4f9c-ad4b-fb5cb2888db9'] Oct 18 13:23:48.071610 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '2957d2d8-2cd2-4495-9941-85fef30b95f3'} Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:48.072515 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2957d2d8-2cd2-4495-9941-85fef30b95f3 does not exist Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b827efdc-143e-4f9c-ad4b-fb5cb2888db9'] Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:23:48.073987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2957d2d8-2cd2-4495-9941-85fef30b95f3 does not exist Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b827efdc-143e-4f9c-ad4b-fb5cb2888db9'] Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2957d2d8-2cd2-4495-9941-85fef30b95f3 does not exist Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b827efdc-143e-4f9c-ad4b-fb5cb2888db9'] Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.075297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:48.076796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:48.076796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:48.076796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:48.076796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:48.076796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2957d2d8-2cd2-4495-9941-85fef30b95f3 does not exist Oct 18 13:23:48.076796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b827efdc-143e-4f9c-ad4b-fb5cb2888db9'] Oct 18 13:23:48.076796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.079403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-36ac568c-8e30-4d57-87ed-8144957ca166 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Returning 404 to user: Security group 2957d2d8-2cd2-4495-9941-85fef30b95f3 does not exist Oct 18 13:23:48.079403 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-b827efdc-143e-4f9c-ad4b-fb5cb2888db9'] {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:48.080753 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-36ac568c-8e30-4d57-87ed-8144957ca166 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/2957d2d8-2cd2-4495-9941-85fef30b95f3" status: 404 len: 194 microversion: 2.1 time: 0.121013 Oct 18 13:23:48.086917 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 919/1788] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:23:47 2022] GET /compute/v2.1/os-security-groups/2957d2d8-2cd2-4495-9941-85fef30b95f3 => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:48.111314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-606d94d9-f0de-451a-806e-b110c3308801 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:48.118252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-606d94d9-f0de-451a-806e-b110c3308801 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:48.149475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-606d94d9-f0de-451a-806e-b110c3308801 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:48.154978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-606d94d9-f0de-451a-806e-b110c3308801 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:48.155803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-606d94d9-f0de-451a-806e-b110c3308801 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:48.161557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-606d94d9-f0de-451a-806e-b110c3308801 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:48.162384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-606d94d9-f0de-451a-806e-b110c3308801 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:48.164020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-606d94d9-f0de-451a-806e-b110c3308801 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:48.389901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b5d3ba5b-bfcf-4889-bca4-d6d01a1b462c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:48.413005 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b5d3ba5b-bfcf-4889-bca4-d6d01a1b462c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1683 microversion: 2.1 time: 0.577772 Oct 18 13:23:48.440330 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 870/1789] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:47 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1683 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:48.455809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bef5c907-397b-468a-aa9c-2bc76f267604 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:48.458085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bef5c907-397b-468a-aa9c-2bc76f267604 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:48.477429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bef5c907-397b-468a-aa9c-2bc76f267604 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:48.480712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bef5c907-397b-468a-aa9c-2bc76f267604 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:48.482189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bef5c907-397b-468a-aa9c-2bc76f267604 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:48.484079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bef5c907-397b-468a-aa9c-2bc76f267604 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:48.484849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bef5c907-397b-468a-aa9c-2bc76f267604 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:48.486297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bef5c907-397b-468a-aa9c-2bc76f267604 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:48.782809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-606d94d9-f0de-451a-806e-b110c3308801 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:48.797130 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-606d94d9-f0de-451a-806e-b110c3308801 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1315 microversion: 2.1 time: 0.704939 Oct 18 13:23:48.814219 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 920/1790] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:48 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:48.822600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5fd930b3-49cc-4240-b766-bc6586735723 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Action: 'update', calling method: .version_select at 0x7ff60ff05ca0>, body: {"security_group": {"name": "tempest-sg-2117108198", "description": "tempest-description-744869662"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:48.873884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bef5c907-397b-468a-aa9c-2bc76f267604 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:48.893880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG neutronclient.v2_0.client [None req-5fd930b3-49cc-4240-b766-bc6586735723 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e9925778-b460-4855-b6ce-ecf48fda4d7a does not exist", "detail": ""}} {{(pid=120611) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:23:48.894748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.security_group_api [None req-5fd930b3-49cc-4240-b766-bc6586735723 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Neutron security group e9925778-b460-4855-b6ce-ecf48fda4d7a not found {{(pid=120611) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:23:48.894961 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bef5c907-397b-468a-aa9c-2bc76f267604 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1310 microversion: 2.1 time: 0.452612 Oct 18 13:23:48.895693 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 871/1791] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:48 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1310 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:48.901109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-240d5aa2-f747-4897-a830-ff6256c300f1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60fc19670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:48.905497 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-5fd930b3-49cc-4240-b766-bc6586735723 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] HTTP exception thrown: Security group e9925778-b460-4855-b6ce-ecf48fda4d7a does not exist Oct 18 13:23:48.905497 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-26149d7d-bf3f-466f-8005-94117196830c'] Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5fd930b3-49cc-4240-b766-bc6586735723 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Request method failure captured: Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: request: PUT /compute/v2.1/os-security-groups/e9925778-b460-4855-b6ce-ecf48fda4d7a HTTP/1.1 Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 101 Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqjhQvgbYpXfNNOhgq3AJCeLWQS5OjoPbX0nnTyT3xJoQwuMqOa50eL28q70B5ndY0Wfv8jnnjhtDn2T9N51YFc8Mk7-pT1XnToW9Db0MtXc4373yuqcmMa4e2qdYPyfYz2_EQZFw9CMjSc4VAPrVsynJjm-iSPwi-T_EO0fupiGfok Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: dc31dc61a0124088bded79c1e39415ea Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-205131837 Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:23:48.908692 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:23:48.910316 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc31dc61a0124088bded79c1e39415ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc31dc61a0124088bded79c1e39415ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc31dc61a0124088bded79c1e39415ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc31dc61a0124088bded79c1e39415ea"}]}] Oct 18 13:23:48.910316 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-205131837 Oct 18 13:23:48.910316 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: dc31dc61a0124088bded79c1e39415ea Oct 18 13:23:48.910316 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-205131837 Oct 18 13:23:48.910316 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupsNegativeTestJSON-205131837-project Oct 18 13:23:48.910316 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:23:48.910316 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:23:48.910316 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6610c06cbb234589b380275b3a3b1cd8 Oct 18 13:23:48.910316 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-205131837-project Oct 18 13:23:48.910316 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:23:48.910316 n-d-858384-13 devstack@n-api.service[120611]: {"security_group": {"name": "tempest-sg-2117108198", "description": "tempest-description-744869662"}} Oct 18 13:23:48.910316 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:23:48.910316 n-d-858384-13 devstack@n-api.service[120611]: exception: Security group e9925778-b460-4855-b6ce-ecf48fda4d7a does not exist Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-26149d7d-bf3f-466f-8005-94117196830c'] Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'e9925778-b460-4855-b6ce-ecf48fda4d7a', 'body': {'security_group': {'name': 'tempest-sg-2117108198', 'description': 'tempest-description-744869662'}}} Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:23:48.911501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e9925778-b460-4855-b6ce-ecf48fda4d7a does not exist Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26149d7d-bf3f-466f-8005-94117196830c'] Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:23:48.913325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e9925778-b460-4855-b6ce-ecf48fda4d7a does not exist Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26149d7d-bf3f-466f-8005-94117196830c'] Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e9925778-b460-4855-b6ce-ecf48fda4d7a does not exist Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26149d7d-bf3f-466f-8005-94117196830c'] Oct 18 13:23:48.914981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.923700 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:23:48.923700 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.923700 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:23:48.923700 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:23:48.923700 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:23:48.923700 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:23:48.923700 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:23:48.923700 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e9925778-b460-4855-b6ce-ecf48fda4d7a does not exist Oct 18 13:23:48.923700 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26149d7d-bf3f-466f-8005-94117196830c'] Oct 18 13:23:48.923700 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:23:48.923700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5fd930b3-49cc-4240-b766-bc6586735723 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] Returning 404 to user: Security group e9925778-b460-4855-b6ce-ecf48fda4d7a does not exist Oct 18 13:23:48.923700 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-26149d7d-bf3f-466f-8005-94117196830c'] {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:23:48.923700 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5fd930b3-49cc-4240-b766-bc6586735723 tempest-SecurityGroupsNegativeTestJSON-205131837 tempest-SecurityGroupsNegativeTestJSON-205131837-project] 10.222.0.40 "PUT /compute/v2.1/os-security-groups/e9925778-b460-4855-b6ce-ecf48fda4d7a" status: 404 len: 194 microversion: 2.1 time: 0.095201 Oct 18 13:23:48.926985 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 921/1792] 10.222.0.40 () {60 vars in 1290 bytes} [Tue Oct 18 13:23:48 2022] PUT /compute/v2.1/os-security-groups/e9925778-b460-4855-b6ce-ecf48fda4d7a => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:23:48.952568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3a38d997-4f85-4f84-89ed-4dc41cba2bf6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:48.959482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3a38d997-4f85-4f84-89ed-4dc41cba2bf6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:48.986556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a38d997-4f85-4f84-89ed-4dc41cba2bf6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:49.005473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a38d997-4f85-4f84-89ed-4dc41cba2bf6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:49.006023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a38d997-4f85-4f84-89ed-4dc41cba2bf6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:49.006976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a38d997-4f85-4f84-89ed-4dc41cba2bf6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:49.015956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a38d997-4f85-4f84-89ed-4dc41cba2bf6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:49.016528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a38d997-4f85-4f84-89ed-4dc41cba2bf6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:49.106473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=9 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:49.651662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3a38d997-4f85-4f84-89ed-4dc41cba2bf6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:49.662397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3a38d997-4f85-4f84-89ed-4dc41cba2bf6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:49.676811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3a38d997-4f85-4f84-89ed-4dc41cba2bf6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:49.682446 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3a38d997-4f85-4f84-89ed-4dc41cba2bf6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1281 microversion: 2.25 time: 0.769529 Oct 18 13:23:49.683707 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 922/1793] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:48 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1281 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:49.691966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac10bd3a-3fbf-4533-a240-d74c1f9e7d4f tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:49.699301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ac10bd3a-3fbf-4533-a240-d74c1f9e7d4f tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:49.709152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac10bd3a-3fbf-4533-a240-d74c1f9e7d4f tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:49.710023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac10bd3a-3fbf-4533-a240-d74c1f9e7d4f tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:49.710835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac10bd3a-3fbf-4533-a240-d74c1f9e7d4f tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:49.711742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac10bd3a-3fbf-4533-a240-d74c1f9e7d4f tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:49.715307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac10bd3a-3fbf-4533-a240-d74c1f9e7d4f tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:49.716096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac10bd3a-3fbf-4533-a240-d74c1f9e7d4f tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.324899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ac10bd3a-3fbf-4533-a240-d74c1f9e7d4f tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:50.336876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ac10bd3a-3fbf-4533-a240-d74c1f9e7d4f tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:50.338737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ac10bd3a-3fbf-4533-a240-d74c1f9e7d4f tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:50.347102 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ac10bd3a-3fbf-4533-a240-d74c1f9e7d4f tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1504 microversion: 2.91 time: 0.661355 Oct 18 13:23:50.371911 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 923/1794] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:49 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1504 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:50.377615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-011f5a5d-314f-4034-a20d-0d17d9a384ea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:50.378473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-011f5a5d-314f-4034-a20d-0d17d9a384ea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:50.386808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-011f5a5d-314f-4034-a20d-0d17d9a384ea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.387616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-011f5a5d-314f-4034-a20d-0d17d9a384ea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.388245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-011f5a5d-314f-4034-a20d-0d17d9a384ea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:50.389129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-011f5a5d-314f-4034-a20d-0d17d9a384ea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:50.389777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-011f5a5d-314f-4034-a20d-0d17d9a384ea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:50.390364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-011f5a5d-314f-4034-a20d-0d17d9a384ea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:51.493523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-011f5a5d-314f-4034-a20d-0d17d9a384ea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:51.511948 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-011f5a5d-314f-4034-a20d-0d17d9a384ea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1683 microversion: 2.1 time: 1.133920 Oct 18 13:23:51.526307 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 924/1795] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:50 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1683 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:51.535232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca7e887b-de65-49ba-a7d7-8a36076877ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:51.535841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca7e887b-de65-49ba-a7d7-8a36076877ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:51.564964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca7e887b-de65-49ba-a7d7-8a36076877ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:51.568001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca7e887b-de65-49ba-a7d7-8a36076877ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:51.581263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca7e887b-de65-49ba-a7d7-8a36076877ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:51.582327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca7e887b-de65-49ba-a7d7-8a36076877ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:51.582963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca7e887b-de65-49ba-a7d7-8a36076877ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:51.583637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca7e887b-de65-49ba-a7d7-8a36076877ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:52.882721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ca7e887b-de65-49ba-a7d7-8a36076877ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:52.902273 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca7e887b-de65-49ba-a7d7-8a36076877ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1315 microversion: 2.1 time: 1.374410 Oct 18 13:23:52.924632 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 925/1796] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:51 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1315 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:52.937216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a969216c-ab1e-4685-87bf-cd3672dbba35 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:52.938553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a969216c-ab1e-4685-87bf-cd3672dbba35 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:52.953570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a969216c-ab1e-4685-87bf-cd3672dbba35 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:52.954272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a969216c-ab1e-4685-87bf-cd3672dbba35 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:52.956202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a969216c-ab1e-4685-87bf-cd3672dbba35 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:52.958913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a969216c-ab1e-4685-87bf-cd3672dbba35 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:52.959777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a969216c-ab1e-4685-87bf-cd3672dbba35 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:52.961567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a969216c-ab1e-4685-87bf-cd3672dbba35 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:53.836568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a969216c-ab1e-4685-87bf-cd3672dbba35 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:53.848162 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a969216c-ab1e-4685-87bf-cd3672dbba35 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1310 microversion: 2.1 time: 0.921387 Oct 18 13:23:53.865009 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 926/1797] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:52 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1310 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:53.881965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9d448745-2ee9-4350-9d73-772d8e35badb req-03349022-626d-40ed-9ab6-23d04200fa84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67746251-6df7-43e6-9a3d-c45f1fb662ae", "name": "network-vif-plugged", "status": "completed", "tag": "06704eb6-7b35-42a7-a441-0dd307106054"}, {"server_uuid": "9aad90b5-28fb-44b2-89da-33bc1b2889f2", "name": "network-vif-plugged", "status": "completed", "tag": "516c3ad3-1e31-4bde-b674-c0c367989f56"}, {"server_uuid": "3a0797de-276a-489b-aab7-16391ac1d0d3", "name": "network-vif-plugged", "status": "completed", "tag": "e9a57904-7800-46a5-9a77-79c987e77696"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:53.915886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9d448745-2ee9-4350-9d73-772d8e35badb req-03349022-626d-40ed-9ab6-23d04200fa84 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:53.917202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9d448745-2ee9-4350-9d73-772d8e35badb req-03349022-626d-40ed-9ab6-23d04200fa84 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:53.917867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9d448745-2ee9-4350-9d73-772d8e35badb req-03349022-626d-40ed-9ab6-23d04200fa84 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:53.957835 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9d448745-2ee9-4350-9d73-772d8e35badb req-03349022-626d-40ed-9ab6-23d04200fa84 service nova] Creating event network-vif-plugged:06704eb6-7b35-42a7-a441-0dd307106054 for instance 67746251-6df7-43e6-9a3d-c45f1fb662ae on n-h2-858384-13 Oct 18 13:23:53.965095 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9d448745-2ee9-4350-9d73-772d8e35badb req-03349022-626d-40ed-9ab6-23d04200fa84 service nova] Creating event network-vif-plugged:516c3ad3-1e31-4bde-b674-c0c367989f56 for instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 on n-h1-858384-13 Oct 18 13:23:53.965884 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9d448745-2ee9-4350-9d73-772d8e35badb req-03349022-626d-40ed-9ab6-23d04200fa84 service nova] Creating event network-vif-plugged:e9a57904-7800-46a5-9a77-79c987e77696 for instance 3a0797de-276a-489b-aab7-16391ac1d0d3 on n-h2-858384-13 Oct 18 13:23:54.002309 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9d448745-2ee9-4350-9d73-772d8e35badb req-03349022-626d-40ed-9ab6-23d04200fa84 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.132297 Oct 18 13:23:54.005459 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 927/1798] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:54.051674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-83833ae0-9bf1-45a2-be52-608fa1c4cee9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:54.056051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-83833ae0-9bf1-45a2-be52-608fa1c4cee9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:54.098131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83833ae0-9bf1-45a2-be52-608fa1c4cee9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:54.099156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83833ae0-9bf1-45a2-be52-608fa1c4cee9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:54.101023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83833ae0-9bf1-45a2-be52-608fa1c4cee9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:54.112419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83833ae0-9bf1-45a2-be52-608fa1c4cee9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:54.113969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83833ae0-9bf1-45a2-be52-608fa1c4cee9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:54.114680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83833ae0-9bf1-45a2-be52-608fa1c4cee9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:55.121602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-83833ae0-9bf1-45a2-be52-608fa1c4cee9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:55.153169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-83833ae0-9bf1-45a2-be52-608fa1c4cee9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:55.181928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-83833ae0-9bf1-45a2-be52-608fa1c4cee9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:55.190574 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-83833ae0-9bf1-45a2-be52-608fa1c4cee9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1281 microversion: 2.25 time: 1.154181 Oct 18 13:23:55.191727 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 928/1799] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:54 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1281 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:55.210780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-185aef76-9cd9-43f9-9f0d-dc1222dfb9d0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:55.214687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-185aef76-9cd9-43f9-9f0d-dc1222dfb9d0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:55.242036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-185aef76-9cd9-43f9-9f0d-dc1222dfb9d0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:55.249811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-185aef76-9cd9-43f9-9f0d-dc1222dfb9d0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:55.251084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-185aef76-9cd9-43f9-9f0d-dc1222dfb9d0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:55.252046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-185aef76-9cd9-43f9-9f0d-dc1222dfb9d0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:55.254535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-185aef76-9cd9-43f9-9f0d-dc1222dfb9d0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:55.255739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-185aef76-9cd9-43f9-9f0d-dc1222dfb9d0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:55.847658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-185aef76-9cd9-43f9-9f0d-dc1222dfb9d0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:55.863422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-185aef76-9cd9-43f9-9f0d-dc1222dfb9d0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:55.871058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-185aef76-9cd9-43f9-9f0d-dc1222dfb9d0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:55.884742 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-185aef76-9cd9-43f9-9f0d-dc1222dfb9d0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1531 microversion: 2.91 time: 0.688661 Oct 18 13:23:55.890491 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 929/1800] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:55 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1531 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:55.896258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-45595568-41a2-4eaa-a650-86b746dc2943 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:55.896869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-45595568-41a2-4eaa-a650-86b746dc2943 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:55.930539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45595568-41a2-4eaa-a650-86b746dc2943 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:55.930981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45595568-41a2-4eaa-a650-86b746dc2943 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:55.931440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45595568-41a2-4eaa-a650-86b746dc2943 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:55.932191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45595568-41a2-4eaa-a650-86b746dc2943 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:55.932751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45595568-41a2-4eaa-a650-86b746dc2943 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:55.933208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45595568-41a2-4eaa-a650-86b746dc2943 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:56.411949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-45595568-41a2-4eaa-a650-86b746dc2943 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:56.425738 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-45595568-41a2-4eaa-a650-86b746dc2943 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1683 microversion: 2.1 time: 0.533034 Oct 18 13:23:56.426662 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 930/1801] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:55 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1683 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:56.448322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0b14c95d-a10f-4fb9-9d59-f330a61d2112 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:56.452122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0b14c95d-a10f-4fb9-9d59-f330a61d2112 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:56.477571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b14c95d-a10f-4fb9-9d59-f330a61d2112 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:56.478076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b14c95d-a10f-4fb9-9d59-f330a61d2112 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:56.478520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b14c95d-a10f-4fb9-9d59-f330a61d2112 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:56.479268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b14c95d-a10f-4fb9-9d59-f330a61d2112 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:56.479738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b14c95d-a10f-4fb9-9d59-f330a61d2112 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:56.480185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b14c95d-a10f-4fb9-9d59-f330a61d2112 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:57.273541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:57.287894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=16 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:57.824161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=34 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:58.109824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0b14c95d-a10f-4fb9-9d59-f330a61d2112 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:58.128638 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0b14c95d-a10f-4fb9-9d59-f330a61d2112 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1315 microversion: 2.1 time: 1.697916 Oct 18 13:23:58.146141 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 931/1802] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:56 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1315 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:58.152787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b511a149-91e5-4fe9-81ca-c2cc60481fbd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:58.156662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b511a149-91e5-4fe9-81ca-c2cc60481fbd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:58.169456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b511a149-91e5-4fe9-81ca-c2cc60481fbd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:58.171395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b511a149-91e5-4fe9-81ca-c2cc60481fbd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:58.172204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b511a149-91e5-4fe9-81ca-c2cc60481fbd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:58.176921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b511a149-91e5-4fe9-81ca-c2cc60481fbd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:58.177987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b511a149-91e5-4fe9-81ca-c2cc60481fbd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:58.179238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b511a149-91e5-4fe9-81ca-c2cc60481fbd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:58.476121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:58.818538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b511a149-91e5-4fe9-81ca-c2cc60481fbd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:23:58.827477 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b511a149-91e5-4fe9-81ca-c2cc60481fbd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1493 microversion: 2.1 time: 0.679276 Oct 18 13:23:58.837220 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 932/1803] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:23:58 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1493 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:23:58.879139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=38 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:58.975803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c9e23ae1-5741-43a4-8d59-da54c092ca0b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:58.976710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c9e23ae1-5741-43a4-8d59-da54c092ca0b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:58.987332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9e23ae1-5741-43a4-8d59-da54c092ca0b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:58.987924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9e23ae1-5741-43a4-8d59-da54c092ca0b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:58.990005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9e23ae1-5741-43a4-8d59-da54c092ca0b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:58.993678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9e23ae1-5741-43a4-8d59-da54c092ca0b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:58.996312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9e23ae1-5741-43a4-8d59-da54c092ca0b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:58.997042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9e23ae1-5741-43a4-8d59-da54c092ca0b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:59.187716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:23:59.360990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-c9e23ae1-5741-43a4-8d59-da54c092ca0b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lazy-loading 'services' on Instance uuid 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:23:59.416818 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c9e23ae1-5741-43a4-8d59-da54c092ca0b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1938 microversion: 2.91 time: 0.582639 Oct 18 13:23:59.417810 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 933/1804] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:58 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1938 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:23:59.423018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-4d592701-bb9a-4436-a745-280f1bd5fc6e req-517b1d19-9108-4cd9-be7d-e0efa4a0af60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e67b4b-fc1a-4c86-80bc-afaddef3d664", "name": "network-vif-plugged", "status": "completed", "tag": "4701da41-d271-440c-847d-ed6212bf8189"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:23:59.452279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4d592701-bb9a-4436-a745-280f1bd5fc6e req-517b1d19-9108-4cd9-be7d-e0efa4a0af60 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:59.459489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4d592701-bb9a-4436-a745-280f1bd5fc6e req-517b1d19-9108-4cd9-be7d-e0efa4a0af60 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:59.460767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4d592701-bb9a-4436-a745-280f1bd5fc6e req-517b1d19-9108-4cd9-be7d-e0efa4a0af60 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:59.486912 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-4d592701-bb9a-4436-a745-280f1bd5fc6e req-517b1d19-9108-4cd9-be7d-e0efa4a0af60 service nova] Creating event network-vif-plugged:4701da41-d271-440c-847d-ed6212bf8189 for instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 on n-h2-858384-13 Oct 18 13:23:59.497219 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-4d592701-bb9a-4436-a745-280f1bd5fc6e req-517b1d19-9108-4cd9-be7d-e0efa4a0af60 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077849 Oct 18 13:23:59.499810 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 934/1805] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:23:59.511371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc6a329d-abb4-4749-bc01-b1e3e0b3e440 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:23:59.512380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc6a329d-abb4-4749-bc01-b1e3e0b3e440 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:23:59.519817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc6a329d-abb4-4749-bc01-b1e3e0b3e440 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:59.520579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc6a329d-abb4-4749-bc01-b1e3e0b3e440 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:59.521250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc6a329d-abb4-4749-bc01-b1e3e0b3e440 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:23:59.530989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc6a329d-abb4-4749-bc01-b1e3e0b3e440 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:23:59.534230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc6a329d-abb4-4749-bc01-b1e3e0b3e440 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:23:59.537856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc6a329d-abb4-4749-bc01-b1e3e0b3e440 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:00.199940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc6a329d-abb4-4749-bc01-b1e3e0b3e440 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:00.219107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc6a329d-abb4-4749-bc01-b1e3e0b3e440 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:00.223513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc6a329d-abb4-4749-bc01-b1e3e0b3e440 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:00.229377 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc6a329d-abb4-4749-bc01-b1e3e0b3e440 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1476 microversion: 2.25 time: 0.722153 Oct 18 13:24:00.231232 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 935/1806] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:23:59 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1476 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:00.243728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8cb2e8ab-2063-46aa-b58d-dfc8ff794343 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:00.246838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8cb2e8ab-2063-46aa-b58d-dfc8ff794343 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:00.269475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cb2e8ab-2063-46aa-b58d-dfc8ff794343 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:00.271297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cb2e8ab-2063-46aa-b58d-dfc8ff794343 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:00.273734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cb2e8ab-2063-46aa-b58d-dfc8ff794343 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:00.278969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cb2e8ab-2063-46aa-b58d-dfc8ff794343 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:00.279747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cb2e8ab-2063-46aa-b58d-dfc8ff794343 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:00.282175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cb2e8ab-2063-46aa-b58d-dfc8ff794343 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:00.588331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8cb2e8ab-2063-46aa-b58d-dfc8ff794343 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:00.605610 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8cb2e8ab-2063-46aa-b58d-dfc8ff794343 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1683 microversion: 2.1 time: 0.370971 Oct 18 13:24:00.606864 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 936/1807] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:00 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1683 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:00.623554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c6d1cf88-0798-453a-b56b-e84f792eacbc tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:00.624390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c6d1cf88-0798-453a-b56b-e84f792eacbc tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:00.639591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6d1cf88-0798-453a-b56b-e84f792eacbc tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:00.642384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6d1cf88-0798-453a-b56b-e84f792eacbc tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:00.643107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6d1cf88-0798-453a-b56b-e84f792eacbc tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:00.643902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6d1cf88-0798-453a-b56b-e84f792eacbc tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:00.644424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6d1cf88-0798-453a-b56b-e84f792eacbc tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:00.644780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6d1cf88-0798-453a-b56b-e84f792eacbc tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:00.913939 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c6d1cf88-0798-453a-b56b-e84f792eacbc tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1646 microversion: 2.1 time: 0.304948 Oct 18 13:24:00.934097 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 937/1808] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:00 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1646 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:00.941680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e524df11-2b5f-442a-8aa4-0facb2d876c6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:00.943281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e524df11-2b5f-442a-8aa4-0facb2d876c6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:00.955595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e524df11-2b5f-442a-8aa4-0facb2d876c6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:00.956592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e524df11-2b5f-442a-8aa4-0facb2d876c6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:00.957414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e524df11-2b5f-442a-8aa4-0facb2d876c6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:00.958577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e524df11-2b5f-442a-8aa4-0facb2d876c6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:00.960791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e524df11-2b5f-442a-8aa4-0facb2d876c6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:00.962431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e524df11-2b5f-442a-8aa4-0facb2d876c6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:01.447315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e524df11-2b5f-442a-8aa4-0facb2d876c6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:01.459617 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e524df11-2b5f-442a-8aa4-0facb2d876c6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1315 microversion: 2.1 time: 0.523667 Oct 18 13:24:01.465470 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 938/1809] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:00 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:01.488139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1af6d73b-3a58-4263-b774-76cd4a250b30 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:01.490070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1af6d73b-3a58-4263-b774-76cd4a250b30 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:01.497686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1af6d73b-3a58-4263-b774-76cd4a250b30 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:01.498610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1af6d73b-3a58-4263-b774-76cd4a250b30 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:01.499283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1af6d73b-3a58-4263-b774-76cd4a250b30 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:01.500224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1af6d73b-3a58-4263-b774-76cd4a250b30 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:01.500921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1af6d73b-3a58-4263-b774-76cd4a250b30 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:01.501670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1af6d73b-3a58-4263-b774-76cd4a250b30 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:01.646679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-1af6d73b-3a58-4263-b774-76cd4a250b30 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lazy-loading 'services' on Instance uuid 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:01.691171 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1af6d73b-3a58-4263-b774-76cd4a250b30 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1938 microversion: 2.91 time: 0.223194 Oct 18 13:24:01.696344 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 939/1810] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:01 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1938 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:02.207909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c1163a9c-66fc-400d-9c27-5dce822ee3fd tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:02.209130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c1163a9c-66fc-400d-9c27-5dce822ee3fd tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:02.221659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1163a9c-66fc-400d-9c27-5dce822ee3fd tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:02.225337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1163a9c-66fc-400d-9c27-5dce822ee3fd tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:02.226660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1163a9c-66fc-400d-9c27-5dce822ee3fd tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:02.228832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1163a9c-66fc-400d-9c27-5dce822ee3fd tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:02.231048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1163a9c-66fc-400d-9c27-5dce822ee3fd tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:02.232473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1163a9c-66fc-400d-9c27-5dce822ee3fd tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:02.837407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-c1163a9c-66fc-400d-9c27-5dce822ee3fd tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid 67746251-6df7-43e6-9a3d-c45f1fb662ae {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:02.864000 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c1163a9c-66fc-400d-9c27-5dce822ee3fd tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1971 microversion: 2.25 time: 1.154213 Oct 18 13:24:02.877236 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 940/1811] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:01 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1971 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:02.877236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5917f0ff-fd6c-41d2-8a0c-6340d4939885 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:02.877236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5917f0ff-fd6c-41d2-8a0c-6340d4939885 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:02.907673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5917f0ff-fd6c-41d2-8a0c-6340d4939885 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:02.908299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5917f0ff-fd6c-41d2-8a0c-6340d4939885 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:02.912305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5917f0ff-fd6c-41d2-8a0c-6340d4939885 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:02.916161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5917f0ff-fd6c-41d2-8a0c-6340d4939885 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:02.917274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5917f0ff-fd6c-41d2-8a0c-6340d4939885 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:02.918342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5917f0ff-fd6c-41d2-8a0c-6340d4939885 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:03.449089 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5917f0ff-fd6c-41d2-8a0c-6340d4939885 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1646 microversion: 2.1 time: 0.578397 Oct 18 13:24:03.451595 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 941/1812] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:02 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1646 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:03.472654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6e95cfb6-b5ef-4ff9-a0ee-dad70e4ac1f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:03.473749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6e95cfb6-b5ef-4ff9-a0ee-dad70e4ac1f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:03.485054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e95cfb6-b5ef-4ff9-a0ee-dad70e4ac1f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:03.487111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e95cfb6-b5ef-4ff9-a0ee-dad70e4ac1f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:03.488875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e95cfb6-b5ef-4ff9-a0ee-dad70e4ac1f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:03.490028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e95cfb6-b5ef-4ff9-a0ee-dad70e4ac1f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:03.491572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e95cfb6-b5ef-4ff9-a0ee-dad70e4ac1f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:03.494251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e95cfb6-b5ef-4ff9-a0ee-dad70e4ac1f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:03.742737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6e95cfb6-b5ef-4ff9-a0ee-dad70e4ac1f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:03.760341 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6e95cfb6-b5ef-4ff9-a0ee-dad70e4ac1f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1683 microversion: 2.1 time: 0.305206 Oct 18 13:24:03.762826 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 942/1813] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:03 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1683 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:03.788589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-43c5470b-fe85-4f30-9c8f-3356613db73b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:03.794541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c5470b-fe85-4f30-9c8f-3356613db73b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:03.795540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c5470b-fe85-4f30-9c8f-3356613db73b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:03.796347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c5470b-fe85-4f30-9c8f-3356613db73b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:03.797282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c5470b-fe85-4f30-9c8f-3356613db73b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:03.798074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c5470b-fe85-4f30-9c8f-3356613db73b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:03.798745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c5470b-fe85-4f30-9c8f-3356613db73b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:03.842920 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-43c5470b-fe85-4f30-9c8f-3356613db73b tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.072092 Oct 18 13:24:03.853542 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 943/1814] 10.222.0.40 () {60 vars in 1217 bytes} [Tue Oct 18 13:24:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:24:03.862246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eaa43079-8612-4995-9a2e-b501b3fe9fbc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:03.863618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eaa43079-8612-4995-9a2e-b501b3fe9fbc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:03.871381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eaa43079-8612-4995-9a2e-b501b3fe9fbc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:03.872214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eaa43079-8612-4995-9a2e-b501b3fe9fbc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:03.872813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eaa43079-8612-4995-9a2e-b501b3fe9fbc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:03.875091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eaa43079-8612-4995-9a2e-b501b3fe9fbc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:03.875716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eaa43079-8612-4995-9a2e-b501b3fe9fbc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:03.876302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eaa43079-8612-4995-9a2e-b501b3fe9fbc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:04.155467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eaa43079-8612-4995-9a2e-b501b3fe9fbc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:04.170124 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eaa43079-8612-4995-9a2e-b501b3fe9fbc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1503 microversion: 2.1 time: 0.313212 Oct 18 13:24:04.187349 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 944/1815] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:03 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:04.228590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-befb18dc-231a-4da0-ab51-f4ca8e2ed65f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:04.231116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-befb18dc-231a-4da0-ab51-f4ca8e2ed65f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:04.254242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-befb18dc-231a-4da0-ab51-f4ca8e2ed65f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:04.258089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-befb18dc-231a-4da0-ab51-f4ca8e2ed65f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:04.261996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-befb18dc-231a-4da0-ab51-f4ca8e2ed65f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:04.263010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-befb18dc-231a-4da0-ab51-f4ca8e2ed65f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:04.267149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-befb18dc-231a-4da0-ab51-f4ca8e2ed65f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:04.267847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-befb18dc-231a-4da0-ab51-f4ca8e2ed65f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:04.686580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-befb18dc-231a-4da0-ab51-f4ca8e2ed65f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid 67746251-6df7-43e6-9a3d-c45f1fb662ae {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:04.743116 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-befb18dc-231a-4da0-ab51-f4ca8e2ed65f tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1971 microversion: 2.25 time: 0.551868 Oct 18 13:24:04.744311 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 945/1816] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:04 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1971 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:04.760992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a832bb5f-6bc7-46ac-a5ea-99002c08929f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:04.775226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a832bb5f-6bc7-46ac-a5ea-99002c08929f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:04.777105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a832bb5f-6bc7-46ac-a5ea-99002c08929f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:04.779863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a832bb5f-6bc7-46ac-a5ea-99002c08929f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:04.782407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a832bb5f-6bc7-46ac-a5ea-99002c08929f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:04.786579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a832bb5f-6bc7-46ac-a5ea-99002c08929f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:04.790646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a832bb5f-6bc7-46ac-a5ea-99002c08929f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:04.859176 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a832bb5f-6bc7-46ac-a5ea-99002c08929f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.112181 Oct 18 13:24:04.868091 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 946/1817] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 18 13:24:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:04.882086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6637b694-eef5-4eb8-aa35-9d35578db442 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:04.884233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6637b694-eef5-4eb8-aa35-9d35578db442 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:04.898288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6637b694-eef5-4eb8-aa35-9d35578db442 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:04.901954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6637b694-eef5-4eb8-aa35-9d35578db442 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:04.902604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6637b694-eef5-4eb8-aa35-9d35578db442 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:04.903520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6637b694-eef5-4eb8-aa35-9d35578db442 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:04.904162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6637b694-eef5-4eb8-aa35-9d35578db442 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:04.905794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6637b694-eef5-4eb8-aa35-9d35578db442 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:04.951519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-6637b694-eef5-4eb8-aa35-9d35578db442 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lazy-loading 'flavor' on Instance uuid 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:10.787531 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-240d5aa2-f747-4897-a830-ff6256c300f1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8" status: 200 len: 1445 microversion: 2.1 time: 21.890516 Oct 18 13:24:10.798415 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 872/1818] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:23:48 2022] GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8 => generated 1445 bytes in 21893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:10.798415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-10da4a2e-b65a-43d4-bc54-2a1a8fe73375 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:10.820138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10da4a2e-b65a-43d4-bc54-2a1a8fe73375 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:10.820798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10da4a2e-b65a-43d4-bc54-2a1a8fe73375 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:10.821372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10da4a2e-b65a-43d4-bc54-2a1a8fe73375 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:10.830030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10da4a2e-b65a-43d4-bc54-2a1a8fe73375 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:10.837852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10da4a2e-b65a-43d4-bc54-2a1a8fe73375 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:10.838442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10da4a2e-b65a-43d4-bc54-2a1a8fe73375 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:10.904342 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-10da4a2e-b65a-43d4-bc54-2a1a8fe73375 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.114165 Oct 18 13:24:10.906487 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 873/1819] 10.222.0.40 () {60 vars in 1217 bytes} [Tue Oct 18 13:24:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:24:10.917751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3d952b7c-25a0-457f-94f4-377f3d1cc824 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:10.919183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3d952b7c-25a0-457f-94f4-377f3d1cc824 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:10.936421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d952b7c-25a0-457f-94f4-377f3d1cc824 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:10.939616 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6637b694-eef5-4eb8-aa35-9d35578db442 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "POST /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7/action" status: 202 len: 0 microversion: 2.91 time: 6.069159 Oct 18 13:24:10.940608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d952b7c-25a0-457f-94f4-377f3d1cc824 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:10.941367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d952b7c-25a0-457f-94f4-377f3d1cc824 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:10.942369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d952b7c-25a0-457f-94f4-377f3d1cc824 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:10.942959 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 947/1820] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:24:04 2022] POST /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7/action => generated 0 bytes in 6073 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:24:10.946348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d952b7c-25a0-457f-94f4-377f3d1cc824 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:10.946919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d952b7c-25a0-457f-94f4-377f3d1cc824 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:10.975305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1bb4f202-5517-484d-9873-417b9aede99f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:10.981652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1bb4f202-5517-484d-9873-417b9aede99f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:10.993137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bb4f202-5517-484d-9873-417b9aede99f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:10.993998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bb4f202-5517-484d-9873-417b9aede99f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:10.994621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bb4f202-5517-484d-9873-417b9aede99f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:10.995526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bb4f202-5517-484d-9873-417b9aede99f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:10.996149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bb4f202-5517-484d-9873-417b9aede99f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:10.997646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bb4f202-5517-484d-9873-417b9aede99f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:11.041449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:11.146678 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1bb4f202-5517-484d-9873-417b9aede99f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3/action" status: 202 len: 0 microversion: 2.1 time: 0.183105 Oct 18 13:24:11.148224 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 948/1821] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:24:10 2022] POST /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:24:11.168686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3d952b7c-25a0-457f-94f4-377f3d1cc824 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:11.187257 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3d952b7c-25a0-457f-94f4-377f3d1cc824 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1683 microversion: 2.1 time: 0.278985 Oct 18 13:24:11.203827 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 874/1822] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:10 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1683 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:11.212206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c67a7543-082a-4ae8-82f0-5092633f1238 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4908082b-e104-4797-9a8f-786becf39952"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:11.215502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c67a7543-082a-4ae8-82f0-5092633f1238 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:11.217408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96cd5a29-8793-4765-baab-8aab16589170 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60fe1faf0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:11.247553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c67a7543-082a-4ae8-82f0-5092633f1238 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:11.248322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c67a7543-082a-4ae8-82f0-5092633f1238 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:11.248945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c67a7543-082a-4ae8-82f0-5092633f1238 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:11.249849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c67a7543-082a-4ae8-82f0-5092633f1238 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:11.250521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c67a7543-082a-4ae8-82f0-5092633f1238 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:11.251113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c67a7543-082a-4ae8-82f0-5092633f1238 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:11.315966 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-96cd5a29-8793-4765-baab-8aab16589170 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8" status: 200 len: 1445 microversion: 2.1 time: 0.109252 Oct 18 13:24:11.320838 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 875/1823] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:11 2022] GET /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8 => generated 1445 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:11.337942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6f2fea1e-6d34-497d-87a5-504982581b1d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-13", "block_migration": "auto"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:11.341206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6f2fea1e-6d34-497d-87a5-504982581b1d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:11.348604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f2fea1e-6d34-497d-87a5-504982581b1d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:11.349534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f2fea1e-6d34-497d-87a5-504982581b1d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:11.350296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f2fea1e-6d34-497d-87a5-504982581b1d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:11.351416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f2fea1e-6d34-497d-87a5-504982581b1d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:11.352157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f2fea1e-6d34-497d-87a5-504982581b1d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:11.352817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f2fea1e-6d34-497d-87a5-504982581b1d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:11.422980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-6f2fea1e-6d34-497d-87a5-504982581b1d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'flavor' on Instance uuid 67746251-6df7-43e6-9a3d-c45f1fb662ae {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:11.447074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6f2fea1e-6d34-497d-87a5-504982581b1d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Going to try to live migrate instance to n-h1-858384-13 {{(pid=120612) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:24:11.847621 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c67a7543-082a-4ae8-82f0-5092633f1238 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "POST /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.667243 Oct 18 13:24:11.859740 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 949/1824] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:24:11 2022] POST /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:11.912584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-01bd2d7f-77eb-489e-acb7-5e2acca8e5bf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:11.916304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-01bd2d7f-77eb-489e-acb7-5e2acca8e5bf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:11.940786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01bd2d7f-77eb-489e-acb7-5e2acca8e5bf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:11.948367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01bd2d7f-77eb-489e-acb7-5e2acca8e5bf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:11.948962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01bd2d7f-77eb-489e-acb7-5e2acca8e5bf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:11.949996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01bd2d7f-77eb-489e-acb7-5e2acca8e5bf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:11.950474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01bd2d7f-77eb-489e-acb7-5e2acca8e5bf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:11.950906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01bd2d7f-77eb-489e-acb7-5e2acca8e5bf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:12.318288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-01bd2d7f-77eb-489e-acb7-5e2acca8e5bf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:12.340411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-01bd2d7f-77eb-489e-acb7-5e2acca8e5bf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:12.343777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-01bd2d7f-77eb-489e-acb7-5e2acca8e5bf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:12.352053 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-01bd2d7f-77eb-489e-acb7-5e2acca8e5bf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.488659 Oct 18 13:24:12.352914 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 950/1825] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:11 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:12.376797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3216e75d-9b7c-4795-9a5d-022070b4d6db tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:12.378399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3216e75d-9b7c-4795-9a5d-022070b4d6db tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:12.395278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3216e75d-9b7c-4795-9a5d-022070b4d6db tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:12.395962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3216e75d-9b7c-4795-9a5d-022070b4d6db tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:12.396561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3216e75d-9b7c-4795-9a5d-022070b4d6db tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:12.399465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3216e75d-9b7c-4795-9a5d-022070b4d6db tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:12.400586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3216e75d-9b7c-4795-9a5d-022070b4d6db tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:12.401885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3216e75d-9b7c-4795-9a5d-022070b4d6db tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:12.951557 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3216e75d-9b7c-4795-9a5d-022070b4d6db tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1631 microversion: 2.1 time: 0.597184 Oct 18 13:24:12.952150 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 951/1826] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:12 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1631 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:12.996264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc42e763-fbbe-4fd4-acfb-8c115076ee88 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f111040>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:14.284112 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6f2fea1e-6d34-497d-87a5-504982581b1d tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae/action" status: 202 len: 0 microversion: 2.25 time: 2.961633 Oct 18 13:24:14.284913 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 876/1827] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:24:11 2022] POST /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae/action => generated 0 bytes in 2963 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:24:14.290795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-36b90ebc-52fc-4cb8-ad0a-d058fbd9bc95 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:14.291452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-36b90ebc-52fc-4cb8-ad0a-d058fbd9bc95 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:14.307412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36b90ebc-52fc-4cb8-ad0a-d058fbd9bc95 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:14.310615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36b90ebc-52fc-4cb8-ad0a-d058fbd9bc95 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:14.311135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36b90ebc-52fc-4cb8-ad0a-d058fbd9bc95 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:14.313138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36b90ebc-52fc-4cb8-ad0a-d058fbd9bc95 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:14.315366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36b90ebc-52fc-4cb8-ad0a-d058fbd9bc95 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:14.317259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36b90ebc-52fc-4cb8-ad0a-d058fbd9bc95 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:14.450409 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc42e763-fbbe-4fd4-acfb-8c115076ee88 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8" status: 204 len: 0 microversion: 2.1 time: 1.474710 Oct 18 13:24:14.451690 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 952/1828] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:12 2022] DELETE /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8 => generated 0 bytes in 1499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:24:14.461905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c90bb39-928e-491e-b21c-606f1c0b465f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-13", "block_migration": true, "disk_over_commit": false}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:14.466577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c90bb39-928e-491e-b21c-606f1c0b465f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:14.486323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c90bb39-928e-491e-b21c-606f1c0b465f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:14.486830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c90bb39-928e-491e-b21c-606f1c0b465f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:14.487262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c90bb39-928e-491e-b21c-606f1c0b465f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:14.487977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c90bb39-928e-491e-b21c-606f1c0b465f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:14.525563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c90bb39-928e-491e-b21c-606f1c0b465f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:14.526411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c90bb39-928e-491e-b21c-606f1c0b465f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:14.606892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-3c90bb39-928e-491e-b21c-606f1c0b465f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lazy-loading 'flavor' on Instance uuid 3a0797de-276a-489b-aab7-16391ac1d0d3 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:14.673073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c90bb39-928e-491e-b21c-606f1c0b465f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Going to try to live migrate instance to n-h1-858384-13 {{(pid=120611) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:24:14.728140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36b90ebc-52fc-4cb8-ad0a-d058fbd9bc95 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:14.748499 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-36b90ebc-52fc-4cb8-ad0a-d058fbd9bc95 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1683 microversion: 2.1 time: 0.462333 Oct 18 13:24:14.754396 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 877/1829] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:14 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1683 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:14.764463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-121ae844-9234-464b-a985-8ac70c2d3fb0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:14.770721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-121ae844-9234-464b-a985-8ac70c2d3fb0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:14.785717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-121ae844-9234-464b-a985-8ac70c2d3fb0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:14.786447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-121ae844-9234-464b-a985-8ac70c2d3fb0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:14.787165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-121ae844-9234-464b-a985-8ac70c2d3fb0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:14.791941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-121ae844-9234-464b-a985-8ac70c2d3fb0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:14.794023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-121ae844-9234-464b-a985-8ac70c2d3fb0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:14.796007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-121ae844-9234-464b-a985-8ac70c2d3fb0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:14.808134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:15.130818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-121ae844-9234-464b-a985-8ac70c2d3fb0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:15.152568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-121ae844-9234-464b-a985-8ac70c2d3fb0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:15.158323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-121ae844-9234-464b-a985-8ac70c2d3fb0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:15.175038 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-121ae844-9234-464b-a985-8ac70c2d3fb0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.418969 Oct 18 13:24:15.189738 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 878/1830] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:14 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:15.613201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5ec52488-ac2d-48ac-b45c-3ce192671b6a tempest-FlavorsV2NegativeTest-1970850977 tempest-FlavorsV2NegativeTest-1970850977-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:15.623544 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5ec52488-ac2d-48ac-b45c-3ce192671b6a tempest-FlavorsV2NegativeTest-1970850977 tempest-FlavorsV2NegativeTest-1970850977-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.442344 Oct 18 13:24:15.625953 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 879/1831] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:24:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:15.654932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c3068d71-a503-45b8-a51d-66283e5909a3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:15.660749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c3068d71-a503-45b8-a51d-66283e5909a3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:15.672795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3068d71-a503-45b8-a51d-66283e5909a3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:15.676390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3068d71-a503-45b8-a51d-66283e5909a3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:15.677120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3068d71-a503-45b8-a51d-66283e5909a3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:15.678054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3068d71-a503-45b8-a51d-66283e5909a3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:15.685909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3068d71-a503-45b8-a51d-66283e5909a3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:15.687543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3068d71-a503-45b8-a51d-66283e5909a3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:16.330402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3068d71-a503-45b8-a51d-66283e5909a3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:16.347862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3068d71-a503-45b8-a51d-66283e5909a3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:16.349863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3068d71-a503-45b8-a51d-66283e5909a3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:16.352670 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c3068d71-a503-45b8-a51d-66283e5909a3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.706128 Oct 18 13:24:16.355106 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 880/1832] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:15 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:16.362239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-743581a4-f0de-4a40-b484-c26fcb8ee0a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:16.362966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-743581a4-f0de-4a40-b484-c26fcb8ee0a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:16.374963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-743581a4-f0de-4a40-b484-c26fcb8ee0a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:16.377349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-743581a4-f0de-4a40-b484-c26fcb8ee0a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:16.378819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-743581a4-f0de-4a40-b484-c26fcb8ee0a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:16.381338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-743581a4-f0de-4a40-b484-c26fcb8ee0a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:16.382646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-743581a4-f0de-4a40-b484-c26fcb8ee0a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:16.383437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-743581a4-f0de-4a40-b484-c26fcb8ee0a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:16.449621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-743581a4-f0de-4a40-b484-c26fcb8ee0a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:24:16.573281 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-743581a4-f0de-4a40-b484-c26fcb8ee0a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 204 len: 0 microversion: 2.1 time: 0.215974 Oct 18 13:24:16.574887 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 881/1833] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:24:16 2022] DELETE /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:24:16.596978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-23edc516-4868-4adf-8c3b-87bd867e71a0 req-875dd860-a4b8-4b98-855d-f516f132f833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2403d808-adf4-45f0-a631-cdc6fad44b76", "name": "network-vif-unplugged", "status": "completed", "tag": "43a6f3fa-36dd-4b00-b299-1037fb97ee80"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:16.628460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-23edc516-4868-4adf-8c3b-87bd867e71a0 req-875dd860-a4b8-4b98-855d-f516f132f833 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:16.629686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-23edc516-4868-4adf-8c3b-87bd867e71a0 req-875dd860-a4b8-4b98-855d-f516f132f833 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:16.630290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-23edc516-4868-4adf-8c3b-87bd867e71a0 req-875dd860-a4b8-4b98-855d-f516f132f833 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:16.658546 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-23edc516-4868-4adf-8c3b-87bd867e71a0 req-875dd860-a4b8-4b98-855d-f516f132f833 service nova] Creating event network-vif-unplugged:43a6f3fa-36dd-4b00-b299-1037fb97ee80 for instance 2403d808-adf4-45f0-a631-cdc6fad44b76 on n-h1-858384-13 Oct 18 13:24:16.667805 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-23edc516-4868-4adf-8c3b-87bd867e71a0 req-875dd860-a4b8-4b98-855d-f516f132f833 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091111 Oct 18 13:24:16.670263 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 882/1834] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:16.687684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e33769c3-c3ff-40ca-b227-e0638207512f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:16.688445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e33769c3-c3ff-40ca-b227-e0638207512f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:16.700535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e33769c3-c3ff-40ca-b227-e0638207512f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:16.701026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e33769c3-c3ff-40ca-b227-e0638207512f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:16.701508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e33769c3-c3ff-40ca-b227-e0638207512f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:16.705400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e33769c3-c3ff-40ca-b227-e0638207512f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:16.705973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e33769c3-c3ff-40ca-b227-e0638207512f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:16.706614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e33769c3-c3ff-40ca-b227-e0638207512f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:16.957704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e33769c3-c3ff-40ca-b227-e0638207512f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:16.976309 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e33769c3-c3ff-40ca-b227-e0638207512f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.295550 Oct 18 13:24:16.978629 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 883/1835] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:16 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:16.999185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-54d39530-1d39-4524-a5d8-e615c64a69f1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:17.000452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-54d39530-1d39-4524-a5d8-e615c64a69f1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:17.029726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54d39530-1d39-4524-a5d8-e615c64a69f1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:17.030858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54d39530-1d39-4524-a5d8-e615c64a69f1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:17.030858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54d39530-1d39-4524-a5d8-e615c64a69f1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:17.036622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54d39530-1d39-4524-a5d8-e615c64a69f1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:17.037129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54d39530-1d39-4524-a5d8-e615c64a69f1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:17.037727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54d39530-1d39-4524-a5d8-e615c64a69f1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:17.204645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-54d39530-1d39-4524-a5d8-e615c64a69f1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:17.218624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-54d39530-1d39-4524-a5d8-e615c64a69f1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:17.221092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-54d39530-1d39-4524-a5d8-e615c64a69f1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:17.230464 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-54d39530-1d39-4524-a5d8-e615c64a69f1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.249685 Oct 18 13:24:17.242703 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 884/1836] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:16 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:17.258256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5ed2e7d4-15b1-4123-b67c-29a7db850c10 tempest-FlavorsV2NegativeTest-1970850977 tempest-FlavorsV2NegativeTest-1970850977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1212839948", "imageRef": "b4f1d520-0feb-44dd-9ec7-796bbbc88b84", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:17.341061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-5ed2e7d4-15b1-4123-b67c-29a7db850c10 tempest-FlavorsV2NegativeTest-1970850977 tempest-FlavorsV2NegativeTest-1970850977-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:24:17.712076 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c90bb39-928e-491e-b21c-606f1c0b465f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3/action" status: 202 len: 0 microversion: 2.1 time: 3.258699 Oct 18 13:24:17.713077 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 953/1837] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:24:14 2022] POST /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3/action => generated 0 bytes in 3260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:24:17.720754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1258150785", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "0b58d9a8-4835-4530-9695-a2f702e82ee6"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:17.744524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=90 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:17.780087 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-5ed2e7d4-15b1-4123-b67c-29a7db850c10 tempest-FlavorsV2NegativeTest-1970850977 tempest-FlavorsV2NegativeTest-1970850977-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5ed2e7d4-15b1-4123-b67c-29a7db850c10 tempest-FlavorsV2NegativeTest-1970850977 tempest-FlavorsV2NegativeTest-1970850977-project] Request method failure captured: Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 143 Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqj9N0-kgKOCIDeESTkD1T9yjWVcHSj2dn2-ktrl9J752jtrpZGa50eCXEIXRJkBeW6gVthjI-XyJbL2Hmu-bywIo2jTfCl1pqNVsbmgTQAKVfZW6jLKS5ut9mIDjgAY_3paTkD96kpHOZL-WVwziY9GaNpcM_ZVIgoCl6pnVRA3IN8 Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 4711d8cba81f415e99a691a506087bea Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FlavorsV2NegativeTest-1970850977 Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:24:17.782716 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:24:17.784392 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4711d8cba81f415e99a691a506087bea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4711d8cba81f415e99a691a506087bea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4711d8cba81f415e99a691a506087bea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4711d8cba81f415e99a691a506087bea"}]}] Oct 18 13:24:17.784392 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FlavorsV2NegativeTest-1970850977 Oct 18 13:24:17.784392 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 4711d8cba81f415e99a691a506087bea Oct 18 13:24:17.784392 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1970850977 Oct 18 13:24:17.784392 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FlavorsV2NegativeTest-1970850977-project Oct 18 13:24:17.784392 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:24:17.784392 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:24:17.784392 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e06b6718bdcf42a2ab95b95d514cd158 Oct 18 13:24:17.784392 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FlavorsV2NegativeTest-1970850977-project Oct 18 13:24:17.784392 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:24:17.784392 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1212839948", "imageRef": "b4f1d520-0feb-44dd-9ec7-796bbbc88b84", "flavorRef": "452"}} Oct 18 13:24:17.784392 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: exception: Flavor's memory is too small for requested image. Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1212839948', 'imageRef': 'b4f1d520-0feb-44dd-9ec7-796bbbc88b84', 'flavorRef': '452'}}} Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:17.785326 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:17.786742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:17.791615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:17.791615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:17.791615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:17.791615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:17.791615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 18 13:24:17.791615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:17.791615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5ed2e7d4-15b1-4123-b67c-29a7db850c10 tempest-FlavorsV2NegativeTest-1970850977 tempest-FlavorsV2NegativeTest-1970850977-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:17.791615 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5ed2e7d4-15b1-4123-b67c-29a7db850c10 tempest-FlavorsV2NegativeTest-1970850977 tempest-FlavorsV2NegativeTest-1970850977-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.550659 Oct 18 13:24:17.791615 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 885/1838] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:17 2022] POST /compute/v2.1/servers => generated 93 bytes in 552 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:24:17.816155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d943db55-7d3a-4692-a678-a472c98493cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:17.824035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d943db55-7d3a-4692-a678-a472c98493cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:17.854072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] validate_networks() for [('0b58d9a8-4835-4530-9695-a2f702e82ee6', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:24:17.860410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d943db55-7d3a-4692-a678-a472c98493cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:17.862092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d943db55-7d3a-4692-a678-a472c98493cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:17.862909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d943db55-7d3a-4692-a678-a472c98493cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:17.864429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d943db55-7d3a-4692-a678-a472c98493cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:17.865024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d943db55-7d3a-4692-a678-a472c98493cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:17.865388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d943db55-7d3a-4692-a678-a472c98493cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:18.271761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d943db55-7d3a-4692-a678-a472c98493cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:18.289506 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d943db55-7d3a-4692-a678-a472c98493cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.502798 Oct 18 13:24:18.290657 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 886/1839] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:17 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:18.299078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aec2a30a-676f-43d9-b66b-c012e98a090b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:18.300214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aec2a30a-676f-43d9-b66b-c012e98a090b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:18.311355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aec2a30a-676f-43d9-b66b-c012e98a090b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:18.312474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aec2a30a-676f-43d9-b66b-c012e98a090b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:18.327376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aec2a30a-676f-43d9-b66b-c012e98a090b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:18.328651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aec2a30a-676f-43d9-b66b-c012e98a090b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:18.333115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aec2a30a-676f-43d9-b66b-c012e98a090b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:18.334793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aec2a30a-676f-43d9-b66b-c012e98a090b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:18.630199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:24:18.631253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:24:18.632168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:24:18.633033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:24:18.633839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:24:18.650358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:18.650358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:18.650358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:18.650937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:18.651748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:18.652864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:18.682887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Getting quotas for project 472fc8535c504953a8f14a24f9d22260. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:24:18.692109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Getting quotas for user f896caa4caa0472db9198f7795401df2 and project 472fc8535c504953a8f14a24f9d22260. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:24:18.714168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:24:18.717234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:24:18.847523 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ce779cef-c591-4f61-aa0c-1ff36f334dc3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.132972 Oct 18 13:24:18.854955 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 954/1840] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:24:18.863915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6fbb8e68-859d-4c2e-b7fe-b4bfc5ad9211 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:18.867105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6fbb8e68-859d-4c2e-b7fe-b4bfc5ad9211 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:18.883116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fbb8e68-859d-4c2e-b7fe-b4bfc5ad9211 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:18.886180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fbb8e68-859d-4c2e-b7fe-b4bfc5ad9211 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:18.886799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fbb8e68-859d-4c2e-b7fe-b4bfc5ad9211 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:18.888368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fbb8e68-859d-4c2e-b7fe-b4bfc5ad9211 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:18.890401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fbb8e68-859d-4c2e-b7fe-b4bfc5ad9211 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:18.891018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fbb8e68-859d-4c2e-b7fe-b4bfc5ad9211 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:19.143742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aec2a30a-676f-43d9-b66b-c012e98a090b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:19.167372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aec2a30a-676f-43d9-b66b-c012e98a090b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:19.177018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aec2a30a-676f-43d9-b66b-c012e98a090b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:19.179235 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aec2a30a-676f-43d9-b66b-c012e98a090b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.886450 Oct 18 13:24:19.187182 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 887/1841] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:18 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:19.198226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6fbb8e68-859d-4c2e-b7fe-b4bfc5ad9211 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:19.209807 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6fbb8e68-859d-4c2e-b7fe-b4bfc5ad9211 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.352707 Oct 18 13:24:19.210749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dcd1e4bf-5b25-4b28-a14a-6f115da87fc3 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:19.221731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dcd1e4bf-5b25-4b28-a14a-6f115da87fc3 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:19.222646 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 955/1842] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:18 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:19.235316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e3bfe69-dd14-4cdd-bdf6-0daec706ff15 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:19.236217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7e3bfe69-dd14-4cdd-bdf6-0daec706ff15 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:19.240371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcd1e4bf-5b25-4b28-a14a-6f115da87fc3 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:19.240870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcd1e4bf-5b25-4b28-a14a-6f115da87fc3 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:19.250199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcd1e4bf-5b25-4b28-a14a-6f115da87fc3 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:19.256433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcd1e4bf-5b25-4b28-a14a-6f115da87fc3 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:19.258188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcd1e4bf-5b25-4b28-a14a-6f115da87fc3 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:19.259081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcd1e4bf-5b25-4b28-a14a-6f115da87fc3 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:19.312249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7e3bfe69-dd14-4cdd-bdf6-0daec706ff15 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:19.332967 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7e3bfe69-dd14-4cdd-bdf6-0daec706ff15 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1208 microversion: 2.1 time: 0.107443 Oct 18 13:24:19.345206 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 956/1843] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:19 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1208 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:19.345206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-33421873-dc07-4ca1-b960-15677a50a447 req-6c8123a8-c544-4550-8306-f5448fbd529a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aad90b5-28fb-44b2-89da-33bc1b2889f2", "name": "network-vif-unplugged", "status": "completed", "tag": "516c3ad3-1e31-4bde-b674-c0c367989f56"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:19.359668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-33421873-dc07-4ca1-b960-15677a50a447 req-6c8123a8-c544-4550-8306-f5448fbd529a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:19.360304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-33421873-dc07-4ca1-b960-15677a50a447 req-6c8123a8-c544-4550-8306-f5448fbd529a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:19.361043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-33421873-dc07-4ca1-b960-15677a50a447 req-6c8123a8-c544-4550-8306-f5448fbd529a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:19.377434 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-33421873-dc07-4ca1-b960-15677a50a447 req-6c8123a8-c544-4550-8306-f5448fbd529a service nova] Creating event network-vif-unplugged:516c3ad3-1e31-4bde-b674-c0c367989f56 for instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 on n-h1-858384-13 Oct 18 13:24:19.384588 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-33421873-dc07-4ca1-b960-15677a50a447 req-6c8123a8-c544-4550-8306-f5448fbd529a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048092 Oct 18 13:24:19.389690 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 957/1844] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:19.472486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dcd1e4bf-5b25-4b28-a14a-6f115da87fc3 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:19.484443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dcd1e4bf-5b25-4b28-a14a-6f115da87fc3 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:19.487795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dcd1e4bf-5b25-4b28-a14a-6f115da87fc3 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:19.509687 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dcd1e4bf-5b25-4b28-a14a-6f115da87fc3 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1558 microversion: 2.91 time: 0.321050 Oct 18 13:24:19.510952 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 888/1845] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:19 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1558 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:20.218830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-01fac337-2ca2-450e-9a46-4ac532706306 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:20.219619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-01fac337-2ca2-450e-9a46-4ac532706306 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:20.242521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01fac337-2ca2-450e-9a46-4ac532706306 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:20.244826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c2d5379e-4409-431d-981b-5cf9d99d49b2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:20.245691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c2d5379e-4409-431d-981b-5cf9d99d49b2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:20.248069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01fac337-2ca2-450e-9a46-4ac532706306 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:20.248543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01fac337-2ca2-450e-9a46-4ac532706306 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:20.254337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01fac337-2ca2-450e-9a46-4ac532706306 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:20.254943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01fac337-2ca2-450e-9a46-4ac532706306 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:20.256460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2d5379e-4409-431d-981b-5cf9d99d49b2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:20.257671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2d5379e-4409-431d-981b-5cf9d99d49b2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:20.258174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2d5379e-4409-431d-981b-5cf9d99d49b2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:20.258839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01fac337-2ca2-450e-9a46-4ac532706306 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:20.259503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2d5379e-4409-431d-981b-5cf9d99d49b2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:20.260003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2d5379e-4409-431d-981b-5cf9d99d49b2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:20.260438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2d5379e-4409-431d-981b-5cf9d99d49b2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:20.825096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-01fac337-2ca2-450e-9a46-4ac532706306 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:20.838352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-01fac337-2ca2-450e-9a46-4ac532706306 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:20.840370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-01fac337-2ca2-450e-9a46-4ac532706306 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:20.841862 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-01fac337-2ca2-450e-9a46-4ac532706306 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.627556 Oct 18 13:24:20.857156 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 958/1846] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:20 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:20.864320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:20.871329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a04870b1-074f-440c-ba90-fe3b441729a1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:20.872263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a04870b1-074f-440c-ba90-fe3b441729a1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:20.879891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a04870b1-074f-440c-ba90-fe3b441729a1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:20.880746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a04870b1-074f-440c-ba90-fe3b441729a1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:20.881495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a04870b1-074f-440c-ba90-fe3b441729a1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:20.883441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a04870b1-074f-440c-ba90-fe3b441729a1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:20.884182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a04870b1-074f-440c-ba90-fe3b441729a1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:20.884879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a04870b1-074f-440c-ba90-fe3b441729a1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:21.009536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a04870b1-074f-440c-ba90-fe3b441729a1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:21.031955 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a04870b1-074f-440c-ba90-fe3b441729a1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1204 microversion: 2.1 time: 0.169628 Oct 18 13:24:21.033809 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 959/1847] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:20 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1204 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:21.050504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d03bddab-155f-4414-a5ae-3296cc8f3d27 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:21.052067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d03bddab-155f-4414-a5ae-3296cc8f3d27 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:21.062862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03bddab-155f-4414-a5ae-3296cc8f3d27 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:21.063975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03bddab-155f-4414-a5ae-3296cc8f3d27 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:21.064674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03bddab-155f-4414-a5ae-3296cc8f3d27 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:21.065818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03bddab-155f-4414-a5ae-3296cc8f3d27 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:21.066518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03bddab-155f-4414-a5ae-3296cc8f3d27 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:21.067368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03bddab-155f-4414-a5ae-3296cc8f3d27 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:21.243139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d03bddab-155f-4414-a5ae-3296cc8f3d27 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:21.252107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c2d5379e-4409-431d-981b-5cf9d99d49b2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:21.259794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d03bddab-155f-4414-a5ae-3296cc8f3d27 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:21.266439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d03bddab-155f-4414-a5ae-3296cc8f3d27 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:21.267920 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c2d5379e-4409-431d-981b-5cf9d99d49b2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 1.032291 Oct 18 13:24:21.283903 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d03bddab-155f-4414-a5ae-3296cc8f3d27 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1558 microversion: 2.91 time: 0.248712 Oct 18 13:24:21.284910 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 960/1848] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:21 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1558 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:21.291949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-bb324045-3e8c-4823-884e-b8f014c2ff10 req-921b1b43-5cb2-42aa-afa2-4e98df09f470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2403d808-adf4-45f0-a631-cdc6fad44b76", "name": "network-vif-deleted", "tag": "43a6f3fa-36dd-4b00-b299-1037fb97ee80"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:21.292721 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 889/1849] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:20 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:21.304401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bb324045-3e8c-4823-884e-b8f014c2ff10 req-921b1b43-5cb2-42aa-afa2-4e98df09f470 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:21.304930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dbbc6479-dd41-4b0d-b4c1-12050c255ea4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:21.305642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dbbc6479-dd41-4b0d-b4c1-12050c255ea4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:21.305816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bb324045-3e8c-4823-884e-b8f014c2ff10 req-921b1b43-5cb2-42aa-afa2-4e98df09f470 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:21.306355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bb324045-3e8c-4823-884e-b8f014c2ff10 req-921b1b43-5cb2-42aa-afa2-4e98df09f470 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:21.318146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbbc6479-dd41-4b0d-b4c1-12050c255ea4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:21.318895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbbc6479-dd41-4b0d-b4c1-12050c255ea4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:21.319524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbbc6479-dd41-4b0d-b4c1-12050c255ea4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:21.320504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbbc6479-dd41-4b0d-b4c1-12050c255ea4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:21.321253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbbc6479-dd41-4b0d-b4c1-12050c255ea4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:21.321841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbbc6479-dd41-4b0d-b4c1-12050c255ea4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:21.324973 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-bb324045-3e8c-4823-884e-b8f014c2ff10 req-921b1b43-5cb2-42aa-afa2-4e98df09f470 service nova] Creating event network-vif-deleted:43a6f3fa-36dd-4b00-b299-1037fb97ee80 for instance 2403d808-adf4-45f0-a631-cdc6fad44b76 on n-h1-858384-13 Oct 18 13:24:21.328965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:21.333059 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-bb324045-3e8c-4823-884e-b8f014c2ff10 req-921b1b43-5cb2-42aa-afa2-4e98df09f470 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045884 Oct 18 13:24:21.334415 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 961/1850] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:21.876139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a1f161a8-0431-4d50-8105-ebf3ce2d4010 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:21.876844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a1f161a8-0431-4d50-8105-ebf3ce2d4010 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:21.892131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1f161a8-0431-4d50-8105-ebf3ce2d4010 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:21.894455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1f161a8-0431-4d50-8105-ebf3ce2d4010 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:21.895135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1f161a8-0431-4d50-8105-ebf3ce2d4010 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:21.900001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1f161a8-0431-4d50-8105-ebf3ce2d4010 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:21.900820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1f161a8-0431-4d50-8105-ebf3ce2d4010 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:21.901554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1f161a8-0431-4d50-8105-ebf3ce2d4010 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:21.945415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dbbc6479-dd41-4b0d-b4c1-12050c255ea4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:21.958775 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dbbc6479-dd41-4b0d-b4c1-12050c255ea4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.664760 Oct 18 13:24:21.961156 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 890/1851] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:21 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:22.008821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-db1c4c2f-90b0-4dcb-831f-0d6185f19ed3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:22.010582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-db1c4c2f-90b0-4dcb-831f-0d6185f19ed3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:22.024505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db1c4c2f-90b0-4dcb-831f-0d6185f19ed3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:22.025824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db1c4c2f-90b0-4dcb-831f-0d6185f19ed3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:22.026904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db1c4c2f-90b0-4dcb-831f-0d6185f19ed3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:22.028564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db1c4c2f-90b0-4dcb-831f-0d6185f19ed3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:22.029662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db1c4c2f-90b0-4dcb-831f-0d6185f19ed3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:22.030779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db1c4c2f-90b0-4dcb-831f-0d6185f19ed3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:22.342771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a1f161a8-0431-4d50-8105-ebf3ce2d4010 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:22.370356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a1f161a8-0431-4d50-8105-ebf3ce2d4010 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:22.379607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a1f161a8-0431-4d50-8105-ebf3ce2d4010 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:22.382904 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a1f161a8-0431-4d50-8105-ebf3ce2d4010 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.510981 Oct 18 13:24:22.386147 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 962/1852] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:21 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:22.409350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c0bb6307-1401-4f5f-9e79-402b84786266 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:22.410025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c0bb6307-1401-4f5f-9e79-402b84786266 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:22.431875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0bb6307-1401-4f5f-9e79-402b84786266 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:22.438380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0bb6307-1401-4f5f-9e79-402b84786266 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:22.439515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0bb6307-1401-4f5f-9e79-402b84786266 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:22.442108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0bb6307-1401-4f5f-9e79-402b84786266 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:22.443183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0bb6307-1401-4f5f-9e79-402b84786266 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:22.447422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0bb6307-1401-4f5f-9e79-402b84786266 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:22.660904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c0bb6307-1401-4f5f-9e79-402b84786266 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:22.673153 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c0bb6307-1401-4f5f-9e79-402b84786266 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1260 microversion: 2.1 time: 0.285287 Oct 18 13:24:22.693379 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 963/1853] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:22 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1260 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:22.699007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-db1c4c2f-90b0-4dcb-831f-0d6185f19ed3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:22.706087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5790aa09-9185-4131-94bf-fce8c831e964 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:22.707175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5790aa09-9185-4131-94bf-fce8c831e964 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:22.717483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5790aa09-9185-4131-94bf-fce8c831e964 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:22.718837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5790aa09-9185-4131-94bf-fce8c831e964 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:22.719114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5790aa09-9185-4131-94bf-fce8c831e964 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:22.719953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5790aa09-9185-4131-94bf-fce8c831e964 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:22.720722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5790aa09-9185-4131-94bf-fce8c831e964 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:22.721776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5790aa09-9185-4131-94bf-fce8c831e964 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:22.745686 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-db1c4c2f-90b0-4dcb-831f-0d6185f19ed3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.742695 Oct 18 13:24:22.748528 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 891/1854] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:21 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:22.771732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e1c328fd-b162-4e0d-816d-8b7bb7b0f0a1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:22.773925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e1c328fd-b162-4e0d-816d-8b7bb7b0f0a1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:22.829640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1c328fd-b162-4e0d-816d-8b7bb7b0f0a1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:22.831183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1c328fd-b162-4e0d-816d-8b7bb7b0f0a1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:22.846844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1c328fd-b162-4e0d-816d-8b7bb7b0f0a1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:22.853446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1c328fd-b162-4e0d-816d-8b7bb7b0f0a1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:22.856313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1c328fd-b162-4e0d-816d-8b7bb7b0f0a1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:22.857483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1c328fd-b162-4e0d-816d-8b7bb7b0f0a1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:23.074063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e1c328fd-b162-4e0d-816d-8b7bb7b0f0a1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:23.093538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e1c328fd-b162-4e0d-816d-8b7bb7b0f0a1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:23.101553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e1c328fd-b162-4e0d-816d-8b7bb7b0f0a1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:23.123569 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e1c328fd-b162-4e0d-816d-8b7bb7b0f0a1 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.369122 Oct 18 13:24:23.124198 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 892/1855] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:22 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:23.138374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-91dacc57-59ee-49b1-a342-0d88f6e019b9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:23.140109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-91dacc57-59ee-49b1-a342-0d88f6e019b9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:23.157954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91dacc57-59ee-49b1-a342-0d88f6e019b9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:23.162153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91dacc57-59ee-49b1-a342-0d88f6e019b9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:23.164056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91dacc57-59ee-49b1-a342-0d88f6e019b9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:23.165034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91dacc57-59ee-49b1-a342-0d88f6e019b9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:23.166931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91dacc57-59ee-49b1-a342-0d88f6e019b9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:23.170623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91dacc57-59ee-49b1-a342-0d88f6e019b9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:23.182673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5790aa09-9185-4131-94bf-fce8c831e964 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:23.192014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:23.199286 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5790aa09-9185-4131-94bf-fce8c831e964 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.503241 Oct 18 13:24:23.202073 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 964/1856] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:22 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:23.441220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6fd7eb00-c2c4-4cb0-a9be-059cf4be4fc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:23.442683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6fd7eb00-c2c4-4cb0-a9be-059cf4be4fc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:23.465157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fd7eb00-c2c4-4cb0-a9be-059cf4be4fc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:23.466014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fd7eb00-c2c4-4cb0-a9be-059cf4be4fc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:23.466721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fd7eb00-c2c4-4cb0-a9be-059cf4be4fc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:23.467476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fd7eb00-c2c4-4cb0-a9be-059cf4be4fc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:23.467938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fd7eb00-c2c4-4cb0-a9be-059cf4be4fc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:23.468369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fd7eb00-c2c4-4cb0-a9be-059cf4be4fc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:23.655093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-91dacc57-59ee-49b1-a342-0d88f6e019b9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:23.666035 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-91dacc57-59ee-49b1-a342-0d88f6e019b9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.539560 Oct 18 13:24:23.667375 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 893/1857] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:23 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:23.692394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-18b5b929-eb4c-4c78-a0bd-32d98a2f690f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:23.698299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-18b5b929-eb4c-4c78-a0bd-32d98a2f690f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:23.716973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18b5b929-eb4c-4c78-a0bd-32d98a2f690f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:23.722534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18b5b929-eb4c-4c78-a0bd-32d98a2f690f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:23.723312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18b5b929-eb4c-4c78-a0bd-32d98a2f690f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:23.724247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18b5b929-eb4c-4c78-a0bd-32d98a2f690f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:23.725014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18b5b929-eb4c-4c78-a0bd-32d98a2f690f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:23.726426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18b5b929-eb4c-4c78-a0bd-32d98a2f690f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:23.853635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6fd7eb00-c2c4-4cb0-a9be-059cf4be4fc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:23.871281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6fd7eb00-c2c4-4cb0-a9be-059cf4be4fc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:23.874897 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-18b5b929-eb4c-4c78-a0bd-32d98a2f690f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.186148 Oct 18 13:24:23.876212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6fd7eb00-c2c4-4cb0-a9be-059cf4be4fc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:23.879507 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 894/1858] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:24:23 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:24:23.881247 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6fd7eb00-c2c4-4cb0-a9be-059cf4be4fc0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.444172 Oct 18 13:24:23.890660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ac2f4de3-920c-4266-b111-0d295c3a54c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:23.891701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ac2f4de3-920c-4266-b111-0d295c3a54c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:23.903328 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 965/1859] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:23 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:24:23.912202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac2f4de3-920c-4266-b111-0d295c3a54c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:23.913590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac2f4de3-920c-4266-b111-0d295c3a54c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:23.915646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac2f4de3-920c-4266-b111-0d295c3a54c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:23.919410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac2f4de3-920c-4266-b111-0d295c3a54c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:23.920228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-186362e2-d521-4c55-842f-7c31d30c691e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:23.921135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-186362e2-d521-4c55-842f-7c31d30c691e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:23.921743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac2f4de3-920c-4266-b111-0d295c3a54c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:23.923042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac2f4de3-920c-4266-b111-0d295c3a54c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:23.947600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-186362e2-d521-4c55-842f-7c31d30c691e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:23.949406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-186362e2-d521-4c55-842f-7c31d30c691e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:23.949973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-186362e2-d521-4c55-842f-7c31d30c691e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:23.954100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-186362e2-d521-4c55-842f-7c31d30c691e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:23.954728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-186362e2-d521-4c55-842f-7c31d30c691e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:23.955266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-186362e2-d521-4c55-842f-7c31d30c691e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:24.330554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-186362e2-d521-4c55-842f-7c31d30c691e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:24.360221 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-186362e2-d521-4c55-842f-7c31d30c691e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1672 microversion: 2.1 time: 0.455245 Oct 18 13:24:24.362078 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 966/1860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:23 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1672 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:24.381386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9bee391b-d16b-483a-a749-315640c5dfcf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:24.382057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9bee391b-d16b-483a-a749-315640c5dfcf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:24.405037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bee391b-d16b-483a-a749-315640c5dfcf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:24.405473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bee391b-d16b-483a-a749-315640c5dfcf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:24.405898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bee391b-d16b-483a-a749-315640c5dfcf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:24.406490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ac2f4de3-920c-4266-b111-0d295c3a54c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:24.411620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bee391b-d16b-483a-a749-315640c5dfcf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:24.412096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bee391b-d16b-483a-a749-315640c5dfcf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:24.412528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bee391b-d16b-483a-a749-315640c5dfcf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:24.423476 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ac2f4de3-920c-4266-b111-0d295c3a54c5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1266 microversion: 2.1 time: 0.539710 Oct 18 13:24:24.425628 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 895/1861] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:23 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1266 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:24.442771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-75f8b70c-5e7d-4d09-aa42-526806decd9f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:24.443756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-75f8b70c-5e7d-4d09-aa42-526806decd9f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:24.457112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75f8b70c-5e7d-4d09-aa42-526806decd9f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:24.461204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75f8b70c-5e7d-4d09-aa42-526806decd9f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:24.464357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75f8b70c-5e7d-4d09-aa42-526806decd9f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:24.465473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75f8b70c-5e7d-4d09-aa42-526806decd9f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:24.467264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75f8b70c-5e7d-4d09-aa42-526806decd9f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:24.467930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75f8b70c-5e7d-4d09-aa42-526806decd9f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:24.691217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9bee391b-d16b-483a-a749-315640c5dfcf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:24.707925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9bee391b-d16b-483a-a749-315640c5dfcf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:24.716037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9bee391b-d16b-483a-a749-315640c5dfcf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:24.729538 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9bee391b-d16b-483a-a749-315640c5dfcf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.359016 Oct 18 13:24:24.738554 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 967/1862] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:24 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:24.916790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7fab0b3f-368b-41be-b9ec-9f8abc89fffd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:24.918345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7fab0b3f-368b-41be-b9ec-9f8abc89fffd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:24.930311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fab0b3f-368b-41be-b9ec-9f8abc89fffd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:24.932120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fab0b3f-368b-41be-b9ec-9f8abc89fffd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:24.934524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fab0b3f-368b-41be-b9ec-9f8abc89fffd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:24.935266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fab0b3f-368b-41be-b9ec-9f8abc89fffd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:24.935726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fab0b3f-368b-41be-b9ec-9f8abc89fffd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:24.938405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fab0b3f-368b-41be-b9ec-9f8abc89fffd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:25.436463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7fab0b3f-368b-41be-b9ec-9f8abc89fffd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:25.450522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7fab0b3f-368b-41be-b9ec-9f8abc89fffd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:25.459447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7fab0b3f-368b-41be-b9ec-9f8abc89fffd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:25.461810 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7fab0b3f-368b-41be-b9ec-9f8abc89fffd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.549668 Oct 18 13:24:25.474340 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 968/1863] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:24 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:25.489289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0830c8e0-aa25-4e5d-aea5-63749364307c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:25.490176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0830c8e0-aa25-4e5d-aea5-63749364307c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:25.498659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0830c8e0-aa25-4e5d-aea5-63749364307c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:25.500594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0830c8e0-aa25-4e5d-aea5-63749364307c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:25.505885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0830c8e0-aa25-4e5d-aea5-63749364307c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:25.507959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0830c8e0-aa25-4e5d-aea5-63749364307c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:25.508719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0830c8e0-aa25-4e5d-aea5-63749364307c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:25.509406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0830c8e0-aa25-4e5d-aea5-63749364307c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:25.594749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-75f8b70c-5e7d-4d09-aa42-526806decd9f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:25.612217 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-75f8b70c-5e7d-4d09-aa42-526806decd9f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 1.185294 Oct 18 13:24:25.621123 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 896/1864] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:24 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:25.639410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d5554d66-743b-406a-bfd5-ec53ef993a31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:25.640740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d5554d66-743b-406a-bfd5-ec53ef993a31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:25.650398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5554d66-743b-406a-bfd5-ec53ef993a31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:25.651352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5554d66-743b-406a-bfd5-ec53ef993a31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:25.655876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5554d66-743b-406a-bfd5-ec53ef993a31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:25.657153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5554d66-743b-406a-bfd5-ec53ef993a31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:25.657967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5554d66-743b-406a-bfd5-ec53ef993a31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:25.658762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5554d66-743b-406a-bfd5-ec53ef993a31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:25.993876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d5554d66-743b-406a-bfd5-ec53ef993a31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:26.006076 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d5554d66-743b-406a-bfd5-ec53ef993a31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1266 microversion: 2.1 time: 0.381036 Oct 18 13:24:26.006777 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 897/1865] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:25 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1266 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:26.020957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-81418db3-c1fa-4c26-97a9-f8c32a941fa8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:26.021846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-81418db3-c1fa-4c26-97a9-f8c32a941fa8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:26.040390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81418db3-c1fa-4c26-97a9-f8c32a941fa8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:26.040885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81418db3-c1fa-4c26-97a9-f8c32a941fa8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:26.041343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81418db3-c1fa-4c26-97a9-f8c32a941fa8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:26.044024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81418db3-c1fa-4c26-97a9-f8c32a941fa8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:26.045710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81418db3-c1fa-4c26-97a9-f8c32a941fa8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:26.046408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81418db3-c1fa-4c26-97a9-f8c32a941fa8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:26.229802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-81418db3-c1fa-4c26-97a9-f8c32a941fa8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:26.247601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-81418db3-c1fa-4c26-97a9-f8c32a941fa8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:26.251727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-81418db3-c1fa-4c26-97a9-f8c32a941fa8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:26.278451 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-81418db3-c1fa-4c26-97a9-f8c32a941fa8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.267639 Oct 18 13:24:26.279874 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 898/1866] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:26 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:26.318973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0830c8e0-aa25-4e5d-aea5-63749364307c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:26.334956 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0830c8e0-aa25-4e5d-aea5-63749364307c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1672 microversion: 2.1 time: 0.859040 Oct 18 13:24:26.335710 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 969/1867] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:25 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1672 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:26.503516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e86a7f8e-62b3-46ec-8191-f280a6a2b7c9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:26.504150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e86a7f8e-62b3-46ec-8191-f280a6a2b7c9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:26.532314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e86a7f8e-62b3-46ec-8191-f280a6a2b7c9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:26.533122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e86a7f8e-62b3-46ec-8191-f280a6a2b7c9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:26.542974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e86a7f8e-62b3-46ec-8191-f280a6a2b7c9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:26.544011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e86a7f8e-62b3-46ec-8191-f280a6a2b7c9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:26.544595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e86a7f8e-62b3-46ec-8191-f280a6a2b7c9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:26.548788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e86a7f8e-62b3-46ec-8191-f280a6a2b7c9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:26.670323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9a74f7bf-1cc8-471d-843c-72c64a9008bb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:26.671633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9a74f7bf-1cc8-471d-843c-72c64a9008bb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:26.691963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a74f7bf-1cc8-471d-843c-72c64a9008bb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:26.693360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a74f7bf-1cc8-471d-843c-72c64a9008bb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:26.693903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a74f7bf-1cc8-471d-843c-72c64a9008bb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:26.695108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a74f7bf-1cc8-471d-843c-72c64a9008bb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:26.698425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a74f7bf-1cc8-471d-843c-72c64a9008bb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:26.700702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a74f7bf-1cc8-471d-843c-72c64a9008bb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.184530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9a74f7bf-1cc8-471d-843c-72c64a9008bb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:27.197597 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9a74f7bf-1cc8-471d-843c-72c64a9008bb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.531854 Oct 18 13:24:27.202814 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 970/1868] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:26 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:27.217374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b728a030-39f3-4d15-b408-24486164c022 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:27.228796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b728a030-39f3-4d15-b408-24486164c022 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:27.248064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b728a030-39f3-4d15-b408-24486164c022 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:27.251798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b728a030-39f3-4d15-b408-24486164c022 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:27.252601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b728a030-39f3-4d15-b408-24486164c022 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.254195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b728a030-39f3-4d15-b408-24486164c022 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:27.255409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b728a030-39f3-4d15-b408-24486164c022 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:27.259194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b728a030-39f3-4d15-b408-24486164c022 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.437267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e86a7f8e-62b3-46ec-8191-f280a6a2b7c9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:27.458577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e86a7f8e-62b3-46ec-8191-f280a6a2b7c9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:27.461153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e86a7f8e-62b3-46ec-8191-f280a6a2b7c9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:27.462804 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e86a7f8e-62b3-46ec-8191-f280a6a2b7c9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.964179 Oct 18 13:24:27.469545 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 899/1869] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:26 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:27.475197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5efb4720-6473-4803-8d92-09ed54dce023 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:27.477886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5efb4720-6473-4803-8d92-09ed54dce023 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:27.479221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b728a030-39f3-4d15-b408-24486164c022 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:27.490979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5efb4720-6473-4803-8d92-09ed54dce023 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:27.498046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5efb4720-6473-4803-8d92-09ed54dce023 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:27.498911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5efb4720-6473-4803-8d92-09ed54dce023 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.500326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5efb4720-6473-4803-8d92-09ed54dce023 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:27.501541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5efb4720-6473-4803-8d92-09ed54dce023 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:27.502235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5efb4720-6473-4803-8d92-09ed54dce023 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.530382 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b728a030-39f3-4d15-b408-24486164c022 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1266 microversion: 2.1 time: 0.324014 Oct 18 13:24:27.532888 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 971/1870] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:27 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:27.554963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-afe3e41d-4293-4fa5-8975-3b31c1b5c55e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:27.555821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-afe3e41d-4293-4fa5-8975-3b31c1b5c55e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:27.573551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afe3e41d-4293-4fa5-8975-3b31c1b5c55e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:27.574499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afe3e41d-4293-4fa5-8975-3b31c1b5c55e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:27.576053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afe3e41d-4293-4fa5-8975-3b31c1b5c55e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.579101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afe3e41d-4293-4fa5-8975-3b31c1b5c55e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:27.580711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afe3e41d-4293-4fa5-8975-3b31c1b5c55e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:27.583402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afe3e41d-4293-4fa5-8975-3b31c1b5c55e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:27.972883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5efb4720-6473-4803-8d92-09ed54dce023 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:27.983051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5efb4720-6473-4803-8d92-09ed54dce023 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:27.994113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5efb4720-6473-4803-8d92-09ed54dce023 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:28.000063 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5efb4720-6473-4803-8d92-09ed54dce023 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.529001 Oct 18 13:24:28.006323 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 900/1871] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:27 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:28.235573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aea4174f-20d9-425d-86b8-b0cd8bac8652 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:28.236599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aea4174f-20d9-425d-86b8-b0cd8bac8652 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:28.248579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aea4174f-20d9-425d-86b8-b0cd8bac8652 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:28.253079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aea4174f-20d9-425d-86b8-b0cd8bac8652 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:28.256206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aea4174f-20d9-425d-86b8-b0cd8bac8652 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:28.257243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aea4174f-20d9-425d-86b8-b0cd8bac8652 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:28.259733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aea4174f-20d9-425d-86b8-b0cd8bac8652 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:28.268883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aea4174f-20d9-425d-86b8-b0cd8bac8652 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:28.269148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-afe3e41d-4293-4fa5-8975-3b31c1b5c55e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:28.284269 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-afe3e41d-4293-4fa5-8975-3b31c1b5c55e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1672 microversion: 2.1 time: 0.748249 Oct 18 13:24:28.286261 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 972/1872] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:27 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1672 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:28.492764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6a5d924f-5418-427a-a468-a098836e0ede tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:28.494306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6a5d924f-5418-427a-a468-a098836e0ede tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:28.506477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a5d924f-5418-427a-a468-a098836e0ede tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:28.507825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a5d924f-5418-427a-a468-a098836e0ede tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:28.509497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a5d924f-5418-427a-a468-a098836e0ede tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:28.510620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a5d924f-5418-427a-a468-a098836e0ede tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:28.525062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a5d924f-5418-427a-a468-a098836e0ede tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:28.530002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a5d924f-5418-427a-a468-a098836e0ede tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:28.670155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:29.320596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=8 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:29.358831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6a5d924f-5418-427a-a468-a098836e0ede tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:29.378187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6a5d924f-5418-427a-a468-a098836e0ede tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:29.383039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6a5d924f-5418-427a-a468-a098836e0ede tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:29.386953 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6a5d924f-5418-427a-a468-a098836e0ede tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.899172 Oct 18 13:24:29.388586 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 973/1873] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:28 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:29.413230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7a720c88-b2e4-461c-b07f-99268e2bd8ef tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:29.415048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7a720c88-b2e4-461c-b07f-99268e2bd8ef tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:29.436775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a720c88-b2e4-461c-b07f-99268e2bd8ef tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:29.440346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a720c88-b2e4-461c-b07f-99268e2bd8ef tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:29.441266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a720c88-b2e4-461c-b07f-99268e2bd8ef tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:29.443926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a720c88-b2e4-461c-b07f-99268e2bd8ef tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:29.445446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a720c88-b2e4-461c-b07f-99268e2bd8ef tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:29.447127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a720c88-b2e4-461c-b07f-99268e2bd8ef tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:29.734617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aea4174f-20d9-425d-86b8-b0cd8bac8652 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:29.744595 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aea4174f-20d9-425d-86b8-b0cd8bac8652 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 1.512879 Oct 18 13:24:29.751343 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 901/1874] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:28 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:24:29.769418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-83ebdf09-4416-4f17-88e8-40db6aae6f62 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:29.770028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-83ebdf09-4416-4f17-88e8-40db6aae6f62 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:29.783099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83ebdf09-4416-4f17-88e8-40db6aae6f62 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:29.783600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83ebdf09-4416-4f17-88e8-40db6aae6f62 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:29.784029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83ebdf09-4416-4f17-88e8-40db6aae6f62 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:29.786039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83ebdf09-4416-4f17-88e8-40db6aae6f62 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:29.798007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83ebdf09-4416-4f17-88e8-40db6aae6f62 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:29.798734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83ebdf09-4416-4f17-88e8-40db6aae6f62 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:30.040723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7a720c88-b2e4-461c-b07f-99268e2bd8ef tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:30.055293 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7a720c88-b2e4-461c-b07f-99268e2bd8ef tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1308 microversion: 2.1 time: 0.663434 Oct 18 13:24:30.056567 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 974/1875] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:29 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1308 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:30.065412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13ec2901-a629-4e9e-a457-8cd950a15d6c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:30.069816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-13ec2901-a629-4e9e-a457-8cd950a15d6c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:30.097490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13ec2901-a629-4e9e-a457-8cd950a15d6c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:30.097490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13ec2901-a629-4e9e-a457-8cd950a15d6c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:30.097490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13ec2901-a629-4e9e-a457-8cd950a15d6c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:30.097490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13ec2901-a629-4e9e-a457-8cd950a15d6c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:30.097925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13ec2901-a629-4e9e-a457-8cd950a15d6c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:30.097925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13ec2901-a629-4e9e-a457-8cd950a15d6c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:30.228960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-83ebdf09-4416-4f17-88e8-40db6aae6f62 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:30.243716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-83ebdf09-4416-4f17-88e8-40db6aae6f62 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:30.252393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-83ebdf09-4416-4f17-88e8-40db6aae6f62 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:30.271172 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-83ebdf09-4416-4f17-88e8-40db6aae6f62 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.518111 Oct 18 13:24:30.276230 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 902/1876] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:29 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:30.420953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d50c4cf9-36e2-4a64-a7d4-0aea4ead115d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:30.421871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d50c4cf9-36e2-4a64-a7d4-0aea4ead115d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:30.432941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-13ec2901-a629-4e9e-a457-8cd950a15d6c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:30.436523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d50c4cf9-36e2-4a64-a7d4-0aea4ead115d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:30.437640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d50c4cf9-36e2-4a64-a7d4-0aea4ead115d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:30.440457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d50c4cf9-36e2-4a64-a7d4-0aea4ead115d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:30.441547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d50c4cf9-36e2-4a64-a7d4-0aea4ead115d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:30.443588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d50c4cf9-36e2-4a64-a7d4-0aea4ead115d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:30.444367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d50c4cf9-36e2-4a64-a7d4-0aea4ead115d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:30.448026 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13ec2901-a629-4e9e-a457-8cd950a15d6c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.390090 Oct 18 13:24:30.451671 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 975/1877] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:30 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:30.482191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-334ff262-cfaf-4ca5-b9ab-cea971b94a8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:30.487547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-334ff262-cfaf-4ca5-b9ab-cea971b94a8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:30.512767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-334ff262-cfaf-4ca5-b9ab-cea971b94a8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:30.515404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-334ff262-cfaf-4ca5-b9ab-cea971b94a8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:30.515751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-334ff262-cfaf-4ca5-b9ab-cea971b94a8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:30.520969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-334ff262-cfaf-4ca5-b9ab-cea971b94a8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:30.521442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-334ff262-cfaf-4ca5-b9ab-cea971b94a8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:30.524883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-334ff262-cfaf-4ca5-b9ab-cea971b94a8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:30.677342 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-334ff262-cfaf-4ca5-b9ab-cea971b94a8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 200 len: 324 microversion: 2.1 time: 0.199900 Oct 18 13:24:30.678437 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 976/1878] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:24:30 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 324 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:30.691066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-887854d8-937d-4030-bcfd-d11ef7a47b04 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:30.691818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-887854d8-937d-4030-bcfd-d11ef7a47b04 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:30.703643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-887854d8-937d-4030-bcfd-d11ef7a47b04 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:30.704134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-887854d8-937d-4030-bcfd-d11ef7a47b04 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:30.718862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-887854d8-937d-4030-bcfd-d11ef7a47b04 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:30.719826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-887854d8-937d-4030-bcfd-d11ef7a47b04 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:30.720302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-887854d8-937d-4030-bcfd-d11ef7a47b04 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:30.720729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-887854d8-937d-4030-bcfd-d11ef7a47b04 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:31.348296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-887854d8-937d-4030-bcfd-d11ef7a47b04 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:31.363686 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-887854d8-937d-4030-bcfd-d11ef7a47b04 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.676745 Oct 18 13:24:31.367820 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 977/1879] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:30 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:31.372960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-df42aa0a-8dcf-462c-ae66-68de84667c5c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:31.373916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-df42aa0a-8dcf-462c-ae66-68de84667c5c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:31.387212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df42aa0a-8dcf-462c-ae66-68de84667c5c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:31.388131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df42aa0a-8dcf-462c-ae66-68de84667c5c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:31.393705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df42aa0a-8dcf-462c-ae66-68de84667c5c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:31.396387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df42aa0a-8dcf-462c-ae66-68de84667c5c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:31.402550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df42aa0a-8dcf-462c-ae66-68de84667c5c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:31.403582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df42aa0a-8dcf-462c-ae66-68de84667c5c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:32.707715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d50c4cf9-36e2-4a64-a7d4-0aea4ead115d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:32.717397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d50c4cf9-36e2-4a64-a7d4-0aea4ead115d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:32.718868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d50c4cf9-36e2-4a64-a7d4-0aea4ead115d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:32.720076 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d50c4cf9-36e2-4a64-a7d4-0aea4ead115d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 2.305023 Oct 18 13:24:32.746392 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 903/1880] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:30 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 2333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:32.759126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1aee3397-88c2-436a-9909-35f505e4b28a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:32.768262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1aee3397-88c2-436a-9909-35f505e4b28a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:32.788579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1aee3397-88c2-436a-9909-35f505e4b28a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:32.797628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1aee3397-88c2-436a-9909-35f505e4b28a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:32.798367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1aee3397-88c2-436a-9909-35f505e4b28a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:32.799281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1aee3397-88c2-436a-9909-35f505e4b28a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:32.801502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1aee3397-88c2-436a-9909-35f505e4b28a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:32.802189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1aee3397-88c2-436a-9909-35f505e4b28a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:32.871344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-df42aa0a-8dcf-462c-ae66-68de84667c5c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:32.912585 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-df42aa0a-8dcf-462c-ae66-68de84667c5c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 1.540198 Oct 18 13:24:32.916025 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 978/1881] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:31 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:32.942857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-abd1e146-302b-4f96-8912-dd9566bba6c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:32.944350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-abd1e146-302b-4f96-8912-dd9566bba6c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:32.961933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-abd1e146-302b-4f96-8912-dd9566bba6c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:32.962808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-abd1e146-302b-4f96-8912-dd9566bba6c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:32.966515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-abd1e146-302b-4f96-8912-dd9566bba6c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:32.968778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-abd1e146-302b-4f96-8912-dd9566bba6c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:32.969565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-abd1e146-302b-4f96-8912-dd9566bba6c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:32.972180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-abd1e146-302b-4f96-8912-dd9566bba6c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:33.214641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-abd1e146-302b-4f96-8912-dd9566bba6c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:33.234015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-abd1e146-302b-4f96-8912-dd9566bba6c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:33.236266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-abd1e146-302b-4f96-8912-dd9566bba6c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:33.251768 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-abd1e146-302b-4f96-8912-dd9566bba6c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.332156 Oct 18 13:24:33.253066 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 979/1882] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:32 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:33.293141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-86ef10b2-58ec-4276-a49f-0611934b634e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:33.294233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-86ef10b2-58ec-4276-a49f-0611934b634e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:33.308050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86ef10b2-58ec-4276-a49f-0611934b634e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:33.311198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86ef10b2-58ec-4276-a49f-0611934b634e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:33.313962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86ef10b2-58ec-4276-a49f-0611934b634e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:33.314995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86ef10b2-58ec-4276-a49f-0611934b634e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:33.316193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86ef10b2-58ec-4276-a49f-0611934b634e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:33.318259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86ef10b2-58ec-4276-a49f-0611934b634e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:33.576805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1aee3397-88c2-436a-9909-35f505e4b28a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:33.586013 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1aee3397-88c2-436a-9909-35f505e4b28a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1308 microversion: 2.1 time: 0.837961 Oct 18 13:24:33.599734 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 904/1883] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:32 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1308 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:33.779001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-27ca3bf1-9961-4bc3-a486-028608a572d6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:33.779724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-27ca3bf1-9961-4bc3-a486-028608a572d6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:33.844185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27ca3bf1-9961-4bc3-a486-028608a572d6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:33.847867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27ca3bf1-9961-4bc3-a486-028608a572d6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:33.855413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27ca3bf1-9961-4bc3-a486-028608a572d6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:33.870270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27ca3bf1-9961-4bc3-a486-028608a572d6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:33.873513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27ca3bf1-9961-4bc3-a486-028608a572d6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:33.874022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27ca3bf1-9961-4bc3-a486-028608a572d6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:34.168296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-27ca3bf1-9961-4bc3-a486-028608a572d6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:34.179869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:34.185225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-27ca3bf1-9961-4bc3-a486-028608a572d6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:34.191859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-27ca3bf1-9961-4bc3-a486-028608a572d6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:34.194680 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-27ca3bf1-9961-4bc3-a486-028608a572d6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.421478 Oct 18 13:24:34.197849 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 905/1884] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:33 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:34.208326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c3cd483f-e9ac-4123-a22f-efe8a7ef17a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:34.212506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c3cd483f-e9ac-4123-a22f-efe8a7ef17a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:34.226908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3cd483f-e9ac-4123-a22f-efe8a7ef17a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:34.231598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3cd483f-e9ac-4123-a22f-efe8a7ef17a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:34.232405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3cd483f-e9ac-4123-a22f-efe8a7ef17a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:34.233442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3cd483f-e9ac-4123-a22f-efe8a7ef17a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:34.237650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3cd483f-e9ac-4123-a22f-efe8a7ef17a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:34.238452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3cd483f-e9ac-4123-a22f-efe8a7ef17a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:34.323203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-86ef10b2-58ec-4276-a49f-0611934b634e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:34.346241 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-86ef10b2-58ec-4276-a49f-0611934b634e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 1.091703 Oct 18 13:24:34.352542 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 980/1885] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:33 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:34.373709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3f8844f7-2668-4d21-a236-a964a2784e00 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:34.388696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3f8844f7-2668-4d21-a236-a964a2784e00 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:34.420803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f8844f7-2668-4d21-a236-a964a2784e00 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:34.428606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f8844f7-2668-4d21-a236-a964a2784e00 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:34.432129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f8844f7-2668-4d21-a236-a964a2784e00 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:34.434348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f8844f7-2668-4d21-a236-a964a2784e00 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:34.434861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f8844f7-2668-4d21-a236-a964a2784e00 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:34.435308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f8844f7-2668-4d21-a236-a964a2784e00 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:34.906518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3cd483f-e9ac-4123-a22f-efe8a7ef17a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:34.913077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3f8844f7-2668-4d21-a236-a964a2784e00 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:34.916070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:34.923499 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c3cd483f-e9ac-4123-a22f-efe8a7ef17a9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.720466 Oct 18 13:24:34.926883 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 906/1886] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:34 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:34.939841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3f8844f7-2668-4d21-a236-a964a2784e00 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:34.941329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3f8844f7-2668-4d21-a236-a964a2784e00 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:34.959156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c4dc25b1-36ba-4bc3-b7b0-a03bdb30a736 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:34.962489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c4dc25b1-36ba-4bc3-b7b0-a03bdb30a736 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:34.978557 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3f8844f7-2668-4d21-a236-a964a2784e00 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.621141 Oct 18 13:24:34.987011 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 981/1887] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:34 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:34.997912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca03bdb5-e773-43fc-b5fe-93a25f19783e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:35.005837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca03bdb5-e773-43fc-b5fe-93a25f19783e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:35.027765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4dc25b1-36ba-4bc3-b7b0-a03bdb30a736 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:35.028275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4dc25b1-36ba-4bc3-b7b0-a03bdb30a736 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:35.028701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4dc25b1-36ba-4bc3-b7b0-a03bdb30a736 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:35.029460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4dc25b1-36ba-4bc3-b7b0-a03bdb30a736 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:35.037675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca03bdb5-e773-43fc-b5fe-93a25f19783e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:35.038878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca03bdb5-e773-43fc-b5fe-93a25f19783e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:35.039491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca03bdb5-e773-43fc-b5fe-93a25f19783e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:35.039664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4dc25b1-36ba-4bc3-b7b0-a03bdb30a736 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:35.040109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca03bdb5-e773-43fc-b5fe-93a25f19783e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:35.040258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4dc25b1-36ba-4bc3-b7b0-a03bdb30a736 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:35.040570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca03bdb5-e773-43fc-b5fe-93a25f19783e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:35.041003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca03bdb5-e773-43fc-b5fe-93a25f19783e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:35.729835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ca03bdb5-e773-43fc-b5fe-93a25f19783e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:35.747239 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca03bdb5-e773-43fc-b5fe-93a25f19783e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1308 microversion: 2.1 time: 0.756671 Oct 18 13:24:35.782138 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 982/1888] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:34 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1308 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:35.790629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-14d7bea4-3e13-4f6f-8abe-fa3181893496 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:35.792091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-14d7bea4-3e13-4f6f-8abe-fa3181893496 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:35.813564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14d7bea4-3e13-4f6f-8abe-fa3181893496 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:35.814090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14d7bea4-3e13-4f6f-8abe-fa3181893496 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:35.814544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14d7bea4-3e13-4f6f-8abe-fa3181893496 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:35.815286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14d7bea4-3e13-4f6f-8abe-fa3181893496 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:35.819233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14d7bea4-3e13-4f6f-8abe-fa3181893496 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:35.820444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14d7bea4-3e13-4f6f-8abe-fa3181893496 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:36.114490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c4dc25b1-36ba-4bc3-b7b0-a03bdb30a736 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:36.143960 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c4dc25b1-36ba-4bc3-b7b0-a03bdb30a736 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 1.215864 Oct 18 13:24:36.144729 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 907/1889] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:34 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:36.166369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-50db1b4b-f50b-4c08-90ca-cedc55a1801d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:36.172285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-50db1b4b-f50b-4c08-90ca-cedc55a1801d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:36.195055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50db1b4b-f50b-4c08-90ca-cedc55a1801d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:36.197691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50db1b4b-f50b-4c08-90ca-cedc55a1801d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:36.199954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50db1b4b-f50b-4c08-90ca-cedc55a1801d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:36.201887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50db1b4b-f50b-4c08-90ca-cedc55a1801d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:36.208135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50db1b4b-f50b-4c08-90ca-cedc55a1801d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:36.215936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50db1b4b-f50b-4c08-90ca-cedc55a1801d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:36.290156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-50db1b4b-f50b-4c08-90ca-cedc55a1801d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:24:36.545064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:36.565126 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-50db1b4b-f50b-4c08-90ca-cedc55a1801d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 204 len: 0 microversion: 2.1 time: 0.416151 Oct 18 13:24:36.568859 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 908/1890] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:24:36 2022] DELETE /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:24:36.576314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-efe32f29-8e03-4f33-99d1-579d8eaea0e2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:36.578246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-efe32f29-8e03-4f33-99d1-579d8eaea0e2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:36.588226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-efe32f29-8e03-4f33-99d1-579d8eaea0e2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:36.589017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-efe32f29-8e03-4f33-99d1-579d8eaea0e2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:36.589655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-efe32f29-8e03-4f33-99d1-579d8eaea0e2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:36.590612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-efe32f29-8e03-4f33-99d1-579d8eaea0e2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:36.591069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-efe32f29-8e03-4f33-99d1-579d8eaea0e2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:36.591804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-efe32f29-8e03-4f33-99d1-579d8eaea0e2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:36.674291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-14d7bea4-3e13-4f6f-8abe-fa3181893496 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:36.693913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-14d7bea4-3e13-4f6f-8abe-fa3181893496 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:36.706500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-14d7bea4-3e13-4f6f-8abe-fa3181893496 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:36.715557 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-14d7bea4-3e13-4f6f-8abe-fa3181893496 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.930050 Oct 18 13:24:36.721442 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 983/1891] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:35 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:36.766162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a543b932-1963-4e81-bdf8-966ace595600 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:36.767099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a543b932-1963-4e81-bdf8-966ace595600 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:36.785537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a543b932-1963-4e81-bdf8-966ace595600 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:36.786576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a543b932-1963-4e81-bdf8-966ace595600 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:36.787259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a543b932-1963-4e81-bdf8-966ace595600 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:36.788268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a543b932-1963-4e81-bdf8-966ace595600 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:36.789150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a543b932-1963-4e81-bdf8-966ace595600 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:36.789860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a543b932-1963-4e81-bdf8-966ace595600 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.001497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a543b932-1963-4e81-bdf8-966ace595600 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:37.030594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a543b932-1963-4e81-bdf8-966ace595600 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:37.032773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a543b932-1963-4e81-bdf8-966ace595600 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:37.050857 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a543b932-1963-4e81-bdf8-966ace595600 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.320257 Oct 18 13:24:37.057004 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 984/1892] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:36 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:37.071587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c6124c39-3859-459b-a779-a905ff1a8d85 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:37.076615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c6124c39-3859-459b-a779-a905ff1a8d85 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:37.088482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6124c39-3859-459b-a779-a905ff1a8d85 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.090934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6124c39-3859-459b-a779-a905ff1a8d85 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.092312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6124c39-3859-459b-a779-a905ff1a8d85 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.093481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6124c39-3859-459b-a779-a905ff1a8d85 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.094146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6124c39-3859-459b-a779-a905ff1a8d85 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.094739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6124c39-3859-459b-a779-a905ff1a8d85 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.234747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-efe32f29-8e03-4f33-99d1-579d8eaea0e2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:37.247894 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-efe32f29-8e03-4f33-99d1-579d8eaea0e2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.679273 Oct 18 13:24:37.252470 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 909/1893] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:36 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:37.259414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-5b2bbf16-da91-420a-84f6-7cb341159f7f req-4d7c802b-299e-4c8f-a0f9-1376aea6801b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dd5017a-89a3-4009-902b-156a36615276", "tag": "4fd0a37b-a6fc-4fa4-ae29-01b3e5f2b288"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:37.284737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5b2bbf16-da91-420a-84f6-7cb341159f7f req-4d7c802b-299e-4c8f-a0f9-1376aea6801b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.290415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5b2bbf16-da91-420a-84f6-7cb341159f7f req-4d7c802b-299e-4c8f-a0f9-1376aea6801b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.292198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5b2bbf16-da91-420a-84f6-7cb341159f7f req-4d7c802b-299e-4c8f-a0f9-1376aea6801b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.321033 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-5b2bbf16-da91-420a-84f6-7cb341159f7f req-4d7c802b-299e-4c8f-a0f9-1376aea6801b service nova] Creating event network-changed:4fd0a37b-a6fc-4fa4-ae29-01b3e5f2b288 for instance 1dd5017a-89a3-4009-902b-156a36615276 on n-h1-858384-13 Oct 18 13:24:37.331573 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-5b2bbf16-da91-420a-84f6-7cb341159f7f req-4d7c802b-299e-4c8f-a0f9-1376aea6801b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077481 Oct 18 13:24:37.336941 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 910/1894] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:37.350392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e213cdd7-faa5-43da-9a54-bd295eeef1bd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:37.353265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e213cdd7-faa5-43da-9a54-bd295eeef1bd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:37.370571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e213cdd7-faa5-43da-9a54-bd295eeef1bd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.371086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e213cdd7-faa5-43da-9a54-bd295eeef1bd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.371526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e213cdd7-faa5-43da-9a54-bd295eeef1bd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.378348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e213cdd7-faa5-43da-9a54-bd295eeef1bd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.379494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e213cdd7-faa5-43da-9a54-bd295eeef1bd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.380148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e213cdd7-faa5-43da-9a54-bd295eeef1bd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.472572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c6124c39-3859-459b-a779-a905ff1a8d85 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:37.504837 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c6124c39-3859-459b-a779-a905ff1a8d85 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.445151 Oct 18 13:24:37.545976 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 985/1895] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:37 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:37.573598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-82a4d547-ddd9-4648-8af3-d1c5f1c92129 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:37.578356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-82a4d547-ddd9-4648-8af3-d1c5f1c92129 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:37.613956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82a4d547-ddd9-4648-8af3-d1c5f1c92129 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.614831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82a4d547-ddd9-4648-8af3-d1c5f1c92129 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.615505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82a4d547-ddd9-4648-8af3-d1c5f1c92129 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.617102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82a4d547-ddd9-4648-8af3-d1c5f1c92129 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.620324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82a4d547-ddd9-4648-8af3-d1c5f1c92129 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.622670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82a4d547-ddd9-4648-8af3-d1c5f1c92129 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.845132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e213cdd7-faa5-43da-9a54-bd295eeef1bd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:37.862453 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e213cdd7-faa5-43da-9a54-bd295eeef1bd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1555 microversion: 2.1 time: 0.519348 Oct 18 13:24:37.863398 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 911/1896] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:37 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1555 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:37.869472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1d2e3ca0-6f06-4861-be69-902dd9763a9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:37.870522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1d2e3ca0-6f06-4861-be69-902dd9763a9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:37.896476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d2e3ca0-6f06-4861-be69-902dd9763a9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.897821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d2e3ca0-6f06-4861-be69-902dd9763a9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.899435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d2e3ca0-6f06-4861-be69-902dd9763a9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:37.901141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d2e3ca0-6f06-4861-be69-902dd9763a9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:37.906138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d2e3ca0-6f06-4861-be69-902dd9763a9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:37.909677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d2e3ca0-6f06-4861-be69-902dd9763a9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.177368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-82a4d547-ddd9-4648-8af3-d1c5f1c92129 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:38.192438 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-82a4d547-ddd9-4648-8af3-d1c5f1c92129 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1308 microversion: 2.1 time: 0.644661 Oct 18 13:24:38.194427 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 986/1897] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:37 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1308 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:38.207822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-423833700", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "fa5737e5-8161-4ff1-a109-dbc177bf4e3a"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:38.336451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] validate_networks() for [('fa5737e5-8161-4ff1-a109-dbc177bf4e3a', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:24:38.469145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1d2e3ca0-6f06-4861-be69-902dd9763a9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:38.486320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1d2e3ca0-6f06-4861-be69-902dd9763a9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:38.493066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1d2e3ca0-6f06-4861-be69-902dd9763a9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:38.494929 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1d2e3ca0-6f06-4861-be69-902dd9763a9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.629731 Oct 18 13:24:38.496459 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 912/1898] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:37 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:38.507375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ee01c797-a507-439b-afc7-9009d9206413 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:38.511240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ee01c797-a507-439b-afc7-9009d9206413 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:38.529855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee01c797-a507-439b-afc7-9009d9206413 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.530908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee01c797-a507-439b-afc7-9009d9206413 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.532167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee01c797-a507-439b-afc7-9009d9206413 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.535004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee01c797-a507-439b-afc7-9009d9206413 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.537319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee01c797-a507-439b-afc7-9009d9206413 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.539034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee01c797-a507-439b-afc7-9009d9206413 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.744748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ee01c797-a507-439b-afc7-9009d9206413 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:38.758188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ee01c797-a507-439b-afc7-9009d9206413 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:38.760544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ee01c797-a507-439b-afc7-9009d9206413 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:38.767714 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ee01c797-a507-439b-afc7-9009d9206413 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.268905 Oct 18 13:24:38.773224 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 913/1899] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:38 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:38.790185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8a14dc10-d47f-4b4a-81c8-41a31e795659 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:38.791212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8a14dc10-d47f-4b4a-81c8-41a31e795659 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:38.809266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a14dc10-d47f-4b4a-81c8-41a31e795659 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.811569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a14dc10-d47f-4b4a-81c8-41a31e795659 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.814494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a14dc10-d47f-4b4a-81c8-41a31e795659 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:38.815506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a14dc10-d47f-4b4a-81c8-41a31e795659 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:38.818698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a14dc10-d47f-4b4a-81c8-41a31e795659 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:38.819647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a14dc10-d47f-4b4a-81c8-41a31e795659 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:39.529133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8a14dc10-d47f-4b4a-81c8-41a31e795659 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:39.544006 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8a14dc10-d47f-4b4a-81c8-41a31e795659 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.772048 Oct 18 13:24:39.547019 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 914/1900] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:38 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:39.562807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3134feb1-467b-4b66-a85c-24d74fd8fd2b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:39.565043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3134feb1-467b-4b66-a85c-24d74fd8fd2b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:39.596185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3134feb1-467b-4b66-a85c-24d74fd8fd2b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:39.597647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3134feb1-467b-4b66-a85c-24d74fd8fd2b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:39.600282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3134feb1-467b-4b66-a85c-24d74fd8fd2b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:39.604324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3134feb1-467b-4b66-a85c-24d74fd8fd2b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:39.607448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3134feb1-467b-4b66-a85c-24d74fd8fd2b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:39.612641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3134feb1-467b-4b66-a85c-24d74fd8fd2b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:39.784109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3134feb1-467b-4b66-a85c-24d74fd8fd2b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:39.804384 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3134feb1-467b-4b66-a85c-24d74fd8fd2b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1513 microversion: 2.1 time: 0.253696 Oct 18 13:24:39.805759 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 915/1901] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:39 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:39.811314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7cd796be-0e19-4d55-9587-96df14c983b1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:39.812202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7cd796be-0e19-4d55-9587-96df14c983b1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:39.820589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cd796be-0e19-4d55-9587-96df14c983b1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:39.821336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cd796be-0e19-4d55-9587-96df14c983b1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:39.821999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cd796be-0e19-4d55-9587-96df14c983b1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:39.822910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cd796be-0e19-4d55-9587-96df14c983b1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:39.823743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cd796be-0e19-4d55-9587-96df14c983b1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:39.824380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cd796be-0e19-4d55-9587-96df14c983b1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.187301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7cd796be-0e19-4d55-9587-96df14c983b1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:40.197459 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7cd796be-0e19-4d55-9587-96df14c983b1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1308 microversion: 2.1 time: 0.389930 Oct 18 13:24:40.207969 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 916/1902] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:39 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1308 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:40.235924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-387558c9-db38-421c-8797-7b6ddf05c597 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:40.242316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-387558c9-db38-421c-8797-7b6ddf05c597 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:40.263862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-387558c9-db38-421c-8797-7b6ddf05c597 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.265347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-387558c9-db38-421c-8797-7b6ddf05c597 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.265842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-387558c9-db38-421c-8797-7b6ddf05c597 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.267871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-387558c9-db38-421c-8797-7b6ddf05c597 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.290170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-387558c9-db38-421c-8797-7b6ddf05c597 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.292542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-387558c9-db38-421c-8797-7b6ddf05c597 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.532148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:24:40.532700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:24:40.533145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:24:40.533927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:24:40.534646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:24:40.576352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.576859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.583684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.584832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.585930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.590394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.659299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Getting quotas for project 452e5b77db474cf9a2b7f6b2abcb6115. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:24:40.678965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Getting quotas for user 2878f8de95694fe1a9a17ed27b6ba40b and project 452e5b77db474cf9a2b7f6b2abcb6115. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:24:40.693955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:40.720966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:24:40.736152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:24:40.759189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-387558c9-db38-421c-8797-7b6ddf05c597 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:40.784234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-387558c9-db38-421c-8797-7b6ddf05c597 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:40.798256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-387558c9-db38-421c-8797-7b6ddf05c597 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:40.802983 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-387558c9-db38-421c-8797-7b6ddf05c597 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.593370 Oct 18 13:24:40.813254 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 917/1903] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:40 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:40.844318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-344baec2-6e72-4755-8b47-d91c4d3d26ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:40.845687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-344baec2-6e72-4755-8b47-d91c4d3d26ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:40.878116 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f7a63f34-a354-4b9d-864d-60f6d098e461 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.679988 Oct 18 13:24:40.878690 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 987/1904] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:24:40.884927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-344baec2-6e72-4755-8b47-d91c4d3d26ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.888633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-344baec2-6e72-4755-8b47-d91c4d3d26ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.890361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-344baec2-6e72-4755-8b47-d91c4d3d26ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.892210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8bfb3e2b-6e85-4261-8745-14a8b8d4a5cc req-a2d451aa-5e53-4d65-bac5-99d8830faaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e67b4b-fc1a-4c86-80bc-afaddef3d664", "name": "network-vif-deleted", "tag": "4701da41-d271-440c-847d-ed6212bf8189"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:40.898853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-344baec2-6e72-4755-8b47-d91c4d3d26ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.904606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-344baec2-6e72-4755-8b47-d91c4d3d26ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.907544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-344baec2-6e72-4755-8b47-d91c4d3d26ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.933734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8bfb3e2b-6e85-4261-8745-14a8b8d4a5cc req-a2d451aa-5e53-4d65-bac5-99d8830faaab service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:40.937488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8bfb3e2b-6e85-4261-8745-14a8b8d4a5cc req-a2d451aa-5e53-4d65-bac5-99d8830faaab service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:40.938778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8bfb3e2b-6e85-4261-8745-14a8b8d4a5cc req-a2d451aa-5e53-4d65-bac5-99d8830faaab service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:40.980383 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8bfb3e2b-6e85-4261-8745-14a8b8d4a5cc req-a2d451aa-5e53-4d65-bac5-99d8830faaab service nova] Creating event network-vif-deleted:4701da41-d271-440c-847d-ed6212bf8189 for instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 on n-h2-858384-13 Oct 18 13:24:41.006241 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8bfb3e2b-6e85-4261-8745-14a8b8d4a5cc req-a2d451aa-5e53-4d65-bac5-99d8830faaab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125375 Oct 18 13:24:41.008329 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 988/1905] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:41.024207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c1b4d8a-eb6e-464c-892a-144996d9891d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:41.025771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c1b4d8a-eb6e-464c-892a-144996d9891d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:41.049355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c1b4d8a-eb6e-464c-892a-144996d9891d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:41.049871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c1b4d8a-eb6e-464c-892a-144996d9891d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:41.050379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c1b4d8a-eb6e-464c-892a-144996d9891d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:41.054306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c1b4d8a-eb6e-464c-892a-144996d9891d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:41.055933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c1b4d8a-eb6e-464c-892a-144996d9891d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:41.063442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c1b4d8a-eb6e-464c-892a-144996d9891d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:41.257952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-344baec2-6e72-4755-8b47-d91c4d3d26ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:41.283520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-344baec2-6e72-4755-8b47-d91c4d3d26ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:41.285502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-344baec2-6e72-4755-8b47-d91c4d3d26ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:41.308100 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-344baec2-6e72-4755-8b47-d91c4d3d26ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.492670 Oct 18 13:24:41.356615 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 918/1906] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:40 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:41.540021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3c1b4d8a-eb6e-464c-892a-144996d9891d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:41.555407 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c1b4d8a-eb6e-464c-892a-144996d9891d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.545366 Oct 18 13:24:41.588170 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 989/1907] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:41 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:41.595625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f809739d-32db-40b4-b470-ea29a8e11392 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:41.601632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f809739d-32db-40b4-b470-ea29a8e11392 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:41.627621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f809739d-32db-40b4-b470-ea29a8e11392 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:41.628136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f809739d-32db-40b4-b470-ea29a8e11392 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:41.628582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f809739d-32db-40b4-b470-ea29a8e11392 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:41.629335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f809739d-32db-40b4-b470-ea29a8e11392 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:41.629801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f809739d-32db-40b4-b470-ea29a8e11392 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:41.630219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f809739d-32db-40b4-b470-ea29a8e11392 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:41.834521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f809739d-32db-40b4-b470-ea29a8e11392 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:41.848416 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f809739d-32db-40b4-b470-ea29a8e11392 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1346 microversion: 2.1 time: 0.258284 Oct 18 13:24:41.851907 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 990/1908] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:41 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1346 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:41.885838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-98426b94-2929-4195-a840-e1bf85653252 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:41.886461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-98426b94-2929-4195-a840-e1bf85653252 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:42.033732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e8f7704e-ce9a-4fec-b0bc-64597e660ea7 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Action: 'create', calling method: .version_select at 0x7ff60f7895e0>, body: {"pool": null} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:42.094606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-98426b94-2929-4195-a840-e1bf85653252 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:42.106808 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-98426b94-2929-4195-a840-e1bf85653252 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1214 microversion: 2.1 time: 0.237485 Oct 18 13:24:42.113848 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 991/1909] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:41 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1214 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:42.126338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fea74040-8a66-41e7-ab77-8f2ca26a24c9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:42.127348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fea74040-8a66-41e7-ab77-8f2ca26a24c9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:42.167716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fea74040-8a66-41e7-ab77-8f2ca26a24c9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:42.173336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fea74040-8a66-41e7-ab77-8f2ca26a24c9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:42.181097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fea74040-8a66-41e7-ab77-8f2ca26a24c9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:42.189318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fea74040-8a66-41e7-ab77-8f2ca26a24c9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:42.190238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fea74040-8a66-41e7-ab77-8f2ca26a24c9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:42.193703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fea74040-8a66-41e7-ab77-8f2ca26a24c9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:42.699455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fea74040-8a66-41e7-ab77-8f2ca26a24c9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:42.711761 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fea74040-8a66-41e7-ab77-8f2ca26a24c9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1308 microversion: 2.1 time: 0.589652 Oct 18 13:24:42.714451 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 992/1910] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:42 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1308 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:42.719498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-267cba7a-581c-4909-a700-9dc43878063b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:42.741664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-267cba7a-581c-4909-a700-9dc43878063b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:42.783188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-267cba7a-581c-4909-a700-9dc43878063b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:42.788119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-267cba7a-581c-4909-a700-9dc43878063b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:42.789539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-267cba7a-581c-4909-a700-9dc43878063b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:42.790653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-267cba7a-581c-4909-a700-9dc43878063b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:42.793214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-267cba7a-581c-4909-a700-9dc43878063b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:42.798430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-267cba7a-581c-4909-a700-9dc43878063b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:43.510015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-267cba7a-581c-4909-a700-9dc43878063b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:43.532858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-267cba7a-581c-4909-a700-9dc43878063b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:43.534788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-267cba7a-581c-4909-a700-9dc43878063b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:43.536300 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-267cba7a-581c-4909-a700-9dc43878063b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.820563 Oct 18 13:24:43.537121 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 993/1911] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:42 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:43.548100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8a459352-4581-48e4-9eec-72115d8568fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:43.555343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8a459352-4581-48e4-9eec-72115d8568fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:43.576933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a459352-4581-48e4-9eec-72115d8568fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:43.585743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a459352-4581-48e4-9eec-72115d8568fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:43.591684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a459352-4581-48e4-9eec-72115d8568fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:43.592560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a459352-4581-48e4-9eec-72115d8568fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:43.601942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a459352-4581-48e4-9eec-72115d8568fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:43.605869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a459352-4581-48e4-9eec-72115d8568fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:43.855637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8a459352-4581-48e4-9eec-72115d8568fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:43.873630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8a459352-4581-48e4-9eec-72115d8568fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:43.875484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8a459352-4581-48e4-9eec-72115d8568fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:43.887959 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8a459352-4581-48e4-9eec-72115d8568fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.346850 Oct 18 13:24:43.889474 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 994/1912] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:43 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:43.900476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f8a7e7ee-8ac1-4218-bbe8-6348aa2831f6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:43.904234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f8a7e7ee-8ac1-4218-bbe8-6348aa2831f6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:43.922536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8a7e7ee-8ac1-4218-bbe8-6348aa2831f6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:43.923333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8a7e7ee-8ac1-4218-bbe8-6348aa2831f6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:43.926653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8a7e7ee-8ac1-4218-bbe8-6348aa2831f6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:43.927692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8a7e7ee-8ac1-4218-bbe8-6348aa2831f6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:43.931718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8a7e7ee-8ac1-4218-bbe8-6348aa2831f6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:43.932500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8a7e7ee-8ac1-4218-bbe8-6348aa2831f6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:45.305803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f8a7e7ee-8ac1-4218-bbe8-6348aa2831f6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:45.316211 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f8a7e7ee-8ac1-4218-bbe8-6348aa2831f6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 1.425396 Oct 18 13:24:45.316811 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 995/1913] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:43 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:45.334311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f8fca35-fdf8-471e-bd53-e79baf9ae58c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:45.352016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7f8fca35-fdf8-471e-bd53-e79baf9ae58c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:45.384012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f8fca35-fdf8-471e-bd53-e79baf9ae58c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:45.388178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f8fca35-fdf8-471e-bd53-e79baf9ae58c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:45.391331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f8fca35-fdf8-471e-bd53-e79baf9ae58c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:45.395022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f8fca35-fdf8-471e-bd53-e79baf9ae58c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:45.399215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f8fca35-fdf8-471e-bd53-e79baf9ae58c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:45.403121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f8fca35-fdf8-471e-bd53-e79baf9ae58c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:45.928473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7f8fca35-fdf8-471e-bd53-e79baf9ae58c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:45.938204 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7f8fca35-fdf8-471e-bd53-e79baf9ae58c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1346 microversion: 2.1 time: 0.607699 Oct 18 13:24:45.943678 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 996/1914] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:45 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1346 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:45.948962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-65c63bae-906b-4504-81fd-b0c4a746d969 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:45.961917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-65c63bae-906b-4504-81fd-b0c4a746d969 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:45.980684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65c63bae-906b-4504-81fd-b0c4a746d969 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:45.981528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65c63bae-906b-4504-81fd-b0c4a746d969 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:45.993314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65c63bae-906b-4504-81fd-b0c4a746d969 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:45.994304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65c63bae-906b-4504-81fd-b0c4a746d969 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:45.994969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65c63bae-906b-4504-81fd-b0c4a746d969 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:45.995792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65c63bae-906b-4504-81fd-b0c4a746d969 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:46.537609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-65c63bae-906b-4504-81fd-b0c4a746d969 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:46.558783 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-65c63bae-906b-4504-81fd-b0c4a746d969 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1272 microversion: 2.1 time: 0.613998 Oct 18 13:24:46.563150 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 997/1915] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:45 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1272 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:46.586436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5fe69ad7-cd07-41f5-8e94-e6a414ec6489 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:46.591540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5fe69ad7-cd07-41f5-8e94-e6a414ec6489 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:46.613396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe69ad7-cd07-41f5-8e94-e6a414ec6489 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:46.615972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe69ad7-cd07-41f5-8e94-e6a414ec6489 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:46.618120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe69ad7-cd07-41f5-8e94-e6a414ec6489 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:46.620581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe69ad7-cd07-41f5-8e94-e6a414ec6489 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:46.622201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe69ad7-cd07-41f5-8e94-e6a414ec6489 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:46.623526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe69ad7-cd07-41f5-8e94-e6a414ec6489 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.206677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5fe69ad7-cd07-41f5-8e94-e6a414ec6489 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:47.216241 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5fe69ad7-cd07-41f5-8e94-e6a414ec6489 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1308 microversion: 2.1 time: 0.643893 Oct 18 13:24:47.226151 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 998/1916] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:46 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1308 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:47.249739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-811bbcb1-b74f-40fd-a6cf-6ef6bf284636 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:47.258245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-811bbcb1-b74f-40fd-a6cf-6ef6bf284636 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:47.279942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-811bbcb1-b74f-40fd-a6cf-6ef6bf284636 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:47.285942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-811bbcb1-b74f-40fd-a6cf-6ef6bf284636 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:47.287442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-811bbcb1-b74f-40fd-a6cf-6ef6bf284636 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.288538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-811bbcb1-b74f-40fd-a6cf-6ef6bf284636 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:47.290164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-811bbcb1-b74f-40fd-a6cf-6ef6bf284636 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:47.290899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-811bbcb1-b74f-40fd-a6cf-6ef6bf284636 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.720779 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e8f7704e-ce9a-4fec-b0bc-64597e660ea7 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.362542 Oct 18 13:24:47.722228 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 919/1917] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 18 13:24:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:47.733240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9a377756-4485-4aee-ac0b-dcc942f8df70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:47.735889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9a377756-4485-4aee-ac0b-dcc942f8df70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:47.756416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a377756-4485-4aee-ac0b-dcc942f8df70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:47.758499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a377756-4485-4aee-ac0b-dcc942f8df70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:47.759768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a377756-4485-4aee-ac0b-dcc942f8df70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.764155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a377756-4485-4aee-ac0b-dcc942f8df70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:47.766584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a377756-4485-4aee-ac0b-dcc942f8df70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:47.767891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a377756-4485-4aee-ac0b-dcc942f8df70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:47.912252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9a377756-4485-4aee-ac0b-dcc942f8df70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:47.949489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9a377756-4485-4aee-ac0b-dcc942f8df70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:47.951593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9a377756-4485-4aee-ac0b-dcc942f8df70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:47.961934 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9a377756-4485-4aee-ac0b-dcc942f8df70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.238437 Oct 18 13:24:47.984077 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 920/1918] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:47 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:48.010379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-42ca3ce0-b7a0-4744-9415-41aa8741e871 req-1a8c9223-2b2d-468f-9a66-6d9c8e82fe1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67746251-6df7-43e6-9a3d-c45f1fb662ae", "name": "network-vif-unplugged", "status": "completed", "tag": "06704eb6-7b35-42a7-a441-0dd307106054"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:48.052497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-42ca3ce0-b7a0-4744-9415-41aa8741e871 req-1a8c9223-2b2d-468f-9a66-6d9c8e82fe1a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.060551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-42ca3ce0-b7a0-4744-9415-41aa8741e871 req-1a8c9223-2b2d-468f-9a66-6d9c8e82fe1a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.063609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-42ca3ce0-b7a0-4744-9415-41aa8741e871 req-1a8c9223-2b2d-468f-9a66-6d9c8e82fe1a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.112184 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-42ca3ce0-b7a0-4744-9415-41aa8741e871 req-1a8c9223-2b2d-468f-9a66-6d9c8e82fe1a service nova] Creating event network-vif-unplugged:06704eb6-7b35-42a7-a441-0dd307106054 for instance 67746251-6df7-43e6-9a3d-c45f1fb662ae on n-h2-858384-13 Oct 18 13:24:48.126159 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-42ca3ce0-b7a0-4744-9415-41aa8741e871 req-1a8c9223-2b2d-468f-9a66-6d9c8e82fe1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140149 Oct 18 13:24:48.127123 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 921/1919] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:48.145022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8f57c49c-3985-48c2-8bcb-e70b06818e07 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:48.146123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8f57c49c-3985-48c2-8bcb-e70b06818e07 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:48.166384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f57c49c-3985-48c2-8bcb-e70b06818e07 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.170581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f57c49c-3985-48c2-8bcb-e70b06818e07 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.174433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f57c49c-3985-48c2-8bcb-e70b06818e07 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.181904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f57c49c-3985-48c2-8bcb-e70b06818e07 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.183325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f57c49c-3985-48c2-8bcb-e70b06818e07 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.189697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f57c49c-3985-48c2-8bcb-e70b06818e07 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.365852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-811bbcb1-b74f-40fd-a6cf-6ef6bf284636 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:48.379981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-811bbcb1-b74f-40fd-a6cf-6ef6bf284636 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:48.384844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-811bbcb1-b74f-40fd-a6cf-6ef6bf284636 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:48.390374 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-811bbcb1-b74f-40fd-a6cf-6ef6bf284636 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 1.146396 Oct 18 13:24:48.391671 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 999/1920] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:47 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:48.396493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5ce6eb36-6681-4ada-b542-44beceaa99a1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:48.397964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5ce6eb36-6681-4ada-b542-44beceaa99a1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:48.405310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ce6eb36-6681-4ada-b542-44beceaa99a1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.406177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ce6eb36-6681-4ada-b542-44beceaa99a1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.406850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ce6eb36-6681-4ada-b542-44beceaa99a1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.407809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ce6eb36-6681-4ada-b542-44beceaa99a1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.408505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ce6eb36-6681-4ada-b542-44beceaa99a1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.409167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ce6eb36-6681-4ada-b542-44beceaa99a1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.533566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5ce6eb36-6681-4ada-b542-44beceaa99a1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:48.545036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8f57c49c-3985-48c2-8bcb-e70b06818e07 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:48.545932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:48.549320 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5ce6eb36-6681-4ada-b542-44beceaa99a1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1346 microversion: 2.1 time: 0.156365 Oct 18 13:24:48.555494 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8f57c49c-3985-48c2-8bcb-e70b06818e07 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.425628 Oct 18 13:24:48.556089 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 922/1921] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:48 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:48.570249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6f7a052f-abb3-4cf9-8e67-ae96c98f5758 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:48.570249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6f7a052f-abb3-4cf9-8e67-ae96c98f5758 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:48.570249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f7a052f-abb3-4cf9-8e67-ae96c98f5758 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.570249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f7a052f-abb3-4cf9-8e67-ae96c98f5758 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.570693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f7a052f-abb3-4cf9-8e67-ae96c98f5758 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.571710 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1000/1922] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:48 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1346 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:48.575032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f7a052f-abb3-4cf9-8e67-ae96c98f5758 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.575962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f7a052f-abb3-4cf9-8e67-ae96c98f5758 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.585293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f7a052f-abb3-4cf9-8e67-ae96c98f5758 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.595049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9ce6ebea-e077-45d9-af3e-d902b350e64b tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Calling method '.version_select at 0x7ff60f08db80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:48.641838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:48.809670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6f7a052f-abb3-4cf9-8e67-ae96c98f5758 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:48.821303 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6f7a052f-abb3-4cf9-8e67-ae96c98f5758 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1314 microversion: 2.1 time: 0.263746 Oct 18 13:24:48.822435 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 923/1923] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:48 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:48.827516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-cc2dd159-e5a9-491e-aa3d-49783b628778 req-8e234f13-4a13-4822-8664-b61b1a2ca889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd5017a-89a3-4009-902b-156a36615276", "name": "network-vif-plugged", "status": "completed", "tag": "4fd0a37b-a6fc-4fa4-ae29-01b3e5f2b288"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:48.839686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cc2dd159-e5a9-491e-aa3d-49783b628778 req-8e234f13-4a13-4822-8664-b61b1a2ca889 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.840495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cc2dd159-e5a9-491e-aa3d-49783b628778 req-8e234f13-4a13-4822-8664-b61b1a2ca889 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.841314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cc2dd159-e5a9-491e-aa3d-49783b628778 req-8e234f13-4a13-4822-8664-b61b1a2ca889 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.855927 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-cc2dd159-e5a9-491e-aa3d-49783b628778 req-8e234f13-4a13-4822-8664-b61b1a2ca889 service nova] Creating event network-vif-plugged:4fd0a37b-a6fc-4fa4-ae29-01b3e5f2b288 for instance 1dd5017a-89a3-4009-902b-156a36615276 on n-h1-858384-13 Oct 18 13:24:48.862711 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-cc2dd159-e5a9-491e-aa3d-49783b628778 req-8e234f13-4a13-4822-8664-b61b1a2ca889 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038712 Oct 18 13:24:48.869381 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 924/1924] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:48.876107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-580d10b3-ecfc-4ac8-b946-1b6a1427d65c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:48.877380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-580d10b3-ecfc-4ac8-b946-1b6a1427d65c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:48.886237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-580d10b3-ecfc-4ac8-b946-1b6a1427d65c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.887097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-580d10b3-ecfc-4ac8-b946-1b6a1427d65c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.887883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-580d10b3-ecfc-4ac8-b946-1b6a1427d65c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:48.888800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-580d10b3-ecfc-4ac8-b946-1b6a1427d65c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:48.889714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-580d10b3-ecfc-4ac8-b946-1b6a1427d65c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:48.890334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-580d10b3-ecfc-4ac8-b946-1b6a1427d65c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:49.160023 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9ce6ebea-e077-45d9-af3e-d902b350e64b tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/6621093f-5894-4398-b14a-bacf3478ce43" status: 200 len: 142 microversion: 2.1 time: 0.580910 Oct 18 13:24:49.161167 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1001/1925] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 18 13:24:48 2022] GET /compute/v2.1/os-floating-ips/6621093f-5894-4398-b14a-bacf3478ce43 => generated 142 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:49.166651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3ef39eb9-06f6-4960-bbb0-76f0d3a7ab5c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.167356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3ef39eb9-06f6-4960-bbb0-76f0d3a7ab5c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:49.180115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ef39eb9-06f6-4960-bbb0-76f0d3a7ab5c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:49.183303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ef39eb9-06f6-4960-bbb0-76f0d3a7ab5c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:49.184228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ef39eb9-06f6-4960-bbb0-76f0d3a7ab5c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:49.185974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ef39eb9-06f6-4960-bbb0-76f0d3a7ab5c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:49.186302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ef39eb9-06f6-4960-bbb0-76f0d3a7ab5c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:49.186742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ef39eb9-06f6-4960-bbb0-76f0d3a7ab5c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:49.364347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-580d10b3-ecfc-4ac8-b946-1b6a1427d65c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:49.386047 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-580d10b3-ecfc-4ac8-b946-1b6a1427d65c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1308 microversion: 2.1 time: 0.515037 Oct 18 13:24:49.386677 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 925/1926] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:48 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1308 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:49.397390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-88bb3733-cdfe-4732-aff5-82d90c80c7e0 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Calling method '.version_select at 0x7ff61428c1f0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.443829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ef39eb9-06f6-4960-bbb0-76f0d3a7ab5c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:49.454516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ef39eb9-06f6-4960-bbb0-76f0d3a7ab5c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:49.461277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ef39eb9-06f6-4960-bbb0-76f0d3a7ab5c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:49.481545 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3ef39eb9-06f6-4960-bbb0-76f0d3a7ab5c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.318895 Oct 18 13:24:49.482585 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1002/1927] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:49 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:49.487629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b17338ed-585c-47c2-9ffb-38508f6390dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.492528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b17338ed-585c-47c2-9ffb-38508f6390dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:49.513544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b17338ed-585c-47c2-9ffb-38508f6390dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:49.514509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b17338ed-585c-47c2-9ffb-38508f6390dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:49.518218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b17338ed-585c-47c2-9ffb-38508f6390dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:49.519427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b17338ed-585c-47c2-9ffb-38508f6390dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:49.520181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b17338ed-585c-47c2-9ffb-38508f6390dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:49.522328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b17338ed-585c-47c2-9ffb-38508f6390dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:49.855460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b17338ed-585c-47c2-9ffb-38508f6390dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:49.868084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b17338ed-585c-47c2-9ffb-38508f6390dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:49.868972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b17338ed-585c-47c2-9ffb-38508f6390dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:49.872997 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b17338ed-585c-47c2-9ffb-38508f6390dc tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.388384 Oct 18 13:24:49.872997 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1003/1928] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:49 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:49.889071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eed3f087-fade-41b2-8531-88a4f702665c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.896046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eed3f087-fade-41b2-8531-88a4f702665c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:49.934861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed3f087-fade-41b2-8531-88a4f702665c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:49.938530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed3f087-fade-41b2-8531-88a4f702665c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:49.938704 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-88bb3733-cdfe-4732-aff5-82d90c80c7e0 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.550155 Oct 18 13:24:49.939840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed3f087-fade-41b2-8531-88a4f702665c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:49.940426 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 926/1929] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 18 13:24:49 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:49.945235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed3f087-fade-41b2-8531-88a4f702665c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:49.948649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed3f087-fade-41b2-8531-88a4f702665c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:49.950133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed3f087-fade-41b2-8531-88a4f702665c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:49.958533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-da0b2f3f-5823-42a0-8b1c-7b82e000172a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:49.960517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-da0b2f3f-5823-42a0-8b1c-7b82e000172a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:49.971034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da0b2f3f-5823-42a0-8b1c-7b82e000172a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:49.971888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da0b2f3f-5823-42a0-8b1c-7b82e000172a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:49.972500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da0b2f3f-5823-42a0-8b1c-7b82e000172a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:49.973502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da0b2f3f-5823-42a0-8b1c-7b82e000172a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:49.974770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da0b2f3f-5823-42a0-8b1c-7b82e000172a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:49.975379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da0b2f3f-5823-42a0-8b1c-7b82e000172a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.141870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eed3f087-fade-41b2-8531-88a4f702665c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:50.159946 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eed3f087-fade-41b2-8531-88a4f702665c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 200 len: 1346 microversion: 2.1 time: 0.285629 Oct 18 13:24:50.180380 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1004/1930] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:49 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 1346 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:50.188333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-99626b94-8d55-4a8a-9ac2-a85a058fcaac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:50.189333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-99626b94-8d55-4a8a-9ac2-a85a058fcaac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:50.200007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-99626b94-8d55-4a8a-9ac2-a85a058fcaac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.201307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-99626b94-8d55-4a8a-9ac2-a85a058fcaac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.202124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-99626b94-8d55-4a8a-9ac2-a85a058fcaac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.204144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-99626b94-8d55-4a8a-9ac2-a85a058fcaac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.222325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-99626b94-8d55-4a8a-9ac2-a85a058fcaac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.223403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-99626b94-8d55-4a8a-9ac2-a85a058fcaac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.412124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-da0b2f3f-5823-42a0-8b1c-7b82e000172a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:50.424710 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-da0b2f3f-5823-42a0-8b1c-7b82e000172a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.482181 Oct 18 13:24:50.426197 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 927/1931] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:49 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:50.431575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f9f922bb-082d-4435-890e-9c6a75b08ea3 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Calling method '.version_select at 0x7ff60fe1f4c0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:50.628574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:50.633359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-99626b94-8d55-4a8a-9ac2-a85a058fcaac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:50.646860 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-99626b94-8d55-4a8a-9ac2-a85a058fcaac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1314 microversion: 2.1 time: 0.464067 Oct 18 13:24:50.649240 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1005/1932] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:50 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:50.654467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9aa33692-fa8a-4269-9572-5cbff000f208 req-fd4df82e-f5fa-41e0-bf38-51fb01d5a100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67746251-6df7-43e6-9a3d-c45f1fb662ae", "tag": "06704eb6-7b35-42a7-a441-0dd307106054"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:50.685728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9aa33692-fa8a-4269-9572-5cbff000f208 req-fd4df82e-f5fa-41e0-bf38-51fb01d5a100 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.687159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9aa33692-fa8a-4269-9572-5cbff000f208 req-fd4df82e-f5fa-41e0-bf38-51fb01d5a100 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.688004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9aa33692-fa8a-4269-9572-5cbff000f208 req-fd4df82e-f5fa-41e0-bf38-51fb01d5a100 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.720013 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9aa33692-fa8a-4269-9572-5cbff000f208 req-fd4df82e-f5fa-41e0-bf38-51fb01d5a100 service nova] Creating event network-changed:06704eb6-7b35-42a7-a441-0dd307106054 for instance 67746251-6df7-43e6-9a3d-c45f1fb662ae on n-h2-858384-13 Oct 18 13:24:50.735537 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9aa33692-fa8a-4269-9572-5cbff000f208 req-fd4df82e-f5fa-41e0-bf38-51fb01d5a100 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084759 Oct 18 13:24:50.739380 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1006/1933] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:50.748346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-4979048b-66be-4752-9edf-445ecc63c107 req-b91204ff-ceb4-4bfb-b610-fd3c3ddf803a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55057538-1fbb-42f0-a01d-c7558e4c2c2d", "tag": "3b6c31dc-0fed-441b-9651-2d2e6ea826de"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:50.777289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4979048b-66be-4752-9edf-445ecc63c107 req-b91204ff-ceb4-4bfb-b610-fd3c3ddf803a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.778779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4979048b-66be-4752-9edf-445ecc63c107 req-b91204ff-ceb4-4bfb-b610-fd3c3ddf803a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.783419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4979048b-66be-4752-9edf-445ecc63c107 req-b91204ff-ceb4-4bfb-b610-fd3c3ddf803a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.817641 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-4979048b-66be-4752-9edf-445ecc63c107 req-b91204ff-ceb4-4bfb-b610-fd3c3ddf803a service nova] Creating event network-changed:3b6c31dc-0fed-441b-9651-2d2e6ea826de for instance 55057538-1fbb-42f0-a01d-c7558e4c2c2d on n-h1-858384-13 Oct 18 13:24:50.827534 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-4979048b-66be-4752-9edf-445ecc63c107 req-b91204ff-ceb4-4bfb-b610-fd3c3ddf803a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083209 Oct 18 13:24:50.828541 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1007/1934] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:50.867830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-587f939a-e46e-4c82-8ea3-d5103189e627 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:50.871455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-587f939a-e46e-4c82-8ea3-d5103189e627 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:50.883184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587f939a-e46e-4c82-8ea3-d5103189e627 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.884106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587f939a-e46e-4c82-8ea3-d5103189e627 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.885137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587f939a-e46e-4c82-8ea3-d5103189e627 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:50.886170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587f939a-e46e-4c82-8ea3-d5103189e627 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:50.886865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587f939a-e46e-4c82-8ea3-d5103189e627 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:50.887552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587f939a-e46e-4c82-8ea3-d5103189e627 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.472088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-587f939a-e46e-4c82-8ea3-d5103189e627 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:51.521856 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-587f939a-e46e-4c82-8ea3-d5103189e627 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1308 microversion: 2.1 time: 0.691665 Oct 18 13:24:51.526902 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1008/1935] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:50 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1308 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:51.549170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1f3f561a-f73a-4515-bebf-a0fa8f17b498 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:51.554220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1f3f561a-f73a-4515-bebf-a0fa8f17b498 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:51.585491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f3f561a-f73a-4515-bebf-a0fa8f17b498 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.585491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f3f561a-f73a-4515-bebf-a0fa8f17b498 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.586570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f3f561a-f73a-4515-bebf-a0fa8f17b498 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:51.594143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f3f561a-f73a-4515-bebf-a0fa8f17b498 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:51.596488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f3f561a-f73a-4515-bebf-a0fa8f17b498 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:51.597534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f3f561a-f73a-4515-bebf-a0fa8f17b498 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:52.003427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1f3f561a-f73a-4515-bebf-a0fa8f17b498 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:52.030498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1f3f561a-f73a-4515-bebf-a0fa8f17b498 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:52.033041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1f3f561a-f73a-4515-bebf-a0fa8f17b498 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:52.052262 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1f3f561a-f73a-4515-bebf-a0fa8f17b498 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.523857 Oct 18 13:24:52.055831 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1009/1936] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:51 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:52.060728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-39deb2e9-4a90-471c-b4a0-4a4fadc1e2c6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:52.073508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-39deb2e9-4a90-471c-b4a0-4a4fadc1e2c6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:52.113772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=8 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:52.115386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39deb2e9-4a90-471c-b4a0-4a4fadc1e2c6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:52.116094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39deb2e9-4a90-471c-b4a0-4a4fadc1e2c6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:52.117545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39deb2e9-4a90-471c-b4a0-4a4fadc1e2c6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:52.118480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39deb2e9-4a90-471c-b4a0-4a4fadc1e2c6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:52.119291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39deb2e9-4a90-471c-b4a0-4a4fadc1e2c6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:52.119544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39deb2e9-4a90-471c-b4a0-4a4fadc1e2c6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:52.725206 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f9f922bb-082d-4435-890e-9c6a75b08ea3 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/6621093f-5894-4398-b14a-bacf3478ce43" status: 202 len: 0 microversion: 2.1 time: 2.297312 Oct 18 13:24:52.728344 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 928/1937] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:24:50 2022] DELETE /compute/v2.1/os-floating-ips/6621093f-5894-4398-b14a-bacf3478ce43 => generated 0 bytes in 2301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:24:52.751555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6b796f37-c7ad-4be5-a678-93d4095e0b67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:52.752448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6b796f37-c7ad-4be5-a678-93d4095e0b67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:52.768766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b796f37-c7ad-4be5-a678-93d4095e0b67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:52.769278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b796f37-c7ad-4be5-a678-93d4095e0b67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:52.769711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b796f37-c7ad-4be5-a678-93d4095e0b67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:52.770411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b796f37-c7ad-4be5-a678-93d4095e0b67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:52.771087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b796f37-c7ad-4be5-a678-93d4095e0b67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:52.771713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b796f37-c7ad-4be5-a678-93d4095e0b67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:52.798376 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-6b796f37-c7ad-4be5-a678-93d4095e0b67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6b796f37-c7ad-4be5-a678-93d4095e0b67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 HTTP/1.1 Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:24:52.800920 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:24:52.802600 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:24:52.802600 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:24:52.802600 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:24:52.802600 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:24:52.802600 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:24:52.802600 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:24:52.802600 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:24:52.802600 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:24:52.802600 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:24:52.802600 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:24:52.802600 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:24:52.802600 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'b0e67b4b-fc1a-4c86-80bc-afaddef3d664'} Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:52.803494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:24:52.805223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:52.808120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6b796f37-c7ad-4be5-a678-93d4095e0b67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:52.809303 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6b796f37-c7ad-4be5-a678-93d4095e0b67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 404 len: 111 microversion: 2.1 time: 0.079111 Oct 18 13:24:52.812619 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 929/1938] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:52 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:52.820045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-85e02e69-bd60-4f67-bda4-844e90710cf4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:52.821462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-85e02e69-bd60-4f67-bda4-844e90710cf4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:52.828559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85e02e69-bd60-4f67-bda4-844e90710cf4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:52.829565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85e02e69-bd60-4f67-bda4-844e90710cf4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:52.830231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85e02e69-bd60-4f67-bda4-844e90710cf4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:52.831180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85e02e69-bd60-4f67-bda4-844e90710cf4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:52.831848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85e02e69-bd60-4f67-bda4-844e90710cf4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:52.832487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85e02e69-bd60-4f67-bda4-844e90710cf4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.024054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-39deb2e9-4a90-471c-b4a0-4a4fadc1e2c6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:53.043714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-39deb2e9-4a90-471c-b4a0-4a4fadc1e2c6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:53.046308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-39deb2e9-4a90-471c-b4a0-4a4fadc1e2c6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:53.048606 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-39deb2e9-4a90-471c-b4a0-4a4fadc1e2c6 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.991534 Oct 18 13:24:53.090168 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1010/1939] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:52 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:53.111932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-63049555-15b9-444c-8a16-227ebad0c7fc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:53.114548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-63049555-15b9-444c-8a16-227ebad0c7fc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:53.124941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63049555-15b9-444c-8a16-227ebad0c7fc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.126070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63049555-15b9-444c-8a16-227ebad0c7fc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.126783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63049555-15b9-444c-8a16-227ebad0c7fc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.129253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63049555-15b9-444c-8a16-227ebad0c7fc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.130465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63049555-15b9-444c-8a16-227ebad0c7fc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.132638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63049555-15b9-444c-8a16-227ebad0c7fc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.145476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-85e02e69-bd60-4f67-bda4-844e90710cf4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:53.154916 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-85e02e69-bd60-4f67-bda4-844e90710cf4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.340877 Oct 18 13:24:53.164025 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 930/1940] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:52 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:53.191478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1464be21-cf8f-4d4f-8649-545c019ab4e2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:53.193204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1464be21-cf8f-4d4f-8649-545c019ab4e2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:53.208246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1464be21-cf8f-4d4f-8649-545c019ab4e2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.208875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1464be21-cf8f-4d4f-8649-545c019ab4e2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.210197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1464be21-cf8f-4d4f-8649-545c019ab4e2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.219439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1464be21-cf8f-4d4f-8649-545c019ab4e2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.223877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1464be21-cf8f-4d4f-8649-545c019ab4e2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.225293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1464be21-cf8f-4d4f-8649-545c019ab4e2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.475020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-63049555-15b9-444c-8a16-227ebad0c7fc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:53.484184 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-63049555-15b9-444c-8a16-227ebad0c7fc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1314 microversion: 2.1 time: 0.392282 Oct 18 13:24:53.484788 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1011/1941] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:53 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:53.495366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a302453b-6790-438c-a43b-7c6732d2ef60 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Action: 'create', calling method: .version_select at 0x7ff60f08d1f0>, body: {"pool": null} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:53.538826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1464be21-cf8f-4d4f-8649-545c019ab4e2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:53.547658 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1464be21-cf8f-4d4f-8649-545c019ab4e2 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 200 len: 1488 microversion: 2.1 time: 0.378988 Oct 18 13:24:53.554372 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 931/1942] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:53 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 1488 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:53.559707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f690e63f-87e6-499e-bde1-3c341064f7bd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:53.570937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f690e63f-87e6-499e-bde1-3c341064f7bd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:53.581958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f690e63f-87e6-499e-bde1-3c341064f7bd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.582749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f690e63f-87e6-499e-bde1-3c341064f7bd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.583387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f690e63f-87e6-499e-bde1-3c341064f7bd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.586636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f690e63f-87e6-499e-bde1-3c341064f7bd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.587331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f690e63f-87e6-499e-bde1-3c341064f7bd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.588040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f690e63f-87e6-499e-bde1-3c341064f7bd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.712143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f690e63f-87e6-499e-bde1-3c341064f7bd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:53.723313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f690e63f-87e6-499e-bde1-3c341064f7bd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:53.726796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f690e63f-87e6-499e-bde1-3c341064f7bd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:53.744233 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f690e63f-87e6-499e-bde1-3c341064f7bd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.187507 Oct 18 13:24:53.747500 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 932/1943] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:53 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:53.752472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4c53799-b4a6-40f2-8101-3777fa4cef67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:53.754938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e4c53799-b4a6-40f2-8101-3777fa4cef67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:53.764551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4c53799-b4a6-40f2-8101-3777fa4cef67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.765362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4c53799-b4a6-40f2-8101-3777fa4cef67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.766000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4c53799-b4a6-40f2-8101-3777fa4cef67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.766889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4c53799-b4a6-40f2-8101-3777fa4cef67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.767510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4c53799-b4a6-40f2-8101-3777fa4cef67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.768212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4c53799-b4a6-40f2-8101-3777fa4cef67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.801844 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e4c53799-b4a6-40f2-8101-3777fa4cef67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4c53799-b4a6-40f2-8101-3777fa4cef67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664/os-volume_attachments HTTP/1.1 Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:24:53.816484 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:24:53.818403 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:24:53.818403 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:24:53.818403 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:24:53.818403 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:24:53.818403 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:24:53.818403 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:24:53.818403 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:24:53.818403 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:24:53.818403 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:24:53.818403 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:24:53.818403 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:24:53.818403 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'server_id': 'b0e67b4b-fc1a-4c86-80bc-afaddef3d664'} Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:53.819484 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:24:53.821297 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:53.838117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4c53799-b4a6-40f2-8101-3777fa4cef67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:53.843035 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e4c53799-b4a6-40f2-8101-3777fa4cef67 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.094132 Oct 18 13:24:53.844805 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 933/1944] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:24:53 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664/os-volume_attachments => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:53.879356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-afdf06d2-2e7e-43f4-85dc-86357155bdab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-596444075"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:53.895858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-afdf06d2-2e7e-43f4-85dc-86357155bdab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:53.924680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afdf06d2-2e7e-43f4-85dc-86357155bdab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.933704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afdf06d2-2e7e-43f4-85dc-86357155bdab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.935224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afdf06d2-2e7e-43f4-85dc-86357155bdab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:53.937989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afdf06d2-2e7e-43f4-85dc-86357155bdab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:53.939981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afdf06d2-2e7e-43f4-85dc-86357155bdab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:53.954933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afdf06d2-2e7e-43f4-85dc-86357155bdab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.121346 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-afdf06d2-2e7e-43f4-85dc-86357155bdab tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276/action" status: 202 len: 0 microversion: 2.1 time: 2.273416 Oct 18 13:24:56.122015 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 934/1945] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:24:53 2022] POST /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276/action => generated 0 bytes in 2276 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:24:56.129444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-746d6ab5-45a4-4fe7-a46d-94742d6aac9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:56.130871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-746d6ab5-45a4-4fe7-a46d-94742d6aac9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:56.141473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-746d6ab5-45a4-4fe7-a46d-94742d6aac9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.142271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-746d6ab5-45a4-4fe7-a46d-94742d6aac9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.142900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-746d6ab5-45a4-4fe7-a46d-94742d6aac9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.144098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-746d6ab5-45a4-4fe7-a46d-94742d6aac9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.144550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-746d6ab5-45a4-4fe7-a46d-94742d6aac9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.145078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-746d6ab5-45a4-4fe7-a46d-94742d6aac9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.307693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-746d6ab5-45a4-4fe7-a46d-94742d6aac9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:56.334543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-746d6ab5-45a4-4fe7-a46d-94742d6aac9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:56.337144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-746d6ab5-45a4-4fe7-a46d-94742d6aac9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:56.338623 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-746d6ab5-45a4-4fe7-a46d-94742d6aac9e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.215545 Oct 18 13:24:56.339190 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 935/1946] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:56 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:56.344696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-23db0868-4c47-4c30-bbfd-39756d2ebc71 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:56.345676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-23db0868-4c47-4c30-bbfd-39756d2ebc71 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:56.353053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23db0868-4c47-4c30-bbfd-39756d2ebc71 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.354215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23db0868-4c47-4c30-bbfd-39756d2ebc71 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.355698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23db0868-4c47-4c30-bbfd-39756d2ebc71 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.357742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23db0868-4c47-4c30-bbfd-39756d2ebc71 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.358212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23db0868-4c47-4c30-bbfd-39756d2ebc71 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.358820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23db0868-4c47-4c30-bbfd-39756d2ebc71 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.515115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-23db0868-4c47-4c30-bbfd-39756d2ebc71 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:56.524507 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-23db0868-4c47-4c30-bbfd-39756d2ebc71 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.184038 Oct 18 13:24:56.525732 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 936/1947] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:56 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:56.530867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-6475737", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "b5cc8010-ea63-4e1f-9434-bf4391452206"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:56.532633 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a302453b-6790-438c-a43b-7c6732d2ef60 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.041478 Oct 18 13:24:56.541289 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1012/1948] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 18 13:24:53 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:56.546020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8667352d-68a2-4c80-94da-c0c99cf05013 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:56.546626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8667352d-68a2-4c80-94da-c0c99cf05013 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:56.552954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8667352d-68a2-4c80-94da-c0c99cf05013 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.553813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8667352d-68a2-4c80-94da-c0c99cf05013 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.554555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8667352d-68a2-4c80-94da-c0c99cf05013 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.555559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8667352d-68a2-4c80-94da-c0c99cf05013 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.556010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8667352d-68a2-4c80-94da-c0c99cf05013 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.556627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8667352d-68a2-4c80-94da-c0c99cf05013 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.594810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] validate_networks() for [('b5cc8010-ea63-4e1f-9434-bf4391452206', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:24:56.757675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8667352d-68a2-4c80-94da-c0c99cf05013 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:56.768020 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8667352d-68a2-4c80-94da-c0c99cf05013 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1314 microversion: 2.1 time: 0.225649 Oct 18 13:24:56.781469 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1013/1949] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:56 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:56.787924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b3938b64-fd75-4244-b2ca-2d11c2632d5a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:56.789391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b3938b64-fd75-4244-b2ca-2d11c2632d5a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:56.796195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3938b64-fd75-4244-b2ca-2d11c2632d5a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.797017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3938b64-fd75-4244-b2ca-2d11c2632d5a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.797979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3938b64-fd75-4244-b2ca-2d11c2632d5a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.798889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3938b64-fd75-4244-b2ca-2d11c2632d5a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:56.799522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3938b64-fd75-4244-b2ca-2d11c2632d5a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:56.799945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3938b64-fd75-4244-b2ca-2d11c2632d5a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:56.886437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b3938b64-fd75-4244-b2ca-2d11c2632d5a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:56.903793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b3938b64-fd75-4244-b2ca-2d11c2632d5a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:56.905587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b3938b64-fd75-4244-b2ca-2d11c2632d5a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:56.914048 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b3938b64-fd75-4244-b2ca-2d11c2632d5a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1535 microversion: 2.91 time: 0.130787 Oct 18 13:24:56.916632 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1014/1950] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:56 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1535 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:56.923928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-42e53d41-d89a-4c72-92c0-e7599895df56 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f08dc10>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:57.002153 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-42e53d41-d89a-4c72-92c0-e7599895df56 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31" status: 200 len: 1409 microversion: 2.1 time: 0.083912 Oct 18 13:24:57.011980 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1015/1951] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:56 2022] GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31 => generated 1409 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:57.019206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9247d9b8-a569-432d-99d2-dd6623c0b6f1 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Calling method '.version_select at 0x7ff60f083700>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:57.337681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:24:57.338720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:24:57.339429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:24:57.340019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:24:57.340682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:24:57.351349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.352153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.352597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.353357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.354176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.354794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.376542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:24:57.384067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for user c0a722d1dc7c4e05b8cc8dc98b5cb619 and project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:24:57.398843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:24:57.401620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:24:57.453480 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-10a25b2d-a4c2-4603-b3fd-787b39c7bce7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926124 Oct 18 13:24:57.454441 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 937/1952] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:24:57.459551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-25f52129-186e-40c8-ba2d-ee793bc0c946 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:57.460198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-25f52129-186e-40c8-ba2d-ee793bc0c946 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:57.467966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25f52129-186e-40c8-ba2d-ee793bc0c946 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.468731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25f52129-186e-40c8-ba2d-ee793bc0c946 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.469394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25f52129-186e-40c8-ba2d-ee793bc0c946 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.470295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25f52129-186e-40c8-ba2d-ee793bc0c946 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.470931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25f52129-186e-40c8-ba2d-ee793bc0c946 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.471526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25f52129-186e-40c8-ba2d-ee793bc0c946 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.636298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-25f52129-186e-40c8-ba2d-ee793bc0c946 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:57.645546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-25f52129-186e-40c8-ba2d-ee793bc0c946 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:57.647170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-25f52129-186e-40c8-ba2d-ee793bc0c946 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:57.649168 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-25f52129-186e-40c8-ba2d-ee793bc0c946 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.193258 Oct 18 13:24:57.666847 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 938/1953] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:57 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:57.666847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0bc75efd-7fa4-47d9-90a4-4c43336b5f91 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:57.666847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0bc75efd-7fa4-47d9-90a4-4c43336b5f91 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:57.720894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0bc75efd-7fa4-47d9-90a4-4c43336b5f91 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:57.733057 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0bc75efd-7fa4-47d9-90a4-4c43336b5f91 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1" status: 200 len: 1212 microversion: 2.1 time: 0.081218 Oct 18 13:24:57.742075 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 939/1954] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:57 2022] GET /compute/v2.1/servers/02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:57.757722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c6b5c4da-1f2f-4cdb-8180-61ca53c8d704 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:57.758345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c6b5c4da-1f2f-4cdb-8180-61ca53c8d704 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:57.765316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6b5c4da-1f2f-4cdb-8180-61ca53c8d704 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.765809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6b5c4da-1f2f-4cdb-8180-61ca53c8d704 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.766242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6b5c4da-1f2f-4cdb-8180-61ca53c8d704 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:57.767221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6b5c4da-1f2f-4cdb-8180-61ca53c8d704 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:57.767908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6b5c4da-1f2f-4cdb-8180-61ca53c8d704 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:57.768416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6b5c4da-1f2f-4cdb-8180-61ca53c8d704 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.025283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c6b5c4da-1f2f-4cdb-8180-61ca53c8d704 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:58.062258 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c6b5c4da-1f2f-4cdb-8180-61ca53c8d704 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.318902 Oct 18 13:24:58.062896 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 940/1955] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:57 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:58.068226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.068941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:58.088744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:24:58.129548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.130724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.131275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.141913 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9247d9b8-a569-432d-99d2-dd6623c0b6f1 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/ffb3a282-5f48-4c40-acbe-41d72b196c4e" status: 202 len: 0 microversion: 2.1 time: 1.126475 Oct 18 13:24:58.142446 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1016/1956] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:24:57 2022] DELETE /compute/v2.1/os-floating-ips/ffb3a282-5f48-4c40-acbe-41d72b196c4e => generated 0 bytes in 1130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:24:58.148870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2514bbe9-316d-4faf-84c8-b45479fba6f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.149731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2514bbe9-316d-4faf-84c8-b45479fba6f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:58.150186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.150974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.151893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.153404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lazy-loading 'flavor' on Instance uuid 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:58.157518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2514bbe9-316d-4faf-84c8-b45479fba6f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.158484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2514bbe9-316d-4faf-84c8-b45479fba6f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.159124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2514bbe9-316d-4faf-84c8-b45479fba6f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.160179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2514bbe9-316d-4faf-84c8-b45479fba6f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.160812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2514bbe9-316d-4faf-84c8-b45479fba6f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.162022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2514bbe9-316d-4faf-84c8-b45479fba6f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.168119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lazy-loading 'system_metadata' on Instance uuid 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:58.224975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lazy-loading 'metadata' on Instance uuid 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:24:58.342088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2514bbe9-316d-4faf-84c8-b45479fba6f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:58.351492 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2514bbe9-316d-4faf-84c8-b45479fba6f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1314 microversion: 2.1 time: 0.207484 Oct 18 13:24:58.352642 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1017/1957] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:58.358368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a2f4fd0a-71c1-4773-844b-77d202c661d9 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.359304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a2f4fd0a-71c1-4773-844b-77d202c661d9 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:58.365739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2f4fd0a-71c1-4773-844b-77d202c661d9 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.366484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2f4fd0a-71c1-4773-844b-77d202c661d9 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.367093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2f4fd0a-71c1-4773-844b-77d202c661d9 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.367898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2f4fd0a-71c1-4773-844b-77d202c661d9 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.368339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2f4fd0a-71c1-4773-844b-77d202c661d9 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.368756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2f4fd0a-71c1-4773-844b-77d202c661d9 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.370298 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.scheduler.client.report [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Deleted allocations for instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 Oct 18 13:24:58.388190 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b6dd3b0f-fc97-4ede-8d8d-d7ea86011a33 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1" status: 204 len: 0 microversion: 2.1 time: 0.324002 Oct 18 13:24:58.388822 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 941/1958] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:24:58 2022] DELETE /compute/v2.1/servers/02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:24:58.393436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-080f4df2-4ec9-4264-804c-ec13163ee4fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60fc99ca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.452304 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-080f4df2-4ec9-4264-804c-ec13163ee4fe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31" status: 200 len: 1409 microversion: 2.1 time: 0.062384 Oct 18 13:24:58.453063 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 942/1959] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31 => generated 1409 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:58.458283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c597e1e-1cff-4985-bf23-67d0ea9d45a9 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Calling method '.version_select at 0x7ff617b5cdc0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.470088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a2f4fd0a-71c1-4773-844b-77d202c661d9 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:58.485088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a2f4fd0a-71c1-4773-844b-77d202c661d9 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:58.486576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a2f4fd0a-71c1-4773-844b-77d202c661d9 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:58.492431 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a2f4fd0a-71c1-4773-844b-77d202c661d9 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1535 microversion: 2.91 time: 0.138421 Oct 18 13:24:58.505537 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1018/1960] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1535 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:24:58.518707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e6166ee0-8a3d-44bd-8fef-ef267abe98b9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.519320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e6166ee0-8a3d-44bd-8fef-ef267abe98b9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:58.526323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6166ee0-8a3d-44bd-8fef-ef267abe98b9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.527511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6166ee0-8a3d-44bd-8fef-ef267abe98b9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.528131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6166ee0-8a3d-44bd-8fef-ef267abe98b9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.529024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6166ee0-8a3d-44bd-8fef-ef267abe98b9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.529675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6166ee0-8a3d-44bd-8fef-ef267abe98b9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.530292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6166ee0-8a3d-44bd-8fef-ef267abe98b9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.542011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-2c597e1e-1cff-4985-bf23-67d0ea9d45a9 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ffb3a282-5f48-4c40-acbe-41d72b196c4e could not be found", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:24:58.542896 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-2c597e1e-1cff-4985-bf23-67d0ea9d45a9 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] HTTP exception thrown: Floating IP not found for ID ffb3a282-5f48-4c40-acbe-41d72b196c4e Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c597e1e-1cff-4985-bf23-67d0ea9d45a9 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Request method failure captured: Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-floating-ips/ffb3a282-5f48-4c40-acbe-41d72b196c4e HTTP/1.1 Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqkYGikDuBKMF_g4A0n08-O0qbVQOwxHasN5oow2wzFhD_fh1Fl44tJjgztVP_uGJ2rmW-_-WLIN7_AKsNhv5JnoMmB5-znQPiN17kPKCK5zJXZIzLteV9xSAazUnXLsSz2BDPcP8zb3nbYpnNqkecvymYJbaf5i1Ji2SJ6HIAHV0Zs Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: e4098337db3741058fb417a14f88fd04 Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FloatingIPsTestJSON-2128398398 Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:24:58.545316 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:24:58.547112 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4098337db3741058fb417a14f88fd04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4098337db3741058fb417a14f88fd04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4098337db3741058fb417a14f88fd04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4098337db3741058fb417a14f88fd04"}]}] Oct 18 13:24:58.547112 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FloatingIPsTestJSON-2128398398 Oct 18 13:24:58.547112 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: e4098337db3741058fb417a14f88fd04 Oct 18 13:24:58.547112 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2128398398 Oct 18 13:24:58.547112 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FloatingIPsTestJSON-2128398398-project Oct 18 13:24:58.547112 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:24:58.547112 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:24:58.547112 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: ff140ce5eac642d8aeddacd39319d8b6 Oct 18 13:24:58.547112 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FloatingIPsTestJSON-2128398398-project Oct 18 13:24:58.547112 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:24:58.547112 n-d-858384-13 devstack@n-api.service[120612]: exception: Floating IP not found for ID ffb3a282-5f48-4c40-acbe-41d72b196c4e Oct 18 13:24:58.547112 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'ffb3a282-5f48-4c40-acbe-41d72b196c4e'} Oct 18 13:24:58.547112 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:24:58.548438 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ffb3a282-5f48-4c40-acbe-41d72b196c4e could not be found Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f95c9ef5-9c68-4d5f-825a-b7c73a9a20d5'] Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ffb3a282-5f48-4c40-acbe-41d72b196c4e. Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:58.549992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ffb3a282-5f48-4c40-acbe-41d72b196c4e Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:58.551424 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:58.552950 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ffb3a282-5f48-4c40-acbe-41d72b196c4e Oct 18 13:24:58.552950 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.552950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c597e1e-1cff-4985-bf23-67d0ea9d45a9 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Returning 404 to user: Floating IP not found for ID ffb3a282-5f48-4c40-acbe-41d72b196c4e {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:58.552950 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2c597e1e-1cff-4985-bf23-67d0ea9d45a9 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/ffb3a282-5f48-4c40-acbe-41d72b196c4e" status: 404 len: 111 microversion: 2.1 time: 0.092684 Oct 18 13:24:58.552950 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 943/1961] 10.222.0.40 () {58 vars in 1260 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/os-floating-ips/ffb3a282-5f48-4c40-acbe-41d72b196c4e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:58.556624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-66064c2a-8e22-458c-bee0-5761f2348fa3 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Calling method '.version_select at 0x7ff617b52f70>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.558853 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-e6166ee0-8a3d-44bd-8fef-ef267abe98b9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e6166ee0-8a3d-44bd-8fef-ef267abe98b9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 HTTP/1.1 Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:24:58.560565 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:24:58.562389 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:24:58.562389 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:24:58.562389 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:24:58.562389 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:24:58.562389 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:24:58.562389 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:24:58.562389 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:24:58.562389 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:24:58.562389 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:24:58.562389 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:24:58.562389 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:24:58.562389 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1'} Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:58.563433 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:24:58.565112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.566733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e6166ee0-8a3d-44bd-8fef-ef267abe98b9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:58.569977 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e6166ee0-8a3d-44bd-8fef-ef267abe98b9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1" status: 404 len: 111 microversion: 2.1 time: 0.055208 Oct 18 13:24:58.572157 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1019/1962] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/servers/02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:58.602835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-66064c2a-8e22-458c-bee0-5761f2348fa3 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ffb3a282-5f48-4c40-acbe-41d72b196c4e could not be found", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:24:58.604030 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-66064c2a-8e22-458c-bee0-5761f2348fa3 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] HTTP exception thrown: Floating IP not found for ID ffb3a282-5f48-4c40-acbe-41d72b196c4e Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-66064c2a-8e22-458c-bee0-5761f2348fa3 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Request method failure captured: Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-floating-ips/ffb3a282-5f48-4c40-acbe-41d72b196c4e HTTP/1.1 Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqkYGikDuBKMF_g4A0n08-O0qbVQOwxHasN5oow2wzFhD_fh1Fl44tJjgztVP_uGJ2rmW-_-WLIN7_AKsNhv5JnoMmB5-znQPiN17kPKCK5zJXZIzLteV9xSAazUnXLsSz2BDPcP8zb3nbYpnNqkecvymYJbaf5i1Ji2SJ6HIAHV0Zs Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: e4098337db3741058fb417a14f88fd04 Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FloatingIPsTestJSON-2128398398 Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:24:58.606541 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:24:58.608307 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4098337db3741058fb417a14f88fd04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4098337db3741058fb417a14f88fd04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4098337db3741058fb417a14f88fd04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4098337db3741058fb417a14f88fd04"}]}] Oct 18 13:24:58.608307 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FloatingIPsTestJSON-2128398398 Oct 18 13:24:58.608307 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: e4098337db3741058fb417a14f88fd04 Oct 18 13:24:58.608307 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2128398398 Oct 18 13:24:58.608307 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FloatingIPsTestJSON-2128398398-project Oct 18 13:24:58.608307 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:24:58.608307 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:24:58.608307 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: ff140ce5eac642d8aeddacd39319d8b6 Oct 18 13:24:58.608307 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FloatingIPsTestJSON-2128398398-project Oct 18 13:24:58.608307 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:24:58.608307 n-d-858384-13 devstack@n-api.service[120612]: exception: Floating IP not found for ID ffb3a282-5f48-4c40-acbe-41d72b196c4e Oct 18 13:24:58.608307 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'ffb3a282-5f48-4c40-acbe-41d72b196c4e'} Oct 18 13:24:58.608307 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:24:58.609404 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ffb3a282-5f48-4c40-acbe-41d72b196c4e could not be found Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1b96175-5c4c-470c-9144-435e7e6a21a8'] Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ffb3a282-5f48-4c40-acbe-41d72b196c4e. Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:58.610923 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ffb3a282-5f48-4c40-acbe-41d72b196c4e Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:24:58.612349 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:24:58.614000 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ffb3a282-5f48-4c40-acbe-41d72b196c4e Oct 18 13:24:58.614000 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:24:58.614000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-66064c2a-8e22-458c-bee0-5761f2348fa3 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] Returning 404 to user: Floating IP not found for ID ffb3a282-5f48-4c40-acbe-41d72b196c4e {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:24:58.614000 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-66064c2a-8e22-458c-bee0-5761f2348fa3 tempest-FloatingIPsTestJSON-2128398398 tempest-FloatingIPsTestJSON-2128398398-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/ffb3a282-5f48-4c40-acbe-41d72b196c4e" status: 404 len: 111 microversion: 2.1 time: 0.055285 Oct 18 13:24:58.614000 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 944/1963] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:24:58 2022] DELETE /compute/v2.1/os-floating-ips/ffb3a282-5f48-4c40-acbe-41d72b196c4e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:24:58.636441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-681325594", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "b5cc8010-ea63-4e1f-9434-bf4391452206"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:58.675693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e102d907-9a3f-4606-b8e4-7e39a75f155b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:58.676406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e102d907-9a3f-4606-b8e4-7e39a75f155b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:58.685487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:58.687293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e102d907-9a3f-4606-b8e4-7e39a75f155b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.689041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e102d907-9a3f-4606-b8e4-7e39a75f155b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.690385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e102d907-9a3f-4606-b8e4-7e39a75f155b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.691907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e102d907-9a3f-4606-b8e4-7e39a75f155b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:58.692373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e102d907-9a3f-4606-b8e4-7e39a75f155b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:58.692800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e102d907-9a3f-4606-b8e4-7e39a75f155b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:58.702914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] validate_networks() for [('b5cc8010-ea63-4e1f-9434-bf4391452206', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:24:59.098483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e102d907-9a3f-4606-b8e4-7e39a75f155b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:59.111530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e102d907-9a3f-4606-b8e4-7e39a75f155b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:59.118984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e102d907-9a3f-4606-b8e4-7e39a75f155b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:59.124578 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e102d907-9a3f-4606-b8e4-7e39a75f155b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.449690 Oct 18 13:24:59.138573 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 945/1964] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:58 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:24:59.152605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8022c17f-7f76-42e4-8759-545a5fe965ec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:59.153665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8022c17f-7f76-42e4-8759-545a5fe965ec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:59.163695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8022c17f-7f76-42e4-8759-545a5fe965ec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.166036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8022c17f-7f76-42e4-8759-545a5fe965ec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.166842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8022c17f-7f76-42e4-8759-545a5fe965ec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.168013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8022c17f-7f76-42e4-8759-545a5fe965ec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.168818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8022c17f-7f76-42e4-8759-545a5fe965ec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.169378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8022c17f-7f76-42e4-8759-545a5fe965ec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.195074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:24:59.252595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:24:59.253457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:24:59.254260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:24:59.254755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:24:59.255087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:24:59.271203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.272687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.273681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.274912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.275570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.276161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.303326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:24:59.314043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for user c0a722d1dc7c4e05b8cc8dc98b5cb619 and project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:24:59.330587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:24:59.333277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:24:59.395771 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e3c4fee0-f5d4-4c17-b8c1-e374135681cb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.763271 Oct 18 13:24:59.399651 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1020/1965] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:24:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:24:59.420817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d21fa4a3-ed15-44a3-bcd4-accc9b9ff29a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:59.422094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d21fa4a3-ed15-44a3-bcd4-accc9b9ff29a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:59.436325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d21fa4a3-ed15-44a3-bcd4-accc9b9ff29a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.436899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d21fa4a3-ed15-44a3-bcd4-accc9b9ff29a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.437433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d21fa4a3-ed15-44a3-bcd4-accc9b9ff29a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.438178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d21fa4a3-ed15-44a3-bcd4-accc9b9ff29a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.438862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d21fa4a3-ed15-44a3-bcd4-accc9b9ff29a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.440021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d21fa4a3-ed15-44a3-bcd4-accc9b9ff29a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.499477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8022c17f-7f76-42e4-8759-545a5fe965ec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:59.510426 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8022c17f-7f76-42e4-8759-545a5fe965ec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.369743 Oct 18 13:24:59.525338 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 946/1966] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:59 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:59.537769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-735a9311-cd85-4ac4-a84a-a0d3d8408ec1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:59.541668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-735a9311-cd85-4ac4-a84a-a0d3d8408ec1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:59.670466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d21fa4a3-ed15-44a3-bcd4-accc9b9ff29a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:59.682376 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d21fa4a3-ed15-44a3-bcd4-accc9b9ff29a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1314 microversion: 2.1 time: 0.279927 Oct 18 13:24:59.683500 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1021/1967] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:59 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:59.698625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-930a712d-1223-4bcf-9cd8-4f96bf84c908 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f7ad9d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:59.778318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-735a9311-cd85-4ac4-a84a-a0d3d8408ec1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:24:59.786975 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-930a712d-1223-4bcf-9cd8-4f96bf84c908 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31" status: 200 len: 1409 microversion: 2.1 time: 0.102251 Oct 18 13:24:59.787561 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1022/1968] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:24:59 2022] GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31 => generated 1409 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:59.800722 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-735a9311-cd85-4ac4-a84a-a0d3d8408ec1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1214 microversion: 2.1 time: 0.274092 Oct 18 13:24:59.813212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-07ee079d-aa90-4fc1-89f5-e5ec1c62151a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:24:59.813494 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 947/1969] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:24:59 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1214 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:24:59.825125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b3f83bf5-ef13-4800-b6c6-bfaeda7f6a1b req-58096aaf-70df-4b22-8399-2c10542e0aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55057538-1fbb-42f0-a01d-c7558e4c2c2d", "name": "network-vif-plugged", "status": "completed", "tag": "3b6c31dc-0fed-441b-9651-2d2e6ea826de"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:24:59.826207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-07ee079d-aa90-4fc1-89f5-e5ec1c62151a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:24:59.840891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07ee079d-aa90-4fc1-89f5-e5ec1c62151a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.841418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07ee079d-aa90-4fc1-89f5-e5ec1c62151a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.845138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07ee079d-aa90-4fc1-89f5-e5ec1c62151a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.846016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07ee079d-aa90-4fc1-89f5-e5ec1c62151a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.846500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07ee079d-aa90-4fc1-89f5-e5ec1c62151a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.846989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07ee079d-aa90-4fc1-89f5-e5ec1c62151a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.863982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b3f83bf5-ef13-4800-b6c6-bfaeda7f6a1b req-58096aaf-70df-4b22-8399-2c10542e0aea service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:24:59.865755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b3f83bf5-ef13-4800-b6c6-bfaeda7f6a1b req-58096aaf-70df-4b22-8399-2c10542e0aea service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:24:59.868190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b3f83bf5-ef13-4800-b6c6-bfaeda7f6a1b req-58096aaf-70df-4b22-8399-2c10542e0aea service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:24:59.906135 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b3f83bf5-ef13-4800-b6c6-bfaeda7f6a1b req-58096aaf-70df-4b22-8399-2c10542e0aea service nova] Creating event network-vif-plugged:3b6c31dc-0fed-441b-9651-2d2e6ea826de for instance 55057538-1fbb-42f0-a01d-c7558e4c2c2d on n-h1-858384-13 Oct 18 13:24:59.918446 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b3f83bf5-ef13-4800-b6c6-bfaeda7f6a1b req-58096aaf-70df-4b22-8399-2c10542e0aea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105118 Oct 18 13:24:59.921849 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 948/1970] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:24:59.993627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-07ee079d-aa90-4fc1-89f5-e5ec1c62151a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:00.013356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-07ee079d-aa90-4fc1-89f5-e5ec1c62151a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:00.015895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-07ee079d-aa90-4fc1-89f5-e5ec1c62151a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:00.023545 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-07ee079d-aa90-4fc1-89f5-e5ec1c62151a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1478 microversion: 2.91 time: 0.229833 Oct 18 13:25:00.024508 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1023/1971] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:24:59 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1478 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:00.061454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-be11d875-f3c8-4963-8250-6a4e3ba8e39f tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858384-13"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:00.065657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-be11d875-f3c8-4963-8250-6a4e3ba8e39f tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:00.075158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be11d875-f3c8-4963-8250-6a4e3ba8e39f tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.076462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be11d875-f3c8-4963-8250-6a4e3ba8e39f tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.076980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be11d875-f3c8-4963-8250-6a4e3ba8e39f tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.077800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be11d875-f3c8-4963-8250-6a4e3ba8e39f tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.078337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be11d875-f3c8-4963-8250-6a4e3ba8e39f tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.079826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be11d875-f3c8-4963-8250-6a4e3ba8e39f tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.154523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0fa4d27e-0ab9-4b58-bd31-673752466b00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:00.155233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0fa4d27e-0ab9-4b58-bd31-673752466b00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:00.176858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa4d27e-0ab9-4b58-bd31-673752466b00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.177765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa4d27e-0ab9-4b58-bd31-673752466b00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.178443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa4d27e-0ab9-4b58-bd31-673752466b00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.180445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa4d27e-0ab9-4b58-bd31-673752466b00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.182252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa4d27e-0ab9-4b58-bd31-673752466b00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.182715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa4d27e-0ab9-4b58-bd31-673752466b00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.250664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-be11d875-f3c8-4963-8250-6a4e3ba8e39f tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858384-13". {{(pid=120612) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 13:25:00.353941 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-be11d875-f3c8-4963-8250-6a4e3ba8e39f tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7/action" status: 202 len: 0 microversion: 2.91 time: 0.300563 Oct 18 13:25:00.355297 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 949/1972] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:25:00 2022] POST /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:25:00.370743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-407fe507-8bb4-401d-abec-ae85917fbe9e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:00.373092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-407fe507-8bb4-401d-abec-ae85917fbe9e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:00.384766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-407fe507-8bb4-401d-abec-ae85917fbe9e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.385161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-407fe507-8bb4-401d-abec-ae85917fbe9e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.388141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-407fe507-8bb4-401d-abec-ae85917fbe9e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.388328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0fa4d27e-0ab9-4b58-bd31-673752466b00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:00.389097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-407fe507-8bb4-401d-abec-ae85917fbe9e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.389607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-407fe507-8bb4-401d-abec-ae85917fbe9e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.390079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-407fe507-8bb4-401d-abec-ae85917fbe9e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.400695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0fa4d27e-0ab9-4b58-bd31-673752466b00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:00.402876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0fa4d27e-0ab9-4b58-bd31-673752466b00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:00.404871 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0fa4d27e-0ab9-4b58-bd31-673752466b00 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.258296 Oct 18 13:25:00.416959 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1024/1973] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:00 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:25:00.509760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-407fe507-8bb4-401d-abec-ae85917fbe9e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:00.520071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-407fe507-8bb4-401d-abec-ae85917fbe9e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:00.526989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-407fe507-8bb4-401d-abec-ae85917fbe9e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:00.537123 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-407fe507-8bb4-401d-abec-ae85917fbe9e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1486 microversion: 2.91 time: 0.177765 Oct 18 13:25:00.538107 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 950/1974] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:00 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1486 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:00.564245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-df7ab66c-35c0-4ab1-950d-732aa8655ea0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:00.565843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-df7ab66c-35c0-4ab1-950d-732aa8655ea0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:00.568181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:00.574203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df7ab66c-35c0-4ab1-950d-732aa8655ea0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.575047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df7ab66c-35c0-4ab1-950d-732aa8655ea0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.575700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df7ab66c-35c0-4ab1-950d-732aa8655ea0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.576658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df7ab66c-35c0-4ab1-950d-732aa8655ea0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.577385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df7ab66c-35c0-4ab1-950d-732aa8655ea0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.578081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df7ab66c-35c0-4ab1-950d-732aa8655ea0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.582612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:00.714312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e7b3ae26-2d0d-421f-8d15-5ee3277d0684 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:00.715286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e7b3ae26-2d0d-421f-8d15-5ee3277d0684 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:00.733990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7b3ae26-2d0d-421f-8d15-5ee3277d0684 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.734626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7b3ae26-2d0d-421f-8d15-5ee3277d0684 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.735360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7b3ae26-2d0d-421f-8d15-5ee3277d0684 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.736957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7b3ae26-2d0d-421f-8d15-5ee3277d0684 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:00.740868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7b3ae26-2d0d-421f-8d15-5ee3277d0684 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:00.742065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7b3ae26-2d0d-421f-8d15-5ee3277d0684 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:00.889892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-df7ab66c-35c0-4ab1-950d-732aa8655ea0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:00.898920 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-df7ab66c-35c0-4ab1-950d-732aa8655ea0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.364365 Oct 18 13:25:00.899518 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1025/1975] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:00 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:00.917751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8550bc53-93ce-43b9-9c47-a8a71dc1e087 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f0af280>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:00.982642 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8550bc53-93ce-43b9-9c47-a8a71dc1e087 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31" status: 200 len: 1409 microversion: 2.1 time: 0.082059 Oct 18 13:25:00.984010 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1026/1976] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:00 2022] GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31 => generated 1409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:00.990393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d31fe19-82ef-4c36-b40f-36de863fb75d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:00.991846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3d31fe19-82ef-4c36-b40f-36de863fb75d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:00.999744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d31fe19-82ef-4c36-b40f-36de863fb75d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.000556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d31fe19-82ef-4c36-b40f-36de863fb75d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.001227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d31fe19-82ef-4c36-b40f-36de863fb75d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.002158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d31fe19-82ef-4c36-b40f-36de863fb75d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.003107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d31fe19-82ef-4c36-b40f-36de863fb75d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.003945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d31fe19-82ef-4c36-b40f-36de863fb75d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.104254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3d31fe19-82ef-4c36-b40f-36de863fb75d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:01.112677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e7b3ae26-2d0d-421f-8d15-5ee3277d0684 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:01.122511 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3d31fe19-82ef-4c36-b40f-36de863fb75d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1266 microversion: 2.1 time: 0.137183 Oct 18 13:25:01.123737 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1027/1977] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:00 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:01.125393 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e7b3ae26-2d0d-421f-8d15-5ee3277d0684 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1314 microversion: 2.1 time: 0.420441 Oct 18 13:25:01.126912 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 951/1978] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:00 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:01.435910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0a9bc16f-9589-4a8b-adb6-fc52cd082031 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:01.437912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0a9bc16f-9589-4a8b-adb6-fc52cd082031 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:01.456136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a9bc16f-9589-4a8b-adb6-fc52cd082031 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.456651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a9bc16f-9589-4a8b-adb6-fc52cd082031 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.457095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a9bc16f-9589-4a8b-adb6-fc52cd082031 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.457850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a9bc16f-9589-4a8b-adb6-fc52cd082031 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.458308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a9bc16f-9589-4a8b-adb6-fc52cd082031 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.458741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a9bc16f-9589-4a8b-adb6-fc52cd082031 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.575003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bfcd68e6-56a9-4210-9c5e-d9468202d267 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:01.576582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bfcd68e6-56a9-4210-9c5e-d9468202d267 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:01.588950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfcd68e6-56a9-4210-9c5e-d9468202d267 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.594297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfcd68e6-56a9-4210-9c5e-d9468202d267 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.594856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfcd68e6-56a9-4210-9c5e-d9468202d267 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.597434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfcd68e6-56a9-4210-9c5e-d9468202d267 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.598071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfcd68e6-56a9-4210-9c5e-d9468202d267 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.598641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfcd68e6-56a9-4210-9c5e-d9468202d267 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.701301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0a9bc16f-9589-4a8b-adb6-fc52cd082031 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:01.724126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0a9bc16f-9589-4a8b-adb6-fc52cd082031 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:01.731116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0a9bc16f-9589-4a8b-adb6-fc52cd082031 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:01.736116 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0a9bc16f-9589-4a8b-adb6-fc52cd082031 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1486 microversion: 2.25 time: 0.301761 Oct 18 13:25:01.738604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bfcd68e6-56a9-4210-9c5e-d9468202d267 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:01.741841 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1028/1979] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:01 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1486 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:01.752254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bfcd68e6-56a9-4210-9c5e-d9468202d267 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:01.755949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bfcd68e6-56a9-4210-9c5e-d9468202d267 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:01.775979 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bfcd68e6-56a9-4210-9c5e-d9468202d267 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1486 microversion: 2.91 time: 0.206451 Oct 18 13:25:01.779342 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 952/1980] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:01 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1486 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:25:01.925208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-80a4e793-e297-43a6-af96-0ba1bb9e4672 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:01.925991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-80a4e793-e297-43a6-af96-0ba1bb9e4672 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:01.943647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80a4e793-e297-43a6-af96-0ba1bb9e4672 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.944426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80a4e793-e297-43a6-af96-0ba1bb9e4672 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.946672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80a4e793-e297-43a6-af96-0ba1bb9e4672 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:01.947952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80a4e793-e297-43a6-af96-0ba1bb9e4672 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:01.951034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80a4e793-e297-43a6-af96-0ba1bb9e4672 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:01.951757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80a4e793-e297-43a6-af96-0ba1bb9e4672 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.002013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-06aecc5a-b382-4245-9454-3ea91a1ac3a9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617a82700>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:02.088032 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-06aecc5a-b382-4245-9454-3ea91a1ac3a9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31" status: 200 len: 1409 microversion: 2.1 time: 0.091202 Oct 18 13:25:02.089501 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 953/1981] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:01 2022] GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31 => generated 1409 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:02.148527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9fd29377-bb06-45a9-8675-bd1c06c198cf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:02.149672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9fd29377-bb06-45a9-8675-bd1c06c198cf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:02.167336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fd29377-bb06-45a9-8675-bd1c06c198cf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.170670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fd29377-bb06-45a9-8675-bd1c06c198cf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.171379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fd29377-bb06-45a9-8675-bd1c06c198cf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.172891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fd29377-bb06-45a9-8675-bd1c06c198cf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.174875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fd29377-bb06-45a9-8675-bd1c06c198cf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.177852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fd29377-bb06-45a9-8675-bd1c06c198cf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.338657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9fd29377-bb06-45a9-8675-bd1c06c198cf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:02.351357 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9fd29377-bb06-45a9-8675-bd1c06c198cf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1272 microversion: 2.1 time: 0.205735 Oct 18 13:25:02.362475 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 954/1982] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:02 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:02.376122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0641166-e7ab-4a9c-af37-2e0cecf82090 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:02.379342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c0641166-e7ab-4a9c-af37-2e0cecf82090 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:02.391729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0641166-e7ab-4a9c-af37-2e0cecf82090 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.392408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0641166-e7ab-4a9c-af37-2e0cecf82090 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.392994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0641166-e7ab-4a9c-af37-2e0cecf82090 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.393891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0641166-e7ab-4a9c-af37-2e0cecf82090 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.394438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0641166-e7ab-4a9c-af37-2e0cecf82090 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.395013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0641166-e7ab-4a9c-af37-2e0cecf82090 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.726999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c0641166-e7ab-4a9c-af37-2e0cecf82090 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:02.741082 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c0641166-e7ab-4a9c-af37-2e0cecf82090 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1314 microversion: 2.1 time: 0.376159 Oct 18 13:25:02.745227 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 955/1983] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:02 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:02.771428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-63198154-89fa-4d4f-bf27-dfa34dfa11a1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:02.772361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-63198154-89fa-4d4f-bf27-dfa34dfa11a1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:02.788113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63198154-89fa-4d4f-bf27-dfa34dfa11a1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.788879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63198154-89fa-4d4f-bf27-dfa34dfa11a1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.790294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63198154-89fa-4d4f-bf27-dfa34dfa11a1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.791262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63198154-89fa-4d4f-bf27-dfa34dfa11a1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.792371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63198154-89fa-4d4f-bf27-dfa34dfa11a1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.794964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63198154-89fa-4d4f-bf27-dfa34dfa11a1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.807038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-80a4e793-e297-43a6-af96-0ba1bb9e4672 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:02.826015 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-80a4e793-e297-43a6-af96-0ba1bb9e4672 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.906653 Oct 18 13:25:02.836251 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1029/1984] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:01 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:02.847084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2505920e-c366-4681-b759-1aea33052c8c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:02.849433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2505920e-c366-4681-b759-1aea33052c8c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:02.875961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2505920e-c366-4681-b759-1aea33052c8c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.876463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2505920e-c366-4681-b759-1aea33052c8c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.876904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2505920e-c366-4681-b759-1aea33052c8c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:02.877636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2505920e-c366-4681-b759-1aea33052c8c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:02.878097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2505920e-c366-4681-b759-1aea33052c8c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:02.886561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2505920e-c366-4681-b759-1aea33052c8c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.269627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2505920e-c366-4681-b759-1aea33052c8c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:03.316722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2505920e-c366-4681-b759-1aea33052c8c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:03.325551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2505920e-c366-4681-b759-1aea33052c8c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:03.340651 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2505920e-c366-4681-b759-1aea33052c8c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.498823 Oct 18 13:25:03.342176 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1030/1985] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:02 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:03.363565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa552899-6427-4a29-9725-fc5cc50b7c93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f11fca0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:03.390625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-63198154-89fa-4d4f-bf27-dfa34dfa11a1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:03.411150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-63198154-89fa-4d4f-bf27-dfa34dfa11a1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:03.421062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-63198154-89fa-4d4f-bf27-dfa34dfa11a1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:03.424627 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-63198154-89fa-4d4f-bf27-dfa34dfa11a1 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1476 microversion: 2.25 time: 0.659107 Oct 18 13:25:03.430974 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 956/1986] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:02 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1476 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:03.466909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2d1a5662-b6b7-486b-8893-273c14d3722f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:03.467602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2d1a5662-b6b7-486b-8893-273c14d3722f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:03.504365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d1a5662-b6b7-486b-8893-273c14d3722f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.505229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d1a5662-b6b7-486b-8893-273c14d3722f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.505884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d1a5662-b6b7-486b-8893-273c14d3722f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.507640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d1a5662-b6b7-486b-8893-273c14d3722f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.508127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d1a5662-b6b7-486b-8893-273c14d3722f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.508559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d1a5662-b6b7-486b-8893-273c14d3722f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.531635 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fa552899-6427-4a29-9725-fc5cc50b7c93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31" status: 200 len: 1409 microversion: 2.1 time: 0.186078 Oct 18 13:25:03.532267 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1031/1987] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:03 2022] GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31 => generated 1409 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:03.559842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c0e00a15-039d-49dc-ac70-7f2ba78bbc04 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '.version_select at 0x7ff60f083160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:03.568671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0e00a15-039d-49dc-ac70-7f2ba78bbc04 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.569645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0e00a15-039d-49dc-ac70-7f2ba78bbc04 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.570402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0e00a15-039d-49dc-ac70-7f2ba78bbc04 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.609230 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c0e00a15-039d-49dc-ac70-7f2ba78bbc04 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 3050 microversion: 2.25 time: 0.065685 Oct 18 13:25:03.611699 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1032/1988] 10.222.0.40 () {60 vars in 1184 bytes} [Tue Oct 18 13:25:03 2022] GET /compute/v2.1/os-migrations => generated 3050 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:03.627130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93368ae6-c850-473b-8042-57b223ec6690 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:03.629911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-93368ae6-c850-473b-8042-57b223ec6690 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:03.654410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93368ae6-c850-473b-8042-57b223ec6690 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.655188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93368ae6-c850-473b-8042-57b223ec6690 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.655799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93368ae6-c850-473b-8042-57b223ec6690 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:03.656691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93368ae6-c850-473b-8042-57b223ec6690 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:03.658205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93368ae6-c850-473b-8042-57b223ec6690 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:03.660407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93368ae6-c850-473b-8042-57b223ec6690 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:04.302062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-93368ae6-c850-473b-8042-57b223ec6690 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] Lazy-loading 'services' on Instance uuid 67746251-6df7-43e6-9a3d-c45f1fb662ae {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:04.343109 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-93368ae6-c850-473b-8042-57b223ec6690 tempest-LiveAutoBlockMigrationV225Test-3531370 tempest-LiveAutoBlockMigrationV225Test-3531370-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1971 microversion: 2.25 time: 0.719796 Oct 18 13:25:04.349838 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1033/1989] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:03 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1971 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:25:04.365420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-002551b7-1fde-44e1-aa37-60e65eebb99a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:04.366338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-002551b7-1fde-44e1-aa37-60e65eebb99a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:04.374156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-002551b7-1fde-44e1-aa37-60e65eebb99a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:04.378203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-002551b7-1fde-44e1-aa37-60e65eebb99a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:04.380331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-002551b7-1fde-44e1-aa37-60e65eebb99a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:04.383207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-002551b7-1fde-44e1-aa37-60e65eebb99a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:04.384014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-002551b7-1fde-44e1-aa37-60e65eebb99a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:04.384650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-002551b7-1fde-44e1-aa37-60e65eebb99a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:04.566541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2d1a5662-b6b7-486b-8893-273c14d3722f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:04.576756 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2d1a5662-b6b7-486b-8893-273c14d3722f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1314 microversion: 2.1 time: 1.144323 Oct 18 13:25:04.589282 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 957/1990] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:03 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1314 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:04.603547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2a51a400-d0cb-4a4b-a2b6-7ef82e6c7988 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:04.605024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2a51a400-d0cb-4a4b-a2b6-7ef82e6c7988 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:04.620925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a51a400-d0cb-4a4b-a2b6-7ef82e6c7988 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:04.622884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a51a400-d0cb-4a4b-a2b6-7ef82e6c7988 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:04.623714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a51a400-d0cb-4a4b-a2b6-7ef82e6c7988 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:04.625507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a51a400-d0cb-4a4b-a2b6-7ef82e6c7988 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:04.625507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a51a400-d0cb-4a4b-a2b6-7ef82e6c7988 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:04.625821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a51a400-d0cb-4a4b-a2b6-7ef82e6c7988 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.263457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-002551b7-1fde-44e1-aa37-60e65eebb99a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:05.296004 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-002551b7-1fde-44e1-aa37-60e65eebb99a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1500 microversion: 2.1 time: 0.944870 Oct 18 13:25:05.296611 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1034/1991] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:04 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1500 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:05.321973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8d0534d7-4cc1-44ee-b815-a10051401431 req-593bc7c7-ab90-4ae8-a8fa-81520777dfd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd5017a-89a3-4009-902b-156a36615276", "name": "network-vif-plugged", "status": "completed", "tag": "4fd0a37b-a6fc-4fa4-ae29-01b3e5f2b288"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:05.326500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2a51a400-d0cb-4a4b-a2b6-7ef82e6c7988 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:05.339539 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2a51a400-d0cb-4a4b-a2b6-7ef82e6c7988 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.748742 Oct 18 13:25:05.349054 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 958/1992] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:04 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:05.355632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8d0534d7-4cc1-44ee-b815-a10051401431 req-593bc7c7-ab90-4ae8-a8fa-81520777dfd8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.356227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8d0534d7-4cc1-44ee-b815-a10051401431 req-593bc7c7-ab90-4ae8-a8fa-81520777dfd8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.356680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8d0534d7-4cc1-44ee-b815-a10051401431 req-593bc7c7-ab90-4ae8-a8fa-81520777dfd8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.380278 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8d0534d7-4cc1-44ee-b815-a10051401431 req-593bc7c7-ab90-4ae8-a8fa-81520777dfd8 service nova] Creating event network-vif-plugged:4fd0a37b-a6fc-4fa4-ae29-01b3e5f2b288 for instance 1dd5017a-89a3-4009-902b-156a36615276 on n-h1-858384-13 Oct 18 13:25:05.380501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6b3bd2b8-3f72-421c-8c65-d33f68dfa809 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:05.380936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6b3bd2b8-3f72-421c-8c65-d33f68dfa809 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:05.388917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b3bd2b8-3f72-421c-8c65-d33f68dfa809 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.389433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b3bd2b8-3f72-421c-8c65-d33f68dfa809 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.389869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b3bd2b8-3f72-421c-8c65-d33f68dfa809 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.390656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b3bd2b8-3f72-421c-8c65-d33f68dfa809 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.391505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b3bd2b8-3f72-421c-8c65-d33f68dfa809 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.391912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b3bd2b8-3f72-421c-8c65-d33f68dfa809 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.392896 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8d0534d7-4cc1-44ee-b815-a10051401431 req-593bc7c7-ab90-4ae8-a8fa-81520777dfd8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081021 Oct 18 13:25:05.396663 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1035/1993] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:05.409455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-44ee7a7d-965a-4dbe-8b8d-1d365e71f9bd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:05.411844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-44ee7a7d-965a-4dbe-8b8d-1d365e71f9bd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:05.428270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-44ee7a7d-965a-4dbe-8b8d-1d365e71f9bd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.431122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-44ee7a7d-965a-4dbe-8b8d-1d365e71f9bd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.432262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-44ee7a7d-965a-4dbe-8b8d-1d365e71f9bd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.434430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-44ee7a7d-965a-4dbe-8b8d-1d365e71f9bd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.436304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-44ee7a7d-965a-4dbe-8b8d-1d365e71f9bd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.437219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-44ee7a7d-965a-4dbe-8b8d-1d365e71f9bd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:05.509548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-44ee7a7d-965a-4dbe-8b8d-1d365e71f9bd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:25:05.676630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6b3bd2b8-3f72-421c-8c65-d33f68dfa809 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:05.714215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6b3bd2b8-3f72-421c-8c65-d33f68dfa809 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:05.716678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6b3bd2b8-3f72-421c-8c65-d33f68dfa809 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:05.742108 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6b3bd2b8-3f72-421c-8c65-d33f68dfa809 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.388324 Oct 18 13:25:05.744141 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 959/1994] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:05 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:05.756378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e445312-857a-4b15-b310-80c6e73670b3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617b30ee0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:05.919466 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-44ee7a7d-965a-4dbe-8b8d-1d365e71f9bd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "DELETE /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 204 len: 0 microversion: 2.25 time: 0.518667 Oct 18 13:25:05.926029 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1036/1995] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:25:05 2022] DELETE /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:25:05.953157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6c0ead67-69c0-45c5-9d57-cd2244466e9b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:05.980506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c0ead67-69c0-45c5-9d57-cd2244466e9b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:05.982737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c0ead67-69c0-45c5-9d57-cd2244466e9b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:05.983454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c0ead67-69c0-45c5-9d57-cd2244466e9b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:06.048398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6c0ead67-69c0-45c5-9d57-cd2244466e9b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Going to try to stop instance {{(pid=120611) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:25:06.153500 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6c0ead67-69c0-45c5-9d57-cd2244466e9b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d/action" status: 202 len: 0 microversion: 2.1 time: 0.224202 Oct 18 13:25:06.155725 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1037/1996] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:25:05 2022] POST /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:06.173399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-763efab7-485d-40fb-a41b-5bc844500de1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:06.174204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-763efab7-485d-40fb-a41b-5bc844500de1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:06.188632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-763efab7-485d-40fb-a41b-5bc844500de1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:06.189354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-763efab7-485d-40fb-a41b-5bc844500de1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:06.197224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-763efab7-485d-40fb-a41b-5bc844500de1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:06.199477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-763efab7-485d-40fb-a41b-5bc844500de1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:06.201527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-763efab7-485d-40fb-a41b-5bc844500de1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:06.202082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-763efab7-485d-40fb-a41b-5bc844500de1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:06.881694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-763efab7-485d-40fb-a41b-5bc844500de1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:06.895085 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-763efab7-485d-40fb-a41b-5bc844500de1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1314 microversion: 2.1 time: 0.736849 Oct 18 13:25:06.905788 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1038/1997] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:06 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:06.920435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c874faf7-ef06-438a-8d8c-1391b54ccb19 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:06.921560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c874faf7-ef06-438a-8d8c-1391b54ccb19 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:06.932723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c874faf7-ef06-438a-8d8c-1391b54ccb19 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:06.940415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c874faf7-ef06-438a-8d8c-1391b54ccb19 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:06.940996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c874faf7-ef06-438a-8d8c-1391b54ccb19 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:06.941890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c874faf7-ef06-438a-8d8c-1391b54ccb19 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:06.942522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c874faf7-ef06-438a-8d8c-1391b54ccb19 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:06.943022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c874faf7-ef06-438a-8d8c-1391b54ccb19 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:07.298626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c874faf7-ef06-438a-8d8c-1391b54ccb19 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:07.315656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c874faf7-ef06-438a-8d8c-1391b54ccb19 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:07.317130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c874faf7-ef06-438a-8d8c-1391b54ccb19 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:07.318653 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c874faf7-ef06-438a-8d8c-1391b54ccb19 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1482 microversion: 2.25 time: 0.410684 Oct 18 13:25:07.333852 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1039/1998] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:06 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1482 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:07.355971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0277ef07-cdf8-4645-b574-bca0af31501e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:07.360599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0277ef07-cdf8-4645-b574-bca0af31501e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:07.369906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:07.378570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0277ef07-cdf8-4645-b574-bca0af31501e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:07.381499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0277ef07-cdf8-4645-b574-bca0af31501e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:07.383882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0277ef07-cdf8-4645-b574-bca0af31501e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:07.386523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0277ef07-cdf8-4645-b574-bca0af31501e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:07.387300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0277ef07-cdf8-4645-b574-bca0af31501e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:07.388710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0277ef07-cdf8-4645-b574-bca0af31501e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:08.496932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0277ef07-cdf8-4645-b574-bca0af31501e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:08.505911 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0277ef07-cdf8-4645-b574-bca0af31501e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1510 microversion: 2.1 time: 1.170587 Oct 18 13:25:08.526001 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1040/1999] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:07 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1510 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:08.532232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-56aea1c6-9779-4136-a3a5-6bd952857f79 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:08.533137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-56aea1c6-9779-4136-a3a5-6bd952857f79 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:08.541212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56aea1c6-9779-4136-a3a5-6bd952857f79 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:08.542672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56aea1c6-9779-4136-a3a5-6bd952857f79 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:08.543301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56aea1c6-9779-4136-a3a5-6bd952857f79 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:08.544245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56aea1c6-9779-4136-a3a5-6bd952857f79 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:08.544925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56aea1c6-9779-4136-a3a5-6bd952857f79 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:08.545546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56aea1c6-9779-4136-a3a5-6bd952857f79 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.055030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-56aea1c6-9779-4136-a3a5-6bd952857f79 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:09.076432 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-56aea1c6-9779-4136-a3a5-6bd952857f79 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.549047 Oct 18 13:25:09.084935 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1041/2000] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:08 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:09.090898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-36d2c834-407c-446b-a9b1-581c6b1aead8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:09.092317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-36d2c834-407c-446b-a9b1-581c6b1aead8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:09.113728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36d2c834-407c-446b-a9b1-581c6b1aead8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.115339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36d2c834-407c-446b-a9b1-581c6b1aead8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.116101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36d2c834-407c-446b-a9b1-581c6b1aead8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.117442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36d2c834-407c-446b-a9b1-581c6b1aead8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.118421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36d2c834-407c-446b-a9b1-581c6b1aead8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.120910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36d2c834-407c-446b-a9b1-581c6b1aead8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.200842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:09.285592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:09.324228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:09.518850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-36d2c834-407c-446b-a9b1-581c6b1aead8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:09.539241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-36d2c834-407c-446b-a9b1-581c6b1aead8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:09.545282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-36d2c834-407c-446b-a9b1-581c6b1aead8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:09.567434 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-36d2c834-407c-446b-a9b1-581c6b1aead8 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.479634 Oct 18 13:25:09.571487 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1042/2001] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:09 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:09.585483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-77a2f26c-00f4-418a-b856-725e41e701f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:09.586385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-77a2f26c-00f4-418a-b856-725e41e701f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:09.602608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a2f26c-00f4-418a-b856-725e41e701f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.605290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a2f26c-00f4-418a-b856-725e41e701f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.606093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a2f26c-00f4-418a-b856-725e41e701f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.607008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a2f26c-00f4-418a-b856-725e41e701f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.610250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a2f26c-00f4-418a-b856-725e41e701f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.610893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a2f26c-00f4-418a-b856-725e41e701f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:09.788927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=10 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:09.941338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-77a2f26c-00f4-418a-b856-725e41e701f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:09.954300 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-77a2f26c-00f4-418a-b856-725e41e701f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1314 microversion: 2.1 time: 0.381266 Oct 18 13:25:09.969899 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1043/2002] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:09 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:09.977100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-6b12504a-7acf-4d52-8d29-761d0a678966 req-58e45ae8-d2b1-405f-9eb9-7cedb4d6e6bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a4247ab-8099-4faa-9d6b-beabeeb98e0d", "tag": "33bce418-405e-4c1d-b340-799e22644041"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:09.987623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6b12504a-7acf-4d52-8d29-761d0a678966 req-58e45ae8-d2b1-405f-9eb9-7cedb4d6e6bc service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:09.988122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6b12504a-7acf-4d52-8d29-761d0a678966 req-58e45ae8-d2b1-405f-9eb9-7cedb4d6e6bc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:09.988545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6b12504a-7acf-4d52-8d29-761d0a678966 req-58e45ae8-d2b1-405f-9eb9-7cedb4d6e6bc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:10.003115 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-6b12504a-7acf-4d52-8d29-761d0a678966 req-58e45ae8-d2b1-405f-9eb9-7cedb4d6e6bc service nova] Creating event network-changed:33bce418-405e-4c1d-b340-799e22644041 for instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d on n-h2-858384-13 Oct 18 13:25:10.009297 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-6b12504a-7acf-4d52-8d29-761d0a678966 req-58e45ae8-d2b1-405f-9eb9-7cedb4d6e6bc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037804 Oct 18 13:25:10.010312 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1044/2003] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:10.016509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1f095e3-e880-4a2b-a5f1-07673a224353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:10.017236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e1f095e3-e880-4a2b-a5f1-07673a224353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:10.030313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1f095e3-e880-4a2b-a5f1-07673a224353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:10.030822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1f095e3-e880-4a2b-a5f1-07673a224353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:10.033527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1f095e3-e880-4a2b-a5f1-07673a224353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:10.034802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1f095e3-e880-4a2b-a5f1-07673a224353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:10.035371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1f095e3-e880-4a2b-a5f1-07673a224353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:10.035827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1f095e3-e880-4a2b-a5f1-07673a224353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:10.312440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e1f095e3-e880-4a2b-a5f1-07673a224353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:10.328951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e1f095e3-e880-4a2b-a5f1-07673a224353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:10.334267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e1f095e3-e880-4a2b-a5f1-07673a224353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:10.336408 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e1f095e3-e880-4a2b-a5f1-07673a224353 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1440 microversion: 2.25 time: 0.324842 Oct 18 13:25:10.338561 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1045/2004] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:10 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1440 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:10.357895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-55d12479-e21a-44ed-8fdb-dcb688a119ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:10.361413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-55d12479-e21a-44ed-8fdb-dcb688a119ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:10.378383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55d12479-e21a-44ed-8fdb-dcb688a119ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:10.381596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55d12479-e21a-44ed-8fdb-dcb688a119ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:10.384118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55d12479-e21a-44ed-8fdb-dcb688a119ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:10.385071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55d12479-e21a-44ed-8fdb-dcb688a119ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:10.385747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55d12479-e21a-44ed-8fdb-dcb688a119ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:10.388483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55d12479-e21a-44ed-8fdb-dcb688a119ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:10.822272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-55d12479-e21a-44ed-8fdb-dcb688a119ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:10.835867 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-55d12479-e21a-44ed-8fdb-dcb688a119ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1510 microversion: 2.1 time: 0.494328 Oct 18 13:25:10.845329 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1046/2005] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:10 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1510 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:10.865793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f8ed6e70-2d4b-423a-aad1-017617f5fc69 req-7644d6af-8037-4241-8df1-5e69a0114a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0797de-276a-489b-aab7-16391ac1d0d3", "name": "network-vif-unplugged", "status": "completed", "tag": "e9a57904-7800-46a5-9a77-79c987e77696"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:10.908046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f8ed6e70-2d4b-423a-aad1-017617f5fc69 req-7644d6af-8037-4241-8df1-5e69a0114a3e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:10.908578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f8ed6e70-2d4b-423a-aad1-017617f5fc69 req-7644d6af-8037-4241-8df1-5e69a0114a3e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:10.915341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f8ed6e70-2d4b-423a-aad1-017617f5fc69 req-7644d6af-8037-4241-8df1-5e69a0114a3e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:10.984735 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f8ed6e70-2d4b-423a-aad1-017617f5fc69 req-7644d6af-8037-4241-8df1-5e69a0114a3e service nova] Creating event network-vif-unplugged:e9a57904-7800-46a5-9a77-79c987e77696 for instance 3a0797de-276a-489b-aab7-16391ac1d0d3 on n-h2-858384-13 Oct 18 13:25:11.000347 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f8ed6e70-2d4b-423a-aad1-017617f5fc69 req-7644d6af-8037-4241-8df1-5e69a0114a3e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150886 Oct 18 13:25:11.001509 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1047/2006] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:11.015388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-02556aad-b3f4-448f-9836-e12de8ca4751 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:11.016316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-02556aad-b3f4-448f-9836-e12de8ca4751 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:11.035825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02556aad-b3f4-448f-9836-e12de8ca4751 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:11.036321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02556aad-b3f4-448f-9836-e12de8ca4751 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:11.036821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02556aad-b3f4-448f-9836-e12de8ca4751 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:11.037567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02556aad-b3f4-448f-9836-e12de8ca4751 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:11.041600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02556aad-b3f4-448f-9836-e12de8ca4751 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:11.042127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02556aad-b3f4-448f-9836-e12de8ca4751 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:11.868754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-02556aad-b3f4-448f-9836-e12de8ca4751 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:11.936214 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-02556aad-b3f4-448f-9836-e12de8ca4751 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.921371 Oct 18 13:25:11.940508 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1048/2007] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:11 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:11.959126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-21a216e4-746e-4089-bb12-0fb600335f7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:11.963394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-21a216e4-746e-4089-bb12-0fb600335f7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:11.994700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21a216e4-746e-4089-bb12-0fb600335f7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:11.996000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21a216e4-746e-4089-bb12-0fb600335f7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:11.997135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21a216e4-746e-4089-bb12-0fb600335f7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:11.998799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21a216e4-746e-4089-bb12-0fb600335f7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:11.999909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21a216e4-746e-4089-bb12-0fb600335f7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:12.001027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21a216e4-746e-4089-bb12-0fb600335f7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:12.287982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-21a216e4-746e-4089-bb12-0fb600335f7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:12.308521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-21a216e4-746e-4089-bb12-0fb600335f7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:12.314068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-21a216e4-746e-4089-bb12-0fb600335f7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:12.437093 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-21a216e4-746e-4089-bb12-0fb600335f7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.487396 Oct 18 13:25:12.453371 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1049/2008] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:11 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:12.470102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-31c030be-d563-4adf-960f-cef1417ee252 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:12.472290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-31c030be-d563-4adf-960f-cef1417ee252 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:12.482486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31c030be-d563-4adf-960f-cef1417ee252 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:12.483570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31c030be-d563-4adf-960f-cef1417ee252 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:12.484262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31c030be-d563-4adf-960f-cef1417ee252 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:12.485329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31c030be-d563-4adf-960f-cef1417ee252 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:12.486045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31c030be-d563-4adf-960f-cef1417ee252 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:12.486726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31c030be-d563-4adf-960f-cef1417ee252 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:13.832973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-31c030be-d563-4adf-960f-cef1417ee252 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:13.843220 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-31c030be-d563-4adf-960f-cef1417ee252 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1314 microversion: 2.1 time: 1.386471 Oct 18 13:25:13.865356 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1050/2009] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:12 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1314 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:13.890087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d86cff5e-fa4f-4b8a-aed9-1d235e930cfd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:13.892371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d86cff5e-fa4f-4b8a-aed9-1d235e930cfd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:13.918341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d86cff5e-fa4f-4b8a-aed9-1d235e930cfd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:13.919724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d86cff5e-fa4f-4b8a-aed9-1d235e930cfd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:13.926909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d86cff5e-fa4f-4b8a-aed9-1d235e930cfd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:13.931456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d86cff5e-fa4f-4b8a-aed9-1d235e930cfd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:13.933640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d86cff5e-fa4f-4b8a-aed9-1d235e930cfd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:13.935703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d86cff5e-fa4f-4b8a-aed9-1d235e930cfd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:14.747004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d86cff5e-fa4f-4b8a-aed9-1d235e930cfd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:14.798711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d86cff5e-fa4f-4b8a-aed9-1d235e930cfd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:14.804071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d86cff5e-fa4f-4b8a-aed9-1d235e930cfd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:14.805750 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d86cff5e-fa4f-4b8a-aed9-1d235e930cfd tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1266 microversion: 2.25 time: 0.936152 Oct 18 13:25:14.829239 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1051/2010] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:13 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1266 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:14.830565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b7dc8be4-a378-4739-89f6-51a5f9b67d01 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:14.839799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7dc8be4-a378-4739-89f6-51a5f9b67d01 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:14.860700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7dc8be4-a378-4739-89f6-51a5f9b67d01 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:14.861309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7dc8be4-a378-4739-89f6-51a5f9b67d01 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:14.864113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7dc8be4-a378-4739-89f6-51a5f9b67d01 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:14.864903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7dc8be4-a378-4739-89f6-51a5f9b67d01 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:14.865416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7dc8be4-a378-4739-89f6-51a5f9b67d01 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:14.865846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7dc8be4-a378-4739-89f6-51a5f9b67d01 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:15.210690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7dc8be4-a378-4739-89f6-51a5f9b67d01 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:15.222857 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b7dc8be4-a378-4739-89f6-51a5f9b67d01 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1510 microversion: 2.1 time: 0.406298 Oct 18 13:25:15.243943 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1052/2011] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:14 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1510 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:15.250907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-5e1f8e47-3563-4aaa-948a-f8a44c0ada13 req-e7b08495-ea47-4e9e-8a20-96ea48922e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67746251-6df7-43e6-9a3d-c45f1fb662ae", "name": "network-vif-deleted", "tag": "06704eb6-7b35-42a7-a441-0dd307106054"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:15.271245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5e1f8e47-3563-4aaa-948a-f8a44c0ada13 req-e7b08495-ea47-4e9e-8a20-96ea48922e91 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:15.272266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5e1f8e47-3563-4aaa-948a-f8a44c0ada13 req-e7b08495-ea47-4e9e-8a20-96ea48922e91 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:15.273806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5e1f8e47-3563-4aaa-948a-f8a44c0ada13 req-e7b08495-ea47-4e9e-8a20-96ea48922e91 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:15.296983 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-5e1f8e47-3563-4aaa-948a-f8a44c0ada13 req-e7b08495-ea47-4e9e-8a20-96ea48922e91 service nova] Creating event network-vif-deleted:06704eb6-7b35-42a7-a441-0dd307106054 for instance 67746251-6df7-43e6-9a3d-c45f1fb662ae on n-h1-858384-13 Oct 18 13:25:15.305934 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-5e1f8e47-3563-4aaa-948a-f8a44c0ada13 req-e7b08495-ea47-4e9e-8a20-96ea48922e91 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057808 Oct 18 13:25:15.312995 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1053/2012] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:15.321778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-baf99388-771b-4c21-b98b-f32c92cc0bf8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:15.323304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-baf99388-771b-4c21-b98b-f32c92cc0bf8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:15.332126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baf99388-771b-4c21-b98b-f32c92cc0bf8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:15.333100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baf99388-771b-4c21-b98b-f32c92cc0bf8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:15.334086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baf99388-771b-4c21-b98b-f32c92cc0bf8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:15.336829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baf99388-771b-4c21-b98b-f32c92cc0bf8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:15.338082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baf99388-771b-4c21-b98b-f32c92cc0bf8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:15.338785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baf99388-771b-4c21-b98b-f32c92cc0bf8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:15.613034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-baf99388-771b-4c21-b98b-f32c92cc0bf8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:15.633882 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-baf99388-771b-4c21-b98b-f32c92cc0bf8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.318999 Oct 18 13:25:15.638388 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1054/2013] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:15 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:15.688706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:15.692020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7274b1df-131d-4a89-a0be-f25f38367742 req-63553c82-c00b-43f1-9164-7fadb57bd69d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0797de-276a-489b-aab7-16391ac1d0d3", "tag": "e9a57904-7800-46a5-9a77-79c987e77696"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:15.729685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:15.753344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7274b1df-131d-4a89-a0be-f25f38367742 req-63553c82-c00b-43f1-9164-7fadb57bd69d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:15.754727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7274b1df-131d-4a89-a0be-f25f38367742 req-63553c82-c00b-43f1-9164-7fadb57bd69d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:15.758345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7274b1df-131d-4a89-a0be-f25f38367742 req-63553c82-c00b-43f1-9164-7fadb57bd69d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:15.791759 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7274b1df-131d-4a89-a0be-f25f38367742 req-63553c82-c00b-43f1-9164-7fadb57bd69d service nova] Creating event network-changed:e9a57904-7800-46a5-9a77-79c987e77696 for instance 3a0797de-276a-489b-aab7-16391ac1d0d3 on n-h2-858384-13 Oct 18 13:25:15.805226 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7274b1df-131d-4a89-a0be-f25f38367742 req-63553c82-c00b-43f1-9164-7fadb57bd69d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164951 Oct 18 13:25:15.810744 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1055/2014] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:15.819255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bfc3278a-2792-4454-829e-d47d327060eb tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:15.820841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bfc3278a-2792-4454-829e-d47d327060eb tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:15.848248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfc3278a-2792-4454-829e-d47d327060eb tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:15.848991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfc3278a-2792-4454-829e-d47d327060eb tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:15.849110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfc3278a-2792-4454-829e-d47d327060eb tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:15.856003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfc3278a-2792-4454-829e-d47d327060eb tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:15.856003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfc3278a-2792-4454-829e-d47d327060eb tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:15.856003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bfc3278a-2792-4454-829e-d47d327060eb tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:15.976843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bfc3278a-2792-4454-829e-d47d327060eb tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:15.992231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bfc3278a-2792-4454-829e-d47d327060eb tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:15.994163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bfc3278a-2792-4454-829e-d47d327060eb tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:16.011283 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bfc3278a-2792-4454-829e-d47d327060eb tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.196344 Oct 18 13:25:16.012125 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1056/2015] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:15 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:16.325613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-94803f59-2c10-4287-b821-721e32de15cd tempest-AbsoluteLimitsTestJSON-1344847989 tempest-AbsoluteLimitsTestJSON-1344847989-project] Calling method '.version_select at 0x7ff60f010820>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:16.377369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94803f59-2c10-4287-b821-721e32de15cd tempest-AbsoluteLimitsTestJSON-1344847989 tempest-AbsoluteLimitsTestJSON-1344847989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:16.381988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94803f59-2c10-4287-b821-721e32de15cd tempest-AbsoluteLimitsTestJSON-1344847989 tempest-AbsoluteLimitsTestJSON-1344847989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:16.386283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94803f59-2c10-4287-b821-721e32de15cd tempest-AbsoluteLimitsTestJSON-1344847989 tempest-AbsoluteLimitsTestJSON-1344847989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:16.392244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94803f59-2c10-4287-b821-721e32de15cd tempest-AbsoluteLimitsTestJSON-1344847989 tempest-AbsoluteLimitsTestJSON-1344847989-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:16.393434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94803f59-2c10-4287-b821-721e32de15cd tempest-AbsoluteLimitsTestJSON-1344847989 tempest-AbsoluteLimitsTestJSON-1344847989-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:16.394152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94803f59-2c10-4287-b821-721e32de15cd tempest-AbsoluteLimitsTestJSON-1344847989 tempest-AbsoluteLimitsTestJSON-1344847989-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:16.487076 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-94803f59-2c10-4287-b821-721e32de15cd tempest-AbsoluteLimitsTestJSON-1344847989 tempest-AbsoluteLimitsTestJSON-1344847989-project] 10.222.0.40 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.455876 Oct 18 13:25:16.494322 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1057/2016] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Oct 18 13:25:16 2022] GET /compute/v2.1/limits => generated 511 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:16.508741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-0aa2152f-dac9-4b31-8edc-b7b54b3749f2 req-9579b167-3d64-4d5f-8f85-2ebdcbbe46cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4247ab-8099-4faa-9d6b-beabeeb98e0d", "name": "network-vif-plugged", "status": "completed", "tag": "33bce418-405e-4c1d-b340-799e22644041"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:16.536584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0aa2152f-dac9-4b31-8edc-b7b54b3749f2 req-9579b167-3d64-4d5f-8f85-2ebdcbbe46cc service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:16.540363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0aa2152f-dac9-4b31-8edc-b7b54b3749f2 req-9579b167-3d64-4d5f-8f85-2ebdcbbe46cc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:16.543822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0aa2152f-dac9-4b31-8edc-b7b54b3749f2 req-9579b167-3d64-4d5f-8f85-2ebdcbbe46cc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:16.606650 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-0aa2152f-dac9-4b31-8edc-b7b54b3749f2 req-9579b167-3d64-4d5f-8f85-2ebdcbbe46cc service nova] Creating event network-vif-plugged:33bce418-405e-4c1d-b340-799e22644041 for instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d on n-h2-858384-13 Oct 18 13:25:16.634066 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-0aa2152f-dac9-4b31-8edc-b7b54b3749f2 req-9579b167-3d64-4d5f-8f85-2ebdcbbe46cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137480 Oct 18 13:25:16.640989 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1058/2017] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:16.664557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e5f0c3b5-a0b4-4c33-bb9a-737a604ed8a4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:16.671821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e5f0c3b5-a0b4-4c33-bb9a-737a604ed8a4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:16.712634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5f0c3b5-a0b4-4c33-bb9a-737a604ed8a4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:16.723659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5f0c3b5-a0b4-4c33-bb9a-737a604ed8a4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:16.731190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5f0c3b5-a0b4-4c33-bb9a-737a604ed8a4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:16.732263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5f0c3b5-a0b4-4c33-bb9a-737a604ed8a4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:16.732846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5f0c3b5-a0b4-4c33-bb9a-737a604ed8a4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:16.733321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5f0c3b5-a0b4-4c33-bb9a-737a604ed8a4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:17.391090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e5f0c3b5-a0b4-4c33-bb9a-737a604ed8a4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:17.405827 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e5f0c3b5-a0b4-4c33-bb9a-737a604ed8a4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1314 microversion: 2.1 time: 0.759810 Oct 18 13:25:17.419857 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1059/2018] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:16 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:17.419857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32c62a74-8428-40d8-ad48-a2fe5fffbb91 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:17.422328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-32c62a74-8428-40d8-ad48-a2fe5fffbb91 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:17.439569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32c62a74-8428-40d8-ad48-a2fe5fffbb91 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:17.442728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32c62a74-8428-40d8-ad48-a2fe5fffbb91 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:17.443828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32c62a74-8428-40d8-ad48-a2fe5fffbb91 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:17.447117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32c62a74-8428-40d8-ad48-a2fe5fffbb91 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:17.447937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32c62a74-8428-40d8-ad48-a2fe5fffbb91 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:17.449012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32c62a74-8428-40d8-ad48-a2fe5fffbb91 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:17.746663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-32c62a74-8428-40d8-ad48-a2fe5fffbb91 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:17.760678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-32c62a74-8428-40d8-ad48-a2fe5fffbb91 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:17.770905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-32c62a74-8428-40d8-ad48-a2fe5fffbb91 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:17.774200 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-32c62a74-8428-40d8-ad48-a2fe5fffbb91 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1266 microversion: 2.25 time: 0.363971 Oct 18 13:25:17.792975 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1060/2019] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:17 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1266 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:17.802483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-01322f4c-1660-4ac4-80ab-87586d770da1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:17.803576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-01322f4c-1660-4ac4-80ab-87586d770da1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:17.812185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01322f4c-1660-4ac4-80ab-87586d770da1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:17.813092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01322f4c-1660-4ac4-80ab-87586d770da1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:17.813916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01322f4c-1660-4ac4-80ab-87586d770da1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:17.817728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01322f4c-1660-4ac4-80ab-87586d770da1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:17.819095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01322f4c-1660-4ac4-80ab-87586d770da1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:17.819897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01322f4c-1660-4ac4-80ab-87586d770da1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:18.269036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-01322f4c-1660-4ac4-80ab-87586d770da1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:18.278833 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-01322f4c-1660-4ac4-80ab-87586d770da1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1510 microversion: 2.1 time: 0.483997 Oct 18 13:25:18.306072 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1061/2020] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:17 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1510 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:18.311027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f42f082a-3e3f-40ec-8978-bda1a226835e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.311641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f42f082a-3e3f-40ec-8978-bda1a226835e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:18.327747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f42f082a-3e3f-40ec-8978-bda1a226835e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:18.328249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f42f082a-3e3f-40ec-8978-bda1a226835e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:18.328724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f42f082a-3e3f-40ec-8978-bda1a226835e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:18.329453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f42f082a-3e3f-40ec-8978-bda1a226835e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:18.329917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f42f082a-3e3f-40ec-8978-bda1a226835e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:18.330364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f42f082a-3e3f-40ec-8978-bda1a226835e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:18.938348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f42f082a-3e3f-40ec-8978-bda1a226835e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:18.946648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:18.956081 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f42f082a-3e3f-40ec-8978-bda1a226835e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.648436 Oct 18 13:25:18.958695 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1062/2021] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:18 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:18.967933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4619deac-99e9-441c-b1f6-69eda2ee7f3a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:18.968622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4619deac-99e9-441c-b1f6-69eda2ee7f3a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:18.996643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4619deac-99e9-441c-b1f6-69eda2ee7f3a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:19.000396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4619deac-99e9-441c-b1f6-69eda2ee7f3a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:19.000893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4619deac-99e9-441c-b1f6-69eda2ee7f3a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:19.001699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4619deac-99e9-441c-b1f6-69eda2ee7f3a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:19.002578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4619deac-99e9-441c-b1f6-69eda2ee7f3a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:19.003038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4619deac-99e9-441c-b1f6-69eda2ee7f3a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:19.289694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4619deac-99e9-441c-b1f6-69eda2ee7f3a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:19.307182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4619deac-99e9-441c-b1f6-69eda2ee7f3a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:19.312697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4619deac-99e9-441c-b1f6-69eda2ee7f3a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:19.328284 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4619deac-99e9-441c-b1f6-69eda2ee7f3a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.364559 Oct 18 13:25:19.328913 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1063/2022] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:18 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:19.340541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3060ff04-e848-48b4-bbf6-ccf5c4bf4035 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:19.341158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3060ff04-e848-48b4-bbf6-ccf5c4bf4035 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:19.359607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3060ff04-e848-48b4-bbf6-ccf5c4bf4035 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:19.360099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3060ff04-e848-48b4-bbf6-ccf5c4bf4035 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:19.360535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3060ff04-e848-48b4-bbf6-ccf5c4bf4035 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:19.368343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3060ff04-e848-48b4-bbf6-ccf5c4bf4035 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:19.369094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3060ff04-e848-48b4-bbf6-ccf5c4bf4035 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:19.369687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3060ff04-e848-48b4-bbf6-ccf5c4bf4035 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:19.843863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3060ff04-e848-48b4-bbf6-ccf5c4bf4035 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:19.856148 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3060ff04-e848-48b4-bbf6-ccf5c4bf4035 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1501 microversion: 2.1 time: 0.524660 Oct 18 13:25:19.856981 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1064/2023] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:19 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1501 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:19.862097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-06df54ab-2c9d-4ffc-a506-3a4cecb7e309 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:19.862709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-06df54ab-2c9d-4ffc-a506-3a4cecb7e309 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:19.871018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06df54ab-2c9d-4ffc-a506-3a4cecb7e309 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:19.871788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06df54ab-2c9d-4ffc-a506-3a4cecb7e309 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:19.872420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06df54ab-2c9d-4ffc-a506-3a4cecb7e309 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:19.873350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06df54ab-2c9d-4ffc-a506-3a4cecb7e309 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:19.874147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06df54ab-2c9d-4ffc-a506-3a4cecb7e309 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:19.874937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06df54ab-2c9d-4ffc-a506-3a4cecb7e309 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:20.066088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-06df54ab-2c9d-4ffc-a506-3a4cecb7e309 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:20.090191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-06df54ab-2c9d-4ffc-a506-3a4cecb7e309 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:20.101812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-06df54ab-2c9d-4ffc-a506-3a4cecb7e309 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:20.103172 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-06df54ab-2c9d-4ffc-a506-3a4cecb7e309 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1266 microversion: 2.25 time: 0.244958 Oct 18 13:25:20.104133 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1065/2024] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:19 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:20.637462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0745ffa4-9cfb-41c1-95bc-a92136b4f1a1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:20.638194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0745ffa4-9cfb-41c1-95bc-a92136b4f1a1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:20.646635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0745ffa4-9cfb-41c1-95bc-a92136b4f1a1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:20.648846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0745ffa4-9cfb-41c1-95bc-a92136b4f1a1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:20.649616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0745ffa4-9cfb-41c1-95bc-a92136b4f1a1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:20.651011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0745ffa4-9cfb-41c1-95bc-a92136b4f1a1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:20.651757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0745ffa4-9cfb-41c1-95bc-a92136b4f1a1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:20.652456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0745ffa4-9cfb-41c1-95bc-a92136b4f1a1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:21.002421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0745ffa4-9cfb-41c1-95bc-a92136b4f1a1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:21.020644 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0745ffa4-9cfb-41c1-95bc-a92136b4f1a1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1510 microversion: 2.1 time: 0.902904 Oct 18 13:25:21.025763 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1066/2025] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:20 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1510 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:21.044421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9fbbe660-36c6-4cf2-ac68-b22a133d583a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:21.046729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9fbbe660-36c6-4cf2-ac68-b22a133d583a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:21.089078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fbbe660-36c6-4cf2-ac68-b22a133d583a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:21.092815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fbbe660-36c6-4cf2-ac68-b22a133d583a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:21.095011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fbbe660-36c6-4cf2-ac68-b22a133d583a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:21.107556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fbbe660-36c6-4cf2-ac68-b22a133d583a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:21.110224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fbbe660-36c6-4cf2-ac68-b22a133d583a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:21.111019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fbbe660-36c6-4cf2-ac68-b22a133d583a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:21.240560 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9fbbe660-36c6-4cf2-ac68-b22a133d583a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "POST /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d/action" status: 202 len: 0 microversion: 2.1 time: 0.208890 Oct 18 13:25:21.245354 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1067/2026] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:25:21 2022] POST /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:21.251789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a24c7749-35df-46eb-baa9-274a754008f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:21.253672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a24c7749-35df-46eb-baa9-274a754008f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:21.261928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:21.263931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a24c7749-35df-46eb-baa9-274a754008f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:21.264924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a24c7749-35df-46eb-baa9-274a754008f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:21.265399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a24c7749-35df-46eb-baa9-274a754008f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:21.266119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a24c7749-35df-46eb-baa9-274a754008f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:21.266626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a24c7749-35df-46eb-baa9-274a754008f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:21.267042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a24c7749-35df-46eb-baa9-274a754008f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:21.749404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a24c7749-35df-46eb-baa9-274a754008f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:21.759561 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a24c7749-35df-46eb-baa9-274a754008f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.514620 Oct 18 13:25:21.769328 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1068/2027] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:21 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:21.792875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6705362d-53ef-43d1-a704-572a7a533a6c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:21.793923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6705362d-53ef-43d1-a704-572a7a533a6c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:21.808877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6705362d-53ef-43d1-a704-572a7a533a6c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:21.817330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6705362d-53ef-43d1-a704-572a7a533a6c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:21.818078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6705362d-53ef-43d1-a704-572a7a533a6c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:21.820426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6705362d-53ef-43d1-a704-572a7a533a6c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:21.822676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6705362d-53ef-43d1-a704-572a7a533a6c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:21.824598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6705362d-53ef-43d1-a704-572a7a533a6c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.212230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6705362d-53ef-43d1-a704-572a7a533a6c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:22.226693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6705362d-53ef-43d1-a704-572a7a533a6c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:22.234410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6705362d-53ef-43d1-a704-572a7a533a6c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:22.247118 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6705362d-53ef-43d1-a704-572a7a533a6c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.476334 Oct 18 13:25:22.247772 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1069/2028] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:21 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:22.281339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:22.281339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:22.282211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:22.283091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:22.283763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.284712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:22.285424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:22.286015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.350372 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e445312-857a-4b15-b310-80c6e73670b3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31" status: 200 len: 1418 microversion: 2.1 time: 16.602216 Oct 18 13:25:22.353164 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 960/2029] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:05 2022] GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31 => generated 1418 bytes in 16606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:22.364779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:22.369723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-53b12d6b-12ab-4619-88b5-5cd1702084c7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:22.369885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:22.370280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.370743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lazy-loading 'fault' on Instance uuid 67746251-6df7-43e6-9a3d-c45f1fb662ae {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:22.371081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-53b12d6b-12ab-4619-88b5-5cd1702084c7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:22.378923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53b12d6b-12ab-4619-88b5-5cd1702084c7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:22.379680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53b12d6b-12ab-4619-88b5-5cd1702084c7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:22.380303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53b12d6b-12ab-4619-88b5-5cd1702084c7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.381201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53b12d6b-12ab-4619-88b5-5cd1702084c7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:22.385433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53b12d6b-12ab-4619-88b5-5cd1702084c7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:22.385433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53b12d6b-12ab-4619-88b5-5cd1702084c7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.514986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:22.537802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:22.540707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:22.542152 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5d78d747-938b-4639-a7c2-546cfd57390b tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 200 len: 1271 microversion: 2.25 time: 0.275545 Oct 18 13:25:22.543240 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1070/2030] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:22 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:22.548532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-49ada978-1a97-43b4-9081-067dc9aa42c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:22.549608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-49ada978-1a97-43b4-9081-067dc9aa42c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:22.563443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-49ada978-1a97-43b4-9081-067dc9aa42c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:22.564200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-49ada978-1a97-43b4-9081-067dc9aa42c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:22.564945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-49ada978-1a97-43b4-9081-067dc9aa42c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.565838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-49ada978-1a97-43b4-9081-067dc9aa42c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:22.566457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-49ada978-1a97-43b4-9081-067dc9aa42c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:22.568705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-49ada978-1a97-43b4-9081-067dc9aa42c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.682446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-53b12d6b-12ab-4619-88b5-5cd1702084c7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:22.696329 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-53b12d6b-12ab-4619-88b5-5cd1702084c7 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1486 microversion: 2.1 time: 0.341219 Oct 18 13:25:22.699411 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 961/2031] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:22 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1486 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:22.706269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a9a33a7d-928c-43ae-ac27-07ab62c9d439 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f05f280>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:22.807544 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a9a33a7d-928c-43ae-ac27-07ab62c9d439 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31" status: 200 len: 1418 microversion: 2.1 time: 0.105356 Oct 18 13:25:22.808152 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 962/2032] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:25:22 2022] GET /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31 => generated 1418 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:22.822632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-508d547c-d055-444e-81f9-7cbc9d8ed7ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:22.834618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-508d547c-d055-444e-81f9-7cbc9d8ed7ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:22.857303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-508d547c-d055-444e-81f9-7cbc9d8ed7ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:22.860901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-508d547c-d055-444e-81f9-7cbc9d8ed7ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:22.863279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-508d547c-d055-444e-81f9-7cbc9d8ed7ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.864054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-49ada978-1a97-43b4-9081-067dc9aa42c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:22.864227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-508d547c-d055-444e-81f9-7cbc9d8ed7ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:22.867589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-508d547c-d055-444e-81f9-7cbc9d8ed7ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:22.870813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-508d547c-d055-444e-81f9-7cbc9d8ed7ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.880395 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-49ada978-1a97-43b4-9081-067dc9aa42c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1510 microversion: 2.1 time: 0.334653 Oct 18 13:25:22.893761 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1071/2033] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:22 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:22.908157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ade9ca12-f542-4079-bd8f-9c5c5c4c330f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:22.914988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ade9ca12-f542-4079-bd8f-9c5c5c4c330f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:22.936823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ade9ca12-f542-4079-bd8f-9c5c5c4c330f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:22.937773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ade9ca12-f542-4079-bd8f-9c5c5c4c330f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:22.938474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ade9ca12-f542-4079-bd8f-9c5c5c4c330f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.939431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ade9ca12-f542-4079-bd8f-9c5c5c4c330f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:22.940131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ade9ca12-f542-4079-bd8f-9c5c5c4c330f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:22.940820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ade9ca12-f542-4079-bd8f-9c5c5c4c330f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:22.962643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-508d547c-d055-444e-81f9-7cbc9d8ed7ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:25:23.301218 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-508d547c-d055-444e-81f9-7cbc9d8ed7ab tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 204 len: 0 microversion: 2.1 time: 0.490296 Oct 18 13:25:23.304418 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 963/2034] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:25:22 2022] DELETE /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:25:23.316381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-724144538", "imageRef": "6ff5544f-6d90-418e-ae5a-45db8a469e31", "flavorRef": "452", "networks": [{"uuid": "0b58d9a8-4835-4530-9695-a2f702e82ee6"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:23.324341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ade9ca12-f542-4079-bd8f-9c5c5c4c330f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:23.333046 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ade9ca12-f542-4079-bd8f-9c5c5c4c330f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1503 microversion: 2.1 time: 0.430607 Oct 18 13:25:23.341739 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1072/2035] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:22 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1503 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:23.352497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5795d585-d5d0-4c65-9fe1-67dad470c08b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:23.373540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5795d585-d5d0-4c65-9fe1-67dad470c08b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:23.384688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5795d585-d5d0-4c65-9fe1-67dad470c08b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:23.385618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5795d585-d5d0-4c65-9fe1-67dad470c08b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:23.386477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5795d585-d5d0-4c65-9fe1-67dad470c08b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:23.387457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5795d585-d5d0-4c65-9fe1-67dad470c08b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:23.393865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5795d585-d5d0-4c65-9fe1-67dad470c08b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:23.394652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5795d585-d5d0-4c65-9fe1-67dad470c08b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:23.465521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] validate_networks() for [('0b58d9a8-4835-4530-9695-a2f702e82ee6', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:25:23.526330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5795d585-d5d0-4c65-9fe1-67dad470c08b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:23.545621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5795d585-d5d0-4c65-9fe1-67dad470c08b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:23.554445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5795d585-d5d0-4c65-9fe1-67dad470c08b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:23.573688 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5795d585-d5d0-4c65-9fe1-67dad470c08b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.230388 Oct 18 13:25:23.575200 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1073/2036] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:23 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:23.580692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cf5d4982-bdcd-4b84-b78b-1e9a59177c4b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:23.589048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cf5d4982-bdcd-4b84-b78b-1e9a59177c4b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:23.609582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf5d4982-bdcd-4b84-b78b-1e9a59177c4b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:23.610555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf5d4982-bdcd-4b84-b78b-1e9a59177c4b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:23.611510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf5d4982-bdcd-4b84-b78b-1e9a59177c4b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:23.612586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf5d4982-bdcd-4b84-b78b-1e9a59177c4b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:23.613298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf5d4982-bdcd-4b84-b78b-1e9a59177c4b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:23.613953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf5d4982-bdcd-4b84-b78b-1e9a59177c4b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:24.075929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cf5d4982-bdcd-4b84-b78b-1e9a59177c4b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:24.086062 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cf5d4982-bdcd-4b84-b78b-1e9a59177c4b tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1492 microversion: 2.1 time: 0.508961 Oct 18 13:25:24.089889 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1074/2037] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:23 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1492 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:24.103311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fefb0e3b-33ab-490b-8130-842b188f2910 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:24.110050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fefb0e3b-33ab-490b-8130-842b188f2910 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 67746251-6df7-43e6-9a3d-c45f1fb662ae] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:24.136609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fefb0e3b-33ab-490b-8130-842b188f2910 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:24.137243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fefb0e3b-33ab-490b-8130-842b188f2910 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:24.139134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fefb0e3b-33ab-490b-8130-842b188f2910 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:24.139926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fefb0e3b-33ab-490b-8130-842b188f2910 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:24.140387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fefb0e3b-33ab-490b-8130-842b188f2910 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:24.140813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fefb0e3b-33ab-490b-8130-842b188f2910 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:24.191714 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-fefb0e3b-33ab-490b-8130-842b188f2910 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] HTTP exception thrown: Instance 67746251-6df7-43e6-9a3d-c45f1fb662ae could not be found. Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fefb0e3b-33ab-490b-8130-842b188f2910 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Request method failure captured: Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae HTTP/1.1 Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdQGWzxjWOYB2BmOtqiK3h5FWRKKIwXTtFOynE-KVeWbt_rW9ApRvfUq8GC6f4bORMSPG5RCPO8-gi9OtnkbAhZHz2FpsMT026SRBgbeDCTe250zwQABmdhkPLlm1HvpUCxtrr1Uih4XltSzUjBIDSeD2fih8nUgo2_OmddusN9UMI Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: e559a35e21d343adab5f772a17b745f9 Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-853601182 Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:25:24.197285 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:25:24.199102 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e559a35e21d343adab5f772a17b745f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e559a35e21d343adab5f772a17b745f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e559a35e21d343adab5f772a17b745f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e559a35e21d343adab5f772a17b745f9"}]}] Oct 18 13:25:24.199102 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-853601182 Oct 18 13:25:24.199102 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: e559a35e21d343adab5f772a17b745f9 Oct 18 13:25:24.199102 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-853601182 Oct 18 13:25:24.199102 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-LiveAutoBlockMigrationV225Test-853601182-project Oct 18 13:25:24.199102 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:25:24.199102 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:25:24.199102 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1bfaa3d005f94cf2a5bdf8e63d20ba3f Oct 18 13:25:24.199102 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-853601182-project Oct 18 13:25:24.199102 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:25:24.199102 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 67746251-6df7-43e6-9a3d-c45f1fb662ae could not be found. Oct 18 13:25:24.199102 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '67746251-6df7-43e6-9a3d-c45f1fb662ae'} Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67746251-6df7-43e6-9a3d-c45f1fb662ae could not be found. Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:24.200174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67746251-6df7-43e6-9a3d-c45f1fb662ae could not be found. Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67746251-6df7-43e6-9a3d-c45f1fb662ae could not be found. Oct 18 13:25:24.201765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:24.203129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fefb0e3b-33ab-490b-8130-842b188f2910 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Returning 404 to user: Instance 67746251-6df7-43e6-9a3d-c45f1fb662ae could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:24.203129 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fefb0e3b-33ab-490b-8130-842b188f2910 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae" status: 404 len: 111 microversion: 2.25 time: 0.108963 Oct 18 13:25:24.207083 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1075/2038] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:24 2022] GET /compute/v2.1/servers/67746251-6df7-43e6-9a3d-c45f1fb662ae => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:25:24.219615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4a4d63e9-0fab-46e5-bafb-92e3a62db750 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:24.223572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4a4d63e9-0fab-46e5-bafb-92e3a62db750 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:24.239223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a4d63e9-0fab-46e5-bafb-92e3a62db750 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:24.239726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a4d63e9-0fab-46e5-bafb-92e3a62db750 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:24.240171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a4d63e9-0fab-46e5-bafb-92e3a62db750 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:24.243653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a4d63e9-0fab-46e5-bafb-92e3a62db750 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:24.244232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a4d63e9-0fab-46e5-bafb-92e3a62db750 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:24.247945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a4d63e9-0fab-46e5-bafb-92e3a62db750 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:24.596904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4a4d63e9-0fab-46e5-bafb-92e3a62db750 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:24.610495 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4a4d63e9-0fab-46e5-bafb-92e3a62db750 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1510 microversion: 2.1 time: 0.400770 Oct 18 13:25:24.611126 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1076/2039] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:24 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1510 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:24.623417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e2fcaf8a-19a6-482a-84d8-8cbe3dd54101 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:24.624043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e2fcaf8a-19a6-482a-84d8-8cbe3dd54101 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:24.652807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e2fcaf8a-19a6-482a-84d8-8cbe3dd54101 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:24.653357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e2fcaf8a-19a6-482a-84d8-8cbe3dd54101 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:24.653803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e2fcaf8a-19a6-482a-84d8-8cbe3dd54101 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:24.654524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e2fcaf8a-19a6-482a-84d8-8cbe3dd54101 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:24.654977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e2fcaf8a-19a6-482a-84d8-8cbe3dd54101 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:24.655399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e2fcaf8a-19a6-482a-84d8-8cbe3dd54101 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:25.049826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:25:25.050307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:25:25.050765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:25:25.051179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:25:25.051618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:25:25.073703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:25.074192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:25.074631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:25.076399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:25.076870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:25.077333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:25.119622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e2fcaf8a-19a6-482a-84d8-8cbe3dd54101 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:25.133459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Getting quotas for project 472fc8535c504953a8f14a24f9d22260. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:25:25.145984 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e2fcaf8a-19a6-482a-84d8-8cbe3dd54101 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1478 microversion: 2.1 time: 0.527129 Oct 18 13:25:25.149653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Getting quotas for user f896caa4caa0472db9198f7795401df2 and project 472fc8535c504953a8f14a24f9d22260. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:25:25.166598 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1077/2040] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:24 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1478 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:25.181918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:25:25.182462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fcde857a-7f5a-4c36-8033-4871f2caefea tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:25.183287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fcde857a-7f5a-4c36-8033-4871f2caefea tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:25.187176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ff5544f-6d90-418e-ae5a-45db8a469e31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:25:25.208119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fcde857a-7f5a-4c36-8033-4871f2caefea tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:25.208613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fcde857a-7f5a-4c36-8033-4871f2caefea tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:25.209047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fcde857a-7f5a-4c36-8033-4871f2caefea tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:25.214458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fcde857a-7f5a-4c36-8033-4871f2caefea tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:25.219228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fcde857a-7f5a-4c36-8033-4871f2caefea tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:25.220052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fcde857a-7f5a-4c36-8033-4871f2caefea tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:25.294948 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-54109eb0-ddf0-4a83-89e4-0f39960b2eb9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.985691 Oct 18 13:25:25.303168 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 964/2041] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:25:25.320226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1c351b8c-3907-4183-9872-89662c893054 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:25.320859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1c351b8c-3907-4183-9872-89662c893054 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:25.344984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c351b8c-3907-4183-9872-89662c893054 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:25.345532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c351b8c-3907-4183-9872-89662c893054 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:25.345975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c351b8c-3907-4183-9872-89662c893054 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:25.346701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c351b8c-3907-4183-9872-89662c893054 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:25.347153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c351b8c-3907-4183-9872-89662c893054 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:25.347577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c351b8c-3907-4183-9872-89662c893054 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:25.470672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fcde857a-7f5a-4c36-8033-4871f2caefea tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:25.473396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:25.489602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fcde857a-7f5a-4c36-8033-4871f2caefea tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:25.499285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fcde857a-7f5a-4c36-8033-4871f2caefea tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:25.515284 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fcde857a-7f5a-4c36-8033-4871f2caefea tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.347515 Oct 18 13:25:25.515893 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1078/2042] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:25 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:25.584048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8f92ba9a-a8b9-47a4-82b7-8f9c0fe38657 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '.version_select at 0x7ff60f01d820>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:25.614421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f92ba9a-a8b9-47a4-82b7-8f9c0fe38657 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:25.615037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f92ba9a-a8b9-47a4-82b7-8f9c0fe38657 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:25.617880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f92ba9a-a8b9-47a4-82b7-8f9c0fe38657 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:25.650843 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8f92ba9a-a8b9-47a4-82b7-8f9c0fe38657 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1955 microversion: 2.1 time: 0.117800 Oct 18 13:25:25.651549 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1079/2043] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 18 13:25:25 2022] GET /compute/v2.1/os-migrations => generated 1955 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:25.688961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6bc93725-92b8-45fb-93e8-bff0b22f5e6c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:25.689608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6bc93725-92b8-45fb-93e8-bff0b22f5e6c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:25.768891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6bc93725-92b8-45fb-93e8-bff0b22f5e6c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:25.778052 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6bc93725-92b8-45fb-93e8-bff0b22f5e6c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1207 microversion: 2.1 time: 0.125439 Oct 18 13:25:25.782484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1c351b8c-3907-4183-9872-89662c893054 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:25.796303 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1080/2044] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:25 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1207 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:25.796816 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1c351b8c-3907-4183-9872-89662c893054 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1492 microversion: 2.1 time: 0.491061 Oct 18 13:25:25.800810 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 965/2045] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:25 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1492 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:25.809915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0b048e2e-e534-4e0d-b65e-0bdb6fce03d6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:25.813384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0b048e2e-e534-4e0d-b65e-0bdb6fce03d6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:25.830661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b048e2e-e534-4e0d-b65e-0bdb6fce03d6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:25.831328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8c454310-bab6-45c8-8862-4ee27100a3a5 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:25.831997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8c454310-bab6-45c8-8862-4ee27100a3a5 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:25.834674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b048e2e-e534-4e0d-b65e-0bdb6fce03d6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:25.835369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b048e2e-e534-4e0d-b65e-0bdb6fce03d6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:25.836641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b048e2e-e534-4e0d-b65e-0bdb6fce03d6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:25.838460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b048e2e-e534-4e0d-b65e-0bdb6fce03d6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:25.842993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b048e2e-e534-4e0d-b65e-0bdb6fce03d6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:25.864576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c454310-bab6-45c8-8862-4ee27100a3a5 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:25.867560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c454310-bab6-45c8-8862-4ee27100a3a5 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:25.868192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c454310-bab6-45c8-8862-4ee27100a3a5 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:25.869115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c454310-bab6-45c8-8862-4ee27100a3a5 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:25.870776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c454310-bab6-45c8-8862-4ee27100a3a5 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:25.871477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c454310-bab6-45c8-8862-4ee27100a3a5 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:26.181950 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8c454310-bab6-45c8-8862-4ee27100a3a5 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1631 microversion: 2.1 time: 0.368128 Oct 18 13:25:26.193484 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 966/2046] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:25 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1631 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:26.237846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-39f64b45-7ae9-4a83-ae6a-b012f0ff2949 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Action: 'create', calling method: .version_select at 0x7ff60f05f310>, body: {"keypair": {"name": "tempest-keypair-1374431439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrr/Nht+F0ukuVYP6RFeMvhlFU9SjZoOV7GbAtIiHlfAPWXfYcUo+akENUqFBf2aFuW7IM7P4ofp8pFTXJxNvj9JmoN2TFEKEgTms3apIK6y4qzJ/vGNm/Ns0vcyoQXdw=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:26.295470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-39f64b45-7ae9-4a83-ae6a-b012f0ff2949 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Getting quotas for project cf7c744c508342f5947ae08743ccc6c7. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:25:26.308910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-39f64b45-7ae9-4a83-ae6a-b012f0ff2949 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Getting quotas for user 2b3d9555419845cc9bc9f650e676d776 and project cf7c744c508342f5947ae08743ccc6c7. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:25:26.381878 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-39f64b45-7ae9-4a83-ae6a-b012f0ff2949 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140186 Oct 18 13:25:26.388963 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 967/2047] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:25:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 18 13:25:26.395693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0b048e2e-e534-4e0d-b65e-0bdb6fce03d6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:26.412559 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0b048e2e-e534-4e0d-b65e-0bdb6fce03d6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1510 microversion: 2.1 time: 0.614064 Oct 18 13:25:26.431282 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1081/2048] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:25 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1510 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:26.553730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96b366d1-5713-457f-ac62-1bb1ec05b191 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:26.555037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-96b366d1-5713-457f-ac62-1bb1ec05b191 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:26.572270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96b366d1-5713-457f-ac62-1bb1ec05b191 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:26.573496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96b366d1-5713-457f-ac62-1bb1ec05b191 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:26.573965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96b366d1-5713-457f-ac62-1bb1ec05b191 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:26.576331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96b366d1-5713-457f-ac62-1bb1ec05b191 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:26.576331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96b366d1-5713-457f-ac62-1bb1ec05b191 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:26.578965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96b366d1-5713-457f-ac62-1bb1ec05b191 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:26.809383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-77a8cb6c-1ae8-4b0f-b8e9-cc6fcdb3c3bf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:26.810311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-77a8cb6c-1ae8-4b0f-b8e9-cc6fcdb3c3bf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:26.835167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:26.844324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-96b366d1-5713-457f-ac62-1bb1ec05b191 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:26.849438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a8cb6c-1ae8-4b0f-b8e9-cc6fcdb3c3bf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:26.850024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a8cb6c-1ae8-4b0f-b8e9-cc6fcdb3c3bf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:26.854777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a8cb6c-1ae8-4b0f-b8e9-cc6fcdb3c3bf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:26.855325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-96b366d1-5713-457f-ac62-1bb1ec05b191 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:26.857513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a8cb6c-1ae8-4b0f-b8e9-cc6fcdb3c3bf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:26.861554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-96b366d1-5713-457f-ac62-1bb1ec05b191 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:26.863390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a8cb6c-1ae8-4b0f-b8e9-cc6fcdb3c3bf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:26.863903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a8cb6c-1ae8-4b0f-b8e9-cc6fcdb3c3bf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:26.876675 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-96b366d1-5713-457f-ac62-1bb1ec05b191 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.329068 Oct 18 13:25:26.878106 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 968/2049] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:26 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:26.884514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a5487f54-4271-4b6b-bff3-01beadf566cd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:26.889557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a5487f54-4271-4b6b-bff3-01beadf566cd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:26.903069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5487f54-4271-4b6b-bff3-01beadf566cd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:26.907199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5487f54-4271-4b6b-bff3-01beadf566cd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:26.907828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5487f54-4271-4b6b-bff3-01beadf566cd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:26.911577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5487f54-4271-4b6b-bff3-01beadf566cd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:26.912542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5487f54-4271-4b6b-bff3-01beadf566cd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:26.914802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5487f54-4271-4b6b-bff3-01beadf566cd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:27.068070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a5487f54-4271-4b6b-bff3-01beadf566cd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:27.102189 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a5487f54-4271-4b6b-bff3-01beadf566cd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1450 microversion: 2.1 time: 0.201522 Oct 18 13:25:27.117884 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 969/2050] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:26 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1450 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:27.127803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-269acbfb-b57b-435c-bae2-26c759eac501 req-4542595f-0e90-40ec-b541-acdc94c42e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4247ab-8099-4faa-9d6b-beabeeb98e0d", "name": "network-vif-deleted", "tag": "33bce418-405e-4c1d-b340-799e22644041"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:27.154811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-269acbfb-b57b-435c-bae2-26c759eac501 req-4542595f-0e90-40ec-b541-acdc94c42e0c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:27.157009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-269acbfb-b57b-435c-bae2-26c759eac501 req-4542595f-0e90-40ec-b541-acdc94c42e0c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:27.158623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-269acbfb-b57b-435c-bae2-26c759eac501 req-4542595f-0e90-40ec-b541-acdc94c42e0c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:27.182897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-77a8cb6c-1ae8-4b0f-b8e9-cc6fcdb3c3bf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:27.188069 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-269acbfb-b57b-435c-bae2-26c759eac501 req-4542595f-0e90-40ec-b541-acdc94c42e0c service nova] Creating event network-vif-deleted:33bce418-405e-4c1d-b340-799e22644041 for instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d on n-h2-858384-13 Oct 18 13:25:27.192169 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-77a8cb6c-1ae8-4b0f-b8e9-cc6fcdb3c3bf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1211 microversion: 2.1 time: 0.387152 Oct 18 13:25:27.197314 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1082/2051] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:26 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1211 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:27.222624 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-269acbfb-b57b-435c-bae2-26c759eac501 req-4542595f-0e90-40ec-b541-acdc94c42e0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103312 Oct 18 13:25:27.228031 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 970/2052] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:27.438863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f2b125fc-1c56-49e6-b565-1c3cdbcf008a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:27.439488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f2b125fc-1c56-49e6-b565-1c3cdbcf008a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:27.451355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2b125fc-1c56-49e6-b565-1c3cdbcf008a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:27.451851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2b125fc-1c56-49e6-b565-1c3cdbcf008a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:27.458083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2b125fc-1c56-49e6-b565-1c3cdbcf008a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:27.458860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2b125fc-1c56-49e6-b565-1c3cdbcf008a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:27.459337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2b125fc-1c56-49e6-b565-1c3cdbcf008a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:27.459777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2b125fc-1c56-49e6-b565-1c3cdbcf008a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:27.690163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f2b125fc-1c56-49e6-b565-1c3cdbcf008a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:27.701919 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f2b125fc-1c56-49e6-b565-1c3cdbcf008a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1510 microversion: 2.1 time: 0.268424 Oct 18 13:25:27.718272 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1083/2053] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:27 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1510 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:27.914582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5e7c3151-de45-435b-a623-f6f5a94ea433 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:27.919722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5e7c3151-de45-435b-a623-f6f5a94ea433 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:27.953463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e7c3151-de45-435b-a623-f6f5a94ea433 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:27.958863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e7c3151-de45-435b-a623-f6f5a94ea433 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:27.959666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e7c3151-de45-435b-a623-f6f5a94ea433 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:27.961908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e7c3151-de45-435b-a623-f6f5a94ea433 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:27.962592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e7c3151-de45-435b-a623-f6f5a94ea433 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:27.963204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e7c3151-de45-435b-a623-f6f5a94ea433 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:28.130005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:28.131005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:28.148486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:28.149990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:28.155014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:28.156104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:28.157400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:28.165362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:28.212261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:28.213308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:28.213987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:28.216238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lazy-loading 'fault' on Instance uuid 6a4247ab-8099-4faa-9d6b-beabeeb98e0d {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:28.428574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5e7c3151-de45-435b-a623-f6f5a94ea433 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:28.449988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5e7c3151-de45-435b-a623-f6f5a94ea433 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:28.451553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5e7c3151-de45-435b-a623-f6f5a94ea433 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:28.476815 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5e7c3151-de45-435b-a623-f6f5a94ea433 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.565025 Oct 18 13:25:28.478880 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 971/2054] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:27 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:28.496980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9dc23b20-3ebc-46da-be49-ac316fdcedfe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:28.516976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9dc23b20-3ebc-46da-be49-ac316fdcedfe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:28.538059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dc23b20-3ebc-46da-be49-ac316fdcedfe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:28.543047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dc23b20-3ebc-46da-be49-ac316fdcedfe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:28.544648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dc23b20-3ebc-46da-be49-ac316fdcedfe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:28.547900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dc23b20-3ebc-46da-be49-ac316fdcedfe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:28.549947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dc23b20-3ebc-46da-be49-ac316fdcedfe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:28.555211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dc23b20-3ebc-46da-be49-ac316fdcedfe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:28.589658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:28.631764 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4787708e-f5f2-4746-93e5-43023e8764c4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 200 len: 1304 microversion: 2.1 time: 0.503961 Oct 18 13:25:28.663066 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1084/2055] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:28 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 1304 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:28.685420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-84558f10-281a-4a62-b4a1-805e32f1a804 req-f4a5850c-c0c4-4bf7-9ca9-af3dc0110006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd5017a-89a3-4009-902b-156a36615276", "name": "network-vif-unplugged", "status": "completed", "tag": "4fd0a37b-a6fc-4fa4-ae29-01b3e5f2b288"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:28.765615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-84558f10-281a-4a62-b4a1-805e32f1a804 req-f4a5850c-c0c4-4bf7-9ca9-af3dc0110006 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:28.766265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-84558f10-281a-4a62-b4a1-805e32f1a804 req-f4a5850c-c0c4-4bf7-9ca9-af3dc0110006 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:28.774020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-84558f10-281a-4a62-b4a1-805e32f1a804 req-f4a5850c-c0c4-4bf7-9ca9-af3dc0110006 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:28.798899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9dc23b20-3ebc-46da-be49-ac316fdcedfe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:28.813565 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9dc23b20-3ebc-46da-be49-ac316fdcedfe tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1265 microversion: 2.1 time: 0.333201 Oct 18 13:25:28.814739 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 972/2056] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:28 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:28.824795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c31cb84b-91d7-4d76-9946-a1ba24ae896d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:28.839583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c31cb84b-91d7-4d76-9946-a1ba24ae896d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:28.846083 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-84558f10-281a-4a62-b4a1-805e32f1a804 req-f4a5850c-c0c4-4bf7-9ca9-af3dc0110006 service nova] Creating event network-vif-unplugged:4fd0a37b-a6fc-4fa4-ae29-01b3e5f2b288 for instance 1dd5017a-89a3-4009-902b-156a36615276 on n-h1-858384-13 Oct 18 13:25:28.880705 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-84558f10-281a-4a62-b4a1-805e32f1a804 req-f4a5850c-c0c4-4bf7-9ca9-af3dc0110006 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.205708 Oct 18 13:25:28.887831 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1085/2057] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:28.889085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c31cb84b-91d7-4d76-9946-a1ba24ae896d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:28.894470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c31cb84b-91d7-4d76-9946-a1ba24ae896d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:28.895222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c31cb84b-91d7-4d76-9946-a1ba24ae896d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:28.898402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c31cb84b-91d7-4d76-9946-a1ba24ae896d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:28.899043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c31cb84b-91d7-4d76-9946-a1ba24ae896d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:28.904454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c31cb84b-91d7-4d76-9946-a1ba24ae896d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.510460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68926125-59d3-4723-9e60-959fb9ab2381 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:29.512873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-68926125-59d3-4723-9e60-959fb9ab2381 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:29.536998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68926125-59d3-4723-9e60-959fb9ab2381 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:29.540317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68926125-59d3-4723-9e60-959fb9ab2381 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:29.540968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68926125-59d3-4723-9e60-959fb9ab2381 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.544294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68926125-59d3-4723-9e60-959fb9ab2381 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:29.544957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68926125-59d3-4723-9e60-959fb9ab2381 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:29.547027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68926125-59d3-4723-9e60-959fb9ab2381 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.572960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c31cb84b-91d7-4d76-9946-a1ba24ae896d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:29.582777 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c31cb84b-91d7-4d76-9946-a1ba24ae896d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1510 microversion: 2.1 time: 0.761723 Oct 18 13:25:29.597831 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 973/2058] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:28 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1510 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:29.687328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-82f16b13-f573-426e-8110-356419f1e386 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:29.690081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-82f16b13-f573-426e-8110-356419f1e386 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:29.707891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82f16b13-f573-426e-8110-356419f1e386 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:29.709297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82f16b13-f573-426e-8110-356419f1e386 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:29.710547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82f16b13-f573-426e-8110-356419f1e386 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.711587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82f16b13-f573-426e-8110-356419f1e386 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:29.712260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82f16b13-f573-426e-8110-356419f1e386 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:29.712894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82f16b13-f573-426e-8110-356419f1e386 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.744557 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-82f16b13-f573-426e-8110-356419f1e386 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-82f16b13-f573-426e-8110-356419f1e386 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d HTTP/1.1 Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:25:29.752136 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:25:29.753972 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:25:29.753972 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:25:29.753972 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:25:29.753972 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:25:29.753972 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:25:29.753972 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:25:29.753972 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:25:29.753972 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:25:29.753972 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:25:29.753972 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:25:29.753972 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:25:29.753972 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '6a4247ab-8099-4faa-9d6b-beabeeb98e0d'} Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:29.754886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:25:29.756368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:25:29.761502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-82f16b13-f573-426e-8110-356419f1e386 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:29.773576 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-82f16b13-f573-426e-8110-356419f1e386 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 404 len: 111 microversion: 2.1 time: 0.089799 Oct 18 13:25:29.774730 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 974/2059] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:29 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:25:29.852396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a4d9e9a5-54e1-4e63-85e4-0dbc6d30e9e8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:29.853420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a4d9e9a5-54e1-4e63-85e4-0dbc6d30e9e8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:29.865204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4d9e9a5-54e1-4e63-85e4-0dbc6d30e9e8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:29.872651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4d9e9a5-54e1-4e63-85e4-0dbc6d30e9e8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:29.884640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4d9e9a5-54e1-4e63-85e4-0dbc6d30e9e8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.887292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4d9e9a5-54e1-4e63-85e4-0dbc6d30e9e8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:29.888689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4d9e9a5-54e1-4e63-85e4-0dbc6d30e9e8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:29.890351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4d9e9a5-54e1-4e63-85e4-0dbc6d30e9e8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:29.905925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68926125-59d3-4723-9e60-959fb9ab2381 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:29.919282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68926125-59d3-4723-9e60-959fb9ab2381 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:29.920911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68926125-59d3-4723-9e60-959fb9ab2381 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:29.959205 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68926125-59d3-4723-9e60-959fb9ab2381 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.453309 Oct 18 13:25:29.963948 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1086/2060] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:29 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:30.087679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1764271686", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "b5cc8010-ea63-4e1f-9434-bf4391452206"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:30.218301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a4d9e9a5-54e1-4e63-85e4-0dbc6d30e9e8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:30.231988 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a4d9e9a5-54e1-4e63-85e4-0dbc6d30e9e8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1265 microversion: 2.1 time: 0.393503 Oct 18 13:25:30.236298 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 975/2061] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:29 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1265 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:30.297435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] validate_networks() for [('b5cc8010-ea63-4e1f-9434-bf4391452206', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:25:30.616605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-095a8dc4-62fb-4085-a1ca-dd180eb66381 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:30.618226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-095a8dc4-62fb-4085-a1ca-dd180eb66381 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:30.636118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-095a8dc4-62fb-4085-a1ca-dd180eb66381 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:30.637826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-095a8dc4-62fb-4085-a1ca-dd180eb66381 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:30.645262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-095a8dc4-62fb-4085-a1ca-dd180eb66381 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:30.646376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-095a8dc4-62fb-4085-a1ca-dd180eb66381 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:30.647097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-095a8dc4-62fb-4085-a1ca-dd180eb66381 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:30.648331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-095a8dc4-62fb-4085-a1ca-dd180eb66381 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:31.125191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-095a8dc4-62fb-4085-a1ca-dd180eb66381 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:31.134495 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-095a8dc4-62fb-4085-a1ca-dd180eb66381 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1510 microversion: 2.1 time: 0.522295 Oct 18 13:25:31.135105 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 976/2062] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:30 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1510 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:31.175057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c20bb3c1-6541-432f-9557-77ec592f5750 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:31.175561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c20bb3c1-6541-432f-9557-77ec592f5750 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:31.197499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c20bb3c1-6541-432f-9557-77ec592f5750 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:31.198053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c20bb3c1-6541-432f-9557-77ec592f5750 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:31.198500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c20bb3c1-6541-432f-9557-77ec592f5750 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:31.199219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c20bb3c1-6541-432f-9557-77ec592f5750 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:31.199706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c20bb3c1-6541-432f-9557-77ec592f5750 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:31.200155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c20bb3c1-6541-432f-9557-77ec592f5750 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:32.279215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c20bb3c1-6541-432f-9557-77ec592f5750 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:32.296290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c20bb3c1-6541-432f-9557-77ec592f5750 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:32.303201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c20bb3c1-6541-432f-9557-77ec592f5750 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:32.321541 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c20bb3c1-6541-432f-9557-77ec592f5750 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 1.158883 Oct 18 13:25:32.346465 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 977/2063] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:31 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:32.353527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-897191b9-a98a-4975-9fc5-c8180aa7afdc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:32.362900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-897191b9-a98a-4975-9fc5-c8180aa7afdc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:32.380989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-897191b9-a98a-4975-9fc5-c8180aa7afdc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:32.386477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-897191b9-a98a-4975-9fc5-c8180aa7afdc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:32.389139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-897191b9-a98a-4975-9fc5-c8180aa7afdc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:32.391324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-897191b9-a98a-4975-9fc5-c8180aa7afdc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:32.394437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-897191b9-a98a-4975-9fc5-c8180aa7afdc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:32.395165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-897191b9-a98a-4975-9fc5-c8180aa7afdc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:32.554698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:25:32.558336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:25:32.558991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:25:32.559528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:25:32.560066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:25:32.587062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:32.587699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:32.589144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:32.596528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:32.597793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:32.606162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:32.686536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:25:32.713980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for user c0a722d1dc7c4e05b8cc8dc98b5cb619 and project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:25:32.748884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:25:32.753072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:25:33.017279 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f57ce2c6-9ed3-46f5-9e54-1c1e7a601b5e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.934744 Oct 18 13:25:33.045726 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1087/2064] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:25:33.068736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d3079692-1b2a-4c59-be1f-2f8f3f3561e8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:33.074542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d3079692-1b2a-4c59-be1f-2f8f3f3561e8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:33.142056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3079692-1b2a-4c59-be1f-2f8f3f3561e8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:33.142827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3079692-1b2a-4c59-be1f-2f8f3f3561e8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:33.146987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3079692-1b2a-4c59-be1f-2f8f3f3561e8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:33.148306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3079692-1b2a-4c59-be1f-2f8f3f3561e8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:33.148758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3079692-1b2a-4c59-be1f-2f8f3f3561e8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:33.161051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3079692-1b2a-4c59-be1f-2f8f3f3561e8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:33.267069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-897191b9-a98a-4975-9fc5-c8180aa7afdc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:33.293676 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-897191b9-a98a-4975-9fc5-c8180aa7afdc tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1307 microversion: 2.1 time: 0.943971 Oct 18 13:25:33.315347 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 978/2065] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:32 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1307 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:33.331043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d6f8be4-5d82-4da1-b3da-98f24f146bca tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:33.332103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4d6f8be4-5d82-4da1-b3da-98f24f146bca tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:33.586733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4d6f8be4-5d82-4da1-b3da-98f24f146bca tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:33.600576 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d6f8be4-5d82-4da1-b3da-98f24f146bca tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1215 microversion: 2.1 time: 0.281139 Oct 18 13:25:33.608859 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 979/2066] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:33 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1215 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:33.649269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b750f500-1dec-4b3f-b6df-a18cf4924277 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:33.651512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b750f500-1dec-4b3f-b6df-a18cf4924277 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:33.695973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b750f500-1dec-4b3f-b6df-a18cf4924277 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:33.697423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b750f500-1dec-4b3f-b6df-a18cf4924277 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:33.700995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b750f500-1dec-4b3f-b6df-a18cf4924277 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:33.702171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b750f500-1dec-4b3f-b6df-a18cf4924277 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:33.706572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b750f500-1dec-4b3f-b6df-a18cf4924277 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:33.709132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b750f500-1dec-4b3f-b6df-a18cf4924277 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:34.080887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b750f500-1dec-4b3f-b6df-a18cf4924277 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:34.093481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:34.111429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b750f500-1dec-4b3f-b6df-a18cf4924277 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:34.121155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b750f500-1dec-4b3f-b6df-a18cf4924277 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:34.177062 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b750f500-1dec-4b3f-b6df-a18cf4924277 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.566849 Oct 18 13:25:34.182211 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 980/2067] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:33 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:34.225804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-be611c61-b1c1-4dcc-b00c-9ea574b0eaf9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:34.229076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-be611c61-b1c1-4dcc-b00c-9ea574b0eaf9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:34.258519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be611c61-b1c1-4dcc-b00c-9ea574b0eaf9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:34.260770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be611c61-b1c1-4dcc-b00c-9ea574b0eaf9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:34.263142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be611c61-b1c1-4dcc-b00c-9ea574b0eaf9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:34.263606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d3079692-1b2a-4c59-be1f-2f8f3f3561e8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:34.269069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be611c61-b1c1-4dcc-b00c-9ea574b0eaf9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:34.277378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be611c61-b1c1-4dcc-b00c-9ea574b0eaf9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:34.279447 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d3079692-1b2a-4c59-be1f-2f8f3f3561e8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1487 microversion: 2.1 time: 1.231737 Oct 18 13:25:34.279919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be611c61-b1c1-4dcc-b00c-9ea574b0eaf9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:34.307967 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1088/2068] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:33 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1487 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:34.321797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13b864ea-d0e3-426b-816f-7e5043ca271a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:34.324196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-13b864ea-d0e3-426b-816f-7e5043ca271a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:34.385426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13b864ea-d0e3-426b-816f-7e5043ca271a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:34.386895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13b864ea-d0e3-426b-816f-7e5043ca271a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:34.387510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13b864ea-d0e3-426b-816f-7e5043ca271a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:34.388354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13b864ea-d0e3-426b-816f-7e5043ca271a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:34.407394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13b864ea-d0e3-426b-816f-7e5043ca271a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:34.407890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13b864ea-d0e3-426b-816f-7e5043ca271a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:34.430031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-be611c61-b1c1-4dcc-b00c-9ea574b0eaf9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:25:34.544313 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13b864ea-d0e3-426b-816f-7e5043ca271a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 200 len: 128 microversion: 2.1 time: 0.234902 Oct 18 13:25:34.545808 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1089/2069] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:25:34 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 128 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:34.580007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0d3dae53-a644-4f1f-badd-b5f5b5026fb8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:34.581310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0d3dae53-a644-4f1f-badd-b5f5b5026fb8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:34.603868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d3dae53-a644-4f1f-badd-b5f5b5026fb8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:34.607744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d3dae53-a644-4f1f-badd-b5f5b5026fb8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:34.608853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d3dae53-a644-4f1f-badd-b5f5b5026fb8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:34.610028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d3dae53-a644-4f1f-badd-b5f5b5026fb8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:34.612465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d3dae53-a644-4f1f-badd-b5f5b5026fb8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:34.613066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d3dae53-a644-4f1f-badd-b5f5b5026fb8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:34.820520 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-be611c61-b1c1-4dcc-b00c-9ea574b0eaf9 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "DELETE /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 204 len: 0 microversion: 2.25 time: 0.606371 Oct 18 13:25:34.840273 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 981/2070] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:25:34 2022] DELETE /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:25:34.848494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aa13fb8c-05de-4841-8cbe-5ccdcb4c2125 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:34.868333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aa13fb8c-05de-4841-8cbe-5ccdcb4c2125 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:34.905601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa13fb8c-05de-4841-8cbe-5ccdcb4c2125 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:34.906113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa13fb8c-05de-4841-8cbe-5ccdcb4c2125 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:34.906558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa13fb8c-05de-4841-8cbe-5ccdcb4c2125 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:34.907285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa13fb8c-05de-4841-8cbe-5ccdcb4c2125 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:34.910788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa13fb8c-05de-4841-8cbe-5ccdcb4c2125 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:34.911245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa13fb8c-05de-4841-8cbe-5ccdcb4c2125 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:35.102064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:35.872724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0d3dae53-a644-4f1f-badd-b5f5b5026fb8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:35.892242 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0d3dae53-a644-4f1f-badd-b5f5b5026fb8 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1307 microversion: 2.1 time: 1.343282 Oct 18 13:25:35.893166 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1090/2071] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:34 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1307 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:35.910064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e6846020-0c4d-42b9-bde5-0668d501d296 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:35.918280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e6846020-0c4d-42b9-bde5-0668d501d296 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:35.948528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6846020-0c4d-42b9-bde5-0668d501d296 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:35.949602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6846020-0c4d-42b9-bde5-0668d501d296 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:35.952472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6846020-0c4d-42b9-bde5-0668d501d296 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:35.954960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6846020-0c4d-42b9-bde5-0668d501d296 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:35.955699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6846020-0c4d-42b9-bde5-0668d501d296 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:35.965929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6846020-0c4d-42b9-bde5-0668d501d296 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:36.380323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e6846020-0c4d-42b9-bde5-0668d501d296 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:36.412700 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e6846020-0c4d-42b9-bde5-0668d501d296 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1267 microversion: 2.1 time: 0.509741 Oct 18 13:25:36.425209 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1091/2072] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:35 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1267 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:36.425209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba350491-6f1a-4b6f-89ab-cde84ec1c18e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:36.425209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ba350491-6f1a-4b6f-89ab-cde84ec1c18e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:36.518401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba350491-6f1a-4b6f-89ab-cde84ec1c18e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:36.519118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba350491-6f1a-4b6f-89ab-cde84ec1c18e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:36.519434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba350491-6f1a-4b6f-89ab-cde84ec1c18e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:36.520210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba350491-6f1a-4b6f-89ab-cde84ec1c18e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:36.520713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba350491-6f1a-4b6f-89ab-cde84ec1c18e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:36.521188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba350491-6f1a-4b6f-89ab-cde84ec1c18e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:36.702793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aa13fb8c-05de-4841-8cbe-5ccdcb4c2125 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:36.714297 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aa13fb8c-05de-4841-8cbe-5ccdcb4c2125 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 1.875152 Oct 18 13:25:36.723412 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 982/2073] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:34 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:36.744804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-581064067", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "f61d9dd3-2d30-4077-83fd-6cb55fe03a9c"}], "security_groups": [{"name": "tempest-securitygroup--246151039"}], "key_name": "tempest-keypair-1374431439", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:37.470526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba350491-6f1a-4b6f-89ab-cde84ec1c18e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:37.487627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba350491-6f1a-4b6f-89ab-cde84ec1c18e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:37.491816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba350491-6f1a-4b6f-89ab-cde84ec1c18e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:37.497423 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ba350491-6f1a-4b6f-89ab-cde84ec1c18e tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 200 len: 1731 microversion: 2.25 time: 1.081479 Oct 18 13:25:37.502953 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1092/2074] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:36 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 1731 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:37.523894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-70621078-8315-46c1-8531-52d6bbde1b30 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:37.524970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-70621078-8315-46c1-8531-52d6bbde1b30 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:37.536645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70621078-8315-46c1-8531-52d6bbde1b30 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:37.538450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70621078-8315-46c1-8531-52d6bbde1b30 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:37.539346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70621078-8315-46c1-8531-52d6bbde1b30 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:37.540792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70621078-8315-46c1-8531-52d6bbde1b30 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:37.544503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70621078-8315-46c1-8531-52d6bbde1b30 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:37.545362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70621078-8315-46c1-8531-52d6bbde1b30 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:37.801713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-70621078-8315-46c1-8531-52d6bbde1b30 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:37.818973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-70621078-8315-46c1-8531-52d6bbde1b30 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:37.830545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-70621078-8315-46c1-8531-52d6bbde1b30 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:37.846379 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-70621078-8315-46c1-8531-52d6bbde1b30 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1531 microversion: 2.91 time: 0.341836 Oct 18 13:25:37.852709 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1093/2075] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:37 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1531 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:37.864390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-66db31d7-04b7-4e29-b534-72a1b2a126ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:37.865573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-66db31d7-04b7-4e29-b534-72a1b2a126ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:37.884002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66db31d7-04b7-4e29-b534-72a1b2a126ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:37.889384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66db31d7-04b7-4e29-b534-72a1b2a126ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:37.893080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66db31d7-04b7-4e29-b534-72a1b2a126ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:37.894226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66db31d7-04b7-4e29-b534-72a1b2a126ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:37.898034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66db31d7-04b7-4e29-b534-72a1b2a126ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:37.898483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66db31d7-04b7-4e29-b534-72a1b2a126ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:37.914288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] validate_networks() for [('f61d9dd3-2d30-4077-83fd-6cb55fe03a9c', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:25:39.659338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:25:39.659948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:25:39.660376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:25:39.660851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:25:39.661363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:25:39.692515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:39.695169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:39.695849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:39.696960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:39.703232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:39.704211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:39.806191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Getting quotas for project cf7c744c508342f5947ae08743ccc6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:25:39.831489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Getting quotas for user 2b3d9555419845cc9bc9f650e676d776 and project cf7c744c508342f5947ae08743ccc6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:25:39.840498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:39.872300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:25:39.887003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:25:39.920190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-66db31d7-04b7-4e29-b534-72a1b2a126ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:39.952576 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-66db31d7-04b7-4e29-b534-72a1b2a126ca tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 2.093059 Oct 18 13:25:39.956172 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1094/2076] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:37 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:39.981621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-41752a03-bc87-45c0-ad7d-233bae9816aa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:39.987286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-41752a03-bc87-45c0-ad7d-233bae9816aa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:39.994744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41752a03-bc87-45c0-ad7d-233bae9816aa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:39.995648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41752a03-bc87-45c0-ad7d-233bae9816aa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:39.996289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41752a03-bc87-45c0-ad7d-233bae9816aa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:39.997323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41752a03-bc87-45c0-ad7d-233bae9816aa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:39.997999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41752a03-bc87-45c0-ad7d-233bae9816aa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:39.998644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41752a03-bc87-45c0-ad7d-233bae9816aa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:40.038109 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-02008a34-700e-4490-81f3-95ddbca6bfcc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.312791 Oct 18 13:25:40.051407 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 983/2077] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 3327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:25:40.064750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bc743adf-433c-41e3-ae73-8df24dda9fbb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:40.066747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bc743adf-433c-41e3-ae73-8df24dda9fbb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:40.095317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc743adf-433c-41e3-ae73-8df24dda9fbb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:40.101936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc743adf-433c-41e3-ae73-8df24dda9fbb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:40.102582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc743adf-433c-41e3-ae73-8df24dda9fbb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:40.103585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc743adf-433c-41e3-ae73-8df24dda9fbb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:40.105881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc743adf-433c-41e3-ae73-8df24dda9fbb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:40.112011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc743adf-433c-41e3-ae73-8df24dda9fbb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:40.581034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bc743adf-433c-41e3-ae73-8df24dda9fbb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:40.598594 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bc743adf-433c-41e3-ae73-8df24dda9fbb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1315 microversion: 2.1 time: 0.545391 Oct 18 13:25:40.600003 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 984/2078] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:40 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:40.605288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e5e7eb6d-21e7-41cf-9f6b-5a4c0b9d48fb req-193d8c74-0c93-433c-832b-82065669fab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22298178-3c70-4617-8c26-bcbecf59552f", "tag": "2bffc881-fcd0-4a95-9bb6-5fa76676fff1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:40.618767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e5e7eb6d-21e7-41cf-9f6b-5a4c0b9d48fb req-193d8c74-0c93-433c-832b-82065669fab7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:40.619714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e5e7eb6d-21e7-41cf-9f6b-5a4c0b9d48fb req-193d8c74-0c93-433c-832b-82065669fab7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:40.620333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e5e7eb6d-21e7-41cf-9f6b-5a4c0b9d48fb req-193d8c74-0c93-433c-832b-82065669fab7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:40.636361 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e5e7eb6d-21e7-41cf-9f6b-5a4c0b9d48fb req-193d8c74-0c93-433c-832b-82065669fab7 service nova] Creating event network-changed:2bffc881-fcd0-4a95-9bb6-5fa76676fff1 for instance 22298178-3c70-4617-8c26-bcbecf59552f on n-h2-858384-13 Oct 18 13:25:40.643718 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e5e7eb6d-21e7-41cf-9f6b-5a4c0b9d48fb req-193d8c74-0c93-433c-832b-82065669fab7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041699 Oct 18 13:25:40.645090 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 985/2079] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:40.653431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-57b9f881-ae9a-4a9f-81a8-775f08b4ed36 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:40.654363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-57b9f881-ae9a-4a9f-81a8-775f08b4ed36 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:40.671931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57b9f881-ae9a-4a9f-81a8-775f08b4ed36 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:40.673686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57b9f881-ae9a-4a9f-81a8-775f08b4ed36 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:40.674564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57b9f881-ae9a-4a9f-81a8-775f08b4ed36 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:40.675516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57b9f881-ae9a-4a9f-81a8-775f08b4ed36 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:40.676320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57b9f881-ae9a-4a9f-81a8-775f08b4ed36 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:40.677307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57b9f881-ae9a-4a9f-81a8-775f08b4ed36 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:40.915577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-57b9f881-ae9a-4a9f-81a8-775f08b4ed36 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lazy-loading 'services' on Instance uuid 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:40.971456 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-57b9f881-ae9a-4a9f-81a8-775f08b4ed36 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1938 microversion: 2.91 time: 0.324846 Oct 18 13:25:40.973241 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 986/2080] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:40 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1938 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:41.369796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0ec66c3a-7e37-4319-8a32-ef88208e899c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'create', calling method: .version_select at 0x7ff60f055790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1560732345", "description": "tempest-description-1199900012"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:41.742814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-41752a03-bc87-45c0-ad7d-233bae9816aa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:41.752198 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-41752a03-bc87-45c0-ad7d-233bae9816aa tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1307 microversion: 2.1 time: 1.790968 Oct 18 13:25:41.762050 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1095/2081] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:39 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1307 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:41.778446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cbee6e1a-00e5-40e9-a0cd-5c95df573c72 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:41.783716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cbee6e1a-00e5-40e9-a0cd-5c95df573c72 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 925c4106-eafb-486f-8846-ff04eea11eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:41.808987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbee6e1a-00e5-40e9-a0cd-5c95df573c72 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:41.809563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbee6e1a-00e5-40e9-a0cd-5c95df573c72 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:41.810011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbee6e1a-00e5-40e9-a0cd-5c95df573c72 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:41.814324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbee6e1a-00e5-40e9-a0cd-5c95df573c72 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:41.815392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbee6e1a-00e5-40e9-a0cd-5c95df573c72 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:41.815995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbee6e1a-00e5-40e9-a0cd-5c95df573c72 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:41.871881 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-cbee6e1a-00e5-40e9-a0cd-5c95df573c72 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] HTTP exception thrown: Instance 925c4106-eafb-486f-8846-ff04eea11eb3 could not be found. Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cbee6e1a-00e5-40e9-a0cd-5c95df573c72 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Request method failure captured: Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 HTTP/1.1 Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdQGWzxjWOYB2BmOtqiK3h5FWRKKIwXTtFOynE-KVeWbt_rW9ApRvfUq8GC6f4bORMSPG5RCPO8-gi9OtnkbAhZHz2FpsMT026SRBgbeDCTe250zwQABmdhkPLlm1HvpUCxtrr1Uih4XltSzUjBIDSeD2fih8nUgo2_OmddusN9UMI Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: e559a35e21d343adab5f772a17b745f9 Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-853601182 Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:25:41.873567 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:25:41.875054 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e559a35e21d343adab5f772a17b745f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e559a35e21d343adab5f772a17b745f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e559a35e21d343adab5f772a17b745f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e559a35e21d343adab5f772a17b745f9"}]}] Oct 18 13:25:41.875054 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-853601182 Oct 18 13:25:41.875054 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: e559a35e21d343adab5f772a17b745f9 Oct 18 13:25:41.875054 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-853601182 Oct 18 13:25:41.875054 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-LiveAutoBlockMigrationV225Test-853601182-project Oct 18 13:25:41.875054 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:25:41.875054 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:25:41.875054 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1bfaa3d005f94cf2a5bdf8e63d20ba3f Oct 18 13:25:41.875054 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-853601182-project Oct 18 13:25:41.875054 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:25:41.875054 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 925c4106-eafb-486f-8846-ff04eea11eb3 could not be found. Oct 18 13:25:41.875054 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '925c4106-eafb-486f-8846-ff04eea11eb3'} Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925c4106-eafb-486f-8846-ff04eea11eb3 could not be found. Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:41.875810 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925c4106-eafb-486f-8846-ff04eea11eb3 could not be found. Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925c4106-eafb-486f-8846-ff04eea11eb3 could not be found. Oct 18 13:25:41.877043 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:41.878094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cbee6e1a-00e5-40e9-a0cd-5c95df573c72 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Returning 404 to user: Instance 925c4106-eafb-486f-8846-ff04eea11eb3 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:41.878094 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cbee6e1a-00e5-40e9-a0cd-5c95df573c72 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3" status: 404 len: 111 microversion: 2.25 time: 0.111738 Oct 18 13:25:41.886902 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1096/2082] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:41 2022] GET /compute/v2.1/servers/925c4106-eafb-486f-8846-ff04eea11eb3 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:25:41.904463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f3d9c94f-10af-4a63-8a1d-ea29848cf55a req-d94ad5c4-bdb4-46a7-87f8-c58a159c9efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925c4106-eafb-486f-8846-ff04eea11eb3", "name": "network-vif-deleted", "tag": "764246b4-ac2a-4fc1-ad53-12db75a818b1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:41.943653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f3d9c94f-10af-4a63-8a1d-ea29848cf55a req-d94ad5c4-bdb4-46a7-87f8-c58a159c9efb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:41.946532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f3d9c94f-10af-4a63-8a1d-ea29848cf55a req-d94ad5c4-bdb4-46a7-87f8-c58a159c9efb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:41.947297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f3d9c94f-10af-4a63-8a1d-ea29848cf55a req-d94ad5c4-bdb4-46a7-87f8-c58a159c9efb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.004813 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f3d9c94f-10af-4a63-8a1d-ea29848cf55a req-d94ad5c4-bdb4-46a7-87f8-c58a159c9efb service nova] Creating event network-vif-deleted:764246b4-ac2a-4fc1-ad53-12db75a818b1 for instance 925c4106-eafb-486f-8846-ff04eea11eb3 on n-h2-858384-13 Oct 18 13:25:42.019200 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f3d9c94f-10af-4a63-8a1d-ea29848cf55a req-d94ad5c4-bdb4-46a7-87f8-c58a159c9efb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130965 Oct 18 13:25:42.020755 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1097/2083] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:42.027000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-43d38d26-2b76-493e-979a-2dbf78fe7154 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:42.031574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-43d38d26-2b76-493e-979a-2dbf78fe7154 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:42.050868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43d38d26-2b76-493e-979a-2dbf78fe7154 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:42.055285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43d38d26-2b76-493e-979a-2dbf78fe7154 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:42.056092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43d38d26-2b76-493e-979a-2dbf78fe7154 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.056994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43d38d26-2b76-493e-979a-2dbf78fe7154 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:42.057703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43d38d26-2b76-493e-979a-2dbf78fe7154 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:42.058767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43d38d26-2b76-493e-979a-2dbf78fe7154 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.300479 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0ec66c3a-7e37-4319-8a32-ef88208e899c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.325902 Oct 18 13:25:42.302413 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 987/2084] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:25:40 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:42.307888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3a6d3b3c-2eae-4740-a093-812850191fb9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:42.308500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3a6d3b3c-2eae-4740-a093-812850191fb9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:42.323980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a6d3b3c-2eae-4740-a093-812850191fb9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:42.326633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a6d3b3c-2eae-4740-a093-812850191fb9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:42.329038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a6d3b3c-2eae-4740-a093-812850191fb9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.330149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a6d3b3c-2eae-4740-a093-812850191fb9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:42.330760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a6d3b3c-2eae-4740-a093-812850191fb9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:42.332526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a6d3b3c-2eae-4740-a093-812850191fb9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.460935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-43d38d26-2b76-493e-979a-2dbf78fe7154 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:42.487034 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-43d38d26-2b76-493e-979a-2dbf78fe7154 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.464793 Oct 18 13:25:42.487708 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1098/2085] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:42 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:42.495289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f2c8991a-7765-4c9a-b508-cebb9805ec64 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:42.504976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f2c8991a-7765-4c9a-b508-cebb9805ec64 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:42.520022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2c8991a-7765-4c9a-b508-cebb9805ec64 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:42.520751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2c8991a-7765-4c9a-b508-cebb9805ec64 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:42.521411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2c8991a-7765-4c9a-b508-cebb9805ec64 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.522289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2c8991a-7765-4c9a-b508-cebb9805ec64 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:42.528283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2c8991a-7765-4c9a-b508-cebb9805ec64 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:42.528915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2c8991a-7765-4c9a-b508-cebb9805ec64 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.532689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3a6d3b3c-2eae-4740-a093-812850191fb9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:42.541799 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3a6d3b3c-2eae-4740-a093-812850191fb9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1286 microversion: 2.1 time: 0.238035 Oct 18 13:25:42.552056 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 988/2086] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:42 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1286 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:42.580319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f4b69349-b0e3-4bcc-a9d2-94ed42079bf5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:42.581092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f4b69349-b0e3-4bcc-a9d2-94ed42079bf5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:42.599424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4b69349-b0e3-4bcc-a9d2-94ed42079bf5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:42.606013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4b69349-b0e3-4bcc-a9d2-94ed42079bf5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:42.608237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4b69349-b0e3-4bcc-a9d2-94ed42079bf5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.612893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4b69349-b0e3-4bcc-a9d2-94ed42079bf5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:42.613589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4b69349-b0e3-4bcc-a9d2-94ed42079bf5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:42.614189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4b69349-b0e3-4bcc-a9d2-94ed42079bf5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:42.644694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-f2c8991a-7765-4c9a-b508-cebb9805ec64 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lazy-loading 'flavor' on Instance uuid 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:42.653240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:42.670033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:42.747933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=10 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:42.997447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f4b69349-b0e3-4bcc-a9d2-94ed42079bf5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:43.008054 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f4b69349-b0e3-4bcc-a9d2-94ed42079bf5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1315 microversion: 2.1 time: 0.452940 Oct 18 13:25:43.017946 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 989/2087] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:42 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:43.040428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-83de4cab-b44b-46c0-be48-afb00a4da158 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '.version_select at 0x7ff60f076ee0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:43.093875 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-83de4cab-b44b-46c0-be48-afb00a4da158 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-997676696" status: 204 len: 0 microversion: 2.25 time: 0.074507 Oct 18 13:25:43.095118 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 990/2088] 10.222.0.40 () {60 vars in 1259 bytes} [Tue Oct 18 13:25:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-997676696 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:25:43.102127 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f2c8991a-7765-4c9a-b508-cebb9805ec64 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "POST /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7/action" status: 202 len: 0 microversion: 2.91 time: 0.610644 Oct 18 13:25:43.106392 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1099/2089] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:25:42 2022] POST /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:25:43.113088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2486e517-a070-4bc9-a8e7-3d116c790b84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:43.116143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2486e517-a070-4bc9-a8e7-3d116c790b84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:43.130822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cc6360e6-c5e8-49c6-983d-21e0b50f420d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'create', calling method: .version_select at 0x7ff60f055e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1066828456", "description": "tempest-description-2049563111"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:43.141962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2486e517-a070-4bc9-a8e7-3d116c790b84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:43.142708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2486e517-a070-4bc9-a8e7-3d116c790b84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:43.144009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2486e517-a070-4bc9-a8e7-3d116c790b84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:43.144956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2486e517-a070-4bc9-a8e7-3d116c790b84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:43.148676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2486e517-a070-4bc9-a8e7-3d116c790b84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:43.149735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2486e517-a070-4bc9-a8e7-3d116c790b84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:43.785343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2486e517-a070-4bc9-a8e7-3d116c790b84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:43.794125 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2486e517-a070-4bc9-a8e7-3d116c790b84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.686082 Oct 18 13:25:43.799769 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1100/2090] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:43 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:43.812694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87786b9b-a6c8-4fda-b41d-94e493e2c9a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:43.827271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-87786b9b-a6c8-4fda-b41d-94e493e2c9a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:43.864832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87786b9b-a6c8-4fda-b41d-94e493e2c9a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:43.865490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87786b9b-a6c8-4fda-b41d-94e493e2c9a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:43.866095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87786b9b-a6c8-4fda-b41d-94e493e2c9a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:43.874990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87786b9b-a6c8-4fda-b41d-94e493e2c9a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:43.875560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87786b9b-a6c8-4fda-b41d-94e493e2c9a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:43.878228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87786b9b-a6c8-4fda-b41d-94e493e2c9a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.527780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-87786b9b-a6c8-4fda-b41d-94e493e2c9a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:44.535455 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-87786b9b-a6c8-4fda-b41d-94e493e2c9a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1307 microversion: 2.1 time: 0.732256 Oct 18 13:25:44.536295 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1101/2091] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:43 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1307 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:44.541981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b4a12780-97b1-4bda-a756-1aa087d0a2fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:44.542870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b4a12780-97b1-4bda-a756-1aa087d0a2fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:44.550068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4a12780-97b1-4bda-a756-1aa087d0a2fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.550958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4a12780-97b1-4bda-a756-1aa087d0a2fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.551645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4a12780-97b1-4bda-a756-1aa087d0a2fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.552755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4a12780-97b1-4bda-a756-1aa087d0a2fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.553897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4a12780-97b1-4bda-a756-1aa087d0a2fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.554683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4a12780-97b1-4bda-a756-1aa087d0a2fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.674567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b4a12780-97b1-4bda-a756-1aa087d0a2fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:44.692559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b4a12780-97b1-4bda-a756-1aa087d0a2fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:44.694032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b4a12780-97b1-4bda-a756-1aa087d0a2fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:44.701091 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b4a12780-97b1-4bda-a756-1aa087d0a2fd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.163460 Oct 18 13:25:44.701720 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1102/2092] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:44 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:44.717486 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cc6360e6-c5e8-49c6-983d-21e0b50f420d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.611179 Oct 18 13:25:44.722321 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 991/2093] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:25:43 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:44.728837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-26f3ca74-5057-4865-8f1a-f0fead8674f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:44.729136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-26f3ca74-5057-4865-8f1a-f0fead8674f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:44.738733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-716358ce-9f01-45de-b2ba-d98297988ddf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:44.739346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-716358ce-9f01-45de-b2ba-d98297988ddf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:44.743940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:44.747737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-716358ce-9f01-45de-b2ba-d98297988ddf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.748489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-716358ce-9f01-45de-b2ba-d98297988ddf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.749070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26f3ca74-5057-4865-8f1a-f0fead8674f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.749257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-716358ce-9f01-45de-b2ba-d98297988ddf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.749612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26f3ca74-5057-4865-8f1a-f0fead8674f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.750055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26f3ca74-5057-4865-8f1a-f0fead8674f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.750452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-716358ce-9f01-45de-b2ba-d98297988ddf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.750763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26f3ca74-5057-4865-8f1a-f0fead8674f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:44.751222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26f3ca74-5057-4865-8f1a-f0fead8674f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.751425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-716358ce-9f01-45de-b2ba-d98297988ddf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:44.751650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26f3ca74-5057-4865-8f1a-f0fead8674f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.752191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-716358ce-9f01-45de-b2ba-d98297988ddf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:44.838995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-716358ce-9f01-45de-b2ba-d98297988ddf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:44.849868 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-716358ce-9f01-45de-b2ba-d98297988ddf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1292 microversion: 2.1 time: 0.125750 Oct 18 13:25:44.849868 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1103/2094] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:44 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1292 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:44.853616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-896678582", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "fa5737e5-8161-4ff1-a109-dbc177bf4e3a"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:44.917409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] validate_networks() for [('fa5737e5-8161-4ff1-a109-dbc177bf4e3a', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:25:45.038043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-26f3ca74-5057-4865-8f1a-f0fead8674f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:45.047808 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-26f3ca74-5057-4865-8f1a-f0fead8674f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1315 microversion: 2.1 time: 0.324336 Oct 18 13:25:45.065823 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 992/2095] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:44 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:45.076570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-51a3786f-ef24-4a65-b1ab-2d44af05418a req-7966a479-59ca-4dac-815d-ae2f36af9f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a52dba4-8897-442b-b15f-4d3185f02add", "tag": "347c646b-dc50-4651-a535-bcda2f5df834"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:45.090627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-51a3786f-ef24-4a65-b1ab-2d44af05418a req-7966a479-59ca-4dac-815d-ae2f36af9f4f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:45.091610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-51a3786f-ef24-4a65-b1ab-2d44af05418a req-7966a479-59ca-4dac-815d-ae2f36af9f4f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:45.092047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-51a3786f-ef24-4a65-b1ab-2d44af05418a req-7966a479-59ca-4dac-815d-ae2f36af9f4f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:45.106542 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-51a3786f-ef24-4a65-b1ab-2d44af05418a req-7966a479-59ca-4dac-815d-ae2f36af9f4f service nova] Creating event network-changed:347c646b-dc50-4651-a535-bcda2f5df834 for instance 3a52dba4-8897-442b-b15f-4d3185f02add on n-h1-858384-13 Oct 18 13:25:45.111895 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-51a3786f-ef24-4a65-b1ab-2d44af05418a req-7966a479-59ca-4dac-815d-ae2f36af9f4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044617 Oct 18 13:25:45.112912 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 993/2096] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:45.118613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-426938834", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "897f1132-314e-435d-9878-506c8ff5f223"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:45.188781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] validate_networks() for [('897f1132-314e-435d-9878-506c8ff5f223', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:25:46.186231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:25:46.186807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:25:46.187195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:25:46.187604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:25:46.196807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:25:46.236783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.237309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.237761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.239216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.239878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.240462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.272186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Getting quotas for project 710435d30626412f9ec22d776f8e94ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:25:46.282675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Getting quotas for user 9b5e09fad51a478788961c1f2b946cc9 and project 710435d30626412f9ec22d776f8e94ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:25:46.306775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:25:46.309875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:25:46.432194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:25:46.433260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:25:46.434022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:25:46.434616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:25:46.435348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:25:46.457488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.458183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.459790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.463289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.463462 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9df991aa-b245-43c5-908b-995086492c6d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.346140 Oct 18 13:25:46.464154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.465647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.477275 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 994/2097] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:25:46.484083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cbc9e50d-9467-4af3-9b19-a2077b88871f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:46.484707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cbc9e50d-9467-4af3-9b19-a2077b88871f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:46.502567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbc9e50d-9467-4af3-9b19-a2077b88871f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.503066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbc9e50d-9467-4af3-9b19-a2077b88871f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.503490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbc9e50d-9467-4af3-9b19-a2077b88871f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.504306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbc9e50d-9467-4af3-9b19-a2077b88871f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.504767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbc9e50d-9467-4af3-9b19-a2077b88871f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.505190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbc9e50d-9467-4af3-9b19-a2077b88871f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.518791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Getting quotas for project 452e5b77db474cf9a2b7f6b2abcb6115. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:25:46.525500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Getting quotas for user 2878f8de95694fe1a9a17ed27b6ba40b and project 452e5b77db474cf9a2b7f6b2abcb6115. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:25:46.560170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:25:46.562760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:25:46.651228 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-34676962-57d3-4a7c-8b97-ce70f2edfb44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802228 Oct 18 13:25:46.658154 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1104/2098] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:25:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:25:46.668895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-302476ee-94ba-43f0-a0a7-0c668de773ba tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:46.671742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-302476ee-94ba-43f0-a0a7-0c668de773ba tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:46.680411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302476ee-94ba-43f0-a0a7-0c668de773ba tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.681132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302476ee-94ba-43f0-a0a7-0c668de773ba tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.681792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302476ee-94ba-43f0-a0a7-0c668de773ba tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.683235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302476ee-94ba-43f0-a0a7-0c668de773ba tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.683778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302476ee-94ba-43f0-a0a7-0c668de773ba tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.684319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302476ee-94ba-43f0-a0a7-0c668de773ba tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.771233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-302476ee-94ba-43f0-a0a7-0c668de773ba tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:46.786781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-302476ee-94ba-43f0-a0a7-0c668de773ba tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:46.790228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-302476ee-94ba-43f0-a0a7-0c668de773ba tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:46.802175 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-302476ee-94ba-43f0-a0a7-0c668de773ba tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.142172 Oct 18 13:25:46.807268 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1105/2099] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:46 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:46.852276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7ab756c0-ed5f-4375-bb7a-670c280690c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:46.852869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7ab756c0-ed5f-4375-bb7a-670c280690c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:46.873697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ab756c0-ed5f-4375-bb7a-670c280690c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.874344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ab756c0-ed5f-4375-bb7a-670c280690c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.874939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ab756c0-ed5f-4375-bb7a-670c280690c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:46.875659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ab756c0-ed5f-4375-bb7a-670c280690c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:46.876118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ab756c0-ed5f-4375-bb7a-670c280690c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:46.876548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ab756c0-ed5f-4375-bb7a-670c280690c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.005297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cbc9e50d-9467-4af3-9b19-a2077b88871f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:47.012485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7ab756c0-ed5f-4375-bb7a-670c280690c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:47.021393 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7ab756c0-ed5f-4375-bb7a-670c280690c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1292 microversion: 2.1 time: 0.179260 Oct 18 13:25:47.028382 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1106/2100] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:46 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1292 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:47.033428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-074e648d-35d5-4d11-8204-5a2b8a68713a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.036342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-074e648d-35d5-4d11-8204-5a2b8a68713a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:47.044013 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cbc9e50d-9467-4af3-9b19-a2077b88871f tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1307 microversion: 2.1 time: 0.568218 Oct 18 13:25:47.046583 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 995/2101] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:46 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1307 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:47.056341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-074e648d-35d5-4d11-8204-5a2b8a68713a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.059705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-074e648d-35d5-4d11-8204-5a2b8a68713a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.060154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-074e648d-35d5-4d11-8204-5a2b8a68713a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.060882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-074e648d-35d5-4d11-8204-5a2b8a68713a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.061374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-074e648d-35d5-4d11-8204-5a2b8a68713a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.061803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-074e648d-35d5-4d11-8204-5a2b8a68713a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.078707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-51d725e8-05ef-40b3-8e38-8409eaa25ea2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.079655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-51d725e8-05ef-40b3-8e38-8409eaa25ea2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:47.274466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-074e648d-35d5-4d11-8204-5a2b8a68713a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:47.288526 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-074e648d-35d5-4d11-8204-5a2b8a68713a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1315 microversion: 2.1 time: 0.256018 Oct 18 13:25:47.292140 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1107/2102] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:47 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:47.301050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca844c56-91a7-4e91-8416-5c61cd6acf01 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.304658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca844c56-91a7-4e91-8416-5c61cd6acf01 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:47.319235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca844c56-91a7-4e91-8416-5c61cd6acf01 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.321466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca844c56-91a7-4e91-8416-5c61cd6acf01 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.322542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca844c56-91a7-4e91-8416-5c61cd6acf01 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.325157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca844c56-91a7-4e91-8416-5c61cd6acf01 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.325956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca844c56-91a7-4e91-8416-5c61cd6acf01 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.328103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca844c56-91a7-4e91-8416-5c61cd6acf01 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.373563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-51d725e8-05ef-40b3-8e38-8409eaa25ea2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:47.390351 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-51d725e8-05ef-40b3-8e38-8409eaa25ea2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1215 microversion: 2.1 time: 0.339144 Oct 18 13:25:47.401824 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 996/2103] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:47 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1215 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:47.401824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8c18fdda-5b7e-4af5-9ee4-d4728ede7528 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.402441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8c18fdda-5b7e-4af5-9ee4-d4728ede7528 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:47.432608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca844c56-91a7-4e91-8416-5c61cd6acf01 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:25:47.603390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8c18fdda-5b7e-4af5-9ee4-d4728ede7528 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:47.629081 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8c18fdda-5b7e-4af5-9ee4-d4728ede7528 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 200 len: 1214 microversion: 2.1 time: 0.222039 Oct 18 13:25:47.643615 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 997/2104] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:47 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 1214 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:47.840661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-76b50998-13d9-4566-b9d3-66ad6702240d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.841439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-76b50998-13d9-4566-b9d3-66ad6702240d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:47.845239 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca844c56-91a7-4e91-8416-5c61cd6acf01 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 204 len: 0 microversion: 2.25 time: 0.551501 Oct 18 13:25:47.846649 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1108/2105] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:25:47 2022] DELETE /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:25:47.853757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76b50998-13d9-4566-b9d3-66ad6702240d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.854514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76b50998-13d9-4566-b9d3-66ad6702240d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.855195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76b50998-13d9-4566-b9d3-66ad6702240d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.857646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-39100c1b-8f6a-4fb1-aee4-2868f3e3fbe3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:47.858161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76b50998-13d9-4566-b9d3-66ad6702240d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.858496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-39100c1b-8f6a-4fb1-aee4-2868f3e3fbe3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:47.859180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76b50998-13d9-4566-b9d3-66ad6702240d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.859832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76b50998-13d9-4566-b9d3-66ad6702240d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.872737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39100c1b-8f6a-4fb1-aee4-2868f3e3fbe3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.873431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39100c1b-8f6a-4fb1-aee4-2868f3e3fbe3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.873983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39100c1b-8f6a-4fb1-aee4-2868f3e3fbe3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:47.875118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39100c1b-8f6a-4fb1-aee4-2868f3e3fbe3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:47.875677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39100c1b-8f6a-4fb1-aee4-2868f3e3fbe3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:47.876422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39100c1b-8f6a-4fb1-aee4-2868f3e3fbe3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:48.079169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-39100c1b-8f6a-4fb1-aee4-2868f3e3fbe3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:48.089504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-39100c1b-8f6a-4fb1-aee4-2868f3e3fbe3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:48.090140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-76b50998-13d9-4566-b9d3-66ad6702240d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:48.092338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-39100c1b-8f6a-4fb1-aee4-2868f3e3fbe3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:48.095115 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-39100c1b-8f6a-4fb1-aee4-2868f3e3fbe3 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1548 microversion: 2.25 time: 0.241954 Oct 18 13:25:48.096520 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1109/2106] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:47 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1548 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:48.099487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-76b50998-13d9-4566-b9d3-66ad6702240d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:48.105236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-76b50998-13d9-4566-b9d3-66ad6702240d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:48.105989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-650860d6-596d-4e15-845f-dbde96c3d1ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:48.106812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-650860d6-596d-4e15-845f-dbde96c3d1ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:48.114261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-650860d6-596d-4e15-845f-dbde96c3d1ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:48.115008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-650860d6-596d-4e15-845f-dbde96c3d1ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:48.115904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-650860d6-596d-4e15-845f-dbde96c3d1ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:48.117557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-650860d6-596d-4e15-845f-dbde96c3d1ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:48.118374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-650860d6-596d-4e15-845f-dbde96c3d1ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:48.119003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-650860d6-596d-4e15-845f-dbde96c3d1ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:48.123509 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-76b50998-13d9-4566-b9d3-66ad6702240d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.288879 Oct 18 13:25:48.135031 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 998/2107] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:47 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:25:48.135031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1134b549-0ba5-48d2-b0c7-7dac0d817d31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:48.135031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1134b549-0ba5-48d2-b0c7-7dac0d817d31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:48.154916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1134b549-0ba5-48d2-b0c7-7dac0d817d31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:48.158915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1134b549-0ba5-48d2-b0c7-7dac0d817d31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:48.159369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1134b549-0ba5-48d2-b0c7-7dac0d817d31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:48.160363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1134b549-0ba5-48d2-b0c7-7dac0d817d31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:48.160821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1134b549-0ba5-48d2-b0c7-7dac0d817d31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:48.161269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1134b549-0ba5-48d2-b0c7-7dac0d817d31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:48.441306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-650860d6-596d-4e15-845f-dbde96c3d1ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:48.453206 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-650860d6-596d-4e15-845f-dbde96c3d1ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1359 microversion: 2.1 time: 0.353168 Oct 18 13:25:48.455486 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1110/2108] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:48 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1359 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:48.469895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb170279-b381-4cef-a12f-38ef7418a7b3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:48.470749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cb170279-b381-4cef-a12f-38ef7418a7b3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:48.483988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb170279-b381-4cef-a12f-38ef7418a7b3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:48.486413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb170279-b381-4cef-a12f-38ef7418a7b3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:48.488835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb170279-b381-4cef-a12f-38ef7418a7b3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:48.489840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb170279-b381-4cef-a12f-38ef7418a7b3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:48.490324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb170279-b381-4cef-a12f-38ef7418a7b3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:48.490776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb170279-b381-4cef-a12f-38ef7418a7b3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:48.702048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cb170279-b381-4cef-a12f-38ef7418a7b3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:48.712585 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cb170279-b381-4cef-a12f-38ef7418a7b3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1315 microversion: 2.1 time: 0.255846 Oct 18 13:25:48.714481 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1111/2109] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:48 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:48.744612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c6dfbc0-d4d3-43e4-a643-01a7d5905c7a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:48.747808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7c6dfbc0-d4d3-43e4-a643-01a7d5905c7a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:48.764496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c6dfbc0-d4d3-43e4-a643-01a7d5905c7a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:48.767554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c6dfbc0-d4d3-43e4-a643-01a7d5905c7a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:48.768255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c6dfbc0-d4d3-43e4-a643-01a7d5905c7a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:48.770087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c6dfbc0-d4d3-43e4-a643-01a7d5905c7a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:48.770471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c6dfbc0-d4d3-43e4-a643-01a7d5905c7a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:48.772368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c6dfbc0-d4d3-43e4-a643-01a7d5905c7a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:48.960604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7c6dfbc0-d4d3-43e4-a643-01a7d5905c7a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:48.965989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1134b549-0ba5-48d2-b0c7-7dac0d817d31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:48.971248 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7c6dfbc0-d4d3-43e4-a643-01a7d5905c7a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1273 microversion: 2.1 time: 0.255700 Oct 18 13:25:48.971904 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1112/2110] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:48 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:48.977627 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1134b549-0ba5-48d2-b0c7-7dac0d817d31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1307 microversion: 2.1 time: 0.851792 Oct 18 13:25:48.980868 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 999/2111] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:48 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1307 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:48.985388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5d7adc08-1847-4d1d-aa2e-a68046b081b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:48.988229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5d7adc08-1847-4d1d-aa2e-a68046b081b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:48.999736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d7adc08-1847-4d1d-aa2e-a68046b081b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:48.999936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d7adc08-1847-4d1d-aa2e-a68046b081b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.000324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d7adc08-1847-4d1d-aa2e-a68046b081b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:49.001029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d7adc08-1847-4d1d-aa2e-a68046b081b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:49.001507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d7adc08-1847-4d1d-aa2e-a68046b081b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.001929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d7adc08-1847-4d1d-aa2e-a68046b081b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:49.020055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:49.120769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5d7adc08-1847-4d1d-aa2e-a68046b081b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:49.123962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bc37cd86-02a0-4e1f-98c0-1ca1a7eb1f17 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:49.124742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bc37cd86-02a0-4e1f-98c0-1ca1a7eb1f17 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:49.128647 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5d7adc08-1847-4d1d-aa2e-a68046b081b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 200 len: 1266 microversion: 2.1 time: 0.155675 Oct 18 13:25:49.132163 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1113/2112] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:48 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:49.134188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc37cd86-02a0-4e1f-98c0-1ca1a7eb1f17 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:49.134838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc37cd86-02a0-4e1f-98c0-1ca1a7eb1f17 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.145869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc37cd86-02a0-4e1f-98c0-1ca1a7eb1f17 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:49.146843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc37cd86-02a0-4e1f-98c0-1ca1a7eb1f17 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:49.147443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc37cd86-02a0-4e1f-98c0-1ca1a7eb1f17 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.148541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc37cd86-02a0-4e1f-98c0-1ca1a7eb1f17 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:49.158165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-00b7ffed-e99c-4d76-b011-c078930e808e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:49.158779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-00b7ffed-e99c-4d76-b011-c078930e808e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:49.165859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00b7ffed-e99c-4d76-b011-c078930e808e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:49.166622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00b7ffed-e99c-4d76-b011-c078930e808e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.167249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00b7ffed-e99c-4d76-b011-c078930e808e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:49.168117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00b7ffed-e99c-4d76-b011-c078930e808e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:49.168834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00b7ffed-e99c-4d76-b011-c078930e808e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.169441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00b7ffed-e99c-4d76-b011-c078930e808e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:49.340881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-00b7ffed-e99c-4d76-b011-c078930e808e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:49.360754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-00b7ffed-e99c-4d76-b011-c078930e808e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:49.368940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-00b7ffed-e99c-4d76-b011-c078930e808e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:49.383335 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-00b7ffed-e99c-4d76-b011-c078930e808e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.227581 Oct 18 13:25:49.386538 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1114/2113] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:49 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:25:49.483310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-63335540-454f-4cc2-9690-c85eeb9cb63e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:49.483982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-63335540-454f-4cc2-9690-c85eeb9cb63e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:49.493553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63335540-454f-4cc2-9690-c85eeb9cb63e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:49.494337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63335540-454f-4cc2-9690-c85eeb9cb63e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.494513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63335540-454f-4cc2-9690-c85eeb9cb63e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:49.498822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63335540-454f-4cc2-9690-c85eeb9cb63e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:49.502898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63335540-454f-4cc2-9690-c85eeb9cb63e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.503418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63335540-454f-4cc2-9690-c85eeb9cb63e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:49.796647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-63335540-454f-4cc2-9690-c85eeb9cb63e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:49.825293 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-63335540-454f-4cc2-9690-c85eeb9cb63e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1359 microversion: 2.1 time: 0.346477 Oct 18 13:25:49.842765 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1115/2114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:49 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1359 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:49.854973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d9c6a4f1-23e7-4fc8-b0a1-37c3ea8aea86 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:49.855902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d9c6a4f1-23e7-4fc8-b0a1-37c3ea8aea86 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:49.864354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9c6a4f1-23e7-4fc8-b0a1-37c3ea8aea86 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:49.864854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9c6a4f1-23e7-4fc8-b0a1-37c3ea8aea86 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.865325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9c6a4f1-23e7-4fc8-b0a1-37c3ea8aea86 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:49.866648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9c6a4f1-23e7-4fc8-b0a1-37c3ea8aea86 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:49.867263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9c6a4f1-23e7-4fc8-b0a1-37c3ea8aea86 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:49.867738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9c6a4f1-23e7-4fc8-b0a1-37c3ea8aea86 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.116786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d9c6a4f1-23e7-4fc8-b0a1-37c3ea8aea86 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.126973 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d9c6a4f1-23e7-4fc8-b0a1-37c3ea8aea86 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1315 microversion: 2.1 time: 0.282318 Oct 18 13:25:50.128411 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1116/2115] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:49 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:50.136067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e85e62e3-d6d2-4a05-8479-ecfb432b075d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:50.136949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e85e62e3-d6d2-4a05-8479-ecfb432b075d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:50.143998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85e62e3-d6d2-4a05-8479-ecfb432b075d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.144792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85e62e3-d6d2-4a05-8479-ecfb432b075d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.145469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85e62e3-d6d2-4a05-8479-ecfb432b075d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.146568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85e62e3-d6d2-4a05-8479-ecfb432b075d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.147290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85e62e3-d6d2-4a05-8479-ecfb432b075d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.148535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85e62e3-d6d2-4a05-8479-ecfb432b075d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.242829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e85e62e3-d6d2-4a05-8479-ecfb432b075d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.243474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bc37cd86-02a0-4e1f-98c0-1ca1a7eb1f17 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.253948 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e85e62e3-d6d2-4a05-8479-ecfb432b075d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1273 microversion: 2.1 time: 0.124137 Oct 18 13:25:50.254429 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1117/2116] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:50 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:50.262688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bc37cd86-02a0-4e1f-98c0-1ca1a7eb1f17 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.264867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bc37cd86-02a0-4e1f-98c0-1ca1a7eb1f17 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.267613 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bc37cd86-02a0-4e1f-98c0-1ca1a7eb1f17 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1548 microversion: 2.25 time: 1.147332 Oct 18 13:25:50.272452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-05c5dbed-1e65-4773-891e-86c200dd397b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:50.273860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-05c5dbed-1e65-4773-891e-86c200dd397b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:50.284720 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1000/2117] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:49 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1548 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:50.291747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05c5dbed-1e65-4773-891e-86c200dd397b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.292247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05c5dbed-1e65-4773-891e-86c200dd397b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.292686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05c5dbed-1e65-4773-891e-86c200dd397b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.293424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05c5dbed-1e65-4773-891e-86c200dd397b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.293884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05c5dbed-1e65-4773-891e-86c200dd397b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.294315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05c5dbed-1e65-4773-891e-86c200dd397b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.304993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2f08e77c-2423-4392-8a56-e842a954aa57 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:50.307330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2f08e77c-2423-4392-8a56-e842a954aa57 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:50.321655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f08e77c-2423-4392-8a56-e842a954aa57 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.322398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f08e77c-2423-4392-8a56-e842a954aa57 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.323014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f08e77c-2423-4392-8a56-e842a954aa57 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.324994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f08e77c-2423-4392-8a56-e842a954aa57 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.325687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f08e77c-2423-4392-8a56-e842a954aa57 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.326488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f08e77c-2423-4392-8a56-e842a954aa57 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.541914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-05c5dbed-1e65-4773-891e-86c200dd397b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.557485 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-05c5dbed-1e65-4773-891e-86c200dd397b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1307 microversion: 2.1 time: 0.300560 Oct 18 13:25:50.577286 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1118/2118] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:50 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1307 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:50.589042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f80cdbd3-4620-4c51-ad52-58742c94760b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:50.589791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f80cdbd3-4620-4c51-ad52-58742c94760b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:50.613493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f80cdbd3-4620-4c51-ad52-58742c94760b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.616204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f80cdbd3-4620-4c51-ad52-58742c94760b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.620000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f80cdbd3-4620-4c51-ad52-58742c94760b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.620965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f80cdbd3-4620-4c51-ad52-58742c94760b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.625228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f80cdbd3-4620-4c51-ad52-58742c94760b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.626747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f80cdbd3-4620-4c51-ad52-58742c94760b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.766665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f80cdbd3-4620-4c51-ad52-58742c94760b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.776304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f80cdbd3-4620-4c51-ad52-58742c94760b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.777794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f80cdbd3-4620-4c51-ad52-58742c94760b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:50.812453 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f80cdbd3-4620-4c51-ad52-58742c94760b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.215394 Oct 18 13:25:50.813141 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1119/2119] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:50 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:50.817936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1375c1b0-0bf7-4ca8-b9cb-33674795f801 req-d38ce676-bd62-47bb-91e3-b1c0f8253231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22298178-3c70-4617-8c26-bcbecf59552f", "name": "network-vif-plugged", "status": "completed", "tag": "2bffc881-fcd0-4a95-9bb6-5fa76676fff1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:50.847011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1375c1b0-0bf7-4ca8-b9cb-33674795f801 req-d38ce676-bd62-47bb-91e3-b1c0f8253231 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.847494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1375c1b0-0bf7-4ca8-b9cb-33674795f801 req-d38ce676-bd62-47bb-91e3-b1c0f8253231 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.847927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1375c1b0-0bf7-4ca8-b9cb-33674795f801 req-d38ce676-bd62-47bb-91e3-b1c0f8253231 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.897164 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1375c1b0-0bf7-4ca8-b9cb-33674795f801 req-d38ce676-bd62-47bb-91e3-b1c0f8253231 service nova] Creating event network-vif-plugged:2bffc881-fcd0-4a95-9bb6-5fa76676fff1 for instance 22298178-3c70-4617-8c26-bcbecf59552f on n-h2-858384-13 Oct 18 13:25:50.934666 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1375c1b0-0bf7-4ca8-b9cb-33674795f801 req-d38ce676-bd62-47bb-91e3-b1c0f8253231 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117790 Oct 18 13:25:50.937953 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1120/2120] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:50.967680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-05c2decc-69d1-485c-bada-a380eccd93c7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:50.969134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-05c2decc-69d1-485c-bada-a380eccd93c7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:50.978380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05c2decc-69d1-485c-bada-a380eccd93c7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.979019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05c2decc-69d1-485c-bada-a380eccd93c7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.979471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05c2decc-69d1-485c-bada-a380eccd93c7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:50.980203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05c2decc-69d1-485c-bada-a380eccd93c7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:50.980661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05c2decc-69d1-485c-bada-a380eccd93c7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:50.981768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05c2decc-69d1-485c-bada-a380eccd93c7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.336626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-05c2decc-69d1-485c-bada-a380eccd93c7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:51.350111 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-05c2decc-69d1-485c-bada-a380eccd93c7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1359 microversion: 2.1 time: 0.408594 Oct 18 13:25:51.352917 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1121/2121] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:50 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1359 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:51.361142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8454b4a9-4fc9-4ba9-88f4-a83fdff7d22f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:51.362950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8454b4a9-4fc9-4ba9-88f4-a83fdff7d22f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:51.373683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8454b4a9-4fc9-4ba9-88f4-a83fdff7d22f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.374358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8454b4a9-4fc9-4ba9-88f4-a83fdff7d22f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.374941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8454b4a9-4fc9-4ba9-88f4-a83fdff7d22f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.376154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8454b4a9-4fc9-4ba9-88f4-a83fdff7d22f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.376947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8454b4a9-4fc9-4ba9-88f4-a83fdff7d22f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.377918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8454b4a9-4fc9-4ba9-88f4-a83fdff7d22f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.478015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2f08e77c-2423-4392-8a56-e842a954aa57 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:51.495132 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2f08e77c-2423-4392-8a56-e842a954aa57 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 200 len: 1314 microversion: 2.1 time: 1.209161 Oct 18 13:25:51.496048 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1001/2122] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:50 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 1314 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:51.500568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ec4d0b8d-3138-4299-a850-f485eaee9ef3 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:51.501163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ec4d0b8d-3138-4299-a850-f485eaee9ef3 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:51.518892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec4d0b8d-3138-4299-a850-f485eaee9ef3 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.519491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec4d0b8d-3138-4299-a850-f485eaee9ef3 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.520289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec4d0b8d-3138-4299-a850-f485eaee9ef3 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.521157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec4d0b8d-3138-4299-a850-f485eaee9ef3 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.521792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec4d0b8d-3138-4299-a850-f485eaee9ef3 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.522511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec4d0b8d-3138-4299-a850-f485eaee9ef3 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.691427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ec4d0b8d-3138-4299-a850-f485eaee9ef3 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:51.701102 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ec4d0b8d-3138-4299-a850-f485eaee9ef3 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1273 microversion: 2.1 time: 0.203804 Oct 18 13:25:51.702365 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1002/2123] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:51 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1273 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:51.707576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c322455e-cc24-4399-880b-e6a51e028953 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:51.708521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c322455e-cc24-4399-880b-e6a51e028953 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:51.721128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c322455e-cc24-4399-880b-e6a51e028953 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.726638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c322455e-cc24-4399-880b-e6a51e028953 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.727414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c322455e-cc24-4399-880b-e6a51e028953 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.730757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c322455e-cc24-4399-880b-e6a51e028953 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.731494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c322455e-cc24-4399-880b-e6a51e028953 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.732113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c322455e-cc24-4399-880b-e6a51e028953 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.739837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:51.820157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8454b4a9-4fc9-4ba9-88f4-a83fdff7d22f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:51.833977 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8454b4a9-4fc9-4ba9-88f4-a83fdff7d22f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1315 microversion: 2.1 time: 0.479579 Oct 18 13:25:51.834797 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1122/2124] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:51 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:51.841677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1ad392d3-ace8-4d1c-a329-e185afa41445 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:51.842876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1ad392d3-ace8-4d1c-a329-e185afa41445 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:51.851886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ad392d3-ace8-4d1c-a329-e185afa41445 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.852839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ad392d3-ace8-4d1c-a329-e185afa41445 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.853465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ad392d3-ace8-4d1c-a329-e185afa41445 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.854427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ad392d3-ace8-4d1c-a329-e185afa41445 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.855035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ad392d3-ace8-4d1c-a329-e185afa41445 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.855611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ad392d3-ace8-4d1c-a329-e185afa41445 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.934613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c322455e-cc24-4399-880b-e6a51e028953 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:51.956049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c322455e-cc24-4399-880b-e6a51e028953 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:51.957807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c322455e-cc24-4399-880b-e6a51e028953 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:51.959989 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c322455e-cc24-4399-880b-e6a51e028953 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 200 len: 1506 microversion: 2.25 time: 0.256472 Oct 18 13:25:51.978706 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1003/2125] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:51 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:51.978706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-f5b1dbda-7a36-4426-8e23-c7d78116b639 req-3ae78e9b-a865-4738-8bb8-edcad447e026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b550c78b-caf6-44ea-a613-978bac95b4fe", "name": "network-vif-deleted", "tag": "f691b18b-7542-4132-925b-d3a8fa57fcae"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:51.978706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f5b1dbda-7a36-4426-8e23-c7d78116b639 req-3ae78e9b-a865-4738-8bb8-edcad447e026 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:51.978706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f5b1dbda-7a36-4426-8e23-c7d78116b639 req-3ae78e9b-a865-4738-8bb8-edcad447e026 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:51.979112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f5b1dbda-7a36-4426-8e23-c7d78116b639 req-3ae78e9b-a865-4738-8bb8-edcad447e026 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:51.996791 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f5b1dbda-7a36-4426-8e23-c7d78116b639 req-3ae78e9b-a865-4738-8bb8-edcad447e026 service nova] Creating event network-vif-deleted:f691b18b-7542-4132-925b-d3a8fa57fcae for instance b550c78b-caf6-44ea-a613-978bac95b4fe on n-h1-858384-13 Oct 18 13:25:52.004382 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-f5b1dbda-7a36-4426-8e23-c7d78116b639 req-3ae78e9b-a865-4738-8bb8-edcad447e026 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040423 Oct 18 13:25:52.005522 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1004/2126] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:52.012704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ab731ffd-290a-481a-8d7b-210643c6b9a0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:52.013980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ab731ffd-290a-481a-8d7b-210643c6b9a0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:52.033226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab731ffd-290a-481a-8d7b-210643c6b9a0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.034287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab731ffd-290a-481a-8d7b-210643c6b9a0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.034982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab731ffd-290a-481a-8d7b-210643c6b9a0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.035980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab731ffd-290a-481a-8d7b-210643c6b9a0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.037340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab731ffd-290a-481a-8d7b-210643c6b9a0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.038071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab731ffd-290a-481a-8d7b-210643c6b9a0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.224192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ab731ffd-290a-481a-8d7b-210643c6b9a0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:52.255089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ab731ffd-290a-481a-8d7b-210643c6b9a0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:52.264109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ab731ffd-290a-481a-8d7b-210643c6b9a0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:52.285810 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ab731ffd-290a-481a-8d7b-210643c6b9a0 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.278098 Oct 18 13:25:52.291192 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1005/2127] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:52 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:52.311864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1ad392d3-ace8-4d1c-a329-e185afa41445 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:52.329147 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1ad392d3-ace8-4d1c-a329-e185afa41445 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1307 microversion: 2.1 time: 0.493053 Oct 18 13:25:52.346250 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1123/2128] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:51 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1307 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:52.383418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-de95fd60-91b1-427e-b484-49be87b7b694 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:52.386348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-de95fd60-91b1-427e-b484-49be87b7b694 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:52.401153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de95fd60-91b1-427e-b484-49be87b7b694 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.402037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de95fd60-91b1-427e-b484-49be87b7b694 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.402483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de95fd60-91b1-427e-b484-49be87b7b694 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.406595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de95fd60-91b1-427e-b484-49be87b7b694 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.407122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de95fd60-91b1-427e-b484-49be87b7b694 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.407620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de95fd60-91b1-427e-b484-49be87b7b694 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.519168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1ace3bd6-d15b-4a97-b85a-1b1211924a54 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:52.520539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1ace3bd6-d15b-4a97-b85a-1b1211924a54 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:52.527671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ace3bd6-d15b-4a97-b85a-1b1211924a54 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.528449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ace3bd6-d15b-4a97-b85a-1b1211924a54 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.529058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ace3bd6-d15b-4a97-b85a-1b1211924a54 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.529954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ace3bd6-d15b-4a97-b85a-1b1211924a54 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.530580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ace3bd6-d15b-4a97-b85a-1b1211924a54 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.531176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ace3bd6-d15b-4a97-b85a-1b1211924a54 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.839390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1ace3bd6-d15b-4a97-b85a-1b1211924a54 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:52.849652 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1ace3bd6-d15b-4a97-b85a-1b1211924a54 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 200 len: 1314 microversion: 2.1 time: 0.334406 Oct 18 13:25:52.865582 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1124/2129] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:52 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:52.877028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-60a12c03-2297-4d5b-a7c1-328cc5ee1b1a req-7f935009-dfb4-49b1-85ac-6552aedbcd7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51afbc1-604c-4e86-b301-1716cfeb7671", "tag": "6f25acf6-2339-400d-bece-c17a12a478b2"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:52.907801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-60a12c03-2297-4d5b-a7c1-328cc5ee1b1a req-7f935009-dfb4-49b1-85ac-6552aedbcd7c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.910942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-60a12c03-2297-4d5b-a7c1-328cc5ee1b1a req-7f935009-dfb4-49b1-85ac-6552aedbcd7c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.912343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-60a12c03-2297-4d5b-a7c1-328cc5ee1b1a req-7f935009-dfb4-49b1-85ac-6552aedbcd7c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.927912 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-60a12c03-2297-4d5b-a7c1-328cc5ee1b1a req-7f935009-dfb4-49b1-85ac-6552aedbcd7c service nova] Creating event network-changed:6f25acf6-2339-400d-bece-c17a12a478b2 for instance f51afbc1-604c-4e86-b301-1716cfeb7671 on n-h2-858384-13 Oct 18 13:25:52.934784 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-60a12c03-2297-4d5b-a7c1-328cc5ee1b1a req-7f935009-dfb4-49b1-85ac-6552aedbcd7c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063792 Oct 18 13:25:52.936269 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1125/2130] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:52.942271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8e1002ef-4575-4c72-8739-3b248dbcebee tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:52.943165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8e1002ef-4575-4c72-8739-3b248dbcebee tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:52.947409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-de95fd60-91b1-427e-b484-49be87b7b694 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:52.952712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e1002ef-4575-4c72-8739-3b248dbcebee tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.953230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e1002ef-4575-4c72-8739-3b248dbcebee tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.953825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e1002ef-4575-4c72-8739-3b248dbcebee tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.954676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e1002ef-4575-4c72-8739-3b248dbcebee tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.955274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e1002ef-4575-4c72-8739-3b248dbcebee tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.955843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e1002ef-4575-4c72-8739-3b248dbcebee tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.956496 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-de95fd60-91b1-427e-b484-49be87b7b694 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1359 microversion: 2.1 time: 0.581658 Oct 18 13:25:52.957084 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1006/2131] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:52 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1359 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:52.968883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-107f174d-c2b8-406a-aa1f-af81e8268cc9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:52.972346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-107f174d-c2b8-406a-aa1f-af81e8268cc9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:52.990168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-107f174d-c2b8-406a-aa1f-af81e8268cc9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.990869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-107f174d-c2b8-406a-aa1f-af81e8268cc9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.992000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-107f174d-c2b8-406a-aa1f-af81e8268cc9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:52.993237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-107f174d-c2b8-406a-aa1f-af81e8268cc9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:52.996197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-107f174d-c2b8-406a-aa1f-af81e8268cc9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:52.996823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-107f174d-c2b8-406a-aa1f-af81e8268cc9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.223284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8e1002ef-4575-4c72-8739-3b248dbcebee tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:53.232057 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8e1002ef-4575-4c72-8739-3b248dbcebee tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1315 microversion: 2.1 time: 0.294067 Oct 18 13:25:53.232992 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1126/2132] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:52 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:53.238430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-921f29b5-100f-47e4-a7c3-f73f43b70f20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:53.239235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-921f29b5-100f-47e4-a7c3-f73f43b70f20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: b550c78b-caf6-44ea-a613-978bac95b4fe] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:53.246713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-921f29b5-100f-47e4-a7c3-f73f43b70f20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.247779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-921f29b5-100f-47e4-a7c3-f73f43b70f20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.248422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-921f29b5-100f-47e4-a7c3-f73f43b70f20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.250027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-921f29b5-100f-47e4-a7c3-f73f43b70f20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.250559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-921f29b5-100f-47e4-a7c3-f73f43b70f20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.251070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-921f29b5-100f-47e4-a7c3-f73f43b70f20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.266949 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-921f29b5-100f-47e4-a7c3-f73f43b70f20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] HTTP exception thrown: Instance b550c78b-caf6-44ea-a613-978bac95b4fe could not be found. Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-921f29b5-100f-47e4-a7c3-f73f43b70f20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Request method failure captured: Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe HTTP/1.1 Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqdQGWzxjWOYB2BmOtqiK3h5FWRKKIwXTtFOynE-KVeWbt_rW9ApRvfUq8GC6f4bORMSPG5RCPO8-gi9OtnkbAhZHz2FpsMT026SRBgbeDCTe250zwQABmdhkPLlm1HvpUCxtrr1Uih4XltSzUjBIDSeD2fih8nUgo2_OmddusN9UMI Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: e559a35e21d343adab5f772a17b745f9 Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-853601182 Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:25:53.269000 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:25:53.270380 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e559a35e21d343adab5f772a17b745f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e559a35e21d343adab5f772a17b745f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e559a35e21d343adab5f772a17b745f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e559a35e21d343adab5f772a17b745f9"}]}] Oct 18 13:25:53.270380 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-853601182 Oct 18 13:25:53.270380 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: e559a35e21d343adab5f772a17b745f9 Oct 18 13:25:53.270380 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-853601182 Oct 18 13:25:53.270380 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-LiveAutoBlockMigrationV225Test-853601182-project Oct 18 13:25:53.270380 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:25:53.270380 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:25:53.270380 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1bfaa3d005f94cf2a5bdf8e63d20ba3f Oct 18 13:25:53.270380 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-853601182-project Oct 18 13:25:53.270380 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:25:53.270380 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance b550c78b-caf6-44ea-a613-978bac95b4fe could not be found. Oct 18 13:25:53.270380 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'b550c78b-caf6-44ea-a613-978bac95b4fe'} Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b550c78b-caf6-44ea-a613-978bac95b4fe could not be found. Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:53.271013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b550c78b-caf6-44ea-a613-978bac95b4fe could not be found. Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b550c78b-caf6-44ea-a613-978bac95b4fe could not be found. Oct 18 13:25:53.272160 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:25:53.275348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-921f29b5-100f-47e4-a7c3-f73f43b70f20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Returning 404 to user: Instance b550c78b-caf6-44ea-a613-978bac95b4fe could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:53.276642 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-921f29b5-100f-47e4-a7c3-f73f43b70f20 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe" status: 404 len: 111 microversion: 2.25 time: 0.042477 Oct 18 13:25:53.277866 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1127/2133] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:53 2022] GET /compute/v2.1/servers/b550c78b-caf6-44ea-a613-978bac95b4fe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:25:53.283101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-dde22365-5782-4484-a148-a68dc1f5f9b3 req-ccfce335-e9e1-4829-909d-4fe0b7590362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a52dba4-8897-442b-b15f-4d3185f02add", "name": "network-vif-plugged", "status": "completed", "tag": "347c646b-dc50-4651-a535-bcda2f5df834"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:53.295248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dde22365-5782-4484-a148-a68dc1f5f9b3 req-ccfce335-e9e1-4829-909d-4fe0b7590362 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.296199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dde22365-5782-4484-a148-a68dc1f5f9b3 req-ccfce335-e9e1-4829-909d-4fe0b7590362 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.297251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dde22365-5782-4484-a148-a68dc1f5f9b3 req-ccfce335-e9e1-4829-909d-4fe0b7590362 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.315886 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-dde22365-5782-4484-a148-a68dc1f5f9b3 req-ccfce335-e9e1-4829-909d-4fe0b7590362 service nova] Creating event network-vif-plugged:347c646b-dc50-4651-a535-bcda2f5df834 for instance 3a52dba4-8897-442b-b15f-4d3185f02add on n-h1-858384-13 Oct 18 13:25:53.324817 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-dde22365-5782-4484-a148-a68dc1f5f9b3 req-ccfce335-e9e1-4829-909d-4fe0b7590362 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045151 Oct 18 13:25:53.329564 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1128/2134] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:53.336556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d9e1c9d6-5944-40d4-baf4-a0107ef72d38 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:53.337423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d9e1c9d6-5944-40d4-baf4-a0107ef72d38 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:53.343889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9e1c9d6-5944-40d4-baf4-a0107ef72d38 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.344408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9e1c9d6-5944-40d4-baf4-a0107ef72d38 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.344889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9e1c9d6-5944-40d4-baf4-a0107ef72d38 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.345660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9e1c9d6-5944-40d4-baf4-a0107ef72d38 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.346112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9e1c9d6-5944-40d4-baf4-a0107ef72d38 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.346533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9e1c9d6-5944-40d4-baf4-a0107ef72d38 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.375040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d9e1c9d6-5944-40d4-baf4-a0107ef72d38 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:25:53.441116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-107f174d-c2b8-406a-aa1f-af81e8268cc9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:53.453417 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-107f174d-c2b8-406a-aa1f-af81e8268cc9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1315 microversion: 2.1 time: 0.490084 Oct 18 13:25:53.454204 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1007/2135] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:52 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:53.459843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e283ec57-ef35-4e19-aa24-413cc2f8e664 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:53.461076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e283ec57-ef35-4e19-aa24-413cc2f8e664 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:53.468857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e283ec57-ef35-4e19-aa24-413cc2f8e664 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.470237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e283ec57-ef35-4e19-aa24-413cc2f8e664 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.470708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e283ec57-ef35-4e19-aa24-413cc2f8e664 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.471635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e283ec57-ef35-4e19-aa24-413cc2f8e664 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.472372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e283ec57-ef35-4e19-aa24-413cc2f8e664 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.472808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e283ec57-ef35-4e19-aa24-413cc2f8e664 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.496248 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d9e1c9d6-5944-40d4-baf4-a0107ef72d38 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 204 len: 0 microversion: 2.25 time: 0.164950 Oct 18 13:25:53.497575 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1129/2136] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:25:53 2022] DELETE /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:25:53.504136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9e4a4454-7d01-4520-bb9e-ce5576a2899a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:53.505131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9e4a4454-7d01-4520-bb9e-ce5576a2899a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:53.511511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e4a4454-7d01-4520-bb9e-ce5576a2899a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.512089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e4a4454-7d01-4520-bb9e-ce5576a2899a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.512640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e4a4454-7d01-4520-bb9e-ce5576a2899a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.513566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e4a4454-7d01-4520-bb9e-ce5576a2899a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.514084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e4a4454-7d01-4520-bb9e-ce5576a2899a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.514535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e4a4454-7d01-4520-bb9e-ce5576a2899a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.587972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9e4a4454-7d01-4520-bb9e-ce5576a2899a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:53.600774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9e4a4454-7d01-4520-bb9e-ce5576a2899a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:53.603047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9e4a4454-7d01-4520-bb9e-ce5576a2899a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:53.608815 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9e4a4454-7d01-4520-bb9e-ce5576a2899a tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.109515 Oct 18 13:25:53.609749 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1130/2137] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:53 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:53.614367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba7941f4-999a-43cd-b9c4-795f48d499b8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:53.614976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ba7941f4-999a-43cd-b9c4-795f48d499b8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:53.622126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba7941f4-999a-43cd-b9c4-795f48d499b8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.622619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba7941f4-999a-43cd-b9c4-795f48d499b8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.623061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba7941f4-999a-43cd-b9c4-795f48d499b8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.623768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba7941f4-999a-43cd-b9c4-795f48d499b8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.625155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba7941f4-999a-43cd-b9c4-795f48d499b8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.625619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba7941f4-999a-43cd-b9c4-795f48d499b8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.642906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:53.775933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba7941f4-999a-43cd-b9c4-795f48d499b8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:53.784882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba7941f4-999a-43cd-b9c4-795f48d499b8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:53.786423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba7941f4-999a-43cd-b9c4-795f48d499b8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:53.787782 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ba7941f4-999a-43cd-b9c4-795f48d499b8 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1563 microversion: 2.25 time: 0.177046 Oct 18 13:25:53.789364 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1131/2138] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:53 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:53.878471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d3c23bc0-fcee-4d97-8c25-237f45c4d5c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:53.879390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d3c23bc0-fcee-4d97-8c25-237f45c4d5c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:53.886987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3c23bc0-fcee-4d97-8c25-237f45c4d5c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.887380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3c23bc0-fcee-4d97-8c25-237f45c4d5c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.887820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3c23bc0-fcee-4d97-8c25-237f45c4d5c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:53.889088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3c23bc0-fcee-4d97-8c25-237f45c4d5c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:53.889088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3c23bc0-fcee-4d97-8c25-237f45c4d5c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:53.889558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3c23bc0-fcee-4d97-8c25-237f45c4d5c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.045888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d3c23bc0-fcee-4d97-8c25-237f45c4d5c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:54.055508 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d3c23bc0-fcee-4d97-8c25-237f45c4d5c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 200 len: 1314 microversion: 2.1 time: 0.180923 Oct 18 13:25:54.073164 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1132/2139] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:53 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:54.073164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e40835ed-b476-4ea8-9a42-b7bbea3a7a5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:54.073164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e40835ed-b476-4ea8-9a42-b7bbea3a7a5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:54.073164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40835ed-b476-4ea8-9a42-b7bbea3a7a5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.073164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40835ed-b476-4ea8-9a42-b7bbea3a7a5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.073628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40835ed-b476-4ea8-9a42-b7bbea3a7a5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.073628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40835ed-b476-4ea8-9a42-b7bbea3a7a5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.073628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40835ed-b476-4ea8-9a42-b7bbea3a7a5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.073628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40835ed-b476-4ea8-9a42-b7bbea3a7a5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.135881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e283ec57-ef35-4e19-aa24-413cc2f8e664 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:54.145406 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e283ec57-ef35-4e19-aa24-413cc2f8e664 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1487 microversion: 2.1 time: 0.689358 Oct 18 13:25:54.146716 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1008/2140] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:53 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1487 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:54.152605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-625d0707-cdad-42be-81a3-a49054a8b0d8 req-e563f98f-86c1-4df2-aced-0d17e36cae50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f4088c-c321-4fc1-8bec-456d1178cda7", "tag": "7732437d-47a0-4c99-8e68-a24b9d4ee37d"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:54.164146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-625d0707-cdad-42be-81a3-a49054a8b0d8 req-e563f98f-86c1-4df2-aced-0d17e36cae50 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.164620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-625d0707-cdad-42be-81a3-a49054a8b0d8 req-e563f98f-86c1-4df2-aced-0d17e36cae50 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.165044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-625d0707-cdad-42be-81a3-a49054a8b0d8 req-e563f98f-86c1-4df2-aced-0d17e36cae50 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.177172 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-625d0707-cdad-42be-81a3-a49054a8b0d8 req-e563f98f-86c1-4df2-aced-0d17e36cae50 service nova] Creating event network-changed:7732437d-47a0-4c99-8e68-a24b9d4ee37d for instance e1f4088c-c321-4fc1-8bec-456d1178cda7 on n-h2-858384-13 Oct 18 13:25:54.183611 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-625d0707-cdad-42be-81a3-a49054a8b0d8 req-e563f98f-86c1-4df2-aced-0d17e36cae50 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035584 Oct 18 13:25:54.184218 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1009/2141] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:54.189567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f42be5e0-c4fa-4c22-b9d3-8bf556aae4bd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Action: 'create', calling method: .version_select at 0x7ff60f0555e0>, body: {"keypair": {"name": "tempest-keypair-1467706171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9lVTTumlB7jrhV+I9ND6G2xhOfPCRi7dFMOjgGZsi3xvtIukt9NrMeDIR6lvDQIbbg81SaSiYeup/rFfIpbk2sRYb8LdwQQwHcqlEPP9DWCMmr1hsAHrvdDy4YhWtP8g=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:54.204094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=29 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:54.206658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-f42be5e0-c4fa-4c22-b9d3-8bf556aae4bd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Getting quotas for project 19e1c317d0a34148949ddddadffb4415. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:25:54.213431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-f42be5e0-c4fa-4c22-b9d3-8bf556aae4bd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Getting quotas for user f3922bd65ede4e2586d23741b8ac19a1 and project 19e1c317d0a34148949ddddadffb4415. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:25:54.243897 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f42be5e0-c4fa-4c22-b9d3-8bf556aae4bd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.058469 Oct 18 13:25:54.244644 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1010/2142] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 18 13:25:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 13:25:54.251818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b0fe78c3-4cc3-4d95-9981-66e5954201cb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:54.252950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b0fe78c3-4cc3-4d95-9981-66e5954201cb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:54.253065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e40835ed-b476-4ea8-9a42-b7bbea3a7a5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:54.263669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0fe78c3-4cc3-4d95-9981-66e5954201cb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.264292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0fe78c3-4cc3-4d95-9981-66e5954201cb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.264803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0fe78c3-4cc3-4d95-9981-66e5954201cb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.265638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0fe78c3-4cc3-4d95-9981-66e5954201cb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.266157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0fe78c3-4cc3-4d95-9981-66e5954201cb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.266653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0fe78c3-4cc3-4d95-9981-66e5954201cb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.267494 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e40835ed-b476-4ea8-9a42-b7bbea3a7a5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1359 microversion: 2.1 time: 0.210178 Oct 18 13:25:54.268284 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1133/2143] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:54 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:54.273451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b5ceb296-767c-4854-a9c7-44572838367b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:54.273451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b5ceb296-767c-4854-a9c7-44572838367b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:54.284207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5ceb296-767c-4854-a9c7-44572838367b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.284696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5ceb296-767c-4854-a9c7-44572838367b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.285135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5ceb296-767c-4854-a9c7-44572838367b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.285994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5ceb296-767c-4854-a9c7-44572838367b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.286459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5ceb296-767c-4854-a9c7-44572838367b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.286906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5ceb296-767c-4854-a9c7-44572838367b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.315303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b0fe78c3-4cc3-4d95-9981-66e5954201cb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:25:54.406455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:54.411910 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b0fe78c3-4cc3-4d95-9981-66e5954201cb tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 204 len: 0 microversion: 2.1 time: 0.165263 Oct 18 13:25:54.412792 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1011/2144] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:25:54 2022] DELETE /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:25:54.423565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a21790a6-5d53-4976-b5a7-408735410916 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:54.424399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a21790a6-5d53-4976-b5a7-408735410916 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:54.432008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a21790a6-5d53-4976-b5a7-408735410916 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.432488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a21790a6-5d53-4976-b5a7-408735410916 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.432922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a21790a6-5d53-4976-b5a7-408735410916 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.433671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a21790a6-5d53-4976-b5a7-408735410916 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.434107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a21790a6-5d53-4976-b5a7-408735410916 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.434508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a21790a6-5d53-4976-b5a7-408735410916 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.523830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b5ceb296-767c-4854-a9c7-44572838367b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:54.539866 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b5ceb296-767c-4854-a9c7-44572838367b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1315 microversion: 2.1 time: 0.270259 Oct 18 13:25:54.540782 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1134/2145] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:54 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:54.547332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-679da691-ca55-47dd-b47b-aef929cc18f3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:54.548364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-679da691-ca55-47dd-b47b-aef929cc18f3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:54.562971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-679da691-ca55-47dd-b47b-aef929cc18f3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.565855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-679da691-ca55-47dd-b47b-aef929cc18f3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.566821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-679da691-ca55-47dd-b47b-aef929cc18f3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.567371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-679da691-ca55-47dd-b47b-aef929cc18f3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.568323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-679da691-ca55-47dd-b47b-aef929cc18f3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.568792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-679da691-ca55-47dd-b47b-aef929cc18f3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.729377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a21790a6-5d53-4976-b5a7-408735410916 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:54.744598 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a21790a6-5d53-4976-b5a7-408735410916 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1493 microversion: 2.1 time: 0.326680 Oct 18 13:25:54.748707 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1012/2146] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:54 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1493 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:54.755803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b8a6530d-4a08-4a76-846c-952a359b6d58 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:54.756747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b8a6530d-4a08-4a76-846c-952a359b6d58 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:54.766946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-679da691-ca55-47dd-b47b-aef929cc18f3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:54.778127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8a6530d-4a08-4a76-846c-952a359b6d58 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.778623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8a6530d-4a08-4a76-846c-952a359b6d58 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.779060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8a6530d-4a08-4a76-846c-952a359b6d58 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.785855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8a6530d-4a08-4a76-846c-952a359b6d58 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.786378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8a6530d-4a08-4a76-846c-952a359b6d58 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.786828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8a6530d-4a08-4a76-846c-952a359b6d58 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.789311 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-679da691-ca55-47dd-b47b-aef929cc18f3 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1315 microversion: 2.1 time: 0.247187 Oct 18 13:25:54.793374 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1135/2147] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:54 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:54.814677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b30b00f9-8f45-49e5-bd13-e9ef7c6f1d5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:54.815538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b30b00f9-8f45-49e5-bd13-e9ef7c6f1d5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:54.818634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:54.825131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b30b00f9-8f45-49e5-bd13-e9ef7c6f1d5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.828842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b30b00f9-8f45-49e5-bd13-e9ef7c6f1d5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.830335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b30b00f9-8f45-49e5-bd13-e9ef7c6f1d5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.831278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b30b00f9-8f45-49e5-bd13-e9ef7c6f1d5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:54.833606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b30b00f9-8f45-49e5-bd13-e9ef7c6f1d5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:54.834409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b30b00f9-8f45-49e5-bd13-e9ef7c6f1d5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:54.889118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b8a6530d-4a08-4a76-846c-952a359b6d58 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:54.900681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b8a6530d-4a08-4a76-846c-952a359b6d58 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:54.906003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b8a6530d-4a08-4a76-846c-952a359b6d58 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:54.913059 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b8a6530d-4a08-4a76-846c-952a359b6d58 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.163033 Oct 18 13:25:54.928360 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1013/2148] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:54 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:55.081737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-877d8d83-bcf3-4a55-aa43-81e9e8e30acf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:55.082729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-877d8d83-bcf3-4a55-aa43-81e9e8e30acf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:55.091583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-877d8d83-bcf3-4a55-aa43-81e9e8e30acf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.092178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-877d8d83-bcf3-4a55-aa43-81e9e8e30acf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.092686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-877d8d83-bcf3-4a55-aa43-81e9e8e30acf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.093534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-877d8d83-bcf3-4a55-aa43-81e9e8e30acf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.094056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-877d8d83-bcf3-4a55-aa43-81e9e8e30acf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.094674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-877d8d83-bcf3-4a55-aa43-81e9e8e30acf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.333947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b30b00f9-8f45-49e5-bd13-e9ef7c6f1d5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:55.344498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b30b00f9-8f45-49e5-bd13-e9ef7c6f1d5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:55.346656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b30b00f9-8f45-49e5-bd13-e9ef7c6f1d5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:55.348315 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b30b00f9-8f45-49e5-bd13-e9ef7c6f1d5a tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1563 microversion: 2.25 time: 0.537759 Oct 18 13:25:55.348887 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1136/2149] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:54 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1563 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:55.373237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-33789e99-178a-4e68-8d1a-bb5c5c9d2ada tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:55.374010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-33789e99-178a-4e68-8d1a-bb5c5c9d2ada tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:55.380729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33789e99-178a-4e68-8d1a-bb5c5c9d2ada tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.381455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33789e99-178a-4e68-8d1a-bb5c5c9d2ada tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.382614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33789e99-178a-4e68-8d1a-bb5c5c9d2ada tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.383508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33789e99-178a-4e68-8d1a-bb5c5c9d2ada tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.384110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33789e99-178a-4e68-8d1a-bb5c5c9d2ada tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.384724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33789e99-178a-4e68-8d1a-bb5c5c9d2ada tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.387412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-877d8d83-bcf3-4a55-aa43-81e9e8e30acf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:55.412890 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-877d8d83-bcf3-4a55-aa43-81e9e8e30acf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 200 len: 1314 microversion: 2.1 time: 0.335531 Oct 18 13:25:55.414425 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1014/2150] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:55 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:55.572252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3a8c7d87-d121-4021-947c-a04293f3fe65 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:55.574090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3a8c7d87-d121-4021-947c-a04293f3fe65 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:55.588054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a8c7d87-d121-4021-947c-a04293f3fe65 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.588882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a8c7d87-d121-4021-947c-a04293f3fe65 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.590561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a8c7d87-d121-4021-947c-a04293f3fe65 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.591587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a8c7d87-d121-4021-947c-a04293f3fe65 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.592389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a8c7d87-d121-4021-947c-a04293f3fe65 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.593326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a8c7d87-d121-4021-947c-a04293f3fe65 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.672473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-33789e99-178a-4e68-8d1a-bb5c5c9d2ada tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:55.692626 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-33789e99-178a-4e68-8d1a-bb5c5c9d2ada tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1359 microversion: 2.1 time: 0.329865 Oct 18 13:25:55.693943 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1137/2151] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:55 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1359 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:55.772331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fb375826-dc47-4391-8b11-bb65410acadf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:55.773887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb375826-dc47-4391-8b11-bb65410acadf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:55.783192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb375826-dc47-4391-8b11-bb65410acadf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.785648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb375826-dc47-4391-8b11-bb65410acadf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.786646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb375826-dc47-4391-8b11-bb65410acadf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.788020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb375826-dc47-4391-8b11-bb65410acadf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.789212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb375826-dc47-4391-8b11-bb65410acadf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.789984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb375826-dc47-4391-8b11-bb65410acadf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.924139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3a8c7d87-d121-4021-947c-a04293f3fe65 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:55.936101 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3a8c7d87-d121-4021-947c-a04293f3fe65 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1315 microversion: 2.1 time: 0.368600 Oct 18 13:25:55.936811 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1015/2152] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:55 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:55.943089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-47cfb522-7b24-40f1-895c-4e002698027a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:55.943918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-47cfb522-7b24-40f1-895c-4e002698027a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:55.959134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47cfb522-7b24-40f1-895c-4e002698027a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.959894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47cfb522-7b24-40f1-895c-4e002698027a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.960763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47cfb522-7b24-40f1-895c-4e002698027a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:55.961702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47cfb522-7b24-40f1-895c-4e002698027a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:55.962362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47cfb522-7b24-40f1-895c-4e002698027a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:55.962997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47cfb522-7b24-40f1-895c-4e002698027a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.075518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fb375826-dc47-4391-8b11-bb65410acadf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:56.093140 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fb375826-dc47-4391-8b11-bb65410acadf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1493 microversion: 2.1 time: 0.326749 Oct 18 13:25:56.109936 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1138/2153] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:55 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1493 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:56.109936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-afe6f26a-cbe7-45b4-92f2-77fbbcdd7fa4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:56.109936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-afe6f26a-cbe7-45b4-92f2-77fbbcdd7fa4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:56.109936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afe6f26a-cbe7-45b4-92f2-77fbbcdd7fa4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.110817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afe6f26a-cbe7-45b4-92f2-77fbbcdd7fa4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.110817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afe6f26a-cbe7-45b4-92f2-77fbbcdd7fa4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.110817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afe6f26a-cbe7-45b4-92f2-77fbbcdd7fa4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.111105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afe6f26a-cbe7-45b4-92f2-77fbbcdd7fa4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.111527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afe6f26a-cbe7-45b4-92f2-77fbbcdd7fa4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.173875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-47cfb522-7b24-40f1-895c-4e002698027a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:56.184856 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-47cfb522-7b24-40f1-895c-4e002698027a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1503 microversion: 2.1 time: 0.246629 Oct 18 13:25:56.186058 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1016/2154] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:55 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1503 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:56.207432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d76af4ce-7d68-4484-9f25-99c42871f980 req-f2abeebe-24d7-48ab-affb-8db6a5411883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157af106-c39d-428a-9cd7-1d37cd98bfcc", "tag": "eade7ea5-b653-468d-aaa4-2b40848f80bd"}, {"server_uuid": "1612cfab-edd0-4df2-90f2-79a1c541ca90", "name": "network-vif-deleted", "tag": "7989e920-3ad6-4f7c-9ee5-6755d27b3383"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:56.223011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d76af4ce-7d68-4484-9f25-99c42871f980 req-f2abeebe-24d7-48ab-affb-8db6a5411883 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.223487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d76af4ce-7d68-4484-9f25-99c42871f980 req-f2abeebe-24d7-48ab-affb-8db6a5411883 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.223980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d76af4ce-7d68-4484-9f25-99c42871f980 req-f2abeebe-24d7-48ab-affb-8db6a5411883 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.239009 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d76af4ce-7d68-4484-9f25-99c42871f980 req-f2abeebe-24d7-48ab-affb-8db6a5411883 service nova] Creating event network-changed:eade7ea5-b653-468d-aaa4-2b40848f80bd for instance 157af106-c39d-428a-9cd7-1d37cd98bfcc on n-h2-858384-13 Oct 18 13:25:56.239541 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d76af4ce-7d68-4484-9f25-99c42871f980 req-f2abeebe-24d7-48ab-affb-8db6a5411883 service nova] Creating event network-vif-deleted:7989e920-3ad6-4f7c-9ee5-6755d27b3383 for instance 1612cfab-edd0-4df2-90f2-79a1c541ca90 on n-h1-858384-13 Oct 18 13:25:56.248785 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d76af4ce-7d68-4484-9f25-99c42871f980 req-f2abeebe-24d7-48ab-affb-8db6a5411883 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050757 Oct 18 13:25:56.249934 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1017/2155] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:56.255181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-20708edf-4fa6-41bb-81c7-76bd3c6b1cb2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:56.255856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-20708edf-4fa6-41bb-81c7-76bd3c6b1cb2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:56.261440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:56.263601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20708edf-4fa6-41bb-81c7-76bd3c6b1cb2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.264252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20708edf-4fa6-41bb-81c7-76bd3c6b1cb2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.264715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20708edf-4fa6-41bb-81c7-76bd3c6b1cb2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.265426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20708edf-4fa6-41bb-81c7-76bd3c6b1cb2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.265940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20708edf-4fa6-41bb-81c7-76bd3c6b1cb2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.266362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20708edf-4fa6-41bb-81c7-76bd3c6b1cb2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.269140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-afe6f26a-cbe7-45b4-92f2-77fbbcdd7fa4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:56.281241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-afe6f26a-cbe7-45b4-92f2-77fbbcdd7fa4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:56.282704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-afe6f26a-cbe7-45b4-92f2-77fbbcdd7fa4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:56.291067 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-afe6f26a-cbe7-45b4-92f2-77fbbcdd7fa4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.196013 Oct 18 13:25:56.305797 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1139/2156] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:56 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:56.323602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-20708edf-4fa6-41bb-81c7-76bd3c6b1cb2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lazy-loading 'flavor' on Instance uuid 3a52dba4-8897-442b-b15f-4d3185f02add {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:56.379603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:56.380409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:56.395296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.395884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.396586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.397609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.398860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.399481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.471211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.471503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.472139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.478806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lazy-loading 'fault' on Instance uuid 1612cfab-edd0-4df2-90f2-79a1c541ca90 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:25:56.507147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:56.555321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:56.620437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:56.634306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:56.637450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bfaa3d005f94cf2a5bdf8e63d20ba3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e559a35e21d343adab5f772a17b745f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:56.646277 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9759a67f-43cd-4815-8ede-6b0bca1ec4d0 tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 200 len: 1351 microversion: 2.25 time: 0.266285 Oct 18 13:25:56.649983 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-20708edf-4fa6-41bb-81c7-76bd3c6b1cb2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "POST /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add/action" status: 202 len: 0 microversion: 2.1 time: 0.398514 Oct 18 13:25:56.656369 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1018/2157] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:25:56 2022] POST /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:25:56.657850 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1140/2158] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:56 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 1351 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:56.672633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c0a93fe-635e-435e-84d8-b6fa0e27da01 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:56.673281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7c0a93fe-635e-435e-84d8-b6fa0e27da01 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:56.674784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d73bd58d-1a68-4023-8178-d295c971c54a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:56.680904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c0a93fe-635e-435e-84d8-b6fa0e27da01 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.681399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d73bd58d-1a68-4023-8178-d295c971c54a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:56.681823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c0a93fe-635e-435e-84d8-b6fa0e27da01 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.682440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c0a93fe-635e-435e-84d8-b6fa0e27da01 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.683339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c0a93fe-635e-435e-84d8-b6fa0e27da01 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.683980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c0a93fe-635e-435e-84d8-b6fa0e27da01 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.684761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c0a93fe-635e-435e-84d8-b6fa0e27da01 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.708618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d73bd58d-1a68-4023-8178-d295c971c54a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.713394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d73bd58d-1a68-4023-8178-d295c971c54a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.714072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d73bd58d-1a68-4023-8178-d295c971c54a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.719376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d73bd58d-1a68-4023-8178-d295c971c54a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:56.720046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d73bd58d-1a68-4023-8178-d295c971c54a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:56.720663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d73bd58d-1a68-4023-8178-d295c971c54a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:56.768776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:25:57.093146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d73bd58d-1a68-4023-8178-d295c971c54a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:57.104773 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d73bd58d-1a68-4023-8178-d295c971c54a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 200 len: 1314 microversion: 2.1 time: 0.445685 Oct 18 13:25:57.108225 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1019/2159] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:56 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:57.120800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd8a4f82-2f9d-44f5-bc0d-bbcb8dd1614e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:57.123669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fd8a4f82-2f9d-44f5-bc0d-bbcb8dd1614e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:57.138501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd8a4f82-2f9d-44f5-bc0d-bbcb8dd1614e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.140706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd8a4f82-2f9d-44f5-bc0d-bbcb8dd1614e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.141445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd8a4f82-2f9d-44f5-bc0d-bbcb8dd1614e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.143555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd8a4f82-2f9d-44f5-bc0d-bbcb8dd1614e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.145163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd8a4f82-2f9d-44f5-bc0d-bbcb8dd1614e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.146766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd8a4f82-2f9d-44f5-bc0d-bbcb8dd1614e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.159212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7c0a93fe-635e-435e-84d8-b6fa0e27da01 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:57.172580 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7c0a93fe-635e-435e-84d8-b6fa0e27da01 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1509 microversion: 2.1 time: 0.511798 Oct 18 13:25:57.176087 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1141/2160] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:56 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1509 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:57.187475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d6fc4303-d847-4ab6-8679-db3462336ef1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:57.188548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d6fc4303-d847-4ab6-8679-db3462336ef1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:57.200134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6fc4303-d847-4ab6-8679-db3462336ef1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.201656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6fc4303-d847-4ab6-8679-db3462336ef1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.203085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6fc4303-d847-4ab6-8679-db3462336ef1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.204052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6fc4303-d847-4ab6-8679-db3462336ef1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.206793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6fc4303-d847-4ab6-8679-db3462336ef1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.208167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6fc4303-d847-4ab6-8679-db3462336ef1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.547474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fd8a4f82-2f9d-44f5-bc0d-bbcb8dd1614e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:57.586114 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fd8a4f82-2f9d-44f5-bc0d-bbcb8dd1614e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1359 microversion: 2.1 time: 0.472134 Oct 18 13:25:57.587971 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1020/2161] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:57 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1359 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:57.603505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d6fc4303-d847-4ab6-8679-db3462336ef1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:57.605858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e7277a9f-c562-4b94-b47b-8fe5e5b776a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:57.606661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e7277a9f-c562-4b94-b47b-8fe5e5b776a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:57.611372 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d6fc4303-d847-4ab6-8679-db3462336ef1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1315 microversion: 2.1 time: 0.433336 Oct 18 13:25:57.613578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7277a9f-c562-4b94-b47b-8fe5e5b776a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.614266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7277a9f-c562-4b94-b47b-8fe5e5b776a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.622528 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1142/2162] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:57 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:57.628424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7277a9f-c562-4b94-b47b-8fe5e5b776a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.629204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7277a9f-c562-4b94-b47b-8fe5e5b776a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.629667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7277a9f-c562-4b94-b47b-8fe5e5b776a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.630092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7277a9f-c562-4b94-b47b-8fe5e5b776a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.633646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-739cc562-118a-4f06-a33e-7f9a5246d859 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:57.634354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-739cc562-118a-4f06-a33e-7f9a5246d859 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:57.641239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-739cc562-118a-4f06-a33e-7f9a5246d859 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.641822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-739cc562-118a-4f06-a33e-7f9a5246d859 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.642449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-739cc562-118a-4f06-a33e-7f9a5246d859 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.643466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-739cc562-118a-4f06-a33e-7f9a5246d859 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.644184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-739cc562-118a-4f06-a33e-7f9a5246d859 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.644820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-739cc562-118a-4f06-a33e-7f9a5246d859 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.723522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-739cc562-118a-4f06-a33e-7f9a5246d859 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:57.732453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-739cc562-118a-4f06-a33e-7f9a5246d859 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:57.734203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-739cc562-118a-4f06-a33e-7f9a5246d859 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:57.739301 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-739cc562-118a-4f06-a33e-7f9a5246d859 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.115763 Oct 18 13:25:57.739881 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1143/2163] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:57 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:25:57.748154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-496109293", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f52bdaf2-fe11-4a9c-9a6d-e39aa386dc17"}, {"port": "ef5c7c5f-a59a-4ff2-ac9a-1bcbff29af46", "tag": "port-1"}, {"port": "0f89053d-88e6-469d-961b-4f3a032c7321", "tag": "port-2"}, {"uuid": "d2b07948-fd86-4dfa-83c2-6e578724b514", "tag": "net-1"}, {"uuid": "d2b07948-fd86-4dfa-83c2-6e578724b514"}, {"uuid": "18c1993c-4292-475e-9039-f32ff5ea53c9", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "18c1993c-4292-475e-9039-f32ff5ea53c9", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b9db83ba-7386-46d3-a9bf-4a07fbc53143", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "780afa7e-bd1b-43b8-9518-bc42c9b7ddfa", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "067748f9-5bae-4364-913c-fc8543bc3431", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--695549053"}], "key_name": "tempest-keypair-1467706171", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:57.875246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] validate_networks() for [('f52bdaf2-fe11-4a9c-9a6d-e39aa386dc17', None, None, None, None, None), (None, None, 'ef5c7c5f-a59a-4ff2-ac9a-1bcbff29af46', None, None, None), (None, None, '0f89053d-88e6-469d-961b-4f3a032c7321', None, None, None), ('d2b07948-fd86-4dfa-83c2-6e578724b514', None, None, None, None, None), ('d2b07948-fd86-4dfa-83c2-6e578724b514', None, None, None, None, None), ('18c1993c-4292-475e-9039-f32ff5ea53c9', '10.2.2.100', None, None, None, None), ('18c1993c-4292-475e-9039-f32ff5ea53c9', '10.2.2.200', None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:25:57.891864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e7277a9f-c562-4b94-b47b-8fe5e5b776a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:57.901001 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e7277a9f-c562-4b94-b47b-8fe5e5b776a6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 200 len: 1493 microversion: 2.1 time: 0.309359 Oct 18 13:25:57.901545 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1021/2164] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:57 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 1493 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:57.917825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dcac81a2-7eb9-4303-b1bd-8828210fae6d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:57.918751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dcac81a2-7eb9-4303-b1bd-8828210fae6d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] [instance: 1612cfab-edd0-4df2-90f2-79a1c541ca90] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:57.926100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcac81a2-7eb9-4303-b1bd-8828210fae6d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.926597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcac81a2-7eb9-4303-b1bd-8828210fae6d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.927033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcac81a2-7eb9-4303-b1bd-8828210fae6d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.928566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcac81a2-7eb9-4303-b1bd-8828210fae6d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:57.928657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcac81a2-7eb9-4303-b1bd-8828210fae6d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:57.929055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcac81a2-7eb9-4303-b1bd-8828210fae6d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:57.947622 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-dcac81a2-7eb9-4303-b1bd-8828210fae6d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] HTTP exception thrown: Instance 1612cfab-edd0-4df2-90f2-79a1c541ca90 could not be found. Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dcac81a2-7eb9-4303-b1bd-8828210fae6d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Request method failure captured: Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 HTTP/1.1 Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqdQGWzxjWOYB2BmOtqiK3h5FWRKKIwXTtFOynE-KVeWbt_rW9ApRvfUq8GC6f4bORMSPG5RCPO8-gi9OtnkbAhZHz2FpsMT026SRBgbeDCTe250zwQABmdhkPLlm1HvpUCxtrr1Uih4XltSzUjBIDSeD2fih8nUgo2_OmddusN9UMI Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.25 Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: e559a35e21d343adab5f772a17b745f9 Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-853601182 Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:25:57.949432 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:25:57.950644 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e559a35e21d343adab5f772a17b745f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e559a35e21d343adab5f772a17b745f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e559a35e21d343adab5f772a17b745f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e559a35e21d343adab5f772a17b745f9"}]}] Oct 18 13:25:57.950644 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-853601182 Oct 18 13:25:57.950644 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: e559a35e21d343adab5f772a17b745f9 Oct 18 13:25:57.950644 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-853601182 Oct 18 13:25:57.950644 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-LiveAutoBlockMigrationV225Test-853601182-project Oct 18 13:25:57.950644 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:25:57.950644 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:25:57.950644 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 1bfaa3d005f94cf2a5bdf8e63d20ba3f Oct 18 13:25:57.950644 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-853601182-project Oct 18 13:25:57.950644 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:25:57.950644 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 1612cfab-edd0-4df2-90f2-79a1c541ca90 could not be found. Oct 18 13:25:57.950644 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '1612cfab-edd0-4df2-90f2-79a1c541ca90'} Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1612cfab-edd0-4df2-90f2-79a1c541ca90 could not be found. Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:25:57.951465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1612cfab-edd0-4df2-90f2-79a1c541ca90 could not be found. Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1612cfab-edd0-4df2-90f2-79a1c541ca90 could not be found. Oct 18 13:25:57.952491 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:25:57.953402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dcac81a2-7eb9-4303-b1bd-8828210fae6d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] Returning 404 to user: Instance 1612cfab-edd0-4df2-90f2-79a1c541ca90 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:25:57.953402 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dcac81a2-7eb9-4303-b1bd-8828210fae6d tempest-LiveAutoBlockMigrationV225Test-853601182 tempest-LiveAutoBlockMigrationV225Test-853601182-project] 10.222.0.40 "GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90" status: 404 len: 111 microversion: 2.25 time: 0.037328 Oct 18 13:25:57.963767 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1022/2165] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:57 2022] GET /compute/v2.1/servers/1612cfab-edd0-4df2-90f2-79a1c541ca90 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:25:58.131906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c4c4fed6-38f1-4dd8-b8f3-867d209b0b67 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:58.133314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c4c4fed6-38f1-4dd8-b8f3-867d209b0b67 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:58.139508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4c4fed6-38f1-4dd8-b8f3-867d209b0b67 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:58.139982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4c4fed6-38f1-4dd8-b8f3-867d209b0b67 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:58.140413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4c4fed6-38f1-4dd8-b8f3-867d209b0b67 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:58.141100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4c4fed6-38f1-4dd8-b8f3-867d209b0b67 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:58.141572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4c4fed6-38f1-4dd8-b8f3-867d209b0b67 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:58.141992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4c4fed6-38f1-4dd8-b8f3-867d209b0b67 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:58.380999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c4c4fed6-38f1-4dd8-b8f3-867d209b0b67 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:58.401791 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c4c4fed6-38f1-4dd8-b8f3-867d209b0b67 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 200 len: 1314 microversion: 2.1 time: 0.273907 Oct 18 13:25:58.402389 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1023/2166] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:58 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:25:58.416601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a3ad61f3-1b77-4c3f-9626-ca516e3b4b02 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:58.417973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a3ad61f3-1b77-4c3f-9626-ca516e3b4b02 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:58.425032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3ad61f3-1b77-4c3f-9626-ca516e3b4b02 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:58.426548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3ad61f3-1b77-4c3f-9626-ca516e3b4b02 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:58.426997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3ad61f3-1b77-4c3f-9626-ca516e3b4b02 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:58.430212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3ad61f3-1b77-4c3f-9626-ca516e3b4b02 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:58.430710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3ad61f3-1b77-4c3f-9626-ca516e3b4b02 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:58.431153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3ad61f3-1b77-4c3f-9626-ca516e3b4b02 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:58.784385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a3ad61f3-1b77-4c3f-9626-ca516e3b4b02 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:58.797166 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a3ad61f3-1b77-4c3f-9626-ca516e3b4b02 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1509 microversion: 2.1 time: 0.386968 Oct 18 13:25:58.814821 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1024/2167] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:58 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1509 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:58.820185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7992eaec-efb4-48ee-beca-ca43c3c23fd2 req-8db199cb-e384-4403-8d5e-19b31f1d2257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22298178-3c70-4617-8c26-bcbecf59552f", "name": "network-vif-deleted", "tag": "2bffc881-fcd0-4a95-9bb6-5fa76676fff1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:58.858959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7992eaec-efb4-48ee-beca-ca43c3c23fd2 req-8db199cb-e384-4403-8d5e-19b31f1d2257 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:58.859759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7992eaec-efb4-48ee-beca-ca43c3c23fd2 req-8db199cb-e384-4403-8d5e-19b31f1d2257 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:58.860910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7992eaec-efb4-48ee-beca-ca43c3c23fd2 req-8db199cb-e384-4403-8d5e-19b31f1d2257 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:58.874770 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7992eaec-efb4-48ee-beca-ca43c3c23fd2 req-8db199cb-e384-4403-8d5e-19b31f1d2257 service nova] Creating event network-vif-deleted:2bffc881-fcd0-4a95-9bb6-5fa76676fff1 for instance 22298178-3c70-4617-8c26-bcbecf59552f on n-h2-858384-13 Oct 18 13:25:58.881853 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7992eaec-efb4-48ee-beca-ca43c3c23fd2 req-8db199cb-e384-4403-8d5e-19b31f1d2257 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065315 Oct 18 13:25:58.883254 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1025/2168] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:58.889747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-34fa95f1-3703-4d8d-8c26-817705a259c7 req-65590dc4-65d8-4232-9bad-e2191a62b92e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f4088c-c321-4fc1-8bec-456d1178cda7", "name": "network-vif-plugged", "status": "completed", "tag": "7732437d-47a0-4c99-8e68-a24b9d4ee37d"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:25:58.914440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-34fa95f1-3703-4d8d-8c26-817705a259c7 req-65590dc4-65d8-4232-9bad-e2191a62b92e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:58.925733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-34fa95f1-3703-4d8d-8c26-817705a259c7 req-65590dc4-65d8-4232-9bad-e2191a62b92e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:58.926779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-34fa95f1-3703-4d8d-8c26-817705a259c7 req-65590dc4-65d8-4232-9bad-e2191a62b92e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:58.944819 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-34fa95f1-3703-4d8d-8c26-817705a259c7 req-65590dc4-65d8-4232-9bad-e2191a62b92e service nova] Creating event network-vif-plugged:7732437d-47a0-4c99-8e68-a24b9d4ee37d for instance e1f4088c-c321-4fc1-8bec-456d1178cda7 on n-h2-858384-13 Oct 18 13:25:58.954595 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-34fa95f1-3703-4d8d-8c26-817705a259c7 req-65590dc4-65d8-4232-9bad-e2191a62b92e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069799 Oct 18 13:25:58.955970 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1026/2169] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:25:58.963644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-38492dae-a744-4c04-ba91-f3349001ed22 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:58.965096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-38492dae-a744-4c04-ba91-f3349001ed22 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:58.973753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38492dae-a744-4c04-ba91-f3349001ed22 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:58.974623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38492dae-a744-4c04-ba91-f3349001ed22 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:58.976374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38492dae-a744-4c04-ba91-f3349001ed22 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:58.977785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38492dae-a744-4c04-ba91-f3349001ed22 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:58.978516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38492dae-a744-4c04-ba91-f3349001ed22 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:58.979096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38492dae-a744-4c04-ba91-f3349001ed22 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:59.263762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-38492dae-a744-4c04-ba91-f3349001ed22 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:59.285308 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-38492dae-a744-4c04-ba91-f3349001ed22 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1359 microversion: 2.1 time: 0.325058 Oct 18 13:25:59.301562 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1027/2170] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:58 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:59.309628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d6f2f042-cf06-4456-ad90-2e8442a808a1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:59.310678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d6f2f042-cf06-4456-ad90-2e8442a808a1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:59.321758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6f2f042-cf06-4456-ad90-2e8442a808a1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:59.330715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6f2f042-cf06-4456-ad90-2e8442a808a1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:59.331517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6f2f042-cf06-4456-ad90-2e8442a808a1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:59.332458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6f2f042-cf06-4456-ad90-2e8442a808a1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:59.333109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6f2f042-cf06-4456-ad90-2e8442a808a1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:59.333767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6f2f042-cf06-4456-ad90-2e8442a808a1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:59.832901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d6f2f042-cf06-4456-ad90-2e8442a808a1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:59.844354 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d6f2f042-cf06-4456-ad90-2e8442a808a1 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1315 microversion: 2.1 time: 0.540244 Oct 18 13:25:59.862045 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1028/2171] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:25:59 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:25:59.872847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a4d3740c-7259-41c0-b66d-e0de04cf7ff4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:25:59.874066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a4d3740c-7259-41c0-b66d-e0de04cf7ff4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:25:59.880632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4d3740c-7259-41c0-b66d-e0de04cf7ff4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:59.881115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4d3740c-7259-41c0-b66d-e0de04cf7ff4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:59.881595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4d3740c-7259-41c0-b66d-e0de04cf7ff4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:59.882835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4d3740c-7259-41c0-b66d-e0de04cf7ff4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:25:59.883291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4d3740c-7259-41c0-b66d-e0de04cf7ff4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:25:59.883719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4d3740c-7259-41c0-b66d-e0de04cf7ff4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:25:59.979673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a4d3740c-7259-41c0-b66d-e0de04cf7ff4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:59.990512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a4d3740c-7259-41c0-b66d-e0de04cf7ff4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:25:59.993079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a4d3740c-7259-41c0-b66d-e0de04cf7ff4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:00.000373 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a4d3740c-7259-41c0-b66d-e0de04cf7ff4 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1558 microversion: 2.91 time: 0.133643 Oct 18 13:26:00.001542 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1029/2172] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:25:59 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1558 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:00.006565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b2326389-8354-4cde-affd-603d2c47de7b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:00.008188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b2326389-8354-4cde-affd-603d2c47de7b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:00.016374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2326389-8354-4cde-affd-603d2c47de7b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:00.018062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2326389-8354-4cde-affd-603d2c47de7b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:00.018731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2326389-8354-4cde-affd-603d2c47de7b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:00.019805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2326389-8354-4cde-affd-603d2c47de7b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:00.021213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2326389-8354-4cde-affd-603d2c47de7b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:00.021790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2326389-8354-4cde-affd-603d2c47de7b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:00.040814 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-b2326389-8354-4cde-affd-603d2c47de7b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b2326389-8354-4cde-affd-603d2c47de7b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f HTTP/1.1 Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:26:00.042629 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:26:00.043977 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:00.043977 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:00.043977 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:00.043977 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:00.043977 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:00.043977 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:26:00.043977 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:26:00.043977 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:00.043977 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:00.043977 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:26:00.043977 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:00.043977 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '22298178-3c70-4617-8c26-bcbecf59552f'} Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:00.044742 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:00.046065 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:00.047144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b2326389-8354-4cde-affd-603d2c47de7b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:00.047144 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b2326389-8354-4cde-affd-603d2c47de7b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 404 len: 111 microversion: 2.1 time: 0.043399 Oct 18 13:26:00.047794 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1030/2173] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:00 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:00.052793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eef7f740-ca67-4206-9308-8fa02a00d8db tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:00.053428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eef7f740-ca67-4206-9308-8fa02a00d8db tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:00.060425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eef7f740-ca67-4206-9308-8fa02a00d8db tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:00.061004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eef7f740-ca67-4206-9308-8fa02a00d8db tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:00.061542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eef7f740-ca67-4206-9308-8fa02a00d8db tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:00.062312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eef7f740-ca67-4206-9308-8fa02a00d8db tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:00.062829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eef7f740-ca67-4206-9308-8fa02a00d8db tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:00.063330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eef7f740-ca67-4206-9308-8fa02a00d8db tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:00.288827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eef7f740-ca67-4206-9308-8fa02a00d8db tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:00.296755 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eef7f740-ca67-4206-9308-8fa02a00d8db tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 200 len: 1314 microversion: 2.1 time: 0.247953 Oct 18 13:26:00.315434 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1031/2174] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:00 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:00.322453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-347ca243-808e-4a77-8930-bb7be8f73a97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:00.323265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-347ca243-808e-4a77-8930-bb7be8f73a97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:00.330007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-347ca243-808e-4a77-8930-bb7be8f73a97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:00.330700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-347ca243-808e-4a77-8930-bb7be8f73a97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:00.331304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-347ca243-808e-4a77-8930-bb7be8f73a97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:00.332243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-347ca243-808e-4a77-8930-bb7be8f73a97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:00.332844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-347ca243-808e-4a77-8930-bb7be8f73a97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:00.333452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-347ca243-808e-4a77-8930-bb7be8f73a97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:00.628130 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 13:26:00.629089 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 13:26:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 18 13:26:00.643445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-347ca243-808e-4a77-8930-bb7be8f73a97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:00.661045 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-347ca243-808e-4a77-8930-bb7be8f73a97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1509 microversion: 2.1 time: 0.343977 Oct 18 13:26:00.662338 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1032/2175] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:00 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1509 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:00.669838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-221b0e03-ca46-4f2c-9b68-68b6f41ea029 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60fddd310>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:00.837937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:00.838581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:00.840156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:00.841218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:00.841785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:00.853272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:00.854243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:00.854837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:00.857638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:00.858274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:00.859057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:00.884649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Getting quotas for project 19e1c317d0a34148949ddddadffb4415. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:00.892178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Getting quotas for user f3922bd65ede4e2586d23741b8ac19a1 and project 19e1c317d0a34148949ddddadffb4415. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:01.199314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:01.202172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b9db83ba-7386-46d3-a9bf-4a07fbc53143',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='780afa7e-bd1b-43b8-9518-bc42c9b7ddfa',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='067748f9-5bae-4364-913c-fc8543bc3431',volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:01.576318 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-221b0e03-ca46-4f2c-9b68-68b6f41ea029 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31" status: 204 len: 0 microversion: 2.1 time: 0.912756 Oct 18 13:26:01.577068 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1033/2176] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:00 2022] DELETE /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31 => generated 0 bytes in 914 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:26:01.582948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-45d3cd9e-95d5-42d5-9647-d19d7208caaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:01.584015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-45d3cd9e-95d5-42d5-9647-d19d7208caaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:01.611124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45d3cd9e-95d5-42d5-9647-d19d7208caaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:01.612036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45d3cd9e-95d5-42d5-9647-d19d7208caaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:01.612595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45d3cd9e-95d5-42d5-9647-d19d7208caaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:01.613664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45d3cd9e-95d5-42d5-9647-d19d7208caaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:01.617148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45d3cd9e-95d5-42d5-9647-d19d7208caaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:01.618070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45d3cd9e-95d5-42d5-9647-d19d7208caaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:01.757914 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b37df909-4c20-43b1-9ba9-ccee799f8509 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 4.016916 Oct 18 13:26:01.759281 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1144/2177] 10.222.0.40 () {62 vars in 1189 bytes} [Tue Oct 18 13:25:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 4019 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:26:01.773731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6cb816ea-64fa-4b74-a47f-6ddb4ca9ddc4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:01.774643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6cb816ea-64fa-4b74-a47f-6ddb4ca9ddc4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:01.782039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cb816ea-64fa-4b74-a47f-6ddb4ca9ddc4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:01.782897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cb816ea-64fa-4b74-a47f-6ddb4ca9ddc4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:01.783517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cb816ea-64fa-4b74-a47f-6ddb4ca9ddc4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:01.784508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cb816ea-64fa-4b74-a47f-6ddb4ca9ddc4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:01.785141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cb816ea-64fa-4b74-a47f-6ddb4ca9ddc4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:01.785777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cb816ea-64fa-4b74-a47f-6ddb4ca9ddc4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:01.873046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-45d3cd9e-95d5-42d5-9647-d19d7208caaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:01.882421 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-45d3cd9e-95d5-42d5-9647-d19d7208caaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1543 microversion: 2.1 time: 0.304030 Oct 18 13:26:01.883002 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1034/2178] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:01 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1543 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:01.893953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-4385c81d-2a2d-4168-988b-7c610bc85f5a req-67ec98cb-165a-4487-a231-729b35225db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51afbc1-604c-4e86-b301-1716cfeb7671", "name": "network-vif-plugged", "status": "completed", "tag": "6f25acf6-2339-400d-bece-c17a12a478b2"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:01.915746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4385c81d-2a2d-4168-988b-7c610bc85f5a req-67ec98cb-165a-4487-a231-729b35225db6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:01.916135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4385c81d-2a2d-4168-988b-7c610bc85f5a req-67ec98cb-165a-4487-a231-729b35225db6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:01.916625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4385c81d-2a2d-4168-988b-7c610bc85f5a req-67ec98cb-165a-4487-a231-729b35225db6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:01.933948 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4385c81d-2a2d-4168-988b-7c610bc85f5a req-67ec98cb-165a-4487-a231-729b35225db6 service nova] Creating event network-vif-plugged:6f25acf6-2339-400d-bece-c17a12a478b2 for instance f51afbc1-604c-4e86-b301-1716cfeb7671 on n-h2-858384-13 Oct 18 13:26:01.952024 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-4385c81d-2a2d-4168-988b-7c610bc85f5a req-67ec98cb-165a-4487-a231-729b35225db6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066224 Oct 18 13:26:01.953056 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1035/2179] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:01.965405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0b593e1b-bd1e-42d9-8d80-6af4aa747f70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:01.966322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0b593e1b-bd1e-42d9-8d80-6af4aa747f70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:01.973247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b593e1b-bd1e-42d9-8d80-6af4aa747f70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:01.974062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b593e1b-bd1e-42d9-8d80-6af4aa747f70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:01.974709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b593e1b-bd1e-42d9-8d80-6af4aa747f70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:01.976636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b593e1b-bd1e-42d9-8d80-6af4aa747f70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:01.978376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b593e1b-bd1e-42d9-8d80-6af4aa747f70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:01.979030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b593e1b-bd1e-42d9-8d80-6af4aa747f70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.115419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0b593e1b-bd1e-42d9-8d80-6af4aa747f70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.130990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0b593e1b-bd1e-42d9-8d80-6af4aa747f70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.140848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0b593e1b-bd1e-42d9-8d80-6af4aa747f70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.151951 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0b593e1b-bd1e-42d9-8d80-6af4aa747f70 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1558 microversion: 2.91 time: 0.197138 Oct 18 13:26:02.152981 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1036/2180] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:01 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1558 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:02.157662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-62b8c1a3-6d48-499f-83d8-d4785e546398 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:02.169858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-62b8c1a3-6d48-499f-83d8-d4785e546398 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:02.172130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6cb816ea-64fa-4b74-a47f-6ddb4ca9ddc4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.182324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62b8c1a3-6d48-499f-83d8-d4785e546398 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.186438 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6cb816ea-64fa-4b74-a47f-6ddb4ca9ddc4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1315 microversion: 2.1 time: 0.419182 Oct 18 13:26:02.187214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62b8c1a3-6d48-499f-83d8-d4785e546398 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.187936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62b8c1a3-6d48-499f-83d8-d4785e546398 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.188830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62b8c1a3-6d48-499f-83d8-d4785e546398 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.190395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62b8c1a3-6d48-499f-83d8-d4785e546398 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.192611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62b8c1a3-6d48-499f-83d8-d4785e546398 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.208826 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1145/2181] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:01 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:02.215887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b1dbf5fc-b0da-435d-96b6-d9fca5a985e5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:02.216394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b1dbf5fc-b0da-435d-96b6-d9fca5a985e5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:02.232065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1dbf5fc-b0da-435d-96b6-d9fca5a985e5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.233954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1dbf5fc-b0da-435d-96b6-d9fca5a985e5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.235045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1dbf5fc-b0da-435d-96b6-d9fca5a985e5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.236561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1dbf5fc-b0da-435d-96b6-d9fca5a985e5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.249170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1dbf5fc-b0da-435d-96b6-d9fca5a985e5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.249843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1dbf5fc-b0da-435d-96b6-d9fca5a985e5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.308133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b1dbf5fc-b0da-435d-96b6-d9fca5a985e5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:26:02.399030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:02.450888 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b1dbf5fc-b0da-435d-96b6-d9fca5a985e5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 204 len: 0 microversion: 2.1 time: 0.240774 Oct 18 13:26:02.458521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-62b8c1a3-6d48-499f-83d8-d4785e546398 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.466522 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1146/2182] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:02 2022] DELETE /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:26:02.468299 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-62b8c1a3-6d48-499f-83d8-d4785e546398 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 200 len: 1314 microversion: 2.1 time: 0.314093 Oct 18 13:26:02.471356 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1037/2183] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:02 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:02.476635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-169427c6-eac8-455a-a77d-07458669b6d8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:02.477594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-169427c6-eac8-455a-a77d-07458669b6d8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:02.489548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1026c416-c502-4ee4-9947-5a0a301002fd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:02.490180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1026c416-c502-4ee4-9947-5a0a301002fd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:02.510838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-169427c6-eac8-455a-a77d-07458669b6d8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.511343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-169427c6-eac8-455a-a77d-07458669b6d8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.511792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-169427c6-eac8-455a-a77d-07458669b6d8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.512514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-169427c6-eac8-455a-a77d-07458669b6d8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.512976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-169427c6-eac8-455a-a77d-07458669b6d8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.513434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-169427c6-eac8-455a-a77d-07458669b6d8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.634115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1026c416-c502-4ee4-9947-5a0a301002fd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.645607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1026c416-c502-4ee4-9947-5a0a301002fd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.649443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1026c416-c502-4ee4-9947-5a0a301002fd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.651020 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1026c416-c502-4ee4-9947-5a0a301002fd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1285 microversion: 2.42 time: 0.178484 Oct 18 13:26:02.652893 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1038/2184] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:02 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:02.661480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-14fbcd5d-450d-4a4c-a949-8c56b27814f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:02.662949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-14fbcd5d-450d-4a4c-a949-8c56b27814f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:02.673254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14fbcd5d-450d-4a4c-a949-8c56b27814f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.674246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14fbcd5d-450d-4a4c-a949-8c56b27814f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.674686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14fbcd5d-450d-4a4c-a949-8c56b27814f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.676453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14fbcd5d-450d-4a4c-a949-8c56b27814f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:02.676931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14fbcd5d-450d-4a4c-a949-8c56b27814f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:02.677675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14fbcd5d-450d-4a4c-a949-8c56b27814f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:02.708012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-169427c6-eac8-455a-a77d-07458669b6d8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:02.720337 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-169427c6-eac8-455a-a77d-07458669b6d8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1509 microversion: 2.1 time: 0.251541 Oct 18 13:26:02.734438 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1147/2185] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:02 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1509 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:02.746786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1202367502", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "0b58d9a8-4835-4530-9695-a2f702e82ee6"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:02.794208 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-14fbcd5d-450d-4a4c-a949-8c56b27814f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139239 Oct 18 13:26:02.796081 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1039/2186] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:26:02 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:02.848840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] validate_networks() for [('0b58d9a8-4835-4530-9695-a2f702e82ee6', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:26:03.184642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e312cde2-a010-4b97-af97-19bea523584c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:03.185458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e312cde2-a010-4b97-af97-19bea523584c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:03.196872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e312cde2-a010-4b97-af97-19bea523584c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.197663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e312cde2-a010-4b97-af97-19bea523584c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.198111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e312cde2-a010-4b97-af97-19bea523584c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.198885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e312cde2-a010-4b97-af97-19bea523584c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.199280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e312cde2-a010-4b97-af97-19bea523584c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.199790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e312cde2-a010-4b97-af97-19bea523584c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.297991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e312cde2-a010-4b97-af97-19bea523584c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:03.308320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e312cde2-a010-4b97-af97-19bea523584c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:03.312594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e312cde2-a010-4b97-af97-19bea523584c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:03.326531 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e312cde2-a010-4b97-af97-19bea523584c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1558 microversion: 2.91 time: 0.137573 Oct 18 13:26:03.333587 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1040/2187] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:03 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:26:03.339056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a52fa7cc-93e0-43b6-9ff9-6800be021e73 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:03.339862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a52fa7cc-93e0-43b6-9ff9-6800be021e73 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:03.347190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a52fa7cc-93e0-43b6-9ff9-6800be021e73 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.348121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a52fa7cc-93e0-43b6-9ff9-6800be021e73 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.349029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a52fa7cc-93e0-43b6-9ff9-6800be021e73 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.350876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a52fa7cc-93e0-43b6-9ff9-6800be021e73 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.351512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a52fa7cc-93e0-43b6-9ff9-6800be021e73 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.352007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a52fa7cc-93e0-43b6-9ff9-6800be021e73 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.382010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:03.615795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a52fa7cc-93e0-43b6-9ff9-6800be021e73 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:03.627769 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a52fa7cc-93e0-43b6-9ff9-6800be021e73 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1315 microversion: 2.1 time: 0.292793 Oct 18 13:26:03.628835 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1041/2188] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:03 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:03.634159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41bb95d4-bd76-47ef-be4f-f8257fae0790 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:03.635461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-41bb95d4-bd76-47ef-be4f-f8257fae0790 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:03.641980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41bb95d4-bd76-47ef-be4f-f8257fae0790 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.642274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41bb95d4-bd76-47ef-be4f-f8257fae0790 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.642704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41bb95d4-bd76-47ef-be4f-f8257fae0790 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.643398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41bb95d4-bd76-47ef-be4f-f8257fae0790 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.643844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41bb95d4-bd76-47ef-be4f-f8257fae0790 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.644265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41bb95d4-bd76-47ef-be4f-f8257fae0790 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.857597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:03.858077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:03.858705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:03.859602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:03.860082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:03.874845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.875322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.875753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.876524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:03.876977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:03.877421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:03.909610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Getting quotas for project 472fc8535c504953a8f14a24f9d22260. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:03.919586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Getting quotas for user f896caa4caa0472db9198f7795401df2 and project 472fc8535c504953a8f14a24f9d22260. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:03.934527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-41bb95d4-bd76-47ef-be4f-f8257fae0790 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:03.952397 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-41bb95d4-bd76-47ef-be4f-f8257fae0790 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 200 len: 1501 microversion: 2.1 time: 0.321859 Oct 18 13:26:03.953050 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1042/2189] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:03 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 1501 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:03.965534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:03.968511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:03.986509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b5925c4f-2997-4862-a788-852cf53d324b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:03.988738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b5925c4f-2997-4862-a788-852cf53d324b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:04.004582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5925c4f-2997-4862-a788-852cf53d324b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.005275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5925c4f-2997-4862-a788-852cf53d324b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.005917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5925c4f-2997-4862-a788-852cf53d324b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.007290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5925c4f-2997-4862-a788-852cf53d324b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.008152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5925c4f-2997-4862-a788-852cf53d324b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.008499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5925c4f-2997-4862-a788-852cf53d324b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.050401 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c0470354-4139-4161-9d5d-f8ffacf92997 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.308970 Oct 18 13:26:04.058177 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1148/2190] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:26:04.086363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-40a3b978-e200-4be0-8b84-bf352d28ac06 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:04.089923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-40a3b978-e200-4be0-8b84-bf352d28ac06 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:04.103910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a3b978-e200-4be0-8b84-bf352d28ac06 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.104716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a3b978-e200-4be0-8b84-bf352d28ac06 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.105396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a3b978-e200-4be0-8b84-bf352d28ac06 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.106316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a3b978-e200-4be0-8b84-bf352d28ac06 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.107001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a3b978-e200-4be0-8b84-bf352d28ac06 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.107629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40a3b978-e200-4be0-8b84-bf352d28ac06 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.300327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b5925c4f-2997-4862-a788-852cf53d324b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:04.316454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b5925c4f-2997-4862-a788-852cf53d324b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:04.320176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b5925c4f-2997-4862-a788-852cf53d324b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:04.322605 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b5925c4f-2997-4862-a788-852cf53d324b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1519 microversion: 2.42 time: 0.348110 Oct 18 13:26:04.324283 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1043/2191] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:03 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1519 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:04.330190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-c755290c-8a21-40ea-bced-420632709619 req-df3094ab-454d-4f22-ae5a-4b076abd02a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157af106-c39d-428a-9cd7-1d37cd98bfcc", "name": "network-vif-plugged", "status": "completed", "tag": "eade7ea5-b653-468d-aaa4-2b40848f80bd"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:04.355744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c755290c-8a21-40ea-bced-420632709619 req-df3094ab-454d-4f22-ae5a-4b076abd02a3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.356420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c755290c-8a21-40ea-bced-420632709619 req-df3094ab-454d-4f22-ae5a-4b076abd02a3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.357157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c755290c-8a21-40ea-bced-420632709619 req-df3094ab-454d-4f22-ae5a-4b076abd02a3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.371505 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-c755290c-8a21-40ea-bced-420632709619 req-df3094ab-454d-4f22-ae5a-4b076abd02a3 service nova] Creating event network-vif-plugged:eade7ea5-b653-468d-aaa4-2b40848f80bd for instance 157af106-c39d-428a-9cd7-1d37cd98bfcc on n-h2-858384-13 Oct 18 13:26:04.377228 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-c755290c-8a21-40ea-bced-420632709619 req-df3094ab-454d-4f22-ae5a-4b076abd02a3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051008 Oct 18 13:26:04.378508 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1044/2192] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:04.385507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-afec3c14-2dab-4e5e-8c9e-445fe08244ac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:04.388526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-afec3c14-2dab-4e5e-8c9e-445fe08244ac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:04.395411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afec3c14-2dab-4e5e-8c9e-445fe08244ac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.396030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afec3c14-2dab-4e5e-8c9e-445fe08244ac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.396710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afec3c14-2dab-4e5e-8c9e-445fe08244ac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.398772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afec3c14-2dab-4e5e-8c9e-445fe08244ac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.399480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afec3c14-2dab-4e5e-8c9e-445fe08244ac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.400011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afec3c14-2dab-4e5e-8c9e-445fe08244ac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.446206 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-afec3c14-2dab-4e5e-8c9e-445fe08244ac tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action" status: 200 len: 14 microversion: 2.1 time: 0.064794 Oct 18 13:26:04.447320 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1045/2193] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:04 2022] POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:04.455253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad655426-75bd-4b30-8850-a4787802cb89 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:04.457107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ad655426-75bd-4b30-8850-a4787802cb89 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:04.458990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-40a3b978-e200-4be0-8b84-bf352d28ac06 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:04.483567 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-40a3b978-e200-4be0-8b84-bf352d28ac06 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1509 microversion: 2.1 time: 0.418817 Oct 18 13:26:04.486840 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1149/2194] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:04 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1509 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:04.501999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-06f98865-701e-46c3-a86f-36e98f5be2ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:04.524196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-06f98865-701e-46c3-a86f-36e98f5be2ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:04.566277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06f98865-701e-46c3-a86f-36e98f5be2ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.570145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06f98865-701e-46c3-a86f-36e98f5be2ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.570598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06f98865-701e-46c3-a86f-36e98f5be2ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.571350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06f98865-701e-46c3-a86f-36e98f5be2ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.579828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06f98865-701e-46c3-a86f-36e98f5be2ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.580370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06f98865-701e-46c3-a86f-36e98f5be2ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.586160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad655426-75bd-4b30-8850-a4787802cb89 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:04.605254 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad655426-75bd-4b30-8850-a4787802cb89 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1208 microversion: 2.1 time: 0.153044 Oct 18 13:26:04.606565 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1046/2195] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:04 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1208 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:04.662220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4fe5438b-0983-4623-b906-cc254e738e5d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:04.664826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4fe5438b-0983-4623-b906-cc254e738e5d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:04.687394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe5438b-0983-4623-b906-cc254e738e5d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.689781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe5438b-0983-4623-b906-cc254e738e5d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.690418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe5438b-0983-4623-b906-cc254e738e5d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.691866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe5438b-0983-4623-b906-cc254e738e5d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.693703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe5438b-0983-4623-b906-cc254e738e5d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.696935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe5438b-0983-4623-b906-cc254e738e5d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:04.805140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-06f98865-701e-46c3-a86f-36e98f5be2ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:04.820574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-06f98865-701e-46c3-a86f-36e98f5be2ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:04.820574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-06f98865-701e-46c3-a86f-36e98f5be2ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:04.836120 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-06f98865-701e-46c3-a86f-36e98f5be2ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.345643 Oct 18 13:26:04.837937 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1150/2196] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:04 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:04.972497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-b1bb35ae-b45e-44ac-9d07-669bd7d26ba8 req-eeb4458b-a6e5-4231-bcf3-2c30705feff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f4088c-c321-4fc1-8bec-456d1178cda7", "tag": "7732437d-47a0-4c99-8e68-a24b9d4ee37d"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:04.997532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b1bb35ae-b45e-44ac-9d07-669bd7d26ba8 req-eeb4458b-a6e5-4231-bcf3-2c30705feff9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:04.998016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b1bb35ae-b45e-44ac-9d07-669bd7d26ba8 req-eeb4458b-a6e5-4231-bcf3-2c30705feff9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:04.998450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b1bb35ae-b45e-44ac-9d07-669bd7d26ba8 req-eeb4458b-a6e5-4231-bcf3-2c30705feff9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.029071 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-b1bb35ae-b45e-44ac-9d07-669bd7d26ba8 req-eeb4458b-a6e5-4231-bcf3-2c30705feff9 service nova] Creating event network-changed:7732437d-47a0-4c99-8e68-a24b9d4ee37d for instance e1f4088c-c321-4fc1-8bec-456d1178cda7 on n-h2-858384-13 Oct 18 13:26:05.035421 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-b1bb35ae-b45e-44ac-9d07-669bd7d26ba8 req-eeb4458b-a6e5-4231-bcf3-2c30705feff9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066400 Oct 18 13:26:05.040358 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1151/2197] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:05.176821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4fe5438b-0983-4623-b906-cc254e738e5d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:05.190869 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4fe5438b-0983-4623-b906-cc254e738e5d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1315 microversion: 2.1 time: 0.542553 Oct 18 13:26:05.205285 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1047/2198] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:04 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:05.356932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3333508a-28fa-4c1b-b929-2b37b51e8a90 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:05.358156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3333508a-28fa-4c1b-b929-2b37b51e8a90 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:05.373498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3333508a-28fa-4c1b-b929-2b37b51e8a90 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.373992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3333508a-28fa-4c1b-b929-2b37b51e8a90 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.381719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3333508a-28fa-4c1b-b929-2b37b51e8a90 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.383194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3333508a-28fa-4c1b-b929-2b37b51e8a90 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.383676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3333508a-28fa-4c1b-b929-2b37b51e8a90 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.384399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3333508a-28fa-4c1b-b929-2b37b51e8a90 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.458931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-502bc3c8-f978-424c-bb34-37ac0c2a13d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:05.463756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-502bc3c8-f978-424c-bb34-37ac0c2a13d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:05.472020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-502bc3c8-f978-424c-bb34-37ac0c2a13d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.472854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-502bc3c8-f978-424c-bb34-37ac0c2a13d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.473650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-502bc3c8-f978-424c-bb34-37ac0c2a13d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.474776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-502bc3c8-f978-424c-bb34-37ac0c2a13d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.475812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-502bc3c8-f978-424c-bb34-37ac0c2a13d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.477799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-502bc3c8-f978-424c-bb34-37ac0c2a13d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.566515 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-502bc3c8-f978-424c-bb34-37ac0c2a13d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action" status: 200 len: 14 microversion: 2.1 time: 0.111657 Oct 18 13:26:05.567518 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1048/2199] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:05 2022] POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:26:05.575259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-60533bc5-f0a3-4411-b9dc-6b31545c43cc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:05.579925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-60533bc5-f0a3-4411-b9dc-6b31545c43cc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:05.593729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3333508a-28fa-4c1b-b929-2b37b51e8a90 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:05.608145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3333508a-28fa-4c1b-b929-2b37b51e8a90 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:05.608919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60533bc5-f0a3-4411-b9dc-6b31545c43cc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.609451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60533bc5-f0a3-4411-b9dc-6b31545c43cc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.616002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3333508a-28fa-4c1b-b929-2b37b51e8a90 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:05.618048 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3333508a-28fa-4c1b-b929-2b37b51e8a90 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1583 microversion: 2.42 time: 0.268178 Oct 18 13:26:05.618181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60533bc5-f0a3-4411-b9dc-6b31545c43cc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.618945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60533bc5-f0a3-4411-b9dc-6b31545c43cc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.619435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60533bc5-f0a3-4411-b9dc-6b31545c43cc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.619883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60533bc5-f0a3-4411-b9dc-6b31545c43cc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.638276 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1152/2200] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:05 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1583 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:05.648265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-31d1b310-4e65-4b36-8ce0-d682ce6b1081 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:05.657677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-31d1b310-4e65-4b36-8ce0-d682ce6b1081 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:05.664833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31d1b310-4e65-4b36-8ce0-d682ce6b1081 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.665630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31d1b310-4e65-4b36-8ce0-d682ce6b1081 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.666262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31d1b310-4e65-4b36-8ce0-d682ce6b1081 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.669941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31d1b310-4e65-4b36-8ce0-d682ce6b1081 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.670642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31d1b310-4e65-4b36-8ce0-d682ce6b1081 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.671234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31d1b310-4e65-4b36-8ce0-d682ce6b1081 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.809087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-31d1b310-4e65-4b36-8ce0-d682ce6b1081 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:05.824269 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-31d1b310-4e65-4b36-8ce0-d682ce6b1081 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1260 microversion: 2.1 time: 0.179798 Oct 18 13:26:05.826976 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1153/2201] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:05 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:05.865198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e9a0e294-fb4b-4d82-ab13-5eb9e505e758 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:05.867333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e9a0e294-fb4b-4d82-ab13-5eb9e505e758 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:05.880407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9a0e294-fb4b-4d82-ab13-5eb9e505e758 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.880900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9a0e294-fb4b-4d82-ab13-5eb9e505e758 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.881372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9a0e294-fb4b-4d82-ab13-5eb9e505e758 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:05.882138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9a0e294-fb4b-4d82-ab13-5eb9e505e758 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:05.890090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9a0e294-fb4b-4d82-ab13-5eb9e505e758 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:05.893027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9a0e294-fb4b-4d82-ab13-5eb9e505e758 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:06.131294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e9a0e294-fb4b-4d82-ab13-5eb9e505e758 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:06.159415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e9a0e294-fb4b-4d82-ab13-5eb9e505e758 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:06.167973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e9a0e294-fb4b-4d82-ab13-5eb9e505e758 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:06.182361 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e9a0e294-fb4b-4d82-ab13-5eb9e505e758 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.321720 Oct 18 13:26:06.210808 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1154/2202] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:05 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:06.224472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-42043c67-942d-4187-a5d4-0775fa44bb0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:06.228776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-42043c67-942d-4187-a5d4-0775fa44bb0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:06.241172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42043c67-942d-4187-a5d4-0775fa44bb0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:06.242847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42043c67-942d-4187-a5d4-0775fa44bb0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:06.243447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42043c67-942d-4187-a5d4-0775fa44bb0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:06.249542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42043c67-942d-4187-a5d4-0775fa44bb0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:06.250194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42043c67-942d-4187-a5d4-0775fa44bb0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:06.250913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42043c67-942d-4187-a5d4-0775fa44bb0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:06.982374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-42043c67-942d-4187-a5d4-0775fa44bb0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:07.004146 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-42043c67-942d-4187-a5d4-0775fa44bb0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1503 microversion: 2.1 time: 0.789160 Oct 18 13:26:07.004752 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1155/2203] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:06 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1503 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:07.027731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87ae7610-a8f5-426d-9f45-d1be9c3721c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:07.033758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-87ae7610-a8f5-426d-9f45-d1be9c3721c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:07.056383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87ae7610-a8f5-426d-9f45-d1be9c3721c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.057100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87ae7610-a8f5-426d-9f45-d1be9c3721c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.057742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87ae7610-a8f5-426d-9f45-d1be9c3721c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.058606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87ae7610-a8f5-426d-9f45-d1be9c3721c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.059210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87ae7610-a8f5-426d-9f45-d1be9c3721c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.059780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87ae7610-a8f5-426d-9f45-d1be9c3721c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.142067 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-87ae7610-a8f5-426d-9f45-d1be9c3721c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action" status: 200 len: 14 microversion: 2.1 time: 0.135998 Oct 18 13:26:07.146890 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1156/2204] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:07 2022] POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:07.163957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-538015be-ec28-4ca5-b664-db552e5b1c14 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:07.168629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-538015be-ec28-4ca5-b664-db552e5b1c14 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:07.180891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-538015be-ec28-4ca5-b664-db552e5b1c14 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.185720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-538015be-ec28-4ca5-b664-db552e5b1c14 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.186386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-538015be-ec28-4ca5-b664-db552e5b1c14 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.187338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-538015be-ec28-4ca5-b664-db552e5b1c14 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.190072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-538015be-ec28-4ca5-b664-db552e5b1c14 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.196766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-538015be-ec28-4ca5-b664-db552e5b1c14 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.502132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-538015be-ec28-4ca5-b664-db552e5b1c14 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:07.522259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-538015be-ec28-4ca5-b664-db552e5b1c14 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:07.531486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-538015be-ec28-4ca5-b664-db552e5b1c14 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:07.532572 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-538015be-ec28-4ca5-b664-db552e5b1c14 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1593 microversion: 2.42 time: 0.383641 Oct 18 13:26:07.533164 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1157/2205] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:07 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1593 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:07.564580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0871130f-9007-4660-99e8-6df1650d80c4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:07.565216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0871130f-9007-4660-99e8-6df1650d80c4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:07.586544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0871130f-9007-4660-99e8-6df1650d80c4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.595598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0871130f-9007-4660-99e8-6df1650d80c4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.597626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0871130f-9007-4660-99e8-6df1650d80c4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.601529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0871130f-9007-4660-99e8-6df1650d80c4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.602014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0871130f-9007-4660-99e8-6df1650d80c4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.602453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0871130f-9007-4660-99e8-6df1650d80c4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.713088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-60533bc5-f0a3-4411-b9dc-6b31545c43cc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:07.729278 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-60533bc5-f0a3-4411-b9dc-6b31545c43cc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1509 microversion: 2.1 time: 2.158852 Oct 18 13:26:07.730222 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1049/2206] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:05 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1509 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:07.755908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6b0ea479-ac80-43b0-947b-72885f66d758 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1560732345"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:07.758448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6b0ea479-ac80-43b0-947b-72885f66d758 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:07.793721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b0ea479-ac80-43b0-947b-72885f66d758 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.794623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b0ea479-ac80-43b0-947b-72885f66d758 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.797162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b0ea479-ac80-43b0-947b-72885f66d758 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.799302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b0ea479-ac80-43b0-947b-72885f66d758 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.803133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b0ea479-ac80-43b0-947b-72885f66d758 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.806010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b0ea479-ac80-43b0-947b-72885f66d758 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.806420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0871130f-9007-4660-99e8-6df1650d80c4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:07.816470 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0871130f-9007-4660-99e8-6df1650d80c4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1266 microversion: 2.1 time: 0.255638 Oct 18 13:26:07.817073 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1158/2207] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:07 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:07.831125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b4367683-853a-43c5-aaa7-30e2ec7ff09c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:07.831531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b4367683-853a-43c5-aaa7-30e2ec7ff09c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:07.843756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4367683-853a-43c5-aaa7-30e2ec7ff09c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.844265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4367683-853a-43c5-aaa7-30e2ec7ff09c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.846520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4367683-853a-43c5-aaa7-30e2ec7ff09c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:07.849842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4367683-853a-43c5-aaa7-30e2ec7ff09c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:07.850340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4367683-853a-43c5-aaa7-30e2ec7ff09c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:07.850869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4367683-853a-43c5-aaa7-30e2ec7ff09c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:08.173686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b4367683-853a-43c5-aaa7-30e2ec7ff09c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:08.189028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b4367683-853a-43c5-aaa7-30e2ec7ff09c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:08.190603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b4367683-853a-43c5-aaa7-30e2ec7ff09c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:08.211603 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b4367683-853a-43c5-aaa7-30e2ec7ff09c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.390427 Oct 18 13:26:08.222244 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1159/2208] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:07 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:08.244311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-6f718186-a320-43ce-8275-3a0a433b099e req-e7192e17-3f82-405b-8233-1539bdb84a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd5017a-89a3-4009-902b-156a36615276", "name": "network-vif-deleted", "tag": "4fd0a37b-a6fc-4fa4-ae29-01b3e5f2b288"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:08.284207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6f718186-a320-43ce-8275-3a0a433b099e req-e7192e17-3f82-405b-8233-1539bdb84a24 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:08.287314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6f718186-a320-43ce-8275-3a0a433b099e req-e7192e17-3f82-405b-8233-1539bdb84a24 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:08.287947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6f718186-a320-43ce-8275-3a0a433b099e req-e7192e17-3f82-405b-8233-1539bdb84a24 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:08.337364 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-6f718186-a320-43ce-8275-3a0a433b099e req-e7192e17-3f82-405b-8233-1539bdb84a24 service nova] Creating event network-vif-deleted:4fd0a37b-a6fc-4fa4-ae29-01b3e5f2b288 for instance 1dd5017a-89a3-4009-902b-156a36615276 on n-h1-858384-13 Oct 18 13:26:08.345375 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-6f718186-a320-43ce-8275-3a0a433b099e req-e7192e17-3f82-405b-8233-1539bdb84a24 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117463 Oct 18 13:26:08.351590 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1160/2209] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:08.361709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f5009556-1e7b-40a1-a930-a4a46c848390 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:08.372421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f5009556-1e7b-40a1-a930-a4a46c848390 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:08.385399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5009556-1e7b-40a1-a930-a4a46c848390 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:08.388644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5009556-1e7b-40a1-a930-a4a46c848390 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:08.389297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5009556-1e7b-40a1-a930-a4a46c848390 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:08.391501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5009556-1e7b-40a1-a930-a4a46c848390 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:08.392121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5009556-1e7b-40a1-a930-a4a46c848390 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:08.392698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5009556-1e7b-40a1-a930-a4a46c848390 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:08.497212 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f5009556-1e7b-40a1-a930-a4a46c848390 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action" status: 200 len: 14 microversion: 2.1 time: 0.143632 Oct 18 13:26:08.501529 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1161/2210] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:08 2022] POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:08.563560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-38acb7c0-7746-4797-b44e-b0356245fcc2 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:08.565163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-38acb7c0-7746-4797-b44e-b0356245fcc2 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:08.606553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:08.611834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38acb7c0-7746-4797-b44e-b0356245fcc2 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:08.615415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38acb7c0-7746-4797-b44e-b0356245fcc2 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:08.616560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38acb7c0-7746-4797-b44e-b0356245fcc2 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:08.617508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38acb7c0-7746-4797-b44e-b0356245fcc2 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:08.618240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38acb7c0-7746-4797-b44e-b0356245fcc2 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:08.620197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38acb7c0-7746-4797-b44e-b0356245fcc2 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:08.706174 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.network.security_group_api [None req-6b0ea479-ac80-43b0-947b-72885f66d758 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Adding security group 3e37b8c9-0281-4d75-bd78-06c339b8dd97 to port eade7ea5-b653-468d-aaa4-2b40848f80bd Oct 18 13:26:09.309979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-38acb7c0-7746-4797-b44e-b0356245fcc2 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:09.328696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-38acb7c0-7746-4797-b44e-b0356245fcc2 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:09.330205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-38acb7c0-7746-4797-b44e-b0356245fcc2 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:09.335683 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-38acb7c0-7746-4797-b44e-b0356245fcc2 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1660 microversion: 2.42 time: 0.776413 Oct 18 13:26:09.357060 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1162/2211] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:08 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1660 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:09.373145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e89d77d9-06b9-4053-8baf-218f4ec7ced0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:09.374089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e89d77d9-06b9-4053-8baf-218f4ec7ced0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:09.391038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e89d77d9-06b9-4053-8baf-218f4ec7ced0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:09.391706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e89d77d9-06b9-4053-8baf-218f4ec7ced0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:09.392305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e89d77d9-06b9-4053-8baf-218f4ec7ced0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:09.393194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e89d77d9-06b9-4053-8baf-218f4ec7ced0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:09.394684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e89d77d9-06b9-4053-8baf-218f4ec7ced0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:09.398544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e89d77d9-06b9-4053-8baf-218f4ec7ced0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:09.954998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e89d77d9-06b9-4053-8baf-218f4ec7ced0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:09.965420 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e89d77d9-06b9-4053-8baf-218f4ec7ced0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1509 microversion: 2.1 time: 0.605928 Oct 18 13:26:09.965420 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1163/2212] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:09 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1509 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:10.001598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3a37e64b-4740-4fc6-b1fe-09fe68bfecbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:10.004209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3a37e64b-4740-4fc6-b1fe-09fe68bfecbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:10.026845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a37e64b-4740-4fc6-b1fe-09fe68bfecbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:10.032942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a37e64b-4740-4fc6-b1fe-09fe68bfecbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:10.033518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a37e64b-4740-4fc6-b1fe-09fe68bfecbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:10.038910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a37e64b-4740-4fc6-b1fe-09fe68bfecbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:10.039413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a37e64b-4740-4fc6-b1fe-09fe68bfecbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:10.039862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a37e64b-4740-4fc6-b1fe-09fe68bfecbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:10.581792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3a37e64b-4740-4fc6-b1fe-09fe68bfecbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:10.597675 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3a37e64b-4740-4fc6-b1fe-09fe68bfecbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1266 microversion: 2.1 time: 0.631480 Oct 18 13:26:10.610107 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1164/2213] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:09 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1266 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:10.626778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2ba87f4f-31d3-40fd-be23-afeb731ab2cf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:10.627213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2ba87f4f-31d3-40fd-be23-afeb731ab2cf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:10.651922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ba87f4f-31d3-40fd-be23-afeb731ab2cf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:10.652639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ba87f4f-31d3-40fd-be23-afeb731ab2cf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:10.656848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ba87f4f-31d3-40fd-be23-afeb731ab2cf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:10.658077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ba87f4f-31d3-40fd-be23-afeb731ab2cf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:10.658791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ba87f4f-31d3-40fd-be23-afeb731ab2cf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:10.659379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ba87f4f-31d3-40fd-be23-afeb731ab2cf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:10.935935 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6b0ea479-ac80-43b0-947b-72885f66d758 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc/action" status: 202 len: 0 microversion: 2.1 time: 3.199000 Oct 18 13:26:10.936662 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1050/2214] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:07 2022] POST /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc/action => generated 0 bytes in 3200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:10.942725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84853e01-2931-4aff-be44-750dd53d7328 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:10.957306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-84853e01-2931-4aff-be44-750dd53d7328 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:10.967960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2ba87f4f-31d3-40fd-be23-afeb731ab2cf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:10.970328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:10.982854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2ba87f4f-31d3-40fd-be23-afeb731ab2cf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:10.993720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2ba87f4f-31d3-40fd-be23-afeb731ab2cf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:10.997832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84853e01-2931-4aff-be44-750dd53d7328 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.001091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84853e01-2931-4aff-be44-750dd53d7328 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.001590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84853e01-2931-4aff-be44-750dd53d7328 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.006791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84853e01-2931-4aff-be44-750dd53d7328 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.011240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84853e01-2931-4aff-be44-750dd53d7328 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.011750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84853e01-2931-4aff-be44-750dd53d7328 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.015311 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2ba87f4f-31d3-40fd-be23-afeb731ab2cf tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.400741 Oct 18 13:26:11.015916 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1165/2215] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:10 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:11.046709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a9cc6b2b-a287-4b77-b0b2-aa1b3ece5c1a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:11.047364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a9cc6b2b-a287-4b77-b0b2-aa1b3ece5c1a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:11.059546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9cc6b2b-a287-4b77-b0b2-aa1b3ece5c1a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.060158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9cc6b2b-a287-4b77-b0b2-aa1b3ece5c1a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.060536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9cc6b2b-a287-4b77-b0b2-aa1b3ece5c1a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.063843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9cc6b2b-a287-4b77-b0b2-aa1b3ece5c1a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.064429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9cc6b2b-a287-4b77-b0b2-aa1b3ece5c1a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.064914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9cc6b2b-a287-4b77-b0b2-aa1b3ece5c1a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.183193 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-84853e01-2931-4aff-be44-750dd53d7328 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action" status: 200 len: 14 microversion: 2.1 time: 0.244505 Oct 18 13:26:11.184103 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1051/2216] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:10 2022] POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action => generated 14 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:11.190192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c3c1cf9-e8b2-4cbf-8536-51a802456acd tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1066828456"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:11.191581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7c3c1cf9-e8b2-4cbf-8536-51a802456acd tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:11.214624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c3c1cf9-e8b2-4cbf-8536-51a802456acd tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.220266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c3c1cf9-e8b2-4cbf-8536-51a802456acd tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.221036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c3c1cf9-e8b2-4cbf-8536-51a802456acd tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.227217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c3c1cf9-e8b2-4cbf-8536-51a802456acd tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.229246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c3c1cf9-e8b2-4cbf-8536-51a802456acd tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.234167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c3c1cf9-e8b2-4cbf-8536-51a802456acd tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.676448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a9cc6b2b-a287-4b77-b0b2-aa1b3ece5c1a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:11.690721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a9cc6b2b-a287-4b77-b0b2-aa1b3ece5c1a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:11.693921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a9cc6b2b-a287-4b77-b0b2-aa1b3ece5c1a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:11.695540 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a9cc6b2b-a287-4b77-b0b2-aa1b3ece5c1a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1752 microversion: 2.42 time: 0.673624 Oct 18 13:26:11.696759 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1166/2217] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:11 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1752 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:11.702231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-59725068-317b-4112-accd-5e1950ccf1fb req-c0888d80-199f-496c-9e2e-ebc358e7df75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157af106-c39d-428a-9cd7-1d37cd98bfcc", "tag": "eade7ea5-b653-468d-aaa4-2b40848f80bd"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:11.718127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-59725068-317b-4112-accd-5e1950ccf1fb req-c0888d80-199f-496c-9e2e-ebc358e7df75 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.718864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-59725068-317b-4112-accd-5e1950ccf1fb req-c0888d80-199f-496c-9e2e-ebc358e7df75 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.719711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-59725068-317b-4112-accd-5e1950ccf1fb req-c0888d80-199f-496c-9e2e-ebc358e7df75 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.749064 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-59725068-317b-4112-accd-5e1950ccf1fb req-c0888d80-199f-496c-9e2e-ebc358e7df75 service nova] Creating event network-changed:eade7ea5-b653-468d-aaa4-2b40848f80bd for instance 157af106-c39d-428a-9cd7-1d37cd98bfcc on n-h2-858384-13 Oct 18 13:26:11.767879 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-59725068-317b-4112-accd-5e1950ccf1fb req-c0888d80-199f-496c-9e2e-ebc358e7df75 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069626 Oct 18 13:26:11.769752 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1167/2218] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:11.805952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4ae0b040-5a55-42fa-ae72-c44cfe39c8e0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:11.816777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4ae0b040-5a55-42fa-ae72-c44cfe39c8e0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:11.837034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ae0b040-5a55-42fa-ae72-c44cfe39c8e0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.837717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ae0b040-5a55-42fa-ae72-c44cfe39c8e0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.838418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ae0b040-5a55-42fa-ae72-c44cfe39c8e0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:11.839268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ae0b040-5a55-42fa-ae72-c44cfe39c8e0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:11.839835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ae0b040-5a55-42fa-ae72-c44cfe39c8e0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:11.841031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ae0b040-5a55-42fa-ae72-c44cfe39c8e0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:12.009221 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.network.security_group_api [None req-7c3c1cf9-e8b2-4cbf-8536-51a802456acd tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Adding security group 87f0b88a-1b1f-46b7-a91c-50248974e9f8 to port eade7ea5-b653-468d-aaa4-2b40848f80bd Oct 18 13:26:12.429522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4ae0b040-5a55-42fa-ae72-c44cfe39c8e0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:12.464204 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4ae0b040-5a55-42fa-ae72-c44cfe39c8e0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1509 microversion: 2.1 time: 0.689330 Oct 18 13:26:12.465436 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1168/2219] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:11 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1509 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:12.471713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-16d75ab8-d8f5-413e-8425-c5c18078d1f3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:12.473326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-16d75ab8-d8f5-413e-8425-c5c18078d1f3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:12.484914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16d75ab8-d8f5-413e-8425-c5c18078d1f3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:12.485847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16d75ab8-d8f5-413e-8425-c5c18078d1f3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:12.486564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16d75ab8-d8f5-413e-8425-c5c18078d1f3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:12.487651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16d75ab8-d8f5-413e-8425-c5c18078d1f3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:12.488441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16d75ab8-d8f5-413e-8425-c5c18078d1f3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:12.491130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16d75ab8-d8f5-413e-8425-c5c18078d1f3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.156232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-16d75ab8-d8f5-413e-8425-c5c18078d1f3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:13.168930 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-16d75ab8-d8f5-413e-8425-c5c18078d1f3 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1308 microversion: 2.1 time: 0.698575 Oct 18 13:26:13.169435 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1169/2220] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:12 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1308 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:13.178366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d2fd22ee-1384-41ac-9b71-23086e90df8e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:13.181452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d2fd22ee-1384-41ac-9b71-23086e90df8e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:13.198696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2fd22ee-1384-41ac-9b71-23086e90df8e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:13.199406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2fd22ee-1384-41ac-9b71-23086e90df8e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:13.209314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2fd22ee-1384-41ac-9b71-23086e90df8e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.209314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2fd22ee-1384-41ac-9b71-23086e90df8e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:13.209314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2fd22ee-1384-41ac-9b71-23086e90df8e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:13.209314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2fd22ee-1384-41ac-9b71-23086e90df8e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.400521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d2fd22ee-1384-41ac-9b71-23086e90df8e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:13.409777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d2fd22ee-1384-41ac-9b71-23086e90df8e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:13.419553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d2fd22ee-1384-41ac-9b71-23086e90df8e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:13.441254 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d2fd22ee-1384-41ac-9b71-23086e90df8e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.268951 Oct 18 13:26:13.448779 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1170/2221] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:13 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:13.470587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53a27ae2-3ad5-4dcc-885c-b3bcbb418188 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:13.473599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53a27ae2-3ad5-4dcc-885c-b3bcbb418188 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:13.503063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a27ae2-3ad5-4dcc-885c-b3bcbb418188 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:13.503604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a27ae2-3ad5-4dcc-885c-b3bcbb418188 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:13.504054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a27ae2-3ad5-4dcc-885c-b3bcbb418188 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.505010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a27ae2-3ad5-4dcc-885c-b3bcbb418188 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:13.505595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a27ae2-3ad5-4dcc-885c-b3bcbb418188 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:13.506033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a27ae2-3ad5-4dcc-885c-b3bcbb418188 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.606236 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53a27ae2-3ad5-4dcc-885c-b3bcbb418188 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action" status: 200 len: 14 microversion: 2.1 time: 0.153400 Oct 18 13:26:13.607407 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1171/2222] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:13 2022] POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:13.614099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f038f861-ed71-4dcf-b145-6b80bbd1642b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:13.619726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f038f861-ed71-4dcf-b145-6b80bbd1642b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:13.642006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f038f861-ed71-4dcf-b145-6b80bbd1642b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:13.642545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f038f861-ed71-4dcf-b145-6b80bbd1642b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:13.661742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f038f861-ed71-4dcf-b145-6b80bbd1642b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.662455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f038f861-ed71-4dcf-b145-6b80bbd1642b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:13.669431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f038f861-ed71-4dcf-b145-6b80bbd1642b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:13.669431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f038f861-ed71-4dcf-b145-6b80bbd1642b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:13.885741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:13.936416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=12 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:14.381579 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7c3c1cf9-e8b2-4cbf-8536-51a802456acd tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc/action" status: 202 len: 0 microversion: 2.1 time: 3.196192 Oct 18 13:26:14.383214 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1052/2223] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:11 2022] POST /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc/action => generated 0 bytes in 3198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:14.388686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-726cbbb9-0bff-4ed0-8243-4d0ac5ab3c6a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:14.389545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-726cbbb9-0bff-4ed0-8243-4d0ac5ab3c6a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:14.419307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-726cbbb9-0bff-4ed0-8243-4d0ac5ab3c6a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.427177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-726cbbb9-0bff-4ed0-8243-4d0ac5ab3c6a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.430158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-726cbbb9-0bff-4ed0-8243-4d0ac5ab3c6a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.431825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-726cbbb9-0bff-4ed0-8243-4d0ac5ab3c6a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.432313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-726cbbb9-0bff-4ed0-8243-4d0ac5ab3c6a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.440857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-726cbbb9-0bff-4ed0-8243-4d0ac5ab3c6a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.441208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f038f861-ed71-4dcf-b145-6b80bbd1642b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:14.460241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f038f861-ed71-4dcf-b145-6b80bbd1642b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:14.462950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f038f861-ed71-4dcf-b145-6b80bbd1642b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:14.466484 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f038f861-ed71-4dcf-b145-6b80bbd1642b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1798 microversion: 2.42 time: 0.856419 Oct 18 13:26:14.468922 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1172/2224] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:13 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1798 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:14.485626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db51bea0-eea3-41cd-a3b8-1b957a95563b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:14.486888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db51bea0-eea3-41cd-a3b8-1b957a95563b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:14.499198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db51bea0-eea3-41cd-a3b8-1b957a95563b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.499706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db51bea0-eea3-41cd-a3b8-1b957a95563b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.500148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db51bea0-eea3-41cd-a3b8-1b957a95563b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.500872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db51bea0-eea3-41cd-a3b8-1b957a95563b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:14.501421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db51bea0-eea3-41cd-a3b8-1b957a95563b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:14.501856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db51bea0-eea3-41cd-a3b8-1b957a95563b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:14.604735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=7 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:14.940063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-726cbbb9-0bff-4ed0-8243-4d0ac5ab3c6a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:14.958237 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-726cbbb9-0bff-4ed0-8243-4d0ac5ab3c6a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1509 microversion: 2.1 time: 0.571260 Oct 18 13:26:14.960283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db51bea0-eea3-41cd-a3b8-1b957a95563b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:14.962487 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1053/2225] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:14 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1509 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:14.972172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e5386e70-5aa5-46cd-9202-85c9e73b8af0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:14.972905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e5386e70-5aa5-46cd-9202-85c9e73b8af0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:14.973876 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db51bea0-eea3-41cd-a3b8-1b957a95563b tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1308 microversion: 2.1 time: 0.503574 Oct 18 13:26:14.974464 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1173/2226] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:14 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1308 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:14.980041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-b34a2fc9-6b80-4803-ac94-551571748250 req-8d7c2af5-ac68-49d3-b53a-86a7180c343d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157af106-c39d-428a-9cd7-1d37cd98bfcc", "tag": "eade7ea5-b653-468d-aaa4-2b40848f80bd"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:15.013808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5386e70-5aa5-46cd-9202-85c9e73b8af0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.014712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5386e70-5aa5-46cd-9202-85c9e73b8af0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.016006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5386e70-5aa5-46cd-9202-85c9e73b8af0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.018020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5386e70-5aa5-46cd-9202-85c9e73b8af0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.019749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5386e70-5aa5-46cd-9202-85c9e73b8af0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.020994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5386e70-5aa5-46cd-9202-85c9e73b8af0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.033546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b34a2fc9-6b80-4803-ac94-551571748250 req-8d7c2af5-ac68-49d3-b53a-86a7180c343d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.034033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b34a2fc9-6b80-4803-ac94-551571748250 req-8d7c2af5-ac68-49d3-b53a-86a7180c343d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.034463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b34a2fc9-6b80-4803-ac94-551571748250 req-8d7c2af5-ac68-49d3-b53a-86a7180c343d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.105482 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-b34a2fc9-6b80-4803-ac94-551571748250 req-8d7c2af5-ac68-49d3-b53a-86a7180c343d service nova] Creating event network-changed:eade7ea5-b653-468d-aaa4-2b40848f80bd for instance 157af106-c39d-428a-9cd7-1d37cd98bfcc on n-h2-858384-13 Oct 18 13:26:15.114285 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-b34a2fc9-6b80-4803-ac94-551571748250 req-8d7c2af5-ac68-49d3-b53a-86a7180c343d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138356 Oct 18 13:26:15.114911 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1174/2227] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:15.134759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d7fe9c5e-a138-4cca-9844-3ec144dab403 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:15.135277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d7fe9c5e-a138-4cca-9844-3ec144dab403 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:15.150427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7fe9c5e-a138-4cca-9844-3ec144dab403 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.151121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7fe9c5e-a138-4cca-9844-3ec144dab403 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.151719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7fe9c5e-a138-4cca-9844-3ec144dab403 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.152607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7fe9c5e-a138-4cca-9844-3ec144dab403 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.153248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7fe9c5e-a138-4cca-9844-3ec144dab403 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.154351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7fe9c5e-a138-4cca-9844-3ec144dab403 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.381586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d7fe9c5e-a138-4cca-9844-3ec144dab403 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:15.400506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d7fe9c5e-a138-4cca-9844-3ec144dab403 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:15.402427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d7fe9c5e-a138-4cca-9844-3ec144dab403 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:15.418532 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d7fe9c5e-a138-4cca-9844-3ec144dab403 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.302105 Oct 18 13:26:15.438634 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1175/2228] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:15.459277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-76abb825-fe85-4fe9-b1e4-678377ef81de tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:15.464415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-76abb825-fe85-4fe9-b1e4-678377ef81de tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:15.494578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76abb825-fe85-4fe9-b1e4-678377ef81de tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.496117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76abb825-fe85-4fe9-b1e4-678377ef81de tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.503132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76abb825-fe85-4fe9-b1e4-678377ef81de tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.506466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76abb825-fe85-4fe9-b1e4-678377ef81de tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.508599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76abb825-fe85-4fe9-b1e4-678377ef81de tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.511477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76abb825-fe85-4fe9-b1e4-678377ef81de tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.596305 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-76abb825-fe85-4fe9-b1e4-678377ef81de tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action" status: 200 len: 14 microversion: 2.1 time: 0.146178 Oct 18 13:26:15.597921 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1176/2229] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:15 2022] POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:26:15.606080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fcd3ccf4-edc3-438a-8eaf-a10f537b3c0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:15.607109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fcd3ccf4-edc3-438a-8eaf-a10f537b3c0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:15.614346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fcd3ccf4-edc3-438a-8eaf-a10f537b3c0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.615312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fcd3ccf4-edc3-438a-8eaf-a10f537b3c0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.615920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fcd3ccf4-edc3-438a-8eaf-a10f537b3c0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:15.617013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fcd3ccf4-edc3-438a-8eaf-a10f537b3c0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:15.617911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fcd3ccf4-edc3-438a-8eaf-a10f537b3c0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:15.618492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fcd3ccf4-edc3-438a-8eaf-a10f537b3c0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:16.016355 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e5386e70-5aa5-46cd-9202-85c9e73b8af0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 1.052567 Oct 18 13:26:16.017918 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1054/2230] 10.222.0.40 () {58 vars in 1293 bytes} [Tue Oct 18 13:26:14 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc/os-security-groups => generated 1159 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:16.023850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dd64501f-cf2c-426c-a7a1-d4b27917809a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:16.024666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dd64501f-cf2c-426c-a7a1-d4b27917809a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:16.045419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd64501f-cf2c-426c-a7a1-d4b27917809a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:16.051528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fcd3ccf4-edc3-438a-8eaf-a10f537b3c0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:16.057122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd64501f-cf2c-426c-a7a1-d4b27917809a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:16.057673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd64501f-cf2c-426c-a7a1-d4b27917809a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:16.060571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd64501f-cf2c-426c-a7a1-d4b27917809a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:16.064043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd64501f-cf2c-426c-a7a1-d4b27917809a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:16.064910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd64501f-cf2c-426c-a7a1-d4b27917809a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:16.067944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fcd3ccf4-edc3-438a-8eaf-a10f537b3c0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:16.069517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fcd3ccf4-edc3-438a-8eaf-a10f537b3c0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:16.075689 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fcd3ccf4-edc3-438a-8eaf-a10f537b3c0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1798 microversion: 2.42 time: 0.476327 Oct 18 13:26:16.101928 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1177/2231] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:15 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1798 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:16.110503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7a3a0e85-107c-453f-8d04-174e74126681 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:16.111887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7a3a0e85-107c-453f-8d04-174e74126681 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:16.119308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a3a0e85-107c-453f-8d04-174e74126681 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:16.120152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a3a0e85-107c-453f-8d04-174e74126681 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:16.121233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a3a0e85-107c-453f-8d04-174e74126681 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:16.122400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a3a0e85-107c-453f-8d04-174e74126681 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:16.123737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a3a0e85-107c-453f-8d04-174e74126681 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:16.124577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a3a0e85-107c-453f-8d04-174e74126681 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:16.699036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7a3a0e85-107c-453f-8d04-174e74126681 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:16.711569 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7a3a0e85-107c-453f-8d04-174e74126681 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1308 microversion: 2.1 time: 0.607181 Oct 18 13:26:16.718681 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1178/2232] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:16 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1308 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:16.728989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-913de1e0-e0e7-43be-ae26-111e4100ebb9 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'create', calling method: .version_select at 0x7ff617b7f160>, body: {"security_group": {"name": " tempest-securitygroup -47158459 ", "description": "tempest-description-1551132683"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:17.139427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dd64501f-cf2c-426c-a7a1-d4b27917809a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:17.161951 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dd64501f-cf2c-426c-a7a1-d4b27917809a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1509 microversion: 2.1 time: 1.142319 Oct 18 13:26:17.164072 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1055/2233] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:16 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1509 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:17.178679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a25b86ed-89ef-4571-954c-e284aacfd052 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:17.182051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a25b86ed-89ef-4571-954c-e284aacfd052 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:17.189020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:17.204914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25b86ed-89ef-4571-954c-e284aacfd052 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.206320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25b86ed-89ef-4571-954c-e284aacfd052 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.206998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25b86ed-89ef-4571-954c-e284aacfd052 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.208075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25b86ed-89ef-4571-954c-e284aacfd052 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.209359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25b86ed-89ef-4571-954c-e284aacfd052 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.212424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25b86ed-89ef-4571-954c-e284aacfd052 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.435468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a25b86ed-89ef-4571-954c-e284aacfd052 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:17.452801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a25b86ed-89ef-4571-954c-e284aacfd052 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:17.457410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a25b86ed-89ef-4571-954c-e284aacfd052 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:17.476015 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a25b86ed-89ef-4571-954c-e284aacfd052 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.308446 Oct 18 13:26:17.479265 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1056/2234] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:17 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:17.490832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-967c38ae-d001-414e-a6d5-cd543703b376 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:17.499592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-967c38ae-d001-414e-a6d5-cd543703b376 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:17.517005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-967c38ae-d001-414e-a6d5-cd543703b376 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.521524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-967c38ae-d001-414e-a6d5-cd543703b376 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.523398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-967c38ae-d001-414e-a6d5-cd543703b376 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.525856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-967c38ae-d001-414e-a6d5-cd543703b376 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.526601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-967c38ae-d001-414e-a6d5-cd543703b376 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.527149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-967c38ae-d001-414e-a6d5-cd543703b376 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.602686 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-967c38ae-d001-414e-a6d5-cd543703b376 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action" status: 200 len: 16389 microversion: 2.1 time: 0.115592 Oct 18 13:26:17.603549 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1057/2235] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:17 2022] POST /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671/action => generated 16389 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:26:17.617541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-69f9b731-f64a-4e17-9b2a-89813124c337 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:17.620972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-69f9b731-f64a-4e17-9b2a-89813124c337 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:17.627706 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-913de1e0-e0e7-43be-ae26-111e4100ebb9 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.907678 Oct 18 13:26:17.636412 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1179/2236] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:26:16 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:17.636412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d522d8a6-32ce-4def-b30a-e2ad5d7110ca req-c7e959cf-52e4-4c32-a29c-75669b172b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f4b424-628f-4f3b-8eba-5bd06df8ea75", "tag": "40da9821-5e60-486f-b517-e14ae94b2a28"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:17.660744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69f9b731-f64a-4e17-9b2a-89813124c337 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.672807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69f9b731-f64a-4e17-9b2a-89813124c337 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.673797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69f9b731-f64a-4e17-9b2a-89813124c337 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.673929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d522d8a6-32ce-4def-b30a-e2ad5d7110ca req-c7e959cf-52e4-4c32-a29c-75669b172b47 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.674361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d522d8a6-32ce-4def-b30a-e2ad5d7110ca req-c7e959cf-52e4-4c32-a29c-75669b172b47 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.674795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d522d8a6-32ce-4def-b30a-e2ad5d7110ca req-c7e959cf-52e4-4c32-a29c-75669b172b47 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.674964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69f9b731-f64a-4e17-9b2a-89813124c337 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.675835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69f9b731-f64a-4e17-9b2a-89813124c337 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.676265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69f9b731-f64a-4e17-9b2a-89813124c337 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.705676 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d522d8a6-32ce-4def-b30a-e2ad5d7110ca req-c7e959cf-52e4-4c32-a29c-75669b172b47 service nova] Creating event network-changed:40da9821-5e60-486f-b517-e14ae94b2a28 for instance f8f4b424-628f-4f3b-8eba-5bd06df8ea75 on n-h1-858384-13 Oct 18 13:26:17.721264 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d522d8a6-32ce-4def-b30a-e2ad5d7110ca req-c7e959cf-52e4-4c32-a29c-75669b172b47 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090389 Oct 18 13:26:17.721888 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1180/2237] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:17.738351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5566ae6e-15d8-49eb-9e98-5f41a793a6c1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:17.743276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5566ae6e-15d8-49eb-9e98-5f41a793a6c1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:17.778326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5566ae6e-15d8-49eb-9e98-5f41a793a6c1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.778834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5566ae6e-15d8-49eb-9e98-5f41a793a6c1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.779462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5566ae6e-15d8-49eb-9e98-5f41a793a6c1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:17.780370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5566ae6e-15d8-49eb-9e98-5f41a793a6c1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:17.780834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5566ae6e-15d8-49eb-9e98-5f41a793a6c1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:17.781618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5566ae6e-15d8-49eb-9e98-5f41a793a6c1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.034468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-69f9b731-f64a-4e17-9b2a-89813124c337 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:18.045967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-69f9b731-f64a-4e17-9b2a-89813124c337 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:18.048209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-69f9b731-f64a-4e17-9b2a-89813124c337 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:18.049760 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-69f9b731-f64a-4e17-9b2a-89813124c337 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1844 microversion: 2.42 time: 0.443594 Oct 18 13:26:18.050595 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1058/2238] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:17 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1844 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:18.065561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0f1a630e-6553-473e-9a77-e32a9a686b8f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff617b52550>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:18.124064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5566ae6e-15d8-49eb-9e98-5f41a793a6c1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:18.135249 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5566ae6e-15d8-49eb-9e98-5f41a793a6c1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.399656 Oct 18 13:26:18.149133 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0f1a630e-6553-473e-9a77-e32a9a686b8f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/2adacd38-4a1e-40b3-a102-e14c9495706c" status: 200 len: 222 microversion: 2.1 time: 0.097127 Oct 18 13:26:18.149699 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1181/2239] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:17 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:18.151018 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1059/2240] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:26:18 2022] GET /compute/v2.1/os-security-groups/2adacd38-4a1e-40b3-a102-e14c9495706c => generated 222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:18.164660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-97c99255-42cf-42ed-b592-ff98eb5b18a5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:18.165519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-97c99255-42cf-42ed-b592-ff98eb5b18a5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:18.166957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6df078aa-eb75-41dd-8cff-5971b5083542 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:18.167710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6df078aa-eb75-41dd-8cff-5971b5083542 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:18.175191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97c99255-42cf-42ed-b592-ff98eb5b18a5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.176280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97c99255-42cf-42ed-b592-ff98eb5b18a5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.176950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97c99255-42cf-42ed-b592-ff98eb5b18a5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.177898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97c99255-42cf-42ed-b592-ff98eb5b18a5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.178548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97c99255-42cf-42ed-b592-ff98eb5b18a5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.179019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97c99255-42cf-42ed-b592-ff98eb5b18a5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.190172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6df078aa-eb75-41dd-8cff-5971b5083542 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.190715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6df078aa-eb75-41dd-8cff-5971b5083542 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.191157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6df078aa-eb75-41dd-8cff-5971b5083542 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.191869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6df078aa-eb75-41dd-8cff-5971b5083542 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.192319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6df078aa-eb75-41dd-8cff-5971b5083542 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.192739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6df078aa-eb75-41dd-8cff-5971b5083542 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.469719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6df078aa-eb75-41dd-8cff-5971b5083542 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:18.481478 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6df078aa-eb75-41dd-8cff-5971b5083542 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.320600 Oct 18 13:26:18.482599 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1060/2241] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:18 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:18.487532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb145ef0-5c9d-41cb-ba5b-20c94d0773ca tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60fe20430>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:18.516965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-97c99255-42cf-42ed-b592-ff98eb5b18a5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:18.525835 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-97c99255-42cf-42ed-b592-ff98eb5b18a5 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1308 microversion: 2.1 time: 0.374894 Oct 18 13:26:18.526443 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1182/2242] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:18 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:18.530967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-77661600-1473-4977-903d-bc2292e7678c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:18.531587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-77661600-1473-4977-903d-bc2292e7678c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:18.576354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77661600-1473-4977-903d-bc2292e7678c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.576859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77661600-1473-4977-903d-bc2292e7678c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.577368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77661600-1473-4977-903d-bc2292e7678c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.578050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77661600-1473-4977-903d-bc2292e7678c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.578510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77661600-1473-4977-903d-bc2292e7678c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.578940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77661600-1473-4977-903d-bc2292e7678c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.918576 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eb145ef0-5c9d-41cb-ba5b-20c94d0773ca tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/2adacd38-4a1e-40b3-a102-e14c9495706c" status: 202 len: 0 microversion: 2.1 time: 0.434557 Oct 18 13:26:18.919513 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1061/2243] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:26:18 2022] DELETE /compute/v2.1/os-security-groups/2adacd38-4a1e-40b3-a102-e14c9495706c => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:18.927019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4888d5a2-53db-425f-a911-7ea9da94579d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:18.929591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4888d5a2-53db-425f-a911-7ea9da94579d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:18.944204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4888d5a2-53db-425f-a911-7ea9da94579d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.948759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4888d5a2-53db-425f-a911-7ea9da94579d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.949567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4888d5a2-53db-425f-a911-7ea9da94579d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.951102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4888d5a2-53db-425f-a911-7ea9da94579d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:18.951895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4888d5a2-53db-425f-a911-7ea9da94579d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:18.952490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4888d5a2-53db-425f-a911-7ea9da94579d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:18.988336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-77661600-1473-4977-903d-bc2292e7678c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:19.003428 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-77661600-1473-4977-903d-bc2292e7678c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1509 microversion: 2.1 time: 0.469887 Oct 18 13:26:19.004335 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1183/2244] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:18 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1509 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:19.015065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-88d7bc3e-616f-41ee-8c44-d7ecd0b02880 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:19.038212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-88d7bc3e-616f-41ee-8c44-d7ecd0b02880 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:19.052144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88d7bc3e-616f-41ee-8c44-d7ecd0b02880 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:19.052889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88d7bc3e-616f-41ee-8c44-d7ecd0b02880 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:19.053547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88d7bc3e-616f-41ee-8c44-d7ecd0b02880 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:19.054951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88d7bc3e-616f-41ee-8c44-d7ecd0b02880 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:19.055705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88d7bc3e-616f-41ee-8c44-d7ecd0b02880 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:19.056297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88d7bc3e-616f-41ee-8c44-d7ecd0b02880 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:19.263230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4888d5a2-53db-425f-a911-7ea9da94579d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:19.271431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-88d7bc3e-616f-41ee-8c44-d7ecd0b02880 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:19.287155 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4888d5a2-53db-425f-a911-7ea9da94579d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.366477 Oct 18 13:26:19.287396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-88d7bc3e-616f-41ee-8c44-d7ecd0b02880 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:19.292553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-88d7bc3e-616f-41ee-8c44-d7ecd0b02880 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:19.310435 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1062/2245] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:18 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:19.321860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16823c50-ef8f-43a2-a32c-535e20829177 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60feebd30>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:19.324212 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-88d7bc3e-616f-41ee-8c44-d7ecd0b02880 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.312878 Oct 18 13:26:19.333369 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1184/2246] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:19 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:19.351549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f0286c56-f8da-4511-9908-4a61d93474de tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:19.352476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f0286c56-f8da-4511-9908-4a61d93474de tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:19.359205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0286c56-f8da-4511-9908-4a61d93474de tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:19.359996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0286c56-f8da-4511-9908-4a61d93474de tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:19.360634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0286c56-f8da-4511-9908-4a61d93474de tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:19.361588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0286c56-f8da-4511-9908-4a61d93474de tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:19.362247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0286c56-f8da-4511-9908-4a61d93474de tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:19.362889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0286c56-f8da-4511-9908-4a61d93474de tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:19.408807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-16823c50-ef8f-43a2-a32c-535e20829177 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:26:19.410014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.security_group_api [None req-16823c50-ef8f-43a2-a32c-535e20829177 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Neutron security group 2adacd38-4a1e-40b3-a102-e14c9495706c not found {{(pid=120612) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:26:19.411164 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-16823c50-ef8f-43a2-a32c-535e20829177 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:26:19.411164 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-ad1cc59e-d1fb-43be-95de-00d051bd038a'] Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16823c50-ef8f-43a2-a32c-535e20829177 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-security-groups/2adacd38-4a1e-40b3-a102-e14c9495706c HTTP/1.1 Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:26:19.422434 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:26:19.423915 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:26:19.423915 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:19.423915 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:26:19.423915 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:19.423915 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:26:19.423915 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:26:19.423915 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:26:19.423915 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:26:19.423915 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:26:19.423915 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:26:19.423915 n-d-858384-13 devstack@n-api.service[120612]: exception: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:26:19.423915 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-ad1cc59e-d1fb-43be-95de-00d051bd038a'] Oct 18 13:26:19.423915 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '2adacd38-4a1e-40b3-a102-e14c9495706c'} Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:19.425689 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad1cc59e-d1fb-43be-95de-00d051bd038a'] Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:26:19.427008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad1cc59e-d1fb-43be-95de-00d051bd038a'] Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad1cc59e-d1fb-43be-95de-00d051bd038a'] Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:19.428290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:19.435493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:19.435493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:19.435493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:19.435493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:19.435493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:26:19.435493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad1cc59e-d1fb-43be-95de-00d051bd038a'] Oct 18 13:26:19.435493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:19.435493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16823c50-ef8f-43a2-a32c-535e20829177 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:26:19.435493 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-ad1cc59e-d1fb-43be-95de-00d051bd038a'] {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:19.435493 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-16823c50-ef8f-43a2-a32c-535e20829177 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/2adacd38-4a1e-40b3-a102-e14c9495706c" status: 404 len: 194 microversion: 2.1 time: 0.112468 Oct 18 13:26:19.435493 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1063/2247] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:26:19 2022] GET /compute/v2.1/os-security-groups/2adacd38-4a1e-40b3-a102-e14c9495706c => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:19.441019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-bcb10c5a-0308-484b-9998-496d956b7a39 req-1a612456-35df-49dd-86c1-930ab942e0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "tag": "2979f9f0-551e-4518-be50-6140626a03d0"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:19.467258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bcb10c5a-0308-484b-9998-496d956b7a39 req-1a612456-35df-49dd-86c1-930ab942e0a3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:19.467954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bcb10c5a-0308-484b-9998-496d956b7a39 req-1a612456-35df-49dd-86c1-930ab942e0a3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:19.468612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bcb10c5a-0308-484b-9998-496d956b7a39 req-1a612456-35df-49dd-86c1-930ab942e0a3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:19.493003 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-bcb10c5a-0308-484b-9998-496d956b7a39 req-1a612456-35df-49dd-86c1-930ab942e0a3 service nova] Creating event network-changed:2979f9f0-551e-4518-be50-6140626a03d0 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:26:19.508302 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-bcb10c5a-0308-484b-9998-496d956b7a39 req-1a612456-35df-49dd-86c1-930ab942e0a3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079739 Oct 18 13:26:19.509585 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1064/2248] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:19.523291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6d2025f4-a7c2-47f3-aefd-bf80f0cf72bb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:19.524034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6d2025f4-a7c2-47f3-aefd-bf80f0cf72bb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:19.543293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d2025f4-a7c2-47f3-aefd-bf80f0cf72bb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:19.543795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d2025f4-a7c2-47f3-aefd-bf80f0cf72bb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:19.544239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d2025f4-a7c2-47f3-aefd-bf80f0cf72bb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:19.544958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d2025f4-a7c2-47f3-aefd-bf80f0cf72bb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:19.545448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d2025f4-a7c2-47f3-aefd-bf80f0cf72bb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:19.545877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d2025f4-a7c2-47f3-aefd-bf80f0cf72bb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:19.646814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f0286c56-f8da-4511-9908-4a61d93474de tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:19.656463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f0286c56-f8da-4511-9908-4a61d93474de tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:19.657947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f0286c56-f8da-4511-9908-4a61d93474de tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:19.659140 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f0286c56-f8da-4511-9908-4a61d93474de tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1844 microversion: 2.42 time: 0.324419 Oct 18 13:26:19.659711 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1185/2249] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:19 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1844 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:19.674008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e8782d63-c618-4693-b818-864da64e3667 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'create', calling method: .version_select at 0x7ff617ac4040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1813835785", "description": "tempest-description-1645207166"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:19.817570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6d2025f4-a7c2-47f3-aefd-bf80f0cf72bb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:19.825779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:19.836333 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6d2025f4-a7c2-47f3-aefd-bf80f0cf72bb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.324470 Oct 18 13:26:19.837158 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1065/2250] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:19 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:19.865426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8076d440-0d5c-4ed5-a5d7-525e53b7c551 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:19.865825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8076d440-0d5c-4ed5-a5d7-525e53b7c551 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:19.879586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8076d440-0d5c-4ed5-a5d7-525e53b7c551 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:19.884780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8076d440-0d5c-4ed5-a5d7-525e53b7c551 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:19.885386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8076d440-0d5c-4ed5-a5d7-525e53b7c551 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:19.886137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8076d440-0d5c-4ed5-a5d7-525e53b7c551 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:19.886608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8076d440-0d5c-4ed5-a5d7-525e53b7c551 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:19.887046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8076d440-0d5c-4ed5-a5d7-525e53b7c551 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:19.977461 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e8782d63-c618-4693-b818-864da64e3667 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.316464 Oct 18 13:26:19.986156 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1186/2251] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:26:19 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:19.990178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dbf8b135-85ea-466a-b884-21ccb5d494c7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:19.990822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dbf8b135-85ea-466a-b884-21ccb5d494c7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:20.006264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbf8b135-85ea-466a-b884-21ccb5d494c7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:20.006817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbf8b135-85ea-466a-b884-21ccb5d494c7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:20.007409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbf8b135-85ea-466a-b884-21ccb5d494c7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:20.020387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbf8b135-85ea-466a-b884-21ccb5d494c7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:20.021167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbf8b135-85ea-466a-b884-21ccb5d494c7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:20.021861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbf8b135-85ea-466a-b884-21ccb5d494c7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:20.087234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:20.186248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dbf8b135-85ea-466a-b884-21ccb5d494c7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Locking {{(pid=120611) lock /opt/stack/nova/nova/compute/api.py:4847}} Oct 18 13:26:20.309648 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dbf8b135-85ea-466a-b884-21ccb5d494c7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.329944 Oct 18 13:26:20.311334 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1187/2252] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:19 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:20.319286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fbde2dc4-b742-48c4-be2e-e70426df20d6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'create', calling method: .version_select at 0x7ff617bb9310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1783804113", "description": "tempest-description-1234779125"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:20.935039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8076d440-0d5c-4ed5-a5d7-525e53b7c551 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:20.947282 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8076d440-0d5c-4ed5-a5d7-525e53b7c551 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1308 microversion: 2.1 time: 1.088674 Oct 18 13:26:20.956059 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1066/2253] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:19 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1308 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:20.970070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eef61718-698b-425a-a47c-1390c20926a0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:20.984278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eef61718-698b-425a-a47c-1390c20926a0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:21.015242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eef61718-698b-425a-a47c-1390c20926a0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.016153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eef61718-698b-425a-a47c-1390c20926a0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.019464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eef61718-698b-425a-a47c-1390c20926a0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.023550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eef61718-698b-425a-a47c-1390c20926a0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.026883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eef61718-698b-425a-a47c-1390c20926a0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.030137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eef61718-698b-425a-a47c-1390c20926a0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.402269 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fbde2dc4-b742-48c4-be2e-e70426df20d6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.089639 Oct 18 13:26:21.402871 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1188/2254] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:26:20 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:21.416141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7934eccb-02d3-4544-a87e-f5ac5ac7a363 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.417133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7934eccb-02d3-4544-a87e-f5ac5ac7a363 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:21.427328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7934eccb-02d3-4544-a87e-f5ac5ac7a363 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.428075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7934eccb-02d3-4544-a87e-f5ac5ac7a363 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.430395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7934eccb-02d3-4544-a87e-f5ac5ac7a363 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.431333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7934eccb-02d3-4544-a87e-f5ac5ac7a363 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.434277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7934eccb-02d3-4544-a87e-f5ac5ac7a363 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.434885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7934eccb-02d3-4544-a87e-f5ac5ac7a363 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.461859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eef61718-698b-425a-a47c-1390c20926a0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:21.471440 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eef61718-698b-425a-a47c-1390c20926a0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1509 microversion: 2.1 time: 0.514212 Oct 18 13:26:21.478689 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1067/2255] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:20 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1509 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:21.494527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0f85f6b6-df82-42cc-92c2-7efc4dea8293 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.506080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0f85f6b6-df82-42cc-92c2-7efc4dea8293 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:21.516550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f85f6b6-df82-42cc-92c2-7efc4dea8293 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.518650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f85f6b6-df82-42cc-92c2-7efc4dea8293 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.519348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f85f6b6-df82-42cc-92c2-7efc4dea8293 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.520288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f85f6b6-df82-42cc-92c2-7efc4dea8293 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.520956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f85f6b6-df82-42cc-92c2-7efc4dea8293 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.521625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f85f6b6-df82-42cc-92c2-7efc4dea8293 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.700623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0f85f6b6-df82-42cc-92c2-7efc4dea8293 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:21.718797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0f85f6b6-df82-42cc-92c2-7efc4dea8293 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:21.728366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0f85f6b6-df82-42cc-92c2-7efc4dea8293 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:21.741003 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0f85f6b6-df82-42cc-92c2-7efc4dea8293 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.258359 Oct 18 13:26:21.765221 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1068/2256] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:21 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:21.765568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad1a8e23-e7fc-44ee-80f4-6763170b5c08 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:21.766022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ad1a8e23-e7fc-44ee-80f4-6763170b5c08 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:21.792028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad1a8e23-e7fc-44ee-80f4-6763170b5c08 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.797367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad1a8e23-e7fc-44ee-80f4-6763170b5c08 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.797996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad1a8e23-e7fc-44ee-80f4-6763170b5c08 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.803160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad1a8e23-e7fc-44ee-80f4-6763170b5c08 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:21.806005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad1a8e23-e7fc-44ee-80f4-6763170b5c08 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:21.806676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad1a8e23-e7fc-44ee-80f4-6763170b5c08 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:21.823096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7934eccb-02d3-4544-a87e-f5ac5ac7a363 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:21.836284 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7934eccb-02d3-4544-a87e-f5ac5ac7a363 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.430872 Oct 18 13:26:21.838368 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1189/2257] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:21 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:21.853130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-795b6789-27da-439c-8751-7d0cabdc44c2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'create', calling method: .version_select at 0x7ff60f23b9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-7275081", "description": "tempest-description-1084376676"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:22.243727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad1a8e23-e7fc-44ee-80f4-6763170b5c08 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:22.261375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad1a8e23-e7fc-44ee-80f4-6763170b5c08 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:22.263795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad1a8e23-e7fc-44ee-80f4-6763170b5c08 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:22.265770 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad1a8e23-e7fc-44ee-80f4-6763170b5c08 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1865 microversion: 2.42 time: 0.514576 Oct 18 13:26:22.267345 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1069/2258] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:21 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1865 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:22.295839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5154c1e1-912c-46c3-8ee5-a44f552825d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:22.316436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5154c1e1-912c-46c3-8ee5-a44f552825d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.318464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5154c1e1-912c-46c3-8ee5-a44f552825d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.319224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5154c1e1-912c-46c3-8ee5-a44f552825d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:22.495057 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-5154c1e1-912c-46c3-8ee5-a44f552825d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] HTTP exception thrown: Instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 is locked Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5154c1e1-912c-46c3-8ee5-a44f552825d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Request method failure captured: Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action HTTP/1.1 Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 15 Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqgSyOovjkBwC2zDG9FKchsa-85pvviPiRczs79e9ogA2WOflaKqo4WjkGNjiwWrTbKQeMF0qFdRR97LgwpYjvL7_VWxucAaxUZM-ArWvxecTGdyg6CEOtjVVE0a_ifjjfGSQqXSLBM0YxminaTsZoLWFl2mIOYtfxpGTzdnzLBn-rI Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 452e5b77db474cf9a2b7f6b2abcb6115 Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerActionsTestJSON-330379010 Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:26:22.500095 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_452e5b77db474cf9a2b7f6b2abcb6115"}]}] Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerActionsTestJSON-330379010 Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 452e5b77db474cf9a2b7f6b2abcb6115 Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerActionsTestJSON-330379010 Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerActionsTestJSON-330379010-project Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 2878f8de95694fe1a9a17ed27b6ba40b Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerActionsTestJSON-330379010-project Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: {"os-stop": {}} Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 is locked Oct 18 13:26:22.501321 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '9aad90b5-28fb-44b2-89da-33bc1b2889f2', 'body': {'os-stop': {}}} Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 is locked Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 18 13:26:22.502072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 is locked Oct 18 13:26:22.503047 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:22.503047 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:22.503047 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:22.503047 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:22.503047 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:22.503047 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:22.503047 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:22.503047 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:22.503047 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 is locked Oct 18 13:26:22.503047 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:22.507163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5154c1e1-912c-46c3-8ee5-a44f552825d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Returning 409 to user: Instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 is locked {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:22.508557 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5154c1e1-912c-46c3-8ee5-a44f552825d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 409 len: 107 microversion: 2.1 time: 0.239116 Oct 18 13:26:22.512983 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1070/2259] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:22 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 107 bytes in 245 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:26:22.559641 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-795b6789-27da-439c-8751-7d0cabdc44c2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.717837 Oct 18 13:26:22.562003 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1190/2260] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:26:21 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:22.577844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-59e1fab0-20a5-42fe-8528-ded9a2ec8a75 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:22.583222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-59e1fab0-20a5-42fe-8528-ded9a2ec8a75 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:22.605708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59e1fab0-20a5-42fe-8528-ded9a2ec8a75 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.611173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59e1fab0-20a5-42fe-8528-ded9a2ec8a75 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.614271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59e1fab0-20a5-42fe-8528-ded9a2ec8a75 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:22.618824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59e1fab0-20a5-42fe-8528-ded9a2ec8a75 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.620426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59e1fab0-20a5-42fe-8528-ded9a2ec8a75 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.631087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59e1fab0-20a5-42fe-8528-ded9a2ec8a75 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:22.856135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e9d88590-523d-4598-a26c-ce70a17f51e1 req-acb20f0b-9115-4677-a19b-415a640198f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "tag": "ef5c7c5f-a59a-4ff2-ac9a-1bcbff29af46"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:22.877674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e9d88590-523d-4598-a26c-ce70a17f51e1 req-acb20f0b-9115-4677-a19b-415a640198f0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.878300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e9d88590-523d-4598-a26c-ce70a17f51e1 req-acb20f0b-9115-4677-a19b-415a640198f0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.878741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e9d88590-523d-4598-a26c-ce70a17f51e1 req-acb20f0b-9115-4677-a19b-415a640198f0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:22.901276 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e9d88590-523d-4598-a26c-ce70a17f51e1 req-acb20f0b-9115-4677-a19b-415a640198f0 service nova] Creating event network-changed:ef5c7c5f-a59a-4ff2-ac9a-1bcbff29af46 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:26:22.919169 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e9d88590-523d-4598-a26c-ce70a17f51e1 req-acb20f0b-9115-4677-a19b-415a640198f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.404567 Oct 18 13:26:22.920363 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1071/2261] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:22.928938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-53887e7e-b46a-4446-800e-9c95e86d44b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:22.930278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-53887e7e-b46a-4446-800e-9c95e86d44b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:22.952858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53887e7e-b46a-4446-800e-9c95e86d44b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.953699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53887e7e-b46a-4446-800e-9c95e86d44b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.954441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53887e7e-b46a-4446-800e-9c95e86d44b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:22.955335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53887e7e-b46a-4446-800e-9c95e86d44b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:22.955804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53887e7e-b46a-4446-800e-9c95e86d44b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:22.956239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53887e7e-b46a-4446-800e-9c95e86d44b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.294068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-53887e7e-b46a-4446-800e-9c95e86d44b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:23.308137 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-53887e7e-b46a-4446-800e-9c95e86d44b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1509 microversion: 2.1 time: 0.386021 Oct 18 13:26:23.308756 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1072/2262] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:22 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1509 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:23.321589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-59e1fab0-20a5-42fe-8528-ded9a2ec8a75 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:23.341666 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-59e1fab0-20a5-42fe-8528-ded9a2ec8a75 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1308 microversion: 2.1 time: 0.766292 Oct 18 13:26:23.342293 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1191/2263] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:22 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1308 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:23.348636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a1d5cf2b-c5e6-40ef-862b-5c83b5ca80a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:23.354149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a1d5cf2b-c5e6-40ef-862b-5c83b5ca80a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:23.370743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1d5cf2b-c5e6-40ef-862b-5c83b5ca80a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:23.370993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1d5cf2b-c5e6-40ef-862b-5c83b5ca80a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:23.372696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1c4afb0f-e376-49ff-9070-f722d8e94df5 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60f1e93a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:23.375651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1d5cf2b-c5e6-40ef-862b-5c83b5ca80a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.376430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1d5cf2b-c5e6-40ef-862b-5c83b5ca80a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:23.376899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1d5cf2b-c5e6-40ef-862b-5c83b5ca80a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:23.382568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1d5cf2b-c5e6-40ef-862b-5c83b5ca80a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.499969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a1d5cf2b-c5e6-40ef-862b-5c83b5ca80a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Unlocking {{(pid=120612) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 18 13:26:23.610493 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a1d5cf2b-c5e6-40ef-862b-5c83b5ca80a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.277450 Oct 18 13:26:23.611834 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1073/2264] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:23 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:23.618319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-c80ccd08-27e9-4556-9624-8e2e8b4ff79e req-eeaa5983-95ff-446e-8d9a-70a418435def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f4b424-628f-4f3b-8eba-5bd06df8ea75", "name": "network-vif-plugged", "status": "completed", "tag": "40da9821-5e60-486f-b517-e14ae94b2a28"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:23.637322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c80ccd08-27e9-4556-9624-8e2e8b4ff79e req-eeaa5983-95ff-446e-8d9a-70a418435def service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:23.638125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c80ccd08-27e9-4556-9624-8e2e8b4ff79e req-eeaa5983-95ff-446e-8d9a-70a418435def service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:23.638774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c80ccd08-27e9-4556-9624-8e2e8b4ff79e req-eeaa5983-95ff-446e-8d9a-70a418435def service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.671307 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-c80ccd08-27e9-4556-9624-8e2e8b4ff79e req-eeaa5983-95ff-446e-8d9a-70a418435def service nova] Creating event network-vif-plugged:40da9821-5e60-486f-b517-e14ae94b2a28 for instance f8f4b424-628f-4f3b-8eba-5bd06df8ea75 on n-h1-858384-13 Oct 18 13:26:23.677209 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-c80ccd08-27e9-4556-9624-8e2e8b4ff79e req-eeaa5983-95ff-446e-8d9a-70a418435def service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063934 Oct 18 13:26:23.678450 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1074/2265] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:23.686272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-80399692-993f-4e3d-8265-656a80715c7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:23.694226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-80399692-993f-4e3d-8265-656a80715c7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:23.714971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80399692-993f-4e3d-8265-656a80715c7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:23.715863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80399692-993f-4e3d-8265-656a80715c7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:23.716547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80399692-993f-4e3d-8265-656a80715c7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.717518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80399692-993f-4e3d-8265-656a80715c7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:23.718165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80399692-993f-4e3d-8265-656a80715c7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:23.718807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80399692-993f-4e3d-8265-656a80715c7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.841630 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1c4afb0f-e376-49ff-9070-f722d8e94df5 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.481441 Oct 18 13:26:23.843216 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1192/2266] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:26:23 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:23.874549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f27848e0-03b0-45f9-b543-9ec2489992b0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:23.877373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f27848e0-03b0-45f9-b543-9ec2489992b0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:23.918475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f27848e0-03b0-45f9-b543-9ec2489992b0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:23.923079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f27848e0-03b0-45f9-b543-9ec2489992b0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:23.923539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f27848e0-03b0-45f9-b543-9ec2489992b0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.926481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f27848e0-03b0-45f9-b543-9ec2489992b0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:23.926965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f27848e0-03b0-45f9-b543-9ec2489992b0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:23.927408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f27848e0-03b0-45f9-b543-9ec2489992b0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:23.987087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-80399692-993f-4e3d-8265-656a80715c7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:24.006334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-80399692-993f-4e3d-8265-656a80715c7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:24.008009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-80399692-993f-4e3d-8265-656a80715c7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:24.035275 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-80399692-993f-4e3d-8265-656a80715c7d tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.354107 Oct 18 13:26:24.035891 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1075/2267] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:23 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:24.071709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1674d250-b850-4e7f-a6c3-b5fe4f592847 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:24.092867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1674d250-b850-4e7f-a6c3-b5fe4f592847 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:24.093399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1674d250-b850-4e7f-a6c3-b5fe4f592847 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:24.093843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1674d250-b850-4e7f-a6c3-b5fe4f592847 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:24.165842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1674d250-b850-4e7f-a6c3-b5fe4f592847 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Going to try to stop instance {{(pid=120612) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:26:24.289236 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1674d250-b850-4e7f-a6c3-b5fe4f592847 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.233962 Oct 18 13:26:24.294742 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1076/2268] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:24 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:24.308184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-92744e78-1971-4e89-81e2-490961fd7b96 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60fe329d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:24.328845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f27848e0-03b0-45f9-b543-9ec2489992b0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:24.355056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f27848e0-03b0-45f9-b543-9ec2489992b0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:24.364361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f27848e0-03b0-45f9-b543-9ec2489992b0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:24.365626 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f27848e0-03b0-45f9-b543-9ec2489992b0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1886 microversion: 2.42 time: 0.506504 Oct 18 13:26:24.366182 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1193/2269] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:23 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1886 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:24.397816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-752164ec-c70b-4f42-bcba-c4e81e196986 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:24.399898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-752164ec-c70b-4f42-bcba-c4e81e196986 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:24.427838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-752164ec-c70b-4f42-bcba-c4e81e196986 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:24.430713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-752164ec-c70b-4f42-bcba-c4e81e196986 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:24.436937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-752164ec-c70b-4f42-bcba-c4e81e196986 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:24.438038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-752164ec-c70b-4f42-bcba-c4e81e196986 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:24.443129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-752164ec-c70b-4f42-bcba-c4e81e196986 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:24.449774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-752164ec-c70b-4f42-bcba-c4e81e196986 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:24.638901 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-92744e78-1971-4e89-81e2-490961fd7b96 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/c1ac03d1-4310-4ce6-b818-63e5ed18323d" status: 202 len: 0 microversion: 2.1 time: 0.345485 Oct 18 13:26:24.639917 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1077/2270] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:26:24 2022] DELETE /compute/v2.1/os-security-groups/c1ac03d1-4310-4ce6-b818-63e5ed18323d => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:24.646905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-81885aff-2eb3-4369-abc9-b35f7893eb97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:24.648039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-81885aff-2eb3-4369-abc9-b35f7893eb97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:24.670034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81885aff-2eb3-4369-abc9-b35f7893eb97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:24.677904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81885aff-2eb3-4369-abc9-b35f7893eb97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:24.678581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81885aff-2eb3-4369-abc9-b35f7893eb97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:24.688816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81885aff-2eb3-4369-abc9-b35f7893eb97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:24.689790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81885aff-2eb3-4369-abc9-b35f7893eb97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:24.690420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81885aff-2eb3-4369-abc9-b35f7893eb97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.072313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-81885aff-2eb3-4369-abc9-b35f7893eb97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:25.087366 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-81885aff-2eb3-4369-abc9-b35f7893eb97 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1530 microversion: 2.1 time: 0.443010 Oct 18 13:26:25.091993 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1078/2271] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:24 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1530 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:25.112960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-752164ec-c70b-4f42-bcba-c4e81e196986 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:25.130416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-423f5714-e473-4a40-9964-6d60b27b36b4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:25.131401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-423f5714-e473-4a40-9964-6d60b27b36b4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:25.133742 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-752164ec-c70b-4f42-bcba-c4e81e196986 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.750223 Oct 18 13:26:25.142186 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1194/2272] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:24 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:25.150714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-423f5714-e473-4a40-9964-6d60b27b36b4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.153659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-423f5714-e473-4a40-9964-6d60b27b36b4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.154957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-423f5714-e473-4a40-9964-6d60b27b36b4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.156777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-423f5714-e473-4a40-9964-6d60b27b36b4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.161936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2628e55f-d84d-4d59-956b-9978148ccf8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60f1e93a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:25.166482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-423f5714-e473-4a40-9964-6d60b27b36b4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.169886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-423f5714-e473-4a40-9964-6d60b27b36b4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.273731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG neutronclient.v2_0.client [None req-2628e55f-d84d-4d59-956b-9978148ccf8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist", "detail": ""}} {{(pid=120611) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:26:25.274924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.security_group_api [None req-2628e55f-d84d-4d59-956b-9978148ccf8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Neutron security group c1ac03d1-4310-4ce6-b818-63e5ed18323d not found {{(pid=120611) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:26:25.275624 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-2628e55f-d84d-4d59-956b-9978148ccf8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:26:25.275624 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-b196f07e-8dcd-459e-b2f2-372ea23f0552'] Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2628e55f-d84d-4d59-956b-9978148ccf8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-security-groups/c1ac03d1-4310-4ce6-b818-63e5ed18323d HTTP/1.1 Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:25.278100 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:25.279241 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:26:25.279241 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:25.279241 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:26:25.279241 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:25.279241 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:26:25.279241 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:25.279241 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:25.279241 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:26:25.279241 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:26:25.279241 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:26:25.279241 n-d-858384-13 devstack@n-api.service[120611]: exception: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:26:25.279241 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-b196f07e-8dcd-459e-b2f2-372ea23f0552'] Oct 18 13:26:25.279241 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'c1ac03d1-4310-4ce6-b818-63e5ed18323d'} Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:25.279930 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b196f07e-8dcd-459e-b2f2-372ea23f0552'] Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:26:25.280994 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b196f07e-8dcd-459e-b2f2-372ea23f0552'] Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b196f07e-8dcd-459e-b2f2-372ea23f0552'] Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:25.281959 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:25.283037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:25.283037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:25.283037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:25.283037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:25.283037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:26:25.283037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b196f07e-8dcd-459e-b2f2-372ea23f0552'] Oct 18 13:26:25.283037 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:25.285095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2628e55f-d84d-4d59-956b-9978148ccf8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:26:25.285095 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-b196f07e-8dcd-459e-b2f2-372ea23f0552'] {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:25.287686 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2628e55f-d84d-4d59-956b-9978148ccf8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/c1ac03d1-4310-4ce6-b818-63e5ed18323d" status: 404 len: 194 microversion: 2.1 time: 0.142952 Oct 18 13:26:25.288798 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1195/2273] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:26:25 2022] GET /compute/v2.1/os-security-groups/c1ac03d1-4310-4ce6-b818-63e5ed18323d => generated 194 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:25.296919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-aa322163-78a3-4dd6-9084-a20088d54d94 req-50083bd8-af6d-4e68-8f00-ec6e876c17e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "tag": "0f89053d-88e6-469d-961b-4f3a032c7321"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:25.318903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-aa322163-78a3-4dd6-9084-a20088d54d94 req-50083bd8-af6d-4e68-8f00-ec6e876c17e0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.320515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-aa322163-78a3-4dd6-9084-a20088d54d94 req-50083bd8-af6d-4e68-8f00-ec6e876c17e0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.324797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-aa322163-78a3-4dd6-9084-a20088d54d94 req-50083bd8-af6d-4e68-8f00-ec6e876c17e0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.349352 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-aa322163-78a3-4dd6-9084-a20088d54d94 req-50083bd8-af6d-4e68-8f00-ec6e876c17e0 service nova] Creating event network-changed:0f89053d-88e6-469d-961b-4f3a032c7321 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:26:25.360818 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-aa322163-78a3-4dd6-9084-a20088d54d94 req-50083bd8-af6d-4e68-8f00-ec6e876c17e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070250 Oct 18 13:26:25.365486 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1196/2274] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:25.383271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a0c9c458-bfc0-4b08-9661-fc10d1fd6e93 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:25.384354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a0c9c458-bfc0-4b08-9661-fc10d1fd6e93 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:25.401872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0c9c458-bfc0-4b08-9661-fc10d1fd6e93 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.402488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0c9c458-bfc0-4b08-9661-fc10d1fd6e93 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.410969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0c9c458-bfc0-4b08-9661-fc10d1fd6e93 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.412284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0c9c458-bfc0-4b08-9661-fc10d1fd6e93 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.412804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0c9c458-bfc0-4b08-9661-fc10d1fd6e93 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.413950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0c9c458-bfc0-4b08-9661-fc10d1fd6e93 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.499103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-423f5714-e473-4a40-9964-6d60b27b36b4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:25.513577 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-423f5714-e473-4a40-9964-6d60b27b36b4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1308 microversion: 2.1 time: 0.420108 Oct 18 13:26:25.521720 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1079/2275] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:25 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1308 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:25.527933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-82abea46-ca50-4e2c-a8e7-027b13aaf6f2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60f5fc310>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:25.540684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a0c9c458-bfc0-4b08-9661-fc10d1fd6e93 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:25.555596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a0c9c458-bfc0-4b08-9661-fc10d1fd6e93 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:25.558588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a0c9c458-bfc0-4b08-9661-fc10d1fd6e93 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:25.571121 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a0c9c458-bfc0-4b08-9661-fc10d1fd6e93 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.202101 Oct 18 13:26:25.571914 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1197/2276] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:25 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:25.584731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6da3ba63-5ea1-440c-9e41-6745646e3ea0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:25.586123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6da3ba63-5ea1-440c-9e41-6745646e3ea0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:25.597499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6da3ba63-5ea1-440c-9e41-6745646e3ea0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.600086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6da3ba63-5ea1-440c-9e41-6745646e3ea0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.604150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6da3ba63-5ea1-440c-9e41-6745646e3ea0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:25.609858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6da3ba63-5ea1-440c-9e41-6745646e3ea0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:25.610734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6da3ba63-5ea1-440c-9e41-6745646e3ea0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:25.611513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6da3ba63-5ea1-440c-9e41-6745646e3ea0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.017095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6da3ba63-5ea1-440c-9e41-6745646e3ea0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:26.030530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6da3ba63-5ea1-440c-9e41-6745646e3ea0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:26.041565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6da3ba63-5ea1-440c-9e41-6745646e3ea0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:26.043774 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6da3ba63-5ea1-440c-9e41-6745646e3ea0 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1886 microversion: 2.42 time: 0.467678 Oct 18 13:26:26.058361 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1198/2277] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:25 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1886 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:26.119289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-12a11b5b-f076-4cfc-977b-ab996d008d84 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:26.121734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-12a11b5b-f076-4cfc-977b-ab996d008d84 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:26.145561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12a11b5b-f076-4cfc-977b-ab996d008d84 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.146421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12a11b5b-f076-4cfc-977b-ab996d008d84 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.147093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12a11b5b-f076-4cfc-977b-ab996d008d84 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.148934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12a11b5b-f076-4cfc-977b-ab996d008d84 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.149701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12a11b5b-f076-4cfc-977b-ab996d008d84 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.150427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12a11b5b-f076-4cfc-977b-ab996d008d84 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.406986 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-82abea46-ca50-4e2c-a8e7-027b13aaf6f2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/511394d9-89f4-4e10-93f8-714a994d214f" status: 202 len: 0 microversion: 2.1 time: 0.883180 Oct 18 13:26:26.407819 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1080/2278] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:26:25 2022] DELETE /compute/v2.1/os-security-groups/511394d9-89f4-4e10-93f8-714a994d214f => generated 0 bytes in 885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:26.415373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4296a736-5d8a-40b9-9a59-c333cfe2bea0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:26.416163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4296a736-5d8a-40b9-9a59-c333cfe2bea0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:26.443184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4296a736-5d8a-40b9-9a59-c333cfe2bea0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.443995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4296a736-5d8a-40b9-9a59-c333cfe2bea0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.444971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4296a736-5d8a-40b9-9a59-c333cfe2bea0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.446445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4296a736-5d8a-40b9-9a59-c333cfe2bea0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.446920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4296a736-5d8a-40b9-9a59-c333cfe2bea0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.447357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4296a736-5d8a-40b9-9a59-c333cfe2bea0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.653449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-12a11b5b-f076-4cfc-977b-ab996d008d84 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:26.664931 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-12a11b5b-f076-4cfc-977b-ab996d008d84 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1530 microversion: 2.1 time: 0.552410 Oct 18 13:26:26.665889 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1199/2279] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:26 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1530 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:26.686101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dbf45ef1-e510-4592-b8f6-6f105f3b937f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60f1e91f0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:26.753449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG neutronclient.v2_0.client [None req-dbf45ef1-e510-4592-b8f6-6f105f3b937f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist", "detail": ""}} {{(pid=120611) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:26:26.754619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.security_group_api [None req-dbf45ef1-e510-4592-b8f6-6f105f3b937f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Neutron security group 511394d9-89f4-4e10-93f8-714a994d214f not found {{(pid=120611) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:26:26.755774 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-dbf45ef1-e510-4592-b8f6-6f105f3b937f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:26:26.755774 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-abcf8dd3-fd0a-41e4-9a8c-a96e20a88ac3'] Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dbf45ef1-e510-4592-b8f6-6f105f3b937f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-security-groups/511394d9-89f4-4e10-93f8-714a994d214f HTTP/1.1 Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:26.760123 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:26.763249 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:26:26.763249 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:26.763249 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:26:26.763249 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:26.763249 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:26:26.763249 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:26.763249 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:26.763249 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:26:26.763249 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:26:26.763249 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:26:26.763249 n-d-858384-13 devstack@n-api.service[120611]: exception: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:26:26.763249 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-abcf8dd3-fd0a-41e4-9a8c-a96e20a88ac3'] Oct 18 13:26:26.763249 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '511394d9-89f4-4e10-93f8-714a994d214f'} Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:26.765300 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-abcf8dd3-fd0a-41e4-9a8c-a96e20a88ac3'] Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:26:26.766864 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-abcf8dd3-fd0a-41e4-9a8c-a96e20a88ac3'] Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-abcf8dd3-fd0a-41e4-9a8c-a96e20a88ac3'] Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:26.768447 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:26.771188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:26.771188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:26.771188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:26.771188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:26.771188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:26:26.771188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-abcf8dd3-fd0a-41e4-9a8c-a96e20a88ac3'] Oct 18 13:26:26.771188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:26.772878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dbf45ef1-e510-4592-b8f6-6f105f3b937f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:26:26.772878 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-abcf8dd3-fd0a-41e4-9a8c-a96e20a88ac3'] {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:26.774231 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dbf45ef1-e510-4592-b8f6-6f105f3b937f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/511394d9-89f4-4e10-93f8-714a994d214f" status: 404 len: 194 microversion: 2.1 time: 0.107265 Oct 18 13:26:26.779574 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1200/2280] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:26:26 2022] GET /compute/v2.1/os-security-groups/511394d9-89f4-4e10-93f8-714a994d214f => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:26.793541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-43828c64-0bd6-41be-ad4f-222bf36e2e62 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:26.801817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-43828c64-0bd6-41be-ad4f-222bf36e2e62 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:26.824546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43828c64-0bd6-41be-ad4f-222bf36e2e62 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.825809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43828c64-0bd6-41be-ad4f-222bf36e2e62 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.827698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43828c64-0bd6-41be-ad4f-222bf36e2e62 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.828596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43828c64-0bd6-41be-ad4f-222bf36e2e62 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.829284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43828c64-0bd6-41be-ad4f-222bf36e2e62 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.829964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43828c64-0bd6-41be-ad4f-222bf36e2e62 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.889117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4296a736-5d8a-40b9-9a59-c333cfe2bea0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:26.897837 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4296a736-5d8a-40b9-9a59-c333cfe2bea0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.488624 Oct 18 13:26:26.902093 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1081/2281] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:26 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:26.913014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-20a044cc-f925-4900-b8c7-ad0d51690780 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:26.914317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-20a044cc-f925-4900-b8c7-ad0d51690780 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:26.939580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20a044cc-f925-4900-b8c7-ad0d51690780 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.943384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20a044cc-f925-4900-b8c7-ad0d51690780 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.944105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20a044cc-f925-4900-b8c7-ad0d51690780 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:26.945055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20a044cc-f925-4900-b8c7-ad0d51690780 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:26.949824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20a044cc-f925-4900-b8c7-ad0d51690780 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:26.951484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20a044cc-f925-4900-b8c7-ad0d51690780 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.064406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-20a044cc-f925-4900-b8c7-ad0d51690780 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:27.077068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:27.099310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-20a044cc-f925-4900-b8c7-ad0d51690780 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:27.103452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-20a044cc-f925-4900-b8c7-ad0d51690780 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:27.162554 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-20a044cc-f925-4900-b8c7-ad0d51690780 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.259101 Oct 18 13:26:27.164063 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1082/2282] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:26 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:27.169073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-091c7b56-9578-4e9c-bf76-90883af12945 req-89862df2-33c5-4990-ae4b-3b8363b4de96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a52dba4-8897-442b-b15f-4d3185f02add", "name": "network-vif-plugged", "status": "completed", "tag": "347c646b-dc50-4651-a535-bcda2f5df834"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:27.195722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-091c7b56-9578-4e9c-bf76-90883af12945 req-89862df2-33c5-4990-ae4b-3b8363b4de96 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.196554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-091c7b56-9578-4e9c-bf76-90883af12945 req-89862df2-33c5-4990-ae4b-3b8363b4de96 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.197238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-091c7b56-9578-4e9c-bf76-90883af12945 req-89862df2-33c5-4990-ae4b-3b8363b4de96 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.226316 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-091c7b56-9578-4e9c-bf76-90883af12945 req-89862df2-33c5-4990-ae4b-3b8363b4de96 service nova] Creating event network-vif-plugged:347c646b-dc50-4651-a535-bcda2f5df834 for instance 3a52dba4-8897-442b-b15f-4d3185f02add on n-h1-858384-13 Oct 18 13:26:27.247098 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-091c7b56-9578-4e9c-bf76-90883af12945 req-89862df2-33c5-4990-ae4b-3b8363b4de96 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081365 Oct 18 13:26:27.248095 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1083/2283] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:27.253888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bdf6aa69-dbb9-471d-bc77-0f98545854b4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60fc99ca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:27.267127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-43828c64-0bd6-41be-ad4f-222bf36e2e62 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:27.276639 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-43828c64-0bd6-41be-ad4f-222bf36e2e62 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1488 microversion: 2.1 time: 0.489978 Oct 18 13:26:27.294623 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1201/2284] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:26 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1488 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:27.315031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7ef0cebc-eb9a-4d6e-8416-7f00e37d7587 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:27.321844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7ef0cebc-eb9a-4d6e-8416-7f00e37d7587 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:27.354520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ef0cebc-eb9a-4d6e-8416-7f00e37d7587 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.355115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ef0cebc-eb9a-4d6e-8416-7f00e37d7587 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.355584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ef0cebc-eb9a-4d6e-8416-7f00e37d7587 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.356309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ef0cebc-eb9a-4d6e-8416-7f00e37d7587 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.356915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ef0cebc-eb9a-4d6e-8416-7f00e37d7587 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.357387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ef0cebc-eb9a-4d6e-8416-7f00e37d7587 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.626230 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bdf6aa69-dbb9-471d-bc77-0f98545854b4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/ca7a3cd5-35c6-423e-b3f3-26759c666e65" status: 202 len: 0 microversion: 2.1 time: 0.376697 Oct 18 13:26:27.626833 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1084/2285] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:26:27 2022] DELETE /compute/v2.1/os-security-groups/ca7a3cd5-35c6-423e-b3f3-26759c666e65 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:27.635949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6a01d95d-6152-42cf-afb7-f361eef515ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-971715732"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:27.647100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6a01d95d-6152-42cf-afb7-f361eef515ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:27.672205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a01d95d-6152-42cf-afb7-f361eef515ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.673859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a01d95d-6152-42cf-afb7-f361eef515ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.674893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a01d95d-6152-42cf-afb7-f361eef515ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.677543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a01d95d-6152-42cf-afb7-f361eef515ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:27.678274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a01d95d-6152-42cf-afb7-f361eef515ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:27.678981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a01d95d-6152-42cf-afb7-f361eef515ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:27.953816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7ef0cebc-eb9a-4d6e-8416-7f00e37d7587 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:27.970896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7ef0cebc-eb9a-4d6e-8416-7f00e37d7587 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:27.975723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7ef0cebc-eb9a-4d6e-8416-7f00e37d7587 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:27.978423 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7ef0cebc-eb9a-4d6e-8416-7f00e37d7587 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1886 microversion: 2.42 time: 0.681676 Oct 18 13:26:27.996245 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1202/2286] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:27 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1886 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:28.006527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3b077a22-5cb0-4962-a3b1-0ef492318fef req-e8efdb17-9f0e-441d-a642-61149499de64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "tag": "dd1adc7a-80d9-4f8e-9246-b25315711c34"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:28.029119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3b077a22-5cb0-4962-a3b1-0ef492318fef req-e8efdb17-9f0e-441d-a642-61149499de64 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:28.032076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3b077a22-5cb0-4962-a3b1-0ef492318fef req-e8efdb17-9f0e-441d-a642-61149499de64 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:28.033655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3b077a22-5cb0-4962-a3b1-0ef492318fef req-e8efdb17-9f0e-441d-a642-61149499de64 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:28.064590 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3b077a22-5cb0-4962-a3b1-0ef492318fef req-e8efdb17-9f0e-441d-a642-61149499de64 service nova] Creating event network-changed:dd1adc7a-80d9-4f8e-9246-b25315711c34 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:26:28.076087 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3b077a22-5cb0-4962-a3b1-0ef492318fef req-e8efdb17-9f0e-441d-a642-61149499de64 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077633 Oct 18 13:26:28.077910 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1203/2287] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:28.107028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c6de0014-025d-4d77-9a46-57552fe4abbb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff617ac4ee0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:28.149703 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6a01d95d-6152-42cf-afb7-f361eef515ce tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "POST /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75/action" status: 202 len: 0 microversion: 2.1 time: 0.500614 Oct 18 13:26:28.162560 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1085/2288] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:27 2022] POST /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:26:28.189661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9333628d-222a-474d-bf88-f39330682cc8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:28.216029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9333628d-222a-474d-bf88-f39330682cc8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:28.236323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9333628d-222a-474d-bf88-f39330682cc8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:28.238807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9333628d-222a-474d-bf88-f39330682cc8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:28.245091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG neutronclient.v2_0.client [None req-c6de0014-025d-4d77-9a46-57552fe4abbb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist", "detail": ""}} {{(pid=120611) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:26:28.246052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.security_group_api [None req-c6de0014-025d-4d77-9a46-57552fe4abbb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Neutron security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 not found {{(pid=120611) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:26:28.247619 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-c6de0014-025d-4d77-9a46-57552fe4abbb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:26:28.247619 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-fd0f1dcd-b810-429d-a7af-5544346f76a0'] Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c6de0014-025d-4d77-9a46-57552fe4abbb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-security-groups/ca7a3cd5-35c6-423e-b3f3-26759c666e65 HTTP/1.1 Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:28.250020 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:28.251153 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:26:28.251153 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:28.251153 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:26:28.251153 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:28.251153 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:26:28.251153 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:28.251153 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:28.251153 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:26:28.251153 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:26:28.251153 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:26:28.251153 n-d-858384-13 devstack@n-api.service[120611]: exception: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:26:28.251153 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-fd0f1dcd-b810-429d-a7af-5544346f76a0'] Oct 18 13:26:28.251153 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'ca7a3cd5-35c6-423e-b3f3-26759c666e65'} Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:28.251835 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd0f1dcd-b810-429d-a7af-5544346f76a0'] Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:26:28.252846 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd0f1dcd-b810-429d-a7af-5544346f76a0'] Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd0f1dcd-b810-429d-a7af-5544346f76a0'] Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:28.253809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:28.254848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:28.254848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:28.254848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:28.254848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:28.254848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:26:28.254848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd0f1dcd-b810-429d-a7af-5544346f76a0'] Oct 18 13:26:28.254848 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:28.260376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c6de0014-025d-4d77-9a46-57552fe4abbb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:26:28.260376 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-fd0f1dcd-b810-429d-a7af-5544346f76a0'] {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:28.261671 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c6de0014-025d-4d77-9a46-57552fe4abbb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/ca7a3cd5-35c6-423e-b3f3-26759c666e65" status: 404 len: 194 microversion: 2.1 time: 0.182400 Oct 18 13:26:28.262457 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1204/2289] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:26:28 2022] GET /compute/v2.1/os-security-groups/ca7a3cd5-35c6-423e-b3f3-26759c666e65 => generated 194 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:28.265951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9333628d-222a-474d-bf88-f39330682cc8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:28.267259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9333628d-222a-474d-bf88-f39330682cc8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:28.270369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9333628d-222a-474d-bf88-f39330682cc8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:28.272802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-83cad32c-c3cd-42e1-a7f0-2ce91edf3d48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:28.274300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9333628d-222a-474d-bf88-f39330682cc8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:28.281010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-83cad32c-c3cd-42e1-a7f0-2ce91edf3d48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:28.295772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83cad32c-c3cd-42e1-a7f0-2ce91edf3d48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:28.297363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83cad32c-c3cd-42e1-a7f0-2ce91edf3d48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:28.301061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83cad32c-c3cd-42e1-a7f0-2ce91edf3d48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:28.302082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83cad32c-c3cd-42e1-a7f0-2ce91edf3d48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:28.302786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83cad32c-c3cd-42e1-a7f0-2ce91edf3d48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:28.305755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83cad32c-c3cd-42e1-a7f0-2ce91edf3d48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:28.975500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9333628d-222a-474d-bf88-f39330682cc8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:28.987822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-83cad32c-c3cd-42e1-a7f0-2ce91edf3d48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:28.999955 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-83cad32c-c3cd-42e1-a7f0-2ce91edf3d48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.736232 Oct 18 13:26:29.000863 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1205/2290] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:28 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:29.006326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-add8f9d8-2a15-4562-a31e-4c5731b1a609 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60ff9cdc0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:29.049480 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9333628d-222a-474d-bf88-f39330682cc8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1525 microversion: 2.1 time: 0.880811 Oct 18 13:26:29.052944 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1086/2291] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:28 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1525 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:29.062680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e542930-bfe6-4030-952e-a4a8e7ac4387 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:29.063672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0e542930-bfe6-4030-952e-a4a8e7ac4387 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:29.087218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e542930-bfe6-4030-952e-a4a8e7ac4387 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:29.088090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e542930-bfe6-4030-952e-a4a8e7ac4387 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:29.094882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e542930-bfe6-4030-952e-a4a8e7ac4387 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:29.096232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e542930-bfe6-4030-952e-a4a8e7ac4387 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:29.096959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e542930-bfe6-4030-952e-a4a8e7ac4387 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:29.097651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e542930-bfe6-4030-952e-a4a8e7ac4387 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:29.197011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e542930-bfe6-4030-952e-a4a8e7ac4387 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:29.206715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e542930-bfe6-4030-952e-a4a8e7ac4387 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:29.210162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e542930-bfe6-4030-952e-a4a8e7ac4387 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:29.216591 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e542930-bfe6-4030-952e-a4a8e7ac4387 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1553 microversion: 2.91 time: 0.161805 Oct 18 13:26:29.229417 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1087/2292] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:29 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:29.242585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-48f96e12-b155-4acf-a46d-f206e365386b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60fec9ee0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:29.581110 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-48f96e12-b155-4acf-a46d-f206e365386b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.349291 Oct 18 13:26:29.582089 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1088/2293] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:26:29 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:29.869809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1279780133", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": "none"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:30.120425 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-add8f9d8-2a15-4562-a31e-4c5731b1a609 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/1a48b309-87b3-4164-9bcd-aa5dc58727b9" status: 200 len: 1409 microversion: 2.1 time: 1.118200 Oct 18 13:26:30.125548 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1206/2294] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:29 2022] GET /compute/v2.1/images/1a48b309-87b3-4164-9bcd-aa5dc58727b9 => generated 1409 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:30.143784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-65664d83-ac99-436c-a8bb-528efc0fe906 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:30.144788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-65664d83-ac99-436c-a8bb-528efc0fe906 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:30.146872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:30.147304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:30.148339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:30.152161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:30.152628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:30.166765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.167601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.168047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:30.168806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.169299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.169733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:30.173453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65664d83-ac99-436c-a8bb-528efc0fe906 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.173966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65664d83-ac99-436c-a8bb-528efc0fe906 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.185469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65664d83-ac99-436c-a8bb-528efc0fe906 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:30.186368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65664d83-ac99-436c-a8bb-528efc0fe906 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.188529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65664d83-ac99-436c-a8bb-528efc0fe906 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.189030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65664d83-ac99-436c-a8bb-528efc0fe906 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:30.195928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Getting quotas for project 8c0234015cf94c6b8a5de068f86f4767. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:30.201814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Getting quotas for user bbf7cfb6f72e46458a61acf38fc33964 and project 8c0234015cf94c6b8a5de068f86f4767. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:30.217997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:30.220795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:30.307554 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eea862de-7459-49f5-b932-1eed1856e4a9 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.723983 Oct 18 13:26:30.308843 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1089/2295] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:26:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:26:30.326947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c3ffa16f-598c-475c-98b6-7229e43812e8 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'create', calling method: .version_select at 0x7ff60f68d700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-950023575", "description": "tempest-description-1213199094"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:30.618080 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c3ffa16f-598c-475c-98b6-7229e43812e8 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.307741 Oct 18 13:26:30.618902 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1090/2296] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:26:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:30.624162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-482107a8-70ce-4821-907b-44a5334c20f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:30.625652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-482107a8-70ce-4821-907b-44a5334c20f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:30.640470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-482107a8-70ce-4821-907b-44a5334c20f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.643948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-482107a8-70ce-4821-907b-44a5334c20f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.644415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-482107a8-70ce-4821-907b-44a5334c20f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:30.645718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-482107a8-70ce-4821-907b-44a5334c20f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.649028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-482107a8-70ce-4821-907b-44a5334c20f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.649945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-482107a8-70ce-4821-907b-44a5334c20f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:30.787563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-65664d83-ac99-436c-a8bb-528efc0fe906 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:30.799624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-65664d83-ac99-436c-a8bb-528efc0fe906 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:30.802303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-65664d83-ac99-436c-a8bb-528efc0fe906 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:30.803954 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-65664d83-ac99-436c-a8bb-528efc0fe906 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1886 microversion: 2.42 time: 0.676980 Oct 18 13:26:30.805376 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1207/2297] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:30 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1886 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:30.810688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-03f10ddb-e8c0-4bd7-a3a3-e226d365eadf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:30.811580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-03f10ddb-e8c0-4bd7-a3a3-e226d365eadf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:30.819258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03f10ddb-e8c0-4bd7-a3a3-e226d365eadf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.821571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03f10ddb-e8c0-4bd7-a3a3-e226d365eadf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.822186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03f10ddb-e8c0-4bd7-a3a3-e226d365eadf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:30.823073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03f10ddb-e8c0-4bd7-a3a3-e226d365eadf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:30.823814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03f10ddb-e8c0-4bd7-a3a3-e226d365eadf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:30.824392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03f10ddb-e8c0-4bd7-a3a3-e226d365eadf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:31.055408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-482107a8-70ce-4821-907b-44a5334c20f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:31.066334 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-482107a8-70ce-4821-907b-44a5334c20f4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.446214 Oct 18 13:26:31.086890 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1091/2298] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:30 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:31.093068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-203a5c36-dfc6-482d-a836-37d3fe142769 req-4d0ed695-d3f4-4d33-9ccd-9f8730b729e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "tag": "e53d609c-cb8b-4106-ad60-0cf706884abe"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:31.114465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-203a5c36-dfc6-482d-a836-37d3fe142769 req-4d0ed695-d3f4-4d33-9ccd-9f8730b729e2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:31.115248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-203a5c36-dfc6-482d-a836-37d3fe142769 req-4d0ed695-d3f4-4d33-9ccd-9f8730b729e2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:31.117378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-203a5c36-dfc6-482d-a836-37d3fe142769 req-4d0ed695-d3f4-4d33-9ccd-9f8730b729e2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:31.141518 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-203a5c36-dfc6-482d-a836-37d3fe142769 req-4d0ed695-d3f4-4d33-9ccd-9f8730b729e2 service nova] Creating event network-changed:e53d609c-cb8b-4106-ad60-0cf706884abe for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:26:31.150806 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-203a5c36-dfc6-482d-a836-37d3fe142769 req-4d0ed695-d3f4-4d33-9ccd-9f8730b729e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060716 Oct 18 13:26:31.151981 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1092/2299] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:31.163817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-04b22778-b4c7-4053-9cbf-32eb523374c1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60fec9b80>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:31.234505 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-04b22778-b4c7-4053-9cbf-32eb523374c1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/1a48b309-87b3-4164-9bcd-aa5dc58727b9" status: 200 len: 1409 microversion: 2.1 time: 0.078638 Oct 18 13:26:31.247286 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1093/2300] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:31 2022] GET /compute/v2.1/images/1a48b309-87b3-4164-9bcd-aa5dc58727b9 => generated 1409 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:31.252825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fda007f8-271e-491a-ae78-520ff1ff3dee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:31.253896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fda007f8-271e-491a-ae78-520ff1ff3dee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:31.272839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fda007f8-271e-491a-ae78-520ff1ff3dee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:31.275421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fda007f8-271e-491a-ae78-520ff1ff3dee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:31.278337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fda007f8-271e-491a-ae78-520ff1ff3dee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:31.280030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fda007f8-271e-491a-ae78-520ff1ff3dee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:31.280727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fda007f8-271e-491a-ae78-520ff1ff3dee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:31.283063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fda007f8-271e-491a-ae78-520ff1ff3dee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:31.510439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-03f10ddb-e8c0-4bd7-a3a3-e226d365eadf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:31.523963 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-03f10ddb-e8c0-4bd7-a3a3-e226d365eadf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1525 microversion: 2.1 time: 0.714644 Oct 18 13:26:31.524613 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1208/2301] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:30 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1525 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:31.549922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-37e378a3-69cd-4d44-8efa-2d2e893c828c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:31.559191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-37e378a3-69cd-4d44-8efa-2d2e893c828c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:31.657347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37e378a3-69cd-4d44-8efa-2d2e893c828c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:31.659980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37e378a3-69cd-4d44-8efa-2d2e893c828c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:31.660604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37e378a3-69cd-4d44-8efa-2d2e893c828c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:31.773371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fda007f8-271e-491a-ae78-520ff1ff3dee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:31.791635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fda007f8-271e-491a-ae78-520ff1ff3dee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:31.804643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fda007f8-271e-491a-ae78-520ff1ff3dee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:31.835658 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fda007f8-271e-491a-ae78-520ff1ff3dee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1535 microversion: 2.91 time: 0.586496 Oct 18 13:26:31.836935 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1094/2302] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:31 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1535 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:31.843921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c4bf7cf1-5d38-4caf-a76c-f9191b55d685 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'create', calling method: .version_select at 0x7ff60f68d0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1208670156", "description": "tempest-description-130112430"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:31.845782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:31.936244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-37e378a3-69cd-4d44-8efa-2d2e893c828c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:31.944455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-37e378a3-69cd-4d44-8efa-2d2e893c828c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:31.953266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-37e378a3-69cd-4d44-8efa-2d2e893c828c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:31.954236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-37e378a3-69cd-4d44-8efa-2d2e893c828c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lazy-loading 'trusted_certs' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:26:31.982786 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-37e378a3-69cd-4d44-8efa-2d2e893c828c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "PUT /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1363 microversion: 2.75 time: 0.438863 Oct 18 13:26:31.983659 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1209/2303] 10.222.0.40 () {62 vars in 1297 bytes} [Tue Oct 18 13:26:31 2022] PUT /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1363 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:31.997517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b5d9cbe8-b78f-4372-9be3-8069d87f65e6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617b2f550>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:32.342500 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b5d9cbe8-b78f-4372-9be3-8069d87f65e6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/images/1a48b309-87b3-4164-9bcd-aa5dc58727b9" status: 204 len: 0 microversion: 2.1 time: 0.357439 Oct 18 13:26:32.343531 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1210/2304] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:31 2022] DELETE /compute/v2.1/images/1a48b309-87b3-4164-9bcd-aa5dc58727b9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:26:32.351560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-09ea3802-84ea-4a97-908c-6d219cb05d69 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:32.352558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-09ea3802-84ea-4a97-908c-6d219cb05d69 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:32.395709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09ea3802-84ea-4a97-908c-6d219cb05d69 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.400736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09ea3802-84ea-4a97-908c-6d219cb05d69 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.402811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09ea3802-84ea-4a97-908c-6d219cb05d69 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.404353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09ea3802-84ea-4a97-908c-6d219cb05d69 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.406631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09ea3802-84ea-4a97-908c-6d219cb05d69 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.408985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09ea3802-84ea-4a97-908c-6d219cb05d69 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.612625 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c4bf7cf1-5d38-4caf-a76c-f9191b55d685 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.773482 Oct 18 13:26:32.625739 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1095/2305] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:26:31 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:32.634129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ba302c66-9877-4942-bb97-f51bfb1a7849 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:32.634808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ba302c66-9877-4942-bb97-f51bfb1a7849 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:32.641759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba302c66-9877-4942-bb97-f51bfb1a7849 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.642257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba302c66-9877-4942-bb97-f51bfb1a7849 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.642696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba302c66-9877-4942-bb97-f51bfb1a7849 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.643468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba302c66-9877-4942-bb97-f51bfb1a7849 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.643925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba302c66-9877-4942-bb97-f51bfb1a7849 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.644356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba302c66-9877-4942-bb97-f51bfb1a7849 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.738035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ba302c66-9877-4942-bb97-f51bfb1a7849 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:32.755933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ba302c66-9877-4942-bb97-f51bfb1a7849 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:32.757468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ba302c66-9877-4942-bb97-f51bfb1a7849 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:32.771587 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ba302c66-9877-4942-bb97-f51bfb1a7849 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1411 microversion: 2.75 time: 0.144392 Oct 18 13:26:32.790251 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1096/2306] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:32 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1411 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:32.805371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f5781601-8d32-4628-abf3-56471cd7ffea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:32.808065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f5781601-8d32-4628-abf3-56471cd7ffea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:32.816967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5781601-8d32-4628-abf3-56471cd7ffea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.818097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5781601-8d32-4628-abf3-56471cd7ffea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.818781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5781601-8d32-4628-abf3-56471cd7ffea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.820791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5781601-8d32-4628-abf3-56471cd7ffea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:32.821517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5781601-8d32-4628-abf3-56471cd7ffea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:32.822246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5781601-8d32-4628-abf3-56471cd7ffea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:32.977199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09ea3802-84ea-4a97-908c-6d219cb05d69 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:32.990914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09ea3802-84ea-4a97-908c-6d219cb05d69 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:32.993108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09ea3802-84ea-4a97-908c-6d219cb05d69 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:32.996529 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-09ea3802-84ea-4a97-908c-6d219cb05d69 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1886 microversion: 2.42 time: 0.651458 Oct 18 13:26:32.997777 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1211/2307] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:32 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1886 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:33.003861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1468ca01-af5c-4cf8-ad34-a537a9c64190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f1abaf0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:33.051049 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-1468ca01-af5c-4cf8-ad34-a537a9c64190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Image not found. Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1468ca01-af5c-4cf8-ad34-a537a9c64190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/images/1a48b309-87b3-4164-9bcd-aa5dc58727b9 HTTP/1.1 Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:33.056300 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: exception: Image not found. Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '1a48b309-87b3-4164-9bcd-aa5dc58727b9'} Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:33.057667 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1a48b309-87b3-4164-9bcd-aa5dc58727b9 Oct 18 13:26:33.058451 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:26:33.059419 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1a48b309-87b3-4164-9bcd-aa5dc58727b9 could not be found. Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:33.060720 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:26:33.061805 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:33.067389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1468ca01-af5c-4cf8-ad34-a537a9c64190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Image not found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:33.069550 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1468ca01-af5c-4cf8-ad34-a537a9c64190 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/images/1a48b309-87b3-4164-9bcd-aa5dc58727b9" status: 404 len: 62 microversion: 2.1 time: 0.070267 Oct 18 13:26:33.072463 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1212/2308] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:26:32 2022] GET /compute/v2.1/images/1a48b309-87b3-4164-9bcd-aa5dc58727b9 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:26:33.083907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3159ef7e-efc9-412f-9475-438db309124f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:33.087909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3159ef7e-efc9-412f-9475-438db309124f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:33.100289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:33.117233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3159ef7e-efc9-412f-9475-438db309124f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.118204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3159ef7e-efc9-412f-9475-438db309124f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.119910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3159ef7e-efc9-412f-9475-438db309124f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.126644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3159ef7e-efc9-412f-9475-438db309124f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.128519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3159ef7e-efc9-412f-9475-438db309124f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.129139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3159ef7e-efc9-412f-9475-438db309124f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.158040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f5781601-8d32-4628-abf3-56471cd7ffea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:33.175555 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f5781601-8d32-4628-abf3-56471cd7ffea tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.383769 Oct 18 13:26:33.177463 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1097/2309] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:32 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:33.195433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed2410b6-5719-4dd4-ade0-b78f3c7ea92b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:33.196413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ed2410b6-5719-4dd4-ade0-b78f3c7ea92b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:33.208335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed2410b6-5719-4dd4-ade0-b78f3c7ea92b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.215064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed2410b6-5719-4dd4-ade0-b78f3c7ea92b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.216949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed2410b6-5719-4dd4-ade0-b78f3c7ea92b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.218033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed2410b6-5719-4dd4-ade0-b78f3c7ea92b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.219213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed2410b6-5719-4dd4-ade0-b78f3c7ea92b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.220250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed2410b6-5719-4dd4-ade0-b78f3c7ea92b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.319573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3159ef7e-efc9-412f-9475-438db309124f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:33.321505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ed2410b6-5719-4dd4-ade0-b78f3c7ea92b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:33.332760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ed2410b6-5719-4dd4-ade0-b78f3c7ea92b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:33.334797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ed2410b6-5719-4dd4-ade0-b78f3c7ea92b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:33.337690 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3159ef7e-efc9-412f-9475-438db309124f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1525 microversion: 2.1 time: 0.261430 Oct 18 13:26:33.349211 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1213/2310] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:33 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1525 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:33.355915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1636242531", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "897f1132-314e-435d-9878-506c8ff5f223"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:33.359216 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ed2410b6-5719-4dd4-ade0-b78f3c7ea92b tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1535 microversion: 2.91 time: 0.180331 Oct 18 13:26:33.360888 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1098/2311] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:33 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1535 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:33.365986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c9d1ea7e-f4fc-4dd7-a181-edd4dc5ea0f4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:33.367102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c9d1ea7e-f4fc-4dd7-a181-edd4dc5ea0f4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:33.375837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d1ea7e-f4fc-4dd7-a181-edd4dc5ea0f4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.376514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d1ea7e-f4fc-4dd7-a181-edd4dc5ea0f4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.377093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d1ea7e-f4fc-4dd7-a181-edd4dc5ea0f4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.377979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d1ea7e-f4fc-4dd7-a181-edd4dc5ea0f4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.378592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d1ea7e-f4fc-4dd7-a181-edd4dc5ea0f4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.379162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d1ea7e-f4fc-4dd7-a181-edd4dc5ea0f4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.493801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] validate_networks() for [('897f1132-314e-435d-9878-506c8ff5f223', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:26:33.569354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c9d1ea7e-f4fc-4dd7-a181-edd4dc5ea0f4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:33.580261 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c9d1ea7e-f4fc-4dd7-a181-edd4dc5ea0f4 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1506 microversion: 2.1 time: 0.217996 Oct 18 13:26:33.593214 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1099/2312] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:33 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:33.593214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-c6079b16-e19c-46f8-a498-7623013518f8 req-d4757719-d8a0-4035-9b6a-c4685c6db96a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "tag": "a097c407-dceb-423a-899b-463450213b4f"}, {"name": "network-changed", "server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "tag": "d3e742e1-6288-419d-a439-1cd1c7e4eff3"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:33.603089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c6079b16-e19c-46f8-a498-7623013518f8 req-d4757719-d8a0-4035-9b6a-c4685c6db96a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.603089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c6079b16-e19c-46f8-a498-7623013518f8 req-d4757719-d8a0-4035-9b6a-c4685c6db96a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.603089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c6079b16-e19c-46f8-a498-7623013518f8 req-d4757719-d8a0-4035-9b6a-c4685c6db96a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.614481 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-c6079b16-e19c-46f8-a498-7623013518f8 req-d4757719-d8a0-4035-9b6a-c4685c6db96a service nova] Creating event network-changed:a097c407-dceb-423a-899b-463450213b4f for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:26:33.615463 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-c6079b16-e19c-46f8-a498-7623013518f8 req-d4757719-d8a0-4035-9b6a-c4685c6db96a service nova] Creating event network-changed:d3e742e1-6288-419d-a439-1cd1c7e4eff3 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:26:33.622306 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-c6079b16-e19c-46f8-a498-7623013518f8 req-d4757719-d8a0-4035-9b6a-c4685c6db96a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039615 Oct 18 13:26:33.623447 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1100/2313] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:33.820357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-78021325-0a28-47ea-970b-8f343bdb5528 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:33.822948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-78021325-0a28-47ea-970b-8f343bdb5528 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:33.829372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:33.839927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78021325-0a28-47ea-970b-8f343bdb5528 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.849050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78021325-0a28-47ea-970b-8f343bdb5528 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.849806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78021325-0a28-47ea-970b-8f343bdb5528 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:33.851149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78021325-0a28-47ea-970b-8f343bdb5528 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:33.853036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78021325-0a28-47ea-970b-8f343bdb5528 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:33.853583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78021325-0a28-47ea-970b-8f343bdb5528 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:34.061468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-78021325-0a28-47ea-970b-8f343bdb5528 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:34.075701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-78021325-0a28-47ea-970b-8f343bdb5528 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:34.078094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-78021325-0a28-47ea-970b-8f343bdb5528 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:34.115554 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-78021325-0a28-47ea-970b-8f343bdb5528 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1417 microversion: 2.75 time: 0.300902 Oct 18 13:26:34.117156 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1101/2314] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:33 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1417 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:34.123897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dd3f385f-b7a4-4057-9f06-9583df5b9cb1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:34.124861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dd3f385f-b7a4-4057-9f06-9583df5b9cb1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:34.148215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd3f385f-b7a4-4057-9f06-9583df5b9cb1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:34.149359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd3f385f-b7a4-4057-9f06-9583df5b9cb1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:34.150077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd3f385f-b7a4-4057-9f06-9583df5b9cb1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:34.151006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd3f385f-b7a4-4057-9f06-9583df5b9cb1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:34.151672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd3f385f-b7a4-4057-9f06-9583df5b9cb1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:34.152458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd3f385f-b7a4-4057-9f06-9583df5b9cb1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:34.437463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:34.438163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:34.440086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:34.440708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:34.441138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:34.462713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:34.463269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:34.463718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:34.465203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:34.465640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:34.466620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:34.505338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Getting quotas for project 710435d30626412f9ec22d776f8e94ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:34.516628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Getting quotas for user 9b5e09fad51a478788961c1f2b946cc9 and project 710435d30626412f9ec22d776f8e94ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:34.536334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:34.540183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:26:34.625411 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5ee27e3a-6547-43f3-945c-8f39ab190bfc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281524 Oct 18 13:26:34.626879 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1214/2315] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:26:34.633557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc70ea0d-9651-430a-a923-3b300ecb2e48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:34.635169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc70ea0d-9651-430a-a923-3b300ecb2e48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:34.643768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc70ea0d-9651-430a-a923-3b300ecb2e48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:34.644799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc70ea0d-9651-430a-a923-3b300ecb2e48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:34.645474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc70ea0d-9651-430a-a923-3b300ecb2e48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:34.646517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc70ea0d-9651-430a-a923-3b300ecb2e48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:34.647162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc70ea0d-9651-430a-a923-3b300ecb2e48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:34.649814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc70ea0d-9651-430a-a923-3b300ecb2e48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:34.729614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dd3f385f-b7a4-4057-9f06-9583df5b9cb1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:34.745528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dd3f385f-b7a4-4057-9f06-9583df5b9cb1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:34.749570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dd3f385f-b7a4-4057-9f06-9583df5b9cb1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:34.750820 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dd3f385f-b7a4-4057-9f06-9583df5b9cb1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1886 microversion: 2.42 time: 0.632441 Oct 18 13:26:34.759962 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1102/2316] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:34 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1886 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:34.783944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a4dd8f8e-077d-4fd9-9fc8-ad43608098c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:34.784753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a4dd8f8e-077d-4fd9-9fc8-ad43608098c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:34.792539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4dd8f8e-077d-4fd9-9fc8-ad43608098c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:34.793046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4dd8f8e-077d-4fd9-9fc8-ad43608098c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:34.793533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4dd8f8e-077d-4fd9-9fc8-ad43608098c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:34.794275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4dd8f8e-077d-4fd9-9fc8-ad43608098c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:34.794736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4dd8f8e-077d-4fd9-9fc8-ad43608098c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:34.795172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4dd8f8e-077d-4fd9-9fc8-ad43608098c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.128143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc70ea0d-9651-430a-a923-3b300ecb2e48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:35.138777 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc70ea0d-9651-430a-a923-3b300ecb2e48 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.509629 Oct 18 13:26:35.139811 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1215/2317] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:34 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:35.146868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c84e065c-8c72-460c-b028-61541c7e73c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:35.147658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c84e065c-8c72-460c-b028-61541c7e73c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:35.160093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c84e065c-8c72-460c-b028-61541c7e73c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.165628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c84e065c-8c72-460c-b028-61541c7e73c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.166114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c84e065c-8c72-460c-b028-61541c7e73c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.166864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c84e065c-8c72-460c-b028-61541c7e73c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.167333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c84e065c-8c72-460c-b028-61541c7e73c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.167760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c84e065c-8c72-460c-b028-61541c7e73c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.335510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c84e065c-8c72-460c-b028-61541c7e73c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:35.358996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c84e065c-8c72-460c-b028-61541c7e73c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:35.360741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c84e065c-8c72-460c-b028-61541c7e73c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:35.368589 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c84e065c-8c72-460c-b028-61541c7e73c6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1538 microversion: 2.91 time: 0.227300 Oct 18 13:26:35.372870 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1216/2318] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:35 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1538 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:35.388994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-306fe5f3-b0a9-42de-b65f-0a267a210299 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:35.389686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-306fe5f3-b0a9-42de-b65f-0a267a210299 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:35.401095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-306fe5f3-b0a9-42de-b65f-0a267a210299 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.401624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-306fe5f3-b0a9-42de-b65f-0a267a210299 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.402063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-306fe5f3-b0a9-42de-b65f-0a267a210299 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.402770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-306fe5f3-b0a9-42de-b65f-0a267a210299 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.419605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-306fe5f3-b0a9-42de-b65f-0a267a210299 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.419605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-306fe5f3-b0a9-42de-b65f-0a267a210299 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.680313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a4dd8f8e-077d-4fd9-9fc8-ad43608098c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:35.699812 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a4dd8f8e-077d-4fd9-9fc8-ad43608098c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1525 microversion: 2.1 time: 0.927078 Oct 18 13:26:35.702511 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1103/2319] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:34 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1525 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:35.716565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7ac17088-cf6b-417a-9a2c-bc40a34217bc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:35.718598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7ac17088-cf6b-417a-9a2c-bc40a34217bc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:35.754727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-306fe5f3-b0a9-42de-b65f-0a267a210299 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:35.774277 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-306fe5f3-b0a9-42de-b65f-0a267a210299 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1501 microversion: 2.1 time: 0.399845 Oct 18 13:26:35.775135 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1217/2320] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:35 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1501 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:35.787870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-b9f8dd88-4271-4735-b912-af8c0baa354a req-57195d22-24cb-47fc-a3d8-51d1937b2b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f4b424-628f-4f3b-8eba-5bd06df8ea75", "name": "network-vif-plugged", "status": "completed", "tag": "40da9821-5e60-486f-b517-e14ae94b2a28"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:35.815207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b9f8dd88-4271-4735-b912-af8c0baa354a req-57195d22-24cb-47fc-a3d8-51d1937b2b78 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.815880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b9f8dd88-4271-4735-b912-af8c0baa354a req-57195d22-24cb-47fc-a3d8-51d1937b2b78 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.816544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b9f8dd88-4271-4735-b912-af8c0baa354a req-57195d22-24cb-47fc-a3d8-51d1937b2b78 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.836390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ac17088-cf6b-417a-9a2c-bc40a34217bc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:35.845266 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7ac17088-cf6b-417a-9a2c-bc40a34217bc tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1216 microversion: 2.1 time: 0.141265 Oct 18 13:26:35.850245 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-b9f8dd88-4271-4735-b912-af8c0baa354a req-57195d22-24cb-47fc-a3d8-51d1937b2b78 service nova] Creating event network-vif-plugged:40da9821-5e60-486f-b517-e14ae94b2a28 for instance f8f4b424-628f-4f3b-8eba-5bd06df8ea75 on n-h1-858384-13 Oct 18 13:26:35.862474 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1104/2321] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:35 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:35.863963 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-b9f8dd88-4271-4735-b912-af8c0baa354a req-57195d22-24cb-47fc-a3d8-51d1937b2b78 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086420 Oct 18 13:26:35.871020 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1218/2322] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:35.878822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-485c7bd4-c074-49b3-b51e-0aed00a53d49 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858384-13"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:35.880627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-011462c1-9a8b-41b1-be4d-56f1c06dc666 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:35.881706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-011462c1-9a8b-41b1-be4d-56f1c06dc666 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:35.882215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-485c7bd4-c074-49b3-b51e-0aed00a53d49 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:35.890151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-485c7bd4-c074-49b3-b51e-0aed00a53d49 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.890902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-485c7bd4-c074-49b3-b51e-0aed00a53d49 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.891519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-485c7bd4-c074-49b3-b51e-0aed00a53d49 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.892403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-485c7bd4-c074-49b3-b51e-0aed00a53d49 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.893158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-485c7bd4-c074-49b3-b51e-0aed00a53d49 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.894111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-485c7bd4-c074-49b3-b51e-0aed00a53d49 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.910342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-011462c1-9a8b-41b1-be4d-56f1c06dc666 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.911023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-011462c1-9a8b-41b1-be4d-56f1c06dc666 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.911569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-011462c1-9a8b-41b1-be4d-56f1c06dc666 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.912806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-011462c1-9a8b-41b1-be4d-56f1c06dc666 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:35.914026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-011462c1-9a8b-41b1-be4d-56f1c06dc666 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:35.915301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-011462c1-9a8b-41b1-be4d-56f1c06dc666 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:35.988326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-485c7bd4-c074-49b3-b51e-0aed00a53d49 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858384-13". {{(pid=120611) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 13:26:36.095497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-011462c1-9a8b-41b1-be4d-56f1c06dc666 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:36.105884 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-485c7bd4-c074-49b3-b51e-0aed00a53d49 tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7/action" status: 202 len: 0 microversion: 2.91 time: 0.233176 Oct 18 13:26:36.107148 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1219/2323] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:26:35 2022] POST /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:26:36.119498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-011462c1-9a8b-41b1-be4d-56f1c06dc666 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:36.126399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-011462c1-9a8b-41b1-be4d-56f1c06dc666 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:36.136315 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-011462c1-9a8b-41b1-be4d-56f1c06dc666 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1438 microversion: 2.75 time: 0.268996 Oct 18 13:26:36.138177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9b056d72-1d4a-4eb2-8251-d046b319c447 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.138592 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1105/2324] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:35 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1438 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:36.138836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9b056d72-1d4a-4eb2-8251-d046b319c447 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:36.145198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-37d10f1c-8d2a-4080-91cb-d97805f6db20 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.146045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-37d10f1c-8d2a-4080-91cb-d97805f6db20 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:36.154925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-37d10f1c-8d2a-4080-91cb-d97805f6db20 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.155595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-37d10f1c-8d2a-4080-91cb-d97805f6db20 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.156195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-37d10f1c-8d2a-4080-91cb-d97805f6db20 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.157142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-37d10f1c-8d2a-4080-91cb-d97805f6db20 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.157776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-37d10f1c-8d2a-4080-91cb-d97805f6db20 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.158356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-37d10f1c-8d2a-4080-91cb-d97805f6db20 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.176295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b056d72-1d4a-4eb2-8251-d046b319c447 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.176819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b056d72-1d4a-4eb2-8251-d046b319c447 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.177291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b056d72-1d4a-4eb2-8251-d046b319c447 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.184309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b056d72-1d4a-4eb2-8251-d046b319c447 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.184811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b056d72-1d4a-4eb2-8251-d046b319c447 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.195512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b056d72-1d4a-4eb2-8251-d046b319c447 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.297810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-37d10f1c-8d2a-4080-91cb-d97805f6db20 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:36.300550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:36.315855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-37d10f1c-8d2a-4080-91cb-d97805f6db20 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:36.319988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-37d10f1c-8d2a-4080-91cb-d97805f6db20 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:36.333923 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-37d10f1c-8d2a-4080-91cb-d97805f6db20 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1486 microversion: 2.91 time: 0.191693 Oct 18 13:26:36.334806 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1106/2325] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:36 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1486 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:36.348455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dd7e4dac-0b65-41a7-8d38-30ba23bb52a4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.349451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dd7e4dac-0b65-41a7-8d38-30ba23bb52a4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:36.363553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd7e4dac-0b65-41a7-8d38-30ba23bb52a4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.364465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd7e4dac-0b65-41a7-8d38-30ba23bb52a4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.366037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd7e4dac-0b65-41a7-8d38-30ba23bb52a4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.368630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd7e4dac-0b65-41a7-8d38-30ba23bb52a4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.372028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd7e4dac-0b65-41a7-8d38-30ba23bb52a4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.372028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd7e4dac-0b65-41a7-8d38-30ba23bb52a4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.677923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b056d72-1d4a-4eb2-8251-d046b319c447 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:36.695181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b056d72-1d4a-4eb2-8251-d046b319c447 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:36.698735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b056d72-1d4a-4eb2-8251-d046b319c447 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:36.717915 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9b056d72-1d4a-4eb2-8251-d046b319c447 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1886 microversion: 2.42 time: 0.607663 Oct 18 13:26:36.735573 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1220/2326] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:36 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1886 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:36.765708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:36.767758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dd7e4dac-0b65-41a7-8d38-30ba23bb52a4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:36.768675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:36.783498 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dd7e4dac-0b65-41a7-8d38-30ba23bb52a4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1657 microversion: 2.1 time: 0.444480 Oct 18 13:26:36.785875 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1107/2327] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:36 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1657 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:36.789227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.789733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.790176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.790891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.791334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.796105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.804038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4969c943-d2e3-41e1-9dda-491059c9f643 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:36.804674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4969c943-d2e3-41e1-9dda-491059c9f643 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:36.825292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4969c943-d2e3-41e1-9dda-491059c9f643 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.825797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4969c943-d2e3-41e1-9dda-491059c9f643 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.826232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4969c943-d2e3-41e1-9dda-491059c9f643 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:36.826966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4969c943-d2e3-41e1-9dda-491059c9f643 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:36.827415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4969c943-d2e3-41e1-9dda-491059c9f643 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:36.827925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4969c943-d2e3-41e1-9dda-491059c9f643 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.010743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:37.018618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:37.019280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:37.023456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:37.024944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:37.211801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:37.248529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.249035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.250809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.251432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.251888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.252333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.307624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4969c943-d2e3-41e1-9dda-491059c9f643 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:37.318695 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4969c943-d2e3-41e1-9dda-491059c9f643 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1525 microversion: 2.1 time: 0.531712 Oct 18 13:26:37.323318 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1108/2328] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:36 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1525 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:37.334149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-699e3425-816a-4e82-8cc4-ef3e9089932d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:37.335805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-699e3425-816a-4e82-8cc4-ef3e9089932d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:37.358333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-699e3425-816a-4e82-8cc4-ef3e9089932d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.360576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-699e3425-816a-4e82-8cc4-ef3e9089932d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.361348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-699e3425-816a-4e82-8cc4-ef3e9089932d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.365388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-699e3425-816a-4e82-8cc4-ef3e9089932d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.366162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-699e3425-816a-4e82-8cc4-ef3e9089932d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.369443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-699e3425-816a-4e82-8cc4-ef3e9089932d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.398219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:37.413672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:37.415255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:37.445248 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4617afe7-225d-4ca1-85e0-e75d304db53e tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "POST /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399/action" status: 202 len: 1495 microversion: 2.75 time: 0.709177 Oct 18 13:26:37.451619 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1221/2329] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:26:36 2022] POST /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399/action => generated 1495 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 13:26:37.466595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-296aca32-1cb9-4722-af38-2a06b6584b19 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:37.484590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-296aca32-1cb9-4722-af38-2a06b6584b19 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.485084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-296aca32-1cb9-4722-af38-2a06b6584b19 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.485548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-296aca32-1cb9-4722-af38-2a06b6584b19 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.529798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-296aca32-1cb9-4722-af38-2a06b6584b19 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Going to try to start instance {{(pid=120611) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 13:26:37.606855 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-296aca32-1cb9-4722-af38-2a06b6584b19 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.153917 Oct 18 13:26:37.607825 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1222/2330] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:37 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:37.613308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d7c68888-9066-46e1-9209-9c9ae839dd0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:37.613962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d7c68888-9066-46e1-9209-9c9ae839dd0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:37.629975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7c68888-9066-46e1-9209-9c9ae839dd0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.637536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7c68888-9066-46e1-9209-9c9ae839dd0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.638273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7c68888-9066-46e1-9209-9c9ae839dd0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.639189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7c68888-9066-46e1-9209-9c9ae839dd0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.639797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7c68888-9066-46e1-9209-9c9ae839dd0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.640570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7c68888-9066-46e1-9209-9c9ae839dd0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.742618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d7c68888-9066-46e1-9209-9c9ae839dd0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:37.752171 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d7c68888-9066-46e1-9209-9c9ae839dd0c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1286 microversion: 2.1 time: 0.143030 Oct 18 13:26:37.752871 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1223/2331] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:37 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:37.759061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-024713fe-0c57-43f4-89f1-86f7461798f5 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:37.759878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-024713fe-0c57-43f4-89f1-86f7461798f5 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:37.771898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-024713fe-0c57-43f4-89f1-86f7461798f5 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.773654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-024713fe-0c57-43f4-89f1-86f7461798f5 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.774277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-024713fe-0c57-43f4-89f1-86f7461798f5 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.775153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-024713fe-0c57-43f4-89f1-86f7461798f5 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.775933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-024713fe-0c57-43f4-89f1-86f7461798f5 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.786072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-024713fe-0c57-43f4-89f1-86f7461798f5 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.902197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-024713fe-0c57-43f4-89f1-86f7461798f5 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:37.912310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:37.916021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-024713fe-0c57-43f4-89f1-86f7461798f5 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:37.917775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-024713fe-0c57-43f4-89f1-86f7461798f5 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:37.924137 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-024713fe-0c57-43f4-89f1-86f7461798f5 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.169896 Oct 18 13:26:37.924521 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1224/2332] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:37 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:37.930269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-26581ec2-4532-4b8e-ba73-e10572359c66 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:37.931064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-26581ec2-4532-4b8e-ba73-e10572359c66 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:37.937712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26581ec2-4532-4b8e-ba73-e10572359c66 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.939172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26581ec2-4532-4b8e-ba73-e10572359c66 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.939764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26581ec2-4532-4b8e-ba73-e10572359c66 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:37.940606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26581ec2-4532-4b8e-ba73-e10572359c66 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:37.941386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26581ec2-4532-4b8e-ba73-e10572359c66 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:37.941993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26581ec2-4532-4b8e-ba73-e10572359c66 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.018979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-699e3425-816a-4e82-8cc4-ef3e9089932d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:38.031327 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-699e3425-816a-4e82-8cc4-ef3e9089932d tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1488 microversion: 2.1 time: 0.706639 Oct 18 13:26:38.042313 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1109/2333] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:37 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1488 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:38.044072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-26581ec2-4532-4b8e-ba73-e10572359c66 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:38.047743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b89465c3-58c1-4fc3-aae7-18f550795e59 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:38.048613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b89465c3-58c1-4fc3-aae7-18f550795e59 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:38.053220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-26581ec2-4532-4b8e-ba73-e10572359c66 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:38.059132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-26581ec2-4532-4b8e-ba73-e10572359c66 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:38.066320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b89465c3-58c1-4fc3-aae7-18f550795e59 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.067173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b89465c3-58c1-4fc3-aae7-18f550795e59 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.067850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b89465c3-58c1-4fc3-aae7-18f550795e59 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.070600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b89465c3-58c1-4fc3-aae7-18f550795e59 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.072727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b89465c3-58c1-4fc3-aae7-18f550795e59 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.073953 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-26581ec2-4532-4b8e-ba73-e10572359c66 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.148074 Oct 18 13:26:38.074385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b89465c3-58c1-4fc3-aae7-18f550795e59 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.074802 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1225/2334] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:37 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:38.090128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-09a2f596-e3ca-40bc-b3a9-51bc52d01e82 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:38.090744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-09a2f596-e3ca-40bc-b3a9-51bc52d01e82 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:38.113213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09a2f596-e3ca-40bc-b3a9-51bc52d01e82 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.113693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09a2f596-e3ca-40bc-b3a9-51bc52d01e82 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.114133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09a2f596-e3ca-40bc-b3a9-51bc52d01e82 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.114838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09a2f596-e3ca-40bc-b3a9-51bc52d01e82 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.115289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09a2f596-e3ca-40bc-b3a9-51bc52d01e82 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.115708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09a2f596-e3ca-40bc-b3a9-51bc52d01e82 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.651290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b89465c3-58c1-4fc3-aae7-18f550795e59 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:38.660765 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b89465c3-58c1-4fc3-aae7-18f550795e59 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1666 microversion: 2.1 time: 0.616937 Oct 18 13:26:38.673615 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1110/2335] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:38 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1666 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:38.683717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b4b320e9-f099-4264-a0f2-1f30c7a13a3e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:38.684591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b4b320e9-f099-4264-a0f2-1f30c7a13a3e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:38.691043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4b320e9-f099-4264-a0f2-1f30c7a13a3e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.691862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4b320e9-f099-4264-a0f2-1f30c7a13a3e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.692526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4b320e9-f099-4264-a0f2-1f30c7a13a3e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.693524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4b320e9-f099-4264-a0f2-1f30c7a13a3e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.695076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4b320e9-f099-4264-a0f2-1f30c7a13a3e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.696452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4b320e9-f099-4264-a0f2-1f30c7a13a3e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.729326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b4b320e9-f099-4264-a0f2-1f30c7a13a3e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:26:38.843590 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b4b320e9-f099-4264-a0f2-1f30c7a13a3e tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 204 len: 0 microversion: 2.1 time: 0.167018 Oct 18 13:26:38.844427 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1111/2336] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:38 2022] DELETE /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:26:38.853435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31249d84-588f-4d7f-8025-1158369afe2c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:38.854969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-31249d84-588f-4d7f-8025-1158369afe2c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:38.864883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31249d84-588f-4d7f-8025-1158369afe2c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.865459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31249d84-588f-4d7f-8025-1158369afe2c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.865899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31249d84-588f-4d7f-8025-1158369afe2c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.867782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31249d84-588f-4d7f-8025-1158369afe2c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.868297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31249d84-588f-4d7f-8025-1158369afe2c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.868735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31249d84-588f-4d7f-8025-1158369afe2c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.921234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09a2f596-e3ca-40bc-b3a9-51bc52d01e82 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:38.932334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09a2f596-e3ca-40bc-b3a9-51bc52d01e82 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:38.937471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09a2f596-e3ca-40bc-b3a9-51bc52d01e82 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:38.942600 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-09a2f596-e3ca-40bc-b3a9-51bc52d01e82 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.866724 Oct 18 13:26:38.943336 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1226/2337] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:38 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:38.948696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c3ba9401-1849-4a4f-a974-c5b9257adb3c req-1db740ba-f9c4-43f4-b030-b9998c303382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f4b424-628f-4f3b-8eba-5bd06df8ea75", "name": "network-vif-unplugged", "status": "completed", "tag": "40da9821-5e60-486f-b517-e14ae94b2a28"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:38.959384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c3ba9401-1849-4a4f-a974-c5b9257adb3c req-1db740ba-f9c4-43f4-b030-b9998c303382 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.960268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c3ba9401-1849-4a4f-a974-c5b9257adb3c req-1db740ba-f9c4-43f4-b030-b9998c303382 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.961107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c3ba9401-1849-4a4f-a974-c5b9257adb3c req-1db740ba-f9c4-43f4-b030-b9998c303382 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:38.975369 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c3ba9401-1849-4a4f-a974-c5b9257adb3c req-1db740ba-f9c4-43f4-b030-b9998c303382 service nova] Creating event network-vif-unplugged:40da9821-5e60-486f-b517-e14ae94b2a28 for instance f8f4b424-628f-4f3b-8eba-5bd06df8ea75 on n-h1-858384-13 Oct 18 13:26:38.981856 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c3ba9401-1849-4a4f-a974-c5b9257adb3c req-1db740ba-f9c4-43f4-b030-b9998c303382 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036493 Oct 18 13:26:38.982570 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1227/2338] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:38.988836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-50c59a39-28f7-466a-abbb-ea3b9e141e55 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:38.990819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-50c59a39-28f7-466a-abbb-ea3b9e141e55 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:38.998341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50c59a39-28f7-466a-abbb-ea3b9e141e55 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:38.999064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50c59a39-28f7-466a-abbb-ea3b9e141e55 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:38.999717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50c59a39-28f7-466a-abbb-ea3b9e141e55 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.000632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50c59a39-28f7-466a-abbb-ea3b9e141e55 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.001314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50c59a39-28f7-466a-abbb-ea3b9e141e55 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.001949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50c59a39-28f7-466a-abbb-ea3b9e141e55 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.247340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-50c59a39-28f7-466a-abbb-ea3b9e141e55 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:39.261702 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-50c59a39-28f7-466a-abbb-ea3b9e141e55 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1316 microversion: 2.1 time: 0.277602 Oct 18 13:26:39.263080 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1228/2339] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:38 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:39.269769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7932b34c-5c6e-4a9c-8b58-8ec43aabdd6a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60fdb2040>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:39.318761 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-7932b34c-5c6e-4a9c-8b58-8ec43aabdd6a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Image not found. Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7932b34c-5c6e-4a9c-8b58-8ec43aabdd6a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/images/1a48b309-87b3-4164-9bcd-aa5dc58727b9 HTTP/1.1 Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:39.322716 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: exception: Image not found. Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '1a48b309-87b3-4164-9bcd-aa5dc58727b9'} Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:39.324112 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1a48b309-87b3-4164-9bcd-aa5dc58727b9 to delete Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:39.324899 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1a48b309-87b3-4164-9bcd-aa5dc58727b9 could not be found. Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:39.326004 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7932b34c-5c6e-4a9c-8b58-8ec43aabdd6a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Image not found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:39.328780 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7932b34c-5c6e-4a9c-8b58-8ec43aabdd6a tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/images/1a48b309-87b3-4164-9bcd-aa5dc58727b9" status: 404 len: 62 microversion: 2.1 time: 0.061691 Oct 18 13:26:39.331956 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1229/2340] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:39 2022] DELETE /compute/v2.1/images/1a48b309-87b3-4164-9bcd-aa5dc58727b9 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:26:39.346302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e91e5b5b-2a86-4d04-9df6-c70685c57b36 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:39.346833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e91e5b5b-2a86-4d04-9df6-c70685c57b36 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:39.358001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e91e5b5b-2a86-4d04-9df6-c70685c57b36 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.358762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e91e5b5b-2a86-4d04-9df6-c70685c57b36 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.361017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e91e5b5b-2a86-4d04-9df6-c70685c57b36 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.361877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e91e5b5b-2a86-4d04-9df6-c70685c57b36 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.362486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e91e5b5b-2a86-4d04-9df6-c70685c57b36 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.363047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e91e5b5b-2a86-4d04-9df6-c70685c57b36 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.370534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31249d84-588f-4d7f-8025-1158369afe2c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:39.385555 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31249d84-588f-4d7f-8025-1158369afe2c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1525 microversion: 2.1 time: 0.535330 Oct 18 13:26:39.397204 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1112/2341] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:38 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1525 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:39.397204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-25c99ac0-d715-4e4e-80bf-32ee50143e00 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:39.397204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-25c99ac0-d715-4e4e-80bf-32ee50143e00 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:39.416116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25c99ac0-d715-4e4e-80bf-32ee50143e00 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.416612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25c99ac0-d715-4e4e-80bf-32ee50143e00 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.417052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25c99ac0-d715-4e4e-80bf-32ee50143e00 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.417821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25c99ac0-d715-4e4e-80bf-32ee50143e00 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.418263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25c99ac0-d715-4e4e-80bf-32ee50143e00 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.418688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25c99ac0-d715-4e4e-80bf-32ee50143e00 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.509754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e91e5b5b-2a86-4d04-9df6-c70685c57b36 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:39.522486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e91e5b5b-2a86-4d04-9df6-c70685c57b36 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:39.523953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e91e5b5b-2a86-4d04-9df6-c70685c57b36 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:39.533119 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e91e5b5b-2a86-4d04-9df6-c70685c57b36 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.199955 Oct 18 13:26:39.534062 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1230/2342] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:39 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:39.575370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1704b1c-f2cd-4994-8403-68e00e621d26 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:39.576113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e1704b1c-f2cd-4994-8403-68e00e621d26 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:39.581516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-25c99ac0-d715-4e4e-80bf-32ee50143e00 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:39.589544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1704b1c-f2cd-4994-8403-68e00e621d26 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.590269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1704b1c-f2cd-4994-8403-68e00e621d26 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.590994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1704b1c-f2cd-4994-8403-68e00e621d26 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.593120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1704b1c-f2cd-4994-8403-68e00e621d26 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.594294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1704b1c-f2cd-4994-8403-68e00e621d26 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.594874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1704b1c-f2cd-4994-8403-68e00e621d26 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.595063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-25c99ac0-d715-4e4e-80bf-32ee50143e00 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:39.598594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-25c99ac0-d715-4e4e-80bf-32ee50143e00 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:39.608710 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-25c99ac0-d715-4e4e-80bf-32ee50143e00 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.221100 Oct 18 13:26:39.610478 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1113/2343] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:39 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:39.638623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e1704b1c-f2cd-4994-8403-68e00e621d26 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:26:39.688992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cbf78d64-e602-4589-a634-9bf924094f24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:39.689703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cbf78d64-e602-4589-a634-9bf924094f24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:39.702361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf78d64-e602-4589-a634-9bf924094f24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.702881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf78d64-e602-4589-a634-9bf924094f24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.703374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf78d64-e602-4589-a634-9bf924094f24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.706981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf78d64-e602-4589-a634-9bf924094f24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.707664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf78d64-e602-4589-a634-9bf924094f24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.708184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbf78d64-e602-4589-a634-9bf924094f24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.731046 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.compute.api [None req-e1704b1c-f2cd-4994-8403-68e00e621d26 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Instance is already in deleting state, ignoring this request Oct 18 13:26:39.731874 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e1704b1c-f2cd-4994-8403-68e00e621d26 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 204 len: 0 microversion: 2.1 time: 0.196839 Oct 18 13:26:39.732455 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1231/2344] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:39 2022] DELETE /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:26:39.746234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-50fbd5cc-f4f1-4e24-88e4-38fe4f012bbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:39.746856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-50fbd5cc-f4f1-4e24-88e4-38fe4f012bbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:39.757363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50fbd5cc-f4f1-4e24-88e4-38fe4f012bbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.757744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50fbd5cc-f4f1-4e24-88e4-38fe4f012bbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.758237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50fbd5cc-f4f1-4e24-88e4-38fe4f012bbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.759140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50fbd5cc-f4f1-4e24-88e4-38fe4f012bbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:39.773879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50fbd5cc-f4f1-4e24-88e4-38fe4f012bbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:39.774368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50fbd5cc-f4f1-4e24-88e4-38fe4f012bbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:39.996344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-50fbd5cc-f4f1-4e24-88e4-38fe4f012bbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:39.997687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cbf78d64-e602-4589-a634-9bf924094f24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:40.007937 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cbf78d64-e602-4589-a634-9bf924094f24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1666 microversion: 2.1 time: 0.323392 Oct 18 13:26:40.008519 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1114/2345] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:39 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1666 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:40.021830 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-50fbd5cc-f4f1-4e24-88e4-38fe4f012bbf tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1494 microversion: 2.1 time: 0.267536 Oct 18 13:26:40.022715 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1232/2346] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:39 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1494 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:40.025034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-881d5daf-42a1-4d19-aa84-9d5153092704 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:40.028026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-881d5daf-42a1-4d19-aa84-9d5153092704 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:40.043689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-881d5daf-42a1-4d19-aa84-9d5153092704 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:40.047266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-881d5daf-42a1-4d19-aa84-9d5153092704 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:40.048629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-881d5daf-42a1-4d19-aa84-9d5153092704 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:40.051345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-881d5daf-42a1-4d19-aa84-9d5153092704 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:40.052947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-881d5daf-42a1-4d19-aa84-9d5153092704 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:40.054822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-881d5daf-42a1-4d19-aa84-9d5153092704 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:40.181609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:40.291066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1cff9ee7-fc4f-4704-9d9b-72fb4aaa0e8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:40.291764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1cff9ee7-fc4f-4704-9d9b-72fb4aaa0e8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:40.309708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1cff9ee7-fc4f-4704-9d9b-72fb4aaa0e8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:40.310272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1cff9ee7-fc4f-4704-9d9b-72fb4aaa0e8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:40.310892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1cff9ee7-fc4f-4704-9d9b-72fb4aaa0e8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:40.311820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1cff9ee7-fc4f-4704-9d9b-72fb4aaa0e8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:40.312441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1cff9ee7-fc4f-4704-9d9b-72fb4aaa0e8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:40.312901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1cff9ee7-fc4f-4704-9d9b-72fb4aaa0e8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:40.998241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-881d5daf-42a1-4d19-aa84-9d5153092704 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:41.015515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-881d5daf-42a1-4d19-aa84-9d5153092704 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:41.017143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-881d5daf-42a1-4d19-aa84-9d5153092704 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:41.018379 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-881d5daf-42a1-4d19-aa84-9d5153092704 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 1.005846 Oct 18 13:26:41.030444 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1115/2347] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:40 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:41.058410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2b5a49ea-e87a-4688-9566-cae88696a430 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:41.059328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2b5a49ea-e87a-4688-9566-cae88696a430 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:41.073016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b5a49ea-e87a-4688-9566-cae88696a430 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.077864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b5a49ea-e87a-4688-9566-cae88696a430 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.083204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b5a49ea-e87a-4688-9566-cae88696a430 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.084492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b5a49ea-e87a-4688-9566-cae88696a430 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.086106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b5a49ea-e87a-4688-9566-cae88696a430 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.088798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b5a49ea-e87a-4688-9566-cae88696a430 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.221531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1cff9ee7-fc4f-4704-9d9b-72fb4aaa0e8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:41.230776 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1cff9ee7-fc4f-4704-9d9b-72fb4aaa0e8c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1316 microversion: 2.1 time: 0.944433 Oct 18 13:26:41.233887 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1233/2348] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:40 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1316 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:41.270020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8a10088-85d7-4b91-9337-3faab1a0f6af tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:41.271411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8a10088-85d7-4b91-9337-3faab1a0f6af tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:41.278778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8a10088-85d7-4b91-9337-3faab1a0f6af tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.279705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8a10088-85d7-4b91-9337-3faab1a0f6af tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.280385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8a10088-85d7-4b91-9337-3faab1a0f6af tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.293558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8a10088-85d7-4b91-9337-3faab1a0f6af tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.294443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8a10088-85d7-4b91-9337-3faab1a0f6af tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.295138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8a10088-85d7-4b91-9337-3faab1a0f6af tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.408687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b8a10088-85d7-4b91-9337-3faab1a0f6af tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:41.422012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b8a10088-85d7-4b91-9337-3faab1a0f6af tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:41.428195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b8a10088-85d7-4b91-9337-3faab1a0f6af tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:41.443765 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8a10088-85d7-4b91-9337-3faab1a0f6af tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.191901 Oct 18 13:26:41.444762 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1234/2349] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:41 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:41.459093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-316a661a-e1e1-400b-99ed-fcaf792edc42 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:41.460108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-316a661a-e1e1-400b-99ed-fcaf792edc42 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:41.469099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-316a661a-e1e1-400b-99ed-fcaf792edc42 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.470974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-316a661a-e1e1-400b-99ed-fcaf792edc42 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.471720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-316a661a-e1e1-400b-99ed-fcaf792edc42 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.474924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-316a661a-e1e1-400b-99ed-fcaf792edc42 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.476155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-316a661a-e1e1-400b-99ed-fcaf792edc42 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.478119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-316a661a-e1e1-400b-99ed-fcaf792edc42 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.636520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-316a661a-e1e1-400b-99ed-fcaf792edc42 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:41.645226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2b5a49ea-e87a-4688-9566-cae88696a430 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:41.655083 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2b5a49ea-e87a-4688-9566-cae88696a430 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1525 microversion: 2.1 time: 0.623209 Oct 18 13:26:41.660477 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1116/2350] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:41 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1525 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:41.671261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-316a661a-e1e1-400b-99ed-fcaf792edc42 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:41.672948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-316a661a-e1e1-400b-99ed-fcaf792edc42 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:41.693983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9d3d3f9e-8c55-4fd7-8e8d-9530aad8f1c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:41.697589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9d3d3f9e-8c55-4fd7-8e8d-9530aad8f1c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:41.698393 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-316a661a-e1e1-400b-99ed-fcaf792edc42 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.248762 Oct 18 13:26:41.711937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d3d3f9e-8c55-4fd7-8e8d-9530aad8f1c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.712489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d3d3f9e-8c55-4fd7-8e8d-9530aad8f1c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.713039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d3d3f9e-8c55-4fd7-8e8d-9530aad8f1c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.717040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d3d3f9e-8c55-4fd7-8e8d-9530aad8f1c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.717561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d3d3f9e-8c55-4fd7-8e8d-9530aad8f1c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.717999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d3d3f9e-8c55-4fd7-8e8d-9530aad8f1c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.720821 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1235/2351] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:41 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:41.732056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a9369210-ab77-41b9-bb1d-4f4934bb1da9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:41.732669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a9369210-ab77-41b9-bb1d-4f4934bb1da9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:41.746918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9369210-ab77-41b9-bb1d-4f4934bb1da9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.747410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9369210-ab77-41b9-bb1d-4f4934bb1da9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.748064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9369210-ab77-41b9-bb1d-4f4934bb1da9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:41.749133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9369210-ab77-41b9-bb1d-4f4934bb1da9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:41.749787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9369210-ab77-41b9-bb1d-4f4934bb1da9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:41.750242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9369210-ab77-41b9-bb1d-4f4934bb1da9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:42.141253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a9369210-ab77-41b9-bb1d-4f4934bb1da9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:42.160076 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a9369210-ab77-41b9-bb1d-4f4934bb1da9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1494 microversion: 2.1 time: 0.435041 Oct 18 13:26:42.175545 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1236/2352] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:41 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1494 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:42.178468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4ad4a423-f75f-473b-8c50-d0da58c30901 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:42.182544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4ad4a423-f75f-473b-8c50-d0da58c30901 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:42.196079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ad4a423-f75f-473b-8c50-d0da58c30901 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:42.196602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ad4a423-f75f-473b-8c50-d0da58c30901 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:42.197208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ad4a423-f75f-473b-8c50-d0da58c30901 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:42.199376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ad4a423-f75f-473b-8c50-d0da58c30901 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:42.199810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ad4a423-f75f-473b-8c50-d0da58c30901 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:42.201953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ad4a423-f75f-473b-8c50-d0da58c30901 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:42.419421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9d3d3f9e-8c55-4fd7-8e8d-9530aad8f1c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:42.436785 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9d3d3f9e-8c55-4fd7-8e8d-9530aad8f1c9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1666 microversion: 2.1 time: 0.761461 Oct 18 13:26:42.450629 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1117/2353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:41 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1666 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:42.456921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-88fa3a3f-d9b6-451f-9a12-1297dd90bdcd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:42.457560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-88fa3a3f-d9b6-451f-9a12-1297dd90bdcd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:42.488108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88fa3a3f-d9b6-451f-9a12-1297dd90bdcd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:42.494279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88fa3a3f-d9b6-451f-9a12-1297dd90bdcd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:42.494831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88fa3a3f-d9b6-451f-9a12-1297dd90bdcd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:42.495643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88fa3a3f-d9b6-451f-9a12-1297dd90bdcd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:42.504501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88fa3a3f-d9b6-451f-9a12-1297dd90bdcd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:42.505104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88fa3a3f-d9b6-451f-9a12-1297dd90bdcd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:42.696591 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4ad4a423-f75f-473b-8c50-d0da58c30901 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1814 microversion: 2.1 time: 0.531101 Oct 18 13:26:42.701240 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1237/2354] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:42 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1814 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:42.717534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f2867cca-810d-4071-9ab5-a0137ad05fd4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:42.718462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f2867cca-810d-4071-9ab5-a0137ad05fd4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:42.730338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2867cca-810d-4071-9ab5-a0137ad05fd4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:42.730839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2867cca-810d-4071-9ab5-a0137ad05fd4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:42.731292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2867cca-810d-4071-9ab5-a0137ad05fd4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:42.735827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2867cca-810d-4071-9ab5-a0137ad05fd4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:42.735827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2867cca-810d-4071-9ab5-a0137ad05fd4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:42.740502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2867cca-810d-4071-9ab5-a0137ad05fd4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.125472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f2867cca-810d-4071-9ab5-a0137ad05fd4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.133763 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f2867cca-810d-4071-9ab5-a0137ad05fd4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1316 microversion: 2.1 time: 0.431443 Oct 18 13:26:43.135473 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1238/2355] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:42 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:43.139932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-faa9411e-298b-4f34-a6ce-2f6410c7b05e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:43.140578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-faa9411e-298b-4f34-a6ce-2f6410c7b05e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:43.153946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faa9411e-298b-4f34-a6ce-2f6410c7b05e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.154437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faa9411e-298b-4f34-a6ce-2f6410c7b05e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.154867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faa9411e-298b-4f34-a6ce-2f6410c7b05e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.169035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faa9411e-298b-4f34-a6ce-2f6410c7b05e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.169556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faa9411e-298b-4f34-a6ce-2f6410c7b05e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.169990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faa9411e-298b-4f34-a6ce-2f6410c7b05e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.287586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-faa9411e-298b-4f34-a6ce-2f6410c7b05e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.319367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-faa9411e-298b-4f34-a6ce-2f6410c7b05e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.327047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-faa9411e-298b-4f34-a6ce-2f6410c7b05e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.343486 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-faa9411e-298b-4f34-a6ce-2f6410c7b05e tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.206618 Oct 18 13:26:43.346772 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1239/2356] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:43 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:43.376812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-989a509c-5142-4aa7-adcd-1ef403b9660e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:43.378199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-989a509c-5142-4aa7-adcd-1ef403b9660e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:43.394547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-989a509c-5142-4aa7-adcd-1ef403b9660e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.399385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-989a509c-5142-4aa7-adcd-1ef403b9660e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.400220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-989a509c-5142-4aa7-adcd-1ef403b9660e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.404467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-989a509c-5142-4aa7-adcd-1ef403b9660e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.405382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-989a509c-5142-4aa7-adcd-1ef403b9660e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.407243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-989a509c-5142-4aa7-adcd-1ef403b9660e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.513598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-88fa3a3f-d9b6-451f-9a12-1297dd90bdcd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.529225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-88fa3a3f-d9b6-451f-9a12-1297dd90bdcd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.535606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-88fa3a3f-d9b6-451f-9a12-1297dd90bdcd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.542234 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-88fa3a3f-d9b6-451f-9a12-1297dd90bdcd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 1.090351 Oct 18 13:26:43.543399 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1118/2357] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:42 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:43.549709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d03aea0-f789-4e05-aa77-b294c663c94e tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:43.564205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d03aea0-f789-4e05-aa77-b294c663c94e tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.566101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d03aea0-f789-4e05-aa77-b294c663c94e tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.566793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d03aea0-f789-4e05-aa77-b294c663c94e tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.571716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d03aea0-f789-4e05-aa77-b294c663c94e tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.572601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d03aea0-f789-4e05-aa77-b294c663c94e tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.573325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d03aea0-f789-4e05-aa77-b294c663c94e tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.623344 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d03aea0-f789-4e05-aa77-b294c663c94e tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.078121 Oct 18 13:26:43.625207 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1119/2358] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 18 13:26:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:43.631136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84c6ac19-a7bd-4a0a-89c0-dc4efb81ca2d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:43.633812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-84c6ac19-a7bd-4a0a-89c0-dc4efb81ca2d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:43.645671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84c6ac19-a7bd-4a0a-89c0-dc4efb81ca2d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.646687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84c6ac19-a7bd-4a0a-89c0-dc4efb81ca2d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.649328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84c6ac19-a7bd-4a0a-89c0-dc4efb81ca2d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.650701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84c6ac19-a7bd-4a0a-89c0-dc4efb81ca2d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.651384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84c6ac19-a7bd-4a0a-89c0-dc4efb81ca2d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.652062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84c6ac19-a7bd-4a0a-89c0-dc4efb81ca2d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.703913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-989a509c-5142-4aa7-adcd-1ef403b9660e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.714052 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-989a509c-5142-4aa7-adcd-1ef403b9660e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1525 microversion: 2.1 time: 0.365014 Oct 18 13:26:43.721236 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1240/2359] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:43 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1525 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:43.739801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ec76762d-c51c-48bc-92ef-5f06fa7f1668 req-0bce0b48-b9b0-4270-9945-f8210deb916b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f4b424-628f-4f3b-8eba-5bd06df8ea75", "name": "network-vif-deleted", "tag": "40da9821-5e60-486f-b517-e14ae94b2a28"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:43.760083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ec76762d-c51c-48bc-92ef-5f06fa7f1668 req-0bce0b48-b9b0-4270-9945-f8210deb916b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.760871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ec76762d-c51c-48bc-92ef-5f06fa7f1668 req-0bce0b48-b9b0-4270-9945-f8210deb916b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.761595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ec76762d-c51c-48bc-92ef-5f06fa7f1668 req-0bce0b48-b9b0-4270-9945-f8210deb916b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.778323 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ec76762d-c51c-48bc-92ef-5f06fa7f1668 req-0bce0b48-b9b0-4270-9945-f8210deb916b service nova] Creating event network-vif-deleted:40da9821-5e60-486f-b517-e14ae94b2a28 for instance f8f4b424-628f-4f3b-8eba-5bd06df8ea75 on n-h1-858384-13 Oct 18 13:26:43.784564 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ec76762d-c51c-48bc-92ef-5f06fa7f1668 req-0bce0b48-b9b0-4270-9945-f8210deb916b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068207 Oct 18 13:26:43.790940 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1241/2360] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:43.800099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:43.800886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:43.809326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.810277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.810783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.811570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.812087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.812582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.837281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:43.862483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:43.863167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:43.863899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:43.866906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lazy-loading 'fault' on Instance uuid f8f4b424-628f-4f3b-8eba-5bd06df8ea75 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:26:43.928999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-84c6ac19-a7bd-4a0a-89c0-dc4efb81ca2d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.942900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-84c6ac19-a7bd-4a0a-89c0-dc4efb81ca2d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.944430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-84c6ac19-a7bd-4a0a-89c0-dc4efb81ca2d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.962320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f896caa4caa0472db9198f7795401df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '472fc8535c504953a8f14a24f9d22260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:43.972419 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-84c6ac19-a7bd-4a0a-89c0-dc4efb81ca2d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.345842 Oct 18 13:26:43.991834 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1120/2361] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:43 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:44.006287 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-08582618-35a8-487d-b593-8a61863c7a45 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 200 len: 1298 microversion: 2.1 time: 0.210788 Oct 18 13:26:44.016429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2dca2b00-80f6-4ab8-9770-701afe49cc7f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:44.017786 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1242/2362] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:43 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 1298 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:44.019524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2dca2b00-80f6-4ab8-9770-701afe49cc7f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:44.044763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dca2b00-80f6-4ab8-9770-701afe49cc7f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.052018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dca2b00-80f6-4ab8-9770-701afe49cc7f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.055148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dca2b00-80f6-4ab8-9770-701afe49cc7f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.060307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dca2b00-80f6-4ab8-9770-701afe49cc7f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.062278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dca2b00-80f6-4ab8-9770-701afe49cc7f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.065424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dca2b00-80f6-4ab8-9770-701afe49cc7f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.161481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-e69640e6-a4aa-4f57-8dbe-e380ee23469f req-f442412d-bced-4129-932a-7a9c4db62b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290", "tag": "6baad0b7-1db5-475b-b6de-51f6616dc237"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:44.174319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e69640e6-a4aa-4f57-8dbe-e380ee23469f req-f442412d-bced-4129-932a-7a9c4db62b79 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.175079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e69640e6-a4aa-4f57-8dbe-e380ee23469f req-f442412d-bced-4129-932a-7a9c4db62b79 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.175726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e69640e6-a4aa-4f57-8dbe-e380ee23469f req-f442412d-bced-4129-932a-7a9c4db62b79 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.190525 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-e69640e6-a4aa-4f57-8dbe-e380ee23469f req-f442412d-bced-4129-932a-7a9c4db62b79 service nova] Creating event network-changed:6baad0b7-1db5-475b-b6de-51f6616dc237 for instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 on n-h1-858384-13 Oct 18 13:26:44.198319 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-e69640e6-a4aa-4f57-8dbe-e380ee23469f req-f442412d-bced-4129-932a-7a9c4db62b79 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177415 Oct 18 13:26:44.200069 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1243/2363] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:44.210287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-86c18ae3-eac5-47a6-9125-b9476e39b20c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:44.212252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-86c18ae3-eac5-47a6-9125-b9476e39b20c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:44.219328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:44.223632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86c18ae3-eac5-47a6-9125-b9476e39b20c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.224283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86c18ae3-eac5-47a6-9125-b9476e39b20c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.224995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86c18ae3-eac5-47a6-9125-b9476e39b20c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.226086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86c18ae3-eac5-47a6-9125-b9476e39b20c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.226839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86c18ae3-eac5-47a6-9125-b9476e39b20c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.227438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86c18ae3-eac5-47a6-9125-b9476e39b20c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.488941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:44.531810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=8 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:44.553260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-86c18ae3-eac5-47a6-9125-b9476e39b20c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:44.566909 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-86c18ae3-eac5-47a6-9125-b9476e39b20c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1316 microversion: 2.1 time: 0.365396 Oct 18 13:26:44.568715 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1244/2364] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:44 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:44.574304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-79ea270f-ec2c-409c-8f98-d8efc7509fe7 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:44.575156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-79ea270f-ec2c-409c-8f98-d8efc7509fe7 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:44.582399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ea270f-ec2c-409c-8f98-d8efc7509fe7 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.584434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ea270f-ec2c-409c-8f98-d8efc7509fe7 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.586214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ea270f-ec2c-409c-8f98-d8efc7509fe7 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.586977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ea270f-ec2c-409c-8f98-d8efc7509fe7 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.587509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ea270f-ec2c-409c-8f98-d8efc7509fe7 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.588068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ea270f-ec2c-409c-8f98-d8efc7509fe7 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.703483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79ea270f-ec2c-409c-8f98-d8efc7509fe7 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:44.713681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79ea270f-ec2c-409c-8f98-d8efc7509fe7 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:44.721584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79ea270f-ec2c-409c-8f98-d8efc7509fe7 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:44.740168 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-79ea270f-ec2c-409c-8f98-d8efc7509fe7 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.171062 Oct 18 13:26:44.753204 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1245/2365] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:44 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:44.761234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7dbfa6d9-1ded-4389-873b-6928f9762e64 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:44.761234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7dbfa6d9-1ded-4389-873b-6928f9762e64 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:44.766628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dbfa6d9-1ded-4389-873b-6928f9762e64 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.768711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dbfa6d9-1ded-4389-873b-6928f9762e64 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.771162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dbfa6d9-1ded-4389-873b-6928f9762e64 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:44.772198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dbfa6d9-1ded-4389-873b-6928f9762e64 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:44.774011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dbfa6d9-1ded-4389-873b-6928f9762e64 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:44.774565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dbfa6d9-1ded-4389-873b-6928f9762e64 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:45.161265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7dbfa6d9-1ded-4389-873b-6928f9762e64 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:45.170013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2dca2b00-80f6-4ab8-9770-701afe49cc7f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:45.174791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7dbfa6d9-1ded-4389-873b-6928f9762e64 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:45.180861 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2dca2b00-80f6-4ab8-9770-701afe49cc7f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 1.184037 Oct 18 13:26:45.181701 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1121/2366] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:43 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:45.197617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7dbfa6d9-1ded-4389-873b-6928f9762e64 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:45.197617 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7dbfa6d9-1ded-4389-873b-6928f9762e64 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.442666 Oct 18 13:26:45.197617 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1246/2367] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:44 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:45.204194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1ea7b9b5-cfd4-462e-a709-baa161b94ae1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:45.204194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1ea7b9b5-cfd4-462e-a709-baa161b94ae1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:45.205943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-00c82ccd-70cb-40c0-a8d5-5002bae321a0 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:45.206773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-00c82ccd-70cb-40c0-a8d5-5002bae321a0 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:45.214152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ea7b9b5-cfd4-462e-a709-baa161b94ae1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:45.216011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ea7b9b5-cfd4-462e-a709-baa161b94ae1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:45.216310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ea7b9b5-cfd4-462e-a709-baa161b94ae1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:45.218638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00c82ccd-70cb-40c0-a8d5-5002bae321a0 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:45.219495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00c82ccd-70cb-40c0-a8d5-5002bae321a0 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:45.219618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ea7b9b5-cfd4-462e-a709-baa161b94ae1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:45.220194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ea7b9b5-cfd4-462e-a709-baa161b94ae1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:45.220401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00c82ccd-70cb-40c0-a8d5-5002bae321a0 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:45.220832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ea7b9b5-cfd4-462e-a709-baa161b94ae1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:45.222183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00c82ccd-70cb-40c0-a8d5-5002bae321a0 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:45.222811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00c82ccd-70cb-40c0-a8d5-5002bae321a0 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:45.223398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00c82ccd-70cb-40c0-a8d5-5002bae321a0 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:45.255372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:45.570145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1ea7b9b5-cfd4-462e-a709-baa161b94ae1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:45.581493 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1ea7b9b5-cfd4-462e-a709-baa161b94ae1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1525 microversion: 2.1 time: 0.392288 Oct 18 13:26:45.583334 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1247/2368] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:45 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1525 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:45.601042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-00c82ccd-70cb-40c0-a8d5-5002bae321a0 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:45.602118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2e13f8e9-3ba7-42be-bce3-f789c7adcb20 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:45.602741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2e13f8e9-3ba7-42be-bce3-f789c7adcb20 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: f8f4b424-628f-4f3b-8eba-5bd06df8ea75] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:45.610680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e13f8e9-3ba7-42be-bce3-f789c7adcb20 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:45.611216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e13f8e9-3ba7-42be-bce3-f789c7adcb20 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:45.611609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e13f8e9-3ba7-42be-bce3-f789c7adcb20 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:45.612297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e13f8e9-3ba7-42be-bce3-f789c7adcb20 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:45.612749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e13f8e9-3ba7-42be-bce3-f789c7adcb20 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:45.613171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e13f8e9-3ba7-42be-bce3-f789c7adcb20 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:45.617212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-00c82ccd-70cb-40c0-a8d5-5002bae321a0 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:45.619300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-00c82ccd-70cb-40c0-a8d5-5002bae321a0 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:45.628056 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-00c82ccd-70cb-40c0-a8d5-5002bae321a0 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.426021 Oct 18 13:26:45.629008 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1122/2369] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:45 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:45.636259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-965e378f-1a00-447f-9ff1-36b267e287cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:45.637791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-965e378f-1a00-447f-9ff1-36b267e287cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:45.645751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-965e378f-1a00-447f-9ff1-36b267e287cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:45.646686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-965e378f-1a00-447f-9ff1-36b267e287cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:45.647371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-965e378f-1a00-447f-9ff1-36b267e287cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:45.648715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-965e378f-1a00-447f-9ff1-36b267e287cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:45.649422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-965e378f-1a00-447f-9ff1-36b267e287cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:45.650072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-965e378f-1a00-447f-9ff1-36b267e287cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:45.674832 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-2e13f8e9-3ba7-42be-bce3-f789c7adcb20 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Instance f8f4b424-628f-4f3b-8eba-5bd06df8ea75 could not be found. Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2e13f8e9-3ba7-42be-bce3-f789c7adcb20 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 HTTP/1.1 Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:45.677077 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:45.678333 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:45.678333 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:45.678333 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:45.678333 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:45.678333 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:45.678333 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:45.678333 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:45.678333 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:45.678333 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:45.678333 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:26:45.678333 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance f8f4b424-628f-4f3b-8eba-5bd06df8ea75 could not be found. Oct 18 13:26:45.678333 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f8f4b424-628f-4f3b-8eba-5bd06df8ea75'} Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f4b424-628f-4f3b-8eba-5bd06df8ea75 could not be found. Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:45.679593 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f4b424-628f-4f3b-8eba-5bd06df8ea75 could not be found. Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f4b424-628f-4f3b-8eba-5bd06df8ea75 could not be found. Oct 18 13:26:45.680655 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:45.681667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2e13f8e9-3ba7-42be-bce3-f789c7adcb20 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Instance f8f4b424-628f-4f3b-8eba-5bd06df8ea75 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:45.681667 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2e13f8e9-3ba7-42be-bce3-f789c7adcb20 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75" status: 404 len: 111 microversion: 2.1 time: 0.093617 Oct 18 13:26:45.693364 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1248/2370] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:45 2022] GET /compute/v2.1/servers/f8f4b424-628f-4f3b-8eba-5bd06df8ea75 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:45.699453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1f9034a2-2997-4c4b-b1a4-90be32ca3a80 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:45.700063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1f9034a2-2997-4c4b-b1a4-90be32ca3a80 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:45.712757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f9034a2-2997-4c4b-b1a4-90be32ca3a80 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:45.714329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f9034a2-2997-4c4b-b1a4-90be32ca3a80 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:45.717719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f9034a2-2997-4c4b-b1a4-90be32ca3a80 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:45.718618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f9034a2-2997-4c4b-b1a4-90be32ca3a80 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:45.719200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f9034a2-2997-4c4b-b1a4-90be32ca3a80 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:45.719685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f9034a2-2997-4c4b-b1a4-90be32ca3a80 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:45.844395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=8 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:45.987862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1f9034a2-2997-4c4b-b1a4-90be32ca3a80 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:46.003065 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1f9034a2-2997-4c4b-b1a4-90be32ca3a80 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1316 microversion: 2.1 time: 0.304682 Oct 18 13:26:46.017320 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1249/2371] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:45 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:46.021333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e5c43258-01e7-4b75-8713-26770a1ee624 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:46.021333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e5c43258-01e7-4b75-8713-26770a1ee624 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:46.039509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5c43258-01e7-4b75-8713-26770a1ee624 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:46.040007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5c43258-01e7-4b75-8713-26770a1ee624 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:46.040444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5c43258-01e7-4b75-8713-26770a1ee624 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:46.041879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5c43258-01e7-4b75-8713-26770a1ee624 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:46.041991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5c43258-01e7-4b75-8713-26770a1ee624 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:46.042369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5c43258-01e7-4b75-8713-26770a1ee624 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:46.092153 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-e5c43258-01e7-4b75-8713-26770a1ee624 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e5c43258-01e7-4b75-8713-26770a1ee624 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f HTTP/1.1 Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:46.098251 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:46.099738 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:46.099738 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:46.099738 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:46.099738 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:46.099738 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:46.099738 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:46.099738 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:46.099738 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:46.099738 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:46.099738 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:26:46.099738 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:46.099738 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '22298178-3c70-4617-8c26-bcbecf59552f'} Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:46.100629 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:46.103003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:46.106494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e5c43258-01e7-4b75-8713-26770a1ee624 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:46.109755 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e5c43258-01e7-4b75-8713-26770a1ee624 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 404 len: 111 microversion: 2.1 time: 0.100724 Oct 18 13:26:46.116466 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1250/2372] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:46 2022] DELETE /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:46.124610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9b000656-5214-48d0-8ddf-84151743fd3c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:46.126345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9b000656-5214-48d0-8ddf-84151743fd3c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:46.144484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b000656-5214-48d0-8ddf-84151743fd3c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:46.145366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b000656-5214-48d0-8ddf-84151743fd3c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:46.146394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b000656-5214-48d0-8ddf-84151743fd3c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:46.149235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b000656-5214-48d0-8ddf-84151743fd3c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:46.154736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b000656-5214-48d0-8ddf-84151743fd3c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:46.155541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b000656-5214-48d0-8ddf-84151743fd3c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:46.314993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b000656-5214-48d0-8ddf-84151743fd3c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:46.325334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b000656-5214-48d0-8ddf-84151743fd3c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:46.327758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b000656-5214-48d0-8ddf-84151743fd3c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:46.335473 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9b000656-5214-48d0-8ddf-84151743fd3c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.216311 Oct 18 13:26:46.364763 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1251/2373] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:46 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:46.377512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-965059a8-8da0-4204-82c8-09025482529c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:46.378499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-965059a8-8da0-4204-82c8-09025482529c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 22298178-3c70-4617-8c26-bcbecf59552f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:46.387663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-965059a8-8da0-4204-82c8-09025482529c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:46.388627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-965059a8-8da0-4204-82c8-09025482529c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:46.389306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-965059a8-8da0-4204-82c8-09025482529c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:46.390761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-965059a8-8da0-4204-82c8-09025482529c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:46.391426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-965059a8-8da0-4204-82c8-09025482529c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:46.392322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-965059a8-8da0-4204-82c8-09025482529c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:46.417777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-965e378f-1a00-447f-9ff1-36b267e287cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:46.430645 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-965059a8-8da0-4204-82c8-09025482529c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:46.432394 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-965e378f-1a00-447f-9ff1-36b267e287cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.802030 Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-965059a8-8da0-4204-82c8-09025482529c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f HTTP/1.1 Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:46.436893 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:46.438184 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:46.438184 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:46.438184 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:46.438184 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:46.438184 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:46.438184 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:46.438184 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:46.438184 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:46.438184 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:46.438184 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:26:46.438184 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:46.438184 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '22298178-3c70-4617-8c26-bcbecf59552f'} Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:46.440118 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. Oct 18 13:26:46.442397 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:46.443348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-965059a8-8da0-4204-82c8-09025482529c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Instance 22298178-3c70-4617-8c26-bcbecf59552f could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:46.443348 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-965059a8-8da0-4204-82c8-09025482529c tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f" status: 404 len: 111 microversion: 2.1 time: 0.067877 Oct 18 13:26:46.443486 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1123/2374] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:45 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:46.445617 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1252/2375] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:46 2022] GET /compute/v2.1/servers/22298178-3c70-4617-8c26-bcbecf59552f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:46.454344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-19535fa6-ae77-410e-8559-1505dcc5fd31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617ad3700>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:46.461089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b74b1f76-cbbb-47c2-b4c7-70aa9b22bced tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:46.462646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b74b1f76-cbbb-47c2-b4c7-70aa9b22bced tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:46.471859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b74b1f76-cbbb-47c2-b4c7-70aa9b22bced tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:46.472738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b74b1f76-cbbb-47c2-b4c7-70aa9b22bced tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:46.473455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b74b1f76-cbbb-47c2-b4c7-70aa9b22bced tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:46.474503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b74b1f76-cbbb-47c2-b4c7-70aa9b22bced tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:46.475012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b74b1f76-cbbb-47c2-b4c7-70aa9b22bced tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:46.475629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b74b1f76-cbbb-47c2-b4c7-70aa9b22bced tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:46.815986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b74b1f76-cbbb-47c2-b4c7-70aa9b22bced tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:46.836437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b74b1f76-cbbb-47c2-b4c7-70aa9b22bced tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:46.843508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b74b1f76-cbbb-47c2-b4c7-70aa9b22bced tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:46.844750 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b74b1f76-cbbb-47c2-b4c7-70aa9b22bced tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.394862 Oct 18 13:26:46.869220 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1124/2376] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:46 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:46.869220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-79b07e2a-2de5-4b94-a091-c0418b6ab432 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:46.869220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-79b07e2a-2de5-4b94-a091-c0418b6ab432 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:46.886825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79b07e2a-2de5-4b94-a091-c0418b6ab432 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:46.887313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79b07e2a-2de5-4b94-a091-c0418b6ab432 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:46.887750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79b07e2a-2de5-4b94-a091-c0418b6ab432 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:46.888459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79b07e2a-2de5-4b94-a091-c0418b6ab432 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:46.888913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79b07e2a-2de5-4b94-a091-c0418b6ab432 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:46.889364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79b07e2a-2de5-4b94-a091-c0418b6ab432 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.049424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-79b07e2a-2de5-4b94-a091-c0418b6ab432 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Unlocking {{(pid=120612) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 18 13:26:47.123118 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-79b07e2a-2de5-4b94-a091-c0418b6ab432 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.266475 Oct 18 13:26:47.124927 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1125/2377] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:46 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:47.132963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-df178914-b1d1-44b3-b387-420e100b000d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:47.135571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-df178914-b1d1-44b3-b387-420e100b000d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:47.146443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df178914-b1d1-44b3-b387-420e100b000d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.148685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df178914-b1d1-44b3-b387-420e100b000d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.149831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df178914-b1d1-44b3-b387-420e100b000d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.151362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df178914-b1d1-44b3-b387-420e100b000d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.152419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df178914-b1d1-44b3-b387-420e100b000d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.153490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df178914-b1d1-44b3-b387-420e100b000d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.406540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-df178914-b1d1-44b3-b387-420e100b000d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:47.414794 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-df178914-b1d1-44b3-b387-420e100b000d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1525 microversion: 2.1 time: 0.288462 Oct 18 13:26:47.415373 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1126/2378] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:47 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1525 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:47.420186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-203780f0-d7c8-41dd-8a18-64cbb580d19c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:47.420800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-203780f0-d7c8-41dd-8a18-64cbb580d19c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:47.427319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-203780f0-d7c8-41dd-8a18-64cbb580d19c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.427795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-203780f0-d7c8-41dd-8a18-64cbb580d19c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.428222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-203780f0-d7c8-41dd-8a18-64cbb580d19c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.429263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-203780f0-d7c8-41dd-8a18-64cbb580d19c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.429719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-203780f0-d7c8-41dd-8a18-64cbb580d19c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.430140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-203780f0-d7c8-41dd-8a18-64cbb580d19c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.531793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-203780f0-d7c8-41dd-8a18-64cbb580d19c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:47.545529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-203780f0-d7c8-41dd-8a18-64cbb580d19c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:47.549817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-203780f0-d7c8-41dd-8a18-64cbb580d19c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:47.557360 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-203780f0-d7c8-41dd-8a18-64cbb580d19c tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.140911 Oct 18 13:26:47.558266 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1127/2379] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:47 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:47.563528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-89671098-ad4a-4673-a10a-7131292a76dd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c46e27e-21ed-43d5-819f-4876739c5601", "device": "/dev/xvdb"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:47.566859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-89671098-ad4a-4673-a10a-7131292a76dd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:47.574922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89671098-ad4a-4673-a10a-7131292a76dd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.575525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89671098-ad4a-4673-a10a-7131292a76dd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.576034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89671098-ad4a-4673-a10a-7131292a76dd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:47.576807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89671098-ad4a-4673-a10a-7131292a76dd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:47.577299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89671098-ad4a-4673-a10a-7131292a76dd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:47.577730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89671098-ad4a-4673-a10a-7131292a76dd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:48.489686 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-19535fa6-ae77-410e-8559-1505dcc5fd31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Image not found. Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-19535fa6-ae77-410e-8559-1505dcc5fd31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31 HTTP/1.1 Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:48.492436 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: exception: Image not found. Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '6ff5544f-6d90-418e-ae5a-45db8a469e31'} Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:48.494640 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6ff5544f-6d90-418e-ae5a-45db8a469e31 to delete Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:48.502497 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6ff5544f-6d90-418e-ae5a-45db8a469e31 could not be found. Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:48.503572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-19535fa6-ae77-410e-8559-1505dcc5fd31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Image not found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-19535fa6-ae77-410e-8559-1505dcc5fd31 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31" status: 404 len: 62 microversion: 2.1 time: 2.048053 Oct 18 13:26:48.505255 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1253/2380] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:46 2022] DELETE /compute/v2.1/images/6ff5544f-6d90-418e-ae5a-45db8a469e31 => generated 62 bytes in 2050 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:26:48.512586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2fd5012b-8d34-49bc-bcb6-1e3d9dc5a7c6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:48.513491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2fd5012b-8d34-49bc-bcb6-1e3d9dc5a7c6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:48.533393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fd5012b-8d34-49bc-bcb6-1e3d9dc5a7c6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:48.533892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fd5012b-8d34-49bc-bcb6-1e3d9dc5a7c6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:48.534336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fd5012b-8d34-49bc-bcb6-1e3d9dc5a7c6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:48.538916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fd5012b-8d34-49bc-bcb6-1e3d9dc5a7c6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:48.539826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fd5012b-8d34-49bc-bcb6-1e3d9dc5a7c6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:48.540462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fd5012b-8d34-49bc-bcb6-1e3d9dc5a7c6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:48.715942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2fd5012b-8d34-49bc-bcb6-1e3d9dc5a7c6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:48.732127 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2fd5012b-8d34-49bc-bcb6-1e3d9dc5a7c6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1316 microversion: 2.1 time: 0.234675 Oct 18 13:26:48.733260 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1254/2381] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:48 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:48.738041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-85844a61-881a-4744-b0b3-b29d3652fd03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:48.738663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-85844a61-881a-4744-b0b3-b29d3652fd03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:48.745429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85844a61-881a-4744-b0b3-b29d3652fd03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:48.746042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85844a61-881a-4744-b0b3-b29d3652fd03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:48.746485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85844a61-881a-4744-b0b3-b29d3652fd03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:48.747192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85844a61-881a-4744-b0b3-b29d3652fd03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:48.747665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85844a61-881a-4744-b0b3-b29d3652fd03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:48.748080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85844a61-881a-4744-b0b3-b29d3652fd03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:48.949077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-85844a61-881a-4744-b0b3-b29d3652fd03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:48.958126 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-85844a61-881a-4744-b0b3-b29d3652fd03 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.223804 Oct 18 13:26:48.974011 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1255/2382] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:48 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:48.983267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c78a5e23-a79e-4efd-abeb-78bb4f9df35c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:48.984476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c78a5e23-a79e-4efd-abeb-78bb4f9df35c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:48.992610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c78a5e23-a79e-4efd-abeb-78bb4f9df35c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:48.993613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c78a5e23-a79e-4efd-abeb-78bb4f9df35c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:48.994470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c78a5e23-a79e-4efd-abeb-78bb4f9df35c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:48.995361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c78a5e23-a79e-4efd-abeb-78bb4f9df35c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:48.995974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c78a5e23-a79e-4efd-abeb-78bb4f9df35c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:48.996397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c78a5e23-a79e-4efd-abeb-78bb4f9df35c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.066111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c78a5e23-a79e-4efd-abeb-78bb4f9df35c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.075709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c78a5e23-a79e-4efd-abeb-78bb4f9df35c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.077363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c78a5e23-a79e-4efd-abeb-78bb4f9df35c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.082849 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c78a5e23-a79e-4efd-abeb-78bb4f9df35c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.107487 Oct 18 13:26:49.093211 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1256/2383] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:48 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:49.093211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-08420b2b-25f5-43c1-a20a-18da05bfbfd7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:49.093211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-08420b2b-25f5-43c1-a20a-18da05bfbfd7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:49.095292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08420b2b-25f5-43c1-a20a-18da05bfbfd7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.095955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08420b2b-25f5-43c1-a20a-18da05bfbfd7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.096541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08420b2b-25f5-43c1-a20a-18da05bfbfd7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.097429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08420b2b-25f5-43c1-a20a-18da05bfbfd7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.098024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08420b2b-25f5-43c1-a20a-18da05bfbfd7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.098758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08420b2b-25f5-43c1-a20a-18da05bfbfd7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.363991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-08420b2b-25f5-43c1-a20a-18da05bfbfd7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.374482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-08420b2b-25f5-43c1-a20a-18da05bfbfd7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.376246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-08420b2b-25f5-43c1-a20a-18da05bfbfd7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.377479 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-08420b2b-25f5-43c1-a20a-18da05bfbfd7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.292696 Oct 18 13:26:49.378078 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1257/2384] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:49 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:49.383464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53bce982-b1d2-40cc-b1eb-06b38905264e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:49.384389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53bce982-b1d2-40cc-b1eb-06b38905264e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:49.391446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53bce982-b1d2-40cc-b1eb-06b38905264e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.391936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53bce982-b1d2-40cc-b1eb-06b38905264e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.392523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53bce982-b1d2-40cc-b1eb-06b38905264e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.393093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53bce982-b1d2-40cc-b1eb-06b38905264e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.393600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53bce982-b1d2-40cc-b1eb-06b38905264e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.394024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53bce982-b1d2-40cc-b1eb-06b38905264e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.534665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-53bce982-b1d2-40cc-b1eb-06b38905264e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.544190 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53bce982-b1d2-40cc-b1eb-06b38905264e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1507 microversion: 2.1 time: 0.164644 Oct 18 13:26:49.544789 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1258/2385] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:49 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:49.562093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-92cd9f7f-e5db-4440-9fdb-bc96a35cc027 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:49.562093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-92cd9f7f-e5db-4440-9fdb-bc96a35cc027 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:49.573040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92cd9f7f-e5db-4440-9fdb-bc96a35cc027 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.573893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92cd9f7f-e5db-4440-9fdb-bc96a35cc027 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.574407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92cd9f7f-e5db-4440-9fdb-bc96a35cc027 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.575188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92cd9f7f-e5db-4440-9fdb-bc96a35cc027 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.575636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92cd9f7f-e5db-4440-9fdb-bc96a35cc027 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.576158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92cd9f7f-e5db-4440-9fdb-bc96a35cc027 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.590830 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-92cd9f7f-e5db-4440-9fdb-bc96a35cc027 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Instance 1dd5017a-89a3-4009-902b-156a36615276 could not be found. Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-92cd9f7f-e5db-4440-9fdb-bc96a35cc027 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 HTTP/1.1 Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:49.592382 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:49.593878 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:49.593878 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:49.593878 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:49.593878 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:49.593878 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:49.593878 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:49.593878 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:49.593878 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:49.593878 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:49.593878 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:26:49.593878 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 1dd5017a-89a3-4009-902b-156a36615276 could not be found. Oct 18 13:26:49.593878 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '1dd5017a-89a3-4009-902b-156a36615276'} Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dd5017a-89a3-4009-902b-156a36615276 could not be found. Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:49.594693 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dd5017a-89a3-4009-902b-156a36615276 could not be found. Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dd5017a-89a3-4009-902b-156a36615276 could not be found. Oct 18 13:26:49.596028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:49.597400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-92cd9f7f-e5db-4440-9fdb-bc96a35cc027 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Instance 1dd5017a-89a3-4009-902b-156a36615276 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:49.597400 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-92cd9f7f-e5db-4440-9fdb-bc96a35cc027 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 404 len: 111 microversion: 2.1 time: 0.047859 Oct 18 13:26:49.597400 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1259/2386] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:49 2022] DELETE /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:49.599053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a93c852f-5a12-4843-9fb9-ca43c857795a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:49.599740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a93c852f-5a12-4843-9fb9-ca43c857795a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:49.606728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a93c852f-5a12-4843-9fb9-ca43c857795a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.607211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a93c852f-5a12-4843-9fb9-ca43c857795a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.607638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a93c852f-5a12-4843-9fb9-ca43c857795a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.608325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a93c852f-5a12-4843-9fb9-ca43c857795a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.608770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a93c852f-5a12-4843-9fb9-ca43c857795a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.609207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a93c852f-5a12-4843-9fb9-ca43c857795a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.689580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a93c852f-5a12-4843-9fb9-ca43c857795a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.699039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a93c852f-5a12-4843-9fb9-ca43c857795a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.700619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a93c852f-5a12-4843-9fb9-ca43c857795a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.706051 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a93c852f-5a12-4843-9fb9-ca43c857795a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.110806 Oct 18 13:26:49.706711 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1260/2387] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:49 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:49.711963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1129daeb-fc42-4683-b098-4038a4086cf0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:49.712647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1129daeb-fc42-4683-b098-4038a4086cf0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:49.718909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1129daeb-fc42-4683-b098-4038a4086cf0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.719500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1129daeb-fc42-4683-b098-4038a4086cf0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.720028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1129daeb-fc42-4683-b098-4038a4086cf0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.720794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1129daeb-fc42-4683-b098-4038a4086cf0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.721375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1129daeb-fc42-4683-b098-4038a4086cf0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.721891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1129daeb-fc42-4683-b098-4038a4086cf0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.899265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1129daeb-fc42-4683-b098-4038a4086cf0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:49.954466 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1129daeb-fc42-4683-b098-4038a4086cf0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.246588 Oct 18 13:26:49.966287 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1261/2388] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:49 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:49.972437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-563f8f24-da53-452c-b53b-3d0b0f2a90ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:49.973466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-563f8f24-da53-452c-b53b-3d0b0f2a90ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 1dd5017a-89a3-4009-902b-156a36615276] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:49.982009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-563f8f24-da53-452c-b53b-3d0b0f2a90ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.982846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-563f8f24-da53-452c-b53b-3d0b0f2a90ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.983503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-563f8f24-da53-452c-b53b-3d0b0f2a90ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:49.984544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-563f8f24-da53-452c-b53b-3d0b0f2a90ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:49.985249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-563f8f24-da53-452c-b53b-3d0b0f2a90ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:49.986147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-563f8f24-da53-452c-b53b-3d0b0f2a90ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.002534 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-563f8f24-da53-452c-b53b-3d0b0f2a90ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Instance 1dd5017a-89a3-4009-902b-156a36615276 could not be found. Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-563f8f24-da53-452c-b53b-3d0b0f2a90ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 HTTP/1.1 Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:50.004470 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:50.005815 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:50.005815 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:50.005815 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:50.005815 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:50.005815 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:50.005815 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:50.005815 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:50.005815 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:50.005815 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:50.005815 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:26:50.005815 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 1dd5017a-89a3-4009-902b-156a36615276 could not be found. Oct 18 13:26:50.005815 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '1dd5017a-89a3-4009-902b-156a36615276'} Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dd5017a-89a3-4009-902b-156a36615276 could not be found. Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:50.006566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dd5017a-89a3-4009-902b-156a36615276 could not be found. Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dd5017a-89a3-4009-902b-156a36615276 could not be found. Oct 18 13:26:50.007802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:50.008829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-563f8f24-da53-452c-b53b-3d0b0f2a90ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Instance 1dd5017a-89a3-4009-902b-156a36615276 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:50.008829 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-563f8f24-da53-452c-b53b-3d0b0f2a90ac tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276" status: 404 len: 111 microversion: 2.1 time: 0.038336 Oct 18 13:26:50.008829 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1262/2389] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:49 2022] GET /compute/v2.1/servers/1dd5017a-89a3-4009-902b-156a36615276 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:50.012848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7b32b09c-4d8e-46cf-b918-8b1a58e273b0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:50.013507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7b32b09c-4d8e-46cf-b918-8b1a58e273b0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:50.019758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b32b09c-4d8e-46cf-b918-8b1a58e273b0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.020243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b32b09c-4d8e-46cf-b918-8b1a58e273b0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.020677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b32b09c-4d8e-46cf-b918-8b1a58e273b0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.021402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b32b09c-4d8e-46cf-b918-8b1a58e273b0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.022085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b32b09c-4d8e-46cf-b918-8b1a58e273b0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.024268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b32b09c-4d8e-46cf-b918-8b1a58e273b0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.173709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7b32b09c-4d8e-46cf-b918-8b1a58e273b0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:50.177759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:50.184177 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7b32b09c-4d8e-46cf-b918-8b1a58e273b0 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1316 microversion: 2.1 time: 0.175826 Oct 18 13:26:50.184910 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1263/2390] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:50 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:50.189934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d58e7679-0419-4949-83cb-674f377819af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:50.190841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d58e7679-0419-4949-83cb-674f377819af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:50.198538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d58e7679-0419-4949-83cb-674f377819af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.199155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d58e7679-0419-4949-83cb-674f377819af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.199690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d58e7679-0419-4949-83cb-674f377819af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.200482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d58e7679-0419-4949-83cb-674f377819af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.201050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d58e7679-0419-4949-83cb-674f377819af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.201507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d58e7679-0419-4949-83cb-674f377819af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.361787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d58e7679-0419-4949-83cb-674f377819af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:50.370687 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d58e7679-0419-4949-83cb-674f377819af tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.184376 Oct 18 13:26:50.371611 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1264/2391] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:50 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:50.376089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1551447-b29d-4622-b78d-390a9c4b4263 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617ba3790>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:50.399024 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-e1551447-b29d-4622-b78d-390a9c4b4263 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Image not found. Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1551447-b29d-4622-b78d-390a9c4b4263 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8 HTTP/1.1 Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:50.401964 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: exception: Image not found. Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '2e53210b-51aa-4aa1-8587-de49ea458cf8'} Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:50.403600 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2e53210b-51aa-4aa1-8587-de49ea458cf8 to delete Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:50.404656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2e53210b-51aa-4aa1-8587-de49ea458cf8 could not be found. Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:50.406060 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:26:50.407431 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:26:50.407431 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:26:50.407431 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:50.407431 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:50.407431 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:50.407431 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:50.407431 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:50.407431 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:50.407431 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:50.407431 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:50.407431 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:26:50.407431 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:50.409452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1551447-b29d-4622-b78d-390a9c4b4263 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Image not found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:50.410494 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e1551447-b29d-4622-b78d-390a9c4b4263 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8" status: 404 len: 62 microversion: 2.1 time: 0.037979 Oct 18 13:26:50.415948 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1265/2392] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:50 2022] DELETE /compute/v2.1/images/2e53210b-51aa-4aa1-8587-de49ea458cf8 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:26:50.423882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-edd5f4d6-0542-4ab8-8245-6f186b19d054 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:50.424756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-edd5f4d6-0542-4ab8-8245-6f186b19d054 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:50.434033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edd5f4d6-0542-4ab8-8245-6f186b19d054 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.434791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edd5f4d6-0542-4ab8-8245-6f186b19d054 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.435402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edd5f4d6-0542-4ab8-8245-6f186b19d054 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.436273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edd5f4d6-0542-4ab8-8245-6f186b19d054 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.436877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edd5f4d6-0542-4ab8-8245-6f186b19d054 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.448340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edd5f4d6-0542-4ab8-8245-6f186b19d054 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.603793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-edd5f4d6-0542-4ab8-8245-6f186b19d054 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:50.619786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-edd5f4d6-0542-4ab8-8245-6f186b19d054 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:50.621196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-edd5f4d6-0542-4ab8-8245-6f186b19d054 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:50.634738 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-edd5f4d6-0542-4ab8-8245-6f186b19d054 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.214959 Oct 18 13:26:50.636756 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1266/2393] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:50 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:50.649403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-14ec4be5-af14-4a50-b1f7-d3da596af2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:50.649952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-14ec4be5-af14-4a50-b1f7-d3da596af2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:50.665087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14ec4be5-af14-4a50-b1f7-d3da596af2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.665615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14ec4be5-af14-4a50-b1f7-d3da596af2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.666053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14ec4be5-af14-4a50-b1f7-d3da596af2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.666762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14ec4be5-af14-4a50-b1f7-d3da596af2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.667216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14ec4be5-af14-4a50-b1f7-d3da596af2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.667640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14ec4be5-af14-4a50-b1f7-d3da596af2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.777267 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-14ec4be5-af14-4a50-b1f7-d3da596af2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.137605 Oct 18 13:26:50.778088 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1267/2394] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:50 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:50.785919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-250777e7-c85c-4c16-abde-cc4c776b24d6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:50.786478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-250777e7-c85c-4c16-abde-cc4c776b24d6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:50.793521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-250777e7-c85c-4c16-abde-cc4c776b24d6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.794011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-250777e7-c85c-4c16-abde-cc4c776b24d6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.794464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-250777e7-c85c-4c16-abde-cc4c776b24d6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:50.795555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-250777e7-c85c-4c16-abde-cc4c776b24d6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:50.795670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-250777e7-c85c-4c16-abde-cc4c776b24d6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:50.796198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-250777e7-c85c-4c16-abde-cc4c776b24d6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.056987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-250777e7-c85c-4c16-abde-cc4c776b24d6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.066550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-250777e7-c85c-4c16-abde-cc4c776b24d6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.067892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-250777e7-c85c-4c16-abde-cc4c776b24d6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.069076 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-250777e7-c85c-4c16-abde-cc4c776b24d6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.289982 Oct 18 13:26:51.078807 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1268/2395] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:50 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:51.108428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb538a08-d959-4086-beb9-723b1027b0d6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.112977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cb538a08-d959-4086-beb9-723b1027b0d6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.121661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb538a08-d959-4086-beb9-723b1027b0d6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.122236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb538a08-d959-4086-beb9-723b1027b0d6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.122755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb538a08-d959-4086-beb9-723b1027b0d6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.123664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb538a08-d959-4086-beb9-723b1027b0d6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.124321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb538a08-d959-4086-beb9-723b1027b0d6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.124935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb538a08-d959-4086-beb9-723b1027b0d6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.142618 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-cb538a08-d959-4086-beb9-723b1027b0d6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Instance 2403d808-adf4-45f0-a631-cdc6fad44b76 could not be found. Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb538a08-d959-4086-beb9-723b1027b0d6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 HTTP/1.1 Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:51.144699 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:51.146164 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:51.146164 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.146164 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.146164 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.146164 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.146164 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:51.146164 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:51.146164 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:51.146164 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.146164 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:26:51.146164 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 2403d808-adf4-45f0-a631-cdc6fad44b76 could not be found. Oct 18 13:26:51.146164 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '2403d808-adf4-45f0-a631-cdc6fad44b76'} Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2403d808-adf4-45f0-a631-cdc6fad44b76 could not be found. Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:51.146973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2403d808-adf4-45f0-a631-cdc6fad44b76 could not be found. Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2403d808-adf4-45f0-a631-cdc6fad44b76 could not be found. Oct 18 13:26:51.148978 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.151502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb538a08-d959-4086-beb9-723b1027b0d6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Instance 2403d808-adf4-45f0-a631-cdc6fad44b76 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:51.152655 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cb538a08-d959-4086-beb9-723b1027b0d6 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 404 len: 111 microversion: 2.1 time: 0.061507 Oct 18 13:26:51.158115 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1269/2396] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:51 2022] DELETE /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:51.165429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68f04d83-b73c-4fa8-af93-3ea8265ba888 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.166182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-68f04d83-b73c-4fa8-af93-3ea8265ba888 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.172494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68f04d83-b73c-4fa8-af93-3ea8265ba888 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.173202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68f04d83-b73c-4fa8-af93-3ea8265ba888 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.173695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68f04d83-b73c-4fa8-af93-3ea8265ba888 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.174580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68f04d83-b73c-4fa8-af93-3ea8265ba888 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.175181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68f04d83-b73c-4fa8-af93-3ea8265ba888 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.175765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68f04d83-b73c-4fa8-af93-3ea8265ba888 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.365812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68f04d83-b73c-4fa8-af93-3ea8265ba888 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.374193 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68f04d83-b73c-4fa8-af93-3ea8265ba888 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1507 microversion: 2.1 time: 0.212804 Oct 18 13:26:51.374766 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1270/2397] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:51 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:51.380769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-29981665-d0c7-4bbb-a177-e57d27c62e06 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.381404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-29981665-d0c7-4bbb-a177-e57d27c62e06 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.388080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29981665-d0c7-4bbb-a177-e57d27c62e06 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.388564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29981665-d0c7-4bbb-a177-e57d27c62e06 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.388996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29981665-d0c7-4bbb-a177-e57d27c62e06 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.389712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29981665-d0c7-4bbb-a177-e57d27c62e06 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.390322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29981665-d0c7-4bbb-a177-e57d27c62e06 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.390944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29981665-d0c7-4bbb-a177-e57d27c62e06 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.467120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-29981665-d0c7-4bbb-a177-e57d27c62e06 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.480075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-29981665-d0c7-4bbb-a177-e57d27c62e06 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.482019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-29981665-d0c7-4bbb-a177-e57d27c62e06 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.487606 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-29981665-d0c7-4bbb-a177-e57d27c62e06 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.111870 Oct 18 13:26:51.488175 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1271/2398] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:51 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:51.493886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aed289f6-9838-41d5-903f-5d8915dd8f84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.494591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aed289f6-9838-41d5-903f-5d8915dd8f84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.500553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aed289f6-9838-41d5-903f-5d8915dd8f84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.501032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aed289f6-9838-41d5-903f-5d8915dd8f84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.501669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aed289f6-9838-41d5-903f-5d8915dd8f84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.502354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aed289f6-9838-41d5-903f-5d8915dd8f84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.502803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aed289f6-9838-41d5-903f-5d8915dd8f84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.503226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aed289f6-9838-41d5-903f-5d8915dd8f84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.594780 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-89671098-ad4a-4673-a10a-7131292a76dd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "POST /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.035285 Oct 18 13:26:51.595493 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1128/2399] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:26:47 2022] POST /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments => generated 194 bytes in 4037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:51.603351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c4b374b-0b64-47cf-953e-d5fef80a6c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.604117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7c4b374b-0b64-47cf-953e-d5fef80a6c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 2403d808-adf4-45f0-a631-cdc6fad44b76] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.611720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c4b374b-0b64-47cf-953e-d5fef80a6c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.612204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c4b374b-0b64-47cf-953e-d5fef80a6c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.612662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c4b374b-0b64-47cf-953e-d5fef80a6c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.613584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c4b374b-0b64-47cf-953e-d5fef80a6c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.614034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c4b374b-0b64-47cf-953e-d5fef80a6c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.614450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c4b374b-0b64-47cf-953e-d5fef80a6c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.629108 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-7c4b374b-0b64-47cf-953e-d5fef80a6c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Instance 2403d808-adf4-45f0-a631-cdc6fad44b76 could not be found. Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c4b374b-0b64-47cf-953e-d5fef80a6c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 HTTP/1.1 Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:26:51.630821 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:26:51.632116 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:51.632116 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.632116 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.632116 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.632116 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.632116 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:26:51.632116 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:26:51.632116 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:51.632116 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.632116 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:26:51.632116 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 2403d808-adf4-45f0-a631-cdc6fad44b76 could not be found. Oct 18 13:26:51.632116 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '2403d808-adf4-45f0-a631-cdc6fad44b76'} Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2403d808-adf4-45f0-a631-cdc6fad44b76 could not be found. Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:51.632898 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2403d808-adf4-45f0-a631-cdc6fad44b76 could not be found. Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2403d808-adf4-45f0-a631-cdc6fad44b76 could not be found. Oct 18 13:26:51.634471 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.635413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c4b374b-0b64-47cf-953e-d5fef80a6c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Instance 2403d808-adf4-45f0-a631-cdc6fad44b76 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:51.635413 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7c4b374b-0b64-47cf-953e-d5fef80a6c57 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76" status: 404 len: 111 microversion: 2.1 time: 0.034059 Oct 18 13:26:51.636673 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1129/2400] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:51 2022] GET /compute/v2.1/servers/2403d808-adf4-45f0-a631-cdc6fad44b76 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:51.640742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fa9c877f-c665-42d4-bf96-2580e14af5bb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.641379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fa9c877f-c665-42d4-bf96-2580e14af5bb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.654721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aed289f6-9838-41d5-903f-5d8915dd8f84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.657087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fa9c877f-c665-42d4-bf96-2580e14af5bb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.657366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fa9c877f-c665-42d4-bf96-2580e14af5bb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.657764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fa9c877f-c665-42d4-bf96-2580e14af5bb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.658476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fa9c877f-c665-42d4-bf96-2580e14af5bb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.658927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fa9c877f-c665-42d4-bf96-2580e14af5bb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.659358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fa9c877f-c665-42d4-bf96-2580e14af5bb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.661887 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aed289f6-9838-41d5-903f-5d8915dd8f84 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1655 microversion: 2.1 time: 0.172567 Oct 18 13:26:51.662454 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1272/2401] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:51 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1655 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:51.667574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1e148bfd-3137-4c4d-8a20-078febd097da tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff60f8238b0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.690284 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-1e148bfd-3137-4c4d-8a20-078febd097da tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Image not found. Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1e148bfd-3137-4c4d-8a20-078febd097da tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f HTTP/1.1 Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:51.692019 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: exception: Image not found. Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'cc3061b0-7156-40f1-968a-7b0f59c8b67f'} Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:51.693388 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cc3061b0-7156-40f1-968a-7b0f59c8b67f to delete Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.694209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc3061b0-7156-40f1-968a-7b0f59c8b67f could not be found. Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:51.695973 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1e148bfd-3137-4c4d-8a20-078febd097da tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Image not found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:51.697147 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1e148bfd-3137-4c4d-8a20-078febd097da tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f" status: 404 len: 62 microversion: 2.1 time: 0.030049 Oct 18 13:26:51.698940 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1273/2402] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:51 2022] DELETE /compute/v2.1/images/cc3061b0-7156-40f1-968a-7b0f59c8b67f => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:26:51.702319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-09e5c483-1b43-459b-926c-55b622a300ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.702920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-09e5c483-1b43-459b-926c-55b622a300ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.711026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09e5c483-1b43-459b-926c-55b622a300ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.711505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09e5c483-1b43-459b-926c-55b622a300ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.711935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09e5c483-1b43-459b-926c-55b622a300ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.712618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09e5c483-1b43-459b-926c-55b622a300ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.713069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09e5c483-1b43-459b-926c-55b622a300ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.713527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09e5c483-1b43-459b-926c-55b622a300ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.779603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09e5c483-1b43-459b-926c-55b622a300ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.788492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09e5c483-1b43-459b-926c-55b622a300ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.789993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09e5c483-1b43-459b-926c-55b622a300ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.794837 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-09e5c483-1b43-459b-926c-55b622a300ee tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.096145 Oct 18 13:26:51.795412 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1274/2403] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:51 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:51.800065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8f48428b-ea0c-4bc5-a7ad-e93a65f5c5c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:51.800605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8f48428b-ea0c-4bc5-a7ad-e93a65f5c5c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.806510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f48428b-ea0c-4bc5-a7ad-e93a65f5c5c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.806995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f48428b-ea0c-4bc5-a7ad-e93a65f5c5c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.807426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f48428b-ea0c-4bc5-a7ad-e93a65f5c5c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.808113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f48428b-ea0c-4bc5-a7ad-e93a65f5c5c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.808494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fa9c877f-c665-42d4-bf96-2580e14af5bb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:51.808629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f48428b-ea0c-4bc5-a7ad-e93a65f5c5c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.809002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f48428b-ea0c-4bc5-a7ad-e93a65f5c5c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.816442 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fa9c877f-c665-42d4-bf96-2580e14af5bb tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1316 microversion: 2.1 time: 0.179326 Oct 18 13:26:51.817018 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1130/2404] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:51 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:51.822370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dd4ca371-3443-49bd-b7d0-df9096cafee9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.822868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dd4ca371-3443-49bd-b7d0-df9096cafee9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.828623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd4ca371-3443-49bd-b7d0-df9096cafee9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.829356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd4ca371-3443-49bd-b7d0-df9096cafee9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.829796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd4ca371-3443-49bd-b7d0-df9096cafee9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.830489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd4ca371-3443-49bd-b7d0-df9096cafee9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.830938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd4ca371-3443-49bd-b7d0-df9096cafee9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.831549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd4ca371-3443-49bd-b7d0-df9096cafee9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.846005 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-dd4ca371-3443-49bd-b7d0-df9096cafee9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Instance c3683577-0991-4e03-b8c5-b3519335935c could not be found. Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dd4ca371-3443-49bd-b7d0-df9096cafee9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c HTTP/1.1 Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:26:51.847564 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:26:51.848860 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:51.848860 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.848860 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.848860 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.848860 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.848860 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:26:51.848860 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:26:51.848860 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:51.848860 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.848860 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:26:51.848860 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c3683577-0991-4e03-b8c5-b3519335935c could not be found. Oct 18 13:26:51.848860 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c3683577-0991-4e03-b8c5-b3519335935c'} Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3683577-0991-4e03-b8c5-b3519335935c could not be found. Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:51.849575 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3683577-0991-4e03-b8c5-b3519335935c could not be found. Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3683577-0991-4e03-b8c5-b3519335935c could not be found. Oct 18 13:26:51.850679 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.852437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dd4ca371-3443-49bd-b7d0-df9096cafee9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Instance c3683577-0991-4e03-b8c5-b3519335935c could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:51.852437 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dd4ca371-3443-49bd-b7d0-df9096cafee9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 404 len: 111 microversion: 2.1 time: 0.031000 Oct 18 13:26:51.852437 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1131/2405] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:51 2022] DELETE /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:51.858244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5f590213-4402-4faa-8db3-3bac1aaca8b9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.858865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5f590213-4402-4faa-8db3-3bac1aaca8b9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: c3683577-0991-4e03-b8c5-b3519335935c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.865398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f590213-4402-4faa-8db3-3bac1aaca8b9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.865885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f590213-4402-4faa-8db3-3bac1aaca8b9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.866344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f590213-4402-4faa-8db3-3bac1aaca8b9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.867025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f590213-4402-4faa-8db3-3bac1aaca8b9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.867480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f590213-4402-4faa-8db3-3bac1aaca8b9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.867922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f590213-4402-4faa-8db3-3bac1aaca8b9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.880009 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8f48428b-ea0c-4bc5-a7ad-e93a65f5c5c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.083393 Oct 18 13:26:51.884185 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1275/2406] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:51 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:51.884346 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-5f590213-4402-4faa-8db3-3bac1aaca8b9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Instance c3683577-0991-4e03-b8c5-b3519335935c could not be found. Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5f590213-4402-4faa-8db3-3bac1aaca8b9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c HTTP/1.1 Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:26:51.884601 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:26:51.886184 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:51.886184 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.886184 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.886184 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.886184 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.886184 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:26:51.886184 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:26:51.886184 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:51.886184 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.886184 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:26:51.886184 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c3683577-0991-4e03-b8c5-b3519335935c could not be found. Oct 18 13:26:51.886184 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c3683577-0991-4e03-b8c5-b3519335935c'} Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3683577-0991-4e03-b8c5-b3519335935c could not be found. Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:51.886928 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3683577-0991-4e03-b8c5-b3519335935c could not be found. Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3683577-0991-4e03-b8c5-b3519335935c could not be found. Oct 18 13:26:51.887978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.888929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5f590213-4402-4faa-8db3-3bac1aaca8b9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Instance c3683577-0991-4e03-b8c5-b3519335935c could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:51.888929 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5f590213-4402-4faa-8db3-3bac1aaca8b9 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c" status: 404 len: 111 microversion: 2.1 time: 0.031434 Oct 18 13:26:51.888929 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1132/2407] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:51 2022] GET /compute/v2.1/servers/c3683577-0991-4e03-b8c5-b3519335935c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:26:51.890263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-76dd9c05-7257-419b-b0a5-1e43ce2929bd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.890980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-76dd9c05-7257-419b-b0a5-1e43ce2929bd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.894333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e9da7473-fcba-45f9-a820-69ce7ffd68e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '.version_select at 0x7ff617b52940>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.897897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dd9c05-7257-419b-b0a5-1e43ce2929bd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.898514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dd9c05-7257-419b-b0a5-1e43ce2929bd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.898944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dd9c05-7257-419b-b0a5-1e43ce2929bd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.899898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dd9c05-7257-419b-b0a5-1e43ce2929bd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.900364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dd9c05-7257-419b-b0a5-1e43ce2929bd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.900780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dd9c05-7257-419b-b0a5-1e43ce2929bd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.916502 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e9da7473-fcba-45f9-a820-69ce7ffd68e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Image not found. Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e9da7473-fcba-45f9-a820-69ce7ffd68e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 HTTP/1.1 Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:26:51.918663 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c35bf82e-eb7d-4f8f-917a-e3268c4c4335'} Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:51.920011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c35bf82e-eb7d-4f8f-917a-e3268c4c4335 to delete Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.920784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c35bf82e-eb7d-4f8f-917a-e3268c4c4335 could not be found. Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:51.921835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e9da7473-fcba-45f9-a820-69ce7ffd68e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e9da7473-fcba-45f9-a820-69ce7ffd68e1 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335" status: 404 len: 62 microversion: 2.1 time: 0.029363 Oct 18 13:26:51.924826 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1133/2408] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:51 2022] DELETE /compute/v2.1/images/c35bf82e-eb7d-4f8f-917a-e3268c4c4335 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:26:51.930702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42ad839b-855d-4b63-a771-05e4c7395699 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.931202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-42ad839b-855d-4b63-a771-05e4c7395699 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.937839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42ad839b-855d-4b63-a771-05e4c7395699 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.938360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42ad839b-855d-4b63-a771-05e4c7395699 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.938831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42ad839b-855d-4b63-a771-05e4c7395699 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.939628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42ad839b-855d-4b63-a771-05e4c7395699 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.940066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42ad839b-855d-4b63-a771-05e4c7395699 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.940674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42ad839b-855d-4b63-a771-05e4c7395699 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.956716 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-42ad839b-855d-4b63-a771-05e4c7395699 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 could not be found. Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42ad839b-855d-4b63-a771-05e4c7395699 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 HTTP/1.1 Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:26:51.958312 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:26:51.959703 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:51.959703 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.959703 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.959703 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.959703 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.959703 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:26:51.959703 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:26:51.959703 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:51.959703 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.959703 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:26:51.959703 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 could not be found. Oct 18 13:26:51.959703 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '70f0df27-75cd-4ece-b3e8-91174239e3a9'} Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 could not be found. Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:51.960467 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 could not be found. Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 could not be found. Oct 18 13:26:51.961876 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.963199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42ad839b-855d-4b63-a771-05e4c7395699 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:51.963199 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-42ad839b-855d-4b63-a771-05e4c7395699 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "DELETE /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 404 len: 111 microversion: 2.1 time: 0.034824 Oct 18 13:26:51.963199 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1134/2409] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:51 2022] DELETE /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:26:51.967952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41bbd32d-182e-4f1e-970d-4901374bec93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:51.968596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-41bbd32d-182e-4f1e-970d-4901374bec93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] [instance: 70f0df27-75cd-4ece-b3e8-91174239e3a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:51.974497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41bbd32d-182e-4f1e-970d-4901374bec93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.974977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41bbd32d-182e-4f1e-970d-4901374bec93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.975423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41bbd32d-182e-4f1e-970d-4901374bec93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.976655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41bbd32d-182e-4f1e-970d-4901374bec93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:51.977106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41bbd32d-182e-4f1e-970d-4901374bec93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:51.977559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41bbd32d-182e-4f1e-970d-4901374bec93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:51.991854 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-41bbd32d-182e-4f1e-970d-4901374bec93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] HTTP exception thrown: Instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 could not be found. Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41bbd32d-182e-4f1e-970d-4901374bec93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Request method failure captured: Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 HTTP/1.1 Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqgD_cYH6m1LrtYbtFatnxFibURZ6Lq4boGHH7DeeK2elgs0Q2dknALHSVXU05WwgKGmkV9OS6nBtm1q02BumeTLHusiZ0I14A1vm9x0-5xnFC_dCYMQiVZ9UQDaU0Sody0hrDAuYT1QXpx4wWzdJbWmPZ6COgWZM7i3sgz7nvXWd1A Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:26:51.993450 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:26:51.994853 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472fc8535c504953a8f14a24f9d22260"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472fc8535c504953a8f14a24f9d22260"}]}] Oct 18 13:26:51.994853 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.994853 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 472fc8535c504953a8f14a24f9d22260 Oct 18 13:26:51.994853 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesTestJSON-65013266 Oct 18 13:26:51.994853 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.994853 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:26:51.994853 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:26:51.994853 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: f896caa4caa0472db9198f7795401df2 Oct 18 13:26:51.994853 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesTestJSON-65013266-project Oct 18 13:26:51.994853 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:26:51.994853 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 could not be found. Oct 18 13:26:51.994853 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '70f0df27-75cd-4ece-b3e8-91174239e3a9'} Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 could not be found. Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:51.995836 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 could not be found. Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 could not be found. Oct 18 13:26:51.997365 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:51.998806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41bbd32d-182e-4f1e-970d-4901374bec93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] Returning 404 to user: Instance 70f0df27-75cd-4ece-b3e8-91174239e3a9 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:51.998806 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-41bbd32d-182e-4f1e-970d-4901374bec93 tempest-ImagesTestJSON-65013266 tempest-ImagesTestJSON-65013266-project] 10.222.0.40 "GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9" status: 404 len: 111 microversion: 2.1 time: 0.030493 Oct 18 13:26:51.998806 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1135/2410] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:51 2022] GET /compute/v2.1/servers/70f0df27-75cd-4ece-b3e8-91174239e3a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:26:52.043242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-76dd9c05-7257-419b-b0a5-1e43ce2929bd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.051079 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-76dd9c05-7257-419b-b0a5-1e43ce2929bd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1662 microversion: 2.1 time: 0.164844 Oct 18 13:26:52.051909 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1276/2411] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:51 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1662 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:26:52.104591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-164801aa-0804-4236-b21f-f41f82c14c9a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:52.105227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-164801aa-0804-4236-b21f-f41f82c14c9a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:52.111162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-164801aa-0804-4236-b21f-f41f82c14c9a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.111652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-164801aa-0804-4236-b21f-f41f82c14c9a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.112076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-164801aa-0804-4236-b21f-f41f82c14c9a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.112762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-164801aa-0804-4236-b21f-f41f82c14c9a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.113236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-164801aa-0804-4236-b21f-f41f82c14c9a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.113660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-164801aa-0804-4236-b21f-f41f82c14c9a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.399907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-da810f05-0bc4-4bd6-8c7d-0b93efd27962 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:52.400713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-da810f05-0bc4-4bd6-8c7d-0b93efd27962 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:52.407437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da810f05-0bc4-4bd6-8c7d-0b93efd27962 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.408309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da810f05-0bc4-4bd6-8c7d-0b93efd27962 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.411190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-164801aa-0804-4236-b21f-f41f82c14c9a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.431174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-164801aa-0804-4236-b21f-f41f82c14c9a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.434152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-164801aa-0804-4236-b21f-f41f82c14c9a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.435262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da810f05-0bc4-4bd6-8c7d-0b93efd27962 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.435888 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-164801aa-0804-4236-b21f-f41f82c14c9a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.336044 Oct 18 13:26:52.436999 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1136/2412] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:52 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:52.438847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da810f05-0bc4-4bd6-8c7d-0b93efd27962 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.441385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da810f05-0bc4-4bd6-8c7d-0b93efd27962 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.444748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da810f05-0bc4-4bd6-8c7d-0b93efd27962 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.534259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-40c90f58-3970-44ec-84c2-861c6627ac07 req-e8f2e827-2e6d-4052-bbad-616471a77184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290", "name": "network-vif-plugged", "status": "completed", "tag": "6baad0b7-1db5-475b-b6de-51f6616dc237"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:52.571886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-40c90f58-3970-44ec-84c2-861c6627ac07 req-e8f2e827-2e6d-4052-bbad-616471a77184 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.572616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-40c90f58-3970-44ec-84c2-861c6627ac07 req-e8f2e827-2e6d-4052-bbad-616471a77184 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.573233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-40c90f58-3970-44ec-84c2-861c6627ac07 req-e8f2e827-2e6d-4052-bbad-616471a77184 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.595628 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-40c90f58-3970-44ec-84c2-861c6627ac07 req-e8f2e827-2e6d-4052-bbad-616471a77184 service nova] Creating event network-vif-plugged:6baad0b7-1db5-475b-b6de-51f6616dc237 for instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 on n-h1-858384-13 Oct 18 13:26:52.610201 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-40c90f58-3970-44ec-84c2-861c6627ac07 req-e8f2e827-2e6d-4052-bbad-616471a77184 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166213 Oct 18 13:26:52.611030 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1137/2413] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:52.618167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0a7cf55c-bd16-490c-a65c-f69bf772c650 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:52.619036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0a7cf55c-bd16-490c-a65c-f69bf772c650 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:52.627111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a7cf55c-bd16-490c-a65c-f69bf772c650 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.627596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a7cf55c-bd16-490c-a65c-f69bf772c650 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.628213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a7cf55c-bd16-490c-a65c-f69bf772c650 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.628922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a7cf55c-bd16-490c-a65c-f69bf772c650 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.629596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a7cf55c-bd16-490c-a65c-f69bf772c650 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.630452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a7cf55c-bd16-490c-a65c-f69bf772c650 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.738079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-da810f05-0bc4-4bd6-8c7d-0b93efd27962 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.747187 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-da810f05-0bc4-4bd6-8c7d-0b93efd27962 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1507 microversion: 2.1 time: 0.351716 Oct 18 13:26:52.747686 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1277/2414] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:52 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:52.822393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0a7cf55c-bd16-490c-a65c-f69bf772c650 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.823349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0f8799a0-706c-4ce1-aced-64c0c959d7a6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:52.823957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0f8799a0-706c-4ce1-aced-64c0c959d7a6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:52.831150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0a7cf55c-bd16-490c-a65c-f69bf772c650 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.832614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0a7cf55c-bd16-490c-a65c-f69bf772c650 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.835772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f8799a0-706c-4ce1-aced-64c0c959d7a6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.837953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f8799a0-706c-4ce1-aced-64c0c959d7a6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.838590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f8799a0-706c-4ce1-aced-64c0c959d7a6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.838881 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0a7cf55c-bd16-490c-a65c-f69bf772c650 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.226423 Oct 18 13:26:52.839998 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1138/2415] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:52 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:52.840349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f8799a0-706c-4ce1-aced-64c0c959d7a6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.840957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f8799a0-706c-4ce1-aced-64c0c959d7a6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.842942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f8799a0-706c-4ce1-aced-64c0c959d7a6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.846928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-200d9b87-424b-42ad-b5f8-c127487300f9 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:52.847722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-200d9b87-424b-42ad-b5f8-c127487300f9 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:52.854260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:52.856036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-200d9b87-424b-42ad-b5f8-c127487300f9 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.856951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-200d9b87-424b-42ad-b5f8-c127487300f9 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.857752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-200d9b87-424b-42ad-b5f8-c127487300f9 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.858883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-200d9b87-424b-42ad-b5f8-c127487300f9 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:52.859485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-200d9b87-424b-42ad-b5f8-c127487300f9 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:52.860054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-200d9b87-424b-42ad-b5f8-c127487300f9 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:52.969715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0f8799a0-706c-4ce1-aced-64c0c959d7a6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.979117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0f8799a0-706c-4ce1-aced-64c0c959d7a6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.980692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0f8799a0-706c-4ce1-aced-64c0c959d7a6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:52.986779 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0f8799a0-706c-4ce1-aced-64c0c959d7a6 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.167514 Oct 18 13:26:52.987355 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1278/2416] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:52 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:53.077168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8961b370-44bc-420f-977b-ee94e0c79900 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:53.079250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8961b370-44bc-420f-977b-ee94e0c79900 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:53.100477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8961b370-44bc-420f-977b-ee94e0c79900 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.103186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8961b370-44bc-420f-977b-ee94e0c79900 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.105819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8961b370-44bc-420f-977b-ee94e0c79900 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:53.106592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8961b370-44bc-420f-977b-ee94e0c79900 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.107093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8961b370-44bc-420f-977b-ee94e0c79900 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.109598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8961b370-44bc-420f-977b-ee94e0c79900 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:53.187623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-200d9b87-424b-42ad-b5f8-c127487300f9 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:53.203190 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-200d9b87-424b-42ad-b5f8-c127487300f9 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1316 microversion: 2.1 time: 0.361751 Oct 18 13:26:53.206592 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1139/2417] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:52 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:53.339597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8961b370-44bc-420f-977b-ee94e0c79900 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:53.348136 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8961b370-44bc-420f-977b-ee94e0c79900 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1662 microversion: 2.1 time: 0.277210 Oct 18 13:26:53.348774 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1279/2418] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:53 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1662 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:53.464110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e3bb945-acdc-4cab-96db-ea5274364aaf tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:53.465314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4e3bb945-acdc-4cab-96db-ea5274364aaf tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:53.471545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e3bb945-acdc-4cab-96db-ea5274364aaf tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.472327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e3bb945-acdc-4cab-96db-ea5274364aaf tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.472774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e3bb945-acdc-4cab-96db-ea5274364aaf tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:53.473519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e3bb945-acdc-4cab-96db-ea5274364aaf tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.474155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e3bb945-acdc-4cab-96db-ea5274364aaf tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.475028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e3bb945-acdc-4cab-96db-ea5274364aaf tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:53.480668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:53.581814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:53.759307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4e3bb945-acdc-4cab-96db-ea5274364aaf tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:53.782666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7b19aa6a-a646-4294-921d-bbdc97c5d00f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:53.782666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7b19aa6a-a646-4294-921d-bbdc97c5d00f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:53.800300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b19aa6a-a646-4294-921d-bbdc97c5d00f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.803425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b19aa6a-a646-4294-921d-bbdc97c5d00f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.803970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b19aa6a-a646-4294-921d-bbdc97c5d00f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:53.810068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b19aa6a-a646-4294-921d-bbdc97c5d00f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.812560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b19aa6a-a646-4294-921d-bbdc97c5d00f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.813787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b19aa6a-a646-4294-921d-bbdc97c5d00f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:53.818608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4e3bb945-acdc-4cab-96db-ea5274364aaf tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:53.823532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4e3bb945-acdc-4cab-96db-ea5274364aaf tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:53.827576 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4e3bb945-acdc-4cab-96db-ea5274364aaf tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.366496 Oct 18 13:26:53.846211 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1140/2419] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:53 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:53.879862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7ef2c741-ca91-41e4-a0bf-c06c11c3eb36 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:53.887108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7ef2c741-ca91-41e4-a0bf-c06c11c3eb36 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:53.911329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ef2c741-ca91-41e4-a0bf-c06c11c3eb36 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.912623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ef2c741-ca91-41e4-a0bf-c06c11c3eb36 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.913315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ef2c741-ca91-41e4-a0bf-c06c11c3eb36 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:53.914528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ef2c741-ca91-41e4-a0bf-c06c11c3eb36 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:53.915142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ef2c741-ca91-41e4-a0bf-c06c11c3eb36 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:53.917588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ef2c741-ca91-41e4-a0bf-c06c11c3eb36 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.068624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ef2c741-ca91-41e4-a0bf-c06c11c3eb36 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:54.081226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ef2c741-ca91-41e4-a0bf-c06c11c3eb36 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:54.082691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ef2c741-ca91-41e4-a0bf-c06c11c3eb36 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:54.100705 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7ef2c741-ca91-41e4-a0bf-c06c11c3eb36 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.232011 Oct 18 13:26:54.105332 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1141/2420] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:53 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:54.119865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-329ab234-a1e1-4209-94ed-742599aae16c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:54.120512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-329ab234-a1e1-4209-94ed-742599aae16c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:54.138158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329ab234-a1e1-4209-94ed-742599aae16c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.138668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329ab234-a1e1-4209-94ed-742599aae16c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.139103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329ab234-a1e1-4209-94ed-742599aae16c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.139821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329ab234-a1e1-4209-94ed-742599aae16c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.140275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329ab234-a1e1-4209-94ed-742599aae16c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.140698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329ab234-a1e1-4209-94ed-742599aae16c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.231332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7b19aa6a-a646-4294-921d-bbdc97c5d00f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:54.244303 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7b19aa6a-a646-4294-921d-bbdc97c5d00f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 200 len: 1510 microversion: 2.1 time: 0.477302 Oct 18 13:26:54.245823 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1280/2421] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:53 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 1510 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:54.250608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c205ff4c-61de-4e1c-9f92-ae451eba1e40 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:54.251274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c205ff4c-61de-4e1c-9f92-ae451eba1e40 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:54.269853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c205ff4c-61de-4e1c-9f92-ae451eba1e40 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.270654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c205ff4c-61de-4e1c-9f92-ae451eba1e40 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.271540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c205ff4c-61de-4e1c-9f92-ae451eba1e40 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.277481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c205ff4c-61de-4e1c-9f92-ae451eba1e40 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.278720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c205ff4c-61de-4e1c-9f92-ae451eba1e40 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.279387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c205ff4c-61de-4e1c-9f92-ae451eba1e40 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.284957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:54.311638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-329ab234-a1e1-4209-94ed-742599aae16c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:54.323741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-329ab234-a1e1-4209-94ed-742599aae16c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:54.327476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-329ab234-a1e1-4209-94ed-742599aae16c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:54.339218 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-329ab234-a1e1-4209-94ed-742599aae16c tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1544 microversion: 2.91 time: 0.230927 Oct 18 13:26:54.342237 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1142/2422] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:54 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1544 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:54.347117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:54.351332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:54.376032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.387154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.388591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.390994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.391820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.394251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.450847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:26:54.481000 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.compute.api [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Working on deleting snapshot 712b47f2-f3d2-4891-8010-204bbd2cb0a9 from shelved instance... Oct 18 13:26:54.548241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c205ff4c-61de-4e1c-9f92-ae451eba1e40 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:54.556939 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c205ff4c-61de-4e1c-9f92-ae451eba1e40 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1316 microversion: 2.1 time: 0.309916 Oct 18 13:26:54.558484 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1281/2423] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:54 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:54.563133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-82138e41-5f3b-4010-8dcb-d76131cd8fbd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:54.563750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-82138e41-5f3b-4010-8dcb-d76131cd8fbd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:54.575705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82138e41-5f3b-4010-8dcb-d76131cd8fbd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.576399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82138e41-5f3b-4010-8dcb-d76131cd8fbd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.577128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82138e41-5f3b-4010-8dcb-d76131cd8fbd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.578595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82138e41-5f3b-4010-8dcb-d76131cd8fbd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.578749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82138e41-5f3b-4010-8dcb-d76131cd8fbd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.579405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82138e41-5f3b-4010-8dcb-d76131cd8fbd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.858809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-82138e41-5f3b-4010-8dcb-d76131cd8fbd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:54.872230 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-82138e41-5f3b-4010-8dcb-d76131cd8fbd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.312475 Oct 18 13:26:54.874893 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1282/2424] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:54 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:54.880876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-397d84a8-e645-4d1d-9145-2c8fd1eaa3dd req-a1d5738d-9bb1-4567-ad6a-a2f2525240ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a52dba4-8897-442b-b15f-4d3185f02add", "name": "network-vif-unplugged", "status": "completed", "tag": "347c646b-dc50-4651-a535-bcda2f5df834"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:54.925607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-397d84a8-e645-4d1d-9145-2c8fd1eaa3dd req-a1d5738d-9bb1-4567-ad6a-a2f2525240ea service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:54.926102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-397d84a8-e645-4d1d-9145-2c8fd1eaa3dd req-a1d5738d-9bb1-4567-ad6a-a2f2525240ea service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:54.926783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-397d84a8-e645-4d1d-9145-2c8fd1eaa3dd req-a1d5738d-9bb1-4567-ad6a-a2f2525240ea service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:54.964977 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-397d84a8-e645-4d1d-9145-2c8fd1eaa3dd req-a1d5738d-9bb1-4567-ad6a-a2f2525240ea service nova] Creating event network-vif-unplugged:347c646b-dc50-4651-a535-bcda2f5df834 for instance 3a52dba4-8897-442b-b15f-4d3185f02add on n-h1-858384-13 Oct 18 13:26:55.001437 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-397d84a8-e645-4d1d-9145-2c8fd1eaa3dd req-a1d5738d-9bb1-4567-ad6a-a2f2525240ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125210 Oct 18 13:26:55.003290 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1283/2425] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:55.024403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a264a26c-9127-477e-a812-c09189def780 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:55.031193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a264a26c-9127-477e-a812-c09189def780 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:55.057118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a264a26c-9127-477e-a812-c09189def780 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.059394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a264a26c-9127-477e-a812-c09189def780 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.064960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a264a26c-9127-477e-a812-c09189def780 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.067873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a264a26c-9127-477e-a812-c09189def780 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.071582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a264a26c-9127-477e-a812-c09189def780 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.083639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a264a26c-9127-477e-a812-c09189def780 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.415853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Doing local delete in cell a8e216eb-ce73-4101-a62e-f9159a9c2bcf(cell1) {{(pid=120612) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 18 13:26:55.417149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.417798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.418412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.418987 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.compute.api [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 18 13:26:55.423295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] deallocate_for_instance() {{(pid=120612) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 18 13:26:55.525270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a264a26c-9127-477e-a812-c09189def780 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:55.537487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a264a26c-9127-477e-a812-c09189def780 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:55.540475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a264a26c-9127-477e-a812-c09189def780 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:55.542241 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a264a26c-9127-477e-a812-c09189def780 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.537514 Oct 18 13:26:55.557260 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1284/2426] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:55 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:55.557260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2d2b3f2e-f72a-413f-88a4-3b1fd9216383 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:55.557260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2d2b3f2e-f72a-413f-88a4-3b1fd9216383 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:55.557824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d2b3f2e-f72a-413f-88a4-3b1fd9216383 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.558561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d2b3f2e-f72a-413f-88a4-3b1fd9216383 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.559219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d2b3f2e-f72a-413f-88a4-3b1fd9216383 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.559972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d2b3f2e-f72a-413f-88a4-3b1fd9216383 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.560428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d2b3f2e-f72a-413f-88a4-3b1fd9216383 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.560848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d2b3f2e-f72a-413f-88a4-3b1fd9216383 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.720777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2d2b3f2e-f72a-413f-88a4-3b1fd9216383 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:55.731006 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2d2b3f2e-f72a-413f-88a4-3b1fd9216383 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.185161 Oct 18 13:26:55.732737 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1285/2427] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:55 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:55.738371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a81815f1-a6bb-41f3-903a-9bb0e710e28d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:55.740129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a81815f1-a6bb-41f3-903a-9bb0e710e28d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:55.747362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a81815f1-a6bb-41f3-903a-9bb0e710e28d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.747984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a81815f1-a6bb-41f3-903a-9bb0e710e28d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.748512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a81815f1-a6bb-41f3-903a-9bb0e710e28d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.749328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a81815f1-a6bb-41f3-903a-9bb0e710e28d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.749879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a81815f1-a6bb-41f3-903a-9bb0e710e28d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.750390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a81815f1-a6bb-41f3-903a-9bb0e710e28d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.844549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a81815f1-a6bb-41f3-903a-9bb0e710e28d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:55.855802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a81815f1-a6bb-41f3-903a-9bb0e710e28d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:55.857632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a81815f1-a6bb-41f3-903a-9bb0e710e28d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:55.863388 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a81815f1-a6bb-41f3-903a-9bb0e710e28d tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.129328 Oct 18 13:26:55.876785 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1286/2428] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:55 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:55.892223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fb0350d4-3695-4775-a789-e07668e76ffc tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:55.892920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb0350d4-3695-4775-a789-e07668e76ffc tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:55.900501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb0350d4-3695-4775-a789-e07668e76ffc tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.900996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb0350d4-3695-4775-a789-e07668e76ffc tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.901459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb0350d4-3695-4775-a789-e07668e76ffc tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:55.902164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb0350d4-3695-4775-a789-e07668e76ffc tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:55.902619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb0350d4-3695-4775-a789-e07668e76ffc tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:55.903046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb0350d4-3695-4775-a789-e07668e76ffc tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.099398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fb0350d4-3695-4775-a789-e07668e76ffc tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:56.112104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fb0350d4-3695-4775-a789-e07668e76ffc tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:56.115596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fb0350d4-3695-4775-a789-e07668e76ffc tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:56.123989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:56.126474 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fb0350d4-3695-4775-a789-e07668e76ffc tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1531 microversion: 2.91 time: 0.241385 Oct 18 13:26:56.142070 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1287/2429] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:55 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1531 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:56.163613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-89976887-ebb0-44af-93c8-2548c86130b2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:56.164803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-89976887-ebb0-44af-93c8-2548c86130b2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:56.188186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89976887-ebb0-44af-93c8-2548c86130b2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.189037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89976887-ebb0-44af-93c8-2548c86130b2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.189660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89976887-ebb0-44af-93c8-2548c86130b2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.190970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89976887-ebb0-44af-93c8-2548c86130b2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.191826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89976887-ebb0-44af-93c8-2548c86130b2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.192468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89976887-ebb0-44af-93c8-2548c86130b2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.480363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-89976887-ebb0-44af-93c8-2548c86130b2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:56.490211 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-89976887-ebb0-44af-93c8-2548c86130b2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1504 microversion: 2.1 time: 0.346511 Oct 18 13:26:56.491812 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1288/2430] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:56 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:56.509857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-26a67962-f5a2-4be3-91f6-12956e610d18 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:56.509857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-26a67962-f5a2-4be3-91f6-12956e610d18 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:56.509857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26a67962-f5a2-4be3-91f6-12956e610d18 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.509857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26a67962-f5a2-4be3-91f6-12956e610d18 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.510177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26a67962-f5a2-4be3-91f6-12956e610d18 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.510177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26a67962-f5a2-4be3-91f6-12956e610d18 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.510177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26a67962-f5a2-4be3-91f6-12956e610d18 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.510489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26a67962-f5a2-4be3-91f6-12956e610d18 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.695756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-26a67962-f5a2-4be3-91f6-12956e610d18 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:56.718253 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-26a67962-f5a2-4be3-91f6-12956e610d18 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.213242 Oct 18 13:26:56.720861 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1289/2431] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:56 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:56.729359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9876fa4a-6cef-4c40-b20e-6c635583bfed tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:56.730466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9876fa4a-6cef-4c40-b20e-6c635583bfed tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:56.739041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9876fa4a-6cef-4c40-b20e-6c635583bfed tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.739633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9876fa4a-6cef-4c40-b20e-6c635583bfed tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.740623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9876fa4a-6cef-4c40-b20e-6c635583bfed tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.741627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9876fa4a-6cef-4c40-b20e-6c635583bfed tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.742164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9876fa4a-6cef-4c40-b20e-6c635583bfed tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.742707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9876fa4a-6cef-4c40-b20e-6c635583bfed tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.824431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Updating instance_info_cache with network_info: [] {{(pid=120612) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:26:56.896889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-9876fa4a-6cef-4c40-b20e-6c635583bfed tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] Lazy-loading 'services' on Instance uuid 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:26:56.936918 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9876fa4a-6cef-4c40-b20e-6c635583bfed tempest-UnshelveToHostMultiNodesTest-622976454 tempest-UnshelveToHostMultiNodesTest-622976454-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1938 microversion: 2.91 time: 0.213919 Oct 18 13:26:56.937751 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1290/2432] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:56 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1938 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:56.969506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cf9a19e4-e543-4131-a361-1f9691b2da0d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-950023575"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:56.970328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cf9a19e4-e543-4131-a361-1f9691b2da0d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:56.978360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf9a19e4-e543-4131-a361-1f9691b2da0d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.979395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf9a19e4-e543-4131-a361-1f9691b2da0d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.980151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf9a19e4-e543-4131-a361-1f9691b2da0d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:56.981561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf9a19e4-e543-4131-a361-1f9691b2da0d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:56.982327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf9a19e4-e543-4131-a361-1f9691b2da0d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:56.984661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf9a19e4-e543-4131-a361-1f9691b2da0d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.175987 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d1fde96d-840b-446e-a84d-ecc673d65dec tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 204 len: 0 microversion: 2.1 time: 2.831649 Oct 18 13:26:57.177553 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1143/2433] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:26:54 2022] DELETE /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 0 bytes in 2835 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:26:57.189821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6121f2e7-ffe7-4bb9-9cea-75e581a0352f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:57.190958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6121f2e7-ffe7-4bb9-9cea-75e581a0352f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:57.211342 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.network.security_group_api [None req-cf9a19e4-e543-4131-a361-1f9691b2da0d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Adding security group 129ad497-f01f-483e-b3d2-1d74291ab2b6 to port 6baad0b7-1db5-475b-b6de-51f6616dc237 Oct 18 13:26:57.211744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6121f2e7-ffe7-4bb9-9cea-75e581a0352f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.212438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6121f2e7-ffe7-4bb9-9cea-75e581a0352f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.213072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6121f2e7-ffe7-4bb9-9cea-75e581a0352f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.216827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6121f2e7-ffe7-4bb9-9cea-75e581a0352f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.217575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6121f2e7-ffe7-4bb9-9cea-75e581a0352f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.218189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6121f2e7-ffe7-4bb9-9cea-75e581a0352f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.621461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6121f2e7-ffe7-4bb9-9cea-75e581a0352f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:57.632009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6121f2e7-ffe7-4bb9-9cea-75e581a0352f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:57.633667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6121f2e7-ffe7-4bb9-9cea-75e581a0352f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:57.634880 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6121f2e7-ffe7-4bb9-9cea-75e581a0352f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.450862 Oct 18 13:26:57.635639 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1144/2434] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:57 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:57.640085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed8459d0-a411-46e1-977a-48fa78239583 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:57.640686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ed8459d0-a411-46e1-977a-48fa78239583 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:57.646853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed8459d0-a411-46e1-977a-48fa78239583 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.647278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed8459d0-a411-46e1-977a-48fa78239583 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.647739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed8459d0-a411-46e1-977a-48fa78239583 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.648429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed8459d0-a411-46e1-977a-48fa78239583 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.649000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed8459d0-a411-46e1-977a-48fa78239583 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.649456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed8459d0-a411-46e1-977a-48fa78239583 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.764993 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cf9a19e4-e543-4131-a361-1f9691b2da0d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290/action" status: 202 len: 0 microversion: 2.1 time: 0.810544 Oct 18 13:26:57.770593 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1291/2435] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:56 2022] POST /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:57.784696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f4c5e42e-511c-4133-b2c3-5ffa8b956398 req-9a4854ed-8f40-480a-91d9-ed6fa3989cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a52dba4-8897-442b-b15f-4d3185f02add", "name": "network-vif-deleted", "tag": "347c646b-dc50-4651-a535-bcda2f5df834"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:57.814200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ed8459d0-a411-46e1-977a-48fa78239583 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:57.816941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f4c5e42e-511c-4133-b2c3-5ffa8b956398 req-9a4854ed-8f40-480a-91d9-ed6fa3989cc1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.819429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f4c5e42e-511c-4133-b2c3-5ffa8b956398 req-9a4854ed-8f40-480a-91d9-ed6fa3989cc1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.823882 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ed8459d0-a411-46e1-977a-48fa78239583 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.187133 Oct 18 13:26:57.824683 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1145/2436] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:57 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:57.830144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aeaa4a9e-949f-432f-8a22-e864b7ffe9d2 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:57.830958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aeaa4a9e-949f-432f-8a22-e864b7ffe9d2 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:57.838539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aeaa4a9e-949f-432f-8a22-e864b7ffe9d2 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.839166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f4c5e42e-511c-4133-b2c3-5ffa8b956398 req-9a4854ed-8f40-480a-91d9-ed6fa3989cc1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.839659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aeaa4a9e-949f-432f-8a22-e864b7ffe9d2 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.840273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aeaa4a9e-949f-432f-8a22-e864b7ffe9d2 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.841229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aeaa4a9e-949f-432f-8a22-e864b7ffe9d2 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.841882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aeaa4a9e-949f-432f-8a22-e864b7ffe9d2 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.842440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aeaa4a9e-949f-432f-8a22-e864b7ffe9d2 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.878292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.compute.server_external_events [req-f4c5e42e-511c-4133-b2c3-5ffa8b956398 req-9a4854ed-8f40-480a-91d9-ed6fa3989cc1 service nova] Unable to find a host for instance 3a52dba4-8897-442b-b15f-4d3185f02add. Dropping event network-vif-deleted {{(pid=120611) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 13:26:57.884423 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f4c5e42e-511c-4133-b2c3-5ffa8b956398 req-9a4854ed-8f40-480a-91d9-ed6fa3989cc1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.112547 Oct 18 13:26:57.891417 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1292/2437] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 120 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 18 13:26:57.898367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3b89bbc8-9d3e-434a-8a45-d97d0044ae19 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:57.899633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3b89bbc8-9d3e-434a-8a45-d97d0044ae19 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:57.906069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b89bbc8-9d3e-434a-8a45-d97d0044ae19 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.907098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b89bbc8-9d3e-434a-8a45-d97d0044ae19 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.907871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b89bbc8-9d3e-434a-8a45-d97d0044ae19 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.908820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b89bbc8-9d3e-434a-8a45-d97d0044ae19 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:57.909754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b89bbc8-9d3e-434a-8a45-d97d0044ae19 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:57.911020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b89bbc8-9d3e-434a-8a45-d97d0044ae19 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:57.950777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3b89bbc8-9d3e-434a-8a45-d97d0044ae19 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:26:57.969060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aeaa4a9e-949f-432f-8a22-e864b7ffe9d2 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:57.978786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aeaa4a9e-949f-432f-8a22-e864b7ffe9d2 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:57.980232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aeaa4a9e-949f-432f-8a22-e864b7ffe9d2 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:57.992080 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aeaa4a9e-949f-432f-8a22-e864b7ffe9d2 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.162955 Oct 18 13:26:57.992710 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1146/2438] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:57 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:58.028017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-caafeb54-4fee-47d7-9618-80cd7b343efd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:58.029713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-caafeb54-4fee-47d7-9618-80cd7b343efd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:58.043095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caafeb54-4fee-47d7-9618-80cd7b343efd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.045456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caafeb54-4fee-47d7-9618-80cd7b343efd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.046101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caafeb54-4fee-47d7-9618-80cd7b343efd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.046855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caafeb54-4fee-47d7-9618-80cd7b343efd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.047405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caafeb54-4fee-47d7-9618-80cd7b343efd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.053172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caafeb54-4fee-47d7-9618-80cd7b343efd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.082997 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3b89bbc8-9d3e-434a-8a45-d97d0044ae19 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 204 len: 0 microversion: 2.91 time: 0.189758 Oct 18 13:26:58.083964 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1293/2439] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:26:57 2022] DELETE /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:26:58.090338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c110eefb-cf71-4104-88a5-5c92d43cbdfe tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60efeb280>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:58.099690 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-caafeb54-4fee-47d7-9618-80cd7b343efd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-caafeb54-4fee-47d7-9618-80cd7b343efd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add HTTP/1.1 Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:26:58.108712 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:26:58.110311 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:26:58.110311 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:26:58.110311 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:26:58.110311 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:26:58.110311 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:26:58.110311 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:26:58.110311 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:26:58.110311 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:26:58.110311 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:26:58.110311 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:26:58.110311 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:26:58.110311 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '3a52dba4-8897-442b-b15f-4d3185f02add'} Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:58.111145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:26:58.112465 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:26:58.115599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-caafeb54-4fee-47d7-9618-80cd7b343efd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:58.117165 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-caafeb54-4fee-47d7-9618-80cd7b343efd tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 404 len: 111 microversion: 2.1 time: 0.099195 Oct 18 13:26:58.117789 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1147/2440] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:57 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:26:58.154240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-c635cb0e-fc5b-4315-a519-ce6338be3e00 req-8e123323-9409-4e43-b34d-95f10030a949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290", "tag": "6baad0b7-1db5-475b-b6de-51f6616dc237"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:58.191755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c635cb0e-fc5b-4315-a519-ce6338be3e00 req-8e123323-9409-4e43-b34d-95f10030a949 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.192233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c635cb0e-fc5b-4315-a519-ce6338be3e00 req-8e123323-9409-4e43-b34d-95f10030a949 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.192663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c635cb0e-fc5b-4315-a519-ce6338be3e00 req-8e123323-9409-4e43-b34d-95f10030a949 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.240315 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-c635cb0e-fc5b-4315-a519-ce6338be3e00 req-8e123323-9409-4e43-b34d-95f10030a949 service nova] Creating event network-changed:6baad0b7-1db5-475b-b6de-51f6616dc237 for instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 on n-h1-858384-13 Oct 18 13:26:58.249797 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-c635cb0e-fc5b-4315-a519-ce6338be3e00 req-8e123323-9409-4e43-b34d-95f10030a949 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102452 Oct 18 13:26:58.253413 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1148/2441] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:26:58.271054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-57045533-a25a-4b0c-a42e-bde7a894991a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:58.272098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-57045533-a25a-4b0c-a42e-bde7a894991a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:58.290613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57045533-a25a-4b0c-a42e-bde7a894991a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.291687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57045533-a25a-4b0c-a42e-bde7a894991a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.292313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57045533-a25a-4b0c-a42e-bde7a894991a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.294638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57045533-a25a-4b0c-a42e-bde7a894991a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.295444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57045533-a25a-4b0c-a42e-bde7a894991a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.296036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57045533-a25a-4b0c-a42e-bde7a894991a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.598665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG neutronclient.v2_0.client [None req-c110eefb-cf71-4104-88a5-5c92d43cbdfe tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 129ad497-f01f-483e-b3d2-1d74291ab2b6 in use.", "detail": ""}} {{(pid=120611) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:26:58.599354 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-c110eefb-cf71-4104-88a5-5c92d43cbdfe tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Security Group 129ad497-f01f-483e-b3d2-1d74291ab2b6 in use. Oct 18 13:26:58.599354 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-000bfb82-8f1d-4812-90ed-65de76f6a3e1'] Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c110eefb-cf71-4104-88a5-5c92d43cbdfe tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/os-security-groups/129ad497-f01f-483e-b3d2-1d74291ab2b6 HTTP/1.1 Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:26:58.602506 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:26:58.603676 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:26:58.603676 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:58.603676 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:26:58.603676 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:26:58.603676 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:26:58.603676 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:26:58.603676 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:26:58.603676 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:26:58.603676 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:26:58.603676 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:26:58.603676 n-d-858384-13 devstack@n-api.service[120611]: exception: Security Group 129ad497-f01f-483e-b3d2-1d74291ab2b6 in use. Oct 18 13:26:58.603676 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-000bfb82-8f1d-4812-90ed-65de76f6a3e1'] Oct 18 13:26:58.603676 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '129ad497-f01f-483e-b3d2-1d74291ab2b6'} Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:58.607236 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 129ad497-f01f-483e-b3d2-1d74291ab2b6 in use. Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-000bfb82-8f1d-4812-90ed-65de76f6a3e1'] Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 129ad497-f01f-483e-b3d2-1d74291ab2b6 in use. Oct 18 13:26:58.608793 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-000bfb82-8f1d-4812-90ed-65de76f6a3e1'] Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 129ad497-f01f-483e-b3d2-1d74291ab2b6 in use. Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-000bfb82-8f1d-4812-90ed-65de76f6a3e1'] Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:26:58.610213 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:26:58.611612 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:26:58.611612 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:26:58.611612 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:26:58.611612 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 129ad497-f01f-483e-b3d2-1d74291ab2b6 in use. Oct 18 13:26:58.611612 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-000bfb82-8f1d-4812-90ed-65de76f6a3e1'] Oct 18 13:26:58.611612 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:26:58.611612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c110eefb-cf71-4104-88a5-5c92d43cbdfe tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 400 to user: Security Group 129ad497-f01f-483e-b3d2-1d74291ab2b6 in use. Oct 18 13:26:58.611612 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-000bfb82-8f1d-4812-90ed-65de76f6a3e1'] {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:26:58.611612 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c110eefb-cf71-4104-88a5-5c92d43cbdfe tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/129ad497-f01f-483e-b3d2-1d74291ab2b6" status: 400 len: 185 microversion: 2.1 time: 0.517954 Oct 18 13:26:58.611612 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1294/2442] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:26:58 2022] DELETE /compute/v2.1/os-security-groups/129ad497-f01f-483e-b3d2-1d74291ab2b6 => generated 185 bytes in 519 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:26:58.613857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3907f40b-fff5-4c0d-9990-8357700d2bdd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:58.620076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3907f40b-fff5-4c0d-9990-8357700d2bdd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:58.652910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3907f40b-fff5-4c0d-9990-8357700d2bdd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.653428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3907f40b-fff5-4c0d-9990-8357700d2bdd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.657602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3907f40b-fff5-4c0d-9990-8357700d2bdd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.660283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3907f40b-fff5-4c0d-9990-8357700d2bdd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.662222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3907f40b-fff5-4c0d-9990-8357700d2bdd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.662697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3907f40b-fff5-4c0d-9990-8357700d2bdd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.695884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-57045533-a25a-4b0c-a42e-bde7a894991a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:58.704097 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-57045533-a25a-4b0c-a42e-bde7a894991a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.449399 Oct 18 13:26:58.704897 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1149/2443] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:58 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:26:58.714697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-410832564", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "b5cc8010-ea63-4e1f-9434-bf4391452206"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:58.782949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3907f40b-fff5-4c0d-9990-8357700d2bdd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:58.799015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3907f40b-fff5-4c0d-9990-8357700d2bdd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:58.808232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] validate_networks() for [('b5cc8010-ea63-4e1f-9434-bf4391452206', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:26:58.812099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3907f40b-fff5-4c0d-9990-8357700d2bdd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:58.827514 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3907f40b-fff5-4c0d-9990-8357700d2bdd tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1537 microversion: 2.91 time: 0.221417 Oct 18 13:26:58.828019 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1295/2444] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:58 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1537 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:58.843366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-da40541f-8519-4bba-b67b-3c4d040457d7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:26:58.846147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-da40541f-8519-4bba-b67b-3c4d040457d7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:58.863601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da40541f-8519-4bba-b67b-3c4d040457d7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.865609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da40541f-8519-4bba-b67b-3c4d040457d7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.866691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da40541f-8519-4bba-b67b-3c4d040457d7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:58.870302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da40541f-8519-4bba-b67b-3c4d040457d7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:58.871126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da40541f-8519-4bba-b67b-3c4d040457d7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:58.885725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da40541f-8519-4bba-b67b-3c4d040457d7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.048932 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-da40541f-8519-4bba-b67b-3c4d040457d7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290/action" status: 202 len: 0 microversion: 2.1 time: 0.219339 Oct 18 13:26:59.066571 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1296/2445] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:26:58 2022] POST /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:26:59.091298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1bc7975f-6011-450f-8ae6-2664e9878dfc tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:59.108915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1bc7975f-6011-450f-8ae6-2664e9878dfc tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:59.128751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bc7975f-6011-450f-8ae6-2664e9878dfc tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.129284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bc7975f-6011-450f-8ae6-2664e9878dfc tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.129738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bc7975f-6011-450f-8ae6-2664e9878dfc tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.142115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bc7975f-6011-450f-8ae6-2664e9878dfc tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.142651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bc7975f-6011-450f-8ae6-2664e9878dfc tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.143080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bc7975f-6011-450f-8ae6-2664e9878dfc tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.207089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:26:59.681558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1bc7975f-6011-450f-8ae6-2664e9878dfc tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:59.696133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1bc7975f-6011-450f-8ae6-2664e9878dfc tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:59.701302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1bc7975f-6011-450f-8ae6-2664e9878dfc tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:26:59.704689 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1bc7975f-6011-450f-8ae6-2664e9878dfc tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.635975 Oct 18 13:26:59.710833 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1297/2446] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:26:59 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:26:59.734761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e085bce6-17da-4bbc-8e95-4e5d46b7cc91 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:26:59.735980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e085bce6-17da-4bbc-8e95-4e5d46b7cc91 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:26:59.745095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e085bce6-17da-4bbc-8e95-4e5d46b7cc91 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.772782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e085bce6-17da-4bbc-8e95-4e5d46b7cc91 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.772782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e085bce6-17da-4bbc-8e95-4e5d46b7cc91 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.772782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e085bce6-17da-4bbc-8e95-4e5d46b7cc91 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.772782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e085bce6-17da-4bbc-8e95-4e5d46b7cc91 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.776077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e085bce6-17da-4bbc-8e95-4e5d46b7cc91 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.911305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:26:59.912628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:26:59.913698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:26:59.914508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:26:59.914948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:26:59.926956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.927467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.927906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.928661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:26:59.929644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:26:59.930141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:26:59.956439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:26:59.960864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for user c0a722d1dc7c4e05b8cc8dc98b5cb619 and project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:26:59.978574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:26:59.981131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:27:00.032644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e085bce6-17da-4bbc-8e95-4e5d46b7cc91 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:00.042618 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e085bce6-17da-4bbc-8e95-4e5d46b7cc91 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.316103 Oct 18 13:27:00.043210 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1298/2447] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:26:59 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:00.066973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2a60c026-c9fa-4bff-890e-4e028ad54c6a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:00.067727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2a60c026-c9fa-4bff-890e-4e028ad54c6a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:00.068907 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ec87c0c9-f0fa-4d10-9cbc-3fe7e44871b5 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.363122 Oct 18 13:27:00.070820 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1150/2448] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:26:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:27:00.076527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9fb8a226-523e-405d-b667-9389b642e8e4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:00.077886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9fb8a226-523e-405d-b667-9389b642e8e4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:00.083090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a60c026-c9fa-4bff-890e-4e028ad54c6a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.089454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a60c026-c9fa-4bff-890e-4e028ad54c6a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.090706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a60c026-c9fa-4bff-890e-4e028ad54c6a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.091958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a60c026-c9fa-4bff-890e-4e028ad54c6a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.092690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a60c026-c9fa-4bff-890e-4e028ad54c6a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.093475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a60c026-c9fa-4bff-890e-4e028ad54c6a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.094675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fb8a226-523e-405d-b667-9389b642e8e4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.095189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fb8a226-523e-405d-b667-9389b642e8e4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.097340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fb8a226-523e-405d-b667-9389b642e8e4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.098200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fb8a226-523e-405d-b667-9389b642e8e4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.103177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fb8a226-523e-405d-b667-9389b642e8e4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.104810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fb8a226-523e-405d-b667-9389b642e8e4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.198157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a60c026-c9fa-4bff-890e-4e028ad54c6a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:00.213008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a60c026-c9fa-4bff-890e-4e028ad54c6a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:00.215361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a60c026-c9fa-4bff-890e-4e028ad54c6a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:00.221058 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2a60c026-c9fa-4bff-890e-4e028ad54c6a tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.167047 Oct 18 13:27:00.222237 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1299/2449] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:00 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:00.227556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:00.228377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:00.236629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.237855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.238535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.239465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.240124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.240751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.299604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.300693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.301608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.304295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lazy-loading 'fault' on Instance uuid 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:00.379140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:00.392582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:00.395105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498b9c14314948998ec1502e9cfe95ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135f8cfe9940417b9518dcceb6f6f78f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:00.401975 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca1333a8-a953-49dc-8b3f-57290d7ce4ec tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 200 len: 1542 microversion: 2.91 time: 0.178265 Oct 18 13:27:00.403020 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1300/2450] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:00 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 1542 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:00.407897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-02f4a9d1-326b-416c-9044-dd354b2e51d9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:00.408677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-02f4a9d1-326b-416c-9044-dd354b2e51d9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:00.472082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-02f4a9d1-326b-416c-9044-dd354b2e51d9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:00.480016 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-02f4a9d1-326b-416c-9044-dd354b2e51d9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1214 microversion: 2.1 time: 0.075602 Oct 18 13:27:00.481249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9fb8a226-523e-405d-b667-9389b642e8e4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:00.490350 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1301/2451] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:00 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:00.490961 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9fb8a226-523e-405d-b667-9389b642e8e4 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1574 microversion: 2.1 time: 0.418551 Oct 18 13:27:00.505772 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1151/2452] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:00 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1574 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:00.740064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1781f6f3-fc9f-4cff-a45a-d0a8094d5676 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:00.740320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1781f6f3-fc9f-4cff-a45a-d0a8094d5676 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:00.751678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1781f6f3-fc9f-4cff-a45a-d0a8094d5676 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.760016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1781f6f3-fc9f-4cff-a45a-d0a8094d5676 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.760555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1781f6f3-fc9f-4cff-a45a-d0a8094d5676 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:00.761361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1781f6f3-fc9f-4cff-a45a-d0a8094d5676 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:00.762454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1781f6f3-fc9f-4cff-a45a-d0a8094d5676 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:00.762454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1781f6f3-fc9f-4cff-a45a-d0a8094d5676 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.026463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1781f6f3-fc9f-4cff-a45a-d0a8094d5676 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:01.037765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1781f6f3-fc9f-4cff-a45a-d0a8094d5676 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:01.040380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1781f6f3-fc9f-4cff-a45a-d0a8094d5676 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:01.042573 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1781f6f3-fc9f-4cff-a45a-d0a8094d5676 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.306783 Oct 18 13:27:01.043649 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1302/2453] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:00 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:01.251671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31ad84d9-49c7-4416-8ca4-e16b074e40fb tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:01.252261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-31ad84d9-49c7-4416-8ca4-e16b074e40fb tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:01.259911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31ad84d9-49c7-4416-8ca4-e16b074e40fb tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.260453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31ad84d9-49c7-4416-8ca4-e16b074e40fb tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.260884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31ad84d9-49c7-4416-8ca4-e16b074e40fb tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.261663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31ad84d9-49c7-4416-8ca4-e16b074e40fb tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.262114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31ad84d9-49c7-4416-8ca4-e16b074e40fb tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.262531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31ad84d9-49c7-4416-8ca4-e16b074e40fb tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.283894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:01.335249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31ad84d9-49c7-4416-8ca4-e16b074e40fb tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:01.347716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31ad84d9-49c7-4416-8ca4-e16b074e40fb tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:01.349155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31ad84d9-49c7-4416-8ca4-e16b074e40fb tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:01.355116 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31ad84d9-49c7-4416-8ca4-e16b074e40fb tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.107355 Oct 18 13:27:01.355682 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1152/2454] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:01 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:01.432045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7879b020-c53d-4ae7-af02-581ab1d56611 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:01.445487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7879b020-c53d-4ae7-af02-581ab1d56611 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] [instance: 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:01.452664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7879b020-c53d-4ae7-af02-581ab1d56611 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.453162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7879b020-c53d-4ae7-af02-581ab1d56611 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.454047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7879b020-c53d-4ae7-af02-581ab1d56611 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.455214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7879b020-c53d-4ae7-af02-581ab1d56611 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.455879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7879b020-c53d-4ae7-af02-581ab1d56611 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.456376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7879b020-c53d-4ae7-af02-581ab1d56611 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.472660 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-7879b020-c53d-4ae7-af02-581ab1d56611 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] HTTP exception thrown: Instance 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 could not be found. Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7879b020-c53d-4ae7-af02-581ab1d56611 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Request method failure captured: Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 HTTP/1.1 Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqjhTzwdMoF6lX5yeSgj9mqQUAS920aYHeGVUblk8bB3m0c9wW2tZdUf5R8gKkIx-80j5OpejelMj0qcyCBeJUx1ct1xU_O_4ntMs1wAWk7l2h5-iDp8BVqLMeergx0RVogeCXMbDm1TbDmOQo3acz-h8JuY6i68qAso_V4q4HvdYag Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.91 Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 135f8cfe9940417b9518dcceb6f6f78f Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1348469062 Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:27:01.474499 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:27:01.476620 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/135f8cfe9940417b9518dcceb6f6f78f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/135f8cfe9940417b9518dcceb6f6f78f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/135f8cfe9940417b9518dcceb6f6f78f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_135f8cfe9940417b9518dcceb6f6f78f"}]}] Oct 18 13:27:01.476620 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1348469062 Oct 18 13:27:01.476620 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 135f8cfe9940417b9518dcceb6f6f78f Oct 18 13:27:01.476620 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1348469062 Oct 18 13:27:01.476620 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-UnshelveToHostMultiNodesTest-1348469062-project Oct 18 13:27:01.476620 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:27:01.476620 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:27:01.476620 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 498b9c14314948998ec1502e9cfe95ce Oct 18 13:27:01.476620 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1348469062-project Oct 18 13:27:01.476620 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:27:01.476620 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 could not be found. Oct 18 13:27:01.476620 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '3244b4cf-2003-43d0-9a4e-ca7f501fa0f7'} Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 could not be found. Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:01.477509 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 could not be found. Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 could not be found. Oct 18 13:27:01.478975 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:01.482615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7879b020-c53d-4ae7-af02-581ab1d56611 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] Returning 404 to user: Instance 3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:01.483887 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7879b020-c53d-4ae7-af02-581ab1d56611 tempest-UnshelveToHostMultiNodesTest-1348469062 tempest-UnshelveToHostMultiNodesTest-1348469062-project] 10.222.0.40 "GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7" status: 404 len: 111 microversion: 2.91 time: 0.057956 Oct 18 13:27:01.484839 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1303/2455] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:01 2022] GET /compute/v2.1/servers/3244b4cf-2003-43d0-9a4e-ca7f501fa0f7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:27:01.505639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f9f33611-6922-4579-856b-d48a10c5722c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:01.506301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f9f33611-6922-4579-856b-d48a10c5722c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:01.515628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9f33611-6922-4579-856b-d48a10c5722c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.516401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9f33611-6922-4579-856b-d48a10c5722c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.516545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-67741d98-465d-446d-aa4f-e57b5419d10e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:01.517103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-67741d98-465d-446d-aa4f-e57b5419d10e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:01.517476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9f33611-6922-4579-856b-d48a10c5722c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.518425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9f33611-6922-4579-856b-d48a10c5722c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.519064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9f33611-6922-4579-856b-d48a10c5722c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.519691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9f33611-6922-4579-856b-d48a10c5722c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.527515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67741d98-465d-446d-aa4f-e57b5419d10e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.528646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67741d98-465d-446d-aa4f-e57b5419d10e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.529203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67741d98-465d-446d-aa4f-e57b5419d10e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.530105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67741d98-465d-446d-aa4f-e57b5419d10e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:01.531027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67741d98-465d-446d-aa4f-e57b5419d10e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:01.531706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67741d98-465d-446d-aa4f-e57b5419d10e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:01.665939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f9f33611-6922-4579-856b-d48a10c5722c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:01.680659 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f9f33611-6922-4579-856b-d48a10c5722c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1274 microversion: 2.1 time: 0.176390 Oct 18 13:27:01.694141 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1153/2456] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:01 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:01.717733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-67741d98-465d-446d-aa4f-e57b5419d10e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:01.728977 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-67741d98-465d-446d-aa4f-e57b5419d10e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1574 microversion: 2.1 time: 0.217704 Oct 18 13:27:01.730428 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1304/2457] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:01 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:02.069900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2022e247-57f0-4759-afb9-550b93ef63a1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:02.070907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2022e247-57f0-4759-afb9-550b93ef63a1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:02.079112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2022e247-57f0-4759-afb9-550b93ef63a1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.079989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2022e247-57f0-4759-afb9-550b93ef63a1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.081745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2022e247-57f0-4759-afb9-550b93ef63a1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.082711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2022e247-57f0-4759-afb9-550b93ef63a1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.083347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2022e247-57f0-4759-afb9-550b93ef63a1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.083946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2022e247-57f0-4759-afb9-550b93ef63a1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.384858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9029c785-7d73-4448-b65f-7157a2f18758 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:02.386094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9029c785-7d73-4448-b65f-7157a2f18758 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:02.395165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9029c785-7d73-4448-b65f-7157a2f18758 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.396260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9029c785-7d73-4448-b65f-7157a2f18758 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.397096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9029c785-7d73-4448-b65f-7157a2f18758 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.399875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9029c785-7d73-4448-b65f-7157a2f18758 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.400829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9029c785-7d73-4448-b65f-7157a2f18758 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.401561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9029c785-7d73-4448-b65f-7157a2f18758 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.474366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9029c785-7d73-4448-b65f-7157a2f18758 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:02.483966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9029c785-7d73-4448-b65f-7157a2f18758 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:02.485513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9029c785-7d73-4448-b65f-7157a2f18758 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:02.490850 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9029c785-7d73-4448-b65f-7157a2f18758 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.110926 Oct 18 13:27:02.491568 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1305/2458] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:02 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:27:02.515628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2022e247-57f0-4759-afb9-550b93ef63a1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:02.528412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2022e247-57f0-4759-afb9-550b93ef63a1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:02.530885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2022e247-57f0-4759-afb9-550b93ef63a1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:02.532516 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2022e247-57f0-4759-afb9-550b93ef63a1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.466736 Oct 18 13:27:02.551428 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1154/2459] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:02 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:02.708221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-77cd171d-6fee-4613-8a70-3ecbdc816c04 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:02.709575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-77cd171d-6fee-4613-8a70-3ecbdc816c04 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:02.717085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77cd171d-6fee-4613-8a70-3ecbdc816c04 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.717996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77cd171d-6fee-4613-8a70-3ecbdc816c04 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.719452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77cd171d-6fee-4613-8a70-3ecbdc816c04 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.720630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77cd171d-6fee-4613-8a70-3ecbdc816c04 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.721411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77cd171d-6fee-4613-8a70-3ecbdc816c04 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.722133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77cd171d-6fee-4613-8a70-3ecbdc816c04 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.763790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e3800ddd-29b2-49a3-86fd-18d7442ee1a6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:02.777543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e3800ddd-29b2-49a3-86fd-18d7442ee1a6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:02.818359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3800ddd-29b2-49a3-86fd-18d7442ee1a6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.820971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3800ddd-29b2-49a3-86fd-18d7442ee1a6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.823694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3800ddd-29b2-49a3-86fd-18d7442ee1a6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:02.825749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3800ddd-29b2-49a3-86fd-18d7442ee1a6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:02.826999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3800ddd-29b2-49a3-86fd-18d7442ee1a6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:02.830440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3800ddd-29b2-49a3-86fd-18d7442ee1a6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.013976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-77cd171d-6fee-4613-8a70-3ecbdc816c04 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:03.023532 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-77cd171d-6fee-4613-8a70-3ecbdc816c04 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1314 microversion: 2.1 time: 0.320648 Oct 18 13:27:03.038317 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1306/2460] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:02 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:03.205500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e3800ddd-29b2-49a3-86fd-18d7442ee1a6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:03.220362 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e3800ddd-29b2-49a3-86fd-18d7442ee1a6 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1572 microversion: 2.1 time: 0.469563 Oct 18 13:27:03.237512 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1155/2461] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:02 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1572 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:03.251484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d445f53e-b214-45fb-b0bb-0a199e38cd57 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1208670156"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:03.252030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d445f53e-b214-45fb-b0bb-0a199e38cd57 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:03.259881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d445f53e-b214-45fb-b0bb-0a199e38cd57 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.260592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d445f53e-b214-45fb-b0bb-0a199e38cd57 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.261599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d445f53e-b214-45fb-b0bb-0a199e38cd57 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.262710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d445f53e-b214-45fb-b0bb-0a199e38cd57 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.263443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d445f53e-b214-45fb-b0bb-0a199e38cd57 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.264021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d445f53e-b214-45fb-b0bb-0a199e38cd57 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.466095 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.network.security_group_api [None req-d445f53e-b214-45fb-b0bb-0a199e38cd57 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Adding security group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca to port 6baad0b7-1db5-475b-b6de-51f6616dc237 Oct 18 13:27:03.520750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-21ca535d-5486-4d5a-acd9-32baba4b05cf tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:03.521391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-21ca535d-5486-4d5a-acd9-32baba4b05cf tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:03.532162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21ca535d-5486-4d5a-acd9-32baba4b05cf tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.534546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21ca535d-5486-4d5a-acd9-32baba4b05cf tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.536927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21ca535d-5486-4d5a-acd9-32baba4b05cf tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.538014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21ca535d-5486-4d5a-acd9-32baba4b05cf tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.539975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21ca535d-5486-4d5a-acd9-32baba4b05cf tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.541717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21ca535d-5486-4d5a-acd9-32baba4b05cf tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.689540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-21ca535d-5486-4d5a-acd9-32baba4b05cf tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:03.699686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-21ca535d-5486-4d5a-acd9-32baba4b05cf tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:03.701396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-21ca535d-5486-4d5a-acd9-32baba4b05cf tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:03.707697 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-21ca535d-5486-4d5a-acd9-32baba4b05cf tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.191257 Oct 18 13:27:03.708598 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1156/2462] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:03 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:27:03.714700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c83961f2-e8ba-4083-8d32-3e66f486e02f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:03.715539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c83961f2-e8ba-4083-8d32-3e66f486e02f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:03.734623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c83961f2-e8ba-4083-8d32-3e66f486e02f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.735280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c83961f2-e8ba-4083-8d32-3e66f486e02f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.735880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c83961f2-e8ba-4083-8d32-3e66f486e02f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:03.737680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c83961f2-e8ba-4083-8d32-3e66f486e02f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:03.740498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c83961f2-e8ba-4083-8d32-3e66f486e02f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:03.742027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c83961f2-e8ba-4083-8d32-3e66f486e02f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.005637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c83961f2-e8ba-4083-8d32-3e66f486e02f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:04.036873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c83961f2-e8ba-4083-8d32-3e66f486e02f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:04.042517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c83961f2-e8ba-4083-8d32-3e66f486e02f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:04.044298 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c83961f2-e8ba-4083-8d32-3e66f486e02f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.334288 Oct 18 13:27:04.046635 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1157/2463] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:03 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:04.051559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-449baafd-926c-4985-aec0-9340e8f4244e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:04.052673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-449baafd-926c-4985-aec0-9340e8f4244e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:04.069816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-449baafd-926c-4985-aec0-9340e8f4244e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.079408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-449baafd-926c-4985-aec0-9340e8f4244e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.081825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-449baafd-926c-4985-aec0-9340e8f4244e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.083022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-449baafd-926c-4985-aec0-9340e8f4244e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.094015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-449baafd-926c-4985-aec0-9340e8f4244e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.094829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-449baafd-926c-4985-aec0-9340e8f4244e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.340013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-449baafd-926c-4985-aec0-9340e8f4244e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:04.352633 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-449baafd-926c-4985-aec0-9340e8f4244e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1314 microversion: 2.1 time: 0.304405 Oct 18 13:27:04.353687 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1158/2464] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:04 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:04.405736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-508110de-f0fa-43f8-a6c2-00869b594ee2 req-df38ae64-2288-4967-a470-d30284ed92e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011b3a1e-b73c-4005-b92f-ece6f98fee72", "tag": "5a291329-93b2-4506-801a-ab24293cd321"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:04.426254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-508110de-f0fa-43f8-a6c2-00869b594ee2 req-df38ae64-2288-4967-a470-d30284ed92e5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.427222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-508110de-f0fa-43f8-a6c2-00869b594ee2 req-df38ae64-2288-4967-a470-d30284ed92e5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.429692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-508110de-f0fa-43f8-a6c2-00869b594ee2 req-df38ae64-2288-4967-a470-d30284ed92e5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.468573 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-508110de-f0fa-43f8-a6c2-00869b594ee2 req-df38ae64-2288-4967-a470-d30284ed92e5 service nova] Creating event network-changed:5a291329-93b2-4506-801a-ab24293cd321 for instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 on n-h2-858384-13 Oct 18 13:27:04.486096 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-508110de-f0fa-43f8-a6c2-00869b594ee2 req-df38ae64-2288-4967-a470-d30284ed92e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082870 Oct 18 13:27:04.486420 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1159/2465] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 18 13:27:04.579990 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d445f53e-b214-45fb-b0bb-0a199e38cd57 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290/action" status: 202 len: 0 microversion: 2.1 time: 1.333544 Oct 18 13:27:04.582892 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1307/2466] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:03 2022] POST /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290/action => generated 0 bytes in 1337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:04.592628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9199230a-b454-41a5-a504-041872ca95c7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60f7a8670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:04.609935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-43e9ca78-0524-4b2d-a14a-46af85964c51 req-5ea65b74-a69b-467d-9b47-8f91b05310ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290", "tag": "6baad0b7-1db5-475b-b6de-51f6616dc237"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:04.629162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-43e9ca78-0524-4b2d-a14a-46af85964c51 req-5ea65b74-a69b-467d-9b47-8f91b05310ea service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.629658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-43e9ca78-0524-4b2d-a14a-46af85964c51 req-5ea65b74-a69b-467d-9b47-8f91b05310ea service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.630081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-43e9ca78-0524-4b2d-a14a-46af85964c51 req-5ea65b74-a69b-467d-9b47-8f91b05310ea service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.653740 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-43e9ca78-0524-4b2d-a14a-46af85964c51 req-5ea65b74-a69b-467d-9b47-8f91b05310ea service nova] Creating event network-changed:6baad0b7-1db5-475b-b6de-51f6616dc237 for instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 on n-h1-858384-13 Oct 18 13:27:04.678095 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-43e9ca78-0524-4b2d-a14a-46af85964c51 req-5ea65b74-a69b-467d-9b47-8f91b05310ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072745 Oct 18 13:27:04.687755 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1308/2467] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:27:04.738855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa9eedd4-c1e5-4e0f-9ad4-93738115b387 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:04.740545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fa9eedd4-c1e5-4e0f-9ad4-93738115b387 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:04.758642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa9eedd4-c1e5-4e0f-9ad4-93738115b387 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.759489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa9eedd4-c1e5-4e0f-9ad4-93738115b387 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.761371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa9eedd4-c1e5-4e0f-9ad4-93738115b387 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.762346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa9eedd4-c1e5-4e0f-9ad4-93738115b387 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:04.763058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa9eedd4-c1e5-4e0f-9ad4-93738115b387 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:04.763734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa9eedd4-c1e5-4e0f-9ad4-93738115b387 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:04.892031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fa9eedd4-c1e5-4e0f-9ad4-93738115b387 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:04.917131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fa9eedd4-c1e5-4e0f-9ad4-93738115b387 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:04.919519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fa9eedd4-c1e5-4e0f-9ad4-93738115b387 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:04.927610 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fa9eedd4-c1e5-4e0f-9ad4-93738115b387 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.193072 Oct 18 13:27:04.929368 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1309/2468] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:04 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:27:05.075649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9563b1f2-a0e0-4e63-a22f-94d47b197b0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:05.078252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9563b1f2-a0e0-4e63-a22f-94d47b197b0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:05.089957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-9199230a-b454-41a5-a504-041872ca95c7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca in use.", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:27:05.090650 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-9199230a-b454-41a5-a504-041872ca95c7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Security Group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca in use. Oct 18 13:27:05.090650 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-db9c9053-7dc5-45d9-a033-9c7e49c87926'] Oct 18 13:27:05.096899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9563b1f2-a0e0-4e63-a22f-94d47b197b0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9199230a-b454-41a5-a504-041872ca95c7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-security-groups/a41d1be5-f608-48c6-8ac4-a8a6d08ccdca HTTP/1.1 Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:27:05.099108 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:27:05.100363 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:27:05.100363 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:05.100363 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:05.100363 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:05.100363 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:05.100363 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:27:05.100363 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:27:05.100363 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:27:05.100363 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:05.100363 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:27:05.100363 n-d-858384-13 devstack@n-api.service[120612]: exception: Security Group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca in use. Oct 18 13:27:05.100363 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-db9c9053-7dc5-45d9-a033-9c7e49c87926'] Oct 18 13:27:05.100363 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'a41d1be5-f608-48c6-8ac4-a8a6d08ccdca'} Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:05.103978 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca in use. Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db9c9053-7dc5-45d9-a033-9c7e49c87926'] Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca in use. Oct 18 13:27:05.106792 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db9c9053-7dc5-45d9-a033-9c7e49c87926'] Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca in use. Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db9c9053-7dc5-45d9-a033-9c7e49c87926'] Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:05.109842 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:05.114089 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:05.114089 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:05.114089 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:05.114089 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca in use. Oct 18 13:27:05.114089 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db9c9053-7dc5-45d9-a033-9c7e49c87926'] Oct 18 13:27:05.114089 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:05.114089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9199230a-b454-41a5-a504-041872ca95c7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 400 to user: Security Group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca in use. Oct 18 13:27:05.114089 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-db9c9053-7dc5-45d9-a033-9c7e49c87926'] {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:05.114089 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9199230a-b454-41a5-a504-041872ca95c7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/a41d1be5-f608-48c6-8ac4-a8a6d08ccdca" status: 400 len: 185 microversion: 2.1 time: 0.513639 Oct 18 13:27:05.115429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9563b1f2-a0e0-4e63-a22f-94d47b197b0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.115591 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1160/2469] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:04 2022] DELETE /compute/v2.1/os-security-groups/a41d1be5-f608-48c6-8ac4-a8a6d08ccdca => generated 185 bytes in 517 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:27:05.115741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9563b1f2-a0e0-4e63-a22f-94d47b197b0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.115741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9563b1f2-a0e0-4e63-a22f-94d47b197b0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.115741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9563b1f2-a0e0-4e63-a22f-94d47b197b0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.115741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9563b1f2-a0e0-4e63-a22f-94d47b197b0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.119944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-844be7b4-50d4-4572-a1a3-23abe7570815 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:05.120645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-844be7b4-50d4-4572-a1a3-23abe7570815 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:05.162325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-844be7b4-50d4-4572-a1a3-23abe7570815 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.162822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-844be7b4-50d4-4572-a1a3-23abe7570815 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.163298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-844be7b4-50d4-4572-a1a3-23abe7570815 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.173919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-844be7b4-50d4-4572-a1a3-23abe7570815 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.177473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-844be7b4-50d4-4572-a1a3-23abe7570815 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.180499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-844be7b4-50d4-4572-a1a3-23abe7570815 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.262319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-844be7b4-50d4-4572-a1a3-23abe7570815 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:27:05.446228 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-844be7b4-50d4-4572-a1a3-23abe7570815 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 204 len: 0 microversion: 2.1 time: 0.339018 Oct 18 13:27:05.447339 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1161/2470] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:27:05 2022] DELETE /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:27:05.456046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d34bb76b-db2c-4766-aa03-a557dfbd7d44 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:05.457031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d34bb76b-db2c-4766-aa03-a557dfbd7d44 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:05.472175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d34bb76b-db2c-4766-aa03-a557dfbd7d44 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.473055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d34bb76b-db2c-4766-aa03-a557dfbd7d44 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.473533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d34bb76b-db2c-4766-aa03-a557dfbd7d44 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.474286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d34bb76b-db2c-4766-aa03-a557dfbd7d44 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.474825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d34bb76b-db2c-4766-aa03-a557dfbd7d44 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.484589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d34bb76b-db2c-4766-aa03-a557dfbd7d44 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.858520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d34bb76b-db2c-4766-aa03-a557dfbd7d44 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:05.863791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9563b1f2-a0e0-4e63-a22f-94d47b197b0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:05.866613 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d34bb76b-db2c-4766-aa03-a557dfbd7d44 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1314 microversion: 2.1 time: 0.417555 Oct 18 13:27:05.869900 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1162/2471] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:05 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:05.881376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9563b1f2-a0e0-4e63-a22f-94d47b197b0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:05.881376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9563b1f2-a0e0-4e63-a22f-94d47b197b0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:05.881376 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9563b1f2-a0e0-4e63-a22f-94d47b197b0c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.811300 Oct 18 13:27:05.890691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea86ea83-4a25-4ac3-871c-385fc7934b08 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:05.891480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ea86ea83-4a25-4ac3-871c-385fc7934b08 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:05.901158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea86ea83-4a25-4ac3-871c-385fc7934b08 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.903027 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1310/2472] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:05 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:27:05.905891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea86ea83-4a25-4ac3-871c-385fc7934b08 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.906564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea86ea83-4a25-4ac3-871c-385fc7934b08 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:05.907474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea86ea83-4a25-4ac3-871c-385fc7934b08 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:05.908034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea86ea83-4a25-4ac3-871c-385fc7934b08 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:05.908533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea86ea83-4a25-4ac3-871c-385fc7934b08 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.135092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13c2192b-9453-41b5-8be7-be53bf0aa8ec tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:06.139990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13c2192b-9453-41b5-8be7-be53bf0aa8ec tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.140482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13c2192b-9453-41b5-8be7-be53bf0aa8ec tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.140918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13c2192b-9453-41b5-8be7-be53bf0aa8ec tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.141691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13c2192b-9453-41b5-8be7-be53bf0aa8ec tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.142148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13c2192b-9453-41b5-8be7-be53bf0aa8ec tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.142742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13c2192b-9453-41b5-8be7-be53bf0aa8ec tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.177515 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13c2192b-9453-41b5-8be7-be53bf0aa8ec tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.272788 Oct 18 13:27:06.178828 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1311/2473] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:27:05 2022] GET /compute/v2.1/os-services => generated 949 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:06.190223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6b7a2c53-0cb0-432a-83cb-990ea2fa35f1 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:06.190843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6b7a2c53-0cb0-432a-83cb-990ea2fa35f1 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:06.206722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b7a2c53-0cb0-432a-83cb-990ea2fa35f1 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.207217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b7a2c53-0cb0-432a-83cb-990ea2fa35f1 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.214765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ea86ea83-4a25-4ac3-871c-385fc7934b08 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:06.219040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b7a2c53-0cb0-432a-83cb-990ea2fa35f1 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.219785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b7a2c53-0cb0-432a-83cb-990ea2fa35f1 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.220254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b7a2c53-0cb0-432a-83cb-990ea2fa35f1 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.220673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b7a2c53-0cb0-432a-83cb-990ea2fa35f1 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.227388 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ea86ea83-4a25-4ac3-871c-385fc7934b08 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1647 microversion: 2.1 time: 0.342398 Oct 18 13:27:06.228095 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1163/2474] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:05 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1647 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:06.250245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad238b83-0ba1-464f-a37b-ff8d638cf375 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:06.261381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad238b83-0ba1-464f-a37b-ff8d638cf375 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.262273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad238b83-0ba1-464f-a37b-ff8d638cf375 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.263072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad238b83-0ba1-464f-a37b-ff8d638cf375 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.264027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad238b83-0ba1-464f-a37b-ff8d638cf375 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.264697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad238b83-0ba1-464f-a37b-ff8d638cf375 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.265371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad238b83-0ba1-464f-a37b-ff8d638cf375 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.298562 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad238b83-0ba1-464f-a37b-ff8d638cf375 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.069011 Oct 18 13:27:06.299626 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1164/2475] 10.222.0.40 () {58 vars in 1170 bytes} [Tue Oct 18 13:27:06 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:06.318850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-80625fb0-7754-49ba-9595-640e59997598 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:06.323913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80625fb0-7754-49ba-9595-640e59997598 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.324489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80625fb0-7754-49ba-9595-640e59997598 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.324996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80625fb0-7754-49ba-9595-640e59997598 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.325821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80625fb0-7754-49ba-9595-640e59997598 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.326346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80625fb0-7754-49ba-9595-640e59997598 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.326891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80625fb0-7754-49ba-9595-640e59997598 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.341166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6b7a2c53-0cb0-432a-83cb-990ea2fa35f1 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:06.357117 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-80625fb0-7754-49ba-9595-640e59997598 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.042267 Oct 18 13:27:06.367230 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1165/2476] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:27:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:27:06.367574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6b7a2c53-0cb0-432a-83cb-990ea2fa35f1 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:06.369394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6b7a2c53-0cb0-432a-83cb-990ea2fa35f1 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:06.373733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-875bf293-64a1-4a15-b586-e640b3378d1f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:06.374510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-875bf293-64a1-4a15-b586-e640b3378d1f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:06.376316 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6b7a2c53-0cb0-432a-83cb-990ea2fa35f1 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.195917 Oct 18 13:27:06.377124 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1312/2477] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:06 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:06.382605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8a47fbfc-d704-45db-bfca-93529fe93368 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:06.383353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-875bf293-64a1-4a15-b586-e640b3378d1f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.383863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-875bf293-64a1-4a15-b586-e640b3378d1f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.384307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-875bf293-64a1-4a15-b586-e640b3378d1f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.385011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-875bf293-64a1-4a15-b586-e640b3378d1f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.385507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-875bf293-64a1-4a15-b586-e640b3378d1f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.385932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-875bf293-64a1-4a15-b586-e640b3378d1f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.388118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a47fbfc-d704-45db-bfca-93529fe93368 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.389015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a47fbfc-d704-45db-bfca-93529fe93368 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.389603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a47fbfc-d704-45db-bfca-93529fe93368 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.391837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a47fbfc-d704-45db-bfca-93529fe93368 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.392457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a47fbfc-d704-45db-bfca-93529fe93368 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.392978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a47fbfc-d704-45db-bfca-93529fe93368 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.431815 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8a47fbfc-d704-45db-bfca-93529fe93368 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=n-d-858384-13&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.053196 Oct 18 13:27:06.432988 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1313/2478] 10.222.0.40 () {58 vars in 1196 bytes} [Tue Oct 18 13:27:06 2022] GET /compute/v2.1/os-services?host=n-d-858384-13&binary=xxx => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:27:06.446559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eba36014-6f6a-4449-9fa1-3962e242e0fa tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:06.450885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eba36014-6f6a-4449-9fa1-3962e242e0fa tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.451565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eba36014-6f6a-4449-9fa1-3962e242e0fa tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.451994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eba36014-6f6a-4449-9fa1-3962e242e0fa tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.452809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eba36014-6f6a-4449-9fa1-3962e242e0fa tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.453361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eba36014-6f6a-4449-9fa1-3962e242e0fa tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.453903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eba36014-6f6a-4449-9fa1-3962e242e0fa tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.489088 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eba36014-6f6a-4449-9fa1-3962e242e0fa tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.047066 Oct 18 13:27:06.490087 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1314/2479] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:27:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:27:06.503865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3092d898-830b-4438-9557-607bd86e7950 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:06.508218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3092d898-830b-4438-9557-607bd86e7950 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.509057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3092d898-830b-4438-9557-607bd86e7950 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.509876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3092d898-830b-4438-9557-607bd86e7950 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.510823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3092d898-830b-4438-9557-607bd86e7950 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.512828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3092d898-830b-4438-9557-607bd86e7950 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.513592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3092d898-830b-4438-9557-607bd86e7950 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.548866 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3092d898-830b-4438-9557-607bd86e7950 tempest-ServicesAdminNegativeTestJSON-887475528 tempest-ServicesAdminNegativeTestJSON-887475528-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.049653 Oct 18 13:27:06.551441 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1315/2480] 10.222.0.40 () {58 vars in 1198 bytes} [Tue Oct 18 13:27:06 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:27:06.570867 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-875bf293-64a1-4a15-b586-e640b3378d1f tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1860 microversion: 2.1 time: 0.197550 Oct 18 13:27:06.572173 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1166/2481] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:06 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1860 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:06.593703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a09dea03-81bf-4183-8eaa-65cf8fec84a9 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-13", "block_migration": true, "disk_over_commit": false}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:06.596346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a09dea03-81bf-4183-8eaa-65cf8fec84a9 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:06.605298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a09dea03-81bf-4183-8eaa-65cf8fec84a9 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.605795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a09dea03-81bf-4183-8eaa-65cf8fec84a9 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.606234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a09dea03-81bf-4183-8eaa-65cf8fec84a9 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.607189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a09dea03-81bf-4183-8eaa-65cf8fec84a9 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.607803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a09dea03-81bf-4183-8eaa-65cf8fec84a9 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.608375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a09dea03-81bf-4183-8eaa-65cf8fec84a9 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.640101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-a09dea03-81bf-4183-8eaa-65cf8fec84a9 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lazy-loading 'flavor' on Instance uuid e1f4088c-c321-4fc1-8bec-456d1178cda7 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:06.657447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a09dea03-81bf-4183-8eaa-65cf8fec84a9 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Going to try to live migrate instance to n-h1-858384-13 {{(pid=120612) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:27:06.691716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6fcab161-a27d-4e9f-b252-c9735e5cc3ad tempest-ServicesAdminNegativeTestJSON-1939751933 tempest-ServicesAdminNegativeTestJSON-1939751933-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:06.696221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6fcab161-a27d-4e9f-b252-c9735e5cc3ad tempest-ServicesAdminNegativeTestJSON-1939751933 tempest-ServicesAdminNegativeTestJSON-1939751933-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'f915896642944213a7b3519562d6d5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52e81e244f247b19a5c7132134d7ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6fcab161-a27d-4e9f-b252-c9735e5cc3ad tempest-ServicesAdminNegativeTestJSON-1939751933 tempest-ServicesAdminNegativeTestJSON-1939751933-project] Request method failure captured: Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqmoEIbkjAWe16u1n3faiS-EhUsclLT360mBklYH_deQdJpUj0sSVbMM9Q7gTED3EeC0NEqhFf_Xu4yLLYP96rgYgWGZiEotaH0rtT5MaRxwwku4YRrFK2SYv3P8QD31UbRE495Ygh03vKYUAWj2pqohgh3X5nbNNxhd-TDVAYoz4zw Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: b52e81e244f247b19a5c7132134d7ae5 Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1939751933 Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:27:06.698376 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:27:06.699854 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b52e81e244f247b19a5c7132134d7ae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b52e81e244f247b19a5c7132134d7ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b52e81e244f247b19a5c7132134d7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b52e81e244f247b19a5c7132134d7ae5"}]}] Oct 18 13:27:06.699854 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1939751933 Oct 18 13:27:06.699854 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: b52e81e244f247b19a5c7132134d7ae5 Oct 18 13:27:06.699854 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1939751933 Oct 18 13:27:06.699854 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServicesAdminNegativeTestJSON-1939751933-project Oct 18 13:27:06.699854 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:27:06.699854 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:27:06.699854 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f915896642944213a7b3519562d6d5ab Oct 18 13:27:06.699854 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1939751933-project Oct 18 13:27:06.699854 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:27:06.699854 n-d-858384-13 devstack@n-api.service[120611]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 13:27:06.699854 n-d-858384-13 devstack@n-api.service[120611]: action_args: {} Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:27:06.700691 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 18 13:27:06.702003 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:06.703976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6fcab161-a27d-4e9f-b252-c9735e5cc3ad tempest-ServicesAdminNegativeTestJSON-1939751933 tempest-ServicesAdminNegativeTestJSON-1939751933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:06.705139 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6fcab161-a27d-4e9f-b252-c9735e5cc3ad tempest-ServicesAdminNegativeTestJSON-1939751933 tempest-ServicesAdminNegativeTestJSON-1939751933-project] 10.222.0.40 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.143494 Oct 18 13:27:06.706046 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1316/2482] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:27:06 2022] GET /compute/v2.1/os-services => generated 112 bytes in 145 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:06.905030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fb86b121-5e0e-4325-bbe8-e9d4806f71a9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:06.906882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb86b121-5e0e-4325-bbe8-e9d4806f71a9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:06.920014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb86b121-5e0e-4325-bbe8-e9d4806f71a9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.924975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb86b121-5e0e-4325-bbe8-e9d4806f71a9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.925708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb86b121-5e0e-4325-bbe8-e9d4806f71a9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:06.927251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb86b121-5e0e-4325-bbe8-e9d4806f71a9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:06.932520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb86b121-5e0e-4325-bbe8-e9d4806f71a9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:06.933261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb86b121-5e0e-4325-bbe8-e9d4806f71a9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:07.139016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fb86b121-5e0e-4325-bbe8-e9d4806f71a9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:07.149375 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fb86b121-5e0e-4325-bbe8-e9d4806f71a9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1314 microversion: 2.1 time: 0.257949 Oct 18 13:27:07.150734 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1317/2483] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:06 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:07.156762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-639da532-d5bd-4936-9451-2107f665e288 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:07.158009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-639da532-d5bd-4936-9451-2107f665e288 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:07.167450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-639da532-d5bd-4936-9451-2107f665e288 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:07.168381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-639da532-d5bd-4936-9451-2107f665e288 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:07.169017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-639da532-d5bd-4936-9451-2107f665e288 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:07.170812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-639da532-d5bd-4936-9451-2107f665e288 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:07.171886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-639da532-d5bd-4936-9451-2107f665e288 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:07.172484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-639da532-d5bd-4936-9451-2107f665e288 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:07.496315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-639da532-d5bd-4936-9451-2107f665e288 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:07.507889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-639da532-d5bd-4936-9451-2107f665e288 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:07.511572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-639da532-d5bd-4936-9451-2107f665e288 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:07.513608 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-639da532-d5bd-4936-9451-2107f665e288 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.360884 Oct 18 13:27:07.530263 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1318/2484] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:07 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:07.540581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca0ea6f6-2b73-4cdc-b804-b5e0cf8d8f0a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:07.541470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca0ea6f6-2b73-4cdc-b804-b5e0cf8d8f0a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:07.549208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0ea6f6-2b73-4cdc-b804-b5e0cf8d8f0a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:07.550651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0ea6f6-2b73-4cdc-b804-b5e0cf8d8f0a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:07.552163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0ea6f6-2b73-4cdc-b804-b5e0cf8d8f0a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:07.552915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0ea6f6-2b73-4cdc-b804-b5e0cf8d8f0a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:07.553433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0ea6f6-2b73-4cdc-b804-b5e0cf8d8f0a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:07.554436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0ea6f6-2b73-4cdc-b804-b5e0cf8d8f0a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:07.788090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ca0ea6f6-2b73-4cdc-b804-b5e0cf8d8f0a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:07.796055 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca0ea6f6-2b73-4cdc-b804-b5e0cf8d8f0a tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1647 microversion: 2.1 time: 0.264353 Oct 18 13:27:07.796852 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1319/2485] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:07 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1647 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:07.821591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-745c03fc-555d-410c-aa3b-61e7ed177384 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:07.822512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-745c03fc-555d-410c-aa3b-61e7ed177384 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:07.829241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-745c03fc-555d-410c-aa3b-61e7ed177384 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:07.829954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-745c03fc-555d-410c-aa3b-61e7ed177384 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:07.830542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-745c03fc-555d-410c-aa3b-61e7ed177384 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:07.831407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-745c03fc-555d-410c-aa3b-61e7ed177384 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:07.832029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-745c03fc-555d-410c-aa3b-61e7ed177384 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:07.832611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-745c03fc-555d-410c-aa3b-61e7ed177384 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:07.837487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:07.904238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-745c03fc-555d-410c-aa3b-61e7ed177384 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:07.915135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-745c03fc-555d-410c-aa3b-61e7ed177384 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:07.916606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-745c03fc-555d-410c-aa3b-61e7ed177384 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:07.923820 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-745c03fc-555d-410c-aa3b-61e7ed177384 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1447 microversion: 2.75 time: 0.125056 Oct 18 13:27:07.938144 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1320/2486] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:07 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1447 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:08.175163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f46e14e6-a848-4d6c-90d3-2cfb4b0deee4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:08.178731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f46e14e6-a848-4d6c-90d3-2cfb4b0deee4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:08.188318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f46e14e6-a848-4d6c-90d3-2cfb4b0deee4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.189245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f46e14e6-a848-4d6c-90d3-2cfb4b0deee4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.189909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f46e14e6-a848-4d6c-90d3-2cfb4b0deee4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:08.191410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f46e14e6-a848-4d6c-90d3-2cfb4b0deee4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.192083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f46e14e6-a848-4d6c-90d3-2cfb4b0deee4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.192711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f46e14e6-a848-4d6c-90d3-2cfb4b0deee4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:08.405320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f46e14e6-a848-4d6c-90d3-2cfb4b0deee4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:08.414054 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f46e14e6-a848-4d6c-90d3-2cfb4b0deee4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1314 microversion: 2.1 time: 0.243421 Oct 18 13:27:08.414896 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1321/2487] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:08 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:08.547348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f1b12705-f372-4915-92a0-d54774bf1427 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:08.548544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f1b12705-f372-4915-92a0-d54774bf1427 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:08.558926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:08.562200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1b12705-f372-4915-92a0-d54774bf1427 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.563156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1b12705-f372-4915-92a0-d54774bf1427 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.563951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1b12705-f372-4915-92a0-d54774bf1427 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:08.564824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1b12705-f372-4915-92a0-d54774bf1427 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.565763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1b12705-f372-4915-92a0-d54774bf1427 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.566946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1b12705-f372-4915-92a0-d54774bf1427 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:08.852594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f1b12705-f372-4915-92a0-d54774bf1427 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:08.862137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f1b12705-f372-4915-92a0-d54774bf1427 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:08.863912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f1b12705-f372-4915-92a0-d54774bf1427 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:08.865386 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f1b12705-f372-4915-92a0-d54774bf1427 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.325023 Oct 18 13:27:08.866205 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1322/2488] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:08 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:27:08.872667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9170275a-4777-4f91-8085-2d716c4f8873 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:08.876019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9170275a-4777-4f91-8085-2d716c4f8873 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:08.887943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9170275a-4777-4f91-8085-2d716c4f8873 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.888956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9170275a-4777-4f91-8085-2d716c4f8873 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.890480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9170275a-4777-4f91-8085-2d716c4f8873 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:08.891436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9170275a-4777-4f91-8085-2d716c4f8873 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:08.892101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9170275a-4777-4f91-8085-2d716c4f8873 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:08.893351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9170275a-4777-4f91-8085-2d716c4f8873 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:09.204444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9170275a-4777-4f91-8085-2d716c4f8873 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:09.222370 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9170275a-4777-4f91-8085-2d716c4f8873 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1647 microversion: 2.1 time: 0.350330 Oct 18 13:27:09.225278 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1323/2489] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:08 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1647 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:09.238404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a3857a3b-cb72-4895-9ee8-5402ed7d9f26 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:09.239356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a3857a3b-cb72-4895-9ee8-5402ed7d9f26 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:09.254960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3857a3b-cb72-4895-9ee8-5402ed7d9f26 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:09.259175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3857a3b-cb72-4895-9ee8-5402ed7d9f26 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:09.263500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3857a3b-cb72-4895-9ee8-5402ed7d9f26 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:09.264454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3857a3b-cb72-4895-9ee8-5402ed7d9f26 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:09.265022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3857a3b-cb72-4895-9ee8-5402ed7d9f26 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:09.265634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3857a3b-cb72-4895-9ee8-5402ed7d9f26 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:09.442311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a3857a3b-cb72-4895-9ee8-5402ed7d9f26 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:09.462516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a3857a3b-cb72-4895-9ee8-5402ed7d9f26 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:09.464816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a3857a3b-cb72-4895-9ee8-5402ed7d9f26 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:09.478221 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a3857a3b-cb72-4895-9ee8-5402ed7d9f26 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1453 microversion: 2.75 time: 0.250855 Oct 18 13:27:09.479228 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1324/2490] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:09 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1453 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:09.490224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1ff1e856-0643-47ce-9a56-a20f2feb6bcc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:09.497619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1ff1e856-0643-47ce-9a56-a20f2feb6bcc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:09.506692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ff1e856-0643-47ce-9a56-a20f2feb6bcc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:09.507594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ff1e856-0643-47ce-9a56-a20f2feb6bcc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:09.508250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ff1e856-0643-47ce-9a56-a20f2feb6bcc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:09.509243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ff1e856-0643-47ce-9a56-a20f2feb6bcc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:09.509917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ff1e856-0643-47ce-9a56-a20f2feb6bcc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:09.510940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ff1e856-0643-47ce-9a56-a20f2feb6bcc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:09.969262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:10.191519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1ff1e856-0643-47ce-9a56-a20f2feb6bcc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:10.206371 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1ff1e856-0643-47ce-9a56-a20f2feb6bcc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1314 microversion: 2.1 time: 0.724174 Oct 18 13:27:10.224837 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1325/2491] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:09 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:10.231798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3addaae9-1c17-434b-ac15-960630475e60 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:10.233147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3addaae9-1c17-434b-ac15-960630475e60 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:10.240136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3addaae9-1c17-434b-ac15-960630475e60 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:10.240921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3addaae9-1c17-434b-ac15-960630475e60 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:10.242145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3addaae9-1c17-434b-ac15-960630475e60 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:10.243456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3addaae9-1c17-434b-ac15-960630475e60 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:10.244235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3addaae9-1c17-434b-ac15-960630475e60 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:10.244910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3addaae9-1c17-434b-ac15-960630475e60 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:10.476766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:10.750272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3addaae9-1c17-434b-ac15-960630475e60 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:10.768326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3addaae9-1c17-434b-ac15-960630475e60 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:10.774656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3addaae9-1c17-434b-ac15-960630475e60 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:10.781953 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3addaae9-1c17-434b-ac15-960630475e60 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.550438 Oct 18 13:27:10.798211 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1326/2492] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:10 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:10.811433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c1481954-7fc0-4504-bcae-8c27845e2325 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:10.812057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c1481954-7fc0-4504-bcae-8c27845e2325 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:10.827112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1481954-7fc0-4504-bcae-8c27845e2325 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:10.829193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1481954-7fc0-4504-bcae-8c27845e2325 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:10.832154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1481954-7fc0-4504-bcae-8c27845e2325 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:10.832951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1481954-7fc0-4504-bcae-8c27845e2325 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:10.833460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1481954-7fc0-4504-bcae-8c27845e2325 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:10.833946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1481954-7fc0-4504-bcae-8c27845e2325 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:10.952781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c1481954-7fc0-4504-bcae-8c27845e2325 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:10.971634 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c1481954-7fc0-4504-bcae-8c27845e2325 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 200 len: 1301 microversion: 2.1 time: 0.172228 Oct 18 13:27:10.998228 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1327/2493] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:10 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 1301 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:11.156809 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a09dea03-81bf-4183-8eaa-65cf8fec84a9 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/action" status: 202 len: 0 microversion: 2.1 time: 4.566775 Oct 18 13:27:11.158489 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1167/2494] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:06 2022] POST /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/action => generated 0 bytes in 4569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:27:11.179997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1159b7dd-fb05-4048-a5eb-222a7236e831 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:11.185133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1159b7dd-fb05-4048-a5eb-222a7236e831 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:11.205572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:11.236013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1159b7dd-fb05-4048-a5eb-222a7236e831 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:11.237223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1159b7dd-fb05-4048-a5eb-222a7236e831 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:11.254568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1159b7dd-fb05-4048-a5eb-222a7236e831 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:11.259256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1159b7dd-fb05-4048-a5eb-222a7236e831 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:11.260411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1159b7dd-fb05-4048-a5eb-222a7236e831 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:11.261834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1159b7dd-fb05-4048-a5eb-222a7236e831 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:11.298585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:11.365040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3a2a797a-3be3-4360-979d-20f899e0fd55 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Action: 'create', calling method: .version_select at 0x7ff60ef58670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-543316341", "description": "tempest-description-1492425582"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:11.418562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1159b7dd-fb05-4048-a5eb-222a7236e831 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:11.435246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1159b7dd-fb05-4048-a5eb-222a7236e831 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:11.441965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1159b7dd-fb05-4048-a5eb-222a7236e831 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:11.467609 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1159b7dd-fb05-4048-a5eb-222a7236e831 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1438 microversion: 2.75 time: 0.307638 Oct 18 13:27:11.469858 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1168/2495] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:11 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1438 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:11.478690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a9556d0a-d0c1-49ee-8ee2-7820697cbe88 req-f5fb94a8-118f-4ffd-b1dd-b93107149262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290", "name": "network-vif-deleted", "tag": "6baad0b7-1db5-475b-b6de-51f6616dc237"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:11.508860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a9556d0a-d0c1-49ee-8ee2-7820697cbe88 req-f5fb94a8-118f-4ffd-b1dd-b93107149262 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:11.510667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a9556d0a-d0c1-49ee-8ee2-7820697cbe88 req-f5fb94a8-118f-4ffd-b1dd-b93107149262 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:11.511108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a9556d0a-d0c1-49ee-8ee2-7820697cbe88 req-f5fb94a8-118f-4ffd-b1dd-b93107149262 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:11.540366 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a9556d0a-d0c1-49ee-8ee2-7820697cbe88 req-f5fb94a8-118f-4ffd-b1dd-b93107149262 service nova] Creating event network-vif-deleted:6baad0b7-1db5-475b-b6de-51f6616dc237 for instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 on n-h1-858384-13 Oct 18 13:27:11.554682 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a9556d0a-d0c1-49ee-8ee2-7820697cbe88 req-f5fb94a8-118f-4ffd-b1dd-b93107149262 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080067 Oct 18 13:27:11.555803 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1169/2496] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:11.577724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d1c51c5f-bd85-4735-a0dc-32e54eb3309d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:11.578523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d1c51c5f-bd85-4735-a0dc-32e54eb3309d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:11.590467 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3a2a797a-3be3-4360-979d-20f899e0fd55 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.591042 Oct 18 13:27:11.591965 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1328/2497] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:27:10 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:11.593267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1c51c5f-bd85-4735-a0dc-32e54eb3309d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:11.593932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1c51c5f-bd85-4735-a0dc-32e54eb3309d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:11.594374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1c51c5f-bd85-4735-a0dc-32e54eb3309d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:11.597296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1c51c5f-bd85-4735-a0dc-32e54eb3309d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:11.597833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1c51c5f-bd85-4735-a0dc-32e54eb3309d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:11.598268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1c51c5f-bd85-4735-a0dc-32e54eb3309d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:11.599222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f01de61-44d3-46ba-b482-057ec0d22291 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:11.600409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7f01de61-44d3-46ba-b482-057ec0d22291 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:11.618855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f01de61-44d3-46ba-b482-057ec0d22291 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:11.619375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f01de61-44d3-46ba-b482-057ec0d22291 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:11.619819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f01de61-44d3-46ba-b482-057ec0d22291 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:11.624089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f01de61-44d3-46ba-b482-057ec0d22291 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:11.624805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f01de61-44d3-46ba-b482-057ec0d22291 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:11.625715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f01de61-44d3-46ba-b482-057ec0d22291 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:12.016015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7f01de61-44d3-46ba-b482-057ec0d22291 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:12.030445 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7f01de61-44d3-46ba-b482-057ec0d22291 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1314 microversion: 2.1 time: 0.435904 Oct 18 13:27:12.032584 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1329/2498] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:11 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:12.053082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d1c51c5f-bd85-4735-a0dc-32e54eb3309d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:12.053637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-22584f54-4a06-42e6-b897-2150adb6c064 req-912d643f-5f24-4561-860a-c17a802d38ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011b3a1e-b73c-4005-b92f-ece6f98fee72", "name": "network-vif-plugged", "status": "completed", "tag": "5a291329-93b2-4506-801a-ab24293cd321"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:12.063007 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d1c51c5f-bd85-4735-a0dc-32e54eb3309d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.506295 Oct 18 13:27:12.071024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-22584f54-4a06-42e6-b897-2150adb6c064 req-912d643f-5f24-4561-860a-c17a802d38ea service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:12.071730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-22584f54-4a06-42e6-b897-2150adb6c064 req-912d643f-5f24-4561-860a-c17a802d38ea service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:12.072354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-22584f54-4a06-42e6-b897-2150adb6c064 req-912d643f-5f24-4561-860a-c17a802d38ea service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:12.074275 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1170/2499] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:11 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:12.106726 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-22584f54-4a06-42e6-b897-2150adb6c064 req-912d643f-5f24-4561-860a-c17a802d38ea service nova] Creating event network-vif-plugged:5a291329-93b2-4506-801a-ab24293cd321 for instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 on n-h2-858384-13 Oct 18 13:27:12.112926 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-22584f54-4a06-42e6-b897-2150adb6c064 req-912d643f-5f24-4561-860a-c17a802d38ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078864 Oct 18 13:27:12.115853 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1330/2500] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:12.139360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5089cc1c-ab71-4362-b055-544744d86da9 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Action: 'create', calling method: .version_select at 0x7ff60ef6fdc0>, body: {"security_group_rule": {"parent_group_id": "7880cefb-e678-48f8-b743-56c7ad66ca52", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:12.477799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:12.481079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:12.496526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:12.497552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:12.498932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:12.500011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:12.505426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:12.506078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:12.648115 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5089cc1c-ab71-4362-b055-544744d86da9 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.529877 Oct 18 13:27:12.649349 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1331/2501] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:27:12 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:12.654948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb077a36-5add-437f-8474-51eefbca8f56 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:12.655798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eb077a36-5add-437f-8474-51eefbca8f56 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:12.666368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:27:12.674804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb077a36-5add-437f-8474-51eefbca8f56 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:12.675438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:27:12.680811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:27:12.681571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb077a36-5add-437f-8474-51eefbca8f56 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:12.682480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:27:12.683000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:27:12.683738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb077a36-5add-437f-8474-51eefbca8f56 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:12.685981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb077a36-5add-437f-8474-51eefbca8f56 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:12.686550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb077a36-5add-437f-8474-51eefbca8f56 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:12.688399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb077a36-5add-437f-8474-51eefbca8f56 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:12.868195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:12.886857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:12.889852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:12.892203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:12.893307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:12.895297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:12.898772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.307345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:13.354844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eb077a36-5add-437f-8474-51eefbca8f56 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:13.377326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eb077a36-5add-437f-8474-51eefbca8f56 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:13.378684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eb077a36-5add-437f-8474-51eefbca8f56 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:13.379864 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eb077a36-5add-437f-8474-51eefbca8f56 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.728950 Oct 18 13:27:13.393727 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c5509770-5fa4-4608-a714-59125c37f173 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399/action" status: 202 len: 1944 microversion: 2.75 time: 1.308936 Oct 18 13:27:13.393727 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1171/2502] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:27:12 2022] POST /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399/action => generated 1944 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 13:27:13.410613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-747ae030-25cc-49a9-8ab4-e41855033286 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:13.411469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-747ae030-25cc-49a9-8ab4-e41855033286 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:13.416450 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1332/2503] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:12 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:13.435070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c806a195-6435-49b5-8985-d7034dc3e8e9 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Action: 'create', calling method: .version_select at 0x7ff60ef64430>, body: {"security_group_rule": {"parent_group_id": "7880cefb-e678-48f8-b743-56c7ad66ca52", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:13.437951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-747ae030-25cc-49a9-8ab4-e41855033286 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.438441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-747ae030-25cc-49a9-8ab4-e41855033286 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.438874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-747ae030-25cc-49a9-8ab4-e41855033286 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.439593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-747ae030-25cc-49a9-8ab4-e41855033286 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.440052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-747ae030-25cc-49a9-8ab4-e41855033286 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.440536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-747ae030-25cc-49a9-8ab4-e41855033286 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.461994 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-747ae030-25cc-49a9-8ab4-e41855033286 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-747ae030-25cc-49a9-8ab4-e41855033286 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 HTTP/1.1 Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:27:13.473445 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:27:13.474793 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:27:13.474793 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:13.474793 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:13.474793 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:13.474793 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:13.474793 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:27:13.474793 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:27:13.474793 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:27:13.474793 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:13.474793 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:27:13.474793 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:13.474793 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290'} Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:13.476194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:13.477334 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.479566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-747ae030-25cc-49a9-8ab4-e41855033286 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:13.479566 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-747ae030-25cc-49a9-8ab4-e41855033286 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 404 len: 111 microversion: 2.1 time: 0.084921 Oct 18 13:27:13.485452 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1172/2504] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:13 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:13.493552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9cb5d035-9ef0-4bd7-92ff-272488b8f19f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:13.494415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9cb5d035-9ef0-4bd7-92ff-272488b8f19f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:13.510709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cb5d035-9ef0-4bd7-92ff-272488b8f19f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.511497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cb5d035-9ef0-4bd7-92ff-272488b8f19f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.512085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cb5d035-9ef0-4bd7-92ff-272488b8f19f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.513022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cb5d035-9ef0-4bd7-92ff-272488b8f19f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.513649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cb5d035-9ef0-4bd7-92ff-272488b8f19f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.514339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cb5d035-9ef0-4bd7-92ff-272488b8f19f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.518622 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-c806a195-6435-49b5-8985-d7034dc3e8e9 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] HTTP exception thrown: This rule already exists in group 7880cefb-e678-48f8-b743-56c7ad66ca52 Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c806a195-6435-49b5-8985-d7034dc3e8e9 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Request method failure captured: Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 138 Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqmuiKayvJWKlKeGkNg0AW769aHt6xwk2yGiKxrCZ86c2mJPJ8yHvERSEpgX8L-6y75o5SWCPnNXuYxO82K0dSYIMlJUtK3MBDlloQnn4_jH5mOobDnSfizA02_sOMCjGt6MfvCkvutvWqvrE1AUaV9YwdJK9slK-Dy-p6QeK3HpA4I Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:27:13.520891 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:27:13.522424 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9512b243ccd04f1a8601bd427a498a69"}]}] Oct 18 13:27:13.522424 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:13.522424 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:13.522424 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:13.522424 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:13.522424 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:27:13.522424 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:27:13.522424 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 393400befcaf46138e7add9efd8204ce Oct 18 13:27:13.522424 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:13.522424 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:27:13.522424 n-d-858384-13 devstack@n-api.service[120611]: {"security_group_rule": {"parent_group_id": "7880cefb-e678-48f8-b743-56c7ad66ca52", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 18 13:27:13.522424 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: exception: This rule already exists in group 7880cefb-e678-48f8-b743-56c7ad66ca52 Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7880cefb-e678-48f8-b743-56c7ad66ca52', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 7880cefb-e678-48f8-b743-56c7ad66ca52 Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:13.523403 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 7880cefb-e678-48f8-b743-56c7ad66ca52 Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 7880cefb-e678-48f8-b743-56c7ad66ca52 Oct 18 13:27:13.524756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:13.528777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c806a195-6435-49b5-8985-d7034dc3e8e9 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Returning 400 to user: This rule already exists in group 7880cefb-e678-48f8-b743-56c7ad66ca52 {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:13.529711 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c806a195-6435-49b5-8985-d7034dc3e8e9 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.105803 Oct 18 13:27:13.531493 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1333/2505] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:27:13 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:27:13.745937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b0210335-8ef3-4e84-a0c5-277d4e5320ba tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:13.747338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b0210335-8ef3-4e84-a0c5-277d4e5320ba tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:13.759051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0210335-8ef3-4e84-a0c5-277d4e5320ba tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.759805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0210335-8ef3-4e84-a0c5-277d4e5320ba tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.760406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0210335-8ef3-4e84-a0c5-277d4e5320ba tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.761391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0210335-8ef3-4e84-a0c5-277d4e5320ba tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.762237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0210335-8ef3-4e84-a0c5-277d4e5320ba tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.762822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0210335-8ef3-4e84-a0c5-277d4e5320ba tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.887627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9cb5d035-9ef0-4bd7-92ff-272488b8f19f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:13.896873 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9cb5d035-9ef0-4bd7-92ff-272488b8f19f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1314 microversion: 2.1 time: 0.410198 Oct 18 13:27:13.900697 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1173/2506] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:13 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:13.915917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3026c6f8-5e82-42fb-9e52-e5cd4aa622be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:13.917094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3026c6f8-5e82-42fb-9e52-e5cd4aa622be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:13.923735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3026c6f8-5e82-42fb-9e52-e5cd4aa622be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.925997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3026c6f8-5e82-42fb-9e52-e5cd4aa622be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.929592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3026c6f8-5e82-42fb-9e52-e5cd4aa622be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:13.931043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3026c6f8-5e82-42fb-9e52-e5cd4aa622be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:13.931746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3026c6f8-5e82-42fb-9e52-e5cd4aa622be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:13.934098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3026c6f8-5e82-42fb-9e52-e5cd4aa622be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:14.014790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b0210335-8ef3-4e84-a0c5-277d4e5320ba tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:14.027186 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b0210335-8ef3-4e84-a0c5-277d4e5320ba tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.494225 Oct 18 13:27:14.028130 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1334/2507] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:13 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:14.034874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-915b7b0c-20cd-4c47-bb5a-e9d2d23c22d7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60ef60e50>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:14.088614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-3026c6f8-5e82-42fb-9e52-e5cd4aa622be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:14.134748 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3026c6f8-5e82-42fb-9e52-e5cd4aa622be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.232536 Oct 18 13:27:14.135694 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1174/2508] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:13 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:14.152332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6e196ec8-d2a9-4da2-801f-7291b4aa3847 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Calling method '.version_select at 0x7ff60f7a24c0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:14.336856 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-915b7b0c-20cd-4c47-bb5a-e9d2d23c22d7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/129ad497-f01f-483e-b3d2-1d74291ab2b6" status: 202 len: 0 microversion: 2.1 time: 0.307157 Oct 18 13:27:14.337559 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1335/2509] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:14 2022] DELETE /compute/v2.1/os-security-groups/129ad497-f01f-483e-b3d2-1d74291ab2b6 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:14.346834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-123d3fc8-c160-4f33-b8d3-e30952e83c34 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60ef644c0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:14.665513 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-123d3fc8-c160-4f33-b8d3-e30952e83c34 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/a41d1be5-f608-48c6-8ac4-a8a6d08ccdca" status: 202 len: 0 microversion: 2.1 time: 0.323413 Oct 18 13:27:14.666967 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1336/2510] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:14 2022] DELETE /compute/v2.1/os-security-groups/a41d1be5-f608-48c6-8ac4-a8a6d08ccdca => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:27:14.671978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d5790005-0174-4c35-acce-155594264c5c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:14.672763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d5790005-0174-4c35-acce-155594264c5c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:14.681496 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6e196ec8-d2a9-4da2-801f-7291b4aa3847 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/31e3edce-e6e8-40f3-97e8-7bb01e010e01" status: 202 len: 0 microversion: 2.1 time: 0.544523 Oct 18 13:27:14.682715 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1175/2511] 10.222.0.40 () {58 vars in 1287 bytes} [Tue Oct 18 13:27:14 2022] DELETE /compute/v2.1/os-security-group-rules/31e3edce-e6e8-40f3-97e8-7bb01e010e01 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:14.690890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-99d5e977-a961-4fe3-92bb-5645d415e1e2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'create', calling method: .version_select at 0x7ff614312310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1396418952", "description": "tempest-description-1041688450"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:14.697632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5790005-0174-4c35-acce-155594264c5c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:14.698500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5790005-0174-4c35-acce-155594264c5c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:14.699115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5790005-0174-4c35-acce-155594264c5c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:14.699990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5790005-0174-4c35-acce-155594264c5c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:14.700445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5790005-0174-4c35-acce-155594264c5c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:14.700870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5790005-0174-4c35-acce-155594264c5c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:15.113323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d5790005-0174-4c35-acce-155594264c5c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:15.128898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d5790005-0174-4c35-acce-155594264c5c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:15.130618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d5790005-0174-4c35-acce-155594264c5c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:15.131953 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d5790005-0174-4c35-acce-155594264c5c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.463784 Oct 18 13:27:15.132710 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1337/2512] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:14 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:15.156500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1ea03171-9e90-483b-aee2-d0040c892e03 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Action: 'create', calling method: .version_select at 0x7ff60ef02670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1211141187", "description": "tempest-description-1068784836"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:15.195493 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-99d5e977-a961-4fe3-92bb-5645d415e1e2 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.511138 Oct 18 13:27:15.196109 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1176/2513] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:27:14 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:15.201891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9fe984ab-3c69-4b80-b3b5-d5705f9ae98c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:15.202518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9fe984ab-3c69-4b80-b3b5-d5705f9ae98c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:15.231736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe984ab-3c69-4b80-b3b5-d5705f9ae98c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:15.233912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe984ab-3c69-4b80-b3b5-d5705f9ae98c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:15.234561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe984ab-3c69-4b80-b3b5-d5705f9ae98c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:15.236951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe984ab-3c69-4b80-b3b5-d5705f9ae98c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:15.239479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe984ab-3c69-4b80-b3b5-d5705f9ae98c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:15.240183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe984ab-3c69-4b80-b3b5-d5705f9ae98c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:15.447894 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1ea03171-9e90-483b-aee2-d0040c892e03 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.301061 Oct 18 13:27:15.448700 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1338/2514] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:27:15 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:15.461944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b2fb41fd-92ed-48ba-98de-4d154073404a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:15.462852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b2fb41fd-92ed-48ba-98de-4d154073404a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:15.477266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2fb41fd-92ed-48ba-98de-4d154073404a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:15.482025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2fb41fd-92ed-48ba-98de-4d154073404a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:15.486016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2fb41fd-92ed-48ba-98de-4d154073404a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:15.487168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2fb41fd-92ed-48ba-98de-4d154073404a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:15.488179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2fb41fd-92ed-48ba-98de-4d154073404a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:15.488911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2fb41fd-92ed-48ba-98de-4d154073404a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:15.741899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b2fb41fd-92ed-48ba-98de-4d154073404a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:15.751921 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b2fb41fd-92ed-48ba-98de-4d154073404a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.301741 Oct 18 13:27:15.753404 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1339/2515] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:15 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:15.762499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-858d542e-0604-41b7-a3f1-ea05ce5073f5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:15.763490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-858d542e-0604-41b7-a3f1-ea05ce5073f5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:15.770695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-858d542e-0604-41b7-a3f1-ea05ce5073f5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:15.771345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-858d542e-0604-41b7-a3f1-ea05ce5073f5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:15.771887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-858d542e-0604-41b7-a3f1-ea05ce5073f5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:15.773536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-858d542e-0604-41b7-a3f1-ea05ce5073f5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:15.774350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-858d542e-0604-41b7-a3f1-ea05ce5073f5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:15.774883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-858d542e-0604-41b7-a3f1-ea05ce5073f5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:15.780431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9fe984ab-3c69-4b80-b3b5-d5705f9ae98c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:15.788746 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9fe984ab-3c69-4b80-b3b5-d5705f9ae98c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1501 microversion: 2.1 time: 0.591122 Oct 18 13:27:15.805628 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1177/2516] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:15 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1501 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:15.812437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8be2c85e-115a-434e-9e5e-fc734e6fc65d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Action: 'update', calling method: .version_select at 0x7ff614343820>, body: {"security_group": {"name": "tempest-sg-hth-536020693", "description": "tempest-description-hth-1961595768"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:15.858984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-858d542e-0604-41b7-a3f1-ea05ce5073f5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:15.877483 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-858d542e-0604-41b7-a3f1-ea05ce5073f5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.122599 Oct 18 13:27:15.878076 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1340/2517] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:15 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:15.883505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5cb274b7-a802-40da-af45-42c025c274b0 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Action: 'create', calling method: .version_select at 0x7ff60ef6f160>, body: {"security_group_rule": {"parent_group_id": "2f650d12-487b-4d3d-9251-70e96459400b", "ip_protocol": "tcp", "from_port": 11641945, "to_port": 22}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:15.938770 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-5cb274b7-a802-40da-af45-42c025c274b0 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] HTTP exception thrown: Invalid port range 11641945:22. Former value cannot be greater than the later Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5cb274b7-a802-40da-af45-42c025c274b0 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Request method failure captured: Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 144 Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqmuiKayvJWKlKeGkNg0AW769aHt6xwk2yGiKxrCZ86c2mJPJ8yHvERSEpgX8L-6y75o5SWCPnNXuYxO82K0dSYIMlJUtK3MBDlloQnn4_jH5mOobDnSfizA02_sOMCjGt6MfvCkvutvWqvrE1AUaV9YwdJK9slK-Dy-p6QeK3HpA4I Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:27:15.940639 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:27:15.942050 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9512b243ccd04f1a8601bd427a498a69"}]}] Oct 18 13:27:15.942050 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:15.942050 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:15.942050 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:15.942050 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:15.942050 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:27:15.942050 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:27:15.942050 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 393400befcaf46138e7add9efd8204ce Oct 18 13:27:15.942050 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:15.942050 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:27:15.942050 n-d-858384-13 devstack@n-api.service[120611]: {"security_group_rule": {"parent_group_id": "2f650d12-487b-4d3d-9251-70e96459400b", "ip_protocol": "tcp", "from_port": 11641945, "to_port": 22}} Oct 18 13:27:15.942050 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid port range 11641945:22. Former value cannot be greater than the later Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2f650d12-487b-4d3d-9251-70e96459400b', 'ip_protocol': 'tcp', 'from_port': 11641945, 'to_port': 22}}} Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 11641945:22. Former value cannot be greater than the later Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:15.942702 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 11641945:22. Former value cannot be greater than the later Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 11641945:22. Former value cannot be greater than the later Oct 18 13:27:15.947353 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:15.948717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5cb274b7-a802-40da-af45-42c025c274b0 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Returning 400 to user: Invalid port range 11641945:22. Former value cannot be greater than the later {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:15.948717 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5cb274b7-a802-40da-af45-42c025c274b0 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 121 microversion: 2.1 time: 0.063285 Oct 18 13:27:15.957986 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1341/2518] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:27:15 2022] POST /compute/v2.1/os-security-group-rules => generated 121 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:27:15.966583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-73a03617-15e1-4c0c-9643-72c9a9b1c81d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:15.975392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73a03617-15e1-4c0c-9643-72c9a9b1c81d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:15.975949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73a03617-15e1-4c0c-9643-72c9a9b1c81d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:15.976446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73a03617-15e1-4c0c-9643-72c9a9b1c81d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:16.004671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-73a03617-15e1-4c0c-9643-72c9a9b1c81d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Going to try to stop instance {{(pid=120611) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:27:16.059498 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-73a03617-15e1-4c0c-9643-72c9a9b1c81d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "POST /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72/action" status: 202 len: 0 microversion: 2.1 time: 0.096941 Oct 18 13:27:16.060536 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1342/2519] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:15 2022] POST /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:16.084711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cadb64e4-744b-425d-9af5-e056b315fbe4 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Action: 'create', calling method: .version_select at 0x7ff60fbfe4c0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1854263258", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:16.087552 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-cadb64e4-744b-425d-9af5-e056b315fbe4 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] HTTP exception thrown: Security group id should be uuid Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cadb64e4-744b-425d-9af5-e056b315fbe4 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Request method failure captured: Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 131 Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqmuiKayvJWKlKeGkNg0AW769aHt6xwk2yGiKxrCZ86c2mJPJ8yHvERSEpgX8L-6y75o5SWCPnNXuYxO82K0dSYIMlJUtK3MBDlloQnn4_jH5mOobDnSfizA02_sOMCjGt6MfvCkvutvWqvrE1AUaV9YwdJK9slK-Dy-p6QeK3HpA4I Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:27:16.089383 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:27:16.090645 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9512b243ccd04f1a8601bd427a498a69"}]}] Oct 18 13:27:16.090645 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:16.090645 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:16.090645 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:16.090645 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:16.090645 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:27:16.090645 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:27:16.090645 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 393400befcaf46138e7add9efd8204ce Oct 18 13:27:16.090645 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:16.090645 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:27:16.090645 n-d-858384-13 devstack@n-api.service[120611]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1854263258", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 18 13:27:16.090645 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:27:16.090645 n-d-858384-13 devstack@n-api.service[120611]: exception: Security group id should be uuid Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1854263258', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:16.091364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cadb64e4-744b-425d-9af5-e056b315fbe4 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Returning 400 to user: Security group id should be uuid {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:16.092476 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cadb64e4-744b-425d-9af5-e056b315fbe4 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.022115 Oct 18 13:27:16.093352 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1343/2520] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:27:16 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:27:16.096482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e8a56f3b-468f-4033-ac40-a0d9245b3011 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:16.097621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e8a56f3b-468f-4033-ac40-a0d9245b3011 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:16.108326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8a56f3b-468f-4033-ac40-a0d9245b3011 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:16.109441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8a56f3b-468f-4033-ac40-a0d9245b3011 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:16.110238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8a56f3b-468f-4033-ac40-a0d9245b3011 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:16.111101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8a56f3b-468f-4033-ac40-a0d9245b3011 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:16.111557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8a56f3b-468f-4033-ac40-a0d9245b3011 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:16.112136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8a56f3b-468f-4033-ac40-a0d9245b3011 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:16.117854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:16.194830 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8be2c85e-115a-434e-9e5e-fc734e6fc65d tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "PUT /compute/v2.1/os-security-groups/b6cb41f9-eede-4fa5-b494-82125e5f03a0" status: 200 len: 217 microversion: 2.1 time: 0.386647 Oct 18 13:27:16.196325 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1178/2521] 10.222.0.40 () {60 vars in 1290 bytes} [Tue Oct 18 13:27:15 2022] PUT /compute/v2.1/os-security-groups/b6cb41f9-eede-4fa5-b494-82125e5f03a0 => generated 217 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:16.201435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-967dc7f0-e53c-45ec-9614-13406115f707 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Action: 'create', calling method: .version_select at 0x7ff60f80a820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1159642009", "description": "tempest-description-1571632662"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:16.336848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:16.337292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e8a56f3b-468f-4033-ac40-a0d9245b3011 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:16.365319 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e8a56f3b-468f-4033-ac40-a0d9245b3011 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.272747 Oct 18 13:27:16.372014 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1344/2522] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:16 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:16.377141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d697eb0b-39a3-4d13-891f-3200c4b809ef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:16.383431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d697eb0b-39a3-4d13-891f-3200c4b809ef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:16.393013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d697eb0b-39a3-4d13-891f-3200c4b809ef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:16.393926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d697eb0b-39a3-4d13-891f-3200c4b809ef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:16.394607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d697eb0b-39a3-4d13-891f-3200c4b809ef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:16.397052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d697eb0b-39a3-4d13-891f-3200c4b809ef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:16.397815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d697eb0b-39a3-4d13-891f-3200c4b809ef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:16.398630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d697eb0b-39a3-4d13-891f-3200c4b809ef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:16.526500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=8 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:16.713295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d697eb0b-39a3-4d13-891f-3200c4b809ef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:16.725826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d697eb0b-39a3-4d13-891f-3200c4b809ef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:16.727630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d697eb0b-39a3-4d13-891f-3200c4b809ef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:16.729416 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d697eb0b-39a3-4d13-891f-3200c4b809ef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.356080 Oct 18 13:27:16.730650 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1345/2523] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:16 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:16.746002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4acaea79-0d59-4046-baf6-4cf1bf223889 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60ef02550>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:16.839043 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4acaea79-0d59-4046-baf6-4cf1bf223889 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/b6cb41f9-eede-4fa5-b494-82125e5f03a0" status: 200 len: 217 microversion: 2.1 time: 0.107073 Oct 18 13:27:16.840908 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1346/2524] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:27:16 2022] GET /compute/v2.1/os-security-groups/b6cb41f9-eede-4fa5-b494-82125e5f03a0 => generated 217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:16.845933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-19f9dab2-fe1c-438c-9b55-9ed0e5cf3076 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:16.846687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-19f9dab2-fe1c-438c-9b55-9ed0e5cf3076 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:16.856672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19f9dab2-fe1c-438c-9b55-9ed0e5cf3076 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:16.860998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19f9dab2-fe1c-438c-9b55-9ed0e5cf3076 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:16.866211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19f9dab2-fe1c-438c-9b55-9ed0e5cf3076 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:16.867106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19f9dab2-fe1c-438c-9b55-9ed0e5cf3076 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:16.867697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19f9dab2-fe1c-438c-9b55-9ed0e5cf3076 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:16.868202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19f9dab2-fe1c-438c-9b55-9ed0e5cf3076 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.049955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-19f9dab2-fe1c-438c-9b55-9ed0e5cf3076 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:17.068493 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-19f9dab2-fe1c-438c-9b55-9ed0e5cf3076 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.225926 Oct 18 13:27:17.081201 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1347/2525] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:16 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:17.094813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6a746c8b-93bf-446b-8239-81f9b6c5544b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60efb7280>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:17.151044 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-967dc7f0-e53c-45ec-9614-13406115f707 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.953471 Oct 18 13:27:17.151718 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1179/2526] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:27:16 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:17.164594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-44919ecd-b598-4040-a5b8-782381d14155 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:17.166023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-44919ecd-b598-4040-a5b8-782381d14155 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:17.184123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44919ecd-b598-4040-a5b8-782381d14155 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.185688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44919ecd-b598-4040-a5b8-782381d14155 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.186350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44919ecd-b598-4040-a5b8-782381d14155 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.187274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44919ecd-b598-4040-a5b8-782381d14155 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.187938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44919ecd-b598-4040-a5b8-782381d14155 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.188571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44919ecd-b598-4040-a5b8-782381d14155 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.408772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-44919ecd-b598-4040-a5b8-782381d14155 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:17.469949 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-44919ecd-b598-4040-a5b8-782381d14155 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.308331 Oct 18 13:27:17.485783 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1180/2527] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:17 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:17.485783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c25ad98e-fb5f-4871-a704-c1dac2a40d2e tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Action: 'create', calling method: .version_select at 0x7ff60f80a430>, body: {"security_group_rule": {"parent_group_id": "511257f1-cdb8-44bd-8404-779644f7447e", "ip_protocol": "tempest-999-940488571", "from_port": 22, "to_port": 22}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:17.486267 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6a746c8b-93bf-446b-8239-81f9b6c5544b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/b6cb41f9-eede-4fa5-b494-82125e5f03a0" status: 202 len: 0 microversion: 2.1 time: 0.413746 Oct 18 13:27:17.486267 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1348/2528] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:17 2022] DELETE /compute/v2.1/os-security-groups/b6cb41f9-eede-4fa5-b494-82125e5f03a0 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:17.493518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0300afc8-5c6d-4990-b48a-bdcb048a45eb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:17.494361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0300afc8-5c6d-4990-b48a-bdcb048a45eb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:17.517961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0300afc8-5c6d-4990-b48a-bdcb048a45eb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.519229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0300afc8-5c6d-4990-b48a-bdcb048a45eb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.521618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0300afc8-5c6d-4990-b48a-bdcb048a45eb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.526280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0300afc8-5c6d-4990-b48a-bdcb048a45eb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.526791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0300afc8-5c6d-4990-b48a-bdcb048a45eb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.527977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0300afc8-5c6d-4990-b48a-bdcb048a45eb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.626231 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-c25ad98e-fb5f-4871-a704-c1dac2a40d2e tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] HTTP exception thrown: Invalid IP protocol tempest-999-940488571. Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c25ad98e-fb5f-4871-a704-c1dac2a40d2e tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Request method failure captured: Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 156 Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqmuiKayvJWKlKeGkNg0AW769aHt6xwk2yGiKxrCZ86c2mJPJ8yHvERSEpgX8L-6y75o5SWCPnNXuYxO82K0dSYIMlJUtK3MBDlloQnn4_jH5mOobDnSfizA02_sOMCjGt6MfvCkvutvWqvrE1AUaV9YwdJK9slK-Dy-p6QeK3HpA4I Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:27:17.628128 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:27:17.629590 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9512b243ccd04f1a8601bd427a498a69"}]}] Oct 18 13:27:17.629590 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:17.629590 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:17.629590 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:17.629590 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:17.629590 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:27:17.629590 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:27:17.629590 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 393400befcaf46138e7add9efd8204ce Oct 18 13:27:17.629590 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:17.629590 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:27:17.629590 n-d-858384-13 devstack@n-api.service[120612]: {"security_group_rule": {"parent_group_id": "511257f1-cdb8-44bd-8404-779644f7447e", "ip_protocol": "tempest-999-940488571", "from_port": 22, "to_port": 22}} Oct 18 13:27:17.629590 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid IP protocol tempest-999-940488571. Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'security_group_rule': {'parent_group_id': '511257f1-cdb8-44bd-8404-779644f7447e', 'ip_protocol': 'tempest-999-940488571', 'from_port': 22, 'to_port': 22}}} Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-940488571. Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:17.630475 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-940488571. Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-940488571. Oct 18 13:27:17.632301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.634647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c25ad98e-fb5f-4871-a704-c1dac2a40d2e tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Returning 400 to user: Invalid IP protocol tempest-999-940488571. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:17.638524 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c25ad98e-fb5f-4871-a704-c1dac2a40d2e tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.161504 Oct 18 13:27:17.639336 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1181/2529] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:27:17 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:27:17.661773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-367e9c23-389e-435e-bcbf-d556293d8808 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:17.662590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-367e9c23-389e-435e-bcbf-d556293d8808 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:17.671563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-367e9c23-389e-435e-bcbf-d556293d8808 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.672396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-367e9c23-389e-435e-bcbf-d556293d8808 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.673058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-367e9c23-389e-435e-bcbf-d556293d8808 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.674086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-367e9c23-389e-435e-bcbf-d556293d8808 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.674753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-367e9c23-389e-435e-bcbf-d556293d8808 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.675533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-367e9c23-389e-435e-bcbf-d556293d8808 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.693324 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-367e9c23-389e-435e-bcbf-d556293d8808 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-367e9c23-389e-435e-bcbf-d556293d8808 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 HTTP/1.1 Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:27:17.697067 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:27:17.698302 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:27:17.698302 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:17.698302 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:17.698302 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:17.698302 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:17.698302 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:27:17.698302 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:27:17.698302 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:27:17.698302 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:17.698302 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:27:17.698302 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:17.698302 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290'} Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:17.699080 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:17.700147 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.702625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-367e9c23-389e-435e-bcbf-d556293d8808 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:17.703723 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-367e9c23-389e-435e-bcbf-d556293d8808 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 404 len: 111 microversion: 2.1 time: 0.063220 Oct 18 13:27:17.705446 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1182/2530] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:27:17 2022] DELETE /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:17.713224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-82247729-8551-47a1-b7fc-60d23d941e77 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Action: 'create', calling method: .version_select at 0x7ff60f7a23a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1706307113", "description": "tempest-description-182534694"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:17.889647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0300afc8-5c6d-4990-b48a-bdcb048a45eb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:17.900220 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0300afc8-5c6d-4990-b48a-bdcb048a45eb tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.413654 Oct 18 13:27:17.901044 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1349/2531] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:17 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:17.914443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2fdd2264-914f-4ec1-8629-3ec245ebe4b7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:17.915070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2fdd2264-914f-4ec1-8629-3ec245ebe4b7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:17.928018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fdd2264-914f-4ec1-8629-3ec245ebe4b7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.928571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fdd2264-914f-4ec1-8629-3ec245ebe4b7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.929064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fdd2264-914f-4ec1-8629-3ec245ebe4b7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.929774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fdd2264-914f-4ec1-8629-3ec245ebe4b7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.930033 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-82247729-8551-47a1-b7fc-60d23d941e77 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.221792 Oct 18 13:27:17.930246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fdd2264-914f-4ec1-8629-3ec245ebe4b7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.930653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fdd2264-914f-4ec1-8629-3ec245ebe4b7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.931747 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1183/2532] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:27:17 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:17.939688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8832c222-3db8-40f0-b842-9706276d4097 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:17.941539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8832c222-3db8-40f0-b842-9706276d4097 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:17.958928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8832c222-3db8-40f0-b842-9706276d4097 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.960680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8832c222-3db8-40f0-b842-9706276d4097 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.961422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8832c222-3db8-40f0-b842-9706276d4097 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.962432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8832c222-3db8-40f0-b842-9706276d4097 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:17.963129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8832c222-3db8-40f0-b842-9706276d4097 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:17.963710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8832c222-3db8-40f0-b842-9706276d4097 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:17.984886 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-2fdd2264-914f-4ec1-8629-3ec245ebe4b7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2fdd2264-914f-4ec1-8629-3ec245ebe4b7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 HTTP/1.1 Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:27:17.986955 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:27:17.988390 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:27:17.988390 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:17.988390 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:17.988390 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:17.988390 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:17.988390 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:27:17.988390 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:27:17.988390 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:27:17.988390 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:17.988390 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:27:17.988390 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:17.988390 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290'} Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:17.989237 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. Oct 18 13:27:17.994040 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:17.995251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2fdd2264-914f-4ec1-8629-3ec245ebe4b7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Instance dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:17.995251 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2fdd2264-914f-4ec1-8629-3ec245ebe4b7 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290" status: 404 len: 111 microversion: 2.1 time: 0.087059 Oct 18 13:27:17.995251 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1350/2533] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:17 2022] GET /compute/v2.1/servers/dc6d6cbd-a032-44d9-91a3-a0e1ad1b6290 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:18.000429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-33fa0f85-4652-40d0-a402-0f7cfe482537 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Action: 'create', calling method: .version_select at 0x7ff60ef648b0>, body: {"security_group_rule": {"parent_group_id": "d86f3e60-bcae-40a1-920c-f5cf1c1bdd70", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:18.060873 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-33fa0f85-4652-40d0-a402-0f7cfe482537 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-33fa0f85-4652-40d0-a402-0f7cfe482537 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Request method failure captured: Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 138 Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqmuiKayvJWKlKeGkNg0AW769aHt6xwk2yGiKxrCZ86c2mJPJ8yHvERSEpgX8L-6y75o5SWCPnNXuYxO82K0dSYIMlJUtK3MBDlloQnn4_jH5mOobDnSfizA02_sOMCjGt6MfvCkvutvWqvrE1AUaV9YwdJK9slK-Dy-p6QeK3HpA4I Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:27:18.063830 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:27:18.065321 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9512b243ccd04f1a8601bd427a498a69"}]}] Oct 18 13:27:18.065321 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:18.065321 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:18.065321 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:18.065321 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:18.065321 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:27:18.065321 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:27:18.065321 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 393400befcaf46138e7add9efd8204ce Oct 18 13:27:18.065321 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:18.065321 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:27:18.065321 n-d-858384-13 devstack@n-api.service[120611]: {"security_group_rule": {"parent_group_id": "d86f3e60-bcae-40a1-920c-f5cf1c1bdd70", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 18 13:27:18.065321 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd86f3e60-bcae-40a1-920c-f5cf1c1bdd70', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.066130 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 18 13:27:18.067552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.070642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-33fa0f85-4652-40d0-a402-0f7cfe482537 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:18.071709 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-33fa0f85-4652-40d0-a402-0f7cfe482537 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.081360 Oct 18 13:27:18.076991 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1351/2534] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:27:17 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:27:18.082932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3619060c-a19a-4348-9d89-119d5d3f486c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60ef04c10>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:18.166537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG neutronclient.v2_0.client [None req-3619060c-a19a-4348-9d89-119d5d3f486c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca does not exist", "detail": ""}} {{(pid=120611) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:27:18.167331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.security_group_api [None req-3619060c-a19a-4348-9d89-119d5d3f486c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Neutron security group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca not found {{(pid=120611) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:27:18.168029 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-3619060c-a19a-4348-9d89-119d5d3f486c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Security group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca does not exist Oct 18 13:27:18.168029 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-c49053b4-1bbe-4ea9-bc9a-a4ab77bd9b74'] Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3619060c-a19a-4348-9d89-119d5d3f486c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/os-security-groups/a41d1be5-f608-48c6-8ac4-a8a6d08ccdca HTTP/1.1 Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:27:18.170538 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:27:18.172087 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:27:18.172087 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.172087 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:18.172087 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.172087 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:18.172087 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:27:18.172087 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:27:18.172087 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:27:18.172087 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:18.172087 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:27:18.172087 n-d-858384-13 devstack@n-api.service[120611]: exception: Security group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca does not exist Oct 18 13:27:18.172087 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-c49053b4-1bbe-4ea9-bc9a-a4ab77bd9b74'] Oct 18 13:27:18.172087 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'a41d1be5-f608-48c6-8ac4-a8a6d08ccdca'} Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.173021 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca does not exist Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c49053b4-1bbe-4ea9-bc9a-a4ab77bd9b74'] Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:27:18.174976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca does not exist Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c49053b4-1bbe-4ea9-bc9a-a4ab77bd9b74'] Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca does not exist Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c49053b4-1bbe-4ea9-bc9a-a4ab77bd9b74'] Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.176225 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.178335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.178335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.178335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:18.178335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:18.178335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca does not exist Oct 18 13:27:18.178335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c49053b4-1bbe-4ea9-bc9a-a4ab77bd9b74'] Oct 18 13:27:18.178335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.181069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3619060c-a19a-4348-9d89-119d5d3f486c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Security group a41d1be5-f608-48c6-8ac4-a8a6d08ccdca does not exist Oct 18 13:27:18.181069 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-c49053b4-1bbe-4ea9-bc9a-a4ab77bd9b74'] {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:18.182496 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3619060c-a19a-4348-9d89-119d5d3f486c tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/a41d1be5-f608-48c6-8ac4-a8a6d08ccdca" status: 404 len: 194 microversion: 2.1 time: 0.104196 Oct 18 13:27:18.186556 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1352/2535] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:18 2022] DELETE /compute/v2.1/os-security-groups/a41d1be5-f608-48c6-8ac4-a8a6d08ccdca => generated 194 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:18.202587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e4bf83b-171a-49c3-8ff7-a2e5671e13fe tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Action: 'create', calling method: .version_select at 0x7ff60ef64670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-682391260", "description": "tempest-description-1735112131"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:18.245869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8832c222-3db8-40f0-b842-9706276d4097 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:18.261398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8832c222-3db8-40f0-b842-9706276d4097 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:18.264051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8832c222-3db8-40f0-b842-9706276d4097 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:18.266229 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8832c222-3db8-40f0-b842-9706276d4097 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.333265 Oct 18 13:27:18.281417 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1184/2536] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:17 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:18.290530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-54983c22-1652-4769-9bee-5ebf3aa2f625 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:18.291404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-54983c22-1652-4769-9bee-5ebf3aa2f625 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:18.298276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54983c22-1652-4769-9bee-5ebf3aa2f625 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:18.299020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54983c22-1652-4769-9bee-5ebf3aa2f625 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:18.299537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54983c22-1652-4769-9bee-5ebf3aa2f625 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:18.300173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54983c22-1652-4769-9bee-5ebf3aa2f625 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:18.300623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54983c22-1652-4769-9bee-5ebf3aa2f625 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:18.301125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54983c22-1652-4769-9bee-5ebf3aa2f625 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:18.488116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-54983c22-1652-4769-9bee-5ebf3aa2f625 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:18.500538 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-54983c22-1652-4769-9bee-5ebf3aa2f625 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.213715 Oct 18 13:27:18.513296 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1185/2537] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:18 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:18.513296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-203c86dc-b063-4330-8255-8150b5fbd73e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60f5dbaf0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:18.538840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-203c86dc-b063-4330-8255-8150b5fbd73e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 129ad497-f01f-483e-b3d2-1d74291ab2b6 does not exist", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:27:18.540194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.security_group_api [None req-203c86dc-b063-4330-8255-8150b5fbd73e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Neutron security group 129ad497-f01f-483e-b3d2-1d74291ab2b6 not found {{(pid=120612) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:27:18.540984 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-203c86dc-b063-4330-8255-8150b5fbd73e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Security group 129ad497-f01f-483e-b3d2-1d74291ab2b6 does not exist Oct 18 13:27:18.540984 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-07b637c0-20ea-451e-984d-f91d01db5648'] Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-203c86dc-b063-4330-8255-8150b5fbd73e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-security-groups/129ad497-f01f-483e-b3d2-1d74291ab2b6 HTTP/1.1 Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:27:18.543204 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:27:18.544634 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:27:18.544634 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.544634 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:18.544634 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.544634 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:18.544634 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:27:18.544634 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:27:18.544634 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:27:18.544634 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:18.544634 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:27:18.544634 n-d-858384-13 devstack@n-api.service[120612]: exception: Security group 129ad497-f01f-483e-b3d2-1d74291ab2b6 does not exist Oct 18 13:27:18.544634 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-07b637c0-20ea-451e-984d-f91d01db5648'] Oct 18 13:27:18.544634 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '129ad497-f01f-483e-b3d2-1d74291ab2b6'} Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.545525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 129ad497-f01f-483e-b3d2-1d74291ab2b6 does not exist Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07b637c0-20ea-451e-984d-f91d01db5648'] Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:27:18.546863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 129ad497-f01f-483e-b3d2-1d74291ab2b6 does not exist Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07b637c0-20ea-451e-984d-f91d01db5648'] Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 129ad497-f01f-483e-b3d2-1d74291ab2b6 does not exist Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07b637c0-20ea-451e-984d-f91d01db5648'] Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.548037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.549540 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.549540 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.549540 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:18.549540 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:18.549540 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 129ad497-f01f-483e-b3d2-1d74291ab2b6 does not exist Oct 18 13:27:18.549540 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07b637c0-20ea-451e-984d-f91d01db5648'] Oct 18 13:27:18.549540 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.549540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-203c86dc-b063-4330-8255-8150b5fbd73e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Security group 129ad497-f01f-483e-b3d2-1d74291ab2b6 does not exist Oct 18 13:27:18.549540 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-07b637c0-20ea-451e-984d-f91d01db5648'] {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:18.549540 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-203c86dc-b063-4330-8255-8150b5fbd73e tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/129ad497-f01f-483e-b3d2-1d74291ab2b6" status: 404 len: 194 microversion: 2.1 time: 0.043154 Oct 18 13:27:18.550237 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1186/2538] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:18 2022] DELETE /compute/v2.1/os-security-groups/129ad497-f01f-483e-b3d2-1d74291ab2b6 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:18.557632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e8b83f9-adfb-4f2b-b29f-dce8cdf9bf0d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:18.558263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4e8b83f9-adfb-4f2b-b29f-dce8cdf9bf0d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:18.566243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e8b83f9-adfb-4f2b-b29f-dce8cdf9bf0d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:18.566724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e8b83f9-adfb-4f2b-b29f-dce8cdf9bf0d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:18.567155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e8b83f9-adfb-4f2b-b29f-dce8cdf9bf0d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:18.568367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e8b83f9-adfb-4f2b-b29f-dce8cdf9bf0d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:18.568828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e8b83f9-adfb-4f2b-b29f-dce8cdf9bf0d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:18.570419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e8b83f9-adfb-4f2b-b29f-dce8cdf9bf0d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:18.665516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-4e8b83f9-adfb-4f2b-b29f-dce8cdf9bf0d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:18.690835 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4e8b83f9-adfb-4f2b-b29f-dce8cdf9bf0d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.139538 Oct 18 13:27:18.691908 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1187/2539] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:18 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:18.699371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6470d837-7f11-4e5b-8689-65b2a6d0205b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60f5f3550>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:18.727528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-6470d837-7f11-4e5b-8689-65b2a6d0205b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:27:18.728212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.security_group_api [None req-6470d837-7f11-4e5b-8689-65b2a6d0205b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Neutron security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 not found {{(pid=120612) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:27:18.729337 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-6470d837-7f11-4e5b-8689-65b2a6d0205b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:27:18.729337 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-09268807-b4bb-47e3-a2c2-da56d1a59413'] Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6470d837-7f11-4e5b-8689-65b2a6d0205b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-security-groups/ca7a3cd5-35c6-423e-b3f3-26759c666e65 HTTP/1.1 Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:27:18.731811 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:27:18.733401 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:27:18.733401 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.733401 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:18.733401 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.733401 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:18.733401 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:27:18.733401 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:27:18.733401 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:27:18.733401 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:18.733401 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:27:18.733401 n-d-858384-13 devstack@n-api.service[120612]: exception: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:27:18.733401 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-09268807-b4bb-47e3-a2c2-da56d1a59413'] Oct 18 13:27:18.733401 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'ca7a3cd5-35c6-423e-b3f3-26759c666e65'} Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.734215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09268807-b4bb-47e3-a2c2-da56d1a59413'] Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:27:18.735439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09268807-b4bb-47e3-a2c2-da56d1a59413'] Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09268807-b4bb-47e3-a2c2-da56d1a59413'] Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.736615 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.737967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.737967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.737967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:18.737967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:18.737967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:27:18.737967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09268807-b4bb-47e3-a2c2-da56d1a59413'] Oct 18 13:27:18.737967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.737967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6470d837-7f11-4e5b-8689-65b2a6d0205b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Security group ca7a3cd5-35c6-423e-b3f3-26759c666e65 does not exist Oct 18 13:27:18.737967 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-09268807-b4bb-47e3-a2c2-da56d1a59413'] {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:18.737967 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6470d837-7f11-4e5b-8689-65b2a6d0205b tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/ca7a3cd5-35c6-423e-b3f3-26759c666e65" status: 404 len: 194 microversion: 2.1 time: 0.040233 Oct 18 13:27:18.738688 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1188/2540] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:18 2022] DELETE /compute/v2.1/os-security-groups/ca7a3cd5-35c6-423e-b3f3-26759c666e65 => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:18.745293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35f7ac59-7ae7-4837-afcd-6359e8770655 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60f80ad30>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:18.764980 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7e4bf83b-171a-49c3-8ff7-a2e5671e13fe tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.576035 Oct 18 13:27:18.775570 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1353/2541] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:27:18 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:18.781059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9490fa0a-f107-4b26-8480-87585d48d257 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Action: 'create', calling method: .version_select at 0x7ff60efe0700>, body: {"security_group_rule": {"parent_group_id": "766be1f5-6c01-481d-bb39-d6fd4d0716fa", "ip_protocol": "tcp", "from_port": 22, "to_port": 690310722}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:18.785761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-35f7ac59-7ae7-4837-afcd-6359e8770655 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:27:18.786573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.security_group_api [None req-35f7ac59-7ae7-4837-afcd-6359e8770655 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Neutron security group 511394d9-89f4-4e10-93f8-714a994d214f not found {{(pid=120612) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:27:18.787236 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-35f7ac59-7ae7-4837-afcd-6359e8770655 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:27:18.787236 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-ceb46b36-ad3e-4564-b3c7-db59924add6c'] Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35f7ac59-7ae7-4837-afcd-6359e8770655 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-security-groups/511394d9-89f4-4e10-93f8-714a994d214f HTTP/1.1 Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:27:18.791940 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:27:18.793513 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:27:18.793513 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.793513 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:18.793513 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.793513 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:18.793513 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:27:18.793513 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:27:18.793513 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:27:18.793513 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:18.793513 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:27:18.793513 n-d-858384-13 devstack@n-api.service[120612]: exception: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:27:18.793513 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-ceb46b36-ad3e-4564-b3c7-db59924add6c'] Oct 18 13:27:18.793513 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '511394d9-89f4-4e10-93f8-714a994d214f'} Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.794232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ceb46b36-ad3e-4564-b3c7-db59924add6c'] Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:27:18.795310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ceb46b36-ad3e-4564-b3c7-db59924add6c'] Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ceb46b36-ad3e-4564-b3c7-db59924add6c'] Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.796264 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.797483 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.797483 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.797483 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:18.797483 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:18.797483 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:27:18.797483 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ceb46b36-ad3e-4564-b3c7-db59924add6c'] Oct 18 13:27:18.797483 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.797483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35f7ac59-7ae7-4837-afcd-6359e8770655 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Security group 511394d9-89f4-4e10-93f8-714a994d214f does not exist Oct 18 13:27:18.797483 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-ceb46b36-ad3e-4564-b3c7-db59924add6c'] {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:18.797483 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-35f7ac59-7ae7-4837-afcd-6359e8770655 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/511394d9-89f4-4e10-93f8-714a994d214f" status: 404 len: 194 microversion: 2.1 time: 0.054266 Oct 18 13:27:18.799641 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1189/2542] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:18 2022] DELETE /compute/v2.1/os-security-groups/511394d9-89f4-4e10-93f8-714a994d214f => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:18.804967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7d88ef8b-3c85-4b4a-aa49-247b28d6707f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60f801310>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:18.830192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-7d88ef8b-3c85-4b4a-aa49-247b28d6707f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:27:18.830828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.security_group_api [None req-7d88ef8b-3c85-4b4a-aa49-247b28d6707f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Neutron security group c1ac03d1-4310-4ce6-b818-63e5ed18323d not found {{(pid=120612) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:27:18.831376 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-7d88ef8b-3c85-4b4a-aa49-247b28d6707f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:27:18.831376 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-0cd7d7a8-bb6e-47b2-a109-fb621131c2b9'] Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7d88ef8b-3c85-4b4a-aa49-247b28d6707f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-security-groups/c1ac03d1-4310-4ce6-b818-63e5ed18323d HTTP/1.1 Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:27:18.834121 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:27:18.836199 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:27:18.836199 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.836199 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:18.836199 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.836199 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:18.836199 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:27:18.836199 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:27:18.836199 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:27:18.836199 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:18.836199 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:27:18.836199 n-d-858384-13 devstack@n-api.service[120612]: exception: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:27:18.836199 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-0cd7d7a8-bb6e-47b2-a109-fb621131c2b9'] Oct 18 13:27:18.836199 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c1ac03d1-4310-4ce6-b818-63e5ed18323d'} Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.836908 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0cd7d7a8-bb6e-47b2-a109-fb621131c2b9'] Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:27:18.837932 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0cd7d7a8-bb6e-47b2-a109-fb621131c2b9'] Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0cd7d7a8-bb6e-47b2-a109-fb621131c2b9'] Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.839037 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.842544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.842544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.842544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:18.842544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:18.842544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:27:18.842544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0cd7d7a8-bb6e-47b2-a109-fb621131c2b9'] Oct 18 13:27:18.842544 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.842544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7d88ef8b-3c85-4b4a-aa49-247b28d6707f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Security group c1ac03d1-4310-4ce6-b818-63e5ed18323d does not exist Oct 18 13:27:18.842544 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-0cd7d7a8-bb6e-47b2-a109-fb621131c2b9'] {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:18.842544 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7d88ef8b-3c85-4b4a-aa49-247b28d6707f tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/c1ac03d1-4310-4ce6-b818-63e5ed18323d" status: 404 len: 194 microversion: 2.1 time: 0.035867 Oct 18 13:27:18.842544 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1190/2543] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:18 2022] DELETE /compute/v2.1/os-security-groups/c1ac03d1-4310-4ce6-b818-63e5ed18323d => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:18.847470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-06756fb5-204f-4ef1-9aa3-c4140a7b2f38 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60f7df310>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:18.890967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-06756fb5-204f-4ef1-9aa3-c4140a7b2f38 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:27:18.891678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.security_group_api [None req-06756fb5-204f-4ef1-9aa3-c4140a7b2f38 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Neutron security group 2adacd38-4a1e-40b3-a102-e14c9495706c not found {{(pid=120612) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:27:18.892323 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-06756fb5-204f-4ef1-9aa3-c4140a7b2f38 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:27:18.892323 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-d0ed625f-6e35-458b-81b9-401bf14b0379'] Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-06756fb5-204f-4ef1-9aa3-c4140a7b2f38 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-security-groups/2adacd38-4a1e-40b3-a102-e14c9495706c HTTP/1.1 Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:27:18.895228 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:27:18.896719 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:27:18.896719 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.896719 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:18.896719 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:18.896719 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:18.896719 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:27:18.896719 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:27:18.896719 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:27:18.896719 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:18.896719 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:27:18.896719 n-d-858384-13 devstack@n-api.service[120612]: exception: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:27:18.896719 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-d0ed625f-6e35-458b-81b9-401bf14b0379'] Oct 18 13:27:18.896719 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '2adacd38-4a1e-40b3-a102-e14c9495706c'} Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.898330 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0ed625f-6e35-458b-81b9-401bf14b0379'] Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:27:18.900281 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0ed625f-6e35-458b-81b9-401bf14b0379'] Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0ed625f-6e35-458b-81b9-401bf14b0379'] Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.901597 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.902891 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.902891 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.902891 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:18.902891 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:18.902891 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:27:18.902891 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0ed625f-6e35-458b-81b9-401bf14b0379'] Oct 18 13:27:18.902891 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.902891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-06756fb5-204f-4ef1-9aa3-c4140a7b2f38 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Security group 2adacd38-4a1e-40b3-a102-e14c9495706c does not exist Oct 18 13:27:18.902891 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-d0ed625f-6e35-458b-81b9-401bf14b0379'] {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:18.908469 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-06756fb5-204f-4ef1-9aa3-c4140a7b2f38 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/2adacd38-4a1e-40b3-a102-e14c9495706c" status: 404 len: 194 microversion: 2.1 time: 0.062538 Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-9490fa0a-f107-4b26-8480-87585d48d257 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] HTTP exception thrown: Invalid port range 22:690310722. Valid TCP ports should be between 1-65535 Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9490fa0a-f107-4b26-8480-87585d48d257 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Request method failure captured: Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 145 Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqmuiKayvJWKlKeGkNg0AW769aHt6xwk2yGiKxrCZ86c2mJPJ8yHvERSEpgX8L-6y75o5SWCPnNXuYxO82K0dSYIMlJUtK3MBDlloQnn4_jH5mOobDnSfizA02_sOMCjGt6MfvCkvutvWqvrE1AUaV9YwdJK9slK-Dy-p6QeK3HpA4I Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:27:18.908693 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:27:18.913258 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9512b243ccd04f1a8601bd427a498a69"}]}] Oct 18 13:27:18.913258 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:18.913258 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:18.913258 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:18.913258 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:18.913258 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:27:18.913258 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:27:18.913258 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 393400befcaf46138e7add9efd8204ce Oct 18 13:27:18.913258 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:18.913258 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:27:18.913258 n-d-858384-13 devstack@n-api.service[120611]: {"security_group_rule": {"parent_group_id": "766be1f5-6c01-481d-bb39-d6fd4d0716fa", "ip_protocol": "tcp", "from_port": 22, "to_port": 690310722}} Oct 18 13:27:18.913258 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid port range 22:690310722. Valid TCP ports should be between 1-65535 Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'security_group_rule': {'parent_group_id': '766be1f5-6c01-481d-bb39-d6fd4d0716fa', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 690310722}}} Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:690310722. Valid TCP ports should be between 1-65535 Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.914764 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:690310722. Valid TCP ports should be between 1-65535 Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:690310722. Valid TCP ports should be between 1-65535 Oct 18 13:27:18.919334 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:18.922017 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1191/2544] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:18 2022] DELETE /compute/v2.1/os-security-groups/2adacd38-4a1e-40b3-a102-e14c9495706c => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:18.922017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-99256c10-85ac-45aa-bfef-896088bb6332 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:18.922017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-99256c10-85ac-45aa-bfef-896088bb6332 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:18.923651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9490fa0a-f107-4b26-8480-87585d48d257 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Returning 400 to user: Invalid port range 22:690310722. Valid TCP ports should be between 1-65535 {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:18.924896 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9490fa0a-f107-4b26-8480-87585d48d257 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.147823 Oct 18 13:27:18.925020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99256c10-85ac-45aa-bfef-896088bb6332 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:18.925541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99256c10-85ac-45aa-bfef-896088bb6332 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:18.926036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99256c10-85ac-45aa-bfef-896088bb6332 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:18.931850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99256c10-85ac-45aa-bfef-896088bb6332 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:18.931850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99256c10-85ac-45aa-bfef-896088bb6332 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:18.931850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99256c10-85ac-45aa-bfef-896088bb6332 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:18.933160 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1354/2545] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:27:18 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:27:18.944560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5477163c-aaf9-4edd-aab9-996c174fd1e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:18.945967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5477163c-aaf9-4edd-aab9-996c174fd1e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:18.956561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5477163c-aaf9-4edd-aab9-996c174fd1e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:18.958114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5477163c-aaf9-4edd-aab9-996c174fd1e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:18.958864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5477163c-aaf9-4edd-aab9-996c174fd1e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:18.960412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5477163c-aaf9-4edd-aab9-996c174fd1e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:18.961088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5477163c-aaf9-4edd-aab9-996c174fd1e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:18.961824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5477163c-aaf9-4edd-aab9-996c174fd1e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:18.965101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-99256c10-85ac-45aa-bfef-896088bb6332 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:27:19.041072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:19.084170 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-99256c10-85ac-45aa-bfef-896088bb6332 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 204 len: 0 microversion: 2.1 time: 0.171911 Oct 18 13:27:19.084170 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1192/2546] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:27:18 2022] DELETE /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:27:19.094551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f43d0877-b065-41a2-aed2-ab75176eaa7e tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Action: 'create', calling method: .version_select at 0x7ff60f7df040>, body: {"security_group_rule": {"parent_group_id": "88e3384c-00f5-4784-857b-5b08f13eaffa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:19.130530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-f43d0877-b065-41a2-aed2-ab75176eaa7e tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 88e3384c-00f5-4784-857b-5b08f13eaffa does not exist", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:27:19.131203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.security_group_api [None req-f43d0877-b065-41a2-aed2-ab75176eaa7e tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Neutron security group 88e3384c-00f5-4784-857b-5b08f13eaffa not found {{(pid=120612) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:27:19.132406 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-f43d0877-b065-41a2-aed2-ab75176eaa7e tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] HTTP exception thrown: Security group 88e3384c-00f5-4784-857b-5b08f13eaffa does not exist Oct 18 13:27:19.132406 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-0dd33c91-1756-4882-bfcf-450cf087f783'] Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f43d0877-b065-41a2-aed2-ab75176eaa7e tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Request method failure captured: Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 138 Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqmuiKayvJWKlKeGkNg0AW769aHt6xwk2yGiKxrCZ86c2mJPJ8yHvERSEpgX8L-6y75o5SWCPnNXuYxO82K0dSYIMlJUtK3MBDlloQnn4_jH5mOobDnSfizA02_sOMCjGt6MfvCkvutvWqvrE1AUaV9YwdJK9slK-Dy-p6QeK3HpA4I Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:27:19.135165 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:27:19.136511 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9512b243ccd04f1a8601bd427a498a69"}]}] Oct 18 13:27:19.136511 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:19.136511 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:19.136511 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:19.136511 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:19.136511 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:27:19.136511 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:27:19.136511 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 393400befcaf46138e7add9efd8204ce Oct 18 13:27:19.136511 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:19.136511 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:27:19.136511 n-d-858384-13 devstack@n-api.service[120612]: {"security_group_rule": {"parent_group_id": "88e3384c-00f5-4784-857b-5b08f13eaffa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 18 13:27:19.136511 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: exception: Security group 88e3384c-00f5-4784-857b-5b08f13eaffa does not exist Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-0dd33c91-1756-4882-bfcf-450cf087f783'] Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'security_group_rule': {'parent_group_id': '88e3384c-00f5-4784-857b-5b08f13eaffa', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:27:19.137162 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 88e3384c-00f5-4784-857b-5b08f13eaffa does not exist Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0dd33c91-1756-4882-bfcf-450cf087f783'] Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 18 13:27:19.138212 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 88e3384c-00f5-4784-857b-5b08f13eaffa does not exist Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0dd33c91-1756-4882-bfcf-450cf087f783'] Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 88e3384c-00f5-4784-857b-5b08f13eaffa does not exist Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0dd33c91-1756-4882-bfcf-450cf087f783'] Oct 18 13:27:19.139241 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.140381 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:19.140381 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.140381 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:19.140381 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:19.140381 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:19.140381 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:19.140381 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:19.140381 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 88e3384c-00f5-4784-857b-5b08f13eaffa does not exist Oct 18 13:27:19.140381 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0dd33c91-1756-4882-bfcf-450cf087f783'] Oct 18 13:27:19.140381 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.140381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f43d0877-b065-41a2-aed2-ab75176eaa7e tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Returning 404 to user: Security group 88e3384c-00f5-4784-857b-5b08f13eaffa does not exist Oct 18 13:27:19.140381 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-0dd33c91-1756-4882-bfcf-450cf087f783'] {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:19.140381 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f43d0877-b065-41a2-aed2-ab75176eaa7e tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.052639 Oct 18 13:27:19.141102 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1193/2547] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:27:19 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:19.146612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-182a5a59-c341-45e1-aa85-33cc5fe9a223 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:19.147689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-182a5a59-c341-45e1-aa85-33cc5fe9a223 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:19.156199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-182a5a59-c341-45e1-aa85-33cc5fe9a223 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:19.157028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-182a5a59-c341-45e1-aa85-33cc5fe9a223 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:19.157708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-182a5a59-c341-45e1-aa85-33cc5fe9a223 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:19.158488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-182a5a59-c341-45e1-aa85-33cc5fe9a223 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:19.159092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-182a5a59-c341-45e1-aa85-33cc5fe9a223 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:19.159595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-182a5a59-c341-45e1-aa85-33cc5fe9a223 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:19.285037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5477163c-aaf9-4edd-aab9-996c174fd1e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:19.297718 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5477163c-aaf9-4edd-aab9-996c174fd1e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.360371 Oct 18 13:27:19.300831 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1355/2548] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:18 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:19.316974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-40f7303c-29d0-4438-aa96-b19dcf01e16a tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Calling method '.version_select at 0x7ff617ad59d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:19.419853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-182a5a59-c341-45e1-aa85-33cc5fe9a223 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:19.437882 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-182a5a59-c341-45e1-aa85-33cc5fe9a223 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1647 microversion: 2.1 time: 0.295877 Oct 18 13:27:19.459263 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1194/2549] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:19 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1647 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:19.468069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e1ac4b7-5fee-4ec2-aa50-ce45eb3a41fb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:19.469065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0e1ac4b7-5fee-4ec2-aa50-ce45eb3a41fb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:19.479559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e1ac4b7-5fee-4ec2-aa50-ce45eb3a41fb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:19.480055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e1ac4b7-5fee-4ec2-aa50-ce45eb3a41fb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:19.480491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e1ac4b7-5fee-4ec2-aa50-ce45eb3a41fb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:19.481248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e1ac4b7-5fee-4ec2-aa50-ce45eb3a41fb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:19.481703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e1ac4b7-5fee-4ec2-aa50-ce45eb3a41fb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:19.482129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e1ac4b7-5fee-4ec2-aa50-ce45eb3a41fb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:19.746890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG neutronclient.v2_0.client [None req-40f7303c-29d0-4438-aa96-b19dcf01e16a tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 40e3d024-9257-4b06-9d6a-778c37b5319d does not exist", "detail": ""}} {{(pid=120611) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:27:19.749135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.security_group_api [None req-40f7303c-29d0-4438-aa96-b19dcf01e16a tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Neutron security group rule 40e3d024-9257-4b06-9d6a-778c37b5319d not found {{(pid=120611) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 18 13:27:19.749844 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-40f7303c-29d0-4438-aa96-b19dcf01e16a tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] HTTP exception thrown: Security group rule 40e3d024-9257-4b06-9d6a-778c37b5319d does not exist Oct 18 13:27:19.749844 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-56ba85b9-53fd-419d-89cc-5cc43732a346'] Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-40f7303c-29d0-4438-aa96-b19dcf01e16a tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Request method failure captured: Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/os-security-group-rules/40e3d024-9257-4b06-9d6a-778c37b5319d HTTP/1.1 Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqmuiKayvJWKlKeGkNg0AW769aHt6xwk2yGiKxrCZ86c2mJPJ8yHvERSEpgX8L-6y75o5SWCPnNXuYxO82K0dSYIMlJUtK3MBDlloQnn4_jH5mOobDnSfizA02_sOMCjGt6MfvCkvutvWqvrE1AUaV9YwdJK9slK-Dy-p6QeK3HpA4I Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:27:19.752478 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:27:19.754003 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9512b243ccd04f1a8601bd427a498a69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9512b243ccd04f1a8601bd427a498a69"}]}] Oct 18 13:27:19.754003 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:19.754003 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 9512b243ccd04f1a8601bd427a498a69 Oct 18 13:27:19.754003 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457 Oct 18 13:27:19.754003 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:19.754003 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:27:19.754003 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:27:19.754003 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 393400befcaf46138e7add9efd8204ce Oct 18 13:27:19.754003 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project Oct 18 13:27:19.754003 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:27:19.754003 n-d-858384-13 devstack@n-api.service[120611]: exception: Security group rule 40e3d024-9257-4b06-9d6a-778c37b5319d does not exist Oct 18 13:27:19.754003 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-56ba85b9-53fd-419d-89cc-5cc43732a346'] Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '40e3d024-9257-4b06-9d6a-778c37b5319d'} Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:19.754843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 40e3d024-9257-4b06-9d6a-778c37b5319d does not exist Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56ba85b9-53fd-419d-89cc-5cc43732a346'] Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 18 13:27:19.756103 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 40e3d024-9257-4b06-9d6a-778c37b5319d does not exist Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56ba85b9-53fd-419d-89cc-5cc43732a346'] Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 40e3d024-9257-4b06-9d6a-778c37b5319d does not exist Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56ba85b9-53fd-419d-89cc-5cc43732a346'] Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.758027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:19.759319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.759319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:19.759319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:19.759319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:19.759319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:19.759319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:19.759319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 40e3d024-9257-4b06-9d6a-778c37b5319d does not exist Oct 18 13:27:19.759319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-56ba85b9-53fd-419d-89cc-5cc43732a346'] Oct 18 13:27:19.759319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:19.761332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-40f7303c-29d0-4438-aa96-b19dcf01e16a tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Returning 404 to user: Security group rule 40e3d024-9257-4b06-9d6a-778c37b5319d does not exist Oct 18 13:27:19.761332 n-d-858384-13 devstack@n-api.service[120611]: Neutron server returns request_ids: ['req-56ba85b9-53fd-419d-89cc-5cc43732a346'] {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:19.761829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e1ac4b7-5fee-4ec2-aa50-ce45eb3a41fb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:19.762648 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-40f7303c-29d0-4438-aa96-b19dcf01e16a tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/40e3d024-9257-4b06-9d6a-778c37b5319d" status: 404 len: 199 microversion: 2.1 time: 0.460590 Oct 18 13:27:19.763379 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1356/2550] 10.222.0.40 () {58 vars in 1287 bytes} [Tue Oct 18 13:27:19 2022] DELETE /compute/v2.1/os-security-group-rules/40e3d024-9257-4b06-9d6a-778c37b5319d => generated 199 bytes in 462 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:19.773057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a3c52a96-30df-4aac-972d-74680b0e262d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:19.774445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e1ac4b7-5fee-4ec2-aa50-ce45eb3a41fb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:19.776108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e1ac4b7-5fee-4ec2-aa50-ce45eb3a41fb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:19.776244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a3c52a96-30df-4aac-972d-74680b0e262d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:19.777619 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e1ac4b7-5fee-4ec2-aa50-ce45eb3a41fb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.317166 Oct 18 13:27:19.795107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3c52a96-30df-4aac-972d-74680b0e262d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:19.795817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3c52a96-30df-4aac-972d-74680b0e262d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:19.796406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3c52a96-30df-4aac-972d-74680b0e262d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:19.797323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3c52a96-30df-4aac-972d-74680b0e262d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:19.797926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3c52a96-30df-4aac-972d-74680b0e262d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:19.798144 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1195/2551] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:19 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:19.801635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3c52a96-30df-4aac-972d-74680b0e262d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:19.806436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-24bd0885-c4ad-4b90-b5d3-615144bc3023 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:19.807465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-24bd0885-c4ad-4b90-b5d3-615144bc3023 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:19.814892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24bd0885-c4ad-4b90-b5d3-615144bc3023 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:19.815638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24bd0885-c4ad-4b90-b5d3-615144bc3023 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:19.816983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24bd0885-c4ad-4b90-b5d3-615144bc3023 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:19.818772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24bd0885-c4ad-4b90-b5d3-615144bc3023 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:19.820214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24bd0885-c4ad-4b90-b5d3-615144bc3023 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:19.821574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24bd0885-c4ad-4b90-b5d3-615144bc3023 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:19.932297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-24bd0885-c4ad-4b90-b5d3-615144bc3023 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:19.971589 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-24bd0885-c4ad-4b90-b5d3-615144bc3023 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.171832 Oct 18 13:27:19.972778 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1196/2552] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:19 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:19.979831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1116e8df-1577-4d53-b324-d068d70968ec tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Calling method '.version_select at 0x7ff60f7a23a0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:20.175500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a3c52a96-30df-4aac-972d-74680b0e262d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:20.184899 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a3c52a96-30df-4aac-972d-74680b0e262d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.420339 Oct 18 13:27:20.189455 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1357/2553] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:19 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:20.212592 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1116e8df-1577-4d53-b324-d068d70968ec tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/766be1f5-6c01-481d-bb39-d6fd4d0716fa" status: 202 len: 0 microversion: 2.1 time: 0.238417 Oct 18 13:27:20.213415 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1197/2554] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:19 2022] DELETE /compute/v2.1/os-security-groups/766be1f5-6c01-481d-bb39-d6fd4d0716fa => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:20.223228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-90c6710e-bead-4028-b5cd-608b9d2c67d6 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Calling method '.version_select at 0x7ff60efbaaf0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:20.325553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-75bc5f86-5bfd-40c2-824d-aa4b2fab2ebc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:20.326253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-75bc5f86-5bfd-40c2-824d-aa4b2fab2ebc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:20.337098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75bc5f86-5bfd-40c2-824d-aa4b2fab2ebc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:20.338032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75bc5f86-5bfd-40c2-824d-aa4b2fab2ebc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:20.338148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75bc5f86-5bfd-40c2-824d-aa4b2fab2ebc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:20.338873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75bc5f86-5bfd-40c2-824d-aa4b2fab2ebc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:20.339333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75bc5f86-5bfd-40c2-824d-aa4b2fab2ebc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:20.339762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75bc5f86-5bfd-40c2-824d-aa4b2fab2ebc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:20.549214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-75bc5f86-5bfd-40c2-824d-aa4b2fab2ebc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:20.571229 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-75bc5f86-5bfd-40c2-824d-aa4b2fab2ebc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.251037 Oct 18 13:27:20.588420 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1198/2555] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:20 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:20.597577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fdb907e6-72f1-4602-b557-f2fc6bda7018 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:20.598368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fdb907e6-72f1-4602-b557-f2fc6bda7018 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:20.605976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdb907e6-72f1-4602-b557-f2fc6bda7018 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:20.606466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdb907e6-72f1-4602-b557-f2fc6bda7018 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:20.606896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdb907e6-72f1-4602-b557-f2fc6bda7018 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:20.607771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdb907e6-72f1-4602-b557-f2fc6bda7018 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:20.608465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdb907e6-72f1-4602-b557-f2fc6bda7018 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:20.608894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdb907e6-72f1-4602-b557-f2fc6bda7018 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:20.906092 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-90c6710e-bead-4028-b5cd-608b9d2c67d6 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/d86f3e60-bcae-40a1-920c-f5cf1c1bdd70" status: 202 len: 0 microversion: 2.1 time: 0.685907 Oct 18 13:27:20.908503 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1358/2556] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:20 2022] DELETE /compute/v2.1/os-security-groups/d86f3e60-bcae-40a1-920c-f5cf1c1bdd70 => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:20.915408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed420f3e-de78-45cb-b369-fdbd35777085 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:20.916631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ed420f3e-de78-45cb-b369-fdbd35777085 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:20.939590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed420f3e-de78-45cb-b369-fdbd35777085 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:20.941463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed420f3e-de78-45cb-b369-fdbd35777085 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:20.941984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed420f3e-de78-45cb-b369-fdbd35777085 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:20.943941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed420f3e-de78-45cb-b369-fdbd35777085 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:20.946243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed420f3e-de78-45cb-b369-fdbd35777085 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:20.953985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed420f3e-de78-45cb-b369-fdbd35777085 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:21.047454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fdb907e6-72f1-4602-b557-f2fc6bda7018 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:21.061064 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fdb907e6-72f1-4602-b557-f2fc6bda7018 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1647 microversion: 2.1 time: 0.467654 Oct 18 13:27:21.062026 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1199/2557] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:20 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1647 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:21.066524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ac2a1ce4-28e5-44ec-bf4b-74b7fa4a3103 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Calling method '.version_select at 0x7ff60f770d30>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:21.320264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ed420f3e-de78-45cb-b369-fdbd35777085 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:21.335425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ed420f3e-de78-45cb-b369-fdbd35777085 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:21.338141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ed420f3e-de78-45cb-b369-fdbd35777085 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:21.339739 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ed420f3e-de78-45cb-b369-fdbd35777085 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.429940 Oct 18 13:27:21.353222 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1359/2558] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:20 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:21.359353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6c687e86-3995-45e8-8fb2-4976841a05d0 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:21.360222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6c687e86-3995-45e8-8fb2-4976841a05d0 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:21.367999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c687e86-3995-45e8-8fb2-4976841a05d0 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:21.369033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c687e86-3995-45e8-8fb2-4976841a05d0 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:21.369589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c687e86-3995-45e8-8fb2-4976841a05d0 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:21.373566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c687e86-3995-45e8-8fb2-4976841a05d0 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:21.374071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c687e86-3995-45e8-8fb2-4976841a05d0 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:21.377828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c687e86-3995-45e8-8fb2-4976841a05d0 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:21.470566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-6c687e86-3995-45e8-8fb2-4976841a05d0 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:21.505834 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6c687e86-3995-45e8-8fb2-4976841a05d0 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.158529 Oct 18 13:27:21.506641 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1360/2559] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:21 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:21.512501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c4ac206-3fe8-47cb-9ad1-86ea2dbdb06b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:21.513506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c4ac206-3fe8-47cb-9ad1-86ea2dbdb06b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:21.521449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c4ac206-3fe8-47cb-9ad1-86ea2dbdb06b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:21.523223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c4ac206-3fe8-47cb-9ad1-86ea2dbdb06b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:21.523910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c4ac206-3fe8-47cb-9ad1-86ea2dbdb06b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:21.525133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c4ac206-3fe8-47cb-9ad1-86ea2dbdb06b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:21.525823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c4ac206-3fe8-47cb-9ad1-86ea2dbdb06b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:21.527405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c4ac206-3fe8-47cb-9ad1-86ea2dbdb06b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:21.629420 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ac2a1ce4-28e5-44ec-bf4b-74b7fa4a3103 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/511257f1-cdb8-44bd-8404-779644f7447e" status: 202 len: 0 microversion: 2.1 time: 0.565070 Oct 18 13:27:21.632655 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1200/2560] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:21 2022] DELETE /compute/v2.1/os-security-groups/511257f1-cdb8-44bd-8404-779644f7447e => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:21.695875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-58006557", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "5c46f408-47ff-4146-8ccb-50d5c1f67c4b"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:21.750237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3c4ac206-3fe8-47cb-9ad1-86ea2dbdb06b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:21.758267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] validate_networks() for [('5c46f408-47ff-4146-8ccb-50d5c1f67c4b', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:27:21.759387 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c4ac206-3fe8-47cb-9ad1-86ea2dbdb06b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.250825 Oct 18 13:27:21.759977 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1361/2561] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:21 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:21.770911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ac8f0024-db81-4ce4-9d27-9594623b9ee6 req-8fb0121d-2694-425f-9f95-d49ab54b71ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157af106-c39d-428a-9cd7-1d37cd98bfcc", "name": "network-vif-deleted", "tag": "eade7ea5-b653-468d-aaa4-2b40848f80bd"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:21.783628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ac8f0024-db81-4ce4-9d27-9594623b9ee6 req-8fb0121d-2694-425f-9f95-d49ab54b71ca service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:21.784106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ac8f0024-db81-4ce4-9d27-9594623b9ee6 req-8fb0121d-2694-425f-9f95-d49ab54b71ca service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:21.784534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ac8f0024-db81-4ce4-9d27-9594623b9ee6 req-8fb0121d-2694-425f-9f95-d49ab54b71ca service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:21.802971 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ac8f0024-db81-4ce4-9d27-9594623b9ee6 req-8fb0121d-2694-425f-9f95-d49ab54b71ca service nova] Creating event network-vif-deleted:eade7ea5-b653-468d-aaa4-2b40848f80bd for instance 157af106-c39d-428a-9cd7-1d37cd98bfcc on n-h2-858384-13 Oct 18 13:27:21.810578 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ac8f0024-db81-4ce4-9d27-9594623b9ee6 req-8fb0121d-2694-425f-9f95-d49ab54b71ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042912 Oct 18 13:27:21.814933 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1362/2562] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:21.824883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0ddfbacb-7dfc-4121-b61e-41201e9a0da0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:21.826600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0ddfbacb-7dfc-4121-b61e-41201e9a0da0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:21.836602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ddfbacb-7dfc-4121-b61e-41201e9a0da0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:21.837465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ddfbacb-7dfc-4121-b61e-41201e9a0da0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:21.838189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ddfbacb-7dfc-4121-b61e-41201e9a0da0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:21.839138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ddfbacb-7dfc-4121-b61e-41201e9a0da0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:21.840087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ddfbacb-7dfc-4121-b61e-41201e9a0da0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:21.841819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ddfbacb-7dfc-4121-b61e-41201e9a0da0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.024792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0ddfbacb-7dfc-4121-b61e-41201e9a0da0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:22.035941 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0ddfbacb-7dfc-4121-b61e-41201e9a0da0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.219120 Oct 18 13:27:22.036520 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1363/2563] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:21 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:22.041931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-79e43c38-0d56-4c7b-b571-98f4ff602dd9 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Calling method '.version_select at 0x7ff60ef64af0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:22.246191 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-79e43c38-0d56-4c7b-b571-98f4ff602dd9 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/2f650d12-487b-4d3d-9251-70e96459400b" status: 202 len: 0 microversion: 2.1 time: 0.208417 Oct 18 13:27:22.247047 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1364/2564] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:22 2022] DELETE /compute/v2.1/os-security-groups/2f650d12-487b-4d3d-9251-70e96459400b => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:22.263195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:22.265861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:22.279715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.280595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.281497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.282435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.283333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.284738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.291681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:27:22.292305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:27:22.293086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:27:22.294688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:27:22.295358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:27:22.317962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.319438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.321070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.322134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.322806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.323591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.357308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.357823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Getting quotas for project 79a03bf7e9014bb6b8e7ea64005b26c9. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:22.357968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.358399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.358859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lazy-loading 'fault' on Instance uuid 157af106-c39d-428a-9cd7-1d37cd98bfcc {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:22.367519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Getting quotas for user 8f2b02e97ca243c490e8e0c9d2283523 and project 79a03bf7e9014bb6b8e7ea64005b26c9. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:22.387745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:27:22.391321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:27:22.408589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5e09fad51a478788961c1f2b946cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710435d30626412f9ec22d776f8e94ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:22.418005 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-93825214-1f0b-44c3-9e52-d97c18de6a42 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 200 len: 1305 microversion: 2.1 time: 0.169640 Oct 18 13:27:22.435692 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1365/2565] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:22 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 1305 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:22.448305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c8b7c2ee-8f6b-4431-9e00-0da1132c14c9 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] Calling method '.version_select at 0x7ff60ef089d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:22.467699 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c7750146-e655-435c-b256-714f13858b5b tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821878 Oct 18 13:27:22.468827 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1201/2566] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:27:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:27:22.483287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-35e7ee6e-eb75-4035-81a4-74ed600e2272 req-bb7a758e-f33a-4a81-968a-09a2385dd50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-plugged", "status": "completed", "tag": "0f89053d-88e6-469d-961b-4f3a032c7321"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:22.506665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-35e7ee6e-eb75-4035-81a4-74ed600e2272 req-bb7a758e-f33a-4a81-968a-09a2385dd50d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.507342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-35e7ee6e-eb75-4035-81a4-74ed600e2272 req-bb7a758e-f33a-4a81-968a-09a2385dd50d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.507848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-35e7ee6e-eb75-4035-81a4-74ed600e2272 req-bb7a758e-f33a-4a81-968a-09a2385dd50d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.522864 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-35e7ee6e-eb75-4035-81a4-74ed600e2272 req-bb7a758e-f33a-4a81-968a-09a2385dd50d service nova] Creating event network-vif-plugged:0f89053d-88e6-469d-961b-4f3a032c7321 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:27:22.529984 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-35e7ee6e-eb75-4035-81a4-74ed600e2272 req-bb7a758e-f33a-4a81-968a-09a2385dd50d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057904 Oct 18 13:27:22.531129 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1202/2567] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:22.536332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-48854b32-83b8-4da8-a5c0-74c27c722fef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:22.537030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-48854b32-83b8-4da8-a5c0-74c27c722fef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:22.553095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-48854b32-83b8-4da8-a5c0-74c27c722fef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.554393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-48854b32-83b8-4da8-a5c0-74c27c722fef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.555016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-48854b32-83b8-4da8-a5c0-74c27c722fef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.555930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-48854b32-83b8-4da8-a5c0-74c27c722fef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.556776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-48854b32-83b8-4da8-a5c0-74c27c722fef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.557392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-48854b32-83b8-4da8-a5c0-74c27c722fef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.737010 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c8b7c2ee-8f6b-4431-9e00-0da1132c14c9 tempest-SecurityGroupRulesNegativeTestJSON-1324541457 tempest-SecurityGroupRulesNegativeTestJSON-1324541457-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/7880cefb-e678-48f8-b743-56c7ad66ca52" status: 202 len: 0 microversion: 2.1 time: 0.294972 Oct 18 13:27:22.738230 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1366/2568] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:22 2022] DELETE /compute/v2.1/os-security-groups/7880cefb-e678-48f8-b743-56c7ad66ca52 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:22.744821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bffd069b-b864-4341-8c0a-c604e5d5cb34 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:22.745728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bffd069b-b864-4341-8c0a-c604e5d5cb34 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:22.894270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bffd069b-b864-4341-8c0a-c604e5d5cb34 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:22.907528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-48854b32-83b8-4da8-a5c0-74c27c722fef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:22.925329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-48854b32-83b8-4da8-a5c0-74c27c722fef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:22.926199 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bffd069b-b864-4341-8c0a-c604e5d5cb34 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1230 microversion: 2.1 time: 0.178032 Oct 18 13:27:22.928384 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1367/2569] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:22 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1230 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:22.935537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-48854b32-83b8-4da8-a5c0-74c27c722fef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:22.937752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eed69532-a06a-4d9e-aa99-232a02719a33 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:22.938834 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-48854b32-83b8-4da8-a5c0-74c27c722fef tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.406554 Oct 18 13:27:22.949584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eed69532-a06a-4d9e-aa99-232a02719a33 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:22.952369 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1203/2570] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:22 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:22.966952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed69532-a06a-4d9e-aa99-232a02719a33 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.967839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-46e1c001-81f3-4a04-a56d-3dfa94a78e28 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:22.968660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-46e1c001-81f3-4a04-a56d-3dfa94a78e28 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:22.969465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed69532-a06a-4d9e-aa99-232a02719a33 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.971518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed69532-a06a-4d9e-aa99-232a02719a33 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.972876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed69532-a06a-4d9e-aa99-232a02719a33 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.974522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed69532-a06a-4d9e-aa99-232a02719a33 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.975370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed69532-a06a-4d9e-aa99-232a02719a33 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.988448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e1c001-81f3-4a04-a56d-3dfa94a78e28 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.990369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e1c001-81f3-4a04-a56d-3dfa94a78e28 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.992650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e1c001-81f3-4a04-a56d-3dfa94a78e28 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:22.993643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e1c001-81f3-4a04-a56d-3dfa94a78e28 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:22.995556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e1c001-81f3-4a04-a56d-3dfa94a78e28 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:22.998311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e1c001-81f3-4a04-a56d-3dfa94a78e28 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:23.178293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-eed69532-a06a-4d9e-aa99-232a02719a33 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:23.242654 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eed69532-a06a-4d9e-aa99-232a02719a33 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.308189 Oct 18 13:27:23.243286 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1368/2571] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:22 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:23.251668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e092fa9-e781-4464-b4aa-3237bfd7e145 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:23.252518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4e092fa9-e781-4464-b4aa-3237bfd7e145 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:23.261973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-46e1c001-81f3-4a04-a56d-3dfa94a78e28 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:23.276421 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-46e1c001-81f3-4a04-a56d-3dfa94a78e28 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.319067 Oct 18 13:27:23.278514 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1204/2572] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:22 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:23.296289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e092fa9-e781-4464-b4aa-3237bfd7e145 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:23.297135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e092fa9-e781-4464-b4aa-3237bfd7e145 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:23.297682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e092fa9-e781-4464-b4aa-3237bfd7e145 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:23.298390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e092fa9-e781-4464-b4aa-3237bfd7e145 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:23.298997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e092fa9-e781-4464-b4aa-3237bfd7e145 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:23.299445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e092fa9-e781-4464-b4aa-3237bfd7e145 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:23.449291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1cc6fb98-c2f3-4bca-932f-a05ae9d25193 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:23.449937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1cc6fb98-c2f3-4bca-932f-a05ae9d25193 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] [instance: 157af106-c39d-428a-9cd7-1d37cd98bfcc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:23.471047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cc6fb98-c2f3-4bca-932f-a05ae9d25193 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:23.471547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cc6fb98-c2f3-4bca-932f-a05ae9d25193 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:23.471981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cc6fb98-c2f3-4bca-932f-a05ae9d25193 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:23.472689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cc6fb98-c2f3-4bca-932f-a05ae9d25193 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:23.473138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cc6fb98-c2f3-4bca-932f-a05ae9d25193 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:23.473583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cc6fb98-c2f3-4bca-932f-a05ae9d25193 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:23.495465 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-1cc6fb98-c2f3-4bca-932f-a05ae9d25193 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] HTTP exception thrown: Instance 157af106-c39d-428a-9cd7-1d37cd98bfcc could not be found. Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1cc6fb98-c2f3-4bca-932f-a05ae9d25193 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Request method failure captured: Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc HTTP/1.1 Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqlRVfVixywbKr4nIHjP58vfzZ8i26rEaI0eca786Hww5kDAM8dF6DsFCw0yIc_qEkRx9rk3yMyeWwv-lKqe4hcvb05OyldnW3nrw1OMjJJw2beMdzgUscPmkcFzk17Zv8j-5fvK5e1xuBOgQX-j3apnpprQeOpBcGEZjYbaCASel7A Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:27:23.507421 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:27:23.509137 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/710435d30626412f9ec22d776f8e94ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_710435d30626412f9ec22d776f8e94ae"}]}] Oct 18 13:27:23.509137 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:23.509137 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 710435d30626412f9ec22d776f8e94ae Oct 18 13:27:23.509137 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-408673585 Oct 18 13:27:23.509137 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:23.509137 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:27:23.509137 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:27:23.509137 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9b5e09fad51a478788961c1f2b946cc9 Oct 18 13:27:23.509137 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-SecurityGroupsTestJSON-408673585-project Oct 18 13:27:23.509137 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:27:23.509137 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 157af106-c39d-428a-9cd7-1d37cd98bfcc could not be found. Oct 18 13:27:23.509137 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '157af106-c39d-428a-9cd7-1d37cd98bfcc'} Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157af106-c39d-428a-9cd7-1d37cd98bfcc could not be found. Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:23.510044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157af106-c39d-428a-9cd7-1d37cd98bfcc could not be found. Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157af106-c39d-428a-9cd7-1d37cd98bfcc could not be found. Oct 18 13:27:23.511302 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:23.512367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1cc6fb98-c2f3-4bca-932f-a05ae9d25193 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Returning 404 to user: Instance 157af106-c39d-428a-9cd7-1d37cd98bfcc could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:23.512367 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1cc6fb98-c2f3-4bca-932f-a05ae9d25193 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc" status: 404 len: 111 microversion: 2.1 time: 0.063790 Oct 18 13:27:23.512367 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1205/2573] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:23 2022] GET /compute/v2.1/servers/157af106-c39d-428a-9cd7-1d37cd98bfcc => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:27:23.517958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-880c64b2-f502-49a8-92c6-dbf6e2fb4bd5 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60f801820>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:23.581924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4e092fa9-e781-4464-b4aa-3237bfd7e145 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:23.594936 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4e092fa9-e781-4464-b4aa-3237bfd7e145 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.348267 Oct 18 13:27:23.622147 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1369/2574] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:23 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:23.870645 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-880c64b2-f502-49a8-92c6-dbf6e2fb4bd5 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/87f0b88a-1b1f-46b7-a91c-50248974e9f8" status: 202 len: 0 microversion: 2.1 time: 0.356361 Oct 18 13:27:23.871292 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1206/2575] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:23 2022] DELETE /compute/v2.1/os-security-groups/87f0b88a-1b1f-46b7-a91c-50248974e9f8 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:27:23.880021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-00fbd6df-16e8-4fcf-b32c-8c8041ddd201 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] Calling method '.version_select at 0x7ff60efeb700>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:23.958221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0d9c1fac-8386-4a72-a024-556888c68199 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:23.960933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0d9c1fac-8386-4a72-a024-556888c68199 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:23.982024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9c1fac-8386-4a72-a024-556888c68199 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:23.985045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9c1fac-8386-4a72-a024-556888c68199 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:23.985728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9c1fac-8386-4a72-a024-556888c68199 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:23.987482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9c1fac-8386-4a72-a024-556888c68199 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:23.990462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9c1fac-8386-4a72-a024-556888c68199 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:23.993280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9c1fac-8386-4a72-a024-556888c68199 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:24.103718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0d9c1fac-8386-4a72-a024-556888c68199 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:24.114490 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0d9c1fac-8386-4a72-a024-556888c68199 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1282 microversion: 2.1 time: 0.164412 Oct 18 13:27:24.126257 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1207/2576] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:23 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1282 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:24.140259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a2d0d629-9a00-4dee-9f6f-7975eaf4ff00 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:24.141611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a2d0d629-9a00-4dee-9f6f-7975eaf4ff00 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:24.149071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2d0d629-9a00-4dee-9f6f-7975eaf4ff00 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:24.149966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2d0d629-9a00-4dee-9f6f-7975eaf4ff00 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:24.150557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2d0d629-9a00-4dee-9f6f-7975eaf4ff00 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:24.151661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2d0d629-9a00-4dee-9f6f-7975eaf4ff00 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:24.152269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2d0d629-9a00-4dee-9f6f-7975eaf4ff00 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:24.153121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2d0d629-9a00-4dee-9f6f-7975eaf4ff00 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:24.309781 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-00fbd6df-16e8-4fcf-b32c-8c8041ddd201 tempest-SecurityGroupsTestJSON-408673585 tempest-SecurityGroupsTestJSON-408673585-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/3e37b8c9-0281-4d75-bd78-06c339b8dd97" status: 202 len: 0 microversion: 2.1 time: 0.433945 Oct 18 13:27:24.311578 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1370/2577] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:27:23 2022] DELETE /compute/v2.1/os-security-groups/3e37b8c9-0281-4d75-bd78-06c339b8dd97 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:24.317511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-accdcdaf-b39b-40ef-bdc0-003c374362f4 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:24.318365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-accdcdaf-b39b-40ef-bdc0-003c374362f4 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:24.334106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-accdcdaf-b39b-40ef-bdc0-003c374362f4 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:24.335472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-accdcdaf-b39b-40ef-bdc0-003c374362f4 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:24.336215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-accdcdaf-b39b-40ef-bdc0-003c374362f4 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:24.337399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-accdcdaf-b39b-40ef-bdc0-003c374362f4 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:24.338085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-accdcdaf-b39b-40ef-bdc0-003c374362f4 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:24.338775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-accdcdaf-b39b-40ef-bdc0-003c374362f4 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:24.477134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-accdcdaf-b39b-40ef-bdc0-003c374362f4 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:24.527668 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-accdcdaf-b39b-40ef-bdc0-003c374362f4 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.212478 Oct 18 13:27:24.530062 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1371/2578] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:24 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:24.536911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-78048192-06d6-4331-b429-44815ecf6d6f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:24.537561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-78048192-06d6-4331-b429-44815ecf6d6f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:24.557421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78048192-06d6-4331-b429-44815ecf6d6f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:24.560325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78048192-06d6-4331-b429-44815ecf6d6f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:24.561039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78048192-06d6-4331-b429-44815ecf6d6f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:24.562662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78048192-06d6-4331-b429-44815ecf6d6f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:24.563292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78048192-06d6-4331-b429-44815ecf6d6f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:24.564263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78048192-06d6-4331-b429-44815ecf6d6f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:24.645201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a2d0d629-9a00-4dee-9f6f-7975eaf4ff00 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:24.664935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a2d0d629-9a00-4dee-9f6f-7975eaf4ff00 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:24.666674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a2d0d629-9a00-4dee-9f6f-7975eaf4ff00 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:24.671288 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a2d0d629-9a00-4dee-9f6f-7975eaf4ff00 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.537676 Oct 18 13:27:24.674535 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1208/2579] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:24 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:24.682943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-0e700f72-bc21-455d-8548-de7409a2bb3c req-79a923a6-b52b-423c-91e2-016ac6b75399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-plugged", "status": "completed", "tag": "2979f9f0-551e-4518-be50-6140626a03d0"}, {"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-plugged", "status": "completed", "tag": "ef5c7c5f-a59a-4ff2-ac9a-1bcbff29af46"}, {"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-plugged", "status": "completed", "tag": "dd1adc7a-80d9-4f8e-9246-b25315711c34"}, {"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-plugged", "status": "completed", "tag": "a097c407-dceb-423a-899b-463450213b4f"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:24.706548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0e700f72-bc21-455d-8548-de7409a2bb3c req-79a923a6-b52b-423c-91e2-016ac6b75399 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:24.707022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0e700f72-bc21-455d-8548-de7409a2bb3c req-79a923a6-b52b-423c-91e2-016ac6b75399 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:24.707451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0e700f72-bc21-455d-8548-de7409a2bb3c req-79a923a6-b52b-423c-91e2-016ac6b75399 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:24.726269 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0e700f72-bc21-455d-8548-de7409a2bb3c req-79a923a6-b52b-423c-91e2-016ac6b75399 service nova] Creating event network-vif-plugged:2979f9f0-551e-4518-be50-6140626a03d0 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:27:24.726785 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0e700f72-bc21-455d-8548-de7409a2bb3c req-79a923a6-b52b-423c-91e2-016ac6b75399 service nova] Creating event network-vif-plugged:ef5c7c5f-a59a-4ff2-ac9a-1bcbff29af46 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:27:24.727272 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0e700f72-bc21-455d-8548-de7409a2bb3c req-79a923a6-b52b-423c-91e2-016ac6b75399 service nova] Creating event network-vif-plugged:dd1adc7a-80d9-4f8e-9246-b25315711c34 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:27:24.727952 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0e700f72-bc21-455d-8548-de7409a2bb3c req-79a923a6-b52b-423c-91e2-016ac6b75399 service nova] Creating event network-vif-plugged:a097c407-dceb-423a-899b-463450213b4f for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:27:24.735876 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-0e700f72-bc21-455d-8548-de7409a2bb3c req-79a923a6-b52b-423c-91e2-016ac6b75399 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.058770 Oct 18 13:27:24.737970 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1209/2580] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:24.744779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-83955822-1e26-471f-adfc-a18e2ee4577a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:24.745527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-83955822-1e26-471f-adfc-a18e2ee4577a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:24.753824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83955822-1e26-471f-adfc-a18e2ee4577a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:24.754434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83955822-1e26-471f-adfc-a18e2ee4577a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:24.754879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83955822-1e26-471f-adfc-a18e2ee4577a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:24.755653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83955822-1e26-471f-adfc-a18e2ee4577a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:24.757213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83955822-1e26-471f-adfc-a18e2ee4577a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:24.758200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83955822-1e26-471f-adfc-a18e2ee4577a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:24.926633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-83955822-1e26-471f-adfc-a18e2ee4577a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:24.941014 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-83955822-1e26-471f-adfc-a18e2ee4577a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.199942 Oct 18 13:27:24.942320 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1210/2581] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:24 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:25.144759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c4d07ef4-0876-4a58-8055-68ed6b74a826 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:25.146114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c4d07ef4-0876-4a58-8055-68ed6b74a826 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:25.159022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4d07ef4-0876-4a58-8055-68ed6b74a826 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:25.159533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4d07ef4-0876-4a58-8055-68ed6b74a826 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:25.159962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4d07ef4-0876-4a58-8055-68ed6b74a826 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:25.160676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4d07ef4-0876-4a58-8055-68ed6b74a826 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:25.161118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4d07ef4-0876-4a58-8055-68ed6b74a826 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:25.161574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4d07ef4-0876-4a58-8055-68ed6b74a826 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:25.328862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c4d07ef4-0876-4a58-8055-68ed6b74a826 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:25.344330 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c4d07ef4-0876-4a58-8055-68ed6b74a826 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1288 microversion: 2.1 time: 0.206139 Oct 18 13:27:25.345907 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1211/2582] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:25 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1288 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:25.568193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8cb30d04-3080-4e9f-8083-726be314c682 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:25.569750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8cb30d04-3080-4e9f-8083-726be314c682 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:25.576895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cb30d04-3080-4e9f-8083-726be314c682 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:25.579140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cb30d04-3080-4e9f-8083-726be314c682 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:25.579843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cb30d04-3080-4e9f-8083-726be314c682 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:25.582018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cb30d04-3080-4e9f-8083-726be314c682 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:25.582718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cb30d04-3080-4e9f-8083-726be314c682 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:25.586738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cb30d04-3080-4e9f-8083-726be314c682 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:25.746671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-78048192-06d6-4331-b429-44815ecf6d6f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:25.750567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:25.754515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-8cb30d04-3080-4e9f-8083-726be314c682 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:25.763042 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-78048192-06d6-4331-b429-44815ecf6d6f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 1.231733 Oct 18 13:27:25.763990 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1372/2583] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:24 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:25.775674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1c457c1d-e8ab-4beb-8943-03c8dcad581c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:25.776559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1c457c1d-e8ab-4beb-8943-03c8dcad581c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:25.784166 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8cb30d04-3080-4e9f-8083-726be314c682 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.230586 Oct 18 13:27:25.785929 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1212/2584] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:25 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:27:25.807814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c457c1d-e8ab-4beb-8943-03c8dcad581c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:25.808633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c457c1d-e8ab-4beb-8943-03c8dcad581c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:25.809517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c457c1d-e8ab-4beb-8943-03c8dcad581c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:25.810469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c457c1d-e8ab-4beb-8943-03c8dcad581c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:25.811077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c457c1d-e8ab-4beb-8943-03c8dcad581c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:25.811572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c457c1d-e8ab-4beb-8943-03c8dcad581c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:25.968383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e13511b8-6c26-415c-810b-249f1f8ed97d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:25.969320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e13511b8-6c26-415c-810b-249f1f8ed97d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:25.985668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e13511b8-6c26-415c-810b-249f1f8ed97d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:25.990204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e13511b8-6c26-415c-810b-249f1f8ed97d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:25.993815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e13511b8-6c26-415c-810b-249f1f8ed97d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:25.994803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e13511b8-6c26-415c-810b-249f1f8ed97d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:25.995440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e13511b8-6c26-415c-810b-249f1f8ed97d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:25.996064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e13511b8-6c26-415c-810b-249f1f8ed97d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:26.244936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e13511b8-6c26-415c-810b-249f1f8ed97d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:26.253655 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e13511b8-6c26-415c-810b-249f1f8ed97d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.289608 Oct 18 13:27:26.257633 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1213/2585] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:25 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:26.370838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b71b02bb-8b02-4e14-8429-13ba8688c736 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:26.371454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b71b02bb-8b02-4e14-8429-13ba8688c736 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:26.376142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:26.387504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b71b02bb-8b02-4e14-8429-13ba8688c736 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:26.388005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b71b02bb-8b02-4e14-8429-13ba8688c736 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:26.389635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b71b02bb-8b02-4e14-8429-13ba8688c736 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:26.391205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b71b02bb-8b02-4e14-8429-13ba8688c736 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:26.393808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b71b02bb-8b02-4e14-8429-13ba8688c736 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:26.395062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b71b02bb-8b02-4e14-8429-13ba8688c736 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:26.563592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1c457c1d-e8ab-4beb-8943-03c8dcad581c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:26.580557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1c457c1d-e8ab-4beb-8943-03c8dcad581c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:26.583602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1c457c1d-e8ab-4beb-8943-03c8dcad581c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:26.587476 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1c457c1d-e8ab-4beb-8943-03c8dcad581c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.821511 Oct 18 13:27:26.592371 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1373/2586] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:25 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:26.642816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b71b02bb-8b02-4e14-8429-13ba8688c736 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:26.667259 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b71b02bb-8b02-4e14-8429-13ba8688c736 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1330 microversion: 2.1 time: 0.300906 Oct 18 13:27:26.668662 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1214/2587] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:26 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1330 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:26.788452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d362455b-789d-4a7b-aaed-80ac02165a94 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:26.789618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d362455b-789d-4a7b-aaed-80ac02165a94 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:26.796915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d362455b-789d-4a7b-aaed-80ac02165a94 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:26.810193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d362455b-789d-4a7b-aaed-80ac02165a94 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:26.810951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d362455b-789d-4a7b-aaed-80ac02165a94 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:26.812176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d362455b-789d-4a7b-aaed-80ac02165a94 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:26.812796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d362455b-789d-4a7b-aaed-80ac02165a94 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:26.813416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d362455b-789d-4a7b-aaed-80ac02165a94 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:26.820027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ebe080c1-765b-42f5-b07f-6bf043b1bf7e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:26.820656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ebe080c1-765b-42f5-b07f-6bf043b1bf7e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:26.837471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebe080c1-765b-42f5-b07f-6bf043b1bf7e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:26.838277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebe080c1-765b-42f5-b07f-6bf043b1bf7e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:26.838899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebe080c1-765b-42f5-b07f-6bf043b1bf7e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:26.839817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebe080c1-765b-42f5-b07f-6bf043b1bf7e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:26.840444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebe080c1-765b-42f5-b07f-6bf043b1bf7e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:26.841050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebe080c1-765b-42f5-b07f-6bf043b1bf7e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:26.889335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:26.982163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-ebe080c1-765b-42f5-b07f-6bf043b1bf7e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:27.026250 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ebe080c1-765b-42f5-b07f-6bf043b1bf7e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.206212 Oct 18 13:27:27.041292 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1215/2588] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:26 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:27.041292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-f44a0fec-c898-43fc-80a6-88f7a9948f67 req-17a6b334-a871-43e1-9394-64773ce49432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-plugged", "status": "completed", "tag": "e53d609c-cb8b-4106-ad60-0cf706884abe"}, {"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-plugged", "status": "completed", "tag": "d3e742e1-6288-419d-a439-1cd1c7e4eff3"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:27.067441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f44a0fec-c898-43fc-80a6-88f7a9948f67 req-17a6b334-a871-43e1-9394-64773ce49432 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:27.067929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f44a0fec-c898-43fc-80a6-88f7a9948f67 req-17a6b334-a871-43e1-9394-64773ce49432 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:27.068358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f44a0fec-c898-43fc-80a6-88f7a9948f67 req-17a6b334-a871-43e1-9394-64773ce49432 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:27.081900 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f44a0fec-c898-43fc-80a6-88f7a9948f67 req-17a6b334-a871-43e1-9394-64773ce49432 service nova] Creating event network-vif-plugged:e53d609c-cb8b-4106-ad60-0cf706884abe for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:27:27.082688 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f44a0fec-c898-43fc-80a6-88f7a9948f67 req-17a6b334-a871-43e1-9394-64773ce49432 service nova] Creating event network-vif-plugged:d3e742e1-6288-419d-a439-1cd1c7e4eff3 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:27:27.107527 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-f44a0fec-c898-43fc-80a6-88f7a9948f67 req-17a6b334-a871-43e1-9394-64773ce49432 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078141 Oct 18 13:27:27.109510 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1216/2589] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:27.277478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4f0bb84a-ab1f-422a-9c67-dc6bc505771a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:27.278340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4f0bb84a-ab1f-422a-9c67-dc6bc505771a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:27.286334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d362455b-789d-4a7b-aaed-80ac02165a94 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:27.291827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f0bb84a-ab1f-422a-9c67-dc6bc505771a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:27.297554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f0bb84a-ab1f-422a-9c67-dc6bc505771a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:27.298147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f0bb84a-ab1f-422a-9c67-dc6bc505771a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:27.298972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f0bb84a-ab1f-422a-9c67-dc6bc505771a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:27.299663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f0bb84a-ab1f-422a-9c67-dc6bc505771a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:27.300351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f0bb84a-ab1f-422a-9c67-dc6bc505771a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:27.302044 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d362455b-789d-4a7b-aaed-80ac02165a94 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.517882 Oct 18 13:27:27.309330 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1374/2590] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:26 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:27.504566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d8eacc76-b92f-4e9f-88f7-4e51a283d633 req-ea0b8c05-fb35-4391-b5fd-3faacfcd6c88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9412adf-f352-4aad-ac60-81be4892dc8f", "tag": "f6fb9e40-9bbf-41f6-afef-32d270604029"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:27.523710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d8eacc76-b92f-4e9f-88f7-4e51a283d633 req-ea0b8c05-fb35-4391-b5fd-3faacfcd6c88 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:27.524198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d8eacc76-b92f-4e9f-88f7-4e51a283d633 req-ea0b8c05-fb35-4391-b5fd-3faacfcd6c88 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:27.524632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d8eacc76-b92f-4e9f-88f7-4e51a283d633 req-ea0b8c05-fb35-4391-b5fd-3faacfcd6c88 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:27.567681 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d8eacc76-b92f-4e9f-88f7-4e51a283d633 req-ea0b8c05-fb35-4391-b5fd-3faacfcd6c88 service nova] Creating event network-changed:f6fb9e40-9bbf-41f6-afef-32d270604029 for instance f9412adf-f352-4aad-ac60-81be4892dc8f on n-h1-858384-13 Oct 18 13:27:27.580721 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d8eacc76-b92f-4e9f-88f7-4e51a283d633 req-ea0b8c05-fb35-4391-b5fd-3faacfcd6c88 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080652 Oct 18 13:27:27.582728 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1375/2591] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:27.619701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4f81c0e3-280a-4f35-921b-85d1e5034173 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:27.621642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4f81c0e3-280a-4f35-921b-85d1e5034173 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:27.629981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f81c0e3-280a-4f35-921b-85d1e5034173 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:27.630665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f81c0e3-280a-4f35-921b-85d1e5034173 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:27.631266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f81c0e3-280a-4f35-921b-85d1e5034173 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:27.633010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f81c0e3-280a-4f35-921b-85d1e5034173 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:27.637108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f81c0e3-280a-4f35-921b-85d1e5034173 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:27.637766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f81c0e3-280a-4f35-921b-85d1e5034173 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:27.664225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4f0bb84a-ab1f-422a-9c67-dc6bc505771a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:27.673298 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4f0bb84a-ab1f-422a-9c67-dc6bc505771a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.401037 Oct 18 13:27:27.691954 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1217/2592] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:27 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:27.698183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea9228c7-f05b-48be-8a22-3523f99a3851 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:27.699146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ea9228c7-f05b-48be-8a22-3523f99a3851 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:27.706518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea9228c7-f05b-48be-8a22-3523f99a3851 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:27.707355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea9228c7-f05b-48be-8a22-3523f99a3851 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:27.708481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea9228c7-f05b-48be-8a22-3523f99a3851 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:27.709461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea9228c7-f05b-48be-8a22-3523f99a3851 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:27.710183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea9228c7-f05b-48be-8a22-3523f99a3851 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:27.710961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea9228c7-f05b-48be-8a22-3523f99a3851 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:28.001451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ea9228c7-f05b-48be-8a22-3523f99a3851 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:28.011009 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ea9228c7-f05b-48be-8a22-3523f99a3851 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1330 microversion: 2.1 time: 0.317297 Oct 18 13:27:28.016254 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1218/2593] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:27 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1330 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:28.058310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a91ef539-a07f-4efe-ba15-d59f74632fde tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:28.059255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a91ef539-a07f-4efe-ba15-d59f74632fde tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:28.066648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a91ef539-a07f-4efe-ba15-d59f74632fde tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:28.067141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a91ef539-a07f-4efe-ba15-d59f74632fde tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:28.067582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a91ef539-a07f-4efe-ba15-d59f74632fde tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:28.068290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a91ef539-a07f-4efe-ba15-d59f74632fde tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:28.069062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a91ef539-a07f-4efe-ba15-d59f74632fde tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:28.070161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a91ef539-a07f-4efe-ba15-d59f74632fde tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:28.153581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-a91ef539-a07f-4efe-ba15-d59f74632fde tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:28.172171 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a91ef539-a07f-4efe-ba15-d59f74632fde tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.118552 Oct 18 13:27:28.172756 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1219/2594] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:28 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:28.334029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-30514d85-bdd5-4052-9112-09b7ea7a6ae3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:28.334658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-30514d85-bdd5-4052-9112-09b7ea7a6ae3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:28.341652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30514d85-bdd5-4052-9112-09b7ea7a6ae3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:28.342167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30514d85-bdd5-4052-9112-09b7ea7a6ae3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:28.342601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30514d85-bdd5-4052-9112-09b7ea7a6ae3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:28.343301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30514d85-bdd5-4052-9112-09b7ea7a6ae3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:28.343752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30514d85-bdd5-4052-9112-09b7ea7a6ae3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:28.344171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30514d85-bdd5-4052-9112-09b7ea7a6ae3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:28.442876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4f81c0e3-280a-4f35-921b-85d1e5034173 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:28.452739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4f81c0e3-280a-4f35-921b-85d1e5034173 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:28.454500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4f81c0e3-280a-4f35-921b-85d1e5034173 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:28.455804 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4f81c0e3-280a-4f35-921b-85d1e5034173 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.841084 Oct 18 13:27:28.456380 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1376/2595] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:27 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:27:28.513153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-30514d85-bdd5-4052-9112-09b7ea7a6ae3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:28.524942 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-30514d85-bdd5-4052-9112-09b7ea7a6ae3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.195112 Oct 18 13:27:28.545482 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1220/2596] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:28 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:28.699052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-be3adbb9-f04c-49b8-92ac-4cabe12bbd79 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:28.699834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-be3adbb9-f04c-49b8-92ac-4cabe12bbd79 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:28.707115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3adbb9-f04c-49b8-92ac-4cabe12bbd79 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:28.707741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3adbb9-f04c-49b8-92ac-4cabe12bbd79 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:28.708271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3adbb9-f04c-49b8-92ac-4cabe12bbd79 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:28.709095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3adbb9-f04c-49b8-92ac-4cabe12bbd79 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:28.709728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3adbb9-f04c-49b8-92ac-4cabe12bbd79 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:28.710978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be3adbb9-f04c-49b8-92ac-4cabe12bbd79 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.017227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-08e0c3b2-b852-45b7-b8aa-07aa14e8566f req-04267f6a-e509-4845-82fb-f69605d6e1cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f4088c-c321-4fc1-8bec-456d1178cda7", "name": "network-vif-unplugged", "status": "completed", "tag": "7732437d-47a0-4c99-8e68-a24b9d4ee37d"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:29.031768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-08e0c3b2-b852-45b7-b8aa-07aa14e8566f req-04267f6a-e509-4845-82fb-f69605d6e1cd service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.032603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-08e0c3b2-b852-45b7-b8aa-07aa14e8566f req-04267f6a-e509-4845-82fb-f69605d6e1cd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.033260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-08e0c3b2-b852-45b7-b8aa-07aa14e8566f req-04267f6a-e509-4845-82fb-f69605d6e1cd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.053601 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-08e0c3b2-b852-45b7-b8aa-07aa14e8566f req-04267f6a-e509-4845-82fb-f69605d6e1cd service nova] Creating event network-vif-unplugged:7732437d-47a0-4c99-8e68-a24b9d4ee37d for instance e1f4088c-c321-4fc1-8bec-456d1178cda7 on n-h2-858384-13 Oct 18 13:27:29.060163 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-08e0c3b2-b852-45b7-b8aa-07aa14e8566f req-04267f6a-e509-4845-82fb-f69605d6e1cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047105 Oct 18 13:27:29.061970 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1221/2597] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:27:29.069444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c454d017-7e5e-47e5-a89f-9e7ba40c1568 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:29.070185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c454d017-7e5e-47e5-a89f-9e7ba40c1568 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:29.083073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c454d017-7e5e-47e5-a89f-9e7ba40c1568 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.083785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c454d017-7e5e-47e5-a89f-9e7ba40c1568 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.084320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c454d017-7e5e-47e5-a89f-9e7ba40c1568 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.085690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c454d017-7e5e-47e5-a89f-9e7ba40c1568 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.091848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c454d017-7e5e-47e5-a89f-9e7ba40c1568 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.092544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c454d017-7e5e-47e5-a89f-9e7ba40c1568 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.094999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-be3adbb9-f04c-49b8-92ac-4cabe12bbd79 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:29.121424 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-be3adbb9-f04c-49b8-92ac-4cabe12bbd79 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.427349 Oct 18 13:27:29.122025 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1377/2598] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:28 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:29.202342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a965a19b-ed48-4d2d-afb7-796fbc1c15df tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:29.203631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a965a19b-ed48-4d2d-afb7-796fbc1c15df tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:29.212343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a965a19b-ed48-4d2d-afb7-796fbc1c15df tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.212838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a965a19b-ed48-4d2d-afb7-796fbc1c15df tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.214176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a965a19b-ed48-4d2d-afb7-796fbc1c15df tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.228553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a965a19b-ed48-4d2d-afb7-796fbc1c15df tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.229428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a965a19b-ed48-4d2d-afb7-796fbc1c15df tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.230167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a965a19b-ed48-4d2d-afb7-796fbc1c15df tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.328573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c454d017-7e5e-47e5-a89f-9e7ba40c1568 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:29.338298 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c454d017-7e5e-47e5-a89f-9e7ba40c1568 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1330 microversion: 2.1 time: 0.274822 Oct 18 13:27:29.343585 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1222/2599] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:29 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1330 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:29.385046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-a965a19b-ed48-4d2d-afb7-796fbc1c15df tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:29.408786 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a965a19b-ed48-4d2d-afb7-796fbc1c15df tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.211315 Oct 18 13:27:29.409755 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1378/2600] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:29 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:27:29.482240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0aad67bd-d256-4798-abe4-3c05697b8643 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:29.482845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0aad67bd-d256-4798-abe4-3c05697b8643 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:29.489028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0aad67bd-d256-4798-abe4-3c05697b8643 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.489545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0aad67bd-d256-4798-abe4-3c05697b8643 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.490275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0aad67bd-d256-4798-abe4-3c05697b8643 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.491046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0aad67bd-d256-4798-abe4-3c05697b8643 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.492002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0aad67bd-d256-4798-abe4-3c05697b8643 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.492571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0aad67bd-d256-4798-abe4-3c05697b8643 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.560888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6fa457f7-52a1-4a90-bd65-ae8c397a8bd8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:29.561740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6fa457f7-52a1-4a90-bd65-ae8c397a8bd8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:29.571431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fa457f7-52a1-4a90-bd65-ae8c397a8bd8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.572341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fa457f7-52a1-4a90-bd65-ae8c397a8bd8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.573029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fa457f7-52a1-4a90-bd65-ae8c397a8bd8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.573827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fa457f7-52a1-4a90-bd65-ae8c397a8bd8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:29.574842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fa457f7-52a1-4a90-bd65-ae8c397a8bd8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:29.575471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fa457f7-52a1-4a90-bd65-ae8c397a8bd8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:29.832125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0aad67bd-d256-4798-abe4-3c05697b8643 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:29.854789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0aad67bd-d256-4798-abe4-3c05697b8643 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:29.856350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0aad67bd-d256-4798-abe4-3c05697b8643 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:29.868289 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0aad67bd-d256-4798-abe4-3c05697b8643 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.388848 Oct 18 13:27:29.869133 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1223/2601] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:29 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:29.951839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6fa457f7-52a1-4a90-bd65-ae8c397a8bd8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:29.971276 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6fa457f7-52a1-4a90-bd65-ae8c397a8bd8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.414149 Oct 18 13:27:29.973113 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1379/2602] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:29 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:30.146930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2059bd7e-f98c-45da-b2b8-780d07213555 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:30.148250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2059bd7e-f98c-45da-b2b8-780d07213555 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:30.156903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2059bd7e-f98c-45da-b2b8-780d07213555 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.157664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2059bd7e-f98c-45da-b2b8-780d07213555 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.159441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2059bd7e-f98c-45da-b2b8-780d07213555 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.160374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2059bd7e-f98c-45da-b2b8-780d07213555 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.160885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2059bd7e-f98c-45da-b2b8-780d07213555 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.161346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2059bd7e-f98c-45da-b2b8-780d07213555 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.363271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a8a0992-0cab-4bd1-8856-8d7171bf66c6 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:30.364232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1a8a0992-0cab-4bd1-8856-8d7171bf66c6 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:30.371555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a8a0992-0cab-4bd1-8856-8d7171bf66c6 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.372332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a8a0992-0cab-4bd1-8856-8d7171bf66c6 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.372930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a8a0992-0cab-4bd1-8856-8d7171bf66c6 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.373929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a8a0992-0cab-4bd1-8856-8d7171bf66c6 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.374563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a8a0992-0cab-4bd1-8856-8d7171bf66c6 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.375154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a8a0992-0cab-4bd1-8856-8d7171bf66c6 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.721518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2059bd7e-f98c-45da-b2b8-780d07213555 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:30.731986 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2059bd7e-f98c-45da-b2b8-780d07213555 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.588867 Oct 18 13:27:30.732745 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1224/2603] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:30 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:30.737789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bfd9eac7-279e-469d-901d-a4d51c66dd6b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:30.738636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bfd9eac7-279e-469d-901d-a4d51c66dd6b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:30.745927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfd9eac7-279e-469d-901d-a4d51c66dd6b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.747036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfd9eac7-279e-469d-901d-a4d51c66dd6b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.747597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfd9eac7-279e-469d-901d-a4d51c66dd6b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.751168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1a8a0992-0cab-4bd1-8856-8d7171bf66c6 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:30.763052 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1a8a0992-0cab-4bd1-8856-8d7171bf66c6 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1330 microversion: 2.1 time: 0.403570 Oct 18 13:27:30.763662 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1380/2604] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:30 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1330 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:30.764673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfd9eac7-279e-469d-901d-a4d51c66dd6b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.765779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfd9eac7-279e-469d-901d-a4d51c66dd6b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.767314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfd9eac7-279e-469d-901d-a4d51c66dd6b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.891919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-bfd9eac7-279e-469d-901d-a4d51c66dd6b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:30.896681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-65b41928-d964-40aa-89a2-879534efbad6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:30.897979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-65b41928-d964-40aa-89a2-879534efbad6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:30.912332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65b41928-d964-40aa-89a2-879534efbad6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.913143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65b41928-d964-40aa-89a2-879534efbad6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.915643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65b41928-d964-40aa-89a2-879534efbad6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.917741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65b41928-d964-40aa-89a2-879534efbad6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:30.921354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65b41928-d964-40aa-89a2-879534efbad6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:30.921979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65b41928-d964-40aa-89a2-879534efbad6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:30.922897 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bfd9eac7-279e-469d-901d-a4d51c66dd6b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.188852 Oct 18 13:27:30.924389 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1225/2605] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:30 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:30.997846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96c89311-3eab-4620-a35a-98ecbae34b29 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:30.999874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-96c89311-3eab-4620-a35a-98ecbae34b29 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:31.012396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96c89311-3eab-4620-a35a-98ecbae34b29 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.012899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96c89311-3eab-4620-a35a-98ecbae34b29 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.013372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96c89311-3eab-4620-a35a-98ecbae34b29 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.015635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96c89311-3eab-4620-a35a-98ecbae34b29 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.016099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96c89311-3eab-4620-a35a-98ecbae34b29 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.017217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96c89311-3eab-4620-a35a-98ecbae34b29 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.276772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-65b41928-d964-40aa-89a2-879534efbad6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:31.294424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-65b41928-d964-40aa-89a2-879534efbad6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:31.295864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-65b41928-d964-40aa-89a2-879534efbad6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:31.297077 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-65b41928-d964-40aa-89a2-879534efbad6 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1874 microversion: 2.42 time: 0.405587 Oct 18 13:27:31.298013 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1381/2606] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:30 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1874 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:31.318368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c3e59c02-8201-4705-ac8d-d6da400fdcd9 req-b74ac0e6-909c-4dc7-8c55-8734404c1ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f4088c-c321-4fc1-8bec-456d1178cda7", "tag": "7732437d-47a0-4c99-8e68-a24b9d4ee37d"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:31.331870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c3e59c02-8201-4705-ac8d-d6da400fdcd9 req-b74ac0e6-909c-4dc7-8c55-8734404c1ab1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.331870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c3e59c02-8201-4705-ac8d-d6da400fdcd9 req-b74ac0e6-909c-4dc7-8c55-8734404c1ab1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.331870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c3e59c02-8201-4705-ac8d-d6da400fdcd9 req-b74ac0e6-909c-4dc7-8c55-8734404c1ab1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.359407 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c3e59c02-8201-4705-ac8d-d6da400fdcd9 req-b74ac0e6-909c-4dc7-8c55-8734404c1ab1 service nova] Creating event network-changed:7732437d-47a0-4c99-8e68-a24b9d4ee37d for instance e1f4088c-c321-4fc1-8bec-456d1178cda7 on n-h2-858384-13 Oct 18 13:27:31.377649 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c3e59c02-8201-4705-ac8d-d6da400fdcd9 req-b74ac0e6-909c-4dc7-8c55-8734404c1ab1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077642 Oct 18 13:27:31.378577 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1382/2607] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:31.486529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-96c89311-3eab-4620-a35a-98ecbae34b29 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:31.496343 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-96c89311-3eab-4620-a35a-98ecbae34b29 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.503791 Oct 18 13:27:31.496938 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1226/2608] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:30 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:31.758059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b9c2ff05-98e0-43af-9dab-e3d912eeebe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:31.758767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b9c2ff05-98e0-43af-9dab-e3d912eeebe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:31.760723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:31.770460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9c2ff05-98e0-43af-9dab-e3d912eeebe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.770948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9c2ff05-98e0-43af-9dab-e3d912eeebe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.771374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9c2ff05-98e0-43af-9dab-e3d912eeebe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.772064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9c2ff05-98e0-43af-9dab-e3d912eeebe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.773049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9c2ff05-98e0-43af-9dab-e3d912eeebe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.773481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9c2ff05-98e0-43af-9dab-e3d912eeebe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.786751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d040caae-cb4a-4e99-ba0e-4df85caa6033 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:31.787788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d040caae-cb4a-4e99-ba0e-4df85caa6033 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:31.797526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d040caae-cb4a-4e99-ba0e-4df85caa6033 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.798287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d040caae-cb4a-4e99-ba0e-4df85caa6033 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.798955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d040caae-cb4a-4e99-ba0e-4df85caa6033 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:31.800367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d040caae-cb4a-4e99-ba0e-4df85caa6033 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:31.801251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d040caae-cb4a-4e99-ba0e-4df85caa6033 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:31.801805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d040caae-cb4a-4e99-ba0e-4df85caa6033 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.146656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b9c2ff05-98e0-43af-9dab-e3d912eeebe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:32.159336 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b9c2ff05-98e0-43af-9dab-e3d912eeebe6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.405796 Oct 18 13:27:32.160288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d040caae-cb4a-4e99-ba0e-4df85caa6033 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:32.173424 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1383/2609] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:31 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:32.178026 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d040caae-cb4a-4e99-ba0e-4df85caa6033 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1330 microversion: 2.1 time: 0.395845 Oct 18 13:27:32.178761 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1227/2610] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:31 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1330 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:32.182816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d6108913-073d-4970-ae42-87b4eca02997 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:32.183431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d6108913-073d-4970-ae42-87b4eca02997 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:32.194707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6108913-073d-4970-ae42-87b4eca02997 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:32.195354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6108913-073d-4970-ae42-87b4eca02997 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:32.195783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6108913-073d-4970-ae42-87b4eca02997 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.196483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6108913-073d-4970-ae42-87b4eca02997 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:32.196934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6108913-073d-4970-ae42-87b4eca02997 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:32.197562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6108913-073d-4970-ae42-87b4eca02997 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.326397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-649c0d04-8978-4a6d-998f-102f3b55279c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:32.327207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-649c0d04-8978-4a6d-998f-102f3b55279c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:32.341449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-649c0d04-8978-4a6d-998f-102f3b55279c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:32.341950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-649c0d04-8978-4a6d-998f-102f3b55279c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:32.342391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-649c0d04-8978-4a6d-998f-102f3b55279c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.343107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-649c0d04-8978-4a6d-998f-102f3b55279c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:32.343559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-649c0d04-8978-4a6d-998f-102f3b55279c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:32.343978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-649c0d04-8978-4a6d-998f-102f3b55279c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.350194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-d6108913-073d-4970-ae42-87b4eca02997 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:32.351189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:32.379904 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d6108913-073d-4970-ae42-87b4eca02997 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.205190 Oct 18 13:27:32.382249 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1384/2611] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:32 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:32.398464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:32.519900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2a2bc065-7d29-47fd-a8ca-87d34aa67e3f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:32.520523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2a2bc065-7d29-47fd-a8ca-87d34aa67e3f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:32.529322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a2bc065-7d29-47fd-a8ca-87d34aa67e3f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:32.530155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a2bc065-7d29-47fd-a8ca-87d34aa67e3f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:32.531103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a2bc065-7d29-47fd-a8ca-87d34aa67e3f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.533243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a2bc065-7d29-47fd-a8ca-87d34aa67e3f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:32.534220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a2bc065-7d29-47fd-a8ca-87d34aa67e3f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:32.535079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a2bc065-7d29-47fd-a8ca-87d34aa67e3f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.759809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a2bc065-7d29-47fd-a8ca-87d34aa67e3f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:32.770030 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2a2bc065-7d29-47fd-a8ca-87d34aa67e3f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.253823 Oct 18 13:27:32.771265 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1385/2612] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:32 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:32.832674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-649c0d04-8978-4a6d-998f-102f3b55279c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:32.871485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-649c0d04-8978-4a6d-998f-102f3b55279c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:32.874932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-649c0d04-8978-4a6d-998f-102f3b55279c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:32.878808 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-649c0d04-8978-4a6d-998f-102f3b55279c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 2832 microversion: 2.42 time: 0.556296 Oct 18 13:27:32.880071 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1228/2613] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:32 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 2832 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:27:32.914771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1dae284e-96b6-418d-a906-0445ed0a3f47 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:32.915628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1dae284e-96b6-418d-a906-0445ed0a3f47 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:32.921464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:32.923771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dae284e-96b6-418d-a906-0445ed0a3f47 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:32.924445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dae284e-96b6-418d-a906-0445ed0a3f47 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:32.925042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dae284e-96b6-418d-a906-0445ed0a3f47 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:32.925978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dae284e-96b6-418d-a906-0445ed0a3f47 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:32.926593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dae284e-96b6-418d-a906-0445ed0a3f47 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:32.927274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dae284e-96b6-418d-a906-0445ed0a3f47 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:33.081053 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1dae284e-96b6-418d-a906-0445ed0a3f47 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.170737 Oct 18 13:27:33.081942 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1386/2614] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 18 13:27:32 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567/os-interface => generated 1833 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:33.186895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3f8b1805-e75e-48d6-800d-e16c4cd73ed9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:33.187932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3f8b1805-e75e-48d6-800d-e16c4cd73ed9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:33.207263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f21e6e0b-5c55-4f63-8b97-8bfb9536a967 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:33.207869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f21e6e0b-5c55-4f63-8b97-8bfb9536a967 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:33.217203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f8b1805-e75e-48d6-800d-e16c4cd73ed9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:33.221462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f21e6e0b-5c55-4f63-8b97-8bfb9536a967 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:33.222276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f21e6e0b-5c55-4f63-8b97-8bfb9536a967 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:33.222985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f8b1805-e75e-48d6-800d-e16c4cd73ed9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:33.224192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f21e6e0b-5c55-4f63-8b97-8bfb9536a967 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:33.228984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f8b1805-e75e-48d6-800d-e16c4cd73ed9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:33.230052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f21e6e0b-5c55-4f63-8b97-8bfb9536a967 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:33.230951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f8b1805-e75e-48d6-800d-e16c4cd73ed9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:33.233079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f21e6e0b-5c55-4f63-8b97-8bfb9536a967 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:33.233702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f21e6e0b-5c55-4f63-8b97-8bfb9536a967 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:33.234045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f8b1805-e75e-48d6-800d-e16c4cd73ed9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:33.235356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f8b1805-e75e-48d6-800d-e16c4cd73ed9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:33.587343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3f8b1805-e75e-48d6-800d-e16c4cd73ed9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:33.604215 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3f8b1805-e75e-48d6-800d-e16c4cd73ed9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.417334 Oct 18 13:27:33.604809 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1229/2615] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:33 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:33.609795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2b5b4130-332a-4bb2-992d-197cb633d89d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:33.612954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2b5b4130-332a-4bb2-992d-197cb633d89d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:33.627829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b5b4130-332a-4bb2-992d-197cb633d89d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:33.634569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b5b4130-332a-4bb2-992d-197cb633d89d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:33.635221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b5b4130-332a-4bb2-992d-197cb633d89d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:33.636233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b5b4130-332a-4bb2-992d-197cb633d89d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:33.642662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b5b4130-332a-4bb2-992d-197cb633d89d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:33.643393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b5b4130-332a-4bb2-992d-197cb633d89d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:33.793733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-2b5b4130-332a-4bb2-992d-197cb633d89d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:33.838281 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2b5b4130-332a-4bb2-992d-197cb633d89d tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.232046 Oct 18 13:27:33.839872 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1230/2616] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:33 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:33.852357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0c1116ea-918f-4e7b-adbc-e58cb1cb406c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:33.863238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0c1116ea-918f-4e7b-adbc-e58cb1cb406c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:33.875976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c1116ea-918f-4e7b-adbc-e58cb1cb406c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:33.877891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c1116ea-918f-4e7b-adbc-e58cb1cb406c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:33.880546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c1116ea-918f-4e7b-adbc-e58cb1cb406c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:33.881286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c1116ea-918f-4e7b-adbc-e58cb1cb406c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:33.882315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c1116ea-918f-4e7b-adbc-e58cb1cb406c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:33.884444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c1116ea-918f-4e7b-adbc-e58cb1cb406c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:34.089772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f21e6e0b-5c55-4f63-8b97-8bfb9536a967 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:34.098420 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f21e6e0b-5c55-4f63-8b97-8bfb9536a967 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1330 microversion: 2.1 time: 0.896605 Oct 18 13:27:34.102801 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1387/2617] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:33 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1330 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:34.199001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0c1116ea-918f-4e7b-adbc-e58cb1cb406c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:34.217156 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0c1116ea-918f-4e7b-adbc-e58cb1cb406c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.375487 Oct 18 13:27:34.218791 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1231/2618] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:33 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:34.633888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d62e889-fd38-4076-a668-a28d44651b3d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:34.634976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d62e889-fd38-4076-a668-a28d44651b3d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:34.644713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d62e889-fd38-4076-a668-a28d44651b3d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:34.645683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d62e889-fd38-4076-a668-a28d44651b3d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:34.646327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d62e889-fd38-4076-a668-a28d44651b3d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:34.648001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d62e889-fd38-4076-a668-a28d44651b3d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:34.649284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d62e889-fd38-4076-a668-a28d44651b3d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:34.649968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d62e889-fd38-4076-a668-a28d44651b3d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:34.868641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f1154e5-345d-4159-8408-fdc3eb67a207 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:34.869273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7f1154e5-345d-4159-8408-fdc3eb67a207 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:34.877095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f1154e5-345d-4159-8408-fdc3eb67a207 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:34.877963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f1154e5-345d-4159-8408-fdc3eb67a207 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:34.885630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f1154e5-345d-4159-8408-fdc3eb67a207 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:34.886663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f1154e5-345d-4159-8408-fdc3eb67a207 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:34.887174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f1154e5-345d-4159-8408-fdc3eb67a207 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:34.888843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f1154e5-345d-4159-8408-fdc3eb67a207 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:34.948603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:35.018408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9d62e889-fd38-4076-a668-a28d44651b3d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:35.031741 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d62e889-fd38-4076-a668-a28d44651b3d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.403193 Oct 18 13:27:35.033076 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1388/2619] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:34 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:35.038399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-a806a517-8662-4c63-9c38-d4ae71396519 req-0148bade-14be-417b-a147-18271f83d8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "tag": "2979f9f0-551e-4518-be50-6140626a03d0"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:35.057360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-7f1154e5-345d-4159-8408-fdc3eb67a207 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:35.063700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a806a517-8662-4c63-9c38-d4ae71396519 req-0148bade-14be-417b-a147-18271f83d8f8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:35.064186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a806a517-8662-4c63-9c38-d4ae71396519 req-0148bade-14be-417b-a147-18271f83d8f8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:35.064608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a806a517-8662-4c63-9c38-d4ae71396519 req-0148bade-14be-417b-a147-18271f83d8f8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:35.078841 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-a806a517-8662-4c63-9c38-d4ae71396519 req-0148bade-14be-417b-a147-18271f83d8f8 service nova] Creating event network-changed:2979f9f0-551e-4518-be50-6140626a03d0 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:27:35.103950 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-a806a517-8662-4c63-9c38-d4ae71396519 req-0148bade-14be-417b-a147-18271f83d8f8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068999 Oct 18 13:27:35.104899 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7f1154e5-345d-4159-8408-fdc3eb67a207 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.235342 Oct 18 13:27:35.105019 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1389/2620] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:35.109633 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1232/2621] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:34 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:35.143441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ad3d33ab-9dcf-4dda-8434-ae65d60226bc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:35.144413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ad3d33ab-9dcf-4dda-8434-ae65d60226bc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:35.155786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad3d33ab-9dcf-4dda-8434-ae65d60226bc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:35.156642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad3d33ab-9dcf-4dda-8434-ae65d60226bc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:35.157341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad3d33ab-9dcf-4dda-8434-ae65d60226bc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:35.158380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad3d33ab-9dcf-4dda-8434-ae65d60226bc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:35.159081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad3d33ab-9dcf-4dda-8434-ae65d60226bc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:35.159720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad3d33ab-9dcf-4dda-8434-ae65d60226bc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:35.243346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-15938200-4311-4471-bdfa-c7ca0bda4bec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:35.243483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-15938200-4311-4471-bdfa-c7ca0bda4bec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:35.255345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15938200-4311-4471-bdfa-c7ca0bda4bec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:35.256000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15938200-4311-4471-bdfa-c7ca0bda4bec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:35.256470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15938200-4311-4471-bdfa-c7ca0bda4bec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:35.258670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15938200-4311-4471-bdfa-c7ca0bda4bec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:35.259140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15938200-4311-4471-bdfa-c7ca0bda4bec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:35.266414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15938200-4311-4471-bdfa-c7ca0bda4bec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:35.467388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ad3d33ab-9dcf-4dda-8434-ae65d60226bc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:35.479272 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ad3d33ab-9dcf-4dda-8434-ae65d60226bc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1330 microversion: 2.1 time: 0.357414 Oct 18 13:27:35.499050 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1390/2622] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:35 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1330 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:35.645569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f0c17de7-83d8-4e14-a3c5-1234c106a152 req-a91b3ead-1ffa-48a9-b56d-d3b824ded4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9412adf-f352-4aad-ac60-81be4892dc8f", "name": "network-vif-plugged", "status": "completed", "tag": "f6fb9e40-9bbf-41f6-afef-32d270604029"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:35.655751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f0c17de7-83d8-4e14-a3c5-1234c106a152 req-a91b3ead-1ffa-48a9-b56d-d3b824ded4e1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:35.656613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f0c17de7-83d8-4e14-a3c5-1234c106a152 req-a91b3ead-1ffa-48a9-b56d-d3b824ded4e1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:35.657554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f0c17de7-83d8-4e14-a3c5-1234c106a152 req-a91b3ead-1ffa-48a9-b56d-d3b824ded4e1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:35.672703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:35.676218 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f0c17de7-83d8-4e14-a3c5-1234c106a152 req-a91b3ead-1ffa-48a9-b56d-d3b824ded4e1 service nova] Creating event network-vif-plugged:f6fb9e40-9bbf-41f6-afef-32d270604029 for instance f9412adf-f352-4aad-ac60-81be4892dc8f on n-h1-858384-13 Oct 18 13:27:35.682410 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f0c17de7-83d8-4e14-a3c5-1234c106a152 req-a91b3ead-1ffa-48a9-b56d-d3b824ded4e1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040870 Oct 18 13:27:35.683922 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1391/2623] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:27:35.712913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-15938200-4311-4471-bdfa-c7ca0bda4bec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:35.722501 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-15938200-4311-4471-bdfa-c7ca0bda4bec tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.483927 Oct 18 13:27:35.723338 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1233/2624] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:35 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:36.058494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fba5bb13-1529-4716-a261-ce168bd4ba75 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:36.060014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fba5bb13-1529-4716-a261-ce168bd4ba75 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:36.078702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba5bb13-1529-4716-a261-ce168bd4ba75 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:36.079460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba5bb13-1529-4716-a261-ce168bd4ba75 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:36.080404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba5bb13-1529-4716-a261-ce168bd4ba75 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:36.081397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba5bb13-1529-4716-a261-ce168bd4ba75 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:36.082115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba5bb13-1529-4716-a261-ce168bd4ba75 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:36.083390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba5bb13-1529-4716-a261-ce168bd4ba75 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:36.138142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-45cd2166-7f35-4c87-91ce-7dec554affdf tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:36.138798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-45cd2166-7f35-4c87-91ce-7dec554affdf tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:36.151088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45cd2166-7f35-4c87-91ce-7dec554affdf tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:36.151869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45cd2166-7f35-4c87-91ce-7dec554affdf tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:36.152301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45cd2166-7f35-4c87-91ce-7dec554affdf tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:36.154171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45cd2166-7f35-4c87-91ce-7dec554affdf tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:36.156395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45cd2166-7f35-4c87-91ce-7dec554affdf tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:36.156909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45cd2166-7f35-4c87-91ce-7dec554affdf tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:36.269821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-45cd2166-7f35-4c87-91ce-7dec554affdf tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:36.298383 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-45cd2166-7f35-4c87-91ce-7dec554affdf tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.165454 Oct 18 13:27:36.299776 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1234/2625] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:36 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:27:36.364473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fba5bb13-1529-4716-a261-ce168bd4ba75 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:36.395173 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fba5bb13-1529-4716-a261-ce168bd4ba75 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.342430 Oct 18 13:27:36.396834 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1392/2626] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:36 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:36.515457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-67932d1b-00ae-456a-8fff-c9d345282037 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:36.516824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-67932d1b-00ae-456a-8fff-c9d345282037 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:36.525983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67932d1b-00ae-456a-8fff-c9d345282037 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:36.527024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67932d1b-00ae-456a-8fff-c9d345282037 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:36.527711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67932d1b-00ae-456a-8fff-c9d345282037 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:36.528647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67932d1b-00ae-456a-8fff-c9d345282037 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:36.529422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67932d1b-00ae-456a-8fff-c9d345282037 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:36.530304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67932d1b-00ae-456a-8fff-c9d345282037 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:36.753969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8b6d23e-39f6-46e2-affe-8bc52cecd0e5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:36.756276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8b6d23e-39f6-46e2-affe-8bc52cecd0e5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:36.770687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8b6d23e-39f6-46e2-affe-8bc52cecd0e5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:36.771431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8b6d23e-39f6-46e2-affe-8bc52cecd0e5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:36.771885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8b6d23e-39f6-46e2-affe-8bc52cecd0e5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:36.772886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8b6d23e-39f6-46e2-affe-8bc52cecd0e5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:36.775799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8b6d23e-39f6-46e2-affe-8bc52cecd0e5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:36.776283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8b6d23e-39f6-46e2-affe-8bc52cecd0e5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:36.817415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-67932d1b-00ae-456a-8fff-c9d345282037 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:36.837232 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-67932d1b-00ae-456a-8fff-c9d345282037 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1330 microversion: 2.1 time: 0.330004 Oct 18 13:27:36.838535 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1235/2627] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:36 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1330 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:37.232080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b8b6d23e-39f6-46e2-affe-8bc52cecd0e5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:37.242782 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8b6d23e-39f6-46e2-affe-8bc52cecd0e5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.497966 Oct 18 13:27:37.245807 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1393/2628] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:36 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:37.337885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8c993898-51b3-4bb8-b90e-f7091d5f2e12 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:37.339115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8c993898-51b3-4bb8-b90e-f7091d5f2e12 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:37.351492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c993898-51b3-4bb8-b90e-f7091d5f2e12 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:37.352288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c993898-51b3-4bb8-b90e-f7091d5f2e12 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:37.352945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c993898-51b3-4bb8-b90e-f7091d5f2e12 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:37.353911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c993898-51b3-4bb8-b90e-f7091d5f2e12 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:37.357552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c993898-51b3-4bb8-b90e-f7091d5f2e12 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:37.358218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c993898-51b3-4bb8-b90e-f7091d5f2e12 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:37.423769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d6902334-f7f6-4f55-aead-725edfd74004 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:37.425651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d6902334-f7f6-4f55-aead-725edfd74004 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:37.437793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6902334-f7f6-4f55-aead-725edfd74004 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:37.438527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6902334-f7f6-4f55-aead-725edfd74004 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:37.440016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6902334-f7f6-4f55-aead-725edfd74004 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:37.440922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6902334-f7f6-4f55-aead-725edfd74004 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:37.441573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6902334-f7f6-4f55-aead-725edfd74004 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:37.442159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6902334-f7f6-4f55-aead-725edfd74004 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:37.597675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-8c993898-51b3-4bb8-b90e-f7091d5f2e12 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:37.651441 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8c993898-51b3-4bb8-b90e-f7091d5f2e12 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.324822 Oct 18 13:27:37.652347 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1236/2629] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:37 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:37.740623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d6902334-f7f6-4f55-aead-725edfd74004 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:37.750890 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d6902334-f7f6-4f55-aead-725edfd74004 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.331642 Oct 18 13:27:37.751926 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1394/2630] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:37 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:37.864061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-04ff9390-4361-41ba-acc0-c13bd3cdc2c4 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:37.865423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-04ff9390-4361-41ba-acc0-c13bd3cdc2c4 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:37.878182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04ff9390-4361-41ba-acc0-c13bd3cdc2c4 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:37.878689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04ff9390-4361-41ba-acc0-c13bd3cdc2c4 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:37.881489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04ff9390-4361-41ba-acc0-c13bd3cdc2c4 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:37.882287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04ff9390-4361-41ba-acc0-c13bd3cdc2c4 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:37.882760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04ff9390-4361-41ba-acc0-c13bd3cdc2c4 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:37.884347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04ff9390-4361-41ba-acc0-c13bd3cdc2c4 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.184921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-04ff9390-4361-41ba-acc0-c13bd3cdc2c4 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:38.199190 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-04ff9390-4361-41ba-acc0-c13bd3cdc2c4 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1534 microversion: 2.1 time: 0.341830 Oct 18 13:27:38.213667 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1237/2631] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:37 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1534 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:38.226045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1887f5b6-1685-4186-a7ce-49f74aecb29a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Action: 'create', calling method: .version_select at 0x7ff60ef60670>, body: {"pool": "0886a8ee-8c44-41d8-a6e7-991604b6adb5"} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:38.275117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-813065e6-501e-4648-929f-9d12ac2017f1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:38.276544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-813065e6-501e-4648-929f-9d12ac2017f1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:38.287048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-813065e6-501e-4648-929f-9d12ac2017f1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:38.288638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-813065e6-501e-4648-929f-9d12ac2017f1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:38.289363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-813065e6-501e-4648-929f-9d12ac2017f1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.290432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-813065e6-501e-4648-929f-9d12ac2017f1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:38.291099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-813065e6-501e-4648-929f-9d12ac2017f1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:38.293105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-813065e6-501e-4648-929f-9d12ac2017f1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.476922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-813065e6-501e-4648-929f-9d12ac2017f1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:38.487048 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-813065e6-501e-4648-929f-9d12ac2017f1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.218641 Oct 18 13:27:38.501424 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1238/2632] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:38 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:38.683618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7be3a06e-3e0f-42d2-8215-b393ef0994ab tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:38.684221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7be3a06e-3e0f-42d2-8215-b393ef0994ab tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:38.690970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7be3a06e-3e0f-42d2-8215-b393ef0994ab tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:38.691681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7be3a06e-3e0f-42d2-8215-b393ef0994ab tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:38.692280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7be3a06e-3e0f-42d2-8215-b393ef0994ab tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.693163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7be3a06e-3e0f-42d2-8215-b393ef0994ab tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:38.693793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7be3a06e-3e0f-42d2-8215-b393ef0994ab tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:38.694507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7be3a06e-3e0f-42d2-8215-b393ef0994ab tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.778528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-7be3a06e-3e0f-42d2-8215-b393ef0994ab tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:38.798263 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7be3a06e-3e0f-42d2-8215-b393ef0994ab tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.118338 Oct 18 13:27:38.799578 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1239/2633] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:38 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:27:38.805127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5f3abf9f-051f-443c-a00b-75aaee1b93ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:38.806044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5f3abf9f-051f-443c-a00b-75aaee1b93ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:38.813113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f3abf9f-051f-443c-a00b-75aaee1b93ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:38.813867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f3abf9f-051f-443c-a00b-75aaee1b93ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:38.814483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f3abf9f-051f-443c-a00b-75aaee1b93ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.815343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f3abf9f-051f-443c-a00b-75aaee1b93ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:38.815941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f3abf9f-051f-443c-a00b-75aaee1b93ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:38.816505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f3abf9f-051f-443c-a00b-75aaee1b93ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:38.991938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5f3abf9f-051f-443c-a00b-75aaee1b93ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:39.002285 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5f3abf9f-051f-443c-a00b-75aaee1b93ff tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.201309 Oct 18 13:27:39.003783 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1240/2634] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:38 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:39.513291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8e2932b1-08cc-44f7-89ec-432e844c1748 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:39.514581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8e2932b1-08cc-44f7-89ec-432e844c1748 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:39.521920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e2932b1-08cc-44f7-89ec-432e844c1748 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:39.523013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e2932b1-08cc-44f7-89ec-432e844c1748 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:39.523550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e2932b1-08cc-44f7-89ec-432e844c1748 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:39.524370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e2932b1-08cc-44f7-89ec-432e844c1748 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:39.524909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e2932b1-08cc-44f7-89ec-432e844c1748 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:39.525614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e2932b1-08cc-44f7-89ec-432e844c1748 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:39.698031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8e2932b1-08cc-44f7-89ec-432e844c1748 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:39.718444 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8e2932b1-08cc-44f7-89ec-432e844c1748 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.208432 Oct 18 13:27:39.723001 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1241/2635] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:39 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:39.832165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0072bd47-ec7c-4a0e-b7e4-077eefb666be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:39.832809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0072bd47-ec7c-4a0e-b7e4-077eefb666be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:39.846489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0072bd47-ec7c-4a0e-b7e4-077eefb666be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:39.847207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0072bd47-ec7c-4a0e-b7e4-077eefb666be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:39.847804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0072bd47-ec7c-4a0e-b7e4-077eefb666be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:39.848689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0072bd47-ec7c-4a0e-b7e4-077eefb666be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:39.849528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0072bd47-ec7c-4a0e-b7e4-077eefb666be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:39.849965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0072bd47-ec7c-4a0e-b7e4-077eefb666be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:39.949759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-0072bd47-ec7c-4a0e-b7e4-077eefb666be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:39.973517 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0072bd47-ec7c-4a0e-b7e4-077eefb666be tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.148743 Oct 18 13:27:39.996691 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1242/2636] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:39 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:40.031472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-66ad750b-494b-4a1d-9a47-adcb598a2417 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:40.034154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-66ad750b-494b-4a1d-9a47-adcb598a2417 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:40.043245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66ad750b-494b-4a1d-9a47-adcb598a2417 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:40.044321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66ad750b-494b-4a1d-9a47-adcb598a2417 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:40.045225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66ad750b-494b-4a1d-9a47-adcb598a2417 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:40.047272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66ad750b-494b-4a1d-9a47-adcb598a2417 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:40.048356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66ad750b-494b-4a1d-9a47-adcb598a2417 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:40.049010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66ad750b-494b-4a1d-9a47-adcb598a2417 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:40.234961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-66ad750b-494b-4a1d-9a47-adcb598a2417 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:40.245449 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-66ad750b-494b-4a1d-9a47-adcb598a2417 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1511 microversion: 2.1 time: 0.219023 Oct 18 13:27:40.246434 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1243/2637] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:40 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:40.748157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f32cc20b-ff40-4cba-9a80-2ec46985a910 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:40.749913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f32cc20b-ff40-4cba-9a80-2ec46985a910 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:40.771645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f32cc20b-ff40-4cba-9a80-2ec46985a910 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:40.775584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f32cc20b-ff40-4cba-9a80-2ec46985a910 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:40.776438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f32cc20b-ff40-4cba-9a80-2ec46985a910 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:40.779080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f32cc20b-ff40-4cba-9a80-2ec46985a910 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:40.779729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f32cc20b-ff40-4cba-9a80-2ec46985a910 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:40.780342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f32cc20b-ff40-4cba-9a80-2ec46985a910 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:41.248303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f32cc20b-ff40-4cba-9a80-2ec46985a910 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:41.265923 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f32cc20b-ff40-4cba-9a80-2ec46985a910 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.526309 Oct 18 13:27:41.269628 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1244/2638] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:40 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:41.288861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-485ce7fa-68ba-479a-81ef-97c423f4a28e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:41.291318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-485ce7fa-68ba-479a-81ef-97c423f4a28e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:41.313810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-485ce7fa-68ba-479a-81ef-97c423f4a28e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:41.314406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-485ce7fa-68ba-479a-81ef-97c423f4a28e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:41.314925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-485ce7fa-68ba-479a-81ef-97c423f4a28e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:41.315718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-485ce7fa-68ba-479a-81ef-97c423f4a28e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:41.319014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-485ce7fa-68ba-479a-81ef-97c423f4a28e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:41.319722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-485ce7fa-68ba-479a-81ef-97c423f4a28e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:41.558278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-485ce7fa-68ba-479a-81ef-97c423f4a28e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:41.638434 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-485ce7fa-68ba-479a-81ef-97c423f4a28e tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.358953 Oct 18 13:27:41.647677 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1245/2639] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:41 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:41.652376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-069fb718-b67e-49ff-8a04-a6e71b53c05e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:41.652991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-069fb718-b67e-49ff-8a04-a6e71b53c05e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:41.682374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-069fb718-b67e-49ff-8a04-a6e71b53c05e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:41.684903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-069fb718-b67e-49ff-8a04-a6e71b53c05e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:41.685427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-069fb718-b67e-49ff-8a04-a6e71b53c05e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:41.686178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-069fb718-b67e-49ff-8a04-a6e71b53c05e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:41.686641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-069fb718-b67e-49ff-8a04-a6e71b53c05e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:41.687068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-069fb718-b67e-49ff-8a04-a6e71b53c05e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:42.387837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-069fb718-b67e-49ff-8a04-a6e71b53c05e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:42.394205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:42.420723 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-069fb718-b67e-49ff-8a04-a6e71b53c05e tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1488 microversion: 2.1 time: 0.780012 Oct 18 13:27:42.421410 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1246/2640] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:41 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1488 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:42.440202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-550ff793-0f9a-4843-903a-1fe61f5b8119 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:42.441741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-550ff793-0f9a-4843-903a-1fe61f5b8119 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:42.458377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550ff793-0f9a-4843-903a-1fe61f5b8119 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:42.459320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550ff793-0f9a-4843-903a-1fe61f5b8119 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:42.461073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550ff793-0f9a-4843-903a-1fe61f5b8119 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:42.462215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550ff793-0f9a-4843-903a-1fe61f5b8119 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:42.463864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550ff793-0f9a-4843-903a-1fe61f5b8119 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:42.464812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550ff793-0f9a-4843-903a-1fe61f5b8119 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:42.589058 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1887f5b6-1685-4186-a7ce-49f74aecb29a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.367612 Oct 18 13:27:42.590955 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1395/2641] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 18 13:27:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:42.595871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8472c52-4254-4f57-830a-9e08746c5be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:42.596612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8472c52-4254-4f57-830a-9e08746c5be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:42.613167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8472c52-4254-4f57-830a-9e08746c5be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:42.613711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8472c52-4254-4f57-830a-9e08746c5be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:42.614172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8472c52-4254-4f57-830a-9e08746c5be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:42.614904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8472c52-4254-4f57-830a-9e08746c5be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:42.618552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8472c52-4254-4f57-830a-9e08746c5be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:42.619193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8472c52-4254-4f57-830a-9e08746c5be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:42.687987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8472c52-4254-4f57-830a-9e08746c5be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:27:42.900091 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8472c52-4254-4f57-830a-9e08746c5be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 204 len: 0 microversion: 2.1 time: 0.289795 Oct 18 13:27:42.906667 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1396/2642] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:27:42 2022] DELETE /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:27:42.931841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.244"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:42.937830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:42.956240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:42.956836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:42.958103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:42.960904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:42.961447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:42.962072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:43.056860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "refresh_cache-f9412adf-f352-4aad-ac60-81be4892dc8f" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:27:43.057369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquired lock "refresh_cache-f9412adf-f352-4aad-ac60-81be4892dc8f" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:27:43.314675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-550ff793-0f9a-4843-903a-1fe61f5b8119 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:43.330006 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-550ff793-0f9a-4843-903a-1fe61f5b8119 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.903999 Oct 18 13:27:43.352643 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1247/2643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:42 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:43.364301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-94a3c376-3dc2-4588-b8bc-5e513e108249 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:43.365311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-94a3c376-3dc2-4588-b8bc-5e513e108249 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:43.378577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94a3c376-3dc2-4588-b8bc-5e513e108249 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:43.383713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94a3c376-3dc2-4588-b8bc-5e513e108249 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:43.384485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94a3c376-3dc2-4588-b8bc-5e513e108249 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:43.385507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94a3c376-3dc2-4588-b8bc-5e513e108249 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:43.390462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94a3c376-3dc2-4588-b8bc-5e513e108249 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:43.391583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94a3c376-3dc2-4588-b8bc-5e513e108249 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:43.511925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-94a3c376-3dc2-4588-b8bc-5e513e108249 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:43.548231 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-94a3c376-3dc2-4588-b8bc-5e513e108249 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1931 microversion: 2.75 time: 0.193952 Oct 18 13:27:43.552784 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1248/2644] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:43 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1931 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:43.559152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-29b15753-7af6-406d-b372-0517f24c0d1a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:43.560063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-29b15753-7af6-406d-b372-0517f24c0d1a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:43.573786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29b15753-7af6-406d-b372-0517f24c0d1a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:43.574658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29b15753-7af6-406d-b372-0517f24c0d1a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:43.575337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29b15753-7af6-406d-b372-0517f24c0d1a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:43.580535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29b15753-7af6-406d-b372-0517f24c0d1a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:43.581245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29b15753-7af6-406d-b372-0517f24c0d1a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:43.581928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29b15753-7af6-406d-b372-0517f24c0d1a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:43.888582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-29b15753-7af6-406d-b372-0517f24c0d1a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:43.904930 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-29b15753-7af6-406d-b372-0517f24c0d1a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1494 microversion: 2.1 time: 0.343475 Oct 18 13:27:43.906266 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1249/2645] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:43 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1494 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:44.492520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1941409040", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "d8caf9e7-a3bc-47de-afe3-4d801826442e"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:44.576311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] validate_networks() for [('d8caf9e7-a3bc-47de-afe3-4d801826442e', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:27:45.125629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:27:45.126262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:27:45.126905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:27:45.127691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:27:45.128234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Building network info cache for instance {{(pid=120611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:27:45.128764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:27:45.141688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:45.142993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:45.143601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:45.144663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:45.145829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:45.146556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:45.225122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Getting quotas for project dc35dfc1cb9b4935814339ccaa47e48b. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:45.267939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:45.275435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Getting quotas for user 2d958d612eec4e968daf74e18c171919 and project dc35dfc1cb9b4935814339ccaa47e48b. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:45.343161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:27:45.349651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:27:45.439070 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-838ed81e-c809-4df1-b27e-50ce44a9591e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219343 Oct 18 13:27:45.440463 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1250/2646] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:27:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:27:45.453226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a64dbf92-526c-4314-b38e-7fe148f74db0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:45.456337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a64dbf92-526c-4314-b38e-7fe148f74db0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:45.472767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a64dbf92-526c-4314-b38e-7fe148f74db0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:45.473741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a64dbf92-526c-4314-b38e-7fe148f74db0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:45.474429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a64dbf92-526c-4314-b38e-7fe148f74db0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:45.488236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a64dbf92-526c-4314-b38e-7fe148f74db0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:45.489028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a64dbf92-526c-4314-b38e-7fe148f74db0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:45.489960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a64dbf92-526c-4314-b38e-7fe148f74db0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:45.816881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a64dbf92-526c-4314-b38e-7fe148f74db0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:45.828264 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a64dbf92-526c-4314-b38e-7fe148f74db0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.386375 Oct 18 13:27:45.829634 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1251/2647] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:45 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:45.845908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d81fb9cb-8f4b-4ae5-b607-d5e038ae7477 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:45.846734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d81fb9cb-8f4b-4ae5-b607-d5e038ae7477 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:45.858343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81fb9cb-8f4b-4ae5-b607-d5e038ae7477 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:45.863199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81fb9cb-8f4b-4ae5-b607-d5e038ae7477 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:45.864459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81fb9cb-8f4b-4ae5-b607-d5e038ae7477 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:45.870227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81fb9cb-8f4b-4ae5-b607-d5e038ae7477 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:45.870827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81fb9cb-8f4b-4ae5-b607-d5e038ae7477 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:45.872112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81fb9cb-8f4b-4ae5-b607-d5e038ae7477 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:46.035277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-d81fb9cb-8f4b-4ae5-b607-d5e038ae7477 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:46.073297 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d81fb9cb-8f4b-4ae5-b607-d5e038ae7477 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1937 microversion: 2.75 time: 0.241207 Oct 18 13:27:46.073859 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1252/2648] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:45 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1937 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:46.184232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-526596d8-3a4a-45a9-a765-00b9ba40dba9 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Action: 'create', calling method: .version_select at 0x7ff60f022430>, body: {"keypair": {"name": "tempest-keypair-1333962263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCOA8sZfcBNv6nbNJW/cKB5dF6C08W4U71YKxhSeWmhyloOLD1iz3qrkpSnNbvzRJjq/W7H4xXioE8sLU9H4DMF5+1Dzu6zNLHfa1s+5F4iEH4tbjORSqnW0ydCWVBXQA=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:46.223428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-526596d8-3a4a-45a9-a765-00b9ba40dba9 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Getting quotas for project 075e04a2359c4f17a5c7cc521e43b885. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:46.236152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-526596d8-3a4a-45a9-a765-00b9ba40dba9 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Getting quotas for user 1d35e70a94604d1f9539fa8c91d06353 and project 075e04a2359c4f17a5c7cc521e43b885. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:46.292380 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-526596d8-3a4a-45a9-a765-00b9ba40dba9 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.217425 Oct 18 13:27:46.293747 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1253/2649] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:27:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:46.299379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed635eb4-c024-4b16-893f-34e3cf9b1be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:46.300249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ed635eb4-c024-4b16-893f-34e3cf9b1be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:46.312762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed635eb4-c024-4b16-893f-34e3cf9b1be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:46.322945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed635eb4-c024-4b16-893f-34e3cf9b1be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:46.325739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed635eb4-c024-4b16-893f-34e3cf9b1be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:46.328035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed635eb4-c024-4b16-893f-34e3cf9b1be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:46.329647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed635eb4-c024-4b16-893f-34e3cf9b1be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:46.334280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed635eb4-c024-4b16-893f-34e3cf9b1be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:46.484664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ed635eb4-c024-4b16-893f-34e3cf9b1be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:46.493882 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ed635eb4-c024-4b16-893f-34e3cf9b1be6 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1452 microversion: 2.1 time: 0.198872 Oct 18 13:27:46.495083 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1254/2650] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:46 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1452 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:46.510841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-df023707-6a27-4797-a1da-8048b32f6344 req-e3212cc3-c725-430d-b973-2ad35d2245c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9412adf-f352-4aad-ac60-81be4892dc8f", "tag": "f6fb9e40-9bbf-41f6-afef-32d270604029"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:46.534531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-df023707-6a27-4797-a1da-8048b32f6344 req-e3212cc3-c725-430d-b973-2ad35d2245c6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:46.535277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-df023707-6a27-4797-a1da-8048b32f6344 req-e3212cc3-c725-430d-b973-2ad35d2245c6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:46.536042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-df023707-6a27-4797-a1da-8048b32f6344 req-e3212cc3-c725-430d-b973-2ad35d2245c6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:46.551860 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-df023707-6a27-4797-a1da-8048b32f6344 req-e3212cc3-c725-430d-b973-2ad35d2245c6 service nova] Creating event network-changed:f6fb9e40-9bbf-41f6-afef-32d270604029 for instance f9412adf-f352-4aad-ac60-81be4892dc8f on n-h1-858384-13 Oct 18 13:27:46.564796 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-df023707-6a27-4797-a1da-8048b32f6344 req-e3212cc3-c725-430d-b973-2ad35d2245c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068267 Oct 18 13:27:46.566029 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1255/2651] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:46.573792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-71d7b3e8-915d-492c-97ff-b5b65fb55a0f tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:46.575078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-71d7b3e8-915d-492c-97ff-b5b65fb55a0f tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:46.582680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71d7b3e8-915d-492c-97ff-b5b65fb55a0f tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:46.583779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71d7b3e8-915d-492c-97ff-b5b65fb55a0f tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:46.584616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71d7b3e8-915d-492c-97ff-b5b65fb55a0f tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:46.585893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71d7b3e8-915d-492c-97ff-b5b65fb55a0f tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:46.586549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71d7b3e8-915d-492c-97ff-b5b65fb55a0f tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:46.587199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71d7b3e8-915d-492c-97ff-b5b65fb55a0f tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:46.677775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-71d7b3e8-915d-492c-97ff-b5b65fb55a0f tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:46.686707 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-71d7b3e8-915d-492c-97ff-b5b65fb55a0f tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1220 microversion: 2.1 time: 0.119216 Oct 18 13:27:46.702280 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1256/2652] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:46 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1220 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:46.856101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ebab5de9-acf4-459a-9e3b-f76b7f3f85fb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:46.857540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ebab5de9-acf4-459a-9e3b-f76b7f3f85fb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:46.864354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebab5de9-acf4-459a-9e3b-f76b7f3f85fb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:46.864830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebab5de9-acf4-459a-9e3b-f76b7f3f85fb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:46.865295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebab5de9-acf4-459a-9e3b-f76b7f3f85fb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:46.866532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebab5de9-acf4-459a-9e3b-f76b7f3f85fb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:46.877489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebab5de9-acf4-459a-9e3b-f76b7f3f85fb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:46.878079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebab5de9-acf4-459a-9e3b-f76b7f3f85fb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:47.271635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ebab5de9-acf4-459a-9e3b-f76b7f3f85fb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:47.281825 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ebab5de9-acf4-459a-9e3b-f76b7f3f85fb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.429544 Oct 18 13:27:47.286198 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1257/2653] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:46 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:47.293965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3d67dc11-fb8d-4e21-83cc-58a7b1f78a9b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:47.299555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3d67dc11-fb8d-4e21-83cc-58a7b1f78a9b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:47.321901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d67dc11-fb8d-4e21-83cc-58a7b1f78a9b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:47.328337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d67dc11-fb8d-4e21-83cc-58a7b1f78a9b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:47.329327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d67dc11-fb8d-4e21-83cc-58a7b1f78a9b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:47.336660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d67dc11-fb8d-4e21-83cc-58a7b1f78a9b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:47.337545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d67dc11-fb8d-4e21-83cc-58a7b1f78a9b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:47.338861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d67dc11-fb8d-4e21-83cc-58a7b1f78a9b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:47.605744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-3d67dc11-fb8d-4e21-83cc-58a7b1f78a9b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:47.642645 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3d67dc11-fb8d-4e21-83cc-58a7b1f78a9b tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1937 microversion: 2.75 time: 0.354558 Oct 18 13:27:47.646591 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1258/2654] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:47 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1937 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:47.654682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:47.657897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:47.690180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:47.694096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:47.694845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:47.695768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:47.696400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:47.698889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:47.796195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:47.796921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:47.797398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:47.798042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lazy-loading 'fault' on Instance uuid 011b3a1e-b73c-4005-b92f-ece6f98fee72 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:47.917869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:47.935488 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-576f6bd1-5b7c-48c4-9e59-b57badebf7c1 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 200 len: 1304 microversion: 2.1 time: 0.286902 Oct 18 13:27:47.936934 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1259/2655] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:47 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 1304 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:47.942287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b7fee2ab-8238-4537-ae6b-0badcdba4818 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:47.942913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b7fee2ab-8238-4537-ae6b-0badcdba4818 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:47.951520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7fee2ab-8238-4537-ae6b-0badcdba4818 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:47.952234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7fee2ab-8238-4537-ae6b-0badcdba4818 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:47.953004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7fee2ab-8238-4537-ae6b-0badcdba4818 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:47.953910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7fee2ab-8238-4537-ae6b-0badcdba4818 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:47.954745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7fee2ab-8238-4537-ae6b-0badcdba4818 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:47.955185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7fee2ab-8238-4537-ae6b-0badcdba4818 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:48.196330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b7fee2ab-8238-4537-ae6b-0badcdba4818 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:48.205599 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b7fee2ab-8238-4537-ae6b-0badcdba4818 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1276 microversion: 2.1 time: 0.267508 Oct 18 13:27:48.222360 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1260/2656] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:47 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1276 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:48.313305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5876595a-38e7-4fac-bbd2-9da9a646e1cc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:48.314298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5876595a-38e7-4fac-bbd2-9da9a646e1cc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:48.323768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5876595a-38e7-4fac-bbd2-9da9a646e1cc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:48.324643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5876595a-38e7-4fac-bbd2-9da9a646e1cc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:48.326902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5876595a-38e7-4fac-bbd2-9da9a646e1cc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:48.327835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5876595a-38e7-4fac-bbd2-9da9a646e1cc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:48.333961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5876595a-38e7-4fac-bbd2-9da9a646e1cc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:48.335211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5876595a-38e7-4fac-bbd2-9da9a646e1cc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:48.797705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Updating instance_info_cache with network_info: [{"id": "f6fb9e40-9bbf-41f6-afef-32d270604029", "address": "fa:16:3e:ca:d7:0d", "network": {"id": "5c46f408-47ff-4146-8ccb-50d5c1f67c4b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1748124832-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "79a03bf7e9014bb6b8e7ea64005b26c9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf6fb9e40-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:27:48.820310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Releasing lock "refresh_cache-f9412adf-f352-4aad-ac60-81be4892dc8f" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:27:48.821314 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3fa61003-2e62-4414-9881-16642c8320e2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action" status: 202 len: 0 microversion: 2.1 time: 5.911902 Oct 18 13:27:48.827937 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1397/2657] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:42 2022] POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action => generated 0 bytes in 5921 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:27:48.848126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-29386622-3cc5-4111-83e6-e9464479e440 req-1f7d979c-3e0e-4166-a760-b51f4f0b5e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011b3a1e-b73c-4005-b92f-ece6f98fee72", "name": "network-vif-deleted", "tag": "5a291329-93b2-4506-801a-ab24293cd321"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:48.884367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-29386622-3cc5-4111-83e6-e9464479e440 req-1f7d979c-3e0e-4166-a760-b51f4f0b5e2a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:48.885208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-29386622-3cc5-4111-83e6-e9464479e440 req-1f7d979c-3e0e-4166-a760-b51f4f0b5e2a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:48.885919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-29386622-3cc5-4111-83e6-e9464479e440 req-1f7d979c-3e0e-4166-a760-b51f4f0b5e2a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:48.901914 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-29386622-3cc5-4111-83e6-e9464479e440 req-1f7d979c-3e0e-4166-a760-b51f4f0b5e2a service nova] Creating event network-vif-deleted:5a291329-93b2-4506-801a-ab24293cd321 for instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 on n-h2-858384-13 Oct 18 13:27:48.908437 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-29386622-3cc5-4111-83e6-e9464479e440 req-1f7d979c-3e0e-4166-a760-b51f4f0b5e2a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077269 Oct 18 13:27:48.909686 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1398/2658] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:48.918099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f496aae-fb3c-47a9-a571-5b28fa0584b5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:48.919237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7f496aae-fb3c-47a9-a571-5b28fa0584b5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:48.934175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f496aae-fb3c-47a9-a571-5b28fa0584b5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:48.934907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f496aae-fb3c-47a9-a571-5b28fa0584b5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:48.935505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f496aae-fb3c-47a9-a571-5b28fa0584b5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:48.936465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f496aae-fb3c-47a9-a571-5b28fa0584b5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:48.937653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f496aae-fb3c-47a9-a571-5b28fa0584b5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:48.938350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f496aae-fb3c-47a9-a571-5b28fa0584b5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.006936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5876595a-38e7-4fac-bbd2-9da9a646e1cc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:49.021777 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5876595a-38e7-4fac-bbd2-9da9a646e1cc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1717 microversion: 2.1 time: 0.707375 Oct 18 13:27:49.023687 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1261/2659] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:48 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1717 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:49.031694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-10d3728a-d2a3-49d0-a1f5-dfadbf7345e6 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Action: 'create', calling method: .version_select at 0x7ff617a825e0>, body: {"pool": "0886a8ee-8c44-41d8-a6e7-991604b6adb5"} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:49.100784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-7f496aae-fb3c-47a9-a571-5b28fa0584b5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] Lazy-loading 'services' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:49.136924 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7f496aae-fb3c-47a9-a571-5b28fa0584b5 tempest-ServersAdmin275Test-380192902 tempest-ServersAdmin275Test-380192902-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1922 microversion: 2.75 time: 0.224427 Oct 18 13:27:49.137867 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1399/2660] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:48 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1922 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:49.142612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc3dc6e2-4234-4a4e-8ff9-403051efd556 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:49.143442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bc3dc6e2-4234-4a4e-8ff9-403051efd556 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:49.151006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc3dc6e2-4234-4a4e-8ff9-403051efd556 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.151751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc3dc6e2-4234-4a4e-8ff9-403051efd556 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.152338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc3dc6e2-4234-4a4e-8ff9-403051efd556 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.153227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc3dc6e2-4234-4a4e-8ff9-403051efd556 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.153830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc3dc6e2-4234-4a4e-8ff9-403051efd556 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.154402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc3dc6e2-4234-4a4e-8ff9-403051efd556 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.183509 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-bc3dc6e2-4234-4a4e-8ff9-403051efd556 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc3dc6e2-4234-4a4e-8ff9-403051efd556 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 HTTP/1.1 Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:27:49.185383 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:27:49.186976 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:27:49.186976 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:27:49.186976 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:27:49.186976 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:27:49.186976 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:27:49.186976 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:27:49.186976 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:27:49.186976 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:27:49.186976 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:27:49.186976 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:27:49.186976 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:27:49.186976 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '011b3a1e-b73c-4005-b92f-ece6f98fee72'} Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:49.188027 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:27:49.189530 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:49.191833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc3dc6e2-4234-4a4e-8ff9-403051efd556 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:49.192835 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bc3dc6e2-4234-4a4e-8ff9-403051efd556 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 404 len: 111 microversion: 2.1 time: 0.053869 Oct 18 13:27:49.193691 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1400/2661] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:49 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:27:49.211248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4dd77548-eb5f-482e-ae96-6c88945feb34 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:49.211751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4dd77548-eb5f-482e-ae96-6c88945feb34 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:49.220035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4dd77548-eb5f-482e-ae96-6c88945feb34 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.220526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4dd77548-eb5f-482e-ae96-6c88945feb34 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.220964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4dd77548-eb5f-482e-ae96-6c88945feb34 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.222366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4dd77548-eb5f-482e-ae96-6c88945feb34 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.222820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4dd77548-eb5f-482e-ae96-6c88945feb34 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.223246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4dd77548-eb5f-482e-ae96-6c88945feb34 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.259363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4dd77548-eb5f-482e-ae96-6c88945feb34 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:27:49.416664 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4dd77548-eb5f-482e-ae96-6c88945feb34 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 204 len: 0 microversion: 2.75 time: 0.216740 Oct 18 13:27:49.417292 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1401/2662] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:27:49 2022] DELETE /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:27:49.430954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5b162c68-2370-4422-805d-705e2ee666ff tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:49.431678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5b162c68-2370-4422-805d-705e2ee666ff tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:49.450600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b162c68-2370-4422-805d-705e2ee666ff tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.451515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b162c68-2370-4422-805d-705e2ee666ff tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.452217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b162c68-2370-4422-805d-705e2ee666ff tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.453716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b162c68-2370-4422-805d-705e2ee666ff tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:49.454725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b162c68-2370-4422-805d-705e2ee666ff tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:49.455361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b162c68-2370-4422-805d-705e2ee666ff tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:49.557251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5b162c68-2370-4422-805d-705e2ee666ff tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:49.572846 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5b162c68-2370-4422-805d-705e2ee666ff tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1274 microversion: 2.1 time: 0.154077 Oct 18 13:27:49.585599 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1402/2663] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:49 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1274 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:49.617803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1512038246", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "b5cc8010-ea63-4e1f-9434-bf4391452206"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:49.722487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] validate_networks() for [('b5cc8010-ea63-4e1f-9434-bf4391452206', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:27:50.286964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:27:50.288435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:27:50.290133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:27:50.290751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:27:50.291463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:27:50.301899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.302658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.303448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.304365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.304912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.305525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.324656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:50.330522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Getting quotas for user c0a722d1dc7c4e05b8cc8dc98b5cb619 and project 7b096c3406ce42d380811b170798afcd. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:50.346093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:27:50.348952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:27:50.403790 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a15cb408-6397-4777-80c5-f1e4978b1b81 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816358 Oct 18 13:27:50.404836 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1403/2664] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:27:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:27:50.410802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d6400ee4-d838-474b-bef9-4183de3c4c99 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:50.411428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d6400ee4-d838-474b-bef9-4183de3c4c99 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:50.421871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6400ee4-d838-474b-bef9-4183de3c4c99 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.422693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6400ee4-d838-474b-bef9-4183de3c4c99 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.423525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6400ee4-d838-474b-bef9-4183de3c4c99 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.423863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6400ee4-d838-474b-bef9-4183de3c4c99 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.424438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6400ee4-d838-474b-bef9-4183de3c4c99 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.424888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6400ee4-d838-474b-bef9-4183de3c4c99 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.519895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d6400ee4-d838-474b-bef9-4183de3c4c99 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:50.535591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d6400ee4-d838-474b-bef9-4183de3c4c99 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:50.538262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d6400ee4-d838-474b-bef9-4183de3c4c99 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:50.544639 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d6400ee4-d838-474b-bef9-4183de3c4c99 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1444 microversion: 2.75 time: 0.138700 Oct 18 13:27:50.545273 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1404/2665] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:50 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1444 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:50.550418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-95cb73c8-c548-4b58-a119-846ea16eb352 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:50.554456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-95cb73c8-c548-4b58-a119-846ea16eb352 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:50.562984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95cb73c8-c548-4b58-a119-846ea16eb352 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.563957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95cb73c8-c548-4b58-a119-846ea16eb352 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.564756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95cb73c8-c548-4b58-a119-846ea16eb352 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.565655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95cb73c8-c548-4b58-a119-846ea16eb352 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.566278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95cb73c8-c548-4b58-a119-846ea16eb352 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.568444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95cb73c8-c548-4b58-a119-846ea16eb352 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.664114 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-95cb73c8-c548-4b58-a119-846ea16eb352 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.117396 Oct 18 13:27:50.665155 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1405/2666] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:50 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:50.672960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b1090813-8b9f-454e-8104-e83231e647e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:50.673689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b1090813-8b9f-454e-8104-e83231e647e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:50.680669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1090813-8b9f-454e-8104-e83231e647e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.681533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1090813-8b9f-454e-8104-e83231e647e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.681962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1090813-8b9f-454e-8104-e83231e647e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.682871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1090813-8b9f-454e-8104-e83231e647e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:50.683468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1090813-8b9f-454e-8104-e83231e647e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:50.684057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1090813-8b9f-454e-8104-e83231e647e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:50.688682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:51.019532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b1090813-8b9f-454e-8104-e83231e647e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:51.029555 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b1090813-8b9f-454e-8104-e83231e647e8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1707 microversion: 2.1 time: 0.362814 Oct 18 13:27:51.030364 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1406/2667] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:50 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1707 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:51.035226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4b5a016b-77d7-4f3b-8196-8d33612cdb41 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:51.036015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4b5a016b-77d7-4f3b-8196-8d33612cdb41 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:51.043534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b5a016b-77d7-4f3b-8196-8d33612cdb41 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:51.044378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b5a016b-77d7-4f3b-8196-8d33612cdb41 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:51.044980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b5a016b-77d7-4f3b-8196-8d33612cdb41 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:51.045891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b5a016b-77d7-4f3b-8196-8d33612cdb41 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:51.046492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b5a016b-77d7-4f3b-8196-8d33612cdb41 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:51.047089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b5a016b-77d7-4f3b-8196-8d33612cdb41 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:51.179301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b5a016b-77d7-4f3b-8196-8d33612cdb41 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:51.221878 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4b5a016b-77d7-4f3b-8196-8d33612cdb41 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1219 microversion: 2.1 time: 0.188590 Oct 18 13:27:51.228926 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1407/2668] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:51 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1219 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:51.250316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db7f08a8-944a-477c-b169-067e4cd50ce4 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:51.258393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db7f08a8-944a-477c-b169-067e4cd50ce4 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:51.281216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db7f08a8-944a-477c-b169-067e4cd50ce4 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:51.281884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db7f08a8-944a-477c-b169-067e4cd50ce4 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:51.282620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db7f08a8-944a-477c-b169-067e4cd50ce4 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:51.284079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db7f08a8-944a-477c-b169-067e4cd50ce4 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:51.284708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db7f08a8-944a-477c-b169-067e4cd50ce4 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:51.285400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db7f08a8-944a-477c-b169-067e4cd50ce4 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:51.701088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db7f08a8-944a-477c-b169-067e4cd50ce4 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:51.713734 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db7f08a8-944a-477c-b169-067e4cd50ce4 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1316 microversion: 2.1 time: 0.482507 Oct 18 13:27:51.733673 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1408/2669] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:51 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:51.741468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-36e37397-c528-45a2-9862-3271204af798 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:51.743108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-36e37397-c528-45a2-9862-3271204af798 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:51.753150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36e37397-c528-45a2-9862-3271204af798 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:51.753865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36e37397-c528-45a2-9862-3271204af798 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:51.759424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36e37397-c528-45a2-9862-3271204af798 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:51.760656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36e37397-c528-45a2-9862-3271204af798 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:51.762233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36e37397-c528-45a2-9862-3271204af798 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:51.762890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36e37397-c528-45a2-9862-3271204af798 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.054085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-36e37397-c528-45a2-9862-3271204af798 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:52.062961 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-36e37397-c528-45a2-9862-3271204af798 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1672 microversion: 2.1 time: 0.328105 Oct 18 13:27:52.068004 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1409/2670] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:51 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1672 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:52.073614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f6cbc8cb-ed92-40a3-882b-a95a69e16777 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '.version_select at 0x7ff60ef37f70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:52.081206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6cbc8cb-ed92-40a3-882b-a95a69e16777 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.084192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6cbc8cb-ed92-40a3-882b-a95a69e16777 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.088730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6cbc8cb-ed92-40a3-882b-a95a69e16777 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.113901 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f6cbc8cb-ed92-40a3-882b-a95a69e16777 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1182 microversion: 2.1 time: 0.044635 Oct 18 13:27:52.114716 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1410/2671] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 18 13:27:52 2022] GET /compute/v2.1/os-migrations => generated 1182 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:52.128859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:52.129899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:52.144731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.145550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.146157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.148170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.150737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.152718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.249594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.250847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.252801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.253318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lazy-loading 'fault' on Instance uuid d3b7f283-916f-4bd7-ab0b-cae94a7e8399 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:52.342007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:52.354082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:52.355915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbf7cfb6f72e46458a61acf38fc33964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0234015cf94c6b8a5de068f86f4767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:52.361918 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7937541e-e440-4e6d-b80d-270043b3d95f tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 200 len: 1449 microversion: 2.75 time: 0.237120 Oct 18 13:27:52.363280 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1411/2672] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:52 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 1449 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:27:52.368374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e0b9b5b-4b59-41e1-a909-44f4a3dc0c7a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:52.369245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4e0b9b5b-4b59-41e1-a909-44f4a3dc0c7a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:52.375870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e0b9b5b-4b59-41e1-a909-44f4a3dc0c7a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.376562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e0b9b5b-4b59-41e1-a909-44f4a3dc0c7a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.376998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e0b9b5b-4b59-41e1-a909-44f4a3dc0c7a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.377753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e0b9b5b-4b59-41e1-a909-44f4a3dc0c7a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.378450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e0b9b5b-4b59-41e1-a909-44f4a3dc0c7a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.379090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e0b9b5b-4b59-41e1-a909-44f4a3dc0c7a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.551205 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4e0b9b5b-4b59-41e1-a909-44f4a3dc0c7a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1860 microversion: 2.1 time: 0.186659 Oct 18 13:27:52.552152 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1412/2673] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:52 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1860 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:52.573870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-88efce32-2ee8-4463-8830-b9caf63e2fdf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:52.574495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-88efce32-2ee8-4463-8830-b9caf63e2fdf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:52.583791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88efce32-2ee8-4463-8830-b9caf63e2fdf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.584416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88efce32-2ee8-4463-8830-b9caf63e2fdf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.585642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88efce32-2ee8-4463-8830-b9caf63e2fdf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.586442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88efce32-2ee8-4463-8830-b9caf63e2fdf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.587033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88efce32-2ee8-4463-8830-b9caf63e2fdf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.587670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88efce32-2ee8-4463-8830-b9caf63e2fdf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.657105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-88efce32-2ee8-4463-8830-b9caf63e2fdf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:52.665761 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-88efce32-2ee8-4463-8830-b9caf63e2fdf tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1267 microversion: 2.1 time: 0.112427 Oct 18 13:27:52.666360 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1413/2674] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:52 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1267 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:52.671122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e8c5260e-0ebe-4b59-a4d9-eb4bca0325fd tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:52.671739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e8c5260e-0ebe-4b59-a4d9-eb4bca0325fd tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:52.679813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8c5260e-0ebe-4b59-a4d9-eb4bca0325fd tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.680379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8c5260e-0ebe-4b59-a4d9-eb4bca0325fd tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.680827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8c5260e-0ebe-4b59-a4d9-eb4bca0325fd tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.682678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8c5260e-0ebe-4b59-a4d9-eb4bca0325fd tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.683505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8c5260e-0ebe-4b59-a4d9-eb4bca0325fd tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.684636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8c5260e-0ebe-4b59-a4d9-eb4bca0325fd tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.899320 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e8c5260e-0ebe-4b59-a4d9-eb4bca0325fd tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1860 microversion: 2.1 time: 0.231551 Oct 18 13:27:52.916570 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1414/2675] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:52 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1860 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:52.921529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-843100fa-7911-459c-8473-953914f0a7b7 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:52.922142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-843100fa-7911-459c-8473-953914f0a7b7 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:52.934186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-843100fa-7911-459c-8473-953914f0a7b7 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.935949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-843100fa-7911-459c-8473-953914f0a7b7 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.936591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-843100fa-7911-459c-8473-953914f0a7b7 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:52.938026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-843100fa-7911-459c-8473-953914f0a7b7 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:52.938680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-843100fa-7911-459c-8473-953914f0a7b7 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:52.939499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-843100fa-7911-459c-8473-953914f0a7b7 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.167181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-843100fa-7911-459c-8473-953914f0a7b7 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:53.175659 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-843100fa-7911-459c-8473-953914f0a7b7 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1316 microversion: 2.1 time: 0.257905 Oct 18 13:27:53.176289 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1415/2676] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:52 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:53.182718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c4e7f086-d262-44b1-9ee0-86a8d46b82c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:53.183216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c4e7f086-d262-44b1-9ee0-86a8d46b82c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:53.189612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4e7f086-d262-44b1-9ee0-86a8d46b82c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.190233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4e7f086-d262-44b1-9ee0-86a8d46b82c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.190674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4e7f086-d262-44b1-9ee0-86a8d46b82c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.191368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4e7f086-d262-44b1-9ee0-86a8d46b82c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.191824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4e7f086-d262-44b1-9ee0-86a8d46b82c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.192250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4e7f086-d262-44b1-9ee0-86a8d46b82c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.289294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-c4e7f086-d262-44b1-9ee0-86a8d46b82c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lazy-loading 'services' on Instance uuid e1f4088c-c321-4fc1-8bec-456d1178cda7 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:27:53.385008 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c4e7f086-d262-44b1-9ee0-86a8d46b82c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments/0c46e27e-21ed-43d5-819f-4876739c5601" status: 202 len: 0 microversion: 2.1 time: 0.207217 Oct 18 13:27:53.388470 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1416/2677] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:27:53 2022] DELETE /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments/0c46e27e-21ed-43d5-819f-4876739c5601 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:53.395706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-79ac869e-e2eb-4469-8272-650fc66c33dc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:53.397418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-79ac869e-e2eb-4469-8272-650fc66c33dc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:53.407649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:53.410326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ac869e-e2eb-4469-8272-650fc66c33dc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.411148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ac869e-e2eb-4469-8272-650fc66c33dc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.411607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ac869e-e2eb-4469-8272-650fc66c33dc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.414131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ac869e-e2eb-4469-8272-650fc66c33dc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.414775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ac869e-e2eb-4469-8272-650fc66c33dc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.415216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ac869e-e2eb-4469-8272-650fc66c33dc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.592091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79ac869e-e2eb-4469-8272-650fc66c33dc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:53.601877 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-79ac869e-e2eb-4469-8272-650fc66c33dc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.211875 Oct 18 13:27:53.602584 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1417/2678] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:53 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:53.608386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cabd2d4f-669b-44e0-b84c-428060d2a338 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:53.609370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cabd2d4f-669b-44e0-b84c-428060d2a338 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] [instance: d3b7f283-916f-4bd7-ab0b-cae94a7e8399] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:53.621775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cabd2d4f-669b-44e0-b84c-428060d2a338 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.622211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cabd2d4f-669b-44e0-b84c-428060d2a338 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.622770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cabd2d4f-669b-44e0-b84c-428060d2a338 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.623622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cabd2d4f-669b-44e0-b84c-428060d2a338 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.624180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cabd2d4f-669b-44e0-b84c-428060d2a338 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.626735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cabd2d4f-669b-44e0-b84c-428060d2a338 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.642542 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-cabd2d4f-669b-44e0-b84c-428060d2a338 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] HTTP exception thrown: Instance d3b7f283-916f-4bd7-ab0b-cae94a7e8399 could not be found. Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cabd2d4f-669b-44e0-b84c-428060d2a338 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Request method failure captured: Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 HTTP/1.1 Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqmCDbA23SjMZv9lrkNQVMDsioTDQfpQzn_4-ZxKusjFXFUOcBtmXl8ipQf0aRiDTW-icRxQE53oT0yAuwRMhTHeRrXMU1KH2KKCb6oD-T-8x3O5wXiR48SX7HTOf24XpRLZEL6-3uU_8Qn5p7HDiW6sSaZZTLJ_NY571j1IJPZATFQ Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.75 Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 8c0234015cf94c6b8a5de068f86f4767 Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersAdmin275Test-83699222 Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:27:53.644316 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:27:53.645954 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c0234015cf94c6b8a5de068f86f4767"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8c0234015cf94c6b8a5de068f86f4767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8c0234015cf94c6b8a5de068f86f4767"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8c0234015cf94c6b8a5de068f86f4767"}]}] Oct 18 13:27:53.645954 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersAdmin275Test-83699222 Oct 18 13:27:53.645954 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 8c0234015cf94c6b8a5de068f86f4767 Oct 18 13:27:53.645954 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersAdmin275Test-83699222 Oct 18 13:27:53.645954 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersAdmin275Test-83699222-project Oct 18 13:27:53.645954 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:27:53.645954 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:27:53.645954 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: bbf7cfb6f72e46458a61acf38fc33964 Oct 18 13:27:53.645954 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersAdmin275Test-83699222-project Oct 18 13:27:53.645954 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:27:53.645954 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance d3b7f283-916f-4bd7-ab0b-cae94a7e8399 could not be found. Oct 18 13:27:53.645954 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'd3b7f283-916f-4bd7-ab0b-cae94a7e8399'} Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b7f283-916f-4bd7-ab0b-cae94a7e8399 could not be found. Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:53.647389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b7f283-916f-4bd7-ab0b-cae94a7e8399 could not be found. Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b7f283-916f-4bd7-ab0b-cae94a7e8399 could not be found. Oct 18 13:27:53.648791 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:27:53.651135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cabd2d4f-669b-44e0-b84c-428060d2a338 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] Returning 404 to user: Instance d3b7f283-916f-4bd7-ab0b-cae94a7e8399 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:53.651135 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cabd2d4f-669b-44e0-b84c-428060d2a338 tempest-ServersAdmin275Test-83699222 tempest-ServersAdmin275Test-83699222-project] 10.222.0.40 "GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399" status: 404 len: 111 microversion: 2.75 time: 0.042326 Oct 18 13:27:53.651135 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1418/2679] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:27:53 2022] GET /compute/v2.1/servers/d3b7f283-916f-4bd7-ab0b-cae94a7e8399 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:27:53.654538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-92b7f6a1-33ec-4a30-9d3d-0e07bb62b3e6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:53.656797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-92b7f6a1-33ec-4a30-9d3d-0e07bb62b3e6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:53.664701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92b7f6a1-33ec-4a30-9d3d-0e07bb62b3e6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.665380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92b7f6a1-33ec-4a30-9d3d-0e07bb62b3e6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.666067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92b7f6a1-33ec-4a30-9d3d-0e07bb62b3e6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.666781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92b7f6a1-33ec-4a30-9d3d-0e07bb62b3e6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.667245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92b7f6a1-33ec-4a30-9d3d-0e07bb62b3e6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.667677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92b7f6a1-33ec-4a30-9d3d-0e07bb62b3e6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.703219 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-92b7f6a1-33ec-4a30-9d3d-0e07bb62b3e6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054143 Oct 18 13:27:53.703798 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1419/2680] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:27:53 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:53.708631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0cefa455-db61-4b59-8939-2cfd6c2c439a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:53.709279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0cefa455-db61-4b59-8939-2cfd6c2c439a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:53.718205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cefa455-db61-4b59-8939-2cfd6c2c439a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.718853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cefa455-db61-4b59-8939-2cfd6c2c439a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.719321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cefa455-db61-4b59-8939-2cfd6c2c439a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.720156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cefa455-db61-4b59-8939-2cfd6c2c439a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.720680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cefa455-db61-4b59-8939-2cfd6c2c439a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.721265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0cefa455-db61-4b59-8939-2cfd6c2c439a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.763707 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-10d3728a-d2a3-49d0-a1f5-dfadbf7345e6 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.738504 Oct 18 13:27:53.765556 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1262/2681] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 18 13:27:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:53.783525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.212"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:53.786517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:53.794092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.794785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.795294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.802861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0cefa455-db61-4b59-8939-2cfd6c2c439a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:53.805804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:53.807056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:53.807802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:53.812424 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0cefa455-db61-4b59-8939-2cfd6c2c439a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1273 microversion: 2.1 time: 0.107261 Oct 18 13:27:53.813082 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1420/2682] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:53 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:53.838974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "refresh_cache-f9412adf-f352-4aad-ac60-81be4892dc8f" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:27:53.839476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquired lock "refresh_cache-f9412adf-f352-4aad-ac60-81be4892dc8f" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:27:54.202388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4ffe98e-34de-426f-8db2-2259ddfaade1 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:54.206300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e4ffe98e-34de-426f-8db2-2259ddfaade1 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:54.220419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4ffe98e-34de-426f-8db2-2259ddfaade1 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:54.220937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4ffe98e-34de-426f-8db2-2259ddfaade1 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:54.222677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4ffe98e-34de-426f-8db2-2259ddfaade1 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:54.223372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4ffe98e-34de-426f-8db2-2259ddfaade1 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:54.223838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4ffe98e-34de-426f-8db2-2259ddfaade1 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:54.224264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4ffe98e-34de-426f-8db2-2259ddfaade1 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:54.540355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e4ffe98e-34de-426f-8db2-2259ddfaade1 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:54.554452 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e4ffe98e-34de-426f-8db2-2259ddfaade1 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1316 microversion: 2.1 time: 0.358331 Oct 18 13:27:54.555463 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1421/2683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:54 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:54.564344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-823892742", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "deb94905-19cf-4bc3-b794-ed82aed718aa"}], "security_groups": [{"name": "tempest-securitygroup--134918455"}], "key_name": "tempest-keypair-1333962263", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:54.726369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] validate_networks() for [('deb94905-19cf-4bc3-b794-ed82aed718aa', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:27:54.887464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.212 (c5fe5720-358a-4111-8d2c-9a27bbf9a793) with port f6fb9e40-9bbf-41f6-afef-32d270604029 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 0886a8ee-8c44-41d8-a6e7-991604b6adb5.", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:27:54.888142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Releasing lock "refresh_cache-f9412adf-f352-4aad-ac60-81be4892dc8f" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:27:54.889201 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.212 (c5fe5720-358a-4111-8d2c-9a27bbf9a793) with port f6fb9e40-9bbf-41f6-afef-32d270604029 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 0886a8ee-8c44-41d8-a6e7-991604b6adb5. Oct 18 13:27:54.889201 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-2bc2952b-bb1f-4cc6-936f-892aeefc4ec8'] Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Request method failure captured: Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action HTTP/1.1 Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 46 Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqm5BxQLII_67bqNeYW6wmSx_gsSXVT64Zf3pAkzfgSGYw7pkv3L6r3AJbQj-47DLyi9epFxuyG-qF2_fkVPoTW5IN1PkqwvkhPVuR3Ez-zsi-A-Ybuo1G3AMfB-BXPnCkCfFIWLgGjQbBc0_93yr3-GXf9z6NobePGrKxx2WzAmqYs Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 79a03bf7e9014bb6b8e7ea64005b26c9 Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:27:54.895224 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:27:54.896976 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79a03bf7e9014bb6b8e7ea64005b26c9"}]}] Oct 18 13:27:54.896976 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:27:54.896976 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 79a03bf7e9014bb6b8e7ea64005b26c9 Oct 18 13:27:54.896976 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:27:54.896976 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project Oct 18 13:27:54.896976 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:27:54.896976 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:27:54.896976 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 8f2b02e97ca243c490e8e0c9d2283523 Oct 18 13:27:54.896976 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project Oct 18 13:27:54.896976 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:27:54.896976 n-d-858384-13 devstack@n-api.service[120612]: {"addFloatingIp": {"address": "172.25.2.212"}} Oct 18 13:27:54.896976 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: exception: Cannot associate floating IP 172.25.2.212 (c5fe5720-358a-4111-8d2c-9a27bbf9a793) with port f6fb9e40-9bbf-41f6-afef-32d270604029 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 0886a8ee-8c44-41d8-a6e7-991604b6adb5. Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-2bc2952b-bb1f-4cc6-936f-892aeefc4ec8'] Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'f9412adf-f352-4aad-ac60-81be4892dc8f', 'body': {'addFloatingIp': {'address': '172.25.2.212'}}} Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:54.900018 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:27:54.901362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.212 (c5fe5720-358a-4111-8d2c-9a27bbf9a793) with port f6fb9e40-9bbf-41f6-afef-32d270604029 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 0886a8ee-8c44-41d8-a6e7-991604b6adb5. Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bc2952b-bb1f-4cc6-936f-892aeefc4ec8'] Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.212 (c5fe5720-358a-4111-8d2c-9a27bbf9a793) with port f6fb9e40-9bbf-41f6-afef-32d270604029 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 0886a8ee-8c44-41d8-a6e7-991604b6adb5. Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bc2952b-bb1f-4cc6-936f-892aeefc4ec8'] Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:54.904909 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.212 (c5fe5720-358a-4111-8d2c-9a27bbf9a793) with port f6fb9e40-9bbf-41f6-afef-32d270604029 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 0886a8ee-8c44-41d8-a6e7-991604b6adb5. Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bc2952b-bb1f-4cc6-936f-892aeefc4ec8'] Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:54.906145 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:27:54.908383 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:54.908383 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:27:54.908383 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:27:54.908383 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:27:54.908383 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:27:54.908383 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:27:54.908383 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.212 (c5fe5720-358a-4111-8d2c-9a27bbf9a793) with port f6fb9e40-9bbf-41f6-afef-32d270604029 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 0886a8ee-8c44-41d8-a6e7-991604b6adb5. Oct 18 13:27:54.908383 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2bc2952b-bb1f-4cc6-936f-892aeefc4ec8'] Oct 18 13:27:54.908383 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:27:54.913015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Returning 400 to user: Cannot associate floating IP 172.25.2.212 (c5fe5720-358a-4111-8d2c-9a27bbf9a793) with port f6fb9e40-9bbf-41f6-afef-32d270604029 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 0886a8ee-8c44-41d8-a6e7-991604b6adb5. Oct 18 13:27:54.913015 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-2bc2952b-bb1f-4cc6-936f-892aeefc4ec8'] {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:27:54.914331 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0c65e5b2-eaf1-4dfb-9c1f-e53ca39d0924 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action" status: 400 len: 381 microversion: 2.1 time: 1.138381 Oct 18 13:27:54.915441 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1263/2684] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:53 2022] POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action => generated 381 bytes in 1140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:27:54.930378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b407dccf-fc31-4326-84be-40b6bbbb132b req-f822bc31-74b3-4eda-991c-8b28fea9b494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b1ea363-fd17-4524-9c4a-925239ec3b7d", "tag": "62fa0d67-1f1c-4da6-9d0d-022cc99356fb"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:54.945582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b407dccf-fc31-4326-84be-40b6bbbb132b req-f822bc31-74b3-4eda-991c-8b28fea9b494 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:54.946522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b407dccf-fc31-4326-84be-40b6bbbb132b req-f822bc31-74b3-4eda-991c-8b28fea9b494 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:54.947131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b407dccf-fc31-4326-84be-40b6bbbb132b req-f822bc31-74b3-4eda-991c-8b28fea9b494 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:54.964837 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b407dccf-fc31-4326-84be-40b6bbbb132b req-f822bc31-74b3-4eda-991c-8b28fea9b494 service nova] Creating event network-changed:62fa0d67-1f1c-4da6-9d0d-022cc99356fb for instance 2b1ea363-fd17-4524-9c4a-925239ec3b7d on n-h1-858384-13 Oct 18 13:27:54.972052 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b407dccf-fc31-4326-84be-40b6bbbb132b req-f822bc31-74b3-4eda-991c-8b28fea9b494 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052035 Oct 18 13:27:54.973084 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1264/2685] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:54.978802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6337d91b-9fde-4e74-bce3-be92e3dc69eb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:54.982889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6337d91b-9fde-4e74-bce3-be92e3dc69eb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:54.989729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6337d91b-9fde-4e74-bce3-be92e3dc69eb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:54.990458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6337d91b-9fde-4e74-bce3-be92e3dc69eb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:54.992124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6337d91b-9fde-4e74-bce3-be92e3dc69eb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:54.993261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6337d91b-9fde-4e74-bce3-be92e3dc69eb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:54.993935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6337d91b-9fde-4e74-bce3-be92e3dc69eb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:54.994555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6337d91b-9fde-4e74-bce3-be92e3dc69eb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:55.052034 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6337d91b-9fde-4e74-bce3-be92e3dc69eb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077314 Oct 18 13:27:55.053051 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1265/2686] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:27:54 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:55.163841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:55.439928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Getting quotas for project 075e04a2359c4f17a5c7cc521e43b885. Resources: dict_keys(['metadata_items']) {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:55.456988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Getting quotas for user 1d35e70a94604d1f9539fa8c91d06353 and project 075e04a2359c4f17a5c7cc521e43b885. Resources: dict_keys(['metadata_items']) {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:55.498005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:27:55.498775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:27:55.500185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:27:55.502171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:27:55.502879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:27:55.526081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:55.527684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:55.529158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:55.530559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:55.533145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:55.533863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:55.574487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Getting quotas for project 075e04a2359c4f17a5c7cc521e43b885. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:27:55.592800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Getting quotas for user 1d35e70a94604d1f9539fa8c91d06353 and project 075e04a2359c4f17a5c7cc521e43b885. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:27:55.617883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:27:55.620777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:27:55.622602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cedea174-c396-46dd-9f57-0921eb46723c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:55.623584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cedea174-c396-46dd-9f57-0921eb46723c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:55.652523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cedea174-c396-46dd-9f57-0921eb46723c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:55.653569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cedea174-c396-46dd-9f57-0921eb46723c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:55.654285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cedea174-c396-46dd-9f57-0921eb46723c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:55.655089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cedea174-c396-46dd-9f57-0921eb46723c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:55.655678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cedea174-c396-46dd-9f57-0921eb46723c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:55.656184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cedea174-c396-46dd-9f57-0921eb46723c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:55.685833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:55.714005 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-93e04e43-0cf6-4c09-a82d-1f2bda6adb6e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.156145 Oct 18 13:27:55.716159 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1422/2687] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:27:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:27:55.722780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-330c9827-85bd-482e-bae6-50939606abd0 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '.version_select at 0x7ff60ef6f820>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:56.249655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=10 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:56.358947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cedea174-c396-46dd-9f57-0921eb46723c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:56.400863 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cedea174-c396-46dd-9f57-0921eb46723c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1315 microversion: 2.1 time: 1.345237 Oct 18 13:27:56.403879 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1266/2688] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:55 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1315 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:56.425466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-62d7d972-3989-4fd6-9a7c-3facd40d778b tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:56.425940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-62d7d972-3989-4fd6-9a7c-3facd40d778b tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:56.447553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62d7d972-3989-4fd6-9a7c-3facd40d778b tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:56.451522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62d7d972-3989-4fd6-9a7c-3facd40d778b tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:56.453976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62d7d972-3989-4fd6-9a7c-3facd40d778b tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:56.458551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62d7d972-3989-4fd6-9a7c-3facd40d778b tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:56.459362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62d7d972-3989-4fd6-9a7c-3facd40d778b tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:56.461740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62d7d972-3989-4fd6-9a7c-3facd40d778b tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:56.774987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-62d7d972-3989-4fd6-9a7c-3facd40d778b tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:56.787484 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-62d7d972-3989-4fd6-9a7c-3facd40d778b tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1316 microversion: 2.1 time: 0.382277 Oct 18 13:27:56.792371 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1267/2689] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:56 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:56.799851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0acd93a-0dba-4b8d-bc38-e917c05da58e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:56.804015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c0acd93a-0dba-4b8d-bc38-e917c05da58e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:56.930535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c0acd93a-0dba-4b8d-bc38-e917c05da58e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:56.941622 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c0acd93a-0dba-4b8d-bc38-e917c05da58e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1277 microversion: 2.1 time: 0.145467 Oct 18 13:27:56.942246 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1268/2690] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:56 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:56.948720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d5a4aed1-1361-49f3-97c9-3fc729984fb7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:56.966942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d5a4aed1-1361-49f3-97c9-3fc729984fb7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:56.979299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5a4aed1-1361-49f3-97c9-3fc729984fb7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:56.980070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5a4aed1-1361-49f3-97c9-3fc729984fb7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:56.980658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5a4aed1-1361-49f3-97c9-3fc729984fb7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:56.982269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5a4aed1-1361-49f3-97c9-3fc729984fb7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:56.983058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5a4aed1-1361-49f3-97c9-3fc729984fb7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:56.983660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5a4aed1-1361-49f3-97c9-3fc729984fb7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:57.060928 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d5a4aed1-1361-49f3-97c9-3fc729984fb7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116853 Oct 18 13:27:57.062302 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1269/2691] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:27:56 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:57.253537 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-330c9827-85bd-482e-bae6-50939606abd0 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/c5fe5720-358a-4111-8d2c-9a27bbf9a793" status: 202 len: 0 microversion: 2.1 time: 1.535935 Oct 18 13:27:57.254439 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1423/2692] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:27:55 2022] DELETE /compute/v2.1/os-floating-ips/c5fe5720-358a-4111-8d2c-9a27bbf9a793 => generated 0 bytes in 1538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:27:57.264694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Action: 'action', calling method: .version_select at 0x7ff6155ba940>, body: {"removeFloatingIp": {"address": "172.25.2.244"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:57.425650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5af20463-4ca2-4aeb-b7d7-1c32b82dc816 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:57.426286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5af20463-4ca2-4aeb-b7d7-1c32b82dc816 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:57.434232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5af20463-4ca2-4aeb-b7d7-1c32b82dc816 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:57.435848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5af20463-4ca2-4aeb-b7d7-1c32b82dc816 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:57.437622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5af20463-4ca2-4aeb-b7d7-1c32b82dc816 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:57.438754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5af20463-4ca2-4aeb-b7d7-1c32b82dc816 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:57.439388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5af20463-4ca2-4aeb-b7d7-1c32b82dc816 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:57.440066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5af20463-4ca2-4aeb-b7d7-1c32b82dc816 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:57.686564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5af20463-4ca2-4aeb-b7d7-1c32b82dc816 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:57.688917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:27:57.706063 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5af20463-4ca2-4aeb-b7d7-1c32b82dc816 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1315 microversion: 2.1 time: 0.284712 Oct 18 13:27:57.709148 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1424/2693] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:57 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:57.768195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:57.792028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:57.792527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:57.792950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:57.793697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:57.794371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:57.794817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:57.820846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f95384c8-8c54-426f-b860-c6ed44406c07 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:57.821508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f95384c8-8c54-426f-b860-c6ed44406c07 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:57.843087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f95384c8-8c54-426f-b860-c6ed44406c07 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:57.843576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f95384c8-8c54-426f-b860-c6ed44406c07 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:57.844010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f95384c8-8c54-426f-b860-c6ed44406c07 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:57.844735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f95384c8-8c54-426f-b860-c6ed44406c07 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:57.845159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f95384c8-8c54-426f-b860-c6ed44406c07 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:57.845592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f95384c8-8c54-426f-b860-c6ed44406c07 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.076029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f95384c8-8c54-426f-b860-c6ed44406c07 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:58.099838 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f95384c8-8c54-426f-b860-c6ed44406c07 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1316 microversion: 2.1 time: 0.274240 Oct 18 13:27:58.101389 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1425/2694] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:57 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:58.107874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6e423241-99f4-4e2d-a462-0036b489708c tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:58.108856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6e423241-99f4-4e2d-a462-0036b489708c tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:58.118669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e423241-99f4-4e2d-a462-0036b489708c tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.119554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e423241-99f4-4e2d-a462-0036b489708c tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.120364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e423241-99f4-4e2d-a462-0036b489708c tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.121532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e423241-99f4-4e2d-a462-0036b489708c tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.122248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e423241-99f4-4e2d-a462-0036b489708c tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.122995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e423241-99f4-4e2d-a462-0036b489708c tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.208058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6e423241-99f4-4e2d-a462-0036b489708c tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:58.221531 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6e423241-99f4-4e2d-a462-0036b489708c tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1329 microversion: 2.1 time: 0.117441 Oct 18 13:27:58.238008 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1426/2695] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:58 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1329 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:27:58.247263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-75a607e6-8a27-4c44-b69e-7c80b2a4099c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:58.251416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-75a607e6-8a27-4c44-b69e-7c80b2a4099c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:58.259108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75a607e6-8a27-4c44-b69e-7c80b2a4099c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.260422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75a607e6-8a27-4c44-b69e-7c80b2a4099c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.261247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75a607e6-8a27-4c44-b69e-7c80b2a4099c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.262236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75a607e6-8a27-4c44-b69e-7c80b2a4099c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.262900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75a607e6-8a27-4c44-b69e-7c80b2a4099c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.263484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75a607e6-8a27-4c44-b69e-7c80b2a4099c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.307725 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-75a607e6-8a27-4c44-b69e-7c80b2a4099c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068159 Oct 18 13:27:58.309115 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1427/2696] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:27:58 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:58.314863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-73b01c27-4a00-42f6-b59f-4f982bf9b107 req-dbe05d97-1613-4fd6-974b-2c88ba7a679f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb88dcce-9600-4324-839a-995db788a4d8", "tag": "75bbdfbd-02a7-483c-91da-58cfa06f8fce"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:58.327906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-73b01c27-4a00-42f6-b59f-4f982bf9b107 req-dbe05d97-1613-4fd6-974b-2c88ba7a679f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.328844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-73b01c27-4a00-42f6-b59f-4f982bf9b107 req-dbe05d97-1613-4fd6-974b-2c88ba7a679f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.329741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-73b01c27-4a00-42f6-b59f-4f982bf9b107 req-dbe05d97-1613-4fd6-974b-2c88ba7a679f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.348284 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-73b01c27-4a00-42f6-b59f-4f982bf9b107 req-dbe05d97-1613-4fd6-974b-2c88ba7a679f service nova] Creating event network-changed:75bbdfbd-02a7-483c-91da-58cfa06f8fce for instance fb88dcce-9600-4324-839a-995db788a4d8 on n-h2-858384-13 Oct 18 13:27:58.360377 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-73b01c27-4a00-42f6-b59f-4f982bf9b107 req-dbe05d97-1613-4fd6-974b-2c88ba7a679f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049241 Oct 18 13:27:58.362819 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1428/2697] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:27:58.451825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "refresh_cache-f9412adf-f352-4aad-ac60-81be4892dc8f" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:27:58.452394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquired lock "refresh_cache-f9412adf-f352-4aad-ac60-81be4892dc8f" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:27:58.738960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8af32037-f8fd-4c67-844a-0abeb54a7594 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:27:58.738960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8af32037-f8fd-4c67-844a-0abeb54a7594 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:27:58.753113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af32037-f8fd-4c67-844a-0abeb54a7594 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.755045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af32037-f8fd-4c67-844a-0abeb54a7594 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.755855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af32037-f8fd-4c67-844a-0abeb54a7594 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.757696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af32037-f8fd-4c67-844a-0abeb54a7594 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:27:58.758784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af32037-f8fd-4c67-844a-0abeb54a7594 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:27:58.759634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8af32037-f8fd-4c67-844a-0abeb54a7594 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:27:58.995847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8af32037-f8fd-4c67-844a-0abeb54a7594 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:27:59.006930 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8af32037-f8fd-4c67-844a-0abeb54a7594 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1315 microversion: 2.1 time: 0.276016 Oct 18 13:27:59.008438 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1429/2698] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:27:58 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:27:59.273732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1927181908", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:27:59.361319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:28:00.053360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Building network info cache for instance {{(pid=120612) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:28:00.206300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:00.207144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:00.208001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:00.208725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:00.209487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:00.224672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:00.226835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:00.228325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:00.229497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:00.230223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:00.231614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:00.265686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:00.273599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:00.294801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:28:00.298552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:00.384332 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3ab5fe62-d1a6-4665-aae4-f97c9334fe9a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.373136 Oct 18 13:28:00.393453 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1430/2699] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:27:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:28:00.404448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f2dd912c-9065-4c8d-a674-dc4158c6e81a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:00.405165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f2dd912c-9065-4c8d-a674-dc4158c6e81a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:00.417417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2dd912c-9065-4c8d-a674-dc4158c6e81a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:00.418079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2dd912c-9065-4c8d-a674-dc4158c6e81a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:00.419243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2dd912c-9065-4c8d-a674-dc4158c6e81a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:00.420143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2dd912c-9065-4c8d-a674-dc4158c6e81a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:00.420608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2dd912c-9065-4c8d-a674-dc4158c6e81a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:00.421040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2dd912c-9065-4c8d-a674-dc4158c6e81a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:00.738405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f2dd912c-9065-4c8d-a674-dc4158c6e81a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:00.762386 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f2dd912c-9065-4c8d-a674-dc4158c6e81a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1316 microversion: 2.1 time: 0.365312 Oct 18 13:28:00.762880 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1431/2700] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:00 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:00.776904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc4b3424-4e9e-4f88-b93b-9585b3bf980a tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:00.780303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bc4b3424-4e9e-4f88-b93b-9585b3bf980a tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:00.793118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc4b3424-4e9e-4f88-b93b-9585b3bf980a tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:00.797120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc4b3424-4e9e-4f88-b93b-9585b3bf980a tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:00.797664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc4b3424-4e9e-4f88-b93b-9585b3bf980a tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:00.797962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc4b3424-4e9e-4f88-b93b-9585b3bf980a tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:00.798433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc4b3424-4e9e-4f88-b93b-9585b3bf980a tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:00.798860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc4b3424-4e9e-4f88-b93b-9585b3bf980a tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.132134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bc4b3424-4e9e-4f88-b93b-9585b3bf980a tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:01.151767 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bc4b3424-4e9e-4f88-b93b-9585b3bf980a tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1402 microversion: 2.1 time: 0.385205 Oct 18 13:28:01.154457 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1432/2701] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:00 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1402 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:01.160708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a44e31d3-5e07-4f3d-93d1-358bdef2ada9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:01.166337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a44e31d3-5e07-4f3d-93d1-358bdef2ada9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:01.176564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a44e31d3-5e07-4f3d-93d1-358bdef2ada9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.177483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a44e31d3-5e07-4f3d-93d1-358bdef2ada9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.179908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a44e31d3-5e07-4f3d-93d1-358bdef2ada9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.182902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a44e31d3-5e07-4f3d-93d1-358bdef2ada9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.183751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a44e31d3-5e07-4f3d-93d1-358bdef2ada9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.185265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a44e31d3-5e07-4f3d-93d1-358bdef2ada9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.243428 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a44e31d3-5e07-4f3d-93d1-358bdef2ada9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086742 Oct 18 13:28:01.245152 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1433/2702] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:28:01 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:28:01.276609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0249f380-c3e4-4f78-abff-538a6d65531f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:01.282696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0249f380-c3e4-4f78-abff-538a6d65531f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:01.301929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0249f380-c3e4-4f78-abff-538a6d65531f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.305485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0249f380-c3e4-4f78-abff-538a6d65531f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.307894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0249f380-c3e4-4f78-abff-538a6d65531f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.311024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0249f380-c3e4-4f78-abff-538a6d65531f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.311749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0249f380-c3e4-4f78-abff-538a6d65531f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.314075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0249f380-c3e4-4f78-abff-538a6d65531f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.710642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0249f380-c3e4-4f78-abff-538a6d65531f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:01.723694 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0249f380-c3e4-4f78-abff-538a6d65531f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1315 microversion: 2.1 time: 0.476076 Oct 18 13:28:01.724661 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1434/2703] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:01 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:01.731945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5e63f460-ad96-447e-badd-972a9ff22c26 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:01.732560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e63f460-ad96-447e-badd-972a9ff22c26 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:01.751606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e63f460-ad96-447e-badd-972a9ff22c26 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.752161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e63f460-ad96-447e-badd-972a9ff22c26 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.752546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e63f460-ad96-447e-badd-972a9ff22c26 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.753292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e63f460-ad96-447e-badd-972a9ff22c26 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.753750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e63f460-ad96-447e-badd-972a9ff22c26 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.757974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e63f460-ad96-447e-badd-972a9ff22c26 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.790070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Updating instance_info_cache with network_info: [{"id": "f6fb9e40-9bbf-41f6-afef-32d270604029", "address": "fa:16:3e:ca:d7:0d", "network": {"id": "5c46f408-47ff-4146-8ccb-50d5c1f67c4b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1748124832-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "79a03bf7e9014bb6b8e7ea64005b26c9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf6fb9e40-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120612) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:28:01.808248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Releasing lock "refresh_cache-f9412adf-f352-4aad-ac60-81be4892dc8f" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:28:01.809319 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6af7c051-127f-4351-92da-f8f873d35ed2 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action" status: 202 len: 0 microversion: 2.1 time: 4.549461 Oct 18 13:28:01.810535 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1270/2704] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:27:57 2022] POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action => generated 0 bytes in 4551 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:28:01.823566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-928d9bb6-bbeb-4417-82cc-f991ced4cf0d req-e197f46b-ed50-443d-b57f-a486a7a175d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9412adf-f352-4aad-ac60-81be4892dc8f", "tag": "f6fb9e40-9bbf-41f6-afef-32d270604029"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:01.856877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-928d9bb6-bbeb-4417-82cc-f991ced4cf0d req-e197f46b-ed50-443d-b57f-a486a7a175d1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.857858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-928d9bb6-bbeb-4417-82cc-f991ced4cf0d req-e197f46b-ed50-443d-b57f-a486a7a175d1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.858414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-928d9bb6-bbeb-4417-82cc-f991ced4cf0d req-e197f46b-ed50-443d-b57f-a486a7a175d1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.870408 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-928d9bb6-bbeb-4417-82cc-f991ced4cf0d req-e197f46b-ed50-443d-b57f-a486a7a175d1 service nova] Creating event network-changed:f6fb9e40-9bbf-41f6-afef-32d270604029 for instance f9412adf-f352-4aad-ac60-81be4892dc8f on n-h1-858384-13 Oct 18 13:28:01.875528 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-928d9bb6-bbeb-4417-82cc-f991ced4cf0d req-e197f46b-ed50-443d-b57f-a486a7a175d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063492 Oct 18 13:28:01.876800 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1271/2705] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:01.882504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4b9599db-f3ce-418f-ba16-8d3d74b6547a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:01.883921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4b9599db-f3ce-418f-ba16-8d3d74b6547a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:01.892849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b9599db-f3ce-418f-ba16-8d3d74b6547a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.893483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b9599db-f3ce-418f-ba16-8d3d74b6547a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.894048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b9599db-f3ce-418f-ba16-8d3d74b6547a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.894977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b9599db-f3ce-418f-ba16-8d3d74b6547a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:01.895676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b9599db-f3ce-418f-ba16-8d3d74b6547a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:01.896344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b9599db-f3ce-418f-ba16-8d3d74b6547a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:01.923832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5e63f460-ad96-447e-badd-972a9ff22c26 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:01.951982 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5e63f460-ad96-447e-badd-972a9ff22c26 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1269 microversion: 2.1 time: 0.226095 Oct 18 13:28:01.954576 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1435/2706] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:01 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1269 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:01.963631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c84700b3-01b5-46c0-81d8-618ff2c53eb0 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '.version_select at 0x7ff60ef18160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:02.407107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4b9599db-f3ce-418f-ba16-8d3d74b6547a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:02.426041 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4b9599db-f3ce-418f-ba16-8d3d74b6547a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1316 microversion: 2.1 time: 0.545837 Oct 18 13:28:02.430863 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1272/2707] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:01 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:02.454295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cd6aa078-b5cd-49b2-b747-72977d05787f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:02.456100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cd6aa078-b5cd-49b2-b747-72977d05787f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:02.474305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd6aa078-b5cd-49b2-b747-72977d05787f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.475584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd6aa078-b5cd-49b2-b747-72977d05787f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:02.476479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd6aa078-b5cd-49b2-b747-72977d05787f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:02.477732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd6aa078-b5cd-49b2-b747-72977d05787f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.483224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd6aa078-b5cd-49b2-b747-72977d05787f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:02.484430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd6aa078-b5cd-49b2-b747-72977d05787f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:02.788929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cd6aa078-b5cd-49b2-b747-72977d05787f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:02.814018 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cd6aa078-b5cd-49b2-b747-72977d05787f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1402 microversion: 2.1 time: 0.380509 Oct 18 13:28:02.814897 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1273/2708] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:02 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1402 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:02.829612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-5d509213-2be2-43a9-9f98-ad357d21a17c req-17569863-0c54-4d27-a281-7a7659e7a5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477de8bd-778f-4e84-8f0d-5ca5f40c5690", "tag": "c4112e45-a6d2-4c90-8e19-c4a0ff6b6cf2"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:02.855155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5d509213-2be2-43a9-9f98-ad357d21a17c req-17569863-0c54-4d27-a281-7a7659e7a5f8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.855566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5d509213-2be2-43a9-9f98-ad357d21a17c req-17569863-0c54-4d27-a281-7a7659e7a5f8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:02.856008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5d509213-2be2-43a9-9f98-ad357d21a17c req-17569863-0c54-4d27-a281-7a7659e7a5f8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:02.896063 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-5d509213-2be2-43a9-9f98-ad357d21a17c req-17569863-0c54-4d27-a281-7a7659e7a5f8 service nova] Creating event network-changed:c4112e45-a6d2-4c90-8e19-c4a0ff6b6cf2 for instance 477de8bd-778f-4e84-8f0d-5ca5f40c5690 on n-h2-858384-13 Oct 18 13:28:02.924485 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-5d509213-2be2-43a9-9f98-ad357d21a17c req-17569863-0c54-4d27-a281-7a7659e7a5f8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107070 Oct 18 13:28:02.926134 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1274/2709] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:02.940195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-565b71a0-f601-421b-8c36-9a6570e44bfc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:02.941272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-565b71a0-f601-421b-8c36-9a6570e44bfc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:02.966966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-565b71a0-f601-421b-8c36-9a6570e44bfc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.967740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-565b71a0-f601-421b-8c36-9a6570e44bfc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:02.968381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-565b71a0-f601-421b-8c36-9a6570e44bfc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:02.971332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-565b71a0-f601-421b-8c36-9a6570e44bfc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:02.972234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-565b71a0-f601-421b-8c36-9a6570e44bfc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:02.981469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-565b71a0-f601-421b-8c36-9a6570e44bfc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.290721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-565b71a0-f601-421b-8c36-9a6570e44bfc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:03.299125 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-565b71a0-f601-421b-8c36-9a6570e44bfc tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1315 microversion: 2.1 time: 0.371761 Oct 18 13:28:03.305774 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1275/2710] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:02 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:03.310989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6270d66d-c509-45ef-b2f9-1ff35c5a0d0c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:03.315884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6270d66d-c509-45ef-b2f9-1ff35c5a0d0c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:03.330656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6270d66d-c509-45ef-b2f9-1ff35c5a0d0c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:03.332290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6270d66d-c509-45ef-b2f9-1ff35c5a0d0c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.334913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6270d66d-c509-45ef-b2f9-1ff35c5a0d0c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.336570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6270d66d-c509-45ef-b2f9-1ff35c5a0d0c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:03.337929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6270d66d-c509-45ef-b2f9-1ff35c5a0d0c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.340118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6270d66d-c509-45ef-b2f9-1ff35c5a0d0c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.480388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6270d66d-c509-45ef-b2f9-1ff35c5a0d0c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:03.490034 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6270d66d-c509-45ef-b2f9-1ff35c5a0d0c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1275 microversion: 2.1 time: 0.182693 Oct 18 13:28:03.491924 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1276/2711] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:03 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:03.498033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-12297316-e62f-46c3-83c9-4da7fad84d8e req-2a233137-9751-44b6-9590-563fac6a02f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b1ea363-fd17-4524-9c4a-925239ec3b7d", "name": "network-vif-plugged", "status": "completed", "tag": "62fa0d67-1f1c-4da6-9d0d-022cc99356fb"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:03.508017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-12297316-e62f-46c3-83c9-4da7fad84d8e req-2a233137-9751-44b6-9590-563fac6a02f6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:03.508737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-12297316-e62f-46c3-83c9-4da7fad84d8e req-2a233137-9751-44b6-9590-563fac6a02f6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.509375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-12297316-e62f-46c3-83c9-4da7fad84d8e req-2a233137-9751-44b6-9590-563fac6a02f6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.522495 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-12297316-e62f-46c3-83c9-4da7fad84d8e req-2a233137-9751-44b6-9590-563fac6a02f6 service nova] Creating event network-vif-plugged:62fa0d67-1f1c-4da6-9d0d-022cc99356fb for instance 2b1ea363-fd17-4524-9c4a-925239ec3b7d on n-h1-858384-13 Oct 18 13:28:03.527833 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-12297316-e62f-46c3-83c9-4da7fad84d8e req-2a233137-9751-44b6-9590-563fac6a02f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034352 Oct 18 13:28:03.529054 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1277/2712] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:03.538306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9e57b536-eaff-44cd-8b36-c5c0c1978d57 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:03.538758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9e57b536-eaff-44cd-8b36-c5c0c1978d57 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:03.545867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e57b536-eaff-44cd-8b36-c5c0c1978d57 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:03.547097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e57b536-eaff-44cd-8b36-c5c0c1978d57 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.547720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e57b536-eaff-44cd-8b36-c5c0c1978d57 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.548651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e57b536-eaff-44cd-8b36-c5c0c1978d57 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:03.549151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e57b536-eaff-44cd-8b36-c5c0c1978d57 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.549731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e57b536-eaff-44cd-8b36-c5c0c1978d57 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.747873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9e57b536-eaff-44cd-8b36-c5c0c1978d57 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:03.768131 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9e57b536-eaff-44cd-8b36-c5c0c1978d57 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1316 microversion: 2.1 time: 0.236972 Oct 18 13:28:03.782423 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1278/2713] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:03 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:03.840930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-72e6a18e-0358-4202-a172-193a9e2ad55d tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:03.842720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-72e6a18e-0358-4202-a172-193a9e2ad55d tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:03.852182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-72e6a18e-0358-4202-a172-193a9e2ad55d tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:03.852372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-72e6a18e-0358-4202-a172-193a9e2ad55d tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.852801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-72e6a18e-0358-4202-a172-193a9e2ad55d tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.853834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-72e6a18e-0358-4202-a172-193a9e2ad55d tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:03.854331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-72e6a18e-0358-4202-a172-193a9e2ad55d tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.854759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-72e6a18e-0358-4202-a172-193a9e2ad55d tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.891946 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c84700b3-01b5-46c0-81d8-618ff2c53eb0 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/badaa712-2111-4b2e-b6fb-cca057dc174b" status: 202 len: 0 microversion: 2.1 time: 1.935870 Oct 18 13:28:03.892759 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1436/2714] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:28:01 2022] DELETE /compute/v2.1/os-floating-ips/badaa712-2111-4b2e-b6fb-cca057dc174b => generated 0 bytes in 1937 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:28:03.902323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a95acbe0-ba5f-4b49-851a-6cad006f14c5 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a95acbe0-ba5f-4b49-851a-6cad006f14c5 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Request method failure captured: Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action HTTP/1.1 Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 34 Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqm5BxQLII_67bqNeYW6wmSx_gsSXVT64Zf3pAkzfgSGYw7pkv3L6r3AJbQj-47DLyi9epFxuyG-qF2_fkVPoTW5IN1PkqwvkhPVuR3Ez-zsi-A-Ybuo1G3AMfB-BXPnCkCfFIWLgGjQbBc0_93yr3-GXf9z6NobePGrKxx2WzAmqYs Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 79a03bf7e9014bb6b8e7ea64005b26c9 Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:03.906894 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:03.908552 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79a03bf7e9014bb6b8e7ea64005b26c9"}]}] Oct 18 13:28:03.908552 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:28:03.908552 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 79a03bf7e9014bb6b8e7ea64005b26c9 Oct 18 13:28:03.908552 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:28:03.908552 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project Oct 18 13:28:03.908552 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:03.908552 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:03.908552 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 8f2b02e97ca243c490e8e0c9d2283523 Oct 18 13:28:03.908552 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project Oct 18 13:28:03.908552 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:28:03.908552 n-d-858384-13 devstack@n-api.service[120611]: {"addFloatingIp": {"address": ""}} Oct 18 13:28:03.908552 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:28:03.908552 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f9412adf-f352-4aad-ac60-81be4892dc8f', 'body': {'addFloatingIp': {'address': ''}}} Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi '' Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:03.909568 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:28:03.911135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:28:03.912990 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 18 13:28:03.912990 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:03.912990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a95acbe0-ba5f-4b49-851a-6cad006f14c5 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:03.912990 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a95acbe0-ba5f-4b49-851a-6cad006f14c5 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action" status: 400 len: 142 microversion: 2.1 time: 0.010167 Oct 18 13:28:03.915339 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1437/2715] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:28:03 2022] POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action => generated 142 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:28:03.931299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:03.934113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:03.940490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:03.941294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.941934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.942811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:03.943431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:03.944835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:03.977727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "refresh_cache-f9412adf-f352-4aad-ac60-81be4892dc8f" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:28:03.978144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquired lock "refresh_cache-f9412adf-f352-4aad-ac60-81be4892dc8f" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:28:04.036957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-72e6a18e-0358-4202-a172-193a9e2ad55d tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:04.046778 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-72e6a18e-0358-4202-a172-193a9e2ad55d tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1402 microversion: 2.1 time: 0.210731 Oct 18 13:28:04.047777 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1279/2716] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:03 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1402 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:04.163036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Releasing lock "refresh_cache-f9412adf-f352-4aad-ac60-81be4892dc8f" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:28:04.164152 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] HTTP exception thrown: floating IP not found Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Request method failure captured: Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action HTTP/1.1 Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 41 Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqm5BxQLII_67bqNeYW6wmSx_gsSXVT64Zf3pAkzfgSGYw7pkv3L6r3AJbQj-47DLyi9epFxuyG-qF2_fkVPoTW5IN1PkqwvkhPVuR3Ez-zsi-A-Ybuo1G3AMfB-BXPnCkCfFIWLgGjQbBc0_93yr3-GXf9z6NobePGrKxx2WzAmqYs Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 79a03bf7e9014bb6b8e7ea64005b26c9 Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:04.165881 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:04.167399 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79a03bf7e9014bb6b8e7ea64005b26c9"}]}] Oct 18 13:28:04.167399 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:28:04.167399 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 79a03bf7e9014bb6b8e7ea64005b26c9 Oct 18 13:28:04.167399 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:28:04.167399 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project Oct 18 13:28:04.167399 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:04.167399 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:04.167399 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 8f2b02e97ca243c490e8e0c9d2283523 Oct 18 13:28:04.167399 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project Oct 18 13:28:04.167399 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:28:04.167399 n-d-858384-13 devstack@n-api.service[120611]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 18 13:28:04.167399 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:28:04.167399 n-d-858384-13 devstack@n-api.service[120611]: exception: floating IP not found Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f9412adf-f352-4aad-ac60-81be4892dc8f', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:04.168304 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 18 13:28:04.174927 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.176341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Returning 404 to user: floating IP not found {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:04.176341 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-297a19fc-c8da-4c30-9181-448b26b5502a tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action" status: 404 len: 67 microversion: 2.1 time: 0.251668 Oct 18 13:28:04.176341 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1438/2717] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:28:03 2022] POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action => generated 67 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:28:04.180777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-44c29e9e-f51b-40d7-8393-7e0495b11e8d tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:04.236589 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-44c29e9e-f51b-40d7-8393-7e0495b11e8d tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-44c29e9e-f51b-40d7-8393-7e0495b11e8d tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Request method failure captured: Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action HTTP/1.1 Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 44 Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqm5BxQLII_67bqNeYW6wmSx_gsSXVT64Zf3pAkzfgSGYw7pkv3L6r3AJbQj-47DLyi9epFxuyG-qF2_fkVPoTW5IN1PkqwvkhPVuR3Ez-zsi-A-Ybuo1G3AMfB-BXPnCkCfFIWLgGjQbBc0_93yr3-GXf9z6NobePGrKxx2WzAmqYs Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 79a03bf7e9014bb6b8e7ea64005b26c9 Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:04.238574 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:04.239926 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79a03bf7e9014bb6b8e7ea64005b26c9"}]}] Oct 18 13:28:04.239926 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:28:04.239926 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 79a03bf7e9014bb6b8e7ea64005b26c9 Oct 18 13:28:04.239926 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:28:04.239926 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project Oct 18 13:28:04.239926 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:04.239926 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:04.239926 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 8f2b02e97ca243c490e8e0c9d2283523 Oct 18 13:28:04.239926 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project Oct 18 13:28:04.239926 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:28:04.239926 n-d-858384-13 devstack@n-api.service[120612]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 18 13:28:04.239926 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:04.239926 n-d-858384-13 devstack@n-api.service[120612]: exception: Floating IP not found for address 0.0.0.0. Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'f9412adf-f352-4aad-ac60-81be4892dc8f', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:04.241929 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 18 13:28:04.243846 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:04.245125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-44c29e9e-f51b-40d7-8393-7e0495b11e8d tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:04.245125 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-44c29e9e-f51b-40d7-8393-7e0495b11e8d tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action" status: 404 len: 88 microversion: 2.1 time: 0.065580 Oct 18 13:28:04.245125 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1280/2718] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:28:04 2022] POST /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f/action => generated 88 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:28:04.250498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1becee76-2157-4cad-9b62-c77ce962696f tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:04.251014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1becee76-2157-4cad-9b62-c77ce962696f tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:04.259087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1becee76-2157-4cad-9b62-c77ce962696f tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.259587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1becee76-2157-4cad-9b62-c77ce962696f tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.260025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1becee76-2157-4cad-9b62-c77ce962696f tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.260729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1becee76-2157-4cad-9b62-c77ce962696f tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.261465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1becee76-2157-4cad-9b62-c77ce962696f tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.262446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1becee76-2157-4cad-9b62-c77ce962696f tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.296214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1becee76-2157-4cad-9b62-c77ce962696f tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:28:04.329516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-597d9f6c-694a-4275-8d83-62fd60a6ad93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:04.330236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-597d9f6c-694a-4275-8d83-62fd60a6ad93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:04.339474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-597d9f6c-694a-4275-8d83-62fd60a6ad93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.340106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-597d9f6c-694a-4275-8d83-62fd60a6ad93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.344838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-597d9f6c-694a-4275-8d83-62fd60a6ad93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.345891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-597d9f6c-694a-4275-8d83-62fd60a6ad93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.346460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-597d9f6c-694a-4275-8d83-62fd60a6ad93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.347061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-597d9f6c-694a-4275-8d83-62fd60a6ad93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.451773 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1becee76-2157-4cad-9b62-c77ce962696f tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 204 len: 0 microversion: 2.1 time: 0.202296 Oct 18 13:28:04.452677 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1439/2719] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:04 2022] DELETE /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:28:04.462264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-324ed997-e677-41c8-ab62-f43c4454d21e tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:04.463209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-324ed997-e677-41c8-ab62-f43c4454d21e tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:04.472343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-324ed997-e677-41c8-ab62-f43c4454d21e tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.473041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-324ed997-e677-41c8-ab62-f43c4454d21e tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.473671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-324ed997-e677-41c8-ab62-f43c4454d21e tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.474539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-324ed997-e677-41c8-ab62-f43c4454d21e tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.475747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-324ed997-e677-41c8-ab62-f43c4454d21e tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.476356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-324ed997-e677-41c8-ab62-f43c4454d21e tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.683172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-597d9f6c-694a-4275-8d83-62fd60a6ad93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:04.692663 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-597d9f6c-694a-4275-8d83-62fd60a6ad93 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1315 microversion: 2.1 time: 0.368130 Oct 18 13:28:04.696190 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1281/2720] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:04 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:04.712231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f7d5c53-7d87-4802-90c9-053dad789ab9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:04.713005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7f7d5c53-7d87-4802-90c9-053dad789ab9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:04.720593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f7d5c53-7d87-4802-90c9-053dad789ab9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.721094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f7d5c53-7d87-4802-90c9-053dad789ab9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.722347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f7d5c53-7d87-4802-90c9-053dad789ab9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.723958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f7d5c53-7d87-4802-90c9-053dad789ab9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.725919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f7d5c53-7d87-4802-90c9-053dad789ab9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.726564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f7d5c53-7d87-4802-90c9-053dad789ab9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.798856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-324ed997-e677-41c8-ab62-f43c4454d21e tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:04.811427 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-324ed997-e677-41c8-ab62-f43c4454d21e tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1540 microversion: 2.1 time: 0.351335 Oct 18 13:28:04.812763 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1440/2721] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:04 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1540 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:04.818047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-63841b5e-0319-4962-a874-40051b7ebe10 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:04.824248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-63841b5e-0319-4962-a874-40051b7ebe10 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:04.839108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63841b5e-0319-4962-a874-40051b7ebe10 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.841301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63841b5e-0319-4962-a874-40051b7ebe10 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.844317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63841b5e-0319-4962-a874-40051b7ebe10 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:04.850349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63841b5e-0319-4962-a874-40051b7ebe10 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:04.851204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63841b5e-0319-4962-a874-40051b7ebe10 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:04.851805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63841b5e-0319-4962-a874-40051b7ebe10 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.050088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7f7d5c53-7d87-4802-90c9-053dad789ab9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:05.061315 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7f7d5c53-7d87-4802-90c9-053dad789ab9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1317 microversion: 2.1 time: 0.363655 Oct 18 13:28:05.064781 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1282/2722] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:04 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:05.086971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b17c2ac7-1d3f-49b0-8a61-e96fdc2fe7ce tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:05.087707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b17c2ac7-1d3f-49b0-8a61-e96fdc2fe7ce tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:05.094169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b17c2ac7-1d3f-49b0-8a61-e96fdc2fe7ce tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.094964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b17c2ac7-1d3f-49b0-8a61-e96fdc2fe7ce tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.095606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b17c2ac7-1d3f-49b0-8a61-e96fdc2fe7ce tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.096538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b17c2ac7-1d3f-49b0-8a61-e96fdc2fe7ce tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.097227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b17c2ac7-1d3f-49b0-8a61-e96fdc2fe7ce tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.097904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b17c2ac7-1d3f-49b0-8a61-e96fdc2fe7ce tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.156909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-63841b5e-0319-4962-a874-40051b7ebe10 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:05.173460 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-63841b5e-0319-4962-a874-40051b7ebe10 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1316 microversion: 2.1 time: 0.358380 Oct 18 13:28:05.174668 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1441/2723] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:04 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:05.295268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b17c2ac7-1d3f-49b0-8a61-e96fdc2fe7ce tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:05.303508 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b17c2ac7-1d3f-49b0-8a61-e96fdc2fe7ce tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1402 microversion: 2.1 time: 0.224484 Oct 18 13:28:05.304917 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1283/2724] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:05 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1402 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:05.549448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-40b7c760-fdc9-43b2-a332-c9e629ccc02e req-b6850634-c186-4fa9-b33f-78274cb3e9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0688b2d-dd1e-427c-b5f1-1ac0fad84598", "tag": "e0e1dcca-7704-41ae-9e89-01a7dda38f72"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:05.559640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-6fdbbb5e-fa77-49a2-9332-6af2420a5e32 req-eaa2abec-49e5-4c46-b33a-5ee987242a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb88dcce-9600-4324-839a-995db788a4d8", "name": "network-vif-plugged", "status": "completed", "tag": "75bbdfbd-02a7-483c-91da-58cfa06f8fce"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:05.574839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-40b7c760-fdc9-43b2-a332-c9e629ccc02e req-b6850634-c186-4fa9-b33f-78274cb3e9b5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.575585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-40b7c760-fdc9-43b2-a332-c9e629ccc02e req-b6850634-c186-4fa9-b33f-78274cb3e9b5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.576179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-40b7c760-fdc9-43b2-a332-c9e629ccc02e req-b6850634-c186-4fa9-b33f-78274cb3e9b5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.577204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6fdbbb5e-fa77-49a2-9332-6af2420a5e32 req-eaa2abec-49e5-4c46-b33a-5ee987242a60 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.577759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6fdbbb5e-fa77-49a2-9332-6af2420a5e32 req-eaa2abec-49e5-4c46-b33a-5ee987242a60 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.578287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6fdbbb5e-fa77-49a2-9332-6af2420a5e32 req-eaa2abec-49e5-4c46-b33a-5ee987242a60 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.590685 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-40b7c760-fdc9-43b2-a332-c9e629ccc02e req-b6850634-c186-4fa9-b33f-78274cb3e9b5 service nova] Creating event network-changed:e0e1dcca-7704-41ae-9e89-01a7dda38f72 for instance b0688b2d-dd1e-427c-b5f1-1ac0fad84598 on n-h2-858384-13 Oct 18 13:28:05.596573 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-6fdbbb5e-fa77-49a2-9332-6af2420a5e32 req-eaa2abec-49e5-4c46-b33a-5ee987242a60 service nova] Creating event network-vif-plugged:75bbdfbd-02a7-483c-91da-58cfa06f8fce for instance fb88dcce-9600-4324-839a-995db788a4d8 on n-h2-858384-13 Oct 18 13:28:05.603748 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-40b7c760-fdc9-43b2-a332-c9e629ccc02e req-b6850634-c186-4fa9-b33f-78274cb3e9b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065960 Oct 18 13:28:05.604027 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-6fdbbb5e-fa77-49a2-9332-6af2420a5e32 req-eaa2abec-49e5-4c46-b33a-5ee987242a60 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053689 Oct 18 13:28:05.605334 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1442/2725] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:05.608079 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1284/2726] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 18 13:28:05.726768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-59438087-bbeb-48a0-8b52-e7807c26cfa9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:05.726768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-59438087-bbeb-48a0-8b52-e7807c26cfa9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:05.733055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59438087-bbeb-48a0-8b52-e7807c26cfa9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.733881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59438087-bbeb-48a0-8b52-e7807c26cfa9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.734862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59438087-bbeb-48a0-8b52-e7807c26cfa9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.736655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59438087-bbeb-48a0-8b52-e7807c26cfa9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.737315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59438087-bbeb-48a0-8b52-e7807c26cfa9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.737958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59438087-bbeb-48a0-8b52-e7807c26cfa9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.837621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fc176854-fb0b-484f-ad3b-b60ed2878efc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:05.838599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fc176854-fb0b-484f-ad3b-b60ed2878efc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:05.845793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc176854-fb0b-484f-ad3b-b60ed2878efc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.846292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc176854-fb0b-484f-ad3b-b60ed2878efc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.846726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc176854-fb0b-484f-ad3b-b60ed2878efc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.847858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc176854-fb0b-484f-ad3b-b60ed2878efc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:05.848491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc176854-fb0b-484f-ad3b-b60ed2878efc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:05.849205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc176854-fb0b-484f-ad3b-b60ed2878efc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:05.902575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-59438087-bbeb-48a0-8b52-e7807c26cfa9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:05.911034 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-59438087-bbeb-48a0-8b52-e7807c26cfa9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1315 microversion: 2.1 time: 0.196223 Oct 18 13:28:05.926302 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1443/2727] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:05 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:05.999143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fc176854-fb0b-484f-ad3b-b60ed2878efc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:06.008066 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fc176854-fb0b-484f-ad3b-b60ed2878efc tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1540 microversion: 2.1 time: 0.175465 Oct 18 13:28:06.022995 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1285/2728] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:05 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1540 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:06.090762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a53bb165-2f39-4aa6-91f8-1d721ce9715d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:06.091487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a53bb165-2f39-4aa6-91f8-1d721ce9715d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:06.097906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a53bb165-2f39-4aa6-91f8-1d721ce9715d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.099233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a53bb165-2f39-4aa6-91f8-1d721ce9715d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.099687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a53bb165-2f39-4aa6-91f8-1d721ce9715d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.101026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a53bb165-2f39-4aa6-91f8-1d721ce9715d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.101533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a53bb165-2f39-4aa6-91f8-1d721ce9715d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.102134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a53bb165-2f39-4aa6-91f8-1d721ce9715d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.106615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:06.197847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bff5134a-fec0-4c97-8a09-094d0bfecbbd tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:06.198682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bff5134a-fec0-4c97-8a09-094d0bfecbbd tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:06.205566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bff5134a-fec0-4c97-8a09-094d0bfecbbd tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.206196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bff5134a-fec0-4c97-8a09-094d0bfecbbd tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.206958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bff5134a-fec0-4c97-8a09-094d0bfecbbd tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.207672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bff5134a-fec0-4c97-8a09-094d0bfecbbd tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.208124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bff5134a-fec0-4c97-8a09-094d0bfecbbd tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.208895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bff5134a-fec0-4c97-8a09-094d0bfecbbd tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.301297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a53bb165-2f39-4aa6-91f8-1d721ce9715d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:06.311960 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a53bb165-2f39-4aa6-91f8-1d721ce9715d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1317 microversion: 2.1 time: 0.225460 Oct 18 13:28:06.312548 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1444/2729] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:06 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:06.336937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3481774f-09d6-4c20-a807-ff775f9e85d6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:06.338528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3481774f-09d6-4c20-a807-ff775f9e85d6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:06.346958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3481774f-09d6-4c20-a807-ff775f9e85d6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.347450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3481774f-09d6-4c20-a807-ff775f9e85d6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.347948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3481774f-09d6-4c20-a807-ff775f9e85d6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.348891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3481774f-09d6-4c20-a807-ff775f9e85d6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.352025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3481774f-09d6-4c20-a807-ff775f9e85d6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.356304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3481774f-09d6-4c20-a807-ff775f9e85d6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.374474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bff5134a-fec0-4c97-8a09-094d0bfecbbd tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:06.385545 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bff5134a-fec0-4c97-8a09-094d0bfecbbd tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1316 microversion: 2.1 time: 0.193233 Oct 18 13:28:06.386757 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1286/2730] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:06 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:06.534070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3481774f-09d6-4c20-a807-ff775f9e85d6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:06.543937 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3481774f-09d6-4c20-a807-ff775f9e85d6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1402 microversion: 2.1 time: 0.217730 Oct 18 13:28:06.546220 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1445/2731] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:06 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1402 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:06.936054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-36c263c3-c120-4eb6-8d57-1c6571d308ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:06.936777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-36c263c3-c120-4eb6-8d57-1c6571d308ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:06.942703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:06.945622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36c263c3-c120-4eb6-8d57-1c6571d308ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.946131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36c263c3-c120-4eb6-8d57-1c6571d308ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.946734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36c263c3-c120-4eb6-8d57-1c6571d308ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.947444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36c263c3-c120-4eb6-8d57-1c6571d308ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:06.948061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36c263c3-c120-4eb6-8d57-1c6571d308ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:06.948490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36c263c3-c120-4eb6-8d57-1c6571d308ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:06.954215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:07.032028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c1d1b9f-e236-4f6b-99b3-c0dd2d5c5b39 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:07.033090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2c1d1b9f-e236-4f6b-99b3-c0dd2d5c5b39 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:07.040893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c1d1b9f-e236-4f6b-99b3-c0dd2d5c5b39 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.041468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c1d1b9f-e236-4f6b-99b3-c0dd2d5c5b39 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.042134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c1d1b9f-e236-4f6b-99b3-c0dd2d5c5b39 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.043064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c1d1b9f-e236-4f6b-99b3-c0dd2d5c5b39 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.043720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c1d1b9f-e236-4f6b-99b3-c0dd2d5c5b39 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.044227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c1d1b9f-e236-4f6b-99b3-c0dd2d5c5b39 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.113104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36c263c3-c120-4eb6-8d57-1c6571d308ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:07.125707 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-36c263c3-c120-4eb6-8d57-1c6571d308ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1315 microversion: 2.1 time: 0.194093 Oct 18 13:28:07.126291 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1287/2732] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:06 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:07.211981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2c1d1b9f-e236-4f6b-99b3-c0dd2d5c5b39 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:07.228142 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2c1d1b9f-e236-4f6b-99b3-c0dd2d5c5b39 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1540 microversion: 2.1 time: 0.199876 Oct 18 13:28:07.229111 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1446/2733] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:07 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1540 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:07.340284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-184a8f28-c468-40db-aad6-869a163e284c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:07.341014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-184a8f28-c468-40db-aad6-869a163e284c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:07.350816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-184a8f28-c468-40db-aad6-869a163e284c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.352412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-184a8f28-c468-40db-aad6-869a163e284c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.353381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-184a8f28-c468-40db-aad6-869a163e284c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.354370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-184a8f28-c468-40db-aad6-869a163e284c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.354890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-184a8f28-c468-40db-aad6-869a163e284c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.355375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-184a8f28-c468-40db-aad6-869a163e284c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.410607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-271b60e0-9392-4d8e-a8d7-eb70420e5217 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:07.411814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-271b60e0-9392-4d8e-a8d7-eb70420e5217 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:07.418796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-271b60e0-9392-4d8e-a8d7-eb70420e5217 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.419705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-271b60e0-9392-4d8e-a8d7-eb70420e5217 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.420292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-271b60e0-9392-4d8e-a8d7-eb70420e5217 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.421148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-271b60e0-9392-4d8e-a8d7-eb70420e5217 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.421832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-271b60e0-9392-4d8e-a8d7-eb70420e5217 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.422725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-271b60e0-9392-4d8e-a8d7-eb70420e5217 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.564583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-184a8f28-c468-40db-aad6-869a163e284c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:07.575800 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-184a8f28-c468-40db-aad6-869a163e284c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1317 microversion: 2.1 time: 0.241017 Oct 18 13:28:07.581355 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1288/2734] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:07 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:07.619334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41ab3576-ebf0-4f84-9c1e-e7bf68d2740e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:07.619996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-41ab3576-ebf0-4f84-9c1e-e7bf68d2740e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:07.630034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:07.644533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41ab3576-ebf0-4f84-9c1e-e7bf68d2740e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.644533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41ab3576-ebf0-4f84-9c1e-e7bf68d2740e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.644533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41ab3576-ebf0-4f84-9c1e-e7bf68d2740e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.644533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41ab3576-ebf0-4f84-9c1e-e7bf68d2740e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.644988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41ab3576-ebf0-4f84-9c1e-e7bf68d2740e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.645442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41ab3576-ebf0-4f84-9c1e-e7bf68d2740e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:07.937859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-41ab3576-ebf0-4f84-9c1e-e7bf68d2740e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:07.950067 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-41ab3576-ebf0-4f84-9c1e-e7bf68d2740e tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1402 microversion: 2.1 time: 0.371752 Oct 18 13:28:07.954064 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1289/2735] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:07 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1402 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:07.961093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-fc980cd0-c755-47c3-b5b2-cba5c6bb8b4e req-c1914dcc-d519-419c-9e93-238cb83eb2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477de8bd-778f-4e84-8f0d-5ca5f40c5690", "name": "network-vif-plugged", "status": "completed", "tag": "c4112e45-a6d2-4c90-8e19-c4a0ff6b6cf2"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:07.983752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fc980cd0-c755-47c3-b5b2-cba5c6bb8b4e req-c1914dcc-d519-419c-9e93-238cb83eb2e8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:07.984504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fc980cd0-c755-47c3-b5b2-cba5c6bb8b4e req-c1914dcc-d519-419c-9e93-238cb83eb2e8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:07.985102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fc980cd0-c755-47c3-b5b2-cba5c6bb8b4e req-c1914dcc-d519-419c-9e93-238cb83eb2e8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.004518 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-fc980cd0-c755-47c3-b5b2-cba5c6bb8b4e req-c1914dcc-d519-419c-9e93-238cb83eb2e8 service nova] Creating event network-vif-plugged:c4112e45-a6d2-4c90-8e19-c4a0ff6b6cf2 for instance 477de8bd-778f-4e84-8f0d-5ca5f40c5690 on n-h2-858384-13 Oct 18 13:28:08.010731 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-fc980cd0-c755-47c3-b5b2-cba5c6bb8b4e req-c1914dcc-d519-419c-9e93-238cb83eb2e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055133 Oct 18 13:28:08.017517 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1290/2736] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:08.031782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-9bc8f231-5218-4502-bb1d-88dc698a5260 req-9c760039-bb75-4842-bd54-982e79aa10c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9412adf-f352-4aad-ac60-81be4892dc8f", "name": "network-vif-deleted", "tag": "f6fb9e40-9bbf-41f6-afef-32d270604029"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:08.059149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9bc8f231-5218-4502-bb1d-88dc698a5260 req-9c760039-bb75-4842-bd54-982e79aa10c2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.060180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9bc8f231-5218-4502-bb1d-88dc698a5260 req-9c760039-bb75-4842-bd54-982e79aa10c2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.062612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9bc8f231-5218-4502-bb1d-88dc698a5260 req-9c760039-bb75-4842-bd54-982e79aa10c2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.072936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-271b60e0-9392-4d8e-a8d7-eb70420e5217 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:08.079120 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-9bc8f231-5218-4502-bb1d-88dc698a5260 req-9c760039-bb75-4842-bd54-982e79aa10c2 service nova] Creating event network-vif-deleted:f6fb9e40-9bbf-41f6-afef-32d270604029 for instance f9412adf-f352-4aad-ac60-81be4892dc8f on n-h1-858384-13 Oct 18 13:28:08.086285 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-9bc8f231-5218-4502-bb1d-88dc698a5260 req-9c760039-bb75-4842-bd54-982e79aa10c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066873 Oct 18 13:28:08.086657 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-271b60e0-9392-4d8e-a8d7-eb70420e5217 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1503 microversion: 2.1 time: 0.675141 Oct 18 13:28:08.087309 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1447/2737] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:07 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1503 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:08.093362 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1291/2738] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:08.112600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f4bf6a3b-251d-443f-b45f-b5fcfbddba65 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.113169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f4bf6a3b-251d-443f-b45f-b5fcfbddba65 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.124510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:08.131000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4bf6a3b-251d-443f-b45f-b5fcfbddba65 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.132379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4bf6a3b-251d-443f-b45f-b5fcfbddba65 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.133011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4bf6a3b-251d-443f-b45f-b5fcfbddba65 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.134129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4bf6a3b-251d-443f-b45f-b5fcfbddba65 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.134766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4bf6a3b-251d-443f-b45f-b5fcfbddba65 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.135568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4bf6a3b-251d-443f-b45f-b5fcfbddba65 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.151160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-466cce40-8809-464e-b250-40a64993067d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.152742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-466cce40-8809-464e-b250-40a64993067d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.171452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-466cce40-8809-464e-b250-40a64993067d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.174368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-466cce40-8809-464e-b250-40a64993067d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.174841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-466cce40-8809-464e-b250-40a64993067d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.175551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-466cce40-8809-464e-b250-40a64993067d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.184203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-466cce40-8809-464e-b250-40a64993067d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.185114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-466cce40-8809-464e-b250-40a64993067d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.256949 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f4bf6a3b-251d-443f-b45f-b5fcfbddba65 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.149147 Oct 18 13:28:08.262168 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1448/2739] 10.222.0.40 () {58 vars in 1296 bytes} [Tue Oct 18 13:28:08 2022] DELETE /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d/os-server-password => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:28:08.278097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.278784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.289414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.290082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.290523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.291229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.291683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.292106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.342628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.343114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.343661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.344177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lazy-loading 'fault' on Instance uuid f9412adf-f352-4aad-ac60-81be4892dc8f {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:08.397168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:08.405735 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7db3bc69-41f4-49c2-9ddb-fff945f5da06 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1320 microversion: 2.1 time: 0.142297 Oct 18 13:28:08.406869 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1449/2740] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:08 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1320 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:08.414649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-870e499f-0e9a-4369-8828-998f0541a478 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.416030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-870e499f-0e9a-4369-8828-998f0541a478 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.422276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-870e499f-0e9a-4369-8828-998f0541a478 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.422649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-870e499f-0e9a-4369-8828-998f0541a478 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.423333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-870e499f-0e9a-4369-8828-998f0541a478 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.424037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-870e499f-0e9a-4369-8828-998f0541a478 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.424485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-870e499f-0e9a-4369-8828-998f0541a478 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.425375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-870e499f-0e9a-4369-8828-998f0541a478 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.446695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-466cce40-8809-464e-b250-40a64993067d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:08.455795 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-870e499f-0e9a-4369-8828-998f0541a478 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.047510 Oct 18 13:28:08.457133 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-466cce40-8809-464e-b250-40a64993067d tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1502 microversion: 2.1 time: 0.310726 Oct 18 13:28:08.457556 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1450/2741] 10.222.0.40 () {58 vars in 1293 bytes} [Tue Oct 18 13:28:08 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d/os-server-password => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:28:08.458441 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1292/2742] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:08 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1502 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:08.484997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-08ee360d-42a9-4bf1-a628-1a520f06a4a9 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.486005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-08ee360d-42a9-4bf1-a628-1a520f06a4a9 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.493416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08ee360d-42a9-4bf1-a628-1a520f06a4a9 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.493906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08ee360d-42a9-4bf1-a628-1a520f06a4a9 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.494075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6d4b740b-f104-47d1-9a03-dc4473e1ee42 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:08.494336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08ee360d-42a9-4bf1-a628-1a520f06a4a9 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.494661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6d4b740b-f104-47d1-9a03-dc4473e1ee42 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.495032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08ee360d-42a9-4bf1-a628-1a520f06a4a9 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.495537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08ee360d-42a9-4bf1-a628-1a520f06a4a9 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.495964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08ee360d-42a9-4bf1-a628-1a520f06a4a9 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.507758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d4b740b-f104-47d1-9a03-dc4473e1ee42 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.509131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d4b740b-f104-47d1-9a03-dc4473e1ee42 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.510716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d4b740b-f104-47d1-9a03-dc4473e1ee42 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.511556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d4b740b-f104-47d1-9a03-dc4473e1ee42 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.513685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d4b740b-f104-47d1-9a03-dc4473e1ee42 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.514409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d4b740b-f104-47d1-9a03-dc4473e1ee42 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.526562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-08ee360d-42a9-4bf1-a628-1a520f06a4a9 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:28:08.560542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-6d4b740b-f104-47d1-9a03-dc4473e1ee42 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lazy-loading 'flavor' on Instance uuid fb88dcce-9600-4324-839a-995db788a4d8 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:08.622367 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-08ee360d-42a9-4bf1-a628-1a520f06a4a9 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 204 len: 0 microversion: 2.1 time: 0.158157 Oct 18 13:28:08.623237 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1451/2743] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:08 2022] DELETE /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:28:08.629116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a5ff4a75-3314-476f-87ce-cfb7d5e1e477 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.629830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a5ff4a75-3314-476f-87ce-cfb7d5e1e477 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.637921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5ff4a75-3314-476f-87ce-cfb7d5e1e477 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.638554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5ff4a75-3314-476f-87ce-cfb7d5e1e477 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.639130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5ff4a75-3314-476f-87ce-cfb7d5e1e477 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.639957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5ff4a75-3314-476f-87ce-cfb7d5e1e477 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.640482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5ff4a75-3314-476f-87ce-cfb7d5e1e477 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.641136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5ff4a75-3314-476f-87ce-cfb7d5e1e477 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.661843 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6d4b740b-f104-47d1-9a03-dc4473e1ee42 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "POST /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8/action" status: 202 len: 0 microversion: 2.1 time: 0.180484 Oct 18 13:28:08.665360 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1293/2744] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:28:08 2022] POST /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:28:08.672816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dcfd3bd3-6a1b-48a5-8d0a-00defcbd6b02 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.673551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dcfd3bd3-6a1b-48a5-8d0a-00defcbd6b02 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.681908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcfd3bd3-6a1b-48a5-8d0a-00defcbd6b02 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.682394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcfd3bd3-6a1b-48a5-8d0a-00defcbd6b02 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.682823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcfd3bd3-6a1b-48a5-8d0a-00defcbd6b02 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.683531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcfd3bd3-6a1b-48a5-8d0a-00defcbd6b02 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.683999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcfd3bd3-6a1b-48a5-8d0a-00defcbd6b02 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.684423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcfd3bd3-6a1b-48a5-8d0a-00defcbd6b02 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.853899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dcfd3bd3-6a1b-48a5-8d0a-00defcbd6b02 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:08.856901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a5ff4a75-3314-476f-87ce-cfb7d5e1e477 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:08.865368 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dcfd3bd3-6a1b-48a5-8d0a-00defcbd6b02 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1509 microversion: 2.1 time: 0.198227 Oct 18 13:28:08.865922 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a5ff4a75-3314-476f-87ce-cfb7d5e1e477 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1317 microversion: 2.1 time: 0.240927 Oct 18 13:28:08.866367 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1452/2745] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:08 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:08.868013 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1294/2746] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:08 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:08.886036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-859c5fd9-16d7-40fd-980d-5c7cbcd6b461 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.886661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-859c5fd9-16d7-40fd-980d-5c7cbcd6b461 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.892877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-859c5fd9-16d7-40fd-980d-5c7cbcd6b461 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.893417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-859c5fd9-16d7-40fd-980d-5c7cbcd6b461 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.893855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-859c5fd9-16d7-40fd-980d-5c7cbcd6b461 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.894542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-859c5fd9-16d7-40fd-980d-5c7cbcd6b461 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.894994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-859c5fd9-16d7-40fd-980d-5c7cbcd6b461 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.895445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-859c5fd9-16d7-40fd-980d-5c7cbcd6b461 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.978435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0f8a64fa-8417-4eff-93f5-150558c4430f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:08.979050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0f8a64fa-8417-4eff-93f5-150558c4430f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:08.987938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f8a64fa-8417-4eff-93f5-150558c4430f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.988432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f8a64fa-8417-4eff-93f5-150558c4430f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.989064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f8a64fa-8417-4eff-93f5-150558c4430f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:08.989838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f8a64fa-8417-4eff-93f5-150558c4430f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:08.990551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f8a64fa-8417-4eff-93f5-150558c4430f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:08.991301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f8a64fa-8417-4eff-93f5-150558c4430f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.088858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-859c5fd9-16d7-40fd-980d-5c7cbcd6b461 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:09.102575 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-859c5fd9-16d7-40fd-980d-5c7cbcd6b461 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1510 microversion: 2.1 time: 0.224173 Oct 18 13:28:09.103418 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1453/2747] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:08 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:09.164922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0f8a64fa-8417-4eff-93f5-150558c4430f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:09.173785 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0f8a64fa-8417-4eff-93f5-150558c4430f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1402 microversion: 2.1 time: 0.199881 Oct 18 13:28:09.174470 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1295/2748] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:08 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1402 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:09.431701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:09.433040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:09.439679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.440333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.440862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.441678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.442206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.442705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.476966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.478169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.478824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.479432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lazy-loading 'fault' on Instance uuid f9412adf-f352-4aad-ac60-81be4892dc8f {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:09.528123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b02e97ca243c490e8e0c9d2283523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a03bf7e9014bb6b8e7ea64005b26c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:09.536173 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4c25554e-d383-448f-a52f-90ef9f9507cd tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 200 len: 1320 microversion: 2.1 time: 0.108758 Oct 18 13:28:09.536744 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1454/2749] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:09 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 1320 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:09.891875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3f2ae98d-eeed-4d12-986c-d298eac02e6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:09.897893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8db51d93-78ea-4867-bb5a-1372f27d2205 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:09.898519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8db51d93-78ea-4867-bb5a-1372f27d2205 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:09.901595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3f2ae98d-eeed-4d12-986c-d298eac02e6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:09.906203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8db51d93-78ea-4867-bb5a-1372f27d2205 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.906702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8db51d93-78ea-4867-bb5a-1372f27d2205 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.907137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8db51d93-78ea-4867-bb5a-1372f27d2205 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.907833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8db51d93-78ea-4867-bb5a-1372f27d2205 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.908284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8db51d93-78ea-4867-bb5a-1372f27d2205 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.908704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8db51d93-78ea-4867-bb5a-1372f27d2205 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.908813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f2ae98d-eeed-4d12-986c-d298eac02e6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.909257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f2ae98d-eeed-4d12-986c-d298eac02e6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.909692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f2ae98d-eeed-4d12-986c-d298eac02e6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:09.910390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f2ae98d-eeed-4d12-986c-d298eac02e6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:09.910895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f2ae98d-eeed-4d12-986c-d298eac02e6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:09.914753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f2ae98d-eeed-4d12-986c-d298eac02e6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.057716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8db51d93-78ea-4867-bb5a-1372f27d2205 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.065993 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8db51d93-78ea-4867-bb5a-1372f27d2205 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1509 microversion: 2.1 time: 0.172391 Oct 18 13:28:10.066972 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1455/2750] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:09 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:10.080039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3f2ae98d-eeed-4d12-986c-d298eac02e6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.088718 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3f2ae98d-eeed-4d12-986c-d298eac02e6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1317 microversion: 2.1 time: 0.200649 Oct 18 13:28:10.089350 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1296/2751] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:09 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:10.125929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-14b7715e-2a1d-4afb-81d8-b937ace3fc70 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:10.126577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-14b7715e-2a1d-4afb-81d8-b937ace3fc70 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:10.133462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14b7715e-2a1d-4afb-81d8-b937ace3fc70 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.133951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14b7715e-2a1d-4afb-81d8-b937ace3fc70 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.134387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14b7715e-2a1d-4afb-81d8-b937ace3fc70 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.135091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14b7715e-2a1d-4afb-81d8-b937ace3fc70 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.135545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14b7715e-2a1d-4afb-81d8-b937ace3fc70 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.136102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14b7715e-2a1d-4afb-81d8-b937ace3fc70 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.198415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b758ed65-d98a-4f2e-8113-9e941e2bf575 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:10.199035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b758ed65-d98a-4f2e-8113-9e941e2bf575 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:10.205330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b758ed65-d98a-4f2e-8113-9e941e2bf575 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.206102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b758ed65-d98a-4f2e-8113-9e941e2bf575 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.206562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b758ed65-d98a-4f2e-8113-9e941e2bf575 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.207978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b758ed65-d98a-4f2e-8113-9e941e2bf575 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.207978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b758ed65-d98a-4f2e-8113-9e941e2bf575 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.208175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b758ed65-d98a-4f2e-8113-9e941e2bf575 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.248215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:10.283663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=22 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:10.300413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-14b7715e-2a1d-4afb-81d8-b937ace3fc70 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.310025 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-14b7715e-2a1d-4afb-81d8-b937ace3fc70 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1493 microversion: 2.1 time: 0.188072 Oct 18 13:28:10.311319 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1456/2752] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:10 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1493 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:10.333024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-11f4cafd-182f-4eb5-9a09-a572aac38059 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:10.333549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-11f4cafd-182f-4eb5-9a09-a572aac38059 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:10.344007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11f4cafd-182f-4eb5-9a09-a572aac38059 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.344533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11f4cafd-182f-4eb5-9a09-a572aac38059 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.345002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11f4cafd-182f-4eb5-9a09-a572aac38059 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.345820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11f4cafd-182f-4eb5-9a09-a572aac38059 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.346278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11f4cafd-182f-4eb5-9a09-a572aac38059 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.346710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11f4cafd-182f-4eb5-9a09-a572aac38059 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.364117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:10.376141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b758ed65-d98a-4f2e-8113-9e941e2bf575 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.379849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-11f4cafd-182f-4eb5-9a09-a572aac38059 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:28:10.385611 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b758ed65-d98a-4f2e-8113-9e941e2bf575 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1589 microversion: 2.1 time: 0.192053 Oct 18 13:28:10.401230 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1297/2753] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:10 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1589 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:10.408348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35ac47ff-d54d-4633-84db-6a9ff80463f8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:10.408851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-35ac47ff-d54d-4633-84db-6a9ff80463f8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:10.415830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35ac47ff-d54d-4633-84db-6a9ff80463f8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.416534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35ac47ff-d54d-4633-84db-6a9ff80463f8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.417081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35ac47ff-d54d-4633-84db-6a9ff80463f8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.417858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35ac47ff-d54d-4633-84db-6a9ff80463f8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.418375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35ac47ff-d54d-4633-84db-6a9ff80463f8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.418860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35ac47ff-d54d-4633-84db-6a9ff80463f8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.474364 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-11f4cafd-182f-4eb5-9a09-a572aac38059 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 204 len: 0 microversion: 2.1 time: 0.144662 Oct 18 13:28:10.476192 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1457/2754] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:10 2022] DELETE /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:28:10.485535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c150bfec-7aa8-4d4e-a89b-aa6d5eac17f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:10.486335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c150bfec-7aa8-4d4e-a89b-aa6d5eac17f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:10.493217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c150bfec-7aa8-4d4e-a89b-aa6d5eac17f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.495210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c150bfec-7aa8-4d4e-a89b-aa6d5eac17f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.495731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c150bfec-7aa8-4d4e-a89b-aa6d5eac17f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.497708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c150bfec-7aa8-4d4e-a89b-aa6d5eac17f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.497708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c150bfec-7aa8-4d4e-a89b-aa6d5eac17f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.498124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c150bfec-7aa8-4d4e-a89b-aa6d5eac17f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.523461 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-35ac47ff-d54d-4633-84db-6a9ff80463f8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119017 Oct 18 13:28:10.524069 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1298/2755] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:28:10 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:28:10.559832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-40510527-9b9f-4a29-a85b-7b748f4e6392 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:10.560358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-40510527-9b9f-4a29-a85b-7b748f4e6392 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] [instance: f9412adf-f352-4aad-ac60-81be4892dc8f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:10.567659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40510527-9b9f-4a29-a85b-7b748f4e6392 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.569216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40510527-9b9f-4a29-a85b-7b748f4e6392 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.569720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40510527-9b9f-4a29-a85b-7b748f4e6392 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.570700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40510527-9b9f-4a29-a85b-7b748f4e6392 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:10.571154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40510527-9b9f-4a29-a85b-7b748f4e6392 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:10.571760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40510527-9b9f-4a29-a85b-7b748f4e6392 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:10.590138 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-40510527-9b9f-4a29-a85b-7b748f4e6392 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] HTTP exception thrown: Instance f9412adf-f352-4aad-ac60-81be4892dc8f could not be found. Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-40510527-9b9f-4a29-a85b-7b748f4e6392 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Request method failure captured: Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f HTTP/1.1 Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqm5BxQLII_67bqNeYW6wmSx_gsSXVT64Zf3pAkzfgSGYw7pkv3L6r3AJbQj-47DLyi9epFxuyG-qF2_fkVPoTW5IN1PkqwvkhPVuR3Ez-zsi-A-Ybuo1G3AMfB-BXPnCkCfFIWLgGjQbBc0_93yr3-GXf9z6NobePGrKxx2WzAmqYs Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 79a03bf7e9014bb6b8e7ea64005b26c9 Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:10.591924 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:10.593698 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79a03bf7e9014bb6b8e7ea64005b26c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79a03bf7e9014bb6b8e7ea64005b26c9"}]}] Oct 18 13:28:10.593698 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:28:10.593698 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 79a03bf7e9014bb6b8e7ea64005b26c9 Oct 18 13:28:10.593698 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 Oct 18 13:28:10.593698 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project Oct 18 13:28:10.593698 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:10.593698 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:10.593698 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 8f2b02e97ca243c490e8e0c9d2283523 Oct 18 13:28:10.593698 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project Oct 18 13:28:10.593698 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:28:10.593698 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance f9412adf-f352-4aad-ac60-81be4892dc8f could not be found. Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'f9412adf-f352-4aad-ac60-81be4892dc8f'} Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9412adf-f352-4aad-ac60-81be4892dc8f could not be found. Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:10.594603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9412adf-f352-4aad-ac60-81be4892dc8f could not be found. Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9412adf-f352-4aad-ac60-81be4892dc8f could not be found. Oct 18 13:28:10.595967 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:10.597080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-40510527-9b9f-4a29-a85b-7b748f4e6392 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] Returning 404 to user: Instance f9412adf-f352-4aad-ac60-81be4892dc8f could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:10.597080 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-40510527-9b9f-4a29-a85b-7b748f4e6392 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884 tempest-FloatingIPsAssociationNegativeTestJSON-1154920884-project] 10.222.0.40 "GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f" status: 404 len: 111 microversion: 2.1 time: 0.037731 Oct 18 13:28:10.597080 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1299/2756] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:10 2022] GET /compute/v2.1/servers/f9412adf-f352-4aad-ac60-81be4892dc8f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:28:10.713125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c150bfec-7aa8-4d4e-a89b-aa6d5eac17f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:10.722810 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c150bfec-7aa8-4d4e-a89b-aa6d5eac17f0 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1499 microversion: 2.1 time: 0.242156 Oct 18 13:28:10.725467 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1458/2757] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:10 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1499 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:11.116721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c96a65ac-95dd-4f98-9f2e-2900aad0f40d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:11.124617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c96a65ac-95dd-4f98-9f2e-2900aad0f40d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:11.126380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e3d8b41f-50df-45bc-8dda-4842dc9bfc5e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:11.127456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e3d8b41f-50df-45bc-8dda-4842dc9bfc5e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:11.139198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c96a65ac-95dd-4f98-9f2e-2900aad0f40d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.140027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c96a65ac-95dd-4f98-9f2e-2900aad0f40d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.140616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c96a65ac-95dd-4f98-9f2e-2900aad0f40d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.141610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c96a65ac-95dd-4f98-9f2e-2900aad0f40d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.142286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c96a65ac-95dd-4f98-9f2e-2900aad0f40d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.143279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c96a65ac-95dd-4f98-9f2e-2900aad0f40d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.167863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3d8b41f-50df-45bc-8dda-4842dc9bfc5e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.168083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3d8b41f-50df-45bc-8dda-4842dc9bfc5e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.171526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3d8b41f-50df-45bc-8dda-4842dc9bfc5e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.174221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3d8b41f-50df-45bc-8dda-4842dc9bfc5e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.175305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3d8b41f-50df-45bc-8dda-4842dc9bfc5e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.176776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3d8b41f-50df-45bc-8dda-4842dc9bfc5e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.479958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c96a65ac-95dd-4f98-9f2e-2900aad0f40d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:11.492556 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c96a65ac-95dd-4f98-9f2e-2900aad0f40d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1317 microversion: 2.1 time: 0.382677 Oct 18 13:28:11.494202 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1459/2758] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:11 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:11.500129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f92a1575-c274-4b51-a1db-81381fefb7ab req-0b39d2f2-72e8-44a2-9d68-56e5d699cec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0688b2d-dd1e-427c-b5f1-1ac0fad84598", "name": "network-vif-plugged", "status": "completed", "tag": "e0e1dcca-7704-41ae-9e89-01a7dda38f72"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:11.513834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f92a1575-c274-4b51-a1db-81381fefb7ab req-0b39d2f2-72e8-44a2-9d68-56e5d699cec6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.514876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f92a1575-c274-4b51-a1db-81381fefb7ab req-0b39d2f2-72e8-44a2-9d68-56e5d699cec6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.515543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f92a1575-c274-4b51-a1db-81381fefb7ab req-0b39d2f2-72e8-44a2-9d68-56e5d699cec6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.542391 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f92a1575-c274-4b51-a1db-81381fefb7ab req-0b39d2f2-72e8-44a2-9d68-56e5d699cec6 service nova] Creating event network-vif-plugged:e0e1dcca-7704-41ae-9e89-01a7dda38f72 for instance b0688b2d-dd1e-427c-b5f1-1ac0fad84598 on n-h2-858384-13 Oct 18 13:28:11.552633 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f92a1575-c274-4b51-a1db-81381fefb7ab req-0b39d2f2-72e8-44a2-9d68-56e5d699cec6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055153 Oct 18 13:28:11.553352 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1460/2759] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:11.687704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e3d8b41f-50df-45bc-8dda-4842dc9bfc5e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:11.699055 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e3d8b41f-50df-45bc-8dda-4842dc9bfc5e tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1509 microversion: 2.1 time: 0.609289 Oct 18 13:28:11.712266 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1300/2760] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:11 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1509 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:11.748387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f14fb0f5-d9a6-4ea7-a98c-0cd021c584e2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:11.749208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f14fb0f5-d9a6-4ea7-a98c-0cd021c584e2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:11.757615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f14fb0f5-d9a6-4ea7-a98c-0cd021c584e2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.757885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f14fb0f5-d9a6-4ea7-a98c-0cd021c584e2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.758331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f14fb0f5-d9a6-4ea7-a98c-0cd021c584e2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:11.759071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f14fb0f5-d9a6-4ea7-a98c-0cd021c584e2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:11.760223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f14fb0f5-d9a6-4ea7-a98c-0cd021c584e2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:11.760223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f14fb0f5-d9a6-4ea7-a98c-0cd021c584e2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.123058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f14fb0f5-d9a6-4ea7-a98c-0cd021c584e2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:12.133861 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f14fb0f5-d9a6-4ea7-a98c-0cd021c584e2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1499 microversion: 2.1 time: 0.389719 Oct 18 13:28:12.165518 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1461/2761] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:11 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1499 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:12.343349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-037cbca6-041e-4b95-92f2-16a4fba02843 req-566f556c-5f74-46d1-a5aa-c5e86f96473f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b1ea363-fd17-4524-9c4a-925239ec3b7d", "name": "network-vif-deleted", "tag": "62fa0d67-1f1c-4da6-9d0d-022cc99356fb"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:12.373057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-037cbca6-041e-4b95-92f2-16a4fba02843 req-566f556c-5f74-46d1-a5aa-c5e86f96473f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.373897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-037cbca6-041e-4b95-92f2-16a4fba02843 req-566f556c-5f74-46d1-a5aa-c5e86f96473f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.374555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-037cbca6-041e-4b95-92f2-16a4fba02843 req-566f556c-5f74-46d1-a5aa-c5e86f96473f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.416852 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-037cbca6-041e-4b95-92f2-16a4fba02843 req-566f556c-5f74-46d1-a5aa-c5e86f96473f service nova] Creating event network-vif-deleted:62fa0d67-1f1c-4da6-9d0d-022cc99356fb for instance 2b1ea363-fd17-4524-9c4a-925239ec3b7d on n-h1-858384-13 Oct 18 13:28:12.435893 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-037cbca6-041e-4b95-92f2-16a4fba02843 req-566f556c-5f74-46d1-a5aa-c5e86f96473f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096539 Oct 18 13:28:12.439969 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1301/2762] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:12.517312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a56696ea-ea1f-4580-9217-e10992089b30 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:12.518818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a56696ea-ea1f-4580-9217-e10992089b30 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:12.544670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a56696ea-ea1f-4580-9217-e10992089b30 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.545795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a56696ea-ea1f-4580-9217-e10992089b30 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.546374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a56696ea-ea1f-4580-9217-e10992089b30 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.547115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a56696ea-ea1f-4580-9217-e10992089b30 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.547596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a56696ea-ea1f-4580-9217-e10992089b30 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.548009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a56696ea-ea1f-4580-9217-e10992089b30 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.728873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:12.729673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:12.745119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.745646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.746080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.749648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.750429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.750883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.830159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:12.831474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:12.832747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:12.834936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lazy-loading 'fault' on Instance uuid 2b1ea363-fd17-4524-9c4a-925239ec3b7d {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:12.977530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a56696ea-ea1f-4580-9217-e10992089b30 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:12.986894 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a56696ea-ea1f-4580-9217-e10992089b30 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1317 microversion: 2.1 time: 0.474580 Oct 18 13:28:12.988127 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1462/2763] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:12 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:13.066703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d958d612eec4e968daf74e18c171919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc35dfc1cb9b4935814339ccaa47e48b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:13.077776 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-41307eb0-42e5-44c4-97a9-15e9be563c72 tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 200 len: 1306 microversion: 2.1 time: 0.354856 Oct 18 13:28:13.078384 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1302/2764] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:12 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 1306 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:13.166075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ee326414-8bad-4cf4-b745-be1c58bef945 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:13.167336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ee326414-8bad-4cf4-b745-be1c58bef945 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:13.186297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee326414-8bad-4cf4-b745-be1c58bef945 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:13.189097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee326414-8bad-4cf4-b745-be1c58bef945 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:13.190337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee326414-8bad-4cf4-b745-be1c58bef945 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:13.191898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee326414-8bad-4cf4-b745-be1c58bef945 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:13.195198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee326414-8bad-4cf4-b745-be1c58bef945 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:13.195884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee326414-8bad-4cf4-b745-be1c58bef945 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:13.672137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ee326414-8bad-4cf4-b745-be1c58bef945 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:13.684508 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ee326414-8bad-4cf4-b745-be1c58bef945 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1499 microversion: 2.1 time: 0.524410 Oct 18 13:28:13.694382 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1463/2765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:13 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1499 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:13.785058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c45b407e-ff4e-4970-b511-a24739c2ab34 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:13.785744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c45b407e-ff4e-4970-b511-a24739c2ab34 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:13.806946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c45b407e-ff4e-4970-b511-a24739c2ab34 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:13.807505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c45b407e-ff4e-4970-b511-a24739c2ab34 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:13.817786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c45b407e-ff4e-4970-b511-a24739c2ab34 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:13.823430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c45b407e-ff4e-4970-b511-a24739c2ab34 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:13.825148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c45b407e-ff4e-4970-b511-a24739c2ab34 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:13.825672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c45b407e-ff4e-4970-b511-a24739c2ab34 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.014652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4ab7b56-6f9a-4938-8bc0-ffb3ff951dd7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:14.015593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e4ab7b56-6f9a-4938-8bc0-ffb3ff951dd7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:14.027544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4ab7b56-6f9a-4938-8bc0-ffb3ff951dd7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.029457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4ab7b56-6f9a-4938-8bc0-ffb3ff951dd7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.030132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4ab7b56-6f9a-4938-8bc0-ffb3ff951dd7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.033966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4ab7b56-6f9a-4938-8bc0-ffb3ff951dd7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.034838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4ab7b56-6f9a-4938-8bc0-ffb3ff951dd7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.035656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4ab7b56-6f9a-4938-8bc0-ffb3ff951dd7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.335557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c45b407e-ff4e-4970-b511-a24739c2ab34 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:14.354932 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c45b407e-ff4e-4970-b511-a24739c2ab34 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1589 microversion: 2.1 time: 0.574010 Oct 18 13:28:14.355956 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1303/2766] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:13 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1589 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:14.377475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7b7f3d06-e91d-4330-b86a-a2105a04ab5a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:14.378322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7b7f3d06-e91d-4330-b86a-a2105a04ab5a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] [instance: 2b1ea363-fd17-4524-9c4a-925239ec3b7d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:14.400013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b7f3d06-e91d-4330-b86a-a2105a04ab5a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.401426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b7f3d06-e91d-4330-b86a-a2105a04ab5a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.402422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b7f3d06-e91d-4330-b86a-a2105a04ab5a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.404552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b7f3d06-e91d-4330-b86a-a2105a04ab5a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.407406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b7f3d06-e91d-4330-b86a-a2105a04ab5a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.408175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b7f3d06-e91d-4330-b86a-a2105a04ab5a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.454269 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-7b7f3d06-e91d-4330-b86a-a2105a04ab5a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] HTTP exception thrown: Instance 2b1ea363-fd17-4524-9c4a-925239ec3b7d could not be found. Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7b7f3d06-e91d-4330-b86a-a2105a04ab5a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Request method failure captured: Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d HTTP/1.1 Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqnQbkYaeHnWO3bGmvu-K9rQg7fiIG1GxjKxhi043NFQtpzFPy5DLbCIBcjTYKl9_iGmfF_tI5AE-XlQLeGkz1wGbwVK3-dyDW_IB3tq_zYZYWD7Ysu_1xMDoz5FMaNDGuuU63lfuZbmD9C8iHjGV-cQalpBBU0ovQblR7Yof5OVKj8 Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: dc35dfc1cb9b4935814339ccaa47e48b Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerPasswordTestJSON-1591128359 Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:14.456028 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:14.457686 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc35dfc1cb9b4935814339ccaa47e48b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc35dfc1cb9b4935814339ccaa47e48b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc35dfc1cb9b4935814339ccaa47e48b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc35dfc1cb9b4935814339ccaa47e48b"}]}] Oct 18 13:28:14.457686 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerPasswordTestJSON-1591128359 Oct 18 13:28:14.457686 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: dc35dfc1cb9b4935814339ccaa47e48b Oct 18 13:28:14.457686 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1591128359 Oct 18 13:28:14.457686 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerPasswordTestJSON-1591128359-project Oct 18 13:28:14.457686 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:14.457686 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:14.457686 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 2d958d612eec4e968daf74e18c171919 Oct 18 13:28:14.457686 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerPasswordTestJSON-1591128359-project Oct 18 13:28:14.457686 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:28:14.457686 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 2b1ea363-fd17-4524-9c4a-925239ec3b7d could not be found. Oct 18 13:28:14.457686 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '2b1ea363-fd17-4524-9c4a-925239ec3b7d'} Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b1ea363-fd17-4524-9c4a-925239ec3b7d could not be found. Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:14.458513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b1ea363-fd17-4524-9c4a-925239ec3b7d could not be found. Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b1ea363-fd17-4524-9c4a-925239ec3b7d could not be found. Oct 18 13:28:14.460877 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:14.463283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7b7f3d06-e91d-4330-b86a-a2105a04ab5a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] Returning 404 to user: Instance 2b1ea363-fd17-4524-9c4a-925239ec3b7d could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:14.463283 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7b7f3d06-e91d-4330-b86a-a2105a04ab5a tempest-ServerPasswordTestJSON-1591128359 tempest-ServerPasswordTestJSON-1591128359-project] 10.222.0.40 "GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d" status: 404 len: 111 microversion: 2.1 time: 0.097144 Oct 18 13:28:14.470460 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1304/2767] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:14 2022] GET /compute/v2.1/servers/2b1ea363-fd17-4524-9c4a-925239ec3b7d => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:14.586139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e4ab7b56-6f9a-4938-8bc0-ffb3ff951dd7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:14.599050 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e4ab7b56-6f9a-4938-8bc0-ffb3ff951dd7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1466 microversion: 2.1 time: 0.588137 Oct 18 13:28:14.603150 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1464/2768] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:14 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1466 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:14.692221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d37a4bba-b370-4e10-8f73-868be12432f4 req-86b69a65-9e83-4c01-8c51-611bc456596d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477de8bd-778f-4e84-8f0d-5ca5f40c5690", "tag": "c4112e45-a6d2-4c90-8e19-c4a0ff6b6cf2"}, {"server_uuid": "fb88dcce-9600-4324-839a-995db788a4d8", "name": "network-vif-deleted", "tag": "75bbdfbd-02a7-483c-91da-58cfa06f8fce"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:14.726090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d37a4bba-b370-4e10-8f73-868be12432f4 req-86b69a65-9e83-4c01-8c51-611bc456596d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.726673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d37a4bba-b370-4e10-8f73-868be12432f4 req-86b69a65-9e83-4c01-8c51-611bc456596d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.727128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d37a4bba-b370-4e10-8f73-868be12432f4 req-86b69a65-9e83-4c01-8c51-611bc456596d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.769557 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d37a4bba-b370-4e10-8f73-868be12432f4 req-86b69a65-9e83-4c01-8c51-611bc456596d service nova] Creating event network-changed:c4112e45-a6d2-4c90-8e19-c4a0ff6b6cf2 for instance 477de8bd-778f-4e84-8f0d-5ca5f40c5690 on n-h2-858384-13 Oct 18 13:28:14.770079 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d37a4bba-b370-4e10-8f73-868be12432f4 req-86b69a65-9e83-4c01-8c51-611bc456596d service nova] Creating event network-vif-deleted:75bbdfbd-02a7-483c-91da-58cfa06f8fce for instance fb88dcce-9600-4324-839a-995db788a4d8 on n-h2-858384-13 Oct 18 13:28:14.786124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-042d00fb-ee84-47c4-a8d8-f539534dfca0 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:14.789774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-042d00fb-ee84-47c4-a8d8-f539534dfca0 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:14.791266 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d37a4bba-b370-4e10-8f73-868be12432f4 req-86b69a65-9e83-4c01-8c51-611bc456596d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.102082 Oct 18 13:28:14.794734 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1465/2769] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:28:14.809709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-042d00fb-ee84-47c4-a8d8-f539534dfca0 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.810708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:14.812971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:14.813119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-042d00fb-ee84-47c4-a8d8-f539534dfca0 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.815978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-042d00fb-ee84-47c4-a8d8-f539534dfca0 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.816824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-042d00fb-ee84-47c4-a8d8-f539534dfca0 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.818274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-042d00fb-ee84-47c4-a8d8-f539534dfca0 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.819954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-042d00fb-ee84-47c4-a8d8-f539534dfca0 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.828547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.829034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.829492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.830193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.841957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.843050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.868986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:14.920970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:14.927584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:14.931310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:14.932002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lazy-loading 'fault' on Instance uuid fb88dcce-9600-4324-839a-995db788a4d8 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:28:15.129539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a722d1dc7c4e05b8cc8dc98b5cb619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b096c3406ce42d380811b170798afcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:15.142838 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-47952d3f-e1ac-4bbb-ae50-3c17ecc7a7ba tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 200 len: 1305 microversion: 2.1 time: 0.345183 Oct 18 13:28:15.151011 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1466/2770] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:14 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 1305 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:16.190616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9e62efd6-b966-425b-ab4f-4a3c186448c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.195112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9e62efd6-b966-425b-ab4f-4a3c186448c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.220529 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-042d00fb-ee84-47c4-a8d8-f539534dfca0 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1619 microversion: 2.1 time: 1.596865 Oct 18 13:28:16.224350 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1305/2771] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:14 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1619 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:16.235279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e62efd6-b966-425b-ab4f-4a3c186448c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.236245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e62efd6-b966-425b-ab4f-4a3c186448c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.236939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e62efd6-b966-425b-ab4f-4a3c186448c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.238433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e62efd6-b966-425b-ab4f-4a3c186448c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.239221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e62efd6-b966-425b-ab4f-4a3c186448c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.240251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e62efd6-b966-425b-ab4f-4a3c186448c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.254710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-016241d6-e01d-4276-8801-e5797e2fd1e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Action: 'create', calling method: .version_select at 0x7ff60f683e50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-681617220", "policies": ["affinity"]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:16.310023 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-9e62efd6-b966-425b-ab4f-4a3c186448c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9e62efd6-b966-425b-ab4f-4a3c186448c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 HTTP/1.1 Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:16.312571 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:16.314412 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:16.314412 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.314412 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.314412 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.314412 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.314412 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:16.314412 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:16.314412 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:16.314412 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.314412 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:28:16.314412 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.314412 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'fb88dcce-9600-4324-839a-995db788a4d8'} Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:16.315365 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.323260 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.326175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9e62efd6-b966-425b-ab4f-4a3c186448c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:16.326175 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9e62efd6-b966-425b-ab4f-4a3c186448c9 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 404 len: 111 microversion: 2.1 time: 0.150187 Oct 18 13:28:16.326175 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1467/2772] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:16 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:16.332904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-016241d6-e01d-4276-8801-e5797e2fd1e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:16.337355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b29d1909-f418-440b-b16d-86dc622f3923 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.337858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b29d1909-f418-440b-b16d-86dc622f3923 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.350464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-016241d6-e01d-4276-8801-e5797e2fd1e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:16.351529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b29d1909-f418-440b-b16d-86dc622f3923 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.352028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b29d1909-f418-440b-b16d-86dc622f3923 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.352459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b29d1909-f418-440b-b16d-86dc622f3923 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.353172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b29d1909-f418-440b-b16d-86dc622f3923 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.353643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b29d1909-f418-440b-b16d-86dc622f3923 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.354069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b29d1909-f418-440b-b16d-86dc622f3923 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.413061 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-b29d1909-f418-440b-b16d-86dc622f3923 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b29d1909-f418-440b-b16d-86dc622f3923 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 HTTP/1.1 Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:16.421133 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:16.422778 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:16.422778 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.422778 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.422778 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.422778 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.422778 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:16.422778 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:16.422778 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:16.422778 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.422778 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:28:16.422778 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.422778 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'fb88dcce-9600-4324-839a-995db788a4d8'} Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:16.423656 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.424843 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.428203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b29d1909-f418-440b-b16d-86dc622f3923 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:16.428203 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b29d1909-f418-440b-b16d-86dc622f3923 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 404 len: 111 microversion: 2.1 time: 0.091726 Oct 18 13:28:16.428203 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1468/2773] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:16 2022] DELETE /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:16.442101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87a7bc91-5c7b-4429-b91c-b3532e4dd6e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.442741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-87a7bc91-5c7b-4429-b91c-b3532e4dd6e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: fb88dcce-9600-4324-839a-995db788a4d8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.457859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-016241d6-e01d-4276-8801-e5797e2fd1e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:16.458402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87a7bc91-5c7b-4429-b91c-b3532e4dd6e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.458896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87a7bc91-5c7b-4429-b91c-b3532e4dd6e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.461922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87a7bc91-5c7b-4429-b91c-b3532e4dd6e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.462921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87a7bc91-5c7b-4429-b91c-b3532e4dd6e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.464240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-016241d6-e01d-4276-8801-e5797e2fd1e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:16.465351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87a7bc91-5c7b-4429-b91c-b3532e4dd6e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.467923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87a7bc91-5c7b-4429-b91c-b3532e4dd6e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.485128 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-016241d6-e01d-4276-8801-e5797e2fd1e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.238060 Oct 18 13:28:16.497548 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1306/2774] 10.222.0.40 () {60 vars in 1174 bytes} [Tue Oct 18 13:28:16 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:16.504284 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-87a7bc91-5c7b-4429-b91c-b3532e4dd6e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87a7bc91-5c7b-4429-b91c-b3532e4dd6e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 HTTP/1.1 Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:16.507412 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:16.509286 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:16.509286 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.509286 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.509286 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.509286 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.509286 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:16.509286 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:16.509286 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:16.509286 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.509286 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:28:16.509286 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.509286 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'fb88dcce-9600-4324-839a-995db788a4d8'} Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:16.510183 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. Oct 18 13:28:16.511609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.512912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87a7bc91-5c7b-4429-b91c-b3532e4dd6e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance fb88dcce-9600-4324-839a-995db788a4d8 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:16.513403 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-87a7bc91-5c7b-4429-b91c-b3532e4dd6e8 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8" status: 404 len: 111 microversion: 2.1 time: 0.080736 Oct 18 13:28:16.514432 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1469/2775] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:16 2022] GET /compute/v2.1/servers/fb88dcce-9600-4324-839a-995db788a4d8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:16.523798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ab5e09a8-f0ce-43e0-95dc-cfe4a37c9688 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.524456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ab5e09a8-f0ce-43e0-95dc-cfe4a37c9688 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.538549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab5e09a8-f0ce-43e0-95dc-cfe4a37c9688 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.539042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab5e09a8-f0ce-43e0-95dc-cfe4a37c9688 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.539613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab5e09a8-f0ce-43e0-95dc-cfe4a37c9688 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.540344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab5e09a8-f0ce-43e0-95dc-cfe4a37c9688 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.540805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab5e09a8-f0ce-43e0-95dc-cfe4a37c9688 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.541245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab5e09a8-f0ce-43e0-95dc-cfe4a37c9688 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.578301 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-ab5e09a8-f0ce-43e0-95dc-cfe4a37c9688 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ab5e09a8-f0ce-43e0-95dc-cfe4a37c9688 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 HTTP/1.1 Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:16.579878 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:16.581334 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:16.581334 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.581334 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.581334 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.581334 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.581334 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:16.581334 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:16.581334 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:16.581334 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.581334 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:28:16.581334 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:28:16.581334 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '011b3a1e-b73c-4005-b92f-ece6f98fee72'} Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:16.582129 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:28:16.583296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.585038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ab5e09a8-f0ce-43e0-95dc-cfe4a37c9688 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:16.585038 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ab5e09a8-f0ce-43e0-95dc-cfe4a37c9688 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 404 len: 111 microversion: 2.1 time: 0.062350 Oct 18 13:28:16.585038 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1307/2776] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:16 2022] DELETE /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:16.595051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7d428d54-f4a1-4a6f-b398-a5d62971c9c2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.595668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7d428d54-f4a1-4a6f-b398-a5d62971c9c2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 011b3a1e-b73c-4005-b92f-ece6f98fee72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.607564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d428d54-f4a1-4a6f-b398-a5d62971c9c2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.607564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d428d54-f4a1-4a6f-b398-a5d62971c9c2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.607564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d428d54-f4a1-4a6f-b398-a5d62971c9c2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.607564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d428d54-f4a1-4a6f-b398-a5d62971c9c2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.607969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d428d54-f4a1-4a6f-b398-a5d62971c9c2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.615570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-653316309", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "cd107ee3-9da9-4d4a-a086-4bbd7f78626f"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:16.617964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d428d54-f4a1-4a6f-b398-a5d62971c9c2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.661881 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-7d428d54-f4a1-4a6f-b398-a5d62971c9c2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7d428d54-f4a1-4a6f-b398-a5d62971c9c2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 HTTP/1.1 Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:16.664908 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:16.666364 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:16.666364 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.666364 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.666364 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.666364 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.666364 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:16.666364 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:16.666364 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:16.666364 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.666364 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:28:16.666364 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:28:16.666364 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '011b3a1e-b73c-4005-b92f-ece6f98fee72'} Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:16.667094 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. Oct 18 13:28:16.668498 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.672115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7d428d54-f4a1-4a6f-b398-a5d62971c9c2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance 011b3a1e-b73c-4005-b92f-ece6f98fee72 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:16.673193 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7d428d54-f4a1-4a6f-b398-a5d62971c9c2 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72" status: 404 len: 111 microversion: 2.1 time: 0.086520 Oct 18 13:28:16.677807 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1470/2777] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:16 2022] GET /compute/v2.1/servers/011b3a1e-b73c-4005-b92f-ece6f98fee72 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:16.681758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:28:16.683786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1b00158c-0a28-44ab-838b-a27dbbbda051 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.684499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1b00158c-0a28-44ab-838b-a27dbbbda051 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.707833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b00158c-0a28-44ab-838b-a27dbbbda051 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.708404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b00158c-0a28-44ab-838b-a27dbbbda051 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.708908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b00158c-0a28-44ab-838b-a27dbbbda051 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.710362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b00158c-0a28-44ab-838b-a27dbbbda051 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.710875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b00158c-0a28-44ab-838b-a27dbbbda051 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.711300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b00158c-0a28-44ab-838b-a27dbbbda051 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.729009 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-1b00158c-0a28-44ab-838b-a27dbbbda051 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1b00158c-0a28-44ab-838b-a27dbbbda051 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add HTTP/1.1 Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:16.731636 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:16.732945 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:16.732945 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.732945 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.732945 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.732945 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.732945 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:16.732945 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:16.732945 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:16.732945 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.732945 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:28:16.732945 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:28:16.732945 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '3a52dba4-8897-442b-b15f-4d3185f02add'} Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:16.733716 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:28:16.734884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.736023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1b00158c-0a28-44ab-838b-a27dbbbda051 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:16.736023 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1b00158c-0a28-44ab-838b-a27dbbbda051 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 404 len: 111 microversion: 2.1 time: 0.055028 Oct 18 13:28:16.738492 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1471/2778] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:16 2022] DELETE /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:16.749593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c299216-1f53-4b9a-a821-bdcff38cf196 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.751366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2c299216-1f53-4b9a-a821-bdcff38cf196 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 3a52dba4-8897-442b-b15f-4d3185f02add] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.765447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c299216-1f53-4b9a-a821-bdcff38cf196 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.766146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c299216-1f53-4b9a-a821-bdcff38cf196 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.768326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c299216-1f53-4b9a-a821-bdcff38cf196 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.772873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c299216-1f53-4b9a-a821-bdcff38cf196 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.774275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c299216-1f53-4b9a-a821-bdcff38cf196 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.780153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c299216-1f53-4b9a-a821-bdcff38cf196 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.808441 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-2c299216-1f53-4b9a-a821-bdcff38cf196 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c299216-1f53-4b9a-a821-bdcff38cf196 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add HTTP/1.1 Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:16.814095 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:16.815479 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:16.815479 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.815479 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.815479 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.815479 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.815479 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:16.815479 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:16.815479 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:16.815479 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.815479 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:28:16.815479 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:28:16.815479 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '3a52dba4-8897-442b-b15f-4d3185f02add'} Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:16.816177 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. Oct 18 13:28:16.817349 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.822724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c299216-1f53-4b9a-a821-bdcff38cf196 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance 3a52dba4-8897-442b-b15f-4d3185f02add could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:16.823814 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2c299216-1f53-4b9a-a821-bdcff38cf196 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add" status: 404 len: 111 microversion: 2.1 time: 0.084066 Oct 18 13:28:16.825552 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1472/2779] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:16 2022] GET /compute/v2.1/servers/3a52dba4-8897-442b-b15f-4d3185f02add => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:16.845640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f50da08f-06e6-4a38-9275-b7bbdfabdcd4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.849358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f50da08f-06e6-4a38-9275-b7bbdfabdcd4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.856102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f50da08f-06e6-4a38-9275-b7bbdfabdcd4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.856644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f50da08f-06e6-4a38-9275-b7bbdfabdcd4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.857085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f50da08f-06e6-4a38-9275-b7bbdfabdcd4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.857933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f50da08f-06e6-4a38-9275-b7bbdfabdcd4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.858469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f50da08f-06e6-4a38-9275-b7bbdfabdcd4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.858885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f50da08f-06e6-4a38-9275-b7bbdfabdcd4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.897003 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-f50da08f-06e6-4a38-9275-b7bbdfabdcd4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f50da08f-06e6-4a38-9275-b7bbdfabdcd4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d HTTP/1.1 Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:16.898926 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:16.900250 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:16.900250 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.900250 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.900250 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.900250 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.900250 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:16.900250 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:16.900250 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:16.900250 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.900250 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:28:16.900250 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:28:16.900250 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '6a4247ab-8099-4faa-9d6b-beabeeb98e0d'} Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:16.904258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:28:16.905452 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.906586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f50da08f-06e6-4a38-9275-b7bbdfabdcd4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:16.906586 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f50da08f-06e6-4a38-9275-b7bbdfabdcd4 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 404 len: 111 microversion: 2.1 time: 0.066707 Oct 18 13:28:16.906586 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1473/2780] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:16 2022] DELETE /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:16.909520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cfbf2a9a-1666-484d-b80d-c26b3031d600 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.911590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cfbf2a9a-1666-484d-b80d-c26b3031d600 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 6a4247ab-8099-4faa-9d6b-beabeeb98e0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.932025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfbf2a9a-1666-484d-b80d-c26b3031d600 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.932784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfbf2a9a-1666-484d-b80d-c26b3031d600 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.932991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfbf2a9a-1666-484d-b80d-c26b3031d600 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.933711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfbf2a9a-1666-484d-b80d-c26b3031d600 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.934456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfbf2a9a-1666-484d-b80d-c26b3031d600 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.934714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfbf2a9a-1666-484d-b80d-c26b3031d600 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.952297 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-cfbf2a9a-1666-484d-b80d-c26b3031d600 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cfbf2a9a-1666-484d-b80d-c26b3031d600 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d HTTP/1.1 Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:16.953814 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:16.955124 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:16.955124 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.955124 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.955124 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.955124 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.955124 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:16.955124 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:16.955124 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:16.955124 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.955124 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:28:16.955124 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:28:16.955124 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '6a4247ab-8099-4faa-9d6b-beabeeb98e0d'} Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:16.955824 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. Oct 18 13:28:16.956966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.961549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cfbf2a9a-1666-484d-b80d-c26b3031d600 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance 6a4247ab-8099-4faa-9d6b-beabeeb98e0d could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:16.961549 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cfbf2a9a-1666-484d-b80d-c26b3031d600 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d" status: 404 len: 111 microversion: 2.1 time: 0.050487 Oct 18 13:28:16.961549 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1474/2781] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:16 2022] GET /compute/v2.1/servers/6a4247ab-8099-4faa-9d6b-beabeeb98e0d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:16.965602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-12024c89-566b-4b06-878c-3ad9a7a24886 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:16.966225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-12024c89-566b-4b06-878c-3ad9a7a24886 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:16.972747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12024c89-566b-4b06-878c-3ad9a7a24886 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.973436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12024c89-566b-4b06-878c-3ad9a7a24886 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.973992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12024c89-566b-4b06-878c-3ad9a7a24886 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.974851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12024c89-566b-4b06-878c-3ad9a7a24886 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:16.975809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12024c89-566b-4b06-878c-3ad9a7a24886 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:16.976453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12024c89-566b-4b06-878c-3ad9a7a24886 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:16.991932 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-12024c89-566b-4b06-878c-3ad9a7a24886 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-12024c89-566b-4b06-878c-3ad9a7a24886 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 HTTP/1.1 Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:16.993910 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:16.995233 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:16.995233 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.995233 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:16.995233 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:16.995233 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.995233 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:16.995233 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:16.995233 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:16.995233 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:16.995233 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:28:16.995233 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:28:16.995233 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1'} Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:16.995983 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:28:16.997146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:17.000629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-12024c89-566b-4b06-878c-3ad9a7a24886 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:17.001813 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-12024c89-566b-4b06-878c-3ad9a7a24886 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1" status: 404 len: 111 microversion: 2.1 time: 0.040711 Oct 18 13:28:17.006943 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1475/2782] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:16 2022] DELETE /compute/v2.1/servers/02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:17.018715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-502c9afb-17e5-40e6-b208-430a9e3ff506 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:17.019343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-502c9afb-17e5-40e6-b208-430a9e3ff506 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:17.030462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-502c9afb-17e5-40e6-b208-430a9e3ff506 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:17.031299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-502c9afb-17e5-40e6-b208-430a9e3ff506 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:17.031989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-502c9afb-17e5-40e6-b208-430a9e3ff506 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:17.033620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-502c9afb-17e5-40e6-b208-430a9e3ff506 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:17.034408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-502c9afb-17e5-40e6-b208-430a9e3ff506 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:17.035290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-502c9afb-17e5-40e6-b208-430a9e3ff506 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:17.055360 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-502c9afb-17e5-40e6-b208-430a9e3ff506 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-502c9afb-17e5-40e6-b208-430a9e3ff506 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 HTTP/1.1 Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:17.057253 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:17.058600 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:17.058600 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:17.058600 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:17.058600 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:17.058600 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:17.058600 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:17.058600 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:17.058600 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:17.058600 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:17.058600 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:28:17.058600 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:28:17.058600 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1'} Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:17.059325 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. Oct 18 13:28:17.060566 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:17.063271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-502c9afb-17e5-40e6-b208-430a9e3ff506 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance 02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:17.067179 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-502c9afb-17e5-40e6-b208-430a9e3ff506 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1" status: 404 len: 111 microversion: 2.1 time: 0.057575 Oct 18 13:28:17.068360 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1476/2783] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:17 2022] GET /compute/v2.1/servers/02fc0ec2-c2ea-487b-9c66-c8c8d39bccb1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:17.244589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:17.245192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:17.245519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:17.245931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:17.246543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:17.342875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:17.343690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:17.344355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:17.345423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:17.347196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:17.347890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:17.371124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:17.379036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:17.394899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Going to run 2 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:28:17.399004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:17.501608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120612) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 18 13:28:17.558803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:17.578029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:17.641172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:17.671479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:17.683459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:17.763141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:17.934728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:17.954618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:18.020541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:18.027676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:18.086098 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e488a34f-94fe-4719-8acb-146cd018f1a5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.476437 Oct 18 13:28:18.093494 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1308/2784] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:28:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 1485 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:28:18.094074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6ecbff74-8f3a-4eff-8dd4-c3120c280ef2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:18.099715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ecbff74-8f3a-4eff-8dd4-c3120c280ef2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:18.112006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6ecbff74-8f3a-4eff-8dd4-c3120c280ef2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Searching by: {'deleted': False, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:28:18.167004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ecbff74-8f3a-4eff-8dd4-c3120c280ef2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:18.179216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ecbff74-8f3a-4eff-8dd4-c3120c280ef2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:18.180621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ecbff74-8f3a-4eff-8dd4-c3120c280ef2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:18.182755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ecbff74-8f3a-4eff-8dd4-c3120c280ef2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:18.183934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ecbff74-8f3a-4eff-8dd4-c3120c280ef2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:18.185027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ecbff74-8f3a-4eff-8dd4-c3120c280ef2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:18.358128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-6ecbff74-8f3a-4eff-8dd4-c3120c280ef2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:28:18.428906 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6ecbff74-8f3a-4eff-8dd4-c3120c280ef2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.338660 Oct 18 13:28:18.430422 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1477/2785] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 13:28:18 2022] GET /compute/v2.1/servers => generated 1002 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:18.445332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5a8aecb6-e151-40b5-8976-682a629ac433 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:18.446553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5a8aecb6-e151-40b5-8976-682a629ac433 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:18.570217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5a8aecb6-e151-40b5-8976-682a629ac433 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:18.581164 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5a8aecb6-e151-40b5-8976-682a629ac433 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1218 microversion: 2.1 time: 0.141099 Oct 18 13:28:18.583336 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1309/2786] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:18 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:19.612413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba2e96ed-eb29-4304-a1c7-de3245428620 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:19.613056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ba2e96ed-eb29-4304-a1c7-de3245428620 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:19.634363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba2e96ed-eb29-4304-a1c7-de3245428620 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:19.634861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba2e96ed-eb29-4304-a1c7-de3245428620 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:19.635299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba2e96ed-eb29-4304-a1c7-de3245428620 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:19.636016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba2e96ed-eb29-4304-a1c7-de3245428620 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:19.636471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba2e96ed-eb29-4304-a1c7-de3245428620 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:19.636919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba2e96ed-eb29-4304-a1c7-de3245428620 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:19.915453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba2e96ed-eb29-4304-a1c7-de3245428620 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:19.932229 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ba2e96ed-eb29-4304-a1c7-de3245428620 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1222 microversion: 2.1 time: 0.325614 Oct 18 13:28:19.949097 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1478/2787] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:19 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1222 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:20.870078 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3a55b47d-3222-4ba9-931c-6d7ba9d312aa tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] 10.222.0.40 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.327335 Oct 18 13:28:20.871116 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1310/2788] 10.222.0.40 () {58 vars in 1128 bytes} [Tue Oct 18 13:28:20 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 13:28:20.879911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bd62a23b-c52a-4d75-b1b3-4d491e994149 tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Calling method '.version_select at 0x7ff60ef04f70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:20.926904 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-bd62a23b-c52a-4d75-b1b3-4d491e994149 tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] HTTP exception thrown: Image not found. Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bd62a23b-c52a-4d75-b1b3-4d491e994149 tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Request method failure captured: Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqn0hKjItE-1jvq380JoziBtHKPRw6wfqA_2fKjgZnmQKQxG9TdlQ16q_XQrC5ytpYnfb_VFbw_2TmLFWICU5MeO8DihOxp0hC7TmOJGGHiZJfS5pQdIGXcSysXkNnBrUr9PY9kLeQTsJ1Y6Xhp8riYTOAOORTNq-u26tJKa8TDjfkA Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 38368deeac2f430f9a241f0535fc9501 Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:20.929376 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_38368deeac2f430f9a241f0535fc9501"}]}] Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 38368deeac2f430f9a241f0535fc9501 Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ImagesDeleteNegativeTestJSON-698695909-project Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7387f8a65f1d43dfa63ac9dd3ccead4b Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-698695909-project Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: exception: Image not found. Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '-1'} Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:20.931209 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.932253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:20.933559 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:28:20.934960 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:28:20.934960 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:28:20.934960 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.934960 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:20.934960 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.934960 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:20.934960 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:20.934960 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:20.934960 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:20.934960 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:20.934960 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:28:20.934960 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.937811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bd62a23b-c52a-4d75-b1b3-4d491e994149 tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Returning 404 to user: Image not found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:20.938707 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bd62a23b-c52a-4d75-b1b3-4d491e994149 tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] 10.222.0.40 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.062637 Oct 18 13:28:20.939272 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1479/2789] 10.222.0.40 () {58 vars in 1134 bytes} [Tue Oct 18 13:28:20 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:28:20.951809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6cb90aaa-ee9d-4799-a107-3b69b4e3538a tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Calling method '.version_select at 0x7ff60ee4d280>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:20.965767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-209be262-2629-4fa2-9ad3-9cc534c4a31c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:20.969978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-209be262-2629-4fa2-9ad3-9cc534c4a31c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:20.985736 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-6cb90aaa-ee9d-4799-a107-3b69b4e3538a tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] HTTP exception thrown: Image not found. Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6cb90aaa-ee9d-4799-a107-3b69b4e3538a tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Request method failure captured: Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/images/eef120f1-7eec-4538-a14a-7963b54df58j HTTP/1.1 Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqn0hKjItE-1jvq380JoziBtHKPRw6wfqA_2fKjgZnmQKQxG9TdlQ16q_XQrC5ytpYnfb_VFbw_2TmLFWICU5MeO8DihOxp0hC7TmOJGGHiZJfS5pQdIGXcSysXkNnBrUr9PY9kLeQTsJ1Y6Xhp8riYTOAOORTNq-u26tJKa8TDjfkA Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 38368deeac2f430f9a241f0535fc9501 Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:20.989611 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:20.991385 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_38368deeac2f430f9a241f0535fc9501"}]}] Oct 18 13:28:20.991385 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:20.991385 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 38368deeac2f430f9a241f0535fc9501 Oct 18 13:28:20.991385 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:20.991385 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesDeleteNegativeTestJSON-698695909-project Oct 18 13:28:20.991385 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:20.991385 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:20.991385 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7387f8a65f1d43dfa63ac9dd3ccead4b Oct 18 13:28:20.991385 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-698695909-project Oct 18 13:28:20.991385 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:20.991385 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:28:20.991385 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'eef120f1-7eec-4538-a14a-7963b54df58j'} Oct 18 13:28:20.991385 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eef120f1-7eec-4538-a14a-7963b54df58j to delete Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:20.992315 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eef120f1-7eec-4538-a14a-7963b54df58j could not be found. Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:20.993457 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6cb90aaa-ee9d-4799-a107-3b69b4e3538a tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:20.994751 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6cb90aaa-ee9d-4799-a107-3b69b4e3538a tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] 10.222.0.40 "DELETE /compute/v2.1/images/eef120f1-7eec-4538-a14a-7963b54df58j" status: 404 len: 62 microversion: 2.1 time: 0.046721 Oct 18 13:28:20.996226 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1311/2790] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:20 2022] DELETE /compute/v2.1/images/eef120f1-7eec-4538-a14a-7963b54df58j => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:28:20.998263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-209be262-2629-4fa2-9ad3-9cc534c4a31c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:20.998758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-209be262-2629-4fa2-9ad3-9cc534c4a31c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:20.999195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-209be262-2629-4fa2-9ad3-9cc534c4a31c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:21.009439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-209be262-2629-4fa2-9ad3-9cc534c4a31c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:21.014861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-209be262-2629-4fa2-9ad3-9cc534c4a31c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:21.015655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-209be262-2629-4fa2-9ad3-9cc534c4a31c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:21.020010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8bb6416e-967d-46d4-a328-cf403b95f82e tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Calling method '.version_select at 0x7ff60f5ea4c0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:21.058826 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-8bb6416e-967d-46d4-a328-cf403b95f82e tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] HTTP exception thrown: Image not found. Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8bb6416e-967d-46d4-a328-cf403b95f82e tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Request method failure captured: Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/images/ae9351b2-7775-40fb-bfe6-3c069aadea661 HTTP/1.1 Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqn0hKjItE-1jvq380JoziBtHKPRw6wfqA_2fKjgZnmQKQxG9TdlQ16q_XQrC5ytpYnfb_VFbw_2TmLFWICU5MeO8DihOxp0hC7TmOJGGHiZJfS5pQdIGXcSysXkNnBrUr9PY9kLeQTsJ1Y6Xhp8riYTOAOORTNq-u26tJKa8TDjfkA Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 38368deeac2f430f9a241f0535fc9501 Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:21.061050 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:21.062441 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_38368deeac2f430f9a241f0535fc9501"}]}] Oct 18 13:28:21.062441 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:21.062441 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 38368deeac2f430f9a241f0535fc9501 Oct 18 13:28:21.062441 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:21.062441 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesDeleteNegativeTestJSON-698695909-project Oct 18 13:28:21.062441 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:21.062441 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:21.062441 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7387f8a65f1d43dfa63ac9dd3ccead4b Oct 18 13:28:21.062441 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-698695909-project Oct 18 13:28:21.062441 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:21.062441 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:28:21.062441 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'ae9351b2-7775-40fb-bfe6-3c069aadea661'} Oct 18 13:28:21.062441 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ae9351b2-7775-40fb-bfe6-3c069aadea661 to delete Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:21.063181 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae9351b2-7775-40fb-bfe6-3c069aadea661 could not be found. Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:21.064243 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8bb6416e-967d-46d4-a328-cf403b95f82e tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:21.068083 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8bb6416e-967d-46d4-a328-cf403b95f82e tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] 10.222.0.40 "DELETE /compute/v2.1/images/ae9351b2-7775-40fb-bfe6-3c069aadea661" status: 404 len: 62 microversion: 2.1 time: 0.065870 Oct 18 13:28:21.073076 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1312/2791] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:21 2022] DELETE /compute/v2.1/images/ae9351b2-7775-40fb-bfe6-3c069aadea661 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:28:21.088014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-609de41e-1317-4f53-916e-b3f033ef9b7d tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Calling method '.version_select at 0x7ff60eeb81f0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:21.136164 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-609de41e-1317-4f53-916e-b3f033ef9b7d tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] HTTP exception thrown: Image not found. Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-609de41e-1317-4f53-916e-b3f033ef9b7d tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Request method failure captured: Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/images/tempest-invalid-653606216 HTTP/1.1 Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqn0hKjItE-1jvq380JoziBtHKPRw6wfqA_2fKjgZnmQKQxG9TdlQ16q_XQrC5ytpYnfb_VFbw_2TmLFWICU5MeO8DihOxp0hC7TmOJGGHiZJfS5pQdIGXcSysXkNnBrUr9PY9kLeQTsJ1Y6Xhp8riYTOAOORTNq-u26tJKa8TDjfkA Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 38368deeac2f430f9a241f0535fc9501 Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:21.153601 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:21.155104 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_38368deeac2f430f9a241f0535fc9501"}]}] Oct 18 13:28:21.155104 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:21.155104 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 38368deeac2f430f9a241f0535fc9501 Oct 18 13:28:21.155104 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:21.155104 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesDeleteNegativeTestJSON-698695909-project Oct 18 13:28:21.155104 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:21.155104 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:21.155104 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7387f8a65f1d43dfa63ac9dd3ccead4b Oct 18 13:28:21.155104 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-698695909-project Oct 18 13:28:21.155104 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:21.155104 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:28:21.155104 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'tempest-invalid-653606216'} Oct 18 13:28:21.155104 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-653606216 to delete Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:21.156217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-653606216 could not be found. Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:21.158044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.161027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-609de41e-1317-4f53-916e-b3f033ef9b7d tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:21.165372 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-609de41e-1317-4f53-916e-b3f033ef9b7d tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] 10.222.0.40 "DELETE /compute/v2.1/images/tempest-invalid-653606216" status: 404 len: 62 microversion: 2.1 time: 0.086477 Oct 18 13:28:21.166099 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1313/2792] 10.222.0.40 () {58 vars in 1203 bytes} [Tue Oct 18 13:28:21 2022] DELETE /compute/v2.1/images/tempest-invalid-653606216 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:28:21.187113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-209be262-2629-4fa2-9ad3-9cc534c4a31c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:21.201959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-adb7aeaf-4a83-4485-8ff1-660ded990d6e tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Calling method '.version_select at 0x7ff60f05faf0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:21.208260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:21.215173 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-209be262-2629-4fa2-9ad3-9cc534c4a31c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1270 microversion: 2.1 time: 0.253530 Oct 18 13:28:21.215765 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1480/2793] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:20 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1270 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:21.266285 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-adb7aeaf-4a83-4485-8ff1-660ded990d6e tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] HTTP exception thrown: Image not found. Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-adb7aeaf-4a83-4485-8ff1-660ded990d6e tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Request method failure captured: Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/images/976f9db4-3189-4f41-8a2a-20afe32da3eb HTTP/1.1 Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqn0hKjItE-1jvq380JoziBtHKPRw6wfqA_2fKjgZnmQKQxG9TdlQ16q_XQrC5ytpYnfb_VFbw_2TmLFWICU5MeO8DihOxp0hC7TmOJGGHiZJfS5pQdIGXcSysXkNnBrUr9PY9kLeQTsJ1Y6Xhp8riYTOAOORTNq-u26tJKa8TDjfkA Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 38368deeac2f430f9a241f0535fc9501 Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:21.270942 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:21.272897 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38368deeac2f430f9a241f0535fc9501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_38368deeac2f430f9a241f0535fc9501"}]}] Oct 18 13:28:21.272897 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:21.272897 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 38368deeac2f430f9a241f0535fc9501 Oct 18 13:28:21.272897 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-698695909 Oct 18 13:28:21.272897 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ImagesDeleteNegativeTestJSON-698695909-project Oct 18 13:28:21.272897 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:21.272897 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:21.272897 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7387f8a65f1d43dfa63ac9dd3ccead4b Oct 18 13:28:21.272897 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-698695909-project Oct 18 13:28:21.272897 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:21.272897 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:28:21.272897 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '976f9db4-3189-4f41-8a2a-20afe32da3eb'} Oct 18 13:28:21.272897 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 976f9db4-3189-4f41-8a2a-20afe32da3eb to delete Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:21.273797 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 976f9db4-3189-4f41-8a2a-20afe32da3eb could not be found. Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:21.274957 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-adb7aeaf-4a83-4485-8ff1-660ded990d6e tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:21.276127 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-adb7aeaf-4a83-4485-8ff1-660ded990d6e tempest-ImagesDeleteNegativeTestJSON-698695909 tempest-ImagesDeleteNegativeTestJSON-698695909-project] 10.222.0.40 "DELETE /compute/v2.1/images/976f9db4-3189-4f41-8a2a-20afe32da3eb" status: 404 len: 62 microversion: 2.1 time: 0.102230 Oct 18 13:28:21.279052 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1314/2794] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:21 2022] DELETE /compute/v2.1/images/976f9db4-3189-4f41-8a2a-20afe32da3eb => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:28:22.246632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c17523b9-a36a-4f2e-b724-14547fd70750 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:22.247868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c17523b9-a36a-4f2e-b724-14547fd70750 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:22.276495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c17523b9-a36a-4f2e-b724-14547fd70750 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.282481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c17523b9-a36a-4f2e-b724-14547fd70750 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.283288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c17523b9-a36a-4f2e-b724-14547fd70750 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.290842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c17523b9-a36a-4f2e-b724-14547fd70750 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.291688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c17523b9-a36a-4f2e-b724-14547fd70750 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.292364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c17523b9-a36a-4f2e-b724-14547fd70750 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.520260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c17523b9-a36a-4f2e-b724-14547fd70750 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:22.548601 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c17523b9-a36a-4f2e-b724-14547fd70750 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1276 microversion: 2.1 time: 0.308316 Oct 18 13:28:22.549831 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1481/2795] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:22 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1276 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:22.801781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7a6ffd56-4f8a-4794-8446-8e071437924c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:22.802479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7a6ffd56-4f8a-4794-8446-8e071437924c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:22.820730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a6ffd56-4f8a-4794-8446-8e071437924c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.821570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a6ffd56-4f8a-4794-8446-8e071437924c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.822127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a6ffd56-4f8a-4794-8446-8e071437924c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.822940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a6ffd56-4f8a-4794-8446-8e071437924c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.823641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a6ffd56-4f8a-4794-8446-8e071437924c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.824289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a6ffd56-4f8a-4794-8446-8e071437924c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.863673 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-7a6ffd56-4f8a-4794-8446-8e071437924c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7a6ffd56-4f8a-4794-8446-8e071437924c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 HTTP/1.1 Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:22.866577 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:22.868764 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:22.868764 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:22.868764 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:22.868764 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:22.868764 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:22.868764 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:22.868764 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:22.868764 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:22.868764 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:22.868764 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:28:22.868764 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:28:22.868764 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'b0e67b4b-fc1a-4c86-80bc-afaddef3d664'} Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:22.869728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:28:22.871752 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:22.875146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7a6ffd56-4f8a-4794-8446-8e071437924c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:22.877119 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7a6ffd56-4f8a-4794-8446-8e071437924c tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 404 len: 111 microversion: 2.1 time: 0.078426 Oct 18 13:28:22.899274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d287d3a2-f920-46a1-812c-bbe5c5a95b07 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:22.899892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d287d3a2-f920-46a1-812c-bbe5c5a95b07 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: b0e67b4b-fc1a-4c86-80bc-afaddef3d664] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:22.908429 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1315/2796] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:22 2022] DELETE /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:22.914247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d287d3a2-f920-46a1-812c-bbe5c5a95b07 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.914761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d287d3a2-f920-46a1-812c-bbe5c5a95b07 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.917483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d287d3a2-f920-46a1-812c-bbe5c5a95b07 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.919655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d287d3a2-f920-46a1-812c-bbe5c5a95b07 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.920380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d287d3a2-f920-46a1-812c-bbe5c5a95b07 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.922241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d287d3a2-f920-46a1-812c-bbe5c5a95b07 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.939226 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-d287d3a2-f920-46a1-812c-bbe5c5a95b07 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d287d3a2-f920-46a1-812c-bbe5c5a95b07 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 HTTP/1.1 Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:22.941025 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:22.942579 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:22.942579 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:22.942579 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:22.942579 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:22.942579 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:22.942579 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:22.942579 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:22.942579 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:22.942579 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:22.942579 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:28:22.942579 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:28:22.942579 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'b0e67b4b-fc1a-4c86-80bc-afaddef3d664'} Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:22.943429 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. Oct 18 13:28:22.945571 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:22.947492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d287d3a2-f920-46a1-812c-bbe5c5a95b07 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance b0e67b4b-fc1a-4c86-80bc-afaddef3d664 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:22.948507 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d287d3a2-f920-46a1-812c-bbe5c5a95b07 tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664" status: 404 len: 111 microversion: 2.1 time: 0.065652 Oct 18 13:28:22.949575 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1482/2797] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:22 2022] GET /compute/v2.1/servers/b0e67b4b-fc1a-4c86-80bc-afaddef3d664 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:22.960637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-429a0f33-69e1-43ed-9ee8-835f125f409a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:22.962261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-429a0f33-69e1-43ed-9ee8-835f125f409a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:22.974664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-429a0f33-69e1-43ed-9ee8-835f125f409a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.976027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-429a0f33-69e1-43ed-9ee8-835f125f409a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.978195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-429a0f33-69e1-43ed-9ee8-835f125f409a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:22.979366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-429a0f33-69e1-43ed-9ee8-835f125f409a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:22.980097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-429a0f33-69e1-43ed-9ee8-835f125f409a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:22.981582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-429a0f33-69e1-43ed-9ee8-835f125f409a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:23.000494 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-429a0f33-69e1-43ed-9ee8-835f125f409a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-429a0f33-69e1-43ed-9ee8-835f125f409a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 HTTP/1.1 Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:23.003695 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:23.005168 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:23.005168 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:23.005168 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:23.005168 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:23.005168 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:23.005168 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:23.005168 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:23.005168 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:23.005168 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:23.005168 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:28:23.005168 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:28:23.005168 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'ee65c386-9550-4e41-99e6-509acdb08f70'} Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:23.006730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:28:23.008225 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:23.010857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-429a0f33-69e1-43ed-9ee8-835f125f409a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:23.010857 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-429a0f33-69e1-43ed-9ee8-835f125f409a tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 404 len: 111 microversion: 2.1 time: 0.052732 Oct 18 13:28:23.010857 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1316/2798] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:22 2022] DELETE /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:23.016461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-433cbcda-410e-43a9-b571-e7cc15d2654f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:23.017105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-433cbcda-410e-43a9-b571-e7cc15d2654f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] [instance: ee65c386-9550-4e41-99e6-509acdb08f70] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:23.024091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-433cbcda-410e-43a9-b571-e7cc15d2654f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:23.024632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-433cbcda-410e-43a9-b571-e7cc15d2654f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:23.025758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-433cbcda-410e-43a9-b571-e7cc15d2654f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:23.026603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-433cbcda-410e-43a9-b571-e7cc15d2654f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:23.027144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-433cbcda-410e-43a9-b571-e7cc15d2654f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:23.027653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-433cbcda-410e-43a9-b571-e7cc15d2654f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:23.043389 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-433cbcda-410e-43a9-b571-e7cc15d2654f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] HTTP exception thrown: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-433cbcda-410e-43a9-b571-e7cc15d2654f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Request method failure captured: Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 HTTP/1.1 Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqincO5I9x5ZRLHZJTCDjRE2ZjyND55j-Sxld0wOEUo2k9IxNaSt31-E0bKyC3LgIFoYxgArjyP3yFgdI4Txln2HVWI1ztWJz5FcfS1TpZshCjri3-yaVs1zjoh7nsD84WksVngYYwwCUTWrGfVUPapfVUHTHmfw4RS4bWGv4brdAlQ Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:23.044929 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:23.046253 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7b096c3406ce42d380811b170798afcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7b096c3406ce42d380811b170798afcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7b096c3406ce42d380811b170798afcd"}]}] Oct 18 13:28:23.046253 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:23.046253 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 7b096c3406ce42d380811b170798afcd Oct 18 13:28:23.046253 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255104152 Oct 18 13:28:23.046253 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:23.046253 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:23.046253 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:23.046253 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c0a722d1dc7c4e05b8cc8dc98b5cb619 Oct 18 13:28:23.046253 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-1255104152-project Oct 18 13:28:23.046253 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:28:23.046253 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:28:23.046253 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'ee65c386-9550-4e41-99e6-509acdb08f70'} Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:23.046962 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. Oct 18 13:28:23.048146 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:23.049208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-433cbcda-410e-43a9-b571-e7cc15d2654f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] Returning 404 to user: Instance ee65c386-9550-4e41-99e6-509acdb08f70 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:23.049208 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-433cbcda-410e-43a9-b571-e7cc15d2654f tempest-DeleteServersTestJSON-1255104152 tempest-DeleteServersTestJSON-1255104152-project] 10.222.0.40 "GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70" status: 404 len: 111 microversion: 2.1 time: 0.034323 Oct 18 13:28:23.049208 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1483/2799] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:23 2022] GET /compute/v2.1/servers/ee65c386-9550-4e41-99e6-509acdb08f70 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:23.573531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f454e1e7-aa15-4f11-8122-513ff594ad1e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:23.574121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f454e1e7-aa15-4f11-8122-513ff594ad1e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:23.586828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f454e1e7-aa15-4f11-8122-513ff594ad1e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:23.587305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f454e1e7-aa15-4f11-8122-513ff594ad1e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:23.587750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f454e1e7-aa15-4f11-8122-513ff594ad1e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:23.592237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f454e1e7-aa15-4f11-8122-513ff594ad1e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:23.593916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f454e1e7-aa15-4f11-8122-513ff594ad1e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:23.594557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f454e1e7-aa15-4f11-8122-513ff594ad1e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:23.846780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f454e1e7-aa15-4f11-8122-513ff594ad1e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:23.864226 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f454e1e7-aa15-4f11-8122-513ff594ad1e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1276 microversion: 2.1 time: 0.295947 Oct 18 13:28:23.864829 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1317/2800] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:23 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:24.892387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b4d86d95-e286-432f-be0f-c6d31ebb57ff tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:24.894869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b4d86d95-e286-432f-be0f-c6d31ebb57ff tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:24.921047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4d86d95-e286-432f-be0f-c6d31ebb57ff tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:24.922374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4d86d95-e286-432f-be0f-c6d31ebb57ff tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:24.926215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4d86d95-e286-432f-be0f-c6d31ebb57ff tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:24.929612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4d86d95-e286-432f-be0f-c6d31ebb57ff tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:24.930378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4d86d95-e286-432f-be0f-c6d31ebb57ff tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:24.931376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4d86d95-e286-432f-be0f-c6d31ebb57ff tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:25.524980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b4d86d95-e286-432f-be0f-c6d31ebb57ff tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:25.539401 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b4d86d95-e286-432f-be0f-c6d31ebb57ff tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1318 microversion: 2.1 time: 0.649225 Oct 18 13:28:25.543143 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1484/2801] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:24 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:25.589561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9739c443-28a6-4102-b4ee-abf8f7a8196a req-47db9e7e-218f-46ec-8d9e-1069730db680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d", "tag": "ab7dce51-8cfe-4a35-8cb3-d897b4b3c6ba"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:25.623924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9739c443-28a6-4102-b4ee-abf8f7a8196a req-47db9e7e-218f-46ec-8d9e-1069730db680 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:25.624641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9739c443-28a6-4102-b4ee-abf8f7a8196a req-47db9e7e-218f-46ec-8d9e-1069730db680 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:25.626852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9739c443-28a6-4102-b4ee-abf8f7a8196a req-47db9e7e-218f-46ec-8d9e-1069730db680 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:25.656589 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9739c443-28a6-4102-b4ee-abf8f7a8196a req-47db9e7e-218f-46ec-8d9e-1069730db680 service nova] Creating event network-changed:ab7dce51-8cfe-4a35-8cb3-d897b4b3c6ba for instance a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d on n-h1-858384-13 Oct 18 13:28:25.670502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cae4e5be-ced5-4d72-8d14-81b21f103f91 tempest-ListImageFiltersNegativeTestJSON-1167636718 tempest-ListImageFiltersNegativeTestJSON-1167636718-project] Calling method '.version_select at 0x7ff60f683af0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:25.681320 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9739c443-28a6-4102-b4ee-abf8f7a8196a req-47db9e7e-218f-46ec-8d9e-1069730db680 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079874 Oct 18 13:28:25.682269 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1485/2802] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:28:25.708607 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-cae4e5be-ced5-4d72-8d14-81b21f103f91 tempest-ListImageFiltersNegativeTestJSON-1167636718 tempest-ListImageFiltersNegativeTestJSON-1167636718-project] HTTP exception thrown: Image not found. Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cae4e5be-ced5-4d72-8d14-81b21f103f91 tempest-ListImageFiltersNegativeTestJSON-1167636718 tempest-ListImageFiltersNegativeTestJSON-1167636718-project] Request method failure captured: Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/images/02426489-1f48-42f2-ac15-75d184721ed3 HTTP/1.1 Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqn4MweXzoobf8OYfrAfAsDbVx9kbIzXRzbHprZ5AltsN-ZhLRymRNBUlrANt03_leAMy52XPeI7y-Xgcg8F3yNfERIIHrwMy5BTrErxUS9jToq_EimN5Vol4hsKZuN_CXJpcdSUDVmLezBqyPBLzEwS7PQ39AdovpQtjVY-UQwLJS0 Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: e4f02e57f56a45b79a78ef1e173292f0 Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1167636718 Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:25.712096 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:25.714270 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4f02e57f56a45b79a78ef1e173292f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4f02e57f56a45b79a78ef1e173292f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4f02e57f56a45b79a78ef1e173292f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4f02e57f56a45b79a78ef1e173292f0"}]}] Oct 18 13:28:25.714270 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1167636718 Oct 18 13:28:25.714270 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: e4f02e57f56a45b79a78ef1e173292f0 Oct 18 13:28:25.714270 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1167636718 Oct 18 13:28:25.714270 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ListImageFiltersNegativeTestJSON-1167636718-project Oct 18 13:28:25.714270 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:25.714270 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:25.714270 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 3eed5b6287d04cffaaf360990e85348e Oct 18 13:28:25.714270 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1167636718-project Oct 18 13:28:25.714270 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:25.714270 n-d-858384-13 devstack@n-api.service[120612]: exception: Image not found. Oct 18 13:28:25.714270 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '02426489-1f48-42f2-ac15-75d184721ed3'} Oct 18 13:28:25.714270 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:28:25.715186 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 02426489-1f48-42f2-ac15-75d184721ed3 Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 18 13:28:25.716939 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 02426489-1f48-42f2-ac15-75d184721ed3 could not be found. Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:25.718600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 18 13:28:25.720226 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:25.721678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cae4e5be-ced5-4d72-8d14-81b21f103f91 tempest-ListImageFiltersNegativeTestJSON-1167636718 tempest-ListImageFiltersNegativeTestJSON-1167636718-project] Returning 404 to user: Image not found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:25.722684 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cae4e5be-ced5-4d72-8d14-81b21f103f91 tempest-ListImageFiltersNegativeTestJSON-1167636718 tempest-ListImageFiltersNegativeTestJSON-1167636718-project] 10.222.0.40 "GET /compute/v2.1/images/02426489-1f48-42f2-ac15-75d184721ed3" status: 404 len: 62 microversion: 2.1 time: 0.595875 Oct 18 13:28:25.727330 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1318/2803] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:25 2022] GET /compute/v2.1/images/02426489-1f48-42f2-ac15-75d184721ed3 => generated 62 bytes in 600 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:28:26.568967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-253f9fb1-5005-43ba-897b-ffd936fa93bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:26.569835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-253f9fb1-5005-43ba-897b-ffd936fa93bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:26.598927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-253f9fb1-5005-43ba-897b-ffd936fa93bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:26.600202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-253f9fb1-5005-43ba-897b-ffd936fa93bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:26.600824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-253f9fb1-5005-43ba-897b-ffd936fa93bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:26.601719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-253f9fb1-5005-43ba-897b-ffd936fa93bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:26.605552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-253f9fb1-5005-43ba-897b-ffd936fa93bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:26.606594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-253f9fb1-5005-43ba-897b-ffd936fa93bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:26.882508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3a938168-4c55-43b4-8354-b61fab8a55dd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:26.884914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3a938168-4c55-43b4-8354-b61fab8a55dd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:26.914481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a938168-4c55-43b4-8354-b61fab8a55dd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:26.915364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a938168-4c55-43b4-8354-b61fab8a55dd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:26.916395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a938168-4c55-43b4-8354-b61fab8a55dd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:26.917773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a938168-4c55-43b4-8354-b61fab8a55dd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:26.919008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a938168-4c55-43b4-8354-b61fab8a55dd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:26.919656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a938168-4c55-43b4-8354-b61fab8a55dd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:27.058781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-253f9fb1-5005-43ba-897b-ffd936fa93bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:27.121918 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-253f9fb1-5005-43ba-897b-ffd936fa93bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1318 microversion: 2.1 time: 0.557887 Oct 18 13:28:27.123384 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1486/2804] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:26 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1318 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:27.361589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:27.434432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3a938168-4c55-43b4-8354-b61fab8a55dd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:27.444470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3a938168-4c55-43b4-8354-b61fab8a55dd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:27.446670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3a938168-4c55-43b4-8354-b61fab8a55dd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:27.448159 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3a938168-4c55-43b4-8354-b61fab8a55dd tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 2950 microversion: 2.42 time: 0.578340 Oct 18 13:28:27.466460 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1319/2805] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:28:26 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 2950 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:28:27.480770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1876912b-0ae3-4f3c-9a8a-fae7df9edd36 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:27.481584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1876912b-0ae3-4f3c-9a8a-fae7df9edd36 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:27.489223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1876912b-0ae3-4f3c-9a8a-fae7df9edd36 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:27.491259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1876912b-0ae3-4f3c-9a8a-fae7df9edd36 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:27.492474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1876912b-0ae3-4f3c-9a8a-fae7df9edd36 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:27.493460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1876912b-0ae3-4f3c-9a8a-fae7df9edd36 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:27.494079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1876912b-0ae3-4f3c-9a8a-fae7df9edd36 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:27.494689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1876912b-0ae3-4f3c-9a8a-fae7df9edd36 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:27.575536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e7afbe19-ace0-4102-a0ac-c29ffb27ab46 req-813fde5c-d394-4990-9d34-1edc82e62916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d173b9-5f53-4e62-aee6-3bc9f580b8ce", "tag": "60dcc269-47e0-4c17-8be7-a1e251674cf8"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:27.591189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e7afbe19-ace0-4102-a0ac-c29ffb27ab46 req-813fde5c-d394-4990-9d34-1edc82e62916 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:27.591671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e7afbe19-ace0-4102-a0ac-c29ffb27ab46 req-813fde5c-d394-4990-9d34-1edc82e62916 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:27.597922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e7afbe19-ace0-4102-a0ac-c29ffb27ab46 req-813fde5c-d394-4990-9d34-1edc82e62916 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:27.621081 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e7afbe19-ace0-4102-a0ac-c29ffb27ab46 req-813fde5c-d394-4990-9d34-1edc82e62916 service nova] Creating event network-changed:60dcc269-47e0-4c17-8be7-a1e251674cf8 for instance 52d173b9-5f53-4e62-aee6-3bc9f580b8ce on n-h1-858384-13 Oct 18 13:28:27.643031 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e7afbe19-ace0-4102-a0ac-c29ffb27ab46 req-813fde5c-d394-4990-9d34-1edc82e62916 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072065 Oct 18 13:28:27.644180 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1320/2806] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:27.991769 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1876912b-0ae3-4f3c-9a8a-fae7df9edd36 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.517424 Oct 18 13:28:28.004552 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1487/2807] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 18 13:28:27 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567/os-interface => generated 1833 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:28:28.154508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c2b44681-f6fc-447a-a82b-03b16998e1ea tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:28.155291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c2b44681-f6fc-447a-a82b-03b16998e1ea tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:28.182807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2b44681-f6fc-447a-a82b-03b16998e1ea tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:28.183406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2b44681-f6fc-447a-a82b-03b16998e1ea tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:28.183847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2b44681-f6fc-447a-a82b-03b16998e1ea tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:28.187018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2b44681-f6fc-447a-a82b-03b16998e1ea tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:28.187713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2b44681-f6fc-447a-a82b-03b16998e1ea tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:28.189366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2b44681-f6fc-447a-a82b-03b16998e1ea tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:28.543639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c2b44681-f6fc-447a-a82b-03b16998e1ea tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:28.566583 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c2b44681-f6fc-447a-a82b-03b16998e1ea tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1318 microversion: 2.1 time: 0.420964 Oct 18 13:28:28.568116 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1321/2808] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:28 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:29.157936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:29.206307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-976243854", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f61d9dd3-2d30-4077-83fd-6cb55fe03a9c"}], "block_device_mapping_v2": [{"uuid": "5485b46f-a27e-4471-adf6-f5071e8ed828", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:29.230137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=32 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:29.339958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-087ae824-882e-4e1d-a51a-96284d948af7 tempest-ListImagesTestJSON-480996663 tempest-ListImagesTestJSON-480996663-project] Calling method '.version_select at 0x7ff60ee24430>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:29.373540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] validate_networks() for [('f61d9dd3-2d30-4077-83fd-6cb55fe03a9c', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:28:29.406264 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-087ae824-882e-4e1d-a51a-96284d948af7 tempest-ListImagesTestJSON-480996663 tempest-ListImagesTestJSON-480996663-project] 10.222.0.40 "GET /compute/v2.1/images/c5f2027d-2f76-420c-95a8-7bb70182af23" status: 200 len: 784 microversion: 2.1 time: 0.253558 Oct 18 13:28:29.419903 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1488/2809] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:28:29 2022] GET /compute/v2.1/images/c5f2027d-2f76-420c-95a8-7bb70182af23 => generated 784 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:29.426105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-650b3a5e-e8f0-45de-acc1-37050c0eeffe tempest-ListImagesTestJSON-480996663 tempest-ListImagesTestJSON-480996663-project] Calling method '.version_select at 0x7ff60edd6d30>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:29.564874 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-650b3a5e-e8f0-45de-acc1-37050c0eeffe tempest-ListImagesTestJSON-480996663 tempest-ListImagesTestJSON-480996663-project] 10.222.0.40 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.143461 Oct 18 13:28:29.566580 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1489/2810] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Oct 18 13:28:29 2022] GET /compute/v2.1/images => generated 445 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:29.585511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b00e7454-4d19-4929-a98a-212e17f95ca9 tempest-ListImagesTestJSON-480996663 tempest-ListImagesTestJSON-480996663-project] Calling method '.version_select at 0x7ff60eef0820>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:29.668662 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b00e7454-4d19-4929-a98a-212e17f95ca9 tempest-ListImagesTestJSON-480996663 tempest-ListImagesTestJSON-480996663-project] 10.222.0.40 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.090382 Oct 18 13:28:29.669557 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1490/2811] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 18 13:28:29 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:29.731697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fb4c626f-06d8-40a5-9a79-6a8db3478cf5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:29.735021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb4c626f-06d8-40a5-9a79-6a8db3478cf5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:29.752629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb4c626f-06d8-40a5-9a79-6a8db3478cf5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:29.758471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb4c626f-06d8-40a5-9a79-6a8db3478cf5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:29.759306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb4c626f-06d8-40a5-9a79-6a8db3478cf5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:29.760657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb4c626f-06d8-40a5-9a79-6a8db3478cf5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:29.772929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb4c626f-06d8-40a5-9a79-6a8db3478cf5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:29.773687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb4c626f-06d8-40a5-9a79-6a8db3478cf5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:30.841513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fb4c626f-06d8-40a5-9a79-6a8db3478cf5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:30.852575 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fb4c626f-06d8-40a5-9a79-6a8db3478cf5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1318 microversion: 2.1 time: 1.135127 Oct 18 13:28:30.879934 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1491/2812] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:29 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1318 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:31.288924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:31.289470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:31.289903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:31.290854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:31.291248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:31.302754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:31.304043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:31.304919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:31.306694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:31.307159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:31.307590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:31.330917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Getting quotas for project cf7c744c508342f5947ae08743ccc6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:31.337757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Getting quotas for user 2b3d9555419845cc9bc9f650e676d776 and project cf7c744c508342f5947ae08743ccc6c7. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:31.449313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:28:31.451444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5485b46f-a27e-4471-adf6-f5071e8ed828',volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:31.744831 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c6c0b32f-d8cf-4a21-84d3-50ac3bd2c251 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.543198 Oct 18 13:28:31.753116 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1322/2813] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:28:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:28:31.761126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2b008ad6-244e-42a9-816f-5886829f9740 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:31.761772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2b008ad6-244e-42a9-816f-5886829f9740 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:31.776451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:31.898820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2b008ad6-244e-42a9-816f-5886829f9740 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:31.908106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0732ead0-a50f-4565-8112-b9bd7c4f7c42 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:31.908334 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2b008ad6-244e-42a9-816f-5886829f9740 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1052 microversion: 2.1 time: 0.154439 Oct 18 13:28:31.922223 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1492/2814] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:31 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1052 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:31.931043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0732ead0-a50f-4565-8112-b9bd7c4f7c42 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:31.942249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0732ead0-a50f-4565-8112-b9bd7c4f7c42 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:31.943146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0732ead0-a50f-4565-8112-b9bd7c4f7c42 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:31.944960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0732ead0-a50f-4565-8112-b9bd7c4f7c42 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:31.947046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0732ead0-a50f-4565-8112-b9bd7c4f7c42 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:31.947757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0732ead0-a50f-4565-8112-b9bd7c4f7c42 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:31.948912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0732ead0-a50f-4565-8112-b9bd7c4f7c42 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:32.384211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0732ead0-a50f-4565-8112-b9bd7c4f7c42 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:32.393203 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0732ead0-a50f-4565-8112-b9bd7c4f7c42 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1318 microversion: 2.1 time: 0.489409 Oct 18 13:28:32.410801 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1323/2815] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:31 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:32.938933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a6738b86-6463-4e63-9703-94e1ca22c394 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:32.940723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a6738b86-6463-4e63-9703-94e1ca22c394 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:32.956821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6738b86-6463-4e63-9703-94e1ca22c394 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:32.960224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6738b86-6463-4e63-9703-94e1ca22c394 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:32.961843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6738b86-6463-4e63-9703-94e1ca22c394 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:32.965677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6738b86-6463-4e63-9703-94e1ca22c394 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:32.968686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6738b86-6463-4e63-9703-94e1ca22c394 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:32.970272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6738b86-6463-4e63-9703-94e1ca22c394 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:33.237480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a6738b86-6463-4e63-9703-94e1ca22c394 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:33.257401 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a6738b86-6463-4e63-9703-94e1ca22c394 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1150 microversion: 2.1 time: 0.312912 Oct 18 13:28:33.258083 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1493/2816] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:32 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1150 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:33.420097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d683a835-cfc6-4e9e-aab1-1058c648b60a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:33.421640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d683a835-cfc6-4e9e-aab1-1058c648b60a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:33.435076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d683a835-cfc6-4e9e-aab1-1058c648b60a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:33.441878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d683a835-cfc6-4e9e-aab1-1058c648b60a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:33.442672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d683a835-cfc6-4e9e-aab1-1058c648b60a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:33.444084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d683a835-cfc6-4e9e-aab1-1058c648b60a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:33.444643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d683a835-cfc6-4e9e-aab1-1058c648b60a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:33.445328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d683a835-cfc6-4e9e-aab1-1058c648b60a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:33.774492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d683a835-cfc6-4e9e-aab1-1058c648b60a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:33.783251 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d683a835-cfc6-4e9e-aab1-1058c648b60a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1318 microversion: 2.1 time: 0.366859 Oct 18 13:28:33.788308 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1324/2817] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:33 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:34.009834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ec39b397-4b15-4034-8bf2-16bcb6e6cbe0 req-17c9f2d5-b201-4867-bdea-2ebf466ecda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d", "name": "network-vif-plugged", "status": "completed", "tag": "ab7dce51-8cfe-4a35-8cb3-d897b4b3c6ba"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:34.047651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ec39b397-4b15-4034-8bf2-16bcb6e6cbe0 req-17c9f2d5-b201-4867-bdea-2ebf466ecda6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:34.049430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ec39b397-4b15-4034-8bf2-16bcb6e6cbe0 req-17c9f2d5-b201-4867-bdea-2ebf466ecda6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:34.052282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ec39b397-4b15-4034-8bf2-16bcb6e6cbe0 req-17c9f2d5-b201-4867-bdea-2ebf466ecda6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:34.103610 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ec39b397-4b15-4034-8bf2-16bcb6e6cbe0 req-17c9f2d5-b201-4867-bdea-2ebf466ecda6 service nova] Creating event network-vif-plugged:ab7dce51-8cfe-4a35-8cb3-d897b4b3c6ba for instance a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d on n-h1-858384-13 Oct 18 13:28:34.126882 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ec39b397-4b15-4034-8bf2-16bcb6e6cbe0 req-17c9f2d5-b201-4867-bdea-2ebf466ecda6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124960 Oct 18 13:28:34.149164 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1494/2818] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:34.280965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b24875be-75f7-4b87-91a1-d232cb9fe2dc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:34.282327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b24875be-75f7-4b87-91a1-d232cb9fe2dc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:34.300628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b24875be-75f7-4b87-91a1-d232cb9fe2dc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:34.301155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b24875be-75f7-4b87-91a1-d232cb9fe2dc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:34.301598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b24875be-75f7-4b87-91a1-d232cb9fe2dc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:34.306007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b24875be-75f7-4b87-91a1-d232cb9fe2dc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:34.306502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b24875be-75f7-4b87-91a1-d232cb9fe2dc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:34.306941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b24875be-75f7-4b87-91a1-d232cb9fe2dc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:34.468960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b24875be-75f7-4b87-91a1-d232cb9fe2dc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:34.484461 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b24875be-75f7-4b87-91a1-d232cb9fe2dc tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1168 microversion: 2.1 time: 0.207645 Oct 18 13:28:34.497221 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1495/2819] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:34 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1168 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:34.812205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cf115ad0-5fdd-49da-a763-c19c4a1eb209 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:34.813085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cf115ad0-5fdd-49da-a763-c19c4a1eb209 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:34.824528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3d345241-3e23-4dfb-af0f-5dd4433d9898 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Action: 'create', calling method: .version_select at 0x7ff60ee1be50>, body: {"keypair": {"name": "tempest-keypair-95683689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOSnuqZDRTkRK0fK3oSBb58smOW2LvWn83qaXlImz1fREZRnM/oDyh4TrPRZ6H6ETpTsWC12BO/C4zTg2ZvE4pShuTXAowfc0jkU+OYne+3DrwaLx6yY62WqbzsNGYkzw=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:34.842997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf115ad0-5fdd-49da-a763-c19c4a1eb209 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:34.847249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf115ad0-5fdd-49da-a763-c19c4a1eb209 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:34.847918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf115ad0-5fdd-49da-a763-c19c4a1eb209 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:34.856514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf115ad0-5fdd-49da-a763-c19c4a1eb209 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:34.859393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf115ad0-5fdd-49da-a763-c19c4a1eb209 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:34.860514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf115ad0-5fdd-49da-a763-c19c4a1eb209 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:34.905950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-3d345241-3e23-4dfb-af0f-5dd4433d9898 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Getting quotas for project f1dcdbea01af4c52a5cfb8433da75a07. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:34.940822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-3d345241-3e23-4dfb-af0f-5dd4433d9898 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Getting quotas for user c2fc0383d2e445d2b04b8da3c7ce6866 and project f1dcdbea01af4c52a5cfb8433da75a07. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:35.040380 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3d345241-3e23-4dfb-af0f-5dd4433d9898 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.907249 Oct 18 13:28:35.041455 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1325/2820] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:28:34 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:35.054062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4be61252-5086-46ab-8045-13d953a80727 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Calling method '.version_select at 0x7ff60f683700>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:35.075806 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4be61252-5086-46ab-8045-13d953a80727 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-95683689" status: 200 len: 496 microversion: 2.1 time: 0.027267 Oct 18 13:28:35.078921 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1326/2821] 10.222.0.40 () {58 vars in 1212 bytes} [Tue Oct 18 13:28:35 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-95683689 => generated 496 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:35.094529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f9635683-5db7-4f12-a92d-46b86904f1d1 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Calling method '.version_select at 0x7ff60ee37160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:35.143876 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f9635683-5db7-4f12-a92d-46b86904f1d1 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-95683689" status: 202 len: 0 microversion: 2.1 time: 0.055251 Oct 18 13:28:35.147344 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1327/2822] 10.222.0.40 () {58 vars in 1215 bytes} [Tue Oct 18 13:28:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-95683689 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:28:35.164942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ac4b8b4d-cf6a-4b47-a3f0-258c1eb7bcfd tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Action: 'create', calling method: .version_select at 0x7ff60ee385e0>, body: {"keypair": {"name": "tempest-keypair-1931076108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMRt6tz2kvTPARO7CPsaawSgNYjYL74+6NOd4zeELpgE2058hEVnGCw05D5Sd5WXZ6edajJUGJF2GPoip3Drn+Qru8iHH/LdlAshjBtEkpRDPQar9RHfX1c4lMNnWQ89Q=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:35.246580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ac4b8b4d-cf6a-4b47-a3f0-258c1eb7bcfd tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Getting quotas for project f1dcdbea01af4c52a5cfb8433da75a07. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:35.261466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ac4b8b4d-cf6a-4b47-a3f0-258c1eb7bcfd tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Getting quotas for user c2fc0383d2e445d2b04b8da3c7ce6866 and project f1dcdbea01af4c52a5cfb8433da75a07. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:35.328994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:35.354633 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ac4b8b4d-cf6a-4b47-a3f0-258c1eb7bcfd tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.200289 Oct 18 13:28:35.359771 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1328/2823] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:28:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:35.380236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-749c6857-902f-4926-8c94-24fc3f0c9e4b tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Calling method '.version_select at 0x7ff60ee3b430>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:35.444553 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-749c6857-902f-4926-8c94-24fc3f0c9e4b tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931076108" status: 202 len: 0 microversion: 2.1 time: 0.077503 Oct 18 13:28:35.449582 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1329/2824] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:28:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931076108 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:28:35.479136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9c5f58c4-14b1-4012-93dc-b3a7ff9e169c tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Action: 'create', calling method: .version_select at 0x7ff60ee37430>, body: {"keypair": {"name": "tempest-keypair-2079809665", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:35.543536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-9c5f58c4-14b1-4012-93dc-b3a7ff9e169c tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Getting quotas for project f1dcdbea01af4c52a5cfb8433da75a07. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:35.564924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-9c5f58c4-14b1-4012-93dc-b3a7ff9e169c tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Getting quotas for user c2fc0383d2e445d2b04b8da3c7ce6866 and project f1dcdbea01af4c52a5cfb8433da75a07. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:35.622167 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9c5f58c4-14b1-4012-93dc-b3a7ff9e169c tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.168396 Oct 18 13:28:35.623336 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1330/2825] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:28:35 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:35.632627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-98f2eaf3-8651-44de-b351-57371a07612a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:35.635599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-98f2eaf3-8651-44de-b351-57371a07612a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:35.649306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98f2eaf3-8651-44de-b351-57371a07612a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:35.652170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98f2eaf3-8651-44de-b351-57371a07612a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:35.652743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98f2eaf3-8651-44de-b351-57371a07612a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:35.656232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98f2eaf3-8651-44de-b351-57371a07612a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:35.657000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98f2eaf3-8651-44de-b351-57371a07612a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:35.658342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98f2eaf3-8651-44de-b351-57371a07612a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:35.844713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-98f2eaf3-8651-44de-b351-57371a07612a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:35.858671 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-98f2eaf3-8651-44de-b351-57371a07612a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1168 microversion: 2.1 time: 0.233989 Oct 18 13:28:35.868072 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1331/2826] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:35 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1168 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:35.888891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8faf7024-734f-492f-a40e-a0fa07bf9986 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Calling method '.version_select at 0x7ff60ee379d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:35.939075 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8faf7024-734f-492f-a40e-a0fa07bf9986 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079809665" status: 202 len: 0 microversion: 2.1 time: 0.069332 Oct 18 13:28:35.948184 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1332/2827] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:28:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079809665 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:28:35.960773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a4a7cea1-f5ed-44d0-8bf3-d69c0a577e9f tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Action: 'create', calling method: .version_select at 0x7ff60ee1baf0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1773418842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTPCxfKYBpYjh/j1rTLUn/GUrosIJbLOVGo4U4FjnsCabs63jtRd614UZN1f96uLXP3Cb9U/0eoHuiK3DRHQ+jIk6To/RPL7JecLaaYrcZrV/OzqVh0nj0O8JgDG640/A=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:35.979968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a4a7cea1-f5ed-44d0-8bf3-d69c0a577e9f tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Getting quotas for project f1dcdbea01af4c52a5cfb8433da75a07. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:35.990024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a4a7cea1-f5ed-44d0-8bf3-d69c0a577e9f tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Getting quotas for user c2fc0383d2e445d2b04b8da3c7ce6866 and project f1dcdbea01af4c52a5cfb8433da75a07. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:36.026949 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a4a7cea1-f5ed-44d0-8bf3-d69c0a577e9f tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.076879 Oct 18 13:28:36.036022 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1333/2828] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:28:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:36.042866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cbd20aee-1822-473a-bbda-78f4aac5459e tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Action: 'create', calling method: .version_select at 0x7ff60ee3b1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2094821885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb5W9JDJxfby3H0RR8Tlof8REDuXuGLf5cl5+mVbuTTY3bTbbYYPipe3m/dDFYUuK/lfiF8q6R0l4Bmr55vxd4MuY3jRsA5MEkg4Y/telytl5GN9j9RwtajuZm8e+GzZQ=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:36.086918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-cbd20aee-1822-473a-bbda-78f4aac5459e tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Getting quotas for project f1dcdbea01af4c52a5cfb8433da75a07. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:36.096056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-cbd20aee-1822-473a-bbda-78f4aac5459e tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Getting quotas for user c2fc0383d2e445d2b04b8da3c7ce6866 and project f1dcdbea01af4c52a5cfb8433da75a07. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:36.156764 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cbd20aee-1822-473a-bbda-78f4aac5459e tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.118857 Oct 18 13:28:36.158132 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1334/2829] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:28:36 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:36.171364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9e3efe25-1594-4d58-8c5b-2d80c4848a6f tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Action: 'create', calling method: .version_select at 0x7ff60ee1bca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-495994895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQ3fsdVbQTFLzu4mgWzvS2+/hjtTxMpZ1LluecCtGy3yxh0xCfxGNPo9QAdxc+O77UfUz/X9eRXFxCvqnp07Q0bgQLOMp3t8LSmXLpuqkHvLi/+KECoW84mFRse4++RpA=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:36.210022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-9e3efe25-1594-4d58-8c5b-2d80c4848a6f tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Getting quotas for project f1dcdbea01af4c52a5cfb8433da75a07. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:36.226518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-9e3efe25-1594-4d58-8c5b-2d80c4848a6f tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Getting quotas for user c2fc0383d2e445d2b04b8da3c7ce6866 and project f1dcdbea01af4c52a5cfb8433da75a07. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:36.291387 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9e3efe25-1594-4d58-8c5b-2d80c4848a6f tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.123987 Oct 18 13:28:36.292013 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1335/2830] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:28:36 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:28:36.302483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6e2c42fb-4df1-4698-a267-9c10a4491bc9 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Calling method '.version_select at 0x7ff60f6ceca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:36.306877 n-d-858384-13 devstack@n-api.service[120612]: WARNING oslo_db.sqlalchemy.utils [None req-6e2c42fb-4df1-4698-a267-9c10a4491bc9 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 13:28:36.328913 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6e2c42fb-4df1-4698-a267-9c10a4491bc9 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.030236 Oct 18 13:28:36.339668 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1336/2831] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:28:36 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:36.349917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b9663ab6-bce5-423e-8f76-8b85b17821d1 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Calling method '.version_select at 0x7ff60ee37040>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:36.398097 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b9663ab6-bce5-423e-8f76-8b85b17821d1 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-495994895" status: 202 len: 0 microversion: 2.1 time: 0.057166 Oct 18 13:28:36.398953 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1337/2832] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:28:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-495994895 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:28:36.407039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3e47369f-6500-4522-9519-cfac3dd26c39 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Calling method '.version_select at 0x7ff60ee3b790>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:36.424633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cf115ad0-5fdd-49da-a763-c19c4a1eb209 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:36.438974 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cf115ad0-5fdd-49da-a763-c19c4a1eb209 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1318 microversion: 2.1 time: 1.629013 Oct 18 13:28:36.447601 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1496/2833] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:34 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1318 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:36.465170 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3e47369f-6500-4522-9519-cfac3dd26c39 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2094821885" status: 202 len: 0 microversion: 2.1 time: 0.061821 Oct 18 13:28:36.469529 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1338/2834] 10.222.0.40 () {58 vars in 1278 bytes} [Tue Oct 18 13:28:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2094821885 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:28:36.475157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba343516-7d01-4472-9f31-a521d87aacc8 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] Calling method '.version_select at 0x7ff60ef6fdc0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:36.527540 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ba343516-7d01-4472-9f31-a521d87aacc8 tempest-KeyPairsV2TestJSON-322009746 tempest-KeyPairsV2TestJSON-322009746-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1773418842" status: 202 len: 0 microversion: 2.1 time: 0.056575 Oct 18 13:28:36.528540 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1497/2835] 10.222.0.40 () {58 vars in 1278 bytes} [Tue Oct 18 13:28:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1773418842 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:28:36.888604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1d9e10fe-b0ac-4450-ad9c-267d87adf6b4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:36.889278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1d9e10fe-b0ac-4450-ad9c-267d87adf6b4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:36.896812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9e10fe-b0ac-4450-ad9c-267d87adf6b4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:36.897318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9e10fe-b0ac-4450-ad9c-267d87adf6b4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:36.905724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9e10fe-b0ac-4450-ad9c-267d87adf6b4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:36.907274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9e10fe-b0ac-4450-ad9c-267d87adf6b4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:36.911276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9e10fe-b0ac-4450-ad9c-267d87adf6b4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:36.911840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9e10fe-b0ac-4450-ad9c-267d87adf6b4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:37.279637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1d9e10fe-b0ac-4450-ad9c-267d87adf6b4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:37.298721 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1d9e10fe-b0ac-4450-ad9c-267d87adf6b4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1210 microversion: 2.1 time: 0.413906 Oct 18 13:28:37.300252 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1339/2836] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:36 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1210 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:37.473024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-55b032b1-c6e6-42d0-aba6-ef046afa41dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:37.473652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-55b032b1-c6e6-42d0-aba6-ef046afa41dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:37.488857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55b032b1-c6e6-42d0-aba6-ef046afa41dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:37.489387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55b032b1-c6e6-42d0-aba6-ef046afa41dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:37.489829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55b032b1-c6e6-42d0-aba6-ef046afa41dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:37.496257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55b032b1-c6e6-42d0-aba6-ef046afa41dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:37.496746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55b032b1-c6e6-42d0-aba6-ef046afa41dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:37.513794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55b032b1-c6e6-42d0-aba6-ef046afa41dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:37.829509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-55b032b1-c6e6-42d0-aba6-ef046afa41dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:37.853898 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-55b032b1-c6e6-42d0-aba6-ef046afa41dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1318 microversion: 2.1 time: 0.381452 Oct 18 13:28:37.854961 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1498/2837] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:37 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:38.329102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22990cdf-de75-4b28-a4db-d98e52216dc2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:38.329793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-22990cdf-de75-4b28-a4db-d98e52216dc2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:38.346429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22990cdf-de75-4b28-a4db-d98e52216dc2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.346931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22990cdf-de75-4b28-a4db-d98e52216dc2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.347378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22990cdf-de75-4b28-a4db-d98e52216dc2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.365068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22990cdf-de75-4b28-a4db-d98e52216dc2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.367688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22990cdf-de75-4b28-a4db-d98e52216dc2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.368287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22990cdf-de75-4b28-a4db-d98e52216dc2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.670752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1ecaf50a-881d-4b38-a1d2-828b0683dd45 req-da50626d-4f40-475e-91eb-4ae4e04cfc3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d173b9-5f53-4e62-aee6-3bc9f580b8ce", "name": "network-vif-plugged", "status": "completed", "tag": "60dcc269-47e0-4c17-8be7-a1e251674cf8"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:38.706694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1ecaf50a-881d-4b38-a1d2-828b0683dd45 req-da50626d-4f40-475e-91eb-4ae4e04cfc3d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.707239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1ecaf50a-881d-4b38-a1d2-828b0683dd45 req-da50626d-4f40-475e-91eb-4ae4e04cfc3d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.708280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1ecaf50a-881d-4b38-a1d2-828b0683dd45 req-da50626d-4f40-475e-91eb-4ae4e04cfc3d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.732043 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1ecaf50a-881d-4b38-a1d2-828b0683dd45 req-da50626d-4f40-475e-91eb-4ae4e04cfc3d service nova] Creating event network-vif-plugged:60dcc269-47e0-4c17-8be7-a1e251674cf8 for instance 52d173b9-5f53-4e62-aee6-3bc9f580b8ce on n-h1-858384-13 Oct 18 13:28:38.739877 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1ecaf50a-881d-4b38-a1d2-828b0683dd45 req-da50626d-4f40-475e-91eb-4ae4e04cfc3d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072433 Oct 18 13:28:38.742693 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1499/2838] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:38.750920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1dbaa6cf-562d-4669-85e0-4370e5f22155 req-db19f8c1-3dbf-4267-8634-1b54af817b16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969d338f-c468-409d-8d40-db5fb2b273ee", "tag": "f734654d-3e14-44d4-bd74-65598fad1317"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:38.765996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1dbaa6cf-562d-4669-85e0-4370e5f22155 req-db19f8c1-3dbf-4267-8634-1b54af817b16 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.766482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1dbaa6cf-562d-4669-85e0-4370e5f22155 req-db19f8c1-3dbf-4267-8634-1b54af817b16 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.766982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1dbaa6cf-562d-4669-85e0-4370e5f22155 req-db19f8c1-3dbf-4267-8634-1b54af817b16 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.799480 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1dbaa6cf-562d-4669-85e0-4370e5f22155 req-db19f8c1-3dbf-4267-8634-1b54af817b16 service nova] Creating event network-changed:f734654d-3e14-44d4-bd74-65598fad1317 for instance 969d338f-c468-409d-8d40-db5fb2b273ee on n-h2-858384-13 Oct 18 13:28:38.809693 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1dbaa6cf-562d-4669-85e0-4370e5f22155 req-db19f8c1-3dbf-4267-8634-1b54af817b16 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065375 Oct 18 13:28:38.825374 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1500/2839] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:38.829927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-22990cdf-de75-4b28-a4db-d98e52216dc2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:38.842612 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-22990cdf-de75-4b28-a4db-d98e52216dc2 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1210 microversion: 2.1 time: 0.522094 Oct 18 13:28:38.849316 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1340/2840] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:38 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1210 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:38.880071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e0882db0-7d2e-48fa-9725-446a84916b10 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:38.881416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e0882db0-7d2e-48fa-9725-446a84916b10 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:38.901639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0882db0-7d2e-48fa-9725-446a84916b10 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.902849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0882db0-7d2e-48fa-9725-446a84916b10 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.905271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0882db0-7d2e-48fa-9725-446a84916b10 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:38.906712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0882db0-7d2e-48fa-9725-446a84916b10 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:38.908985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0882db0-7d2e-48fa-9725-446a84916b10 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:38.909671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0882db0-7d2e-48fa-9725-446a84916b10 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:39.394119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e0882db0-7d2e-48fa-9725-446a84916b10 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:39.403477 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e0882db0-7d2e-48fa-9725-446a84916b10 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1318 microversion: 2.1 time: 0.528921 Oct 18 13:28:39.418636 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1501/2841] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:38 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:39.866906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f7563252-cfd8-4b1d-a872-8c0c871ba1c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:39.867709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f7563252-cfd8-4b1d-a872-8c0c871ba1c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:39.879253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7563252-cfd8-4b1d-a872-8c0c871ba1c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:39.879755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7563252-cfd8-4b1d-a872-8c0c871ba1c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:39.880194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7563252-cfd8-4b1d-a872-8c0c871ba1c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:39.882775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7563252-cfd8-4b1d-a872-8c0c871ba1c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:39.886162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7563252-cfd8-4b1d-a872-8c0c871ba1c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:39.886554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7563252-cfd8-4b1d-a872-8c0c871ba1c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.060014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c72782cf-38f8-4e4b-968c-c08f22074405 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Action: 'create', calling method: .version_select at 0x7ff60ff47700>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPCddHas1Ou7sQj+sykr4K1w9tQbxuBEJQ5vk13M8nwriJXBlPBfJGrSOSySIaX6iwrRhNHI96Cz5diSomfI/jomGo03B8aRBo306QbA8F9sEjB/yZBEGzQ8nUpQcVGug=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c72782cf-38f8-4e4b-968c-c08f22074405 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Request method failure captured: Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 257 Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqoHKLxgxzW1CxdQ7L1sfKUDpzYkTpmYbM0l1ovnd_r9w8ie-clCjaME5hcXv4Lj-GCiRkFQZIqQdSidbB5F3d9w8bfPmBpN-cpLGVK5yx_zy4V9L-FafALFXT5MxLvfoZ-RZ7YaYePyw-rZacYv_HVExYtUSb5Z399ccwqgtR_wUVM Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:40.069608 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:40.070978 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2e5499d2764419d88a0ad8ffe7faefc"}]}] Oct 18 13:28:40.070978 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.070978 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.070978 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.070978 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.070978 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:40.070978 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:40.070978 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7d76a733485a4072b842b75cbd20e987 Oct 18 13:28:40.070978 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.070978 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:28:40.070978 n-d-858384-13 devstack@n-api.service[120612]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPCddHas1Ou7sQj+sykr4K1w9tQbxuBEJQ5vk13M8nwriJXBlPBfJGrSOSySIaX6iwrRhNHI96Cz5diSomfI/jomGo03B8aRBo306QbA8F9sEjB/yZBEGzQ8nUpQcVGug=="}} Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPCddHas1Ou7sQj+sykr4K1w9tQbxuBEJQ5vk13M8nwriJXBlPBfJGrSOSySIaX6iwrRhNHI96Cz5diSomfI/jomGo03B8aRBo306QbA8F9sEjB/yZBEGzQ8nUpQcVGug=='}}} Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.071860 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:40.072894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:28:40.074425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:28:40.075582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 18 13:28:40.075582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.077660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c72782cf-38f8-4e4b-968c-c08f22074405 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:40.078803 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c72782cf-38f8-4e4b-968c-c08f22074405 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.241357 Oct 18 13:28:40.080597 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1341/2842] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:28:39 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 244 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:28:40.103312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ede1e386-32dc-438b-bb7e-236db6c7ff30 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Action: 'create', calling method: .version_select at 0x7ff60ee1e0d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1574076858", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:40.120191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ede1e386-32dc-438b-bb7e-236db6c7ff30 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Getting quotas for project a2e5499d2764419d88a0ad8ffe7faefc. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:40.125668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ede1e386-32dc-438b-bb7e-236db6c7ff30 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Getting quotas for user 7d76a733485a4072b842b75cbd20e987 and project a2e5499d2764419d88a0ad8ffe7faefc. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:40.145850 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-ede1e386-32dc-438b-bb7e-236db6c7ff30 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ede1e386-32dc-438b-bb7e-236db6c7ff30 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Request method failure captured: Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 2167 Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqoHKLxgxzW1CxdQ7L1sfKUDpzYkTpmYbM0l1ovnd_r9w8ie-clCjaME5hcXv4Lj-GCiRkFQZIqQdSidbB5F3d9w8bfPmBpN-cpLGVK5yx_zy4V9L-FafALFXT5MxLvfoZ-RZ7YaYePyw-rZacYv_HVExYtUSb5Z399ccwqgtR_wUVM Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2e5499d2764419d88a0ad8ffe7faefc"}]}] Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7d76a733485a4072b842b75cbd20e987 Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1574076858", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:40.168790 n-d-858384-13 devstack@n-api.service[120612]: exception: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1574076858', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:40.170977 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ede1e386-32dc-438b-bb7e-236db6c7ff30 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ede1e386-32dc-438b-bb7e-236db6c7ff30 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.080598 Oct 18 13:28:40.173408 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1342/2843] 10.222.0.40 () {60 vars in 1160 bytes} [Tue Oct 18 13:28:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:28:40.184661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bd075293-89ae-4ea1-9bab-b30e8098fbcd tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Action: 'create', calling method: .version_select at 0x7ff60eeaeee0>, body: {"keypair": {"name": "tempest-keypair-1327701233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2UvNsw+KALH25oHmUuXcSDfvMPqnnh6yajgceCuFgTp4psNOUFUD6heWbwBffIn30Ywaa6CgGeLqbqCbMtzFNfct/NugU2RZKsXEanGYSC2aypQ0I2JXGs9KfpuM3gYA=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:40.204779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-bd075293-89ae-4ea1-9bab-b30e8098fbcd tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Getting quotas for project a2e5499d2764419d88a0ad8ffe7faefc. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:40.212360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-bd075293-89ae-4ea1-9bab-b30e8098fbcd tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Getting quotas for user 7d76a733485a4072b842b75cbd20e987 and project a2e5499d2764419d88a0ad8ffe7faefc. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:40.241688 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bd075293-89ae-4ea1-9bab-b30e8098fbcd tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060856 Oct 18 13:28:40.242966 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1343/2844] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:28:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:28:40.257722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e3ab341c-4c65-4940-94b9-f078bf5153b9 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Action: 'create', calling method: .version_select at 0x7ff60ee4d1f0>, body: {"keypair": {"name": "tempest-keypair-1327701233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgLMRyz+qwKabFng30bTu+8RO7YqC5iwu+8QLhvrWjmc+wLXAcIPLvRRNftBiZg/3IUjk0wBxvfEyOuUygmj2BcQM3jdfxoxFx2jkJuzZKRmymFiii5t80o/RpXBPhYYA=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:40.259776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f7563252-cfd8-4b1d-a872-8c0c871ba1c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:40.272166 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f7563252-cfd8-4b1d-a872-8c0c871ba1c1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1210 microversion: 2.1 time: 0.409124 Oct 18 13:28:40.277480 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1502/2845] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:39 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1210 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:40.297847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e3ab341c-4c65-4940-94b9-f078bf5153b9 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Getting quotas for project a2e5499d2764419d88a0ad8ffe7faefc. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:40.302211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=90,nova_api:DELETE=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:40.307042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e3ab341c-4c65-4940-94b9-f078bf5153b9 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Getting quotas for user 7d76a733485a4072b842b75cbd20e987 and project a2e5499d2764419d88a0ad8ffe7faefc. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:40.344149 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e3ab341c-4c65-4940-94b9-f078bf5153b9 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] HTTP exception thrown: Key pair 'tempest-keypair-1327701233' already exists. Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e3ab341c-4c65-4940-94b9-f078bf5153b9 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Request method failure captured: Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 273 Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqoHKLxgxzW1CxdQ7L1sfKUDpzYkTpmYbM0l1ovnd_r9w8ie-clCjaME5hcXv4Lj-GCiRkFQZIqQdSidbB5F3d9w8bfPmBpN-cpLGVK5yx_zy4V9L-FafALFXT5MxLvfoZ-RZ7YaYePyw-rZacYv_HVExYtUSb5Z399ccwqgtR_wUVM Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2e5499d2764419d88a0ad8ffe7faefc"}]}] Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7d76a733485a4072b842b75cbd20e987 Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: {"keypair": {"name": "tempest-keypair-1327701233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgLMRyz+qwKabFng30bTu+8RO7YqC5iwu+8QLhvrWjmc+wLXAcIPLvRRNftBiZg/3IUjk0wBxvfEyOuUygmj2BcQM3jdfxoxFx2jkJuzZKRmymFiii5t80o/RpXBPhYYA=="}} Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: exception: Key pair 'tempest-keypair-1327701233' already exists. Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1327701233', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgLMRyz+qwKabFng30bTu+8RO7YqC5iwu+8QLhvrWjmc+wLXAcIPLvRRNftBiZg/3IUjk0wBxvfEyOuUygmj2BcQM3jdfxoxFx2jkJuzZKRmymFiii5t80o/RpXBPhYYA=='}}} Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result.read() Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '7d76a733485a4072b842b75cbd20e987-tempest-keypair-1327701233' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 18 13:28:40.348684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi session.flush() Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result.read() Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 18 13:28:40.353284 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '7d76a733485a4072b842b75cbd20e987-tempest-keypair-1327701233' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 18, 13, 28, 40, 335196), 'updated_at': None, 'name': 'tempest-keypair-1327701233', 'user_id': '7d76a733485a4072b842b75cbd20e987', 'fingerprint': '71:f4:53:ff:35:d8:97:64:ed:07:12:5b:6d:0c:9e:47', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgLMRyz+qwKabFng30bTu+8RO7YqC5iwu+8QLhvrWjmc+wLXAcIPLvRRNftBiZg/3IUjk0wBxvfEyOuUygmj2BcQM3jdfxoxFx2jkJuzZKRmymFiii5t80o/RpXBPhYYA==', 'type': 'ssh'}] Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6780, in import_key_pair Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi keypair.create() Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._create() Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1327701233' already exists. Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 18 13:28:40.357366 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1327701233' already exists. Oct 18 13:28:40.363869 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.363869 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.363869 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.363869 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.363869 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.363869 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.363869 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:40.363869 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:40.363869 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1327701233' already exists. Oct 18 13:28:40.363869 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.363869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e3ab341c-4c65-4940-94b9-f078bf5153b9 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Returning 409 to user: Key pair 'tempest-keypair-1327701233' already exists. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:40.363869 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e3ab341c-4c65-4940-94b9-f078bf5153b9 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.105671 Oct 18 13:28:40.363869 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1344/2846] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:28:40 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:28:40.372152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-56a9b1cc-9730-49be-a7dd-8b77d5a69490 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Calling method '.version_select at 0x7ff60eeca280>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:40.420229 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-56a9b1cc-9730-49be-a7dd-8b77d5a69490 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327701233" status: 202 len: 0 microversion: 2.1 time: 0.053085 Oct 18 13:28:40.431195 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1503/2847] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327701233 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:28:40.436705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d05d7ca2-165f-4df7-8b45-f1c306a602a7 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Action: 'create', calling method: .version_select at 0x7ff60eeaba60>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQvfAad3ipL7L2WGnjrgzlKWJOV9I/I4wQ7WlXhkplwDOwjJrugRoRm7B3v2T1njG9HsVlm2510OK1tb9R43z5ADuuhJSKeobRRto2aIIfmh1vjtqWH1vZL7THz/H4/oA=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:40.442570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1ff0e25a-71fc-4a82-9f00-f5cdd4ee3f6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:40.443214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1ff0e25a-71fc-4a82-9f00-f5cdd4ee3f6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d05d7ca2-165f-4df7-8b45-f1c306a602a7 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Request method failure captured: Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 247 Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqoHKLxgxzW1CxdQ7L1sfKUDpzYkTpmYbM0l1ovnd_r9w8ie-clCjaME5hcXv4Lj-GCiRkFQZIqQdSidbB5F3d9w8bfPmBpN-cpLGVK5yx_zy4V9L-FafALFXT5MxLvfoZ-RZ7YaYePyw-rZacYv_HVExYtUSb5Z399ccwqgtR_wUVM Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2e5499d2764419d88a0ad8ffe7faefc"}]}] Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7d76a733485a4072b842b75cbd20e987 Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQvfAad3ipL7L2WGnjrgzlKWJOV9I/I4wQ7WlXhkplwDOwjJrugRoRm7B3v2T1njG9HsVlm2510OK1tb9R43z5ADuuhJSKeobRRto2aIIfmh1vjtqWH1vZL7THz/H4/oA=="}} Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQvfAad3ipL7L2WGnjrgzlKWJOV9I/I4wQ7WlXhkplwDOwjJrugRoRm7B3v2T1njG9HsVlm2510OK1tb9R43z5ADuuhJSKeobRRto2aIIfmh1vjtqWH1vZL7THz/H4/oA=='}}} Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi '' Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:28:40.445327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.450377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d05d7ca2-165f-4df7-8b45-f1c306a602a7 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:40.452118 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d05d7ca2-165f-4df7-8b45-f1c306a602a7 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.020082 Oct 18 13:28:40.460323 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1345/2848] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:28:40 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:28:40.465869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ace77092-010c-45ce-b834-87f1c40c6fbe tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Action: 'create', calling method: .version_select at 0x7ff60eeae820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1438304684", "public_key": " "}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:40.475725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ff0e25a-71fc-4a82-9f00-f5cdd4ee3f6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.477227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ff0e25a-71fc-4a82-9f00-f5cdd4ee3f6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.478140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ff0e25a-71fc-4a82-9f00-f5cdd4ee3f6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.479051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ff0e25a-71fc-4a82-9f00-f5cdd4ee3f6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:40.482197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ff0e25a-71fc-4a82-9f00-f5cdd4ee3f6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:40.482891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ff0e25a-71fc-4a82-9f00-f5cdd4ee3f6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:40.502902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ace77092-010c-45ce-b834-87f1c40c6fbe tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Getting quotas for project a2e5499d2764419d88a0ad8ffe7faefc. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:40.518292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ace77092-010c-45ce-b834-87f1c40c6fbe tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Getting quotas for user 7d76a733485a4072b842b75cbd20e987 and project a2e5499d2764419d88a0ad8ffe7faefc. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:40.583509 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-ace77092-010c-45ce-b834-87f1c40c6fbe tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ace77092-010c-45ce-b834-87f1c40c6fbe tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Request method failure captured: Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 95 Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqoHKLxgxzW1CxdQ7L1sfKUDpzYkTpmYbM0l1ovnd_r9w8ie-clCjaME5hcXv4Lj-GCiRkFQZIqQdSidbB5F3d9w8bfPmBpN-cpLGVK5yx_zy4V9L-FafALFXT5MxLvfoZ-RZ7YaYePyw-rZacYv_HVExYtUSb5Z399ccwqgtR_wUVM Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2e5499d2764419d88a0ad8ffe7faefc"}]}] Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7d76a733485a4072b842b75cbd20e987 Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1438304684", "public_key": " "}} Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: exception: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1438304684', 'public_key': ' '}}} Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.585659 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ace77092-010c-45ce-b834-87f1c40c6fbe tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ace77092-010c-45ce-b834-87f1c40c6fbe tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.125900 Oct 18 13:28:40.597518 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1346/2849] 10.222.0.40 () {60 vars in 1158 bytes} [Tue Oct 18 13:28:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:28:40.600860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6afd57bd-5079-418a-8449-2f3524a249cf tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Action: 'create', calling method: .version_select at 0x7ff60ee37ee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT1/8q+kEUVVpWMAxxNTI7TTM68IYihiQ/BhYqMAhER46jm1/HpMVxs1lm469oi/i1WbNJfxaLasnlDUdSUs9oByapcVUoQDbGd2KFb4tYnk91tW8Qn7dvnbONQlUyyZw=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6afd57bd-5079-418a-8449-2f3524a249cf tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Request method failure captured: Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 507 Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqoHKLxgxzW1CxdQ7L1sfKUDpzYkTpmYbM0l1ovnd_r9w8ie-clCjaME5hcXv4Lj-GCiRkFQZIqQdSidbB5F3d9w8bfPmBpN-cpLGVK5yx_zy4V9L-FafALFXT5MxLvfoZ-RZ7YaYePyw-rZacYv_HVExYtUSb5Z399ccwqgtR_wUVM Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2e5499d2764419d88a0ad8ffe7faefc"}]}] Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7d76a733485a4072b842b75cbd20e987 Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT1/8q+kEUVVpWMAxxNTI7TTM68IYihiQ/BhYqMAhER46jm1/HpMVxs1lm469oi/i1WbNJfxaLasnlDUdSUs9oByapcVUoQDbGd2KFb4tYnk91tW8Qn7dvnbONQlUyyZw=="}} Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT1/8q+kEUVVpWMAxxNTI7TTM68IYihiQ/BhYqMAhER46jm1/HpMVxs1lm469oi/i1WbNJfxaLasnlDUdSUs9oByapcVUoQDbGd2KFb4tYnk91tW8Qn7dvnbONQlUyyZw=='}}} Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 18 13:28:40.604698 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.608432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6afd57bd-5079-418a-8449-2f3524a249cf tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:40.610908 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6afd57bd-5079-418a-8449-2f3524a249cf tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.014169 Oct 18 13:28:40.610908 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1347/2850] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:28:40 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:28:40.624267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb9d0fd8-3c26-46a5-80fe-e2559df085a4 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Action: 'create', calling method: .version_select at 0x7ff60eeabaf0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-808669826", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:40.658533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-eb9d0fd8-3c26-46a5-80fe-e2559df085a4 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Getting quotas for project a2e5499d2764419d88a0ad8ffe7faefc. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:40.665714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-eb9d0fd8-3c26-46a5-80fe-e2559df085a4 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Getting quotas for user 7d76a733485a4072b842b75cbd20e987 and project a2e5499d2764419d88a0ad8ffe7faefc. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:40.687085 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-eb9d0fd8-3c26-46a5-80fe-e2559df085a4 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb9d0fd8-3c26-46a5-80fe-e2559df085a4 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Request method failure captured: Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 117 Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqoHKLxgxzW1CxdQ7L1sfKUDpzYkTpmYbM0l1ovnd_r9w8ie-clCjaME5hcXv4Lj-GCiRkFQZIqQdSidbB5F3d9w8bfPmBpN-cpLGVK5yx_zy4V9L-FafALFXT5MxLvfoZ-RZ7YaYePyw-rZacYv_HVExYtUSb5Z399ccwqgtR_wUVM Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2e5499d2764419d88a0ad8ffe7faefc"}]}] Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7d76a733485a4072b842b75cbd20e987 Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-808669826", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: exception: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-808669826', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 18 13:28:40.689091 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb9d0fd8-3c26-46a5-80fe-e2559df085a4 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:40.695586 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eb9d0fd8-3c26-46a5-80fe-e2559df085a4 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.071147 Oct 18 13:28:40.698460 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1348/2851] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:28:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:28:40.717992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1154a0a3-13d9-4d58-b420-3c1b49e79de0 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Calling method '.version_select at 0x7ff60ee4d670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:40.739106 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-1154a0a3-13d9-4d58-b420-3c1b49e79de0 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-652803262 not found for user 7d76a733485a4072b842b75cbd20e987 Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1154a0a3-13d9-4d58-b420-3c1b49e79de0 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Request method failure captured: Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-652803262 HTTP/1.1 Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqoHKLxgxzW1CxdQ7L1sfKUDpzYkTpmYbM0l1ovnd_r9w8ie-clCjaME5hcXv4Lj-GCiRkFQZIqQdSidbB5F3d9w8bfPmBpN-cpLGVK5yx_zy4V9L-FafALFXT5MxLvfoZ-RZ7YaYePyw-rZacYv_HVExYtUSb5Z399ccwqgtR_wUVM Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2e5499d2764419d88a0ad8ffe7faefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2e5499d2764419d88a0ad8ffe7faefc"}]}] Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a2e5499d2764419d88a0ad8ffe7faefc Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1798963218 Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7d76a733485a4072b842b75cbd20e987 Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1798963218-project Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: exception: Keypair tempest-keypair-non-existent-652803262 not found for user 7d76a733485a4072b842b75cbd20e987 Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'tempest-keypair-non-existent-652803262'} Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6864, in delete_key_pair Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6885, in get_key_pair Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-652803262 not found for user 7d76a733485a4072b842b75cbd20e987 Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.742148 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-652803262 not found for user 7d76a733485a4072b842b75cbd20e987 Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-652803262 not found for user 7d76a733485a4072b842b75cbd20e987 Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1154a0a3-13d9-4d58-b420-3c1b49e79de0 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] Returning 404 to user: Keypair tempest-keypair-non-existent-652803262 not found for user 7d76a733485a4072b842b75cbd20e987 {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:40.747237 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1154a0a3-13d9-4d58-b420-3c1b49e79de0 tempest-KeyPairsNegativeTestJSON-1798963218 tempest-KeyPairsNegativeTestJSON-1798963218-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-652803262" status: 404 len: 144 microversion: 2.1 time: 0.044441 Oct 18 13:28:40.751995 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1349/2852] 10.222.0.40 () {58 vars in 1257 bytes} [Tue Oct 18 13:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-652803262 => generated 144 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:40.995673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1ff0e25a-71fc-4a82-9f00-f5cdd4ee3f6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:41.013445 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1ff0e25a-71fc-4a82-9f00-f5cdd4ee3f6f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1318 microversion: 2.1 time: 0.578481 Oct 18 13:28:41.021109 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1504/2853] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:40 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:41.302514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c4198791-1dbc-45a3-b2bd-b65cf3227ff7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:41.303810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c4198791-1dbc-45a3-b2bd-b65cf3227ff7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:41.318809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4198791-1dbc-45a3-b2bd-b65cf3227ff7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:41.320020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4198791-1dbc-45a3-b2bd-b65cf3227ff7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:41.321960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4198791-1dbc-45a3-b2bd-b65cf3227ff7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:41.328811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4198791-1dbc-45a3-b2bd-b65cf3227ff7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:41.330079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4198791-1dbc-45a3-b2bd-b65cf3227ff7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:41.332821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4198791-1dbc-45a3-b2bd-b65cf3227ff7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:41.333661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:41.697782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c4198791-1dbc-45a3-b2bd-b65cf3227ff7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:41.712699 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c4198791-1dbc-45a3-b2bd-b65cf3227ff7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1210 microversion: 2.1 time: 0.415978 Oct 18 13:28:41.727638 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1350/2854] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:41 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1210 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:42.042685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc1a06de-4b15-4cf7-989f-58b6fccd32e2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.043224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bc1a06de-4b15-4cf7-989f-58b6fccd32e2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:42.050485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:42.073121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc1a06de-4b15-4cf7-989f-58b6fccd32e2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.074046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc1a06de-4b15-4cf7-989f-58b6fccd32e2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.074735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc1a06de-4b15-4cf7-989f-58b6fccd32e2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.075710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc1a06de-4b15-4cf7-989f-58b6fccd32e2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.076366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc1a06de-4b15-4cf7-989f-58b6fccd32e2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.077033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc1a06de-4b15-4cf7-989f-58b6fccd32e2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.565127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bc1a06de-4b15-4cf7-989f-58b6fccd32e2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:42.594685 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bc1a06de-4b15-4cf7-989f-58b6fccd32e2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1468 microversion: 2.1 time: 0.555837 Oct 18 13:28:42.596314 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1505/2855] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1468 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:42.620724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d81822ac-863b-4bd6-b960-56b22d51f2dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.621954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d81822ac-863b-4bd6-b960-56b22d51f2dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:42.629651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81822ac-863b-4bd6-b960-56b22d51f2dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.630396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81822ac-863b-4bd6-b960-56b22d51f2dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.631609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81822ac-863b-4bd6-b960-56b22d51f2dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.632811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81822ac-863b-4bd6-b960-56b22d51f2dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.634206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81822ac-863b-4bd6-b960-56b22d51f2dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.635006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81822ac-863b-4bd6-b960-56b22d51f2dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.746583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dcaa2ded-176d-456f-9141-c6e081649eaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.747567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dcaa2ded-176d-456f-9141-c6e081649eaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:42.759808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcaa2ded-176d-456f-9141-c6e081649eaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.761202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcaa2ded-176d-456f-9141-c6e081649eaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.761790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcaa2ded-176d-456f-9141-c6e081649eaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.762657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcaa2ded-176d-456f-9141-c6e081649eaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.763318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcaa2ded-176d-456f-9141-c6e081649eaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:42.763892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcaa2ded-176d-456f-9141-c6e081649eaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:42.907458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d81822ac-863b-4bd6-b960-56b22d51f2dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:42.942065 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d81822ac-863b-4bd6-b960-56b22d51f2dd tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d" status: 200 len: 1468 microversion: 2.1 time: 0.325173 Oct 18 13:28:42.942861 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1351/2856] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d => generated 1468 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:42.969873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:42.989129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:42.990502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Searching by: {'reservation_id': 'r-lyh5iq1k', 'deleted': False, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:28:42.997133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:42.999599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.000302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.001547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.003640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.004215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.249201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dcaa2ded-176d-456f-9141-c6e081649eaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:43.264201 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dcaa2ded-176d-456f-9141-c6e081649eaf tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1210 microversion: 2.1 time: 0.522910 Oct 18 13:28:43.264867 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1506/2857] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1210 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:43.288287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:28:43.518758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:43.559154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.560240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.566372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:43.832347 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2870cc8a-dd43-40ba-88ba-b5135f210f25 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?reservation_id=r-lyh5iq1k" status: 200 len: 2929 microversion: 2.1 time: 0.867060 Oct 18 13:28:43.833341 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1352/2858] 10.222.0.40 () {58 vars in 1197 bytes} [Tue Oct 18 13:28:42 2022] GET /compute/v2.1/servers/detail?reservation_id=r-lyh5iq1k => generated 2929 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:43.860552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7392c421-ee60-40fa-aed0-3b2d5e02097f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:43.935213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.compute.server_groups [None req-7392c421-ee60-40fa-aed0-3b2d5e02097f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Querying cell a8e216eb-ce73-4101-a62e-f9159a9c2bcf(cell1) for 2 instances {{(pid=120611) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 13:28:43.936208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7392c421-ee60-40fa-aed0-3b2d5e02097f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:43.937747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7392c421-ee60-40fa-aed0-3b2d5e02097f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:43.940236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7392c421-ee60-40fa-aed0-3b2d5e02097f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:44.020607 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7392c421-ee60-40fa-aed0-3b2d5e02097f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/cd107ee3-9da9-4d4a-a086-4bbd7f78626f" status: 200 len: 265 microversion: 2.1 time: 0.163944 Oct 18 13:28:44.021726 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1507/2859] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:28:43 2022] GET /compute/v2.1/os-server-groups/cd107ee3-9da9-4d4a-a086-4bbd7f78626f => generated 265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:44.034489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31184b24-f93d-4046-8562-692195b1a39e tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:44.035024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-31184b24-f93d-4046-8562-692195b1a39e tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:44.047527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31184b24-f93d-4046-8562-692195b1a39e tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:44.049390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31184b24-f93d-4046-8562-692195b1a39e tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:44.049832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31184b24-f93d-4046-8562-692195b1a39e tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:44.055089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31184b24-f93d-4046-8562-692195b1a39e tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:44.055580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31184b24-f93d-4046-8562-692195b1a39e tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:44.056034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31184b24-f93d-4046-8562-692195b1a39e tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:44.305737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db64c255-9544-472b-84c3-8adde1f37ae7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:44.308688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db64c255-9544-472b-84c3-8adde1f37ae7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:44.331142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db64c255-9544-472b-84c3-8adde1f37ae7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:44.337829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db64c255-9544-472b-84c3-8adde1f37ae7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:44.338296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db64c255-9544-472b-84c3-8adde1f37ae7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:44.340876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db64c255-9544-472b-84c3-8adde1f37ae7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:44.342191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db64c255-9544-472b-84c3-8adde1f37ae7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:44.344454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db64c255-9544-472b-84c3-8adde1f37ae7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:44.417805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:44.475353 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31184b24-f93d-4046-8562-692195b1a39e tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 200 len: 1621 microversion: 2.1 time: 0.445839 Oct 18 13:28:44.478196 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1353/2860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:44 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 1621 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:44.502211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e912c766-5ed2-45cb-9489-f54c83570439 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:44.503202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e912c766-5ed2-45cb-9489-f54c83570439 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] [instance: a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:44.515451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e912c766-5ed2-45cb-9489-f54c83570439 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:44.522235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e912c766-5ed2-45cb-9489-f54c83570439 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:44.523347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e912c766-5ed2-45cb-9489-f54c83570439 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:44.525602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e912c766-5ed2-45cb-9489-f54c83570439 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:44.531472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e912c766-5ed2-45cb-9489-f54c83570439 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:44.532213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e912c766-5ed2-45cb-9489-f54c83570439 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:44.916238 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e912c766-5ed2-45cb-9489-f54c83570439 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d" status: 200 len: 1621 microversion: 2.1 time: 0.415502 Oct 18 13:28:44.918184 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1354/2861] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:44 2022] GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d => generated 1621 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:44.947463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0c36c26f-7396-41de-9123-5c8c076fd5b2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Action: 'create', calling method: .version_select at 0x7ff60ee37af0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1001407527", "policies": ["anti-affinity"]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:44.985281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0c36c26f-7396-41de-9123-5c8c076fd5b2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:44.998339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0c36c26f-7396-41de-9123-5c8c076fd5b2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:45.070407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0c36c26f-7396-41de-9123-5c8c076fd5b2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:45.074623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db64c255-9544-472b-84c3-8adde1f37ae7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:45.099134 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db64c255-9544-472b-84c3-8adde1f37ae7 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1198 microversion: 2.1 time: 0.815152 Oct 18 13:28:45.100235 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1508/2862] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:44 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1198 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:45.110505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0c36c26f-7396-41de-9123-5c8c076fd5b2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:45.152024 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0c36c26f-7396-41de-9123-5c8c076fd5b2 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.209362 Oct 18 13:28:45.152995 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1355/2863] 10.222.0.40 () {60 vars in 1174 bytes} [Tue Oct 18 13:28:44 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:28:45.309995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1120097911", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "1f4cebc3-5166-4ca3-bd1b-22fa3064d4a7"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:45.419379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:28:46.126267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-07aa38ef-94b4-43f8-a7c4-d4eeb459aad5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:46.127196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-07aa38ef-94b4-43f8-a7c4-d4eeb459aad5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:46.140526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07aa38ef-94b4-43f8-a7c4-d4eeb459aad5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.141025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07aa38ef-94b4-43f8-a7c4-d4eeb459aad5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.141501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07aa38ef-94b4-43f8-a7c4-d4eeb459aad5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.142212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07aa38ef-94b4-43f8-a7c4-d4eeb459aad5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.142669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07aa38ef-94b4-43f8-a7c4-d4eeb459aad5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.143092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07aa38ef-94b4-43f8-a7c4-d4eeb459aad5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.184490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:46.425935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-07aa38ef-94b4-43f8-a7c4-d4eeb459aad5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:46.435860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:46.437022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:46.437791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:46.438388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:46.439225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:46.467019 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-07aa38ef-94b4-43f8-a7c4-d4eeb459aad5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1198 microversion: 2.1 time: 0.344002 Oct 18 13:28:46.484186 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1356/2864] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:46 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1198 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:46.486517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.487179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.488109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.488906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:46.489630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:46.490655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:46.519877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:46.531152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:46.558058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Going to run 2 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:28:46.565047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: f95363be-8589-49f4-b67e-c4329353ab4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:46.640810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120611) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 18 13:28:46.679003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:46.693890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:46.809995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:46.823429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:46.876701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=f95363be-8589-49f4-b67e-c4329353ab4d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:46.978586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:46.990464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:47.040060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:47.087758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:47.114457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'server_group_members'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:47.210086 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fb61fbb3-f3c8-4025-9ea3-a5796c614987 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.907902 Oct 18 13:28:47.213992 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1509/2865] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:28:45 2022] POST /compute/v2.1/servers => generated 32 bytes in 1912 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:28:47.227185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-81538587-b68e-41c6-91a5-fc9ed76068a1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:47.250955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-81538587-b68e-41c6-91a5-fc9ed76068a1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:47.251671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-81538587-b68e-41c6-91a5-fc9ed76068a1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Searching by: {'deleted': False, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:28:47.309287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81538587-b68e-41c6-91a5-fc9ed76068a1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:47.310087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81538587-b68e-41c6-91a5-fc9ed76068a1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:47.310750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81538587-b68e-41c6-91a5-fc9ed76068a1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:47.311739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81538587-b68e-41c6-91a5-fc9ed76068a1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:47.312813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81538587-b68e-41c6-91a5-fc9ed76068a1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:47.313462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81538587-b68e-41c6-91a5-fc9ed76068a1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:47.359440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-81538587-b68e-41c6-91a5-fc9ed76068a1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:28:47.409666 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-81538587-b68e-41c6-91a5-fc9ed76068a1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.194454 Oct 18 13:28:47.414834 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1357/2866] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 13:28:47 2022] GET /compute/v2.1/servers => generated 1664 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:47.427175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2773f965-2804-4027-b391-505877cc8fc6 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:47.427841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2773f965-2804-4027-b391-505877cc8fc6 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:47.495649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7116ba07-ab23-4373-84aa-e7fa76396e5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:47.496644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7116ba07-ab23-4373-84aa-e7fa76396e5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:47.511820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7116ba07-ab23-4373-84aa-e7fa76396e5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:47.515626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7116ba07-ab23-4373-84aa-e7fa76396e5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:47.516392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7116ba07-ab23-4373-84aa-e7fa76396e5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:47.521923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7116ba07-ab23-4373-84aa-e7fa76396e5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:47.523217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7116ba07-ab23-4373-84aa-e7fa76396e5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:47.523895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7116ba07-ab23-4373-84aa-e7fa76396e5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:48.084571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2773f965-2804-4027-b391-505877cc8fc6 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:48.102856 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2773f965-2804-4027-b391-505877cc8fc6 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1219 microversion: 2.1 time: 0.679752 Oct 18 13:28:48.122196 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1510/2867] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:47 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1219 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:48.345282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e5d8794c-14da-4670-9c88-8e06fbe05156 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:48.360582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e5d8794c-14da-4670-9c88-8e06fbe05156 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:48.361939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e5d8794c-14da-4670-9c88-8e06fbe05156 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Searching by: {'deleted': False, 'project_id': '075e04a2359c4f17a5c7cc521e43b885'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:28:48.372400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5d8794c-14da-4670-9c88-8e06fbe05156 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:48.372869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5d8794c-14da-4670-9c88-8e06fbe05156 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:48.373591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5d8794c-14da-4670-9c88-8e06fbe05156 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:48.374923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5d8794c-14da-4670-9c88-8e06fbe05156 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:48.375564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5d8794c-14da-4670-9c88-8e06fbe05156 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:48.376196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5d8794c-14da-4670-9c88-8e06fbe05156 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:48.584724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7116ba07-ab23-4373-84aa-e7fa76396e5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:48.608346 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7116ba07-ab23-4373-84aa-e7fa76396e5e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1198 microversion: 2.1 time: 1.116848 Oct 18 13:28:48.608959 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1358/2868] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:47 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1198 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:49.130153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1fc989b3-e3cd-4059-8e1d-e1fa9230bd48 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:49.131477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1fc989b3-e3cd-4059-8e1d-e1fa9230bd48 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:49.150020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1fc989b3-e3cd-4059-8e1d-e1fa9230bd48 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.150525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1fc989b3-e3cd-4059-8e1d-e1fa9230bd48 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.151135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1fc989b3-e3cd-4059-8e1d-e1fa9230bd48 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.151846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1fc989b3-e3cd-4059-8e1d-e1fa9230bd48 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.152299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1fc989b3-e3cd-4059-8e1d-e1fa9230bd48 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.152720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1fc989b3-e3cd-4059-8e1d-e1fa9230bd48 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.159418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-e5d8794c-14da-4670-9c88-8e06fbe05156 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:28:49.227673 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e5d8794c-14da-4670-9c88-8e06fbe05156 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.886400 Oct 18 13:28:49.235825 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1511/2869] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 13:28:48 2022] GET /compute/v2.1/servers => generated 339 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:28:49.256466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:49.269779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:49.273775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Searching by: {'deleted': False, 'project_id': '075e04a2359c4f17a5c7cc521e43b885'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:28:49.283503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.284194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.284885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.286011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.286676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.287344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.371370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:28:49.451391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:49.469904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.470616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.471242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.606854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1fc989b3-e3cd-4059-8e1d-e1fa9230bd48 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:49.622307 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1fc989b3-e3cd-4059-8e1d-e1fa9230bd48 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1215 microversion: 2.1 time: 0.495846 Oct 18 13:28:49.630536 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1359/2870] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:49 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1215 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:49.649042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1fee5b6f-7629-4478-a9cb-408e6095e562 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:49.655010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1fee5b6f-7629-4478-a9cb-408e6095e562 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:49.677225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1fee5b6f-7629-4478-a9cb-408e6095e562 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.683321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1fee5b6f-7629-4478-a9cb-408e6095e562 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.683779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1fee5b6f-7629-4478-a9cb-408e6095e562 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:49.691529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1fee5b6f-7629-4478-a9cb-408e6095e562 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:49.696012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1fee5b6f-7629-4478-a9cb-408e6095e562 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:49.700639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1fee5b6f-7629-4478-a9cb-408e6095e562 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.067954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1fee5b6f-7629-4478-a9cb-408e6095e562 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:50.081992 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1fee5b6f-7629-4478-a9cb-408e6095e562 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1198 microversion: 2.1 time: 0.449539 Oct 18 13:28:50.100750 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1360/2871] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:49 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1198 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:50.650020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2573261f-8af0-4eab-85cd-6f231858ae82 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:50.651354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2573261f-8af0-4eab-85cd-6f231858ae82 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:50.667416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2573261f-8af0-4eab-85cd-6f231858ae82 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.668179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2573261f-8af0-4eab-85cd-6f231858ae82 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.669590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2573261f-8af0-4eab-85cd-6f231858ae82 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.671878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2573261f-8af0-4eab-85cd-6f231858ae82 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:50.673096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2573261f-8af0-4eab-85cd-6f231858ae82 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:50.674657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2573261f-8af0-4eab-85cd-6f231858ae82 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:50.751346 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5ef1190f-c473-4344-bcab-e2038e9f7cc6 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 1.504804 Oct 18 13:28:50.753708 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1512/2872] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:28:49 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:50.787821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-850a29c4-afed-4694-8aa4-b0ec09cde9e2 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:50.818680 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-850a29c4-afed-4694-8aa4-b0ec09cde9e2 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036070 Oct 18 13:28:50.822467 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1513/2873] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:28:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:50.898805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2573261f-8af0-4eab-85cd-6f231858ae82 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:50.906951 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2573261f-8af0-4eab-85cd-6f231858ae82 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1271 microversion: 2.1 time: 0.261384 Oct 18 13:28:50.914106 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1361/2874] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:50 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1271 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:51.111158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04316dc7-780e-4aca-878e-5b32f1f57acb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:51.111771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04316dc7-780e-4aca-878e-5b32f1f57acb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:51.134572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-faa6f2b2-8539-48e4-9385-6b373ab23da8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:51.135061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-faa6f2b2-8539-48e4-9385-6b373ab23da8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:51.143970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faa6f2b2-8539-48e4-9385-6b373ab23da8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.144671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faa6f2b2-8539-48e4-9385-6b373ab23da8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.145099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faa6f2b2-8539-48e4-9385-6b373ab23da8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.145823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faa6f2b2-8539-48e4-9385-6b373ab23da8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.146819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faa6f2b2-8539-48e4-9385-6b373ab23da8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.148461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04316dc7-780e-4aca-878e-5b32f1f57acb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.149098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04316dc7-780e-4aca-878e-5b32f1f57acb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.149770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04316dc7-780e-4aca-878e-5b32f1f57acb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.150867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04316dc7-780e-4aca-878e-5b32f1f57acb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.151520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faa6f2b2-8539-48e4-9385-6b373ab23da8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.153730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04316dc7-780e-4aca-878e-5b32f1f57acb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.154345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04316dc7-780e-4aca-878e-5b32f1f57acb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.215545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-faa6f2b2-8539-48e4-9385-6b373ab23da8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:28:51.338282 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-faa6f2b2-8539-48e4-9385-6b373ab23da8 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "DELETE /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 204 len: 0 microversion: 2.1 time: 0.207292 Oct 18 13:28:51.339566 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1362/2875] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:28:51 2022] DELETE /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:28:51.348827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-64bb9ab3-9e89-4013-aa35-2bff0fa25967 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:51.350236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-64bb9ab3-9e89-4013-aa35-2bff0fa25967 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:51.370003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64bb9ab3-9e89-4013-aa35-2bff0fa25967 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.370599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64bb9ab3-9e89-4013-aa35-2bff0fa25967 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.371130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64bb9ab3-9e89-4013-aa35-2bff0fa25967 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.371936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64bb9ab3-9e89-4013-aa35-2bff0fa25967 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.372481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64bb9ab3-9e89-4013-aa35-2bff0fa25967 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.372992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64bb9ab3-9e89-4013-aa35-2bff0fa25967 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.782021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04316dc7-780e-4aca-878e-5b32f1f57acb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:51.804000 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04316dc7-780e-4aca-878e-5b32f1f57acb tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1198 microversion: 2.1 time: 0.696648 Oct 18 13:28:51.806678 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1514/2876] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:51 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1198 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:51.911252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-79b67462-4c09-44e6-bdaf-cc562374bd81 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:51.912773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-79b67462-4c09-44e6-bdaf-cc562374bd81 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:51.927225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79b67462-4c09-44e6-bdaf-cc562374bd81 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.944141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79b67462-4c09-44e6-bdaf-cc562374bd81 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.946748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79b67462-4c09-44e6-bdaf-cc562374bd81 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:51.949744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79b67462-4c09-44e6-bdaf-cc562374bd81 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:51.953465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79b67462-4c09-44e6-bdaf-cc562374bd81 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:51.960779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79b67462-4c09-44e6-bdaf-cc562374bd81 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:52.122266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-64bb9ab3-9e89-4013-aa35-2bff0fa25967 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:52.137148 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-64bb9ab3-9e89-4013-aa35-2bff0fa25967 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1713 microversion: 2.1 time: 0.792249 Oct 18 13:28:52.139082 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1363/2877] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:51 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1713 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:52.149453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c4beaa82-3a2f-4b13-9fb9-12b369b9d9af tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:52.150372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c4beaa82-3a2f-4b13-9fb9-12b369b9d9af tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:52.188042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4beaa82-3a2f-4b13-9fb9-12b369b9d9af tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:52.192722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4beaa82-3a2f-4b13-9fb9-12b369b9d9af tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:52.194129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4beaa82-3a2f-4b13-9fb9-12b369b9d9af tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:52.195073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4beaa82-3a2f-4b13-9fb9-12b369b9d9af tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:52.196078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4beaa82-3a2f-4b13-9fb9-12b369b9d9af tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:52.196868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c4beaa82-3a2f-4b13-9fb9-12b369b9d9af tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:52.435107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79b67462-4c09-44e6-bdaf-cc562374bd81 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:52.446407 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-79b67462-4c09-44e6-bdaf-cc562374bd81 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.544211 Oct 18 13:28:52.446993 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1515/2878] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:51 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:52.476247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c4beaa82-3a2f-4b13-9fb9-12b369b9d9af tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:52.494760 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c4beaa82-3a2f-4b13-9fb9-12b369b9d9af tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1277 microversion: 2.1 time: 0.354380 Oct 18 13:28:52.498330 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1364/2879] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:52 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1277 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:52.509478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-76feb602-7606-4edb-bed2-7336a970f40f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:52.510247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-76feb602-7606-4edb-bed2-7336a970f40f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:52.527501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76feb602-7606-4edb-bed2-7336a970f40f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:52.528000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76feb602-7606-4edb-bed2-7336a970f40f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:52.528440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76feb602-7606-4edb-bed2-7336a970f40f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:52.529154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76feb602-7606-4edb-bed2-7336a970f40f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:52.529639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76feb602-7606-4edb-bed2-7336a970f40f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:52.530066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76feb602-7606-4edb-bed2-7336a970f40f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:52.840152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cef1826e-4c05-4be1-a035-8f5a1eb33a6a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:52.841041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cef1826e-4c05-4be1-a035-8f5a1eb33a6a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:52.851696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cef1826e-4c05-4be1-a035-8f5a1eb33a6a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:52.855108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cef1826e-4c05-4be1-a035-8f5a1eb33a6a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:52.856073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cef1826e-4c05-4be1-a035-8f5a1eb33a6a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:52.857015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cef1826e-4c05-4be1-a035-8f5a1eb33a6a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:52.866678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cef1826e-4c05-4be1-a035-8f5a1eb33a6a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:52.867417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cef1826e-4c05-4be1-a035-8f5a1eb33a6a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:53.476663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-76feb602-7606-4edb-bed2-7336a970f40f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:53.497652 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-76feb602-7606-4edb-bed2-7336a970f40f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 1.016476 Oct 18 13:28:53.502227 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1516/2880] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:52 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:53.514053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-132bbb31-da3a-4b66-8a66-ba332d87598f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:53.515509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-132bbb31-da3a-4b66-8a66-ba332d87598f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:53.542247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-132bbb31-da3a-4b66-8a66-ba332d87598f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:53.543964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-132bbb31-da3a-4b66-8a66-ba332d87598f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:53.546128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-132bbb31-da3a-4b66-8a66-ba332d87598f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:53.547121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-132bbb31-da3a-4b66-8a66-ba332d87598f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:53.549449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-132bbb31-da3a-4b66-8a66-ba332d87598f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:53.550807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-132bbb31-da3a-4b66-8a66-ba332d87598f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:53.945164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cef1826e-4c05-4be1-a035-8f5a1eb33a6a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:53.953799 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cef1826e-4c05-4be1-a035-8f5a1eb33a6a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1198 microversion: 2.1 time: 1.122596 Oct 18 13:28:53.969698 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1365/2881] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:52 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1198 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:53.975293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fea98772-ab48-4202-93e4-fc9d635cd035 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:53.976156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fea98772-ab48-4202-93e4-fc9d635cd035 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:53.998307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fea98772-ab48-4202-93e4-fc9d635cd035 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:53.999046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fea98772-ab48-4202-93e4-fc9d635cd035 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:53.999680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fea98772-ab48-4202-93e4-fc9d635cd035 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:54.000607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fea98772-ab48-4202-93e4-fc9d635cd035 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:54.001233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fea98772-ab48-4202-93e4-fc9d635cd035 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:54.001808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fea98772-ab48-4202-93e4-fc9d635cd035 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:54.516652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-132bbb31-da3a-4b66-8a66-ba332d87598f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:54.534488 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-132bbb31-da3a-4b66-8a66-ba332d87598f tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1713 microversion: 2.1 time: 1.030340 Oct 18 13:28:54.535116 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1517/2882] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:53 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1713 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:54.551269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-081a272d-3eef-415e-b4d3-719097e0078c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:54.554340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-081a272d-3eef-415e-b4d3-719097e0078c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:54.578323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-081a272d-3eef-415e-b4d3-719097e0078c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:54.587055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-081a272d-3eef-415e-b4d3-719097e0078c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:54.587704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-081a272d-3eef-415e-b4d3-719097e0078c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:54.588645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-081a272d-3eef-415e-b4d3-719097e0078c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:54.589119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-081a272d-3eef-415e-b4d3-719097e0078c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:54.589645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-081a272d-3eef-415e-b4d3-719097e0078c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:55.143068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fea98772-ab48-4202-93e4-fc9d635cd035 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:55.148300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=60 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:55.159079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-081a272d-3eef-415e-b4d3-719097e0078c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:55.170902 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-081a272d-3eef-415e-b4d3-719097e0078c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1319 microversion: 2.1 time: 0.634706 Oct 18 13:28:55.172187 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fea98772-ab48-4202-93e4-fc9d635cd035 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 1.196697 Oct 18 13:28:55.172868 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1366/2883] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:53 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:55.177351 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1518/2884] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:54 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1319 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:55.188689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-209f9d35-e58b-4d8c-bbf8-54a92e2801e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:55.189693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-209f9d35-e58b-4d8c-bbf8-54a92e2801e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:55.217897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-209f9d35-e58b-4d8c-bbf8-54a92e2801e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:55.223395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-209f9d35-e58b-4d8c-bbf8-54a92e2801e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:55.224259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-209f9d35-e58b-4d8c-bbf8-54a92e2801e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:55.225889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-209f9d35-e58b-4d8c-bbf8-54a92e2801e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:55.226512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-209f9d35-e58b-4d8c-bbf8-54a92e2801e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:55.227127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-209f9d35-e58b-4d8c-bbf8-54a92e2801e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:55.374167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-926553164", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "957967ef-b16a-4ada-8195-b0481995b464"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:55.473389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] validate_networks() for [('957967ef-b16a-4ada-8195-b0481995b464', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:28:55.495755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-209f9d35-e58b-4d8c-bbf8-54a92e2801e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:55.504782 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-209f9d35-e58b-4d8c-bbf8-54a92e2801e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1198 microversion: 2.1 time: 0.324734 Oct 18 13:28:55.507499 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1519/2885] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:55 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1198 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:55.516991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3645d7cb-e7cd-4573-a8af-cd9e870457cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:55.519181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3645d7cb-e7cd-4573-a8af-cd9e870457cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:55.540925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3645d7cb-e7cd-4573-a8af-cd9e870457cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:55.541601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3645d7cb-e7cd-4573-a8af-cd9e870457cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:55.542147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3645d7cb-e7cd-4573-a8af-cd9e870457cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:55.542975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3645d7cb-e7cd-4573-a8af-cd9e870457cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:55.543538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3645d7cb-e7cd-4573-a8af-cd9e870457cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:55.544268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3645d7cb-e7cd-4573-a8af-cd9e870457cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:55.905610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3645d7cb-e7cd-4573-a8af-cd9e870457cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:55.918128 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3645d7cb-e7cd-4573-a8af-cd9e870457cb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.408661 Oct 18 13:28:55.919305 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1520/2886] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:55 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:55.926306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-906bb46c-073b-4862-8c22-267a64b7d9be tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:55.927436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-906bb46c-073b-4862-8c22-267a64b7d9be tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:55.936392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-906bb46c-073b-4862-8c22-267a64b7d9be tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:55.937561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-906bb46c-073b-4862-8c22-267a64b7d9be tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:55.938348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-906bb46c-073b-4862-8c22-267a64b7d9be tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:55.939710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-906bb46c-073b-4862-8c22-267a64b7d9be tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:55.940483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-906bb46c-073b-4862-8c22-267a64b7d9be tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:55.941233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-906bb46c-073b-4862-8c22-267a64b7d9be tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:56.100780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-906bb46c-073b-4862-8c22-267a64b7d9be tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d35e70a94604d1f9539fa8c91d06353', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075e04a2359c4f17a5c7cc521e43b885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:56.129763 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-906bb46c-073b-4862-8c22-267a64b7d9be tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 200 len: 1362 microversion: 2.1 time: 0.192044 Oct 18 13:28:56.145303 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1521/2887] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:55 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:56.145303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-43d5d242-56d2-4d11-9d29-207e0e6768d4 req-cc5ac6b4-38d1-48d6-937f-4aba0aac2158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477de8bd-778f-4e84-8f0d-5ca5f40c5690", "name": "network-vif-deleted", "tag": "c4112e45-a6d2-4c90-8e19-c4a0ff6b6cf2"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:56.176761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-43d5d242-56d2-4d11-9d29-207e0e6768d4 req-cc5ac6b4-38d1-48d6-937f-4aba0aac2158 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:56.176761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-43d5d242-56d2-4d11-9d29-207e0e6768d4 req-cc5ac6b4-38d1-48d6-937f-4aba0aac2158 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:56.177218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-43d5d242-56d2-4d11-9d29-207e0e6768d4 req-cc5ac6b4-38d1-48d6-937f-4aba0aac2158 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:56.221172 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-43d5d242-56d2-4d11-9d29-207e0e6768d4 req-cc5ac6b4-38d1-48d6-937f-4aba0aac2158 service nova] Creating event network-vif-deleted:c4112e45-a6d2-4c90-8e19-c4a0ff6b6cf2 for instance 477de8bd-778f-4e84-8f0d-5ca5f40c5690 on n-h2-858384-13 Oct 18 13:28:56.239534 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-43d5d242-56d2-4d11-9d29-207e0e6768d4 req-cc5ac6b4-38d1-48d6-937f-4aba0aac2158 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105639 Oct 18 13:28:56.247574 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1522/2888] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:56.274203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-37933c46-854d-4bba-bd64-a64bf9b0e8f9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:56.274922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-37933c46-854d-4bba-bd64-a64bf9b0e8f9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:56.307335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37933c46-854d-4bba-bd64-a64bf9b0e8f9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:56.308031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37933c46-854d-4bba-bd64-a64bf9b0e8f9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:56.308416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37933c46-854d-4bba-bd64-a64bf9b0e8f9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:56.309621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37933c46-854d-4bba-bd64-a64bf9b0e8f9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:56.310428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37933c46-854d-4bba-bd64-a64bf9b0e8f9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:56.311125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37933c46-854d-4bba-bd64-a64bf9b0e8f9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:56.658371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-37933c46-854d-4bba-bd64-a64bf9b0e8f9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:56.670925 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-37933c46-854d-4bba-bd64-a64bf9b0e8f9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1319 microversion: 2.1 time: 0.419494 Oct 18 13:28:56.671737 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1523/2889] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:56 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:56.687637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-370508225", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "fa5737e5-8161-4ff1-a109-dbc177bf4e3a"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:56.765298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] validate_networks() for [('fa5737e5-8161-4ff1-a109-dbc177bf4e3a', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:28:57.321143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:57.321595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:57.322642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:57.322642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:57.323067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:57.333831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:57.335681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:57.336205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:57.336622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:57.337394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:57.337855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:57.338285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:57.371233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Getting quotas for project 452e5b77db474cf9a2b7f6b2abcb6115. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:57.386231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Getting quotas for user 2878f8de95694fe1a9a17ed27b6ba40b and project 452e5b77db474cf9a2b7f6b2abcb6115. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:57.436408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:28:57.439411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:57.552347 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f6ff1c96-5ea2-4700-83c6-f76e2815c73c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.879144 Oct 18 13:28:57.554119 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1524/2890] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:28:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:28:57.559585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-41bde105-bd97-4561-bfff-b8f4217bdf38 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:57.560591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-41bde105-bd97-4561-bfff-b8f4217bdf38 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:57.570821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41bde105-bd97-4561-bfff-b8f4217bdf38 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:57.571639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41bde105-bd97-4561-bfff-b8f4217bdf38 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:57.572244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41bde105-bd97-4561-bfff-b8f4217bdf38 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:57.573133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41bde105-bd97-4561-bfff-b8f4217bdf38 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:57.573773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41bde105-bd97-4561-bfff-b8f4217bdf38 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:57.574353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41bde105-bd97-4561-bfff-b8f4217bdf38 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:57.854117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-41bde105-bd97-4561-bfff-b8f4217bdf38 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:57.867909 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-41bde105-bd97-4561-bfff-b8f4217bdf38 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1198 microversion: 2.1 time: 0.309702 Oct 18 13:28:57.871265 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1525/2891] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:57 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1198 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:57.894242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-450e6dbb-bdf0-4f86-ae89-f8c441dc0a4a req-327c0525-29cd-4167-a430-ce256481828c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969d338f-c468-409d-8d40-db5fb2b273ee", "name": "network-vif-plugged", "status": "completed", "tag": "f734654d-3e14-44d4-bd74-65598fad1317"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:28:57.907236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-450e6dbb-bdf0-4f86-ae89-f8c441dc0a4a req-327c0525-29cd-4167-a430-ce256481828c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:57.907735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-450e6dbb-bdf0-4f86-ae89-f8c441dc0a4a req-327c0525-29cd-4167-a430-ce256481828c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:57.908358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-450e6dbb-bdf0-4f86-ae89-f8c441dc0a4a req-327c0525-29cd-4167-a430-ce256481828c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:57.931694 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-450e6dbb-bdf0-4f86-ae89-f8c441dc0a4a req-327c0525-29cd-4167-a430-ce256481828c service nova] Creating event network-vif-plugged:f734654d-3e14-44d4-bd74-65598fad1317 for instance 969d338f-c468-409d-8d40-db5fb2b273ee on n-h2-858384-13 Oct 18 13:28:57.943099 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-450e6dbb-bdf0-4f86-ae89-f8c441dc0a4a req-327c0525-29cd-4167-a430-ce256481828c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054630 Oct 18 13:28:57.948101 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1526/2892] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:28:57.964878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1657a0d-2a19-4412-93e8-a6e948541e27 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:57.966594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1657a0d-2a19-4412-93e8-a6e948541e27 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] [instance: 477de8bd-778f-4e84-8f0d-5ca5f40c5690] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:57.987100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1657a0d-2a19-4412-93e8-a6e948541e27 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:57.989554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1657a0d-2a19-4412-93e8-a6e948541e27 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:57.991003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1657a0d-2a19-4412-93e8-a6e948541e27 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:57.994665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1657a0d-2a19-4412-93e8-a6e948541e27 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:57.996346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1657a0d-2a19-4412-93e8-a6e948541e27 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:57.998690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1657a0d-2a19-4412-93e8-a6e948541e27 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:58.074258 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-d1657a0d-2a19-4412-93e8-a6e948541e27 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] HTTP exception thrown: Instance 477de8bd-778f-4e84-8f0d-5ca5f40c5690 could not be found. Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1657a0d-2a19-4412-93e8-a6e948541e27 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Request method failure captured: Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 HTTP/1.1 Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqnQoNq9SyNRdx2hYNhEEoHQRzpEWa3odYHyzEyzLSoQZKGvfY0KaAeu9Ienvcok4jpub3Be-UsGwBcq8NiCIGCmsemYvRKbORsD-4jSOMk-faK_kyTUI_tAUefAK-KJiRG_mSS0J5L85GpylUN55BBIJA6U0Pk2T1kmdKwExJ4uBeA Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 075e04a2359c4f17a5c7cc521e43b885 Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersTestManualDisk-1790898635 Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/075e04a2359c4f17a5c7cc521e43b885"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/075e04a2359c4f17a5c7cc521e43b885"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/075e04a2359c4f17a5c7cc521e43b885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_075e04a2359c4f17a5c7cc521e43b885"}]}] Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersTestManualDisk-1790898635 Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 075e04a2359c4f17a5c7cc521e43b885 Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersTestManualDisk-1790898635 Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersTestManualDisk-1790898635-project Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1d35e70a94604d1f9539fa8c91d06353 Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersTestManualDisk-1790898635-project Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 477de8bd-778f-4e84-8f0d-5ca5f40c5690 could not be found. Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '477de8bd-778f-4e84-8f0d-5ca5f40c5690'} Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477de8bd-778f-4e84-8f0d-5ca5f40c5690 could not be found. Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477de8bd-778f-4e84-8f0d-5ca5f40c5690 could not be found. Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:28:58.076222 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:58.081208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:28:58.081208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:28:58.081208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:28:58.081208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:28:58.081208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:28:58.081208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477de8bd-778f-4e84-8f0d-5ca5f40c5690 could not be found. Oct 18 13:28:58.081208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:28:58.081208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1657a0d-2a19-4412-93e8-a6e948541e27 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Returning 404 to user: Instance 477de8bd-778f-4e84-8f0d-5ca5f40c5690 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:28:58.081208 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d1657a0d-2a19-4412-93e8-a6e948541e27 tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690" status: 404 len: 111 microversion: 2.1 time: 0.127540 Oct 18 13:28:58.089490 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1527/2893] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:57 2022] GET /compute/v2.1/servers/477de8bd-778f-4e84-8f0d-5ca5f40c5690 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:28:58.105898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-16f517fc-f036-4910-a37b-42a82aef20c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:58.106528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-16f517fc-f036-4910-a37b-42a82aef20c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:58.272602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-16f517fc-f036-4910-a37b-42a82aef20c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:58.279855 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-16f517fc-f036-4910-a37b-42a82aef20c8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1214 microversion: 2.1 time: 0.189325 Oct 18 13:28:58.280458 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1528/2894] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:58 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1214 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:58.304799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1603dc6c-e97a-44db-af9d-7e0658b05b67 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:58.305847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1603dc6c-e97a-44db-af9d-7e0658b05b67 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:58.321572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1603dc6c-e97a-44db-af9d-7e0658b05b67 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:58.322078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1603dc6c-e97a-44db-af9d-7e0658b05b67 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:58.322520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1603dc6c-e97a-44db-af9d-7e0658b05b67 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:58.323242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1603dc6c-e97a-44db-af9d-7e0658b05b67 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:58.323702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1603dc6c-e97a-44db-af9d-7e0658b05b67 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:58.324137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1603dc6c-e97a-44db-af9d-7e0658b05b67 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:58.537002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:28:58.537648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:28:58.538038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:28:58.538501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:28:58.539038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:28:58.548472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:58.591367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:58.591367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:58.592356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:58.595430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:58.603262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:58.608061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:58.738850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Getting quotas for project c0a33407ead044eb8f22cb67796fe416. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:28:58.757843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Getting quotas for user 7c94468144da455d9a9b7f3bcda39102 and project c0a33407ead044eb8f22cb67796fe416. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:28:58.829312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:28:58.831352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1603dc6c-e97a-44db-af9d-7e0658b05b67 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:58.837228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:28:58.843713 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1603dc6c-e97a-44db-af9d-7e0658b05b67 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1319 microversion: 2.1 time: 0.547059 Oct 18 13:28:58.846586 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1529/2895] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:58 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1319 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:58.859641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-327420d4-20d0-46ea-ba86-ab6cb77c192d tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] Calling method '.version_select at 0x7ff60eecf0d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:58.928333 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-327420d4-20d0-46ea-ba86-ab6cb77c192d tempest-ServersTestManualDisk-1790898635 tempest-ServersTestManualDisk-1790898635-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333962263" status: 202 len: 0 microversion: 2.1 time: 0.078762 Oct 18 13:28:58.929792 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1530/2896] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:28:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333962263 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:28:58.947686 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ffa9e265-0bf4-47fe-afa4-c6a22ceba9f9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.763413 Oct 18 13:28:58.949661 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1367/2897] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:28:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:28:58.952748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a93f8ab5-8593-4ee3-8c58-0830f0675c44 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:58.957363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a93f8ab5-8593-4ee3-8c58-0830f0675c44 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:58.974374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-560945e6-e94c-4a86-9847-86628935a077 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:58.975651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-560945e6-e94c-4a86-9847-86628935a077 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:58.986445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a93f8ab5-8593-4ee3-8c58-0830f0675c44 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:58.987194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a93f8ab5-8593-4ee3-8c58-0830f0675c44 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:58.988750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a93f8ab5-8593-4ee3-8c58-0830f0675c44 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:58.992384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a93f8ab5-8593-4ee3-8c58-0830f0675c44 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:58.993048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a93f8ab5-8593-4ee3-8c58-0830f0675c44 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:58.993680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a93f8ab5-8593-4ee3-8c58-0830f0675c44 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:59.054492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:28:59.261286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-560945e6-e94c-4a86-9847-86628935a077 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:59.269262 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-560945e6-e94c-4a86-9847-86628935a077 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1227 microversion: 2.1 time: 0.301493 Oct 18 13:28:59.274136 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1368/2898] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:58 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1227 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:59.304715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8cbf4ade-85bf-4558-b304-05a836743ff6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:59.305652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8cbf4ade-85bf-4558-b304-05a836743ff6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:59.330866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cbf4ade-85bf-4558-b304-05a836743ff6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:59.333160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cbf4ade-85bf-4558-b304-05a836743ff6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:59.340147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cbf4ade-85bf-4558-b304-05a836743ff6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:59.341409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cbf4ade-85bf-4558-b304-05a836743ff6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:59.342214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cbf4ade-85bf-4558-b304-05a836743ff6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:59.342841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cbf4ade-85bf-4558-b304-05a836743ff6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:59.347114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a93f8ab5-8593-4ee3-8c58-0830f0675c44 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:59.358653 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a93f8ab5-8593-4ee3-8c58-0830f0675c44 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1198 microversion: 2.1 time: 0.427202 Oct 18 13:28:59.360093 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1531/2899] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:58 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1198 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:28:59.669494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8cbf4ade-85bf-4558-b304-05a836743ff6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:28:59.697796 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8cbf4ade-85bf-4558-b304-05a836743ff6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1266 microversion: 2.1 time: 0.389967 Oct 18 13:28:59.705336 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1369/2900] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:59 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1266 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:28:59.878457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0601550e-94b2-4acd-99e5-b39c48c91142 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:28:59.891908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0601550e-94b2-4acd-99e5-b39c48c91142 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:28:59.916095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0601550e-94b2-4acd-99e5-b39c48c91142 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:59.916599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0601550e-94b2-4acd-99e5-b39c48c91142 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:59.917045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0601550e-94b2-4acd-99e5-b39c48c91142 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:28:59.917867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0601550e-94b2-4acd-99e5-b39c48c91142 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:28:59.918329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0601550e-94b2-4acd-99e5-b39c48c91142 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:28:59.918760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0601550e-94b2-4acd-99e5-b39c48c91142 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:00.224537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0601550e-94b2-4acd-99e5-b39c48c91142 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:00.236141 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0601550e-94b2-4acd-99e5-b39c48c91142 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1319 microversion: 2.1 time: 0.365496 Oct 18 13:29:00.237382 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1532/2901] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:28:59 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:00.294359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84b19b45-a24c-4da1-8fa0-64d10c07bb22 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:00.295117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-84b19b45-a24c-4da1-8fa0-64d10c07bb22 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:00.316302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84b19b45-a24c-4da1-8fa0-64d10c07bb22 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.318123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84b19b45-a24c-4da1-8fa0-64d10c07bb22 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.319429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84b19b45-a24c-4da1-8fa0-64d10c07bb22 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:00.326647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84b19b45-a24c-4da1-8fa0-64d10c07bb22 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.356196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84b19b45-a24c-4da1-8fa0-64d10c07bb22 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.356196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84b19b45-a24c-4da1-8fa0-64d10c07bb22 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:00.390641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c642d5f-3828-4c9b-b3ad-7cd9e73f3f75 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:00.391437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c642d5f-3828-4c9b-b3ad-7cd9e73f3f75 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:00.403874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c642d5f-3828-4c9b-b3ad-7cd9e73f3f75 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.404699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c642d5f-3828-4c9b-b3ad-7cd9e73f3f75 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.405254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c642d5f-3828-4c9b-b3ad-7cd9e73f3f75 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:00.406119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c642d5f-3828-4c9b-b3ad-7cd9e73f3f75 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.406835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c642d5f-3828-4c9b-b3ad-7cd9e73f3f75 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.408363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c642d5f-3828-4c9b-b3ad-7cd9e73f3f75 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:00.541796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-84b19b45-a24c-4da1-8fa0-64d10c07bb22 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:00.594111 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-84b19b45-a24c-4da1-8fa0-64d10c07bb22 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1223 microversion: 2.1 time: 0.304938 Oct 18 13:29:00.597853 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1370/2902] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:00 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1223 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:00.774651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-61e814c5-de06-40dc-b07b-46959205f018 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Action: 'create', calling method: .version_select at 0x7ff60ee37f70>, body: {"keypair": {"name": "tempest-keypair-905784993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOz7IidaIvtf3JN8TiCf+TQliV6PPueJcwLqW/bS6gemQrqOBkKlHaWoAwlb5Lm/nOvPgw92vBSenm5otC3AW8+j94bqgZdXej+BOXhqL2W1cXMgI9vY8Rx9cSRBqdWvaw=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:00.830679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-61e814c5-de06-40dc-b07b-46959205f018 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Getting quotas for project d2002f3acb0b4230b26d590df9095f11. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:00.840225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3c642d5f-3828-4c9b-b3ad-7cd9e73f3f75 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:00.857149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-61e814c5-de06-40dc-b07b-46959205f018 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Getting quotas for user c2f8a6c491a443c2be1cb6fad5e336fa and project d2002f3acb0b4230b26d590df9095f11. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:00.870917 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c642d5f-3828-4c9b-b3ad-7cd9e73f3f75 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1382 microversion: 2.1 time: 0.484875 Oct 18 13:29:00.887155 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1533/2903] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:00 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1382 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:00.898831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-683099ed-2981-4b56-8086-ef41caa57c44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:00.908364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-683099ed-2981-4b56-8086-ef41caa57c44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:00.930849 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-61e814c5-de06-40dc-b07b-46959205f018 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.328741 Oct 18 13:29:00.936514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-683099ed-2981-4b56-8086-ef41caa57c44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.943626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-683099ed-2981-4b56-8086-ef41caa57c44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.946768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-683099ed-2981-4b56-8086-ef41caa57c44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:00.947793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-683099ed-2981-4b56-8086-ef41caa57c44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.948213 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1371/2904] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:29:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:00.960800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-683099ed-2981-4b56-8086-ef41caa57c44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.961885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-277285bf-e2ab-4fc3-88da-f665c045dd7d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:00.962795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-683099ed-2981-4b56-8086-ef41caa57c44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:00.963880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-277285bf-e2ab-4fc3-88da-f665c045dd7d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:00.992714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-277285bf-e2ab-4fc3-88da-f665c045dd7d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:00.994574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-277285bf-e2ab-4fc3-88da-f665c045dd7d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:00.996528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-277285bf-e2ab-4fc3-88da-f665c045dd7d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.000029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-277285bf-e2ab-4fc3-88da-f665c045dd7d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.002983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-277285bf-e2ab-4fc3-88da-f665c045dd7d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.003530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-277285bf-e2ab-4fc3-88da-f665c045dd7d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.148020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-683099ed-2981-4b56-8086-ef41caa57c44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:01.171745 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-683099ed-2981-4b56-8086-ef41caa57c44 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1272 microversion: 2.1 time: 0.277320 Oct 18 13:29:01.173311 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1534/2905] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:00 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1272 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:01.185889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-fc541316-47fd-4274-8edd-46075ac7f3bb req-77f0bfbe-704d-43c8-b630-2feeee998422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f95363be-8589-49f4-b67e-c4329353ab4d", "tag": "33dfd4a6-9d84-4219-a3c9-213dce92ae9e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:01.213314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fc541316-47fd-4274-8edd-46075ac7f3bb req-77f0bfbe-704d-43c8-b630-2feeee998422 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.214148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fc541316-47fd-4274-8edd-46075ac7f3bb req-77f0bfbe-704d-43c8-b630-2feeee998422 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.214906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fc541316-47fd-4274-8edd-46075ac7f3bb req-77f0bfbe-704d-43c8-b630-2feeee998422 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.244206 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-fc541316-47fd-4274-8edd-46075ac7f3bb req-77f0bfbe-704d-43c8-b630-2feeee998422 service nova] Creating event network-changed:33dfd4a6-9d84-4219-a3c9-213dce92ae9e for instance f95363be-8589-49f4-b67e-c4329353ab4d on n-h1-858384-13 Oct 18 13:29:01.256681 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-fc541316-47fd-4274-8edd-46075ac7f3bb req-77f0bfbe-704d-43c8-b630-2feeee998422 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078052 Oct 18 13:29:01.259117 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1535/2906] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:01.275758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-028f4577-81d9-4260-86af-ace7d963e7ba tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:01.277122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-028f4577-81d9-4260-86af-ace7d963e7ba tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:01.292027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-028f4577-81d9-4260-86af-ace7d963e7ba tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.293099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-028f4577-81d9-4260-86af-ace7d963e7ba tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.293986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-028f4577-81d9-4260-86af-ace7d963e7ba tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.295132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-028f4577-81d9-4260-86af-ace7d963e7ba tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.296169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-028f4577-81d9-4260-86af-ace7d963e7ba tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.296917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-028f4577-81d9-4260-86af-ace7d963e7ba tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.556743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-028f4577-81d9-4260-86af-ace7d963e7ba tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:01.572081 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-028f4577-81d9-4260-86af-ace7d963e7ba tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1319 microversion: 2.1 time: 0.308441 Oct 18 13:29:01.587353 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1536/2907] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:01 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:01.631185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b17da7ac-5bcb-461e-8721-a118957d0594 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:01.632408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b17da7ac-5bcb-461e-8721-a118957d0594 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:01.645300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b17da7ac-5bcb-461e-8721-a118957d0594 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.646345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b17da7ac-5bcb-461e-8721-a118957d0594 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.647017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b17da7ac-5bcb-461e-8721-a118957d0594 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.652935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b17da7ac-5bcb-461e-8721-a118957d0594 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.653912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b17da7ac-5bcb-461e-8721-a118957d0594 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.656006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b17da7ac-5bcb-461e-8721-a118957d0594 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.788218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b17da7ac-5bcb-461e-8721-a118957d0594 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:01.804765 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b17da7ac-5bcb-461e-8721-a118957d0594 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1297 microversion: 2.1 time: 0.177963 Oct 18 13:29:01.805674 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1537/2908] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:01 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1297 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:01.906010 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-277285bf-e2ab-4fc3-88da-f665c045dd7d tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1535 microversion: 2.1 time: 0.955545 Oct 18 13:29:01.906992 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1372/2909] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:00 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1535 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:01.935035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-feab3c4f-5377-45da-be25-a7c40565a5ba tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:01.935651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-feab3c4f-5377-45da-be25-a7c40565a5ba tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:01.952272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-feab3c4f-5377-45da-be25-a7c40565a5ba tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.953052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-feab3c4f-5377-45da-be25-a7c40565a5ba tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.953803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-feab3c4f-5377-45da-be25-a7c40565a5ba tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:01.954679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-feab3c4f-5377-45da-be25-a7c40565a5ba tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:01.955302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-feab3c4f-5377-45da-be25-a7c40565a5ba tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:01.955932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-feab3c4f-5377-45da-be25-a7c40565a5ba tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.201781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3c6ae161-d8f7-407c-8958-c1a209c2878b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:02.202445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3c6ae161-d8f7-407c-8958-c1a209c2878b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:02.217421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c6ae161-d8f7-407c-8958-c1a209c2878b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.218172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c6ae161-d8f7-407c-8958-c1a209c2878b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.220489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c6ae161-d8f7-407c-8958-c1a209c2878b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.222039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c6ae161-d8f7-407c-8958-c1a209c2878b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.222677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c6ae161-d8f7-407c-8958-c1a209c2878b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.223887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c6ae161-d8f7-407c-8958-c1a209c2878b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.276178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:02.339870 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-feab3c4f-5377-45da-be25-a7c40565a5ba tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1535 microversion: 2.1 time: 0.403640 Oct 18 13:29:02.340450 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1538/2910] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:01 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1535 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:02.367063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-59ad19f0-adc5-4ff1-b83a-482f4f6e48cf tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:02.377449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59ad19f0-adc5-4ff1-b83a-482f4f6e48cf tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.378404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59ad19f0-adc5-4ff1-b83a-482f4f6e48cf tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.379040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59ad19f0-adc5-4ff1-b83a-482f4f6e48cf tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.380057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59ad19f0-adc5-4ff1-b83a-482f4f6e48cf tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.395434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59ad19f0-adc5-4ff1-b83a-482f4f6e48cf tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.396389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59ad19f0-adc5-4ff1-b83a-482f4f6e48cf tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.452671 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-59ad19f0-adc5-4ff1-b83a-482f4f6e48cf tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.090014 Oct 18 13:29:02.453641 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1539/2911] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 18 13:29:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:02.475788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fafebb32-7ac1-4fd9-af31-bb36a9847c3a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-13", "block_migration": false, "disk_over_commit": false}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:02.483260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fafebb32-7ac1-4fd9-af31-bb36a9847c3a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:02.507577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fafebb32-7ac1-4fd9-af31-bb36a9847c3a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.508455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fafebb32-7ac1-4fd9-af31-bb36a9847c3a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.509101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fafebb32-7ac1-4fd9-af31-bb36a9847c3a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.510076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fafebb32-7ac1-4fd9-af31-bb36a9847c3a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:02.510775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fafebb32-7ac1-4fd9-af31-bb36a9847c3a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:02.511439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fafebb32-7ac1-4fd9-af31-bb36a9847c3a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:02.588296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-fafebb32-7ac1-4fd9-af31-bb36a9847c3a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lazy-loading 'flavor' on Instance uuid 969d338f-c468-409d-8d40-db5fb2b273ee {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:02.622304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fafebb32-7ac1-4fd9-af31-bb36a9847c3a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Going to try to live migrate instance to n-h1-858384-13 {{(pid=120611) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 13:29:03.306603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3c6ae161-d8f7-407c-8958-c1a209c2878b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:03.326381 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3c6ae161-d8f7-407c-8958-c1a209c2878b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1314 microversion: 2.1 time: 1.130914 Oct 18 13:29:03.327298 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1373/2912] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:02 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1314 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:03.340830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3281bcdc-aa4d-480d-8624-ee9dd8fd35c4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:03.341933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3281bcdc-aa4d-480d-8624-ee9dd8fd35c4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:03.353689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3281bcdc-aa4d-480d-8624-ee9dd8fd35c4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:03.354770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3281bcdc-aa4d-480d-8624-ee9dd8fd35c4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:03.355420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3281bcdc-aa4d-480d-8624-ee9dd8fd35c4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:03.358008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3281bcdc-aa4d-480d-8624-ee9dd8fd35c4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:03.359071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3281bcdc-aa4d-480d-8624-ee9dd8fd35c4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:03.359712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3281bcdc-aa4d-480d-8624-ee9dd8fd35c4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.340729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3281bcdc-aa4d-480d-8624-ee9dd8fd35c4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:04.358298 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3281bcdc-aa4d-480d-8624-ee9dd8fd35c4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1319 microversion: 2.1 time: 1.029311 Oct 18 13:29:04.359625 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1374/2913] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:03 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1319 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:04.377433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb65ee00-fb25-480b-8e6c-f788fa40df01 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:04.378312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb65ee00-fb25-480b-8e6c-f788fa40df01 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:04.387060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb65ee00-fb25-480b-8e6c-f788fa40df01 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.392567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb65ee00-fb25-480b-8e6c-f788fa40df01 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.393323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb65ee00-fb25-480b-8e6c-f788fa40df01 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.394238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb65ee00-fb25-480b-8e6c-f788fa40df01 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.394850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb65ee00-fb25-480b-8e6c-f788fa40df01 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.398327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb65ee00-fb25-480b-8e6c-f788fa40df01 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.760269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fb65ee00-fb25-480b-8e6c-f788fa40df01 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:04.769346 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb65ee00-fb25-480b-8e6c-f788fa40df01 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1285 microversion: 2.1 time: 0.408465 Oct 18 13:29:04.782042 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1375/2914] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:04 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1285 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:04.787934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-535168f3-6736-49d5-8b76-b1dc69aef7be req-1792cd21-38db-4156-97d9-78d468e224bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f9fab1-89bc-4227-a832-a4306f609784", "tag": "2e329f36-eac9-421b-9ccb-6d67f90e37ef"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:04.809034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-535168f3-6736-49d5-8b76-b1dc69aef7be req-1792cd21-38db-4156-97d9-78d468e224bb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.809540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-535168f3-6736-49d5-8b76-b1dc69aef7be req-1792cd21-38db-4156-97d9-78d468e224bb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.809976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-535168f3-6736-49d5-8b76-b1dc69aef7be req-1792cd21-38db-4156-97d9-78d468e224bb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.832110 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-535168f3-6736-49d5-8b76-b1dc69aef7be req-1792cd21-38db-4156-97d9-78d468e224bb service nova] Creating event network-changed:2e329f36-eac9-421b-9ccb-6d67f90e37ef for instance 20f9fab1-89bc-4227-a832-a4306f609784 on n-h2-858384-13 Oct 18 13:29:04.848845 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-535168f3-6736-49d5-8b76-b1dc69aef7be req-1792cd21-38db-4156-97d9-78d468e224bb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065073 Oct 18 13:29:04.850684 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1376/2915] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:04.857344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-93bf2125-e5f1-4be5-a604-88adcb001eb6 req-1a407cda-3d28-473e-9adb-73578106fe36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a", "tag": "b7079b74-4b6a-4fa3-a3ae-3342a2ace45a"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:04.879341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-93bf2125-e5f1-4be5-a604-88adcb001eb6 req-1a407cda-3d28-473e-9adb-73578106fe36 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.887123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-93bf2125-e5f1-4be5-a604-88adcb001eb6 req-1a407cda-3d28-473e-9adb-73578106fe36 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.888087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-93bf2125-e5f1-4be5-a604-88adcb001eb6 req-1a407cda-3d28-473e-9adb-73578106fe36 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.914913 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-93bf2125-e5f1-4be5-a604-88adcb001eb6 req-1a407cda-3d28-473e-9adb-73578106fe36 service nova] Creating event network-changed:b7079b74-4b6a-4fa3-a3ae-3342a2ace45a for instance 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a on n-h2-858384-13 Oct 18 13:29:04.920325 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-93bf2125-e5f1-4be5-a604-88adcb001eb6 req-1a407cda-3d28-473e-9adb-73578106fe36 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068058 Oct 18 13:29:04.921631 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1377/2916] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:04.940320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f0558360-6a8b-4277-a33f-e076a71c6e41 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:04.946252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f0558360-6a8b-4277-a33f-e076a71c6e41 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:04.967966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f0558360-6a8b-4277-a33f-e076a71c6e41 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.968986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f0558360-6a8b-4277-a33f-e076a71c6e41 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.980662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f0558360-6a8b-4277-a33f-e076a71c6e41 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:04.981684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f0558360-6a8b-4277-a33f-e076a71c6e41 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:04.984661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f0558360-6a8b-4277-a33f-e076a71c6e41 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:04.985408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f0558360-6a8b-4277-a33f-e076a71c6e41 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.736474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f0558360-6a8b-4277-a33f-e076a71c6e41 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:05.759031 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f0558360-6a8b-4277-a33f-e076a71c6e41 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1314 microversion: 2.1 time: 0.835651 Oct 18 13:29:05.775112 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1378/2917] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:04 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1314 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:05.789499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af603095-503d-4c4c-90b8-562b70aa44e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:05.790194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-af603095-503d-4c4c-90b8-562b70aa44e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:05.812111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af603095-503d-4c4c-90b8-562b70aa44e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.813460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af603095-503d-4c4c-90b8-562b70aa44e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.813917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af603095-503d-4c4c-90b8-562b70aa44e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.814563 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fafebb32-7ac1-4fd9-af31-bb36a9847c3a tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee/action" status: 202 len: 0 microversion: 2.1 time: 3.348046 Oct 18 13:29:05.815800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af603095-503d-4c4c-90b8-562b70aa44e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.817009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af603095-503d-4c4c-90b8-562b70aa44e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.818191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af603095-503d-4c4c-90b8-562b70aa44e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.820862 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1540/2918] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:29:02 2022] POST /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee/action => generated 0 bytes in 3356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:05.827380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9763d7b9-bc50-4946-b10a-0992f1a8944f tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:05.833749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9763d7b9-bc50-4946-b10a-0992f1a8944f tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:05.881665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:05.886565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9763d7b9-bc50-4946-b10a-0992f1a8944f tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.887423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9763d7b9-bc50-4946-b10a-0992f1a8944f tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.888160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9763d7b9-bc50-4946-b10a-0992f1a8944f tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:05.905133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9763d7b9-bc50-4946-b10a-0992f1a8944f tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:05.907994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9763d7b9-bc50-4946-b10a-0992f1a8944f tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:05.908984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9763d7b9-bc50-4946-b10a-0992f1a8944f tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:06.317043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9763d7b9-bc50-4946-b10a-0992f1a8944f tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:06.330037 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9763d7b9-bc50-4946-b10a-0992f1a8944f tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1327 microversion: 2.1 time: 0.507819 Oct 18 13:29:06.347203 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1541/2919] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:05 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1327 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:06.360157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6c36e2ea-ce5b-4453-b359-3f4d5fea3495 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:06.366744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6c36e2ea-ce5b-4453-b359-3f4d5fea3495 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:06.372442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-af603095-503d-4c4c-90b8-562b70aa44e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:06.380290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c36e2ea-ce5b-4453-b359-3f4d5fea3495 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:06.381746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c36e2ea-ce5b-4453-b359-3f4d5fea3495 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:06.384174 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-af603095-503d-4c4c-90b8-562b70aa44e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1319 microversion: 2.1 time: 0.603464 Oct 18 13:29:06.384940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c36e2ea-ce5b-4453-b359-3f4d5fea3495 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:06.386567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c36e2ea-ce5b-4453-b359-3f4d5fea3495 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:06.387260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c36e2ea-ce5b-4453-b359-3f4d5fea3495 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:06.387902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c36e2ea-ce5b-4453-b359-3f4d5fea3495 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:06.390308 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1379/2920] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:05 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1319 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:06.758266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6c36e2ea-ce5b-4453-b359-3f4d5fea3495 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:06.767437 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6c36e2ea-ce5b-4453-b359-3f4d5fea3495 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.415878 Oct 18 13:29:06.779671 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1542/2921] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:06 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:06.792804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d390ab1e-e559-4f3b-8140-b0b1b94f28ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:06.793560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d390ab1e-e559-4f3b-8140-b0b1b94f28ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:06.800447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d390ab1e-e559-4f3b-8140-b0b1b94f28ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:06.801713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d390ab1e-e559-4f3b-8140-b0b1b94f28ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:06.802453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d390ab1e-e559-4f3b-8140-b0b1b94f28ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:06.804175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d390ab1e-e559-4f3b-8140-b0b1b94f28ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:06.804845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d390ab1e-e559-4f3b-8140-b0b1b94f28ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:06.805802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d390ab1e-e559-4f3b-8140-b0b1b94f28ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:07.348261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "cf4187e9-5568-4943-94a6-b64f72ffd895"}], "security_groups": [{"name": "tempest-securitygroup--1448488753"}], "key_name": "tempest-keypair-905784993", "user_data": "}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:07.580274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] validate_networks() for [('cf4187e9-5568-4943-94a6-b64f72ffd895', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:29:08.100555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d390ab1e-e559-4f3b-8140-b0b1b94f28ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:08.109032 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d390ab1e-e559-4f3b-8140-b0b1b94f28ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1314 microversion: 2.1 time: 1.320119 Oct 18 13:29:08.122008 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1380/2922] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:06 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1314 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:08.136145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41b830b4-7cd9-44aa-ba9c-798686ffb374 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:08.139288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-41b830b4-7cd9-44aa-ba9c-798686ffb374 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:08.150801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41b830b4-7cd9-44aa-ba9c-798686ffb374 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.151579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41b830b4-7cd9-44aa-ba9c-798686ffb374 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.152346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41b830b4-7cd9-44aa-ba9c-798686ffb374 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.153272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41b830b4-7cd9-44aa-ba9c-798686ffb374 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.153943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41b830b4-7cd9-44aa-ba9c-798686ffb374 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.155056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41b830b4-7cd9-44aa-ba9c-798686ffb374 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.279427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=34 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:08.457491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:29:08.458071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:29:08.458907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:29:08.459448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:29:08.459892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:29:08.485815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.488897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.489431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.494060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.494808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.495427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.541133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Getting quotas for project d2002f3acb0b4230b26d590df9095f11. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:08.549435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Getting quotas for user c2f8a6c491a443c2be1cb6fad5e336fa and project d2002f3acb0b4230b26d590df9095f11. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:08.578123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:29:08.583236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:29:08.671351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:08.683942 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6f7cffb4-c48c-49e8-b2c0-85de99f0248d tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.335303 Oct 18 13:29:08.686126 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1543/2923] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:29:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:29:08.697949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2b46b4e3-e20a-40a7-8c95-8ba5d0aca1d5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:08.698936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2b46b4e3-e20a-40a7-8c95-8ba5d0aca1d5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:08.711297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b46b4e3-e20a-40a7-8c95-8ba5d0aca1d5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.711799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b46b4e3-e20a-40a7-8c95-8ba5d0aca1d5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.712250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b46b4e3-e20a-40a7-8c95-8ba5d0aca1d5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.712969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b46b4e3-e20a-40a7-8c95-8ba5d0aca1d5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:08.713460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b46b4e3-e20a-40a7-8c95-8ba5d0aca1d5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:08.729525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b46b4e3-e20a-40a7-8c95-8ba5d0aca1d5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:08.970938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2b46b4e3-e20a-40a7-8c95-8ba5d0aca1d5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:08.984697 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2b46b4e3-e20a-40a7-8c95-8ba5d0aca1d5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1319 microversion: 2.1 time: 0.296999 Oct 18 13:29:08.986260 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1544/2924] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:08 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:08.991777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f58d01c3-ae93-4766-b8b8-a767d60525fe tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:08.992797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f58d01c3-ae93-4766-b8b8-a767d60525fe tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:09.000871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f58d01c3-ae93-4766-b8b8-a767d60525fe tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.001705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f58d01c3-ae93-4766-b8b8-a767d60525fe tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.002363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f58d01c3-ae93-4766-b8b8-a767d60525fe tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.004506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f58d01c3-ae93-4766-b8b8-a767d60525fe tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.005214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f58d01c3-ae93-4766-b8b8-a767d60525fe tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.006253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f58d01c3-ae93-4766-b8b8-a767d60525fe tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.219459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-41b830b4-7cd9-44aa-ba9c-798686ffb374 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:09.230040 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-41b830b4-7cd9-44aa-ba9c-798686ffb374 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1327 microversion: 2.1 time: 1.106534 Oct 18 13:29:09.230606 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1381/2925] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:08 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1327 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:09.253159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0030922d-eb23-403d-9f86-2ebef2a24906 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:09.260406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0030922d-eb23-403d-9f86-2ebef2a24906 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:09.270657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f58d01c3-ae93-4766-b8b8-a767d60525fe tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:09.295013 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f58d01c3-ae93-4766-b8b8-a767d60525fe tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.305414 Oct 18 13:29:09.298029 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1545/2926] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:08 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:09.318988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d156b865-4cb2-4c60-a083-8499741d4ebb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:09.319962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d156b865-4cb2-4c60-a083-8499741d4ebb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:09.335280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d156b865-4cb2-4c60-a083-8499741d4ebb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.336233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d156b865-4cb2-4c60-a083-8499741d4ebb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.340914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d156b865-4cb2-4c60-a083-8499741d4ebb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.344378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d156b865-4cb2-4c60-a083-8499741d4ebb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.345248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d156b865-4cb2-4c60-a083-8499741d4ebb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.345807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d156b865-4cb2-4c60-a083-8499741d4ebb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.567641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d156b865-4cb2-4c60-a083-8499741d4ebb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:09.580800 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d156b865-4cb2-4c60-a083-8499741d4ebb tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1314 microversion: 2.1 time: 0.280537 Oct 18 13:29:09.582260 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1546/2927] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:09 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:09.714693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0030922d-eb23-403d-9f86-2ebef2a24906 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:09.722455 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0030922d-eb23-403d-9f86-2ebef2a24906 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1225 microversion: 2.1 time: 0.484260 Oct 18 13:29:09.726008 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1382/2928] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:09 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1225 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:09.912629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c7b94b22-9fcd-4a7a-803c-c056eeda2016 req-0a5f4108-1710-4e34-bfc2-39da74b03c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f9fab1-89bc-4227-a832-a4306f609784", "name": "network-vif-plugged", "status": "completed", "tag": "2e329f36-eac9-421b-9ccb-6d67f90e37ef"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:09.931947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c7b94b22-9fcd-4a7a-803c-c056eeda2016 req-0a5f4108-1710-4e34-bfc2-39da74b03c8d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:09.932427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c7b94b22-9fcd-4a7a-803c-c056eeda2016 req-0a5f4108-1710-4e34-bfc2-39da74b03c8d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:09.932863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c7b94b22-9fcd-4a7a-803c-c056eeda2016 req-0a5f4108-1710-4e34-bfc2-39da74b03c8d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:09.974913 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c7b94b22-9fcd-4a7a-803c-c056eeda2016 req-0a5f4108-1710-4e34-bfc2-39da74b03c8d service nova] Creating event network-vif-plugged:2e329f36-eac9-421b-9ccb-6d67f90e37ef for instance 20f9fab1-89bc-4227-a832-a4306f609784 on n-h2-858384-13 Oct 18 13:29:09.994437 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c7b94b22-9fcd-4a7a-803c-c056eeda2016 req-0a5f4108-1710-4e34-bfc2-39da74b03c8d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086809 Oct 18 13:29:09.995054 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1547/2929] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:10.011434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5aac50c8-3e30-4f99-be3d-181cd8531691 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:10.012509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5aac50c8-3e30-4f99-be3d-181cd8531691 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:10.035235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5aac50c8-3e30-4f99-be3d-181cd8531691 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.038303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5aac50c8-3e30-4f99-be3d-181cd8531691 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.039412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5aac50c8-3e30-4f99-be3d-181cd8531691 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.050808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5aac50c8-3e30-4f99-be3d-181cd8531691 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.052174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5aac50c8-3e30-4f99-be3d-181cd8531691 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.054335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5aac50c8-3e30-4f99-be3d-181cd8531691 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.267428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-15868e15-0eb9-47d9-8477-62ddcca820f1 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:10.269236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-15868e15-0eb9-47d9-8477-62ddcca820f1 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:10.304678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15868e15-0eb9-47d9-8477-62ddcca820f1 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.305222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15868e15-0eb9-47d9-8477-62ddcca820f1 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.305935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15868e15-0eb9-47d9-8477-62ddcca820f1 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.306667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15868e15-0eb9-47d9-8477-62ddcca820f1 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.310404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15868e15-0eb9-47d9-8477-62ddcca820f1 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.311060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15868e15-0eb9-47d9-8477-62ddcca820f1 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.338630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:10.662930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-15868e15-0eb9-47d9-8477-62ddcca820f1 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:10.676560 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-15868e15-0eb9-47d9-8477-62ddcca820f1 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1327 microversion: 2.1 time: 0.416421 Oct 18 13:29:10.678824 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1548/2930] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:10 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1327 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:10.694930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6b771a75-3a53-4193-bc9f-1e044470df42 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:10.696159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6b771a75-3a53-4193-bc9f-1e044470df42 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:10.710354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b771a75-3a53-4193-bc9f-1e044470df42 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.711247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b771a75-3a53-4193-bc9f-1e044470df42 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.712091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b771a75-3a53-4193-bc9f-1e044470df42 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.713010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b771a75-3a53-4193-bc9f-1e044470df42 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.713742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b771a75-3a53-4193-bc9f-1e044470df42 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.714508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b771a75-3a53-4193-bc9f-1e044470df42 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.939794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6b771a75-3a53-4193-bc9f-1e044470df42 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:10.951509 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6b771a75-3a53-4193-bc9f-1e044470df42 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.270504 Oct 18 13:29:10.952040 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1549/2931] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:10 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:10.979643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a5782588-b121-4306-8a8b-df88ed45e8c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:10.980737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a5782588-b121-4306-8a8b-df88ed45e8c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:10.990587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5782588-b121-4306-8a8b-df88ed45e8c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.991585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5782588-b121-4306-8a8b-df88ed45e8c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.992372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5782588-b121-4306-8a8b-df88ed45e8c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:10.994455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5782588-b121-4306-8a8b-df88ed45e8c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:10.995096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5782588-b121-4306-8a8b-df88ed45e8c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:10.996000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5782588-b121-4306-8a8b-df88ed45e8c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:11.237011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a5782588-b121-4306-8a8b-df88ed45e8c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:11.248580 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a5782588-b121-4306-8a8b-df88ed45e8c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1314 microversion: 2.1 time: 0.275153 Oct 18 13:29:11.251562 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1550/2932] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:10 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:11.265905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13f844a3-1a8f-4562-aaae-f95572896227 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:11.277081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-13f844a3-1a8f-4562-aaae-f95572896227 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:11.299941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13f844a3-1a8f-4562-aaae-f95572896227 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:11.301313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13f844a3-1a8f-4562-aaae-f95572896227 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:11.301923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13f844a3-1a8f-4562-aaae-f95572896227 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:11.306942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13f844a3-1a8f-4562-aaae-f95572896227 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:11.308242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13f844a3-1a8f-4562-aaae-f95572896227 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:11.308461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13f844a3-1a8f-4562-aaae-f95572896227 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:11.458179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-13f844a3-1a8f-4562-aaae-f95572896227 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:11.475662 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13f844a3-1a8f-4562-aaae-f95572896227 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1295 microversion: 2.1 time: 0.217801 Oct 18 13:29:11.477032 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1551/2933] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:11 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1295 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:11.694158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5aac50c8-3e30-4f99-be3d-181cd8531691 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:11.704236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-de82836f-0cd8-47ae-abae-1b6bf502f65d tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:11.705002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-de82836f-0cd8-47ae-abae-1b6bf502f65d tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:11.705708 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5aac50c8-3e30-4f99-be3d-181cd8531691 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1319 microversion: 2.1 time: 1.701153 Oct 18 13:29:11.709256 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1383/2934] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:10 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1319 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:11.724725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de82836f-0cd8-47ae-abae-1b6bf502f65d tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:11.726690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de82836f-0cd8-47ae-abae-1b6bf502f65d tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:11.727114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de82836f-0cd8-47ae-abae-1b6bf502f65d tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:11.727875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de82836f-0cd8-47ae-abae-1b6bf502f65d tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:11.733335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de82836f-0cd8-47ae-abae-1b6bf502f65d tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:11.734242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de82836f-0cd8-47ae-abae-1b6bf502f65d tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:11.981686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f809d451-a333-4adb-9738-29c3c03fcc55 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:11.983050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f809d451-a333-4adb-9738-29c3c03fcc55 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:11.997161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f809d451-a333-4adb-9738-29c3c03fcc55 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:11.999380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f809d451-a333-4adb-9738-29c3c03fcc55 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:12.000305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f809d451-a333-4adb-9738-29c3c03fcc55 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:12.002392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f809d451-a333-4adb-9738-29c3c03fcc55 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:12.004046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f809d451-a333-4adb-9738-29c3c03fcc55 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:12.007249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f809d451-a333-4adb-9738-29c3c03fcc55 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:12.795067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f809d451-a333-4adb-9738-29c3c03fcc55 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:12.803867 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f809d451-a333-4adb-9738-29c3c03fcc55 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.827223 Oct 18 13:29:12.822578 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1384/2935] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:11 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:12.835935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-11b615c6-2c68-444e-ae01-9fa9307b6efa req-768645b7-ffae-4ec3-b574-8340676b9de8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba16c299-3b2e-481a-99f0-89e02c0c7642", "tag": "b8c58ecb-c9f8-44fe-a484-01aaf1be4c74"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:12.902839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-11b615c6-2c68-444e-ae01-9fa9307b6efa req-768645b7-ffae-4ec3-b574-8340676b9de8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:12.916607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-11b615c6-2c68-444e-ae01-9fa9307b6efa req-768645b7-ffae-4ec3-b574-8340676b9de8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:12.917312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-11b615c6-2c68-444e-ae01-9fa9307b6efa req-768645b7-ffae-4ec3-b574-8340676b9de8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:12.969349 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-11b615c6-2c68-444e-ae01-9fa9307b6efa req-768645b7-ffae-4ec3-b574-8340676b9de8 service nova] Creating event network-changed:b8c58ecb-c9f8-44fe-a484-01aaf1be4c74 for instance ba16c299-3b2e-481a-99f0-89e02c0c7642 on n-h2-858384-13 Oct 18 13:29:12.982471 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-11b615c6-2c68-444e-ae01-9fa9307b6efa req-768645b7-ffae-4ec3-b574-8340676b9de8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158015 Oct 18 13:29:12.984165 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1385/2936] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:12.990704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6ba503a8-e3f2-45a7-b9e4-8182222589ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:12.991640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6ba503a8-e3f2-45a7-b9e4-8182222589ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:13.000220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ba503a8-e3f2-45a7-b9e4-8182222589ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.000927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ba503a8-e3f2-45a7-b9e4-8182222589ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.001595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ba503a8-e3f2-45a7-b9e4-8182222589ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.002538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ba503a8-e3f2-45a7-b9e4-8182222589ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.004296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ba503a8-e3f2-45a7-b9e4-8182222589ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.004901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ba503a8-e3f2-45a7-b9e4-8182222589ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.066770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-de82836f-0cd8-47ae-abae-1b6bf502f65d tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:13.088155 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-de82836f-0cd8-47ae-abae-1b6bf502f65d tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1327 microversion: 2.1 time: 1.386705 Oct 18 13:29:13.090095 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1552/2937] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:11 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1327 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:13.100978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-951b158c-bb0b-40dd-9f37-b8e91118f4a2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:13.103924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-951b158c-bb0b-40dd-9f37-b8e91118f4a2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:13.117394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-951b158c-bb0b-40dd-9f37-b8e91118f4a2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.118106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-951b158c-bb0b-40dd-9f37-b8e91118f4a2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.118941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-951b158c-bb0b-40dd-9f37-b8e91118f4a2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.119850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-951b158c-bb0b-40dd-9f37-b8e91118f4a2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.120312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-951b158c-bb0b-40dd-9f37-b8e91118f4a2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.132604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-951b158c-bb0b-40dd-9f37-b8e91118f4a2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.378048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-951b158c-bb0b-40dd-9f37-b8e91118f4a2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:13.389484 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-951b158c-bb0b-40dd-9f37-b8e91118f4a2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1283 microversion: 2.1 time: 0.296358 Oct 18 13:29:13.392243 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1553/2938] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:13 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1283 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:13.400543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3a416273-99be-48fe-a8ed-f3a94c519100 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:13.402793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3a416273-99be-48fe-a8ed-f3a94c519100 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:13.422174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a416273-99be-48fe-a8ed-f3a94c519100 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.422670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a416273-99be-48fe-a8ed-f3a94c519100 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.423108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a416273-99be-48fe-a8ed-f3a94c519100 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.423817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a416273-99be-48fe-a8ed-f3a94c519100 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.424270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a416273-99be-48fe-a8ed-f3a94c519100 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.424693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a416273-99be-48fe-a8ed-f3a94c519100 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.553217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6ba503a8-e3f2-45a7-b9e4-8182222589ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:13.566255 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6ba503a8-e3f2-45a7-b9e4-8182222589ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1314 microversion: 2.1 time: 0.580286 Oct 18 13:29:13.569248 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1386/2939] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:12 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:13.578970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-35baf377-e6e2-4147-96ce-69496e28d433 req-2bc89590-bb50-4068-a4e0-fd7e06be0a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95363be-8589-49f4-b67e-c4329353ab4d", "name": "network-vif-plugged", "status": "completed", "tag": "33dfd4a6-9d84-4219-a3c9-213dce92ae9e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:13.650266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-35baf377-e6e2-4147-96ce-69496e28d433 req-2bc89590-bb50-4068-a4e0-fd7e06be0a42 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.650989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-35baf377-e6e2-4147-96ce-69496e28d433 req-2bc89590-bb50-4068-a4e0-fd7e06be0a42 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.651659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-35baf377-e6e2-4147-96ce-69496e28d433 req-2bc89590-bb50-4068-a4e0-fd7e06be0a42 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.679735 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-35baf377-e6e2-4147-96ce-69496e28d433 req-2bc89590-bb50-4068-a4e0-fd7e06be0a42 service nova] Creating event network-vif-plugged:33dfd4a6-9d84-4219-a3c9-213dce92ae9e for instance f95363be-8589-49f4-b67e-c4329353ab4d on n-h1-858384-13 Oct 18 13:29:13.694764 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-35baf377-e6e2-4147-96ce-69496e28d433 req-2bc89590-bb50-4068-a4e0-fd7e06be0a42 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123947 Oct 18 13:29:13.695655 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1387/2940] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:13.848019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3fb655f7-2b40-48d2-9ddd-dec5a01156a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:13.850061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3fb655f7-2b40-48d2-9ddd-dec5a01156a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:13.869855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb655f7-2b40-48d2-9ddd-dec5a01156a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.870712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb655f7-2b40-48d2-9ddd-dec5a01156a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.871366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb655f7-2b40-48d2-9ddd-dec5a01156a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:13.872308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb655f7-2b40-48d2-9ddd-dec5a01156a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:13.872928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb655f7-2b40-48d2-9ddd-dec5a01156a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:13.873571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb655f7-2b40-48d2-9ddd-dec5a01156a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.387992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3fb655f7-2b40-48d2-9ddd-dec5a01156a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:14.405648 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3fb655f7-2b40-48d2-9ddd-dec5a01156a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.560796 Oct 18 13:29:14.418427 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1388/2941] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:13 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:14.430261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e99bc884-6e0e-477d-910a-10e78f647a18 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:14.431503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e99bc884-6e0e-477d-910a-10e78f647a18 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:14.438841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e99bc884-6e0e-477d-910a-10e78f647a18 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.439658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e99bc884-6e0e-477d-910a-10e78f647a18 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.440320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e99bc884-6e0e-477d-910a-10e78f647a18 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.441349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e99bc884-6e0e-477d-910a-10e78f647a18 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.442022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e99bc884-6e0e-477d-910a-10e78f647a18 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.442901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e99bc884-6e0e-477d-910a-10e78f647a18 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.546919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3a416273-99be-48fe-a8ed-f3a94c519100 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:14.564314 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3a416273-99be-48fe-a8ed-f3a94c519100 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1468 microversion: 2.1 time: 1.164324 Oct 18 13:29:14.565254 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1554/2942] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:13 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1468 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:14.595765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1793c990-b1eb-4bb3-8030-ea96d062b0de tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:14.597707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1793c990-b1eb-4bb3-8030-ea96d062b0de tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:14.610861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1793c990-b1eb-4bb3-8030-ea96d062b0de tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.611662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1793c990-b1eb-4bb3-8030-ea96d062b0de tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.612754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1793c990-b1eb-4bb3-8030-ea96d062b0de tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.614146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1793c990-b1eb-4bb3-8030-ea96d062b0de tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.615696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1793c990-b1eb-4bb3-8030-ea96d062b0de tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.617088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1793c990-b1eb-4bb3-8030-ea96d062b0de tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.747763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e99bc884-6e0e-477d-910a-10e78f647a18 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:14.759079 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e99bc884-6e0e-477d-910a-10e78f647a18 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1327 microversion: 2.1 time: 0.339141 Oct 18 13:29:14.759899 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1389/2943] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:14 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1327 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:14.788564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe6c352c-5ae6-4d4d-960f-1795d659938a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:14.789287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe6c352c-5ae6-4d4d-960f-1795d659938a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:14.795754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe6c352c-5ae6-4d4d-960f-1795d659938a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.796238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe6c352c-5ae6-4d4d-960f-1795d659938a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.796666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe6c352c-5ae6-4d4d-960f-1795d659938a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.798680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe6c352c-5ae6-4d4d-960f-1795d659938a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.799142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe6c352c-5ae6-4d4d-960f-1795d659938a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.799562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe6c352c-5ae6-4d4d-960f-1795d659938a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.941305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1793c990-b1eb-4bb3-8030-ea96d062b0de tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:14.958244 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1793c990-b1eb-4bb3-8030-ea96d062b0de tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1351 microversion: 2.1 time: 0.373832 Oct 18 13:29:14.959338 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1555/2944] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:14 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1351 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:14.977414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-67a57311-d901-43fb-aa33-2fa468124f8a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:14.979888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-67a57311-d901-43fb-aa33-2fa468124f8a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: f95363be-8589-49f4-b67e-c4329353ab4d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:14.993054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67a57311-d901-43fb-aa33-2fa468124f8a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.994772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67a57311-d901-43fb-aa33-2fa468124f8a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.995616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67a57311-d901-43fb-aa33-2fa468124f8a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:14.996509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67a57311-d901-43fb-aa33-2fa468124f8a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:14.997121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67a57311-d901-43fb-aa33-2fa468124f8a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:14.998687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67a57311-d901-43fb-aa33-2fa468124f8a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:15.500525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe6c352c-5ae6-4d4d-960f-1795d659938a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:15.515605 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fe6c352c-5ae6-4d4d-960f-1795d659938a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1314 microversion: 2.1 time: 0.739362 Oct 18 13:29:15.523195 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1390/2945] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:14 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:15.560416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-306968a2-e4c8-4652-8793-2df84b58187a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:15.562188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-306968a2-e4c8-4652-8793-2df84b58187a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:15.575060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-306968a2-e4c8-4652-8793-2df84b58187a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:15.575464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-306968a2-e4c8-4652-8793-2df84b58187a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:15.575896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-306968a2-e4c8-4652-8793-2df84b58187a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:15.576602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-306968a2-e4c8-4652-8793-2df84b58187a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:15.577047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-306968a2-e4c8-4652-8793-2df84b58187a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:15.577493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-306968a2-e4c8-4652-8793-2df84b58187a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:15.752599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-67a57311-d901-43fb-aa33-2fa468124f8a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:15.768143 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-67a57311-d901-43fb-aa33-2fa468124f8a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d" status: 200 len: 1319 microversion: 2.1 time: 0.800832 Oct 18 13:29:15.769045 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1556/2946] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:14 2022] GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d => generated 1319 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:15.804755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9e74d1ae-825d-4268-b247-970da91db346 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:15.809747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9e74d1ae-825d-4268-b247-970da91db346 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:15.819492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e74d1ae-825d-4268-b247-970da91db346 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:15.820172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e74d1ae-825d-4268-b247-970da91db346 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:15.820798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e74d1ae-825d-4268-b247-970da91db346 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:15.821974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e74d1ae-825d-4268-b247-970da91db346 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:15.822684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e74d1ae-825d-4268-b247-970da91db346 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:15.823439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e74d1ae-825d-4268-b247-970da91db346 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:16.000160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-306968a2-e4c8-4652-8793-2df84b58187a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:16.010656 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-306968a2-e4c8-4652-8793-2df84b58187a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.469826 Oct 18 13:29:16.013085 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1391/2947] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:15 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:16.026886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2dc6d30e-8a0f-46d2-aecd-b907a2401932 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:16.028310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2dc6d30e-8a0f-46d2-aecd-b907a2401932 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:16.037814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dc6d30e-8a0f-46d2-aecd-b907a2401932 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:16.038616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dc6d30e-8a0f-46d2-aecd-b907a2401932 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:16.039289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dc6d30e-8a0f-46d2-aecd-b907a2401932 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:16.040228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dc6d30e-8a0f-46d2-aecd-b907a2401932 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:16.040879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dc6d30e-8a0f-46d2-aecd-b907a2401932 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:16.041546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dc6d30e-8a0f-46d2-aecd-b907a2401932 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:16.340965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9e74d1ae-825d-4268-b247-970da91db346 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:16.352825 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9e74d1ae-825d-4268-b247-970da91db346 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1327 microversion: 2.1 time: 0.565282 Oct 18 13:29:16.355757 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1557/2948] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:15 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1327 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:16.366466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c9cbc532-8838-4080-be74-dc145a0aeaa5 req-fedba3ec-166a-41b8-903b-b13f26a75d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a", "name": "network-vif-plugged", "status": "completed", "tag": "b7079b74-4b6a-4fa3-a3ae-3342a2ace45a"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:16.393809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c9cbc532-8838-4080-be74-dc145a0aeaa5 req-fedba3ec-166a-41b8-903b-b13f26a75d35 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:16.394794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c9cbc532-8838-4080-be74-dc145a0aeaa5 req-fedba3ec-166a-41b8-903b-b13f26a75d35 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:16.395460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c9cbc532-8838-4080-be74-dc145a0aeaa5 req-fedba3ec-166a-41b8-903b-b13f26a75d35 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:16.413846 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c9cbc532-8838-4080-be74-dc145a0aeaa5 req-fedba3ec-166a-41b8-903b-b13f26a75d35 service nova] Creating event network-vif-plugged:b7079b74-4b6a-4fa3-a3ae-3342a2ace45a for instance 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a on n-h2-858384-13 Oct 18 13:29:16.421010 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c9cbc532-8838-4080-be74-dc145a0aeaa5 req-fedba3ec-166a-41b8-903b-b13f26a75d35 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063718 Oct 18 13:29:16.422824 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1558/2949] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:16.550276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-97df370f-0c6d-4888-a74c-7d4157b5b78f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:16.552793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-97df370f-0c6d-4888-a74c-7d4157b5b78f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:16.575963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97df370f-0c6d-4888-a74c-7d4157b5b78f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:16.576860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97df370f-0c6d-4888-a74c-7d4157b5b78f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:16.577551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97df370f-0c6d-4888-a74c-7d4157b5b78f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:16.579149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97df370f-0c6d-4888-a74c-7d4157b5b78f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:16.579923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97df370f-0c6d-4888-a74c-7d4157b5b78f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:16.581824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97df370f-0c6d-4888-a74c-7d4157b5b78f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.118613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-97df370f-0c6d-4888-a74c-7d4157b5b78f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:17.133419 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-97df370f-0c6d-4888-a74c-7d4157b5b78f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1314 microversion: 2.1 time: 0.586685 Oct 18 13:29:17.134060 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1559/2950] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:16 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:17.149575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-500df143-0211-4269-837d-969c157a7162 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:17.150203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-500df143-0211-4269-837d-969c157a7162 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: f95363be-8589-49f4-b67e-c4329353ab4d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:17.156660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-500df143-0211-4269-837d-969c157a7162 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.157160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-500df143-0211-4269-837d-969c157a7162 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.157676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-500df143-0211-4269-837d-969c157a7162 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.158361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-500df143-0211-4269-837d-969c157a7162 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.158807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-500df143-0211-4269-837d-969c157a7162 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.164647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-500df143-0211-4269-837d-969c157a7162 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.453602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-500df143-0211-4269-837d-969c157a7162 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:17.469307 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-500df143-0211-4269-837d-969c157a7162 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d" status: 200 len: 1469 microversion: 2.1 time: 0.333982 Oct 18 13:29:17.470531 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1560/2951] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:17 2022] GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d => generated 1469 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:17.475955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f7e00d71-6641-40e4-b0c8-958114acff68 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:17.476942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f7e00d71-6641-40e4-b0c8-958114acff68 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:17.483733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7e00d71-6641-40e4-b0c8-958114acff68 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.485408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7e00d71-6641-40e4-b0c8-958114acff68 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.486096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7e00d71-6641-40e4-b0c8-958114acff68 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.487345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7e00d71-6641-40e4-b0c8-958114acff68 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.488395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7e00d71-6641-40e4-b0c8-958114acff68 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.489061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7e00d71-6641-40e4-b0c8-958114acff68 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.636681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2dc6d30e-8a0f-46d2-aecd-b907a2401932 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:17.651557 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2dc6d30e-8a0f-46d2-aecd-b907a2401932 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1351 microversion: 2.1 time: 1.636066 Oct 18 13:29:17.673372 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1392/2952] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:16 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1351 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:17.691141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8d1bf0cf-44f5-4ad4-abde-cc2cf11d7ce3 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:17.691729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8d1bf0cf-44f5-4ad4-abde-cc2cf11d7ce3 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:17.698636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d1bf0cf-44f5-4ad4-abde-cc2cf11d7ce3 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.699383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d1bf0cf-44f5-4ad4-abde-cc2cf11d7ce3 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.700130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d1bf0cf-44f5-4ad4-abde-cc2cf11d7ce3 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:17.701029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d1bf0cf-44f5-4ad4-abde-cc2cf11d7ce3 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:17.701639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d1bf0cf-44f5-4ad4-abde-cc2cf11d7ce3 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:17.702250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d1bf0cf-44f5-4ad4-abde-cc2cf11d7ce3 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.003110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f7e00d71-6641-40e4-b0c8-958114acff68 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:18.014062 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f7e00d71-6641-40e4-b0c8-958114acff68 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.541976 Oct 18 13:29:18.015018 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1561/2953] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:17 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:18.020351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:18.027847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8d1bf0cf-44f5-4ad4-abde-cc2cf11d7ce3 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:18.030731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:18.036289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:18.044609 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8d1bf0cf-44f5-4ad4-abde-cc2cf11d7ce3 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1327 microversion: 2.1 time: 0.367110 Oct 18 13:29:18.045013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Searching by: {'reservation_id': 'r-21nk9vvx', 'deleted': False, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:29:18.048375 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1393/2954] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:17 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1327 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:18.055213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.056348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.057061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.058056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.058782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.059430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.064168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=13 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:18.103439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d6b16c7a-91d5-452f-9a01-886cf2ca2b61 req-05004865-09e0-4a23-ab89-ad78a1d70ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c74e947-034e-4c4d-80b4-2e6b59f4ae41", "tag": "b223df49-be57-4fa3-9914-5f17b0c21d6e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:18.140546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d6b16c7a-91d5-452f-9a01-886cf2ca2b61 req-05004865-09e0-4a23-ab89-ad78a1d70ce2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.142596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d6b16c7a-91d5-452f-9a01-886cf2ca2b61 req-05004865-09e0-4a23-ab89-ad78a1d70ce2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.143400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d6b16c7a-91d5-452f-9a01-886cf2ca2b61 req-05004865-09e0-4a23-ab89-ad78a1d70ce2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.164686 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d6b16c7a-91d5-452f-9a01-886cf2ca2b61 req-05004865-09e0-4a23-ab89-ad78a1d70ce2 service nova] Creating event network-changed:b223df49-be57-4fa3-9914-5f17b0c21d6e for instance 5c74e947-034e-4c4d-80b4-2e6b59f4ae41 on n-h1-858384-13 Oct 18 13:29:18.171362 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d6b16c7a-91d5-452f-9a01-886cf2ca2b61 req-05004865-09e0-4a23-ab89-ad78a1d70ce2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073753 Oct 18 13:29:18.172618 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1394/2955] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:29:18.179444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e523e4c6-d434-41c9-a773-e03bd91f14c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:18.181015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e523e4c6-d434-41c9-a773-e03bd91f14c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:18.188855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e523e4c6-d434-41c9-a773-e03bd91f14c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.190117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e523e4c6-d434-41c9-a773-e03bd91f14c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.190759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e523e4c6-d434-41c9-a773-e03bd91f14c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.191630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e523e4c6-d434-41c9-a773-e03bd91f14c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.192286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e523e4c6-d434-41c9-a773-e03bd91f14c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.193107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e523e4c6-d434-41c9-a773-e03bd91f14c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.274114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:29:18.442234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:18.465302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.469355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.469822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.519936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e523e4c6-d434-41c9-a773-e03bd91f14c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:18.528553 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e523e4c6-d434-41c9-a773-e03bd91f14c6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1314 microversion: 2.1 time: 0.354013 Oct 18 13:29:18.529149 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1395/2956] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:18 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:18.679351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-583a0c67-0ce3-4df5-8142-5c62e8907874 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:18.680004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-583a0c67-0ce3-4df5-8142-5c62e8907874 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:18.691472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-583a0c67-0ce3-4df5-8142-5c62e8907874 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.692822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-583a0c67-0ce3-4df5-8142-5c62e8907874 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.694488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-583a0c67-0ce3-4df5-8142-5c62e8907874 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.696731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-583a0c67-0ce3-4df5-8142-5c62e8907874 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.697817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-583a0c67-0ce3-4df5-8142-5c62e8907874 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.699285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-583a0c67-0ce3-4df5-8142-5c62e8907874 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.785288 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-66555b5e-ac1d-4432-a731-0c73e6656377 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?reservation_id=r-21nk9vvx" status: 200 len: 2930 microversion: 2.1 time: 0.769306 Oct 18 13:29:18.787204 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1562/2957] 10.222.0.40 () {58 vars in 1197 bytes} [Tue Oct 18 13:29:18 2022] GET /compute/v2.1/servers/detail?reservation_id=r-21nk9vvx => generated 2930 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:18.813936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-29cc12bf-1b41-42ac-a394-df0b8a7c9ebb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:18.839871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.compute.server_groups [None req-29cc12bf-1b41-42ac-a394-df0b8a7c9ebb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Querying cell a8e216eb-ce73-4101-a62e-f9159a9c2bcf(cell1) for 2 instances {{(pid=120611) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 13:29:18.840980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29cc12bf-1b41-42ac-a394-df0b8a7c9ebb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.841867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29cc12bf-1b41-42ac-a394-df0b8a7c9ebb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.842516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-29cc12bf-1b41-42ac-a394-df0b8a7c9ebb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.893068 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-29cc12bf-1b41-42ac-a394-df0b8a7c9ebb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/1f4cebc3-5166-4ca3-bd1b-22fa3064d4a7" status: 200 len: 271 microversion: 2.1 time: 0.083523 Oct 18 13:29:18.896529 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1563/2958] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:29:18 2022] GET /compute/v2.1/os-server-groups/1f4cebc3-5166-4ca3-bd1b-22fa3064d4a7 => generated 271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:18.913913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8b1259c1-2224-48c3-850d-63592e9080a7 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:18.915993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8b1259c1-2224-48c3-850d-63592e9080a7 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:18.929753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b1259c1-2224-48c3-850d-63592e9080a7 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.931511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b1259c1-2224-48c3-850d-63592e9080a7 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.934049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b1259c1-2224-48c3-850d-63592e9080a7 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:18.935147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b1259c1-2224-48c3-850d-63592e9080a7 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:18.936329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b1259c1-2224-48c3-850d-63592e9080a7 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:18.939094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b1259c1-2224-48c3-850d-63592e9080a7 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.044377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-583a0c67-0ce3-4df5-8142-5c62e8907874 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:19.054967 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-583a0c67-0ce3-4df5-8142-5c62e8907874 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1351 microversion: 2.1 time: 0.379492 Oct 18 13:29:19.060384 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1396/2959] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:18 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1351 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:19.066283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b1d3b34b-51d5-4c8f-9a41-f61dc742208b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:19.070471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b1d3b34b-51d5-4c8f-9a41-f61dc742208b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:19.101976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1d3b34b-51d5-4c8f-9a41-f61dc742208b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.102488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1d3b34b-51d5-4c8f-9a41-f61dc742208b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.103322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1d3b34b-51d5-4c8f-9a41-f61dc742208b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.106503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1d3b34b-51d5-4c8f-9a41-f61dc742208b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.107236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1d3b34b-51d5-4c8f-9a41-f61dc742208b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.107855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1d3b34b-51d5-4c8f-9a41-f61dc742208b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.246971 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8b1259c1-2224-48c3-850d-63592e9080a7 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 200 len: 1621 microversion: 2.1 time: 0.343086 Oct 18 13:29:19.248651 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1564/2960] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:18 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 1621 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:19.262709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-64229576-bbf1-4a35-b561-e4c854852b2e tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:19.265379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-64229576-bbf1-4a35-b561-e4c854852b2e tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:19.284287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64229576-bbf1-4a35-b561-e4c854852b2e tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.285424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64229576-bbf1-4a35-b561-e4c854852b2e tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.287464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64229576-bbf1-4a35-b561-e4c854852b2e tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.289574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64229576-bbf1-4a35-b561-e4c854852b2e tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.291897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64229576-bbf1-4a35-b561-e4c854852b2e tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.292761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64229576-bbf1-4a35-b561-e4c854852b2e tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.322158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:19.479865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b1d3b34b-51d5-4c8f-9a41-f61dc742208b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:19.488343 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b1d3b34b-51d5-4c8f-9a41-f61dc742208b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.426479 Oct 18 13:29:19.495554 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1397/2961] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:19 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:19.500221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b5b7bdd4-35a7-4b7e-a6ef-9e816003fb42 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:19.500838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b5b7bdd4-35a7-4b7e-a6ef-9e816003fb42 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] [instance: f95363be-8589-49f4-b67e-c4329353ab4d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:19.504481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-64229576-bbf1-4a35-b561-e4c854852b2e tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:19.515745 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-64229576-bbf1-4a35-b561-e4c854852b2e tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1327 microversion: 2.1 time: 0.265655 Oct 18 13:29:19.517652 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1565/2962] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:19 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1327 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:19.523366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-b7990899-dde5-4098-b5f9-e14de70e39f1 req-3062367a-3a6f-408e-af10-8088adedab94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba16c299-3b2e-481a-99f0-89e02c0c7642", "name": "network-vif-plugged", "status": "completed", "tag": "b8c58ecb-c9f8-44fe-a484-01aaf1be4c74"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:19.534741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b7990899-dde5-4098-b5f9-e14de70e39f1 req-3062367a-3a6f-408e-af10-8088adedab94 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.536134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b7990899-dde5-4098-b5f9-e14de70e39f1 req-3062367a-3a6f-408e-af10-8088adedab94 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.537621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b7990899-dde5-4098-b5f9-e14de70e39f1 req-3062367a-3a6f-408e-af10-8088adedab94 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.541612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5b7bdd4-35a7-4b7e-a6ef-9e816003fb42 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.542106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5b7bdd4-35a7-4b7e-a6ef-9e816003fb42 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.542540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5b7bdd4-35a7-4b7e-a6ef-9e816003fb42 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.543280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5b7bdd4-35a7-4b7e-a6ef-9e816003fb42 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.543757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5b7bdd4-35a7-4b7e-a6ef-9e816003fb42 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.544186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5b7bdd4-35a7-4b7e-a6ef-9e816003fb42 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.586691 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-b7990899-dde5-4098-b5f9-e14de70e39f1 req-3062367a-3a6f-408e-af10-8088adedab94 service nova] Creating event network-vif-plugged:b8c58ecb-c9f8-44fe-a484-01aaf1be4c74 for instance ba16c299-3b2e-481a-99f0-89e02c0c7642 on n-h2-858384-13 Oct 18 13:29:19.594621 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-b7990899-dde5-4098-b5f9-e14de70e39f1 req-3062367a-3a6f-408e-af10-8088adedab94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075161 Oct 18 13:29:19.595568 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1566/2963] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:19.603414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f38224e2-9129-47e4-81f9-d81bb3c37bc4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:19.604999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f38224e2-9129-47e4-81f9-d81bb3c37bc4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:19.612914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f38224e2-9129-47e4-81f9-d81bb3c37bc4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.613518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f38224e2-9129-47e4-81f9-d81bb3c37bc4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.614253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f38224e2-9129-47e4-81f9-d81bb3c37bc4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.616309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f38224e2-9129-47e4-81f9-d81bb3c37bc4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.617246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f38224e2-9129-47e4-81f9-d81bb3c37bc4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.618677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f38224e2-9129-47e4-81f9-d81bb3c37bc4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.718801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=14 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:19.855920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f38224e2-9129-47e4-81f9-d81bb3c37bc4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:19.868247 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f38224e2-9129-47e4-81f9-d81bb3c37bc4 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1501 microversion: 2.1 time: 0.271004 Oct 18 13:29:19.873987 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1567/2964] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:19 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1501 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:19.897780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-217befa4-8934-47f8-8879-a6a1c88fb0d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:19.898309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-217befa4-8934-47f8-8879-a6a1c88fb0d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:19.905056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-217befa4-8934-47f8-8879-a6a1c88fb0d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.905548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-217befa4-8934-47f8-8879-a6a1c88fb0d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.905984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-217befa4-8934-47f8-8879-a6a1c88fb0d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:19.906681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-217befa4-8934-47f8-8879-a6a1c88fb0d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:19.907135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-217befa4-8934-47f8-8879-a6a1c88fb0d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:19.907617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-217befa4-8934-47f8-8879-a6a1c88fb0d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:20.003718 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b5b7bdd4-35a7-4b7e-a6ef-9e816003fb42 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d" status: 200 len: 1622 microversion: 2.1 time: 0.507127 Oct 18 13:29:20.011858 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1398/2965] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:19 2022] GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d => generated 1622 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:20.084681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0a21d4ef-1509-49b2-ae86-2271cb878077 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:20.085441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0a21d4ef-1509-49b2-ae86-2271cb878077 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:20.096414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a21d4ef-1509-49b2-ae86-2271cb878077 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:20.097017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a21d4ef-1509-49b2-ae86-2271cb878077 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:20.100325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a21d4ef-1509-49b2-ae86-2271cb878077 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:20.101273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a21d4ef-1509-49b2-ae86-2271cb878077 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:20.102204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a21d4ef-1509-49b2-ae86-2271cb878077 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:20.102599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a21d4ef-1509-49b2-ae86-2271cb878077 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:20.212941 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.network.security_group_api [None req-217befa4-8934-47f8-8879-a6a1c88fb0d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Removing security group 2a56c95d-b0de-4cdb-9e74-7fff0ae0bf73 from port b7079b74-4b6a-4fa3-a3ae-3342a2ace45a Oct 18 13:29:20.316008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0a21d4ef-1509-49b2-ae86-2271cb878077 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:20.326550 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0a21d4ef-1509-49b2-ae86-2271cb878077 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1351 microversion: 2.1 time: 0.246388 Oct 18 13:29:20.328321 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1399/2966] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:20 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1351 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:20.339200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-427641897", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "b0688b2d-dd1e-427c-b5f1-1ac0fad84598"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:20.700363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:29:20.920201 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-217befa4-8934-47f8-8879-a6a1c88fb0d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a/action" status: 202 len: 0 microversion: 2.1 time: 1.026648 Oct 18 13:29:20.921440 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1568/2967] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:29:19 2022] POST /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a/action => generated 0 bytes in 1029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:29:20.928071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-249e0813-2bc6-40e0-ac09-4e5dc4c182d3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:20.928706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-249e0813-2bc6-40e0-ac09-4e5dc4c182d3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:20.957546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-249e0813-2bc6-40e0-ac09-4e5dc4c182d3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:20.958067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-249e0813-2bc6-40e0-ac09-4e5dc4c182d3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:20.958660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-249e0813-2bc6-40e0-ac09-4e5dc4c182d3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:20.959391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-249e0813-2bc6-40e0-ac09-4e5dc4c182d3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:20.959847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-249e0813-2bc6-40e0-ac09-4e5dc4c182d3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:20.963896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-249e0813-2bc6-40e0-ac09-4e5dc4c182d3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.027602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:29:21.028368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:29:21.030553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:29:21.031394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:29:21.032049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:29:21.059554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.061698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.063786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.065642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.069103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.069726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.131243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:21.138568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:21.141383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:21.161300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:29:21.164415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:29:21.286213 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9ef4eeec-96bc-4821-80fe-bacd723ec5cf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956164 Oct 18 13:29:21.291561 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1400/2968] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:29:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:29:21.311611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-55148962-a6c1-47e7-aede-61f62d231d43 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:21.312256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-55148962-a6c1-47e7-aede-61f62d231d43 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:21.330257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55148962-a6c1-47e7-aede-61f62d231d43 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.336350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55148962-a6c1-47e7-aede-61f62d231d43 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.338241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55148962-a6c1-47e7-aede-61f62d231d43 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.341917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55148962-a6c1-47e7-aede-61f62d231d43 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.348200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55148962-a6c1-47e7-aede-61f62d231d43 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.350549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55148962-a6c1-47e7-aede-61f62d231d43 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.481691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-249e0813-2bc6-40e0-ac09-4e5dc4c182d3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:21.493736 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-249e0813-2bc6-40e0-ac09-4e5dc4c182d3 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.570379 Oct 18 13:29:21.495633 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1569/2969] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:20 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:21.503375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f16f6892-6c8c-4fc2-91e1-c53c73649fb2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:21.508729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f16f6892-6c8c-4fc2-91e1-c53c73649fb2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:21.522526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f16f6892-6c8c-4fc2-91e1-c53c73649fb2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.528345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f16f6892-6c8c-4fc2-91e1-c53c73649fb2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.528970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f16f6892-6c8c-4fc2-91e1-c53c73649fb2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.529862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f16f6892-6c8c-4fc2-91e1-c53c73649fb2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.530461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f16f6892-6c8c-4fc2-91e1-c53c73649fb2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.531113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f16f6892-6c8c-4fc2-91e1-c53c73649fb2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.778697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f16f6892-6c8c-4fc2-91e1-c53c73649fb2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:21.790817 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f16f6892-6c8c-4fc2-91e1-c53c73649fb2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1459 microversion: 2.1 time: 0.291784 Oct 18 13:29:21.795412 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1570/2970] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:21 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1459 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:21.803996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ee72b4b0-c808-4503-ac2c-00d8f9eae184 req-e74d8511-2b53-468e-b984-7a0f49dbb0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a", "tag": "b7079b74-4b6a-4fa3-a3ae-3342a2ace45a"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:21.830109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ee72b4b0-c808-4503-ac2c-00d8f9eae184 req-e74d8511-2b53-468e-b984-7a0f49dbb0d7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:21.830582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ee72b4b0-c808-4503-ac2c-00d8f9eae184 req-e74d8511-2b53-468e-b984-7a0f49dbb0d7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:21.831512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ee72b4b0-c808-4503-ac2c-00d8f9eae184 req-e74d8511-2b53-468e-b984-7a0f49dbb0d7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:21.867802 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ee72b4b0-c808-4503-ac2c-00d8f9eae184 req-e74d8511-2b53-468e-b984-7a0f49dbb0d7 service nova] Creating event network-changed:b7079b74-4b6a-4fa3-a3ae-3342a2ace45a for instance 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a on n-h2-858384-13 Oct 18 13:29:21.884460 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ee72b4b0-c808-4503-ac2c-00d8f9eae184 req-e74d8511-2b53-468e-b984-7a0f49dbb0d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085888 Oct 18 13:29:21.886220 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1571/2971] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:21.914168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6265a7dc-e0a6-409c-bde5-5755f4952144 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:21.915431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6265a7dc-e0a6-409c-bde5-5755f4952144 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:22.017113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6265a7dc-e0a6-409c-bde5-5755f4952144 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:22.041550 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6265a7dc-e0a6-409c-bde5-5755f4952144 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1216 microversion: 2.1 time: 0.151487 Oct 18 13:29:22.042653 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1572/2972] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:21 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:22.065081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ea556617-b7e6-4794-bdfb-62a04790f2f1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:22.066052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ea556617-b7e6-4794-bdfb-62a04790f2f1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:22.078686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea556617-b7e6-4794-bdfb-62a04790f2f1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.079521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea556617-b7e6-4794-bdfb-62a04790f2f1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.080200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea556617-b7e6-4794-bdfb-62a04790f2f1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.081109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea556617-b7e6-4794-bdfb-62a04790f2f1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.082540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea556617-b7e6-4794-bdfb-62a04790f2f1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.083376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea556617-b7e6-4794-bdfb-62a04790f2f1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.160993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-55148962-a6c1-47e7-aede-61f62d231d43 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:22.171971 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-55148962-a6c1-47e7-aede-61f62d231d43 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1527 microversion: 2.1 time: 0.879044 Oct 18 13:29:22.173496 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1401/2973] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:21 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1527 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:22.206884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ae1079a2-9a52-48b2-8c96-8841545d3574 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:22.210046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ae1079a2-9a52-48b2-8c96-8841545d3574 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:22.217346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae1079a2-9a52-48b2-8c96-8841545d3574 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.217942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae1079a2-9a52-48b2-8c96-8841545d3574 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.218542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae1079a2-9a52-48b2-8c96-8841545d3574 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.219329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae1079a2-9a52-48b2-8c96-8841545d3574 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.219851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae1079a2-9a52-48b2-8c96-8841545d3574 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.220329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae1079a2-9a52-48b2-8c96-8841545d3574 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.337721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ea556617-b7e6-4794-bdfb-62a04790f2f1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:22.348706 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ea556617-b7e6-4794-bdfb-62a04790f2f1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1351 microversion: 2.1 time: 0.287361 Oct 18 13:29:22.350793 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1573/2974] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:22 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1351 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:22.356115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-27c4a65b-33fa-4e5d-b4aa-459a6a4955f2 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:22.357526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-27c4a65b-33fa-4e5d-b4aa-459a6a4955f2 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:22.369259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27c4a65b-33fa-4e5d-b4aa-459a6a4955f2 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.370615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27c4a65b-33fa-4e5d-b4aa-459a6a4955f2 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.371320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27c4a65b-33fa-4e5d-b4aa-459a6a4955f2 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.372565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27c4a65b-33fa-4e5d-b4aa-459a6a4955f2 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.373276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27c4a65b-33fa-4e5d-b4aa-459a6a4955f2 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.373890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27c4a65b-33fa-4e5d-b4aa-459a6a4955f2 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.585233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-27c4a65b-33fa-4e5d-b4aa-459a6a4955f2 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:22.602714 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-27c4a65b-33fa-4e5d-b4aa-459a6a4955f2 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1527 microversion: 2.1 time: 0.250622 Oct 18 13:29:22.603901 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1574/2975] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:22 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1527 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:22.610135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e50acc92-1759-4fa5-9040-ceba7ef992c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:22.614028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e50acc92-1759-4fa5-9040-ceba7ef992c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:22.624084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e50acc92-1759-4fa5-9040-ceba7ef992c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.624632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e50acc92-1759-4fa5-9040-ceba7ef992c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.625073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e50acc92-1759-4fa5-9040-ceba7ef992c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.626222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e50acc92-1759-4fa5-9040-ceba7ef992c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.626955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e50acc92-1759-4fa5-9040-ceba7ef992c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.627842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e50acc92-1759-4fa5-9040-ceba7ef992c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.686427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ae1079a2-9a52-48b2-8c96-8841545d3574 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:22.703933 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ae1079a2-9a52-48b2-8c96-8841545d3574 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.512037 Oct 18 13:29:22.705583 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1402/2976] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:22 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:22.881108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e50acc92-1759-4fa5-9040-ceba7ef992c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:22.894820 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e50acc92-1759-4fa5-9040-ceba7ef992c4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.287918 Oct 18 13:29:22.896639 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1575/2977] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:22 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:22.903708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7ae200ae-dded-4ce8-875a-6b7a9e2a1a24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:22.904623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7ae200ae-dded-4ce8-875a-6b7a9e2a1a24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:22.919201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ae200ae-dded-4ce8-875a-6b7a9e2a1a24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.922738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ae200ae-dded-4ce8-875a-6b7a9e2a1a24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.924154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ae200ae-dded-4ce8-875a-6b7a9e2a1a24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:22.926185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ae200ae-dded-4ce8-875a-6b7a9e2a1a24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:22.928586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ae200ae-dded-4ce8-875a-6b7a9e2a1a24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:22.929079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ae200ae-dded-4ce8-875a-6b7a9e2a1a24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.102782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9cbd4803-89d7-4b3f-9937-15979929624f tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:23.103773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9cbd4803-89d7-4b3f-9937-15979929624f tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:23.112245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cbd4803-89d7-4b3f-9937-15979929624f tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.113167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cbd4803-89d7-4b3f-9937-15979929624f tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.113848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cbd4803-89d7-4b3f-9937-15979929624f tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.115814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cbd4803-89d7-4b3f-9937-15979929624f tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.116427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cbd4803-89d7-4b3f-9937-15979929624f tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.117041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cbd4803-89d7-4b3f-9937-15979929624f tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.146457 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-9cbd4803-89d7-4b3f-9937-15979929624f tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] HTTP exception thrown: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9cbd4803-89d7-4b3f-9937-15979929624f tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Request method failure captured: Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 HTTP/1.1 Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqoVzZ9Mk4AeYLUwSQpL59T7SukQBZcfm8CvlMW1U1pRZfVS1EybqzDysQq8lLz8a8onfjY5iKivyDbWJzmvfIDcJvFv1ZR2zXRx3XGUZm7c80_QV7XG4_Mm0X6H1_vBeI3QC4EdE05RD8HqtOTjq8CLCSq3nQbLP4fd48cXTpxr6BY Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: ab13b93181dc4d69babc55626dacf160 Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-884287916 Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab13b93181dc4d69babc55626dacf160"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ab13b93181dc4d69babc55626dacf160"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab13b93181dc4d69babc55626dacf160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ab13b93181dc4d69babc55626dacf160"}]}] Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-884287916 Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: ab13b93181dc4d69babc55626dacf160 Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-884287916 Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestMultiTenantJSON-884287916-project Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: ebeab2b1c314476cbf7989a9ca189c38 Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-884287916-project Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'ba16c299-3b2e-481a-99f0-89e02c0c7642'} Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:23.153541 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:23.158337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:23.158337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:29:23.158337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:23.158337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:29:23.158337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:23.158337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:23.158337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:23.158337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:23.158337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:23.158337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:23.158337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:29:23.162312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9cbd4803-89d7-4b3f-9937-15979929624f tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Returning 404 to user: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:23.163475 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9cbd4803-89d7-4b3f-9937-15979929624f tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 404 len: 111 microversion: 2.1 time: 0.456717 Oct 18 13:29:23.164060 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1403/2978] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:22 2022] DELETE /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 111 bytes in 458 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:23.184617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d39e34a6-beb7-4d97-9057-452a050e9e68 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:23.185407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d39e34a6-beb7-4d97-9057-452a050e9e68 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:23.201163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7ae200ae-dded-4ce8-875a-6b7a9e2a1a24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:23.201964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d39e34a6-beb7-4d97-9057-452a050e9e68 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.203173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d39e34a6-beb7-4d97-9057-452a050e9e68 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.203619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d39e34a6-beb7-4d97-9057-452a050e9e68 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.206343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d39e34a6-beb7-4d97-9057-452a050e9e68 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.209564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d39e34a6-beb7-4d97-9057-452a050e9e68 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.210281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d39e34a6-beb7-4d97-9057-452a050e9e68 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.217550 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7ae200ae-dded-4ce8-875a-6b7a9e2a1a24 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.318742 Oct 18 13:29:23.219582 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1576/2979] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:22 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:23.227300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8cd4ab11-7111-4974-856e-e0fd5065cc82 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:23.229300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8cd4ab11-7111-4974-856e-e0fd5065cc82 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:23.238196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cd4ab11-7111-4974-856e-e0fd5065cc82 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.242243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cd4ab11-7111-4974-856e-e0fd5065cc82 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.245587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cd4ab11-7111-4974-856e-e0fd5065cc82 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.251283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cd4ab11-7111-4974-856e-e0fd5065cc82 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.262183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cd4ab11-7111-4974-856e-e0fd5065cc82 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.265474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cd4ab11-7111-4974-856e-e0fd5065cc82 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.406045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d39e34a6-beb7-4d97-9057-452a050e9e68 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:23.420164 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d39e34a6-beb7-4d97-9057-452a050e9e68 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1268 microversion: 2.1 time: 0.249601 Oct 18 13:29:23.433203 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1404/2980] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:23 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1268 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:23.433203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-14970f02-9fda-4351-b697-0ee88d58810e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:23.433203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-14970f02-9fda-4351-b697-0ee88d58810e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:23.437032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14970f02-9fda-4351-b697-0ee88d58810e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.437763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14970f02-9fda-4351-b697-0ee88d58810e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.438401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14970f02-9fda-4351-b697-0ee88d58810e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.439263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14970f02-9fda-4351-b697-0ee88d58810e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.439951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14970f02-9fda-4351-b697-0ee88d58810e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.440614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14970f02-9fda-4351-b697-0ee88d58810e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.515806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8cd4ab11-7111-4974-856e-e0fd5065cc82 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:23.528904 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8cd4ab11-7111-4974-856e-e0fd5065cc82 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1527 microversion: 2.1 time: 0.307747 Oct 18 13:29:23.541211 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1577/2981] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:23 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1527 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:23.541211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-26ce5b2c-da4b-4f2c-a676-b2ca308ced8e tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:23.541211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-26ce5b2c-da4b-4f2c-a676-b2ca308ced8e tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:23.544453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26ce5b2c-da4b-4f2c-a676-b2ca308ced8e tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.545225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26ce5b2c-da4b-4f2c-a676-b2ca308ced8e tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.545904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26ce5b2c-da4b-4f2c-a676-b2ca308ced8e tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.546854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26ce5b2c-da4b-4f2c-a676-b2ca308ced8e tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.547790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26ce5b2c-da4b-4f2c-a676-b2ca308ced8e tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.548437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-26ce5b2c-da4b-4f2c-a676-b2ca308ced8e tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.783964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-26ce5b2c-da4b-4f2c-a676-b2ca308ced8e tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:23.795365 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-26ce5b2c-da4b-4f2c-a676-b2ca308ced8e tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1351 microversion: 2.1 time: 0.262791 Oct 18 13:29:23.812354 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1578/2982] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:23 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1351 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:23.822637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b6c5f7af-ff2f-4cc2-a6ee-753b5d8dcd06 tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Action: 'update', calling method: >, body: {"server": {"name": "ba16c299-3b2e-481a-99f0-89e02c0c7642_new"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:23.825351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b6c5f7af-ff2f-4cc2-a6ee-753b5d8dcd06 tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:23.835625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6c5f7af-ff2f-4cc2-a6ee-753b5d8dcd06 tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.836673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6c5f7af-ff2f-4cc2-a6ee-753b5d8dcd06 tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.837738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6c5f7af-ff2f-4cc2-a6ee-753b5d8dcd06 tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.839008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6c5f7af-ff2f-4cc2-a6ee-753b5d8dcd06 tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.839828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6c5f7af-ff2f-4cc2-a6ee-753b5d8dcd06 tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.840558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6c5f7af-ff2f-4cc2-a6ee-753b5d8dcd06 tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.891457 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-b6c5f7af-ff2f-4cc2-a6ee-753b5d8dcd06 tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] HTTP exception thrown: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b6c5f7af-ff2f-4cc2-a6ee-753b5d8dcd06 tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Request method failure captured: Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: request: PUT /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 HTTP/1.1 Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 64 Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqoVzZ9Mk4AeYLUwSQpL59T7SukQBZcfm8CvlMW1U1pRZfVS1EybqzDysQq8lLz8a8onfjY5iKivyDbWJzmvfIDcJvFv1ZR2zXRx3XGUZm7c80_QV7XG4_Mm0X6H1_vBeI3QC4EdE05RD8HqtOTjq8CLCSq3nQbLP4fd48cXTpxr6BY Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: ab13b93181dc4d69babc55626dacf160 Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-884287916 Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab13b93181dc4d69babc55626dacf160"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ab13b93181dc4d69babc55626dacf160"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab13b93181dc4d69babc55626dacf160"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ab13b93181dc4d69babc55626dacf160"}]}] Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-884287916 Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: ab13b93181dc4d69babc55626dacf160 Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-884287916 Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestMultiTenantJSON-884287916-project Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: ebeab2b1c314476cbf7989a9ca189c38 Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-884287916-project Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "ba16c299-3b2e-481a-99f0-89e02c0c7642_new"}} Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'ba16c299-3b2e-481a-99f0-89e02c0c7642', 'body': {'server': {'name': 'ba16c299-3b2e-481a-99f0-89e02c0c7642_new'}}} Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:29:23.900316 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b6c5f7af-ff2f-4cc2-a6ee-753b5d8dcd06 tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] Returning 404 to user: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b6c5f7af-ff2f-4cc2-a6ee-753b5d8dcd06 tempest-ServersNegativeTestMultiTenantJSON-884287916 tempest-ServersNegativeTestMultiTenantJSON-884287916-project] 10.222.0.40 "PUT /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 404 len: 111 microversion: 2.1 time: 0.088464 Oct 18 13:29:23.904405 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1579/2983] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 18 13:29:23 2022] PUT /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:23.916797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1f5ecb6c-4b46-466f-9bf4-79f4e01346dd tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:23.918842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1f5ecb6c-4b46-466f-9bf4-79f4e01346dd tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:23.919596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:23.926691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f5ecb6c-4b46-466f-9bf4-79f4e01346dd tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.928834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f5ecb6c-4b46-466f-9bf4-79f4e01346dd tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.929624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f5ecb6c-4b46-466f-9bf4-79f4e01346dd tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.931358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f5ecb6c-4b46-466f-9bf4-79f4e01346dd tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:23.932357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f5ecb6c-4b46-466f-9bf4-79f4e01346dd tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:23.933532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1f5ecb6c-4b46-466f-9bf4-79f4e01346dd tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:23.977375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1f5ecb6c-4b46-466f-9bf4-79f4e01346dd tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:24.141440 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1f5ecb6c-4b46-466f-9bf4-79f4e01346dd tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 204 len: 0 microversion: 2.1 time: 0.230122 Oct 18 13:29:24.142643 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1580/2984] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:23 2022] DELETE /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:29:24.149029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dfd9eeb5-5d3f-4b15-a886-25cf6a3e504e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:24.149244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-14970f02-9fda-4351-b697-0ee88d58810e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:24.149846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dfd9eeb5-5d3f-4b15-a886-25cf6a3e504e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:24.158406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfd9eeb5-5d3f-4b15-a886-25cf6a3e504e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.158773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfd9eeb5-5d3f-4b15-a886-25cf6a3e504e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.159268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfd9eeb5-5d3f-4b15-a886-25cf6a3e504e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.161551 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-14970f02-9fda-4351-b697-0ee88d58810e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.738713 Oct 18 13:29:24.163151 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1405/2985] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:23 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:24.163766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfd9eeb5-5d3f-4b15-a886-25cf6a3e504e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.164089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfd9eeb5-5d3f-4b15-a886-25cf6a3e504e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.164529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfd9eeb5-5d3f-4b15-a886-25cf6a3e504e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.169319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-39d6d51a-d12c-475c-ac49-f988c631327b tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:24.170181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-39d6d51a-d12c-475c-ac49-f988c631327b tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:24.178814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39d6d51a-d12c-475c-ac49-f988c631327b tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.179646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39d6d51a-d12c-475c-ac49-f988c631327b tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.180466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39d6d51a-d12c-475c-ac49-f988c631327b tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.181770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39d6d51a-d12c-475c-ac49-f988c631327b tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.182455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39d6d51a-d12c-475c-ac49-f988c631327b tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.183116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39d6d51a-d12c-475c-ac49-f988c631327b tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.411963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dfd9eeb5-5d3f-4b15-a886-25cf6a3e504e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:24.425044 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dfd9eeb5-5d3f-4b15-a886-25cf6a3e504e tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.280945 Oct 18 13:29:24.438331 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1581/2986] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:24 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:24.452467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca17c700-809f-411f-a1e5-209030f5aa3c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:24.454474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca17c700-809f-411f-a1e5-209030f5aa3c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:24.472320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca17c700-809f-411f-a1e5-209030f5aa3c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.475204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca17c700-809f-411f-a1e5-209030f5aa3c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.477150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca17c700-809f-411f-a1e5-209030f5aa3c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.478031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca17c700-809f-411f-a1e5-209030f5aa3c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.479767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca17c700-809f-411f-a1e5-209030f5aa3c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.481064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca17c700-809f-411f-a1e5-209030f5aa3c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.712444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ca17c700-809f-411f-a1e5-209030f5aa3c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:24.723058 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca17c700-809f-411f-a1e5-209030f5aa3c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.282802 Oct 18 13:29:24.724574 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1582/2987] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:24 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:24.733045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1e2367fa-accc-4800-8e2f-389efc8241fb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:24.735380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1e2367fa-accc-4800-8e2f-389efc8241fb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:24.753670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e2367fa-accc-4800-8e2f-389efc8241fb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.754488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e2367fa-accc-4800-8e2f-389efc8241fb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.754750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e2367fa-accc-4800-8e2f-389efc8241fb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.755805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e2367fa-accc-4800-8e2f-389efc8241fb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.756262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e2367fa-accc-4800-8e2f-389efc8241fb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.756692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e2367fa-accc-4800-8e2f-389efc8241fb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.894308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1e2367fa-accc-4800-8e2f-389efc8241fb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:24.899374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:24.939742 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1e2367fa-accc-4800-8e2f-389efc8241fb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1268 microversion: 2.1 time: 0.213838 Oct 18 13:29:24.945820 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1583/2988] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:24 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1268 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:24.962562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-77a6855d-182c-4aaf-a191-85e315f4fc79 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:24.964533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-77a6855d-182c-4aaf-a191-85e315f4fc79 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:24.987002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a6855d-182c-4aaf-a191-85e315f4fc79 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.987549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a6855d-182c-4aaf-a191-85e315f4fc79 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.988009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a6855d-182c-4aaf-a191-85e315f4fc79 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:24.989137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a6855d-182c-4aaf-a191-85e315f4fc79 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:24.989736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a6855d-182c-4aaf-a191-85e315f4fc79 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:24.990171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77a6855d-182c-4aaf-a191-85e315f4fc79 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:25.218501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-39d6d51a-d12c-475c-ac49-f988c631327b tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:25.229336 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-39d6d51a-d12c-475c-ac49-f988c631327b tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1533 microversion: 2.1 time: 1.064059 Oct 18 13:29:25.230020 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1406/2989] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:24 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1533 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:25.243363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1537114613", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "fa5737e5-8161-4ff1-a109-dbc177bf4e3a"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:25.369442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] validate_networks() for [('fa5737e5-8161-4ff1-a109-dbc177bf4e3a', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:29:25.446493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-77a6855d-182c-4aaf-a191-85e315f4fc79 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:25.460966 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-77a6855d-182c-4aaf-a191-85e315f4fc79 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1351 microversion: 2.1 time: 0.513997 Oct 18 13:29:25.461920 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1584/2990] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:24 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1351 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:25.466903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f441cf57-b438-4aac-a6b6-b3e23c1999e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:25.467598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f441cf57-b438-4aac-a6b6-b3e23c1999e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:25.476859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f441cf57-b438-4aac-a6b6-b3e23c1999e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.477761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f441cf57-b438-4aac-a6b6-b3e23c1999e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:25.478590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f441cf57-b438-4aac-a6b6-b3e23c1999e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:25.480034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f441cf57-b438-4aac-a6b6-b3e23c1999e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.480990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f441cf57-b438-4aac-a6b6-b3e23c1999e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:25.481650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f441cf57-b438-4aac-a6b6-b3e23c1999e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:25.779754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f441cf57-b438-4aac-a6b6-b3e23c1999e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:25.816473 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f441cf57-b438-4aac-a6b6-b3e23c1999e0 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.349838 Oct 18 13:29:25.816960 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1585/2991] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:25 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:25.972923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cd8c193c-5cc0-4cb7-a2a8-861073408ec5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:25.973639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cd8c193c-5cc0-4cb7-a2a8-861073408ec5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:25.985801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd8c193c-5cc0-4cb7-a2a8-861073408ec5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:25.999809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd8c193c-5cc0-4cb7-a2a8-861073408ec5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:26.003574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd8c193c-5cc0-4cb7-a2a8-861073408ec5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:26.007167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd8c193c-5cc0-4cb7-a2a8-861073408ec5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:26.012856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd8c193c-5cc0-4cb7-a2a8-861073408ec5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:26.015679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd8c193c-5cc0-4cb7-a2a8-861073408ec5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:26.194913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cd8c193c-5cc0-4cb7-a2a8-861073408ec5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:26.205266 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cd8c193c-5cc0-4cb7-a2a8-861073408ec5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1274 microversion: 2.1 time: 0.237072 Oct 18 13:29:26.206757 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1586/2992] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:25 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1274 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:26.226971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-17ba7801-1620-4e9f-a7b2-5fefa11a007c req-d92e88c0-91b4-49f4-abaf-2818174207c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969d338f-c468-409d-8d40-db5fb2b273ee", "name": "network-vif-unplugged", "status": "completed", "tag": "f734654d-3e14-44d4-bd74-65598fad1317"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:26.257084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-17ba7801-1620-4e9f-a7b2-5fefa11a007c req-d92e88c0-91b4-49f4-abaf-2818174207c6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:26.258009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-17ba7801-1620-4e9f-a7b2-5fefa11a007c req-d92e88c0-91b4-49f4-abaf-2818174207c6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:26.259011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-17ba7801-1620-4e9f-a7b2-5fefa11a007c req-d92e88c0-91b4-49f4-abaf-2818174207c6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:26.291056 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-17ba7801-1620-4e9f-a7b2-5fefa11a007c req-d92e88c0-91b4-49f4-abaf-2818174207c6 service nova] Creating event network-vif-unplugged:f734654d-3e14-44d4-bd74-65598fad1317 for instance 969d338f-c468-409d-8d40-db5fb2b273ee on n-h2-858384-13 Oct 18 13:29:26.296760 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-17ba7801-1620-4e9f-a7b2-5fefa11a007c req-d92e88c0-91b4-49f4-abaf-2818174207c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075841 Oct 18 13:29:26.297966 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1587/2993] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:29:26.308730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-07a756d7-13cb-4e3e-a18a-8f03779282a8 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:26.309142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-07a756d7-13cb-4e3e-a18a-8f03779282a8 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:26.316673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07a756d7-13cb-4e3e-a18a-8f03779282a8 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:26.317156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07a756d7-13cb-4e3e-a18a-8f03779282a8 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:26.318462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07a756d7-13cb-4e3e-a18a-8f03779282a8 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:26.318926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07a756d7-13cb-4e3e-a18a-8f03779282a8 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:26.319382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07a756d7-13cb-4e3e-a18a-8f03779282a8 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:26.319800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07a756d7-13cb-4e3e-a18a-8f03779282a8 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:26.773196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-07a756d7-13cb-4e3e-a18a-8f03779282a8 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:26.783024 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-07a756d7-13cb-4e3e-a18a-8f03779282a8 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1533 microversion: 2.1 time: 0.483858 Oct 18 13:29:26.794184 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1588/2994] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:26 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1533 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:26.808327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-126d828a-2008-4d02-b289-d25beba8f439 req-48f1e3de-5147-4295-a160-71995e159363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c74e947-034e-4c4d-80b4-2e6b59f4ae41", "name": "network-vif-plugged", "status": "completed", "tag": "b223df49-be57-4fa3-9914-5f17b0c21d6e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:26.826128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-126d828a-2008-4d02-b289-d25beba8f439 req-48f1e3de-5147-4295-a160-71995e159363 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:26.827872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-126d828a-2008-4d02-b289-d25beba8f439 req-48f1e3de-5147-4295-a160-71995e159363 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:26.828888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-126d828a-2008-4d02-b289-d25beba8f439 req-48f1e3de-5147-4295-a160-71995e159363 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:26.863112 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-126d828a-2008-4d02-b289-d25beba8f439 req-48f1e3de-5147-4295-a160-71995e159363 service nova] Creating event network-vif-plugged:b223df49-be57-4fa3-9914-5f17b0c21d6e for instance 5c74e947-034e-4c4d-80b4-2e6b59f4ae41 on n-h1-858384-13 Oct 18 13:29:26.893507 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-126d828a-2008-4d02-b289-d25beba8f439 req-48f1e3de-5147-4295-a160-71995e159363 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092275 Oct 18 13:29:26.894838 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1589/2995] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:26.902574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32921a53-71c0-42a2-abae-870639109d91 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:26.903560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-32921a53-71c0-42a2-abae-870639109d91 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:26.913152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32921a53-71c0-42a2-abae-870639109d91 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:26.913978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32921a53-71c0-42a2-abae-870639109d91 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:26.914648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32921a53-71c0-42a2-abae-870639109d91 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:26.915571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32921a53-71c0-42a2-abae-870639109d91 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:26.916264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32921a53-71c0-42a2-abae-870639109d91 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:26.917089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32921a53-71c0-42a2-abae-870639109d91 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.415449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-32921a53-71c0-42a2-abae-870639109d91 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:27.429609 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-32921a53-71c0-42a2-abae-870639109d91 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1351 microversion: 2.1 time: 0.532387 Oct 18 13:29:27.445213 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1590/2996] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:26 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1351 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:27.452788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b4e56056-3776-473b-9839-2976cca8e78a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:27.452788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b4e56056-3776-473b-9839-2976cca8e78a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:27.476779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4e56056-3776-473b-9839-2976cca8e78a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.480868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4e56056-3776-473b-9839-2976cca8e78a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.482623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4e56056-3776-473b-9839-2976cca8e78a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.486999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4e56056-3776-473b-9839-2976cca8e78a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.487822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4e56056-3776-473b-9839-2976cca8e78a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.488035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4e56056-3776-473b-9839-2976cca8e78a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.735625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:29:27.736972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:29:27.737673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:29:27.738313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:29:27.738921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:29:27.761454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.761988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.762475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.763502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.763993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.764420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.811634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Getting quotas for project 452e5b77db474cf9a2b7f6b2abcb6115. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:27.820170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b4e56056-3776-473b-9839-2976cca8e78a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:27.823107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Getting quotas for user 2878f8de95694fe1a9a17ed27b6ba40b and project 452e5b77db474cf9a2b7f6b2abcb6115. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:27.840621 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b4e56056-3776-473b-9839-2976cca8e78a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.403903 Oct 18 13:29:27.843271 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1591/2997] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:27 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:27.851494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b1a59d43-d14c-48dd-840d-0285d1644254 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:27.852544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b1a59d43-d14c-48dd-840d-0285d1644254 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:27.858055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:29:27.860255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:29:27.872934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1a59d43-d14c-48dd-840d-0285d1644254 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.875321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1a59d43-d14c-48dd-840d-0285d1644254 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.876277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1a59d43-d14c-48dd-840d-0285d1644254 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.877518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1a59d43-d14c-48dd-840d-0285d1644254 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.879040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1a59d43-d14c-48dd-840d-0285d1644254 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.885686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1a59d43-d14c-48dd-840d-0285d1644254 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.963280 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e23311bc-4845-44d4-8cd5-701d4e3dbd09 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.724797 Oct 18 13:29:27.964483 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1407/2998] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:29:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:29:27.970852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0df4bce0-3aab-4285-9f2f-968d296345b9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:27.975018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0df4bce0-3aab-4285-9f2f-968d296345b9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:27.994549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0df4bce0-3aab-4285-9f2f-968d296345b9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.995316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0df4bce0-3aab-4285-9f2f-968d296345b9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.995961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0df4bce0-3aab-4285-9f2f-968d296345b9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:27.997123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0df4bce0-3aab-4285-9f2f-968d296345b9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:27.997764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0df4bce0-3aab-4285-9f2f-968d296345b9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:27.998360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0df4bce0-3aab-4285-9f2f-968d296345b9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.181078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:28.374044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0df4bce0-3aab-4285-9f2f-968d296345b9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c94468144da455d9a9b7f3bcda39102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a33407ead044eb8f22cb67796fe416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:28.390875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b1a59d43-d14c-48dd-840d-0285d1644254 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:28.393553 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0df4bce0-3aab-4285-9f2f-968d296345b9 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 200 len: 1491 microversion: 2.1 time: 0.426058 Oct 18 13:29:28.395387 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1408/2999] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:27 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 1491 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:28.405541 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b1a59d43-d14c-48dd-840d-0285d1644254 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1316 microversion: 2.1 time: 0.558353 Oct 18 13:29:28.406668 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1592/3000] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:27 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:28.414870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-32e219bd-7106-422e-bba8-dc9510189b2d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:28.414870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-32e219bd-7106-422e-bba8-dc9510189b2d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:28.461341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9df9a41f-13b1-450f-9e3a-625e91394ff1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:28.462199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9df9a41f-13b1-450f-9e3a-625e91394ff1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:28.472748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9df9a41f-13b1-450f-9e3a-625e91394ff1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.482416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9df9a41f-13b1-450f-9e3a-625e91394ff1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.483295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9df9a41f-13b1-450f-9e3a-625e91394ff1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.484436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9df9a41f-13b1-450f-9e3a-625e91394ff1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.485304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9df9a41f-13b1-450f-9e3a-625e91394ff1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.486004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9df9a41f-13b1-450f-9e3a-625e91394ff1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.626631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-32e219bd-7106-422e-bba8-dc9510189b2d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:28.639071 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-32e219bd-7106-422e-bba8-dc9510189b2d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1215 microversion: 2.1 time: 0.241220 Oct 18 13:29:28.644400 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1409/3001] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:28 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1215 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:28.658355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a58f0dcc-0725-4bcb-b059-dc719bfb4f02 req-a14622a2-4c30-4338-a7f7-f7184500fa1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba16c299-3b2e-481a-99f0-89e02c0c7642", "name": "network-vif-deleted", "tag": "b8c58ecb-c9f8-44fe-a484-01aaf1be4c74"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:28.693396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a58f0dcc-0725-4bcb-b059-dc719bfb4f02 req-a14622a2-4c30-4338-a7f7-f7184500fa1b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.695390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a58f0dcc-0725-4bcb-b059-dc719bfb4f02 req-a14622a2-4c30-4338-a7f7-f7184500fa1b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.697641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a58f0dcc-0725-4bcb-b059-dc719bfb4f02 req-a14622a2-4c30-4338-a7f7-f7184500fa1b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.748339 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a58f0dcc-0725-4bcb-b059-dc719bfb4f02 req-a14622a2-4c30-4338-a7f7-f7184500fa1b service nova] Creating event network-vif-deleted:b8c58ecb-c9f8-44fe-a484-01aaf1be4c74 for instance ba16c299-3b2e-481a-99f0-89e02c0c7642 on n-h2-858384-13 Oct 18 13:29:28.760574 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a58f0dcc-0725-4bcb-b059-dc719bfb4f02 req-a14622a2-4c30-4338-a7f7-f7184500fa1b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114018 Oct 18 13:29:28.764394 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1410/3002] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:28.875811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4f9cb7b3-9a3b-4458-8773-edaec6b41fd1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:28.876983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4f9cb7b3-9a3b-4458-8773-edaec6b41fd1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:28.877362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9df9a41f-13b1-450f-9e3a-625e91394ff1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:28.891908 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9df9a41f-13b1-450f-9e3a-625e91394ff1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1351 microversion: 2.1 time: 0.435076 Oct 18 13:29:28.893577 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1593/3003] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:28 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1351 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:28.904032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f9cb7b3-9a3b-4458-8773-edaec6b41fd1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.904554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f9cb7b3-9a3b-4458-8773-edaec6b41fd1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.905392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f9cb7b3-9a3b-4458-8773-edaec6b41fd1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.906272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f9cb7b3-9a3b-4458-8773-edaec6b41fd1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.909973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f9cb7b3-9a3b-4458-8773-edaec6b41fd1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.910782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f9cb7b3-9a3b-4458-8773-edaec6b41fd1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:28.947957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-bd84dd89-4cb1-4a33-b5da-f4b8e7ac394b req-87aa3d37-331a-4da1-a55f-6bee26e0f11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9553c0a8-d014-4d8f-a4c7-b21f44bb47ff", "tag": "3a5e8acd-285c-468b-b9c5-1cb3c3934322"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:28.983110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bd84dd89-4cb1-4a33-b5da-f4b8e7ac394b req-87aa3d37-331a-4da1-a55f-6bee26e0f11e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:28.984989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bd84dd89-4cb1-4a33-b5da-f4b8e7ac394b req-87aa3d37-331a-4da1-a55f-6bee26e0f11e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:28.985848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bd84dd89-4cb1-4a33-b5da-f4b8e7ac394b req-87aa3d37-331a-4da1-a55f-6bee26e0f11e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:29.046868 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-bd84dd89-4cb1-4a33-b5da-f4b8e7ac394b req-87aa3d37-331a-4da1-a55f-6bee26e0f11e service nova] Creating event network-changed:3a5e8acd-285c-468b-b9c5-1cb3c3934322 for instance 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff on n-h1-858384-13 Oct 18 13:29:29.063831 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-bd84dd89-4cb1-4a33-b5da-f4b8e7ac394b req-87aa3d37-331a-4da1-a55f-6bee26e0f11e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122295 Oct 18 13:29:29.067541 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1594/3004] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:29:29.426470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-00a1b500-763a-4eee-946d-57efe79b6f76 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:29.428103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-00a1b500-763a-4eee-946d-57efe79b6f76 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] [instance: ba16c299-3b2e-481a-99f0-89e02c0c7642] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:29.437589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00a1b500-763a-4eee-946d-57efe79b6f76 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:29.438230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00a1b500-763a-4eee-946d-57efe79b6f76 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:29.438805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00a1b500-763a-4eee-946d-57efe79b6f76 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:29.440060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00a1b500-763a-4eee-946d-57efe79b6f76 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:29.440575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00a1b500-763a-4eee-946d-57efe79b6f76 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:29.441879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00a1b500-763a-4eee-946d-57efe79b6f76 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:29.467991 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-00a1b500-763a-4eee-946d-57efe79b6f76 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] HTTP exception thrown: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-00a1b500-763a-4eee-946d-57efe79b6f76 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Request method failure captured: Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 HTTP/1.1 Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqoFSJzdJDTNjmgXha43IaOYh72fdar4OFC-8qqDTdKRMxFurqOwKYXIZuvWgMh6kieRw65Wd6U3Jf72HzrHEX1CBQZvrHt9zx1ORRZYm8ZeYnSjBqJ6E4LZzXKq_wooKCyxRfOm_ktBP0tvKqtX-cD_FQxkZwDGzt3G9Jws2bSis4o Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: c0a33407ead044eb8f22cb67796fe416 Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1470442197 Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0a33407ead044eb8f22cb67796fe416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c0a33407ead044eb8f22cb67796fe416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c0a33407ead044eb8f22cb67796fe416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c0a33407ead044eb8f22cb67796fe416"}]}] Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1470442197 Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: c0a33407ead044eb8f22cb67796fe416 Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1470442197 Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1470442197-project Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7c94468144da455d9a9b7f3bcda39102 Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1470442197-project Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'ba16c299-3b2e-481a-99f0-89e02c0c7642'} Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:29.470827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:29.476477 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:29.476477 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:29.476477 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:29.476477 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:29.476477 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:29.476477 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:29.476477 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:29.476477 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. Oct 18 13:29:29.476477 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:29.476477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-00a1b500-763a-4eee-946d-57efe79b6f76 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] Returning 404 to user: Instance ba16c299-3b2e-481a-99f0-89e02c0c7642 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:29.476477 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-00a1b500-763a-4eee-946d-57efe79b6f76 tempest-ServersNegativeTestMultiTenantJSON-1470442197 tempest-ServersNegativeTestMultiTenantJSON-1470442197-project] 10.222.0.40 "GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642" status: 404 len: 111 microversion: 2.1 time: 0.053192 Oct 18 13:29:29.476477 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1595/3005] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:29 2022] GET /compute/v2.1/servers/ba16c299-3b2e-481a-99f0-89e02c0c7642 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:29:29.481588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6e7a2cbf-7202-482c-80c7-9d8ec02ea353 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:29.482533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6e7a2cbf-7202-482c-80c7-9d8ec02ea353 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:29.491364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e7a2cbf-7202-482c-80c7-9d8ec02ea353 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:29.491962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e7a2cbf-7202-482c-80c7-9d8ec02ea353 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:29.492624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e7a2cbf-7202-482c-80c7-9d8ec02ea353 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:29.493392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e7a2cbf-7202-482c-80c7-9d8ec02ea353 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:29.493844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e7a2cbf-7202-482c-80c7-9d8ec02ea353 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:29.494518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e7a2cbf-7202-482c-80c7-9d8ec02ea353 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:29.791866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4f9cb7b3-9a3b-4458-8773-edaec6b41fd1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:29.810717 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4f9cb7b3-9a3b-4458-8773-edaec6b41fd1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.941063 Oct 18 13:29:29.825804 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1411/3006] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:28 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:29.836970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-feeef1d7-8e39-420c-987d-2af0ee080b8e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:29.837929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-feeef1d7-8e39-420c-987d-2af0ee080b8e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:29.845052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-feeef1d7-8e39-420c-987d-2af0ee080b8e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:29.845983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-feeef1d7-8e39-420c-987d-2af0ee080b8e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:29.846711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-feeef1d7-8e39-420c-987d-2af0ee080b8e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:29.847858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-feeef1d7-8e39-420c-987d-2af0ee080b8e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:29.848577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-feeef1d7-8e39-420c-987d-2af0ee080b8e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:29.850410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-feeef1d7-8e39-420c-987d-2af0ee080b8e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:30.016286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6e7a2cbf-7202-482c-80c7-9d8ec02ea353 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:30.029643 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6e7a2cbf-7202-482c-80c7-9d8ec02ea353 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1316 microversion: 2.1 time: 0.554829 Oct 18 13:29:30.032133 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1596/3007] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:29 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:30.045906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-feeef1d7-8e39-420c-987d-2af0ee080b8e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:30.047551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fbed27e4-b1e8-4209-a090-f1d20de2ee0c tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:30.049018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fbed27e4-b1e8-4209-a090-f1d20de2ee0c tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:30.071340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fbed27e4-b1e8-4209-a090-f1d20de2ee0c tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:30.072069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fbed27e4-b1e8-4209-a090-f1d20de2ee0c tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:30.073801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fbed27e4-b1e8-4209-a090-f1d20de2ee0c tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:30.076407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fbed27e4-b1e8-4209-a090-f1d20de2ee0c tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:30.077262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fbed27e4-b1e8-4209-a090-f1d20de2ee0c tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:30.079026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fbed27e4-b1e8-4209-a090-f1d20de2ee0c tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:30.102193 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-feeef1d7-8e39-420c-987d-2af0ee080b8e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1211 microversion: 2.1 time: 0.237585 Oct 18 13:29:30.104671 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1412/3008] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:29 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1211 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:30.766905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fbed27e4-b1e8-4209-a090-f1d20de2ee0c tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:30.780613 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fbed27e4-b1e8-4209-a090-f1d20de2ee0c tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1541 microversion: 2.1 time: 0.745126 Oct 18 13:29:30.781837 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1597/3009] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:30 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1541 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:30.808594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af1e3088-ad65-4e96-a33f-9a23404b4037 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:30.809777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-af1e3088-ad65-4e96-a33f-9a23404b4037 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:30.818567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af1e3088-ad65-4e96-a33f-9a23404b4037 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:30.819701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af1e3088-ad65-4e96-a33f-9a23404b4037 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:30.820414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af1e3088-ad65-4e96-a33f-9a23404b4037 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:30.821572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af1e3088-ad65-4e96-a33f-9a23404b4037 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:30.822422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af1e3088-ad65-4e96-a33f-9a23404b4037 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:30.823053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af1e3088-ad65-4e96-a33f-9a23404b4037 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:30.839574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-03926848-2d11-4032-85ca-a7494bf61630 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:30.840968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-03926848-2d11-4032-85ca-a7494bf61630 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:30.853232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03926848-2d11-4032-85ca-a7494bf61630 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:30.854421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03926848-2d11-4032-85ca-a7494bf61630 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:30.856146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03926848-2d11-4032-85ca-a7494bf61630 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:30.857446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03926848-2d11-4032-85ca-a7494bf61630 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:30.858799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03926848-2d11-4032-85ca-a7494bf61630 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:30.860692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03926848-2d11-4032-85ca-a7494bf61630 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:31.027602 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-af1e3088-ad65-4e96-a33f-9a23404b4037 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.225224 Oct 18 13:29:31.037654 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1413/3010] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:29:30 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:31.043853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-66fbe00c-92f3-4110-95f4-0741d14bfd03 req-17a5d0e9-72e8-4606-b20a-483aa458e88c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969d338f-c468-409d-8d40-db5fb2b273ee", "tag": "f734654d-3e14-44d4-bd74-65598fad1317"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:31.078005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-66fbe00c-92f3-4110-95f4-0741d14bfd03 req-17a5d0e9-72e8-4606-b20a-483aa458e88c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:31.079210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-66fbe00c-92f3-4110-95f4-0741d14bfd03 req-17a5d0e9-72e8-4606-b20a-483aa458e88c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:31.082040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-66fbe00c-92f3-4110-95f4-0741d14bfd03 req-17a5d0e9-72e8-4606-b20a-483aa458e88c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:31.151764 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-66fbe00c-92f3-4110-95f4-0741d14bfd03 req-17a5d0e9-72e8-4606-b20a-483aa458e88c service nova] Creating event network-changed:f734654d-3e14-44d4-bd74-65598fad1317 for instance 969d338f-c468-409d-8d40-db5fb2b273ee on n-h2-858384-13 Oct 18 13:29:31.171671 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-66fbe00c-92f3-4110-95f4-0741d14bfd03 req-17a5d0e9-72e8-4606-b20a-483aa458e88c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131824 Oct 18 13:29:31.173623 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1414/3011] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:31.182976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-987f8d41-c0e4-40cb-9b48-d91fbf2287d8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:31.184035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-987f8d41-c0e4-40cb-9b48-d91fbf2287d8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:31.191975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-987f8d41-c0e4-40cb-9b48-d91fbf2287d8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:31.193056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-987f8d41-c0e4-40cb-9b48-d91fbf2287d8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:31.193891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-987f8d41-c0e4-40cb-9b48-d91fbf2287d8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:31.194914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-987f8d41-c0e4-40cb-9b48-d91fbf2287d8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:31.195586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-987f8d41-c0e4-40cb-9b48-d91fbf2287d8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:31.196225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-987f8d41-c0e4-40cb-9b48-d91fbf2287d8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:31.539820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-03926848-2d11-4032-85ca-a7494bf61630 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:31.558179 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-03926848-2d11-4032-85ca-a7494bf61630 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.719481 Oct 18 13:29:31.568468 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1598/3012] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:30 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:31.568468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ddd0ff93-e1cf-4d29-beac-3cb93b149861 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:31.568468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ddd0ff93-e1cf-4d29-beac-3cb93b149861 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:31.594636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddd0ff93-e1cf-4d29-beac-3cb93b149861 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:31.596286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddd0ff93-e1cf-4d29-beac-3cb93b149861 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:31.598648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddd0ff93-e1cf-4d29-beac-3cb93b149861 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:31.600234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddd0ff93-e1cf-4d29-beac-3cb93b149861 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:31.602661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddd0ff93-e1cf-4d29-beac-3cb93b149861 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:31.603988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddd0ff93-e1cf-4d29-beac-3cb93b149861 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:31.656828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-987f8d41-c0e4-40cb-9b48-d91fbf2287d8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:31.665358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:31.672009 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-987f8d41-c0e4-40cb-9b48-d91fbf2287d8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1316 microversion: 2.1 time: 0.496436 Oct 18 13:29:31.685649 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1415/3013] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:31 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1316 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:32.039375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=10 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:32.084369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ddd0ff93-e1cf-4d29-beac-3cb93b149861 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:32.111079 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ddd0ff93-e1cf-4d29-beac-3cb93b149861 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1273 microversion: 2.1 time: 0.549813 Oct 18 13:29:32.112049 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1599/3014] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:31 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1273 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:32.585105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f82f6ea8-5a56-4e1e-a3f4-f161544fceea tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:32.585754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f82f6ea8-5a56-4e1e-a3f4-f161544fceea tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:32.595549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f82f6ea8-5a56-4e1e-a3f4-f161544fceea tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.596530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f82f6ea8-5a56-4e1e-a3f4-f161544fceea tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.597375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f82f6ea8-5a56-4e1e-a3f4-f161544fceea tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.598615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f82f6ea8-5a56-4e1e-a3f4-f161544fceea tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.600328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f82f6ea8-5a56-4e1e-a3f4-f161544fceea tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.601116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f82f6ea8-5a56-4e1e-a3f4-f161544fceea tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.702639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1634c2e0-3bda-411e-a023-eab84967656a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:32.703675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1634c2e0-3bda-411e-a023-eab84967656a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:32.711029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1634c2e0-3bda-411e-a023-eab84967656a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.711893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1634c2e0-3bda-411e-a023-eab84967656a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.713532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1634c2e0-3bda-411e-a023-eab84967656a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:32.714476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1634c2e0-3bda-411e-a023-eab84967656a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:32.715129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1634c2e0-3bda-411e-a023-eab84967656a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:32.715707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1634c2e0-3bda-411e-a023-eab84967656a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:33.449378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1634c2e0-3bda-411e-a023-eab84967656a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:33.465654 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1634c2e0-3bda-411e-a023-eab84967656a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1316 microversion: 2.1 time: 0.766031 Oct 18 13:29:33.479918 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1600/3015] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:32 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1316 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:33.509242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f3945ce-c149-49e8-9041-ce2b7e382369 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:33.509878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7f3945ce-c149-49e8-9041-ce2b7e382369 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:33.544778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f3945ce-c149-49e8-9041-ce2b7e382369 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:33.546848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f3945ce-c149-49e8-9041-ce2b7e382369 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:33.550687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f3945ce-c149-49e8-9041-ce2b7e382369 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:33.555459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f3945ce-c149-49e8-9041-ce2b7e382369 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:33.557642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f3945ce-c149-49e8-9041-ce2b7e382369 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:33.559203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f3945ce-c149-49e8-9041-ce2b7e382369 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:33.953212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7f3945ce-c149-49e8-9041-ce2b7e382369 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:33.971829 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7f3945ce-c149-49e8-9041-ce2b7e382369 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1273 microversion: 2.1 time: 0.487389 Oct 18 13:29:33.975925 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1601/3016] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:33 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1273 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:33.994513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-30beb40b-d614-4eac-93a8-17f35cb80012 req-6fa1f81e-b3b5-4811-b5f2-da469c3321a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c74e947-034e-4c4d-80b4-2e6b59f4ae41", "tag": "b223df49-be57-4fa3-9914-5f17b0c21d6e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:34.028627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-30beb40b-d614-4eac-93a8-17f35cb80012 req-6fa1f81e-b3b5-4811-b5f2-da469c3321a0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:34.033110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-30beb40b-d614-4eac-93a8-17f35cb80012 req-6fa1f81e-b3b5-4811-b5f2-da469c3321a0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:34.034520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-30beb40b-d614-4eac-93a8-17f35cb80012 req-6fa1f81e-b3b5-4811-b5f2-da469c3321a0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:34.084782 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-30beb40b-d614-4eac-93a8-17f35cb80012 req-6fa1f81e-b3b5-4811-b5f2-da469c3321a0 service nova] Creating event network-changed:b223df49-be57-4fa3-9914-5f17b0c21d6e for instance 5c74e947-034e-4c4d-80b4-2e6b59f4ae41 on n-h1-858384-13 Oct 18 13:29:34.106248 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-30beb40b-d614-4eac-93a8-17f35cb80012 req-6fa1f81e-b3b5-4811-b5f2-da469c3321a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123720 Oct 18 13:29:34.108993 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1602/3017] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:34.235307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f82f6ea8-5a56-4e1e-a3f4-f161544fceea tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:34.273103 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f82f6ea8-5a56-4e1e-a3f4-f161544fceea tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 1.692938 Oct 18 13:29:34.280438 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1416/3018] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:32 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:34.497252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-599b7799-3ed1-4bd1-836e-3f082711c1bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:34.500885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-599b7799-3ed1-4bd1-836e-3f082711c1bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:34.525108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-599b7799-3ed1-4bd1-836e-3f082711c1bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:34.528405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-599b7799-3ed1-4bd1-836e-3f082711c1bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:34.531292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-599b7799-3ed1-4bd1-836e-3f082711c1bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:34.532367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-599b7799-3ed1-4bd1-836e-3f082711c1bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:34.533066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-599b7799-3ed1-4bd1-836e-3f082711c1bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:34.535310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-599b7799-3ed1-4bd1-836e-3f082711c1bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:35.001074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-658a4dbc-2c00-41c0-8623-69e487e8fb23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:35.002298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-658a4dbc-2c00-41c0-8623-69e487e8fb23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:35.016619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-658a4dbc-2c00-41c0-8623-69e487e8fb23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:35.018452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-658a4dbc-2c00-41c0-8623-69e487e8fb23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:35.019245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-658a4dbc-2c00-41c0-8623-69e487e8fb23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:35.020193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-658a4dbc-2c00-41c0-8623-69e487e8fb23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:35.021335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-658a4dbc-2c00-41c0-8623-69e487e8fb23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:35.021986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-658a4dbc-2c00-41c0-8623-69e487e8fb23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:35.983855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-658a4dbc-2c00-41c0-8623-69e487e8fb23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:36.001130 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-658a4dbc-2c00-41c0-8623-69e487e8fb23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1315 microversion: 2.1 time: 1.001852 Oct 18 13:29:36.005699 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1417/3019] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:34 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1315 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:36.028261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3b0903fb-769d-4def-a22d-4c07e5711f11 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:36.029473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3b0903fb-769d-4def-a22d-4c07e5711f11 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:36.067977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b0903fb-769d-4def-a22d-4c07e5711f11 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:36.068736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b0903fb-769d-4def-a22d-4c07e5711f11 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:36.070507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b0903fb-769d-4def-a22d-4c07e5711f11 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:36.072265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b0903fb-769d-4def-a22d-4c07e5711f11 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:36.073172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b0903fb-769d-4def-a22d-4c07e5711f11 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:36.073866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b0903fb-769d-4def-a22d-4c07e5711f11 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:36.143338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-599b7799-3ed1-4bd1-836e-3f082711c1bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:36.146270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:36.169639 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-599b7799-3ed1-4bd1-836e-3f082711c1bf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1316 microversion: 2.1 time: 1.685125 Oct 18 13:29:36.171089 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1603/3020] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:34 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1316 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:37.029985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-57f132b0-8589-4772-8ba8-61b98adcbb0d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:37.030607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-57f132b0-8589-4772-8ba8-61b98adcbb0d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:37.039336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57f132b0-8589-4772-8ba8-61b98adcbb0d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:37.039829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57f132b0-8589-4772-8ba8-61b98adcbb0d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:37.040262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57f132b0-8589-4772-8ba8-61b98adcbb0d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:37.040965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57f132b0-8589-4772-8ba8-61b98adcbb0d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:37.063815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57f132b0-8589-4772-8ba8-61b98adcbb0d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:37.064565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57f132b0-8589-4772-8ba8-61b98adcbb0d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:37.688343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3b0903fb-769d-4def-a22d-4c07e5711f11 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:37.702731 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3b0903fb-769d-4def-a22d-4c07e5711f11 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 1.694300 Oct 18 13:29:37.705909 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1418/3021] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:36 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:37.719973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-862c5ff9-293e-438a-925d-dd12cdcf35e7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:37.721027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-862c5ff9-293e-438a-925d-dd12cdcf35e7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:37.733465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-862c5ff9-293e-438a-925d-dd12cdcf35e7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:37.734279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-862c5ff9-293e-438a-925d-dd12cdcf35e7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:37.735216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-862c5ff9-293e-438a-925d-dd12cdcf35e7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:37.736128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-862c5ff9-293e-438a-925d-dd12cdcf35e7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:37.738957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-862c5ff9-293e-438a-925d-dd12cdcf35e7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:37.741862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-862c5ff9-293e-438a-925d-dd12cdcf35e7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:37.788470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:38.042645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-57f132b0-8589-4772-8ba8-61b98adcbb0d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:38.060861 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-57f132b0-8589-4772-8ba8-61b98adcbb0d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1315 microversion: 2.1 time: 1.034717 Oct 18 13:29:38.061508 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1604/3022] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:37 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1315 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:38.372086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-862c5ff9-293e-438a-925d-dd12cdcf35e7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:38.381206 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-862c5ff9-293e-438a-925d-dd12cdcf35e7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1316 microversion: 2.1 time: 0.674013 Oct 18 13:29:38.385507 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1419/3023] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:37 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1316 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:38.729241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3a614257-cdac-418a-8e1c-cd5e32eb3057 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:38.730161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3a614257-cdac-418a-8e1c-cd5e32eb3057 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:38.741255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a614257-cdac-418a-8e1c-cd5e32eb3057 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:38.742846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a614257-cdac-418a-8e1c-cd5e32eb3057 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:38.743487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a614257-cdac-418a-8e1c-cd5e32eb3057 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:38.744511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a614257-cdac-418a-8e1c-cd5e32eb3057 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:38.744981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a614257-cdac-418a-8e1c-cd5e32eb3057 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:38.745454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a614257-cdac-418a-8e1c-cd5e32eb3057 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.066157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3a614257-cdac-418a-8e1c-cd5e32eb3057 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:39.077226 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3a614257-cdac-418a-8e1c-cd5e32eb3057 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.352344 Oct 18 13:29:39.086745 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1605/3024] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:38 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:39.118826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0cb50ecd-2e0a-4bd6-8aa1-df2135a1f705 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:39.119469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0cb50ecd-2e0a-4bd6-8aa1-df2135a1f705 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:39.121416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=14 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:39.135258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cb50ecd-2e0a-4bd6-8aa1-df2135a1f705 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.135757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cb50ecd-2e0a-4bd6-8aa1-df2135a1f705 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.136270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cb50ecd-2e0a-4bd6-8aa1-df2135a1f705 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.136972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cb50ecd-2e0a-4bd6-8aa1-df2135a1f705 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.137610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cb50ecd-2e0a-4bd6-8aa1-df2135a1f705 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.137861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0cb50ecd-2e0a-4bd6-8aa1-df2135a1f705 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.367875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c88e8f5d-a67e-410d-8fbb-5ab43069bf22 req-c83c10d8-a5ee-4ad1-9383-3e80016793ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b83d20-5690-49dc-bff4-e6906a63ee23", "tag": "e01e4d55-3474-4431-af07-7a611cccd407"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:39.413378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c88e8f5d-a67e-410d-8fbb-5ab43069bf22 req-c83c10d8-a5ee-4ad1-9383-3e80016793ec service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.414291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c88e8f5d-a67e-410d-8fbb-5ab43069bf22 req-c83c10d8-a5ee-4ad1-9383-3e80016793ec service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.416118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c88e8f5d-a67e-410d-8fbb-5ab43069bf22 req-c83c10d8-a5ee-4ad1-9383-3e80016793ec service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.432965 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c88e8f5d-a67e-410d-8fbb-5ab43069bf22 req-c83c10d8-a5ee-4ad1-9383-3e80016793ec service nova] Creating event network-changed:e01e4d55-3474-4431-af07-7a611cccd407 for instance 92b83d20-5690-49dc-bff4-e6906a63ee23 on n-h2-858384-13 Oct 18 13:29:39.441630 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c88e8f5d-a67e-410d-8fbb-5ab43069bf22 req-c83c10d8-a5ee-4ad1-9383-3e80016793ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080518 Oct 18 13:29:39.443156 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1606/3025] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:39.453905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b23a1517-ef1c-42a9-b5d2-ef45152b10db tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:39.455079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b23a1517-ef1c-42a9-b5d2-ef45152b10db tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:39.463567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b23a1517-ef1c-42a9-b5d2-ef45152b10db tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.469767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b23a1517-ef1c-42a9-b5d2-ef45152b10db tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.470232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b23a1517-ef1c-42a9-b5d2-ef45152b10db tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.472793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b23a1517-ef1c-42a9-b5d2-ef45152b10db tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:39.477070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b23a1517-ef1c-42a9-b5d2-ef45152b10db tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:39.477566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b23a1517-ef1c-42a9-b5d2-ef45152b10db tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:39.743282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0cb50ecd-2e0a-4bd6-8aa1-df2135a1f705 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:39.754728 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0cb50ecd-2e0a-4bd6-8aa1-df2135a1f705 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1315 microversion: 2.1 time: 0.674139 Oct 18 13:29:39.772757 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1420/3026] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:39 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1315 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:39.861479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1482186858", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "ed3d6fb6-bc95-4e0a-9617-ed9ae0b77a43"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:39.905267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b23a1517-ef1c-42a9-b5d2-ef45152b10db tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:39.919938 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b23a1517-ef1c-42a9-b5d2-ef45152b10db tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1316 microversion: 2.1 time: 0.471044 Oct 18 13:29:39.940772 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1607/3027] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:39 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:39.988656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] validate_networks() for [('ed3d6fb6-bc95-4e0a-9617-ed9ae0b77a43', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:29:40.119428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-840a7460-5fab-4c59-8d1f-23ee8010e30c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:40.121916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-840a7460-5fab-4c59-8d1f-23ee8010e30c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:40.132229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-840a7460-5fab-4c59-8d1f-23ee8010e30c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.136514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-840a7460-5fab-4c59-8d1f-23ee8010e30c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.138018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-840a7460-5fab-4c59-8d1f-23ee8010e30c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:40.179816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-840a7460-5fab-4c59-8d1f-23ee8010e30c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.182752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-840a7460-5fab-4c59-8d1f-23ee8010e30c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.183459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-840a7460-5fab-4c59-8d1f-23ee8010e30c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:40.553040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-840a7460-5fab-4c59-8d1f-23ee8010e30c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:40.563731 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-840a7460-5fab-4c59-8d1f-23ee8010e30c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.449655 Oct 18 13:29:40.581807 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1608/3028] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:40 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:40.615106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-bbab1e70-ec4a-4cb4-9bdd-2b20aa88fd91 req-d3cecd99-d21e-4aaa-82e9-c1c428297a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9553c0a8-d014-4d8f-a4c7-b21f44bb47ff", "name": "network-vif-plugged", "status": "completed", "tag": "3a5e8acd-285c-468b-b9c5-1cb3c3934322"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:40.632609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bbab1e70-ec4a-4cb4-9bdd-2b20aa88fd91 req-d3cecd99-d21e-4aaa-82e9-c1c428297a33 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.635601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bbab1e70-ec4a-4cb4-9bdd-2b20aa88fd91 req-d3cecd99-d21e-4aaa-82e9-c1c428297a33 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.637430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bbab1e70-ec4a-4cb4-9bdd-2b20aa88fd91 req-d3cecd99-d21e-4aaa-82e9-c1c428297a33 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:40.668794 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-bbab1e70-ec4a-4cb4-9bdd-2b20aa88fd91 req-d3cecd99-d21e-4aaa-82e9-c1c428297a33 service nova] Creating event network-vif-plugged:3a5e8acd-285c-468b-b9c5-1cb3c3934322 for instance 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff on n-h1-858384-13 Oct 18 13:29:40.679566 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-bbab1e70-ec4a-4cb4-9bdd-2b20aa88fd91 req-d3cecd99-d21e-4aaa-82e9-c1c428297a33 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068577 Oct 18 13:29:40.683004 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1609/3029] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:29:40.790587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6f7fb1f4-e4ee-433a-895c-9f1ea81cf171 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:40.791482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6f7fb1f4-e4ee-433a-895c-9f1ea81cf171 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:40.805157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f7fb1f4-e4ee-433a-895c-9f1ea81cf171 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.807499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f7fb1f4-e4ee-433a-895c-9f1ea81cf171 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.808135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f7fb1f4-e4ee-433a-895c-9f1ea81cf171 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:40.808977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f7fb1f4-e4ee-433a-895c-9f1ea81cf171 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:40.812762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f7fb1f4-e4ee-433a-895c-9f1ea81cf171 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:40.813725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f7fb1f4-e4ee-433a-895c-9f1ea81cf171 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.044691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6f7fb1f4-e4ee-433a-895c-9f1ea81cf171 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:41.074265 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6f7fb1f4-e4ee-433a-895c-9f1ea81cf171 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1315 microversion: 2.1 time: 0.290088 Oct 18 13:29:41.124612 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1610/3030] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:40 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:41.136047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-38804c95-eae3-4e62-a98c-27ea51d1fa39 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:41.140904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-38804c95-eae3-4e62-a98c-27ea51d1fa39 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:41.152330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38804c95-eae3-4e62-a98c-27ea51d1fa39 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.153160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38804c95-eae3-4e62-a98c-27ea51d1fa39 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.153721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38804c95-eae3-4e62-a98c-27ea51d1fa39 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.154510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38804c95-eae3-4e62-a98c-27ea51d1fa39 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.155040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38804c95-eae3-4e62-a98c-27ea51d1fa39 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.155686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38804c95-eae3-4e62-a98c-27ea51d1fa39 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.368919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:29:41.369459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:29:41.369906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:29:41.371728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:29:41.372223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:29:41.407676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.408762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.412668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.415205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.415927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.417542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.432020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-38804c95-eae3-4e62-a98c-27ea51d1fa39 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:41.440924 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-38804c95-eae3-4e62-a98c-27ea51d1fa39 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1316 microversion: 2.1 time: 0.312252 Oct 18 13:29:41.459807 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1611/3031] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:41 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:41.473008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Getting quotas for project 02171c961e924aa0b2ec216ec3fc2250. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:41.479874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Getting quotas for user 3cba0dade9b74a5b9e647244d9f66184 and project 02171c961e924aa0b2ec216ec3fc2250. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:41.494270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:29:41.496777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:29:41.553508 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7e4a574d-5539-4bf1-b133-80126f5094ab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.779335 Oct 18 13:29:41.554824 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1421/3032] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:29:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:29:41.566972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-69309c69-baf4-42c8-9d2d-0ba459412c6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:41.568913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-69309c69-baf4-42c8-9d2d-0ba459412c6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:41.594596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e0f030d-1685-4b7e-86ee-ffb4723e4d8b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:41.595522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0e0f030d-1685-4b7e-86ee-ffb4723e4d8b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:41.607550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e0f030d-1685-4b7e-86ee-ffb4723e4d8b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.613540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e0f030d-1685-4b7e-86ee-ffb4723e4d8b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.614341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e0f030d-1685-4b7e-86ee-ffb4723e4d8b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.616041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e0f030d-1685-4b7e-86ee-ffb4723e4d8b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:41.616694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e0f030d-1685-4b7e-86ee-ffb4723e4d8b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:41.617449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e0f030d-1685-4b7e-86ee-ffb4723e4d8b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:41.669461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-69309c69-baf4-42c8-9d2d-0ba459412c6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:41.684157 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-69309c69-baf4-42c8-9d2d-0ba459412c6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1218 microversion: 2.1 time: 0.117854 Oct 18 13:29:41.685608 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1612/3033] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:41 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:41.965373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e0f030d-1685-4b7e-86ee-ffb4723e4d8b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:41.974938 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e0f030d-1685-4b7e-86ee-ffb4723e4d8b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1392 microversion: 2.1 time: 0.384419 Oct 18 13:29:41.979062 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1422/3034] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:41 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1392 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:42.109389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eda0edda-8310-4ddb-bcec-042be10a6550 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:42.110110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eda0edda-8310-4ddb-bcec-042be10a6550 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:42.123269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eda0edda-8310-4ddb-bcec-042be10a6550 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.124076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eda0edda-8310-4ddb-bcec-042be10a6550 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.127288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eda0edda-8310-4ddb-bcec-042be10a6550 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.129032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eda0edda-8310-4ddb-bcec-042be10a6550 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.129889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eda0edda-8310-4ddb-bcec-042be10a6550 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.130592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eda0edda-8310-4ddb-bcec-042be10a6550 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.368837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eda0edda-8310-4ddb-bcec-042be10a6550 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:42.379026 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eda0edda-8310-4ddb-bcec-042be10a6550 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1315 microversion: 2.1 time: 0.276277 Oct 18 13:29:42.379992 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1613/3035] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:42 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:42.464262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b82ce264-7c44-4ad3-81ee-c7e6b6faaee9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:42.464885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b82ce264-7c44-4ad3-81ee-c7e6b6faaee9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:42.487229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b82ce264-7c44-4ad3-81ee-c7e6b6faaee9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.492740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b82ce264-7c44-4ad3-81ee-c7e6b6faaee9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.493626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b82ce264-7c44-4ad3-81ee-c7e6b6faaee9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.494378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b82ce264-7c44-4ad3-81ee-c7e6b6faaee9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.494843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b82ce264-7c44-4ad3-81ee-c7e6b6faaee9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.495265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b82ce264-7c44-4ad3-81ee-c7e6b6faaee9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.711742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e40a7252-9c7e-466e-a098-58c554792e38 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:42.712367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e40a7252-9c7e-466e-a098-58c554792e38 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:42.727678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40a7252-9c7e-466e-a098-58c554792e38 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.729126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40a7252-9c7e-466e-a098-58c554792e38 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.730173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40a7252-9c7e-466e-a098-58c554792e38 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.731376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40a7252-9c7e-466e-a098-58c554792e38 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:42.732093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40a7252-9c7e-466e-a098-58c554792e38 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:42.732727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40a7252-9c7e-466e-a098-58c554792e38 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:42.843234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e40a7252-9c7e-466e-a098-58c554792e38 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:42.868811 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e40a7252-9c7e-466e-a098-58c554792e38 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1270 microversion: 2.1 time: 0.161847 Oct 18 13:29:42.871062 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1614/3036] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:42 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:43.009691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-52b393dc-b334-4e0b-99df-bcc200f1916c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:43.011108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-52b393dc-b334-4e0b-99df-bcc200f1916c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:43.034666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52b393dc-b334-4e0b-99df-bcc200f1916c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.035298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52b393dc-b334-4e0b-99df-bcc200f1916c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.035788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52b393dc-b334-4e0b-99df-bcc200f1916c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.041412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52b393dc-b334-4e0b-99df-bcc200f1916c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.041980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52b393dc-b334-4e0b-99df-bcc200f1916c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.046709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52b393dc-b334-4e0b-99df-bcc200f1916c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.175674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b82ce264-7c44-4ad3-81ee-c7e6b6faaee9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:43.190788 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b82ce264-7c44-4ad3-81ee-c7e6b6faaee9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1316 microversion: 2.1 time: 0.730440 Oct 18 13:29:43.199388 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1423/3037] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:42 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:43.384970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-52b393dc-b334-4e0b-99df-bcc200f1916c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:43.395302 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-52b393dc-b334-4e0b-99df-bcc200f1916c tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1382 microversion: 2.1 time: 0.399087 Oct 18 13:29:43.410597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2a61d308-21e1-4c0f-ba4c-0650b9ac1747 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:43.411922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2a61d308-21e1-4c0f-ba4c-0650b9ac1747 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:43.412071 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1615/3038] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:42 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1382 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:43.425202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a61d308-21e1-4c0f-ba4c-0650b9ac1747 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.425453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0a7d4752-4cde-4d81-a3c8-4a49d6bf33de tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '.version_select at 0x7ff60ee871f0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:43.426261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a61d308-21e1-4c0f-ba4c-0650b9ac1747 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.429878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a61d308-21e1-4c0f-ba4c-0650b9ac1747 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.430891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a61d308-21e1-4c0f-ba4c-0650b9ac1747 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.432950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a7d4752-4cde-4d81-a3c8-4a49d6bf33de tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.433479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a7d4752-4cde-4d81-a3c8-4a49d6bf33de tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.433882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a61d308-21e1-4c0f-ba4c-0650b9ac1747 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.434562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a61d308-21e1-4c0f-ba4c-0650b9ac1747 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.435931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a7d4752-4cde-4d81-a3c8-4a49d6bf33de tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.480131 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0a7d4752-4cde-4d81-a3c8-4a49d6bf33de tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1569 microversion: 2.1 time: 0.058931 Oct 18 13:29:43.491851 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1616/3039] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 18 13:29:43 2022] GET /compute/v2.1/os-migrations => generated 1569 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:43.497267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8704fda1-0dc1-4cfc-9628-9f7c190aabe1 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:43.507082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8704fda1-0dc1-4cfc-9628-9f7c190aabe1 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:43.531058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8704fda1-0dc1-4cfc-9628-9f7c190aabe1 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.531674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8704fda1-0dc1-4cfc-9628-9f7c190aabe1 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.532122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8704fda1-0dc1-4cfc-9628-9f7c190aabe1 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.532994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8704fda1-0dc1-4cfc-9628-9f7c190aabe1 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.533602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8704fda1-0dc1-4cfc-9628-9f7c190aabe1 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.534033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8704fda1-0dc1-4cfc-9628-9f7c190aabe1 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.797912 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8704fda1-0dc1-4cfc-9628-9f7c190aabe1 tempest-LiveMigrationTest-1893767997 tempest-LiveMigrationTest-1893767997-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1535 microversion: 2.1 time: 0.304854 Oct 18 13:29:43.804015 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1617/3040] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:43 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1535 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:43.847265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a9a81147-6024-44aa-8f6b-a314be5be9f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:43.847822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a9a81147-6024-44aa-8f6b-a314be5be9f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:43.866689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9a81147-6024-44aa-8f6b-a314be5be9f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.867193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9a81147-6024-44aa-8f6b-a314be5be9f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.869497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9a81147-6024-44aa-8f6b-a314be5be9f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.870311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9a81147-6024-44aa-8f6b-a314be5be9f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.875083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9a81147-6024-44aa-8f6b-a314be5be9f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.876840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9a81147-6024-44aa-8f6b-a314be5be9f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.943353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2a61d308-21e1-4c0f-ba4c-0650b9ac1747 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:43.955532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a9a81147-6024-44aa-8f6b-a314be5be9f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:29:43.959873 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2a61d308-21e1-4c0f-ba4c-0650b9ac1747 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1315 microversion: 2.1 time: 0.553246 Oct 18 13:29:43.962615 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1424/3041] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:43 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:43.973779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e92df5ed-1fa7-43e8-ba7a-25cc0f2db7bb tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:43.976538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e92df5ed-1fa7-43e8-ba7a-25cc0f2db7bb tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:43.992341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e92df5ed-1fa7-43e8-ba7a-25cc0f2db7bb tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.994373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e92df5ed-1fa7-43e8-ba7a-25cc0f2db7bb tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.995000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e92df5ed-1fa7-43e8-ba7a-25cc0f2db7bb tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:43.997334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e92df5ed-1fa7-43e8-ba7a-25cc0f2db7bb tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:43.998965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e92df5ed-1fa7-43e8-ba7a-25cc0f2db7bb tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:43.999436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e92df5ed-1fa7-43e8-ba7a-25cc0f2db7bb tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:44.125800 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a9a81147-6024-44aa-8f6b-a314be5be9f4 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "DELETE /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 204 len: 0 microversion: 2.1 time: 0.282446 Oct 18 13:29:44.127305 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1618/3042] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:29:43 2022] DELETE /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:29:44.142219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f09e7076-3139-4772-ba6b-634b5cfae708 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:44.145991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f09e7076-3139-4772-ba6b-634b5cfae708 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:44.165216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09e7076-3139-4772-ba6b-634b5cfae708 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:44.166037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09e7076-3139-4772-ba6b-634b5cfae708 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:44.166740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09e7076-3139-4772-ba6b-634b5cfae708 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:44.167621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09e7076-3139-4772-ba6b-634b5cfae708 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:44.168084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09e7076-3139-4772-ba6b-634b5cfae708 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:44.168785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09e7076-3139-4772-ba6b-634b5cfae708 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:44.223359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e92df5ed-1fa7-43e8-ba7a-25cc0f2db7bb tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:44.238811 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e92df5ed-1fa7-43e8-ba7a-25cc0f2db7bb tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1288 microversion: 2.1 time: 0.273092 Oct 18 13:29:44.239928 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1425/3043] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:43 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1288 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:44.246323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bf6f9ef6-7c4d-4ecb-81ef-aba052ebcfbb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:44.247683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bf6f9ef6-7c4d-4ecb-81ef-aba052ebcfbb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:44.257491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf6f9ef6-7c4d-4ecb-81ef-aba052ebcfbb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:44.258481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf6f9ef6-7c4d-4ecb-81ef-aba052ebcfbb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:44.259197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf6f9ef6-7c4d-4ecb-81ef-aba052ebcfbb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:44.260257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf6f9ef6-7c4d-4ecb-81ef-aba052ebcfbb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:44.261808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf6f9ef6-7c4d-4ecb-81ef-aba052ebcfbb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:44.262469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf6f9ef6-7c4d-4ecb-81ef-aba052ebcfbb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:44.428594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f09e7076-3139-4772-ba6b-634b5cfae708 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:44.437816 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f09e7076-3139-4772-ba6b-634b5cfae708 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1388 microversion: 2.1 time: 0.305543 Oct 18 13:29:44.438746 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1619/3044] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:44 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1388 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:44.991114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-83c7d248-bd4d-49b0-8084-85e9ae4ee026 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:44.991744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-83c7d248-bd4d-49b0-8084-85e9ae4ee026 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:45.003032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83c7d248-bd4d-49b0-8084-85e9ae4ee026 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.003527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83c7d248-bd4d-49b0-8084-85e9ae4ee026 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.003966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83c7d248-bd4d-49b0-8084-85e9ae4ee026 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.004671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83c7d248-bd4d-49b0-8084-85e9ae4ee026 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.005514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83c7d248-bd4d-49b0-8084-85e9ae4ee026 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.006178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83c7d248-bd4d-49b0-8084-85e9ae4ee026 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.008464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bf6f9ef6-7c4d-4ecb-81ef-aba052ebcfbb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:45.019071 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bf6f9ef6-7c4d-4ecb-81ef-aba052ebcfbb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1466 microversion: 2.1 time: 0.777696 Oct 18 13:29:45.022199 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1426/3045] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:44 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1466 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:45.046313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f5b11fef-efe6-49ac-ad35-3fce09672699 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:45.047175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f5b11fef-efe6-49ac-ad35-3fce09672699 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:45.062691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5b11fef-efe6-49ac-ad35-3fce09672699 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.063470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5b11fef-efe6-49ac-ad35-3fce09672699 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.064148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5b11fef-efe6-49ac-ad35-3fce09672699 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.065023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5b11fef-efe6-49ac-ad35-3fce09672699 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.065686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5b11fef-efe6-49ac-ad35-3fce09672699 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.066271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5b11fef-efe6-49ac-ad35-3fce09672699 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.430312 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f5b11fef-efe6-49ac-ad35-3fce09672699 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1619 microversion: 2.1 time: 0.388449 Oct 18 13:29:45.446243 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1427/3046] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:45 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1619 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:45.466698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-250a0d8a-84d8-4d46-adbd-611f03ffe130 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:45.467554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-250a0d8a-84d8-4d46-adbd-611f03ffe130 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:45.476875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-250a0d8a-84d8-4d46-adbd-611f03ffe130 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.477741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-250a0d8a-84d8-4d46-adbd-611f03ffe130 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.478406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-250a0d8a-84d8-4d46-adbd-611f03ffe130 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.479400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-250a0d8a-84d8-4d46-adbd-611f03ffe130 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.480097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-250a0d8a-84d8-4d46-adbd-611f03ffe130 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.480736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-250a0d8a-84d8-4d46-adbd-611f03ffe130 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.637095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-83c7d248-bd4d-49b0-8084-85e9ae4ee026 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:45.647429 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-83c7d248-bd4d-49b0-8084-85e9ae4ee026 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1315 microversion: 2.1 time: 0.660470 Oct 18 13:29:45.649749 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1620/3047] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:44 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:45.666183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-333c3cb4-c62a-4a7e-8714-7d41425e43f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:45.667043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-333c3cb4-c62a-4a7e-8714-7d41425e43f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:45.673768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-333c3cb4-c62a-4a7e-8714-7d41425e43f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.674432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-333c3cb4-c62a-4a7e-8714-7d41425e43f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.675028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-333c3cb4-c62a-4a7e-8714-7d41425e43f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.675896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-333c3cb4-c62a-4a7e-8714-7d41425e43f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:45.676530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-333c3cb4-c62a-4a7e-8714-7d41425e43f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:45.677879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-333c3cb4-c62a-4a7e-8714-7d41425e43f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:45.692689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-250a0d8a-84d8-4d46-adbd-611f03ffe130 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:45.704148 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-250a0d8a-84d8-4d46-adbd-611f03ffe130 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1276 microversion: 2.1 time: 0.256315 Oct 18 13:29:45.711264 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1428/3048] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:45 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1276 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:45.724262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1434098464", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["b0688b2d-dd1e-427c-b5f1-1ac0fad84598"]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:45.825166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:29:45.869166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-333c3cb4-c62a-4a7e-8714-7d41425e43f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:45.873051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:45.902262 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-333c3cb4-c62a-4a7e-8714-7d41425e43f8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1388 microversion: 2.1 time: 0.251113 Oct 18 13:29:45.902988 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1621/3049] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:45 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1388 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:46.679339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8a5823c5-6276-4d60-9d9f-870da7d50ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:46.681841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8a5823c5-6276-4d60-9d9f-870da7d50ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:46.691967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a5823c5-6276-4d60-9d9f-870da7d50ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.693748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a5823c5-6276-4d60-9d9f-870da7d50ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.694381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a5823c5-6276-4d60-9d9f-870da7d50ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:46.695490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a5823c5-6276-4d60-9d9f-870da7d50ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.695977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a5823c5-6276-4d60-9d9f-870da7d50ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.696570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a5823c5-6276-4d60-9d9f-870da7d50ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:46.697248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:29:46.698618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:29:46.699260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:29:46.699826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:29:46.700569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:29:46.712016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.712802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.713514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:46.714401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.715069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.726663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:46.754389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:29:46.761118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:46.763136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:29:46.781837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:29:46.784848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:29:46.847372 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f9d20ae2-020d-4e12-9e19-a55cdceab3e1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.133623 Oct 18 13:29:46.848352 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1429/3050] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:29:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:29:46.855766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-535c2a1f-0dd3-47b8-a9a4-14d43afab8e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:46.856387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-535c2a1f-0dd3-47b8-a9a4-14d43afab8e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:46.863732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-535c2a1f-0dd3-47b8-a9a4-14d43afab8e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.865064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-535c2a1f-0dd3-47b8-a9a4-14d43afab8e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.865716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-535c2a1f-0dd3-47b8-a9a4-14d43afab8e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:46.867697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-535c2a1f-0dd3-47b8-a9a4-14d43afab8e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:46.868288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-535c2a1f-0dd3-47b8-a9a4-14d43afab8e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:46.868715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-535c2a1f-0dd3-47b8-a9a4-14d43afab8e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.190730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8a5823c5-6276-4d60-9d9f-870da7d50ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:47.206128 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8a5823c5-6276-4d60-9d9f-870da7d50ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1315 microversion: 2.1 time: 0.531387 Oct 18 13:29:47.215143 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1622/3051] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:46 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:47.231980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a878dd3f-9e20-4338-8ebe-755b563f9a94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:47.233564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a878dd3f-9e20-4338-8ebe-755b563f9a94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:47.264372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:47.375407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a878dd3f-9e20-4338-8ebe-755b563f9a94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:47.401952 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a878dd3f-9e20-4338-8ebe-755b563f9a94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1217 microversion: 2.1 time: 0.185301 Oct 18 13:29:47.403052 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1623/3052] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:47 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:47.415906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f69791aa-3d86-4709-a17d-5a53e8dabafd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:47.416617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f69791aa-3d86-4709-a17d-5a53e8dabafd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:47.425386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f69791aa-3d86-4709-a17d-5a53e8dabafd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:47.425957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f69791aa-3d86-4709-a17d-5a53e8dabafd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:47.428605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f69791aa-3d86-4709-a17d-5a53e8dabafd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.429432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f69791aa-3d86-4709-a17d-5a53e8dabafd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:47.429975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f69791aa-3d86-4709-a17d-5a53e8dabafd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:47.431937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f69791aa-3d86-4709-a17d-5a53e8dabafd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.738657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f69791aa-3d86-4709-a17d-5a53e8dabafd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:47.751164 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f69791aa-3d86-4709-a17d-5a53e8dabafd tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1346 microversion: 2.1 time: 0.346930 Oct 18 13:29:47.751763 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1624/3053] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:47 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1346 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:47.770006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-535c2a1f-0dd3-47b8-a9a4-14d43afab8e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:47.774092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ff6a85c1-6bb9-4b5b-b93c-3b2d16203685 req-f0f5dd3d-7c12-44b0-8c4d-3f3b799abdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969d338f-c468-409d-8d40-db5fb2b273ee", "name": "network-vif-deleted", "tag": "f734654d-3e14-44d4-bd74-65598fad1317"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:47.783080 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-535c2a1f-0dd3-47b8-a9a4-14d43afab8e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1318 microversion: 2.1 time: 0.932920 Oct 18 13:29:47.786065 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1430/3054] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:46 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1318 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:47.812262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ff6a85c1-6bb9-4b5b-b93c-3b2d16203685 req-f0f5dd3d-7c12-44b0-8c4d-3f3b799abdb5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:47.812801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ff6a85c1-6bb9-4b5b-b93c-3b2d16203685 req-f0f5dd3d-7c12-44b0-8c4d-3f3b799abdb5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:47.813304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ff6a85c1-6bb9-4b5b-b93c-3b2d16203685 req-f0f5dd3d-7c12-44b0-8c4d-3f3b799abdb5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.814112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-93b238ef-e24c-4aba-9ed5-549830686793 req-cd1dbf5f-de04-4f38-b8e2-02bf518f8296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b83d20-5690-49dc-bff4-e6906a63ee23", "name": "network-vif-plugged", "status": "completed", "tag": "e01e4d55-3474-4431-af07-7a611cccd407"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:47.858424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-93b238ef-e24c-4aba-9ed5-549830686793 req-cd1dbf5f-de04-4f38-b8e2-02bf518f8296 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:47.870315 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ff6a85c1-6bb9-4b5b-b93c-3b2d16203685 req-f0f5dd3d-7c12-44b0-8c4d-3f3b799abdb5 service nova] Creating event network-vif-deleted:f734654d-3e14-44d4-bd74-65598fad1317 for instance 969d338f-c468-409d-8d40-db5fb2b273ee on n-h1-858384-13 Oct 18 13:29:47.872453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-93b238ef-e24c-4aba-9ed5-549830686793 req-cd1dbf5f-de04-4f38-b8e2-02bf518f8296 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:47.873100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-93b238ef-e24c-4aba-9ed5-549830686793 req-cd1dbf5f-de04-4f38-b8e2-02bf518f8296 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:47.892391 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ff6a85c1-6bb9-4b5b-b93c-3b2d16203685 req-f0f5dd3d-7c12-44b0-8c4d-3f3b799abdb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139259 Oct 18 13:29:47.901641 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1625/3055] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:47.908987 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-93b238ef-e24c-4aba-9ed5-549830686793 req-cd1dbf5f-de04-4f38-b8e2-02bf518f8296 service nova] Creating event network-vif-plugged:e01e4d55-3474-4431-af07-7a611cccd407 for instance 92b83d20-5690-49dc-bff4-e6906a63ee23 on n-h2-858384-13 Oct 18 13:29:47.919677 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-93b238ef-e24c-4aba-9ed5-549830686793 req-cd1dbf5f-de04-4f38-b8e2-02bf518f8296 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118435 Oct 18 13:29:47.925994 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1431/3056] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:48.236289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2386c9c2-b548-412d-886d-4da34f56e3d9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:48.237297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2386c9c2-b548-412d-886d-4da34f56e3d9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:48.255733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2386c9c2-b548-412d-886d-4da34f56e3d9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.256692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2386c9c2-b548-412d-886d-4da34f56e3d9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.257372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2386c9c2-b548-412d-886d-4da34f56e3d9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.258299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2386c9c2-b548-412d-886d-4da34f56e3d9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.258766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2386c9c2-b548-412d-886d-4da34f56e3d9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.259264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2386c9c2-b548-412d-886d-4da34f56e3d9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.426261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e5423ecf-aca7-41a6-bdb6-b7427fefb4a8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:48.427793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e5423ecf-aca7-41a6-bdb6-b7427fefb4a8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:48.437760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5423ecf-aca7-41a6-bdb6-b7427fefb4a8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.438256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5423ecf-aca7-41a6-bdb6-b7427fefb4a8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.438700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5423ecf-aca7-41a6-bdb6-b7427fefb4a8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.439404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5423ecf-aca7-41a6-bdb6-b7427fefb4a8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.449360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5423ecf-aca7-41a6-bdb6-b7427fefb4a8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.450096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5423ecf-aca7-41a6-bdb6-b7427fefb4a8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.635802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e5423ecf-aca7-41a6-bdb6-b7427fefb4a8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:48.646530 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e5423ecf-aca7-41a6-bdb6-b7427fefb4a8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1269 microversion: 2.1 time: 0.225236 Oct 18 13:29:48.650460 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1432/3057] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:48 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1269 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:48.676500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2386c9c2-b548-412d-886d-4da34f56e3d9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:48.689087 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2386c9c2-b548-412d-886d-4da34f56e3d9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1315 microversion: 2.1 time: 0.457356 Oct 18 13:29:48.717669 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1626/3058] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:48 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:48.782982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ba14b14d-c18e-4c8a-8d9f-d5e6c08c64a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:48.789263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ba14b14d-c18e-4c8a-8d9f-d5e6c08c64a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:48.802179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba14b14d-c18e-4c8a-8d9f-d5e6c08c64a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.802694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba14b14d-c18e-4c8a-8d9f-d5e6c08c64a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.803146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba14b14d-c18e-4c8a-8d9f-d5e6c08c64a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.803856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba14b14d-c18e-4c8a-8d9f-d5e6c08c64a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.804306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba14b14d-c18e-4c8a-8d9f-d5e6c08c64a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.804720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba14b14d-c18e-4c8a-8d9f-d5e6c08c64a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.818956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dbe1d561-7423-456d-8052-f42fcc2db3ce tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:48.820098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dbe1d561-7423-456d-8052-f42fcc2db3ce tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:48.829200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbe1d561-7423-456d-8052-f42fcc2db3ce tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.831866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbe1d561-7423-456d-8052-f42fcc2db3ce tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.832631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbe1d561-7423-456d-8052-f42fcc2db3ce tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.835398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbe1d561-7423-456d-8052-f42fcc2db3ce tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:48.836785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbe1d561-7423-456d-8052-f42fcc2db3ce tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:48.838721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbe1d561-7423-456d-8052-f42fcc2db3ce tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:48.952336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ba14b14d-c18e-4c8a-8d9f-d5e6c08c64a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:48.965026 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ba14b14d-c18e-4c8a-8d9f-d5e6c08c64a1 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1183 microversion: 2.1 time: 0.191011 Oct 18 13:29:48.969846 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1433/3059] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:48 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:49.179171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dbe1d561-7423-456d-8052-f42fcc2db3ce tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:49.209995 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dbe1d561-7423-456d-8052-f42fcc2db3ce tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1318 microversion: 2.1 time: 0.400656 Oct 18 13:29:49.210607 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1627/3060] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:48 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:49.679093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-61ddaf8c-d327-4f31-9844-728073a20a81 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:49.680656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-61ddaf8c-d327-4f31-9844-728073a20a81 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:49.697444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61ddaf8c-d327-4f31-9844-728073a20a81 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:49.698036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61ddaf8c-d327-4f31-9844-728073a20a81 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:49.698581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61ddaf8c-d327-4f31-9844-728073a20a81 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:49.701649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61ddaf8c-d327-4f31-9844-728073a20a81 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:49.702235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61ddaf8c-d327-4f31-9844-728073a20a81 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:49.703753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61ddaf8c-d327-4f31-9844-728073a20a81 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:49.729257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aa37e900-552c-46ab-ad54-a6562043d591 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:49.730028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aa37e900-552c-46ab-ad54-a6562043d591 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:49.745295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa37e900-552c-46ab-ad54-a6562043d591 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:49.745793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa37e900-552c-46ab-ad54-a6562043d591 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:49.746236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa37e900-552c-46ab-ad54-a6562043d591 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:49.759816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa37e900-552c-46ab-ad54-a6562043d591 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:49.761569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa37e900-552c-46ab-ad54-a6562043d591 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:49.763070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa37e900-552c-46ab-ad54-a6562043d591 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:49.790619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:49.866993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-61ddaf8c-d327-4f31-9844-728073a20a81 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:49.880361 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-61ddaf8c-d327-4f31-9844-728073a20a81 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1277 microversion: 2.1 time: 0.204230 Oct 18 13:29:49.882549 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1434/3061] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:49 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:49.935309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a892f092-b4c5-4003-a9ca-19ab4a0a9a75 req-144f30ac-9a83-406f-87bb-0aa9a936cdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37db5c9f-afcd-4471-930c-d3a55a279f09", "tag": "24869de5-2c8b-4aa0-97bf-68b16afb361f"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:49.964431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a892f092-b4c5-4003-a9ca-19ab4a0a9a75 req-144f30ac-9a83-406f-87bb-0aa9a936cdb5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:49.966617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a892f092-b4c5-4003-a9ca-19ab4a0a9a75 req-144f30ac-9a83-406f-87bb-0aa9a936cdb5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:49.967471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a892f092-b4c5-4003-a9ca-19ab4a0a9a75 req-144f30ac-9a83-406f-87bb-0aa9a936cdb5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:49.995965 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a892f092-b4c5-4003-a9ca-19ab4a0a9a75 req-144f30ac-9a83-406f-87bb-0aa9a936cdb5 service nova] Creating event network-changed:24869de5-2c8b-4aa0-97bf-68b16afb361f for instance 37db5c9f-afcd-4471-930c-d3a55a279f09 on n-h2-858384-13 Oct 18 13:29:50.011178 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a892f092-b4c5-4003-a9ca-19ab4a0a9a75 req-144f30ac-9a83-406f-87bb-0aa9a936cdb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083857 Oct 18 13:29:50.012749 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1435/3062] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:29:50.025013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-92729caf-df91-462a-8c2c-def8dfcce0d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:50.028127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-92729caf-df91-462a-8c2c-def8dfcce0d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:50.041529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92729caf-df91-462a-8c2c-def8dfcce0d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.042032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92729caf-df91-462a-8c2c-def8dfcce0d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.048652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92729caf-df91-462a-8c2c-def8dfcce0d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.049713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92729caf-df91-462a-8c2c-def8dfcce0d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.050512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92729caf-df91-462a-8c2c-def8dfcce0d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.051281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92729caf-df91-462a-8c2c-def8dfcce0d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.188205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-92729caf-df91-462a-8c2c-def8dfcce0d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:50.199868 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-92729caf-df91-462a-8c2c-def8dfcce0d5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1183 microversion: 2.1 time: 0.183394 Oct 18 13:29:50.204077 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1436/3063] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:50 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:50.234353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-83daf374-e679-4821-94d0-60331c0e7436 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:50.234981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-83daf374-e679-4821-94d0-60331c0e7436 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:50.245472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83daf374-e679-4821-94d0-60331c0e7436 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.245979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83daf374-e679-4821-94d0-60331c0e7436 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.246419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83daf374-e679-4821-94d0-60331c0e7436 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.247123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83daf374-e679-4821-94d0-60331c0e7436 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.247579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83daf374-e679-4821-94d0-60331c0e7436 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.248007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83daf374-e679-4821-94d0-60331c0e7436 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.414866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aa37e900-552c-46ab-ad54-a6562043d591 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:50.426314 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aa37e900-552c-46ab-ad54-a6562043d591 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1501 microversion: 2.1 time: 0.701294 Oct 18 13:29:50.428743 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1628/3064] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:49 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1501 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:50.455411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5a46e22e-6221-4e34-9dbf-22295aff2822 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:50.456939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5a46e22e-6221-4e34-9dbf-22295aff2822 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:50.474522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a46e22e-6221-4e34-9dbf-22295aff2822 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.476150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a46e22e-6221-4e34-9dbf-22295aff2822 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.476764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a46e22e-6221-4e34-9dbf-22295aff2822 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.482564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a46e22e-6221-4e34-9dbf-22295aff2822 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.483342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a46e22e-6221-4e34-9dbf-22295aff2822 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.484669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a46e22e-6221-4e34-9dbf-22295aff2822 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.605725 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5a46e22e-6221-4e34-9dbf-22295aff2822 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23/action" status: 202 len: 0 microversion: 2.1 time: 0.154416 Oct 18 13:29:50.607557 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1629/3065] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:29:50 2022] POST /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:29:50.621373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d4fb9af6-7fc0-42f4-a522-26bb315467b3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:50.625766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d4fb9af6-7fc0-42f4-a522-26bb315467b3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:50.653687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4fb9af6-7fc0-42f4-a522-26bb315467b3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.662730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4fb9af6-7fc0-42f4-a522-26bb315467b3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.663548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4fb9af6-7fc0-42f4-a522-26bb315467b3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.665969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4fb9af6-7fc0-42f4-a522-26bb315467b3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.666873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4fb9af6-7fc0-42f4-a522-26bb315467b3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.669149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4fb9af6-7fc0-42f4-a522-26bb315467b3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.910400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d4fb9af6-7fc0-42f4-a522-26bb315467b3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:50.921738 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d4fb9af6-7fc0-42f4-a522-26bb315467b3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1506 microversion: 2.1 time: 0.308574 Oct 18 13:29:50.923364 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1630/3066] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:50 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:50.929160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1d744c9b-1ad9-444e-9838-0e41c8df8955 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:50.930159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1d744c9b-1ad9-444e-9838-0e41c8df8955 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:50.941572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d744c9b-1ad9-444e-9838-0e41c8df8955 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.942817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d744c9b-1ad9-444e-9838-0e41c8df8955 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.943624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d744c9b-1ad9-444e-9838-0e41c8df8955 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:50.944586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d744c9b-1ad9-444e-9838-0e41c8df8955 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:50.945309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d744c9b-1ad9-444e-9838-0e41c8df8955 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:50.947367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d744c9b-1ad9-444e-9838-0e41c8df8955 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:51.050339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1d744c9b-1ad9-444e-9838-0e41c8df8955 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:51.062152 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1d744c9b-1ad9-444e-9838-0e41c8df8955 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1275 microversion: 2.1 time: 0.137458 Oct 18 13:29:51.062744 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1631/3067] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:50 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:51.228626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-39ecfa4e-fdb7-484d-9f92-d1796307e054 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:51.229453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-39ecfa4e-fdb7-484d-9f92-d1796307e054 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:51.240926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39ecfa4e-fdb7-484d-9f92-d1796307e054 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:51.241472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39ecfa4e-fdb7-484d-9f92-d1796307e054 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:51.241921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39ecfa4e-fdb7-484d-9f92-d1796307e054 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:51.242646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39ecfa4e-fdb7-484d-9f92-d1796307e054 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:51.246310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39ecfa4e-fdb7-484d-9f92-d1796307e054 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:51.246807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39ecfa4e-fdb7-484d-9f92-d1796307e054 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:51.284638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-83daf374-e679-4821-94d0-60331c0e7436 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:51.309783 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-83daf374-e679-4821-94d0-60331c0e7436 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1318 microversion: 2.1 time: 1.080197 Oct 18 13:29:51.325992 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1437/3068] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:50 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1318 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:51.492162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-39ecfa4e-fdb7-484d-9f92-d1796307e054 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:51.506943 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-39ecfa4e-fdb7-484d-9f92-d1796307e054 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1183 microversion: 2.1 time: 0.281950 Oct 18 13:29:51.525932 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1632/3069] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:51 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:51.947765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-851120f1-e368-4a6a-86b6-eb97fe42b3f5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:51.949536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-851120f1-e368-4a6a-86b6-eb97fe42b3f5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:51.969608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-851120f1-e368-4a6a-86b6-eb97fe42b3f5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:51.970830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-851120f1-e368-4a6a-86b6-eb97fe42b3f5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:51.971523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-851120f1-e368-4a6a-86b6-eb97fe42b3f5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:51.972448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-851120f1-e368-4a6a-86b6-eb97fe42b3f5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:51.974205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-851120f1-e368-4a6a-86b6-eb97fe42b3f5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:51.974856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-851120f1-e368-4a6a-86b6-eb97fe42b3f5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.090847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-88800331-a47a-4563-bec1-4a3487cb6c65 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:52.091453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-88800331-a47a-4563-bec1-4a3487cb6c65 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:52.106959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88800331-a47a-4563-bec1-4a3487cb6c65 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.108226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88800331-a47a-4563-bec1-4a3487cb6c65 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.108827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88800331-a47a-4563-bec1-4a3487cb6c65 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.111370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88800331-a47a-4563-bec1-4a3487cb6c65 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.111989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88800331-a47a-4563-bec1-4a3487cb6c65 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.114024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88800331-a47a-4563-bec1-4a3487cb6c65 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.368299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-88800331-a47a-4563-bec1-4a3487cb6c65 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:52.379045 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-88800331-a47a-4563-bec1-4a3487cb6c65 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1317 microversion: 2.1 time: 0.292417 Oct 18 13:29:52.380936 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1633/3070] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:52 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:52.389302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87b9a793-df60-4cc2-9bf3-d41d678ed1b7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:52.390352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-87b9a793-df60-4cc2-9bf3-d41d678ed1b7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:52.403381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87b9a793-df60-4cc2-9bf3-d41d678ed1b7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.404507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87b9a793-df60-4cc2-9bf3-d41d678ed1b7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.405199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87b9a793-df60-4cc2-9bf3-d41d678ed1b7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.406556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87b9a793-df60-4cc2-9bf3-d41d678ed1b7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.408153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87b9a793-df60-4cc2-9bf3-d41d678ed1b7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.408831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87b9a793-df60-4cc2-9bf3-d41d678ed1b7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.603607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-87b9a793-df60-4cc2-9bf3-d41d678ed1b7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:52.617493 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-87b9a793-df60-4cc2-9bf3-d41d678ed1b7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1318 microversion: 2.1 time: 0.233279 Oct 18 13:29:52.625327 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1634/3071] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:52 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:52.640459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f1b5b595-77e2-4f4b-a413-103389be3286 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:52.641145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f1b5b595-77e2-4f4b-a413-103389be3286 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:52.655164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1b5b595-77e2-4f4b-a413-103389be3286 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.655674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1b5b595-77e2-4f4b-a413-103389be3286 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.657014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1b5b595-77e2-4f4b-a413-103389be3286 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.657774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1b5b595-77e2-4f4b-a413-103389be3286 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.659595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-851120f1-e368-4a6a-86b6-eb97fe42b3f5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:52.660070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1b5b595-77e2-4f4b-a413-103389be3286 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.660507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1b5b595-77e2-4f4b-a413-103389be3286 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.676018 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-851120f1-e368-4a6a-86b6-eb97fe42b3f5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1486 microversion: 2.1 time: 0.733226 Oct 18 13:29:52.690718 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1438/3072] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:51 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1486 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:52.709712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a8149069-6279-4ff4-85a0-93b202f4be5f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:52.710087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a8149069-6279-4ff4-85a0-93b202f4be5f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:52.727057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8149069-6279-4ff4-85a0-93b202f4be5f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.727617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8149069-6279-4ff4-85a0-93b202f4be5f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.728065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8149069-6279-4ff4-85a0-93b202f4be5f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.731886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8149069-6279-4ff4-85a0-93b202f4be5f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:52.732361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8149069-6279-4ff4-85a0-93b202f4be5f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:52.732796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8149069-6279-4ff4-85a0-93b202f4be5f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:52.768625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-a8149069-6279-4ff4-85a0-93b202f4be5f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lazy-loading 'flavor' on Instance uuid 92b83d20-5690-49dc-bff4-e6906a63ee23 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:29:52.799274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f1b5b595-77e2-4f4b-a413-103389be3286 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:52.812608 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f1b5b595-77e2-4f4b-a413-103389be3286 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1183 microversion: 2.1 time: 0.185406 Oct 18 13:29:52.815873 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1635/3073] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:52 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:53.184410 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a8149069-6279-4ff4-85a0-93b202f4be5f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23/action" status: 202 len: 0 microversion: 2.1 time: 0.480775 Oct 18 13:29:53.185034 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1439/3074] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:29:52 2022] POST /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:29:53.194070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3ce3249c-e360-41d6-9984-9c75067f6ffd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:53.194691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3ce3249c-e360-41d6-9984-9c75067f6ffd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:53.203966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ce3249c-e360-41d6-9984-9c75067f6ffd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.207983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ce3249c-e360-41d6-9984-9c75067f6ffd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.214214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ce3249c-e360-41d6-9984-9c75067f6ffd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.215012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ce3249c-e360-41d6-9984-9c75067f6ffd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.215498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ce3249c-e360-41d6-9984-9c75067f6ffd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.215943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ce3249c-e360-41d6-9984-9c75067f6ffd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.407150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-04f20fa9-e017-477c-8561-a82da8430a9f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:53.408193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-04f20fa9-e017-477c-8561-a82da8430a9f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:53.433533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04f20fa9-e017-477c-8561-a82da8430a9f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.434031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04f20fa9-e017-477c-8561-a82da8430a9f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.451127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04f20fa9-e017-477c-8561-a82da8430a9f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.452457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04f20fa9-e017-477c-8561-a82da8430a9f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.453107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04f20fa9-e017-477c-8561-a82da8430a9f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.457398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04f20fa9-e017-477c-8561-a82da8430a9f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.478249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ce3249c-e360-41d6-9984-9c75067f6ffd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:53.492408 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3ce3249c-e360-41d6-9984-9c75067f6ffd tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1492 microversion: 2.1 time: 0.302551 Oct 18 13:29:53.495631 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1636/3075] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:53 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1492 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:53.641915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e14363b1-a732-40f2-b4e4-ea663fa11069 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:53.643545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e14363b1-a732-40f2-b4e4-ea663fa11069 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:53.661267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e14363b1-a732-40f2-b4e4-ea663fa11069 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.662033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e14363b1-a732-40f2-b4e4-ea663fa11069 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.662703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e14363b1-a732-40f2-b4e4-ea663fa11069 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.663647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e14363b1-a732-40f2-b4e4-ea663fa11069 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:53.668771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e14363b1-a732-40f2-b4e4-ea663fa11069 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:53.669840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e14363b1-a732-40f2-b4e4-ea663fa11069 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:53.966862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e14363b1-a732-40f2-b4e4-ea663fa11069 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:53.976291 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e14363b1-a732-40f2-b4e4-ea663fa11069 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1318 microversion: 2.1 time: 0.338567 Oct 18 13:29:53.977514 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1637/3076] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:53 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:54.014734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-a1765d8b-4ac1-45c8-a542-18e4fad1d878 req-5f8162c3-5fc5-4bc9-9450-b162bf2bef16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a1ba414-b725-477c-917a-d5e846e42462", "tag": "fc85f618-9d9c-41c0-b8d7-706b0f9a2358"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:54.028196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a1765d8b-4ac1-45c8-a542-18e4fad1d878 req-5f8162c3-5fc5-4bc9-9450-b162bf2bef16 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.029061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a1765d8b-4ac1-45c8-a542-18e4fad1d878 req-5f8162c3-5fc5-4bc9-9450-b162bf2bef16 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.029792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a1765d8b-4ac1-45c8-a542-18e4fad1d878 req-5f8162c3-5fc5-4bc9-9450-b162bf2bef16 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.030012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-04f20fa9-e017-477c-8561-a82da8430a9f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:54.044286 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-04f20fa9-e017-477c-8561-a82da8430a9f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1317 microversion: 2.1 time: 0.640760 Oct 18 13:29:54.047178 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1440/3077] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:53 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:54.060769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-32adaed5-4f3e-4f31-8c5b-8adde80e6bfa tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:54.061637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-32adaed5-4f3e-4f31-8c5b-8adde80e6bfa tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:54.068613 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-a1765d8b-4ac1-45c8-a542-18e4fad1d878 req-5f8162c3-5fc5-4bc9-9450-b162bf2bef16 service nova] Creating event network-changed:fc85f618-9d9c-41c0-b8d7-706b0f9a2358 for instance 8a1ba414-b725-477c-917a-d5e846e42462 on n-h1-858384-13 Oct 18 13:29:54.077240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32adaed5-4f3e-4f31-8c5b-8adde80e6bfa tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.077767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32adaed5-4f3e-4f31-8c5b-8adde80e6bfa tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.078281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32adaed5-4f3e-4f31-8c5b-8adde80e6bfa tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.079342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32adaed5-4f3e-4f31-8c5b-8adde80e6bfa tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.089516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32adaed5-4f3e-4f31-8c5b-8adde80e6bfa tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.091456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32adaed5-4f3e-4f31-8c5b-8adde80e6bfa tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.098570 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-a1765d8b-4ac1-45c8-a542-18e4fad1d878 req-5f8162c3-5fc5-4bc9-9450-b162bf2bef16 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102237 Oct 18 13:29:54.099448 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1638/3078] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:54.235976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-32adaed5-4f3e-4f31-8c5b-8adde80e6bfa tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:54.256321 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-32adaed5-4f3e-4f31-8c5b-8adde80e6bfa tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 200 len: 1183 microversion: 2.1 time: 0.206157 Oct 18 13:29:54.257419 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1441/3079] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:54 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 1183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:54.466345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6acb2055-f42b-4b6c-a21d-b6ff34462df1 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Action: 'create', calling method: .version_select at 0x7ff617bbe160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-39995923"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:54.530829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-540df694-73fb-4433-9786-a3d6d4271260 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:54.531335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-540df694-73fb-4433-9786-a3d6d4271260 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:54.542691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-540df694-73fb-4433-9786-a3d6d4271260 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.549409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-540df694-73fb-4433-9786-a3d6d4271260 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.550001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-540df694-73fb-4433-9786-a3d6d4271260 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.550992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-540df694-73fb-4433-9786-a3d6d4271260 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:54.553773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-540df694-73fb-4433-9786-a3d6d4271260 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:54.554715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-540df694-73fb-4433-9786-a3d6d4271260 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:54.744996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-540df694-73fb-4433-9786-a3d6d4271260 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:54.755620 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-540df694-73fb-4433-9786-a3d6d4271260 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1513 microversion: 2.1 time: 0.231198 Oct 18 13:29:54.756291 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1442/3080] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:54 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:54.843727 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6acb2055-f42b-4b6c-a21d-b6ff34462df1 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.539298 Oct 18 13:29:54.844921 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1639/3081] 10.222.0.40 () {60 vars in 1155 bytes} [Tue Oct 18 13:29:54 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 542 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 18 13:29:54.859182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e7da8642-2756-493b-98c0-fee46112d2e2 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60eeab670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:54.912519 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e7da8642-2756-493b-98c0-fee46112d2e2 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc" status: 200 len: 343 microversion: 2.1 time: 0.057050 Oct 18 13:29:54.913358 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1443/3082] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:29:54 2022] GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc => generated 343 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:55.003385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e067e24-e002-4bb1-b9a4-4bf7eecf241b tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:55.004133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7e067e24-e002-4bb1-b9a4-4bf7eecf241b tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:55.012000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e067e24-e002-4bb1-b9a4-4bf7eecf241b tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.012497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e067e24-e002-4bb1-b9a4-4bf7eecf241b tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.012932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e067e24-e002-4bb1-b9a4-4bf7eecf241b tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.013680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e067e24-e002-4bb1-b9a4-4bf7eecf241b tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.014141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e067e24-e002-4bb1-b9a4-4bf7eecf241b tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.014570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e067e24-e002-4bb1-b9a4-4bf7eecf241b tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.072248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cc285b0f-e9f8-4069-80d6-6b6225b83970 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:55.073106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cc285b0f-e9f8-4069-80d6-6b6225b83970 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:55.098907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc285b0f-e9f8-4069-80d6-6b6225b83970 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.099912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc285b0f-e9f8-4069-80d6-6b6225b83970 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.100566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc285b0f-e9f8-4069-80d6-6b6225b83970 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.102880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc285b0f-e9f8-4069-80d6-6b6225b83970 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.103553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc285b0f-e9f8-4069-80d6-6b6225b83970 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.104182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc285b0f-e9f8-4069-80d6-6b6225b83970 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.241977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7e067e24-e002-4bb1-b9a4-4bf7eecf241b tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:55.248520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:55.273076 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7e067e24-e002-4bb1-b9a4-4bf7eecf241b tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1318 microversion: 2.1 time: 0.269207 Oct 18 13:29:55.274627 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1640/3083] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:54 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:55.279768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a7865da3-064b-4f16-96f3-15294d399843 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:55.280621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a7865da3-064b-4f16-96f3-15294d399843 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 969d338f-c468-409d-8d40-db5fb2b273ee] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:55.292019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7865da3-064b-4f16-96f3-15294d399843 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.292847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7865da3-064b-4f16-96f3-15294d399843 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.293701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7865da3-064b-4f16-96f3-15294d399843 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.294621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7865da3-064b-4f16-96f3-15294d399843 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.295284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7865da3-064b-4f16-96f3-15294d399843 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.296026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7865da3-064b-4f16-96f3-15294d399843 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.315974 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-a7865da3-064b-4f16-96f3-15294d399843 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] HTTP exception thrown: Instance 969d338f-c468-409d-8d40-db5fb2b273ee could not be found. Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a7865da3-064b-4f16-96f3-15294d399843 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Request method failure captured: Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee HTTP/1.1 Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqh3-Bo1lQthpoqW1ytyGHX_iWOryv_Newpq73Q_9g-reuRzQLMu5eC9rE6MXgoMKHMjnL1WLhVH8Pvt5jOEV2r1prckoWJRDFa6cILAQ_qFeTkg16envL2slQyQV5SKOO7QFuDavquWHGMYgdxCjaDhijAc6rHYbjv12YFhBPkK7gM Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: cf7c744c508342f5947ae08743ccc6c7 Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-LiveMigrationTest-1806726401 Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf7c744c508342f5947ae08743ccc6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf7c744c508342f5947ae08743ccc6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf7c744c508342f5947ae08743ccc6c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf7c744c508342f5947ae08743ccc6c7"}]}] Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-LiveMigrationTest-1806726401 Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: cf7c744c508342f5947ae08743ccc6c7 Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-LiveMigrationTest-1806726401 Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-LiveMigrationTest-1806726401-project Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 2b3d9555419845cc9bc9f650e676d776 Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-LiveMigrationTest-1806726401-project Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 969d338f-c468-409d-8d40-db5fb2b273ee could not be found. Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '969d338f-c468-409d-8d40-db5fb2b273ee'} Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969d338f-c468-409d-8d40-db5fb2b273ee could not be found. Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969d338f-c468-409d-8d40-db5fb2b273ee could not be found. Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:29:55.318803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:55.323956 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:29:55.323956 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:29:55.323956 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:29:55.323956 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:29:55.323956 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:29:55.323956 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969d338f-c468-409d-8d40-db5fb2b273ee could not be found. Oct 18 13:29:55.323956 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:29:55.325318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a7865da3-064b-4f16-96f3-15294d399843 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Returning 404 to user: Instance 969d338f-c468-409d-8d40-db5fb2b273ee could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:29:55.326358 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a7865da3-064b-4f16-96f3-15294d399843 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee" status: 404 len: 111 microversion: 2.1 time: 0.050491 Oct 18 13:29:55.327438 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1641/3084] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:55 2022] GET /compute/v2.1/servers/969d338f-c468-409d-8d40-db5fb2b273ee => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:29:55.426730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cc285b0f-e9f8-4069-80d6-6b6225b83970 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:55.436789 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cc285b0f-e9f8-4069-80d6-6b6225b83970 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1317 microversion: 2.1 time: 0.370116 Oct 18 13:29:55.457517 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1444/3085] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:55 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:55.781609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1b40e2d0-faf0-46bb-9e62-56460b44e8fe tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:55.782239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1b40e2d0-faf0-46bb-9e62-56460b44e8fe tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:55.795445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b40e2d0-faf0-46bb-9e62-56460b44e8fe tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.796207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b40e2d0-faf0-46bb-9e62-56460b44e8fe tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.796917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b40e2d0-faf0-46bb-9e62-56460b44e8fe tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.797909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b40e2d0-faf0-46bb-9e62-56460b44e8fe tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:55.812461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b40e2d0-faf0-46bb-9e62-56460b44e8fe tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:55.814044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b40e2d0-faf0-46bb-9e62-56460b44e8fe tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:55.926939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b1ca4403-aa6b-4800-a6d5-b66a50c11852 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60ee3bca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:56.119405 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b1ca4403-aa6b-4800-a6d5-b66a50c11852 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc" status: 200 len: 343 microversion: 2.1 time: 0.196163 Oct 18 13:29:56.127377 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1445/3086] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:29:55 2022] GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:29:56.295971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84efa5e1-5e6a-4f44-b018-24e3573be4e1 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:56.296594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-84efa5e1-5e6a-4f44-b018-24e3573be4e1 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:56.312756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84efa5e1-5e6a-4f44-b018-24e3573be4e1 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.313286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84efa5e1-5e6a-4f44-b018-24e3573be4e1 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.314128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84efa5e1-5e6a-4f44-b018-24e3573be4e1 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.315557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84efa5e1-5e6a-4f44-b018-24e3573be4e1 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.318863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84efa5e1-5e6a-4f44-b018-24e3573be4e1 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.319487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84efa5e1-5e6a-4f44-b018-24e3573be4e1 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.395960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1b40e2d0-faf0-46bb-9e62-56460b44e8fe tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:56.404432 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1b40e2d0-faf0-46bb-9e62-56460b44e8fe tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.626951 Oct 18 13:29:56.419230 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1642/3087] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:55 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:56.466316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2aa2beda-7f6a-4238-a95d-2b66b68ea1d7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:56.467398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2aa2beda-7f6a-4238-a95d-2b66b68ea1d7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:56.475393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2aa2beda-7f6a-4238-a95d-2b66b68ea1d7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.476265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2aa2beda-7f6a-4238-a95d-2b66b68ea1d7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.477274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2aa2beda-7f6a-4238-a95d-2b66b68ea1d7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.478269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2aa2beda-7f6a-4238-a95d-2b66b68ea1d7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:56.478948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2aa2beda-7f6a-4238-a95d-2b66b68ea1d7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:56.480045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2aa2beda-7f6a-4238-a95d-2b66b68ea1d7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:56.738446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:56.774308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=12 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:56.908533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2aa2beda-7f6a-4238-a95d-2b66b68ea1d7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:56.918236 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2aa2beda-7f6a-4238-a95d-2b66b68ea1d7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1317 microversion: 2.1 time: 0.457392 Oct 18 13:29:56.928219 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1643/3088] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:56 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:56.967705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-84efa5e1-5e6a-4f44-b018-24e3573be4e1 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:56.984010 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-84efa5e1-5e6a-4f44-b018-24e3573be4e1 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1318 microversion: 2.1 time: 0.691913 Oct 18 13:29:56.987365 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1446/3089] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:56 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1318 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:57.136572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1391cedb-f4eb-40d2-b3ef-f64503f1ced5 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60ed8b940>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:57.262084 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1391cedb-f4eb-40d2-b3ef-f64503f1ced5 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc" status: 200 len: 344 microversion: 2.1 time: 0.130753 Oct 18 13:29:57.262714 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1644/3090] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:29:57 2022] GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc => generated 344 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:29:57.278149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f2618579-6f1d-45c3-9d25-1232c408c08a tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Action: 'create', calling method: .version_select at 0x7ff60ee3bca0>, body: {"snapshot": {"volume_id": "e33556eb-4670-478d-8436-ade7f10442bc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2135427445"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:57.431052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:29:57.435712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f4c88c39-747f-49a0-8711-b63d08ade650 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:57.436335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f4c88c39-747f-49a0-8711-b63d08ade650 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:57.462463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4c88c39-747f-49a0-8711-b63d08ade650 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:57.462958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4c88c39-747f-49a0-8711-b63d08ade650 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:57.465097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4c88c39-747f-49a0-8711-b63d08ade650 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:57.466023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4c88c39-747f-49a0-8711-b63d08ade650 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:57.466655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4c88c39-747f-49a0-8711-b63d08ade650 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:57.469374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4c88c39-747f-49a0-8711-b63d08ade650 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:57.820892 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f2618579-6f1d-45c3-9d25-1232c408c08a tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.547886 Oct 18 13:29:57.822360 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1447/3091] 10.222.0.40 () {60 vars in 1162 bytes} [Tue Oct 18 13:29:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:57.835480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d1dbc394-79a4-433d-80d8-3ba9b9e1ca6d tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60eeae040>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:57.908599 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d1dbc394-79a4-433d-80d8-3ba9b9e1ca6d tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351" status: 200 len: 287 microversion: 2.1 time: 0.078956 Oct 18 13:29:57.909545 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1448/3092] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 18 13:29:57 2022] GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:57.921062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9cf0b4df-2909-4f44-9dd4-6b645c4b8b3c tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60ee4de50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:58.031833 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9cf0b4df-2909-4f44-9dd4-6b645c4b8b3c tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.115051 Oct 18 13:29:58.032700 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1449/3093] 10.222.0.40 () {58 vars in 1140 bytes} [Tue Oct 18 13:29:57 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:58.038879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8c677fa1-9171-4002-a823-e6729110c62c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:58.040468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8c677fa1-9171-4002-a823-e6729110c62c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:58.052832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c677fa1-9171-4002-a823-e6729110c62c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:58.058243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c677fa1-9171-4002-a823-e6729110c62c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:58.059021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c677fa1-9171-4002-a823-e6729110c62c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:58.060193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c677fa1-9171-4002-a823-e6729110c62c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:58.060907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c677fa1-9171-4002-a823-e6729110c62c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:58.063236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c677fa1-9171-4002-a823-e6729110c62c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:58.320628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f4c88c39-747f-49a0-8711-b63d08ade650 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:58.328637 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f4c88c39-747f-49a0-8711-b63d08ade650 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.898742 Oct 18 13:29:58.329226 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1645/3094] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:57 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:29:58.357840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5f132f58-2f82-436b-b952-e5fa6f5d17b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:58.358420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5f132f58-2f82-436b-b952-e5fa6f5d17b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:58.374304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8c677fa1-9171-4002-a823-e6729110c62c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:58.387677 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8c677fa1-9171-4002-a823-e6729110c62c tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1317 microversion: 2.1 time: 0.353253 Oct 18 13:29:58.391762 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1450/3095] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:58 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:58.398405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f132f58-2f82-436b-b952-e5fa6f5d17b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:58.401430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f132f58-2f82-436b-b952-e5fa6f5d17b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:58.402593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f132f58-2f82-436b-b952-e5fa6f5d17b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:58.404687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0b8d7c29-c234-4c72-85f3-d12379bb5d16 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60ee4dd30>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:58.409333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f132f58-2f82-436b-b952-e5fa6f5d17b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:58.410099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f132f58-2f82-436b-b952-e5fa6f5d17b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:58.414019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f132f58-2f82-436b-b952-e5fa6f5d17b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:58.640666 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0b8d7c29-c234-4c72-85f3-d12379bb5d16 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351" status: 200 len: 287 microversion: 2.1 time: 0.247436 Oct 18 13:29:58.641482 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1451/3096] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 18 13:29:58 2022] GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351 => generated 287 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:59.074092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5f132f58-2f82-436b-b952-e5fa6f5d17b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:59.095382 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5f132f58-2f82-436b-b952-e5fa6f5d17b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1318 microversion: 2.1 time: 0.756382 Oct 18 13:29:59.096233 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1646/3097] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:58 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1318 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:59.356292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42ec9584-f302-48b3-946d-209f95042245 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:59.357070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-42ec9584-f302-48b3-946d-209f95042245 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:59.377092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42ec9584-f302-48b3-946d-209f95042245 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:59.380363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42ec9584-f302-48b3-946d-209f95042245 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:59.381137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42ec9584-f302-48b3-946d-209f95042245 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:59.387183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42ec9584-f302-48b3-946d-209f95042245 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:59.388077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42ec9584-f302-48b3-946d-209f95042245 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:59.390357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42ec9584-f302-48b3-946d-209f95042245 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:59.422405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-758ccb13-8ded-4331-ad33-0cbf0dafd875 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:59.423537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-758ccb13-8ded-4331-ad33-0cbf0dafd875 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:29:59.439099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-758ccb13-8ded-4331-ad33-0cbf0dafd875 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:59.441535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-758ccb13-8ded-4331-ad33-0cbf0dafd875 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:59.445862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-758ccb13-8ded-4331-ad33-0cbf0dafd875 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:59.453356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-758ccb13-8ded-4331-ad33-0cbf0dafd875 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:59.454203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-758ccb13-8ded-4331-ad33-0cbf0dafd875 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:59.454872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-758ccb13-8ded-4331-ad33-0cbf0dafd875 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:59.769711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-42ec9584-f302-48b3-946d-209f95042245 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:29:59.789230 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-42ec9584-f302-48b3-946d-209f95042245 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.436938 Oct 18 13:29:59.791600 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1452/3098] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:59 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:29:59.811316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bd821906-b6d5-42bb-8d8e-b7859ccba6ed tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60f05f940>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:29:59.887647 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bd821906-b6d5-42bb-8d8e-b7859ccba6ed tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351" status: 200 len: 287 microversion: 2.1 time: 0.087879 Oct 18 13:29:59.888657 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1453/3099] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 18 13:29:59 2022] GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:29:59.893959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d073f919-6943-458a-be9b-d655a2e28e04 req-2abc429d-4b1c-4627-aa4a-d6927a6c25e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37db5c9f-afcd-4471-930c-d3a55a279f09", "name": "network-vif-plugged", "status": "completed", "tag": "24869de5-2c8b-4aa0-97bf-68b16afb361f"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:29:59.927203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d073f919-6943-458a-be9b-d655a2e28e04 req-2abc429d-4b1c-4627-aa4a-d6927a6c25e9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:29:59.927659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d073f919-6943-458a-be9b-d655a2e28e04 req-2abc429d-4b1c-4627-aa4a-d6927a6c25e9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:29:59.933644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d073f919-6943-458a-be9b-d655a2e28e04 req-2abc429d-4b1c-4627-aa4a-d6927a6c25e9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:29:59.964037 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d073f919-6943-458a-be9b-d655a2e28e04 req-2abc429d-4b1c-4627-aa4a-d6927a6c25e9 service nova] Creating event network-vif-plugged:24869de5-2c8b-4aa0-97bf-68b16afb361f for instance 37db5c9f-afcd-4471-930c-d3a55a279f09 on n-h2-858384-13 Oct 18 13:29:59.974922 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d073f919-6943-458a-be9b-d655a2e28e04 req-2abc429d-4b1c-4627-aa4a-d6927a6c25e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084806 Oct 18 13:29:59.980606 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1454/3100] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:00.123564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dd9f18a8-f8cd-4bb3-8cba-947e85e047b8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:00.124686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dd9f18a8-f8cd-4bb3-8cba-947e85e047b8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:00.134712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd9f18a8-f8cd-4bb3-8cba-947e85e047b8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:00.137915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd9f18a8-f8cd-4bb3-8cba-947e85e047b8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:00.138594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd9f18a8-f8cd-4bb3-8cba-947e85e047b8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:00.141509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd9f18a8-f8cd-4bb3-8cba-947e85e047b8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:00.142250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd9f18a8-f8cd-4bb3-8cba-947e85e047b8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:00.145737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd9f18a8-f8cd-4bb3-8cba-947e85e047b8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:00.516840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dd9f18a8-f8cd-4bb3-8cba-947e85e047b8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:00.533773 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dd9f18a8-f8cd-4bb3-8cba-947e85e047b8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1318 microversion: 2.1 time: 0.409047 Oct 18 13:30:00.534453 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1455/3101] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:00 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:00.549299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-758ccb13-8ded-4331-ad33-0cbf0dafd875 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:00.558771 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-758ccb13-8ded-4331-ad33-0cbf0dafd875 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1317 microversion: 2.1 time: 1.135601 Oct 18 13:30:00.559694 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1647/3102] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:29:59 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1317 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:00.818767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bcb15a09-0aca-48ec-a0f7-d0cfdb286f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:00.819471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bcb15a09-0aca-48ec-a0f7-d0cfdb286f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:00.835110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcb15a09-0aca-48ec-a0f7-d0cfdb286f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:00.836031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcb15a09-0aca-48ec-a0f7-d0cfdb286f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:00.838720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcb15a09-0aca-48ec-a0f7-d0cfdb286f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:00.839466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcb15a09-0aca-48ec-a0f7-d0cfdb286f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:00.839934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcb15a09-0aca-48ec-a0f7-d0cfdb286f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:00.840366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcb15a09-0aca-48ec-a0f7-d0cfdb286f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:00.901481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a7e7cbf4-4fc3-4218-b47a-091947a6be13 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60f7adb80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:00.950933 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a7e7cbf4-4fc3-4218-b47a-091947a6be13 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351" status: 200 len: 287 microversion: 2.1 time: 0.054129 Oct 18 13:30:00.952241 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1648/3103] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 18 13:30:00 2022] GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:01.563301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-500770ab-5edb-465e-8454-09f116658ee3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:01.565246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-500770ab-5edb-465e-8454-09f116658ee3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:01.577820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-500770ab-5edb-465e-8454-09f116658ee3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:01.579031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-500770ab-5edb-465e-8454-09f116658ee3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:01.579708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-500770ab-5edb-465e-8454-09f116658ee3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:01.580924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-500770ab-5edb-465e-8454-09f116658ee3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:01.583466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-500770ab-5edb-465e-8454-09f116658ee3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:01.584200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-500770ab-5edb-465e-8454-09f116658ee3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:01.901261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bcb15a09-0aca-48ec-a0f7-d0cfdb286f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:01.917139 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bcb15a09-0aca-48ec-a0f7-d0cfdb286f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 1.105275 Oct 18 13:30:01.919367 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1456/3104] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:00 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:01.930577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-532df020-a44b-4356-be1f-1e2f5af19d94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:01.931732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-532df020-a44b-4356-be1f-1e2f5af19d94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:01.964050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-532df020-a44b-4356-be1f-1e2f5af19d94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:01.981606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-532df020-a44b-4356-be1f-1e2f5af19d94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:01.983052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-532df020-a44b-4356-be1f-1e2f5af19d94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:01.983833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-532df020-a44b-4356-be1f-1e2f5af19d94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:01.986174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-532df020-a44b-4356-be1f-1e2f5af19d94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:01.986423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-532df020-a44b-4356-be1f-1e2f5af19d94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:02.039259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-500770ab-5edb-465e-8454-09f116658ee3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:02.039670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:02.049981 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-500770ab-5edb-465e-8454-09f116658ee3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1318 microversion: 2.1 time: 0.490689 Oct 18 13:30:02.069287 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1649/3105] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:01 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:02.086134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-18a874dd-feae-4d74-bb62-170daa18fe0c tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60f8293a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:02.143263 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-18a874dd-feae-4d74-bb62-170daa18fe0c tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351" status: 200 len: 288 microversion: 2.1 time: 0.072399 Oct 18 13:30:02.144194 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1650/3106] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 18 13:30:02 2022] GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351 => generated 288 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:02.156115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c30c5299-7ce6-4186-b9ce-27bc9c5f9343 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff617bbe040>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:02.299407 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c30c5299-7ce6-4186-b9ce-27bc9c5f9343 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351" status: 202 len: 0 microversion: 2.1 time: 0.146990 Oct 18 13:30:02.300390 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1651/3107] 10.222.0.40 () {58 vars in 1254 bytes} [Tue Oct 18 13:30:02 2022] DELETE /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:30:02.310885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-29a6c1f9-ae45-4c5a-932f-8861b80765c8 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff617b813a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:02.387368 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-29a6c1f9-ae45-4c5a-932f-8861b80765c8 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351" status: 200 len: 287 microversion: 2.1 time: 0.082006 Oct 18 13:30:02.388262 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1652/3108] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 18 13:30:02 2022] GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:02.941451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-55366fd7-0453-42ef-994e-4120f6b83138 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:02.943119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-55366fd7-0453-42ef-994e-4120f6b83138 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:02.963058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55366fd7-0453-42ef-994e-4120f6b83138 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:02.966258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55366fd7-0453-42ef-994e-4120f6b83138 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:02.969687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55366fd7-0453-42ef-994e-4120f6b83138 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:02.970478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55366fd7-0453-42ef-994e-4120f6b83138 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:02.970965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55366fd7-0453-42ef-994e-4120f6b83138 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:02.971403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55366fd7-0453-42ef-994e-4120f6b83138 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:02.980744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-532df020-a44b-4356-be1f-1e2f5af19d94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:02.993160 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-532df020-a44b-4356-be1f-1e2f5af19d94 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1317 microversion: 2.1 time: 1.072338 Oct 18 13:30:02.997923 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1457/3109] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:01 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1317 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:03.084382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1b33cb04-4c11-467d-a52b-0ee67f71e6e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:03.085383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1b33cb04-4c11-467d-a52b-0ee67f71e6e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:03.099740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b33cb04-4c11-467d-a52b-0ee67f71e6e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:03.104548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b33cb04-4c11-467d-a52b-0ee67f71e6e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:03.105377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b33cb04-4c11-467d-a52b-0ee67f71e6e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:03.122516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b33cb04-4c11-467d-a52b-0ee67f71e6e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:03.123357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b33cb04-4c11-467d-a52b-0ee67f71e6e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:03.124022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b33cb04-4c11-467d-a52b-0ee67f71e6e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:03.387773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-55366fd7-0453-42ef-994e-4120f6b83138 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:03.399649 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-55366fd7-0453-42ef-994e-4120f6b83138 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.463408 Oct 18 13:30:03.420713 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1653/3110] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:02 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:03.459690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-659122b0-992b-417d-83a2-d955f020633b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Action: 'create', calling method: .version_select at 0x7ff617b2f160>, body: {"keypair": {"name": "tempest-keypair-547733761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCij+SVq2KA+8g7IT5e9U/WjlonQs49aBda+rlwtQw/rR6EpU//ujTb0VKBkFzjCP/GtbQqqPTsJSM2JuYkiyoJqicNs8KX6KBSzzTRU4jlWI8nFEVXOFAxunuaIBSNe4w=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:03.511419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-659122b0-992b-417d-83a2-d955f020633b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Getting quotas for project b91a2293232c48fbb6395fe741f745b4. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:30:03.524892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-659122b0-992b-417d-83a2-d955f020633b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Getting quotas for user 8fb9d8f5b3ea4aab81db501c78ed1dce and project b91a2293232c48fbb6395fe741f745b4. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:30:03.529167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1b33cb04-4c11-467d-a52b-0ee67f71e6e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:03.538333 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1b33cb04-4c11-467d-a52b-0ee67f71e6e4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1507 microversion: 2.1 time: 0.464022 Oct 18 13:30:03.562192 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1458/3111] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:03 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:03.572398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f1f17d03-8812-4602-823f-b1c2c929262d tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60ee1e700>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:03.572786 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-659122b0-992b-417d-83a2-d955f020633b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.149026 Oct 18 13:30:03.573951 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1654/3112] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 18 13:30:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 13:30:03.586288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-df3e1252-23eb-4c56-bc3b-161873e6656f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:03.587205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-df3e1252-23eb-4c56-bc3b-161873e6656f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:03.601512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df3e1252-23eb-4c56-bc3b-161873e6656f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:03.602285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df3e1252-23eb-4c56-bc3b-161873e6656f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:03.605561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df3e1252-23eb-4c56-bc3b-161873e6656f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:03.606542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df3e1252-23eb-4c56-bc3b-161873e6656f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:03.607223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df3e1252-23eb-4c56-bc3b-161873e6656f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:03.617624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df3e1252-23eb-4c56-bc3b-161873e6656f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:03.673559 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f1f17d03-8812-4602-823f-b1c2c929262d tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351" status: 200 len: 287 microversion: 2.1 time: 0.109934 Oct 18 13:30:03.674483 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1459/3113] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 18 13:30:03 2022] GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351 => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:03.682509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb505525-d5a9-42f7-a426-a765bcec4a90 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:03.683054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eb505525-d5a9-42f7-a426-a765bcec4a90 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:03.699173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb505525-d5a9-42f7-a426-a765bcec4a90 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:03.701818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb505525-d5a9-42f7-a426-a765bcec4a90 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:03.702276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb505525-d5a9-42f7-a426-a765bcec4a90 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:03.709313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb505525-d5a9-42f7-a426-a765bcec4a90 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:03.709770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb505525-d5a9-42f7-a426-a765bcec4a90 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:03.710224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb505525-d5a9-42f7-a426-a765bcec4a90 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:03.814176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eb505525-d5a9-42f7-a426-a765bcec4a90 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:30:03.902152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-df3e1252-23eb-4c56-bc3b-161873e6656f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:03.920173 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-df3e1252-23eb-4c56-bc3b-161873e6656f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1507 microversion: 2.1 time: 0.344588 Oct 18 13:30:03.921504 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1655/3114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:03 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:03.953008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:03.967857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:04.014880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.017892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.018818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.019852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.020821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.021642 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eb505525-d5a9-42f7-a426-a765bcec4a90 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 204 len: 0 microversion: 2.1 time: 0.345478 Oct 18 13:30:04.025439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.028632 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1460/3115] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:03 2022] DELETE /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:30:04.034102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6603b3be-bb96-4ca5-9a10-ab01ac37115d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:04.040748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6603b3be-bb96-4ca5-9a10-ab01ac37115d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:04.054814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6603b3be-bb96-4ca5-9a10-ab01ac37115d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.066001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6603b3be-bb96-4ca5-9a10-ab01ac37115d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.066716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6603b3be-bb96-4ca5-9a10-ab01ac37115d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.067756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6603b3be-bb96-4ca5-9a10-ab01ac37115d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.068488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6603b3be-bb96-4ca5-9a10-ab01ac37115d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.069119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6603b3be-bb96-4ca5-9a10-ab01ac37115d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.274723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:30:04.275151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:30:04.277287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:30:04.277831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:30:04.278257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:30:04.433681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:04.458378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.459965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.460437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.461213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.461666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.465705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.584896 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d0066d8-d6bc-443d-abcf-3e2c48304763 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "POST /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09/action" status: 202 len: 1109 microversion: 2.1 time: 0.643229 Oct 18 13:30:04.590238 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1656/3116] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:30:03 2022] POST /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09/action => generated 1109 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 13:30:04.604985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-02a29813-3bf0-4476-a960-3c539bdc98ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:04.605859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-02a29813-3bf0-4476-a960-3c539bdc98ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:04.619278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02a29813-3bf0-4476-a960-3c539bdc98ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.621151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02a29813-3bf0-4476-a960-3c539bdc98ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.623022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02a29813-3bf0-4476-a960-3c539bdc98ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:04.623824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02a29813-3bf0-4476-a960-3c539bdc98ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:04.624318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02a29813-3bf0-4476-a960-3c539bdc98ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:04.627107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02a29813-3bf0-4476-a960-3c539bdc98ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.192906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-02a29813-3bf0-4476-a960-3c539bdc98ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:05.202471 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-02a29813-3bf0-4476-a960-3c539bdc98ad tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1667 microversion: 2.1 time: 0.610149 Oct 18 13:30:05.213960 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1657/3117] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:04 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1667 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:05.230351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-436512d2-5ff4-41fd-b1c8-606b49d4f418 req-f06c976b-c3a8-4efd-add5-0fc2214e5df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b83d20-5690-49dc-bff4-e6906a63ee23", "name": "network-vif-plugged", "status": "completed", "tag": "e01e4d55-3474-4431-af07-7a611cccd407"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:05.267850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-436512d2-5ff4-41fd-b1c8-606b49d4f418 req-f06c976b-c3a8-4efd-add5-0fc2214e5df4 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:05.268341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-436512d2-5ff4-41fd-b1c8-606b49d4f418 req-f06c976b-c3a8-4efd-add5-0fc2214e5df4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:05.268778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-436512d2-5ff4-41fd-b1c8-606b49d4f418 req-f06c976b-c3a8-4efd-add5-0fc2214e5df4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.331017 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-436512d2-5ff4-41fd-b1c8-606b49d4f418 req-f06c976b-c3a8-4efd-add5-0fc2214e5df4 service nova] Creating event network-vif-plugged:e01e4d55-3474-4431-af07-7a611cccd407 for instance 92b83d20-5690-49dc-bff4-e6906a63ee23 on n-h2-858384-13 Oct 18 13:30:05.363110 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-436512d2-5ff4-41fd-b1c8-606b49d4f418 req-f06c976b-c3a8-4efd-add5-0fc2214e5df4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147699 Oct 18 13:30:05.364582 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1658/3118] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:05.369956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0d50afd7-0eac-43d2-96e2-aa48602c35d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:05.370670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0d50afd7-0eac-43d2-96e2-aa48602c35d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:05.395607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d50afd7-0eac-43d2-96e2-aa48602c35d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:05.396344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d50afd7-0eac-43d2-96e2-aa48602c35d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:05.396789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d50afd7-0eac-43d2-96e2-aa48602c35d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.401343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d50afd7-0eac-43d2-96e2-aa48602c35d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:05.401866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d50afd7-0eac-43d2-96e2-aa48602c35d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:05.402319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d50afd7-0eac-43d2-96e2-aa48602c35d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.891166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6603b3be-bb96-4ca5-9a10-ab01ac37115d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:05.901545 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6603b3be-bb96-4ca5-9a10-ab01ac37115d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1317 microversion: 2.1 time: 1.871382 Oct 18 13:30:05.902155 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1461/3119] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:04 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1317 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:05.912134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-39e35f44-9fa5-45f1-9754-2303a3041b63 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:05.912776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-39e35f44-9fa5-45f1-9754-2303a3041b63 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:05.940331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39e35f44-9fa5-45f1-9754-2303a3041b63 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:05.940840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39e35f44-9fa5-45f1-9754-2303a3041b63 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:05.941311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39e35f44-9fa5-45f1-9754-2303a3041b63 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:05.942072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39e35f44-9fa5-45f1-9754-2303a3041b63 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:05.960091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39e35f44-9fa5-45f1-9754-2303a3041b63 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:05.964228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39e35f44-9fa5-45f1-9754-2303a3041b63 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.501063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0d50afd7-0eac-43d2-96e2-aa48602c35d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:06.512725 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0d50afd7-0eac-43d2-96e2-aa48602c35d5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 1.145284 Oct 18 13:30:06.530408 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1659/3120] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:05 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:06.545704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-043ea6f4-064a-4eb6-bedf-d0f96f324d0c tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60fdb2040>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:06.596859 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-043ea6f4-064a-4eb6-bedf-d0f96f324d0c tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] HTTP exception thrown: Snapshot 354d967b-d1a7-466b-8749-f521a1574351 could not be found. Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-043ea6f4-064a-4eb6-bedf-d0f96f324d0c tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Request method failure captured: Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351 HTTP/1.1 Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqpS1Fm5wxvYG_Q4cu0mN7KphYlc7hrn6HtmlInXAZ_In-3y5FnpdQ1MOE3V8Mw3JXLgeng71mCvsBra2iBQzjelwwNcb9KUtybriWJFJRy_UmxIBnHi1jW6bpCyH37g47mLSgF1EcpBi_nfDCFhNakr3Olbfw9GuLAWkEND-d7KXt8 Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: da714cd1277f4a4b8f0e2f584efaa5bd Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-729514585 Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da714cd1277f4a4b8f0e2f584efaa5bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da714cd1277f4a4b8f0e2f584efaa5bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da714cd1277f4a4b8f0e2f584efaa5bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da714cd1277f4a4b8f0e2f584efaa5bd"}]}] Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-VolumesSnapshotsTestJSON-729514585 Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: da714cd1277f4a4b8f0e2f584efaa5bd Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-729514585 Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-VolumesSnapshotsTestJSON-729514585-project Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 306cb8f8b77846e98273011b448dc145 Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-VolumesSnapshotsTestJSON-729514585-project Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: exception: Snapshot 354d967b-d1a7-466b-8749-f521a1574351 could not be found. Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '354d967b-d1a7-466b-8749-f521a1574351'} Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 354d967b-d1a7-466b-8749-f521a1574351 could not be found. (HTTP 404) (Request-ID: req-ee05cf5b-2280-41a3-8597-453d57a262ac) Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:30:06.622765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 354d967b-d1a7-466b-8749-f521a1574351 could not be found. Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 354d967b-d1a7-466b-8749-f521a1574351 could not be found. Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 354d967b-d1a7-466b-8749-f521a1574351 could not be found. Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-043ea6f4-064a-4eb6-bedf-d0f96f324d0c tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Returning 404 to user: Snapshot 354d967b-d1a7-466b-8749-f521a1574351 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-043ea6f4-064a-4eb6-bedf-d0f96f324d0c tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351" status: 404 len: 111 microversion: 2.1 time: 0.093281 Oct 18 13:30:06.627772 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1660/3121] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 18 13:30:06 2022] GET /compute/v2.1/os-snapshots/354d967b-d1a7-466b-8749-f521a1574351 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:06.633559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-34cd0f41-38b6-444e-a9b3-4949cf3e382b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:06.635156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-34cd0f41-38b6-444e-a9b3-4949cf3e382b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:06.661337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34cd0f41-38b6-444e-a9b3-4949cf3e382b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:06.661842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34cd0f41-38b6-444e-a9b3-4949cf3e382b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:06.666070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34cd0f41-38b6-444e-a9b3-4949cf3e382b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.666996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34cd0f41-38b6-444e-a9b3-4949cf3e382b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:06.667511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34cd0f41-38b6-444e-a9b3-4949cf3e382b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:06.667930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34cd0f41-38b6-444e-a9b3-4949cf3e382b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:06.831237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-34cd0f41-38b6-444e-a9b3-4949cf3e382b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:06.846678 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-34cd0f41-38b6-444e-a9b3-4949cf3e382b tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1600 microversion: 2.1 time: 0.218238 Oct 18 13:30:06.849107 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1661/3122] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:06 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1600 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:06.882701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5a575a57-4056-4697-bbaa-1b3d151b70a7 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff617ba45e0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:06.938504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-39e35f44-9fa5-45f1-9754-2303a3041b63 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:06.947023 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-39e35f44-9fa5-45f1-9754-2303a3041b63 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 1.040052 Oct 18 13:30:06.958424 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1462/3123] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:05 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:06.966641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3b399faf-32fc-4714-91fe-a99fb9504498 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:06.966641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3b399faf-32fc-4714-91fe-a99fb9504498 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:07.024506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b399faf-32fc-4714-91fe-a99fb9504498 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:07.030083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b399faf-32fc-4714-91fe-a99fb9504498 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:07.033761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b399faf-32fc-4714-91fe-a99fb9504498 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:07.039152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b399faf-32fc-4714-91fe-a99fb9504498 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:07.053881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b399faf-32fc-4714-91fe-a99fb9504498 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:07.054621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b399faf-32fc-4714-91fe-a99fb9504498 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:07.107141 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5a575a57-4056-4697-bbaa-1b3d151b70a7 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc" status: 202 len: 0 microversion: 2.1 time: 0.254038 Oct 18 13:30:07.107141 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1662/3124] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:30:06 2022] DELETE /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:30:07.115884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-65d61b65-0f4f-4501-9386-b3ffcc2266d5 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff617b3d4c0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:07.238755 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-65d61b65-0f4f-4501-9386-b3ffcc2266d5 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc" status: 200 len: 343 microversion: 2.1 time: 0.128724 Oct 18 13:30:07.240201 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1663/3125] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:30:07 2022] GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc => generated 343 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:07.460810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7a5ce5da-5153-44b2-a98a-5b07f8947079 req-eb58b785-a532-499c-ac16-e7f1df3cb7bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1ba414-b725-477c-917a-d5e846e42462", "name": "network-vif-plugged", "status": "completed", "tag": "fc85f618-9d9c-41c0-b8d7-706b0f9a2358"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:07.487897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7a5ce5da-5153-44b2-a98a-5b07f8947079 req-eb58b785-a532-499c-ac16-e7f1df3cb7bc service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:07.495361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7a5ce5da-5153-44b2-a98a-5b07f8947079 req-eb58b785-a532-499c-ac16-e7f1df3cb7bc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:07.497351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7a5ce5da-5153-44b2-a98a-5b07f8947079 req-eb58b785-a532-499c-ac16-e7f1df3cb7bc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:07.543892 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7a5ce5da-5153-44b2-a98a-5b07f8947079 req-eb58b785-a532-499c-ac16-e7f1df3cb7bc service nova] Creating event network-vif-plugged:fc85f618-9d9c-41c0-b8d7-706b0f9a2358 for instance 8a1ba414-b725-477c-917a-d5e846e42462 on n-h1-858384-13 Oct 18 13:30:07.568856 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7a5ce5da-5153-44b2-a98a-5b07f8947079 req-eb58b785-a532-499c-ac16-e7f1df3cb7bc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112079 Oct 18 13:30:07.572003 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1664/3126] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:07.597704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1fa397f2-bade-49be-8ac1-0557211fabc9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:07.618949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1fa397f2-bade-49be-8ac1-0557211fabc9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:07.664224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1fa397f2-bade-49be-8ac1-0557211fabc9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:07.673267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1fa397f2-bade-49be-8ac1-0557211fabc9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:07.675517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1fa397f2-bade-49be-8ac1-0557211fabc9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:07.683347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1fa397f2-bade-49be-8ac1-0557211fabc9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:07.686782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1fa397f2-bade-49be-8ac1-0557211fabc9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:07.688927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1fa397f2-bade-49be-8ac1-0557211fabc9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:07.782590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3b399faf-32fc-4714-91fe-a99fb9504498 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:07.795334 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3b399faf-32fc-4714-91fe-a99fb9504498 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1317 microversion: 2.1 time: 0.838730 Oct 18 13:30:07.798404 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1463/3127] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:06 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1317 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:07.871196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c42e373e-6018-4d44-b243-c391c6e7ed43 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:07.872215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c42e373e-6018-4d44-b243-c391c6e7ed43 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:07.882627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c42e373e-6018-4d44-b243-c391c6e7ed43 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:07.884546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c42e373e-6018-4d44-b243-c391c6e7ed43 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:07.885296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c42e373e-6018-4d44-b243-c391c6e7ed43 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:07.886363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c42e373e-6018-4d44-b243-c391c6e7ed43 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:07.887064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c42e373e-6018-4d44-b243-c391c6e7ed43 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:07.887764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c42e373e-6018-4d44-b243-c391c6e7ed43 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:08.094351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c42e373e-6018-4d44-b243-c391c6e7ed43 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:08.103661 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c42e373e-6018-4d44-b243-c391c6e7ed43 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1600 microversion: 2.1 time: 0.237660 Oct 18 13:30:08.110901 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1464/3128] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:07 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1600 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:08.123879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-03c648de-60c8-408c-aec5-8c6e9a2578e0 req-c04dc7f4-371e-4a23-88da-23638ef545c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f4088c-c321-4fc1-8bec-456d1178cda7", "name": "network-vif-deleted", "tag": "7732437d-47a0-4c99-8e68-a24b9d4ee37d"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:08.149291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-03c648de-60c8-408c-aec5-8c6e9a2578e0 req-c04dc7f4-371e-4a23-88da-23638ef545c2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:08.149801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-03c648de-60c8-408c-aec5-8c6e9a2578e0 req-c04dc7f4-371e-4a23-88da-23638ef545c2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:08.150437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-03c648de-60c8-408c-aec5-8c6e9a2578e0 req-c04dc7f4-371e-4a23-88da-23638ef545c2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:08.189612 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-03c648de-60c8-408c-aec5-8c6e9a2578e0 req-c04dc7f4-371e-4a23-88da-23638ef545c2 service nova] Creating event network-vif-deleted:7732437d-47a0-4c99-8e68-a24b9d4ee37d for instance e1f4088c-c321-4fc1-8bec-456d1178cda7 on n-h1-858384-13 Oct 18 13:30:08.199907 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-03c648de-60c8-408c-aec5-8c6e9a2578e0 req-c04dc7f4-371e-4a23-88da-23638ef545c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086479 Oct 18 13:30:08.202033 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1465/3129] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:08.213078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e077550-6dfd-4f3f-9b76-6f81961ad722 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:08.213995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0e077550-6dfd-4f3f-9b76-6f81961ad722 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:08.224231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e077550-6dfd-4f3f-9b76-6f81961ad722 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:08.225519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e077550-6dfd-4f3f-9b76-6f81961ad722 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:08.226133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e077550-6dfd-4f3f-9b76-6f81961ad722 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:08.227311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e077550-6dfd-4f3f-9b76-6f81961ad722 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:08.227922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e077550-6dfd-4f3f-9b76-6f81961ad722 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:08.228526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e077550-6dfd-4f3f-9b76-6f81961ad722 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:08.387999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1fa397f2-bade-49be-8ac1-0557211fabc9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:08.409347 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1fa397f2-bade-49be-8ac1-0557211fabc9 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.831393 Oct 18 13:30:08.413666 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1665/3130] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:07 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:08.445802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-44360d12-8762-4beb-941a-8baa39dca05b tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff617b813a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:08.462663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e077550-6dfd-4f3f-9b76-6f81961ad722 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:08.473014 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e077550-6dfd-4f3f-9b76-6f81961ad722 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.269037 Oct 18 13:30:08.474847 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1466/3131] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:08 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:08.593312 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-44360d12-8762-4beb-941a-8baa39dca05b tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc" status: 200 len: 343 microversion: 2.1 time: 0.178345 Oct 18 13:30:08.593961 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1666/3132] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:30:08 2022] GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc => generated 343 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:08.825784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-11848826-fb28-4a71-8baf-30cc9d97459e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:08.826834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-11848826-fb28-4a71-8baf-30cc9d97459e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:08.845599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11848826-fb28-4a71-8baf-30cc9d97459e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:08.854327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11848826-fb28-4a71-8baf-30cc9d97459e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:08.854816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11848826-fb28-4a71-8baf-30cc9d97459e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:08.855648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11848826-fb28-4a71-8baf-30cc9d97459e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:08.856109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11848826-fb28-4a71-8baf-30cc9d97459e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:08.856534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11848826-fb28-4a71-8baf-30cc9d97459e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:09.076002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-11848826-fb28-4a71-8baf-30cc9d97459e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:09.089742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1888835440", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e389cb60-8e59-4344-aaf6-83b72fafb0b7"}, {"port": "49c418e1-353c-497f-923e-d6752ffbf9f7", "tag": "port-1"}, {"port": "85bd4b91-835a-4c86-9150-32d18f92eefc", "tag": "port-2"}, {"uuid": "7e4bf0fa-319a-4f98-b1b6-58bcddcc65a1", "tag": "net-1"}, {"uuid": "7e4bf0fa-319a-4f98-b1b6-58bcddcc65a1"}, {"uuid": "6c4510e5-b2b1-47aa-8376-ed0bf9bd522c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6c4510e5-b2b1-47aa-8376-ed0bf9bd522c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0b067bfb-98b6-4f1d-82ba-12d06d996517", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "70de4a2d-967e-4d3d-99ad-f4580db1c737", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "694f2a40-9fac-4f89-9d14-7559a6a9fdc8", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1835454009"}], "key_name": "tempest-keypair-547733761", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:09.100931 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-11848826-fb28-4a71-8baf-30cc9d97459e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1317 microversion: 2.1 time: 0.280302 Oct 18 13:30:09.101542 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1467/3133] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:08 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:09.136927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:09.137914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:09.148870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:09.153575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:09.156021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:09.156958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:09.161594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:09.162381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:09.215819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:09.216723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:09.217323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:09.217893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lazy-loading 'fault' on Instance uuid e1f4088c-c321-4fc1-8bec-456d1178cda7 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:09.277884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:09.287404 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cf18ccf3-a172-45ae-859b-abd5d1b9052a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1324 microversion: 2.1 time: 0.153996 Oct 18 13:30:09.288866 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1468/3134] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:09 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1324 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:09.307038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] validate_networks() for [('e389cb60-8e59-4344-aaf6-83b72fafb0b7', None, None, None, None, None), (None, None, '49c418e1-353c-497f-923e-d6752ffbf9f7', None, None, None), (None, None, '85bd4b91-835a-4c86-9150-32d18f92eefc', None, None, None), ('7e4bf0fa-319a-4f98-b1b6-58bcddcc65a1', None, None, None, None, None), ('7e4bf0fa-319a-4f98-b1b6-58bcddcc65a1', None, None, None, None, None), ('6c4510e5-b2b1-47aa-8376-ed0bf9bd522c', '10.2.2.100', None, None, None, None), ('6c4510e5-b2b1-47aa-8376-ed0bf9bd522c', '10.2.2.200', None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:30:09.435207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5e1ec42e-dc02-4b48-94e2-31869d21497b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:09.435829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5e1ec42e-dc02-4b48-94e2-31869d21497b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:09.450154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e1ec42e-dc02-4b48-94e2-31869d21497b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:09.451133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e1ec42e-dc02-4b48-94e2-31869d21497b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:09.451600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e1ec42e-dc02-4b48-94e2-31869d21497b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:09.452319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e1ec42e-dc02-4b48-94e2-31869d21497b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:09.452774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e1ec42e-dc02-4b48-94e2-31869d21497b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:09.453268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e1ec42e-dc02-4b48-94e2-31869d21497b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:09.776890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5e1ec42e-dc02-4b48-94e2-31869d21497b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:09.793506 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5e1ec42e-dc02-4b48-94e2-31869d21497b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.363229 Oct 18 13:30:09.795782 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1469/3135] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:09 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:09.800744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31c0b449-7bd5-4efd-9df0-1142e44d1d6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:09.811126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-31c0b449-7bd5-4efd-9df0-1142e44d1d6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:09.820606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c0b449-7bd5-4efd-9df0-1142e44d1d6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:09.821395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c0b449-7bd5-4efd-9df0-1142e44d1d6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:09.823234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c0b449-7bd5-4efd-9df0-1142e44d1d6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:09.826009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c0b449-7bd5-4efd-9df0-1142e44d1d6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:09.826655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c0b449-7bd5-4efd-9df0-1142e44d1d6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:09.827277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c0b449-7bd5-4efd-9df0-1142e44d1d6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.108254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31c0b449-7bd5-4efd-9df0-1142e44d1d6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:10.126702 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31c0b449-7bd5-4efd-9df0-1142e44d1d6d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.329587 Oct 18 13:30:10.127870 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1470/3136] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:09 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:10.134445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f97f40da-ad66-4f42-a31d-d3b217f63734 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff617a5baf0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:10.266394 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f97f40da-ad66-4f42-a31d-d3b217f63734 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc" status: 200 len: 343 microversion: 2.1 time: 0.137213 Oct 18 13:30:10.275864 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1471/3137] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:30:10 2022] GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc => generated 343 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:10.286407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5bcde55f-ce29-4eab-b3fb-cae9f8cb17b8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:10.287834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5bcde55f-ce29-4eab-b3fb-cae9f8cb17b8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:10.298421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bcde55f-ce29-4eab-b3fb-cae9f8cb17b8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.298914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bcde55f-ce29-4eab-b3fb-cae9f8cb17b8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.299354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bcde55f-ce29-4eab-b3fb-cae9f8cb17b8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.300074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bcde55f-ce29-4eab-b3fb-cae9f8cb17b8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.300532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bcde55f-ce29-4eab-b3fb-cae9f8cb17b8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.301721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bcde55f-ce29-4eab-b3fb-cae9f8cb17b8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.506110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5bcde55f-ce29-4eab-b3fb-cae9f8cb17b8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:10.515658 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5bcde55f-ce29-4eab-b3fb-cae9f8cb17b8 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1467 microversion: 2.1 time: 0.238445 Oct 18 13:30:10.516622 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1472/3138] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:10 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1467 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:10.522512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:10.523133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:10.529730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.530345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.530968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.531847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.532443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.532860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.583155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.597314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.601978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.602863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lazy-loading 'fault' on Instance uuid e1f4088c-c321-4fc1-8bec-456d1178cda7 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:10.718507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:10.729727 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5b0fe487-f8c1-4c9e-9605-4453f6b7c00d tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 200 len: 1324 microversion: 2.1 time: 0.211898 Oct 18 13:30:10.745289 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1473/3139] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:10 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 1324 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:10.745289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9ce2121a-0a0f-44e6-af1c-1fe799804f31 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:10.745289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9ce2121a-0a0f-44e6-af1c-1fe799804f31 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:10.760072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ce2121a-0a0f-44e6-af1c-1fe799804f31 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.760579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ce2121a-0a0f-44e6-af1c-1fe799804f31 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.761023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ce2121a-0a0f-44e6-af1c-1fe799804f31 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.764333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ce2121a-0a0f-44e6-af1c-1fe799804f31 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:10.769342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ce2121a-0a0f-44e6-af1c-1fe799804f31 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:10.769699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ce2121a-0a0f-44e6-af1c-1fe799804f31 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:10.789677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:10.977693 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9ce2121a-0a0f-44e6-af1c-1fe799804f31 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1620 microversion: 2.1 time: 0.239822 Oct 18 13:30:10.982000 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1474/3140] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:10 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1620 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:10.992949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ac153386-d3af-40b2-9d7a-87067b1408d0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:10.993841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ac153386-d3af-40b2-9d7a-87067b1408d0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:11.030647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac153386-d3af-40b2-9d7a-87067b1408d0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:11.034280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac153386-d3af-40b2-9d7a-87067b1408d0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:11.034964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac153386-d3af-40b2-9d7a-87067b1408d0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:11.036492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac153386-d3af-40b2-9d7a-87067b1408d0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:11.037191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac153386-d3af-40b2-9d7a-87067b1408d0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:11.038146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac153386-d3af-40b2-9d7a-87067b1408d0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Oct 18 13:30:11.272475 n-d-858384-13 devstack@n-api.service[120611]: ERROR sqlalchemy.pool.impl.QueuePool Oct 18 13:30:11.276587 n-d-858384-13 devstack@n-api.service[120611]: Exception ignored in: . at 0x7ff617b2f550> Oct 18 13:30:11.276802 n-d-858384-13 devstack@n-api.service[120611]: Traceback (most recent call last): Oct 18 13:30:11.277011 n-d-858384-13 devstack@n-api.service[120611]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 18 13:30:11.277865 n-d-858384-13 devstack@n-api.service[120611]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 18 13:30:11.278079 n-d-858384-13 devstack@n-api.service[120611]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 18 13:30:11.278660 n-d-858384-13 devstack@n-api.service[120611]: connection_record.checkin() Oct 18 13:30:11.279523 n-d-858384-13 devstack@n-api.service[120611]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 18 13:30:11.280013 n-d-858384-13 devstack@n-api.service[120611]: pool.dispatch.checkin(connection, self) Oct 18 13:30:11.280217 n-d-858384-13 devstack@n-api.service[120611]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 18 13:30:11.280685 n-d-858384-13 devstack@n-api.service[120611]: fn(*args, **kw) Oct 18 13:30:11.280895 n-d-858384-13 devstack@n-api.service[120611]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 18 13:30:11.281480 n-d-858384-13 devstack@n-api.service[120611]: time.sleep(0) Oct 18 13:30:11.281684 n-d-858384-13 devstack@n-api.service[120611]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 18 13:30:11.282000 n-d-858384-13 devstack@n-api.service[120611]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 18 13:30:11.282203 n-d-858384-13 devstack@n-api.service[120611]: AssertionError: do not call blocking functions from the mainloop Oct 18 13:30:11.329748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ac153386-d3af-40b2-9d7a-87067b1408d0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:11.339453 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ac153386-d3af-40b2-9d7a-87067b1408d0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.356421 Oct 18 13:30:11.353211 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1475/3141] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:10 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:11.353211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5259cf4f-a568-4e97-b1e5-9d3c145441c7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:11.353211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5259cf4f-a568-4e97-b1e5-9d3c145441c7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:11.353211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5259cf4f-a568-4e97-b1e5-9d3c145441c7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:11.353211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5259cf4f-a568-4e97-b1e5-9d3c145441c7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:11.353211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5259cf4f-a568-4e97-b1e5-9d3c145441c7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:11.353803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5259cf4f-a568-4e97-b1e5-9d3c145441c7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:11.353890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5259cf4f-a568-4e97-b1e5-9d3c145441c7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:11.356099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5259cf4f-a568-4e97-b1e5-9d3c145441c7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:11.539505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5259cf4f-a568-4e97-b1e5-9d3c145441c7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:11.554043 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5259cf4f-a568-4e97-b1e5-9d3c145441c7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.211976 Oct 18 13:30:11.554487 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1476/3142] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:11 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:11.578143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-368584069", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b0688b2d-dd1e-427c-b5f1-1ac0fad84598"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:11.658985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:30:11.965773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:30:11.966912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:30:11.967519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:30:11.968752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:30:11.969556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:30:11.983566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:11.984207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:11.984754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:11.985640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:11.987305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:11.987877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.011714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:12.025698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for project caf4a24f687647e4a23fbee030d4e53a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:30:12.037760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Getting quotas for user 2cb58ae89a06444e95eca4c886e9cc0c and project caf4a24f687647e4a23fbee030d4e53a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:30:12.063960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:30:12.066362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:30:12.124359 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b4807fc5-c7c5-4631-a563-366e7be37150 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550088 Oct 18 13:30:12.131464 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1477/3143] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:30:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:30:12.137567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d7122955-693c-4a41-8e97-21ad78e6260f tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60eefeb80>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:12.206625 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-d7122955-693c-4a41-8e97-21ad78e6260f tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] HTTP exception thrown: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d7122955-693c-4a41-8e97-21ad78e6260f tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Request method failure captured: Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc HTTP/1.1 Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqpS1Fm5wxvYG_Q4cu0mN7KphYlc7hrn6HtmlInXAZ_In-3y5FnpdQ1MOE3V8Mw3JXLgeng71mCvsBra2iBQzjelwwNcb9KUtybriWJFJRy_UmxIBnHi1jW6bpCyH37g47mLSgF1EcpBi_nfDCFhNakr3Olbfw9GuLAWkEND-d7KXt8 Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: da714cd1277f4a4b8f0e2f584efaa5bd Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-729514585 Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da714cd1277f4a4b8f0e2f584efaa5bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da714cd1277f4a4b8f0e2f584efaa5bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da714cd1277f4a4b8f0e2f584efaa5bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da714cd1277f4a4b8f0e2f584efaa5bd"}]}] Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-VolumesSnapshotsTestJSON-729514585 Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: da714cd1277f4a4b8f0e2f584efaa5bd Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-729514585 Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-VolumesSnapshotsTestJSON-729514585-project Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 306cb8f8b77846e98273011b448dc145 Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-VolumesSnapshotsTestJSON-729514585-project Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: exception: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'e33556eb-4670-478d-8436-ade7f10442bc'} Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. (HTTP 404) (Request-ID: req-1fd463b9-aaf9-46a4-8a75-e7075cf8ce6c) Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:30:12.213669 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.218513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d7122955-693c-4a41-8e97-21ad78e6260f tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Returning 404 to user: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:12.222432 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d7122955-693c-4a41-8e97-21ad78e6260f tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc" status: 404 len: 109 microversion: 2.1 time: 0.089276 Oct 18 13:30:12.223824 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1478/3144] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:30:12 2022] GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:12.228554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd6c1dd0-bdae-4622-b706-891c121d699f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:12.229293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fd6c1dd0-bdae-4622-b706-891c121d699f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: e1f4088c-c321-4fc1-8bec-456d1178cda7] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:12.243008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd6c1dd0-bdae-4622-b706-891c121d699f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.249808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd6c1dd0-bdae-4622-b706-891c121d699f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.250368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd6c1dd0-bdae-4622-b706-891c121d699f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.251195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd6c1dd0-bdae-4622-b706-891c121d699f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.251759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd6c1dd0-bdae-4622-b706-891c121d699f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.258502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd6c1dd0-bdae-4622-b706-891c121d699f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.292718 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-fd6c1dd0-bdae-4622-b706-891c121d699f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] HTTP exception thrown: Instance e1f4088c-c321-4fc1-8bec-456d1178cda7 could not be found. Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd6c1dd0-bdae-4622-b706-891c121d699f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Request method failure captured: Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 HTTP/1.1 Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqh3-Bo1lQthpoqW1ytyGHX_iWOryv_Newpq73Q_9g-reuRzQLMu5eC9rE6MXgoMKHMjnL1WLhVH8Pvt5jOEV2r1prckoWJRDFa6cILAQ_qFeTkg16envL2slQyQV5SKOO7QFuDavquWHGMYgdxCjaDhijAc6rHYbjv12YFhBPkK7gM Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: cf7c744c508342f5947ae08743ccc6c7 Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-LiveMigrationTest-1806726401 Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf7c744c508342f5947ae08743ccc6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf7c744c508342f5947ae08743ccc6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf7c744c508342f5947ae08743ccc6c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf7c744c508342f5947ae08743ccc6c7"}]}] Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-LiveMigrationTest-1806726401 Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: cf7c744c508342f5947ae08743ccc6c7 Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-LiveMigrationTest-1806726401 Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-LiveMigrationTest-1806726401-project Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 2b3d9555419845cc9bc9f650e676d776 Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-LiveMigrationTest-1806726401-project Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance e1f4088c-c321-4fc1-8bec-456d1178cda7 could not be found. Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'e1f4088c-c321-4fc1-8bec-456d1178cda7'} Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f4088c-c321-4fc1-8bec-456d1178cda7 could not be found. Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f4088c-c321-4fc1-8bec-456d1178cda7 could not be found. Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:12.294449 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.299951 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.299951 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:12.299951 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:12.299951 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:12.299951 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:12.299951 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f4088c-c321-4fc1-8bec-456d1178cda7 could not be found. Oct 18 13:30:12.299951 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.299951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd6c1dd0-bdae-4622-b706-891c121d699f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Returning 404 to user: Instance e1f4088c-c321-4fc1-8bec-456d1178cda7 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:12.300703 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fd6c1dd0-bdae-4622-b706-891c121d699f tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7" status: 404 len: 111 microversion: 2.1 time: 0.075142 Oct 18 13:30:12.302050 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1479/3145] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:12 2022] GET /compute/v2.1/servers/e1f4088c-c321-4fc1-8bec-456d1178cda7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:12.307559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5ae3eca4-a222-475b-90cc-efab92949ff5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:12.308330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5ae3eca4-a222-475b-90cc-efab92949ff5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:12.371600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5ae3eca4-a222-475b-90cc-efab92949ff5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:12.382291 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5ae3eca4-a222-475b-90cc-efab92949ff5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1216 microversion: 2.1 time: 0.078958 Oct 18 13:30:12.398051 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1480/3146] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:12 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1216 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:12.403085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-620aa7cb-212b-432e-ae78-44ee91f6fac0 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60ee5d280>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:12.465287 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-620aa7cb-212b-432e-ae78-44ee91f6fac0 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] HTTP exception thrown: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-620aa7cb-212b-432e-ae78-44ee91f6fac0 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Request method failure captured: Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc HTTP/1.1 Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqpS1Fm5wxvYG_Q4cu0mN7KphYlc7hrn6HtmlInXAZ_In-3y5FnpdQ1MOE3V8Mw3JXLgeng71mCvsBra2iBQzjelwwNcb9KUtybriWJFJRy_UmxIBnHi1jW6bpCyH37g47mLSgF1EcpBi_nfDCFhNakr3Olbfw9GuLAWkEND-d7KXt8 Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: da714cd1277f4a4b8f0e2f584efaa5bd Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-729514585 Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da714cd1277f4a4b8f0e2f584efaa5bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da714cd1277f4a4b8f0e2f584efaa5bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da714cd1277f4a4b8f0e2f584efaa5bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da714cd1277f4a4b8f0e2f584efaa5bd"}]}] Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-VolumesSnapshotsTestJSON-729514585 Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: da714cd1277f4a4b8f0e2f584efaa5bd Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-729514585 Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-VolumesSnapshotsTestJSON-729514585-project Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 306cb8f8b77846e98273011b448dc145 Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-VolumesSnapshotsTestJSON-729514585-project Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: exception: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'e33556eb-4670-478d-8436-ade7f10442bc'} Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. (HTTP 404) (Request-ID: req-f10cde44-ce13-4937-b19f-30f6e1ce27f4) Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:30:12.467694 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.471495 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.479485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-620aa7cb-212b-432e-ae78-44ee91f6fac0 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Returning 404 to user: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:12.481070 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-620aa7cb-212b-432e-ae78-44ee91f6fac0 tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc" status: 404 len: 109 microversion: 2.1 time: 0.081939 Oct 18 13:30:12.481946 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1481/3147] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:30:12 2022] DELETE /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:12.491479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5946affb-4d45-488f-a907-185c90267b01 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '.version_select at 0x7ff60ee3b310>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:12.524661 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5946affb-4d45-488f-a907-185c90267b01 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374431439" status: 202 len: 0 microversion: 2.1 time: 0.040803 Oct 18 13:30:12.525889 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1482/3148] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:30:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374431439 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:30:12.531349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-01586ff2-9e8b-4d5d-8873-459a5fadb61b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:12.532155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-01586ff2-9e8b-4d5d-8873-459a5fadb61b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:12.540513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01586ff2-9e8b-4d5d-8873-459a5fadb61b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.542212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01586ff2-9e8b-4d5d-8873-459a5fadb61b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.542853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01586ff2-9e8b-4d5d-8873-459a5fadb61b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.543709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01586ff2-9e8b-4d5d-8873-459a5fadb61b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.544318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01586ff2-9e8b-4d5d-8873-459a5fadb61b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.547341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01586ff2-9e8b-4d5d-8873-459a5fadb61b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.888263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-01586ff2-9e8b-4d5d-8873-459a5fadb61b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:12.905850 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-01586ff2-9e8b-4d5d-8873-459a5fadb61b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.377205 Oct 18 13:30:12.928419 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1483/3149] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:12 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:12.937863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:30:12.938390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d76ebdd3-979d-4d07-b475-00985ca4070f tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Calling method '.version_select at 0x7ff60f80aca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:12.939219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:30:12.940515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:30:12.941265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:30:12.942188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:30:12.960459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.961634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.962504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.963492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:12.968200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:12.968905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:12.979282 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-d76ebdd3-979d-4d07-b475-00985ca4070f tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] HTTP exception thrown: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d76ebdd3-979d-4d07-b475-00985ca4070f tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Request method failure captured: Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc HTTP/1.1 Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqpS1Fm5wxvYG_Q4cu0mN7KphYlc7hrn6HtmlInXAZ_In-3y5FnpdQ1MOE3V8Mw3JXLgeng71mCvsBra2iBQzjelwwNcb9KUtybriWJFJRy_UmxIBnHi1jW6bpCyH37g47mLSgF1EcpBi_nfDCFhNakr3Olbfw9GuLAWkEND-d7KXt8 Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: da714cd1277f4a4b8f0e2f584efaa5bd Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-729514585 Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da714cd1277f4a4b8f0e2f584efaa5bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da714cd1277f4a4b8f0e2f584efaa5bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da714cd1277f4a4b8f0e2f584efaa5bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da714cd1277f4a4b8f0e2f584efaa5bd"}]}] Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-VolumesSnapshotsTestJSON-729514585 Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: da714cd1277f4a4b8f0e2f584efaa5bd Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-729514585 Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-VolumesSnapshotsTestJSON-729514585-project Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 306cb8f8b77846e98273011b448dc145 Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-VolumesSnapshotsTestJSON-729514585-project Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: exception: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'e33556eb-4670-478d-8436-ade7f10442bc'} Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. (HTTP 404) (Request-ID: req-06657566-d1b0-4a7c-b3e8-6092e7cd3960) Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:30:12.982574 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. Oct 18 13:30:12.989034 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:12.994155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d76ebdd3-979d-4d07-b475-00985ca4070f tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] Returning 404 to user: Volume e33556eb-4670-478d-8436-ade7f10442bc could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:12.994155 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d76ebdd3-979d-4d07-b475-00985ca4070f tempest-VolumesSnapshotsTestJSON-729514585 tempest-VolumesSnapshotsTestJSON-729514585-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc" status: 404 len: 109 microversion: 2.1 time: 0.062042 Oct 18 13:30:13.011296 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1484/3150] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:30:12 2022] GET /compute/v2.1/os-volumes/e33556eb-4670-478d-8436-ade7f10442bc => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:13.031883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Getting quotas for project b91a2293232c48fbb6395fe741f745b4. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:30:13.041094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-283d8af7-2a62-4a30-9a04-2ff33fb116e8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:13.045333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Getting quotas for user 8fb9d8f5b3ea4aab81db501c78ed1dce and project b91a2293232c48fbb6395fe741f745b4. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:30:13.046848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-283d8af7-2a62-4a30-9a04-2ff33fb116e8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:13.070641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-283d8af7-2a62-4a30-9a04-2ff33fb116e8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:13.071133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-283d8af7-2a62-4a30-9a04-2ff33fb116e8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:13.071578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-283d8af7-2a62-4a30-9a04-2ff33fb116e8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:13.072292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-283d8af7-2a62-4a30-9a04-2ff33fb116e8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:13.072749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-283d8af7-2a62-4a30-9a04-2ff33fb116e8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:13.073196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-283d8af7-2a62-4a30-9a04-2ff33fb116e8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:13.528865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:30:13.532297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0b067bfb-98b6-4f1d-82ba-12d06d996517',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='70de4a2d-967e-4d3d-99ad-f4580db1c737',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='694f2a40-9fac-4f89-9d14-7559a6a9fdc8',volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:30:13.613477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-283d8af7-2a62-4a30-9a04-2ff33fb116e8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:13.624794 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-283d8af7-2a62-4a30-9a04-2ff33fb116e8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.612394 Oct 18 13:30:13.628625 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1485/3151] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:13 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:13.634592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d60a4f80-52c7-4797-a412-c776d76e9bee tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:13.651737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d60a4f80-52c7-4797-a412-c776d76e9bee tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:13.678989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d60a4f80-52c7-4797-a412-c776d76e9bee tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:13.682515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d60a4f80-52c7-4797-a412-c776d76e9bee tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:13.691056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d60a4f80-52c7-4797-a412-c776d76e9bee tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:13.697517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d60a4f80-52c7-4797-a412-c776d76e9bee tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:13.698305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d60a4f80-52c7-4797-a412-c776d76e9bee tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:13.698942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d60a4f80-52c7-4797-a412-c776d76e9bee tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.340061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d60a4f80-52c7-4797-a412-c776d76e9bee tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:14.353908 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d60a4f80-52c7-4797-a412-c776d76e9bee tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1220 microversion: 2.1 time: 0.722018 Oct 18 13:30:14.355253 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1486/3152] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:13 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1220 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:14.364355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a8a17871-9d95-4fa2-887c-632a982f7b3f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:14.369426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a8a17871-9d95-4fa2-887c-632a982f7b3f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:14.382807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a17871-9d95-4fa2-887c-632a982f7b3f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.383564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a17871-9d95-4fa2-887c-632a982f7b3f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.384002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a17871-9d95-4fa2-887c-632a982f7b3f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.384861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a17871-9d95-4fa2-887c-632a982f7b3f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.385487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a17871-9d95-4fa2-887c-632a982f7b3f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.386086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a17871-9d95-4fa2-887c-632a982f7b3f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.515235 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-868369b8-df2f-435a-94f2-8c4619137813 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 5.430727 Oct 18 13:30:14.519952 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1667/3153] 10.222.0.40 () {62 vars in 1189 bytes} [Tue Oct 18 13:30:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 5436 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:30:14.539820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-828b3189-fc44-4117-8f94-11528c36a16c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:14.540964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-828b3189-fc44-4117-8f94-11528c36a16c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:14.551300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:14.641795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-828b3189-fc44-4117-8f94-11528c36a16c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:14.669566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-828b3189-fc44-4117-8f94-11528c36a16c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:14.675585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-828b3189-fc44-4117-8f94-11528c36a16c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:14.678155 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-828b3189-fc44-4117-8f94-11528c36a16c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1285 microversion: 2.32 time: 0.154232 Oct 18 13:30:14.686629 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1668/3154] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:14 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:14.692595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2b7caa1e-7988-4a56-b9cb-8b711297f104 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:14.696415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2b7caa1e-7988-4a56-b9cb-8b711297f104 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:14.703586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b7caa1e-7988-4a56-b9cb-8b711297f104 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.704515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b7caa1e-7988-4a56-b9cb-8b711297f104 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.705145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b7caa1e-7988-4a56-b9cb-8b711297f104 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.706200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b7caa1e-7988-4a56-b9cb-8b711297f104 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.706871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b7caa1e-7988-4a56-b9cb-8b711297f104 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.707519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b7caa1e-7988-4a56-b9cb-8b711297f104 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.711074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:14.889622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a8a17871-9d95-4fa2-887c-632a982f7b3f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:14.912110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2b7caa1e-7988-4a56-b9cb-8b711297f104 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:14.923887 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2b7caa1e-7988-4a56-b9cb-8b711297f104 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.235693 Oct 18 13:30:14.930728 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a8a17871-9d95-4fa2-887c-632a982f7b3f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.570779 Oct 18 13:30:14.933523 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1487/3155] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:14 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:14.943729 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1669/3156] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:14 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:14.944296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4247024-0cc4-4988-a3bc-328faf5dd1ed tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:14.946201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e4247024-0cc4-4988-a3bc-328faf5dd1ed tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:14.971005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4247024-0cc4-4988-a3bc-328faf5dd1ed tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.972317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4247024-0cc4-4988-a3bc-328faf5dd1ed tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.974402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4247024-0cc4-4988-a3bc-328faf5dd1ed tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:14.975949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4247024-0cc4-4988-a3bc-328faf5dd1ed tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:14.976665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4247024-0cc4-4988-a3bc-328faf5dd1ed tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:14.977761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4247024-0cc4-4988-a3bc-328faf5dd1ed tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.041111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e4247024-0cc4-4988-a3bc-328faf5dd1ed tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:30:15.256537 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e4247024-0cc4-4988-a3bc-328faf5dd1ed tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 204 len: 0 microversion: 2.1 time: 0.321121 Oct 18 13:30:15.258201 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1488/3157] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:14 2022] DELETE /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:30:15.270201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c635ed88-e5e3-4ba4-a132-f0d64bf57d7a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:15.271665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c635ed88-e5e3-4ba4-a132-f0d64bf57d7a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:15.282045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c635ed88-e5e3-4ba4-a132-f0d64bf57d7a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.282769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c635ed88-e5e3-4ba4-a132-f0d64bf57d7a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.283085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c635ed88-e5e3-4ba4-a132-f0d64bf57d7a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.284205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c635ed88-e5e3-4ba4-a132-f0d64bf57d7a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.284911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c635ed88-e5e3-4ba4-a132-f0d64bf57d7a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.287084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c635ed88-e5e3-4ba4-a132-f0d64bf57d7a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.386107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ec9b88b8-5354-426d-9473-5f14856d2a56 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:15.386827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ec9b88b8-5354-426d-9473-5f14856d2a56 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:15.400992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec9b88b8-5354-426d-9473-5f14856d2a56 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.402931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec9b88b8-5354-426d-9473-5f14856d2a56 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.403404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec9b88b8-5354-426d-9473-5f14856d2a56 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.406362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec9b88b8-5354-426d-9473-5f14856d2a56 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.406853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec9b88b8-5354-426d-9473-5f14856d2a56 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.407297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec9b88b8-5354-426d-9473-5f14856d2a56 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.561836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ec9b88b8-5354-426d-9473-5f14856d2a56 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:15.566411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c635ed88-e5e3-4ba4-a132-f0d64bf57d7a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:15.579306 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c635ed88-e5e3-4ba4-a132-f0d64bf57d7a tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1484 microversion: 2.1 time: 0.315048 Oct 18 13:30:15.580418 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1670/3158] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:15 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1484 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:15.591939 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ec9b88b8-5354-426d-9473-5f14856d2a56 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1274 microversion: 2.1 time: 0.210644 Oct 18 13:30:15.605334 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1489/3159] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:15 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:15.720822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bbd28ea4-c2f9-4289-b512-d54c4a5e4f0d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:15.725009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bbd28ea4-c2f9-4289-b512-d54c4a5e4f0d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:15.897137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bbd28ea4-c2f9-4289-b512-d54c4a5e4f0d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:15.921486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bbd28ea4-c2f9-4289-b512-d54c4a5e4f0d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:15.926112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bbd28ea4-c2f9-4289-b512-d54c4a5e4f0d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:15.930693 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bbd28ea4-c2f9-4289-b512-d54c4a5e4f0d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1285 microversion: 2.32 time: 0.220575 Oct 18 13:30:15.937658 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1671/3160] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:15 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:15.964285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ab21b841-50b4-41b7-8cdb-82c81bf95b10 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:15.965570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ab21b841-50b4-41b7-8cdb-82c81bf95b10 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:15.981740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3ed751df-0609-45d0-bc13-02972a450f55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:15.987773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab21b841-50b4-41b7-8cdb-82c81bf95b10 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.992097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3ed751df-0609-45d0-bc13-02972a450f55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:15.993061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab21b841-50b4-41b7-8cdb-82c81bf95b10 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.995300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab21b841-50b4-41b7-8cdb-82c81bf95b10 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:15.998209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab21b841-50b4-41b7-8cdb-82c81bf95b10 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:15.998701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab21b841-50b4-41b7-8cdb-82c81bf95b10 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:15.999180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab21b841-50b4-41b7-8cdb-82c81bf95b10 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.017586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ed751df-0609-45d0-bc13-02972a450f55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.020911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ed751df-0609-45d0-bc13-02972a450f55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.023118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ed751df-0609-45d0-bc13-02972a450f55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.025508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ed751df-0609-45d0-bc13-02972a450f55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.027662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ed751df-0609-45d0-bc13-02972a450f55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.030156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ed751df-0609-45d0-bc13-02972a450f55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.452289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ed751df-0609-45d0-bc13-02972a450f55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:16.468847 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3ed751df-0609-45d0-bc13-02972a450f55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.499512 Oct 18 13:30:16.486611 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1672/3161] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:15 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:16.522645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ab21b841-50b4-41b7-8cdb-82c81bf95b10 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:16.546303 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ab21b841-50b4-41b7-8cdb-82c81bf95b10 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.594352 Oct 18 13:30:16.552128 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1490/3162] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:15 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:16.604605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c419809d-19d4-4285-b2e6-6b9935795ab5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:16.605892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c419809d-19d4-4285-b2e6-6b9935795ab5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:16.623274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-69bad1a6-961c-4e3d-b985-2d4eccdfa884 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:16.623931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-69bad1a6-961c-4e3d-b985-2d4eccdfa884 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:16.627256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c419809d-19d4-4285-b2e6-6b9935795ab5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.628092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c419809d-19d4-4285-b2e6-6b9935795ab5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.629443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c419809d-19d4-4285-b2e6-6b9935795ab5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.631589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c419809d-19d4-4285-b2e6-6b9935795ab5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.633885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c419809d-19d4-4285-b2e6-6b9935795ab5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.634839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c419809d-19d4-4285-b2e6-6b9935795ab5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.641271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69bad1a6-961c-4e3d-b985-2d4eccdfa884 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.641803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69bad1a6-961c-4e3d-b985-2d4eccdfa884 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.645489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69bad1a6-961c-4e3d-b985-2d4eccdfa884 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:16.646397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69bad1a6-961c-4e3d-b985-2d4eccdfa884 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:16.646882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69bad1a6-961c-4e3d-b985-2d4eccdfa884 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:16.647378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69bad1a6-961c-4e3d-b985-2d4eccdfa884 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:17.002506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c419809d-19d4-4285-b2e6-6b9935795ab5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:17.011207 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c419809d-19d4-4285-b2e6-6b9935795ab5 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1484 microversion: 2.1 time: 0.411158 Oct 18 13:30:17.018472 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1673/3163] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:16 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1484 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:17.133424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-69bad1a6-961c-4e3d-b985-2d4eccdfa884 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:17.151837 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-69bad1a6-961c-4e3d-b985-2d4eccdfa884 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1316 microversion: 2.1 time: 0.532990 Oct 18 13:30:17.174491 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1491/3164] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:16 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:17.180606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c779726e-628a-4708-900f-a757e052afeb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:17.193289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c779726e-628a-4708-900f-a757e052afeb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:17.209337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c779726e-628a-4708-900f-a757e052afeb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:17.209809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c779726e-628a-4708-900f-a757e052afeb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:17.210255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c779726e-628a-4708-900f-a757e052afeb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:17.210975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c779726e-628a-4708-900f-a757e052afeb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:17.223610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c779726e-628a-4708-900f-a757e052afeb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:17.225665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c779726e-628a-4708-900f-a757e052afeb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:17.320146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-921133fa-b638-4754-8956-aa261a5c2a83 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] Action: 'create', calling method: .version_select at 0x7ff617a85ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1053731819", "metadata": {"Type": "work"}}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:17.446011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c779726e-628a-4708-900f-a757e052afeb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:17.462884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c779726e-628a-4708-900f-a757e052afeb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:17.475096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c779726e-628a-4708-900f-a757e052afeb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:17.476572 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c779726e-628a-4708-900f-a757e052afeb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1575 microversion: 2.32 time: 0.300783 Oct 18 13:30:17.479262 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1492/3165] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:17 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1575 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:17.484602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-4d85142a-90b4-45a5-94ee-d190cb04407a req-fa9c7c05-b2f1-436b-8b76-ae276a51d9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0797de-276a-489b-aab7-16391ac1d0d3", "name": "network-vif-deleted", "tag": "e9a57904-7800-46a5-9a77-79c987e77696"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:17.510602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4d85142a-90b4-45a5-94ee-d190cb04407a req-fa9c7c05-b2f1-436b-8b76-ae276a51d9f1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:17.512649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4d85142a-90b4-45a5-94ee-d190cb04407a req-fa9c7c05-b2f1-436b-8b76-ae276a51d9f1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:17.515267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4d85142a-90b4-45a5-94ee-d190cb04407a req-fa9c7c05-b2f1-436b-8b76-ae276a51d9f1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:17.550861 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4d85142a-90b4-45a5-94ee-d190cb04407a req-fa9c7c05-b2f1-436b-8b76-ae276a51d9f1 service nova] Creating event network-vif-deleted:e9a57904-7800-46a5-9a77-79c987e77696 for instance 3a0797de-276a-489b-aab7-16391ac1d0d3 on n-h1-858384-13 Oct 18 13:30:17.564812 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-4d85142a-90b4-45a5-94ee-d190cb04407a req-fa9c7c05-b2f1-436b-8b76-ae276a51d9f1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084038 Oct 18 13:30:17.566180 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1493/3166] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:17.578706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-621af3d3-93d8-4efe-bbda-f9a0c5d6285e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:17.579851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-621af3d3-93d8-4efe-bbda-f9a0c5d6285e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:17.587647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-621af3d3-93d8-4efe-bbda-f9a0c5d6285e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:17.588551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-621af3d3-93d8-4efe-bbda-f9a0c5d6285e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:17.590134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-621af3d3-93d8-4efe-bbda-f9a0c5d6285e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:17.591802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-621af3d3-93d8-4efe-bbda-f9a0c5d6285e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:17.600400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-621af3d3-93d8-4efe-bbda-f9a0c5d6285e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:17.601054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-621af3d3-93d8-4efe-bbda-f9a0c5d6285e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.080130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-621af3d3-93d8-4efe-bbda-f9a0c5d6285e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:18.094890 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-621af3d3-93d8-4efe-bbda-f9a0c5d6285e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.524122 Oct 18 13:30:18.096682 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1494/3167] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:17 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:18.117346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4ab1cb93-9f41-41c4-b2eb-3744a5614f3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:18.118333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4ab1cb93-9f41-41c4-b2eb-3744a5614f3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:18.135612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ab1cb93-9f41-41c4-b2eb-3744a5614f3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.142319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ab1cb93-9f41-41c4-b2eb-3744a5614f3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.146094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ab1cb93-9f41-41c4-b2eb-3744a5614f3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.148375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ab1cb93-9f41-41c4-b2eb-3744a5614f3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.152264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ab1cb93-9f41-41c4-b2eb-3744a5614f3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.153114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ab1cb93-9f41-41c4-b2eb-3744a5614f3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.194872 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-921133fa-b638-4754-8956-aa261a5c2a83 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.174971 Oct 18 13:30:18.195575 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1674/3168] 10.222.0.40 () {60 vars in 1156 bytes} [Tue Oct 18 13:30:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1176 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 18 13:30:18.203997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:18.209153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:18.232281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.236640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.237127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.239664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.243224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.243927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.336047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.337909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.338437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.338944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lazy-loading 'fault' on Instance uuid 3a0797de-276a-489b-aab7-16391ac1d0d3 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:18.437609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:18.453075 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-60945fdb-f2e6-4928-9910-325dc4152e19 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 200 len: 1300 microversion: 2.1 time: 0.256210 Oct 18 13:30:18.456460 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1675/3169] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:18 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 1300 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:18.480649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2fb5e7e4-8f98-480d-9ed9-426b4bd3bfeb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:18.481658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2fb5e7e4-8f98-480d-9ed9-426b4bd3bfeb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:18.489925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb5e7e4-8f98-480d-9ed9-426b4bd3bfeb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.495195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb5e7e4-8f98-480d-9ed9-426b4bd3bfeb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.496027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb5e7e4-8f98-480d-9ed9-426b4bd3bfeb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.496953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb5e7e4-8f98-480d-9ed9-426b4bd3bfeb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:18.497619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb5e7e4-8f98-480d-9ed9-426b4bd3bfeb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:18.498217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb5e7e4-8f98-480d-9ed9-426b4bd3bfeb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:18.835112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4ab1cb93-9f41-41c4-b2eb-3744a5614f3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:18.851973 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4ab1cb93-9f41-41c4-b2eb-3744a5614f3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.754158 Oct 18 13:30:18.858392 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1495/3170] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:18 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:18.877553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8e2acec3-3312-4514-a091-ea080a151576 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] Calling method '.version_select at 0x7ff60f73b550>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:18.981000 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8e2acec3-3312-4514-a091-ea080a151576 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78" status: 200 len: 353 microversion: 2.1 time: 0.120533 Oct 18 13:30:18.982015 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1496/3171] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:30:18 2022] GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:18.999620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-80b08a12-ecc0-4f86-8455-40f83f4b0b75 req-ca778cc4-c3e0-4a11-916d-4d2aa3bfa9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae5cdbf3-dba0-4cf3-b231-c458ab89246a", "tag": "feb49e88-b71e-48f2-932c-682c80b73e9e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:19.000127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2fb5e7e4-8f98-480d-9ed9-426b4bd3bfeb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:19.015412 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2fb5e7e4-8f98-480d-9ed9-426b4bd3bfeb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1316 microversion: 2.1 time: 0.557704 Oct 18 13:30:19.020577 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1676/3172] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:18 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:19.026724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-86164fc6-dc0b-452f-8a1a-9f42f05e6e94 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:19.027606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-86164fc6-dc0b-452f-8a1a-9f42f05e6e94 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:19.037408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-80b08a12-ecc0-4f86-8455-40f83f4b0b75 req-ca778cc4-c3e0-4a11-916d-4d2aa3bfa9c3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.038028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-80b08a12-ecc0-4f86-8455-40f83f4b0b75 req-ca778cc4-c3e0-4a11-916d-4d2aa3bfa9c3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.038545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86164fc6-dc0b-452f-8a1a-9f42f05e6e94 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.038675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-80b08a12-ecc0-4f86-8455-40f83f4b0b75 req-ca778cc4-c3e0-4a11-916d-4d2aa3bfa9c3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.045907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86164fc6-dc0b-452f-8a1a-9f42f05e6e94 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.048290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86164fc6-dc0b-452f-8a1a-9f42f05e6e94 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.049231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86164fc6-dc0b-452f-8a1a-9f42f05e6e94 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.049879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86164fc6-dc0b-452f-8a1a-9f42f05e6e94 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.051036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86164fc6-dc0b-452f-8a1a-9f42f05e6e94 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.068740 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-80b08a12-ecc0-4f86-8455-40f83f4b0b75 req-ca778cc4-c3e0-4a11-916d-4d2aa3bfa9c3 service nova] Creating event network-changed:feb49e88-b71e-48f2-932c-682c80b73e9e for instance ae5cdbf3-dba0-4cf3-b231-c458ab89246a on n-h2-858384-13 Oct 18 13:30:19.081028 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-80b08a12-ecc0-4f86-8455-40f83f4b0b75 req-ca778cc4-c3e0-4a11-916d-4d2aa3bfa9c3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086987 Oct 18 13:30:19.084414 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1497/3173] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:19.121350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-71b13504-039f-4c03-9a23-8f20137a6b00 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:19.122309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-71b13504-039f-4c03-9a23-8f20137a6b00 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:19.136298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71b13504-039f-4c03-9a23-8f20137a6b00 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.139117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71b13504-039f-4c03-9a23-8f20137a6b00 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.141887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71b13504-039f-4c03-9a23-8f20137a6b00 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.146641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71b13504-039f-4c03-9a23-8f20137a6b00 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.148390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71b13504-039f-4c03-9a23-8f20137a6b00 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.149481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71b13504-039f-4c03-9a23-8f20137a6b00 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.172447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-86164fc6-dc0b-452f-8a1a-9f42f05e6e94 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:19.185407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-86164fc6-dc0b-452f-8a1a-9f42f05e6e94 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:19.192748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:19.198398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-86164fc6-dc0b-452f-8a1a-9f42f05e6e94 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:19.202380 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-86164fc6-dc0b-452f-8a1a-9f42f05e6e94 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1593 microversion: 2.32 time: 0.180109 Oct 18 13:30:19.208485 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1677/3174] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:19 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1593 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:19.493471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e43af4a7-56f7-422a-aefe-116e2025c287 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:19.494737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e43af4a7-56f7-422a-aefe-116e2025c287 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 3a0797de-276a-489b-aab7-16391ac1d0d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:19.513026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e43af4a7-56f7-422a-aefe-116e2025c287 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.513809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e43af4a7-56f7-422a-aefe-116e2025c287 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.514268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e43af4a7-56f7-422a-aefe-116e2025c287 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.515022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e43af4a7-56f7-422a-aefe-116e2025c287 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.515487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e43af4a7-56f7-422a-aefe-116e2025c287 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.515922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e43af4a7-56f7-422a-aefe-116e2025c287 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.537338 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-e43af4a7-56f7-422a-aefe-116e2025c287 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] HTTP exception thrown: Instance 3a0797de-276a-489b-aab7-16391ac1d0d3 could not be found. Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e43af4a7-56f7-422a-aefe-116e2025c287 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Request method failure captured: Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 HTTP/1.1 Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqh3-Bo1lQthpoqW1ytyGHX_iWOryv_Newpq73Q_9g-reuRzQLMu5eC9rE6MXgoMKHMjnL1WLhVH8Pvt5jOEV2r1prckoWJRDFa6cILAQ_qFeTkg16envL2slQyQV5SKOO7QFuDavquWHGMYgdxCjaDhijAc6rHYbjv12YFhBPkK7gM Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: cf7c744c508342f5947ae08743ccc6c7 Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-LiveMigrationTest-1806726401 Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf7c744c508342f5947ae08743ccc6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf7c744c508342f5947ae08743ccc6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf7c744c508342f5947ae08743ccc6c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf7c744c508342f5947ae08743ccc6c7"}]}] Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-LiveMigrationTest-1806726401 Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: cf7c744c508342f5947ae08743ccc6c7 Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-LiveMigrationTest-1806726401 Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-LiveMigrationTest-1806726401-project Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 2b3d9555419845cc9bc9f650e676d776 Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-LiveMigrationTest-1806726401-project Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 3a0797de-276a-489b-aab7-16391ac1d0d3 could not be found. Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '3a0797de-276a-489b-aab7-16391ac1d0d3'} Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0797de-276a-489b-aab7-16391ac1d0d3 could not be found. Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0797de-276a-489b-aab7-16391ac1d0d3 could not be found. Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:19.541725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:19.546248 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:19.546248 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:19.546248 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:19.546248 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:19.546248 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:19.546248 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0797de-276a-489b-aab7-16391ac1d0d3 could not be found. Oct 18 13:30:19.546248 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:19.546248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e43af4a7-56f7-422a-aefe-116e2025c287 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Returning 404 to user: Instance 3a0797de-276a-489b-aab7-16391ac1d0d3 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:19.546248 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e43af4a7-56f7-422a-aefe-116e2025c287 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3" status: 404 len: 111 microversion: 2.1 time: 0.064332 Oct 18 13:30:19.546248 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1678/3175] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:19 2022] GET /compute/v2.1/servers/3a0797de-276a-489b-aab7-16391ac1d0d3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:19.560445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-46ef18ab-b555-4c12-bc72-5b9007765df6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:19.564103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-46ef18ab-b555-4c12-bc72-5b9007765df6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:19.579558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46ef18ab-b555-4c12-bc72-5b9007765df6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.581552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46ef18ab-b555-4c12-bc72-5b9007765df6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.582989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46ef18ab-b555-4c12-bc72-5b9007765df6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.586030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46ef18ab-b555-4c12-bc72-5b9007765df6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.586710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46ef18ab-b555-4c12-bc72-5b9007765df6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.587710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46ef18ab-b555-4c12-bc72-5b9007765df6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.643578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-71b13504-039f-4c03-9a23-8f20137a6b00 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:19.657049 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-71b13504-039f-4c03-9a23-8f20137a6b00 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.539676 Oct 18 13:30:19.671690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-46ef18ab-b555-4c12-bc72-5b9007765df6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:30:19.694339 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1498/3176] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:19 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:19.866635 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-46ef18ab-b555-4c12-bc72-5b9007765df6 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "DELETE /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 204 len: 0 microversion: 2.1 time: 0.315790 Oct 18 13:30:19.873035 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1679/3177] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:19 2022] DELETE /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:30:19.882111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cedd8445-946d-4a52-9f5b-fdebc00aaf60 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:19.882764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cedd8445-946d-4a52-9f5b-fdebc00aaf60 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:19.884638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5a135147-2a9a-4334-8e03-8a1c91703b85 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:19.885684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5a135147-2a9a-4334-8e03-8a1c91703b85 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:19.893404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a135147-2a9a-4334-8e03-8a1c91703b85 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.894220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a135147-2a9a-4334-8e03-8a1c91703b85 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.894556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cedd8445-946d-4a52-9f5b-fdebc00aaf60 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.895193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a135147-2a9a-4334-8e03-8a1c91703b85 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.895920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cedd8445-946d-4a52-9f5b-fdebc00aaf60 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.896373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cedd8445-946d-4a52-9f5b-fdebc00aaf60 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.896745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a135147-2a9a-4334-8e03-8a1c91703b85 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.897079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cedd8445-946d-4a52-9f5b-fdebc00aaf60 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:19.897577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cedd8445-946d-4a52-9f5b-fdebc00aaf60 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.897823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a135147-2a9a-4334-8e03-8a1c91703b85 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:19.897997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cedd8445-946d-4a52-9f5b-fdebc00aaf60 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:19.898512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a135147-2a9a-4334-8e03-8a1c91703b85 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:20.107983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cedd8445-946d-4a52-9f5b-fdebc00aaf60 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:20.121306 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cedd8445-946d-4a52-9f5b-fdebc00aaf60 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1500 microversion: 2.1 time: 0.243987 Oct 18 13:30:20.122647 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1499/3178] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:19 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1500 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:20.136803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3a0aba09-4549-4099-bf50-4d91aa873278 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] Calling method '.version_select at 0x7ff60ecf6b80>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:20.286924 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3a0aba09-4549-4099-bf50-4d91aa873278 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78" status: 200 len: 354 microversion: 2.1 time: 0.163035 Oct 18 13:30:20.289170 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1500/3179] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:30:20 2022] GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 => generated 354 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:20.301659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-30727e0b-7d28-40d4-a0e1-35348cead056 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:20.302584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-30727e0b-7d28-40d4-a0e1-35348cead056 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:20.313266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5a135147-2a9a-4334-8e03-8a1c91703b85 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:20.319160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30727e0b-7d28-40d4-a0e1-35348cead056 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:20.321643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30727e0b-7d28-40d4-a0e1-35348cead056 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:20.322285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30727e0b-7d28-40d4-a0e1-35348cead056 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:20.325987 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5a135147-2a9a-4334-8e03-8a1c91703b85 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.447961 Oct 18 13:30:20.326592 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1680/3180] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:19 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:20.327304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30727e0b-7d28-40d4-a0e1-35348cead056 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:20.328276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30727e0b-7d28-40d4-a0e1-35348cead056 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:20.329002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30727e0b-7d28-40d4-a0e1-35348cead056 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:20.333470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d08c946a-894a-480e-99be-022a9b694d16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:20.334111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d08c946a-894a-480e-99be-022a9b694d16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:20.352909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d08c946a-894a-480e-99be-022a9b694d16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:20.353501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d08c946a-894a-480e-99be-022a9b694d16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:20.353991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d08c946a-894a-480e-99be-022a9b694d16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:20.354747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d08c946a-894a-480e-99be-022a9b694d16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:20.355252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d08c946a-894a-480e-99be-022a9b694d16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:20.355678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d08c946a-894a-480e-99be-022a9b694d16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:20.570547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-30727e0b-7d28-40d4-a0e1-35348cead056 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:20.580398 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-30727e0b-7d28-40d4-a0e1-35348cead056 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1316 microversion: 2.1 time: 0.289633 Oct 18 13:30:20.595467 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1501/3181] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:20 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:20.601548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e77d1793-0cfe-4b97-b5d5-021167cf5995 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] Calling method '.version_select at 0x7ff60f693b80>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:20.671734 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e77d1793-0cfe-4b97-b5d5-021167cf5995 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78" status: 200 len: 354 microversion: 2.1 time: 0.074779 Oct 18 13:30:20.672848 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1502/3182] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:30:20 2022] GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:20.689028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a7a19404-cc80-4b09-8f54-c2ce95087c95 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] Calling method '.version_select at 0x7ff60f727a60>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:20.709082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d08c946a-894a-480e-99be-022a9b694d16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:20.726567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d08c946a-894a-480e-99be-022a9b694d16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:20.729204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d08c946a-894a-480e-99be-022a9b694d16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:20.732285 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d08c946a-894a-480e-99be-022a9b694d16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1661 microversion: 2.32 time: 0.404645 Oct 18 13:30:20.735272 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1681/3183] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:20 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1661 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:20.801036 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a7a19404-cc80-4b09-8f54-c2ce95087c95 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78" status: 202 len: 0 microversion: 2.1 time: 0.117407 Oct 18 13:30:20.803187 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1503/3184] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:30:20 2022] DELETE /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:30:20.812361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-85ccb9c0-d629-4ea2-a6ff-9ac7cfff0dee tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] Calling method '.version_select at 0x7ff60f7a8160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:20.937665 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-85ccb9c0-d629-4ea2-a6ff-9ac7cfff0dee tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78" status: 200 len: 353 microversion: 2.1 time: 0.129686 Oct 18 13:30:20.938325 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1504/3185] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:30:20 2022] GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:21.110480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-19753aec-42f3-4b50-a3c0-0afbee24aa76 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:21.111528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-19753aec-42f3-4b50-a3c0-0afbee24aa76 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:21.144769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1419b501-cd8d-43b0-a376-5b92ca2f8701 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:21.146569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1419b501-cd8d-43b0-a376-5b92ca2f8701 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:21.147027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19753aec-42f3-4b50-a3c0-0afbee24aa76 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:21.148363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19753aec-42f3-4b50-a3c0-0afbee24aa76 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:21.150770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19753aec-42f3-4b50-a3c0-0afbee24aa76 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:21.154659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19753aec-42f3-4b50-a3c0-0afbee24aa76 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:21.156972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19753aec-42f3-4b50-a3c0-0afbee24aa76 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:21.159739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19753aec-42f3-4b50-a3c0-0afbee24aa76 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:21.169776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1419b501-cd8d-43b0-a376-5b92ca2f8701 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:21.170573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1419b501-cd8d-43b0-a376-5b92ca2f8701 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:21.171183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1419b501-cd8d-43b0-a376-5b92ca2f8701 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:21.172735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1419b501-cd8d-43b0-a376-5b92ca2f8701 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:21.180581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1419b501-cd8d-43b0-a376-5b92ca2f8701 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:21.181329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1419b501-cd8d-43b0-a376-5b92ca2f8701 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:21.564497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-19753aec-42f3-4b50-a3c0-0afbee24aa76 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:21.577715 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-19753aec-42f3-4b50-a3c0-0afbee24aa76 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.838880 Oct 18 13:30:21.584842 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1682/3186] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:20 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:21.596822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-edded823-84f2-48de-b72d-ca845ea64b50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:21.600767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-edded823-84f2-48de-b72d-ca845ea64b50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:21.619500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edded823-84f2-48de-b72d-ca845ea64b50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:21.625957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edded823-84f2-48de-b72d-ca845ea64b50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:21.627329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edded823-84f2-48de-b72d-ca845ea64b50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:21.631306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edded823-84f2-48de-b72d-ca845ea64b50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:21.631861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edded823-84f2-48de-b72d-ca845ea64b50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:21.635985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edded823-84f2-48de-b72d-ca845ea64b50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:22.007725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:22.376293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=8 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:22.412297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-edded823-84f2-48de-b72d-ca845ea64b50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:22.421506 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-edded823-84f2-48de-b72d-ca845ea64b50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.835222 Oct 18 13:30:22.426795 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1683/3187] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:21 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:22.438922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b42037cc-316c-4229-9151-069658b35453 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:22.439786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b42037cc-316c-4229-9151-069658b35453 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:22.454992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b42037cc-316c-4229-9151-069658b35453 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:22.461995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b42037cc-316c-4229-9151-069658b35453 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:22.462866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b42037cc-316c-4229-9151-069658b35453 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:22.463848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b42037cc-316c-4229-9151-069658b35453 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:22.464474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b42037cc-316c-4229-9151-069658b35453 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:22.465095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b42037cc-316c-4229-9151-069658b35453 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:22.667696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b42037cc-316c-4229-9151-069658b35453 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:22.680030 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b42037cc-316c-4229-9151-069658b35453 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1316 microversion: 2.1 time: 0.251592 Oct 18 13:30:22.693203 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1684/3188] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:22 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:22.693203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04ab24a7-ba95-49cd-b9eb-1fbac4a791f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:22.693203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04ab24a7-ba95-49cd-b9eb-1fbac4a791f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:22.700246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04ab24a7-ba95-49cd-b9eb-1fbac4a791f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:22.700995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04ab24a7-ba95-49cd-b9eb-1fbac4a791f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:22.701544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04ab24a7-ba95-49cd-b9eb-1fbac4a791f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:22.702309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04ab24a7-ba95-49cd-b9eb-1fbac4a791f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:22.702827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04ab24a7-ba95-49cd-b9eb-1fbac4a791f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:22.703728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04ab24a7-ba95-49cd-b9eb-1fbac4a791f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:23.002478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:23.106714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1419b501-cd8d-43b0-a376-5b92ca2f8701 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:23.116724 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1419b501-cd8d-43b0-a376-5b92ca2f8701 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1500 microversion: 2.1 time: 1.976507 Oct 18 13:30:23.118900 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1505/3189] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:21 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1500 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:23.125531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cac41c7f-3257-4006-ac16-1fb084c95b6c tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] Calling method '.version_select at 0x7ff60ecc1280>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:23.182820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04ab24a7-ba95-49cd-b9eb-1fbac4a791f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:23.203897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04ab24a7-ba95-49cd-b9eb-1fbac4a791f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:23.205410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04ab24a7-ba95-49cd-b9eb-1fbac4a791f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:23.206620 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04ab24a7-ba95-49cd-b9eb-1fbac4a791f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1708 microversion: 2.32 time: 0.522588 Oct 18 13:30:23.229199 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1685/3190] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:22 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1708 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:23.248760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-72394652-5d92-400c-8ef2-d5a34f226437 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:23.267869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-72394652-5d92-400c-8ef2-d5a34f226437 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:23.276512 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cac41c7f-3257-4006-ac16-1fb084c95b6c tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78" status: 200 len: 353 microversion: 2.1 time: 0.155816 Oct 18 13:30:23.277109 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1506/3191] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:30:23 2022] GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:23.296539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72394652-5d92-400c-8ef2-d5a34f226437 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:23.302395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72394652-5d92-400c-8ef2-d5a34f226437 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:23.304014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72394652-5d92-400c-8ef2-d5a34f226437 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:23.304890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72394652-5d92-400c-8ef2-d5a34f226437 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:23.307852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72394652-5d92-400c-8ef2-d5a34f226437 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:23.314344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72394652-5d92-400c-8ef2-d5a34f226437 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:23.327109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-741584b5-8575-4cf3-942d-3df10ab15b61 req-85eb0dd7-9d79-49c7-933f-3b3e414a168d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f29db8-d1db-4c86-b2a2-aa699fa80532", "name": "network-vif-deleted", "tag": "a6e78562-1d84-4cfc-b01a-bfe734a39542"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:23.382592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-741584b5-8575-4cf3-942d-3df10ab15b61 req-85eb0dd7-9d79-49c7-933f-3b3e414a168d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:23.385206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-741584b5-8575-4cf3-942d-3df10ab15b61 req-85eb0dd7-9d79-49c7-933f-3b3e414a168d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:23.385683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-741584b5-8575-4cf3-942d-3df10ab15b61 req-85eb0dd7-9d79-49c7-933f-3b3e414a168d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:23.435901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:23.443761 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-741584b5-8575-4cf3-942d-3df10ab15b61 req-85eb0dd7-9d79-49c7-933f-3b3e414a168d service nova] Creating event network-vif-deleted:a6e78562-1d84-4cfc-b01a-bfe734a39542 for instance 80f29db8-d1db-4c86-b2a2-aa699fa80532 on n-h2-858384-13 Oct 18 13:30:23.479202 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-741584b5-8575-4cf3-942d-3df10ab15b61 req-85eb0dd7-9d79-49c7-933f-3b3e414a168d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156407 Oct 18 13:30:23.486969 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1507/3192] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:30:23.519122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f33185bd-91c8-4db2-86d1-7e12ab291d4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:23.523934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f33185bd-91c8-4db2-86d1-7e12ab291d4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:23.554893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33185bd-91c8-4db2-86d1-7e12ab291d4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:23.555876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33185bd-91c8-4db2-86d1-7e12ab291d4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:23.563083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33185bd-91c8-4db2-86d1-7e12ab291d4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:23.564528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33185bd-91c8-4db2-86d1-7e12ab291d4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:23.564974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33185bd-91c8-4db2-86d1-7e12ab291d4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:23.569961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33185bd-91c8-4db2-86d1-7e12ab291d4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:23.976911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-72394652-5d92-400c-8ef2-d5a34f226437 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:23.989215 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-72394652-5d92-400c-8ef2-d5a34f226437 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.758125 Oct 18 13:30:23.993837 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1686/3193] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:23 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:24.004743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-30317319-08fc-4da3-8ac9-130461953f41 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:24.017746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-30317319-08fc-4da3-8ac9-130461953f41 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:24.046906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30317319-08fc-4da3-8ac9-130461953f41 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.047406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30317319-08fc-4da3-8ac9-130461953f41 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.047849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30317319-08fc-4da3-8ac9-130461953f41 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.048566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30317319-08fc-4da3-8ac9-130461953f41 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.049248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30317319-08fc-4da3-8ac9-130461953f41 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.049747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30317319-08fc-4da3-8ac9-130461953f41 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.113534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f33185bd-91c8-4db2-86d1-7e12ab291d4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:24.124218 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f33185bd-91c8-4db2-86d1-7e12ab291d4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.633214 Oct 18 13:30:24.124830 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1508/3194] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:23 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:24.157543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:24.165544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:24.185348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.185867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.186304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.187021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.187461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.197927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.261296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.262054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.267393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.268131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lazy-loading 'fault' on Instance uuid 80f29db8-d1db-4c86-b2a2-aa699fa80532 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:24.392471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3d9555419845cc9bc9f650e676d776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7c744c508342f5947ae08743ccc6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:24.408771 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f33d5035-952e-41d6-a21f-479e34955ed8 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 200 len: 1301 microversion: 2.1 time: 0.269607 Oct 18 13:30:24.409662 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1509/3195] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:24 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 1301 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:24.462736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a3d81814-a8c4-4e55-b683-99649a0c9e0b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:24.463352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a3d81814-a8c4-4e55-b683-99649a0c9e0b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:24.474013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3d81814-a8c4-4e55-b683-99649a0c9e0b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.474161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3d81814-a8c4-4e55-b683-99649a0c9e0b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.474884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3d81814-a8c4-4e55-b683-99649a0c9e0b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.475672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3d81814-a8c4-4e55-b683-99649a0c9e0b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:24.476234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3d81814-a8c4-4e55-b683-99649a0c9e0b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:24.478624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3d81814-a8c4-4e55-b683-99649a0c9e0b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:24.782317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a3d81814-a8c4-4e55-b683-99649a0c9e0b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:24.795058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a3d81814-a8c4-4e55-b683-99649a0c9e0b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:24.797135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a3d81814-a8c4-4e55-b683-99649a0c9e0b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:24.798972 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a3d81814-a8c4-4e55-b683-99649a0c9e0b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1755 microversion: 2.32 time: 0.372872 Oct 18 13:30:24.818963 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1510/3196] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:24 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1755 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:24.825473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-635f2c79-f805-41c1-aed6-5595400c3af0 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] Calling method '.version_select at 0x7ff614312e50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:24.848324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-30317319-08fc-4da3-8ac9-130461953f41 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:24.863067 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-30317319-08fc-4da3-8ac9-130461953f41 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1316 microversion: 2.1 time: 0.865623 Oct 18 13:30:24.875627 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1687/3197] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:23 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1316 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:24.905909 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-635f2c79-f805-41c1-aed6-5595400c3af0 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78" status: 200 len: 353 microversion: 2.1 time: 0.084775 Oct 18 13:30:24.907248 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1511/3198] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:30:24 2022] GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:25.022869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ee5beff4-86b2-4f50-9d73-49266cec7225 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:25.025700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ee5beff4-86b2-4f50-9d73-49266cec7225 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:25.034054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee5beff4-86b2-4f50-9d73-49266cec7225 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.034810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee5beff4-86b2-4f50-9d73-49266cec7225 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.036086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee5beff4-86b2-4f50-9d73-49266cec7225 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.037274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee5beff4-86b2-4f50-9d73-49266cec7225 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.037893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee5beff4-86b2-4f50-9d73-49266cec7225 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.038472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee5beff4-86b2-4f50-9d73-49266cec7225 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.148567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2570c238-2d01-4412-a6de-4f93badbf76e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:25.149740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2570c238-2d01-4412-a6de-4f93badbf76e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:25.163988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2570c238-2d01-4412-a6de-4f93badbf76e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.164763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2570c238-2d01-4412-a6de-4f93badbf76e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.165516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2570c238-2d01-4412-a6de-4f93badbf76e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.169040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2570c238-2d01-4412-a6de-4f93badbf76e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.169825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2570c238-2d01-4412-a6de-4f93badbf76e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.170470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2570c238-2d01-4412-a6de-4f93badbf76e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.315662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ee5beff4-86b2-4f50-9d73-49266cec7225 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:25.328017 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ee5beff4-86b2-4f50-9d73-49266cec7225 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.313010 Oct 18 13:30:25.328629 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1688/3199] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:25 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:25.433809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04fe8206-7e26-4904-99d4-f4c0cd5127c9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:25.434833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04fe8206-7e26-4904-99d4-f4c0cd5127c9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] [instance: 80f29db8-d1db-4c86-b2a2-aa699fa80532] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:25.454190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04fe8206-7e26-4904-99d4-f4c0cd5127c9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.464623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04fe8206-7e26-4904-99d4-f4c0cd5127c9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.467923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04fe8206-7e26-4904-99d4-f4c0cd5127c9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.470296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04fe8206-7e26-4904-99d4-f4c0cd5127c9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.472540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04fe8206-7e26-4904-99d4-f4c0cd5127c9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.476674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04fe8206-7e26-4904-99d4-f4c0cd5127c9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.503888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2570c238-2d01-4412-a6de-4f93badbf76e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:25.519244 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2570c238-2d01-4412-a6de-4f93badbf76e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.375503 Oct 18 13:30:25.522784 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1512/3200] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:25 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:25.524849 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-04fe8206-7e26-4904-99d4-f4c0cd5127c9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] HTTP exception thrown: Instance 80f29db8-d1db-4c86-b2a2-aa699fa80532 could not be found. Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04fe8206-7e26-4904-99d4-f4c0cd5127c9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Request method failure captured: Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 HTTP/1.1 Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqh3-Bo1lQthpoqW1ytyGHX_iWOryv_Newpq73Q_9g-reuRzQLMu5eC9rE6MXgoMKHMjnL1WLhVH8Pvt5jOEV2r1prckoWJRDFa6cILAQ_qFeTkg16envL2slQyQV5SKOO7QFuDavquWHGMYgdxCjaDhijAc6rHYbjv12YFhBPkK7gM Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: cf7c744c508342f5947ae08743ccc6c7 Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-LiveMigrationTest-1806726401 Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf7c744c508342f5947ae08743ccc6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf7c744c508342f5947ae08743ccc6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf7c744c508342f5947ae08743ccc6c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf7c744c508342f5947ae08743ccc6c7"}]}] Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-LiveMigrationTest-1806726401 Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: cf7c744c508342f5947ae08743ccc6c7 Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-LiveMigrationTest-1806726401 Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-LiveMigrationTest-1806726401-project Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 2b3d9555419845cc9bc9f650e676d776 Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-LiveMigrationTest-1806726401-project Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 80f29db8-d1db-4c86-b2a2-aa699fa80532 could not be found. Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '80f29db8-d1db-4c86-b2a2-aa699fa80532'} Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f29db8-d1db-4c86-b2a2-aa699fa80532 could not be found. Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f29db8-d1db-4c86-b2a2-aa699fa80532 could not be found. Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:25.528376 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:25.532277 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:25.532277 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:25.532277 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:25.532277 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:25.532277 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:25.532277 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f29db8-d1db-4c86-b2a2-aa699fa80532 could not be found. Oct 18 13:30:25.532277 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:25.532277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04fe8206-7e26-4904-99d4-f4c0cd5127c9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] Returning 404 to user: Instance 80f29db8-d1db-4c86-b2a2-aa699fa80532 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:25.537145 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04fe8206-7e26-4904-99d4-f4c0cd5127c9 tempest-LiveMigrationTest-1806726401 tempest-LiveMigrationTest-1806726401-project] 10.222.0.40 "GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532" status: 404 len: 111 microversion: 2.1 time: 0.108336 Oct 18 13:30:25.541079 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1689/3201] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:25 2022] GET /compute/v2.1/servers/80f29db8-d1db-4c86-b2a2-aa699fa80532 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:25.723754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-649e2494-7463-4546-81db-c754bce0d014 req-68652d03-6b67-4013-bd0f-79c073402180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5cdbf3-dba0-4cf3-b231-c458ab89246a", "name": "network-vif-plugged", "status": "completed", "tag": "feb49e88-b71e-48f2-932c-682c80b73e9e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:25.771494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-649e2494-7463-4546-81db-c754bce0d014 req-68652d03-6b67-4013-bd0f-79c073402180 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.771984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-649e2494-7463-4546-81db-c754bce0d014 req-68652d03-6b67-4013-bd0f-79c073402180 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.772418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-649e2494-7463-4546-81db-c754bce0d014 req-68652d03-6b67-4013-bd0f-79c073402180 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.806416 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-649e2494-7463-4546-81db-c754bce0d014 req-68652d03-6b67-4013-bd0f-79c073402180 service nova] Creating event network-vif-plugged:feb49e88-b71e-48f2-932c-682c80b73e9e for instance ae5cdbf3-dba0-4cf3-b231-c458ab89246a on n-h2-858384-13 Oct 18 13:30:25.831456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1af2fe7e-afe7-4076-a03b-5841c9571f02 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:25.833018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1af2fe7e-afe7-4076-a03b-5841c9571f02 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:25.843284 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-649e2494-7463-4546-81db-c754bce0d014 req-68652d03-6b67-4013-bd0f-79c073402180 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123240 Oct 18 13:30:25.846477 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1513/3202] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:25.846881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1af2fe7e-afe7-4076-a03b-5841c9571f02 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.850012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1af2fe7e-afe7-4076-a03b-5841c9571f02 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.851080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1af2fe7e-afe7-4076-a03b-5841c9571f02 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.852004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1af2fe7e-afe7-4076-a03b-5841c9571f02 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.855493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1af2fe7e-afe7-4076-a03b-5841c9571f02 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.856113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1af2fe7e-afe7-4076-a03b-5841c9571f02 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.888898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9f51138c-8b7d-498b-ad6e-24b20ad4e893 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:25.890088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9f51138c-8b7d-498b-ad6e-24b20ad4e893 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:25.908148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f51138c-8b7d-498b-ad6e-24b20ad4e893 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.908952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f51138c-8b7d-498b-ad6e-24b20ad4e893 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.909659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f51138c-8b7d-498b-ad6e-24b20ad4e893 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:25.910971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f51138c-8b7d-498b-ad6e-24b20ad4e893 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:25.911737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f51138c-8b7d-498b-ad6e-24b20ad4e893 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:25.912116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=14 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:25.914137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f51138c-8b7d-498b-ad6e-24b20ad4e893 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:26.265381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9f51138c-8b7d-498b-ad6e-24b20ad4e893 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:26.278965 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9f51138c-8b7d-498b-ad6e-24b20ad4e893 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1316 microversion: 2.1 time: 0.394440 Oct 18 13:30:26.279563 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1514/3203] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:25 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:26.295937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ff6cde42-13a4-43c9-8b5a-ddbd53238894 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] Calling method '.version_select at 0x7ff60ee4d160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:26.333882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1af2fe7e-afe7-4076-a03b-5841c9571f02 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:26.346949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1af2fe7e-afe7-4076-a03b-5841c9571f02 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:26.354237 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-ff6cde42-13a4-43c9-8b5a-ddbd53238894 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] HTTP exception thrown: Volume 8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 could not be found. Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ff6cde42-13a4-43c9-8b5a-ddbd53238894 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] Request method failure captured: Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 HTTP/1.1 Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqpo0aex8Ta4JYSrN-HM92YdvDE6cWTlYaXc5Sbvux_zKGqnCeyucz-Eb8ctB3exDopxo0QU1jOx5B7M_0hz0T-CypMxekks8qIhPSr54xRKjRNciXIl3kvhqYLSrOCX0lSQPecwKkB4bVvJa9XlYwsk-I69d8q0POUhcgediA3UciQ Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 472bfcd75cab458a9286006063a01df5 Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-VolumesGetTestJSON-733620095 Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472bfcd75cab458a9286006063a01df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/472bfcd75cab458a9286006063a01df5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/472bfcd75cab458a9286006063a01df5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_472bfcd75cab458a9286006063a01df5"}]}] Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-VolumesGetTestJSON-733620095 Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 472bfcd75cab458a9286006063a01df5 Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-VolumesGetTestJSON-733620095 Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-VolumesGetTestJSON-733620095-project Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 43965a498383449583664009d46f3352 Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-VolumesGetTestJSON-733620095-project Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: exception: Volume 8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 could not be found. Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78'} Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 could not be found. (HTTP 404) (Request-ID: req-3a627989-0f18-4ab6-9d2b-be7496253a49) Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:30:26.356623 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 could not be found. Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 could not be found. Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 could not be found. Oct 18 13:30:26.361559 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:26.370437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1af2fe7e-afe7-4076-a03b-5841c9571f02 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:26.378071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ff6cde42-13a4-43c9-8b5a-ddbd53238894 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] Returning 404 to user: Volume 8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:26.379254 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ff6cde42-13a4-43c9-8b5a-ddbd53238894 tempest-VolumesGetTestJSON-733620095 tempest-VolumesGetTestJSON-733620095-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78" status: 404 len: 109 microversion: 2.1 time: 0.087876 Oct 18 13:30:26.380373 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1515/3204] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:30:26 2022] GET /compute/v2.1/os-volumes/8fc4cd43-935a-4cc3-bf3f-e6c812ab4d78 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:26.386181 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1af2fe7e-afe7-4076-a03b-5841c9571f02 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1802 microversion: 2.32 time: 0.545397 Oct 18 13:30:26.402394 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1690/3205] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:25 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1802 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:26.406364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-697ee58a-22a2-497b-8000-5b5327a8e22d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:26.413501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-697ee58a-22a2-497b-8000-5b5327a8e22d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:26.444626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-697ee58a-22a2-497b-8000-5b5327a8e22d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:26.445870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-697ee58a-22a2-497b-8000-5b5327a8e22d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:26.446806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-697ee58a-22a2-497b-8000-5b5327a8e22d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:26.448045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-697ee58a-22a2-497b-8000-5b5327a8e22d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:26.448821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-697ee58a-22a2-497b-8000-5b5327a8e22d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:26.449681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-697ee58a-22a2-497b-8000-5b5327a8e22d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:26.543202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac58658b-b1bb-4232-ab11-bd5ea9d4ff92 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:26.543935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ac58658b-b1bb-4232-ab11-bd5ea9d4ff92 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:26.557597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac58658b-b1bb-4232-ab11-bd5ea9d4ff92 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:26.562232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac58658b-b1bb-4232-ab11-bd5ea9d4ff92 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:26.563888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac58658b-b1bb-4232-ab11-bd5ea9d4ff92 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:26.564862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac58658b-b1bb-4232-ab11-bd5ea9d4ff92 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:26.565683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac58658b-b1bb-4232-ab11-bd5ea9d4ff92 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:26.566282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac58658b-b1bb-4232-ab11-bd5ea9d4ff92 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:26.937375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ac58658b-b1bb-4232-ab11-bd5ea9d4ff92 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:26.952583 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ac58658b-b1bb-4232-ab11-bd5ea9d4ff92 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.413684 Oct 18 13:30:26.956661 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1691/3206] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:26 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:27.079577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-697ee58a-22a2-497b-8000-5b5327a8e22d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:27.088466 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-697ee58a-22a2-497b-8000-5b5327a8e22d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.706622 Oct 18 13:30:27.089690 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1516/3207] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:26 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:27.303932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a1099ced-a18d-4441-8e59-457e043ff145 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:27.304672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a1099ced-a18d-4441-8e59-457e043ff145 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:27.345579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1099ced-a18d-4441-8e59-457e043ff145 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:27.346170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1099ced-a18d-4441-8e59-457e043ff145 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:27.346437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1099ced-a18d-4441-8e59-457e043ff145 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:27.347168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1099ced-a18d-4441-8e59-457e043ff145 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:27.347679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1099ced-a18d-4441-8e59-457e043ff145 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:27.353911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1099ced-a18d-4441-8e59-457e043ff145 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:27.418788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a327a47-a110-4909-8f4b-d1ce92531d46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:27.420508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4a327a47-a110-4909-8f4b-d1ce92531d46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:27.431832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a327a47-a110-4909-8f4b-d1ce92531d46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:27.432944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a327a47-a110-4909-8f4b-d1ce92531d46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:27.433789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a327a47-a110-4909-8f4b-d1ce92531d46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:27.435065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a327a47-a110-4909-8f4b-d1ce92531d46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:27.435759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a327a47-a110-4909-8f4b-d1ce92531d46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:27.436635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a327a47-a110-4909-8f4b-d1ce92531d46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:27.564747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a1099ced-a18d-4441-8e59-457e043ff145 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:27.577511 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a1099ced-a18d-4441-8e59-457e043ff145 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1316 microversion: 2.1 time: 0.278141 Oct 18 13:30:27.578714 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1692/3208] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:27 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:27.797976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a327a47-a110-4909-8f4b-d1ce92531d46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:27.812220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a327a47-a110-4909-8f4b-d1ce92531d46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:27.818491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a327a47-a110-4909-8f4b-d1ce92531d46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:27.823243 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4a327a47-a110-4909-8f4b-d1ce92531d46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1802 microversion: 2.32 time: 0.408640 Oct 18 13:30:27.824263 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1517/3209] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:27 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1802 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:30:27.980248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f156b78d-7b34-4ce2-bb35-d15725005dcf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:27.980935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f156b78d-7b34-4ce2-bb35-d15725005dcf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:27.991238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f156b78d-7b34-4ce2-bb35-d15725005dcf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:27.992608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f156b78d-7b34-4ce2-bb35-d15725005dcf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:27.993450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f156b78d-7b34-4ce2-bb35-d15725005dcf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:27.996547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f156b78d-7b34-4ce2-bb35-d15725005dcf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:27.997069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f156b78d-7b34-4ce2-bb35-d15725005dcf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:27.998705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f156b78d-7b34-4ce2-bb35-d15725005dcf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:28.115798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3bd7f265-f292-47e1-a077-f39c328f9de1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:28.116829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3bd7f265-f292-47e1-a077-f39c328f9de1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:28.125786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3bd7f265-f292-47e1-a077-f39c328f9de1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:28.126437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3bd7f265-f292-47e1-a077-f39c328f9de1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:28.126960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3bd7f265-f292-47e1-a077-f39c328f9de1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:28.128088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3bd7f265-f292-47e1-a077-f39c328f9de1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:28.133267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3bd7f265-f292-47e1-a077-f39c328f9de1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:28.134604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3bd7f265-f292-47e1-a077-f39c328f9de1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:28.445846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f156b78d-7b34-4ce2-bb35-d15725005dcf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:28.524912 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f156b78d-7b34-4ce2-bb35-d15725005dcf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.548384 Oct 18 13:30:28.543847 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1693/3210] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:27 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:28.556132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3bd7f265-f292-47e1-a077-f39c328f9de1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:28.579583 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3bd7f265-f292-47e1-a077-f39c328f9de1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1505 microversion: 2.1 time: 0.470086 Oct 18 13:30:28.583341 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1518/3211] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:28 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:28.604625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f542bf9e-22c1-4519-be10-bd3ed5e0f995 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:28.605742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f542bf9e-22c1-4519-be10-bd3ed5e0f995 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:28.612780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f542bf9e-22c1-4519-be10-bd3ed5e0f995 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:28.615008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f542bf9e-22c1-4519-be10-bd3ed5e0f995 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:28.615671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f542bf9e-22c1-4519-be10-bd3ed5e0f995 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:28.616865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f542bf9e-22c1-4519-be10-bd3ed5e0f995 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:28.617506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f542bf9e-22c1-4519-be10-bd3ed5e0f995 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:28.618138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f542bf9e-22c1-4519-be10-bd3ed5e0f995 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:28.862796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f5d4d901-06e1-4f8f-9641-604c94765d50 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:28.863619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f5d4d901-06e1-4f8f-9641-604c94765d50 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:28.877219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5d4d901-06e1-4f8f-9641-604c94765d50 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:28.877807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5d4d901-06e1-4f8f-9641-604c94765d50 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:28.878265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5d4d901-06e1-4f8f-9641-604c94765d50 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:28.879520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5d4d901-06e1-4f8f-9641-604c94765d50 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:28.880157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5d4d901-06e1-4f8f-9641-604c94765d50 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:28.887280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5d4d901-06e1-4f8f-9641-604c94765d50 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:29.210723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f542bf9e-22c1-4519-be10-bd3ed5e0f995 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:29.222633 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f542bf9e-22c1-4519-be10-bd3ed5e0f995 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1466 microversion: 2.1 time: 0.624129 Oct 18 13:30:29.226895 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1694/3212] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:28 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1466 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:29.254924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-43743f6a-b7c8-4a16-a0e5-4d0c5ddf85d4 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:29.256328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-43743f6a-b7c8-4a16-a0e5-4d0c5ddf85d4 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:29.265398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43743f6a-b7c8-4a16-a0e5-4d0c5ddf85d4 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:29.267674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43743f6a-b7c8-4a16-a0e5-4d0c5ddf85d4 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:29.268479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43743f6a-b7c8-4a16-a0e5-4d0c5ddf85d4 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:29.271057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43743f6a-b7c8-4a16-a0e5-4d0c5ddf85d4 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:29.271700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43743f6a-b7c8-4a16-a0e5-4d0c5ddf85d4 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:29.272289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43743f6a-b7c8-4a16-a0e5-4d0c5ddf85d4 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:29.405235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f5d4d901-06e1-4f8f-9641-604c94765d50 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:29.420207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f5d4d901-06e1-4f8f-9641-604c94765d50 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:29.425784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f5d4d901-06e1-4f8f-9641-604c94765d50 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:29.428556 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f5d4d901-06e1-4f8f-9641-604c94765d50 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1849 microversion: 2.32 time: 0.575042 Oct 18 13:30:29.451516 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1519/3213] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:28 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1849 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:30:29.551039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-93244e1d-b81b-43d4-9e8f-0b4cee6a85fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:29.552718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-93244e1d-b81b-43d4-9e8f-0b4cee6a85fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:29.566941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93244e1d-b81b-43d4-9e8f-0b4cee6a85fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:29.569930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93244e1d-b81b-43d4-9e8f-0b4cee6a85fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:29.571062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93244e1d-b81b-43d4-9e8f-0b4cee6a85fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:29.574512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93244e1d-b81b-43d4-9e8f-0b4cee6a85fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:29.577015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93244e1d-b81b-43d4-9e8f-0b4cee6a85fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:29.578458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93244e1d-b81b-43d4-9e8f-0b4cee6a85fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:29.654197 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-43743f6a-b7c8-4a16-a0e5-4d0c5ddf85d4 tempest-ServersOnMultiNodesTest-1573781757 tempest-ServersOnMultiNodesTest-1573781757-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1619 microversion: 2.1 time: 0.405415 Oct 18 13:30:29.663533 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1695/3214] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:29 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1619 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:29.680519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-556291ba-e4b7-480d-b4cb-c14d9a23b23c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:29.682419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-556291ba-e4b7-480d-b4cb-c14d9a23b23c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:29.704725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-556291ba-e4b7-480d-b4cb-c14d9a23b23c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:29.705301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-556291ba-e4b7-480d-b4cb-c14d9a23b23c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:29.705752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-556291ba-e4b7-480d-b4cb-c14d9a23b23c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:29.708278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-556291ba-e4b7-480d-b4cb-c14d9a23b23c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:29.711232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-556291ba-e4b7-480d-b4cb-c14d9a23b23c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:29.714193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-556291ba-e4b7-480d-b4cb-c14d9a23b23c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:30.124740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-556291ba-e4b7-480d-b4cb-c14d9a23b23c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:30.148608 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-556291ba-e4b7-480d-b4cb-c14d9a23b23c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1505 microversion: 2.1 time: 0.481111 Oct 18 13:30:30.152392 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1696/3215] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:29 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:30.167475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f189cbff-aa61-48d3-b214-08e11006b77f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:30.168339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f189cbff-aa61-48d3-b214-08e11006b77f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:30.184657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f189cbff-aa61-48d3-b214-08e11006b77f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:30.192811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f189cbff-aa61-48d3-b214-08e11006b77f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:30.196109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f189cbff-aa61-48d3-b214-08e11006b77f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:30.197170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f189cbff-aa61-48d3-b214-08e11006b77f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:30.198092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f189cbff-aa61-48d3-b214-08e11006b77f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:30.201932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f189cbff-aa61-48d3-b214-08e11006b77f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:30.242436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-93244e1d-b81b-43d4-9e8f-0b4cee6a85fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:30.252607 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-93244e1d-b81b-43d4-9e8f-0b4cee6a85fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.706482 Oct 18 13:30:30.259755 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1520/3216] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:29 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:30.267546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-c943b899-7648-4b56-bc46-f8fa409874ed req-311f3b6a-6d44-4658-8ae4-042db359a59b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "tag": "8f544790-5930-4353-bbad-e9bb309d7d6c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:30.299991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f189cbff-aa61-48d3-b214-08e11006b77f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:30:30.304191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c943b899-7648-4b56-bc46-f8fa409874ed req-311f3b6a-6d44-4658-8ae4-042db359a59b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:30.309442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c943b899-7648-4b56-bc46-f8fa409874ed req-311f3b6a-6d44-4658-8ae4-042db359a59b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:30.311617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c943b899-7648-4b56-bc46-f8fa409874ed req-311f3b6a-6d44-4658-8ae4-042db359a59b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:30.357094 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-c943b899-7648-4b56-bc46-f8fa409874ed req-311f3b6a-6d44-4658-8ae4-042db359a59b service nova] Creating event network-changed:8f544790-5930-4353-bbad-e9bb309d7d6c for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:30:30.367067 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-c943b899-7648-4b56-bc46-f8fa409874ed req-311f3b6a-6d44-4658-8ae4-042db359a59b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105664 Oct 18 13:30:30.370091 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1521/3217] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:30.460827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b38baac2-2fa5-471d-bfba-ff9a8971fb96 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:30.462599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b38baac2-2fa5-471d-bfba-ff9a8971fb96 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:30.472719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38baac2-2fa5-471d-bfba-ff9a8971fb96 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:30.475186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38baac2-2fa5-471d-bfba-ff9a8971fb96 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:30.477465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38baac2-2fa5-471d-bfba-ff9a8971fb96 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:30.478626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38baac2-2fa5-471d-bfba-ff9a8971fb96 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:30.481703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38baac2-2fa5-471d-bfba-ff9a8971fb96 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:30.484237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38baac2-2fa5-471d-bfba-ff9a8971fb96 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:30.529903 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f189cbff-aa61-48d3-b214-08e11006b77f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 204 len: 0 microversion: 2.1 time: 0.375435 Oct 18 13:30:30.539599 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1697/3218] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:30 2022] DELETE /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:30:30.564067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-355da5e4-5f19-4d10-9341-d0244ff247b1 req-16f9474f-9ad1-46be-9786-3512f915501d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b83d20-5690-49dc-bff4-e6906a63ee23", "name": "network-vif-unplugged", "status": "completed", "tag": "e01e4d55-3474-4431-af07-7a611cccd407"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:30.591293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-355da5e4-5f19-4d10-9341-d0244ff247b1 req-16f9474f-9ad1-46be-9786-3512f915501d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:30.592501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-355da5e4-5f19-4d10-9341-d0244ff247b1 req-16f9474f-9ad1-46be-9786-3512f915501d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:30.592946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-355da5e4-5f19-4d10-9341-d0244ff247b1 req-16f9474f-9ad1-46be-9786-3512f915501d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:30.621552 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-355da5e4-5f19-4d10-9341-d0244ff247b1 req-16f9474f-9ad1-46be-9786-3512f915501d service nova] Creating event network-vif-unplugged:e01e4d55-3474-4431-af07-7a611cccd407 for instance 92b83d20-5690-49dc-bff4-e6906a63ee23 on n-h2-858384-13 Oct 18 13:30:30.634751 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-355da5e4-5f19-4d10-9341-d0244ff247b1 req-16f9474f-9ad1-46be-9786-3512f915501d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093518 Oct 18 13:30:30.645587 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1698/3219] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:30.653699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-207758b9-b8d6-4a81-a4fc-488e262cd26a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:30.656309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-207758b9-b8d6-4a81-a4fc-488e262cd26a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:30.678427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-207758b9-b8d6-4a81-a4fc-488e262cd26a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:30.679259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-207758b9-b8d6-4a81-a4fc-488e262cd26a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:30.679911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-207758b9-b8d6-4a81-a4fc-488e262cd26a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:30.681008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-207758b9-b8d6-4a81-a4fc-488e262cd26a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:30.681740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-207758b9-b8d6-4a81-a4fc-488e262cd26a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:30.682625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-207758b9-b8d6-4a81-a4fc-488e262cd26a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:31.081127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-207758b9-b8d6-4a81-a4fc-488e262cd26a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:31.094061 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-207758b9-b8d6-4a81-a4fc-488e262cd26a tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1472 microversion: 2.1 time: 0.445000 Oct 18 13:30:31.094660 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1699/3220] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:30 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:31.176175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-37d694c3-1ffc-4440-b7d7-c003031eb740 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:31.177249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-37d694c3-1ffc-4440-b7d7-c003031eb740 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:31.192675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d694c3-1ffc-4440-b7d7-c003031eb740 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:31.193858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d694c3-1ffc-4440-b7d7-c003031eb740 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:31.195560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d694c3-1ffc-4440-b7d7-c003031eb740 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:31.197700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d694c3-1ffc-4440-b7d7-c003031eb740 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:31.199289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d694c3-1ffc-4440-b7d7-c003031eb740 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:31.202095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d694c3-1ffc-4440-b7d7-c003031eb740 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:31.644965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b38baac2-2fa5-471d-bfba-ff9a8971fb96 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:31.672373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b38baac2-2fa5-471d-bfba-ff9a8971fb96 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:31.678043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b38baac2-2fa5-471d-bfba-ff9a8971fb96 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:31.680182 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b38baac2-2fa5-471d-bfba-ff9a8971fb96 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1849 microversion: 2.32 time: 1.225736 Oct 18 13:30:31.696655 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1522/3221] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:30 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1849 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:31.724690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-637662a4-6894-4e04-80a1-c117b90d9d13 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:31.727673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-637662a4-6894-4e04-80a1-c117b90d9d13 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:31.744101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-637662a4-6894-4e04-80a1-c117b90d9d13 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:31.744600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-637662a4-6894-4e04-80a1-c117b90d9d13 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:31.745040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-637662a4-6894-4e04-80a1-c117b90d9d13 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:31.745789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-637662a4-6894-4e04-80a1-c117b90d9d13 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:31.746287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-637662a4-6894-4e04-80a1-c117b90d9d13 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:31.756461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-637662a4-6894-4e04-80a1-c117b90d9d13 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:31.814005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:31.859647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-37d694c3-1ffc-4440-b7d7-c003031eb740 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:31.875198 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-37d694c3-1ffc-4440-b7d7-c003031eb740 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1505 microversion: 2.1 time: 0.704687 Oct 18 13:30:31.875792 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1700/3222] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:31 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1505 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:32.118037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b7664124-6e02-49ee-bee6-04f567c548f3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:32.118650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7664124-6e02-49ee-bee6-04f567c548f3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:32.126739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7664124-6e02-49ee-bee6-04f567c548f3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:32.132012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7664124-6e02-49ee-bee6-04f567c548f3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:32.134242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7664124-6e02-49ee-bee6-04f567c548f3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:32.136499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7664124-6e02-49ee-bee6-04f567c548f3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:32.137130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7664124-6e02-49ee-bee6-04f567c548f3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:32.138103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7664124-6e02-49ee-bee6-04f567c548f3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:32.296118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-637662a4-6894-4e04-80a1-c117b90d9d13 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:32.313561 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-637662a4-6894-4e04-80a1-c117b90d9d13 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1514 microversion: 2.1 time: 0.621525 Oct 18 13:30:32.314507 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1523/3223] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:31 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1514 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:32.589914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-17bd24bf-646e-4a23-82d5-483f0f8d7c20 req-49713d06-d439-463a-99e4-58c0122a0016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "tag": "49c418e1-353c-497f-923e-d6752ffbf9f7"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:32.621248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-17bd24bf-646e-4a23-82d5-483f0f8d7c20 req-49713d06-d439-463a-99e4-58c0122a0016 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:32.626282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-17bd24bf-646e-4a23-82d5-483f0f8d7c20 req-49713d06-d439-463a-99e4-58c0122a0016 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:32.627334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-17bd24bf-646e-4a23-82d5-483f0f8d7c20 req-49713d06-d439-463a-99e4-58c0122a0016 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:32.683147 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-17bd24bf-646e-4a23-82d5-483f0f8d7c20 req-49713d06-d439-463a-99e4-58c0122a0016 service nova] Creating event network-changed:49c418e1-353c-497f-923e-d6752ffbf9f7 for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:30:32.705910 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-17bd24bf-646e-4a23-82d5-483f0f8d7c20 req-49713d06-d439-463a-99e4-58c0122a0016 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123720 Oct 18 13:30:32.706545 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1524/3224] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:30:32.729129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e7581c0-bbd9-4c5a-9a7f-927726650780 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:32.732544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1e7581c0-bbd9-4c5a-9a7f-927726650780 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:32.751798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e7581c0-bbd9-4c5a-9a7f-927726650780 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:32.752309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e7581c0-bbd9-4c5a-9a7f-927726650780 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:32.754953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e7581c0-bbd9-4c5a-9a7f-927726650780 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:32.764044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e7581c0-bbd9-4c5a-9a7f-927726650780 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:32.773273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e7581c0-bbd9-4c5a-9a7f-927726650780 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:32.774154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e7581c0-bbd9-4c5a-9a7f-927726650780 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:32.804059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7664124-6e02-49ee-bee6-04f567c548f3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:32.840800 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b7664124-6e02-49ee-bee6-04f567c548f3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1472 microversion: 2.1 time: 0.724539 Oct 18 13:30:32.845859 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1701/3225] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:32 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1472 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:32.902952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-783d600b-4524-451b-9c24-0bcac0e2cf23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:32.904875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-783d600b-4524-451b-9c24-0bcac0e2cf23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:32.921717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-783d600b-4524-451b-9c24-0bcac0e2cf23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:32.922495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-783d600b-4524-451b-9c24-0bcac0e2cf23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:32.923296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-783d600b-4524-451b-9c24-0bcac0e2cf23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:32.927922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-783d600b-4524-451b-9c24-0bcac0e2cf23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:32.928841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-783d600b-4524-451b-9c24-0bcac0e2cf23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:32.934911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-783d600b-4524-451b-9c24-0bcac0e2cf23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:33.278033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-783d600b-4524-451b-9c24-0bcac0e2cf23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:33.288030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:33.299126 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-783d600b-4524-451b-9c24-0bcac0e2cf23 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 200 len: 1508 microversion: 2.1 time: 0.401965 Oct 18 13:30:33.300004 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1702/3226] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:32 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 1508 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:33.828812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8191023e-4b0f-4733-a223-284b05aabe19 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:33.832695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8191023e-4b0f-4733-a223-284b05aabe19 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:33.848519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8191023e-4b0f-4733-a223-284b05aabe19 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:33.849094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8191023e-4b0f-4733-a223-284b05aabe19 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:33.854875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8191023e-4b0f-4733-a223-284b05aabe19 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:33.855979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8191023e-4b0f-4733-a223-284b05aabe19 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:33.858538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8191023e-4b0f-4733-a223-284b05aabe19 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:33.859017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8191023e-4b0f-4733-a223-284b05aabe19 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:33.971883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8191023e-4b0f-4733-a223-284b05aabe19 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:30:34.050621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1e7581c0-bbd9-4c5a-9a7f-927726650780 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:34.072471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1e7581c0-bbd9-4c5a-9a7f-927726650780 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:34.084697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1e7581c0-bbd9-4c5a-9a7f-927726650780 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:34.087084 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1e7581c0-bbd9-4c5a-9a7f-927726650780 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1870 microversion: 2.32 time: 1.370839 Oct 18 13:30:34.089509 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1525/3227] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:32 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1870 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:34.100681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e757209e-282e-43da-8792-0a5baecb5597 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:34.101864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e757209e-282e-43da-8792-0a5baecb5597 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:34.143803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e757209e-282e-43da-8792-0a5baecb5597 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:34.147325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e757209e-282e-43da-8792-0a5baecb5597 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:34.150551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e757209e-282e-43da-8792-0a5baecb5597 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:34.151612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e757209e-282e-43da-8792-0a5baecb5597 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:34.152377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e757209e-282e-43da-8792-0a5baecb5597 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:34.153977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e757209e-282e-43da-8792-0a5baecb5597 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:34.256603 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8191023e-4b0f-4733-a223-284b05aabe19 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 204 len: 0 microversion: 2.42 time: 0.953734 Oct 18 13:30:34.257509 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1703/3228] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:30:33 2022] DELETE /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 0 bytes in 957 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:30:34.277328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4b109676-b1f0-40df-94c5-148fda8993ba tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:34.279749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4b109676-b1f0-40df-94c5-148fda8993ba tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:34.304352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b109676-b1f0-40df-94c5-148fda8993ba tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:34.306212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b109676-b1f0-40df-94c5-148fda8993ba tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:34.310057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b109676-b1f0-40df-94c5-148fda8993ba tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:34.311068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b109676-b1f0-40df-94c5-148fda8993ba tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:34.312167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b109676-b1f0-40df-94c5-148fda8993ba tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:34.312839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b109676-b1f0-40df-94c5-148fda8993ba tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:34.874723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b109676-b1f0-40df-94c5-148fda8993ba tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:34.896654 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4b109676-b1f0-40df-94c5-148fda8993ba tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1520 microversion: 2.1 time: 0.630917 Oct 18 13:30:34.899368 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1704/3229] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:34 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1520 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:34.924143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-575534df-a898-482d-8985-0565bcdeeab4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:34.927380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-575534df-a898-482d-8985-0565bcdeeab4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:34.946042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-575534df-a898-482d-8985-0565bcdeeab4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:34.946566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-575534df-a898-482d-8985-0565bcdeeab4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:34.948277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-575534df-a898-482d-8985-0565bcdeeab4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:34.952339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-575534df-a898-482d-8985-0565bcdeeab4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:34.954971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-575534df-a898-482d-8985-0565bcdeeab4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:34.955862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-575534df-a898-482d-8985-0565bcdeeab4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:34.958554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e757209e-282e-43da-8792-0a5baecb5597 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:34.987788 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e757209e-282e-43da-8792-0a5baecb5597 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.895908 Oct 18 13:30:34.991714 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1526/3230] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:34 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:35.003050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-dae7849d-62e9-4dd4-a1c5-da0a1f2060aa req-b2bebb0a-fc85-4355-9ac9-8dbc51c4b6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5cdbf3-dba0-4cf3-b231-c458ab89246a", "name": "network-vif-unplugged", "status": "completed", "tag": "feb49e88-b71e-48f2-932c-682c80b73e9e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:35.030101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:35.036648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-dae7849d-62e9-4dd4-a1c5-da0a1f2060aa req-b2bebb0a-fc85-4355-9ac9-8dbc51c4b6be service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:35.038879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-dae7849d-62e9-4dd4-a1c5-da0a1f2060aa req-b2bebb0a-fc85-4355-9ac9-8dbc51c4b6be service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:35.039328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-dae7849d-62e9-4dd4-a1c5-da0a1f2060aa req-b2bebb0a-fc85-4355-9ac9-8dbc51c4b6be service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:35.106816 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-dae7849d-62e9-4dd4-a1c5-da0a1f2060aa req-b2bebb0a-fc85-4355-9ac9-8dbc51c4b6be service nova] Creating event network-vif-unplugged:feb49e88-b71e-48f2-932c-682c80b73e9e for instance ae5cdbf3-dba0-4cf3-b231-c458ab89246a on n-h2-858384-13 Oct 18 13:30:35.116331 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-dae7849d-62e9-4dd4-a1c5-da0a1f2060aa req-b2bebb0a-fc85-4355-9ac9-8dbc51c4b6be service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122144 Oct 18 13:30:35.124449 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1527/3231] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:35.133352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-848acc49-7e3a-498a-9299-4377656dde03 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:35.134439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-848acc49-7e3a-498a-9299-4377656dde03 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:35.153150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-848acc49-7e3a-498a-9299-4377656dde03 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:35.154865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-848acc49-7e3a-498a-9299-4377656dde03 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:35.156094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-848acc49-7e3a-498a-9299-4377656dde03 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:35.157315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-848acc49-7e3a-498a-9299-4377656dde03 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:35.158157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-848acc49-7e3a-498a-9299-4377656dde03 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:35.159445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-848acc49-7e3a-498a-9299-4377656dde03 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:35.446916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-575534df-a898-482d-8985-0565bcdeeab4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:35.461368 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-575534df-a898-482d-8985-0565bcdeeab4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1472 microversion: 2.1 time: 0.559446 Oct 18 13:30:35.466887 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1705/3232] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:34 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1472 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:35.486138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53e1c2c6-7849-4c10-95a4-f2a6139916b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:35.487299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53e1c2c6-7849-4c10-95a4-f2a6139916b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:35.498193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53e1c2c6-7849-4c10-95a4-f2a6139916b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:35.500075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53e1c2c6-7849-4c10-95a4-f2a6139916b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:35.501921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53e1c2c6-7849-4c10-95a4-f2a6139916b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:35.505439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53e1c2c6-7849-4c10-95a4-f2a6139916b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:35.510223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53e1c2c6-7849-4c10-95a4-f2a6139916b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:35.511172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53e1c2c6-7849-4c10-95a4-f2a6139916b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:35.756684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-53e1c2c6-7849-4c10-95a4-f2a6139916b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:35.767065 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53e1c2c6-7849-4c10-95a4-f2a6139916b1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.298433 Oct 18 13:30:35.767667 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1706/3233] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:35 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:35.792906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9a6ccb5f-41dd-4300-872e-3fcf2ae7e590 req-5ccb7dce-a448-40bc-abdc-a8042d1c171e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "tag": "85bd4b91-835a-4c86-9150-32d18f92eefc"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:35.820177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:35.838777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9a6ccb5f-41dd-4300-872e-3fcf2ae7e590 req-5ccb7dce-a448-40bc-abdc-a8042d1c171e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:35.839251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9a6ccb5f-41dd-4300-872e-3fcf2ae7e590 req-5ccb7dce-a448-40bc-abdc-a8042d1c171e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:35.840022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9a6ccb5f-41dd-4300-872e-3fcf2ae7e590 req-5ccb7dce-a448-40bc-abdc-a8042d1c171e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:35.856708 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9a6ccb5f-41dd-4300-872e-3fcf2ae7e590 req-5ccb7dce-a448-40bc-abdc-a8042d1c171e service nova] Creating event network-changed:85bd4b91-835a-4c86-9150-32d18f92eefc for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:30:35.862384 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9a6ccb5f-41dd-4300-872e-3fcf2ae7e590 req-5ccb7dce-a448-40bc-abdc-a8042d1c171e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078631 Oct 18 13:30:35.863004 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1707/3234] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:35.876030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-443030b7-5394-4dde-8b8e-029e713f53a9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:35.876742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-443030b7-5394-4dde-8b8e-029e713f53a9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:35.884027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-443030b7-5394-4dde-8b8e-029e713f53a9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:35.885698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-443030b7-5394-4dde-8b8e-029e713f53a9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:35.886523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-443030b7-5394-4dde-8b8e-029e713f53a9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:35.887461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-443030b7-5394-4dde-8b8e-029e713f53a9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:35.888143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-443030b7-5394-4dde-8b8e-029e713f53a9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:35.888867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-443030b7-5394-4dde-8b8e-029e713f53a9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:36.372844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-443030b7-5394-4dde-8b8e-029e713f53a9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:36.391261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-443030b7-5394-4dde-8b8e-029e713f53a9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:36.399023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-443030b7-5394-4dde-8b8e-029e713f53a9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:36.403116 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-443030b7-5394-4dde-8b8e-029e713f53a9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1891 microversion: 2.32 time: 0.529556 Oct 18 13:30:36.403217 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1708/3235] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:35 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1891 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:36.425511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-09061b33-3cf5-4412-a2ac-d3d5df3fa496 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:36.426547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-09061b33-3cf5-4412-a2ac-d3d5df3fa496 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:36.442486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09061b33-3cf5-4412-a2ac-d3d5df3fa496 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:36.442989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09061b33-3cf5-4412-a2ac-d3d5df3fa496 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:36.443423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09061b33-3cf5-4412-a2ac-d3d5df3fa496 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:36.444137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09061b33-3cf5-4412-a2ac-d3d5df3fa496 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:36.444594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09061b33-3cf5-4412-a2ac-d3d5df3fa496 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:36.445019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09061b33-3cf5-4412-a2ac-d3d5df3fa496 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:36.476641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-848acc49-7e3a-498a-9299-4377656dde03 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:36.495500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-848acc49-7e3a-498a-9299-4377656dde03 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:36.501735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-848acc49-7e3a-498a-9299-4377656dde03 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:36.507381 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-848acc49-7e3a-498a-9299-4377656dde03 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 2956 microversion: 2.42 time: 1.380642 Oct 18 13:30:36.508443 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1528/3236] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:35 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 2956 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:36.519627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-985a8ad7-97c5-4eef-8576-de10107108e3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:36.525424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-985a8ad7-97c5-4eef-8576-de10107108e3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:36.538496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-985a8ad7-97c5-4eef-8576-de10107108e3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:36.538990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-985a8ad7-97c5-4eef-8576-de10107108e3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:36.539426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-985a8ad7-97c5-4eef-8576-de10107108e3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:36.540152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-985a8ad7-97c5-4eef-8576-de10107108e3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:36.545985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-985a8ad7-97c5-4eef-8576-de10107108e3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:36.546666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-985a8ad7-97c5-4eef-8576-de10107108e3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.076587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09061b33-3cf5-4412-a2ac-d3d5df3fa496 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:37.092141 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-09061b33-3cf5-4412-a2ac-d3d5df3fa496 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.687798 Oct 18 13:30:37.111920 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1709/3237] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:36 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:37.124168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:37.126246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:37.149593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.150376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.152139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.153375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.156057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.156697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.255682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.256192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.256644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.257094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lazy-loading 'fault' on Instance uuid ae5cdbf3-dba0-4cf3-b231-c458ab89246a {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:37.416091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-985a8ad7-97c5-4eef-8576-de10107108e3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:37.425056 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-985a8ad7-97c5-4eef-8576-de10107108e3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1520 microversion: 2.1 time: 0.915431 Oct 18 13:30:37.428283 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1529/3238] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:36 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1520 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:37.461798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ac8e0e90-98a5-4526-a480-39f11efc3693 req-ba91f037-e50e-4f63-b3b3-be1bf171b83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae5cdbf3-dba0-4cf3-b231-c458ab89246a", "name": "network-vif-deleted", "tag": "feb49e88-b71e-48f2-932c-682c80b73e9e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:37.490279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ac8e0e90-98a5-4526-a480-39f11efc3693 req-ba91f037-e50e-4f63-b3b3-be1bf171b83c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.491649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ac8e0e90-98a5-4526-a480-39f11efc3693 req-ba91f037-e50e-4f63-b3b3-be1bf171b83c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.492360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ac8e0e90-98a5-4526-a480-39f11efc3693 req-ba91f037-e50e-4f63-b3b3-be1bf171b83c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.524288 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ac8e0e90-98a5-4526-a480-39f11efc3693 req-ba91f037-e50e-4f63-b3b3-be1bf171b83c service nova] Creating event network-vif-deleted:feb49e88-b71e-48f2-932c-682c80b73e9e for instance ae5cdbf3-dba0-4cf3-b231-c458ab89246a on n-h2-858384-13 Oct 18 13:30:37.539279 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ac8e0e90-98a5-4526-a480-39f11efc3693 req-ba91f037-e50e-4f63-b3b3-be1bf171b83c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097756 Oct 18 13:30:37.542465 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1530/3239] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:37.563370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1ca1aa94-b63b-49c9-90b4-bfad7edcd7f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:37.564644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1ca1aa94-b63b-49c9-90b4-bfad7edcd7f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:37.591614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ca1aa94-b63b-49c9-90b4-bfad7edcd7f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.595895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ca1aa94-b63b-49c9-90b4-bfad7edcd7f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.598405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ca1aa94-b63b-49c9-90b4-bfad7edcd7f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:37.603027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ca1aa94-b63b-49c9-90b4-bfad7edcd7f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:37.607480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ca1aa94-b63b-49c9-90b4-bfad7edcd7f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:37.608450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ca1aa94-b63b-49c9-90b4-bfad7edcd7f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:38.181650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:38.190519 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d72b005-7856-4ae0-9978-cf5e7b0253fe tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 200 len: 1306 microversion: 2.1 time: 1.075033 Oct 18 13:30:38.193880 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1710/3240] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:37 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 1306 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:38.212519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-63be6180-44f4-4dd0-8f3f-1fad2c33434e req-b116b003-3a2b-4bc7-9ea8-793192aaa4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37db5c9f-afcd-4471-930c-d3a55a279f09", "name": "network-vif-unplugged", "status": "completed", "tag": "24869de5-2c8b-4aa0-97bf-68b16afb361f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:38.244395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-63be6180-44f4-4dd0-8f3f-1fad2c33434e req-b116b003-3a2b-4bc7-9ea8-793192aaa4b1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:38.244960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-63be6180-44f4-4dd0-8f3f-1fad2c33434e req-b116b003-3a2b-4bc7-9ea8-793192aaa4b1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:38.245471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-63be6180-44f4-4dd0-8f3f-1fad2c33434e req-b116b003-3a2b-4bc7-9ea8-793192aaa4b1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:38.274068 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-63be6180-44f4-4dd0-8f3f-1fad2c33434e req-b116b003-3a2b-4bc7-9ea8-793192aaa4b1 service nova] Creating event network-vif-unplugged:24869de5-2c8b-4aa0-97bf-68b16afb361f for instance 37db5c9f-afcd-4471-930c-d3a55a279f09 on n-h2-858384-13 Oct 18 13:30:38.283615 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-63be6180-44f4-4dd0-8f3f-1fad2c33434e req-b116b003-3a2b-4bc7-9ea8-793192aaa4b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088277 Oct 18 13:30:38.288047 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1711/3241] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:38.306026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-89bd5da3-40fb-4cc5-8745-8b161be2b87e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:38.309459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-89bd5da3-40fb-4cc5-8745-8b161be2b87e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:38.326489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89bd5da3-40fb-4cc5-8745-8b161be2b87e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:38.330070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89bd5da3-40fb-4cc5-8745-8b161be2b87e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:38.330739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89bd5da3-40fb-4cc5-8745-8b161be2b87e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:38.336323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89bd5da3-40fb-4cc5-8745-8b161be2b87e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:38.337055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89bd5da3-40fb-4cc5-8745-8b161be2b87e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:38.337709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89bd5da3-40fb-4cc5-8745-8b161be2b87e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:38.977323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-89bd5da3-40fb-4cc5-8745-8b161be2b87e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:38.991785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-89bd5da3-40fb-4cc5-8745-8b161be2b87e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:39.001961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1ca1aa94-b63b-49c9-90b4-bfad7edcd7f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:39.012586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-89bd5da3-40fb-4cc5-8745-8b161be2b87e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:39.013916 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-89bd5da3-40fb-4cc5-8745-8b161be2b87e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1891 microversion: 2.32 time: 0.724487 Oct 18 13:30:39.023595 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1712/3242] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:38 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1891 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:39.045863 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1ca1aa94-b63b-49c9-90b4-bfad7edcd7f7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 1.478473 Oct 18 13:30:39.046539 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1531/3243] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:37 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:39.054585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c3754daa-eb20-45b4-9b1f-1fc6b3f9ab0b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:39.055213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c3754daa-eb20-45b4-9b1f-1fc6b3f9ab0b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:39.061481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c1e5bfb4-b1d7-49c9-b801-1a7279290d34 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:39.063696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c1e5bfb4-b1d7-49c9-b801-1a7279290d34 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:39.074693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3754daa-eb20-45b4-9b1f-1fc6b3f9ab0b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.077326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3754daa-eb20-45b4-9b1f-1fc6b3f9ab0b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.077973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3754daa-eb20-45b4-9b1f-1fc6b3f9ab0b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.081232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3754daa-eb20-45b4-9b1f-1fc6b3f9ab0b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.090539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3754daa-eb20-45b4-9b1f-1fc6b3f9ab0b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.092764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1e5bfb4-b1d7-49c9-b801-1a7279290d34 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.093515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3754daa-eb20-45b4-9b1f-1fc6b3f9ab0b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.106042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1e5bfb4-b1d7-49c9-b801-1a7279290d34 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.106899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1e5bfb4-b1d7-49c9-b801-1a7279290d34 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.108449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1e5bfb4-b1d7-49c9-b801-1a7279290d34 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.114310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1e5bfb4-b1d7-49c9-b801-1a7279290d34 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.115062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1e5bfb4-b1d7-49c9-b801-1a7279290d34 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.684331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c3754daa-eb20-45b4-9b1f-1fc6b3f9ab0b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:39.701409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c3754daa-eb20-45b4-9b1f-1fc6b3f9ab0b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:39.714033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c3754daa-eb20-45b4-9b1f-1fc6b3f9ab0b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:39.717307 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c3754daa-eb20-45b4-9b1f-1fc6b3f9ab0b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 2956 microversion: 2.42 time: 0.676801 Oct 18 13:30:39.734840 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1713/3244] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:39 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 2956 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:39.747284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-113466ae-af85-462b-8aac-6a1011f0d2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:39.762578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-113466ae-af85-462b-8aac-6a1011f0d2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:39.764869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-113466ae-af85-462b-8aac-6a1011f0d2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:39.766708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-113466ae-af85-462b-8aac-6a1011f0d2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:39.854878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-113466ae-af85-462b-8aac-6a1011f0d2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Going to try to stop instance {{(pid=120611) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:30:39.961748 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-113466ae-af85-462b-8aac-6a1011f0d2e7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.223688 Oct 18 13:30:39.970056 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1714/3245] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:30:39 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:30:39.983765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8850b89d-e814-4291-a6b4-0809bf021c3e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:39.986140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8850b89d-e814-4291-a6b4-0809bf021c3e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: ae5cdbf3-dba0-4cf3-b231-c458ab89246a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:40.006106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8850b89d-e814-4291-a6b4-0809bf021c3e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.006886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8850b89d-e814-4291-a6b4-0809bf021c3e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.008599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8850b89d-e814-4291-a6b4-0809bf021c3e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.010771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8850b89d-e814-4291-a6b4-0809bf021c3e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.013523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8850b89d-e814-4291-a6b4-0809bf021c3e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.015558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8850b89d-e814-4291-a6b4-0809bf021c3e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.022948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c1e5bfb4-b1d7-49c9-b801-1a7279290d34 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:40.041729 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c1e5bfb4-b1d7-49c9-b801-1a7279290d34 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1520 microversion: 2.1 time: 0.994014 Oct 18 13:30:40.042333 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1532/3246] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:39 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1520 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:40.049165 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-8850b89d-e814-4291-a6b4-0809bf021c3e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] HTTP exception thrown: Instance ae5cdbf3-dba0-4cf3-b231-c458ab89246a could not be found. Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8850b89d-e814-4291-a6b4-0809bf021c3e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Request method failure captured: Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a HTTP/1.1 Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqndNLs5iysNG23-990uCB6IZiSZkcLI4gL8Qkhkx6hDM3roQSaiGw3uN57kA58uDMNrm3neXJWgNJRAid03luKpDQ1sZv_fzgili9c_3TIxftm-KkB76hk5QD3QbHyppnfRAcigbOIXHX0jEj11r1ElaYHrcV6kpFMOD216mFEzEZU Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_caf4a24f687647e4a23fbee030d4e53a"}]}] Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 2cb58ae89a06444e95eca4c886e9cc0c Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance ae5cdbf3-dba0-4cf3-b231-c458ab89246a could not be found. Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'ae5cdbf3-dba0-4cf3-b231-c458ab89246a'} Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae5cdbf3-dba0-4cf3-b231-c458ab89246a could not be found. Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae5cdbf3-dba0-4cf3-b231-c458ab89246a could not be found. Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:40.051745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:40.056531 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:40.056531 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:40.056531 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:40.056531 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:40.056531 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:40.056531 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae5cdbf3-dba0-4cf3-b231-c458ab89246a could not be found. Oct 18 13:30:40.056531 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:30:40.057055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-870184a7-11f0-494b-9854-4e0f4d4c966b req-a2732b84-af3e-44ff-beb1-bb6ae4ecc150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "tag": "d6206404-f696-46cc-a70b-84728c57e26e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:40.060223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8850b89d-e814-4291-a6b4-0809bf021c3e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Returning 404 to user: Instance ae5cdbf3-dba0-4cf3-b231-c458ab89246a could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:40.069760 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8850b89d-e814-4291-a6b4-0809bf021c3e tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a" status: 404 len: 111 microversion: 2.1 time: 0.097979 Oct 18 13:30:40.070582 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1715/3247] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:39 2022] GET /compute/v2.1/servers/ae5cdbf3-dba0-4cf3-b231-c458ab89246a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:40.078283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b2a8b1dd-6b3d-4558-b7bf-7af2fa8a9efa tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:40.082123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b2a8b1dd-6b3d-4558-b7bf-7af2fa8a9efa tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:40.094947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-870184a7-11f0-494b-9854-4e0f4d4c966b req-a2732b84-af3e-44ff-beb1-bb6ae4ecc150 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.095654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-870184a7-11f0-494b-9854-4e0f4d4c966b req-a2732b84-af3e-44ff-beb1-bb6ae4ecc150 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.096859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-870184a7-11f0-494b-9854-4e0f4d4c966b req-a2732b84-af3e-44ff-beb1-bb6ae4ecc150 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.125736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2a8b1dd-6b3d-4558-b7bf-7af2fa8a9efa tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.126273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2a8b1dd-6b3d-4558-b7bf-7af2fa8a9efa tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.128256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2a8b1dd-6b3d-4558-b7bf-7af2fa8a9efa tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.129714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2a8b1dd-6b3d-4558-b7bf-7af2fa8a9efa tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.130646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2a8b1dd-6b3d-4558-b7bf-7af2fa8a9efa tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.130787 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-870184a7-11f0-494b-9854-4e0f4d4c966b req-a2732b84-af3e-44ff-beb1-bb6ae4ecc150 service nova] Creating event network-changed:d6206404-f696-46cc-a70b-84728c57e26e for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:30:40.131377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2a8b1dd-6b3d-4558-b7bf-7af2fa8a9efa tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.136108 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-870184a7-11f0-494b-9854-4e0f4d4c966b req-a2732b84-af3e-44ff-beb1-bb6ae4ecc150 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092580 Oct 18 13:30:40.137393 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1533/3248] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:40.146164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2568bab5-04e1-4fce-902b-9b6476245224 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:40.153541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2568bab5-04e1-4fce-902b-9b6476245224 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:40.168157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2568bab5-04e1-4fce-902b-9b6476245224 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.171049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2568bab5-04e1-4fce-902b-9b6476245224 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.172887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2568bab5-04e1-4fce-902b-9b6476245224 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.174465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2568bab5-04e1-4fce-902b-9b6476245224 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.175102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2568bab5-04e1-4fce-902b-9b6476245224 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.175759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2568bab5-04e1-4fce-902b-9b6476245224 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.581755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b2a8b1dd-6b3d-4558-b7bf-7af2fa8a9efa tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:40.594214 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b2a8b1dd-6b3d-4558-b7bf-7af2fa8a9efa tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.522249 Oct 18 13:30:40.598440 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1716/3249] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:40 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:40.609320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-99740c99-f386-4d21-b912-bae72efce9ac tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:40.609819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-99740c99-f386-4d21-b912-bae72efce9ac tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:40.638486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-99740c99-f386-4d21-b912-bae72efce9ac tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.644310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-99740c99-f386-4d21-b912-bae72efce9ac tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.644800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-99740c99-f386-4d21-b912-bae72efce9ac tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.645574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-99740c99-f386-4d21-b912-bae72efce9ac tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.646038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-99740c99-f386-4d21-b912-bae72efce9ac tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.646458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-99740c99-f386-4d21-b912-bae72efce9ac tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.720427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-99740c99-f386-4d21-b912-bae72efce9ac tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:30:40.770491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:40.887198 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-99740c99-f386-4d21-b912-bae72efce9ac tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 204 len: 0 microversion: 2.1 time: 0.287367 Oct 18 13:30:40.888051 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1717/3250] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:40 2022] DELETE /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:30:40.905781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c0cc7cdd-0885-4e36-adf8-9bab2742b04c req-471f05da-858e-4a63-b791-d8d21be2a1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37db5c9f-afcd-4471-930c-d3a55a279f09", "name": "network-vif-plugged", "status": "completed", "tag": "24869de5-2c8b-4aa0-97bf-68b16afb361f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:40.920899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c0cc7cdd-0885-4e36-adf8-9bab2742b04c req-471f05da-858e-4a63-b791-d8d21be2a1f8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:40.925411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c0cc7cdd-0885-4e36-adf8-9bab2742b04c req-471f05da-858e-4a63-b791-d8d21be2a1f8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:40.926186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c0cc7cdd-0885-4e36-adf8-9bab2742b04c req-471f05da-858e-4a63-b791-d8d21be2a1f8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:40.955853 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c0cc7cdd-0885-4e36-adf8-9bab2742b04c req-471f05da-858e-4a63-b791-d8d21be2a1f8 service nova] Creating event network-vif-plugged:24869de5-2c8b-4aa0-97bf-68b16afb361f for instance 37db5c9f-afcd-4471-930c-d3a55a279f09 on n-h2-858384-13 Oct 18 13:30:40.971649 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c0cc7cdd-0885-4e36-adf8-9bab2742b04c req-471f05da-858e-4a63-b791-d8d21be2a1f8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081974 Oct 18 13:30:40.972592 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1718/3251] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:40.985818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-def05f87-c4e8-4e4b-be25-16bcb6f1cad1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:40.987115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-def05f87-c4e8-4e4b-be25-16bcb6f1cad1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:41.000027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-def05f87-c4e8-4e4b-be25-16bcb6f1cad1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:41.014060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-def05f87-c4e8-4e4b-be25-16bcb6f1cad1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:41.014926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-def05f87-c4e8-4e4b-be25-16bcb6f1cad1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:41.015927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-def05f87-c4e8-4e4b-be25-16bcb6f1cad1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:41.016682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-def05f87-c4e8-4e4b-be25-16bcb6f1cad1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:41.017378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-def05f87-c4e8-4e4b-be25-16bcb6f1cad1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:41.582768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-def05f87-c4e8-4e4b-be25-16bcb6f1cad1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:41.603043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-def05f87-c4e8-4e4b-be25-16bcb6f1cad1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:41.606083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-def05f87-c4e8-4e4b-be25-16bcb6f1cad1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:41.608231 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-def05f87-c4e8-4e4b-be25-16bcb6f1cad1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 2956 microversion: 2.42 time: 0.633984 Oct 18 13:30:41.609940 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1719/3252] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:40 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 2956 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:41.626070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-524c5f4f-b26a-45c6-9694-bb2946d39606 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:41.628618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-524c5f4f-b26a-45c6-9694-bb2946d39606 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:41.650916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-524c5f4f-b26a-45c6-9694-bb2946d39606 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:41.653764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-524c5f4f-b26a-45c6-9694-bb2946d39606 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:41.655122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-524c5f4f-b26a-45c6-9694-bb2946d39606 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:41.657366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-524c5f4f-b26a-45c6-9694-bb2946d39606 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:41.660670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-524c5f4f-b26a-45c6-9694-bb2946d39606 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:41.661118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-524c5f4f-b26a-45c6-9694-bb2946d39606 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:41.924394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2568bab5-04e1-4fce-902b-9b6476245224 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:41.941665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2568bab5-04e1-4fce-902b-9b6476245224 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:41.946329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2568bab5-04e1-4fce-902b-9b6476245224 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:41.952334 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2568bab5-04e1-4fce-902b-9b6476245224 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1891 microversion: 2.32 time: 1.809399 Oct 18 13:30:41.976980 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1534/3253] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:40 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1891 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:41.982183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-80a4bfec-ac62-467e-8cc0-87db916bf989 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:41.988182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-80a4bfec-ac62-467e-8cc0-87db916bf989 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:42.005912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80a4bfec-ac62-467e-8cc0-87db916bf989 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.006779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80a4bfec-ac62-467e-8cc0-87db916bf989 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.007435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80a4bfec-ac62-467e-8cc0-87db916bf989 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.008350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80a4bfec-ac62-467e-8cc0-87db916bf989 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.013689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80a4bfec-ac62-467e-8cc0-87db916bf989 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.014370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80a4bfec-ac62-467e-8cc0-87db916bf989 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.096771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-524c5f4f-b26a-45c6-9694-bb2946d39606 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:42.118764 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-524c5f4f-b26a-45c6-9694-bb2946d39606 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1473 microversion: 2.1 time: 0.503534 Oct 18 13:30:42.127371 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1720/3254] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:41 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1473 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:42.135085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f5f233b0-78cf-4ca6-9fa9-ba06bbfb4b87 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:42.135760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f5f233b0-78cf-4ca6-9fa9-ba06bbfb4b87 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:42.154031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5f233b0-78cf-4ca6-9fa9-ba06bbfb4b87 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.154456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5f233b0-78cf-4ca6-9fa9-ba06bbfb4b87 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.154939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5f233b0-78cf-4ca6-9fa9-ba06bbfb4b87 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.155610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5f233b0-78cf-4ca6-9fa9-ba06bbfb4b87 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.156081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5f233b0-78cf-4ca6-9fa9-ba06bbfb4b87 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.156525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5f233b0-78cf-4ca6-9fa9-ba06bbfb4b87 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.546714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-80a4bfec-ac62-467e-8cc0-87db916bf989 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:42.558971 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-80a4bfec-ac62-467e-8cc0-87db916bf989 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1520 microversion: 2.1 time: 0.580490 Oct 18 13:30:42.570343 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1535/3255] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:41 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1520 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:42.584189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-59c2cf74-c593-429d-a433-add63f1642e0 req-cdd58293-d6c8-47dd-a7e5-1ce2805103ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "tag": "48ef6290-b5a1-4b6a-bfeb-f1656a0b1efb"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:42.598969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-59c2cf74-c593-429d-a433-add63f1642e0 req-cdd58293-d6c8-47dd-a7e5-1ce2805103ed service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.599728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-59c2cf74-c593-429d-a433-add63f1642e0 req-cdd58293-d6c8-47dd-a7e5-1ce2805103ed service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.601196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-59c2cf74-c593-429d-a433-add63f1642e0 req-cdd58293-d6c8-47dd-a7e5-1ce2805103ed service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.602641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f5f233b0-78cf-4ca6-9fa9-ba06bbfb4b87 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:42.611663 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f5f233b0-78cf-4ca6-9fa9-ba06bbfb4b87 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.483114 Oct 18 13:30:42.612257 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1721/3256] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:42 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:42.631516 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-59c2cf74-c593-429d-a433-add63f1642e0 req-cdd58293-d6c8-47dd-a7e5-1ce2805103ed service nova] Creating event network-changed:48ef6290-b5a1-4b6a-bfeb-f1656a0b1efb for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:30:42.637154 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-59c2cf74-c593-429d-a433-add63f1642e0 req-cdd58293-d6c8-47dd-a7e5-1ce2805103ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065442 Oct 18 13:30:42.639605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c510401f-bef4-448c-8c32-febe3385934b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:42.640417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c510401f-bef4-448c-8c32-febe3385934b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:42.640931 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1536/3257] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:42.648088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c510401f-bef4-448c-8c32-febe3385934b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.648587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c510401f-bef4-448c-8c32-febe3385934b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.649089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c510401f-bef4-448c-8c32-febe3385934b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.649828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c510401f-bef4-448c-8c32-febe3385934b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:42.650287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c510401f-bef4-448c-8c32-febe3385934b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:42.650715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c510401f-bef4-448c-8c32-febe3385934b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:42.989977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f362402d-0bd8-4ef4-bd65-3c1d41dbc330 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:42.990707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f362402d-0bd8-4ef4-bd65-3c1d41dbc330 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:43.011329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f362402d-0bd8-4ef4-bd65-3c1d41dbc330 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.012084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f362402d-0bd8-4ef4-bd65-3c1d41dbc330 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.012683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f362402d-0bd8-4ef4-bd65-3c1d41dbc330 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.017658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f362402d-0bd8-4ef4-bd65-3c1d41dbc330 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.018389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f362402d-0bd8-4ef4-bd65-3c1d41dbc330 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.018989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f362402d-0bd8-4ef4-bd65-3c1d41dbc330 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.247132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c510401f-bef4-448c-8c32-febe3385934b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:43.261584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c510401f-bef4-448c-8c32-febe3385934b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:43.269082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c510401f-bef4-448c-8c32-febe3385934b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:43.279132 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c510401f-bef4-448c-8c32-febe3385934b tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 2935 microversion: 2.42 time: 0.644999 Oct 18 13:30:43.280041 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1722/3258] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:42 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 2935 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:43.286060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-6187bb26-b7df-4b5c-bc76-c852ee3da9cb req-34f2c081-6a1c-4aa1-80a2-807f50e3b402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1ba414-b725-477c-917a-d5e846e42462", "name": "network-vif-unplugged", "status": "completed", "tag": "fc85f618-9d9c-41c0-b8d7-706b0f9a2358"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:43.311792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6187bb26-b7df-4b5c-bc76-c852ee3da9cb req-34f2c081-6a1c-4aa1-80a2-807f50e3b402 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.312264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6187bb26-b7df-4b5c-bc76-c852ee3da9cb req-34f2c081-6a1c-4aa1-80a2-807f50e3b402 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.312739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6187bb26-b7df-4b5c-bc76-c852ee3da9cb req-34f2c081-6a1c-4aa1-80a2-807f50e3b402 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.332874 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-6187bb26-b7df-4b5c-bc76-c852ee3da9cb req-34f2c081-6a1c-4aa1-80a2-807f50e3b402 service nova] Creating event network-vif-unplugged:fc85f618-9d9c-41c0-b8d7-706b0f9a2358 for instance 8a1ba414-b725-477c-917a-d5e846e42462 on n-h1-858384-13 Oct 18 13:30:43.349306 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-6187bb26-b7df-4b5c-bc76-c852ee3da9cb req-34f2c081-6a1c-4aa1-80a2-807f50e3b402 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067425 Oct 18 13:30:43.354075 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1723/3259] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:43.362394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ea281325-7828-4835-8f91-319428bede7d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:43.366898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ea281325-7828-4835-8f91-319428bede7d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:43.387069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea281325-7828-4835-8f91-319428bede7d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.387867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea281325-7828-4835-8f91-319428bede7d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.388479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea281325-7828-4835-8f91-319428bede7d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.389373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea281325-7828-4835-8f91-319428bede7d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.390179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea281325-7828-4835-8f91-319428bede7d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.392169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea281325-7828-4835-8f91-319428bede7d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.854420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ea281325-7828-4835-8f91-319428bede7d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:43.874637 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ea281325-7828-4835-8f91-319428bede7d tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1473 microversion: 2.1 time: 0.518813 Oct 18 13:30:43.875683 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1724/3260] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:43 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1473 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:43.881250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-307a55df-73b4-4944-b024-c683a5599ed2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:43.886489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-307a55df-73b4-4944-b024-c683a5599ed2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:43.902897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-307a55df-73b4-4944-b024-c683a5599ed2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.904223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-307a55df-73b4-4944-b024-c683a5599ed2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.905643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-307a55df-73b4-4944-b024-c683a5599ed2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:43.914620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-307a55df-73b4-4944-b024-c683a5599ed2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:43.915447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-307a55df-73b4-4944-b024-c683a5599ed2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:43.916048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-307a55df-73b4-4944-b024-c683a5599ed2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:44.229264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f362402d-0bd8-4ef4-bd65-3c1d41dbc330 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:44.257396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f362402d-0bd8-4ef4-bd65-3c1d41dbc330 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:44.259787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f362402d-0bd8-4ef4-bd65-3c1d41dbc330 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:44.262707 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f362402d-0bd8-4ef4-bd65-3c1d41dbc330 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1891 microversion: 2.32 time: 1.285744 Oct 18 13:30:44.264517 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1537/3261] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:42 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1891 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:30:44.271809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d076f3b3-e941-4d33-a226-c94ec5af40a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:44.272744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d076f3b3-e941-4d33-a226-c94ec5af40a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:44.279938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d076f3b3-e941-4d33-a226-c94ec5af40a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:44.280660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d076f3b3-e941-4d33-a226-c94ec5af40a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:44.281957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d076f3b3-e941-4d33-a226-c94ec5af40a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:44.282866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d076f3b3-e941-4d33-a226-c94ec5af40a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:44.283470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d076f3b3-e941-4d33-a226-c94ec5af40a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:44.284214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d076f3b3-e941-4d33-a226-c94ec5af40a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:44.404443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-307a55df-73b4-4944-b024-c683a5599ed2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:44.424037 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-307a55df-73b4-4944-b024-c683a5599ed2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1505 microversion: 2.1 time: 0.541870 Oct 18 13:30:44.424761 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1725/3262] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:43 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:44.435993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-88c8dc01-6961-4e5e-9a76-29e8ffc1ff87 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:44.444244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-88c8dc01-6961-4e5e-9a76-29e8ffc1ff87 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:44.471075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88c8dc01-6961-4e5e-9a76-29e8ffc1ff87 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:44.471558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88c8dc01-6961-4e5e-9a76-29e8ffc1ff87 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:44.471992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88c8dc01-6961-4e5e-9a76-29e8ffc1ff87 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:44.473394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88c8dc01-6961-4e5e-9a76-29e8ffc1ff87 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:44.475229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88c8dc01-6961-4e5e-9a76-29e8ffc1ff87 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:44.475743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88c8dc01-6961-4e5e-9a76-29e8ffc1ff87 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.034676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-88c8dc01-6961-4e5e-9a76-29e8ffc1ff87 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:45.048945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-88c8dc01-6961-4e5e-9a76-29e8ffc1ff87 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:45.053018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-88c8dc01-6961-4e5e-9a76-29e8ffc1ff87 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:45.055749 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-88c8dc01-6961-4e5e-9a76-29e8ffc1ff87 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 2914 microversion: 2.42 time: 0.629251 Oct 18 13:30:45.056684 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1726/3263] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:44 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 2914 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:45.104129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-70260fbf-9041-4d1f-8ef9-8a4b7b4b0682 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:45.105122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-70260fbf-9041-4d1f-8ef9-8a4b7b4b0682 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:45.112937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70260fbf-9041-4d1f-8ef9-8a4b7b4b0682 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.114397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70260fbf-9041-4d1f-8ef9-8a4b7b4b0682 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.115016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70260fbf-9041-4d1f-8ef9-8a4b7b4b0682 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.115171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d076f3b3-e941-4d33-a226-c94ec5af40a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:45.116063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70260fbf-9041-4d1f-8ef9-8a4b7b4b0682 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.116837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70260fbf-9041-4d1f-8ef9-8a4b7b4b0682 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.117510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70260fbf-9041-4d1f-8ef9-8a4b7b4b0682 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.135797 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d076f3b3-e941-4d33-a226-c94ec5af40a5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.862634 Oct 18 13:30:45.139230 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1538/3264] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:44 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:45.161421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-8ca006b0-d398-4dd3-a45b-c48be428aea3 req-2aa3f759-91c8-42e1-a8a6-3ca5a4ebaad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1ba414-b725-477c-917a-d5e846e42462", "name": "network-vif-deleted", "tag": "fc85f618-9d9c-41c0-b8d7-706b0f9a2358"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:45.197955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8ca006b0-d398-4dd3-a45b-c48be428aea3 req-2aa3f759-91c8-42e1-a8a6-3ca5a4ebaad7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.198438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8ca006b0-d398-4dd3-a45b-c48be428aea3 req-2aa3f759-91c8-42e1-a8a6-3ca5a4ebaad7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.199092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8ca006b0-d398-4dd3-a45b-c48be428aea3 req-2aa3f759-91c8-42e1-a8a6-3ca5a4ebaad7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.227356 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-8ca006b0-d398-4dd3-a45b-c48be428aea3 req-2aa3f759-91c8-42e1-a8a6-3ca5a4ebaad7 service nova] Creating event network-vif-deleted:fc85f618-9d9c-41c0-b8d7-706b0f9a2358 for instance 8a1ba414-b725-477c-917a-d5e846e42462 on n-h1-858384-13 Oct 18 13:30:45.250507 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-8ca006b0-d398-4dd3-a45b-c48be428aea3 req-2aa3f759-91c8-42e1-a8a6-3ca5a4ebaad7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098568 Oct 18 13:30:45.252260 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1539/3265] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:45.262066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:45.263038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:45.275411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.276384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.277910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.278847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.279517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.280206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.345013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.346767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.348383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.349404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lazy-loading 'fault' on Instance uuid 8a1ba414-b725-477c-917a-d5e846e42462 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:45.452031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-70260fbf-9041-4d1f-8ef9-8a4b7b4b0682 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:45.462508 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-70260fbf-9041-4d1f-8ef9-8a4b7b4b0682 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 200 len: 1505 microversion: 2.1 time: 0.383656 Oct 18 13:30:45.467014 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1727/3266] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:45 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:45.478077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dc50f64f-9de1-4b6d-ad16-a91590d32f74 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:45.481053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dc50f64f-9de1-4b6d-ad16-a91590d32f74 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:45.493508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc50f64f-9de1-4b6d-ad16-a91590d32f74 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.494018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc50f64f-9de1-4b6d-ad16-a91590d32f74 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.494452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc50f64f-9de1-4b6d-ad16-a91590d32f74 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.495167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc50f64f-9de1-4b6d-ad16-a91590d32f74 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.495625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc50f64f-9de1-4b6d-ad16-a91590d32f74 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.496052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc50f64f-9de1-4b6d-ad16-a91590d32f74 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.657040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:45.671706 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7c8cb4d2-c951-455a-8e50-4ec5d9963fb1 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 200 len: 1307 microversion: 2.1 time: 0.418036 Oct 18 13:30:45.680895 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1540/3267] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:45 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 1307 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:45.712307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-4768ae23-a686-41e8-b646-bc39264079b0 req-0e024538-935e-4eab-ab82-9206134dce3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-unplugged", "status": "completed", "tag": "dd1adc7a-80d9-4f8e-9246-b25315711c34"}, {"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-unplugged", "status": "completed", "tag": "a097c407-dceb-423a-899b-463450213b4f"}, {"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-unplugged", "status": "completed", "tag": "e53d609c-cb8b-4106-ad60-0cf706884abe"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:45.743505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4768ae23-a686-41e8-b646-bc39264079b0 req-0e024538-935e-4eab-ab82-9206134dce3b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.743994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4768ae23-a686-41e8-b646-bc39264079b0 req-0e024538-935e-4eab-ab82-9206134dce3b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.744428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4768ae23-a686-41e8-b646-bc39264079b0 req-0e024538-935e-4eab-ab82-9206134dce3b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.764692 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4768ae23-a686-41e8-b646-bc39264079b0 req-0e024538-935e-4eab-ab82-9206134dce3b service nova] Creating event network-vif-unplugged:dd1adc7a-80d9-4f8e-9246-b25315711c34 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:30:45.774858 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4768ae23-a686-41e8-b646-bc39264079b0 req-0e024538-935e-4eab-ab82-9206134dce3b service nova] Creating event network-vif-unplugged:a097c407-dceb-423a-899b-463450213b4f for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:30:45.775695 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4768ae23-a686-41e8-b646-bc39264079b0 req-0e024538-935e-4eab-ab82-9206134dce3b service nova] Creating event network-vif-unplugged:e53d609c-cb8b-4106-ad60-0cf706884abe for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:30:45.787261 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-4768ae23-a686-41e8-b646-bc39264079b0 req-0e024538-935e-4eab-ab82-9206134dce3b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.095916 Oct 18 13:30:45.798008 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1541/3268] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:45.805567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b18b62c5-ff1a-4bd9-b327-13ff77377c0a tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:45.806445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b18b62c5-ff1a-4bd9-b327-13ff77377c0a tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:45.821446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b18b62c5-ff1a-4bd9-b327-13ff77377c0a tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.829458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b18b62c5-ff1a-4bd9-b327-13ff77377c0a tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.830272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b18b62c5-ff1a-4bd9-b327-13ff77377c0a tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.831842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b18b62c5-ff1a-4bd9-b327-13ff77377c0a tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:45.835173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b18b62c5-ff1a-4bd9-b327-13ff77377c0a tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:45.835875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b18b62c5-ff1a-4bd9-b327-13ff77377c0a tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:45.907832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b18b62c5-ff1a-4bd9-b327-13ff77377c0a tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:30:46.023280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:46.069524 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b18b62c5-ff1a-4bd9-b327-13ff77377c0a tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "DELETE /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 204 len: 0 microversion: 2.1 time: 0.268487 Oct 18 13:30:46.072424 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1542/3269] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:45 2022] DELETE /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:30:46.108170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ceb28e94-427f-4238-aefb-ebd96e9b68a7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:46.108507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ceb28e94-427f-4238-aefb-ebd96e9b68a7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:46.117067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ceb28e94-427f-4238-aefb-ebd96e9b68a7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.117592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ceb28e94-427f-4238-aefb-ebd96e9b68a7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.118083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ceb28e94-427f-4238-aefb-ebd96e9b68a7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:46.118799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ceb28e94-427f-4238-aefb-ebd96e9b68a7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.119459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ceb28e94-427f-4238-aefb-ebd96e9b68a7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.120036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ceb28e94-427f-4238-aefb-ebd96e9b68a7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:46.122362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc50f64f-9de1-4b6d-ad16-a91590d32f74 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:46.133890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc50f64f-9de1-4b6d-ad16-a91590d32f74 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:46.135338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc50f64f-9de1-4b6d-ad16-a91590d32f74 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:46.136526 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dc50f64f-9de1-4b6d-ad16-a91590d32f74 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1891 microversion: 2.32 time: 0.668257 Oct 18 13:30:46.137107 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1728/3270] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:45 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1891 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:46.181405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8caed5d9-ca34-4e3d-bde4-e2dcebcd60c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:46.193447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8caed5d9-ca34-4e3d-bde4-e2dcebcd60c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:46.215547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8caed5d9-ca34-4e3d-bde4-e2dcebcd60c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.216050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8caed5d9-ca34-4e3d-bde4-e2dcebcd60c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.216494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8caed5d9-ca34-4e3d-bde4-e2dcebcd60c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:46.217226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8caed5d9-ca34-4e3d-bde4-e2dcebcd60c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.218802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8caed5d9-ca34-4e3d-bde4-e2dcebcd60c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.219578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8caed5d9-ca34-4e3d-bde4-e2dcebcd60c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:46.714474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8caed5d9-ca34-4e3d-bde4-e2dcebcd60c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:46.725097 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8caed5d9-ca34-4e3d-bde4-e2dcebcd60c2 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.547300 Oct 18 13:30:46.739089 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1729/3271] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:46 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:46.751845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1844586557", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "ed3d6fb6-bc95-4e0a-9617-ed9ae0b77a43"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:46.905001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] validate_networks() for [('ed3d6fb6-bc95-4e0a-9617-ed9ae0b77a43', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:30:46.948225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ceb28e94-427f-4238-aefb-ebd96e9b68a7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:46.967584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ceb28e94-427f-4238-aefb-ebd96e9b68a7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:46.969262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ceb28e94-427f-4238-aefb-ebd96e9b68a7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:46.970603 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ceb28e94-427f-4238-aefb-ebd96e9b68a7 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 2914 microversion: 2.42 time: 0.873108 Oct 18 13:30:46.971660 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1543/3272] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:46 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 2914 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:46.980149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1cc6b2f2-a67b-487c-89dc-116bc30e0906 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:46.980772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1cc6b2f2-a67b-487c-89dc-116bc30e0906 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 8a1ba414-b725-477c-917a-d5e846e42462] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:46.996746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cc6b2f2-a67b-487c-89dc-116bc30e0906 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.996746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cc6b2f2-a67b-487c-89dc-116bc30e0906 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.996746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cc6b2f2-a67b-487c-89dc-116bc30e0906 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:46.997091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cc6b2f2-a67b-487c-89dc-116bc30e0906 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:46.997592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cc6b2f2-a67b-487c-89dc-116bc30e0906 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:46.997970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cc6b2f2-a67b-487c-89dc-116bc30e0906 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.060239 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-1cc6b2f2-a67b-487c-89dc-116bc30e0906 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] HTTP exception thrown: Instance 8a1ba414-b725-477c-917a-d5e846e42462 could not be found. Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1cc6b2f2-a67b-487c-89dc-116bc30e0906 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Request method failure captured: Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 HTTP/1.1 Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqndNLs5iysNG23-990uCB6IZiSZkcLI4gL8Qkhkx6hDM3roQSaiGw3uN57kA58uDMNrm3neXJWgNJRAid03luKpDQ1sZv_fzgili9c_3TIxftm-KkB76hk5QD3QbHyppnfRAcigbOIXHX0jEj11r1ElaYHrcV6kpFMOD216mFEzEZU Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_caf4a24f687647e4a23fbee030d4e53a"}]}] Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 2cb58ae89a06444e95eca4c886e9cc0c Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 8a1ba414-b725-477c-917a-d5e846e42462 could not be found. Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '8a1ba414-b725-477c-917a-d5e846e42462'} Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1ba414-b725-477c-917a-d5e846e42462 could not be found. Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1ba414-b725-477c-917a-d5e846e42462 could not be found. Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:47.064764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:47.072046 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:47.072046 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:47.072046 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:47.072046 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:47.072046 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:47.072046 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1ba414-b725-477c-917a-d5e846e42462 could not be found. Oct 18 13:30:47.072046 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:47.072046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1cc6b2f2-a67b-487c-89dc-116bc30e0906 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Returning 404 to user: Instance 8a1ba414-b725-477c-917a-d5e846e42462 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:47.072046 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1cc6b2f2-a67b-487c-89dc-116bc30e0906 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462" status: 404 len: 111 microversion: 2.1 time: 0.093667 Oct 18 13:30:47.081268 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1544/3273] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:46 2022] GET /compute/v2.1/servers/8a1ba414-b725-477c-917a-d5e846e42462 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:47.100891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bf147539-ade2-4194-b24f-7f3c805cf0d9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:47.103195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bf147539-ade2-4194-b24f-7f3c805cf0d9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:47.126281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf147539-ade2-4194-b24f-7f3c805cf0d9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.129429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf147539-ade2-4194-b24f-7f3c805cf0d9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.130152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf147539-ade2-4194-b24f-7f3c805cf0d9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.130952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf147539-ade2-4194-b24f-7f3c805cf0d9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.131372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf147539-ade2-4194-b24f-7f3c805cf0d9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.131805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf147539-ade2-4194-b24f-7f3c805cf0d9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.219992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bf147539-ade2-4194-b24f-7f3c805cf0d9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:30:47.400400 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bf147539-ade2-4194-b24f-7f3c805cf0d9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 204 len: 0 microversion: 2.1 time: 0.316673 Oct 18 13:30:47.401417 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1545/3274] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:47 2022] DELETE /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:30:47.408844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ceb168e7-86a7-4768-9749-6a615952e8ce tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:47.409789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ceb168e7-86a7-4768-9749-6a615952e8ce tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:47.425064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ceb168e7-86a7-4768-9749-6a615952e8ce tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.426379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ceb168e7-86a7-4768-9749-6a615952e8ce tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.432107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ceb168e7-86a7-4768-9749-6a615952e8ce tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:47.433396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ceb168e7-86a7-4768-9749-6a615952e8ce tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:47.434039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ceb168e7-86a7-4768-9749-6a615952e8ce tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:47.434638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ceb168e7-86a7-4768-9749-6a615952e8ce tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:48.320149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ceb168e7-86a7-4768-9749-6a615952e8ce tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:48.340251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ceb168e7-86a7-4768-9749-6a615952e8ce tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:48.348798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ceb168e7-86a7-4768-9749-6a615952e8ce tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:48.354065 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ceb168e7-86a7-4768-9749-6a615952e8ce tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1891 microversion: 2.32 time: 0.951263 Oct 18 13:30:48.358791 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1546/3275] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:47 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1891 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:48.365409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-feb04167-7b15-44ac-bd7f-6c72550b0543 req-18767107-4106-437a-8a14-e83135b33bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "tag": "ff507a08-6d1d-489d-9972-88fe76f7ecb0"}, {"name": "network-changed", "server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "tag": "1e430439-0ec3-424e-b978-369a2167d04b"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:48.396975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-feb04167-7b15-44ac-bd7f-6c72550b0543 req-18767107-4106-437a-8a14-e83135b33bf2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:48.399292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-feb04167-7b15-44ac-bd7f-6c72550b0543 req-18767107-4106-437a-8a14-e83135b33bf2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:48.399958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-feb04167-7b15-44ac-bd7f-6c72550b0543 req-18767107-4106-437a-8a14-e83135b33bf2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:48.434237 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-feb04167-7b15-44ac-bd7f-6c72550b0543 req-18767107-4106-437a-8a14-e83135b33bf2 service nova] Creating event network-changed:ff507a08-6d1d-489d-9972-88fe76f7ecb0 for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:30:48.435107 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-feb04167-7b15-44ac-bd7f-6c72550b0543 req-18767107-4106-437a-8a14-e83135b33bf2 service nova] Creating event network-changed:1e430439-0ec3-424e-b978-369a2167d04b for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:30:48.453519 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-feb04167-7b15-44ac-bd7f-6c72550b0543 req-18767107-4106-437a-8a14-e83135b33bf2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.093142 Oct 18 13:30:48.457628 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1547/3276] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:48.463259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0f39a957-3ee5-46df-a1f2-73e1d0a73ecf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:48.470487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0f39a957-3ee5-46df-a1f2-73e1d0a73ecf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:48.490178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f39a957-3ee5-46df-a1f2-73e1d0a73ecf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:48.490952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f39a957-3ee5-46df-a1f2-73e1d0a73ecf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:48.492907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f39a957-3ee5-46df-a1f2-73e1d0a73ecf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:48.493843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f39a957-3ee5-46df-a1f2-73e1d0a73ecf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:48.494456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f39a957-3ee5-46df-a1f2-73e1d0a73ecf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:48.496786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f39a957-3ee5-46df-a1f2-73e1d0a73ecf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:48.862398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:30:48.864105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:30:48.865743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:30:48.866603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:30:48.867891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:30:48.887767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:48.888280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:48.888716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:48.889465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:48.889918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:48.890467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:48.918291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Getting quotas for project 02171c961e924aa0b2ec216ec3fc2250. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:30:48.928965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Getting quotas for user 3cba0dade9b74a5b9e647244d9f66184 and project 02171c961e924aa0b2ec216ec3fc2250. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:30:48.946659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:30:48.949674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:30:49.024972 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-90b563e5-d6ef-46e2-bb18-4d95b5bd34d3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.284646 Oct 18 13:30:49.026048 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1730/3277] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:30:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:30:49.032620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9ab56c54-c559-43dd-8dab-253b5b5915c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:49.035725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9ab56c54-c559-43dd-8dab-253b5b5915c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:49.056369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ab56c54-c559-43dd-8dab-253b5b5915c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.056897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ab56c54-c559-43dd-8dab-253b5b5915c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.057676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ab56c54-c559-43dd-8dab-253b5b5915c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.058603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ab56c54-c559-43dd-8dab-253b5b5915c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.059271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ab56c54-c559-43dd-8dab-253b5b5915c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.059989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ab56c54-c559-43dd-8dab-253b5b5915c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.330956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0f39a957-3ee5-46df-a1f2-73e1d0a73ecf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:49.352746 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0f39a957-3ee5-46df-a1f2-73e1d0a73ecf tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1472 microversion: 2.1 time: 0.889114 Oct 18 13:30:49.356388 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1548/3278] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:48 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1472 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:49.371480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe5495e7-3525-43cb-b7a7-b74f5b4949af tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:49.372657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe5495e7-3525-43cb-b7a7-b74f5b4949af tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:49.411271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe5495e7-3525-43cb-b7a7-b74f5b4949af tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.411782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe5495e7-3525-43cb-b7a7-b74f5b4949af tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.419578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe5495e7-3525-43cb-b7a7-b74f5b4949af tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.420409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe5495e7-3525-43cb-b7a7-b74f5b4949af tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.420901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe5495e7-3525-43cb-b7a7-b74f5b4949af tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.421375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe5495e7-3525-43cb-b7a7-b74f5b4949af tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.771620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9ab56c54-c559-43dd-8dab-253b5b5915c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:49.786609 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9ab56c54-c559-43dd-8dab-253b5b5915c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.756111 Oct 18 13:30:49.789327 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1731/3279] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:49 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:49.795429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-b50ff0a5-f356-4679-8734-defc06d7e2e3 req-0bb18fa2-1174-4262-9618-4ebfd0521239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-unplugged", "status": "completed", "tag": "d3e742e1-6288-419d-a439-1cd1c7e4eff3"}, {"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-unplugged", "status": "completed", "tag": "2979f9f0-551e-4518-be50-6140626a03d0"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:49.806879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b50ff0a5-f356-4679-8734-defc06d7e2e3 req-0bb18fa2-1174-4262-9618-4ebfd0521239 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.807883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b50ff0a5-f356-4679-8734-defc06d7e2e3 req-0bb18fa2-1174-4262-9618-4ebfd0521239 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.808533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b50ff0a5-f356-4679-8734-defc06d7e2e3 req-0bb18fa2-1174-4262-9618-4ebfd0521239 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.824330 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-b50ff0a5-f356-4679-8734-defc06d7e2e3 req-0bb18fa2-1174-4262-9618-4ebfd0521239 service nova] Creating event network-vif-unplugged:d3e742e1-6288-419d-a439-1cd1c7e4eff3 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:30:49.827765 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-b50ff0a5-f356-4679-8734-defc06d7e2e3 req-0bb18fa2-1174-4262-9618-4ebfd0521239 service nova] Creating event network-vif-unplugged:2979f9f0-551e-4518-be50-6140626a03d0 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:30:49.851374 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-b50ff0a5-f356-4679-8734-defc06d7e2e3 req-0bb18fa2-1174-4262-9618-4ebfd0521239 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.043726 Oct 18 13:30:49.852686 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1732/3280] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:49.867964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-26caaf39-0d5c-4de8-8a95-e93dc4bd8130 req-b3236ad7-8919-4053-bac7-8623f4166362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-deleted", "tag": "d3e742e1-6288-419d-a439-1cd1c7e4eff3"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:49.900127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-26caaf39-0d5c-4de8-8a95-e93dc4bd8130 req-b3236ad7-8919-4053-bac7-8623f4166362 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.900787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-26caaf39-0d5c-4de8-8a95-e93dc4bd8130 req-b3236ad7-8919-4053-bac7-8623f4166362 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.902047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-26caaf39-0d5c-4de8-8a95-e93dc4bd8130 req-b3236ad7-8919-4053-bac7-8623f4166362 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.955985 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-26caaf39-0d5c-4de8-8a95-e93dc4bd8130 req-b3236ad7-8919-4053-bac7-8623f4166362 service nova] Creating event network-vif-deleted:d3e742e1-6288-419d-a439-1cd1c7e4eff3 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:30:49.966025 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-26caaf39-0d5c-4de8-8a95-e93dc4bd8130 req-b3236ad7-8919-4053-bac7-8623f4166362 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111252 Oct 18 13:30:49.966648 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1733/3281] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:49.973114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb1f507e-f962-4f9c-a769-5bce4d19bb95 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:49.974459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eb1f507e-f962-4f9c-a769-5bce4d19bb95 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:49.982926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb1f507e-f962-4f9c-a769-5bce4d19bb95 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.983714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb1f507e-f962-4f9c-a769-5bce4d19bb95 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.984351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb1f507e-f962-4f9c-a769-5bce4d19bb95 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:49.985308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb1f507e-f962-4f9c-a769-5bce4d19bb95 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:49.985960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb1f507e-f962-4f9c-a769-5bce4d19bb95 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:49.986581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb1f507e-f962-4f9c-a769-5bce4d19bb95 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.135923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eb1f507e-f962-4f9c-a769-5bce4d19bb95 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.165270 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eb1f507e-f962-4f9c-a769-5bce4d19bb95 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1222 microversion: 2.1 time: 0.195924 Oct 18 13:30:50.169793 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1734/3282] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:49 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1222 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:50.186399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fd235857-9cd7-4daf-ab74-d45cdf9ab1f6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:50.188034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fd235857-9cd7-4daf-ab74-d45cdf9ab1f6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:50.197343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd235857-9cd7-4daf-ab74-d45cdf9ab1f6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.198643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd235857-9cd7-4daf-ab74-d45cdf9ab1f6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.199576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd235857-9cd7-4daf-ab74-d45cdf9ab1f6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.200546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd235857-9cd7-4daf-ab74-d45cdf9ab1f6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.201465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd235857-9cd7-4daf-ab74-d45cdf9ab1f6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.202108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd235857-9cd7-4daf-ab74-d45cdf9ab1f6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.296672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe5495e7-3525-43cb-b7a7-b74f5b4949af tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.312572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe5495e7-3525-43cb-b7a7-b74f5b4949af tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.314277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe5495e7-3525-43cb-b7a7-b74f5b4949af tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.315753 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fe5495e7-3525-43cb-b7a7-b74f5b4949af tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 2868 microversion: 2.42 time: 0.957934 Oct 18 13:30:50.317320 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1549/3283] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:49 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 2868 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:50.384774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0566e05c-b5f9-40ca-8eb8-d1d94db0e88b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:50.386589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0566e05c-b5f9-40ca-8eb8-d1d94db0e88b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:50.397253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0566e05c-b5f9-40ca-8eb8-d1d94db0e88b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.397964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0566e05c-b5f9-40ca-8eb8-d1d94db0e88b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.398598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0566e05c-b5f9-40ca-8eb8-d1d94db0e88b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.399778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0566e05c-b5f9-40ca-8eb8-d1d94db0e88b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.400382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0566e05c-b5f9-40ca-8eb8-d1d94db0e88b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.400960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0566e05c-b5f9-40ca-8eb8-d1d94db0e88b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.768996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fd235857-9cd7-4daf-ab74-d45cdf9ab1f6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.787911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fd235857-9cd7-4daf-ab74-d45cdf9ab1f6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.789435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fd235857-9cd7-4daf-ab74-d45cdf9ab1f6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.790651 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fd235857-9cd7-4daf-ab74-d45cdf9ab1f6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.617908 Oct 18 13:30:50.806299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0566e05c-b5f9-40ca-8eb8-d1d94db0e88b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:50.819510 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0566e05c-b5f9-40ca-8eb8-d1d94db0e88b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1472 microversion: 2.1 time: 0.442185 Oct 18 13:30:50.824715 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1735/3284] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:50 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:50.825014 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1550/3285] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:50 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:50.838023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f552e3e8-78f5-4f81-ae13-090be008eaed tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:50.839264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f552e3e8-78f5-4f81-ae13-090be008eaed tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:50.855874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f552e3e8-78f5-4f81-ae13-090be008eaed tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.857794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f552e3e8-78f5-4f81-ae13-090be008eaed tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.859401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f552e3e8-78f5-4f81-ae13-090be008eaed tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:50.860435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f552e3e8-78f5-4f81-ae13-090be008eaed tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:50.864833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f552e3e8-78f5-4f81-ae13-090be008eaed tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:50.865518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f552e3e8-78f5-4f81-ae13-090be008eaed tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.201659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d1191369-57d9-499f-ab69-f9c0775d9c72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:51.202767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d1191369-57d9-499f-ab69-f9c0775d9c72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:51.226965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1191369-57d9-499f-ab69-f9c0775d9c72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.227536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1191369-57d9-499f-ab69-f9c0775d9c72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.228098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1191369-57d9-499f-ab69-f9c0775d9c72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.229348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1191369-57d9-499f-ab69-f9c0775d9c72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.230138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1191369-57d9-499f-ab69-f9c0775d9c72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.230757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1191369-57d9-499f-ab69-f9c0775d9c72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.403911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d1191369-57d9-499f-ab69-f9c0775d9c72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:51.412743 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d1191369-57d9-499f-ab69-f9c0775d9c72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1276 microversion: 2.1 time: 0.224268 Oct 18 13:30:51.444316 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1551/3286] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:51 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1276 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:51.450162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f552e3e8-78f5-4f81-ae13-090be008eaed tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:51.452034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-11873209-4ea3-4fc1-89c0-361a78b99b04 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:51.452841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-11873209-4ea3-4fc1-89c0-361a78b99b04 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:51.457414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:51.463951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11873209-4ea3-4fc1-89c0-361a78b99b04 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.464679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11873209-4ea3-4fc1-89c0-361a78b99b04 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.465307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11873209-4ea3-4fc1-89c0-361a78b99b04 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.467012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11873209-4ea3-4fc1-89c0-361a78b99b04 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.467829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11873209-4ea3-4fc1-89c0-361a78b99b04 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.469099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11873209-4ea3-4fc1-89c0-361a78b99b04 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.470405 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f552e3e8-78f5-4f81-ae13-090be008eaed tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.644143 Oct 18 13:30:51.485625 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1736/3287] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:50 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:51.601104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-e812459b-27a5-4e8a-b047-4a3c24d94cee req-e7231872-a40b-4588-86c6-954f4ab9978c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9553c0a8-d014-4d8f-a4c7-b21f44bb47ff", "name": "network-vif-deleted", "tag": "3a5e8acd-285c-468b-b9c5-1cb3c3934322"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:51.630012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e812459b-27a5-4e8a-b047-4a3c24d94cee req-e7231872-a40b-4588-86c6-954f4ab9978c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.632105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e812459b-27a5-4e8a-b047-4a3c24d94cee req-e7231872-a40b-4588-86c6-954f4ab9978c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.633046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e812459b-27a5-4e8a-b047-4a3c24d94cee req-e7231872-a40b-4588-86c6-954f4ab9978c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.666678 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-e812459b-27a5-4e8a-b047-4a3c24d94cee req-e7231872-a40b-4588-86c6-954f4ab9978c service nova] Creating event network-vif-deleted:3a5e8acd-285c-468b-b9c5-1cb3c3934322 for instance 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff on n-h1-858384-13 Oct 18 13:30:51.673605 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-e812459b-27a5-4e8a-b047-4a3c24d94cee req-e7231872-a40b-4588-86c6-954f4ab9978c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076926 Oct 18 13:30:51.675162 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1737/3288] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:51.836135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-27efb851-a2b7-4f70-a583-a29cf46ef57e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:51.837094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-27efb851-a2b7-4f70-a583-a29cf46ef57e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:51.864521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27efb851-a2b7-4f70-a583-a29cf46ef57e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.865071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27efb851-a2b7-4f70-a583-a29cf46ef57e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.867498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27efb851-a2b7-4f70-a583-a29cf46ef57e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:51.868488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27efb851-a2b7-4f70-a583-a29cf46ef57e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:51.868982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27efb851-a2b7-4f70-a583-a29cf46ef57e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:51.869443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27efb851-a2b7-4f70-a583-a29cf46ef57e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.211422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-27efb851-a2b7-4f70-a583-a29cf46ef57e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:52.220501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-27efb851-a2b7-4f70-a583-a29cf46ef57e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:52.221961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-27efb851-a2b7-4f70-a583-a29cf46ef57e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:52.223850 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-27efb851-a2b7-4f70-a583-a29cf46ef57e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.401717 Oct 18 13:30:52.224424 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1738/3289] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:51 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:52.239684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:52.240645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:52.246676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.247156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.247620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.248364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.248820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.249271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.280608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.281119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.281587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.282035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lazy-loading 'fault' on Instance uuid 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:52.324132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:52.332348 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ebdef437-4a4f-49fd-a240-f6974b7ff7a7 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 200 len: 1306 microversion: 2.1 time: 0.097662 Oct 18 13:30:52.333101 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1739/3290] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:52 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 1306 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:52.337873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-24c181e1-ebe7-4572-b45f-2e491ab100e1 req-0cd53388-2f83-44d6-920c-0cc53c5a563a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37db5c9f-afcd-4471-930c-d3a55a279f09", "name": "network-vif-deleted", "tag": "24869de5-2c8b-4aa0-97bf-68b16afb361f"}, {"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-deleted", "tag": "a097c407-dceb-423a-899b-463450213b4f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:52.349321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-24c181e1-ebe7-4572-b45f-2e491ab100e1 req-0cd53388-2f83-44d6-920c-0cc53c5a563a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.349800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-24c181e1-ebe7-4572-b45f-2e491ab100e1 req-0cd53388-2f83-44d6-920c-0cc53c5a563a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.350250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-24c181e1-ebe7-4572-b45f-2e491ab100e1 req-0cd53388-2f83-44d6-920c-0cc53c5a563a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.364681 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-24c181e1-ebe7-4572-b45f-2e491ab100e1 req-0cd53388-2f83-44d6-920c-0cc53c5a563a service nova] Creating event network-vif-deleted:24869de5-2c8b-4aa0-97bf-68b16afb361f for instance 37db5c9f-afcd-4471-930c-d3a55a279f09 on n-h2-858384-13 Oct 18 13:30:52.365208 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-24c181e1-ebe7-4572-b45f-2e491ab100e1 req-0cd53388-2f83-44d6-920c-0cc53c5a563a service nova] Creating event network-vif-deleted:a097c407-dceb-423a-899b-463450213b4f for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:30:52.373598 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-24c181e1-ebe7-4572-b45f-2e491ab100e1 req-0cd53388-2f83-44d6-920c-0cc53c5a563a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039174 Oct 18 13:30:52.374203 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1740/3291] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:52.437702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c88ffe0d-a29b-4843-9e1b-5e48ffb128b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:52.438680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c88ffe0d-a29b-4843-9e1b-5e48ffb128b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:52.446262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c88ffe0d-a29b-4843-9e1b-5e48ffb128b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.446747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c88ffe0d-a29b-4843-9e1b-5e48ffb128b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.447357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c88ffe0d-a29b-4843-9e1b-5e48ffb128b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.448241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c88ffe0d-a29b-4843-9e1b-5e48ffb128b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.448693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c88ffe0d-a29b-4843-9e1b-5e48ffb128b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.449110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c88ffe0d-a29b-4843-9e1b-5e48ffb128b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.504823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-11873209-4ea3-4fc1-89c0-361a78b99b04 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:52.515448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-11873209-4ea3-4fc1-89c0-361a78b99b04 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:52.519687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-11873209-4ea3-4fc1-89c0-361a78b99b04 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:52.529404 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-11873209-4ea3-4fc1-89c0-361a78b99b04 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 2708 microversion: 2.42 time: 1.082394 Oct 18 13:30:52.543014 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1552/3292] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:51 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 2708 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:52.563765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c88ffe0d-a29b-4843-9e1b-5e48ffb128b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:52.570617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0b6a6e1-9d6b-41e2-a97c-71f2c17f3e72 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:52.572352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e0b6a6e1-9d6b-41e2-a97c-71f2c17f3e72 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:52.575956 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c88ffe0d-a29b-4843-9e1b-5e48ffb128b3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1276 microversion: 2.1 time: 0.142660 Oct 18 13:30:52.577221 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1741/3293] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:52 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:52.588874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0b6a6e1-9d6b-41e2-a97c-71f2c17f3e72 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.590811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0b6a6e1-9d6b-41e2-a97c-71f2c17f3e72 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.591887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0b6a6e1-9d6b-41e2-a97c-71f2c17f3e72 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:52.593149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0b6a6e1-9d6b-41e2-a97c-71f2c17f3e72 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:52.595384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0b6a6e1-9d6b-41e2-a97c-71f2c17f3e72 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:52.598583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0b6a6e1-9d6b-41e2-a97c-71f2c17f3e72 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.253043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f69f9e6-a929-4d2a-9483-3f13b72d00aa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:53.254420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7f69f9e6-a929-4d2a-9483-3f13b72d00aa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:53.266802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f69f9e6-a929-4d2a-9483-3f13b72d00aa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.267305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f69f9e6-a929-4d2a-9483-3f13b72d00aa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.267749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f69f9e6-a929-4d2a-9483-3f13b72d00aa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.270731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f69f9e6-a929-4d2a-9483-3f13b72d00aa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.271492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f69f9e6-a929-4d2a-9483-3f13b72d00aa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.272520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f69f9e6-a929-4d2a-9483-3f13b72d00aa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.327055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e0b6a6e1-9d6b-41e2-a97c-71f2c17f3e72 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:53.346061 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e0b6a6e1-9d6b-41e2-a97c-71f2c17f3e72 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.801270 Oct 18 13:30:53.346874 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1553/3294] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:52 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:53.369621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2a2c5b6-8652-48ae-9c4d-7ba6079e8727 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:53.370779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d2a2c5b6-8652-48ae-9c4d-7ba6079e8727 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:53.377344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2a2c5b6-8652-48ae-9c4d-7ba6079e8727 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.377829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2a2c5b6-8652-48ae-9c4d-7ba6079e8727 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.378472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2a2c5b6-8652-48ae-9c4d-7ba6079e8727 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.379247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2a2c5b6-8652-48ae-9c4d-7ba6079e8727 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.379893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2a2c5b6-8652-48ae-9c4d-7ba6079e8727 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.380351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2a2c5b6-8652-48ae-9c4d-7ba6079e8727 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.396091 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-d2a2c5b6-8652-48ae-9c4d-7ba6079e8727 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] HTTP exception thrown: Instance 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff could not be found. Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2a2c5b6-8652-48ae-9c4d-7ba6079e8727 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Request method failure captured: Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff HTTP/1.1 Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqndNLs5iysNG23-990uCB6IZiSZkcLI4gL8Qkhkx6hDM3roQSaiGw3uN57kA58uDMNrm3neXJWgNJRAid03luKpDQ1sZv_fzgili9c_3TIxftm-KkB76hk5QD3QbHyppnfRAcigbOIXHX0jEj11r1ElaYHrcV6kpFMOD216mFEzEZU Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_caf4a24f687647e4a23fbee030d4e53a"}]}] Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 2cb58ae89a06444e95eca4c886e9cc0c Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff could not be found. Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '9553c0a8-d014-4d8f-a4c7-b21f44bb47ff'} Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff could not be found. Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff could not be found. Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:30:53.398423 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:53.402473 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:30:53.402473 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:30:53.402473 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:30:53.402473 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:30:53.402473 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:30:53.402473 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff could not be found. Oct 18 13:30:53.402473 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:30:53.403642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2a2c5b6-8652-48ae-9c4d-7ba6079e8727 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Returning 404 to user: Instance 9553c0a8-d014-4d8f-a4c7-b21f44bb47ff could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:30:53.404697 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d2a2c5b6-8652-48ae-9c4d-7ba6079e8727 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff" status: 404 len: 111 microversion: 2.1 time: 0.046031 Oct 18 13:30:53.405909 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1554/3295] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:53 2022] GET /compute/v2.1/servers/9553c0a8-d014-4d8f-a4c7-b21f44bb47ff => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:30:53.416233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-98bee026-ec84-4862-97c3-0da3068b6609 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:53.417091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-98bee026-ec84-4862-97c3-0da3068b6609 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: f95363be-8589-49f4-b67e-c4329353ab4d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:53.430778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98bee026-ec84-4862-97c3-0da3068b6609 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.431377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98bee026-ec84-4862-97c3-0da3068b6609 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.431923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98bee026-ec84-4862-97c3-0da3068b6609 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.433624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98bee026-ec84-4862-97c3-0da3068b6609 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.434163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98bee026-ec84-4862-97c3-0da3068b6609 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.434776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98bee026-ec84-4862-97c3-0da3068b6609 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.480133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-98bee026-ec84-4862-97c3-0da3068b6609 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: f95363be-8589-49f4-b67e-c4329353ab4d] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:30:53.627482 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-98bee026-ec84-4862-97c3-0da3068b6609 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d" status: 204 len: 0 microversion: 2.1 time: 0.215801 Oct 18 13:30:53.628134 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1555/3296] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:53 2022] DELETE /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:30:53.637352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31f9a3cc-e74e-43fc-a717-328194cda237 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:53.638289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-31f9a3cc-e74e-43fc-a717-328194cda237 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:53.648025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31f9a3cc-e74e-43fc-a717-328194cda237 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.648636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31f9a3cc-e74e-43fc-a717-328194cda237 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.649265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31f9a3cc-e74e-43fc-a717-328194cda237 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.650028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31f9a3cc-e74e-43fc-a717-328194cda237 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.650581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31f9a3cc-e74e-43fc-a717-328194cda237 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.651021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31f9a3cc-e74e-43fc-a717-328194cda237 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.717068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7f69f9e6-a929-4d2a-9483-3f13b72d00aa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:53.728209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7f69f9e6-a929-4d2a-9483-3f13b72d00aa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:53.730032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7f69f9e6-a929-4d2a-9483-3f13b72d00aa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:53.731258 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7f69f9e6-a929-4d2a-9483-3f13b72d00aa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.484010 Oct 18 13:30:53.732485 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1742/3297] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:53 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:53.737574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9cbe5cc5-cb87-4261-a8b9-c16b02b60f28 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:53.739124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9cbe5cc5-cb87-4261-a8b9-c16b02b60f28 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:53.746246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cbe5cc5-cb87-4261-a8b9-c16b02b60f28 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.746969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cbe5cc5-cb87-4261-a8b9-c16b02b60f28 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.747405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cbe5cc5-cb87-4261-a8b9-c16b02b60f28 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.748271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cbe5cc5-cb87-4261-a8b9-c16b02b60f28 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.748721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cbe5cc5-cb87-4261-a8b9-c16b02b60f28 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.749422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cbe5cc5-cb87-4261-a8b9-c16b02b60f28 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.814636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9cbe5cc5-cb87-4261-a8b9-c16b02b60f28 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:53.823693 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9cbe5cc5-cb87-4261-a8b9-c16b02b60f28 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1276 microversion: 2.1 time: 0.089601 Oct 18 13:30:53.824433 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1743/3298] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:53 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:53.829203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-38d363f1-a9b3-4a3d-8855-37484743fafb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:53.829965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-38d363f1-a9b3-4a3d-8855-37484743fafb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:53.836608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38d363f1-a9b3-4a3d-8855-37484743fafb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.837106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38d363f1-a9b3-4a3d-8855-37484743fafb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.837641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38d363f1-a9b3-4a3d-8855-37484743fafb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.838340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38d363f1-a9b3-4a3d-8855-37484743fafb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.838794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38d363f1-a9b3-4a3d-8855-37484743fafb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.839214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38d363f1-a9b3-4a3d-8855-37484743fafb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.868317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-38d363f1-a9b3-4a3d-8855-37484743fafb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:30:53.939764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:53.960568 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-38d363f1-a9b3-4a3d-8855-37484743fafb tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "DELETE /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 204 len: 0 microversion: 2.1 time: 0.134654 Oct 18 13:30:53.961546 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1744/3299] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:30:53 2022] DELETE /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:30:53.970393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a9e78459-1c10-4565-b98a-5730a3b0b711 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:53.973202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a9e78459-1c10-4565-b98a-5730a3b0b711 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: f95363be-8589-49f4-b67e-c4329353ab4d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:53.979331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9e78459-1c10-4565-b98a-5730a3b0b711 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.979825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9e78459-1c10-4565-b98a-5730a3b0b711 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.980401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9e78459-1c10-4565-b98a-5730a3b0b711 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:53.981362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9e78459-1c10-4565-b98a-5730a3b0b711 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:53.981889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9e78459-1c10-4565-b98a-5730a3b0b711 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:53.982501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9e78459-1c10-4565-b98a-5730a3b0b711 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.131526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a9e78459-1c10-4565-b98a-5730a3b0b711 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:54.139964 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a9e78459-1c10-4565-b98a-5730a3b0b711 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d" status: 200 len: 1475 microversion: 2.1 time: 0.174119 Oct 18 13:30:54.140554 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1745/3300] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:53 2022] GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d => generated 1475 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:54.232172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31f9a3cc-e74e-43fc-a717-328194cda237 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:54.245685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31f9a3cc-e74e-43fc-a717-328194cda237 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:54.247137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31f9a3cc-e74e-43fc-a717-328194cda237 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:54.248586 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31f9a3cc-e74e-43fc-a717-328194cda237 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 2504 microversion: 2.42 time: 0.619380 Oct 18 13:30:54.249659 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1556/3301] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:53 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 2504 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:54.387917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2da7d997-e809-43ce-992d-e5bc8d0f94c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:54.391438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2da7d997-e809-43ce-992d-e5bc8d0f94c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:54.409474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d05306c3-327a-4d07-aef9-33fd03c82dc3 req-a48900ce-a857-49f2-8bdc-2c46e26b0dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-deleted", "tag": "e53d609c-cb8b-4106-ad60-0cf706884abe"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:54.418086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2da7d997-e809-43ce-992d-e5bc8d0f94c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:54.422634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2da7d997-e809-43ce-992d-e5bc8d0f94c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:54.423413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2da7d997-e809-43ce-992d-e5bc8d0f94c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.427306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d05306c3-327a-4d07-aef9-33fd03c82dc3 req-a48900ce-a857-49f2-8bdc-2c46e26b0dd0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:54.427876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2da7d997-e809-43ce-992d-e5bc8d0f94c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:54.428918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2da7d997-e809-43ce-992d-e5bc8d0f94c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:54.429613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2da7d997-e809-43ce-992d-e5bc8d0f94c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.433988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d05306c3-327a-4d07-aef9-33fd03c82dc3 req-a48900ce-a857-49f2-8bdc-2c46e26b0dd0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:54.435630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d05306c3-327a-4d07-aef9-33fd03c82dc3 req-a48900ce-a857-49f2-8bdc-2c46e26b0dd0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.456715 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d05306c3-327a-4d07-aef9-33fd03c82dc3 req-a48900ce-a857-49f2-8bdc-2c46e26b0dd0 service nova] Creating event network-vif-deleted:e53d609c-cb8b-4106-ad60-0cf706884abe for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:30:54.463661 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d05306c3-327a-4d07-aef9-33fd03c82dc3 req-a48900ce-a857-49f2-8bdc-2c46e26b0dd0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058409 Oct 18 13:30:54.464937 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1557/3302] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:54.670634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2da7d997-e809-43ce-992d-e5bc8d0f94c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:54.678921 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2da7d997-e809-43ce-992d-e5bc8d0f94c3 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1680 microversion: 2.1 time: 0.307434 Oct 18 13:30:54.679522 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1746/3303] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:54 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1680 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:54.759354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f1f85934-bd01-4089-af45-6f2e3f21f6a1 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:54.760054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f1f85934-bd01-4089-af45-6f2e3f21f6a1 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:54.781334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1f85934-bd01-4089-af45-6f2e3f21f6a1 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:54.788451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1f85934-bd01-4089-af45-6f2e3f21f6a1 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:54.788970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1f85934-bd01-4089-af45-6f2e3f21f6a1 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.789765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1f85934-bd01-4089-af45-6f2e3f21f6a1 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:54.790237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1f85934-bd01-4089-af45-6f2e3f21f6a1 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:54.790838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1f85934-bd01-4089-af45-6f2e3f21f6a1 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.850670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-379466fd-6953-4e81-95df-f3ea52940084 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:54.851922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-379466fd-6953-4e81-95df-f3ea52940084 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:54.866982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-379466fd-6953-4e81-95df-f3ea52940084 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:54.867492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-379466fd-6953-4e81-95df-f3ea52940084 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:54.868899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-379466fd-6953-4e81-95df-f3ea52940084 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:54.869655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-379466fd-6953-4e81-95df-f3ea52940084 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:54.870128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-379466fd-6953-4e81-95df-f3ea52940084 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:54.874265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-379466fd-6953-4e81-95df-f3ea52940084 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:55.213384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f1f85934-bd01-4089-af45-6f2e3f21f6a1 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:55.235078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:55.242727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f1f85934-bd01-4089-af45-6f2e3f21f6a1 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:55.253420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f1f85934-bd01-4089-af45-6f2e3f21f6a1 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:55.254891 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f1f85934-bd01-4089-af45-6f2e3f21f6a1 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.500427 Oct 18 13:30:55.255462 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1558/3304] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:54 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:55.292869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4aabd0e6-2c40-4cc0-a8c3-4ca42416cd3b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:55.295416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4aabd0e6-2c40-4cc0-a8c3-4ca42416cd3b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: f95363be-8589-49f4-b67e-c4329353ab4d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:55.304735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4aabd0e6-2c40-4cc0-a8c3-4ca42416cd3b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:55.311024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4aabd0e6-2c40-4cc0-a8c3-4ca42416cd3b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:55.315210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4aabd0e6-2c40-4cc0-a8c3-4ca42416cd3b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:55.316331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4aabd0e6-2c40-4cc0-a8c3-4ca42416cd3b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:55.317028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4aabd0e6-2c40-4cc0-a8c3-4ca42416cd3b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:55.319925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4aabd0e6-2c40-4cc0-a8c3-4ca42416cd3b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:55.626990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-379466fd-6953-4e81-95df-f3ea52940084 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:55.640902 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-379466fd-6953-4e81-95df-f3ea52940084 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1318 microversion: 2.1 time: 0.796532 Oct 18 13:30:55.642088 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1747/3305] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:54 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1318 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:55.652148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-63cdd6aa-6445-4a9e-8390-8e1a1a18638c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:55.653104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-63cdd6aa-6445-4a9e-8390-8e1a1a18638c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:55.669379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63cdd6aa-6445-4a9e-8390-8e1a1a18638c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:55.670743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63cdd6aa-6445-4a9e-8390-8e1a1a18638c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:55.673842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63cdd6aa-6445-4a9e-8390-8e1a1a18638c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:55.681483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63cdd6aa-6445-4a9e-8390-8e1a1a18638c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:55.682648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63cdd6aa-6445-4a9e-8390-8e1a1a18638c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:55.683893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63cdd6aa-6445-4a9e-8390-8e1a1a18638c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.114661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-63cdd6aa-6445-4a9e-8390-8e1a1a18638c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:56.134472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-63cdd6aa-6445-4a9e-8390-8e1a1a18638c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:56.136180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-63cdd6aa-6445-4a9e-8390-8e1a1a18638c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:56.137733 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-63cdd6aa-6445-4a9e-8390-8e1a1a18638c tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 2344 microversion: 2.42 time: 0.494526 Oct 18 13:30:56.138321 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1748/3306] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:55 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 2344 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:56.143188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e12a1ebf-c833-495a-99d6-5082fd6f43cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:56.154258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e12a1ebf-c833-495a-99d6-5082fd6f43cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:56.168772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e12a1ebf-c833-495a-99d6-5082fd6f43cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.169596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e12a1ebf-c833-495a-99d6-5082fd6f43cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.170198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e12a1ebf-c833-495a-99d6-5082fd6f43cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.171068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e12a1ebf-c833-495a-99d6-5082fd6f43cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.171684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e12a1ebf-c833-495a-99d6-5082fd6f43cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.172269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e12a1ebf-c833-495a-99d6-5082fd6f43cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.589924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4aabd0e6-2c40-4cc0-a8c3-4ca42416cd3b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:56.598682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e12a1ebf-c833-495a-99d6-5082fd6f43cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:56.605585 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4aabd0e6-2c40-4cc0-a8c3-4ca42416cd3b tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d" status: 200 len: 1475 microversion: 2.1 time: 1.348256 Oct 18 13:30:56.614603 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e12a1ebf-c833-495a-99d6-5082fd6f43cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1657 microversion: 2.1 time: 0.473801 Oct 18 13:30:56.627873 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1559/3307] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:55 2022] GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d => generated 1475 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:56.629863 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1749/3308] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:56 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1657 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:56.638034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a541101b-6de0-4d99-a2c4-690902ae75ec tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:56.644542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-61b173ca-4f8d-49bf-822e-52c3382686d7 req-93be33a4-6518-4f46-acef-86499f5c04e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-deleted", "tag": "2979f9f0-551e-4518-be50-6140626a03d0"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:56.647202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a541101b-6de0-4d99-a2c4-690902ae75ec tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:56.659564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a541101b-6de0-4d99-a2c4-690902ae75ec tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.663874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-61b173ca-4f8d-49bf-822e-52c3382686d7 req-93be33a4-6518-4f46-acef-86499f5c04e3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.664554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-61b173ca-4f8d-49bf-822e-52c3382686d7 req-93be33a4-6518-4f46-acef-86499f5c04e3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.665172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-61b173ca-4f8d-49bf-822e-52c3382686d7 req-93be33a4-6518-4f46-acef-86499f5c04e3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.666008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a541101b-6de0-4d99-a2c4-690902ae75ec tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.666521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a541101b-6de0-4d99-a2c4-690902ae75ec tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.667472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a541101b-6de0-4d99-a2c4-690902ae75ec tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.667951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a541101b-6de0-4d99-a2c4-690902ae75ec tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.668392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a541101b-6de0-4d99-a2c4-690902ae75ec tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.689623 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-61b173ca-4f8d-49bf-822e-52c3382686d7 req-93be33a4-6518-4f46-acef-86499f5c04e3 service nova] Creating event network-vif-deleted:2979f9f0-551e-4518-be50-6140626a03d0 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:30:56.698817 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-61b173ca-4f8d-49bf-822e-52c3382686d7 req-93be33a4-6518-4f46-acef-86499f5c04e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067292 Oct 18 13:30:56.701142 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1750/3309] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:56.707578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed91ed2b-3554-4198-938b-1ae18906906a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:56.714543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed91ed2b-3554-4198-938b-1ae18906906a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.715401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed91ed2b-3554-4198-938b-1ae18906906a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.716086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed91ed2b-3554-4198-938b-1ae18906906a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.744923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ed91ed2b-3554-4198-938b-1ae18906906a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Going to try to start instance {{(pid=120611) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 13:30:56.842009 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ed91ed2b-3554-4198-938b-1ae18906906a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.138958 Oct 18 13:30:56.848458 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1751/3310] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:30:56 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:30:56.861998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-efc491e7-ccf7-4861-bd9b-38c55ae58de8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:56.866297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-efc491e7-ccf7-4861-bd9b-38c55ae58de8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:56.875590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efc491e7-ccf7-4861-bd9b-38c55ae58de8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.876186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efc491e7-ccf7-4861-bd9b-38c55ae58de8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.876943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efc491e7-ccf7-4861-bd9b-38c55ae58de8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.878001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efc491e7-ccf7-4861-bd9b-38c55ae58de8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:56.878720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efc491e7-ccf7-4861-bd9b-38c55ae58de8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:56.879436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efc491e7-ccf7-4861-bd9b-38c55ae58de8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:56.902195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:57.280062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-efc491e7-ccf7-4861-bd9b-38c55ae58de8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:57.297564 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-efc491e7-ccf7-4861-bd9b-38c55ae58de8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1318 microversion: 2.1 time: 0.442568 Oct 18 13:30:57.318449 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1752/3311] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:56 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:57.341601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c1954b94-5edc-4066-a8d7-c2f730e40056 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:57.342539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c1954b94-5edc-4066-a8d7-c2f730e40056 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:57.358065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1954b94-5edc-4066-a8d7-c2f730e40056 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:57.359582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1954b94-5edc-4066-a8d7-c2f730e40056 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:57.361454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1954b94-5edc-4066-a8d7-c2f730e40056 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.366253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1954b94-5edc-4066-a8d7-c2f730e40056 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:57.367874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1954b94-5edc-4066-a8d7-c2f730e40056 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:57.376740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1954b94-5edc-4066-a8d7-c2f730e40056 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.745724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c1954b94-5edc-4066-a8d7-c2f730e40056 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:57.773133 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c1954b94-5edc-4066-a8d7-c2f730e40056 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1666 microversion: 2.1 time: 0.448028 Oct 18 13:30:57.777445 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1753/3312] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:57 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1666 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:57.784108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-6459e2c6-e53e-487d-96bf-b36d0aacfa4a req-5f1d443c-01f1-4378-96e4-eaa66977572c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95363be-8589-49f4-b67e-c4329353ab4d", "name": "network-vif-deleted", "tag": "33dfd4a6-9d84-4219-a3c9-213dce92ae9e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:57.824627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6459e2c6-e53e-487d-96bf-b36d0aacfa4a req-5f1d443c-01f1-4378-96e4-eaa66977572c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:57.825110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6459e2c6-e53e-487d-96bf-b36d0aacfa4a req-5f1d443c-01f1-4378-96e4-eaa66977572c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:57.836369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6459e2c6-e53e-487d-96bf-b36d0aacfa4a req-5f1d443c-01f1-4378-96e4-eaa66977572c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.851954 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-6459e2c6-e53e-487d-96bf-b36d0aacfa4a req-5f1d443c-01f1-4378-96e4-eaa66977572c service nova] Creating event network-vif-deleted:33dfd4a6-9d84-4219-a3c9-213dce92ae9e for instance f95363be-8589-49f4-b67e-c4329353ab4d on n-h1-858384-13 Oct 18 13:30:57.868859 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-6459e2c6-e53e-487d-96bf-b36d0aacfa4a req-5f1d443c-01f1-4378-96e4-eaa66977572c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090063 Oct 18 13:30:57.870964 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1754/3313] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:57.880439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3751beac-9e04-487a-a779-1c018ea09b67 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:57.883165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3751beac-9e04-487a-a779-1c018ea09b67 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:57.892685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3751beac-9e04-487a-a779-1c018ea09b67 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:57.893679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3751beac-9e04-487a-a779-1c018ea09b67 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:57.894429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3751beac-9e04-487a-a779-1c018ea09b67 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.895398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3751beac-9e04-487a-a779-1c018ea09b67 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:57.897524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3751beac-9e04-487a-a779-1c018ea09b67 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:57.915233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3751beac-9e04-487a-a779-1c018ea09b67 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:57.986526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a541101b-6de0-4d99-a2c4-690902ae75ec tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:58.001318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a541101b-6de0-4d99-a2c4-690902ae75ec tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:58.005973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a541101b-6de0-4d99-a2c4-690902ae75ec tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:58.009935 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a541101b-6de0-4d99-a2c4-690902ae75ec tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 1.380333 Oct 18 13:30:58.012995 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1560/3314] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:56 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:58.019387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:58.023431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: f95363be-8589-49f4-b67e-c4329353ab4d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:58.060873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.064857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.067103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.068831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.071557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.075403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.180276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3751beac-9e04-487a-a779-1c018ea09b67 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:58.186188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.187228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.192926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.193893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lazy-loading 'fault' on Instance uuid f95363be-8589-49f4-b67e-c4329353ab4d {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:30:58.194685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3751beac-9e04-487a-a779-1c018ea09b67 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:58.197209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3751beac-9e04-487a-a779-1c018ea09b67 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:58.199374 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3751beac-9e04-487a-a779-1c018ea09b67 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 2053 microversion: 2.42 time: 0.326089 Oct 18 13:30:58.201040 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1755/3315] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:57 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 2053 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:58.326065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-003e21ff-67ce-4180-8884-ec96bc38f9b5 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:58.326727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-003e21ff-67ce-4180-8884-ec96bc38f9b5 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:58.336461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:58.347077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-003e21ff-67ce-4180-8884-ec96bc38f9b5 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.348118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-003e21ff-67ce-4180-8884-ec96bc38f9b5 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.348749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-003e21ff-67ce-4180-8884-ec96bc38f9b5 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.349723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-003e21ff-67ce-4180-8884-ec96bc38f9b5 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.350528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-003e21ff-67ce-4180-8884-ec96bc38f9b5 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.351110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-003e21ff-67ce-4180-8884-ec96bc38f9b5 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.402595 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d0125f4b-12f2-40f3-8e54-2241f4a858f0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d" status: 200 len: 1309 microversion: 2.1 time: 0.386850 Oct 18 13:30:58.433064 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1561/3316] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:58 2022] GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d => generated 1309 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:58.804108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-57c77f66-108e-48ed-ad99-67c79c569f13 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:58.805142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-57c77f66-108e-48ed-ad99-67c79c569f13 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:58.822498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57c77f66-108e-48ed-ad99-67c79c569f13 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.831677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57c77f66-108e-48ed-ad99-67c79c569f13 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.841936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57c77f66-108e-48ed-ad99-67c79c569f13 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.842706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57c77f66-108e-48ed-ad99-67c79c569f13 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:58.843178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57c77f66-108e-48ed-ad99-67c79c569f13 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:58.843588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57c77f66-108e-48ed-ad99-67c79c569f13 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:58.906639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:58.939195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:30:59.210503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-003e21ff-67ce-4180-8884-ec96bc38f9b5 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:59.219759 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-003e21ff-67ce-4180-8884-ec96bc38f9b5 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1318 microversion: 2.1 time: 0.897451 Oct 18 13:30:59.230109 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1756/3317] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:58 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1318 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:30:59.244020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-18052bc4-559d-4cbc-a536-25da6eb35fb9 req-4fa46d1b-136f-46e0-8161-fa744fd17a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f9fab1-89bc-4227-a832-a4306f609784", "name": "network-vif-deleted", "tag": "2e329f36-eac9-421b-9ccb-6d67f90e37ef"}, {"server_uuid": "f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567", "name": "network-vif-deleted", "tag": "dd1adc7a-80d9-4f8e-9246-b25315711c34"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:30:59.287681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-18052bc4-559d-4cbc-a536-25da6eb35fb9 req-4fa46d1b-136f-46e0-8161-fa744fd17a06 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.292685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-18052bc4-559d-4cbc-a536-25da6eb35fb9 req-4fa46d1b-136f-46e0-8161-fa744fd17a06 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.295392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-18052bc4-559d-4cbc-a536-25da6eb35fb9 req-4fa46d1b-136f-46e0-8161-fa744fd17a06 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:59.337890 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-18052bc4-559d-4cbc-a536-25da6eb35fb9 req-4fa46d1b-136f-46e0-8161-fa744fd17a06 service nova] Creating event network-vif-deleted:2e329f36-eac9-421b-9ccb-6d67f90e37ef for instance 20f9fab1-89bc-4227-a832-a4306f609784 on n-h2-858384-13 Oct 18 13:30:59.339355 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-18052bc4-559d-4cbc-a536-25da6eb35fb9 req-4fa46d1b-136f-46e0-8161-fa744fd17a06 service nova] Creating event network-vif-deleted:dd1adc7a-80d9-4f8e-9246-b25315711c34 for instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 on n-h1-858384-13 Oct 18 13:30:59.361868 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-18052bc4-559d-4cbc-a536-25da6eb35fb9 req-4fa46d1b-136f-46e0-8161-fa744fd17a06 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.129920 Oct 18 13:30:59.362976 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1757/3318] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:30:59.380739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9a76478e-e0e3-4a24-bf7c-9277093ca586 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:59.381680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9a76478e-e0e3-4a24-bf7c-9277093ca586 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:59.408642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a76478e-e0e3-4a24-bf7c-9277093ca586 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.409343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a76478e-e0e3-4a24-bf7c-9277093ca586 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.414682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a76478e-e0e3-4a24-bf7c-9277093ca586 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:59.415736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a76478e-e0e3-4a24-bf7c-9277093ca586 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.416311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a76478e-e0e3-4a24-bf7c-9277093ca586 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.416820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a76478e-e0e3-4a24-bf7c-9277093ca586 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:59.513400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-57c77f66-108e-48ed-ad99-67c79c569f13 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:59.521904 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-57c77f66-108e-48ed-ad99-67c79c569f13 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1666 microversion: 2.1 time: 0.725481 Oct 18 13:30:59.540598 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1562/3319] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:58 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1666 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:30:59.553320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0f15f2d-03b6-48ca-87e7-712f2ca34adb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:59.569470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c0f15f2d-03b6-48ca-87e7-712f2ca34adb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:59.592133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0f15f2d-03b6-48ca-87e7-712f2ca34adb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.595813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0f15f2d-03b6-48ca-87e7-712f2ca34adb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.596432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0f15f2d-03b6-48ca-87e7-712f2ca34adb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:59.599470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0f15f2d-03b6-48ca-87e7-712f2ca34adb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.600914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0f15f2d-03b6-48ca-87e7-712f2ca34adb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.601670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0f15f2d-03b6-48ca-87e7-712f2ca34adb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:59.859357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c0f15f2d-03b6-48ca-87e7-712f2ca34adb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:59.900829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c0f15f2d-03b6-48ca-87e7-712f2ca34adb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:59.907777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c0f15f2d-03b6-48ca-87e7-712f2ca34adb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:30:59.927942 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c0f15f2d-03b6-48ca-87e7-712f2ca34adb tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.370469 Oct 18 13:30:59.934902 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1563/3320] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:59 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:30:59.964531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e9b9268a-2fe5-4672-a386-11421c7d24a4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:30:59.965158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e9b9268a-2fe5-4672-a386-11421c7d24a4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: f95363be-8589-49f4-b67e-c4329353ab4d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:30:59.985654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9b9268a-2fe5-4672-a386-11421c7d24a4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.986153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9b9268a-2fe5-4672-a386-11421c7d24a4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.986586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9b9268a-2fe5-4672-a386-11421c7d24a4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:30:59.990463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9b9268a-2fe5-4672-a386-11421c7d24a4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:30:59.991779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9b9268a-2fe5-4672-a386-11421c7d24a4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:30:59.992384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9b9268a-2fe5-4672-a386-11421c7d24a4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.026800 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e9b9268a-2fe5-4672-a386-11421c7d24a4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] HTTP exception thrown: Instance f95363be-8589-49f4-b67e-c4329353ab4d could not be found. Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e9b9268a-2fe5-4672-a386-11421c7d24a4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Request method failure captured: Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d HTTP/1.1 Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqndNLs5iysNG23-990uCB6IZiSZkcLI4gL8Qkhkx6hDM3roQSaiGw3uN57kA58uDMNrm3neXJWgNJRAid03luKpDQ1sZv_fzgili9c_3TIxftm-KkB76hk5QD3QbHyppnfRAcigbOIXHX0jEj11r1ElaYHrcV6kpFMOD216mFEzEZU Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_caf4a24f687647e4a23fbee030d4e53a"}]}] Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 2cb58ae89a06444e95eca4c886e9cc0c Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance f95363be-8589-49f4-b67e-c4329353ab4d could not be found. Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'f95363be-8589-49f4-b67e-c4329353ab4d'} Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f95363be-8589-49f4-b67e-c4329353ab4d could not be found. Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f95363be-8589-49f4-b67e-c4329353ab4d could not be found. Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:00.030710 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:00.038497 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:00.038497 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:00.038497 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:00.038497 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:00.038497 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:00.038497 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f95363be-8589-49f4-b67e-c4329353ab4d could not be found. Oct 18 13:31:00.038497 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:00.038497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e9b9268a-2fe5-4672-a386-11421c7d24a4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Returning 404 to user: Instance f95363be-8589-49f4-b67e-c4329353ab4d could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:00.038497 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e9b9268a-2fe5-4672-a386-11421c7d24a4 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d" status: 404 len: 111 microversion: 2.1 time: 0.095158 Oct 18 13:31:00.039182 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1564/3321] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:30:59 2022] GET /compute/v2.1/servers/f95363be-8589-49f4-b67e-c4329353ab4d => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:00.043339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-60a1999b-411c-4b69-be5e-218f90dc5ed9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:00.043951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-60a1999b-411c-4b69-be5e-218f90dc5ed9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 20f9fab1-89bc-4227-a832-a4306f609784] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:00.060985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60a1999b-411c-4b69-be5e-218f90dc5ed9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.062900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60a1999b-411c-4b69-be5e-218f90dc5ed9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.065497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60a1999b-411c-4b69-be5e-218f90dc5ed9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.067517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60a1999b-411c-4b69-be5e-218f90dc5ed9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.068685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60a1999b-411c-4b69-be5e-218f90dc5ed9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.069120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60a1999b-411c-4b69-be5e-218f90dc5ed9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.120271 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-60a1999b-411c-4b69-be5e-218f90dc5ed9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] HTTP exception thrown: Instance 20f9fab1-89bc-4227-a832-a4306f609784 could not be found. Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-60a1999b-411c-4b69-be5e-218f90dc5ed9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Request method failure captured: Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 HTTP/1.1 Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqndNLs5iysNG23-990uCB6IZiSZkcLI4gL8Qkhkx6hDM3roQSaiGw3uN57kA58uDMNrm3neXJWgNJRAid03luKpDQ1sZv_fzgili9c_3TIxftm-KkB76hk5QD3QbHyppnfRAcigbOIXHX0jEj11r1ElaYHrcV6kpFMOD216mFEzEZU Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_caf4a24f687647e4a23fbee030d4e53a"}]}] Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 2cb58ae89a06444e95eca4c886e9cc0c Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 20f9fab1-89bc-4227-a832-a4306f609784 could not be found. Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '20f9fab1-89bc-4227-a832-a4306f609784'} Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f9fab1-89bc-4227-a832-a4306f609784 could not be found. Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f9fab1-89bc-4227-a832-a4306f609784 could not be found. Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:00.121851 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:00.125943 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:00.125943 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:00.125943 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:00.125943 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:00.125943 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:00.125943 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f9fab1-89bc-4227-a832-a4306f609784 could not be found. Oct 18 13:31:00.125943 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:00.125943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-60a1999b-411c-4b69-be5e-218f90dc5ed9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Returning 404 to user: Instance 20f9fab1-89bc-4227-a832-a4306f609784 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:00.125943 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-60a1999b-411c-4b69-be5e-218f90dc5ed9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784" status: 404 len: 111 microversion: 2.1 time: 0.083710 Oct 18 13:31:00.125943 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1565/3322] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:00 2022] GET /compute/v2.1/servers/20f9fab1-89bc-4227-a832-a4306f609784 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:00.132181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-523b3835-58a5-4631-87a0-67d9a5a26044 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:00.155140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:00.212953 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-523b3835-58a5-4631-87a0-67d9a5a26044 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/1f4cebc3-5166-4ca3-bd1b-22fa3064d4a7" status: 204 len: 0 microversion: 2.1 time: 0.084546 Oct 18 13:31:00.216549 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1566/3323] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 18 13:31:00 2022] DELETE /compute/v2.1/os-server-groups/1f4cebc3-5166-4ca3-bd1b-22fa3064d4a7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:00.221780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-852f0e83-1cb2-42fe-b6eb-3a89e51ea7b3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:00.222907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-852f0e83-1cb2-42fe-b6eb-3a89e51ea7b3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:00.238398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-852f0e83-1cb2-42fe-b6eb-3a89e51ea7b3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.238823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-852f0e83-1cb2-42fe-b6eb-3a89e51ea7b3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.239349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-852f0e83-1cb2-42fe-b6eb-3a89e51ea7b3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.240066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-852f0e83-1cb2-42fe-b6eb-3a89e51ea7b3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.240519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-852f0e83-1cb2-42fe-b6eb-3a89e51ea7b3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.241057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-852f0e83-1cb2-42fe-b6eb-3a89e51ea7b3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.308987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-852f0e83-1cb2-42fe-b6eb-3a89e51ea7b3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:00.433067 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-852f0e83-1cb2-42fe-b6eb-3a89e51ea7b3 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d" status: 204 len: 0 microversion: 2.1 time: 0.214027 Oct 18 13:31:00.433992 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1567/3324] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:00 2022] DELETE /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:00.439039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-61def8f4-a972-45e4-ae12-7075e45abf4c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:00.441815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-61def8f4-a972-45e4-ae12-7075e45abf4c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:00.450385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61def8f4-a972-45e4-ae12-7075e45abf4c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.451400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61def8f4-a972-45e4-ae12-7075e45abf4c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.452029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61def8f4-a972-45e4-ae12-7075e45abf4c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.453041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61def8f4-a972-45e4-ae12-7075e45abf4c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.453761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61def8f4-a972-45e4-ae12-7075e45abf4c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.454353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61def8f4-a972-45e4-ae12-7075e45abf4c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.580624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9a76478e-e0e3-4a24-bf7c-9277093ca586 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:00.599326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9a76478e-e0e3-4a24-bf7c-9277093ca586 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:00.601231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9a76478e-e0e3-4a24-bf7c-9277093ca586 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:00.618759 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9a76478e-e0e3-4a24-bf7c-9277093ca586 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 1.244437 Oct 18 13:31:00.619564 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1758/3325] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:30:59 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:00.624073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2a704b6f-e665-4b4d-bb3e-5e16e5c6ba07 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:00.624788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2a704b6f-e665-4b4d-bb3e-5e16e5c6ba07 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:00.631634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a704b6f-e665-4b4d-bb3e-5e16e5c6ba07 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.632502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a704b6f-e665-4b4d-bb3e-5e16e5c6ba07 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.633090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a704b6f-e665-4b4d-bb3e-5e16e5c6ba07 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.633980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a704b6f-e665-4b4d-bb3e-5e16e5c6ba07 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.634599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a704b6f-e665-4b4d-bb3e-5e16e5c6ba07 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.635189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a704b6f-e665-4b4d-bb3e-5e16e5c6ba07 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.668229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2a704b6f-e665-4b4d-bb3e-5e16e5c6ba07 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:00.753274 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2a704b6f-e665-4b4d-bb3e-5e16e5c6ba07 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "DELETE /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 204 len: 0 microversion: 2.1 time: 0.132396 Oct 18 13:31:00.753893 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1759/3326] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:00 2022] DELETE /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:00.806373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-61def8f4-a972-45e4-ae12-7075e45abf4c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:00.820650 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-61def8f4-a972-45e4-ae12-7075e45abf4c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1318 microversion: 2.1 time: 0.385707 Oct 18 13:31:00.837263 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1568/3327] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:00 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:00.842313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f672dde2-c36e-4cdf-bc6e-191f88f965b0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:00.843128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f672dde2-c36e-4cdf-bc6e-191f88f965b0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:00.850423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f672dde2-c36e-4cdf-bc6e-191f88f965b0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.851135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f672dde2-c36e-4cdf-bc6e-191f88f965b0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.851778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f672dde2-c36e-4cdf-bc6e-191f88f965b0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.852642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f672dde2-c36e-4cdf-bc6e-191f88f965b0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:00.853374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f672dde2-c36e-4cdf-bc6e-191f88f965b0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:00.854022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f672dde2-c36e-4cdf-bc6e-191f88f965b0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:00.937882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c9ca907f-5812-4eee-a7f8-c3fb3360cd58 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Calling method '.version_select at 0x7ff60f23b9d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:01.042469 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c9ca907f-5812-4eee-a7f8-c3fb3360cd58 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0" status: 200 len: 371 microversion: 2.1 time: 0.286795 Oct 18 13:31:01.044203 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1760/3328] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 18 13:31:00 2022] GET /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0 => generated 371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:01.051530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-57520663-c3ea-42f8-9dd3-db050da8e0a9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:01.054685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-57520663-c3ea-42f8-9dd3-db050da8e0a9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:01.063084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57520663-c3ea-42f8-9dd3-db050da8e0a9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.064635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57520663-c3ea-42f8-9dd3-db050da8e0a9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.065081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57520663-c3ea-42f8-9dd3-db050da8e0a9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.066726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57520663-c3ea-42f8-9dd3-db050da8e0a9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.067921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57520663-c3ea-42f8-9dd3-db050da8e0a9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.068649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57520663-c3ea-42f8-9dd3-db050da8e0a9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.074777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f672dde2-c36e-4cdf-bc6e-191f88f965b0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:01.104344 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f672dde2-c36e-4cdf-bc6e-191f88f965b0 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1666 microversion: 2.1 time: 0.265697 Oct 18 13:31:01.105401 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1569/3329] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:00 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1666 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:01.110617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-66fe0788-6ad6-4e83-9132-a870b27e9391 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:01.111538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-66fe0788-6ad6-4e83-9132-a870b27e9391 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:01.118375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66fe0788-6ad6-4e83-9132-a870b27e9391 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.119155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66fe0788-6ad6-4e83-9132-a870b27e9391 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.119863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66fe0788-6ad6-4e83-9132-a870b27e9391 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.120794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66fe0788-6ad6-4e83-9132-a870b27e9391 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.121545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66fe0788-6ad6-4e83-9132-a870b27e9391 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.122193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66fe0788-6ad6-4e83-9132-a870b27e9391 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.205577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-66fe0788-6ad6-4e83-9132-a870b27e9391 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:01.217289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-66fe0788-6ad6-4e83-9132-a870b27e9391 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:01.218746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-66fe0788-6ad6-4e83-9132-a870b27e9391 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:01.219961 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-66fe0788-6ad6-4e83-9132-a870b27e9391 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.113185 Oct 18 13:31:01.220901 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1570/3330] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:01 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:01.226340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-47369b88-d998-42f6-8844-efd2fc2f13dd tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Action: 'update', calling method: .version_select at 0x7ff60f7a2280>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:01.304073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-57520663-c3ea-42f8-9dd3-db050da8e0a9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:01.313414 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-57520663-c3ea-42f8-9dd3-db050da8e0a9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d" status: 200 len: 1474 microversion: 2.1 time: 0.267729 Oct 18 13:31:01.314805 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1761/3331] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:01 2022] GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d => generated 1474 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:01.427652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f72bbc31-ee14-47b0-9eae-ec4eefb28f5c req-a2dc050e-3340-4be8-9347-6a8a07c338a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "206ae481-4890-46be-a0eb-83a6f22eb0b6", "tag": "66a40b29-9fc8-40b9-b9d7-336889430bb8"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:01.437670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f72bbc31-ee14-47b0-9eae-ec4eefb28f5c req-a2dc050e-3340-4be8-9347-6a8a07c338a3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.438406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f72bbc31-ee14-47b0-9eae-ec4eefb28f5c req-a2dc050e-3340-4be8-9347-6a8a07c338a3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.439065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f72bbc31-ee14-47b0-9eae-ec4eefb28f5c req-a2dc050e-3340-4be8-9347-6a8a07c338a3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.452656 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f72bbc31-ee14-47b0-9eae-ec4eefb28f5c req-a2dc050e-3340-4be8-9347-6a8a07c338a3 service nova] Creating event network-changed:66a40b29-9fc8-40b9-b9d7-336889430bb8 for instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 on n-h2-858384-13 Oct 18 13:31:01.458649 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f72bbc31-ee14-47b0-9eae-ec4eefb28f5c req-a2dc050e-3340-4be8-9347-6a8a07c338a3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035548 Oct 18 13:31:01.459737 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1762/3332] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:31:01.507061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47369b88-d998-42f6-8844-efd2fc2f13dd tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.507455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47369b88-d998-42f6-8844-efd2fc2f13dd tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.507903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47369b88-d998-42f6-8844-efd2fc2f13dd tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.508708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47369b88-d998-42f6-8844-efd2fc2f13dd tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.509088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47369b88-d998-42f6-8844-efd2fc2f13dd tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.509558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47369b88-d998-42f6-8844-efd2fc2f13dd tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.564324 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-47369b88-d998-42f6-8844-efd2fc2f13dd tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0" status: 200 len: 328 microversion: 2.1 time: 0.341851 Oct 18 13:31:01.566516 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1571/3333] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:31:01 2022] PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0 => generated 328 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:01.650257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-389a44d6-9a7f-4b23-8eaa-83a398fb9b61 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:01.652560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-389a44d6-9a7f-4b23-8eaa-83a398fb9b61 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:01.662380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-389a44d6-9a7f-4b23-8eaa-83a398fb9b61 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.663494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-389a44d6-9a7f-4b23-8eaa-83a398fb9b61 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.664530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-389a44d6-9a7f-4b23-8eaa-83a398fb9b61 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.666026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-389a44d6-9a7f-4b23-8eaa-83a398fb9b61 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:01.666815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-389a44d6-9a7f-4b23-8eaa-83a398fb9b61 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:01.667538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-389a44d6-9a7f-4b23-8eaa-83a398fb9b61 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:01.851220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1490857193", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:01.920195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:31:01.989412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-389a44d6-9a7f-4b23-8eaa-83a398fb9b61 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.000021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-389a44d6-9a7f-4b23-8eaa-83a398fb9b61 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.002391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-389a44d6-9a7f-4b23-8eaa-83a398fb9b61 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.004980 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-389a44d6-9a7f-4b23-8eaa-83a398fb9b61 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.360688 Oct 18 13:31:02.006554 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1763/3334] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:01 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:02.025446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-52f92304-169c-4f56-8b10-3d624d5767b2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:02.026502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-52f92304-169c-4f56-8b10-3d624d5767b2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:02.033779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52f92304-169c-4f56-8b10-3d624d5767b2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.034912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52f92304-169c-4f56-8b10-3d624d5767b2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.035677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52f92304-169c-4f56-8b10-3d624d5767b2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.036842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52f92304-169c-4f56-8b10-3d624d5767b2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.037684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52f92304-169c-4f56-8b10-3d624d5767b2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.038338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52f92304-169c-4f56-8b10-3d624d5767b2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.272571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-52f92304-169c-4f56-8b10-3d624d5767b2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.289196 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-52f92304-169c-4f56-8b10-3d624d5767b2 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1318 microversion: 2.1 time: 0.276297 Oct 18 13:31:02.290625 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1764/3335] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:02 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:02.299827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-566dcd47-c3e7-4986-9ee5-99fcc6c2b584 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:02.300837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-566dcd47-c3e7-4986-9ee5-99fcc6c2b584 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:02.315567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-566dcd47-c3e7-4986-9ee5-99fcc6c2b584 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.317481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-566dcd47-c3e7-4986-9ee5-99fcc6c2b584 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.318425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-566dcd47-c3e7-4986-9ee5-99fcc6c2b584 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.322685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-566dcd47-c3e7-4986-9ee5-99fcc6c2b584 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.323525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-566dcd47-c3e7-4986-9ee5-99fcc6c2b584 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.324146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-566dcd47-c3e7-4986-9ee5-99fcc6c2b584 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.480932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:31:02.481671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:31:02.482372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:31:02.482880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:31:02.483702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:31:02.500712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.502802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.505376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.506260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.508381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.509871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.541875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Getting quotas for project b3d9afff3ff44d55aafe117fc403bae0. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:02.551505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Getting quotas for user 7119fc5d72a94a508e4742284107a36e and project b3d9afff3ff44d55aafe117fc403bae0. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:02.572562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.utils [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] cores quota exceeded for b3d9afff3ff44d55aafe117fc403bae0, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120612) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 18 13:31:02.574387 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 13:31:02.585455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-566dcd47-c3e7-4986-9ee5-99fcc6c2b584 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.615633 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-566dcd47-c3e7-4986-9ee5-99fcc6c2b584 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1666 microversion: 2.1 time: 0.322903 Oct 18 13:31:02.616830 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1765/3336] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:02 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1666 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Request method failure captured: Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 145 Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqqS6v-wRn6RElDwl0Q0sUW5ge1WQhXVpxzVRWxFRW1A5TfbyiPCwIsat8zuAhz-jKI--zKP6c_yKUi4_Bq4e3x-3ovp1IZDNFH9WdZnah0cq_YvXolvy3Wr8dMZkThI2Fqiq-thfYwctGurOI_J_Z92TGHZo8IapC2U0wP59SqkcCM Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b3d9afff3ff44d55aafe117fc403bae0 Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-QuotasAdminNegativeTest-547056400 Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3d9afff3ff44d55aafe117fc403bae0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b3d9afff3ff44d55aafe117fc403bae0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3d9afff3ff44d55aafe117fc403bae0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b3d9afff3ff44d55aafe117fc403bae0"}]}] Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-QuotasAdminNegativeTest-547056400 Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b3d9afff3ff44d55aafe117fc403bae0 Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-547056400 Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-QuotasAdminNegativeTest-547056400-project Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7119fc5d72a94a508e4742284107a36e Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-QuotasAdminNegativeTest-547056400-project Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1490857193", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1490857193', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452'}}} Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:31:02.622121 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 18 13:31:02.626733 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:02.632303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:02.634035 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b8300f7e-9af0-474e-9c7b-7556a2776b85 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.955332 Oct 18 13:31:02.636351 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1572/3337] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:31:01 2022] POST /compute/v2.1/servers => generated 111 bytes in 958 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:02.643295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2083ef05-9615-4816-b1d8-0941c24bae4f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:02.648487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2083ef05-9615-4816-b1d8-0941c24bae4f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:02.652206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cdabaafe-7efe-4d42-9cbf-713b594199e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:02.653123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cdabaafe-7efe-4d42-9cbf-713b594199e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:02.664285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2083ef05-9615-4816-b1d8-0941c24bae4f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.666320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2083ef05-9615-4816-b1d8-0941c24bae4f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.669622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2083ef05-9615-4816-b1d8-0941c24bae4f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.670948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2083ef05-9615-4816-b1d8-0941c24bae4f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.671910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cdabaafe-7efe-4d42-9cbf-713b594199e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.672534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2083ef05-9615-4816-b1d8-0941c24bae4f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.673402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cdabaafe-7efe-4d42-9cbf-713b594199e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.674857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2083ef05-9615-4816-b1d8-0941c24bae4f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.675655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cdabaafe-7efe-4d42-9cbf-713b594199e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.679330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cdabaafe-7efe-4d42-9cbf-713b594199e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:02.680090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cdabaafe-7efe-4d42-9cbf-713b594199e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:02.681283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cdabaafe-7efe-4d42-9cbf-713b594199e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:02.828236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2083ef05-9615-4816-b1d8-0941c24bae4f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.843564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2083ef05-9615-4816-b1d8-0941c24bae4f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.844882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2083ef05-9615-4816-b1d8-0941c24bae4f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.846415 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2083ef05-9615-4816-b1d8-0941c24bae4f tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.226560 Oct 18 13:31:02.847065 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1766/3338] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:02 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:02.859773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b53858ac-6a13-4c05-988d-d8b0ca76079c tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Action: 'update', calling method: .version_select at 0x7ff60eff6790>, body: {"quota_set": {"cores": 20}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:02.989504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cdabaafe-7efe-4d42-9cbf-713b594199e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:02.997414 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cdabaafe-7efe-4d42-9cbf-713b594199e9 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d" status: 200 len: 1474 microversion: 2.1 time: 0.355706 Oct 18 13:31:02.997998 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1573/3339] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:02 2022] GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d => generated 1474 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:03.004603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c77f08ca-eee0-449a-bd85-04d5a9f60cf1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:03.005373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c77f08ca-eee0-449a-bd85-04d5a9f60cf1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:03.017807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c77f08ca-eee0-449a-bd85-04d5a9f60cf1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.020667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c77f08ca-eee0-449a-bd85-04d5a9f60cf1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.021751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c77f08ca-eee0-449a-bd85-04d5a9f60cf1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.022821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c77f08ca-eee0-449a-bd85-04d5a9f60cf1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.023500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c77f08ca-eee0-449a-bd85-04d5a9f60cf1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.024249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c77f08ca-eee0-449a-bd85-04d5a9f60cf1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.056954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c77f08ca-eee0-449a-bd85-04d5a9f60cf1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:03.152369 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c77f08ca-eee0-449a-bd85-04d5a9f60cf1 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 204 len: 0 microversion: 2.1 time: 0.151770 Oct 18 13:31:03.153707 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1574/3340] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:02 2022] DELETE /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:03.160442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d4f29933-6f0a-4b85-8ae0-705673aebe3c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:03.161562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d4f29933-6f0a-4b85-8ae0-705673aebe3c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:03.168472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4f29933-6f0a-4b85-8ae0-705673aebe3c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.169382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4f29933-6f0a-4b85-8ae0-705673aebe3c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.170021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4f29933-6f0a-4b85-8ae0-705673aebe3c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.170873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4f29933-6f0a-4b85-8ae0-705673aebe3c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.171420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4f29933-6f0a-4b85-8ae0-705673aebe3c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.171946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4f29933-6f0a-4b85-8ae0-705673aebe3c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.192625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:03.249151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b53858ac-6a13-4c05-988d-d8b0ca76079c tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.249670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b53858ac-6a13-4c05-988d-d8b0ca76079c tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.250117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b53858ac-6a13-4c05-988d-d8b0ca76079c tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.250855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b53858ac-6a13-4c05-988d-d8b0ca76079c tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.251317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b53858ac-6a13-4c05-988d-d8b0ca76079c tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.251757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b53858ac-6a13-4c05-988d-d8b0ca76079c tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.379970 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b53858ac-6a13-4c05-988d-d8b0ca76079c tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0" status: 200 len: 329 microversion: 2.1 time: 0.531306 Oct 18 13:31:03.381136 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1767/3341] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:31:02 2022] PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0 => generated 329 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:03.387296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-97b7693c-dd8f-4d6b-a4ea-efc5b1c6534f tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:03.388361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-97b7693c-dd8f-4d6b-a4ea-efc5b1c6534f tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:03.397702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b7693c-dd8f-4d6b-a4ea-efc5b1c6534f tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.398362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b7693c-dd8f-4d6b-a4ea-efc5b1c6534f tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.399134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b7693c-dd8f-4d6b-a4ea-efc5b1c6534f tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.399991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b7693c-dd8f-4d6b-a4ea-efc5b1c6534f tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.400606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b7693c-dd8f-4d6b-a4ea-efc5b1c6534f tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.401256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b7693c-dd8f-4d6b-a4ea-efc5b1c6534f tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.592569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-97b7693c-dd8f-4d6b-a4ea-efc5b1c6534f tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:03.603053 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-97b7693c-dd8f-4d6b-a4ea-efc5b1c6534f tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1665 microversion: 2.1 time: 0.220484 Oct 18 13:31:03.604503 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1768/3342] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:03 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1665 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:03.612020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0a9c2c8e-3fea-40be-b0cb-d19859de7c2e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:03.614118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0a9c2c8e-3fea-40be-b0cb-d19859de7c2e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:03.623000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a9c2c8e-3fea-40be-b0cb-d19859de7c2e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.623501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a9c2c8e-3fea-40be-b0cb-d19859de7c2e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.624243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a9c2c8e-3fea-40be-b0cb-d19859de7c2e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.625011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a9c2c8e-3fea-40be-b0cb-d19859de7c2e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.626456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a9c2c8e-3fea-40be-b0cb-d19859de7c2e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.626892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a9c2c8e-3fea-40be-b0cb-d19859de7c2e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.765039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d4f29933-6f0a-4b85-8ae0-705673aebe3c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:03.777162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d4f29933-6f0a-4b85-8ae0-705673aebe3c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:03.778704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d4f29933-6f0a-4b85-8ae0-705673aebe3c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:03.780089 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d4f29933-6f0a-4b85-8ae0-705673aebe3c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.625003 Oct 18 13:31:03.780665 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1575/3343] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:03 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:03.787308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-594b5cd3-702d-416b-a8f0-00acb3bd145c tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Calling method '.version_select at 0x7ff60fec9e50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:03.799896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0a9c2c8e-3fea-40be-b0cb-d19859de7c2e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:03.808897 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0a9c2c8e-3fea-40be-b0cb-d19859de7c2e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1318 microversion: 2.1 time: 0.202792 Oct 18 13:31:03.821265 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1769/3344] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:03 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:03.821265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-af64c620-fdec-4c64-b738-59564a05d235 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:03.821265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-af64c620-fdec-4c64-b738-59564a05d235 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:03.821265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af64c620-fdec-4c64-b738-59564a05d235 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.821945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af64c620-fdec-4c64-b738-59564a05d235 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.822249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af64c620-fdec-4c64-b738-59564a05d235 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:03.822934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af64c620-fdec-4c64-b738-59564a05d235 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:03.823382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af64c620-fdec-4c64-b738-59564a05d235 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:03.823806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-af64c620-fdec-4c64-b738-59564a05d235 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.021065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-af64c620-fdec-4c64-b738-59564a05d235 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:04.030531 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-af64c620-fdec-4c64-b738-59564a05d235 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1666 microversion: 2.1 time: 0.219922 Oct 18 13:31:04.031777 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1770/3345] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:03 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1666 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:04.036689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-27d5e612-8f35-4ad5-b5f8-ee5618e18865 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:04.037901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-27d5e612-8f35-4ad5-b5f8-ee5618e18865 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:04.047576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d5e612-8f35-4ad5-b5f8-ee5618e18865 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:04.049940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d5e612-8f35-4ad5-b5f8-ee5618e18865 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:04.052637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d5e612-8f35-4ad5-b5f8-ee5618e18865 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.053957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d5e612-8f35-4ad5-b5f8-ee5618e18865 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:04.057222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d5e612-8f35-4ad5-b5f8-ee5618e18865 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:04.058043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d5e612-8f35-4ad5-b5f8-ee5618e18865 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.065119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:04.197523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-27d5e612-8f35-4ad5-b5f8-ee5618e18865 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:04.212884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-27d5e612-8f35-4ad5-b5f8-ee5618e18865 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:04.226678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-27d5e612-8f35-4ad5-b5f8-ee5618e18865 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:04.227943 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-27d5e612-8f35-4ad5-b5f8-ee5618e18865 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.195013 Oct 18 13:31:04.228747 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1771/3346] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:04 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:04.252124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-10072539-f3af-4d55-bebd-b8d4d2e6869f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:04.253036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-10072539-f3af-4d55-bebd-b8d4d2e6869f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:04.259522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10072539-f3af-4d55-bebd-b8d4d2e6869f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:04.260306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10072539-f3af-4d55-bebd-b8d4d2e6869f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:04.260956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10072539-f3af-4d55-bebd-b8d4d2e6869f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.261904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10072539-f3af-4d55-bebd-b8d4d2e6869f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:04.262559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10072539-f3af-4d55-bebd-b8d4d2e6869f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:04.263183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10072539-f3af-4d55-bebd-b8d4d2e6869f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.275280 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-594b5cd3-702d-416b-a8f0-00acb3bd145c tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0" status: 200 len: 371 microversion: 2.1 time: 0.493112 Oct 18 13:31:04.275867 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1576/3347] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 18 13:31:03 2022] GET /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0 => generated 371 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:04.293614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-03beecda-88a5-430f-bae3-0134fbe7fa67 req-b37b2eb1-35d7-4302-a7ba-3dd9c60f0432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206ae481-4890-46be-a0eb-83a6f22eb0b6", "name": "network-vif-plugged", "status": "completed", "tag": "66a40b29-9fc8-40b9-b9d7-336889430bb8"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:04.306466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-03beecda-88a5-430f-bae3-0134fbe7fa67 req-b37b2eb1-35d7-4302-a7ba-3dd9c60f0432 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:04.307047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-03beecda-88a5-430f-bae3-0134fbe7fa67 req-b37b2eb1-35d7-4302-a7ba-3dd9c60f0432 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:04.307899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-03beecda-88a5-430f-bae3-0134fbe7fa67 req-b37b2eb1-35d7-4302-a7ba-3dd9c60f0432 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.319654 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-03beecda-88a5-430f-bae3-0134fbe7fa67 req-b37b2eb1-35d7-4302-a7ba-3dd9c60f0432 service nova] Creating event network-vif-plugged:66a40b29-9fc8-40b9-b9d7-336889430bb8 for instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 on n-h2-858384-13 Oct 18 13:31:04.325891 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-03beecda-88a5-430f-bae3-0134fbe7fa67 req-b37b2eb1-35d7-4302-a7ba-3dd9c60f0432 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043073 Oct 18 13:31:04.328321 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1577/3348] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:04.338164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-67d779f7-a09b-4604-ab91-d99e16fb7b7a tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Action: 'update', calling method: .version_select at 0x7ff60f7df040>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:04.481372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-10072539-f3af-4d55-bebd-b8d4d2e6869f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:04.492876 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-10072539-f3af-4d55-bebd-b8d4d2e6869f tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d" status: 200 len: 1474 microversion: 2.1 time: 0.250530 Oct 18 13:31:04.493883 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1772/3349] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:04 2022] GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d => generated 1474 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:04.579588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67d779f7-a09b-4604-ab91-d99e16fb7b7a tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:04.580531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67d779f7-a09b-4604-ab91-d99e16fb7b7a tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:04.581237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67d779f7-a09b-4604-ab91-d99e16fb7b7a tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.582296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67d779f7-a09b-4604-ab91-d99e16fb7b7a tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:04.582935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67d779f7-a09b-4604-ab91-d99e16fb7b7a tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:04.583731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67d779f7-a09b-4604-ab91-d99e16fb7b7a tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.630302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-650a2997-8242-4ed1-95c3-78c47c8af9b2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:04.631063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-650a2997-8242-4ed1-95c3-78c47c8af9b2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:04.647889 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-67d779f7-a09b-4604-ab91-d99e16fb7b7a tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0" status: 200 len: 328 microversion: 2.1 time: 0.318097 Oct 18 13:31:04.648200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-650a2997-8242-4ed1-95c3-78c47c8af9b2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:04.648711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-650a2997-8242-4ed1-95c3-78c47c8af9b2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:04.661721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-650a2997-8242-4ed1-95c3-78c47c8af9b2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.661721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-650a2997-8242-4ed1-95c3-78c47c8af9b2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:04.661721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-650a2997-8242-4ed1-95c3-78c47c8af9b2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:04.661721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-650a2997-8242-4ed1-95c3-78c47c8af9b2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:04.665416 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1578/3350] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:31:04 2022] PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0 => generated 328 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:04.805958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2026849236", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:04.875970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:31:05.365343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:31:05.366519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:31:05.366519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:31:05.366868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:31:05.367281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:31:05.382441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.384356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.385079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:05.386181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.386944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.388079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:05.410908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Getting quotas for project b3d9afff3ff44d55aafe117fc403bae0. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:05.418152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Getting quotas for user 7119fc5d72a94a508e4742284107a36e and project b3d9afff3ff44d55aafe117fc403bae0. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:05.438810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.utils [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] instances quota exceeded for b3d9afff3ff44d55aafe117fc403bae0, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120612) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 18 13:31:05.439389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-650a2997-8242-4ed1-95c3-78c47c8af9b2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:05.440355 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Request method failure captured: Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 145 Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqqS6v-wRn6RElDwl0Q0sUW5ge1WQhXVpxzVRWxFRW1A5TfbyiPCwIsat8zuAhz-jKI--zKP6c_yKUi4_Bq4e3x-3ovp1IZDNFH9WdZnah0cq_YvXolvy3Wr8dMZkThI2Fqiq-thfYwctGurOI_J_Z92TGHZo8IapC2U0wP59SqkcCM Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b3d9afff3ff44d55aafe117fc403bae0 Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-QuotasAdminNegativeTest-547056400 Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3d9afff3ff44d55aafe117fc403bae0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b3d9afff3ff44d55aafe117fc403bae0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3d9afff3ff44d55aafe117fc403bae0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b3d9afff3ff44d55aafe117fc403bae0"}]}] Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-QuotasAdminNegativeTest-547056400 Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b3d9afff3ff44d55aafe117fc403bae0 Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-547056400 Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-QuotasAdminNegativeTest-547056400-project Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7119fc5d72a94a508e4742284107a36e Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-QuotasAdminNegativeTest-547056400-project Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2026849236", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2026849236', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452'}}} Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:31:05.444229 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:05.450642 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cfe51b1e-bc0b-47d2-9808-705886e150ef tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.650325 Oct 18 13:31:05.461966 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-650a2997-8242-4ed1-95c3-78c47c8af9b2 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1665 microversion: 2.1 time: 0.826626 Oct 18 13:31:05.461966 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1773/3352] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:04 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1665 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:05.462522 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1579/3352] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:31:04 2022] POST /compute/v2.1/servers => generated 119 bytes in 655 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:05.462658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b5de9b51-c716-4d44-ba92-a962ad04fcba tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:05.462658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b5de9b51-c716-4d44-ba92-a962ad04fcba tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:05.464281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-205b02b3-aeee-451a-97d7-de2b944ff80d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:05.465897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-205b02b3-aeee-451a-97d7-de2b944ff80d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:05.477127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5de9b51-c716-4d44-ba92-a962ad04fcba tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.478127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5de9b51-c716-4d44-ba92-a962ad04fcba tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.478869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5de9b51-c716-4d44-ba92-a962ad04fcba tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:05.479830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5de9b51-c716-4d44-ba92-a962ad04fcba tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.480319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-205b02b3-aeee-451a-97d7-de2b944ff80d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.480821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-205b02b3-aeee-451a-97d7-de2b944ff80d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.482301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5de9b51-c716-4d44-ba92-a962ad04fcba tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.483005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5de9b51-c716-4d44-ba92-a962ad04fcba tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:05.485503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-205b02b3-aeee-451a-97d7-de2b944ff80d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:05.486641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-205b02b3-aeee-451a-97d7-de2b944ff80d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.486833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-205b02b3-aeee-451a-97d7-de2b944ff80d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.487263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-205b02b3-aeee-451a-97d7-de2b944ff80d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:05.848535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b5de9b51-c716-4d44-ba92-a962ad04fcba tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:05.864822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b5de9b51-c716-4d44-ba92-a962ad04fcba tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:05.866352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b5de9b51-c716-4d44-ba92-a962ad04fcba tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:05.867571 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b5de9b51-c716-4d44-ba92-a962ad04fcba tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.414045 Oct 18 13:31:05.868156 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1774/3353] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:05 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:05.883602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-65b55eb1-8d97-484e-a06d-382b6ca84933 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:05.885044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-65b55eb1-8d97-484e-a06d-382b6ca84933 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:05.901691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65b55eb1-8d97-484e-a06d-382b6ca84933 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.903611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65b55eb1-8d97-484e-a06d-382b6ca84933 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.905593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65b55eb1-8d97-484e-a06d-382b6ca84933 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:05.907806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65b55eb1-8d97-484e-a06d-382b6ca84933 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:05.908524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65b55eb1-8d97-484e-a06d-382b6ca84933 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:05.909134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65b55eb1-8d97-484e-a06d-382b6ca84933 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:06.406895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-65b55eb1-8d97-484e-a06d-382b6ca84933 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:06.418603 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-65b55eb1-8d97-484e-a06d-382b6ca84933 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.549197 Oct 18 13:31:06.422159 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1775/3354] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:05 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:06.428604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b5dd80d1-bf94-47ea-8455-6193aa681864 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:06.431830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b5dd80d1-bf94-47ea-8455-6193aa681864 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:06.438876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5dd80d1-bf94-47ea-8455-6193aa681864 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:06.439802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5dd80d1-bf94-47ea-8455-6193aa681864 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:06.441543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5dd80d1-bf94-47ea-8455-6193aa681864 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:06.442886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5dd80d1-bf94-47ea-8455-6193aa681864 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:06.443827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5dd80d1-bf94-47ea-8455-6193aa681864 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:06.444484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5dd80d1-bf94-47ea-8455-6193aa681864 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:06.602155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b5dd80d1-bf94-47ea-8455-6193aa681864 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:06.615056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b5dd80d1-bf94-47ea-8455-6193aa681864 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:06.616518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b5dd80d1-bf94-47ea-8455-6193aa681864 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:06.617770 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b5dd80d1-bf94-47ea-8455-6193aa681864 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.194002 Oct 18 13:31:06.618351 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1776/3355] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:06 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:06.641137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c11ba6a5-be25-4d8a-a309-84986d086ea4 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Action: 'update', calling method: .version_select at 0x7ff60eeb8160>, body: {"quota_set": {"instances": 10}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:06.728643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-205b02b3-aeee-451a-97d7-de2b944ff80d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:06.740813 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-205b02b3-aeee-451a-97d7-de2b944ff80d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1318 microversion: 2.1 time: 1.287447 Oct 18 13:31:06.745479 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1580/3356] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:05 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1318 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:06.757721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-801c6e6a-db37-4ea8-836c-fbea855a5fa0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:06.758575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-801c6e6a-db37-4ea8-836c-fbea855a5fa0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:06.772620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-801c6e6a-db37-4ea8-836c-fbea855a5fa0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:06.777525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-801c6e6a-db37-4ea8-836c-fbea855a5fa0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:06.779218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-801c6e6a-db37-4ea8-836c-fbea855a5fa0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:06.779929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-801c6e6a-db37-4ea8-836c-fbea855a5fa0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:06.780396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-801c6e6a-db37-4ea8-836c-fbea855a5fa0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:06.780837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-801c6e6a-db37-4ea8-836c-fbea855a5fa0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:06.933993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-801c6e6a-db37-4ea8-836c-fbea855a5fa0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:06.947577 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-801c6e6a-db37-4ea8-836c-fbea855a5fa0 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d" status: 200 len: 1303 microversion: 2.1 time: 0.200669 Oct 18 13:31:06.951303 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1581/3357] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:06 2022] GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d => generated 1303 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:06.962873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e853a360-3844-497f-99eb-91d6463d9593 req-af770abf-20c9-405e-9dd4-17b341b9749c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d173b9-5f53-4e62-aee6-3bc9f580b8ce", "name": "network-vif-deleted", "tag": "60dcc269-47e0-4c17-8be7-a1e251674cf8"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:06.997805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e853a360-3844-497f-99eb-91d6463d9593 req-af770abf-20c9-405e-9dd4-17b341b9749c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:06.998500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e853a360-3844-497f-99eb-91d6463d9593 req-af770abf-20c9-405e-9dd4-17b341b9749c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:06.999108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e853a360-3844-497f-99eb-91d6463d9593 req-af770abf-20c9-405e-9dd4-17b341b9749c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.033444 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e853a360-3844-497f-99eb-91d6463d9593 req-af770abf-20c9-405e-9dd4-17b341b9749c service nova] Creating event network-vif-deleted:60dcc269-47e0-4c17-8be7-a1e251674cf8 for instance 52d173b9-5f53-4e62-aee6-3bc9f580b8ce on n-h1-858384-13 Oct 18 13:31:07.050693 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e853a360-3844-497f-99eb-91d6463d9593 req-af770abf-20c9-405e-9dd4-17b341b9749c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097293 Oct 18 13:31:07.051418 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1582/3358] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:07.056800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-602edd9e-5c9b-47ae-8fe4-5f419c878dfd req-f73d22a2-f74c-47a7-a537-357676a70425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d", "name": "network-vif-unplugged", "status": "completed", "tag": "ab7dce51-8cfe-4a35-8cb3-d897b4b3c6ba"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:07.060747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c11ba6a5-be25-4d8a-a309-84986d086ea4 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.061284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c11ba6a5-be25-4d8a-a309-84986d086ea4 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.061943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c11ba6a5-be25-4d8a-a309-84986d086ea4 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.062866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c11ba6a5-be25-4d8a-a309-84986d086ea4 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.063495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c11ba6a5-be25-4d8a-a309-84986d086ea4 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.064083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c11ba6a5-be25-4d8a-a309-84986d086ea4 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.077896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-602edd9e-5c9b-47ae-8fe4-5f419c878dfd req-f73d22a2-f74c-47a7-a537-357676a70425 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.079273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-602edd9e-5c9b-47ae-8fe4-5f419c878dfd req-f73d22a2-f74c-47a7-a537-357676a70425 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.080074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-602edd9e-5c9b-47ae-8fe4-5f419c878dfd req-f73d22a2-f74c-47a7-a537-357676a70425 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.124182 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-602edd9e-5c9b-47ae-8fe4-5f419c878dfd req-f73d22a2-f74c-47a7-a537-357676a70425 service nova] Creating event network-vif-unplugged:ab7dce51-8cfe-4a35-8cb3-d897b4b3c6ba for instance a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d on n-h1-858384-13 Oct 18 13:31:07.132466 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-602edd9e-5c9b-47ae-8fe4-5f419c878dfd req-f73d22a2-f74c-47a7-a537-357676a70425 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079421 Oct 18 13:31:07.133957 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1583/3359] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:07.141158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d4300a0d-bf34-4167-ab8d-d6cf9f5bbb6f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:07.142117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d4300a0d-bf34-4167-ab8d-d6cf9f5bbb6f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:07.143898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:07.148873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:07.151508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4300a0d-bf34-4167-ab8d-d6cf9f5bbb6f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.152243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4300a0d-bf34-4167-ab8d-d6cf9f5bbb6f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.152446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4300a0d-bf34-4167-ab8d-d6cf9f5bbb6f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.153109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4300a0d-bf34-4167-ab8d-d6cf9f5bbb6f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.153597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4300a0d-bf34-4167-ab8d-d6cf9f5bbb6f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.154101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4300a0d-bf34-4167-ab8d-d6cf9f5bbb6f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.217876 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c11ba6a5-be25-4d8a-a309-84986d086ea4 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0" status: 200 len: 329 microversion: 2.1 time: 0.588817 Oct 18 13:31:07.219993 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1777/3360] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:31:06 2022] PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0 => generated 329 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:07.227111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3562adeb-04d2-40c3-9028-066796603863 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:07.229838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3562adeb-04d2-40c3-9028-066796603863 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:07.237394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3562adeb-04d2-40c3-9028-066796603863 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.238460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3562adeb-04d2-40c3-9028-066796603863 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.239351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3562adeb-04d2-40c3-9028-066796603863 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.241670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3562adeb-04d2-40c3-9028-066796603863 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.242357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3562adeb-04d2-40c3-9028-066796603863 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.242995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3562adeb-04d2-40c3-9028-066796603863 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.418339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3562adeb-04d2-40c3-9028-066796603863 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.427837 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3562adeb-04d2-40c3-9028-066796603863 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1665 microversion: 2.1 time: 0.205821 Oct 18 13:31:07.428704 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1778/3361] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:07 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1665 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:07.449969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-967f7ae6-e08f-4f2f-80be-c713eb86414c req-f070e2e5-9a47-4652-b270-f61eb19f4cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d", "name": "network-vif-deleted", "tag": "ab7dce51-8cfe-4a35-8cb3-d897b4b3c6ba"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:07.459619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-967f7ae6-e08f-4f2f-80be-c713eb86414c req-f070e2e5-9a47-4652-b270-f61eb19f4cfb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.460132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-967f7ae6-e08f-4f2f-80be-c713eb86414c req-f070e2e5-9a47-4652-b270-f61eb19f4cfb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.460544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-967f7ae6-e08f-4f2f-80be-c713eb86414c req-f070e2e5-9a47-4652-b270-f61eb19f4cfb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.471821 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-967f7ae6-e08f-4f2f-80be-c713eb86414c req-f070e2e5-9a47-4652-b270-f61eb19f4cfb service nova] Creating event network-vif-deleted:ab7dce51-8cfe-4a35-8cb3-d897b4b3c6ba for instance a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d on n-h1-858384-13 Oct 18 13:31:07.477147 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-967f7ae6-e08f-4f2f-80be-c713eb86414c req-f070e2e5-9a47-4652-b270-f61eb19f4cfb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033907 Oct 18 13:31:07.477775 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1779/3362] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:07.484125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dc56ce5a-8f51-4182-b992-11c090db806e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:07.484995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dc56ce5a-8f51-4182-b992-11c090db806e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:07.492185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc56ce5a-8f51-4182-b992-11c090db806e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.492915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc56ce5a-8f51-4182-b992-11c090db806e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.493400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc56ce5a-8f51-4182-b992-11c090db806e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.494091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc56ce5a-8f51-4182-b992-11c090db806e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.494537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc56ce5a-8f51-4182-b992-11c090db806e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.494956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc56ce5a-8f51-4182-b992-11c090db806e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.522742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d4300a0d-bf34-4167-ab8d-d6cf9f5bbb6f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.536571 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d4300a0d-bf34-4167-ab8d-d6cf9f5bbb6f tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.401204 Oct 18 13:31:07.538430 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1584/3363] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:07 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:07.544875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-01329af1-cc5f-4302-8dde-a2af1594e8fc tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Calling method '.version_select at 0x7ff61449e430>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:07.651194 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-01329af1-cc5f-4302-8dde-a2af1594e8fc tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0" status: 200 len: 371 microversion: 2.1 time: 0.111198 Oct 18 13:31:07.652274 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1585/3364] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 18 13:31:07 2022] GET /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0 => generated 371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:07.658729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7badf71e-ecec-41f2-a1ba-5982b7df8ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:07.659674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7badf71e-ecec-41f2-a1ba-5982b7df8ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:07.667204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7badf71e-ecec-41f2-a1ba-5982b7df8ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.668653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7badf71e-ecec-41f2-a1ba-5982b7df8ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.669363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7badf71e-ecec-41f2-a1ba-5982b7df8ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.670303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7badf71e-ecec-41f2-a1ba-5982b7df8ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.671084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7badf71e-ecec-41f2-a1ba-5982b7df8ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.671789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7badf71e-ecec-41f2-a1ba-5982b7df8ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.796332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc56ce5a-8f51-4182-b992-11c090db806e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.814003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc56ce5a-8f51-4182-b992-11c090db806e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.820502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc56ce5a-8f51-4182-b992-11c090db806e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.822539 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dc56ce5a-8f51-4182-b992-11c090db806e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.343434 Oct 18 13:31:07.824334 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1780/3365] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:07 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:07.830269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f243cc7-a86e-40bc-acc2-354644d11ea3 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:07.831071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7f243cc7-a86e-40bc-acc2-354644d11ea3 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:07.844021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f243cc7-a86e-40bc-acc2-354644d11ea3 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.844952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f243cc7-a86e-40bc-acc2-354644d11ea3 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.845663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f243cc7-a86e-40bc-acc2-354644d11ea3 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.848421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f243cc7-a86e-40bc-acc2-354644d11ea3 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.849063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f243cc7-a86e-40bc-acc2-354644d11ea3 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.849902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f243cc7-a86e-40bc-acc2-354644d11ea3 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.938608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7f243cc7-a86e-40bc-acc2-354644d11ea3 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.960404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7badf71e-ecec-41f2-a1ba-5982b7df8ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.962442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7f243cc7-a86e-40bc-acc2-354644d11ea3 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.963930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7f243cc7-a86e-40bc-acc2-354644d11ea3 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:07.965501 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7f243cc7-a86e-40bc-acc2-354644d11ea3 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.139323 Oct 18 13:31:07.970432 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7badf71e-ecec-41f2-a1ba-5982b7df8ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.316707 Oct 18 13:31:07.973276 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1781/3366] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:07 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:07.985214 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1586/3367] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:07 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:07.985214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7622e2b8-74f7-4ee0-9dbe-07229d098bd7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:07.985214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7622e2b8-74f7-4ee0-9dbe-07229d098bd7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:07.992011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7622e2b8-74f7-4ee0-9dbe-07229d098bd7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.992580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7622e2b8-74f7-4ee0-9dbe-07229d098bd7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.993080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7622e2b8-74f7-4ee0-9dbe-07229d098bd7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.994070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7622e2b8-74f7-4ee0-9dbe-07229d098bd7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:07.995021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7622e2b8-74f7-4ee0-9dbe-07229d098bd7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:07.995518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7622e2b8-74f7-4ee0-9dbe-07229d098bd7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:07.997279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6576225a-1d82-4e06-a639-39fbbea89dc1 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Action: 'update', calling method: .version_select at 0x7ff60f001280>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:08.331068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7622e2b8-74f7-4ee0-9dbe-07229d098bd7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:08.341614 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7622e2b8-74f7-4ee0-9dbe-07229d098bd7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1508 microversion: 2.1 time: 0.365006 Oct 18 13:31:08.351358 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1587/3368] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:07 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1508 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:08.362586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0a142b70-ae5e-48dd-b57c-85bfcd2f3792 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:08.365139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0a142b70-ae5e-48dd-b57c-85bfcd2f3792 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:08.382422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a142b70-ae5e-48dd-b57c-85bfcd2f3792 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.383395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a142b70-ae5e-48dd-b57c-85bfcd2f3792 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.384058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a142b70-ae5e-48dd-b57c-85bfcd2f3792 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.387228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a142b70-ae5e-48dd-b57c-85bfcd2f3792 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.387946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a142b70-ae5e-48dd-b57c-85bfcd2f3792 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.388996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a142b70-ae5e-48dd-b57c-85bfcd2f3792 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.437218 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-0a142b70-ae5e-48dd-b57c-85bfcd2f3792 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] HTTP exception thrown: Instance a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d could not be found. Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0a142b70-ae5e-48dd-b57c-85bfcd2f3792 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Request method failure captured: Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d HTTP/1.1 Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqndNLs5iysNG23-990uCB6IZiSZkcLI4gL8Qkhkx6hDM3roQSaiGw3uN57kA58uDMNrm3neXJWgNJRAid03luKpDQ1sZv_fzgili9c_3TIxftm-KkB76hk5QD3QbHyppnfRAcigbOIXHX0jEj11r1ElaYHrcV6kpFMOD216mFEzEZU Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_caf4a24f687647e4a23fbee030d4e53a"}]}] Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 2cb58ae89a06444e95eca4c886e9cc0c Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d could not be found. Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d'} Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d could not be found. Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d could not be found. Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:08.442787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:08.447822 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:08.447822 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:08.447822 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:08.447822 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:08.447822 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:08.447822 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d could not be found. Oct 18 13:31:08.447822 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:08.447822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0a142b70-ae5e-48dd-b57c-85bfcd2f3792 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Returning 404 to user: Instance a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:08.447822 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0a142b70-ae5e-48dd-b57c-85bfcd2f3792 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d" status: 404 len: 111 microversion: 2.1 time: 0.091876 Oct 18 13:31:08.447822 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1588/3369] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:08 2022] GET /compute/v2.1/servers/a3e5f0a9-80a6-4737-93d7-d78fd3b65d9d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:08.470946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-19b50ea4-be64-43cc-bdc6-d4ee6b096607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:08.471622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-19b50ea4-be64-43cc-bdc6-d4ee6b096607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:08.488273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19b50ea4-be64-43cc-bdc6-d4ee6b096607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.488790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19b50ea4-be64-43cc-bdc6-d4ee6b096607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.489262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19b50ea4-be64-43cc-bdc6-d4ee6b096607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.489988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19b50ea4-be64-43cc-bdc6-d4ee6b096607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.495282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19b50ea4-be64-43cc-bdc6-d4ee6b096607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.496764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19b50ea4-be64-43cc-bdc6-d4ee6b096607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.563726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6576225a-1d82-4e06-a639-39fbbea89dc1 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.564269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6576225a-1d82-4e06-a639-39fbbea89dc1 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.564543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6576225a-1d82-4e06-a639-39fbbea89dc1 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.568860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6576225a-1d82-4e06-a639-39fbbea89dc1 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.569473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6576225a-1d82-4e06-a639-39fbbea89dc1 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.570075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6576225a-1d82-4e06-a639-39fbbea89dc1 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.667073 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6576225a-1d82-4e06-a639-39fbbea89dc1 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0" status: 200 len: 325 microversion: 2.1 time: 0.692348 Oct 18 13:31:08.668010 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1782/3370] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:31:07 2022] PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0 => generated 325 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:08.672436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-17af013b-9c69-40f3-b313-4690103d3ae3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:08.673039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-17af013b-9c69-40f3-b313-4690103d3ae3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:08.687047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17af013b-9c69-40f3-b313-4690103d3ae3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.687561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17af013b-9c69-40f3-b313-4690103d3ae3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.687980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17af013b-9c69-40f3-b313-4690103d3ae3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.688680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17af013b-9c69-40f3-b313-4690103d3ae3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.689122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17af013b-9c69-40f3-b313-4690103d3ae3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.695777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17af013b-9c69-40f3-b313-4690103d3ae3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.890080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-17af013b-9c69-40f3-b313-4690103d3ae3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:08.891911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-19b50ea4-be64-43cc-bdc6-d4ee6b096607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:08.901595 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-19b50ea4-be64-43cc-bdc6-d4ee6b096607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.453804 Oct 18 13:31:08.903211 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-17af013b-9c69-40f3-b313-4690103d3ae3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1508 microversion: 2.1 time: 0.234164 Oct 18 13:31:08.904016 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1783/3371] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:08 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:08.905128 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1589/3372] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:08 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:08.909075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-730fbdc3-2dec-4ab8-9ddf-9cf0624072e5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:08.910292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-730fbdc3-2dec-4ab8-9ddf-9cf0624072e5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: 52d173b9-5f53-4e62-aee6-3bc9f580b8ce] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:08.910776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:08.917369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-730fbdc3-2dec-4ab8-9ddf-9cf0624072e5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.918194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-730fbdc3-2dec-4ab8-9ddf-9cf0624072e5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.918983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-730fbdc3-2dec-4ab8-9ddf-9cf0624072e5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.919242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:08.921039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-730fbdc3-2dec-4ab8-9ddf-9cf0624072e5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.922020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-730fbdc3-2dec-4ab8-9ddf-9cf0624072e5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.922693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-730fbdc3-2dec-4ab8-9ddf-9cf0624072e5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.932525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.934082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.934539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.935260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:08.935718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:08.936153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:08.943545 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-730fbdc3-2dec-4ab8-9ddf-9cf0624072e5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] HTTP exception thrown: Instance 52d173b9-5f53-4e62-aee6-3bc9f580b8ce could not be found. Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-730fbdc3-2dec-4ab8-9ddf-9cf0624072e5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Request method failure captured: Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce HTTP/1.1 Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqndNLs5iysNG23-990uCB6IZiSZkcLI4gL8Qkhkx6hDM3roQSaiGw3uN57kA58uDMNrm3neXJWgNJRAid03luKpDQ1sZv_fzgili9c_3TIxftm-KkB76hk5QD3QbHyppnfRAcigbOIXHX0jEj11r1ElaYHrcV6kpFMOD216mFEzEZU Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_caf4a24f687647e4a23fbee030d4e53a"}]}] Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 2cb58ae89a06444e95eca4c886e9cc0c Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 52d173b9-5f53-4e62-aee6-3bc9f580b8ce could not be found. Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '52d173b9-5f53-4e62-aee6-3bc9f580b8ce'} Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d173b9-5f53-4e62-aee6-3bc9f580b8ce could not be found. Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d173b9-5f53-4e62-aee6-3bc9f580b8ce could not be found. Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:08.946159 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:08.951038 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:08.951038 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:08.951038 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:08.951038 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:08.951038 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:08.951038 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d173b9-5f53-4e62-aee6-3bc9f580b8ce could not be found. Oct 18 13:31:08.951038 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:08.953921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-730fbdc3-2dec-4ab8-9ddf-9cf0624072e5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Returning 404 to user: Instance 52d173b9-5f53-4e62-aee6-3bc9f580b8ce could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:08.955622 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-730fbdc3-2dec-4ab8-9ddf-9cf0624072e5 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce" status: 404 len: 111 microversion: 2.1 time: 0.050457 Oct 18 13:31:08.957791 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1784/3373] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:08 2022] GET /compute/v2.1/servers/52d173b9-5f53-4e62-aee6-3bc9f580b8ce => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:08.968933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1780098915", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:08.999330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.000417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.001046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.001685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lazy-loading 'fault' on Instance uuid 5c74e947-034e-4c4d-80b4-2e6b59f4ae41 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:09.051938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2f8a6c491a443c2be1cb6fad5e336fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2002f3acb0b4230b26d590df9095f11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:09.064991 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f19b1269-ebca-492e-a637-9f54a6cf4895 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 200 len: 1315 microversion: 2.1 time: 0.158237 Oct 18 13:31:09.066838 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1590/3374] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:08 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:09.075152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e3cb4a52-35d3-4533-9713-452c7a91a325 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:09.075963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e3cb4a52-35d3-4533-9713-452c7a91a325 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:09.106872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3cb4a52-35d3-4533-9713-452c7a91a325 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.107739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3cb4a52-35d3-4533-9713-452c7a91a325 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.108525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3cb4a52-35d3-4533-9713-452c7a91a325 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.109603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3cb4a52-35d3-4533-9713-452c7a91a325 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.110215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3cb4a52-35d3-4533-9713-452c7a91a325 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.111113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3cb4a52-35d3-4533-9713-452c7a91a325 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.436103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e3cb4a52-35d3-4533-9713-452c7a91a325 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:09.449244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e3cb4a52-35d3-4533-9713-452c7a91a325 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:09.451090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e3cb4a52-35d3-4533-9713-452c7a91a325 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:09.453916 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e3cb4a52-35d3-4533-9713-452c7a91a325 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.384912 Oct 18 13:31:09.469516 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1591/3375] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:09 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:09.478538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c4f1008-c83a-42ed-848a-290114832def tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:09.481467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2c4f1008-c83a-42ed-848a-290114832def tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:09.496981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c4f1008-c83a-42ed-848a-290114832def tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.497711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c4f1008-c83a-42ed-848a-290114832def tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.498326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c4f1008-c83a-42ed-848a-290114832def tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.499334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c4f1008-c83a-42ed-848a-290114832def tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.499775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c4f1008-c83a-42ed-848a-290114832def tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.500372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c4f1008-c83a-42ed-848a-290114832def tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.593033 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2c4f1008-c83a-42ed-848a-290114832def tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "PUT /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1080 microversion: 2.1 time: 0.122080 Oct 18 13:31:09.606347 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1592/3376] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 18 13:31:09 2022] PUT /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1080 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:09.606463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:31:09.606927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-55850890-e428-4530-8200-464fbace5479 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:09.606927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-55850890-e428-4530-8200-464fbace5479 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:09.615435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55850890-e428-4530-8200-464fbace5479 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.616087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55850890-e428-4530-8200-464fbace5479 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.617515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55850890-e428-4530-8200-464fbace5479 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.618252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55850890-e428-4530-8200-464fbace5479 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.618712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55850890-e428-4530-8200-464fbace5479 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.619140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55850890-e428-4530-8200-464fbace5479 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.812586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-55850890-e428-4530-8200-464fbace5479 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:09.824215 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-55850890-e428-4530-8200-464fbace5479 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.228063 Oct 18 13:31:09.825527 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1593/3377] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:09 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:09.830730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4167ac0b-a0bd-407c-ad3d-8c54ff6fb532 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:09.871743 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4167ac0b-a0bd-407c-ad3d-8c54ff6fb532 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/cd107ee3-9da9-4d4a-a086-4bbd7f78626f" status: 204 len: 0 microversion: 2.1 time: 0.044814 Oct 18 13:31:09.872342 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1594/3378] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 18 13:31:09 2022] DELETE /compute/v2.1/os-server-groups/cd107ee3-9da9-4d4a-a086-4bbd7f78626f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:09.878012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2efa40a8-fe48-44dd-8c7d-b8df9b9b1622 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:09.879297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2efa40a8-fe48-44dd-8c7d-b8df9b9b1622 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:09.886673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2efa40a8-fe48-44dd-8c7d-b8df9b9b1622 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.887289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2efa40a8-fe48-44dd-8c7d-b8df9b9b1622 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.887899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2efa40a8-fe48-44dd-8c7d-b8df9b9b1622 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.888648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2efa40a8-fe48-44dd-8c7d-b8df9b9b1622 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.889103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2efa40a8-fe48-44dd-8c7d-b8df9b9b1622 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.889570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2efa40a8-fe48-44dd-8c7d-b8df9b9b1622 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.906203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:31:09.906962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:31:09.911210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:31:09.913916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:31:09.914732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:31:09.935391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.935957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.940722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.942665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:09.943199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:09.943862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:09.976829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2efa40a8-fe48-44dd-8c7d-b8df9b9b1622 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:09.988956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2efa40a8-fe48-44dd-8c7d-b8df9b9b1622 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:09.989649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Getting quotas for project b3d9afff3ff44d55aafe117fc403bae0. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:09.991159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2efa40a8-fe48-44dd-8c7d-b8df9b9b1622 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:09.992708 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2efa40a8-fe48-44dd-8c7d-b8df9b9b1622 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.119389 Oct 18 13:31:09.993527 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1595/3379] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:09 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:09.996358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Getting quotas for user 7119fc5d72a94a508e4742284107a36e and project b3d9afff3ff44d55aafe117fc403bae0. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:09.998727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-cecb95a6-dfcf-4c54-88f8-f06fdf93165e req-8e28e032-b0e0-4f76-b040-84566e5ba3d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c74e947-034e-4c4d-80b4-2e6b59f4ae41", "name": "network-vif-deleted", "tag": "b223df49-be57-4fa3-9914-5f17b0c21d6e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:10.009069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cecb95a6-dfcf-4c54-88f8-f06fdf93165e req-8e28e032-b0e0-4f76-b040-84566e5ba3d5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.009789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cecb95a6-dfcf-4c54-88f8-f06fdf93165e req-8e28e032-b0e0-4f76-b040-84566e5ba3d5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.010016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cecb95a6-dfcf-4c54-88f8-f06fdf93165e req-8e28e032-b0e0-4f76-b040-84566e5ba3d5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.024002 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-cecb95a6-dfcf-4c54-88f8-f06fdf93165e req-8e28e032-b0e0-4f76-b040-84566e5ba3d5 service nova] Creating event network-vif-deleted:b223df49-be57-4fa3-9914-5f17b0c21d6e for instance 5c74e947-034e-4c4d-80b4-2e6b59f4ae41 on n-h1-858384-13 Oct 18 13:31:10.030790 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-cecb95a6-dfcf-4c54-88f8-f06fdf93165e req-8e28e032-b0e0-4f76-b040-84566e5ba3d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035529 Oct 18 13:31:10.037968 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1596/3380] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:10.044004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8a6e7042-b80a-4194-abe8-a0657cb49d73 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:10.045133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8a6e7042-b80a-4194-abe8-a0657cb49d73 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:10.053014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.utils [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] ram quota exceeded for b3d9afff3ff44d55aafe117fc403bae0, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120611) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 18 13:31:10.053890 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 13:31:10.054390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a6e7042-b80a-4194-abe8-a0657cb49d73 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.055070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a6e7042-b80a-4194-abe8-a0657cb49d73 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.055693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a6e7042-b80a-4194-abe8-a0657cb49d73 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.056755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a6e7042-b80a-4194-abe8-a0657cb49d73 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.057999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a6e7042-b80a-4194-abe8-a0657cb49d73 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.058650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a6e7042-b80a-4194-abe8-a0657cb49d73 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Request method failure captured: Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 145 Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqqS6v-wRn6RElDwl0Q0sUW5ge1WQhXVpxzVRWxFRW1A5TfbyiPCwIsat8zuAhz-jKI--zKP6c_yKUi4_Bq4e3x-3ovp1IZDNFH9WdZnah0cq_YvXolvy3Wr8dMZkThI2Fqiq-thfYwctGurOI_J_Z92TGHZo8IapC2U0wP59SqkcCM Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: b3d9afff3ff44d55aafe117fc403bae0 Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-QuotasAdminNegativeTest-547056400 Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3d9afff3ff44d55aafe117fc403bae0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b3d9afff3ff44d55aafe117fc403bae0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3d9afff3ff44d55aafe117fc403bae0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b3d9afff3ff44d55aafe117fc403bae0"}]}] Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-QuotasAdminNegativeTest-547056400 Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: b3d9afff3ff44d55aafe117fc403bae0 Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-547056400 Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-QuotasAdminNegativeTest-547056400-project Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7119fc5d72a94a508e4742284107a36e Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-QuotasAdminNegativeTest-547056400-project Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1780098915", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1780098915', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452'}}} Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:31:10.063058 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 18 13:31:10.067514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.069747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:10.069747 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1d6461a7-d9cf-429b-98db-32a7ed103da1 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.110573 Oct 18 13:31:10.070759 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1785/3381] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:31:08 2022] POST /compute/v2.1/servers => generated 110 bytes in 1112 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:10.081289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-77944d6c-b815-4005-bc40-d9ddc5eb50ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:10.090716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-77944d6c-b815-4005-bc40-d9ddc5eb50ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:10.106337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77944d6c-b815-4005-bc40-d9ddc5eb50ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.106849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77944d6c-b815-4005-bc40-d9ddc5eb50ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.107265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77944d6c-b815-4005-bc40-d9ddc5eb50ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.108181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77944d6c-b815-4005-bc40-d9ddc5eb50ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.108800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77944d6c-b815-4005-bc40-d9ddc5eb50ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.109579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77944d6c-b815-4005-bc40-d9ddc5eb50ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.151923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-77944d6c-b815-4005-bc40-d9ddc5eb50ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lazy-loading 'flavor' on Instance uuid 9aad90b5-28fb-44b2-89da-33bc1b2889f2 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:10.252570 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-77944d6c-b815-4005-bc40-d9ddc5eb50ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.180970 Oct 18 13:31:10.253866 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1786/3382] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:31:10 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:31:10.259838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-352dd06a-2d0f-4b4f-a4bf-79e078eb1158 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:10.260823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-352dd06a-2d0f-4b4f-a4bf-79e078eb1158 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:10.275630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-352dd06a-2d0f-4b4f-a4bf-79e078eb1158 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.276418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-352dd06a-2d0f-4b4f-a4bf-79e078eb1158 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.277522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-352dd06a-2d0f-4b4f-a4bf-79e078eb1158 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.279897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-352dd06a-2d0f-4b4f-a4bf-79e078eb1158 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.280362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-352dd06a-2d0f-4b4f-a4bf-79e078eb1158 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.280791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-352dd06a-2d0f-4b4f-a4bf-79e078eb1158 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.305918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8a6e7042-b80a-4194-abe8-a0657cb49d73 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:10.316810 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8a6e7042-b80a-4194-abe8-a0657cb49d73 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1506 microversion: 2.1 time: 0.277195 Oct 18 13:31:10.323862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-352dd06a-2d0f-4b4f-a4bf-79e078eb1158 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:10.330138 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1597/3383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:10 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:10.341761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1a865d73-db36-4bee-9cdb-a32da095cd87 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Action: 'update', calling method: .version_select at 0x7ff60feeb8b0>, body: {"quota_set": {"ram": 51200}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:10.387431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:10.421452 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-352dd06a-2d0f-4b4f-a4bf-79e078eb1158 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 204 len: 0 microversion: 2.1 time: 0.165884 Oct 18 13:31:10.422590 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1787/3384] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:10 2022] DELETE /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:10.428982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-23681fd2-3a6b-42a6-aed8-d1624b9fd344 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:10.429938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-23681fd2-3a6b-42a6-aed8-d1624b9fd344 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] [instance: 5c74e947-034e-4c4d-80b4-2e6b59f4ae41] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:10.437631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23681fd2-3a6b-42a6-aed8-d1624b9fd344 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.438273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23681fd2-3a6b-42a6-aed8-d1624b9fd344 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.438858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23681fd2-3a6b-42a6-aed8-d1624b9fd344 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.439726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23681fd2-3a6b-42a6-aed8-d1624b9fd344 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.440329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23681fd2-3a6b-42a6-aed8-d1624b9fd344 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.441570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23681fd2-3a6b-42a6-aed8-d1624b9fd344 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.457987 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-23681fd2-3a6b-42a6-aed8-d1624b9fd344 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] HTTP exception thrown: Instance 5c74e947-034e-4c4d-80b4-2e6b59f4ae41 could not be found. Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-23681fd2-3a6b-42a6-aed8-d1624b9fd344 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Request method failure captured: Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 HTTP/1.1 Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqocpfFbrGYO4rXdiVRmVxwv5M6e-jhv5xomBG-tiNe1X3UlVSOFqYTbL2hseZQM6N4O7d-__x-ElA248YB4AkXsU05_0goqgi2i24c0jEUAzEmDbI3UV5k3i3APVvv8aRO1QakABJHBiHKIl_JEGuuguj3herp-pNS_jUirshofbWY Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d2002f3acb0b4230b26d590df9095f11 Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersTestFqdnHostnames-147110924 Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d2002f3acb0b4230b26d590df9095f11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d2002f3acb0b4230b26d590df9095f11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d2002f3acb0b4230b26d590df9095f11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d2002f3acb0b4230b26d590df9095f11"}]}] Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersTestFqdnHostnames-147110924 Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d2002f3acb0b4230b26d590df9095f11 Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-147110924 Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersTestFqdnHostnames-147110924-project Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c2f8a6c491a443c2be1cb6fad5e336fa Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersTestFqdnHostnames-147110924-project Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 5c74e947-034e-4c4d-80b4-2e6b59f4ae41 could not be found. Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '5c74e947-034e-4c4d-80b4-2e6b59f4ae41'} Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c74e947-034e-4c4d-80b4-2e6b59f4ae41 could not be found. Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c74e947-034e-4c4d-80b4-2e6b59f4ae41 could not be found. Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:10.459877 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.464737 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:10.464737 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:10.464737 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:10.464737 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:10.464737 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:10.464737 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c74e947-034e-4c4d-80b4-2e6b59f4ae41 could not be found. Oct 18 13:31:10.464737 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:10.467033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-23681fd2-3a6b-42a6-aed8-d1624b9fd344 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Returning 404 to user: Instance 5c74e947-034e-4c4d-80b4-2e6b59f4ae41 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:10.468237 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-23681fd2-3a6b-42a6-aed8-d1624b9fd344 tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41" status: 404 len: 111 microversion: 2.1 time: 0.044166 Oct 18 13:31:10.469771 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1788/3385] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:10 2022] GET /compute/v2.1/servers/5c74e947-034e-4c4d-80b4-2e6b59f4ae41 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:10.476057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f5c9b3f6-4c17-477c-b3b2-ff57e08bace7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:10.478818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f5c9b3f6-4c17-477c-b3b2-ff57e08bace7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:10.500381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5c9b3f6-4c17-477c-b3b2-ff57e08bace7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.501582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5c9b3f6-4c17-477c-b3b2-ff57e08bace7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.503088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5c9b3f6-4c17-477c-b3b2-ff57e08bace7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.504979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5c9b3f6-4c17-477c-b3b2-ff57e08bace7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.505628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5c9b3f6-4c17-477c-b3b2-ff57e08bace7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.506239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5c9b3f6-4c17-477c-b3b2-ff57e08bace7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.646413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a865d73-db36-4bee-9cdb-a32da095cd87 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.647082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a865d73-db36-4bee-9cdb-a32da095cd87 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.647616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a865d73-db36-4bee-9cdb-a32da095cd87 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.648564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a865d73-db36-4bee-9cdb-a32da095cd87 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.649825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a865d73-db36-4bee-9cdb-a32da095cd87 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.650609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a865d73-db36-4bee-9cdb-a32da095cd87 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.692864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f5c9b3f6-4c17-477c-b3b2-ff57e08bace7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:10.702360 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f5c9b3f6-4c17-477c-b3b2-ff57e08bace7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1678 microversion: 2.1 time: 0.230576 Oct 18 13:31:10.703287 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1789/3386] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:10 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1678 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:10.716517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9c2ea54f-4bc0-4e3d-b203-0fd2b18d3b01 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:10.718113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9c2ea54f-4bc0-4e3d-b203-0fd2b18d3b01 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:10.728398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c2ea54f-4bc0-4e3d-b203-0fd2b18d3b01 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.729131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c2ea54f-4bc0-4e3d-b203-0fd2b18d3b01 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.729857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c2ea54f-4bc0-4e3d-b203-0fd2b18d3b01 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.730784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c2ea54f-4bc0-4e3d-b203-0fd2b18d3b01 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.731455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c2ea54f-4bc0-4e3d-b203-0fd2b18d3b01 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.732093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c2ea54f-4bc0-4e3d-b203-0fd2b18d3b01 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.739917 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1a865d73-db36-4bee-9cdb-a32da095cd87 tempest-QuotasAdminNegativeTest-52047504 tempest-QuotasAdminNegativeTest-52047504-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0" status: 200 len: 329 microversion: 2.1 time: 0.408415 Oct 18 13:31:10.740554 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1598/3387] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:31:10 2022] PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0 => generated 329 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:10.748355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fcad30fd-f58d-4ea4-9497-ec89898cd909 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:10.748355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fcad30fd-f58d-4ea4-9497-ec89898cd909 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:10.755657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcad30fd-f58d-4ea4-9497-ec89898cd909 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.756256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcad30fd-f58d-4ea4-9497-ec89898cd909 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.756690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcad30fd-f58d-4ea4-9497-ec89898cd909 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.757427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcad30fd-f58d-4ea4-9497-ec89898cd909 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.757873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcad30fd-f58d-4ea4-9497-ec89898cd909 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.758296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcad30fd-f58d-4ea4-9497-ec89898cd909 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.785116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:10.921713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9c2ea54f-4bc0-4e3d-b203-0fd2b18d3b01 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:10.926353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fcad30fd-f58d-4ea4-9497-ec89898cd909 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:10.934358 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9c2ea54f-4bc0-4e3d-b203-0fd2b18d3b01 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1506 microversion: 2.1 time: 0.223278 Oct 18 13:31:10.945396 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fcad30fd-f58d-4ea4-9497-ec89898cd909 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1472 microversion: 2.1 time: 0.195440 Oct 18 13:31:10.945396 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1599/3388] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:10 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:10.957304 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1790/3389] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:10 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:10.957465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d002e3b1-8081-4555-ab52-c7859d63333a tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] Calling method '.version_select at 0x7ff614303040>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:10.963529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2a57bc62-877a-44d6-b2ae-c20e318550b6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:10.964143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2a57bc62-877a-44d6-b2ae-c20e318550b6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:10.971276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a57bc62-877a-44d6-b2ae-c20e318550b6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.971800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a57bc62-877a-44d6-b2ae-c20e318550b6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.972341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a57bc62-877a-44d6-b2ae-c20e318550b6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.973328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a57bc62-877a-44d6-b2ae-c20e318550b6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:10.973768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a57bc62-877a-44d6-b2ae-c20e318550b6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:10.974214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a57bc62-877a-44d6-b2ae-c20e318550b6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:10.978133 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d002e3b1-8081-4555-ab52-c7859d63333a tempest-ServersTestFqdnHostnames-147110924 tempest-ServersTestFqdnHostnames-147110924-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-905784993" status: 202 len: 0 microversion: 2.1 time: 0.038473 Oct 18 13:31:10.980324 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1600/3390] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 18 13:31:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-905784993 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:31:11.000538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e6be6e9f-ca80-418a-98c3-c88301f8bd66 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Action: 'update', calling method: .version_select at 0x7ff60fc99ca0>, body: {"quota_set": {"ram": 0}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:11.020572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e6be6e9f-ca80-418a-98c3-c88301f8bd66 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '7119fc5d72a94a508e4742284107a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d9afff3ff44d55aafe117fc403bae0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e6be6e9f-ca80-418a-98c3-c88301f8bd66 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Request method failure captured: Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: request: PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0 HTTP/1.1 Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 25 Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqqS6v-wRn6RElDwl0Q0sUW5ge1WQhXVpxzVRWxFRW1A5TfbyiPCwIsat8zuAhz-jKI--zKP6c_yKUi4_Bq4e3x-3ovp1IZDNFH9WdZnah0cq_YvXolvy3Wr8dMZkThI2Fqiq-thfYwctGurOI_J_Z92TGHZo8IapC2U0wP59SqkcCM Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b3d9afff3ff44d55aafe117fc403bae0 Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-QuotasAdminNegativeTest-547056400 Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3d9afff3ff44d55aafe117fc403bae0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b3d9afff3ff44d55aafe117fc403bae0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3d9afff3ff44d55aafe117fc403bae0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b3d9afff3ff44d55aafe117fc403bae0"}]}] Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-QuotasAdminNegativeTest-547056400 Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b3d9afff3ff44d55aafe117fc403bae0 Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-547056400 Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-QuotasAdminNegativeTest-547056400-project Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7119fc5d72a94a508e4742284107a36e Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-QuotasAdminNegativeTest-547056400-project Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: {"quota_set": {"ram": 0}} Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'b3d9afff3ff44d55aafe117fc403bae0', 'body': {'quota_set': {'ram': 0}}} Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise self.value Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 18 13:31:11.035861 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 18 13:31:11.040840 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:11.043771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e6be6e9f-ca80-418a-98c3-c88301f8bd66 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:11.046117 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e6be6e9f-ca80-418a-98c3-c88301f8bd66 tempest-QuotasAdminNegativeTest-547056400 tempest-QuotasAdminNegativeTest-547056400-project] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0" status: 403 len: 116 microversion: 2.1 time: 0.065331 Oct 18 13:31:11.049167 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1601/3391] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:31:10 2022] PUT /compute/v2.1/os-quota-sets/b3d9afff3ff44d55aafe117fc403bae0 => generated 116 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:11.076941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:11.084756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:11.101055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.102063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.102063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.102779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.103174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.103600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.215793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:31:11.216626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:31:11.217807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:31:11.218436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:31:11.219653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:31:11.319729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:11.329287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.330066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.330749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.332689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.333812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.334467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.379450 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-642e9af1-4595-4294-93e6-5d4817c994f8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "POST /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6/action" status: 202 len: 1112 microversion: 2.1 time: 0.326653 Oct 18 13:31:11.381004 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1602/3392] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:31:11 2022] POST /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6/action => generated 1112 bytes in 329 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 13:31:11.386506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-10e9ef37-34a2-4596-936e-d2f9ab6df99d tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:11.387397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-10e9ef37-34a2-4596-936e-d2f9ab6df99d tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:11.402461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10e9ef37-34a2-4596-936e-d2f9ab6df99d tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.404632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10e9ef37-34a2-4596-936e-d2f9ab6df99d tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.405783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10e9ef37-34a2-4596-936e-d2f9ab6df99d tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.408434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10e9ef37-34a2-4596-936e-d2f9ab6df99d tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.408920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10e9ef37-34a2-4596-936e-d2f9ab6df99d tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.409428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10e9ef37-34a2-4596-936e-d2f9ab6df99d tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.412020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a57bc62-877a-44d6-b2ae-c20e318550b6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:11.434476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a57bc62-877a-44d6-b2ae-c20e318550b6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:11.437917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a57bc62-877a-44d6-b2ae-c20e318550b6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:11.442038 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2a57bc62-877a-44d6-b2ae-c20e318550b6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.482253 Oct 18 13:31:11.443252 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1791/3393] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:10 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:11.458833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e8fc3d6-87d7-458a-bf07-3db265459c57 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:11.459899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7e8fc3d6-87d7-458a-bf07-3db265459c57 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:11.480511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e8fc3d6-87d7-458a-bf07-3db265459c57 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.483287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e8fc3d6-87d7-458a-bf07-3db265459c57 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.484167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e8fc3d6-87d7-458a-bf07-3db265459c57 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.485846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e8fc3d6-87d7-458a-bf07-3db265459c57 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.488920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e8fc3d6-87d7-458a-bf07-3db265459c57 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.489814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e8fc3d6-87d7-458a-bf07-3db265459c57 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.715903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7e8fc3d6-87d7-458a-bf07-3db265459c57 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:11.726217 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7e8fc3d6-87d7-458a-bf07-3db265459c57 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1517 microversion: 2.1 time: 0.276919 Oct 18 13:31:11.727199 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1792/3394] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:11 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1517 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:11.745533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d829f578-906d-486e-a6bc-9f5ccfd013cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:11.748815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d829f578-906d-486e-a6bc-9f5ccfd013cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:11.767576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d829f578-906d-486e-a6bc-9f5ccfd013cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.768183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d829f578-906d-486e-a6bc-9f5ccfd013cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.769306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d829f578-906d-486e-a6bc-9f5ccfd013cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.771935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d829f578-906d-486e-a6bc-9f5ccfd013cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.773529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d829f578-906d-486e-a6bc-9f5ccfd013cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.774861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d829f578-906d-486e-a6bc-9f5ccfd013cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.820058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-10e9ef37-34a2-4596-936e-d2f9ab6df99d tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:11.837891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-10e9ef37-34a2-4596-936e-d2f9ab6df99d tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:11.839829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-10e9ef37-34a2-4596-936e-d2f9ab6df99d tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:11.842624 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-10e9ef37-34a2-4596-936e-d2f9ab6df99d tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.460305 Oct 18 13:31:11.848591 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1603/3395] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:11 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:11.961723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6a4a6e18-b9ba-456a-88c9-af50ab7b7279 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:11.962880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6a4a6e18-b9ba-456a-88c9-af50ab7b7279 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:11.973436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a4a6e18-b9ba-456a-88c9-af50ab7b7279 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.974030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a4a6e18-b9ba-456a-88c9-af50ab7b7279 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.974605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a4a6e18-b9ba-456a-88c9-af50ab7b7279 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:11.975835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a4a6e18-b9ba-456a-88c9-af50ab7b7279 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:11.976360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a4a6e18-b9ba-456a-88c9-af50ab7b7279 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:11.976939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a4a6e18-b9ba-456a-88c9-af50ab7b7279 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:12.068621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d829f578-906d-486e-a6bc-9f5ccfd013cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:12.086579 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d829f578-906d-486e-a6bc-9f5ccfd013cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1678 microversion: 2.1 time: 0.357882 Oct 18 13:31:12.091481 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1793/3396] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:11 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1678 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:12.410684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6a4a6e18-b9ba-456a-88c9-af50ab7b7279 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:12.429801 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6a4a6e18-b9ba-456a-88c9-af50ab7b7279 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1472 microversion: 2.1 time: 0.468788 Oct 18 13:31:12.431817 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1604/3397] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:11 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1472 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:12.474531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc8d867b-7cfa-4d89-8cf7-771f13a7989c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:12.475190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc8d867b-7cfa-4d89-8cf7-771f13a7989c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:12.504300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc8d867b-7cfa-4d89-8cf7-771f13a7989c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:12.504718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc8d867b-7cfa-4d89-8cf7-771f13a7989c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:12.508862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc8d867b-7cfa-4d89-8cf7-771f13a7989c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:12.509652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc8d867b-7cfa-4d89-8cf7-771f13a7989c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:12.510194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc8d867b-7cfa-4d89-8cf7-771f13a7989c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:12.510633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc8d867b-7cfa-4d89-8cf7-771f13a7989c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:12.749702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5baeb59e-0be7-4642-8a53-f91cf43516fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:12.750516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5baeb59e-0be7-4642-8a53-f91cf43516fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:12.760527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5baeb59e-0be7-4642-8a53-f91cf43516fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:12.762876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5baeb59e-0be7-4642-8a53-f91cf43516fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:12.764596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5baeb59e-0be7-4642-8a53-f91cf43516fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:12.765484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5baeb59e-0be7-4642-8a53-f91cf43516fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:12.767388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5baeb59e-0be7-4642-8a53-f91cf43516fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:12.768411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5baeb59e-0be7-4642-8a53-f91cf43516fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:12.802811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc8d867b-7cfa-4d89-8cf7-771f13a7989c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:12.822306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc8d867b-7cfa-4d89-8cf7-771f13a7989c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:12.830790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc8d867b-7cfa-4d89-8cf7-771f13a7989c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:12.833722 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc8d867b-7cfa-4d89-8cf7-771f13a7989c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.364413 Oct 18 13:31:12.849428 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1794/3398] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:12 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:12.878743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8b672813-4bb4-4af4-ad64-2e7e0f63c313 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:12.879433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8b672813-4bb4-4af4-ad64-2e7e0f63c313 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:12.891476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b672813-4bb4-4af4-ad64-2e7e0f63c313 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:12.894095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b672813-4bb4-4af4-ad64-2e7e0f63c313 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:12.894586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b672813-4bb4-4af4-ad64-2e7e0f63c313 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:12.895321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b672813-4bb4-4af4-ad64-2e7e0f63c313 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:12.895839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b672813-4bb4-4af4-ad64-2e7e0f63c313 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:12.900178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b672813-4bb4-4af4-ad64-2e7e0f63c313 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.083851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8b672813-4bb4-4af4-ad64-2e7e0f63c313 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:13.105970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8b672813-4bb4-4af4-ad64-2e7e0f63c313 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:13.116043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8b672813-4bb4-4af4-ad64-2e7e0f63c313 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:13.119302 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8b672813-4bb4-4af4-ad64-2e7e0f63c313 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.245481 Oct 18 13:31:13.141505 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1795/3399] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:12 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:31:13.147933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-57f102be-d55f-468c-9e58-ec19b03a23cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:13.148549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-57f102be-d55f-468c-9e58-ec19b03a23cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:13.156341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57f102be-d55f-468c-9e58-ec19b03a23cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.157164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57f102be-d55f-468c-9e58-ec19b03a23cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.157861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57f102be-d55f-468c-9e58-ec19b03a23cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.158880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57f102be-d55f-468c-9e58-ec19b03a23cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.160593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57f102be-d55f-468c-9e58-ec19b03a23cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.161266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57f102be-d55f-468c-9e58-ec19b03a23cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.278633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5baeb59e-0be7-4642-8a53-f91cf43516fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:13.291761 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5baeb59e-0be7-4642-8a53-f91cf43516fe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1517 microversion: 2.1 time: 0.546671 Oct 18 13:31:13.301368 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1605/3400] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:12 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1517 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:13.318447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-c6ec0dd2-0023-47a5-8f3a-d59a7e5d9955 req-ffb52afc-eec0-483c-abd2-9759b94fd488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0688b2d-dd1e-427c-b5f1-1ac0fad84598", "name": "network-vif-deleted", "tag": "e0e1dcca-7704-41ae-9e89-01a7dda38f72"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:13.349887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c6ec0dd2-0023-47a5-8f3a-d59a7e5d9955 req-ffb52afc-eec0-483c-abd2-9759b94fd488 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.350719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c6ec0dd2-0023-47a5-8f3a-d59a7e5d9955 req-ffb52afc-eec0-483c-abd2-9759b94fd488 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.352737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c6ec0dd2-0023-47a5-8f3a-d59a7e5d9955 req-ffb52afc-eec0-483c-abd2-9759b94fd488 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.386153 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-c6ec0dd2-0023-47a5-8f3a-d59a7e5d9955 req-ffb52afc-eec0-483c-abd2-9759b94fd488 service nova] Creating event network-vif-deleted:e0e1dcca-7704-41ae-9e89-01a7dda38f72 for instance b0688b2d-dd1e-427c-b5f1-1ac0fad84598 on n-h2-858384-13 Oct 18 13:31:13.402308 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-c6ec0dd2-0023-47a5-8f3a-d59a7e5d9955 req-ffb52afc-eec0-483c-abd2-9759b94fd488 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097982 Oct 18 13:31:13.407109 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1606/3401] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:13.457087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:13.457964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:13.473463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.478523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.480881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.485892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.486712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.487408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.580370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.582205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.582885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.583590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lazy-loading 'fault' on Instance uuid b0688b2d-dd1e-427c-b5f1-1ac0fad84598 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:13.627340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-57f102be-d55f-468c-9e58-ec19b03a23cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:13.632923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb58ae89a06444e95eca4c886e9cc0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4a24f687647e4a23fbee030d4e53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:13.639207 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-57f102be-d55f-468c-9e58-ec19b03a23cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1661 microversion: 2.1 time: 0.496421 Oct 18 13:31:13.640004 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1796/3402] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:13 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1661 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:13.650384 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3882c278-40b2-4432-b4c5-26f922dece76 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 200 len: 1307 microversion: 2.1 time: 0.198498 Oct 18 13:31:13.651655 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1607/3403] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:13 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 1307 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:13.683374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b752ad43-a368-4101-9530-eb984a6d4fb5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:13.694423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b752ad43-a368-4101-9530-eb984a6d4fb5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:13.706100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b752ad43-a368-4101-9530-eb984a6d4fb5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.717504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b752ad43-a368-4101-9530-eb984a6d4fb5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.720328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b752ad43-a368-4101-9530-eb984a6d4fb5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.723792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b752ad43-a368-4101-9530-eb984a6d4fb5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.725146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b752ad43-a368-4101-9530-eb984a6d4fb5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.727037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b752ad43-a368-4101-9530-eb984a6d4fb5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.847613 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b752ad43-a368-4101-9530-eb984a6d4fb5 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action" status: 202 len: 0 microversion: 2.1 time: 0.177831 Oct 18 13:31:13.850995 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1797/3404] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:31:13 2022] POST /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:31:13.858886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-54af847a-1761-40c9-8f1a-7b5a1b133a55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:13.859429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-54af847a-1761-40c9-8f1a-7b5a1b133a55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:13.876153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54af847a-1761-40c9-8f1a-7b5a1b133a55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.878796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d34ff60d-9a40-4ef7-b0aa-d45e4138d901 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:13.879494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d34ff60d-9a40-4ef7-b0aa-d45e4138d901 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:13.880379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54af847a-1761-40c9-8f1a-7b5a1b133a55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.880780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54af847a-1761-40c9-8f1a-7b5a1b133a55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.884637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54af847a-1761-40c9-8f1a-7b5a1b133a55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.885095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54af847a-1761-40c9-8f1a-7b5a1b133a55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.885573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54af847a-1761-40c9-8f1a-7b5a1b133a55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.902280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d34ff60d-9a40-4ef7-b0aa-d45e4138d901 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.902779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d34ff60d-9a40-4ef7-b0aa-d45e4138d901 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.903214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d34ff60d-9a40-4ef7-b0aa-d45e4138d901 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:13.910898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d34ff60d-9a40-4ef7-b0aa-d45e4138d901 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:13.911298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d34ff60d-9a40-4ef7-b0aa-d45e4138d901 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:13.913821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d34ff60d-9a40-4ef7-b0aa-d45e4138d901 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:14.200655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-54af847a-1761-40c9-8f1a-7b5a1b133a55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:14.219707 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-54af847a-1761-40c9-8f1a-7b5a1b133a55 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1667 microversion: 2.1 time: 0.363694 Oct 18 13:31:14.223058 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1608/3405] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:13 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1667 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:14.235514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6d0e4866-b62b-417a-8a4c-88adfdf15dce tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:14.239632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6d0e4866-b62b-417a-8a4c-88adfdf15dce tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:14.255289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d0e4866-b62b-417a-8a4c-88adfdf15dce tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:14.257422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d0e4866-b62b-417a-8a4c-88adfdf15dce tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:14.258560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d0e4866-b62b-417a-8a4c-88adfdf15dce tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:14.260959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d0e4866-b62b-417a-8a4c-88adfdf15dce tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:14.262473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d0e4866-b62b-417a-8a4c-88adfdf15dce tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:14.263167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d0e4866-b62b-417a-8a4c-88adfdf15dce tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:14.401586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6d0e4866-b62b-417a-8a4c-88adfdf15dce tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:14.416625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6d0e4866-b62b-417a-8a4c-88adfdf15dce tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:14.419687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6d0e4866-b62b-417a-8a4c-88adfdf15dce tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:14.422364 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6d0e4866-b62b-417a-8a4c-88adfdf15dce tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.197430 Oct 18 13:31:14.423082 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1609/3406] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:14 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:14.451514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-275da4dd-ce1e-42f4-a486-61780d95ca84 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:14.452223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-275da4dd-ce1e-42f4-a486-61780d95ca84 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:14.463044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-275da4dd-ce1e-42f4-a486-61780d95ca84 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:14.463615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-275da4dd-ce1e-42f4-a486-61780d95ca84 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:14.464236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-275da4dd-ce1e-42f4-a486-61780d95ca84 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:14.465827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-275da4dd-ce1e-42f4-a486-61780d95ca84 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:14.466463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-275da4dd-ce1e-42f4-a486-61780d95ca84 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:14.469447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-275da4dd-ce1e-42f4-a486-61780d95ca84 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:14.530531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d34ff60d-9a40-4ef7-b0aa-d45e4138d901 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:14.544848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d34ff60d-9a40-4ef7-b0aa-d45e4138d901 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:14.559165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d34ff60d-9a40-4ef7-b0aa-d45e4138d901 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:14.560401 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d34ff60d-9a40-4ef7-b0aa-d45e4138d901 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.696435 Oct 18 13:31:14.571280 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1798/3407] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:13 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:14.678529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-17c657f7-e081-48c1-8b85-95eb897b8793 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:14.679083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-17c657f7-e081-48c1-8b85-95eb897b8793 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] [instance: b0688b2d-dd1e-427c-b5f1-1ac0fad84598] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:14.688607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17c657f7-e081-48c1-8b85-95eb897b8793 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:14.689096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17c657f7-e081-48c1-8b85-95eb897b8793 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:14.689557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17c657f7-e081-48c1-8b85-95eb897b8793 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:14.690256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17c657f7-e081-48c1-8b85-95eb897b8793 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:14.691238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17c657f7-e081-48c1-8b85-95eb897b8793 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:14.691649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17c657f7-e081-48c1-8b85-95eb897b8793 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:14.735492 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-17c657f7-e081-48c1-8b85-95eb897b8793 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] HTTP exception thrown: Instance b0688b2d-dd1e-427c-b5f1-1ac0fad84598 could not be found. Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-17c657f7-e081-48c1-8b85-95eb897b8793 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Request method failure captured: Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 HTTP/1.1 Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqndNLs5iysNG23-990uCB6IZiSZkcLI4gL8Qkhkx6hDM3roQSaiGw3uN57kA58uDMNrm3neXJWgNJRAid03luKpDQ1sZv_fzgili9c_3TIxftm-KkB76hk5QD3QbHyppnfRAcigbOIXHX0jEj11r1ElaYHrcV6kpFMOD216mFEzEZU Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/caf4a24f687647e4a23fbee030d4e53a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_caf4a24f687647e4a23fbee030d4e53a"}]}] Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: caf4a24f687647e4a23fbee030d4e53a Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1896020738 Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 2cb58ae89a06444e95eca4c886e9cc0c Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersOnMultiNodesTest-1896020738-project Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance b0688b2d-dd1e-427c-b5f1-1ac0fad84598 could not be found. Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'b0688b2d-dd1e-427c-b5f1-1ac0fad84598'} Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0688b2d-dd1e-427c-b5f1-1ac0fad84598 could not be found. Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0688b2d-dd1e-427c-b5f1-1ac0fad84598 could not be found. Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:14.737157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:14.742370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:14.742370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:14.742370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:14.742370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:14.742370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:14.742370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0688b2d-dd1e-427c-b5f1-1ac0fad84598 could not be found. Oct 18 13:31:14.742370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:14.742370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-17c657f7-e081-48c1-8b85-95eb897b8793 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] Returning 404 to user: Instance b0688b2d-dd1e-427c-b5f1-1ac0fad84598 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:14.742370 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-17c657f7-e081-48c1-8b85-95eb897b8793 tempest-ServersOnMultiNodesTest-1896020738 tempest-ServersOnMultiNodesTest-1896020738-project] 10.222.0.40 "GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598" status: 404 len: 111 microversion: 2.1 time: 0.064248 Oct 18 13:31:14.743063 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1799/3408] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:14 2022] GET /compute/v2.1/servers/b0688b2d-dd1e-427c-b5f1-1ac0fad84598 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:14.846773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-275da4dd-ce1e-42f4-a486-61780d95ca84 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:14.861730 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-275da4dd-ce1e-42f4-a486-61780d95ca84 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1517 microversion: 2.1 time: 0.416644 Oct 18 13:31:14.867879 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1610/3409] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:14 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1517 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:15.245911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-143b557b-0503-44e5-9703-83e59cab2f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:15.247074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-143b557b-0503-44e5-9703-83e59cab2f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:15.277036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-143b557b-0503-44e5-9703-83e59cab2f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:15.278335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-143b557b-0503-44e5-9703-83e59cab2f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:15.282200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-143b557b-0503-44e5-9703-83e59cab2f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:15.284374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-143b557b-0503-44e5-9703-83e59cab2f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:15.285858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-143b557b-0503-44e5-9703-83e59cab2f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:15.291298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-143b557b-0503-44e5-9703-83e59cab2f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:15.451070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-44eaddf1-58b4-4102-989e-bdf6d0b59514 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:15.452188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-44eaddf1-58b4-4102-989e-bdf6d0b59514 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:15.467791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44eaddf1-58b4-4102-989e-bdf6d0b59514 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:15.472025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44eaddf1-58b4-4102-989e-bdf6d0b59514 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:15.473660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44eaddf1-58b4-4102-989e-bdf6d0b59514 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:15.477739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44eaddf1-58b4-4102-989e-bdf6d0b59514 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:15.479257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44eaddf1-58b4-4102-989e-bdf6d0b59514 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:15.483853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44eaddf1-58b4-4102-989e-bdf6d0b59514 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:15.645330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-44eaddf1-58b4-4102-989e-bdf6d0b59514 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:15.656198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-44eaddf1-58b4-4102-989e-bdf6d0b59514 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:15.662651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-44eaddf1-58b4-4102-989e-bdf6d0b59514 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:15.664253 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-44eaddf1-58b4-4102-989e-bdf6d0b59514 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.217442 Oct 18 13:31:15.665021 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1611/3410] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:15 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:15.700023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-28cf0a01-1b4c-4588-98fa-bec454f39d51 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:15.707252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-28cf0a01-1b4c-4588-98fa-bec454f39d51 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:15.732786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28cf0a01-1b4c-4588-98fa-bec454f39d51 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:15.733300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28cf0a01-1b4c-4588-98fa-bec454f39d51 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:15.735537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28cf0a01-1b4c-4588-98fa-bec454f39d51 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:15.736285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28cf0a01-1b4c-4588-98fa-bec454f39d51 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:15.736744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28cf0a01-1b4c-4588-98fa-bec454f39d51 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:15.737172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28cf0a01-1b4c-4588-98fa-bec454f39d51 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:15.822887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-143b557b-0503-44e5-9703-83e59cab2f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:15.831965 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-143b557b-0503-44e5-9703-83e59cab2f26 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1667 microversion: 2.1 time: 0.592163 Oct 18 13:31:15.832551 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1800/3411] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:15 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1667 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:15.894367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93c2cfa0-d216-4451-96c1-0138d3175da7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:15.895474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-93c2cfa0-d216-4451-96c1-0138d3175da7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:15.907207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93c2cfa0-d216-4451-96c1-0138d3175da7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:15.910527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93c2cfa0-d216-4451-96c1-0138d3175da7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:15.911211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93c2cfa0-d216-4451-96c1-0138d3175da7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:15.913322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93c2cfa0-d216-4451-96c1-0138d3175da7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:15.914621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93c2cfa0-d216-4451-96c1-0138d3175da7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:15.915703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93c2cfa0-d216-4451-96c1-0138d3175da7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:16.178651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-93c2cfa0-d216-4451-96c1-0138d3175da7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:16.197585 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-93c2cfa0-d216-4451-96c1-0138d3175da7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1517 microversion: 2.1 time: 0.309144 Oct 18 13:31:16.201637 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1801/3412] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:15 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1517 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:16.343151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-28cf0a01-1b4c-4588-98fa-bec454f39d51 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:16.357106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-28cf0a01-1b4c-4588-98fa-bec454f39d51 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:16.364351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-28cf0a01-1b4c-4588-98fa-bec454f39d51 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:16.366512 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-28cf0a01-1b4c-4588-98fa-bec454f39d51 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.686018 Oct 18 13:31:16.369629 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1612/3413] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:15 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:16.697104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9f2068d0-657a-40e9-95f4-589f8e4bcc01 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:16.697766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9f2068d0-657a-40e9-95f4-589f8e4bcc01 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:16.713691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f2068d0-657a-40e9-95f4-589f8e4bcc01 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:16.714185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f2068d0-657a-40e9-95f4-589f8e4bcc01 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:16.719256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f2068d0-657a-40e9-95f4-589f8e4bcc01 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:16.720465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f2068d0-657a-40e9-95f4-589f8e4bcc01 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:16.728564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f2068d0-657a-40e9-95f4-589f8e4bcc01 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:16.729032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f2068d0-657a-40e9-95f4-589f8e4bcc01 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:16.849332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13ac33ab-30ff-4f1c-b62a-4a3222cf09a9 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Action: 'create', calling method: .version_select at 0x7ff60ec12f70>, body: {"keypair": {"name": "tempest-keypair-632289830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJM5WRN82r4MwgAb/Iq6xZIdmEQ2wV5J13pWqWHKE2DEKCctRPUvGs/cQ4iVPEPaWq/3EVBFX5PKNCbGDFypOBklSznHrVd6HqMWzJ98J1ZIvNlcjx3by0tzuMcx918EVA=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:16.873309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-13ac33ab-30ff-4f1c-b62a-4a3222cf09a9 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:16.881062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-13ac33ab-30ff-4f1c-b62a-4a3222cf09a9 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for user 1ec7bfa430504a89bc449fcfce46f9b3 and project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:16.950873 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13ac33ab-30ff-4f1c-b62a-4a3222cf09a9 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.749135 Oct 18 13:31:16.951833 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1802/3414] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 752 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:31:16.970438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0a8e3e2b-af66-42d5-8142-c5a8d5941e8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:16.977435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0a8e3e2b-af66-42d5-8142-c5a8d5941e8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:17.013534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a8e3e2b-af66-42d5-8142-c5a8d5941e8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:17.014393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a8e3e2b-af66-42d5-8142-c5a8d5941e8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:17.017940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a8e3e2b-af66-42d5-8142-c5a8d5941e8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:17.022077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a8e3e2b-af66-42d5-8142-c5a8d5941e8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:17.023393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a8e3e2b-af66-42d5-8142-c5a8d5941e8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:17.027953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a8e3e2b-af66-42d5-8142-c5a8d5941e8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:17.089295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9f2068d0-657a-40e9-95f4-589f8e4bcc01 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:17.106429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9f2068d0-657a-40e9-95f4-589f8e4bcc01 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:17.109599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9f2068d0-657a-40e9-95f4-589f8e4bcc01 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:17.117645 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9f2068d0-657a-40e9-95f4-589f8e4bcc01 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.425776 Oct 18 13:31:17.120056 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1613/3415] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:16 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:31:17.126717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bb3add32-d545-4709-8c88-1230e1a303ff tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff617b5c550>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:17.151738 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bb3add32-d545-4709-8c88-1230e1a303ff tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-632289830" status: 200 len: 512 microversion: 2.2 time: 0.027140 Oct 18 13:31:17.153655 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1614/3416] 10.222.0.40 () {60 vars in 1255 bytes} [Tue Oct 18 13:31:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-632289830 => generated 512 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:17.166345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b26f9110-0910-4247-a040-d0b9135e14e1 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff60fc993a0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:17.212636 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b26f9110-0910-4247-a040-d0b9135e14e1 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-632289830" status: 204 len: 0 microversion: 2.2 time: 0.051049 Oct 18 13:31:17.213482 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1615/3417] 10.222.0.40 () {60 vars in 1258 bytes} [Tue Oct 18 13:31:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-632289830 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:17.232110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-263bb029-d4ec-4db6-adbc-388c6f5de32d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:17.235895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-263bb029-d4ec-4db6-adbc-388c6f5de32d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:17.252236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-263bb029-d4ec-4db6-adbc-388c6f5de32d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:17.252941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-263bb029-d4ec-4db6-adbc-388c6f5de32d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:17.254184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-263bb029-d4ec-4db6-adbc-388c6f5de32d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:17.255400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-263bb029-d4ec-4db6-adbc-388c6f5de32d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:17.256087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-263bb029-d4ec-4db6-adbc-388c6f5de32d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:17.256684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-263bb029-d4ec-4db6-adbc-388c6f5de32d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:17.686621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-263bb029-d4ec-4db6-adbc-388c6f5de32d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:17.699576 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-263bb029-d4ec-4db6-adbc-388c6f5de32d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1517 microversion: 2.1 time: 0.474706 Oct 18 13:31:17.710099 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1616/3418] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:17 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1517 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:17.712943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0a8e3e2b-af66-42d5-8142-c5a8d5941e8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:17.719448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5387e649-83f0-4ab7-83ea-dca5819a47c5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Action: 'create', calling method: .version_select at 0x7ff60fd98430>, body: {"keypair": {"name": "tempest-keypair-2095488878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5eByEhRDOUzGdjAT3qITk8LClab+aumVXaP99ysiue5toBc7XU6rRB4kaDlneg/jr6k4gMGbXoZJZUkPkpMeTKIMwCJd1g4tTlcmTkOi0YIwnPnYbe4TTWkJykNfcwbQ=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:17.723500 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0a8e3e2b-af66-42d5-8142-c5a8d5941e8c tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.770339 Oct 18 13:31:17.724078 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1803/3419] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:16 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:17.742971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f25a15cf-fd1e-4471-b02a-8f788314f856 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:17.743825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f25a15cf-fd1e-4471-b02a-8f788314f856 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:17.756534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f25a15cf-fd1e-4471-b02a-8f788314f856 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:17.759598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=5,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:17.763155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f25a15cf-fd1e-4471-b02a-8f788314f856 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:17.764417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f25a15cf-fd1e-4471-b02a-8f788314f856 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:17.768283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f25a15cf-fd1e-4471-b02a-8f788314f856 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:17.770699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f25a15cf-fd1e-4471-b02a-8f788314f856 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:17.771155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f25a15cf-fd1e-4471-b02a-8f788314f856 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:17.778915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5387e649-83f0-4ab7-83ea-dca5819a47c5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:17.802543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5387e649-83f0-4ab7-83ea-dca5819a47c5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for user 1ec7bfa430504a89bc449fcfce46f9b3 and project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:17.868969 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5387e649-83f0-4ab7-83ea-dca5819a47c5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.164559 Oct 18 13:31:17.869835 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1617/3420] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:31:17.885515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68acaabd-4f0d-408c-ab5a-11775eb228cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:17.886514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-68acaabd-4f0d-408c-ab5a-11775eb228cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:17.904657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68acaabd-4f0d-408c-ab5a-11775eb228cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:17.906741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68acaabd-4f0d-408c-ab5a-11775eb228cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:17.907378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68acaabd-4f0d-408c-ab5a-11775eb228cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:17.911825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68acaabd-4f0d-408c-ab5a-11775eb228cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:17.912586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68acaabd-4f0d-408c-ab5a-11775eb228cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:17.913591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68acaabd-4f0d-408c-ab5a-11775eb228cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:18.812847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-68acaabd-4f0d-408c-ab5a-11775eb228cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:18.822043 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-68acaabd-4f0d-408c-ab5a-11775eb228cc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1670 microversion: 2.1 time: 0.949686 Oct 18 13:31:18.823241 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1618/3421] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:17 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1670 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:18.828982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31082002-6615-4d93-8980-82208371808a tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff60fe1f9d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:18.855679 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31082002-6615-4d93-8980-82208371808a tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095488878" status: 204 len: 0 microversion: 2.2 time: 0.030324 Oct 18 13:31:18.856699 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1619/3422] 10.222.0.40 () {60 vars in 1261 bytes} [Tue Oct 18 13:31:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095488878 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:18.867180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a96f6d7-05a0-4503-83cf-1d0a840395e4 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:18.868094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4a96f6d7-05a0-4503-83cf-1d0a840395e4 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:18.879171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a96f6d7-05a0-4503-83cf-1d0a840395e4 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:18.880978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a96f6d7-05a0-4503-83cf-1d0a840395e4 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:18.882181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a96f6d7-05a0-4503-83cf-1d0a840395e4 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:18.883800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a96f6d7-05a0-4503-83cf-1d0a840395e4 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:18.884043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f25a15cf-fd1e-4471-b02a-8f788314f856 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:18.884984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a96f6d7-05a0-4503-83cf-1d0a840395e4 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:18.885630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a96f6d7-05a0-4503-83cf-1d0a840395e4 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:18.910302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f25a15cf-fd1e-4471-b02a-8f788314f856 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:18.915896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f25a15cf-fd1e-4471-b02a-8f788314f856 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:18.919066 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f25a15cf-fd1e-4471-b02a-8f788314f856 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 1.188055 Oct 18 13:31:18.921681 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1804/3423] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:17 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:18.931716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7dc8a872-9c52-4fa1-9105-86d3feb330ff tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:18.932707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7dc8a872-9c52-4fa1-9105-86d3feb330ff tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:18.941383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:18.971165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:18.974461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dc8a872-9c52-4fa1-9105-86d3feb330ff tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:18.977590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dc8a872-9c52-4fa1-9105-86d3feb330ff tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:18.978191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dc8a872-9c52-4fa1-9105-86d3feb330ff tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:18.979079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dc8a872-9c52-4fa1-9105-86d3feb330ff tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:18.981198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dc8a872-9c52-4fa1-9105-86d3feb330ff tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:18.982366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dc8a872-9c52-4fa1-9105-86d3feb330ff tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:19.113975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a96f6d7-05a0-4503-83cf-1d0a840395e4 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:19.133005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a96f6d7-05a0-4503-83cf-1d0a840395e4 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:19.135948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a96f6d7-05a0-4503-83cf-1d0a840395e4 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:19.140936 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4a96f6d7-05a0-4503-83cf-1d0a840395e4 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.279243 Oct 18 13:31:19.141834 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1620/3424] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:18 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:19.152352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:19.157071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:19.172960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:19.173518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:19.176159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:19.177591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:19.180877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:19.181612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:19.262783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:19.279789 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.compute.api [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Working on deleting snapshot 847133a3-e989-4e91-8b5c-8d45cab7207f from shelved instance... Oct 18 13:31:19.429112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7dc8a872-9c52-4fa1-9105-86d3feb330ff tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:19.432078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:19.441080 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7dc8a872-9c52-4fa1-9105-86d3feb330ff tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1517 microversion: 2.1 time: 0.517877 Oct 18 13:31:19.442512 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1805/3425] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:18 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1517 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:19.447956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87c81f99-2d68-4853-acee-c5169a17157a tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Action: 'create', calling method: .version_select at 0x7ff60eca54c0>, body: {"keypair": {"name": "tempest-keypair-765331849", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:19.473777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-87c81f99-2d68-4853-acee-c5169a17157a tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:19.484607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-87c81f99-2d68-4853-acee-c5169a17157a tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for user 1ec7bfa430504a89bc449fcfce46f9b3 and project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:19.520922 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-87c81f99-2d68-4853-acee-c5169a17157a tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.076849 Oct 18 13:31:19.524356 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1806/3426] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:19 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:31:19.544186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-580bd04a-5b82-418c-bf50-eea4daa0a575 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff60edd6820>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:19.607158 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-580bd04a-5b82-418c-bf50-eea4daa0a575 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-765331849" status: 204 len: 0 microversion: 2.2 time: 0.075206 Oct 18 13:31:19.610663 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1807/3427] 10.222.0.40 () {60 vars in 1258 bytes} [Tue Oct 18 13:31:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-765331849 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:31:19.651131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cca0a22d-84a7-4fd0-bcdb-dcb5887a8ee2 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Action: 'create', calling method: .version_select at 0x7ff60effb3a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1280125789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9e+VYmkMqZqqa/KGzodMUds2nyo88AKzfeaxLH4gWuDQOE3u2+H0VPsMLPYdPcg34m8fPAzjSL00hieKcFZ0gLbDYZnb++FCa0ACFyZjILroRDOZd6BTHv0NPF84Yqaw=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:19.727254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-cca0a22d-84a7-4fd0-bcdb-dcb5887a8ee2 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:19.744183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-cca0a22d-84a7-4fd0-bcdb-dcb5887a8ee2 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for user 1ec7bfa430504a89bc449fcfce46f9b3 and project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:19.822145 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cca0a22d-84a7-4fd0-bcdb-dcb5887a8ee2 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.196168 Oct 18 13:31:19.832322 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1808/3428] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:19 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 207 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:31:19.848329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04fc0798-26e8-4048-8291-473bb4637ae4 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Action: 'create', calling method: .version_select at 0x7ff60eeb8ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-724498693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhzzWubqt743bDE56jmclS+P787lu13zwl8UlPqlNVayojzaiCj3tmpHR6mdAOzMOvjqS6C0AJsjUQ8ofPRM+QMP9hGRVZ/DbE4ef15/6jU4GP7NtLoPJ8IwF4N41oTwQ=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:19.907912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-04fc0798-26e8-4048-8291-473bb4637ae4 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:19.925883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-04fc0798-26e8-4048-8291-473bb4637ae4 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for user 1ec7bfa430504a89bc449fcfce46f9b3 and project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:19.960547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=8 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:20.007366 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04fc0798-26e8-4048-8291-473bb4637ae4 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.168906 Oct 18 13:31:20.019440 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1809/3429] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:19 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 182 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:31:20.024501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-20e819e7-8b42-4a7a-921f-734a03be840c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:20.049422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-20e819e7-8b42-4a7a-921f-734a03be840c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:20.060342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20e819e7-8b42-4a7a-921f-734a03be840c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:20.060600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20e819e7-8b42-4a7a-921f-734a03be840c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:20.061043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20e819e7-8b42-4a7a-921f-734a03be840c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:20.074285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20e819e7-8b42-4a7a-921f-734a03be840c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:20.074845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20e819e7-8b42-4a7a-921f-734a03be840c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:20.075301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20e819e7-8b42-4a7a-921f-734a03be840c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:20.611906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-20e819e7-8b42-4a7a-921f-734a03be840c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:20.629797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-20e819e7-8b42-4a7a-921f-734a03be840c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:20.645045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-20e819e7-8b42-4a7a-921f-734a03be840c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:20.646526 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-20e819e7-8b42-4a7a-921f-734a03be840c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.625744 Oct 18 13:31:20.647136 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1810/3430] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:20 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:20.652092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3f259e87-ce73-4ed9-ac44-813632e1b5ad tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Action: 'create', calling method: .version_select at 0x7ff60ef3a5e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1668185248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6kGA3E6v6C3exJzB81ySfMeBuGXuTw/fIAWJorHQCod4fSxMIwI8vBDHT9XdMDNkzxvUstYF/jgZ6NSlj9YhVlH1rVMRMK56FEsK2hHOcq90+nGx0cqzOPOBAcRgtFsg=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:20.660650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=10 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:20.700738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Doing local delete in cell a8e216eb-ce73-4101-a62e-f9159a9c2bcf(cell1) {{(pid=120612) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 18 13:31:20.706313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:20.707058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:20.709371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:20.710073 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.compute.api [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 18 13:31:20.720939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] deallocate_for_instance() {{(pid=120612) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 18 13:31:20.726043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3f259e87-ce73-4ed9-ac44-813632e1b5ad tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:20.746745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3f259e87-ce73-4ed9-ac44-813632e1b5ad tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for user 1ec7bfa430504a89bc449fcfce46f9b3 and project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:20.787507 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3f259e87-ce73-4ed9-ac44-813632e1b5ad tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.139026 Oct 18 13:31:20.788385 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1811/3431] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:20 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:31:20.801858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-264a946e-546a-488f-855e-9fdfe8416d18 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:20.805442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-264a946e-546a-488f-855e-9fdfe8416d18 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:20.817154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-264a946e-546a-488f-855e-9fdfe8416d18 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:20.821698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-264a946e-546a-488f-855e-9fdfe8416d18 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:20.822365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-264a946e-546a-488f-855e-9fdfe8416d18 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:20.826796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-264a946e-546a-488f-855e-9fdfe8416d18 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:20.827595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-264a946e-546a-488f-855e-9fdfe8416d18 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:20.828187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-264a946e-546a-488f-855e-9fdfe8416d18 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:20.975087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-264a946e-546a-488f-855e-9fdfe8416d18 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:21.009547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-264a946e-546a-488f-855e-9fdfe8416d18 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:21.015655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-264a946e-546a-488f-855e-9fdfe8416d18 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:21.022929 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-264a946e-546a-488f-855e-9fdfe8416d18 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1604 microversion: 2.42 time: 0.230586 Oct 18 13:31:21.027514 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1812/3432] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:20 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1604 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:21.032903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8c8c8b99-2ca0-4f95-a548-c4888678f372 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:21.042616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8c8c8b99-2ca0-4f95-a548-c4888678f372 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:21.055915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c8c8b99-2ca0-4f95-a548-c4888678f372 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:21.056511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c8c8b99-2ca0-4f95-a548-c4888678f372 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:21.057011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c8c8b99-2ca0-4f95-a548-c4888678f372 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:21.057751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c8c8b99-2ca0-4f95-a548-c4888678f372 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:21.058676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c8c8b99-2ca0-4f95-a548-c4888678f372 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:21.059448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c8c8b99-2ca0-4f95-a548-c4888678f372 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:21.327386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8c8c8b99-2ca0-4f95-a548-c4888678f372 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:21.340160 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8c8c8b99-2ca0-4f95-a548-c4888678f372 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1517 microversion: 2.1 time: 0.311110 Oct 18 13:31:21.341242 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1813/3433] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:21 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1517 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:21.346033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6b31d8e1-53ee-4448-92d9-1347b9ec3f53 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff60ef3a670>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:21.350429 n-d-858384-13 devstack@n-api.service[120611]: WARNING oslo_db.sqlalchemy.utils [None req-6b31d8e1-53ee-4448-92d9-1347b9ec3f53 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 13:31:21.363379 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6b31d8e1-53ee-4448-92d9-1347b9ec3f53 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.020955 Oct 18 13:31:21.364288 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1814/3434] 10.222.0.40 () {60 vars in 1177 bytes} [Tue Oct 18 13:31:21 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:21.711230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-19cb898c-10ca-406f-aa42-0ed7ec2b5d93 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:21.715902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19cb898c-10ca-406f-aa42-0ed7ec2b5d93 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:21.717493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19cb898c-10ca-406f-aa42-0ed7ec2b5d93 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:21.719337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19cb898c-10ca-406f-aa42-0ed7ec2b5d93 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:21.721124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19cb898c-10ca-406f-aa42-0ed7ec2b5d93 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:21.722308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19cb898c-10ca-406f-aa42-0ed7ec2b5d93 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:21.723282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19cb898c-10ca-406f-aa42-0ed7ec2b5d93 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:21.754391 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-19cb898c-10ca-406f-aa42-0ed7ec2b5d93 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.388486 Oct 18 13:31:21.755249 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1815/3435] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:31:21 2022] GET /compute/v2.1/os-services => generated 949 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:21.765611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53e31c2a-d5b0-4a17-9f9d-95df105dcba7 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff60eecac10>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:21.798105 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53e31c2a-d5b0-4a17-9f9d-95df105dcba7 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1668185248" status: 204 len: 0 microversion: 2.2 time: 0.041545 Oct 18 13:31:21.800919 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1816/3436] 10.222.0.40 () {60 vars in 1321 bytes} [Tue Oct 18 13:31:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1668185248 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:21.810404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3ab4fd07-71c6-4eb8-ac3a-aa2c436860ea tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:21.814860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3ab4fd07-71c6-4eb8-ac3a-aa2c436860ea tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:21.826647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab4fd07-71c6-4eb8-ac3a-aa2c436860ea tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:21.828011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab4fd07-71c6-4eb8-ac3a-aa2c436860ea tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:21.828902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab4fd07-71c6-4eb8-ac3a-aa2c436860ea tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:21.830078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab4fd07-71c6-4eb8-ac3a-aa2c436860ea tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:21.830729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab4fd07-71c6-4eb8-ac3a-aa2c436860ea tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:21.832041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab4fd07-71c6-4eb8-ac3a-aa2c436860ea tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:21.899188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Updating instance_info_cache with network_info: [] {{(pid=120612) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:31:22.150653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ab4fd07-71c6-4eb8-ac3a-aa2c436860ea tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:22.167684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ab4fd07-71c6-4eb8-ac3a-aa2c436860ea tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:22.170245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ab4fd07-71c6-4eb8-ac3a-aa2c436860ea tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:22.172852 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3ab4fd07-71c6-4eb8-ac3a-aa2c436860ea tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.369441 Oct 18 13:31:22.177248 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1817/3437] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:21 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:22.198012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-843ea5b7-90a9-44f8-b5ce-8fb48420a560 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.202493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-843ea5b7-90a9-44f8-b5ce-8fb48420a560 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.203411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-843ea5b7-90a9-44f8-b5ce-8fb48420a560 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.204242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-843ea5b7-90a9-44f8-b5ce-8fb48420a560 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.205453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-843ea5b7-90a9-44f8-b5ce-8fb48420a560 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.206807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-843ea5b7-90a9-44f8-b5ce-8fb48420a560 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.207582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-843ea5b7-90a9-44f8-b5ce-8fb48420a560 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.240727 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-843ea5b7-90a9-44f8-b5ce-8fb48420a560 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=n-d-858384-13" status: 200 len: 581 microversion: 2.1 time: 0.062178 Oct 18 13:31:22.241472 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1818/3438] 10.222.0.40 () {58 vars in 1174 bytes} [Tue Oct 18 13:31:22 2022] GET /compute/v2.1/os-services?host=n-d-858384-13 => generated 581 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:22.247521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-82519382-ecd2-47c6-94f7-91ab117b3ffe tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff60ec10280>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.263694 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1260327d-6508-4a99-9301-5eabb35513d8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "DELETE /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 204 len: 0 microversion: 2.1 time: 3.120486 Oct 18 13:31:22.264848 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1621/3439] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:19 2022] DELETE /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 0 bytes in 3122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:22.271170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-aa17b67e-a3fe-4908-b5b1-717474e8d68e req-3e3ba020-a495-44bd-a177-0d3a507be107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b83d20-5690-49dc-bff4-e6906a63ee23", "name": "network-vif-deleted", "tag": "e01e4d55-3474-4431-af07-7a611cccd407"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:22.275378 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-82519382-ecd2-47c6-94f7-91ab117b3ffe tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-724498693" status: 204 len: 0 microversion: 2.2 time: 0.032586 Oct 18 13:31:22.277225 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1819/3440] 10.222.0.40 () {60 vars in 1318 bytes} [Tue Oct 18 13:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-724498693 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:22.291597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.292671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:22.298580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-aa17b67e-a3fe-4908-b5b1-717474e8d68e req-3e3ba020-a495-44bd-a177-0d3a507be107 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.299318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-aa17b67e-a3fe-4908-b5b1-717474e8d68e req-3e3ba020-a495-44bd-a177-0d3a507be107 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.300240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-aa17b67e-a3fe-4908-b5b1-717474e8d68e req-3e3ba020-a495-44bd-a177-0d3a507be107 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.300771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.301349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.301825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.302526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.303156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.303717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.318121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.compute.server_external_events [req-aa17b67e-a3fe-4908-b5b1-717474e8d68e req-3e3ba020-a495-44bd-a177-0d3a507be107 service nova] Unable to find a host for instance 92b83d20-5690-49dc-bff4-e6906a63ee23. Dropping event network-vif-deleted {{(pid=120612) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 13:31:22.319575 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-aa17b67e-a3fe-4908-b5b1-717474e8d68e req-3e3ba020-a495-44bd-a177-0d3a507be107 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.053626 Oct 18 13:31:22.320988 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1622/3441] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 18 13:31:22.327168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7922e075-6842-4d42-98cc-b0dd97d4ab14 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.332786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7922e075-6842-4d42-98cc-b0dd97d4ab14 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.334115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7922e075-6842-4d42-98cc-b0dd97d4ab14 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.334856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7922e075-6842-4d42-98cc-b0dd97d4ab14 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.335804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7922e075-6842-4d42-98cc-b0dd97d4ab14 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.336515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7922e075-6842-4d42-98cc-b0dd97d4ab14 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.337887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7922e075-6842-4d42-98cc-b0dd97d4ab14 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.370666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.371705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.372488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.373148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lazy-loading 'fault' on Instance uuid f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:31:22.380221 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7922e075-6842-4d42-98cc-b0dd97d4ab14 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.057923 Oct 18 13:31:22.382758 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1623/3442] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 18 13:31:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:22.388053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c2d458ea-2923-4657-90c9-a09c759d2ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.388666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c2d458ea-2923-4657-90c9-a09c759d2ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 92b83d20-5690-49dc-bff4-e6906a63ee23] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:22.403239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2d458ea-2923-4657-90c9-a09c759d2ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.407357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2d458ea-2923-4657-90c9-a09c759d2ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.407821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2d458ea-2923-4657-90c9-a09c759d2ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.408575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2d458ea-2923-4657-90c9-a09c759d2ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.409127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2d458ea-2923-4657-90c9-a09c759d2ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.411233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2d458ea-2923-4657-90c9-a09c759d2ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.425356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:22.429869 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-c2d458ea-2923-4657-90c9-a09c759d2ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] HTTP exception thrown: Instance 92b83d20-5690-49dc-bff4-e6906a63ee23 could not be found. Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c2d458ea-2923-4657-90c9-a09c759d2ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Request method failure captured: Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 HTTP/1.1 Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqgSyOovjkBwC2zDG9FKchsa-85pvviPiRczs79e9ogA2WOflaKqo4WjkGNjiwWrTbKQeMF0qFdRR97LgwpYjvL7_VWxucAaxUZM-ArWvxecTGdyg6CEOtjVVE0a_ifjjfGSQqXSLBM0YxminaTsZoLWFl2mIOYtfxpGTzdnzLBn-rI Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 452e5b77db474cf9a2b7f6b2abcb6115 Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_452e5b77db474cf9a2b7f6b2abcb6115"}]}] Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 452e5b77db474cf9a2b7f6b2abcb6115 Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerActionsTestJSON-330379010-project Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 2878f8de95694fe1a9a17ed27b6ba40b Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerActionsTestJSON-330379010-project Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 92b83d20-5690-49dc-bff4-e6906a63ee23 could not be found. Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '92b83d20-5690-49dc-bff4-e6906a63ee23'} Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b83d20-5690-49dc-bff4-e6906a63ee23 could not be found. Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b83d20-5690-49dc-bff4-e6906a63ee23 could not be found. Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:22.431662 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:22.436309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:22.436309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:22.436309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:22.436309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:22.436309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:22.436309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b83d20-5690-49dc-bff4-e6906a63ee23 could not be found. Oct 18 13:31:22.436309 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:22.436751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:22.438633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c2d458ea-2923-4657-90c9-a09c759d2ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Returning 404 to user: Instance 92b83d20-5690-49dc-bff4-e6906a63ee23 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:22.439366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3922bd65ede4e2586d23741b8ac19a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e1c317d0a34148949ddddadffb4415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:22.439940 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c2d458ea-2923-4657-90c9-a09c759d2ec8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23" status: 404 len: 111 microversion: 2.1 time: 0.055652 Oct 18 13:31:22.441335 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a016fc5b-39d6-4979-a351-3234b264d211 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 200 len: 1371 microversion: 2.42 time: 0.158390 Oct 18 13:31:22.441820 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1624/3443] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:22 2022] GET /compute/v2.1/servers/92b83d20-5690-49dc-bff4-e6906a63ee23 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:22.442838 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1820/3444] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:22 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:22.447687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-639c938b-9bbc-4caa-a319-e7f7ae1da822 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.448487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-639c938b-9bbc-4caa-a319-e7f7ae1da822 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:22.455547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-639c938b-9bbc-4caa-a319-e7f7ae1da822 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.456382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-639c938b-9bbc-4caa-a319-e7f7ae1da822 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.457117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-639c938b-9bbc-4caa-a319-e7f7ae1da822 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.458076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-639c938b-9bbc-4caa-a319-e7f7ae1da822 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.458748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-639c938b-9bbc-4caa-a319-e7f7ae1da822 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.459472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-639c938b-9bbc-4caa-a319-e7f7ae1da822 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.466786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dabecdfd-c2e7-4f89-a286-0258738badde tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff617b11430>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.491207 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dabecdfd-c2e7-4f89-a286-0258738badde tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1280125789" status: 204 len: 0 microversion: 2.2 time: 0.036979 Oct 18 13:31:22.492082 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1625/3445] 10.222.0.40 () {60 vars in 1321 bytes} [Tue Oct 18 13:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1280125789 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:22.504874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b9330831-ef69-4168-9e2e-2aaf1f476304 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.510112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9330831-ef69-4168-9e2e-2aaf1f476304 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.510744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9330831-ef69-4168-9e2e-2aaf1f476304 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.511188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9330831-ef69-4168-9e2e-2aaf1f476304 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.512152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9330831-ef69-4168-9e2e-2aaf1f476304 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.512883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9330831-ef69-4168-9e2e-2aaf1f476304 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.513346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9330831-ef69-4168-9e2e-2aaf1f476304 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.551388 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b9330831-ef69-4168-9e2e-2aaf1f476304 tempest-ServicesAdminTestJSON-717266096 tempest-ServicesAdminTestJSON-717266096-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.057921 Oct 18 13:31:22.552009 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1626/3446] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:31:22 2022] GET /compute/v2.1/os-services => generated 949 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:22.556827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8d446f5c-b368-437d-8056-d639e7e6325e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.557538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8d446f5c-b368-437d-8056-d639e7e6325e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:22.564289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d446f5c-b368-437d-8056-d639e7e6325e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.564782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d446f5c-b368-437d-8056-d639e7e6325e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.565255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d446f5c-b368-437d-8056-d639e7e6325e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.566790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d446f5c-b368-437d-8056-d639e7e6325e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.567248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d446f5c-b368-437d-8056-d639e7e6325e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.567848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d446f5c-b368-437d-8056-d639e7e6325e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.596994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8d446f5c-b368-437d-8056-d639e7e6325e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:22.617686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-639c938b-9bbc-4caa-a319-e7f7ae1da822 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:22.626382 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-639c938b-9bbc-4caa-a319-e7f7ae1da822 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1517 microversion: 2.1 time: 0.182366 Oct 18 13:31:22.627782 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1821/3447] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:22 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:22.634103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c4301a5b-1d00-4c01-8353-72a5d530dd65 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Action: 'create', calling method: .version_select at 0x7ff60ec103a0>, body: {"keypair": {"name": "tempest-keypair-915659522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKToAIqZ+XRlGOvpnSmpbbC85kUmUROMMkdJstx5XWR/SDNaLSnlWCpsBSaK465ptZZ47JshPMz7aEdl1x0j5iTzHfWa6oyib9sMFMWCap0ZtWdA6bLlmw7jMOZ8Iz9iw=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:22.656780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c4301a5b-1d00-4c01-8353-72a5d530dd65 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:22.665715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c4301a5b-1d00-4c01-8353-72a5d530dd65 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for user 1ec7bfa430504a89bc449fcfce46f9b3 and project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:22.706097 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c4301a5b-1d00-4c01-8353-72a5d530dd65 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.076459 Oct 18 13:31:22.707587 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1822/3448] 10.222.0.40 () {62 vars in 1199 bytes} [Tue Oct 18 13:31:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:31:22.720946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1c0dadc7-fa4e-438c-9312-3989483bffca tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff60ec7cb80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.731125 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8d446f5c-b368-437d-8056-d639e7e6325e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 204 len: 0 microversion: 2.1 time: 0.177771 Oct 18 13:31:22.732736 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1627/3449] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:22 2022] DELETE /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:22.743172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b71c6130-9bdc-4222-a1b6-ee839da3f646 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.743901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b71c6130-9bdc-4222-a1b6-ee839da3f646 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:22.744226 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1c0dadc7-fa4e-438c-9312-3989483bffca tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-915659522" status: 200 len: 512 microversion: 2.2 time: 0.029900 Oct 18 13:31:22.745370 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1823/3450] 10.222.0.40 () {60 vars in 1255 bytes} [Tue Oct 18 13:31:22 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-915659522 => generated 512 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:31:22.751852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b71c6130-9bdc-4222-a1b6-ee839da3f646 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.752369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b71c6130-9bdc-4222-a1b6-ee839da3f646 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.753871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b71c6130-9bdc-4222-a1b6-ee839da3f646 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.754947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b71c6130-9bdc-4222-a1b6-ee839da3f646 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:22.755433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b71c6130-9bdc-4222-a1b6-ee839da3f646 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:22.755890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b71c6130-9bdc-4222-a1b6-ee839da3f646 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:22.766420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2fa94d8d-5610-4a10-b352-41ea1fafbb27 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff60ec09b80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.773917 n-d-858384-13 devstack@n-api.service[120611]: WARNING oslo_db.sqlalchemy.utils [None req-2fa94d8d-5610-4a10-b352-41ea1fafbb27 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 13:31:22.782241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:22.799766 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2fa94d8d-5610-4a10-b352-41ea1fafbb27 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.043748 Oct 18 13:31:22.802786 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1824/3451] 10.222.0.40 () {60 vars in 1177 bytes} [Tue Oct 18 13:31:22 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:22.828258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68b5b763-cf9d-41bd-aede-213c6628508b tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff60ec09ca0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:22.857879 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68b5b763-cf9d-41bd-aede-213c6628508b tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-915659522" status: 204 len: 0 microversion: 2.2 time: 0.038405 Oct 18 13:31:22.858628 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1825/3452] 10.222.0.40 () {60 vars in 1258 bytes} [Tue Oct 18 13:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-915659522 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:22.869424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-939d9883-a88c-4b42-84a5-578f45be79f5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Action: 'create', calling method: .version_select at 0x7ff60ec7c1f0>, body: {"keypair": {"name": "tempest-keypair-2085862249", "type": "x509"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:22.879701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b71c6130-9bdc-4222-a1b6-ee839da3f646 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:22.890280 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b71c6130-9bdc-4222-a1b6-ee839da3f646 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1465 microversion: 2.1 time: 0.153593 Oct 18 13:31:22.891267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-939d9883-a88c-4b42-84a5-578f45be79f5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:22.891898 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1628/3453] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:22 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:22.898295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-939d9883-a88c-4b42-84a5-578f45be79f5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for user 1ec7bfa430504a89bc449fcfce46f9b3 and project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:22.918955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.processutils [None req-939d9883-a88c-4b42-84a5-578f45be79f5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpap3rwina/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpap3rwina/temp.key -subj /CN=1ec7bfa430504a89bc449fcfce46f9b3 -extensions v3_req_client {{(pid=120611) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 18 13:31:23.145350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.processutils [None req-939d9883-a88c-4b42-84a5-578f45be79f5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpap3rwina/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpap3rwina/temp.key -subj /CN=1ec7bfa430504a89bc449fcfce46f9b3 -extensions v3_req_client" returned: 0 in 0.226s {{(pid=120611) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 18 13:31:23.146997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.processutils [None req-939d9883-a88c-4b42-84a5-578f45be79f5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpap3rwina/temp.key -password pass: {{(pid=120611) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 18 13:31:23.185543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.processutils [None req-939d9883-a88c-4b42-84a5-578f45be79f5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpap3rwina/temp.key -password pass:" returned: 0 in 0.038s {{(pid=120611) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 18 13:31:23.206555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dfa3dc69-fadb-454d-8976-d3153fc3f07b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:23.207187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dfa3dc69-fadb-454d-8976-d3153fc3f07b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:23.214036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfa3dc69-fadb-454d-8976-d3153fc3f07b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.214568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfa3dc69-fadb-454d-8976-d3153fc3f07b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.215205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfa3dc69-fadb-454d-8976-d3153fc3f07b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:23.216231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfa3dc69-fadb-454d-8976-d3153fc3f07b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.216923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfa3dc69-fadb-454d-8976-d3153fc3f07b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.217406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfa3dc69-fadb-454d-8976-d3153fc3f07b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:23.242055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-939d9883-a88c-4b42-84a5-578f45be79f5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:23.249064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-939d9883-a88c-4b42-84a5-578f45be79f5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Getting quotas for user 1ec7bfa430504a89bc449fcfce46f9b3 and project 97f7e32f9b86432d99169d2485896a33. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:23.270611 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-939d9883-a88c-4b42-84a5-578f45be79f5 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.405544 Oct 18 13:31:23.277692 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1826/3454] 10.222.0.40 () {62 vars in 1198 bytes} [Tue Oct 18 13:31:22 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 408 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:31:23.286475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5b8283b7-fdd8-4a68-a96a-bdb3d69908d1 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff60ec10b80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:23.298920 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5b8283b7-fdd8-4a68-a96a-bdb3d69908d1 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-2085862249" status: 200 len: 1534 microversion: 2.2 time: 0.019434 Oct 18 13:31:23.307788 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1827/3455] 10.222.0.40 () {60 vars in 1258 bytes} [Tue Oct 18 13:31:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2085862249 => generated 1534 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:23.313676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-de85c737-403a-49e2-99bf-0a55fec03004 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff60ef3a430>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:23.319331 n-d-858384-13 devstack@n-api.service[120611]: WARNING oslo_db.sqlalchemy.utils [None req-de85c737-403a-49e2-99bf-0a55fec03004 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 13:31:23.326642 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-de85c737-403a-49e2-99bf-0a55fec03004 tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.017172 Oct 18 13:31:23.335046 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1828/3456] 10.222.0.40 () {60 vars in 1177 bytes} [Tue Oct 18 13:31:23 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:23.340856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f765967-c50f-48bb-bdf9-50a050822f5d tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] Calling method '.version_select at 0x7ff60eca5820>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:23.367142 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9f765967-c50f-48bb-bdf9-50a050822f5d tempest-KeyPairsV22TestJSON-772895364 tempest-KeyPairsV22TestJSON-772895364-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085862249" status: 204 len: 0 microversion: 2.2 time: 0.030399 Oct 18 13:31:23.368088 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1829/3457] 10.222.0.40 () {60 vars in 1261 bytes} [Tue Oct 18 13:31:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085862249 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:23.474760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-907b0f92-411c-497f-aa5a-4a75ce75354e tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:23.475643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-907b0f92-411c-497f-aa5a-4a75ce75354e tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:23.485504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-907b0f92-411c-497f-aa5a-4a75ce75354e tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.489996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-907b0f92-411c-497f-aa5a-4a75ce75354e tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.497392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-907b0f92-411c-497f-aa5a-4a75ce75354e tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:23.498438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-907b0f92-411c-497f-aa5a-4a75ce75354e tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.499002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-907b0f92-411c-497f-aa5a-4a75ce75354e tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.499851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-907b0f92-411c-497f-aa5a-4a75ce75354e tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:23.535499 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-907b0f92-411c-497f-aa5a-4a75ce75354e tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] HTTP exception thrown: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-907b0f92-411c-497f-aa5a-4a75ce75354e tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Request method failure captured: Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 HTTP/1.1 Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqkACTXpZbelTc_C7QsACdkT4dSwkASWdvJl0a4TPblMirmpJ0mwQz-KpfhXSHl27RDX6DavQ1vMsDyZaJW22Hj2jouOzDQPqnoEvbvJDWzyrCtlnxukkQdPbwnEldMx2i2MBaOQRKkBKQHVr4jBeQ8zb2-qElZ6fwYTHz1C8Md31Bo Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.42 Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 19e1c317d0a34148949ddddadffb4415 Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-137896444 Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19e1c317d0a34148949ddddadffb4415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19e1c317d0a34148949ddddadffb4415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19e1c317d0a34148949ddddadffb4415"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19e1c317d0a34148949ddddadffb4415"}]}] Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TaggedBootDevicesTest_v242-137896444 Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 19e1c317d0a34148949ddddadffb4415 Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-137896444 Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TaggedBootDevicesTest_v242-137896444-project Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f3922bd65ede4e2586d23741b8ac19a1 Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TaggedBootDevicesTest_v242-137896444-project Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567'} Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:23.537366 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:23.546240 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:23.546240 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:23.546240 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:23.546240 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:23.546240 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:23.546240 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:23.546240 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:23.546240 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:23.562101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-907b0f92-411c-497f-aa5a-4a75ce75354e tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Returning 404 to user: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:23.563457 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-907b0f92-411c-497f-aa5a-4a75ce75354e tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 404 len: 111 microversion: 2.42 time: 0.095039 Oct 18 13:31:23.569532 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1830/3458] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:23 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:31:23.574679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-29eac5ec-d057-439f-9f85-a5c0af9775d1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '.version_select at 0x7ff60ef3adc0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:23.600319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dfa3dc69-fadb-454d-8976-d3153fc3f07b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:23.621342 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-29eac5ec-d057-439f-9f85-a5c0af9775d1 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467706171" status: 204 len: 0 microversion: 2.42 time: 0.050366 Oct 18 13:31:23.622421 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1831/3459] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:31:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467706171 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:31:23.629875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dfa3dc69-fadb-454d-8976-d3153fc3f07b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:23.633284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dfa3dc69-fadb-454d-8976-d3153fc3f07b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:23.635023 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dfa3dc69-fadb-454d-8976-d3153fc3f07b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.433229 Oct 18 13:31:23.635757 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1629/3460] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:23 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:31:23.654514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f6fade58-03a5-43e7-901a-82e4ba9952df tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:23.655156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f6fade58-03a5-43e7-901a-82e4ba9952df tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:23.673939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6fade58-03a5-43e7-901a-82e4ba9952df tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.676364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6fade58-03a5-43e7-901a-82e4ba9952df tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.676824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6fade58-03a5-43e7-901a-82e4ba9952df tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:23.677580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6fade58-03a5-43e7-901a-82e4ba9952df tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.678042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6fade58-03a5-43e7-901a-82e4ba9952df tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.678470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6fade58-03a5-43e7-901a-82e4ba9952df tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:23.915418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5b36f9ec-79ce-45bf-912c-96573bf336ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:23.916196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5b36f9ec-79ce-45bf-912c-96573bf336ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:23.924347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b36f9ec-79ce-45bf-912c-96573bf336ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.925140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b36f9ec-79ce-45bf-912c-96573bf336ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.926021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b36f9ec-79ce-45bf-912c-96573bf336ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:23.926731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b36f9ec-79ce-45bf-912c-96573bf336ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:23.927846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b36f9ec-79ce-45bf-912c-96573bf336ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:23.928577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b36f9ec-79ce-45bf-912c-96573bf336ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:24.052941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f6fade58-03a5-43e7-901a-82e4ba9952df tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:24.068538 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f6fade58-03a5-43e7-901a-82e4ba9952df tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1517 microversion: 2.1 time: 0.417723 Oct 18 13:31:24.071309 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1832/3461] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:23 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1517 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:24.123724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5b36f9ec-79ce-45bf-912c-96573bf336ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:24.132942 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5b36f9ec-79ce-45bf-912c-96573bf336ae tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1465 microversion: 2.1 time: 0.221786 Oct 18 13:31:24.148390 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1630/3462] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:23 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1465 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:24.664142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d4c9fdab-a513-435c-be75-ffe06e6d92be tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:24.664762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d4c9fdab-a513-435c-be75-ffe06e6d92be tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:24.681111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4c9fdab-a513-435c-be75-ffe06e6d92be tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:24.681705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4c9fdab-a513-435c-be75-ffe06e6d92be tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:24.682230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4c9fdab-a513-435c-be75-ffe06e6d92be tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:24.683260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4c9fdab-a513-435c-be75-ffe06e6d92be tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:24.684028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4c9fdab-a513-435c-be75-ffe06e6d92be tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:24.684499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4c9fdab-a513-435c-be75-ffe06e6d92be tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.047261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d4c9fdab-a513-435c-be75-ffe06e6d92be tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:25.096200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8fb67a43-9176-4c9d-a8a3-0b0acbf2566f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:25.098027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8fb67a43-9176-4c9d-a8a3-0b0acbf2566f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:25.136429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8fb67a43-9176-4c9d-a8a3-0b0acbf2566f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.142281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8fb67a43-9176-4c9d-a8a3-0b0acbf2566f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.145318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8fb67a43-9176-4c9d-a8a3-0b0acbf2566f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.146339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8fb67a43-9176-4c9d-a8a3-0b0acbf2566f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.148051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d4c9fdab-a513-435c-be75-ffe06e6d92be tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:25.150761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8fb67a43-9176-4c9d-a8a3-0b0acbf2566f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.154563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d4c9fdab-a513-435c-be75-ffe06e6d92be tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:25.156850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8fb67a43-9176-4c9d-a8a3-0b0acbf2566f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.168433 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d4c9fdab-a513-435c-be75-ffe06e6d92be tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.505561 Oct 18 13:31:25.173266 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1833/3463] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:24 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:25.222182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-67daed01-db72-4e0c-a11b-46a18c411ee6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:25.228758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-67daed01-db72-4e0c-a11b-46a18c411ee6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:25.273713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67daed01-db72-4e0c-a11b-46a18c411ee6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.277646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67daed01-db72-4e0c-a11b-46a18c411ee6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.279690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67daed01-db72-4e0c-a11b-46a18c411ee6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.282718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67daed01-db72-4e0c-a11b-46a18c411ee6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.288585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67daed01-db72-4e0c-a11b-46a18c411ee6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.291300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67daed01-db72-4e0c-a11b-46a18c411ee6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.471661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-67daed01-db72-4e0c-a11b-46a18c411ee6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:25.496316 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-67daed01-db72-4e0c-a11b-46a18c411ee6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 200 len: 1465 microversion: 2.1 time: 0.319013 Oct 18 13:31:25.497429 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1834/3464] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:25 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 1465 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:25.633136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-aebc98c3-d1de-4c86-8cfb-ac68f470c85b req-f99967fe-71a4-453a-9e84-cece5345dd14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a", "name": "network-vif-deleted", "tag": "b7079b74-4b6a-4fa3-a3ae-3342a2ace45a"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:25.680256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-aebc98c3-d1de-4c86-8cfb-ac68f470c85b req-f99967fe-71a4-453a-9e84-cece5345dd14 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:25.680879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-aebc98c3-d1de-4c86-8cfb-ac68f470c85b req-f99967fe-71a4-453a-9e84-cece5345dd14 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:25.681172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-aebc98c3-d1de-4c86-8cfb-ac68f470c85b req-f99967fe-71a4-453a-9e84-cece5345dd14 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:25.699340 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-aebc98c3-d1de-4c86-8cfb-ac68f470c85b req-f99967fe-71a4-453a-9e84-cece5345dd14 service nova] Creating event network-vif-deleted:b7079b74-4b6a-4fa3-a3ae-3342a2ace45a for instance 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a on n-h2-858384-13 Oct 18 13:31:25.706660 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-aebc98c3-d1de-4c86-8cfb-ac68f470c85b req-f99967fe-71a4-453a-9e84-cece5345dd14 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088279 Oct 18 13:31:25.708184 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1835/3465] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:25.743595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8fb67a43-9176-4c9d-a8a3-0b0acbf2566f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:25.759107 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8fb67a43-9176-4c9d-a8a3-0b0acbf2566f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1517 microversion: 2.1 time: 0.668649 Oct 18 13:31:25.773279 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1631/3466] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:25 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1517 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:26.203563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dfbf0ba1-eae5-402c-81e2-0712336e9cbf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:26.204828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dfbf0ba1-eae5-402c-81e2-0712336e9cbf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:26.216803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfbf0ba1-eae5-402c-81e2-0712336e9cbf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:26.219279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfbf0ba1-eae5-402c-81e2-0712336e9cbf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:26.219729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfbf0ba1-eae5-402c-81e2-0712336e9cbf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:26.224369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfbf0ba1-eae5-402c-81e2-0712336e9cbf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:26.224854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfbf0ba1-eae5-402c-81e2-0712336e9cbf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:26.225311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfbf0ba1-eae5-402c-81e2-0712336e9cbf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:26.623308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dfbf0ba1-eae5-402c-81e2-0712336e9cbf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:26.633744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:26.650905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dfbf0ba1-eae5-402c-81e2-0712336e9cbf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:26.652807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dfbf0ba1-eae5-402c-81e2-0712336e9cbf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:26.654217 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dfbf0ba1-eae5-402c-81e2-0712336e9cbf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.456014 Oct 18 13:31:26.657976 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1632/3467] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:26 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:31:26.670865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e2577d8-d57d-4ef8-8905-fc550c5208cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:26.674540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1e2577d8-d57d-4ef8-8905-fc550c5208cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:26.699353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e2577d8-d57d-4ef8-8905-fc550c5208cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:26.700133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e2577d8-d57d-4ef8-8905-fc550c5208cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:26.702323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e2577d8-d57d-4ef8-8905-fc550c5208cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:26.703228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e2577d8-d57d-4ef8-8905-fc550c5208cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:26.703695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e2577d8-d57d-4ef8-8905-fc550c5208cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:26.706923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e2577d8-d57d-4ef8-8905-fc550c5208cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:26.751339 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-1e2577d8-d57d-4ef8-8905-fc550c5208cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] HTTP exception thrown: Instance 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a could not be found. Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e2577d8-d57d-4ef8-8905-fc550c5208cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Request method failure captured: Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a HTTP/1.1 Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqgSyOovjkBwC2zDG9FKchsa-85pvviPiRczs79e9ogA2WOflaKqo4WjkGNjiwWrTbKQeMF0qFdRR97LgwpYjvL7_VWxucAaxUZM-ArWvxecTGdyg6CEOtjVVE0a_ifjjfGSQqXSLBM0YxminaTsZoLWFl2mIOYtfxpGTzdnzLBn-rI Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 452e5b77db474cf9a2b7f6b2abcb6115 Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_452e5b77db474cf9a2b7f6b2abcb6115"}]}] Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 452e5b77db474cf9a2b7f6b2abcb6115 Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerActionsTestJSON-330379010-project Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 2878f8de95694fe1a9a17ed27b6ba40b Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerActionsTestJSON-330379010-project Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a could not be found. Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a'} Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a could not be found. Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a could not be found. Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:26.774072 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:26.778938 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:26.778938 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:26.778938 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:26.778938 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:26.778938 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:26.778938 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a could not be found. Oct 18 13:31:26.778938 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:26.778938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e2577d8-d57d-4ef8-8905-fc550c5208cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Returning 404 to user: Instance 7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:26.778938 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1e2577d8-d57d-4ef8-8905-fc550c5208cf tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a" status: 404 len: 111 microversion: 2.1 time: 0.116306 Oct 18 13:31:26.788807 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1633/3468] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:26 2022] GET /compute/v2.1/servers/7c9121b2-75fe-4c9e-a9c8-d6d29cd01a6a => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:26.810878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2064527317", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "05635c8d-9e2d-42ba-97da-22257a0022a5"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:26.822253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9be33eba-ad01-4117-961c-efaf6cb2efe8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:26.825669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9be33eba-ad01-4117-961c-efaf6cb2efe8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:26.868102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9be33eba-ad01-4117-961c-efaf6cb2efe8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:26.870334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9be33eba-ad01-4117-961c-efaf6cb2efe8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:26.870992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9be33eba-ad01-4117-961c-efaf6cb2efe8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:26.871931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9be33eba-ad01-4117-961c-efaf6cb2efe8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:26.874287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9be33eba-ad01-4117-961c-efaf6cb2efe8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:26.875054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9be33eba-ad01-4117-961c-efaf6cb2efe8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:26.995959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] validate_networks() for [('05635c8d-9e2d-42ba-97da-22257a0022a5', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:31:27.386345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9be33eba-ad01-4117-961c-efaf6cb2efe8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:27.399646 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9be33eba-ad01-4117-961c-efaf6cb2efe8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1517 microversion: 2.1 time: 0.609222 Oct 18 13:31:27.403776 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1634/3469] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:26 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1517 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:27.419166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-20b7fac7-ccb3-4131-b944-4d0eaac4e2ad tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:27.420423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-20b7fac7-ccb3-4131-b944-4d0eaac4e2ad tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:27.455361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20b7fac7-ccb3-4131-b944-4d0eaac4e2ad tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:27.461913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20b7fac7-ccb3-4131-b944-4d0eaac4e2ad tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:27.465308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20b7fac7-ccb3-4131-b944-4d0eaac4e2ad tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:27.467754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20b7fac7-ccb3-4131-b944-4d0eaac4e2ad tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:27.469482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20b7fac7-ccb3-4131-b944-4d0eaac4e2ad tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:27.470194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20b7fac7-ccb3-4131-b944-4d0eaac4e2ad tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:27.535785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-20b7fac7-ccb3-4131-b944-4d0eaac4e2ad tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:27.758452 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-20b7fac7-ccb3-4131-b944-4d0eaac4e2ad tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 204 len: 0 microversion: 2.1 time: 0.351659 Oct 18 13:31:27.759728 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1635/3470] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:27 2022] DELETE /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:27.776107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-12f24b84-b38d-4723-8c27-44eeccc69223 req-90b2e013-f962-4929-ac18-c86ba304b146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-plugged", "status": "completed", "tag": "8f544790-5930-4353-bbad-e9bb309d7d6c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:27.814612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-12f24b84-b38d-4723-8c27-44eeccc69223 req-90b2e013-f962-4929-ac18-c86ba304b146 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:27.816114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-12f24b84-b38d-4723-8c27-44eeccc69223 req-90b2e013-f962-4929-ac18-c86ba304b146 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:27.819921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-12f24b84-b38d-4723-8c27-44eeccc69223 req-90b2e013-f962-4929-ac18-c86ba304b146 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:27.846083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=44 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:27.853785 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-12f24b84-b38d-4723-8c27-44eeccc69223 req-90b2e013-f962-4929-ac18-c86ba304b146 service nova] Creating event network-vif-plugged:8f544790-5930-4353-bbad-e9bb309d7d6c for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:31:27.870256 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-12f24b84-b38d-4723-8c27-44eeccc69223 req-90b2e013-f962-4929-ac18-c86ba304b146 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106337 Oct 18 13:31:27.873094 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1636/3471] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:27.886721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7055cce6-c1bb-48ef-9cbf-33b3aa5c5c46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:27.890779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7055cce6-c1bb-48ef-9cbf-33b3aa5c5c46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:27.911857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7055cce6-c1bb-48ef-9cbf-33b3aa5c5c46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:27.913599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7055cce6-c1bb-48ef-9cbf-33b3aa5c5c46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:27.915324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7055cce6-c1bb-48ef-9cbf-33b3aa5c5c46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:27.918137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7055cce6-c1bb-48ef-9cbf-33b3aa5c5c46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:27.919965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7055cce6-c1bb-48ef-9cbf-33b3aa5c5c46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:27.921591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7055cce6-c1bb-48ef-9cbf-33b3aa5c5c46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.281525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:31:28.281991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:31:28.282429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:31:28.282844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:31:28.283285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:31:28.295395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.296320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.296940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.297896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.303525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.304381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.349207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Getting quotas for project 61eb84fa8e2342b8bae22eeae31bcf8d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:28.358569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Getting quotas for user 35276a270e8f46a28215737c2dbea762 and project 61eb84fa8e2342b8bae22eeae31bcf8d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:28.407668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:31:28.418715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:31:28.427813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7055cce6-c1bb-48ef-9cbf-33b3aa5c5c46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:28.447298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7055cce6-c1bb-48ef-9cbf-33b3aa5c5c46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:28.450865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7055cce6-c1bb-48ef-9cbf-33b3aa5c5c46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:28.454064 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7055cce6-c1bb-48ef-9cbf-33b3aa5c5c46 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.576651 Oct 18 13:31:28.454666 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1637/3472] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:27 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:28.480596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e7438e64-999e-4771-a22c-8f3fe5094ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:28.483584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e7438e64-999e-4771-a22c-8f3fe5094ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:28.506175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7438e64-999e-4771-a22c-8f3fe5094ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.508184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7438e64-999e-4771-a22c-8f3fe5094ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.513589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7438e64-999e-4771-a22c-8f3fe5094ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.516717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7438e64-999e-4771-a22c-8f3fe5094ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.517919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7438e64-999e-4771-a22c-8f3fe5094ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.520438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7438e64-999e-4771-a22c-8f3fe5094ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.598918 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d304b675-7551-4ff6-b1b2-591c79b3444a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.431537 Oct 18 13:31:28.605486 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1836/3473] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:31:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:31:28.623979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0c453a5c-65eb-4177-a1a1-57c5ec80eb0c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:28.643102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0c453a5c-65eb-4177-a1a1-57c5ec80eb0c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:28.663034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c453a5c-65eb-4177-a1a1-57c5ec80eb0c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.674048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c453a5c-65eb-4177-a1a1-57c5ec80eb0c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.675460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c453a5c-65eb-4177-a1a1-57c5ec80eb0c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.677735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c453a5c-65eb-4177-a1a1-57c5ec80eb0c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:28.679537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c453a5c-65eb-4177-a1a1-57c5ec80eb0c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:28.680196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c453a5c-65eb-4177-a1a1-57c5ec80eb0c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:28.948701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0c453a5c-65eb-4177-a1a1-57c5ec80eb0c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:28.966794 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0c453a5c-65eb-4177-a1a1-57c5ec80eb0c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1523 microversion: 2.1 time: 0.359643 Oct 18 13:31:28.968337 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1837/3474] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:28 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:28.984080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2099460906", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "05635c8d-9e2d-42ba-97da-22257a0022a5"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:29.138130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] validate_networks() for [('05635c8d-9e2d-42ba-97da-22257a0022a5', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:31:29.285234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e7438e64-999e-4771-a22c-8f3fe5094ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:29.296860 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e7438e64-999e-4771-a22c-8f3fe5094ca6 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 200 len: 1507 microversion: 2.1 time: 0.841126 Oct 18 13:31:29.309195 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1638/3475] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:28 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 1507 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:29.480667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9a14ccd2-6cd9-4510-834b-1b65844c30f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:29.482175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9a14ccd2-6cd9-4510-834b-1b65844c30f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:29.503629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a14ccd2-6cd9-4510-834b-1b65844c30f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:29.504194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a14ccd2-6cd9-4510-834b-1b65844c30f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:29.504629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a14ccd2-6cd9-4510-834b-1b65844c30f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:29.505375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a14ccd2-6cd9-4510-834b-1b65844c30f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:29.505819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a14ccd2-6cd9-4510-834b-1b65844c30f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:29.521074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a14ccd2-6cd9-4510-834b-1b65844c30f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:30.172254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:31:30.172786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:31:30.173385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:31:30.173895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:31:30.174912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:31:30.193918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=71 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:30.195579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:30.196220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:30.199625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:30.207408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:30.207985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:30.211674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:30.244722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9a14ccd2-6cd9-4510-834b-1b65844c30f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:30.261656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9a14ccd2-6cd9-4510-834b-1b65844c30f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:30.263487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9a14ccd2-6cd9-4510-834b-1b65844c30f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:30.264900 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9a14ccd2-6cd9-4510-834b-1b65844c30f8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.788987 Oct 18 13:31:30.269328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Getting quotas for project 61eb84fa8e2342b8bae22eeae31bcf8d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:30.270522 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1639/3476] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:29 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:31:30.294918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Getting quotas for user 35276a270e8f46a28215737c2dbea762 and project 61eb84fa8e2342b8bae22eeae31bcf8d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:30.318927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:31:30.322980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: b3b7058d-7bdc-4d34-b3e3-fa5be5730997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:31:30.405055 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-97d5e74b-bb96-4694-9a25-1c733ed73d30 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.424487 Oct 18 13:31:30.408345 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1838/3477] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:31:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:31:30.429227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5728b500-4951-4713-924f-9a5fe1ea59d6 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:30.430002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5728b500-4951-4713-924f-9a5fe1ea59d6 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:30.456255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5728b500-4951-4713-924f-9a5fe1ea59d6 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:30.457508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5728b500-4951-4713-924f-9a5fe1ea59d6 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:30.458252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5728b500-4951-4713-924f-9a5fe1ea59d6 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:30.460791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5728b500-4951-4713-924f-9a5fe1ea59d6 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:30.461564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5728b500-4951-4713-924f-9a5fe1ea59d6 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:30.465359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5728b500-4951-4713-924f-9a5fe1ea59d6 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:30.564773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1864211471", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:30.664083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:31:30.883761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5728b500-4951-4713-924f-9a5fe1ea59d6 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:30.897754 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5728b500-4951-4713-924f-9a5fe1ea59d6 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1523 microversion: 2.1 time: 0.480634 Oct 18 13:31:30.898892 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1839/3478] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:30 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1523 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:30.929276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-22f9318a-ddd5-4b15-8f05-e3b69a80f844 req-3665ff00-111b-4a32-8eb1-5d45361adbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-plugged", "status": "completed", "tag": "1e430439-0ec3-424e-b978-369a2167d04b"}, {"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-plugged", "status": "completed", "tag": "ff507a08-6d1d-489d-9972-88fe76f7ecb0"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:30.943858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-22f9318a-ddd5-4b15-8f05-e3b69a80f844 req-3665ff00-111b-4a32-8eb1-5d45361adbf4 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:30.946272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-22f9318a-ddd5-4b15-8f05-e3b69a80f844 req-3665ff00-111b-4a32-8eb1-5d45361adbf4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:30.947154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-22f9318a-ddd5-4b15-8f05-e3b69a80f844 req-3665ff00-111b-4a32-8eb1-5d45361adbf4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:30.969527 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-22f9318a-ddd5-4b15-8f05-e3b69a80f844 req-3665ff00-111b-4a32-8eb1-5d45361adbf4 service nova] Creating event network-vif-plugged:1e430439-0ec3-424e-b978-369a2167d04b for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:31:30.970672 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-22f9318a-ddd5-4b15-8f05-e3b69a80f844 req-3665ff00-111b-4a32-8eb1-5d45361adbf4 service nova] Creating event network-vif-plugged:ff507a08-6d1d-489d-9972-88fe76f7ecb0 for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:31:30.986034 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-22f9318a-ddd5-4b15-8f05-e3b69a80f844 req-3665ff00-111b-4a32-8eb1-5d45361adbf4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059634 Oct 18 13:31:30.987674 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1840/3479] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:30.994896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-97111a0e-42fc-48dd-8272-00f5cac5b44b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:30.996201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-97111a0e-42fc-48dd-8272-00f5cac5b44b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:31.004707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97111a0e-42fc-48dd-8272-00f5cac5b44b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.010692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97111a0e-42fc-48dd-8272-00f5cac5b44b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.011351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97111a0e-42fc-48dd-8272-00f5cac5b44b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.012403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97111a0e-42fc-48dd-8272-00f5cac5b44b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:31.012880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97111a0e-42fc-48dd-8272-00f5cac5b44b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:31.016011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97111a0e-42fc-48dd-8272-00f5cac5b44b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:31.978496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-97111a0e-42fc-48dd-8272-00f5cac5b44b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:31.994228 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-97111a0e-42fc-48dd-8272-00f5cac5b44b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 200 len: 1507 microversion: 2.1 time: 1.004886 Oct 18 13:31:31.998229 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1841/3480] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:30 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 1507 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:32.031045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-309103288", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "451", "networks": [{"uuid": "05635c8d-9e2d-42ba-97da-22257a0022a5"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:32.173981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] validate_networks() for [('05635c8d-9e2d-42ba-97da-22257a0022a5', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:31:32.331689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:31:32.332442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:31:32.333299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:31:32.333901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:31:32.334368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:31:32.360228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:32.367426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:32.381226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:32.385132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:32.391307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:32.392944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:32.434288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Getting quotas for project 459877b552184a8eb2674bb504eb7aae. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:32.443505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Getting quotas for user 67aa27c9e39a422985e3d32520aea9f1 and project 459877b552184a8eb2674bb504eb7aae. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:32.463840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:31:32.466526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:31:32.558316 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0390418e-6a98-45b4-8336-722846cf75fe tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.286180 Oct 18 13:31:32.568726 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1640/3481] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:31:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:31:32.575731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-03d13e40-8317-4b53-ac31-081665900c12 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:32.588654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-03d13e40-8317-4b53-ac31-081665900c12 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:32.608396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03d13e40-8317-4b53-ac31-081665900c12 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:32.609002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03d13e40-8317-4b53-ac31-081665900c12 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:32.609477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03d13e40-8317-4b53-ac31-081665900c12 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:32.617345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03d13e40-8317-4b53-ac31-081665900c12 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:32.620436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03d13e40-8317-4b53-ac31-081665900c12 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:32.621235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03d13e40-8317-4b53-ac31-081665900c12 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:33.438045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-03d13e40-8317-4b53-ac31-081665900c12 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:33.458188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-03d13e40-8317-4b53-ac31-081665900c12 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:33.469380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-03d13e40-8317-4b53-ac31-081665900c12 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:33.474158 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-03d13e40-8317-4b53-ac31-081665900c12 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.910062 Oct 18 13:31:33.489981 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1641/3482] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:32 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:33.532827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c28969c9-e7f9-47a0-ae1f-b958b2c11f76 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:33.533553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c28969c9-e7f9-47a0-ae1f-b958b2c11f76 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:33.536762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:33.562144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c28969c9-e7f9-47a0-ae1f-b958b2c11f76 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:33.562879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c28969c9-e7f9-47a0-ae1f-b958b2c11f76 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:33.563792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c28969c9-e7f9-47a0-ae1f-b958b2c11f76 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:33.567221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c28969c9-e7f9-47a0-ae1f-b958b2c11f76 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:33.568162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c28969c9-e7f9-47a0-ae1f-b958b2c11f76 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:33.570235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c28969c9-e7f9-47a0-ae1f-b958b2c11f76 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.152200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:31:34.153645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:31:34.154957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:31:34.155989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:31:34.156633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:31:34.168192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c28969c9-e7f9-47a0-ae1f-b958b2c11f76 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:34.187981 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c28969c9-e7f9-47a0-ae1f-b958b2c11f76 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1523 microversion: 2.1 time: 0.695742 Oct 18 13:31:34.201732 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1642/3483] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:33 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1523 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:34.203316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.203915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.204363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.205167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.205649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.206831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.217055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-17e52c60-9d46-497b-9507-53003480a116 req-416ef2a9-422c-47c0-8df8-5ed8e9cf1016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51afbc1-604c-4e86-b301-1716cfeb7671", "name": "network-vif-deleted", "tag": "6f25acf6-2339-400d-bece-c17a12a478b2"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:34.230072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-17e52c60-9d46-497b-9507-53003480a116 req-416ef2a9-422c-47c0-8df8-5ed8e9cf1016 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.231187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-17e52c60-9d46-497b-9507-53003480a116 req-416ef2a9-422c-47c0-8df8-5ed8e9cf1016 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.231979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-17e52c60-9d46-497b-9507-53003480a116 req-416ef2a9-422c-47c0-8df8-5ed8e9cf1016 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.249308 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-17e52c60-9d46-497b-9507-53003480a116 req-416ef2a9-422c-47c0-8df8-5ed8e9cf1016 service nova] Creating event network-vif-deleted:6f25acf6-2339-400d-bece-c17a12a478b2 for instance f51afbc1-604c-4e86-b301-1716cfeb7671 on n-h2-858384-13 Oct 18 13:31:34.257568 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-17e52c60-9d46-497b-9507-53003480a116 req-416ef2a9-422c-47c0-8df8-5ed8e9cf1016 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054464 Oct 18 13:31:34.258789 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1643/3484] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:34.267776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b61b3a4c-70ea-435d-9e52-4bed5b9f6b57 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:34.270130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b61b3a4c-70ea-435d-9e52-4bed5b9f6b57 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:34.271911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Getting quotas for project 61eb84fa8e2342b8bae22eeae31bcf8d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:34.279255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b61b3a4c-70ea-435d-9e52-4bed5b9f6b57 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.279959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b61b3a4c-70ea-435d-9e52-4bed5b9f6b57 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.280929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b61b3a4c-70ea-435d-9e52-4bed5b9f6b57 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.281861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b61b3a4c-70ea-435d-9e52-4bed5b9f6b57 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.282524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b61b3a4c-70ea-435d-9e52-4bed5b9f6b57 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.283283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b61b3a4c-70ea-435d-9e52-4bed5b9f6b57 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.284115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Getting quotas for user 35276a270e8f46a28215737c2dbea762 and project 61eb84fa8e2342b8bae22eeae31bcf8d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:34.316747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:INSERT=7 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:34.320662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:31:34.323465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:31:34.428191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b61b3a4c-70ea-435d-9e52-4bed5b9f6b57 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:34.449787 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b61b3a4c-70ea-435d-9e52-4bed5b9f6b57 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1266 microversion: 2.1 time: 0.188600 Oct 18 13:31:34.451228 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1644/3485] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:34 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:34.466401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8466460c-bde2-41a8-91a1-0a97750f5dc8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:34.468192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8466460c-bde2-41a8-91a1-0a97750f5dc8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: f51afbc1-604c-4e86-b301-1716cfeb7671] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:34.484004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8466460c-bde2-41a8-91a1-0a97750f5dc8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.484507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8466460c-bde2-41a8-91a1-0a97750f5dc8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.484942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8466460c-bde2-41a8-91a1-0a97750f5dc8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.485674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8466460c-bde2-41a8-91a1-0a97750f5dc8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.486123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8466460c-bde2-41a8-91a1-0a97750f5dc8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.490760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8466460c-bde2-41a8-91a1-0a97750f5dc8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.491819 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c4f73971-a791-40a8-89a9-b43d59f6aaf3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.492155 Oct 18 13:31:34.493019 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1842/3486] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:31:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:31:34.511483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-719fe312-afa9-488a-a0b0-94312b6af040 req-4df7b6f7-18a9-456c-9402-da071ea143d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-plugged", "status": "completed", "tag": "49c418e1-353c-497f-923e-d6752ffbf9f7"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:34.538600 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-8466460c-bde2-41a8-91a1-0a97750f5dc8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] HTTP exception thrown: Instance f51afbc1-604c-4e86-b301-1716cfeb7671 could not be found. Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8466460c-bde2-41a8-91a1-0a97750f5dc8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Request method failure captured: Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 HTTP/1.1 Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqgSyOovjkBwC2zDG9FKchsa-85pvviPiRczs79e9ogA2WOflaKqo4WjkGNjiwWrTbKQeMF0qFdRR97LgwpYjvL7_VWxucAaxUZM-ArWvxecTGdyg6CEOtjVVE0a_ifjjfGSQqXSLBM0YxminaTsZoLWFl2mIOYtfxpGTzdnzLBn-rI Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 452e5b77db474cf9a2b7f6b2abcb6115 Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_452e5b77db474cf9a2b7f6b2abcb6115"}]}] Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 452e5b77db474cf9a2b7f6b2abcb6115 Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerActionsTestJSON-330379010-project Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 2878f8de95694fe1a9a17ed27b6ba40b Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerActionsTestJSON-330379010-project Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance f51afbc1-604c-4e86-b301-1716cfeb7671 could not be found. Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'f51afbc1-604c-4e86-b301-1716cfeb7671'} Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f51afbc1-604c-4e86-b301-1716cfeb7671 could not be found. Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f51afbc1-604c-4e86-b301-1716cfeb7671 could not be found. Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:34.541232 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:34.546338 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:34.546338 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:34.546338 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:34.546338 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:34.546338 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:34.546338 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f51afbc1-604c-4e86-b301-1716cfeb7671 could not be found. Oct 18 13:31:34.546338 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:34.546338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8466460c-bde2-41a8-91a1-0a97750f5dc8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Returning 404 to user: Instance f51afbc1-604c-4e86-b301-1716cfeb7671 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:34.546338 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8466460c-bde2-41a8-91a1-0a97750f5dc8 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671" status: 404 len: 111 microversion: 2.1 time: 0.088220 Oct 18 13:31:34.546338 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1645/3487] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:34 2022] GET /compute/v2.1/servers/f51afbc1-604c-4e86-b301-1716cfeb7671 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:34.547791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-719fe312-afa9-488a-a0b0-94312b6af040 req-4df7b6f7-18a9-456c-9402-da071ea143d1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.548463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-719fe312-afa9-488a-a0b0-94312b6af040 req-4df7b6f7-18a9-456c-9402-da071ea143d1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.551854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-719fe312-afa9-488a-a0b0-94312b6af040 req-4df7b6f7-18a9-456c-9402-da071ea143d1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.572296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f4485a00-1a7e-411a-84cc-7d5754603cef tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:34.573038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f4485a00-1a7e-411a-84cc-7d5754603cef tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:34.582881 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-719fe312-afa9-488a-a0b0-94312b6af040 req-4df7b6f7-18a9-456c-9402-da071ea143d1 service nova] Creating event network-vif-plugged:49c418e1-353c-497f-923e-d6752ffbf9f7 for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:31:34.594524 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-719fe312-afa9-488a-a0b0-94312b6af040 req-4df7b6f7-18a9-456c-9402-da071ea143d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091849 Oct 18 13:31:34.596389 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1843/3488] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:34.607972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ae32e8cc-9678-414e-96dc-c49e8864f657 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:34.612708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ae32e8cc-9678-414e-96dc-c49e8864f657 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:34.634776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae32e8cc-9678-414e-96dc-c49e8864f657 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.637762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae32e8cc-9678-414e-96dc-c49e8864f657 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.644090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae32e8cc-9678-414e-96dc-c49e8864f657 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.650698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae32e8cc-9678-414e-96dc-c49e8864f657 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:34.650698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae32e8cc-9678-414e-96dc-c49e8864f657 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:34.650698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae32e8cc-9678-414e-96dc-c49e8864f657 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:34.957149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f4485a00-1a7e-411a-84cc-7d5754603cef tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:34.972022 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f4485a00-1a7e-411a-84cc-7d5754603cef tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1220 microversion: 2.1 time: 0.423993 Oct 18 13:31:34.982686 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1646/3489] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:34 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1220 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:35.016720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ff1f8973-d954-44ad-83f1-fb388662d31e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:35.017963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ff1f8973-d954-44ad-83f1-fb388662d31e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:35.056768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff1f8973-d954-44ad-83f1-fb388662d31e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:35.057634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff1f8973-d954-44ad-83f1-fb388662d31e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:35.059869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff1f8973-d954-44ad-83f1-fb388662d31e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:35.060971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff1f8973-d954-44ad-83f1-fb388662d31e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:35.063722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff1f8973-d954-44ad-83f1-fb388662d31e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:35.064173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff1f8973-d954-44ad-83f1-fb388662d31e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:35.188074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ff1f8973-d954-44ad-83f1-fb388662d31e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:35.443168 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ff1f8973-d954-44ad-83f1-fb388662d31e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "DELETE /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 204 len: 0 microversion: 2.1 time: 0.467058 Oct 18 13:31:35.444024 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1647/3490] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:34 2022] DELETE /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:35.459150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c056551-ce17-4ef9-899d-17c075a884e0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:35.462180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2c056551-ce17-4ef9-899d-17c075a884e0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:35.482708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c056551-ce17-4ef9-899d-17c075a884e0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:35.483219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c056551-ce17-4ef9-899d-17c075a884e0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:35.483674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c056551-ce17-4ef9-899d-17c075a884e0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:35.489068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c056551-ce17-4ef9-899d-17c075a884e0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:35.492111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c056551-ce17-4ef9-899d-17c075a884e0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:35.494891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c056551-ce17-4ef9-899d-17c075a884e0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:35.873913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ae32e8cc-9678-414e-96dc-c49e8864f657 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:35.905563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ae32e8cc-9678-414e-96dc-c49e8864f657 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:35.907983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ae32e8cc-9678-414e-96dc-c49e8864f657 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:35.913583 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ae32e8cc-9678-414e-96dc-c49e8864f657 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 1.315562 Oct 18 13:31:35.917398 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1844/3491] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:34 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:35.928756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ddacf295-83a7-43ac-9748-2d88dfdf6d88 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:35.930174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ddacf295-83a7-43ac-9748-2d88dfdf6d88 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:35.939010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddacf295-83a7-43ac-9748-2d88dfdf6d88 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:35.939772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddacf295-83a7-43ac-9748-2d88dfdf6d88 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:35.941404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddacf295-83a7-43ac-9748-2d88dfdf6d88 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:35.942404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddacf295-83a7-43ac-9748-2d88dfdf6d88 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:35.943024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddacf295-83a7-43ac-9748-2d88dfdf6d88 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:35.943618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddacf295-83a7-43ac-9748-2d88dfdf6d88 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:35.972746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:36.336268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ddacf295-83a7-43ac-9748-2d88dfdf6d88 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:36.351204 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ddacf295-83a7-43ac-9748-2d88dfdf6d88 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1493 microversion: 2.1 time: 0.432516 Oct 18 13:31:36.352359 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1845/3492] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:35 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1493 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:36.369270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-81e46dfb-aad2-43bd-8116-27b73e3e33d8 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:36.370174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-81e46dfb-aad2-43bd-8116-27b73e3e33d8 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:36.381633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81e46dfb-aad2-43bd-8116-27b73e3e33d8 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:36.382677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81e46dfb-aad2-43bd-8116-27b73e3e33d8 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:36.383336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81e46dfb-aad2-43bd-8116-27b73e3e33d8 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:36.384432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81e46dfb-aad2-43bd-8116-27b73e3e33d8 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:36.385970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81e46dfb-aad2-43bd-8116-27b73e3e33d8 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:36.386573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81e46dfb-aad2-43bd-8116-27b73e3e33d8 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:36.518353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-81e46dfb-aad2-43bd-8116-27b73e3e33d8 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:36.527889 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-81e46dfb-aad2-43bd-8116-27b73e3e33d8 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1272 microversion: 2.1 time: 0.174177 Oct 18 13:31:36.536169 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1846/3493] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:36 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:36.541697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a3d5de33-447d-4f0f-9d2d-be0dbf08ff3a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:36.550146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2c056551-ce17-4ef9-899d-17c075a884e0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:36.552318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a3d5de33-447d-4f0f-9d2d-be0dbf08ff3a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:36.559669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3d5de33-447d-4f0f-9d2d-be0dbf08ff3a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:36.560419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3d5de33-447d-4f0f-9d2d-be0dbf08ff3a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:36.562200 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2c056551-ce17-4ef9-899d-17c075a884e0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1523 microversion: 2.1 time: 1.110980 Oct 18 13:31:36.562737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3d5de33-447d-4f0f-9d2d-be0dbf08ff3a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:36.563662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3d5de33-447d-4f0f-9d2d-be0dbf08ff3a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:36.566681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3d5de33-447d-4f0f-9d2d-be0dbf08ff3a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:36.566850 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1648/3494] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:35 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1523 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:36.567472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3d5de33-447d-4f0f-9d2d-be0dbf08ff3a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:36.586035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f30e6ba2-6d7d-4e02-a0ac-4e27ebff1264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:36.594004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f30e6ba2-6d7d-4e02-a0ac-4e27ebff1264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:36.601847 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-a3d5de33-447d-4f0f-9d2d-be0dbf08ff3a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] HTTP exception thrown: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a3d5de33-447d-4f0f-9d2d-be0dbf08ff3a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Request method failure captured: Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 HTTP/1.1 Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqkACTXpZbelTc_C7QsACdkT4dSwkASWdvJl0a4TPblMirmpJ0mwQz-KpfhXSHl27RDX6DavQ1vMsDyZaJW22Hj2jouOzDQPqnoEvbvJDWzyrCtlnxukkQdPbwnEldMx2i2MBaOQRKkBKQHVr4jBeQ8zb2-qElZ6fwYTHz1C8Md31Bo Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.42 Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 19e1c317d0a34148949ddddadffb4415 Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-137896444 Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19e1c317d0a34148949ddddadffb4415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19e1c317d0a34148949ddddadffb4415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19e1c317d0a34148949ddddadffb4415"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19e1c317d0a34148949ddddadffb4415"}]}] Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TaggedBootDevicesTest_v242-137896444 Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 19e1c317d0a34148949ddddadffb4415 Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-137896444 Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TaggedBootDevicesTest_v242-137896444-project Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f3922bd65ede4e2586d23741b8ac19a1 Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TaggedBootDevicesTest_v242-137896444-project Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567'} Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:36.603886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:36.609028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:36.609028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:36.609028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:36.609028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:36.609028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:36.609028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:36.609028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:36.609028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:36.609028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:36.609028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:36.609028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:36.610829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a3d5de33-447d-4f0f-9d2d-be0dbf08ff3a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Returning 404 to user: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:36.615481 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a3d5de33-447d-4f0f-9d2d-be0dbf08ff3a tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 404 len: 111 microversion: 2.42 time: 0.077301 Oct 18 13:31:36.615936 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1847/3495] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:31:36 2022] DELETE /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:31:36.619426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f30e6ba2-6d7d-4e02-a0ac-4e27ebff1264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:36.619943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f30e6ba2-6d7d-4e02-a0ac-4e27ebff1264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:36.623973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed3528ed-3ba5-4419-8b68-c670fbd56b15 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:36.624581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ed3528ed-3ba5-4419-8b68-c670fbd56b15 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] [instance: f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:36.625016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f30e6ba2-6d7d-4e02-a0ac-4e27ebff1264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:36.625821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f30e6ba2-6d7d-4e02-a0ac-4e27ebff1264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:36.626299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f30e6ba2-6d7d-4e02-a0ac-4e27ebff1264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:36.626856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f30e6ba2-6d7d-4e02-a0ac-4e27ebff1264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:36.642857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed3528ed-3ba5-4419-8b68-c670fbd56b15 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:36.643685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed3528ed-3ba5-4419-8b68-c670fbd56b15 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:36.644531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed3528ed-3ba5-4419-8b68-c670fbd56b15 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:36.645459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed3528ed-3ba5-4419-8b68-c670fbd56b15 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:36.649593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed3528ed-3ba5-4419-8b68-c670fbd56b15 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:36.650285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed3528ed-3ba5-4419-8b68-c670fbd56b15 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:36.680504 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-ed3528ed-3ba5-4419-8b68-c670fbd56b15 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] HTTP exception thrown: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed3528ed-3ba5-4419-8b68-c670fbd56b15 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Request method failure captured: Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 HTTP/1.1 Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqkACTXpZbelTc_C7QsACdkT4dSwkASWdvJl0a4TPblMirmpJ0mwQz-KpfhXSHl27RDX6DavQ1vMsDyZaJW22Hj2jouOzDQPqnoEvbvJDWzyrCtlnxukkQdPbwnEldMx2i2MBaOQRKkBKQHVr4jBeQ8zb2-qElZ6fwYTHz1C8Md31Bo Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.42 Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 19e1c317d0a34148949ddddadffb4415 Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-137896444 Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19e1c317d0a34148949ddddadffb4415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19e1c317d0a34148949ddddadffb4415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19e1c317d0a34148949ddddadffb4415"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19e1c317d0a34148949ddddadffb4415"}]}] Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TaggedBootDevicesTest_v242-137896444 Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 19e1c317d0a34148949ddddadffb4415 Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-137896444 Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TaggedBootDevicesTest_v242-137896444-project Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f3922bd65ede4e2586d23741b8ac19a1 Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TaggedBootDevicesTest_v242-137896444-project Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567'} Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:36.682430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:36.687738 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:36.687738 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:36.687738 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:36.687738 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:36.687738 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:36.687738 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:36.687738 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. Oct 18 13:31:36.687738 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:36.689906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed3528ed-3ba5-4419-8b68-c670fbd56b15 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] Returning 404 to user: Instance f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:36.691576 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ed3528ed-3ba5-4419-8b68-c670fbd56b15 tempest-TaggedBootDevicesTest_v242-137896444 tempest-TaggedBootDevicesTest_v242-137896444-project] 10.222.0.40 "GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567" status: 404 len: 111 microversion: 2.42 time: 0.071686 Oct 18 13:31:36.692691 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1848/3496] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:36 2022] GET /compute/v2.1/servers/f2f3cdc8-b9b5-4a6f-bd9b-31029cb70567 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:31:36.799254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f30e6ba2-6d7d-4e02-a0ac-4e27ebff1264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:36.807754 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f30e6ba2-6d7d-4e02-a0ac-4e27ebff1264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1272 microversion: 2.1 time: 0.239661 Oct 18 13:31:36.821294 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1649/3497] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:36 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:36.860552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3d1ea890-daa0-4863-9f49-fd8d62dc2fa9 req-715c7b5d-279b-4f3e-92e9-ef2512145962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-plugged", "status": "completed", "tag": "48ef6290-b5a1-4b6a-bfeb-f1656a0b1efb"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:36.891406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3d1ea890-daa0-4863-9f49-fd8d62dc2fa9 req-715c7b5d-279b-4f3e-92e9-ef2512145962 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:36.892189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3d1ea890-daa0-4863-9f49-fd8d62dc2fa9 req-715c7b5d-279b-4f3e-92e9-ef2512145962 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:36.892309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3d1ea890-daa0-4863-9f49-fd8d62dc2fa9 req-715c7b5d-279b-4f3e-92e9-ef2512145962 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:36.909470 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3d1ea890-daa0-4863-9f49-fd8d62dc2fa9 req-715c7b5d-279b-4f3e-92e9-ef2512145962 service nova] Creating event network-vif-plugged:48ef6290-b5a1-4b6a-bfeb-f1656a0b1efb for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:31:36.922254 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3d1ea890-daa0-4863-9f49-fd8d62dc2fa9 req-715c7b5d-279b-4f3e-92e9-ef2512145962 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065241 Oct 18 13:31:36.922873 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1849/3498] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:36.950307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9d86b234-db0b-4495-9f2b-3e68fb7c6f30 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:36.950941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9d86b234-db0b-4495-9f2b-3e68fb7c6f30 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:36.961338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d86b234-db0b-4495-9f2b-3e68fb7c6f30 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:36.961837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d86b234-db0b-4495-9f2b-3e68fb7c6f30 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:36.962276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d86b234-db0b-4495-9f2b-3e68fb7c6f30 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:36.962988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d86b234-db0b-4495-9f2b-3e68fb7c6f30 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:36.967549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d86b234-db0b-4495-9f2b-3e68fb7c6f30 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:36.968067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d86b234-db0b-4495-9f2b-3e68fb7c6f30 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:37.025599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:37.382737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8774dccd-826d-4e09-a786-5b0fe3e7735e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:37.385533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8774dccd-826d-4e09-a786-5b0fe3e7735e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:37.410653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8774dccd-826d-4e09-a786-5b0fe3e7735e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:37.415285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8774dccd-826d-4e09-a786-5b0fe3e7735e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:37.415965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8774dccd-826d-4e09-a786-5b0fe3e7735e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:37.417010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8774dccd-826d-4e09-a786-5b0fe3e7735e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:37.418281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8774dccd-826d-4e09-a786-5b0fe3e7735e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:37.420144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8774dccd-826d-4e09-a786-5b0fe3e7735e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:38.057449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9d86b234-db0b-4495-9f2b-3e68fb7c6f30 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:38.071709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9d86b234-db0b-4495-9f2b-3e68fb7c6f30 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:38.080791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9d86b234-db0b-4495-9f2b-3e68fb7c6f30 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:38.082428 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9d86b234-db0b-4495-9f2b-3e68fb7c6f30 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 1.138673 Oct 18 13:31:38.099972 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1650/3499] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:36 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:38.112016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8774dccd-826d-4e09-a786-5b0fe3e7735e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:38.115768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-017b866a-7d57-431d-8808-be34e1bd99fb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:38.120955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-017b866a-7d57-431d-8808-be34e1bd99fb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:38.121836 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8774dccd-826d-4e09-a786-5b0fe3e7735e tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1493 microversion: 2.1 time: 0.745965 Oct 18 13:31:38.132169 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1850/3500] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:37 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1493 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:38.136662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a95d8b5c-5b7d-4145-b0c0-8432af9d3618 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:38.137311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a95d8b5c-5b7d-4145-b0c0-8432af9d3618 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:38.145693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-017b866a-7d57-431d-8808-be34e1bd99fb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:38.146278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-017b866a-7d57-431d-8808-be34e1bd99fb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:38.146760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-017b866a-7d57-431d-8808-be34e1bd99fb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:38.147530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-017b866a-7d57-431d-8808-be34e1bd99fb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:38.148096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-017b866a-7d57-431d-8808-be34e1bd99fb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:38.148559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-017b866a-7d57-431d-8808-be34e1bd99fb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:38.168937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a95d8b5c-5b7d-4145-b0c0-8432af9d3618 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:38.170068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a95d8b5c-5b7d-4145-b0c0-8432af9d3618 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:38.170193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a95d8b5c-5b7d-4145-b0c0-8432af9d3618 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:38.176581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a95d8b5c-5b7d-4145-b0c0-8432af9d3618 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:38.176581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a95d8b5c-5b7d-4145-b0c0-8432af9d3618 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:38.176581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a95d8b5c-5b7d-4145-b0c0-8432af9d3618 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:38.459605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-017b866a-7d57-431d-8808-be34e1bd99fb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:38.473808 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-017b866a-7d57-431d-8808-be34e1bd99fb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1272 microversion: 2.1 time: 0.372513 Oct 18 13:31:38.485666 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1651/3501] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:38 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1272 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:38.501982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e1fcf655-45ff-4f55-9df9-e1dc7f05daf0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:38.503626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e1fcf655-45ff-4f55-9df9-e1dc7f05daf0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:38.510125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1fcf655-45ff-4f55-9df9-e1dc7f05daf0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:38.511045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1fcf655-45ff-4f55-9df9-e1dc7f05daf0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:38.511504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1fcf655-45ff-4f55-9df9-e1dc7f05daf0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:38.512250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1fcf655-45ff-4f55-9df9-e1dc7f05daf0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:38.512777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1fcf655-45ff-4f55-9df9-e1dc7f05daf0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:38.513248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1fcf655-45ff-4f55-9df9-e1dc7f05daf0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:38.819032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e1fcf655-45ff-4f55-9df9-e1dc7f05daf0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:38.839469 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e1fcf655-45ff-4f55-9df9-e1dc7f05daf0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1278 microversion: 2.1 time: 0.356709 Oct 18 13:31:38.842057 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1652/3502] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:38 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1278 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:39.103621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-2f494389-6b9c-47c9-9026-36ac57d13409 req-585ae71a-9f4a-4348-8c09-54c64ff7bcfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-plugged", "status": "completed", "tag": "d6206404-f696-46cc-a70b-84728c57e26e"}, {"server_uuid": "206ae481-4890-46be-a0eb-83a6f22eb0b6", "name": "network-vif-plugged", "status": "completed", "tag": "66a40b29-9fc8-40b9-b9d7-336889430bb8"}, {"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-plugged", "status": "completed", "tag": "85bd4b91-835a-4c86-9150-32d18f92eefc"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:39.127715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2f494389-6b9c-47c9-9026-36ac57d13409 req-585ae71a-9f4a-4348-8c09-54c64ff7bcfc service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:39.131796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2f494389-6b9c-47c9-9026-36ac57d13409 req-585ae71a-9f4a-4348-8c09-54c64ff7bcfc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:39.132564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2f494389-6b9c-47c9-9026-36ac57d13409 req-585ae71a-9f4a-4348-8c09-54c64ff7bcfc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:39.166817 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-2f494389-6b9c-47c9-9026-36ac57d13409 req-585ae71a-9f4a-4348-8c09-54c64ff7bcfc service nova] Creating event network-vif-plugged:d6206404-f696-46cc-a70b-84728c57e26e for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:31:39.172984 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-2f494389-6b9c-47c9-9026-36ac57d13409 req-585ae71a-9f4a-4348-8c09-54c64ff7bcfc service nova] Creating event network-vif-plugged:66a40b29-9fc8-40b9-b9d7-336889430bb8 for instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 on n-h2-858384-13 Oct 18 13:31:39.173831 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-2f494389-6b9c-47c9-9026-36ac57d13409 req-585ae71a-9f4a-4348-8c09-54c64ff7bcfc service nova] Creating event network-vif-plugged:85bd4b91-835a-4c86-9150-32d18f92eefc for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:31:39.194329 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-2f494389-6b9c-47c9-9026-36ac57d13409 req-585ae71a-9f4a-4348-8c09-54c64ff7bcfc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.095062 Oct 18 13:31:39.195561 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1653/3503] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:31:39.219646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-75b75ea1-00d1-48e6-bcfd-3a7746a7ad4f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:39.225658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-75b75ea1-00d1-48e6-bcfd-3a7746a7ad4f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:39.251143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75b75ea1-00d1-48e6-bcfd-3a7746a7ad4f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:39.254583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75b75ea1-00d1-48e6-bcfd-3a7746a7ad4f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:39.257984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75b75ea1-00d1-48e6-bcfd-3a7746a7ad4f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:39.260396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75b75ea1-00d1-48e6-bcfd-3a7746a7ad4f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:39.260893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75b75ea1-00d1-48e6-bcfd-3a7746a7ad4f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:39.264467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75b75ea1-00d1-48e6-bcfd-3a7746a7ad4f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:39.339090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a95d8b5c-5b7d-4145-b0c0-8432af9d3618 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:39.357947 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a95d8b5c-5b7d-4145-b0c0-8432af9d3618 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1523 microversion: 2.1 time: 1.231173 Oct 18 13:31:39.359788 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1851/3504] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:38 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1523 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:39.386537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f85a22b6-1f74-4179-8f4a-b3eef32cbc7d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:39.393168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f85a22b6-1f74-4179-8f4a-b3eef32cbc7d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:39.408003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f85a22b6-1f74-4179-8f4a-b3eef32cbc7d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:39.411016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f85a22b6-1f74-4179-8f4a-b3eef32cbc7d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:39.413298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f85a22b6-1f74-4179-8f4a-b3eef32cbc7d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:39.414376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f85a22b6-1f74-4179-8f4a-b3eef32cbc7d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:39.419564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f85a22b6-1f74-4179-8f4a-b3eef32cbc7d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:39.421036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f85a22b6-1f74-4179-8f4a-b3eef32cbc7d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:40.022584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f85a22b6-1f74-4179-8f4a-b3eef32cbc7d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:40.036530 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f85a22b6-1f74-4179-8f4a-b3eef32cbc7d tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 200 len: 1451 microversion: 2.1 time: 0.668576 Oct 18 13:31:40.037802 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1852/3505] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:39 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 1451 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:40.053685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c2730ea-9ef6-4cdc-aa99-76d6b1f8749a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:40.054693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4c2730ea-9ef6-4cdc-aa99-76d6b1f8749a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:40.069901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c2730ea-9ef6-4cdc-aa99-76d6b1f8749a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:40.071491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c2730ea-9ef6-4cdc-aa99-76d6b1f8749a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:40.073558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c2730ea-9ef6-4cdc-aa99-76d6b1f8749a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:40.074922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c2730ea-9ef6-4cdc-aa99-76d6b1f8749a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:40.076311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c2730ea-9ef6-4cdc-aa99-76d6b1f8749a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:40.077458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c2730ea-9ef6-4cdc-aa99-76d6b1f8749a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:40.254475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c2730ea-9ef6-4cdc-aa99-76d6b1f8749a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:40.267442 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4c2730ea-9ef6-4cdc-aa99-76d6b1f8749a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1272 microversion: 2.1 time: 0.228345 Oct 18 13:31:40.285655 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1853/3506] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:40 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:40.295767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f16a5865-8818-46fc-877c-2ff3608f92b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:40.296400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f16a5865-8818-46fc-877c-2ff3608f92b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:40.304255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f16a5865-8818-46fc-877c-2ff3608f92b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:40.304751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f16a5865-8818-46fc-877c-2ff3608f92b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:40.305204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f16a5865-8818-46fc-877c-2ff3608f92b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:40.306207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f16a5865-8818-46fc-877c-2ff3608f92b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:40.306665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f16a5865-8818-46fc-877c-2ff3608f92b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:40.307094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f16a5865-8818-46fc-877c-2ff3608f92b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:40.571396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f16a5865-8818-46fc-877c-2ff3608f92b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:40.582612 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f16a5865-8818-46fc-877c-2ff3608f92b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1278 microversion: 2.1 time: 0.295751 Oct 18 13:31:40.587122 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1854/3507] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:40 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1278 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:40.923265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-75b75ea1-00d1-48e6-bcfd-3a7746a7ad4f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:40.923827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3cb94c8f-3dc3-4459-a1aa-7415d0987a76 req-5d94129d-8193-4452-b0bb-a81517e55a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55057538-1fbb-42f0-a01d-c7558e4c2c2d", "name": "network-vif-deleted", "tag": "3b6c31dc-0fed-441b-9651-2d2e6ea826de"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:40.935535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-75b75ea1-00d1-48e6-bcfd-3a7746a7ad4f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:40.940938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3cb94c8f-3dc3-4459-a1aa-7415d0987a76 req-5d94129d-8193-4452-b0bb-a81517e55a4f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:40.943130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3cb94c8f-3dc3-4459-a1aa-7415d0987a76 req-5d94129d-8193-4452-b0bb-a81517e55a4f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:40.943860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3cb94c8f-3dc3-4459-a1aa-7415d0987a76 req-5d94129d-8193-4452-b0bb-a81517e55a4f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:40.944334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-75b75ea1-00d1-48e6-bcfd-3a7746a7ad4f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:40.945737 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-75b75ea1-00d1-48e6-bcfd-3a7746a7ad4f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 1.748606 Oct 18 13:31:40.961899 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1654/3508] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:39 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:40.962652 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3cb94c8f-3dc3-4459-a1aa-7415d0987a76 req-5d94129d-8193-4452-b0bb-a81517e55a4f service nova] Creating event network-vif-deleted:3b6c31dc-0fed-441b-9651-2d2e6ea826de for instance 55057538-1fbb-42f0-a01d-c7558e4c2c2d on n-h1-858384-13 Oct 18 13:31:40.968273 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3cb94c8f-3dc3-4459-a1aa-7415d0987a76 req-5d94129d-8193-4452-b0bb-a81517e55a4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.379587 Oct 18 13:31:40.969531 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1855/3509] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:40.975981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bd0b7830-dbd3-4373-a37c-8f3e6259ff4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:40.977095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bd0b7830-dbd3-4373-a37c-8f3e6259ff4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:40.984576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd0b7830-dbd3-4373-a37c-8f3e6259ff4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:40.985483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-80cf9e8e-29eb-4544-8a0d-caf7df25ad84 req-804db22e-6b87-4187-8cf2-2241a3c585f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edaa1a81-2913-4817-bd63-18ebf8b5fa2b", "tag": "773cc058-6f5c-4279-b7fe-03240ae29a1a"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:40.986709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd0b7830-dbd3-4373-a37c-8f3e6259ff4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:40.988512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd0b7830-dbd3-4373-a37c-8f3e6259ff4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:40.989766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd0b7830-dbd3-4373-a37c-8f3e6259ff4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:40.990402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd0b7830-dbd3-4373-a37c-8f3e6259ff4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:40.991240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd0b7830-dbd3-4373-a37c-8f3e6259ff4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:41.020348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-80cf9e8e-29eb-4544-8a0d-caf7df25ad84 req-804db22e-6b87-4187-8cf2-2241a3c585f9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:41.023197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-80cf9e8e-29eb-4544-8a0d-caf7df25ad84 req-804db22e-6b87-4187-8cf2-2241a3c585f9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:41.023962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-80cf9e8e-29eb-4544-8a0d-caf7df25ad84 req-804db22e-6b87-4187-8cf2-2241a3c585f9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:41.052813 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-80cf9e8e-29eb-4544-8a0d-caf7df25ad84 req-804db22e-6b87-4187-8cf2-2241a3c585f9 service nova] Creating event network-changed:773cc058-6f5c-4279-b7fe-03240ae29a1a for instance edaa1a81-2913-4817-bd63-18ebf8b5fa2b on n-h2-858384-13 Oct 18 13:31:41.062498 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-80cf9e8e-29eb-4544-8a0d-caf7df25ad84 req-804db22e-6b87-4187-8cf2-2241a3c585f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087875 Oct 18 13:31:41.063114 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1655/3510] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:41.076459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e39db856-ae98-4ffb-9518-20bc1d26beb7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:41.079101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e39db856-ae98-4ffb-9518-20bc1d26beb7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 55057538-1fbb-42f0-a01d-c7558e4c2c2d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:41.092707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e39db856-ae98-4ffb-9518-20bc1d26beb7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:41.093212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e39db856-ae98-4ffb-9518-20bc1d26beb7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:41.094532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e39db856-ae98-4ffb-9518-20bc1d26beb7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:41.095233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e39db856-ae98-4ffb-9518-20bc1d26beb7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:41.095683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e39db856-ae98-4ffb-9518-20bc1d26beb7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:41.096110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e39db856-ae98-4ffb-9518-20bc1d26beb7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:41.131296 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e39db856-ae98-4ffb-9518-20bc1d26beb7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] HTTP exception thrown: Instance 55057538-1fbb-42f0-a01d-c7558e4c2c2d could not be found. Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e39db856-ae98-4ffb-9518-20bc1d26beb7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Request method failure captured: Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d HTTP/1.1 Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqgSyOovjkBwC2zDG9FKchsa-85pvviPiRczs79e9ogA2WOflaKqo4WjkGNjiwWrTbKQeMF0qFdRR97LgwpYjvL7_VWxucAaxUZM-ArWvxecTGdyg6CEOtjVVE0a_ifjjfGSQqXSLBM0YxminaTsZoLWFl2mIOYtfxpGTzdnzLBn-rI Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 452e5b77db474cf9a2b7f6b2abcb6115 Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_452e5b77db474cf9a2b7f6b2abcb6115"}]}] Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 452e5b77db474cf9a2b7f6b2abcb6115 Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerActionsTestJSON-330379010-project Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 2878f8de95694fe1a9a17ed27b6ba40b Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerActionsTestJSON-330379010-project Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 55057538-1fbb-42f0-a01d-c7558e4c2c2d could not be found. Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '55057538-1fbb-42f0-a01d-c7558e4c2c2d'} Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55057538-1fbb-42f0-a01d-c7558e4c2c2d could not be found. Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55057538-1fbb-42f0-a01d-c7558e4c2c2d could not be found. Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:41.132990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:41.137878 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:41.137878 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:41.137878 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:41.137878 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:41.137878 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:41.137878 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55057538-1fbb-42f0-a01d-c7558e4c2c2d could not be found. Oct 18 13:31:41.137878 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:31:41.137878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e39db856-ae98-4ffb-9518-20bc1d26beb7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Returning 404 to user: Instance 55057538-1fbb-42f0-a01d-c7558e4c2c2d could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:41.138690 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e39db856-ae98-4ffb-9518-20bc1d26beb7 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d" status: 404 len: 111 microversion: 2.1 time: 0.073136 Oct 18 13:31:41.139889 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1656/3511] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:41 2022] GET /compute/v2.1/servers/55057538-1fbb-42f0-a01d-c7558e4c2c2d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:41.162633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7d6739ae-0096-4cd3-a189-22fb5dcf75ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:41.163141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7d6739ae-0096-4cd3-a189-22fb5dcf75ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:41.176983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d6739ae-0096-4cd3-a189-22fb5dcf75ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:41.177505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d6739ae-0096-4cd3-a189-22fb5dcf75ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:41.177945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d6739ae-0096-4cd3-a189-22fb5dcf75ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:41.178672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d6739ae-0096-4cd3-a189-22fb5dcf75ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:41.179128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d6739ae-0096-4cd3-a189-22fb5dcf75ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:41.179557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d6739ae-0096-4cd3-a189-22fb5dcf75ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:41.228931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7d6739ae-0096-4cd3-a189-22fb5dcf75ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:41.415902 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7d6739ae-0096-4cd3-a189-22fb5dcf75ab tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 204 len: 0 microversion: 2.1 time: 0.270278 Oct 18 13:31:41.421657 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1657/3512] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:41 2022] DELETE /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:41.428681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b571f33b-6b6a-45f3-bd4d-d8d5e02bfe15 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:41.429526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b571f33b-6b6a-45f3-bd4d-d8d5e02bfe15 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:41.446145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b571f33b-6b6a-45f3-bd4d-d8d5e02bfe15 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:41.446992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b571f33b-6b6a-45f3-bd4d-d8d5e02bfe15 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:41.448259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b571f33b-6b6a-45f3-bd4d-d8d5e02bfe15 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:41.449160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b571f33b-6b6a-45f3-bd4d-d8d5e02bfe15 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:41.449857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b571f33b-6b6a-45f3-bd4d-d8d5e02bfe15 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:41.450497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b571f33b-6b6a-45f3-bd4d-d8d5e02bfe15 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:41.898336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bd0b7830-dbd3-4373-a37c-8f3e6259ff4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:41.907973 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bd0b7830-dbd3-4373-a37c-8f3e6259ff4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1523 microversion: 2.1 time: 0.937055 Oct 18 13:31:41.908576 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1856/3513] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:40 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1523 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:41.918386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d2b9d233-4e56-4d3a-a451-819c69acdacc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:41.919009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d2b9d233-4e56-4d3a-a451-819c69acdacc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:41.957364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2b9d233-4e56-4d3a-a451-819c69acdacc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:41.957775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2b9d233-4e56-4d3a-a451-819c69acdacc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:41.958212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2b9d233-4e56-4d3a-a451-819c69acdacc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:41.958914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2b9d233-4e56-4d3a-a451-819c69acdacc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:41.959363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2b9d233-4e56-4d3a-a451-819c69acdacc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:41.959782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2b9d233-4e56-4d3a-a451-819c69acdacc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:42.244857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d2b9d233-4e56-4d3a-a451-819c69acdacc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:42.254695 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d2b9d233-4e56-4d3a-a451-819c69acdacc tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1676 microversion: 2.1 time: 0.345006 Oct 18 13:31:42.255554 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1857/3514] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:41 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1676 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:42.260501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e0bef62c-5e53-4f8c-9887-878a6556d160 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:42.261104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e0bef62c-5e53-4f8c-9887-878a6556d160 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:42.267793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0bef62c-5e53-4f8c-9887-878a6556d160 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:42.269906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0bef62c-5e53-4f8c-9887-878a6556d160 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:42.271289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0bef62c-5e53-4f8c-9887-878a6556d160 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:42.272184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0bef62c-5e53-4f8c-9887-878a6556d160 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:42.273312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0bef62c-5e53-4f8c-9887-878a6556d160 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:42.273914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0bef62c-5e53-4f8c-9887-878a6556d160 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:42.419430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:42.444444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b571f33b-6b6a-45f3-bd4d-d8d5e02bfe15 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:42.461719 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b571f33b-6b6a-45f3-bd4d-d8d5e02bfe15 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1314 microversion: 2.1 time: 1.038667 Oct 18 13:31:42.462481 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1658/3515] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:41 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1314 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:42.467109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d0c1e7c3-75b5-4302-b99e-cfc2fd888206 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:42.467716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d0c1e7c3-75b5-4302-b99e-cfc2fd888206 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:42.496063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0c1e7c3-75b5-4302-b99e-cfc2fd888206 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:42.496586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0c1e7c3-75b5-4302-b99e-cfc2fd888206 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:42.497025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0c1e7c3-75b5-4302-b99e-cfc2fd888206 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:42.497789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0c1e7c3-75b5-4302-b99e-cfc2fd888206 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:42.498248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0c1e7c3-75b5-4302-b99e-cfc2fd888206 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:42.505846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0c1e7c3-75b5-4302-b99e-cfc2fd888206 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:42.527303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e0bef62c-5e53-4f8c-9887-878a6556d160 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:42.541672 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e0bef62c-5e53-4f8c-9887-878a6556d160 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1320 microversion: 2.1 time: 0.284550 Oct 18 13:31:42.542591 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1858/3516] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:42 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1320 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:42.935084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ea5382cd-bb53-49b0-9076-5d58d45ae00f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:42.936594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ea5382cd-bb53-49b0-9076-5d58d45ae00f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:42.957589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea5382cd-bb53-49b0-9076-5d58d45ae00f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:42.958352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea5382cd-bb53-49b0-9076-5d58d45ae00f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:42.959190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea5382cd-bb53-49b0-9076-5d58d45ae00f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:42.960132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea5382cd-bb53-49b0-9076-5d58d45ae00f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:42.960839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea5382cd-bb53-49b0-9076-5d58d45ae00f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:42.961575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea5382cd-bb53-49b0-9076-5d58d45ae00f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:43.223029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d0c1e7c3-75b5-4302-b99e-cfc2fd888206 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:43.242856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d0c1e7c3-75b5-4302-b99e-cfc2fd888206 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:43.243017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d0c1e7c3-75b5-4302-b99e-cfc2fd888206 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:43.248540 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d0c1e7c3-75b5-4302-b99e-cfc2fd888206 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1879 microversion: 2.32 time: 0.784864 Oct 18 13:31:43.252034 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1659/3517] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:42 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1879 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:43.280768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1539e2cf-8967-47e3-8f6a-f177e311a607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:43.281766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1539e2cf-8967-47e3-8f6a-f177e311a607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:43.298558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1539e2cf-8967-47e3-8f6a-f177e311a607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:43.301990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1539e2cf-8967-47e3-8f6a-f177e311a607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:43.302442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1539e2cf-8967-47e3-8f6a-f177e311a607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:43.306076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1539e2cf-8967-47e3-8f6a-f177e311a607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:43.306570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1539e2cf-8967-47e3-8f6a-f177e311a607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:43.310932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1539e2cf-8967-47e3-8f6a-f177e311a607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:43.523042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ea5382cd-bb53-49b0-9076-5d58d45ae00f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:43.554997 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ea5382cd-bb53-49b0-9076-5d58d45ae00f tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1508 microversion: 2.1 time: 0.621636 Oct 18 13:31:43.562224 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1859/3518] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:42 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1508 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:43.601770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-01cb050e-ab96-4d9a-a098-66207876983e tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:43.611051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-01cb050e-ab96-4d9a-a098-66207876983e tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:43.635940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01cb050e-ab96-4d9a-a098-66207876983e tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:43.636498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01cb050e-ab96-4d9a-a098-66207876983e tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:43.642761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01cb050e-ab96-4d9a-a098-66207876983e tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:43.656134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01cb050e-ab96-4d9a-a098-66207876983e tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:43.662094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01cb050e-ab96-4d9a-a098-66207876983e tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:43.662669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01cb050e-ab96-4d9a-a098-66207876983e tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:44.099691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-01cb050e-ab96-4d9a-a098-66207876983e tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:44.114615 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-01cb050e-ab96-4d9a-a098-66207876983e tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1314 microversion: 2.1 time: 0.548442 Oct 18 13:31:44.129889 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1860/3519] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:43 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:44.145477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c1a128db-2bc8-4f74-9cfe-972c11ef4a8b req-b54ce79a-dd9b-431b-954e-83a82005c87d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3b7058d-7bdc-4d34-b3e3-fa5be5730997", "tag": "521de7e6-06e5-4a89-a9a8-91a43322d930"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:44.170156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c1a128db-2bc8-4f74-9cfe-972c11ef4a8b req-b54ce79a-dd9b-431b-954e-83a82005c87d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:44.170653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c1a128db-2bc8-4f74-9cfe-972c11ef4a8b req-b54ce79a-dd9b-431b-954e-83a82005c87d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:44.171094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c1a128db-2bc8-4f74-9cfe-972c11ef4a8b req-b54ce79a-dd9b-431b-954e-83a82005c87d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:44.228049 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c1a128db-2bc8-4f74-9cfe-972c11ef4a8b req-b54ce79a-dd9b-431b-954e-83a82005c87d service nova] Creating event network-changed:521de7e6-06e5-4a89-a9a8-91a43322d930 for instance b3b7058d-7bdc-4d34-b3e3-fa5be5730997 on n-h1-858384-13 Oct 18 13:31:44.242270 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c1a128db-2bc8-4f74-9cfe-972c11ef4a8b req-b54ce79a-dd9b-431b-954e-83a82005c87d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110888 Oct 18 13:31:44.243504 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1861/3520] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:44.260162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-104088e1-33c0-4e1c-bbd8-07f7349f10a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:44.261296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-104088e1-33c0-4e1c-bbd8-07f7349f10a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:44.279227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=10 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:44.290050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-104088e1-33c0-4e1c-bbd8-07f7349f10a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:44.293407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-104088e1-33c0-4e1c-bbd8-07f7349f10a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:44.294091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-104088e1-33c0-4e1c-bbd8-07f7349f10a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:44.295621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-104088e1-33c0-4e1c-bbd8-07f7349f10a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:44.297346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-104088e1-33c0-4e1c-bbd8-07f7349f10a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:44.298252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-104088e1-33c0-4e1c-bbd8-07f7349f10a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:44.305128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=11 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:44.741343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-104088e1-33c0-4e1c-bbd8-07f7349f10a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:44.785840 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-104088e1-33c0-4e1c-bbd8-07f7349f10a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1320 microversion: 2.1 time: 0.525931 Oct 18 13:31:44.789513 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1862/3521] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:44 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1320 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:44.801782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aec564b1-2ff7-4acd-8a7b-a11d04d91a4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:44.803393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aec564b1-2ff7-4acd-8a7b-a11d04d91a4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:44.827685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aec564b1-2ff7-4acd-8a7b-a11d04d91a4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:44.828831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aec564b1-2ff7-4acd-8a7b-a11d04d91a4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:44.829658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aec564b1-2ff7-4acd-8a7b-a11d04d91a4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:44.830843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aec564b1-2ff7-4acd-8a7b-a11d04d91a4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:44.832685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aec564b1-2ff7-4acd-8a7b-a11d04d91a4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:44.833452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aec564b1-2ff7-4acd-8a7b-a11d04d91a4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:44.967291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=8 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:45.194244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1539e2cf-8967-47e3-8f6a-f177e311a607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:45.203924 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1539e2cf-8967-47e3-8f6a-f177e311a607 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1676 microversion: 2.1 time: 1.927849 Oct 18 13:31:45.210342 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1660/3522] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:43 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1676 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:45.215211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f5e70ab1-02ea-4275-ace7-a6a6f216d2fc tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:45.215830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f5e70ab1-02ea-4275-ace7-a6a6f216d2fc tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:45.232722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5e70ab1-02ea-4275-ace7-a6a6f216d2fc tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:45.233248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5e70ab1-02ea-4275-ace7-a6a6f216d2fc tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:45.233695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5e70ab1-02ea-4275-ace7-a6a6f216d2fc tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:45.234409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5e70ab1-02ea-4275-ace7-a6a6f216d2fc tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:45.234862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5e70ab1-02ea-4275-ace7-a6a6f216d2fc tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:45.235303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5e70ab1-02ea-4275-ace7-a6a6f216d2fc tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:45.382488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aec564b1-2ff7-4acd-8a7b-a11d04d91a4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:45.402086 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aec564b1-2ff7-4acd-8a7b-a11d04d91a4d tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 200 len: 1508 microversion: 2.1 time: 0.610664 Oct 18 13:31:45.417741 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1863/3523] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:44 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 1508 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:45.426647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-cdb28073-a175-4b0c-abc1-8d7fdbe58fba req-88ba1cea-f901-43ba-bf36-c8374c590b20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98e8ac53-2c9b-4c4b-b2f9-1d14d996736e", "tag": "920fcd55-e944-4969-b916-c77d2230eb02"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:45.437910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-cdb28073-a175-4b0c-abc1-8d7fdbe58fba req-88ba1cea-f901-43ba-bf36-c8374c590b20 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:45.438655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-cdb28073-a175-4b0c-abc1-8d7fdbe58fba req-88ba1cea-f901-43ba-bf36-c8374c590b20 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:45.439244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-cdb28073-a175-4b0c-abc1-8d7fdbe58fba req-88ba1cea-f901-43ba-bf36-c8374c590b20 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:45.453856 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-cdb28073-a175-4b0c-abc1-8d7fdbe58fba req-88ba1cea-f901-43ba-bf36-c8374c590b20 service nova] Creating event network-changed:920fcd55-e944-4969-b916-c77d2230eb02 for instance 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e on n-h1-858384-13 Oct 18 13:31:45.464902 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-cdb28073-a175-4b0c-abc1-8d7fdbe58fba req-88ba1cea-f901-43ba-bf36-c8374c590b20 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045538 Oct 18 13:31:45.466306 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1864/3524] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:45.473698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2235d0db-44bd-4cc1-bf5b-534e8deee69a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:45.474782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2235d0db-44bd-4cc1-bf5b-534e8deee69a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:45.483909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2235d0db-44bd-4cc1-bf5b-534e8deee69a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:45.485867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2235d0db-44bd-4cc1-bf5b-534e8deee69a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:45.486576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2235d0db-44bd-4cc1-bf5b-534e8deee69a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:45.488365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2235d0db-44bd-4cc1-bf5b-534e8deee69a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:45.489726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2235d0db-44bd-4cc1-bf5b-534e8deee69a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:45.491072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2235d0db-44bd-4cc1-bf5b-534e8deee69a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:45.839245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2235d0db-44bd-4cc1-bf5b-534e8deee69a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:45.864313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:45.872724 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2235d0db-44bd-4cc1-bf5b-534e8deee69a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1314 microversion: 2.1 time: 0.404948 Oct 18 13:31:45.875358 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1865/3525] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:45 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:45.883697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-41144fe6-67bb-48c4-b024-9adb6ce8caab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:45.884417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-41144fe6-67bb-48c4-b024-9adb6ce8caab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:45.913687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41144fe6-67bb-48c4-b024-9adb6ce8caab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:45.915353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41144fe6-67bb-48c4-b024-9adb6ce8caab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:45.917213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41144fe6-67bb-48c4-b024-9adb6ce8caab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:45.918121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41144fe6-67bb-48c4-b024-9adb6ce8caab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:45.919893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41144fe6-67bb-48c4-b024-9adb6ce8caab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:45.920342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41144fe6-67bb-48c4-b024-9adb6ce8caab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:45.984072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-41144fe6-67bb-48c4-b024-9adb6ce8caab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:31:46.136181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f5e70ab1-02ea-4275-ace7-a6a6f216d2fc tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:46.149913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f5e70ab1-02ea-4275-ace7-a6a6f216d2fc tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:46.152567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f5e70ab1-02ea-4275-ace7-a6a6f216d2fc tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:46.152778 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-41144fe6-67bb-48c4-b024-9adb6ce8caab tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "DELETE /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 204 len: 0 microversion: 2.1 time: 0.271843 Oct 18 13:31:46.153463 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1866/3526] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:31:45 2022] DELETE /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:31:46.155097 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f5e70ab1-02ea-4275-ace7-a6a6f216d2fc tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2831 microversion: 2.32 time: 0.943575 Oct 18 13:31:46.158196 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1661/3527] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:31:45 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2831 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:46.163437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6b309498-adf1-452a-92ee-3f5dfb1a5414 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:46.163437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6b309498-adf1-452a-92ee-3f5dfb1a5414 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:46.172826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b309498-adf1-452a-92ee-3f5dfb1a5414 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:46.184019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b309498-adf1-452a-92ee-3f5dfb1a5414 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:46.184019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b309498-adf1-452a-92ee-3f5dfb1a5414 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:46.184019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b309498-adf1-452a-92ee-3f5dfb1a5414 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:46.184019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b309498-adf1-452a-92ee-3f5dfb1a5414 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:46.184019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b309498-adf1-452a-92ee-3f5dfb1a5414 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:46.189050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4141b4dd-62d6-475f-9ece-ae093854df65 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:46.191235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4141b4dd-62d6-475f-9ece-ae093854df65 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:46.199013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4141b4dd-62d6-475f-9ece-ae093854df65 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:46.200474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4141b4dd-62d6-475f-9ece-ae093854df65 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:46.209988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4141b4dd-62d6-475f-9ece-ae093854df65 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:46.211103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4141b4dd-62d6-475f-9ece-ae093854df65 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:46.211737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4141b4dd-62d6-475f-9ece-ae093854df65 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:46.212343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4141b4dd-62d6-475f-9ece-ae093854df65 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:46.460739 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4141b4dd-62d6-475f-9ece-ae093854df65 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.275492 Oct 18 13:31:46.473531 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1662/3528] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 18 13:31:46 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1/os-interface => generated 1832 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:31:46.479405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-62364ff7-1f62-4496-98d4-250aa6b3319b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:46.480354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-62364ff7-1f62-4496-98d4-250aa6b3319b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:46.488016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62364ff7-1f62-4496-98d4-250aa6b3319b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:46.489273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62364ff7-1f62-4496-98d4-250aa6b3319b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:46.490127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62364ff7-1f62-4496-98d4-250aa6b3319b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:46.491283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62364ff7-1f62-4496-98d4-250aa6b3319b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:46.491988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62364ff7-1f62-4496-98d4-250aa6b3319b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:46.492731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62364ff7-1f62-4496-98d4-250aa6b3319b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:46.587606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6b309498-adf1-452a-92ee-3f5dfb1a5414 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:46.598778 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6b309498-adf1-452a-92ee-3f5dfb1a5414 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1320 microversion: 2.1 time: 0.441179 Oct 18 13:31:46.599572 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1867/3529] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:46 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1320 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:46.619237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2060581391", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "ed3d6fb6-bc95-4e0a-9617-ed9ae0b77a43"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:46.701594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] validate_networks() for [('ed3d6fb6-bc95-4e0a-9617-ed9ae0b77a43', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:31:47.414571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-62364ff7-1f62-4496-98d4-250aa6b3319b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:47.435382 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-62364ff7-1f62-4496-98d4-250aa6b3319b tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1676 microversion: 2.1 time: 0.960250 Oct 18 13:31:47.436655 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1663/3530] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:46 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1676 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:47.447071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e7b55c47-5cbd-4d21-965b-5b8749c069a3 req-20d47ec7-2b2d-4b7c-b6eb-fc7d0b701ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edaa1a81-2913-4817-bd63-18ebf8b5fa2b", "name": "network-vif-plugged", "status": "completed", "tag": "773cc058-6f5c-4279-b7fe-03240ae29a1a"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:47.469064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e7b55c47-5cbd-4d21-965b-5b8749c069a3 req-20d47ec7-2b2d-4b7c-b6eb-fc7d0b701ef3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:47.470120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e7b55c47-5cbd-4d21-965b-5b8749c069a3 req-20d47ec7-2b2d-4b7c-b6eb-fc7d0b701ef3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:47.470725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e7b55c47-5cbd-4d21-965b-5b8749c069a3 req-20d47ec7-2b2d-4b7c-b6eb-fc7d0b701ef3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:47.494398 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e7b55c47-5cbd-4d21-965b-5b8749c069a3 req-20d47ec7-2b2d-4b7c-b6eb-fc7d0b701ef3 service nova] Creating event network-vif-plugged:773cc058-6f5c-4279-b7fe-03240ae29a1a for instance edaa1a81-2913-4817-bd63-18ebf8b5fa2b on n-h2-858384-13 Oct 18 13:31:47.501394 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e7b55c47-5cbd-4d21-965b-5b8749c069a3 req-20d47ec7-2b2d-4b7c-b6eb-fc7d0b701ef3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062771 Oct 18 13:31:47.508337 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1664/3531] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:47.547678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bed354c9-5ce6-47f6-922a-efc32c120689 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:47.550980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bed354c9-5ce6-47f6-922a-efc32c120689 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:47.567604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bed354c9-5ce6-47f6-922a-efc32c120689 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:47.568479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bed354c9-5ce6-47f6-922a-efc32c120689 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:47.569608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bed354c9-5ce6-47f6-922a-efc32c120689 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:47.570501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bed354c9-5ce6-47f6-922a-efc32c120689 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:47.571215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bed354c9-5ce6-47f6-922a-efc32c120689 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:47.571953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bed354c9-5ce6-47f6-922a-efc32c120689 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:47.801936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:31:47.802486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:31:47.803087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:31:47.803629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:31:47.804146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:31:47.814018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:47.814825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:47.815792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:47.816846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:47.817577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:47.818375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:47.840387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Getting quotas for project 02171c961e924aa0b2ec216ec3fc2250. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:31:47.848444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Getting quotas for user 3cba0dade9b74a5b9e647244d9f66184 and project 02171c961e924aa0b2ec216ec3fc2250. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:31:47.863691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:31:47.868496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:31:47.947215 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c326426-2696-4e6b-83a1-5a2c38acea47 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.331794 Oct 18 13:31:47.950246 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1868/3532] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:31:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:31:48.256535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d40b76b8-07ec-430e-a537-cf739d70b4e8 req-147c2fda-6a56-422d-9ccd-cc89ed0b1f9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92f317e-f6ee-4eae-a8bd-9f9d3801b675", "tag": "4e6083cb-8b52-4b0b-afb3-2a482f0c1479"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:48.272148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d40b76b8-07ec-430e-a537-cf739d70b4e8 req-147c2fda-6a56-422d-9ccd-cc89ed0b1f9a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:48.272629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d40b76b8-07ec-430e-a537-cf739d70b4e8 req-147c2fda-6a56-422d-9ccd-cc89ed0b1f9a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:48.281702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d40b76b8-07ec-430e-a537-cf739d70b4e8 req-147c2fda-6a56-422d-9ccd-cc89ed0b1f9a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:48.301975 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d40b76b8-07ec-430e-a537-cf739d70b4e8 req-147c2fda-6a56-422d-9ccd-cc89ed0b1f9a service nova] Creating event network-changed:4e6083cb-8b52-4b0b-afb3-2a482f0c1479 for instance a92f317e-f6ee-4eae-a8bd-9f9d3801b675 on n-h2-858384-13 Oct 18 13:31:48.312582 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d40b76b8-07ec-430e-a537-cf739d70b4e8 req-147c2fda-6a56-422d-9ccd-cc89ed0b1f9a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.360711 Oct 18 13:31:48.313458 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1869/3533] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:48.329110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-641c554b-645c-4a1a-becd-cfab605908ce tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:48.330029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-641c554b-645c-4a1a-becd-cfab605908ce tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:48.337283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-641c554b-645c-4a1a-becd-cfab605908ce tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:48.341808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-641c554b-645c-4a1a-becd-cfab605908ce tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:48.342529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-641c554b-645c-4a1a-becd-cfab605908ce tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:48.344652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-641c554b-645c-4a1a-becd-cfab605908ce tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:48.345395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-641c554b-645c-4a1a-becd-cfab605908ce tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:48.346050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-641c554b-645c-4a1a-becd-cfab605908ce tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:48.748751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-641c554b-645c-4a1a-becd-cfab605908ce tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:48.757936 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-641c554b-645c-4a1a-becd-cfab605908ce tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1320 microversion: 2.1 time: 0.440875 Oct 18 13:31:48.761578 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1870/3534] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:48 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1320 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:48.770807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6222c609-2cbc-45e6-9ab1-95fe8a86421c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:48.771347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6222c609-2cbc-45e6-9ab1-95fe8a86421c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:48.783246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6222c609-2cbc-45e6-9ab1-95fe8a86421c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:48.784541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6222c609-2cbc-45e6-9ab1-95fe8a86421c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:48.785270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6222c609-2cbc-45e6-9ab1-95fe8a86421c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:48.787666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6222c609-2cbc-45e6-9ab1-95fe8a86421c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:48.788754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6222c609-2cbc-45e6-9ab1-95fe8a86421c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:48.789542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6222c609-2cbc-45e6-9ab1-95fe8a86421c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:48.806497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bed354c9-5ce6-47f6-922a-efc32c120689 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:48.825042 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bed354c9-5ce6-47f6-922a-efc32c120689 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1314 microversion: 2.1 time: 1.314844 Oct 18 13:31:48.828335 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1665/3535] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:47 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1314 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:48.837084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6235ebeb-7f91-457b-a563-857a364254d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:48.841339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6235ebeb-7f91-457b-a563-857a364254d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:48.859146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6235ebeb-7f91-457b-a563-857a364254d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:48.860407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6235ebeb-7f91-457b-a563-857a364254d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:48.863249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6235ebeb-7f91-457b-a563-857a364254d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:48.864775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6235ebeb-7f91-457b-a563-857a364254d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:48.866674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6235ebeb-7f91-457b-a563-857a364254d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:48.868969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6235ebeb-7f91-457b-a563-857a364254d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:48.981474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6222c609-2cbc-45e6-9ab1-95fe8a86421c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:49.000184 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6222c609-2cbc-45e6-9ab1-95fe8a86421c tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1222 microversion: 2.1 time: 0.237342 Oct 18 13:31:49.000906 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1871/3536] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:48 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1222 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:49.465160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-91571446-755b-47f9-8e07-0ce6854d80ad req-2e1323df-fb01-4404-9041-efd179097c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206ae481-4890-46be-a0eb-83a6f22eb0b6", "name": "network-vif-deleted", "tag": "66a40b29-9fc8-40b9-b9d7-336889430bb8"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:49.496421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-91571446-755b-47f9-8e07-0ce6854d80ad req-2e1323df-fb01-4404-9041-efd179097c6d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:49.506561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-91571446-755b-47f9-8e07-0ce6854d80ad req-2e1323df-fb01-4404-9041-efd179097c6d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:49.509530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-91571446-755b-47f9-8e07-0ce6854d80ad req-2e1323df-fb01-4404-9041-efd179097c6d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:49.544078 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-91571446-755b-47f9-8e07-0ce6854d80ad req-2e1323df-fb01-4404-9041-efd179097c6d service nova] Creating event network-vif-deleted:66a40b29-9fc8-40b9-b9d7-336889430bb8 for instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 on n-h2-858384-13 Oct 18 13:31:49.558536 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-91571446-755b-47f9-8e07-0ce6854d80ad req-2e1323df-fb01-4404-9041-efd179097c6d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098307 Oct 18 13:31:49.566349 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1872/3537] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:49.786365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-72d3eca9-b111-44f7-90fb-9bcc9f1bb08f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:49.787207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-72d3eca9-b111-44f7-90fb-9bcc9f1bb08f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:49.796379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72d3eca9-b111-44f7-90fb-9bcc9f1bb08f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:49.796849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72d3eca9-b111-44f7-90fb-9bcc9f1bb08f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:49.801854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72d3eca9-b111-44f7-90fb-9bcc9f1bb08f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:49.802777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72d3eca9-b111-44f7-90fb-9bcc9f1bb08f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:49.803459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72d3eca9-b111-44f7-90fb-9bcc9f1bb08f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:49.805136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72d3eca9-b111-44f7-90fb-9bcc9f1bb08f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:50.116514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6235ebeb-7f91-457b-a563-857a364254d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:50.131129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-72d3eca9-b111-44f7-90fb-9bcc9f1bb08f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:50.132685 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6235ebeb-7f91-457b-a563-857a364254d1 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1676 microversion: 2.1 time: 1.302434 Oct 18 13:31:50.134195 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1666/3538] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:48 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1676 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:50.139407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-94940875-633f-461a-b94c-ec3bd706e5d9 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:50.140302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-94940875-633f-461a-b94c-ec3bd706e5d9 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:50.148614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94940875-633f-461a-b94c-ec3bd706e5d9 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:50.149534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94940875-633f-461a-b94c-ec3bd706e5d9 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:50.150263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94940875-633f-461a-b94c-ec3bd706e5d9 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:50.151113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94940875-633f-461a-b94c-ec3bd706e5d9 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:50.152056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94940875-633f-461a-b94c-ec3bd706e5d9 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:50.152634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94940875-633f-461a-b94c-ec3bd706e5d9 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:50.169620 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-72d3eca9-b111-44f7-90fb-9bcc9f1bb08f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1320 microversion: 2.1 time: 0.388829 Oct 18 13:31:50.172216 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1873/3539] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:49 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1320 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:50.193502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-645ed908-b462-457b-b3dd-3e5d68fe1bbf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:50.197985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-645ed908-b462-457b-b3dd-3e5d68fe1bbf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:50.219349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-645ed908-b462-457b-b3dd-3e5d68fe1bbf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:50.221260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-645ed908-b462-457b-b3dd-3e5d68fe1bbf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:50.223296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-645ed908-b462-457b-b3dd-3e5d68fe1bbf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:50.225910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-645ed908-b462-457b-b3dd-3e5d68fe1bbf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:50.228629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-645ed908-b462-457b-b3dd-3e5d68fe1bbf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:50.230891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-645ed908-b462-457b-b3dd-3e5d68fe1bbf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:50.339331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-645ed908-b462-457b-b3dd-3e5d68fe1bbf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:50.351991 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-645ed908-b462-457b-b3dd-3e5d68fe1bbf tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1278 microversion: 2.1 time: 0.176241 Oct 18 13:31:50.352861 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1874/3540] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:50 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:50.834286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-21db2f8d-58e0-49b3-8748-35c299935757 req-96b28c18-f0f5-44d7-9dc2-b44139e7ae8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aad90b5-28fb-44b2-89da-33bc1b2889f2", "name": "network-vif-deleted", "tag": "516c3ad3-1e31-4bde-b674-c0c367989f56"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:50.858224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-21db2f8d-58e0-49b3-8748-35c299935757 req-96b28c18-f0f5-44d7-9dc2-b44139e7ae8f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:50.859144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-21db2f8d-58e0-49b3-8748-35c299935757 req-96b28c18-f0f5-44d7-9dc2-b44139e7ae8f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:50.859940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-21db2f8d-58e0-49b3-8748-35c299935757 req-96b28c18-f0f5-44d7-9dc2-b44139e7ae8f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:50.883895 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-21db2f8d-58e0-49b3-8748-35c299935757 req-96b28c18-f0f5-44d7-9dc2-b44139e7ae8f service nova] Creating event network-vif-deleted:516c3ad3-1e31-4bde-b674-c0c367989f56 for instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 on n-h1-858384-13 Oct 18 13:31:50.892861 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-21db2f8d-58e0-49b3-8748-35c299935757 req-96b28c18-f0f5-44d7-9dc2-b44139e7ae8f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061415 Oct 18 13:31:50.895158 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1875/3541] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:51.163162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8f3116a2-8964-44b2-a46f-7a23aee9df9a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:51.165772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8f3116a2-8964-44b2-a46f-7a23aee9df9a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:51.192793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f3116a2-8964-44b2-a46f-7a23aee9df9a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:51.193325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f3116a2-8964-44b2-a46f-7a23aee9df9a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:51.193768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f3116a2-8964-44b2-a46f-7a23aee9df9a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:51.194485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f3116a2-8964-44b2-a46f-7a23aee9df9a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:51.194942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f3116a2-8964-44b2-a46f-7a23aee9df9a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:51.195367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f3116a2-8964-44b2-a46f-7a23aee9df9a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:51.240818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-94940875-633f-461a-b94c-ec3bd706e5d9 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:51.251502 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-94940875-633f-461a-b94c-ec3bd706e5d9 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1314 microversion: 2.1 time: 1.115996 Oct 18 13:31:51.260044 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1667/3542] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:50 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1314 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:51.275170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-26632c14-4b5e-4211-8756-eb5911ec1652 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:51.280068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-26632c14-4b5e-4211-8756-eb5911ec1652 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:51.291375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26632c14-4b5e-4211-8756-eb5911ec1652 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:51.296452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26632c14-4b5e-4211-8756-eb5911ec1652 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:51.301554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26632c14-4b5e-4211-8756-eb5911ec1652 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:51.303990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26632c14-4b5e-4211-8756-eb5911ec1652 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:51.308018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26632c14-4b5e-4211-8756-eb5911ec1652 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:51.309102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26632c14-4b5e-4211-8756-eb5911ec1652 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:51.359991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:51.514433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8f3116a2-8964-44b2-a46f-7a23aee9df9a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878f8de95694fe1a9a17ed27b6ba40b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '452e5b77db474cf9a2b7f6b2abcb6115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:51.526061 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8f3116a2-8964-44b2-a46f-7a23aee9df9a tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 200 len: 1324 microversion: 2.1 time: 0.370263 Oct 18 13:31:51.526926 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1876/3543] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:51 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 1324 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:51.533025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1760fc6-5661-404a-ab66-b0f7b22a68d7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:51.534261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e1760fc6-5661-404a-ab66-b0f7b22a68d7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:51.541146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1760fc6-5661-404a-ab66-b0f7b22a68d7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:51.541935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1760fc6-5661-404a-ab66-b0f7b22a68d7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:51.542750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1760fc6-5661-404a-ab66-b0f7b22a68d7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:51.543723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1760fc6-5661-404a-ab66-b0f7b22a68d7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:51.544413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1760fc6-5661-404a-ab66-b0f7b22a68d7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:51.545057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1760fc6-5661-404a-ab66-b0f7b22a68d7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:51.652429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e1760fc6-5661-404a-ab66-b0f7b22a68d7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:51.664817 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e1760fc6-5661-404a-ab66-b0f7b22a68d7 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1276 microversion: 2.1 time: 0.136303 Oct 18 13:31:51.666219 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1877/3544] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:51 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:52.280981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3bc33255-a274-4aef-9783-b092d9103ecb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:52.282635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3bc33255-a274-4aef-9783-b092d9103ecb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:52.295762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bc33255-a274-4aef-9783-b092d9103ecb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:52.303093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bc33255-a274-4aef-9783-b092d9103ecb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:52.303546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bc33255-a274-4aef-9783-b092d9103ecb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:52.304316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bc33255-a274-4aef-9783-b092d9103ecb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:52.304779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bc33255-a274-4aef-9783-b092d9103ecb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:52.305303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bc33255-a274-4aef-9783-b092d9103ecb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:52.581170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3bc33255-a274-4aef-9783-b092d9103ecb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:52.591704 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3bc33255-a274-4aef-9783-b092d9103ecb tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1314 microversion: 2.1 time: 0.312392 Oct 18 13:31:52.592426 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1878/3545] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:52 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:52.604715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5674785f-1c37-477f-95ed-76e6689cfe07 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:52.605711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5674785f-1c37-477f-95ed-76e6689cfe07 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] [instance: 9aad90b5-28fb-44b2-89da-33bc1b2889f2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:52.612893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5674785f-1c37-477f-95ed-76e6689cfe07 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:52.613639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5674785f-1c37-477f-95ed-76e6689cfe07 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:52.614300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5674785f-1c37-477f-95ed-76e6689cfe07 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:52.615386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5674785f-1c37-477f-95ed-76e6689cfe07 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:52.616018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5674785f-1c37-477f-95ed-76e6689cfe07 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:52.616820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5674785f-1c37-477f-95ed-76e6689cfe07 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:52.633624 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-5674785f-1c37-477f-95ed-76e6689cfe07 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] HTTP exception thrown: Instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 could not be found. Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5674785f-1c37-477f-95ed-76e6689cfe07 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Request method failure captured: Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 HTTP/1.1 Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqgSyOovjkBwC2zDG9FKchsa-85pvviPiRczs79e9ogA2WOflaKqo4WjkGNjiwWrTbKQeMF0qFdRR97LgwpYjvL7_VWxucAaxUZM-ArWvxecTGdyg6CEOtjVVE0a_ifjjfGSQqXSLBM0YxminaTsZoLWFl2mIOYtfxpGTzdnzLBn-rI Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 452e5b77db474cf9a2b7f6b2abcb6115 Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/452e5b77db474cf9a2b7f6b2abcb6115"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_452e5b77db474cf9a2b7f6b2abcb6115"}]}] Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 452e5b77db474cf9a2b7f6b2abcb6115 Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerActionsTestJSON-330379010 Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerActionsTestJSON-330379010-project Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 2878f8de95694fe1a9a17ed27b6ba40b Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerActionsTestJSON-330379010-project Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 could not be found. Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '9aad90b5-28fb-44b2-89da-33bc1b2889f2'} Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 could not be found. Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 could not be found. Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:31:52.635712 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:52.640756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:31:52.640756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:31:52.640756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:31:52.640756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:31:52.640756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:31:52.640756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 could not be found. Oct 18 13:31:52.640756 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:31:52.644916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5674785f-1c37-477f-95ed-76e6689cfe07 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Returning 404 to user: Instance 9aad90b5-28fb-44b2-89da-33bc1b2889f2 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:31:52.646354 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5674785f-1c37-477f-95ed-76e6689cfe07 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2" status: 404 len: 111 microversion: 2.1 time: 0.052161 Oct 18 13:31:52.647549 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1879/3546] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:52 2022] GET /compute/v2.1/servers/9aad90b5-28fb-44b2-89da-33bc1b2889f2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:31:52.656199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b5646263-306f-4316-bbf3-5f632b6bca01 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] Calling method '.version_select at 0x7ff60ebe70d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:52.686643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:52.713912 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b5646263-306f-4316-bbf3-5f632b6bca01 tempest-ServerActionsTestJSON-330379010 tempest-ServerActionsTestJSON-330379010-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554421635" status: 202 len: 0 microversion: 2.1 time: 0.061187 Oct 18 13:31:52.716071 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1880/3547] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:31:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554421635 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:31:52.729673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5857fd1c-8b61-48b7-a325-7befd40a6461 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:52.731757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5857fd1c-8b61-48b7-a325-7befd40a6461 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:52.769506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5857fd1c-8b61-48b7-a325-7befd40a6461 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:52.771531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5857fd1c-8b61-48b7-a325-7befd40a6461 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:52.772209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5857fd1c-8b61-48b7-a325-7befd40a6461 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:52.773457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5857fd1c-8b61-48b7-a325-7befd40a6461 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:52.778073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5857fd1c-8b61-48b7-a325-7befd40a6461 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:52.784087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5857fd1c-8b61-48b7-a325-7befd40a6461 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:52.919423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-26632c14-4b5e-4211-8756-eb5911ec1652 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:52.933259 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-26632c14-4b5e-4211-8756-eb5911ec1652 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1320 microversion: 2.1 time: 1.671166 Oct 18 13:31:52.954273 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1668/3548] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:51 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1320 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:53.303437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5857fd1c-8b61-48b7-a325-7befd40a6461 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:53.318536 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5857fd1c-8b61-48b7-a325-7befd40a6461 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1318 microversion: 2.1 time: 0.601042 Oct 18 13:31:53.319907 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1881/3549] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:52 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1318 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:53.493469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-72ab0e1b-6899-4e83-81a9-1708036a86c1 req-7a3ef4d6-e6f4-42a7-a978-e285ce71fe62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "tag": "8f544790-5930-4353-bbad-e9bb309d7d6c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:53.517490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-72ab0e1b-6899-4e83-81a9-1708036a86c1 req-7a3ef4d6-e6f4-42a7-a978-e285ce71fe62 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:53.524086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-72ab0e1b-6899-4e83-81a9-1708036a86c1 req-7a3ef4d6-e6f4-42a7-a978-e285ce71fe62 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:53.524652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-72ab0e1b-6899-4e83-81a9-1708036a86c1 req-7a3ef4d6-e6f4-42a7-a978-e285ce71fe62 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:53.598367 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-72ab0e1b-6899-4e83-81a9-1708036a86c1 req-7a3ef4d6-e6f4-42a7-a978-e285ce71fe62 service nova] Creating event network-changed:8f544790-5930-4353-bbad-e9bb309d7d6c for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:31:53.615862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-035db6cb-0487-4e5f-81ae-c776e3ca5db4 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:53.617774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-035db6cb-0487-4e5f-81ae-c776e3ca5db4 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:53.631646 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-72ab0e1b-6899-4e83-81a9-1708036a86c1 req-7a3ef4d6-e6f4-42a7-a978-e285ce71fe62 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150012 Oct 18 13:31:53.636032 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1669/3550] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:53.638255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-035db6cb-0487-4e5f-81ae-c776e3ca5db4 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:53.640549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-035db6cb-0487-4e5f-81ae-c776e3ca5db4 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:53.645783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-035db6cb-0487-4e5f-81ae-c776e3ca5db4 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:53.650728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-035db6cb-0487-4e5f-81ae-c776e3ca5db4 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:53.675259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-035db6cb-0487-4e5f-81ae-c776e3ca5db4 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:53.675849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-035db6cb-0487-4e5f-81ae-c776e3ca5db4 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:53.961483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b9c9ec35-3477-4bd7-a963-ced3a99d6578 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:53.962383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b9c9ec35-3477-4bd7-a963-ced3a99d6578 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:53.982188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9c9ec35-3477-4bd7-a963-ced3a99d6578 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:53.982607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9c9ec35-3477-4bd7-a963-ced3a99d6578 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:53.986866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9c9ec35-3477-4bd7-a963-ced3a99d6578 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:53.990966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9c9ec35-3477-4bd7-a963-ced3a99d6578 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:53.991629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9c9ec35-3477-4bd7-a963-ced3a99d6578 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:53.995079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9c9ec35-3477-4bd7-a963-ced3a99d6578 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:54.535996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b9c9ec35-3477-4bd7-a963-ced3a99d6578 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:54.552397 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b9c9ec35-3477-4bd7-a963-ced3a99d6578 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1320 microversion: 2.1 time: 0.595505 Oct 18 13:31:54.567945 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1670/3551] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:53 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1320 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:54.573080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b32e3fe0-d999-44c3-a022-48f112be78bd tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:54.573881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b32e3fe0-d999-44c3-a022-48f112be78bd tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:54.584168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b32e3fe0-d999-44c3-a022-48f112be78bd tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:54.585037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b32e3fe0-d999-44c3-a022-48f112be78bd tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:54.585802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b32e3fe0-d999-44c3-a022-48f112be78bd tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:54.586917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b32e3fe0-d999-44c3-a022-48f112be78bd tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:54.587623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b32e3fe0-d999-44c3-a022-48f112be78bd tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:54.588268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b32e3fe0-d999-44c3-a022-48f112be78bd tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:55.133132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b32e3fe0-d999-44c3-a022-48f112be78bd tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:55.142238 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b32e3fe0-d999-44c3-a022-48f112be78bd tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1318 microversion: 2.1 time: 0.572979 Oct 18 13:31:55.149870 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1671/3552] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:54 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:55.457147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-035db6cb-0487-4e5f-81ae-c776e3ca5db4 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:55.474224 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-035db6cb-0487-4e5f-81ae-c776e3ca5db4 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1314 microversion: 2.1 time: 1.862144 Oct 18 13:31:55.479337 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1882/3553] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:53 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1314 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:55.579746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d60d2b43-a3e9-4319-9b88-34c908e1195c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:55.580699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d60d2b43-a3e9-4319-9b88-34c908e1195c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:55.594241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d60d2b43-a3e9-4319-9b88-34c908e1195c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:55.595072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d60d2b43-a3e9-4319-9b88-34c908e1195c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:55.597131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d60d2b43-a3e9-4319-9b88-34c908e1195c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:55.598191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d60d2b43-a3e9-4319-9b88-34c908e1195c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:55.601005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d60d2b43-a3e9-4319-9b88-34c908e1195c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:55.601817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d60d2b43-a3e9-4319-9b88-34c908e1195c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:55.690821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6e263c97-f964-4382-ac1b-6a8caa9db1c4 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Action: 'create', calling method: .version_select at 0x7ff60f07a670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1115679307", "description": "tempest-description-922048927"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:56.331403 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6e263c97-f964-4382-ac1b-6a8caa9db1c4 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.177637 Oct 18 13:31:56.332303 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1672/3554] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:31:55 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:56.348976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-9aacdb28-c9ae-4491-90b3-5bfa7a3cf01f req-b133dc76-e4fe-4ff3-a483-46679bcce724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f081e01-2b0e-402b-99a9-127e4b2a6354", "tag": "f68b4371-64fc-4b8e-a386-808f9859fc60"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:56.375698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9aacdb28-c9ae-4491-90b3-5bfa7a3cf01f req-b133dc76-e4fe-4ff3-a483-46679bcce724 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:56.383122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9aacdb28-c9ae-4491-90b3-5bfa7a3cf01f req-b133dc76-e4fe-4ff3-a483-46679bcce724 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:56.383782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9aacdb28-c9ae-4491-90b3-5bfa7a3cf01f req-b133dc76-e4fe-4ff3-a483-46679bcce724 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:56.414268 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-9aacdb28-c9ae-4491-90b3-5bfa7a3cf01f req-b133dc76-e4fe-4ff3-a483-46679bcce724 service nova] Creating event network-changed:f68b4371-64fc-4b8e-a386-808f9859fc60 for instance 2f081e01-2b0e-402b-99a9-127e4b2a6354 on n-h2-858384-13 Oct 18 13:31:56.431282 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-9aacdb28-c9ae-4491-90b3-5bfa7a3cf01f req-b133dc76-e4fe-4ff3-a483-46679bcce724 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097687 Oct 18 13:31:56.439070 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1673/3555] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:56.584161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d60d2b43-a3e9-4319-9b88-34c908e1195c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:56.598921 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d60d2b43-a3e9-4319-9b88-34c908e1195c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1320 microversion: 2.1 time: 1.023441 Oct 18 13:31:56.614447 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1883/3556] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:55 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1320 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:31:56.628695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ef1f8a48-5501-4ac7-89a6-49dc16de5330 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:56.632950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ef1f8a48-5501-4ac7-89a6-49dc16de5330 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:56.644166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef1f8a48-5501-4ac7-89a6-49dc16de5330 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:56.644669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef1f8a48-5501-4ac7-89a6-49dc16de5330 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:56.645112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef1f8a48-5501-4ac7-89a6-49dc16de5330 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:56.647914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef1f8a48-5501-4ac7-89a6-49dc16de5330 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:56.648393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef1f8a48-5501-4ac7-89a6-49dc16de5330 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:56.651456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef1f8a48-5501-4ac7-89a6-49dc16de5330 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:56.815882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-4c3cf392-4890-4161-9ff8-a2a7feae92fa req-41888ff0-3c0d-4b8e-8eb4-1845391c3f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e8ac53-2c9b-4c4b-b2f9-1d14d996736e", "name": "network-vif-plugged", "status": "completed", "tag": "920fcd55-e944-4969-b916-c77d2230eb02"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:56.837262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4c3cf392-4890-4161-9ff8-a2a7feae92fa req-41888ff0-3c0d-4b8e-8eb4-1845391c3f7f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:56.837770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4c3cf392-4890-4161-9ff8-a2a7feae92fa req-41888ff0-3c0d-4b8e-8eb4-1845391c3f7f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:56.841543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4c3cf392-4890-4161-9ff8-a2a7feae92fa req-41888ff0-3c0d-4b8e-8eb4-1845391c3f7f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:56.886568 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4c3cf392-4890-4161-9ff8-a2a7feae92fa req-41888ff0-3c0d-4b8e-8eb4-1845391c3f7f service nova] Creating event network-vif-plugged:920fcd55-e944-4969-b916-c77d2230eb02 for instance 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e on n-h1-858384-13 Oct 18 13:31:56.899074 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-4c3cf392-4890-4161-9ff8-a2a7feae92fa req-41888ff0-3c0d-4b8e-8eb4-1845391c3f7f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.456295 Oct 18 13:31:56.900016 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1674/3557] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:56.916105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-540a391a-ca15-466f-870a-73fbf27f94d6 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Action: 'create', calling method: .version_select at 0x7ff60f079040>, body: {"security_group_rule": {"parent_group_id": "d8a91ce2-c73a-4922-91c1-1167a3518cc4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:57.384885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ef1f8a48-5501-4ac7-89a6-49dc16de5330 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:57.407354 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ef1f8a48-5501-4ac7-89a6-49dc16de5330 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1318 microversion: 2.1 time: 0.787145 Oct 18 13:31:57.413560 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1884/3558] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:56 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1318 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:57.424052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-866787bc-ff31-4292-b753-7e47100b5667 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:57.436049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-866787bc-ff31-4292-b753-7e47100b5667 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:57.465369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-866787bc-ff31-4292-b753-7e47100b5667 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:57.466917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-866787bc-ff31-4292-b753-7e47100b5667 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:57.467477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-866787bc-ff31-4292-b753-7e47100b5667 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:57.488546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-866787bc-ff31-4292-b753-7e47100b5667 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:57.491281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-866787bc-ff31-4292-b753-7e47100b5667 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:57.491916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-866787bc-ff31-4292-b753-7e47100b5667 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:57.554874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:57.793267 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-540a391a-ca15-466f-870a-73fbf27f94d6 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.884401 Oct 18 13:31:57.796815 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1675/3559] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:31:56 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:57.812727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9de2b0f3-8bb9-4ffc-b730-3c2f1c20b130 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:57.813855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9de2b0f3-8bb9-4ffc-b730-3c2f1c20b130 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:57.825703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9de2b0f3-8bb9-4ffc-b730-3c2f1c20b130 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:57.826447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9de2b0f3-8bb9-4ffc-b730-3c2f1c20b130 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:57.827078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:57.827741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9de2b0f3-8bb9-4ffc-b730-3c2f1c20b130 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:57.828825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9de2b0f3-8bb9-4ffc-b730-3c2f1c20b130 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:57.829567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9de2b0f3-8bb9-4ffc-b730-3c2f1c20b130 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:57.830947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9de2b0f3-8bb9-4ffc-b730-3c2f1c20b130 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:57.856745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:31:58.163311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-866787bc-ff31-4292-b753-7e47100b5667 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:58.192947 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-866787bc-ff31-4292-b753-7e47100b5667 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1314 microversion: 2.1 time: 0.777218 Oct 18 13:31:58.213703 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1885/3560] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:57 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:58.232125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5966fea6-eaf9-4fc5-8cd5-5ff9b8e50397 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Action: 'create', calling method: .version_select at 0x7ff60ebe8dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-781992642", "description": "tempest-description-2010616507"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:58.327361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9de2b0f3-8bb9-4ffc-b730-3c2f1c20b130 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:58.349130 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9de2b0f3-8bb9-4ffc-b730-3c2f1c20b130 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1320 microversion: 2.1 time: 0.550207 Oct 18 13:31:58.351205 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1676/3561] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:57 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1320 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:58.446209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6d080d23-46cd-4297-8036-497bfe3379a3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:58.449509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6d080d23-46cd-4297-8036-497bfe3379a3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:58.460209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d080d23-46cd-4297-8036-497bfe3379a3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:58.460711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d080d23-46cd-4297-8036-497bfe3379a3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:58.461160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d080d23-46cd-4297-8036-497bfe3379a3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:58.462100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d080d23-46cd-4297-8036-497bfe3379a3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:58.462564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d080d23-46cd-4297-8036-497bfe3379a3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:58.462994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d080d23-46cd-4297-8036-497bfe3379a3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:58.782370 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5966fea6-eaf9-4fc5-8cd5-5ff9b8e50397 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.567495 Oct 18 13:31:58.783188 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1886/3562] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:31:58 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:58.798255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ae770d51-c52f-4f59-b8b3-bbd27d3aae7a tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Action: 'create', calling method: .version_select at 0x7ff60ebdf280>, body: {"security_group_rule": {"parent_group_id": "9affc800-28bf-4dcc-9045-d1e951330d28", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:59.571950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6d080d23-46cd-4297-8036-497bfe3379a3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:31:59.584115 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6d080d23-46cd-4297-8036-497bfe3379a3 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1318 microversion: 2.1 time: 1.142758 Oct 18 13:31:59.590617 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1677/3563] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:58 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1318 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:31:59.599888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-eb07bb90-dc93-4e21-9252-9d558ecd175e req-eff0e5f7-d7d3-4b71-94b3-82ff013ed35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92f317e-f6ee-4eae-a8bd-9f9d3801b675", "name": "network-vif-plugged", "status": "completed", "tag": "4e6083cb-8b52-4b0b-afb3-2a482f0c1479"}, {"server_uuid": "b3b7058d-7bdc-4d34-b3e3-fa5be5730997", "name": "network-vif-plugged", "status": "completed", "tag": "521de7e6-06e5-4a89-a9a8-91a43322d930"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:31:59.615867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-eb07bb90-dc93-4e21-9252-9d558ecd175e req-eff0e5f7-d7d3-4b71-94b3-82ff013ed35e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:59.616948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-eb07bb90-dc93-4e21-9252-9d558ecd175e req-eff0e5f7-d7d3-4b71-94b3-82ff013ed35e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:59.617678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-eb07bb90-dc93-4e21-9252-9d558ecd175e req-eff0e5f7-d7d3-4b71-94b3-82ff013ed35e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:59.639418 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-eb07bb90-dc93-4e21-9252-9d558ecd175e req-eff0e5f7-d7d3-4b71-94b3-82ff013ed35e service nova] Creating event network-vif-plugged:4e6083cb-8b52-4b0b-afb3-2a482f0c1479 for instance a92f317e-f6ee-4eae-a8bd-9f9d3801b675 on n-h2-858384-13 Oct 18 13:31:59.640301 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-eb07bb90-dc93-4e21-9252-9d558ecd175e req-eff0e5f7-d7d3-4b71-94b3-82ff013ed35e service nova] Creating event network-vif-plugged:521de7e6-06e5-4a89-a9a8-91a43322d930 for instance b3b7058d-7bdc-4d34-b3e3-fa5be5730997 on n-h1-858384-13 Oct 18 13:31:59.650709 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-eb07bb90-dc93-4e21-9252-9d558ecd175e req-eff0e5f7-d7d3-4b71-94b3-82ff013ed35e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058423 Oct 18 13:31:59.656871 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1678/3564] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:59.663568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-acdde29b-2971-4c14-a2c2-2d54c3fcb155 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:59.664586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-acdde29b-2971-4c14-a2c2-2d54c3fcb155 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:59.673315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acdde29b-2971-4c14-a2c2-2d54c3fcb155 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:59.674084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acdde29b-2971-4c14-a2c2-2d54c3fcb155 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:59.674861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acdde29b-2971-4c14-a2c2-2d54c3fcb155 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:59.675787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acdde29b-2971-4c14-a2c2-2d54c3fcb155 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:59.676420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acdde29b-2971-4c14-a2c2-2d54c3fcb155 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:59.677207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acdde29b-2971-4c14-a2c2-2d54c3fcb155 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:59.731005 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ae770d51-c52f-4f59-b8b3-bbd27d3aae7a tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.937822 Oct 18 13:31:59.733603 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1887/3565] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:31:58 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:31:59.742957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8ff0175c-422d-493c-85e3-172cefdf8af7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:31:59.744889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8ff0175c-422d-493c-85e3-172cefdf8af7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:31:59.799908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff0175c-422d-493c-85e3-172cefdf8af7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:59.801253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff0175c-422d-493c-85e3-172cefdf8af7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:59.801720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff0175c-422d-493c-85e3-172cefdf8af7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:31:59.804637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff0175c-422d-493c-85e3-172cefdf8af7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:31:59.805626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff0175c-422d-493c-85e3-172cefdf8af7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:31:59.806087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff0175c-422d-493c-85e3-172cefdf8af7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:00.294436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-acdde29b-2971-4c14-a2c2-2d54c3fcb155 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:00.316481 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-acdde29b-2971-4c14-a2c2-2d54c3fcb155 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1314 microversion: 2.1 time: 0.654433 Oct 18 13:32:00.331382 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1679/3566] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:59 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:00.333519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8ff0175c-422d-493c-85e3-172cefdf8af7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:00.348413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-637a102d-4e51-4e59-92b3-24a594857c9f tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Action: 'create', calling method: .version_select at 0x7ff60ee37ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-257754237", "description": "tempest-description-1452177746"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:00.370958 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8ff0175c-422d-493c-85e3-172cefdf8af7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1512 microversion: 2.1 time: 0.634811 Oct 18 13:32:00.374909 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1888/3567] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:31:59 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1512 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:00.410898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b3c17846-7153-494c-8d00-c9bd734ac388 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:00.412837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b3c17846-7153-494c-8d00-c9bd734ac388 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:00.431388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3c17846-7153-494c-8d00-c9bd734ac388 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:00.436574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3c17846-7153-494c-8d00-c9bd734ac388 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:00.438263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3c17846-7153-494c-8d00-c9bd734ac388 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:00.443723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3c17846-7153-494c-8d00-c9bd734ac388 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:00.446851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3c17846-7153-494c-8d00-c9bd734ac388 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:00.448430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3c17846-7153-494c-8d00-c9bd734ac388 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:01.033082 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-637a102d-4e51-4e59-92b3-24a594857c9f tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.699681 Oct 18 13:32:01.035759 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1680/3568] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:32:00 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:01.050787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-04eec729-f06d-4857-8d4b-ddba4597fc74 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:01.051907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-04eec729-f06d-4857-8d4b-ddba4597fc74 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:01.061146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04eec729-f06d-4857-8d4b-ddba4597fc74 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:01.062267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04eec729-f06d-4857-8d4b-ddba4597fc74 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:01.062992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04eec729-f06d-4857-8d4b-ddba4597fc74 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:01.064534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04eec729-f06d-4857-8d4b-ddba4597fc74 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:01.066544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04eec729-f06d-4857-8d4b-ddba4597fc74 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:01.067160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04eec729-f06d-4857-8d4b-ddba4597fc74 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:01.120890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b3c17846-7153-494c-8d00-c9bd734ac388 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:01.135141 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b3c17846-7153-494c-8d00-c9bd734ac388 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1512 microversion: 2.1 time: 0.739233 Oct 18 13:32:01.136375 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1889/3569] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:00 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1512 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:01.164603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ff4de215-4a98-4ea6-bff8-b8d9a9157262 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Action: 'create', calling method: .version_select at 0x7ff60ebdfee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-875874977", "description": "tempest-description-1711128412"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:01.471299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-04eec729-f06d-4857-8d4b-ddba4597fc74 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:01.494453 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-04eec729-f06d-4857-8d4b-ddba4597fc74 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1318 microversion: 2.1 time: 0.457093 Oct 18 13:32:01.512531 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1681/3570] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:01 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:01.528407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c1f6976e-59e0-4ede-a0be-fffb5d9fd815 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:01.529019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c1f6976e-59e0-4ede-a0be-fffb5d9fd815 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: b3b7058d-7bdc-4d34-b3e3-fa5be5730997] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:01.537294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1f6976e-59e0-4ede-a0be-fffb5d9fd815 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:01.539225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1f6976e-59e0-4ede-a0be-fffb5d9fd815 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:01.539849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1f6976e-59e0-4ede-a0be-fffb5d9fd815 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:01.540737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1f6976e-59e0-4ede-a0be-fffb5d9fd815 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:01.541385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1f6976e-59e0-4ede-a0be-fffb5d9fd815 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:01.541972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1f6976e-59e0-4ede-a0be-fffb5d9fd815 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:01.564442 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ff4de215-4a98-4ea6-bff8-b8d9a9157262 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.403793 Oct 18 13:32:01.566275 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1890/3571] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:32:01 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:01.585565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f20836b0-c701-4d6b-84c9-52aabf3a7116 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:01.589776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f20836b0-c701-4d6b-84c9-52aabf3a7116 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:01.604757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f20836b0-c701-4d6b-84c9-52aabf3a7116 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:01.605275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f20836b0-c701-4d6b-84c9-52aabf3a7116 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:01.605712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f20836b0-c701-4d6b-84c9-52aabf3a7116 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:01.606507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f20836b0-c701-4d6b-84c9-52aabf3a7116 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:01.609421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f20836b0-c701-4d6b-84c9-52aabf3a7116 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:01.611251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f20836b0-c701-4d6b-84c9-52aabf3a7116 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:01.960880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f20836b0-c701-4d6b-84c9-52aabf3a7116 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:01.969688 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f20836b0-c701-4d6b-84c9-52aabf3a7116 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1314 microversion: 2.1 time: 0.398014 Oct 18 13:32:01.972418 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1891/3572] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:01 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:01.988368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-160f767f-4a9b-487c-b24f-bc6f1c1e2a59 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Action: 'create', calling method: .version_select at 0x7ff60ebdef70>, body: {"security_group_rule": {"parent_group_id": "0f086053-4e0a-4c03-b1d2-2ed6972ccd3e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "682b9428-f567-4e9b-956a-17fe5b7b723a"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:02.015562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c1f6976e-59e0-4ede-a0be-fffb5d9fd815 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:02.036083 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c1f6976e-59e0-4ede-a0be-fffb5d9fd815 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997" status: 200 len: 1321 microversion: 2.1 time: 0.515464 Oct 18 13:32:02.040043 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1682/3573] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:01 2022] GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997 => generated 1321 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:02.527204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41c9ee17-9abd-4275-8c99-28c8c33d4c44 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:02.528734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-41c9ee17-9abd-4275-8c99-28c8c33d4c44 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:02.542063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41c9ee17-9abd-4275-8c99-28c8c33d4c44 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:02.542756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41c9ee17-9abd-4275-8c99-28c8c33d4c44 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:02.543358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41c9ee17-9abd-4275-8c99-28c8c33d4c44 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:02.544245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41c9ee17-9abd-4275-8c99-28c8c33d4c44 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:02.545348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41c9ee17-9abd-4275-8c99-28c8c33d4c44 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:02.545937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41c9ee17-9abd-4275-8c99-28c8c33d4c44 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:02.681011 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-160f767f-4a9b-487c-b24f-bc6f1c1e2a59 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.707472 Oct 18 13:32:02.682221 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1892/3574] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:32:01 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:02.699246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1ba50cb-783e-4173-9cf1-6de5bcf8c974 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Action: 'create', calling method: .version_select at 0x7ff60ebe81f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1982575502", "description": "tempest-description-328209810"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:03.046709 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e1ba50cb-783e-4173-9cf1-6de5bcf8c974 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.350985 Oct 18 13:32:03.056273 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1893/3575] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:32:02 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:03.061863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-11ea0ec1-40e5-4231-beff-a2015215f19d tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:03.062498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-11ea0ec1-40e5-4231-beff-a2015215f19d tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:03.076271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11ea0ec1-40e5-4231-beff-a2015215f19d tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:03.076773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11ea0ec1-40e5-4231-beff-a2015215f19d tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:03.077246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11ea0ec1-40e5-4231-beff-a2015215f19d tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:03.077985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11ea0ec1-40e5-4231-beff-a2015215f19d tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:03.078434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11ea0ec1-40e5-4231-beff-a2015215f19d tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:03.078864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11ea0ec1-40e5-4231-beff-a2015215f19d tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:03.407292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-11ea0ec1-40e5-4231-beff-a2015215f19d tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:03.419848 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-11ea0ec1-40e5-4231-beff-a2015215f19d tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1464 microversion: 2.1 time: 0.362329 Oct 18 13:32:03.420627 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1894/3576] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:03 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1464 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:03.433457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-75af8a42-5e9b-4aa6-99cf-e7f127c1b191 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Action: 'create', calling method: .version_select at 0x7ff60eeca430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1762212074", "description": "tempest-description-385499000"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:03.506473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-41c9ee17-9abd-4275-8c99-28c8c33d4c44 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:03.517806 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-41c9ee17-9abd-4275-8c99-28c8c33d4c44 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1318 microversion: 2.1 time: 0.995914 Oct 18 13:32:03.521615 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1683/3577] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:02 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1318 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:03.524981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-353e3803-7659-4cc0-86d5-0cd597c8d44f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:03.525805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-353e3803-7659-4cc0-86d5-0cd597c8d44f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: b3b7058d-7bdc-4d34-b3e3-fa5be5730997] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:03.535986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-353e3803-7659-4cc0-86d5-0cd597c8d44f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:03.537427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-353e3803-7659-4cc0-86d5-0cd597c8d44f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:03.538833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-353e3803-7659-4cc0-86d5-0cd597c8d44f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:03.539725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-353e3803-7659-4cc0-86d5-0cd597c8d44f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:03.540363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-353e3803-7659-4cc0-86d5-0cd597c8d44f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:03.542309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-353e3803-7659-4cc0-86d5-0cd597c8d44f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:03.665545 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-75af8a42-5e9b-4aa6-99cf-e7f127c1b191 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.241225 Oct 18 13:32:03.672605 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1895/3578] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:32:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:03.677316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-b801c871-484f-4981-80a2-b385ea6378af req-76369b17-65d2-4d8a-8994-0d23b82f19da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f081e01-2b0e-402b-99a9-127e4b2a6354", "name": "network-vif-plugged", "status": "completed", "tag": "f68b4371-64fc-4b8e-a386-808f9859fc60"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:03.690573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b801c871-484f-4981-80a2-b385ea6378af req-76369b17-65d2-4d8a-8994-0d23b82f19da service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:03.691204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b801c871-484f-4981-80a2-b385ea6378af req-76369b17-65d2-4d8a-8994-0d23b82f19da service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:03.691555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b801c871-484f-4981-80a2-b385ea6378af req-76369b17-65d2-4d8a-8994-0d23b82f19da service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:03.703665 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-b801c871-484f-4981-80a2-b385ea6378af req-76369b17-65d2-4d8a-8994-0d23b82f19da service nova] Creating event network-vif-plugged:f68b4371-64fc-4b8e-a386-808f9859fc60 for instance 2f081e01-2b0e-402b-99a9-127e4b2a6354 on n-h2-858384-13 Oct 18 13:32:03.709557 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-b801c871-484f-4981-80a2-b385ea6378af req-76369b17-65d2-4d8a-8994-0d23b82f19da service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041852 Oct 18 13:32:03.710197 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1896/3579] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:03.952591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e26b189e-d8ce-4f6e-bb22-c315bd7010d0 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Calling method '.version_select at 0x7ff60ebdedc0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:03.969319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e26b189e-d8ce-4f6e-bb22-c315bd7010d0 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:03.970532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e26b189e-d8ce-4f6e-bb22-c315bd7010d0 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:03.972104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e26b189e-d8ce-4f6e-bb22-c315bd7010d0 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.000877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e26b189e-d8ce-4f6e-bb22-c315bd7010d0 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.001881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e26b189e-d8ce-4f6e-bb22-c315bd7010d0 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.003637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e26b189e-d8ce-4f6e-bb22-c315bd7010d0 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.033878 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e26b189e-d8ce-4f6e-bb22-c315bd7010d0 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/459877b552184a8eb2674bb504eb7aae?start=2022-10-17T13%3A32%3A03.437911&end=2022-10-19T13%3A32%3A03.437911" status: 200 len: 695 microversion: 2.1 time: 0.321934 Oct 18 13:32:04.035099 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1897/3580] 10.222.0.40 () {58 vars in 1412 bytes} [Tue Oct 18 13:32:03 2022] GET /compute/v2.1/os-simple-tenant-usage/459877b552184a8eb2674bb504eb7aae?start=2022-10-17T13%3A32%3A03.437911&end=2022-10-19T13%3A32%3A03.437911 => generated 695 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:04.040729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cba56e63-b797-4492-86f5-c15d96d29b5e tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Action: 'create', calling method: .version_select at 0x7ff60ebe8280>, body: {"security_group_rule": {"parent_group_id": "fbd35e55-b203-4fab-a32f-6bb87d1507ce", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ea27cb50-7ef9-4c44-8aac-b387cacc5132"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:04.055496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-353e3803-7659-4cc0-86d5-0cd597c8d44f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:04.064355 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-353e3803-7659-4cc0-86d5-0cd597c8d44f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997" status: 200 len: 1513 microversion: 2.1 time: 0.543960 Oct 18 13:32:04.066409 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1684/3581] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:03 2022] GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997 => generated 1513 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:04.077662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8a5f30b1-45e8-4217-a3d1-2177b4128524 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '.version_select at 0x7ff60feeb8b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:04.106376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:04.108573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a5f30b1-45e8-4217-a3d1-2177b4128524 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.109908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a5f30b1-45e8-4217-a3d1-2177b4128524 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.110725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a5f30b1-45e8-4217-a3d1-2177b4128524 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.133198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a5f30b1-45e8-4217-a3d1-2177b4128524 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.133692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a5f30b1-45e8-4217-a3d1-2177b4128524 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.134402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a5f30b1-45e8-4217-a3d1-2177b4128524 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.155030 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8a5f30b1-45e8-4217-a3d1-2177b4128524 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/459877b552184a8eb2674bb504eb7aae?start=2022-10-17T13%3A32%3A03.437911&end=2022-10-19T13%3A32%3A03.437911" status: 200 len: 695 microversion: 2.1 time: 0.087361 Oct 18 13:32:04.156235 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1685/3582] 10.222.0.40 () {58 vars in 1412 bytes} [Tue Oct 18 13:32:04 2022] GET /compute/v2.1/os-simple-tenant-usage/459877b552184a8eb2674bb504eb7aae?start=2022-10-17T13%3A32%3A03.437911&end=2022-10-19T13%3A32%3A03.437911 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:04.162001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:04.167157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:04.168170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:04.181695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.182187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.182626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.183348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.184056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.184479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.296025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:04.411288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:04.419561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.421014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.421730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.762169 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e68fdc6a-cc15-455e-b197-9affa96f24f3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.604670 Oct 18 13:32:04.762765 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1686/3583] 10.222.0.40 () {58 vars in 1167 bytes} [Tue Oct 18 13:32:04 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:04.767445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7ff0e15-c2ed-4151-a81d-26d0f77caf36 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Calling method '.version_select at 0x7ff60ecc1ee0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:04.791457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7ff0e15-c2ed-4151-a81d-26d0f77caf36 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.792195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7ff0e15-c2ed-4151-a81d-26d0f77caf36 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.792791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7ff0e15-c2ed-4151-a81d-26d0f77caf36 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:04.828175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7ff0e15-c2ed-4151-a81d-26d0f77caf36 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:04.828861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7ff0e15-c2ed-4151-a81d-26d0f77caf36 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:04.829570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7ff0e15-c2ed-4151-a81d-26d0f77caf36 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.066989 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f7ff0e15-c2ed-4151-a81d-26d0f77caf36 tempest-TenantUsagesTestJSON-582931075 tempest-TenantUsagesTestJSON-582931075-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T13%3A32%3A03.437911&end=2022-10-19T13%3A32%3A03.437911&detailed=1" status: 200 len: 39639 microversion: 2.1 time: 0.302852 Oct 18 13:32:05.068086 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1687/3584] 10.222.0.40 () {58 vars in 1335 bytes} [Tue Oct 18 13:32:04 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-17T13%3A32%3A03.437911&end=2022-10-19T13%3A32%3A03.437911&detailed=1 => generated 39639 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:32:05.073645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d480f597-f8c3-4761-8cae-2e6957653c83 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:05.074259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d480f597-f8c3-4761-8cae-2e6957653c83 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:05.080906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d480f597-f8c3-4761-8cae-2e6957653c83 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.081623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d480f597-f8c3-4761-8cae-2e6957653c83 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.082238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d480f597-f8c3-4761-8cae-2e6957653c83 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.083126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d480f597-f8c3-4761-8cae-2e6957653c83 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.083763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d480f597-f8c3-4761-8cae-2e6957653c83 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.084355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d480f597-f8c3-4761-8cae-2e6957653c83 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.117080 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cba56e63-b797-4492-86f5-c15d96d29b5e tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.080363 Oct 18 13:32:05.118370 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1898/3585] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:32:04 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:05.135237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:05.144290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:05.145996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2064527317', 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:05.161766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.165063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.165728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.166578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.167025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.169817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.323211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:05.399016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d480f597-f8c3-4761-8cae-2e6957653c83 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:05.421606 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d480f597-f8c3-4761-8cae-2e6957653c83 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1508 microversion: 2.1 time: 0.349950 Oct 18 13:32:05.423887 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1688/3586] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:05 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:05.442071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6fe31dcc-92f1-40fa-830c-e9cadb8451b3 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:05.442620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6fe31dcc-92f1-40fa-830c-e9cadb8451b3 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:05.456127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fe31dcc-92f1-40fa-830c-e9cadb8451b3 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.456613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fe31dcc-92f1-40fa-830c-e9cadb8451b3 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.457045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fe31dcc-92f1-40fa-830c-e9cadb8451b3 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.457779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fe31dcc-92f1-40fa-830c-e9cadb8451b3 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.459583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fe31dcc-92f1-40fa-830c-e9cadb8451b3 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.460075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fe31dcc-92f1-40fa-830c-e9cadb8451b3 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.466549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:05.478711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.482288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.482950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.530927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6fe31dcc-92f1-40fa-830c-e9cadb8451b3 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:32:05.613467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:05.665855 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6fe31dcc-92f1-40fa-830c-e9cadb8451b3 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 204 len: 0 microversion: 2.1 time: 0.240431 Oct 18 13:32:05.666610 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1689/3587] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:32:05 2022] DELETE /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:32:05.673798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-21b7713a-b1af-4be6-917b-4c0f15b0edab tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Calling method '.version_select at 0x7ff60f6ce8b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:05.771863 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b693322e-e3d6-48dd-bf99-c7092737a140 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2064527317" status: 200 len: 1515 microversion: 2.1 time: 0.652317 Oct 18 13:32:05.781569 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1899/3588] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:32:05 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2064527317 => generated 1515 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:05.797090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb242497-8eb0-40df-8432-9e2bebd199a8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:05.801250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cb242497-8eb0-40df-8432-9e2bebd199a8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:05.823521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb242497-8eb0-40df-8432-9e2bebd199a8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.824164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb242497-8eb0-40df-8432-9e2bebd199a8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.824676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb242497-8eb0-40df-8432-9e2bebd199a8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:05.825523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb242497-8eb0-40df-8432-9e2bebd199a8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:05.826830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb242497-8eb0-40df-8432-9e2bebd199a8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:05.827521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb242497-8eb0-40df-8432-9e2bebd199a8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.068995 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-21b7713a-b1af-4be6-917b-4c0f15b0edab tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/ea27cb50-7ef9-4c44-8aac-b387cacc5132" status: 202 len: 0 microversion: 2.1 time: 0.400716 Oct 18 13:32:06.070344 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1690/3589] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:05 2022] DELETE /compute/v2.1/os-security-groups/ea27cb50-7ef9-4c44-8aac-b387cacc5132 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:06.076242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6e404b8c-0bf0-4c91-8b7b-4a9d9456c187 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:06.077278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6e404b8c-0bf0-4c91-8b7b-4a9d9456c187 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:06.086079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e404b8c-0bf0-4c91-8b7b-4a9d9456c187 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.086857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e404b8c-0bf0-4c91-8b7b-4a9d9456c187 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.087522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e404b8c-0bf0-4c91-8b7b-4a9d9456c187 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.088431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e404b8c-0bf0-4c91-8b7b-4a9d9456c187 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.089077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e404b8c-0bf0-4c91-8b7b-4a9d9456c187 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.089841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e404b8c-0bf0-4c91-8b7b-4a9d9456c187 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.199109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cb242497-8eb0-40df-8432-9e2bebd199a8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:06.219939 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cb242497-8eb0-40df-8432-9e2bebd199a8 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1508 microversion: 2.1 time: 0.435437 Oct 18 13:32:06.223134 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1900/3590] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:05 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1508 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:06.228593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:06.236196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:06.238061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:06.244210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.244916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.246652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.248127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.248593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.249093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.344581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6e404b8c-0bf0-4c91-8b7b-4a9d9456c187 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:06.356791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:06.360278 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6e404b8c-0bf0-4c91-8b7b-4a9d9456c187 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1470 microversion: 2.1 time: 0.288470 Oct 18 13:32:06.362137 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1691/3591] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:06 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1470 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:06.371513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aa4e3f31-e4a5-4a81-97f2-7520727797e5 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Calling method '.version_select at 0x7ff60efaa790>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:06.472727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:06.481939 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aa4e3f31-e4a5-4a81-97f2-7520727797e5 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/fbd35e55-b203-4fab-a32f-6bb87d1507ce" status: 200 len: 247 microversion: 2.1 time: 0.116906 Oct 18 13:32:06.482853 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1692/3592] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:32:06 2022] GET /compute/v2.1/os-security-groups/fbd35e55-b203-4fab-a32f-6bb87d1507ce => generated 247 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:06.492075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e185ff4e-4ac6-4025-8d56-532873c19520 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:06.492315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.492572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.493925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.508611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e185ff4e-4ac6-4025-8d56-532873c19520 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:06.519952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e185ff4e-4ac6-4025-8d56-532873c19520 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.520749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e185ff4e-4ac6-4025-8d56-532873c19520 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.521455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e185ff4e-4ac6-4025-8d56-532873c19520 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.522410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e185ff4e-4ac6-4025-8d56-532873c19520 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.523109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e185ff4e-4ac6-4025-8d56-532873c19520 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.523727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e185ff4e-4ac6-4025-8d56-532873c19520 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.619687 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e185ff4e-4ac6-4025-8d56-532873c19520 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "PUT /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1080 microversion: 2.1 time: 0.133370 Oct 18 13:32:06.620645 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1693/3593] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 18 13:32:06 2022] PUT /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1080 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:06.659474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-da5dbc77-ed09-4455-b1e8-02535ffa8aaa tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Action: 'create', calling method: .version_select at 0x7ff60efdf670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-164567516", "description": "tempest-description-1833774715"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:06.765555 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8f886eb4-b0e7-4a64-a020-cc70771034bf tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.540690 Oct 18 13:32:06.770009 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1901/3594] 10.222.0.40 () {58 vars in 1173 bytes} [Tue Oct 18 13:32:06 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:06.778904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5757e3be-510e-4eb1-986c-ebe87ea3c1b0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:06.779518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5757e3be-510e-4eb1-986c-ebe87ea3c1b0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:06.789474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5757e3be-510e-4eb1-986c-ebe87ea3c1b0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.790369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5757e3be-510e-4eb1-986c-ebe87ea3c1b0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.790982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5757e3be-510e-4eb1-986c-ebe87ea3c1b0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.791929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5757e3be-510e-4eb1-986c-ebe87ea3c1b0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:06.792544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5757e3be-510e-4eb1-986c-ebe87ea3c1b0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:06.793299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5757e3be-510e-4eb1-986c-ebe87ea3c1b0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:06.991993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5757e3be-510e-4eb1-986c-ebe87ea3c1b0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:07.001284 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5757e3be-510e-4eb1-986c-ebe87ea3c1b0 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1506 microversion: 2.1 time: 0.226583 Oct 18 13:32:07.016456 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1902/3595] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:06 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:07.028685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:07.034854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:07.035668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.compute.servers [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Removing options 'limit' from query {{(pid=120611) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 13:32:07.036883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:07.042702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:07.043516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:07.044165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.045118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:07.045847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:07.046707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.060217 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-da5dbc77-ed09-4455-b1e8-02535ffa8aaa tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.421321 Oct 18 13:32:07.061045 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1694/3596] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:32:06 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:07.067663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1c376bc7-3e10-44c6-8517-ecf069166f72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:07.069223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1c376bc7-3e10-44c6-8517-ecf069166f72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:07.097422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c376bc7-3e10-44c6-8517-ecf069166f72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:07.099794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c376bc7-3e10-44c6-8517-ecf069166f72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:07.100301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c376bc7-3e10-44c6-8517-ecf069166f72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.109364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c376bc7-3e10-44c6-8517-ecf069166f72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:07.109364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c376bc7-3e10-44c6-8517-ecf069166f72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:07.109364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c376bc7-3e10-44c6-8517-ecf069166f72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.144357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:07.152937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:07.153444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:07.153876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.429225 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-610bb4a6-330b-4b52-9e21-a70b8900b124 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.408424 Oct 18 13:32:07.439174 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1903/3597] 10.222.0.40 () {58 vars in 1161 bytes} [Tue Oct 18 13:32:07 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:07.446498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4a531429-df03-47c2-bf6c-b1b8f5c39345 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Action: 'create', calling method: .version_select at 0x7ff60eca2dc0>, body: {"security_group_rule": {"parent_group_id": "f471fdc5-f20c-45cc-85c0-84ceb0727a45", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:07.460166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1c376bc7-3e10-44c6-8517-ecf069166f72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:07.480652 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1c376bc7-3e10-44c6-8517-ecf069166f72 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1506 microversion: 2.1 time: 0.416838 Oct 18 13:32:07.481604 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1695/3598] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:07 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:07.489124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8f7ba2c1-cc2b-41ce-bbf4-a51f076dcb69 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:07.490097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8f7ba2c1-cc2b-41ce-bbf4-a51f076dcb69 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:07.516110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f7ba2c1-cc2b-41ce-bbf4-a51f076dcb69 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:07.518766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f7ba2c1-cc2b-41ce-bbf4-a51f076dcb69 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:07.521289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f7ba2c1-cc2b-41ce-bbf4-a51f076dcb69 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.525140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f7ba2c1-cc2b-41ce-bbf4-a51f076dcb69 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:07.525906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f7ba2c1-cc2b-41ce-bbf4-a51f076dcb69 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:07.526703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f7ba2c1-cc2b-41ce-bbf4-a51f076dcb69 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.819531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8f7ba2c1-cc2b-41ce-bbf4-a51f076dcb69 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67aa27c9e39a422985e3d32520aea9f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459877b552184a8eb2674bb504eb7aae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:07.841589 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8f7ba2c1-cc2b-41ce-bbf4-a51f076dcb69 tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 200 len: 1470 microversion: 2.1 time: 0.356628 Oct 18 13:32:07.855338 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1696/3599] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:07 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 1470 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:07.855338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3611d7c4-d2e8-4a1a-8be9-f1c61ec8475f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:07.865222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3611d7c4-d2e8-4a1a-8be9-f1c61ec8475f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:07.866110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3611d7c4-d2e8-4a1a-8be9-f1c61ec8475f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:07.873890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3611d7c4-d2e8-4a1a-8be9-f1c61ec8475f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:07.874652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3611d7c4-d2e8-4a1a-8be9-f1c61ec8475f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:07.875424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3611d7c4-d2e8-4a1a-8be9-f1c61ec8475f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.876337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3611d7c4-d2e8-4a1a-8be9-f1c61ec8475f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:07.877545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3611d7c4-d2e8-4a1a-8be9-f1c61ec8475f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:07.879044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3611d7c4-d2e8-4a1a-8be9-f1c61ec8475f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:07.976376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-3611d7c4-d2e8-4a1a-8be9-f1c61ec8475f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:08.025442 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3611d7c4-d2e8-4a1a-8be9-f1c61ec8475f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.179923 Oct 18 13:32:08.026535 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1697/3600] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:32:07 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:08.036982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d9a2c703-acb5-4393-82bd-d5a11b323593 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:08.040022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d9a2c703-acb5-4393-82bd-d5a11b323593 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:08.050329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9a2c703-acb5-4393-82bd-d5a11b323593 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.052335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9a2c703-acb5-4393-82bd-d5a11b323593 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.052956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9a2c703-acb5-4393-82bd-d5a11b323593 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.054040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9a2c703-acb5-4393-82bd-d5a11b323593 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.054665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9a2c703-acb5-4393-82bd-d5a11b323593 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.055283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9a2c703-acb5-4393-82bd-d5a11b323593 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.125330 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4a531429-df03-47c2-bf6c-b1b8f5c39345 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.684402 Oct 18 13:32:08.126032 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1904/3601] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:32:07 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:08.127714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4a531429-df03-47c2-bf6c-b1b8f5c39345 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:08.128728 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4a531429-df03-47c2-bf6c-b1b8f5c39345 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001810 Oct 18 13:32:08.129161 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1905/3602] 10.222.0.40 () {56 vars in 886 bytes} [Tue Oct 18 13:32:08 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 13:32:08.134752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:08.180977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:08.181952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.compute.servers [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Removing options 'limit' from query {{(pid=120611) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 13:32:08.183283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:08.200146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.200765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.201343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.202832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.203948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.204497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.211106 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d9a2c703-acb5-4393-82bd-d5a11b323593 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "PUT /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1082 microversion: 2.1 time: 0.182987 Oct 18 13:32:08.221227 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1698/3603] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 18 13:32:08 2022] PUT /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1082 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:08.232876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9090e2a3-c285-4360-8dea-da06b25177cd tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Action: 'create', calling method: .version_select at 0x7ff60f6ceb80>, body: {"security_group_rule": {"parent_group_id": "f471fdc5-f20c-45cc-85c0-84ceb0727a45", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:08.296659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:08.353227 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.222877 Oct 18 13:32:08.354149 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1906/3604] 10.222.0.40 () {58 vars in 1150 bytes} [Tue Oct 18 13:32:08 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:08.356305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:08.357454 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6c94e59d-b3f9-4d48-a943-19f629038f99 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001746 Oct 18 13:32:08.358200 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1907/3605] 10.222.0.40 () {54 vars in 1035 bytes} [Tue Oct 18 13:32:08 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 18 13:32:08.364169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-23f30aa2-9f4d-4714-ac3e-211dbbe7575c req-957ce0d2-7512-4058-941e-66d114f89992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92f317e-f6ee-4eae-a8bd-9f9d3801b675", "name": "network-vif-deleted", "tag": "4e6083cb-8b52-4b0b-afb3-2a482f0c1479"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:08.376221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-23f30aa2-9f4d-4714-ac3e-211dbbe7575c req-957ce0d2-7512-4058-941e-66d114f89992 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.376752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-23f30aa2-9f4d-4714-ac3e-211dbbe7575c req-957ce0d2-7512-4058-941e-66d114f89992 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.377780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-23f30aa2-9f4d-4714-ac3e-211dbbe7575c req-957ce0d2-7512-4058-941e-66d114f89992 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.393731 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-23f30aa2-9f4d-4714-ac3e-211dbbe7575c req-957ce0d2-7512-4058-941e-66d114f89992 service nova] Creating event network-vif-deleted:4e6083cb-8b52-4b0b-afb3-2a482f0c1479 for instance a92f317e-f6ee-4eae-a8bd-9f9d3801b675 on n-h2-858384-13 Oct 18 13:32:08.402662 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-23f30aa2-9f4d-4714-ac3e-211dbbe7575c req-957ce0d2-7512-4058-941e-66d114f89992 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043024 Oct 18 13:32:08.408912 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1908/3606] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:08.414621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a8e901c7-56ff-49d0-b356-89e05ab66411 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:08.415332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a8e901c7-56ff-49d0-b356-89e05ab66411 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:08.422641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8e901c7-56ff-49d0-b356-89e05ab66411 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.423055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8e901c7-56ff-49d0-b356-89e05ab66411 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.423492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8e901c7-56ff-49d0-b356-89e05ab66411 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.424800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8e901c7-56ff-49d0-b356-89e05ab66411 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.425284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8e901c7-56ff-49d0-b356-89e05ab66411 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.425709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8e901c7-56ff-49d0-b356-89e05ab66411 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.610228 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9090e2a3-c285-4360-8dea-da06b25177cd tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.381306 Oct 18 13:32:08.618672 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1699/3607] 10.222.0.40 () {60 vars in 1195 bytes} [Tue Oct 18 13:32:08 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:08.625521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-04ae09a3-5ec2-470b-91fa-62d41e9d33ec tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:08.630936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-04ae09a3-5ec2-470b-91fa-62d41e9d33ec tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:08.631732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-04ae09a3-5ec2-470b-91fa-62d41e9d33ec tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:08.648758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04ae09a3-5ec2-470b-91fa-62d41e9d33ec tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.653473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04ae09a3-5ec2-470b-91fa-62d41e9d33ec tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.653968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04ae09a3-5ec2-470b-91fa-62d41e9d33ec tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.654343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a8e901c7-56ff-49d0-b356-89e05ab66411 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:08.654843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04ae09a3-5ec2-470b-91fa-62d41e9d33ec tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.655179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04ae09a3-5ec2-470b-91fa-62d41e9d33ec tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.663613 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a8e901c7-56ff-49d0-b356-89e05ab66411 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1508 microversion: 2.1 time: 0.253287 Oct 18 13:32:08.665090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04ae09a3-5ec2-470b-91fa-62d41e9d33ec tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.666768 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1909/3608] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:08 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:08.668856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a8e901c7-56ff-49d0-b356-89e05ab66411 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:08.670081 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a8e901c7-56ff-49d0-b356-89e05ab66411 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002218 Oct 18 13:32:08.670671 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1910/3609] 10.222.0.40 () {54 vars in 1041 bytes} [Tue Oct 18 13:32:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:08.676874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-465af6c9-79cf-49e1-ad18-070402b8dee4 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Calling method '.version_select at 0x7ff60ea4de50>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:08.722195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-04ae09a3-5ec2-470b-91fa-62d41e9d33ec tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:08.782482 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-04ae09a3-5ec2-470b-91fa-62d41e9d33ec tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.161649 Oct 18 13:32:08.784106 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1700/3610] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 13:32:08 2022] GET /compute/v2.1/servers => generated 1011 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:08.785162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-04ae09a3-5ec2-470b-91fa-62d41e9d33ec tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:08.786125 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-04ae09a3-5ec2-470b-91fa-62d41e9d33ec tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001233 Oct 18 13:32:08.786627 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1701/3611] 10.222.0.40 () {56 vars in 886 bytes} [Tue Oct 18 13:32:08 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 13:32:08.801214 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-465af6c9-79cf-49e1-ad18-070402b8dee4 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/f471fdc5-f20c-45cc-85c0-84ceb0727a45" status: 200 len: 664 microversion: 2.1 time: 0.118055 Oct 18 13:32:08.801214 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1911/3612] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:32:08 2022] GET /compute/v2.1/os-security-groups/f471fdc5-f20c-45cc-85c0-84ceb0727a45 => generated 664 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:08.801214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6eb28d3a-a70d-435e-a6c4-d339caa77bd7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:08.804672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9e884db2-6539-4ba9-ba63-b01a61776a3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:08.806026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9e884db2-6539-4ba9-ba63-b01a61776a3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:08.813419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e884db2-6539-4ba9-ba63-b01a61776a3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.814214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e884db2-6539-4ba9-ba63-b01a61776a3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.815395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e884db2-6539-4ba9-ba63-b01a61776a3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.816362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e884db2-6539-4ba9-ba63-b01a61776a3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.817033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e884db2-6539-4ba9-ba63-b01a61776a3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.817865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e884db2-6539-4ba9-ba63-b01a61776a3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.818924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6eb28d3a-a70d-435e-a6c4-d339caa77bd7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:08.819733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6eb28d3a-a70d-435e-a6c4-d339caa77bd7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:08.860340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6eb28d3a-a70d-435e-a6c4-d339caa77bd7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.861906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6eb28d3a-a70d-435e-a6c4-d339caa77bd7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.862790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6eb28d3a-a70d-435e-a6c4-d339caa77bd7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.863871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6eb28d3a-a70d-435e-a6c4-d339caa77bd7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:08.864723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6eb28d3a-a70d-435e-a6c4-d339caa77bd7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:08.865520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6eb28d3a-a70d-435e-a6c4-d339caa77bd7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:08.994112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-6eb28d3a-a70d-435e-a6c4-d339caa77bd7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:09.091777 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6eb28d3a-a70d-435e-a6c4-d339caa77bd7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.298260 Oct 18 13:32:09.094056 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1912/3613] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:32:08 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:09.105538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-57df19ed-e47f-42ce-a169-03f57da680c8 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Calling method '.version_select at 0x7ff60ea71430>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:09.361982 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-57df19ed-e47f-42ce-a169-03f57da680c8 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/7e51471a-6a95-4165-9fad-0bbd9cdc80b6" status: 202 len: 0 microversion: 2.1 time: 0.265796 Oct 18 13:32:09.362960 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1913/3614] 10.222.0.40 () {58 vars in 1287 bytes} [Tue Oct 18 13:32:09 2022] DELETE /compute/v2.1/os-security-group-rules/7e51471a-6a95-4165-9fad-0bbd9cdc80b6 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:09.370283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ff356846-c736-43c4-a6ba-1d7fba5d5e9a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:09.371280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ff356846-c736-43c4-a6ba-1d7fba5d5e9a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] [instance: a92f317e-f6ee-4eae-a8bd-9f9d3801b675] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:09.386816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff356846-c736-43c4-a6ba-1d7fba5d5e9a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.387505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff356846-c736-43c4-a6ba-1d7fba5d5e9a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.388127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff356846-c736-43c4-a6ba-1d7fba5d5e9a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.390523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff356846-c736-43c4-a6ba-1d7fba5d5e9a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.391210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff356846-c736-43c4-a6ba-1d7fba5d5e9a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.391842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff356846-c736-43c4-a6ba-1d7fba5d5e9a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.415860 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-ff356846-c736-43c4-a6ba-1d7fba5d5e9a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] HTTP exception thrown: Instance a92f317e-f6ee-4eae-a8bd-9f9d3801b675 could not be found. Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ff356846-c736-43c4-a6ba-1d7fba5d5e9a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Request method failure captured: Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 HTTP/1.1 Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqqwbWSmmJLI2inHGPSqXMYT9iyPecbCp9cUPSXiAjzDUdAneK0rLKek9fM6cZBgrB4kEpznIs8dIcNCHsEex00bGOo_olYmZOAxOJgxHcOyoOa6SDeJ6BpwhYqZGDfLLA_53_IFOq87janNEPPXZez2Rynm54hJov6YPCIQYWSa2bY Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 459877b552184a8eb2674bb504eb7aae Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TenantUsagesTestJSON-473134979 Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/459877b552184a8eb2674bb504eb7aae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/459877b552184a8eb2674bb504eb7aae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/459877b552184a8eb2674bb504eb7aae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_459877b552184a8eb2674bb504eb7aae"}]}] Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TenantUsagesTestJSON-473134979 Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 459877b552184a8eb2674bb504eb7aae Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TenantUsagesTestJSON-473134979 Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TenantUsagesTestJSON-473134979-project Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 67aa27c9e39a422985e3d32520aea9f1 Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TenantUsagesTestJSON-473134979-project Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance a92f317e-f6ee-4eae-a8bd-9f9d3801b675 could not be found. Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'a92f317e-f6ee-4eae-a8bd-9f9d3801b675'} Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92f317e-f6ee-4eae-a8bd-9f9d3801b675 could not be found. Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92f317e-f6ee-4eae-a8bd-9f9d3801b675 could not be found. Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:09.424120 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:09.432679 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:09.432679 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:09.432679 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:09.432679 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:09.432679 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:09.432679 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92f317e-f6ee-4eae-a8bd-9f9d3801b675 could not be found. Oct 18 13:32:09.432679 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:09.432679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ff356846-c736-43c4-a6ba-1d7fba5d5e9a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] Returning 404 to user: Instance a92f317e-f6ee-4eae-a8bd-9f9d3801b675 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:09.432679 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ff356846-c736-43c4-a6ba-1d7fba5d5e9a tempest-TenantUsagesTestJSON-473134979 tempest-TenantUsagesTestJSON-473134979-project] 10.222.0.40 "GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675" status: 404 len: 111 microversion: 2.1 time: 0.063773 Oct 18 13:32:09.432679 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1914/3615] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:09 2022] GET /compute/v2.1/servers/a92f317e-f6ee-4eae-a8bd-9f9d3801b675 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:09.454675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-afc5f9c8-710a-46f9-b48b-b87e5680f092 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:09.465305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-afc5f9c8-710a-46f9-b48b-b87e5680f092 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:09.467102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.compute.servers [None req-afc5f9c8-710a-46f9-b48b-b87e5680f092 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Removing options 'limit' from query {{(pid=120611) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 13:32:09.471306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-afc5f9c8-710a-46f9-b48b-b87e5680f092 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:09.488968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afc5f9c8-710a-46f9-b48b-b87e5680f092 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.489586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afc5f9c8-710a-46f9-b48b-b87e5680f092 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.491310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afc5f9c8-710a-46f9-b48b-b87e5680f092 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.492183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afc5f9c8-710a-46f9-b48b-b87e5680f092 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.493975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afc5f9c8-710a-46f9-b48b-b87e5680f092 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.496145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afc5f9c8-710a-46f9-b48b-b87e5680f092 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.546296 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-afc5f9c8-710a-46f9-b48b-b87e5680f092 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.112992 Oct 18 13:32:09.552368 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1915/3616] 10.222.0.40 () {58 vars in 1140 bytes} [Tue Oct 18 13:32:09 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:09.559320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4bf18549-bf4b-48aa-8d14-836399f5ebe2 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Calling method '.version_select at 0x7ff60ebd0f70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:09.578972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9e884db2-6539-4ba9-ba63-b01a61776a3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:09.593884 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9e884db2-6539-4ba9-ba63-b01a61776a3e tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1508 microversion: 2.1 time: 0.806018 Oct 18 13:32:09.597671 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1702/3617] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:08 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1508 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:09.607054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1c051711-bdf6-49f0-b19c-f586489a2ad5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:09.618172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1c051711-bdf6-49f0-b19c-f586489a2ad5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:09.619576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1c051711-bdf6-49f0-b19c-f586489a2ad5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2064527317', 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:09.626777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c051711-bdf6-49f0-b19c-f586489a2ad5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.628802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c051711-bdf6-49f0-b19c-f586489a2ad5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.629683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c051711-bdf6-49f0-b19c-f586489a2ad5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.630719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c051711-bdf6-49f0-b19c-f586489a2ad5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.631643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c051711-bdf6-49f0-b19c-f586489a2ad5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.632700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c051711-bdf6-49f0-b19c-f586489a2ad5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.759512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-1c051711-bdf6-49f0-b19c-f586489a2ad5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:09.906903 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1c051711-bdf6-49f0-b19c-f586489a2ad5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2064527317" status: 200 len: 346 microversion: 2.1 time: 0.307006 Oct 18 13:32:09.907613 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1703/3618] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 18 13:32:09 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2064527317 => generated 346 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:09.916545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb3a42e3-745d-4831-b542-f619d4cc87ea tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:09.917653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eb3a42e3-745d-4831-b542-f619d4cc87ea tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:09.925859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb3a42e3-745d-4831-b542-f619d4cc87ea tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.927172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb3a42e3-745d-4831-b542-f619d4cc87ea tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.927844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb3a42e3-745d-4831-b542-f619d4cc87ea tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.928782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb3a42e3-745d-4831-b542-f619d4cc87ea tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:09.930673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb3a42e3-745d-4831-b542-f619d4cc87ea tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:09.930876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb3a42e3-745d-4831-b542-f619d4cc87ea tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:09.997421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eb3a42e3-745d-4831-b542-f619d4cc87ea tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:32:10.165823 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eb3a42e3-745d-4831-b542-f619d4cc87ea tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 204 len: 0 microversion: 2.1 time: 0.256306 Oct 18 13:32:10.170612 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1704/3619] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:32:09 2022] DELETE /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:32:10.176073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bf8dcb81-c5ce-4128-9e06-df39630936c5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:10.199007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf8dcb81-c5ce-4128-9e06-df39630936c5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:10.199663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf8dcb81-c5ce-4128-9e06-df39630936c5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:10.200104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf8dcb81-c5ce-4128-9e06-df39630936c5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:10.258561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bf8dcb81-c5ce-4128-9e06-df39630936c5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Going to try to stop instance {{(pid=120612) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:32:10.353991 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bf8dcb81-c5ce-4128-9e06-df39630936c5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "POST /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b/action" status: 202 len: 0 microversion: 2.1 time: 0.181412 Oct 18 13:32:10.356271 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1705/3620] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:32:10 2022] POST /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:10.370818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-210b429d-63d8-4b53-9b47-917f158d5655 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:10.373905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-210b429d-63d8-4b53-9b47-917f158d5655 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:10.390724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-210b429d-63d8-4b53-9b47-917f158d5655 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:10.394035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-210b429d-63d8-4b53-9b47-917f158d5655 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:10.397150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-210b429d-63d8-4b53-9b47-917f158d5655 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:10.398243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-210b429d-63d8-4b53-9b47-917f158d5655 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:10.401889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-210b429d-63d8-4b53-9b47-917f158d5655 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:10.402712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-210b429d-63d8-4b53-9b47-917f158d5655 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:10.431758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:10.438011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-210b429d-63d8-4b53-9b47-917f158d5655 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:32:10.450630 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4bf18549-bf4b-48aa-8d14-836399f5ebe2 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f471fdc5-f20c-45cc-85c0-84ceb0727a45" status: 202 len: 0 microversion: 2.1 time: 0.895731 Oct 18 13:32:10.452067 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1916/3621] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:09 2022] DELETE /compute/v2.1/os-security-groups/f471fdc5-f20c-45cc-85c0-84ceb0727a45 => generated 0 bytes in 899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:10.457853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca968075-e4af-4b7b-93d2-7f4787c88703 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:10.458909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca968075-e4af-4b7b-93d2-7f4787c88703 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:10.479574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca968075-e4af-4b7b-93d2-7f4787c88703 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:10.480688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca968075-e4af-4b7b-93d2-7f4787c88703 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:10.481525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca968075-e4af-4b7b-93d2-7f4787c88703 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:10.482713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca968075-e4af-4b7b-93d2-7f4787c88703 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:10.483392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca968075-e4af-4b7b-93d2-7f4787c88703 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:10.484054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca968075-e4af-4b7b-93d2-7f4787c88703 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:10.493135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:10.494332 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.compute.api [None req-210b429d-63d8-4b53-9b47-917f158d5655 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Instance is already in deleting state, ignoring this request Oct 18 13:32:10.495278 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-210b429d-63d8-4b53-9b47-917f158d5655 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 204 len: 0 microversion: 2.1 time: 0.137739 Oct 18 13:32:10.496504 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1706/3622] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:32:10 2022] DELETE /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:32:10.504457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-670a71b3-7a72-49c9-a0b9-f8a7e3f7dea2 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Calling method '.version_select at 0x7ff60eb51550>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:10.554027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG neutronclient.v2_0.client [None req-670a71b3-7a72-49c9-a0b9-f8a7e3f7dea2 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ea27cb50-7ef9-4c44-8aac-b387cacc5132 does not exist", "detail": ""}} {{(pid=120612) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 18 13:32:10.554653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.security_group_api [None req-670a71b3-7a72-49c9-a0b9-f8a7e3f7dea2 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Neutron security group ea27cb50-7ef9-4c44-8aac-b387cacc5132 not found {{(pid=120612) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 18 13:32:10.555184 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-670a71b3-7a72-49c9-a0b9-f8a7e3f7dea2 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] HTTP exception thrown: Security group ea27cb50-7ef9-4c44-8aac-b387cacc5132 does not exist Oct 18 13:32:10.555184 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-b42aa3f9-f0f5-480c-9f5c-aeee9f6224f2'] Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-670a71b3-7a72-49c9-a0b9-f8a7e3f7dea2 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Request method failure captured: Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-security-groups/ea27cb50-7ef9-4c44-8aac-b387cacc5132 HTTP/1.1 Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqrKqe2lGcgbgeK1X5KaThL8d3E9V0Zmrd-oDYbzVqWySrsIu98pfZqDdj7cWd88H7LGIlVyfTAZNF7XvuV2f8qxXChESMjHQa8u2ePvKC47prFWv55U5-Cn5fY5d5W-vTEfZKRwUZ-XzIRUgHrrVFKFJ_jcUp_wV97ajw7TK0LY3Mk Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 695bf0981c57464a8b347403b019c084 Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1739729323 Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/695bf0981c57464a8b347403b019c084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/695bf0981c57464a8b347403b019c084"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/695bf0981c57464a8b347403b019c084"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_695bf0981c57464a8b347403b019c084"}]}] Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1739729323 Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 695bf0981c57464a8b347403b019c084 Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1739729323 Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-SecurityGroupRulesTestJSON-1739729323-project Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a434c4cbb87e44ccab0561a223689da3 Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1739729323-project Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: exception: Security group ea27cb50-7ef9-4c44-8aac-b387cacc5132 does not exist Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-b42aa3f9-f0f5-480c-9f5c-aeee9f6224f2'] Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'ea27cb50-7ef9-4c44-8aac-b387cacc5132'} Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 18 13:32:10.557532 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ea27cb50-7ef9-4c44-8aac-b387cacc5132 does not exist Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b42aa3f9-f0f5-480c-9f5c-aeee9f6224f2'] Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ea27cb50-7ef9-4c44-8aac-b387cacc5132 does not exist Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b42aa3f9-f0f5-480c-9f5c-aeee9f6224f2'] Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ea27cb50-7ef9-4c44-8aac-b387cacc5132 does not exist Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b42aa3f9-f0f5-480c-9f5c-aeee9f6224f2'] Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ea27cb50-7ef9-4c44-8aac-b387cacc5132 does not exist Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b42aa3f9-f0f5-480c-9f5c-aeee9f6224f2'] Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-670a71b3-7a72-49c9-a0b9-f8a7e3f7dea2 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Returning 404 to user: Security group ea27cb50-7ef9-4c44-8aac-b387cacc5132 does not exist Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: Neutron server returns request_ids: ['req-b42aa3f9-f0f5-480c-9f5c-aeee9f6224f2'] {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-670a71b3-7a72-49c9-a0b9-f8a7e3f7dea2 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/ea27cb50-7ef9-4c44-8aac-b387cacc5132" status: 404 len: 194 microversion: 2.1 time: 0.061387 Oct 18 13:32:10.562149 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1707/3623] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:10 2022] DELETE /compute/v2.1/os-security-groups/ea27cb50-7ef9-4c44-8aac-b387cacc5132 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:10.565898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb692806-227c-43e8-ad7a-281c4e899911 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:10.566965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eb692806-227c-43e8-ad7a-281c4e899911 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:10.591084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb692806-227c-43e8-ad7a-281c4e899911 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:10.596311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb692806-227c-43e8-ad7a-281c4e899911 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:10.596861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb692806-227c-43e8-ad7a-281c4e899911 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:10.597643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb692806-227c-43e8-ad7a-281c4e899911 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:10.598729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb692806-227c-43e8-ad7a-281c4e899911 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:10.599158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb692806-227c-43e8-ad7a-281c4e899911 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:10.805973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eb692806-227c-43e8-ad7a-281c4e899911 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:10.818007 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eb692806-227c-43e8-ad7a-281c4e899911 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1514 microversion: 2.1 time: 0.256659 Oct 18 13:32:10.819251 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1708/3624] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:10 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:10.824683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fa4cfbb1-b1a9-4bc2-a809-b8ced29fe47a tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Calling method '.version_select at 0x7ff60eb51a60>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:10.994711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ca968075-e4af-4b7b-93d2-7f4787c88703 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:11.008778 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca968075-e4af-4b7b-93d2-7f4787c88703 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1522 microversion: 2.1 time: 0.554956 Oct 18 13:32:11.010336 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1917/3625] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:10 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:11.168787 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fa4cfbb1-b1a9-4bc2-a809-b8ced29fe47a tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/fbd35e55-b203-4fab-a32f-6bb87d1507ce" status: 202 len: 0 microversion: 2.1 time: 0.348049 Oct 18 13:32:11.172855 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1709/3626] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:10 2022] DELETE /compute/v2.1/os-security-groups/fbd35e55-b203-4fab-a32f-6bb87d1507ce => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:11.179687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-be7fc4bb-a898-45f6-a8fb-4186118fc748 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Calling method '.version_select at 0x7ff60eca5dc0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:11.861097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-763e3f5a-b75d-4ba0-9963-286444dbe7dc tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:11.863451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-763e3f5a-b75d-4ba0-9963-286444dbe7dc tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:11.879449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-763e3f5a-b75d-4ba0-9963-286444dbe7dc tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:11.882020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-763e3f5a-b75d-4ba0-9963-286444dbe7dc tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:11.882728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-763e3f5a-b75d-4ba0-9963-286444dbe7dc tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:11.884680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-763e3f5a-b75d-4ba0-9963-286444dbe7dc tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:11.885555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-763e3f5a-b75d-4ba0-9963-286444dbe7dc tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:11.886358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-763e3f5a-b75d-4ba0-9963-286444dbe7dc tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:12.230295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-763e3f5a-b75d-4ba0-9963-286444dbe7dc tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:12.247771 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-763e3f5a-b75d-4ba0-9963-286444dbe7dc tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1514 microversion: 2.1 time: 0.407111 Oct 18 13:32:12.253621 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1710/3627] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:11 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1514 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:12.259200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-94c88e4a-ca57-48cb-a8ef-6ebf2ec50a7c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:12.260145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-94c88e4a-ca57-48cb-a8ef-6ebf2ec50a7c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:12.296630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94c88e4a-ca57-48cb-a8ef-6ebf2ec50a7c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:12.297207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94c88e4a-ca57-48cb-a8ef-6ebf2ec50a7c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:12.297760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94c88e4a-ca57-48cb-a8ef-6ebf2ec50a7c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:12.302060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94c88e4a-ca57-48cb-a8ef-6ebf2ec50a7c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:12.302624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94c88e4a-ca57-48cb-a8ef-6ebf2ec50a7c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:12.303396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94c88e4a-ca57-48cb-a8ef-6ebf2ec50a7c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:12.713241 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-be7fc4bb-a898-45f6-a8fb-4186118fc748 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/682b9428-f567-4e9b-956a-17fe5b7b723a" status: 202 len: 0 microversion: 2.1 time: 1.538198 Oct 18 13:32:12.716111 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1918/3628] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:11 2022] DELETE /compute/v2.1/os-security-groups/682b9428-f567-4e9b-956a-17fe5b7b723a => generated 0 bytes in 1542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:12.732309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-35f08d97-06b0-4942-8596-d855057d8be3 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Calling method '.version_select at 0x7ff60ea4d3a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:12.868142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-94c88e4a-ca57-48cb-a8ef-6ebf2ec50a7c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:12.885498 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-94c88e4a-ca57-48cb-a8ef-6ebf2ec50a7c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1522 microversion: 2.1 time: 0.630382 Oct 18 13:32:12.886081 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1711/3629] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:12 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1522 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:13.277213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0424670a-51cf-4f2a-b24a-ed521c621bfe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:13.277778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0424670a-51cf-4f2a-b24a-ed521c621bfe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:13.290788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0424670a-51cf-4f2a-b24a-ed521c621bfe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:13.291518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0424670a-51cf-4f2a-b24a-ed521c621bfe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:13.292111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0424670a-51cf-4f2a-b24a-ed521c621bfe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:13.294634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0424670a-51cf-4f2a-b24a-ed521c621bfe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:13.295300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0424670a-51cf-4f2a-b24a-ed521c621bfe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:13.303426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0424670a-51cf-4f2a-b24a-ed521c621bfe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:13.502515 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-35f08d97-06b0-4942-8596-d855057d8be3 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/0f086053-4e0a-4c03-b1d2-2ed6972ccd3e" status: 202 len: 0 microversion: 2.1 time: 0.783627 Oct 18 13:32:13.507388 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1919/3630] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:12 2022] DELETE /compute/v2.1/os-security-groups/0f086053-4e0a-4c03-b1d2-2ed6972ccd3e => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:13.512840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7dcac7cb-72df-46d6-84ac-455c1069dacd req-e9249b63-fc3b-44ce-94f9-3aa6226119a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f081e01-2b0e-402b-99a9-127e4b2a6354", "name": "network-vif-deleted", "tag": "f68b4371-64fc-4b8e-a386-808f9859fc60"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:13.527966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7dcac7cb-72df-46d6-84ac-455c1069dacd req-e9249b63-fc3b-44ce-94f9-3aa6226119a1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:13.528875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7dcac7cb-72df-46d6-84ac-455c1069dacd req-e9249b63-fc3b-44ce-94f9-3aa6226119a1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:13.529885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7dcac7cb-72df-46d6-84ac-455c1069dacd req-e9249b63-fc3b-44ce-94f9-3aa6226119a1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:13.552494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0424670a-51cf-4f2a-b24a-ed521c621bfe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cba0dade9b74a5b9e647244d9f66184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02171c961e924aa0b2ec216ec3fc2250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:13.563323 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7dcac7cb-72df-46d6-84ac-455c1069dacd req-e9249b63-fc3b-44ce-94f9-3aa6226119a1 service nova] Creating event network-vif-deleted:f68b4371-64fc-4b8e-a386-808f9859fc60 for instance 2f081e01-2b0e-402b-99a9-127e4b2a6354 on n-h2-858384-13 Oct 18 13:32:13.566909 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0424670a-51cf-4f2a-b24a-ed521c621bfe tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 200 len: 1472 microversion: 2.1 time: 0.295526 Oct 18 13:32:13.569646 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1712/3631] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:13 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:13.575768 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7dcac7cb-72df-46d6-84ac-455c1069dacd req-e9249b63-fc3b-44ce-94f9-3aa6226119a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066972 Oct 18 13:32:13.576723 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1920/3632] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:13.594509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ac96753b-6f59-444e-91a0-ad6ada029260 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Calling method '.version_select at 0x7ff617b69160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:13.914234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c2642a9-2a25-4865-867f-1b36868eb784 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:13.915752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2c2642a9-2a25-4865-867f-1b36868eb784 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:13.923916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c2642a9-2a25-4865-867f-1b36868eb784 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:13.924473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c2642a9-2a25-4865-867f-1b36868eb784 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:13.924935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c2642a9-2a25-4865-867f-1b36868eb784 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:13.926103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c2642a9-2a25-4865-867f-1b36868eb784 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:13.927062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c2642a9-2a25-4865-867f-1b36868eb784 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:13.927661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c2642a9-2a25-4865-867f-1b36868eb784 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.406569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:14.427863 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ac96753b-6f59-444e-91a0-ad6ada029260 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/9affc800-28bf-4dcc-9045-d1e951330d28" status: 202 len: 0 microversion: 2.1 time: 0.856880 Oct 18 13:32:14.428476 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1713/3633] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:13 2022] DELETE /compute/v2.1/os-security-groups/9affc800-28bf-4dcc-9045-d1e951330d28 => generated 0 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:14.436464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7249e3dc-ba8c-4571-8b7e-0b8c6ebd3597 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] Calling method '.version_select at 0x7ff617b5c160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:14.738232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2c2642a9-2a25-4865-867f-1b36868eb784 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:14.747619 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2c2642a9-2a25-4865-867f-1b36868eb784 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1522 microversion: 2.1 time: 0.837635 Oct 18 13:32:14.748204 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1921/3634] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:13 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1522 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:14.753697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2315b595-60ec-4bc3-9286-3287685d5552 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:14.754543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2315b595-60ec-4bc3-9286-3287685d5552 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 2f081e01-2b0e-402b-99a9-127e4b2a6354] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:14.770640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2315b595-60ec-4bc3-9286-3287685d5552 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.771121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2315b595-60ec-4bc3-9286-3287685d5552 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.772926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2315b595-60ec-4bc3-9286-3287685d5552 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.774070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2315b595-60ec-4bc3-9286-3287685d5552 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.774539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2315b595-60ec-4bc3-9286-3287685d5552 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.776063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2315b595-60ec-4bc3-9286-3287685d5552 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.803919 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-2315b595-60ec-4bc3-9286-3287685d5552 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] HTTP exception thrown: Instance 2f081e01-2b0e-402b-99a9-127e4b2a6354 could not be found. Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2315b595-60ec-4bc3-9286-3287685d5552 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Request method failure captured: Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 HTTP/1.1 Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqpDLsSNWFRosYVlNrucBq7ewHMWr9NG_ZYPE9SnO_Vde8eCe-rdLyKAXB49PKMt2f3X-vhzZ6oaQytZ4BV2vXK1cXBAR6unSrHOILsSt2lvnbrTRbRNYuU6YDka02Eb7nqC60fMaBQLritv0WUC3ak17q1Xie94085jDIEc01FULEY Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 02171c961e924aa0b2ec216ec3fc2250 Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_02171c961e924aa0b2ec216ec3fc2250"}]}] Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 02171c961e924aa0b2ec216ec3fc2250 Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerDiskConfigTestJSON-970291395-project Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3cba0dade9b74a5b9e647244d9f66184 Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerDiskConfigTestJSON-970291395-project Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 2f081e01-2b0e-402b-99a9-127e4b2a6354 could not be found. Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '2f081e01-2b0e-402b-99a9-127e4b2a6354'} Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f081e01-2b0e-402b-99a9-127e4b2a6354 could not be found. Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f081e01-2b0e-402b-99a9-127e4b2a6354 could not be found. Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:14.805856 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.811499 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:14.811499 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:14.811499 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:14.811499 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:14.811499 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:14.811499 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f081e01-2b0e-402b-99a9-127e4b2a6354 could not be found. Oct 18 13:32:14.811499 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.813684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2315b595-60ec-4bc3-9286-3287685d5552 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Returning 404 to user: Instance 2f081e01-2b0e-402b-99a9-127e4b2a6354 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:14.815077 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2315b595-60ec-4bc3-9286-3287685d5552 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354" status: 404 len: 111 microversion: 2.1 time: 0.065039 Oct 18 13:32:14.821268 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1922/3635] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:14 2022] GET /compute/v2.1/servers/2f081e01-2b0e-402b-99a9-127e4b2a6354 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:14.827672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-be8f2d10-b4d2-48d8-b59e-8518dbcdb310 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:14.828188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-be8f2d10-b4d2-48d8-b59e-8518dbcdb310 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:14.838578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be8f2d10-b4d2-48d8-b59e-8518dbcdb310 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.839076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be8f2d10-b4d2-48d8-b59e-8518dbcdb310 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.839986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be8f2d10-b4d2-48d8-b59e-8518dbcdb310 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.842100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be8f2d10-b4d2-48d8-b59e-8518dbcdb310 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.842588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be8f2d10-b4d2-48d8-b59e-8518dbcdb310 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.843202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be8f2d10-b4d2-48d8-b59e-8518dbcdb310 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.864879 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-be8f2d10-b4d2-48d8-b59e-8518dbcdb310 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] HTTP exception thrown: Instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 could not be found. Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-be8f2d10-b4d2-48d8-b59e-8518dbcdb310 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Request method failure captured: Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 HTTP/1.1 Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqpDLsSNWFRosYVlNrucBq7ewHMWr9NG_ZYPE9SnO_Vde8eCe-rdLyKAXB49PKMt2f3X-vhzZ6oaQytZ4BV2vXK1cXBAR6unSrHOILsSt2lvnbrTRbRNYuU6YDka02Eb7nqC60fMaBQLritv0WUC3ak17q1Xie94085jDIEc01FULEY Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 02171c961e924aa0b2ec216ec3fc2250 Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_02171c961e924aa0b2ec216ec3fc2250"}]}] Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 02171c961e924aa0b2ec216ec3fc2250 Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerDiskConfigTestJSON-970291395-project Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3cba0dade9b74a5b9e647244d9f66184 Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerDiskConfigTestJSON-970291395-project Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 could not be found. Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '206ae481-4890-46be-a0eb-83a6f22eb0b6'} Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 could not be found. Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:14.866524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 could not be found. Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 could not be found. Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-be8f2d10-b4d2-48d8-b59e-8518dbcdb310 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Returning 404 to user: Instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-be8f2d10-b4d2-48d8-b59e-8518dbcdb310 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "DELETE /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 404 len: 111 microversion: 2.1 time: 0.045449 Oct 18 13:32:14.871475 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1923/3636] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:32:14 2022] DELETE /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:14.878168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0b8d2e8a-9801-4aa4-851b-86caa6ef9029 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:14.878874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0b8d2e8a-9801-4aa4-851b-86caa6ef9029 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 206ae481-4890-46be-a0eb-83a6f22eb0b6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:14.886823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b8d2e8a-9801-4aa4-851b-86caa6ef9029 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.887134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b8d2e8a-9801-4aa4-851b-86caa6ef9029 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.887762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b8d2e8a-9801-4aa4-851b-86caa6ef9029 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.888552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b8d2e8a-9801-4aa4-851b-86caa6ef9029 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.889087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b8d2e8a-9801-4aa4-851b-86caa6ef9029 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.889640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b8d2e8a-9801-4aa4-851b-86caa6ef9029 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.905041 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-0b8d2e8a-9801-4aa4-851b-86caa6ef9029 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] HTTP exception thrown: Instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 could not be found. Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0b8d2e8a-9801-4aa4-851b-86caa6ef9029 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Request method failure captured: Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 HTTP/1.1 Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqpDLsSNWFRosYVlNrucBq7ewHMWr9NG_ZYPE9SnO_Vde8eCe-rdLyKAXB49PKMt2f3X-vhzZ6oaQytZ4BV2vXK1cXBAR6unSrHOILsSt2lvnbrTRbRNYuU6YDka02Eb7nqC60fMaBQLritv0WUC3ak17q1Xie94085jDIEc01FULEY Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 02171c961e924aa0b2ec216ec3fc2250 Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_02171c961e924aa0b2ec216ec3fc2250"}]}] Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 02171c961e924aa0b2ec216ec3fc2250 Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerDiskConfigTestJSON-970291395-project Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3cba0dade9b74a5b9e647244d9f66184 Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerDiskConfigTestJSON-970291395-project Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 could not be found. Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '206ae481-4890-46be-a0eb-83a6f22eb0b6'} Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 could not be found. Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 could not be found. Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:14.906635 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.912034 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:14.912034 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:14.912034 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:14.912034 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:14.912034 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:14.912034 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 could not be found. Oct 18 13:32:14.912034 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.912034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0b8d2e8a-9801-4aa4-851b-86caa6ef9029 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Returning 404 to user: Instance 206ae481-4890-46be-a0eb-83a6f22eb0b6 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:14.912034 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0b8d2e8a-9801-4aa4-851b-86caa6ef9029 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6" status: 404 len: 111 microversion: 2.1 time: 0.036539 Oct 18 13:32:14.917061 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1924/3637] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:14 2022] GET /compute/v2.1/servers/206ae481-4890-46be-a0eb-83a6f22eb0b6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:32:14.922357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-91a5621e-bdf7-4c77-a468-4695b9b79e50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:14.922858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-91a5621e-bdf7-4c77-a468-4695b9b79e50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:14.939374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91a5621e-bdf7-4c77-a468-4695b9b79e50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.940509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91a5621e-bdf7-4c77-a468-4695b9b79e50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.941077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91a5621e-bdf7-4c77-a468-4695b9b79e50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.941836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91a5621e-bdf7-4c77-a468-4695b9b79e50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.942305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91a5621e-bdf7-4c77-a468-4695b9b79e50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.942803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91a5621e-bdf7-4c77-a468-4695b9b79e50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.970090 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-91a5621e-bdf7-4c77-a468-4695b9b79e50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] HTTP exception thrown: Instance 37db5c9f-afcd-4471-930c-d3a55a279f09 could not be found. Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-91a5621e-bdf7-4c77-a468-4695b9b79e50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Request method failure captured: Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 HTTP/1.1 Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqpDLsSNWFRosYVlNrucBq7ewHMWr9NG_ZYPE9SnO_Vde8eCe-rdLyKAXB49PKMt2f3X-vhzZ6oaQytZ4BV2vXK1cXBAR6unSrHOILsSt2lvnbrTRbRNYuU6YDka02Eb7nqC60fMaBQLritv0WUC3ak17q1Xie94085jDIEc01FULEY Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 02171c961e924aa0b2ec216ec3fc2250 Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_02171c961e924aa0b2ec216ec3fc2250"}]}] Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 02171c961e924aa0b2ec216ec3fc2250 Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerDiskConfigTestJSON-970291395-project Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3cba0dade9b74a5b9e647244d9f66184 Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerDiskConfigTestJSON-970291395-project Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 37db5c9f-afcd-4471-930c-d3a55a279f09 could not be found. Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '37db5c9f-afcd-4471-930c-d3a55a279f09'} Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37db5c9f-afcd-4471-930c-d3a55a279f09 could not be found. Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:14.972884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37db5c9f-afcd-4471-930c-d3a55a279f09 could not be found. Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37db5c9f-afcd-4471-930c-d3a55a279f09 could not be found. Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-91a5621e-bdf7-4c77-a468-4695b9b79e50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Returning 404 to user: Instance 37db5c9f-afcd-4471-930c-d3a55a279f09 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-91a5621e-bdf7-4c77-a468-4695b9b79e50 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "DELETE /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 404 len: 111 microversion: 2.1 time: 0.056334 Oct 18 13:32:14.980048 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1925/3638] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:32:14 2022] DELETE /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:14.983451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8967c527-8c0d-4300-8b39-068bedb3d6c4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:14.984072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8967c527-8c0d-4300-8b39-068bedb3d6c4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] [instance: 37db5c9f-afcd-4471-930c-d3a55a279f09] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:14.991591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8967c527-8c0d-4300-8b39-068bedb3d6c4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.992088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8967c527-8c0d-4300-8b39-068bedb3d6c4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.992529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8967c527-8c0d-4300-8b39-068bedb3d6c4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:14.993260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8967c527-8c0d-4300-8b39-068bedb3d6c4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:14.993722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8967c527-8c0d-4300-8b39-068bedb3d6c4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:14.994151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8967c527-8c0d-4300-8b39-068bedb3d6c4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:15.009769 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-8967c527-8c0d-4300-8b39-068bedb3d6c4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] HTTP exception thrown: Instance 37db5c9f-afcd-4471-930c-d3a55a279f09 could not be found. Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8967c527-8c0d-4300-8b39-068bedb3d6c4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Request method failure captured: Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 HTTP/1.1 Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqpDLsSNWFRosYVlNrucBq7ewHMWr9NG_ZYPE9SnO_Vde8eCe-rdLyKAXB49PKMt2f3X-vhzZ6oaQytZ4BV2vXK1cXBAR6unSrHOILsSt2lvnbrTRbRNYuU6YDka02Eb7nqC60fMaBQLritv0WUC3ak17q1Xie94085jDIEc01FULEY Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 02171c961e924aa0b2ec216ec3fc2250 Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/02171c961e924aa0b2ec216ec3fc2250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_02171c961e924aa0b2ec216ec3fc2250"}]}] Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 02171c961e924aa0b2ec216ec3fc2250 Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-970291395 Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerDiskConfigTestJSON-970291395-project Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3cba0dade9b74a5b9e647244d9f66184 Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerDiskConfigTestJSON-970291395-project Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 37db5c9f-afcd-4471-930c-d3a55a279f09 could not be found. Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '37db5c9f-afcd-4471-930c-d3a55a279f09'} Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37db5c9f-afcd-4471-930c-d3a55a279f09 could not be found. Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37db5c9f-afcd-4471-930c-d3a55a279f09 could not be found. Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:15.011341 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:15.016809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:15.016809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:15.016809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:15.016809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:15.016809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:15.016809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37db5c9f-afcd-4471-930c-d3a55a279f09 could not be found. Oct 18 13:32:15.016809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:15.016809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8967c527-8c0d-4300-8b39-068bedb3d6c4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] Returning 404 to user: Instance 37db5c9f-afcd-4471-930c-d3a55a279f09 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:15.016809 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8967c527-8c0d-4300-8b39-068bedb3d6c4 tempest-ServerDiskConfigTestJSON-970291395 tempest-ServerDiskConfigTestJSON-970291395-project] 10.222.0.40 "GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09" status: 404 len: 111 microversion: 2.1 time: 0.033098 Oct 18 13:32:15.017704 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1926/3639] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:14 2022] GET /compute/v2.1/servers/37db5c9f-afcd-4471-930c-d3a55a279f09 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:15.514804 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7249e3dc-ba8c-4571-8b7e-0b8c6ebd3597 tempest-SecurityGroupRulesTestJSON-1739729323 tempest-SecurityGroupRulesTestJSON-1739729323-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/d8a91ce2-c73a-4922-91c1-1167a3518cc4" status: 202 len: 0 microversion: 2.1 time: 1.081638 Oct 18 13:32:15.517128 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1714/3640] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:32:14 2022] DELETE /compute/v2.1/os-security-groups/d8a91ce2-c73a-4922-91c1-1167a3518cc4 => generated 0 bytes in 1085 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:15.781657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eff908d3-4a80-4222-b322-1f9f65568d5f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:15.782470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eff908d3-4a80-4222-b322-1f9f65568d5f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:15.794107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eff908d3-4a80-4222-b322-1f9f65568d5f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:15.794752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eff908d3-4a80-4222-b322-1f9f65568d5f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:15.795672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eff908d3-4a80-4222-b322-1f9f65568d5f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:15.796486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eff908d3-4a80-4222-b322-1f9f65568d5f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:15.798556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eff908d3-4a80-4222-b322-1f9f65568d5f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:15.799280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eff908d3-4a80-4222-b322-1f9f65568d5f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:16.674138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eff908d3-4a80-4222-b322-1f9f65568d5f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:16.684005 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eff908d3-4a80-4222-b322-1f9f65568d5f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1522 microversion: 2.1 time: 0.914725 Oct 18 13:32:16.691299 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1927/3641] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:15 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1522 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:17.718965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dfa09a73-a936-4caa-8d5d-edb5455d4fc8 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:17.719671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dfa09a73-a936-4caa-8d5d-edb5455d4fc8 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:17.749716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfa09a73-a936-4caa-8d5d-edb5455d4fc8 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:17.753867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfa09a73-a936-4caa-8d5d-edb5455d4fc8 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:17.755826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfa09a73-a936-4caa-8d5d-edb5455d4fc8 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:17.756869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfa09a73-a936-4caa-8d5d-edb5455d4fc8 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:17.758451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfa09a73-a936-4caa-8d5d-edb5455d4fc8 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:17.759363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfa09a73-a936-4caa-8d5d-edb5455d4fc8 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:18.625552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dfa09a73-a936-4caa-8d5d-edb5455d4fc8 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:18.665111 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dfa09a73-a936-4caa-8d5d-edb5455d4fc8 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1522 microversion: 2.1 time: 0.952733 Oct 18 13:32:18.672757 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1715/3642] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:17 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1522 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:19.698263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-92c8f04b-1b2a-4f34-9705-d2389160fff4 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:19.699621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-92c8f04b-1b2a-4f34-9705-d2389160fff4 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:19.703983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:19.705116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=14 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:19.711552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92c8f04b-1b2a-4f34-9705-d2389160fff4 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:19.712364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92c8f04b-1b2a-4f34-9705-d2389160fff4 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:19.713141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92c8f04b-1b2a-4f34-9705-d2389160fff4 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:19.714124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92c8f04b-1b2a-4f34-9705-d2389160fff4 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:19.714865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92c8f04b-1b2a-4f34-9705-d2389160fff4 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:19.715714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92c8f04b-1b2a-4f34-9705-d2389160fff4 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:20.105930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-92c8f04b-1b2a-4f34-9705-d2389160fff4 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:20.143935 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-92c8f04b-1b2a-4f34-9705-d2389160fff4 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1522 microversion: 2.1 time: 0.449468 Oct 18 13:32:20.145242 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1928/3643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:19 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:21.172711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d7b86964-03dc-4239-89f9-8a40dbf19eb0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:21.180555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d7b86964-03dc-4239-89f9-8a40dbf19eb0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:21.188758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=12 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:21.193089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7b86964-03dc-4239-89f9-8a40dbf19eb0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:21.193925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7b86964-03dc-4239-89f9-8a40dbf19eb0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:21.194876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7b86964-03dc-4239-89f9-8a40dbf19eb0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:21.197071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7b86964-03dc-4239-89f9-8a40dbf19eb0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:21.200030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7b86964-03dc-4239-89f9-8a40dbf19eb0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:21.200869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7b86964-03dc-4239-89f9-8a40dbf19eb0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:22.153468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d7b86964-03dc-4239-89f9-8a40dbf19eb0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:22.165434 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d7b86964-03dc-4239-89f9-8a40dbf19eb0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1522 microversion: 2.1 time: 0.998519 Oct 18 13:32:22.170017 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1716/3644] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:21 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1522 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:23.198390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-69697a0d-d923-46e7-86be-fac62d04c060 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:23.199032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-69697a0d-d923-46e7-86be-fac62d04c060 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:23.206308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:23.208270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69697a0d-d923-46e7-86be-fac62d04c060 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:23.211011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69697a0d-d923-46e7-86be-fac62d04c060 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:23.211770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69697a0d-d923-46e7-86be-fac62d04c060 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:23.212698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69697a0d-d923-46e7-86be-fac62d04c060 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:23.216650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69697a0d-d923-46e7-86be-fac62d04c060 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:23.217405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69697a0d-d923-46e7-86be-fac62d04c060 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:24.119259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-69697a0d-d923-46e7-86be-fac62d04c060 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:24.132010 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-69697a0d-d923-46e7-86be-fac62d04c060 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1499 microversion: 2.1 time: 0.937644 Oct 18 13:32:24.144465 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1929/3645] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:23 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1499 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:24.170890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-83c41d73-80ae-4d2f-a108-4b17f0f1f0bd tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:24.179276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-83c41d73-80ae-4d2f-a108-4b17f0f1f0bd tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:24.180451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-83c41d73-80ae-4d2f-a108-4b17f0f1f0bd tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:24.203162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83c41d73-80ae-4d2f-a108-4b17f0f1f0bd tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:24.205438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83c41d73-80ae-4d2f-a108-4b17f0f1f0bd tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:24.206884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83c41d73-80ae-4d2f-a108-4b17f0f1f0bd tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:24.211705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83c41d73-80ae-4d2f-a108-4b17f0f1f0bd tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:24.212434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83c41d73-80ae-4d2f-a108-4b17f0f1f0bd tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:24.215981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83c41d73-80ae-4d2f-a108-4b17f0f1f0bd tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:24.289041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-83c41d73-80ae-4d2f-a108-4b17f0f1f0bd tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:24.383872 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-83c41d73-80ae-4d2f-a108-4b17f0f1f0bd tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.214393 Oct 18 13:32:24.386724 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1717/3646] 10.222.0.40 () {58 vars in 1154 bytes} [Tue Oct 18 13:32:24 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:32:24.404227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e26954e1-0785-4211-b838-e7e795b47b27 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:24.419349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e26954e1-0785-4211-b838-e7e795b47b27 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:24.420731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e26954e1-0785-4211-b838-e7e795b47b27 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:24.422799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e26954e1-0785-4211-b838-e7e795b47b27 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:24.519557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e26954e1-0785-4211-b838-e7e795b47b27 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Going to try to start instance {{(pid=120611) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 13:32:24.627881 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e26954e1-0785-4211-b838-e7e795b47b27 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "POST /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b/action" status: 202 len: 0 microversion: 2.1 time: 0.228695 Oct 18 13:32:24.644921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-623927b6-21d6-4cae-b70d-d5571deb01b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:24.646354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-623927b6-21d6-4cae-b70d-d5571deb01b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:24.652217 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1930/3647] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:32:24 2022] POST /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:32:24.657870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-623927b6-21d6-4cae-b70d-d5571deb01b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:24.659036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-623927b6-21d6-4cae-b70d-d5571deb01b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:24.660777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-623927b6-21d6-4cae-b70d-d5571deb01b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:24.662253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-623927b6-21d6-4cae-b70d-d5571deb01b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:24.663084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-623927b6-21d6-4cae-b70d-d5571deb01b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:24.663823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-623927b6-21d6-4cae-b70d-d5571deb01b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:25.889695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-623927b6-21d6-4cae-b70d-d5571deb01b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:25.910846 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-623927b6-21d6-4cae-b70d-d5571deb01b1 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1508 microversion: 2.1 time: 1.275901 Oct 18 13:32:25.936079 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1718/3648] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:24 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1508 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:26.965164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d19040f-b117-4b81-a3d8-086156c4bc16 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:26.965823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3d19040f-b117-4b81-a3d8-086156c4bc16 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:26.992886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d19040f-b117-4b81-a3d8-086156c4bc16 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:26.994819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d19040f-b117-4b81-a3d8-086156c4bc16 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:26.997431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d19040f-b117-4b81-a3d8-086156c4bc16 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:26.998245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d19040f-b117-4b81-a3d8-086156c4bc16 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:26.998721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d19040f-b117-4b81-a3d8-086156c4bc16 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:27.001879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d19040f-b117-4b81-a3d8-086156c4bc16 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:28.542834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3d19040f-b117-4b81-a3d8-086156c4bc16 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:28.573377 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3d19040f-b117-4b81-a3d8-086156c4bc16 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1508 microversion: 2.1 time: 1.613110 Oct 18 13:32:28.578675 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1931/3649] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:26 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1508 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:29.601821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b53b380b-f78f-445d-b352-beecab84d7a2 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:29.603060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b53b380b-f78f-445d-b352-beecab84d7a2 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:29.622983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b53b380b-f78f-445d-b352-beecab84d7a2 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.623555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b53b380b-f78f-445d-b352-beecab84d7a2 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.626112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b53b380b-f78f-445d-b352-beecab84d7a2 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:29.626953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b53b380b-f78f-445d-b352-beecab84d7a2 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:29.632582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b53b380b-f78f-445d-b352-beecab84d7a2 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:29.633114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b53b380b-f78f-445d-b352-beecab84d7a2 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:30.065421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-acadab81-8a33-44ad-8b88-f1e9b603081c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Action: 'create', calling method: .version_select at 0x7ff60ec37430>, body: {"keypair": {"name": "tempest-keypair-829305784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUv2gKHAIYy8xz6RuVQVatfnWv6xwQN0lO+FcFH2oIWe6iiybw4wiZBVR5yS4MkgsfTLh2+q38eMNAYD4IwNYHS0A+1AnxhXmbGZMlex+5kAF1a9m0fM7W2QlHEbfTReA=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:30.105114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-acadab81-8a33-44ad-8b88-f1e9b603081c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Getting quotas for project 6e2231c4720246789ebb4ae0b1a29128. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:30.123389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-acadab81-8a33-44ad-8b88-f1e9b603081c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Getting quotas for user 8ffdf91ab1a4414da1ec7fdcd4965bed and project 6e2231c4720246789ebb4ae0b1a29128. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:30.178444 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-acadab81-8a33-44ad-8b88-f1e9b603081c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.368245 Oct 18 13:32:30.181573 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1932/3650] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 18 13:32:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 372 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 13:32:30.272576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b53b380b-f78f-445d-b352-beecab84d7a2 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:30.294142 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b53b380b-f78f-445d-b352-beecab84d7a2 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1512 microversion: 2.1 time: 0.699203 Oct 18 13:32:30.295423 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1719/3651] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:29 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1512 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:30.326419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c68aca4-6027-40b4-9d2a-9fc475d2abba tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:30.331816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2c68aca4-6027-40b4-9d2a-9fc475d2abba tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:30.335534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.compute.servers [None req-2c68aca4-6027-40b4-9d2a-9fc475d2abba tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Removing options 'limit' from query {{(pid=120611) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 13:32:30.337061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2c68aca4-6027-40b4-9d2a-9fc475d2abba tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:30.341253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c68aca4-6027-40b4-9d2a-9fc475d2abba tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:30.342373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c68aca4-6027-40b4-9d2a-9fc475d2abba tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:30.343374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c68aca4-6027-40b4-9d2a-9fc475d2abba tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:30.347818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c68aca4-6027-40b4-9d2a-9fc475d2abba tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:30.349003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c68aca4-6027-40b4-9d2a-9fc475d2abba tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:30.355321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c68aca4-6027-40b4-9d2a-9fc475d2abba tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:30.357210 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2c68aca4-6027-40b4-9d2a-9fc475d2abba tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.038826 Oct 18 13:32:30.358351 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1933/3652] 10.222.0.40 () {58 vars in 1140 bytes} [Tue Oct 18 13:32:30 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:32:30.371952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af0be9b9-c583-4e74-84a5-013155e68b1c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:30.372573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-af0be9b9-c583-4e74-84a5-013155e68b1c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:30.387859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af0be9b9-c583-4e74-84a5-013155e68b1c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:30.392443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af0be9b9-c583-4e74-84a5-013155e68b1c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:30.393444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af0be9b9-c583-4e74-84a5-013155e68b1c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:30.394433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af0be9b9-c583-4e74-84a5-013155e68b1c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:30.395074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af0be9b9-c583-4e74-84a5-013155e68b1c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:30.395877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af0be9b9-c583-4e74-84a5-013155e68b1c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:31.036839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-af0be9b9-c583-4e74-84a5-013155e68b1c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:31.065932 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-af0be9b9-c583-4e74-84a5-013155e68b1c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1512 microversion: 2.1 time: 0.697715 Oct 18 13:32:31.066949 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1720/3653] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:30 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1512 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:31.094303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-57143116-97e3-4145-8485-d8fc044cbb24 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:31.094959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-57143116-97e3-4145-8485-d8fc044cbb24 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: b3b7058d-7bdc-4d34-b3e3-fa5be5730997] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:31.111965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57143116-97e3-4145-8485-d8fc044cbb24 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:31.114898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57143116-97e3-4145-8485-d8fc044cbb24 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:31.115362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57143116-97e3-4145-8485-d8fc044cbb24 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:31.116110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57143116-97e3-4145-8485-d8fc044cbb24 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:31.120581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57143116-97e3-4145-8485-d8fc044cbb24 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:31.122052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57143116-97e3-4145-8485-d8fc044cbb24 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:31.989646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-933775bc-1eb1-4e31-bd82-e478c8b6e24f tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1034390254", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:31.996903 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-933775bc-1eb1-4e31-bd82-e478c8b6e24f tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] HTTP exception thrown: min_count must be <= max_count Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-933775bc-1eb1-4e31-bd82-e478c8b6e24f tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Request method failure captured: Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 184 Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqruKn_nLmoDLVkR9ScIsnl2YvoL3ZyzRfFDTN4zaGYrnoYbO3ugXFb4l-oNrtFfO8x9BA8Wj6Ui44uE1yeKpn4U8bjRZMrhMzhg2DSDIQbgbhEVoioLFlS5cWAp5cF7caNSnBt9bR7O4tP6K4wTPc2chau_-Wh12G_eStYYduKxkew Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 51917e61900749c8a558fc6c681903be Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51917e61900749c8a558fc6c681903be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/51917e61900749c8a558fc6c681903be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51917e61900749c8a558fc6c681903be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_51917e61900749c8a558fc6c681903be"}]}] Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 51917e61900749c8a558fc6c681903be Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-MultipleCreateNegativeTestJSON-431726247-project Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 02cb784832504ce1ba7af3dc74b3372b Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-431726247-project Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1034390254", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: exception: min_count must be <= max_count Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1034390254', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 18 13:32:31.998775 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.005901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-933775bc-1eb1-4e31-bd82-e478c8b6e24f tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Returning 400 to user: min_count must be <= max_count {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:32.005901 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-933775bc-1eb1-4e31-bd82-e478c8b6e24f tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.590281 Oct 18 13:32:32.005901 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1721/3654] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:31 2022] POST /compute/v2.1/servers => generated 74 bytes in 594 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:32:32.062060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-57143116-97e3-4145-8485-d8fc044cbb24 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:32.084965 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-57143116-97e3-4145-8485-d8fc044cbb24 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997" status: 200 len: 1513 microversion: 2.1 time: 0.989490 Oct 18 13:32:32.088057 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1934/3655] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:31 2022] GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997 => generated 1513 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:32.117443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-87fb6684-92b2-4654-9ad3-bce22693bb34 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:32.122292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-87fb6684-92b2-4654-9ad3-bce22693bb34 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:32.141493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87fb6684-92b2-4654-9ad3-bce22693bb34 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:32.142583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87fb6684-92b2-4654-9ad3-bce22693bb34 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:32.144203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87fb6684-92b2-4654-9ad3-bce22693bb34 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:32.147139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87fb6684-92b2-4654-9ad3-bce22693bb34 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:32.148528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87fb6684-92b2-4654-9ad3-bce22693bb34 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:32.150841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87fb6684-92b2-4654-9ad3-bce22693bb34 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:32.230304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6ce4490c-7728-45b8-b120-b68b40da8fb7 tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-639586374", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "max_count": 0}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6ce4490c-7728-45b8-b120-b68b40da8fb7 tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Request method failure captured: Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 167 Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqruKn_nLmoDLVkR9ScIsnl2YvoL3ZyzRfFDTN4zaGYrnoYbO3ugXFb4l-oNrtFfO8x9BA8Wj6Ui44uE1yeKpn4U8bjRZMrhMzhg2DSDIQbgbhEVoioLFlS5cWAp5cF7caNSnBt9bR7O4tP6K4wTPc2chau_-Wh12G_eStYYduKxkew Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 51917e61900749c8a558fc6c681903be Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51917e61900749c8a558fc6c681903be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/51917e61900749c8a558fc6c681903be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51917e61900749c8a558fc6c681903be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_51917e61900749c8a558fc6c681903be"}]}] Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 51917e61900749c8a558fc6c681903be Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-MultipleCreateNegativeTestJSON-431726247-project Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 02cb784832504ce1ba7af3dc74b3372b Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-431726247-project Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-639586374", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "max_count": 0}} Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-639586374', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'max_count': 0}}} Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 0 Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:32:32.234808 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 18 13:32:32.243047 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.250024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6ce4490c-7728-45b8-b120-b68b40da8fb7 tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:32.251207 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6ce4490c-7728-45b8-b120-b68b40da8fb7 tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.025037 Oct 18 13:32:32.255349 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1935/3656] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:32 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:32:32.494320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc3a2a40-d231-4621-a72b-cb2def8e3fc6 tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-455047234", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "max_count": 2.5}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc3a2a40-d231-4621-a72b-cb2def8e3fc6 tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Request method failure captured: Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 169 Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqruKn_nLmoDLVkR9ScIsnl2YvoL3ZyzRfFDTN4zaGYrnoYbO3ugXFb4l-oNrtFfO8x9BA8Wj6Ui44uE1yeKpn4U8bjRZMrhMzhg2DSDIQbgbhEVoioLFlS5cWAp5cF7caNSnBt9bR7O4tP6K4wTPc2chau_-Wh12G_eStYYduKxkew Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 51917e61900749c8a558fc6c681903be Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51917e61900749c8a558fc6c681903be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/51917e61900749c8a558fc6c681903be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51917e61900749c8a558fc6c681903be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_51917e61900749c8a558fc6c681903be"}]}] Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 51917e61900749c8a558fc6c681903be Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-MultipleCreateNegativeTestJSON-431726247-project Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 02cb784832504ce1ba7af3dc74b3372b Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-431726247-project Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-455047234", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "max_count": 2.5}} Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-455047234', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'max_count': 2.5}}} Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 2.5 Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:32:32.503630 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc3a2a40-d231-4621-a72b-cb2def8e3fc6 tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:32.509639 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bc3a2a40-d231-4621-a72b-cb2def8e3fc6 tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016193 Oct 18 13:32:32.512435 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1936/3657] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:32 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:32:32.854735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-255b7efe-f223-437f-b8b9-fc807a6515af tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-55688771", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "min_count": 0}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-255b7efe-f223-437f-b8b9-fc807a6515af tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Request method failure captured: Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 166 Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqruKn_nLmoDLVkR9ScIsnl2YvoL3ZyzRfFDTN4zaGYrnoYbO3ugXFb4l-oNrtFfO8x9BA8Wj6Ui44uE1yeKpn4U8bjRZMrhMzhg2DSDIQbgbhEVoioLFlS5cWAp5cF7caNSnBt9bR7O4tP6K4wTPc2chau_-Wh12G_eStYYduKxkew Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 51917e61900749c8a558fc6c681903be Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51917e61900749c8a558fc6c681903be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/51917e61900749c8a558fc6c681903be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51917e61900749c8a558fc6c681903be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_51917e61900749c8a558fc6c681903be"}]}] Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 51917e61900749c8a558fc6c681903be Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-MultipleCreateNegativeTestJSON-431726247-project Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 02cb784832504ce1ba7af3dc74b3372b Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-431726247-project Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-55688771", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "min_count": 0}} Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-55688771', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'min_count': 0}}} Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 0 Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:32:32.862705 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-255b7efe-f223-437f-b8b9-fc807a6515af tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-255b7efe-f223-437f-b8b9-fc807a6515af tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.013986 Oct 18 13:32:32.867335 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1937/3658] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:32 2022] POST /compute/v2.1/servers => generated 130 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:32:32.945989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-87fb6684-92b2-4654-9ad3-bce22693bb34 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:32.969408 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-87fb6684-92b2-4654-9ad3-bce22693bb34 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1512 microversion: 2.1 time: 0.856967 Oct 18 13:32:32.971586 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1722/3659] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:32 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1512 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:33.009093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f43dbb6a-4a1d-4902-a03c-04b656ebe062 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:33.015671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f43dbb6a-4a1d-4902-a03c-04b656ebe062 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:33.021117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f43dbb6a-4a1d-4902-a03c-04b656ebe062 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:33.154637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8c461bc6-dbc6-411d-a1f4-573a4c835294 tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-349585198", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "min_count": 2.5}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8c461bc6-dbc6-411d-a1f4-573a4c835294 tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Request method failure captured: Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 169 Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqruKn_nLmoDLVkR9ScIsnl2YvoL3ZyzRfFDTN4zaGYrnoYbO3ugXFb4l-oNrtFfO8x9BA8Wj6Ui44uE1yeKpn4U8bjRZMrhMzhg2DSDIQbgbhEVoioLFlS5cWAp5cF7caNSnBt9bR7O4tP6K4wTPc2chau_-Wh12G_eStYYduKxkew Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 51917e61900749c8a558fc6c681903be Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51917e61900749c8a558fc6c681903be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/51917e61900749c8a558fc6c681903be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51917e61900749c8a558fc6c681903be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_51917e61900749c8a558fc6c681903be"}]}] Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 51917e61900749c8a558fc6c681903be Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-431726247 Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-MultipleCreateNegativeTestJSON-431726247-project Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 02cb784832504ce1ba7af3dc74b3372b Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-431726247-project Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-349585198", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "min_count": 2.5}} Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-349585198', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'min_count': 2.5}}} Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 2.5 Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:32:33.172665 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 18 13:32:33.178992 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:33.187335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8c461bc6-dbc6-411d-a1f4-573a4c835294 tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:33.193517 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8c461bc6-dbc6-411d-a1f4-573a4c835294 tempest-MultipleCreateNegativeTestJSON-431726247 tempest-MultipleCreateNegativeTestJSON-431726247-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.043111 Oct 18 13:32:33.198234 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1723/3660] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:33 2022] POST /compute/v2.1/servers => generated 139 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:32:33.426032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f43dbb6a-4a1d-4902-a03c-04b656ebe062 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.428249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f43dbb6a-4a1d-4902-a03c-04b656ebe062 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.429296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f43dbb6a-4a1d-4902-a03c-04b656ebe062 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:33.432060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f43dbb6a-4a1d-4902-a03c-04b656ebe062 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.432999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f43dbb6a-4a1d-4902-a03c-04b656ebe062 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.434200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f43dbb6a-4a1d-4902-a03c-04b656ebe062 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:33.704721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-f43dbb6a-4a1d-4902-a03c-04b656ebe062 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:33.903576 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f43dbb6a-4a1d-4902-a03c-04b656ebe062 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.905072 Oct 18 13:32:33.906419 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1938/3661] 10.222.0.40 () {58 vars in 1154 bytes} [Tue Oct 18 13:32:32 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:33.921306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1c3d749c-3804-40d1-860d-3b9496572165 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:33.922304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1c3d749c-3804-40d1-860d-3b9496572165 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:33.938972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c3d749c-3804-40d1-860d-3b9496572165 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.940003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c3d749c-3804-40d1-860d-3b9496572165 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.941637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c3d749c-3804-40d1-860d-3b9496572165 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:33.944451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c3d749c-3804-40d1-860d-3b9496572165 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:33.948892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c3d749c-3804-40d1-860d-3b9496572165 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:33.950293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c3d749c-3804-40d1-860d-3b9496572165 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:34.249550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:34.466680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-24abc1f2-d4b0-4cc7-a2f7-a74a885dcc16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:34.467974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-24abc1f2-d4b0-4cc7-a2f7-a74a885dcc16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:34.485170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24abc1f2-d4b0-4cc7-a2f7-a74a885dcc16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:34.485926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24abc1f2-d4b0-4cc7-a2f7-a74a885dcc16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:34.486478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24abc1f2-d4b0-4cc7-a2f7-a74a885dcc16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:34.491017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24abc1f2-d4b0-4cc7-a2f7-a74a885dcc16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:34.492186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24abc1f2-d4b0-4cc7-a2f7-a74a885dcc16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:34.493666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24abc1f2-d4b0-4cc7-a2f7-a74a885dcc16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:35.144512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-24abc1f2-d4b0-4cc7-a2f7-a74a885dcc16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:35.168289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-24abc1f2-d4b0-4cc7-a2f7-a74a885dcc16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:35.173962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-24abc1f2-d4b0-4cc7-a2f7-a74a885dcc16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:35.178073 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-24abc1f2-d4b0-4cc7-a2f7-a74a885dcc16 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2950 microversion: 2.32 time: 0.719412 Oct 18 13:32:35.183796 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1939/3662] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:34 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2950 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:35.214272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c1344c5e-7811-46e1-b087-94a710c40121 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:35.214780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c1344c5e-7811-46e1-b087-94a710c40121 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:35.232385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1344c5e-7811-46e1-b087-94a710c40121 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:35.232902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1344c5e-7811-46e1-b087-94a710c40121 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:35.238682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1344c5e-7811-46e1-b087-94a710c40121 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:35.242385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1344c5e-7811-46e1-b087-94a710c40121 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:35.243257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1344c5e-7811-46e1-b087-94a710c40121 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:35.244552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1344c5e-7811-46e1-b087-94a710c40121 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:35.319639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1c3d749c-3804-40d1-860d-3b9496572165 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:35.331386 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1c3d749c-3804-40d1-860d-3b9496572165 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1512 microversion: 2.1 time: 1.414593 Oct 18 13:32:35.343500 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1724/3663] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:33 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1512 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:35.369129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9d831feb-d4c2-47f4-ad14-4129adf17d35 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:35.370327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9d831feb-d4c2-47f4-ad14-4129adf17d35 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: b3b7058d-7bdc-4d34-b3e3-fa5be5730997] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:35.379973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:35.385283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d831feb-d4c2-47f4-ad14-4129adf17d35 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:35.386107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d831feb-d4c2-47f4-ad14-4129adf17d35 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:35.387280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d831feb-d4c2-47f4-ad14-4129adf17d35 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:35.388513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d831feb-d4c2-47f4-ad14-4129adf17d35 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:35.389527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d831feb-d4c2-47f4-ad14-4129adf17d35 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:35.390178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d831feb-d4c2-47f4-ad14-4129adf17d35 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:35.560458 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c1344c5e-7811-46e1-b087-94a710c40121 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.351046 Oct 18 13:32:35.561372 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1940/3664] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 18 13:32:35 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1/os-interface => generated 1832 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:32:35.622494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1798616816", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b76c1c8-1de7-45dc-a1e5-7e21cbe193f0"}], "security_groups": [{"name": "tempest-securitygroup--1976336028"}], "key_name": "tempest-keypair-829305784", "user_data": "}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:35.931270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] validate_networks() for [('3b76c1c8-1de7-45dc-a1e5-7e21cbe193f0', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:32:35.938677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9d831feb-d4c2-47f4-ad14-4129adf17d35 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:35.964562 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9d831feb-d4c2-47f4-ad14-4129adf17d35 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997" status: 200 len: 1513 microversion: 2.1 time: 0.599657 Oct 18 13:32:35.968982 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1725/3665] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:35 2022] GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997 => generated 1513 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:36.003193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-37212d8e-96e3-4846-976e-c6b2f58f938c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:36.004108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-37212d8e-96e3-4846-976e-c6b2f58f938c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:36.014082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-37212d8e-96e3-4846-976e-c6b2f58f938c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:36.015044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-37212d8e-96e3-4846-976e-c6b2f58f938c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:36.017961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-37212d8e-96e3-4846-976e-c6b2f58f938c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:36.019558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-37212d8e-96e3-4846-976e-c6b2f58f938c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:36.020449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-37212d8e-96e3-4846-976e-c6b2f58f938c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:36.021582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-37212d8e-96e3-4846-976e-c6b2f58f938c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:36.921100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:32:36.921744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:32:36.922283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:32:36.922814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:32:36.924028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:32:36.935160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-37212d8e-96e3-4846-976e-c6b2f58f938c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:36.945762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:36.950335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:36.950794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:36.951583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:36.952286 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-37212d8e-96e3-4846-976e-c6b2f58f938c tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1512 microversion: 2.1 time: 0.961645 Oct 18 13:32:36.952811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:36.953271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:36.974356 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1726/3666] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:35 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1512 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:36.979220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:36.992041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:36.993130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:37.010754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.011246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.011685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.012419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.012870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.013322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.054082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Getting quotas for project 6e2231c4720246789ebb4ae0b1a29128. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:37.072674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:37.074857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Getting quotas for user 8ffdf91ab1a4414da1ec7fdcd4965bed and project 6e2231c4720246789ebb4ae0b1a29128. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:37.117515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:32:37.120754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:37.125840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:32:37.259484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:37.276843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.277662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.278336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.311952 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aa56b9ff-9f2e-4ce1-bba2-3b8c83d096a8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.698035 Oct 18 13:32:37.321765 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1941/3667] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:32:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:32:37.336523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68652d6b-1092-4d46-a842-337b52b6bbb1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:37.337629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-68652d6b-1092-4d46-a842-337b52b6bbb1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:37.477073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68652d6b-1092-4d46-a842-337b52b6bbb1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:37.490654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68652d6b-1092-4d46-a842-337b52b6bbb1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:37.490979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68652d6b-1092-4d46-a842-337b52b6bbb1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:37.502088 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68652d6b-1092-4d46-a842-337b52b6bbb1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1281 microversion: 2.20 time: 0.172261 Oct 18 13:32:37.514998 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1942/3668] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:37 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1281 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:37.719548 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3fc0b335-0a60-44d7-96e2-1f02932b5a3a tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.743314 Oct 18 13:32:37.721947 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1727/3669] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:32:36 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:37.757127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2d09dc9f-00ab-4608-a5b1-f9788dd02aae tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:37.767947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2d09dc9f-00ab-4608-a5b1-f9788dd02aae tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:37.772324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2d09dc9f-00ab-4608-a5b1-f9788dd02aae tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:37.914199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d09dc9f-00ab-4608-a5b1-f9788dd02aae tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.914789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d09dc9f-00ab-4608-a5b1-f9788dd02aae tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.915989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d09dc9f-00ab-4608-a5b1-f9788dd02aae tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:37.916924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d09dc9f-00ab-4608-a5b1-f9788dd02aae tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:37.917690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d09dc9f-00ab-4608-a5b1-f9788dd02aae tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:37.918599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d09dc9f-00ab-4608-a5b1-f9788dd02aae tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.022154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-2d09dc9f-00ab-4608-a5b1-f9788dd02aae tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:38.105087 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2d09dc9f-00ab-4608-a5b1-f9788dd02aae tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.354302 Oct 18 13:32:38.114237 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1943/3670] 10.222.0.40 () {58 vars in 1150 bytes} [Tue Oct 18 13:32:37 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:38.132651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-01b73032-33a5-4e33-9140-41b13e84e1a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.145924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-01b73032-33a5-4e33-9140-41b13e84e1a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:38.150678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-01b73032-33a5-4e33-9140-41b13e84e1a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:38.188740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01b73032-33a5-4e33-9140-41b13e84e1a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.189408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01b73032-33a5-4e33-9140-41b13e84e1a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.189986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01b73032-33a5-4e33-9140-41b13e84e1a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.193556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01b73032-33a5-4e33-9140-41b13e84e1a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.194067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01b73032-33a5-4e33-9140-41b13e84e1a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.195923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01b73032-33a5-4e33-9140-41b13e84e1a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.531981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f2fe9804-7ead-4ed0-8a3d-c5f087d7f8a6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.532907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f2fe9804-7ead-4ed0-8a3d-c5f087d7f8a6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:38.546820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2fe9804-7ead-4ed0-8a3d-c5f087d7f8a6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.547322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2fe9804-7ead-4ed0-8a3d-c5f087d7f8a6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.553704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2fe9804-7ead-4ed0-8a3d-c5f087d7f8a6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.556090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2fe9804-7ead-4ed0-8a3d-c5f087d7f8a6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.558536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2fe9804-7ead-4ed0-8a3d-c5f087d7f8a6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.561803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2fe9804-7ead-4ed0-8a3d-c5f087d7f8a6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.587654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-01b73032-33a5-4e33-9140-41b13e84e1a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:38.824718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f2fe9804-7ead-4ed0-8a3d-c5f087d7f8a6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:38.834307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f2fe9804-7ead-4ed0-8a3d-c5f087d7f8a6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:38.850104 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-01b73032-33a5-4e33-9140-41b13e84e1a3 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.724603 Oct 18 13:32:38.854353 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1728/3671] 10.222.0.40 () {58 vars in 1212 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:38.867452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f2fe9804-7ead-4ed0-8a3d-c5f087d7f8a6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:38.875474 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f2fe9804-7ead-4ed0-8a3d-c5f087d7f8a6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1277 microversion: 2.20 time: 0.343631 Oct 18 13:32:38.878749 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1944/3672] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1277 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:32:38.898188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d611b426-6372-49dc-aa47-4a8728d65a17 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:38.906476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d611b426-6372-49dc-aa47-4a8728d65a17 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:38.907310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d611b426-6372-49dc-aa47-4a8728d65a17 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:38.940043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d611b426-6372-49dc-aa47-4a8728d65a17 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.940564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d611b426-6372-49dc-aa47-4a8728d65a17 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.942897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d611b426-6372-49dc-aa47-4a8728d65a17 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:38.950231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d611b426-6372-49dc-aa47-4a8728d65a17 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:38.952890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d611b426-6372-49dc-aa47-4a8728d65a17 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:38.954228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d611b426-6372-49dc-aa47-4a8728d65a17 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.154436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-333122141", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "179c2b2e-8f5f-4957-9d40-71ca983fd20f"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:39.258665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:39.276231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] validate_networks() for [('179c2b2e-8f5f-4957-9d40-71ca983fd20f', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:32:39.348382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-d611b426-6372-49dc-aa47-4a8728d65a17 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:39.562466 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d611b426-6372-49dc-aa47-4a8728d65a17 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.681488 Oct 18 13:32:39.569239 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1945/3673] 10.222.0.40 () {58 vars in 1196 bytes} [Tue Oct 18 13:32:38 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:39.582129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-302c714b-818e-4f12-8315-96e7e1413ff0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:39.622119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-302c714b-818e-4f12-8315-96e7e1413ff0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:39.625862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-302c714b-818e-4f12-8315-96e7e1413ff0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'name': '2064527317', 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:39.650478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302c714b-818e-4f12-8315-96e7e1413ff0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.651210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302c714b-818e-4f12-8315-96e7e1413ff0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.655470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302c714b-818e-4f12-8315-96e7e1413ff0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.656327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302c714b-818e-4f12-8315-96e7e1413ff0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.656925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302c714b-818e-4f12-8315-96e7e1413ff0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.659807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302c714b-818e-4f12-8315-96e7e1413ff0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.873138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-302c714b-818e-4f12-8315-96e7e1413ff0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:39.945858 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-302c714b-818e-4f12-8315-96e7e1413ff0 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?name=2064527317" status: 200 len: 346 microversion: 2.1 time: 0.370382 Oct 18 13:32:39.948829 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1946/3674] 10.222.0.40 () {58 vars in 1156 bytes} [Tue Oct 18 13:32:39 2022] GET /compute/v2.1/servers?name=2064527317 => generated 346 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:32:39.955603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-91a18c52-46a1-4b7e-84c2-899d60ad51ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:39.956506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-91a18c52-46a1-4b7e-84c2-899d60ad51ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:39.964966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91a18c52-46a1-4b7e-84c2-899d60ad51ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.966720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91a18c52-46a1-4b7e-84c2-899d60ad51ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.966720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91a18c52-46a1-4b7e-84c2-899d60ad51ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:39.968792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91a18c52-46a1-4b7e-84c2-899d60ad51ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:39.969833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91a18c52-46a1-4b7e-84c2-899d60ad51ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:39.971430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91a18c52-46a1-4b7e-84c2-899d60ad51ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.279873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-91a18c52-46a1-4b7e-84c2-899d60ad51ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.291039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-91a18c52-46a1-4b7e-84c2-899d60ad51ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.302340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-91a18c52-46a1-4b7e-84c2-899d60ad51ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.304823 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-91a18c52-46a1-4b7e-84c2-899d60ad51ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1339 microversion: 2.20 time: 0.354499 Oct 18 13:32:40.305851 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1947/3675] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:39 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1339 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:40.320774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a72f30ae-8288-4183-9d0d-0a57db6af7a6 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:40.332491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a72f30ae-8288-4183-9d0d-0a57db6af7a6 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.332861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a72f30ae-8288-4183-9d0d-0a57db6af7a6 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:40.347056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a72f30ae-8288-4183-9d0d-0a57db6af7a6 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.347782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a72f30ae-8288-4183-9d0d-0a57db6af7a6 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.353659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a72f30ae-8288-4183-9d0d-0a57db6af7a6 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.354927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a72f30ae-8288-4183-9d0d-0a57db6af7a6 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.355613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a72f30ae-8288-4183-9d0d-0a57db6af7a6 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.356204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a72f30ae-8288-4183-9d0d-0a57db6af7a6 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.558542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-a72f30ae-8288-4183-9d0d-0a57db6af7a6 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:40.630021 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a72f30ae-8288-4183-9d0d-0a57db6af7a6 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.322999 Oct 18 13:32:40.630979 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1948/3676] 10.222.0.40 () {58 vars in 1154 bytes} [Tue Oct 18 13:32:40 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:40.644679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04291257-87b3-4321-a460-5c1edb107264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:40.654309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04291257-87b3-4321-a460-5c1edb107264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:40.656254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04291257-87b3-4321-a460-5c1edb107264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-206452731', 'deleted': False, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:32:40.668360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04291257-87b3-4321-a460-5c1edb107264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.669297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04291257-87b3-4321-a460-5c1edb107264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.670059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04291257-87b3-4321-a460-5c1edb107264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.671025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04291257-87b3-4321-a460-5c1edb107264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.671713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04291257-87b3-4321-a460-5c1edb107264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.672305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04291257-87b3-4321-a460-5c1edb107264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.795583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-04291257-87b3-4321-a460-5c1edb107264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:32:40.886892 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04291257-87b3-4321-a460-5c1edb107264 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-206452731" status: 200 len: 346 microversion: 2.1 time: 0.247020 Oct 18 13:32:40.896779 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1949/3677] 10.222.0.40 () {58 vars in 1228 bytes} [Tue Oct 18 13:32:40 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-206452731 => generated 346 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:40.904602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-154a660e-2f07-44ed-a9ed-f0115b2ead3d tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:40.905123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-154a660e-2f07-44ed-a9ed-f0115b2ead3d tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:40.912077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-154a660e-2f07-44ed-a9ed-f0115b2ead3d tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.912571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-154a660e-2f07-44ed-a9ed-f0115b2ead3d tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.913016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-154a660e-2f07-44ed-a9ed-f0115b2ead3d tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:40.913766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-154a660e-2f07-44ed-a9ed-f0115b2ead3d tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:40.914237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-154a660e-2f07-44ed-a9ed-f0115b2ead3d tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:40.914823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-154a660e-2f07-44ed-a9ed-f0115b2ead3d tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.043000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-154a660e-2f07-44ed-a9ed-f0115b2ead3d tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:32:41.296549 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-154a660e-2f07-44ed-a9ed-f0115b2ead3d tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "DELETE /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 204 len: 0 microversion: 2.1 time: 0.396212 Oct 18 13:32:41.297284 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1950/3678] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:32:40 2022] DELETE /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:32:41.316526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-079ed59f-7104-423c-8600-81b7e054844e tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:41.317167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-079ed59f-7104-423c-8600-81b7e054844e tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:41.335736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-079ed59f-7104-423c-8600-81b7e054844e tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.336459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-079ed59f-7104-423c-8600-81b7e054844e tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.341921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-079ed59f-7104-423c-8600-81b7e054844e tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.342878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-079ed59f-7104-423c-8600-81b7e054844e tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.343701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-079ed59f-7104-423c-8600-81b7e054844e tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.345390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-079ed59f-7104-423c-8600-81b7e054844e tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.575436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:32:41.576483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:32:41.577132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:32:41.577963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:32:41.578552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:32:41.607073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.609097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.614044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.616503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.617484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.619191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.664914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Getting quotas for project adecadde75c5450cbbacb33a6eed63c6. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:41.679240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Getting quotas for user 6498058370ca4841b84fb6be162573e7 and project adecadde75c5450cbbacb33a6eed63c6. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:41.752605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:32:41.759228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:32:41.856198 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a8c3f64c-5768-4c2f-b369-c5132f6d7941 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.997585 Oct 18 13:32:41.857823 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1729/3679] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:32:41.877047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-64521e55-1ada-432c-95f8-29cffa9d8596 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:41.878281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-64521e55-1ada-432c-95f8-29cffa9d8596 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:41.890900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64521e55-1ada-432c-95f8-29cffa9d8596 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.892342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64521e55-1ada-432c-95f8-29cffa9d8596 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.892984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64521e55-1ada-432c-95f8-29cffa9d8596 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:41.894495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64521e55-1ada-432c-95f8-29cffa9d8596 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:41.895762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64521e55-1ada-432c-95f8-29cffa9d8596 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:41.896632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64521e55-1ada-432c-95f8-29cffa9d8596 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:42.171851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-64521e55-1ada-432c-95f8-29cffa9d8596 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:42.186476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-64521e55-1ada-432c-95f8-29cffa9d8596 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:42.190283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-64521e55-1ada-432c-95f8-29cffa9d8596 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:42.191666 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-64521e55-1ada-432c-95f8-29cffa9d8596 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1339 microversion: 2.20 time: 0.332157 Oct 18 13:32:42.192431 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1730/3680] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:41 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1339 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:42.211221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-36073653-8baa-4818-a76b-ace8f0007bb9 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:42.213080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-36073653-8baa-4818-a76b-ace8f0007bb9 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:42.365913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36073653-8baa-4818-a76b-ace8f0007bb9 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:42.385162 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-36073653-8baa-4818-a76b-ace8f0007bb9 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1223 microversion: 2.1 time: 0.182897 Oct 18 13:32:42.403386 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1731/3681] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:42 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1223 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:43.217998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4b2e4319-3aec-4046-a05c-473a118dca58 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:43.218679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4b2e4319-3aec-4046-a05c-473a118dca58 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:43.233319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b2e4319-3aec-4046-a05c-473a118dca58 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:43.233863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b2e4319-3aec-4046-a05c-473a118dca58 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:43.236151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b2e4319-3aec-4046-a05c-473a118dca58 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:43.237995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b2e4319-3aec-4046-a05c-473a118dca58 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:43.240697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b2e4319-3aec-4046-a05c-473a118dca58 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:43.242238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b2e4319-3aec-4046-a05c-473a118dca58 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:43.286820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-079ed59f-7104-423c-8600-81b7e054844e tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:43.300785 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-079ed59f-7104-423c-8600-81b7e054844e tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1518 microversion: 2.1 time: 1.994389 Oct 18 13:32:43.303985 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1951/3682] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:41 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1518 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:43.411049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-716cc622-5865-4351-86d3-c2e6294e7a1d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:43.411951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-716cc622-5865-4351-86d3-c2e6294e7a1d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:43.427230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-716cc622-5865-4351-86d3-c2e6294e7a1d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:43.430639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-716cc622-5865-4351-86d3-c2e6294e7a1d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:43.431349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-716cc622-5865-4351-86d3-c2e6294e7a1d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:43.433416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-716cc622-5865-4351-86d3-c2e6294e7a1d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:43.434879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-716cc622-5865-4351-86d3-c2e6294e7a1d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:43.437992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-716cc622-5865-4351-86d3-c2e6294e7a1d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:43.930028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-716cc622-5865-4351-86d3-c2e6294e7a1d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:43.953347 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-716cc622-5865-4351-86d3-c2e6294e7a1d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1275 microversion: 2.1 time: 0.544608 Oct 18 13:32:43.956156 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1952/3683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:43 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1275 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:44.256074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4b2e4319-3aec-4046-a05c-473a118dca58 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:44.275264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4b2e4319-3aec-4046-a05c-473a118dca58 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:44.277218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4b2e4319-3aec-4046-a05c-473a118dca58 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:44.278649 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4b2e4319-3aec-4046-a05c-473a118dca58 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 1.065038 Oct 18 13:32:44.279225 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1732/3684] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:43 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:32:44.331361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-569f6d5c-5192-401d-8ab3-7d74c500ff40 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:44.332023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-569f6d5c-5192-401d-8ab3-7d74c500ff40 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:44.344269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-569f6d5c-5192-401d-8ab3-7d74c500ff40 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:44.347121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-569f6d5c-5192-401d-8ab3-7d74c500ff40 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:44.347713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-569f6d5c-5192-401d-8ab3-7d74c500ff40 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:44.348583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-569f6d5c-5192-401d-8ab3-7d74c500ff40 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:44.349044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-569f6d5c-5192-401d-8ab3-7d74c500ff40 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:44.349495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-569f6d5c-5192-401d-8ab3-7d74c500ff40 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.005078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ac60c41f-2dff-4927-8be9-003a543e717f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:45.008164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ac60c41f-2dff-4927-8be9-003a543e717f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:45.028918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac60c41f-2dff-4927-8be9-003a543e717f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.032648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac60c41f-2dff-4927-8be9-003a543e717f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.034061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac60c41f-2dff-4927-8be9-003a543e717f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.039124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac60c41f-2dff-4927-8be9-003a543e717f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.040108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac60c41f-2dff-4927-8be9-003a543e717f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.040789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac60c41f-2dff-4927-8be9-003a543e717f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.214033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ac60c41f-2dff-4927-8be9-003a543e717f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:45.226886 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ac60c41f-2dff-4927-8be9-003a543e717f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1281 microversion: 2.1 time: 0.246171 Oct 18 13:32:45.233488 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1733/3685] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:44 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1281 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:45.307493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-569f6d5c-5192-401d-8ab3-7d74c500ff40 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:45.314987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-420724af-80f9-4e54-b534-a12a54e4dd86 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:45.316243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-420724af-80f9-4e54-b534-a12a54e4dd86 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:45.330803 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-569f6d5c-5192-401d-8ab3-7d74c500ff40 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1518 microversion: 2.1 time: 0.996280 Oct 18 13:32:45.333054 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1953/3686] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:44 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1518 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:45.346914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-420724af-80f9-4e54-b534-a12a54e4dd86 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.347571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-420724af-80f9-4e54-b534-a12a54e4dd86 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.348350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-420724af-80f9-4e54-b534-a12a54e4dd86 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.349065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-420724af-80f9-4e54-b534-a12a54e4dd86 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:45.349793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-420724af-80f9-4e54-b534-a12a54e4dd86 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:45.350249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-420724af-80f9-4e54-b534-a12a54e4dd86 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:45.662449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-420724af-80f9-4e54-b534-a12a54e4dd86 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:45.674850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-420724af-80f9-4e54-b534-a12a54e4dd86 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:45.677828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-420724af-80f9-4e54-b534-a12a54e4dd86 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:45.679256 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-420724af-80f9-4e54-b534-a12a54e4dd86 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 0.377578 Oct 18 13:32:45.680323 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1734/3687] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:45 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:32:46.075702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-57f3146f-a19e-490e-aa11-aa1d3f1f2ba5 req-8ae97346-fbd3-4c77-b1dc-8cb15b8d154b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e8ac53-2c9b-4c4b-b2f9-1d14d996736e", "name": "network-vif-deleted", "tag": "920fcd55-e944-4969-b916-c77d2230eb02"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:46.120502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-57f3146f-a19e-490e-aa11-aa1d3f1f2ba5 req-8ae97346-fbd3-4c77-b1dc-8cb15b8d154b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.122672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-57f3146f-a19e-490e-aa11-aa1d3f1f2ba5 req-8ae97346-fbd3-4c77-b1dc-8cb15b8d154b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.123176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-57f3146f-a19e-490e-aa11-aa1d3f1f2ba5 req-8ae97346-fbd3-4c77-b1dc-8cb15b8d154b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.182154 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-57f3146f-a19e-490e-aa11-aa1d3f1f2ba5 req-8ae97346-fbd3-4c77-b1dc-8cb15b8d154b service nova] Creating event network-vif-deleted:920fcd55-e944-4969-b916-c77d2230eb02 for instance 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e on n-h1-858384-13 Oct 18 13:32:46.198941 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-57f3146f-a19e-490e-aa11-aa1d3f1f2ba5 req-8ae97346-fbd3-4c77-b1dc-8cb15b8d154b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132066 Oct 18 13:32:46.202206 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1954/3688] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:46.252994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f3943041-9bb6-4e62-9412-4851b2410897 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:46.254217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f3943041-9bb6-4e62-9412-4851b2410897 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:46.262831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f3943041-9bb6-4e62-9412-4851b2410897 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.263746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f3943041-9bb6-4e62-9412-4851b2410897 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.264561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f3943041-9bb6-4e62-9412-4851b2410897 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.265573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f3943041-9bb6-4e62-9412-4851b2410897 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.266266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f3943041-9bb6-4e62-9412-4851b2410897 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.267554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f3943041-9bb6-4e62-9412-4851b2410897 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.360135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:46.361547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:46.376190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.380181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.381962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.382574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.385610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.386719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.483866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.486743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.487765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.488639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lazy-loading 'fault' on Instance uuid 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:32:46.879025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f3943041-9bb6-4e62-9412-4851b2410897 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:46.898736 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f3943041-9bb6-4e62-9412-4851b2410897 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1323 microversion: 2.1 time: 0.650466 Oct 18 13:32:46.901054 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1735/3689] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:46 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1323 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:46.912112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-83602d33-9417-4668-b099-554d32bbca0e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:46.913579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-83602d33-9417-4668-b099-554d32bbca0e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:46.928863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83602d33-9417-4668-b099-554d32bbca0e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.929737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83602d33-9417-4668-b099-554d32bbca0e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.931779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83602d33-9417-4668-b099-554d32bbca0e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:46.932795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83602d33-9417-4668-b099-554d32bbca0e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:46.936146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83602d33-9417-4668-b099-554d32bbca0e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:46.938177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83602d33-9417-4668-b099-554d32bbca0e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:47.136652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:47.146425 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d745e84c-0b16-4bc7-b128-fc039741570f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 200 len: 1310 microversion: 2.1 time: 0.792330 Oct 18 13:32:47.183572 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1955/3690] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:46 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 1310 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:32:47.723076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-83602d33-9417-4668-b099-554d32bbca0e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:47.740632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-83602d33-9417-4668-b099-554d32bbca0e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:47.746342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-83602d33-9417-4668-b099-554d32bbca0e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:47.757305 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-83602d33-9417-4668-b099-554d32bbca0e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 0.853482 Oct 18 13:32:47.757840 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1736/3691] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:46 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:47.929603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eee960cf-65cf-47f0-a572-c7756a3311d5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:47.931724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eee960cf-65cf-47f0-a572-c7756a3311d5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:47.949566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=12 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:47.951830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eee960cf-65cf-47f0-a572-c7756a3311d5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:47.952534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eee960cf-65cf-47f0-a572-c7756a3311d5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:47.956674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eee960cf-65cf-47f0-a572-c7756a3311d5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:47.959352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eee960cf-65cf-47f0-a572-c7756a3311d5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:47.966775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eee960cf-65cf-47f0-a572-c7756a3311d5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:47.967592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eee960cf-65cf-47f0-a572-c7756a3311d5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.179018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-02c01ada-fd3e-4c94-bf98-c4264fffcab7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:48.180488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-02c01ada-fd3e-4c94-bf98-c4264fffcab7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:48.193620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02c01ada-fd3e-4c94-bf98-c4264fffcab7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:48.194999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02c01ada-fd3e-4c94-bf98-c4264fffcab7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:48.195918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02c01ada-fd3e-4c94-bf98-c4264fffcab7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.196906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02c01ada-fd3e-4c94-bf98-c4264fffcab7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:48.197575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02c01ada-fd3e-4c94-bf98-c4264fffcab7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:48.198431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02c01ada-fd3e-4c94-bf98-c4264fffcab7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.259487 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-02c01ada-fd3e-4c94-bf98-c4264fffcab7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] HTTP exception thrown: Instance 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e could not be found. Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-02c01ada-fd3e-4c94-bf98-c4264fffcab7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Request method failure captured: Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e HTTP/1.1 Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqqtQ9fZHDN7Xh7Csc4h5jBXZ9EzJlCqb7YqHz9ULF50n8z5GWi8906crJPM-tWaLDnEiVKzm8VSYGuFMdzp1aQ9hoNN9Qh1E4op37d_QjkD0FlqhVlT0KH1jKnjnG6R7Mvbv3yUWEUhHmnq0-rhl6EC-yjXPc5ZOfG4iPhb2l5vg4o Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 61eb84fa8e2342b8bae22eeae31bcf8d Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ListServerFiltersTestJSON-1766072609 Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/61eb84fa8e2342b8bae22eeae31bcf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/61eb84fa8e2342b8bae22eeae31bcf8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/61eb84fa8e2342b8bae22eeae31bcf8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_61eb84fa8e2342b8bae22eeae31bcf8d"}]}] Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ListServerFiltersTestJSON-1766072609 Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 61eb84fa8e2342b8bae22eeae31bcf8d Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1766072609 Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ListServerFiltersTestJSON-1766072609-project Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 35276a270e8f46a28215737c2dbea762 Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ListServerFiltersTestJSON-1766072609-project Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e could not be found. Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '98e8ac53-2c9b-4c4b-b2f9-1d14d996736e'} Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e could not be found. Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e could not be found. Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:48.263325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:48.271513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:48.271513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:48.271513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:48.271513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:48.271513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:48.271513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e could not be found. Oct 18 13:32:48.271513 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:48.271513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-02c01ada-fd3e-4c94-bf98-c4264fffcab7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Returning 404 to user: Instance 98e8ac53-2c9b-4c4b-b2f9-1d14d996736e could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:48.276165 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-02c01ada-fd3e-4c94-bf98-c4264fffcab7 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e" status: 404 len: 111 microversion: 2.1 time: 0.098743 Oct 18 13:32:48.283150 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1737/3692] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:48 2022] GET /compute/v2.1/servers/98e8ac53-2c9b-4c4b-b2f9-1d14d996736e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:32:48.288714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f8d4760a-1f91-4ba7-b3ee-599687d5a115 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:48.289462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f8d4760a-1f91-4ba7-b3ee-599687d5a115 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: b3b7058d-7bdc-4d34-b3e3-fa5be5730997] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:48.307770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8d4760a-1f91-4ba7-b3ee-599687d5a115 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:48.310732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8d4760a-1f91-4ba7-b3ee-599687d5a115 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:48.311369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8d4760a-1f91-4ba7-b3ee-599687d5a115 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.312413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8d4760a-1f91-4ba7-b3ee-599687d5a115 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:48.315230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8d4760a-1f91-4ba7-b3ee-599687d5a115 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:48.324006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8d4760a-1f91-4ba7-b3ee-599687d5a115 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.391105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f8d4760a-1f91-4ba7-b3ee-599687d5a115 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: b3b7058d-7bdc-4d34-b3e3-fa5be5730997] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:32:48.586068 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f8d4760a-1f91-4ba7-b3ee-599687d5a115 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997" status: 204 len: 0 microversion: 2.1 time: 0.301183 Oct 18 13:32:48.592354 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1738/3693] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:32:48 2022] DELETE /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:32:48.604820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2046a495-a97e-4b3e-aa4e-a5d65795440b tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:48.605559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2046a495-a97e-4b3e-aa4e-a5d65795440b tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: b3b7058d-7bdc-4d34-b3e3-fa5be5730997] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:48.618791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2046a495-a97e-4b3e-aa4e-a5d65795440b tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:48.619281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2046a495-a97e-4b3e-aa4e-a5d65795440b tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:48.619710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2046a495-a97e-4b3e-aa4e-a5d65795440b tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:48.630624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2046a495-a97e-4b3e-aa4e-a5d65795440b tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:48.631255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2046a495-a97e-4b3e-aa4e-a5d65795440b tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:48.631701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2046a495-a97e-4b3e-aa4e-a5d65795440b tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:49.025910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2046a495-a97e-4b3e-aa4e-a5d65795440b tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:49.035986 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2046a495-a97e-4b3e-aa4e-a5d65795440b tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997" status: 200 len: 1519 microversion: 2.1 time: 0.441972 Oct 18 13:32:49.038901 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1739/3694] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:48 2022] GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997 => generated 1519 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:49.051813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6557c3ae-e76b-40c3-93c3-1b7f9133acca tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:49.052803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6557c3ae-e76b-40c3-93c3-1b7f9133acca tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:49.061717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6557c3ae-e76b-40c3-93c3-1b7f9133acca tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:49.062549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6557c3ae-e76b-40c3-93c3-1b7f9133acca tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:49.063210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6557c3ae-e76b-40c3-93c3-1b7f9133acca tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:49.064960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6557c3ae-e76b-40c3-93c3-1b7f9133acca tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:49.066194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6557c3ae-e76b-40c3-93c3-1b7f9133acca tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:49.066902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6557c3ae-e76b-40c3-93c3-1b7f9133acca tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:49.112016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eee960cf-65cf-47f0-a572-c7756a3311d5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:49.122020 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eee960cf-65cf-47f0-a572-c7756a3311d5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1323 microversion: 2.1 time: 1.200182 Oct 18 13:32:49.138343 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1956/3695] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:47 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1323 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:49.488051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6557c3ae-e76b-40c3-93c3-1b7f9133acca tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:49.506640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6557c3ae-e76b-40c3-93c3-1b7f9133acca tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:49.509914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6557c3ae-e76b-40c3-93c3-1b7f9133acca tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:49.511819 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6557c3ae-e76b-40c3-93c3-1b7f9133acca tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 0.469879 Oct 18 13:32:49.513314 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1740/3696] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:49 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:49.551432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-08851b33-1e45-4af5-a368-226c7497aa6c req-9fc84ac5-1e90-42b8-b1a1-c2df6f3a4ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1a8797f-2b84-44d0-b925-5115ecdeea0d", "tag": "7d99fb30-ea22-4ee8-aca6-1d4f06679c96"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:49.575540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-08851b33-1e45-4af5-a368-226c7497aa6c req-9fc84ac5-1e90-42b8-b1a1-c2df6f3a4ce0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:49.577061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-08851b33-1e45-4af5-a368-226c7497aa6c req-9fc84ac5-1e90-42b8-b1a1-c2df6f3a4ce0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:49.577701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-08851b33-1e45-4af5-a368-226c7497aa6c req-9fc84ac5-1e90-42b8-b1a1-c2df6f3a4ce0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:49.598775 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-08851b33-1e45-4af5-a368-226c7497aa6c req-9fc84ac5-1e90-42b8-b1a1-c2df6f3a4ce0 service nova] Creating event network-changed:7d99fb30-ea22-4ee8-aca6-1d4f06679c96 for instance d1a8797f-2b84-44d0-b925-5115ecdeea0d on n-h1-858384-13 Oct 18 13:32:49.604390 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-08851b33-1e45-4af5-a368-226c7497aa6c req-9fc84ac5-1e90-42b8-b1a1-c2df6f3a4ce0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057816 Oct 18 13:32:49.605678 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1957/3697] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:49.737582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-2e61cefd-c784-4683-82c7-827e75cf4514 req-9a10e65d-03bb-4b8e-b0a1-92ba3953e0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa292c2-3801-4d84-b31a-4d3eeeb41818", "tag": "8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:49.758734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2e61cefd-c784-4683-82c7-827e75cf4514 req-9a10e65d-03bb-4b8e-b0a1-92ba3953e0e1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:49.759283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2e61cefd-c784-4683-82c7-827e75cf4514 req-9a10e65d-03bb-4b8e-b0a1-92ba3953e0e1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:49.759730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2e61cefd-c784-4683-82c7-827e75cf4514 req-9a10e65d-03bb-4b8e-b0a1-92ba3953e0e1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:49.780813 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-2e61cefd-c784-4683-82c7-827e75cf4514 req-9a10e65d-03bb-4b8e-b0a1-92ba3953e0e1 service nova] Creating event network-changed:8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa for instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 on n-h2-858384-13 Oct 18 13:32:49.798653 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-2e61cefd-c784-4683-82c7-827e75cf4514 req-9a10e65d-03bb-4b8e-b0a1-92ba3953e0e1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066402 Oct 18 13:32:49.799448 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1741/3698] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:50.063039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-877a061f-5d96-4fa1-93a0-c45a9cb28c43 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:50.064208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-877a061f-5d96-4fa1-93a0-c45a9cb28c43 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: b3b7058d-7bdc-4d34-b3e3-fa5be5730997] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:50.077434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-877a061f-5d96-4fa1-93a0-c45a9cb28c43 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.078314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-877a061f-5d96-4fa1-93a0-c45a9cb28c43 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.079813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-877a061f-5d96-4fa1-93a0-c45a9cb28c43 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.081901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-877a061f-5d96-4fa1-93a0-c45a9cb28c43 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.082639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-877a061f-5d96-4fa1-93a0-c45a9cb28c43 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.085668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-877a061f-5d96-4fa1-93a0-c45a9cb28c43 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.152882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c9421145-067c-47e1-814d-f30b639b83c2 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:50.153664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c9421145-067c-47e1-814d-f30b639b83c2 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:50.170165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9421145-067c-47e1-814d-f30b639b83c2 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.170783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9421145-067c-47e1-814d-f30b639b83c2 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.171225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9421145-067c-47e1-814d-f30b639b83c2 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.172013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9421145-067c-47e1-814d-f30b639b83c2 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:50.172466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9421145-067c-47e1-814d-f30b639b83c2 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:50.173447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9421145-067c-47e1-814d-f30b639b83c2 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:50.733974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=14 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:51.047055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c9421145-067c-47e1-814d-f30b639b83c2 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:51.065593 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c9421145-067c-47e1-814d-f30b639b83c2 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1323 microversion: 2.1 time: 0.912915 Oct 18 13:32:51.066688 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1742/3699] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:50 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1323 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:51.077348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a9606091-81d9-434f-897f-fa65c05e81fd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:51.083973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a9606091-81d9-434f-897f-fa65c05e81fd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:51.121347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9606091-81d9-434f-897f-fa65c05e81fd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:51.122376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9606091-81d9-434f-897f-fa65c05e81fd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:51.123107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9606091-81d9-434f-897f-fa65c05e81fd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:51.123745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9606091-81d9-434f-897f-fa65c05e81fd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:51.124197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9606091-81d9-434f-897f-fa65c05e81fd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:51.124619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9606091-81d9-434f-897f-fa65c05e81fd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:51.366391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a9606091-81d9-434f-897f-fa65c05e81fd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:51.385742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a9606091-81d9-434f-897f-fa65c05e81fd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:51.390588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a9606091-81d9-434f-897f-fa65c05e81fd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:51.401007 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a9606091-81d9-434f-897f-fa65c05e81fd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 0.330570 Oct 18 13:32:51.402920 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1743/3700] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:51 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:52.095419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-27d7813c-e407-48a3-a1b8-fd50462731e5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:52.098144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-27d7813c-e407-48a3-a1b8-fd50462731e5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:52.103717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:52.111656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27d7813c-e407-48a3-a1b8-fd50462731e5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.112709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27d7813c-e407-48a3-a1b8-fd50462731e5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.113499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27d7813c-e407-48a3-a1b8-fd50462731e5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.115278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27d7813c-e407-48a3-a1b8-fd50462731e5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.115988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27d7813c-e407-48a3-a1b8-fd50462731e5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.117121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27d7813c-e407-48a3-a1b8-fd50462731e5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.147136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:52.372090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=10 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:52.518051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-27d7813c-e407-48a3-a1b8-fd50462731e5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:52.551726 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-27d7813c-e407-48a3-a1b8-fd50462731e5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1323 microversion: 2.1 time: 0.454820 Oct 18 13:32:52.554368 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1744/3701] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:52 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1323 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:52.561825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0c3893cc-28ae-4881-826c-f8a7c9b5b3f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:52.562780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0c3893cc-28ae-4881-826c-f8a7c9b5b3f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:52.564742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-877a061f-5d96-4fa1-93a0-c45a9cb28c43 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:52.574702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c3893cc-28ae-4881-826c-f8a7c9b5b3f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.577383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c3893cc-28ae-4881-826c-f8a7c9b5b3f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.579616 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-877a061f-5d96-4fa1-93a0-c45a9cb28c43 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997" status: 200 len: 1519 microversion: 2.1 time: 2.520871 Oct 18 13:32:52.579741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c3893cc-28ae-4881-826c-f8a7c9b5b3f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.589329 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1958/3702] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:50 2022] GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997 => generated 1519 bytes in 2529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:52.599097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c3893cc-28ae-4881-826c-f8a7c9b5b3f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:52.600138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c3893cc-28ae-4881-826c-f8a7c9b5b3f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:52.601143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c3893cc-28ae-4881-826c-f8a7c9b5b3f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:52.824369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0c3893cc-28ae-4881-826c-f8a7c9b5b3f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:52.835743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0c3893cc-28ae-4881-826c-f8a7c9b5b3f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:52.837197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0c3893cc-28ae-4881-826c-f8a7c9b5b3f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:52.845169 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0c3893cc-28ae-4881-826c-f8a7c9b5b3f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 0.288219 Oct 18 13:32:52.850014 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1745/3703] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:52 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:53.584480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6727e2fb-4d2c-401b-8277-59f97652fc32 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:53.586824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6727e2fb-4d2c-401b-8277-59f97652fc32 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:53.598927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:53.602816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6727e2fb-4d2c-401b-8277-59f97652fc32 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.604357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6727e2fb-4d2c-401b-8277-59f97652fc32 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.604998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6727e2fb-4d2c-401b-8277-59f97652fc32 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.605924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6727e2fb-4d2c-401b-8277-59f97652fc32 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.607381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6727e2fb-4d2c-401b-8277-59f97652fc32 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.608036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6727e2fb-4d2c-401b-8277-59f97652fc32 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.608174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9947eaa6-d888-4b32-8f62-924b0110e0f5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:53.608705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9947eaa6-d888-4b32-8f62-924b0110e0f5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: b3b7058d-7bdc-4d34-b3e3-fa5be5730997] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:53.628193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9947eaa6-d888-4b32-8f62-924b0110e0f5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.628993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9947eaa6-d888-4b32-8f62-924b0110e0f5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.629619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9947eaa6-d888-4b32-8f62-924b0110e0f5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:53.630608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9947eaa6-d888-4b32-8f62-924b0110e0f5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:53.631227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9947eaa6-d888-4b32-8f62-924b0110e0f5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:53.631817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9947eaa6-d888-4b32-8f62-924b0110e0f5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:54.074859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9947eaa6-d888-4b32-8f62-924b0110e0f5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:54.086053 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9947eaa6-d888-4b32-8f62-924b0110e0f5 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997" status: 200 len: 1519 microversion: 2.1 time: 0.481684 Oct 18 13:32:54.087363 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1746/3704] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:53 2022] GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997 => generated 1519 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:54.097036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-33d1dfc3-aba7-49c1-98f8-ada9c91b4504 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:54.103082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-33d1dfc3-aba7-49c1-98f8-ada9c91b4504 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:54.125610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33d1dfc3-aba7-49c1-98f8-ada9c91b4504 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:54.126532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33d1dfc3-aba7-49c1-98f8-ada9c91b4504 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:54.127097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33d1dfc3-aba7-49c1-98f8-ada9c91b4504 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:54.130664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33d1dfc3-aba7-49c1-98f8-ada9c91b4504 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:54.131600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33d1dfc3-aba7-49c1-98f8-ada9c91b4504 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:54.132259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33d1dfc3-aba7-49c1-98f8-ada9c91b4504 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:54.291492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6727e2fb-4d2c-401b-8277-59f97652fc32 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:54.294109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:54.308269 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6727e2fb-4d2c-401b-8277-59f97652fc32 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1323 microversion: 2.1 time: 0.730560 Oct 18 13:32:54.314072 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1959/3705] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:53 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1323 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:54.697581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-33d1dfc3-aba7-49c1-98f8-ada9c91b4504 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:54.710776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-33d1dfc3-aba7-49c1-98f8-ada9c91b4504 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:54.724878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-33d1dfc3-aba7-49c1-98f8-ada9c91b4504 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:54.727777 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-33d1dfc3-aba7-49c1-98f8-ada9c91b4504 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 0.638230 Oct 18 13:32:54.732029 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1747/3706] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:54 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:54.970244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-382301c9-3c08-4a7b-b4e1-ec56342c4e57 req-0ec59403-9721-40ee-b406-5776e8dc0ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b7058d-7bdc-4d34-b3e3-fa5be5730997", "name": "network-vif-deleted", "tag": "521de7e6-06e5-4a89-a9a8-91a43322d930"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:54.991340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-382301c9-3c08-4a7b-b4e1-ec56342c4e57 req-0ec59403-9721-40ee-b406-5776e8dc0ef7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:54.991780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-382301c9-3c08-4a7b-b4e1-ec56342c4e57 req-0ec59403-9721-40ee-b406-5776e8dc0ef7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:54.992210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-382301c9-3c08-4a7b-b4e1-ec56342c4e57 req-0ec59403-9721-40ee-b406-5776e8dc0ef7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.046024 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-382301c9-3c08-4a7b-b4e1-ec56342c4e57 req-0ec59403-9721-40ee-b406-5776e8dc0ef7 service nova] Creating event network-vif-deleted:521de7e6-06e5-4a89-a9a8-91a43322d930 for instance b3b7058d-7bdc-4d34-b3e3-fa5be5730997 on n-h1-858384-13 Oct 18 13:32:55.057579 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-382301c9-3c08-4a7b-b4e1-ec56342c4e57 req-0ec59403-9721-40ee-b406-5776e8dc0ef7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091507 Oct 18 13:32:55.059706 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1960/3707] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:55.115080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:55.116696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: b3b7058d-7bdc-4d34-b3e3-fa5be5730997] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:55.129827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.130333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.130772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.137164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.137746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.138191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.238274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.239098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.243346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.244564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lazy-loading 'fault' on Instance uuid b3b7058d-7bdc-4d34-b3e3-fa5be5730997 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:32:55.327801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:55.342301 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e8cbfdcb-4ee4-411f-a5e4-a99242576895 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997" status: 200 len: 1311 microversion: 2.1 time: 0.232775 Oct 18 13:32:55.346800 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1748/3708] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:55 2022] GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997 => generated 1311 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:55.401737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7ed47ad2-fe04-4b8a-98a2-75c903b9fdd7 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:55.415616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7ed47ad2-fe04-4b8a-98a2-75c903b9fdd7 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:55.443508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ed47ad2-fe04-4b8a-98a2-75c903b9fdd7 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.449593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ed47ad2-fe04-4b8a-98a2-75c903b9fdd7 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.452515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ed47ad2-fe04-4b8a-98a2-75c903b9fdd7 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.458400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ed47ad2-fe04-4b8a-98a2-75c903b9fdd7 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.460356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ed47ad2-fe04-4b8a-98a2-75c903b9fdd7 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.472732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7ed47ad2-fe04-4b8a-98a2-75c903b9fdd7 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.761589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7e9aeaec-de0d-44a4-8e67-a22f7f5ce623 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:55.762965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7e9aeaec-de0d-44a4-8e67-a22f7f5ce623 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:55.782456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e9aeaec-de0d-44a4-8e67-a22f7f5ce623 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.784052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e9aeaec-de0d-44a4-8e67-a22f7f5ce623 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.785094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e9aeaec-de0d-44a4-8e67-a22f7f5ce623 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:55.786991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e9aeaec-de0d-44a4-8e67-a22f7f5ce623 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:55.787670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e9aeaec-de0d-44a4-8e67-a22f7f5ce623 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:55.797600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e9aeaec-de0d-44a4-8e67-a22f7f5ce623 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:56.420452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7e9aeaec-de0d-44a4-8e67-a22f7f5ce623 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:56.434977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7e9aeaec-de0d-44a4-8e67-a22f7f5ce623 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:56.436546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7e9aeaec-de0d-44a4-8e67-a22f7f5ce623 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:56.442414 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7e9aeaec-de0d-44a4-8e67-a22f7f5ce623 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 0.685986 Oct 18 13:32:56.443654 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1749/3709] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:55 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:56.459149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-12924eba-7e92-4730-9216-6f1ee52787fc tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:56.459849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-12924eba-7e92-4730-9216-6f1ee52787fc tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: b3b7058d-7bdc-4d34-b3e3-fa5be5730997] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:56.467602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12924eba-7e92-4730-9216-6f1ee52787fc tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:56.476491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12924eba-7e92-4730-9216-6f1ee52787fc tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:56.477239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12924eba-7e92-4730-9216-6f1ee52787fc tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:56.478550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12924eba-7e92-4730-9216-6f1ee52787fc tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:56.479520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12924eba-7e92-4730-9216-6f1ee52787fc tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:56.480144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12924eba-7e92-4730-9216-6f1ee52787fc tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:56.504946 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-12924eba-7e92-4730-9216-6f1ee52787fc tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] HTTP exception thrown: Instance b3b7058d-7bdc-4d34-b3e3-fa5be5730997 could not be found. Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-12924eba-7e92-4730-9216-6f1ee52787fc tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Request method failure captured: Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997 HTTP/1.1 Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqqtQ9fZHDN7Xh7Csc4h5jBXZ9EzJlCqb7YqHz9ULF50n8z5GWi8906crJPM-tWaLDnEiVKzm8VSYGuFMdzp1aQ9hoNN9Qh1E4op37d_QjkD0FlqhVlT0KH1jKnjnG6R7Mvbv3yUWEUhHmnq0-rhl6EC-yjXPc5ZOfG4iPhb2l5vg4o Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 61eb84fa8e2342b8bae22eeae31bcf8d Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ListServerFiltersTestJSON-1766072609 Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/61eb84fa8e2342b8bae22eeae31bcf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/61eb84fa8e2342b8bae22eeae31bcf8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/61eb84fa8e2342b8bae22eeae31bcf8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_61eb84fa8e2342b8bae22eeae31bcf8d"}]}] Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ListServerFiltersTestJSON-1766072609 Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 61eb84fa8e2342b8bae22eeae31bcf8d Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1766072609 Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ListServerFiltersTestJSON-1766072609-project Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 35276a270e8f46a28215737c2dbea762 Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ListServerFiltersTestJSON-1766072609-project Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance b3b7058d-7bdc-4d34-b3e3-fa5be5730997 could not be found. Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'b3b7058d-7bdc-4d34-b3e3-fa5be5730997'} Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3b7058d-7bdc-4d34-b3e3-fa5be5730997 could not be found. Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3b7058d-7bdc-4d34-b3e3-fa5be5730997 could not be found. Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:32:56.509643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:56.514494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:32:56.514494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:32:56.514494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:32:56.514494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:32:56.514494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:32:56.514494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3b7058d-7bdc-4d34-b3e3-fa5be5730997 could not be found. Oct 18 13:32:56.514494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:32:56.518177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-12924eba-7e92-4730-9216-6f1ee52787fc tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Returning 404 to user: Instance b3b7058d-7bdc-4d34-b3e3-fa5be5730997 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:32:56.519419 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-12924eba-7e92-4730-9216-6f1ee52787fc tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997" status: 404 len: 111 microversion: 2.1 time: 0.074534 Oct 18 13:32:56.520785 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1750/3710] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:56 2022] GET /compute/v2.1/servers/b3b7058d-7bdc-4d34-b3e3-fa5be5730997 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:32:56.533428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1d3cb665-1c9b-4e33-8b20-0b812fa6de08 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:56.535493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1d3cb665-1c9b-4e33-8b20-0b812fa6de08 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:56.543094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d3cb665-1c9b-4e33-8b20-0b812fa6de08 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:56.543852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d3cb665-1c9b-4e33-8b20-0b812fa6de08 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:56.545210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d3cb665-1c9b-4e33-8b20-0b812fa6de08 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:56.546867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d3cb665-1c9b-4e33-8b20-0b812fa6de08 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:56.553241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d3cb665-1c9b-4e33-8b20-0b812fa6de08 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:56.555028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d3cb665-1c9b-4e33-8b20-0b812fa6de08 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:56.584780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7ed47ad2-fe04-4b8a-98a2-75c903b9fdd7 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:56.600428 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7ed47ad2-fe04-4b8a-98a2-75c903b9fdd7 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1323 microversion: 2.1 time: 1.267846 Oct 18 13:32:56.603658 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1961/3711] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:55 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1323 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:56.617337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1d3cb665-1c9b-4e33-8b20-0b812fa6de08 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:32:56.767777 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1d3cb665-1c9b-4e33-8b20-0b812fa6de08 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "DELETE /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 204 len: 0 microversion: 2.1 time: 0.241234 Oct 18 13:32:56.769929 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1751/3712] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:32:56 2022] DELETE /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:32:56.783803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-789bd223-d888-47dc-8f56-b3653144715f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:56.785222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-789bd223-d888-47dc-8f56-b3653144715f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:56.803992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789bd223-d888-47dc-8f56-b3653144715f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:56.804494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789bd223-d888-47dc-8f56-b3653144715f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:56.807103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789bd223-d888-47dc-8f56-b3653144715f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:56.807837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789bd223-d888-47dc-8f56-b3653144715f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:56.808302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789bd223-d888-47dc-8f56-b3653144715f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:56.808727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789bd223-d888-47dc-8f56-b3653144715f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:57.024717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-789bd223-d888-47dc-8f56-b3653144715f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:57.049590 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-789bd223-d888-47dc-8f56-b3653144715f tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1518 microversion: 2.1 time: 0.272004 Oct 18 13:32:57.049590 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1962/3713] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:56 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1518 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:57.410996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1960033949", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "f422a1cf-f5aa-4c61-bc16-004452c8a7b2"}, {"uuid": "0f63fed6-6af5-42db-9d99-de2f865f0f29"}, {"uuid": "f422a1cf-f5aa-4c61-bc16-004452c8a7b2"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:57.419866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-15b639ec-bda1-4063-a4f7-d1aaa5cf510a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Action: 'create', calling method: .version_select at 0x7ff60eb515e0>, body: {"keypair": {"name": "tempest-keypair-1405522993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE9WYnr0UYJPE68gupcPQFCr2u+QAlhK69VzCNJ//mpaHeJhiGIuCa8rLZrsC4FK3WOs1ooTDSGRZbbia3NSsgVMwMdIKwcRwykL7xkyVTA1FAg2mjtB5zgwL2rR/xBZQ=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:32:57.473779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-15b639ec-bda1-4063-a4f7-d1aaa5cf510a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Getting quotas for project 3ec155a5641940afb3f80c12e83c57ec. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:57.489392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-15b639ec-bda1-4063-a4f7-d1aaa5cf510a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Getting quotas for user eab6be43a2404bf1889cc592466bee4e and project 3ec155a5641940afb3f80c12e83c57ec. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:57.492257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] validate_networks() for [('f422a1cf-f5aa-4c61-bc16-004452c8a7b2', None, None, None, None, None), ('0f63fed6-6af5-42db-9d99-de2f865f0f29', None, None, None, None, None), ('f422a1cf-f5aa-4c61-bc16-004452c8a7b2', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:32:57.527750 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-15b639ec-bda1-4063-a4f7-d1aaa5cf510a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.474095 Oct 18 13:32:57.529859 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1752/3714] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:32:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:32:57.536911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8effd5cf-c22d-49eb-a61d-8d80edc4a33e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:57.538449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8effd5cf-c22d-49eb-a61d-8d80edc4a33e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:57.550699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8effd5cf-c22d-49eb-a61d-8d80edc4a33e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:57.551435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8effd5cf-c22d-49eb-a61d-8d80edc4a33e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:57.552048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8effd5cf-c22d-49eb-a61d-8d80edc4a33e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:57.552968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8effd5cf-c22d-49eb-a61d-8d80edc4a33e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:57.553635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8effd5cf-c22d-49eb-a61d-8d80edc4a33e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:57.554227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8effd5cf-c22d-49eb-a61d-8d80edc4a33e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:58.013257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8effd5cf-c22d-49eb-a61d-8d80edc4a33e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:58.027082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8effd5cf-c22d-49eb-a61d-8d80edc4a33e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:58.028674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8effd5cf-c22d-49eb-a61d-8d80edc4a33e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:58.036710 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8effd5cf-c22d-49eb-a61d-8d80edc4a33e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 0.505689 Oct 18 13:32:58.037654 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1753/3715] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:57 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:32:58.064176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-276083d3-9cc4-441f-8acf-7a3c79f54ea5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:58.064801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-276083d3-9cc4-441f-8acf-7a3c79f54ea5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:58.074812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:32:58.092700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-276083d3-9cc4-441f-8acf-7a3c79f54ea5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:58.094000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-276083d3-9cc4-441f-8acf-7a3c79f54ea5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:58.095213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-276083d3-9cc4-441f-8acf-7a3c79f54ea5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:58.096182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-276083d3-9cc4-441f-8acf-7a3c79f54ea5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:58.096796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-276083d3-9cc4-441f-8acf-7a3c79f54ea5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:58.097492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-276083d3-9cc4-441f-8acf-7a3c79f54ea5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.348621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-276083d3-9cc4-441f-8acf-7a3c79f54ea5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:59.356874 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-276083d3-9cc4-441f-8acf-7a3c79f54ea5 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1323 microversion: 2.1 time: 1.318303 Oct 18 13:32:59.360979 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1754/3716] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:58 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1323 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:59.377463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a9aab0be-aee7-4217-889c-1c47820a0325 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:59.378447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a9aab0be-aee7-4217-889c-1c47820a0325 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:59.395093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9aab0be-aee7-4217-889c-1c47820a0325 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.399571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9aab0be-aee7-4217-889c-1c47820a0325 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.402261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9aab0be-aee7-4217-889c-1c47820a0325 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.403271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9aab0be-aee7-4217-889c-1c47820a0325 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.403979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9aab0be-aee7-4217-889c-1c47820a0325 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.404619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9aab0be-aee7-4217-889c-1c47820a0325 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.614494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:32:59.615137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:32:59.616927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:32:59.617652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:32:59.618281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:32:59.637380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.639039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.639507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.645515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.646442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.649806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.693111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Getting quotas for project 59efb35dab2a4e64924a27d6f255e8ab. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:32:59.699713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Getting quotas for user e8916fc7da5847e38fb2e4b3b5bdf297 and project 59efb35dab2a4e64924a27d6f255e8ab. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:32:59.740252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:32:59.743241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:32:59.752055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a9aab0be-aee7-4217-889c-1c47820a0325 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:32:59.765829 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a9aab0be-aee7-4217-889c-1c47820a0325 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1518 microversion: 2.1 time: 0.403103 Oct 18 13:32:59.767190 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1755/3717] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:59 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1518 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:32:59.795312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1ba28d5e-f75b-4016-bedf-1551a1df977d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:59.796246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1ba28d5e-f75b-4016-bedf-1551a1df977d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:32:59.808859 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-488023ef-473d-46aa-87c1-9a814a2c389e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.406170 Oct 18 13:32:59.818099 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1963/3718] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:32:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:32:59.819618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ba28d5e-f75b-4016-bedf-1551a1df977d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.820067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ba28d5e-f75b-4016-bedf-1551a1df977d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.820560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ba28d5e-f75b-4016-bedf-1551a1df977d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.821550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ba28d5e-f75b-4016-bedf-1551a1df977d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:32:59.822010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ba28d5e-f75b-4016-bedf-1551a1df977d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:32:59.822437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ba28d5e-f75b-4016-bedf-1551a1df977d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:32:59.825970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-055384c1-9095-4802-a368-daee09fc4bae tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:32:59.826914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-055384c1-9095-4802-a368-daee09fc4bae tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:00.134619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-055384c1-9095-4802-a368-daee09fc4bae tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.162151 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-055384c1-9095-4802-a368-daee09fc4bae tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1213 microversion: 2.1 time: 0.328362 Oct 18 13:33:00.163760 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1964/3719] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:32:59 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1213 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:00.344194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1ade6b6f-071a-4524-ac01-c87bb4888189 req-833bc692-ce1f-41b8-a3d6-2d3354a6fc2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edaa1a81-2913-4817-bd63-18ebf8b5fa2b", "name": "network-vif-deleted", "tag": "773cc058-6f5c-4279-b7fe-03240ae29a1a"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:00.384877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1ade6b6f-071a-4524-ac01-c87bb4888189 req-833bc692-ce1f-41b8-a3d6-2d3354a6fc2b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.388165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1ade6b6f-071a-4524-ac01-c87bb4888189 req-833bc692-ce1f-41b8-a3d6-2d3354a6fc2b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.394874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1ade6b6f-071a-4524-ac01-c87bb4888189 req-833bc692-ce1f-41b8-a3d6-2d3354a6fc2b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.430483 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1ade6b6f-071a-4524-ac01-c87bb4888189 req-833bc692-ce1f-41b8-a3d6-2d3354a6fc2b service nova] Creating event network-vif-deleted:773cc058-6f5c-4279-b7fe-03240ae29a1a for instance edaa1a81-2913-4817-bd63-18ebf8b5fa2b on n-h2-858384-13 Oct 18 13:33:00.447299 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1ade6b6f-071a-4524-ac01-c87bb4888189 req-833bc692-ce1f-41b8-a3d6-2d3354a6fc2b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112443 Oct 18 13:33:00.449763 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1965/3720] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:00.463645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b5ec6d24-9728-4900-b8a5-8f305849f44e tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:00.464604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b5ec6d24-9728-4900-b8a5-8f305849f44e tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:00.473397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5ec6d24-9728-4900-b8a5-8f305849f44e tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.474275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5ec6d24-9728-4900-b8a5-8f305849f44e tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.476051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5ec6d24-9728-4900-b8a5-8f305849f44e tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.477817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5ec6d24-9728-4900-b8a5-8f305849f44e tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.479103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5ec6d24-9728-4900-b8a5-8f305849f44e tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.479789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5ec6d24-9728-4900-b8a5-8f305849f44e tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.535145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1ba28d5e-f75b-4016-bedf-1551a1df977d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.568318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1ba28d5e-f75b-4016-bedf-1551a1df977d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.576523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1ba28d5e-f75b-4016-bedf-1551a1df977d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:00.578098 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1ba28d5e-f75b-4016-bedf-1551a1df977d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 0.794712 Oct 18 13:33:00.590269 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1756/3721] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:32:59 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:00.793660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:00.794432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:00.804299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.808897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.809935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.811265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.813468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.814258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.923331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:00.924001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:00.926312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:00.926800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lazy-loading 'fault' on Instance uuid edaa1a81-2913-4817-bd63-18ebf8b5fa2b {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:01.014009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b5ec6d24-9728-4900-b8a5-8f305849f44e tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:01.027148 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b5ec6d24-9728-4900-b8a5-8f305849f44e tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1323 microversion: 2.1 time: 0.575258 Oct 18 13:33:01.037570 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1966/3722] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:00 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1323 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:01.048202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35276a270e8f46a28215737c2dbea762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61eb84fa8e2342b8bae22eeae31bcf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:01.061823 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ea0a3dc9-2b2f-49c2-bf8e-537e7ed478ee tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 200 len: 1311 microversion: 2.1 time: 0.272162 Oct 18 13:33:01.064235 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1757/3723] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:00 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 1311 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:01.187988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a3b6fa4f-6282-4239-bad4-c677ac16ced6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:01.189077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a3b6fa4f-6282-4239-bad4-c677ac16ced6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:01.212635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3b6fa4f-6282-4239-bad4-c677ac16ced6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.218279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3b6fa4f-6282-4239-bad4-c677ac16ced6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.218279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3b6fa4f-6282-4239-bad4-c677ac16ced6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.218616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3b6fa4f-6282-4239-bad4-c677ac16ced6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.227855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3b6fa4f-6282-4239-bad4-c677ac16ced6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.228585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3b6fa4f-6282-4239-bad4-c677ac16ced6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.378951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a3b6fa4f-6282-4239-bad4-c677ac16ced6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:01.388793 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a3b6fa4f-6282-4239-bad4-c677ac16ced6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1209 microversion: 2.1 time: 0.204976 Oct 18 13:33:01.392473 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1967/3724] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:01 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1209 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:01.613978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-373ec87f-5cbd-406b-bf0f-744ada20aeb0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:01.614736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-373ec87f-5cbd-406b-bf0f-744ada20aeb0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:01.622766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-373ec87f-5cbd-406b-bf0f-744ada20aeb0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.623380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-373ec87f-5cbd-406b-bf0f-744ada20aeb0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.623917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-373ec87f-5cbd-406b-bf0f-744ada20aeb0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:01.624748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-373ec87f-5cbd-406b-bf0f-744ada20aeb0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:01.625347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-373ec87f-5cbd-406b-bf0f-744ada20aeb0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:01.626591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-373ec87f-5cbd-406b-bf0f-744ada20aeb0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.065691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-81ca48ee-da6b-46f7-aa93-d6c19f823587 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:02.066413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-81ca48ee-da6b-46f7-aa93-d6c19f823587 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:02.080260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81ca48ee-da6b-46f7-aa93-d6c19f823587 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.081217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81ca48ee-da6b-46f7-aa93-d6c19f823587 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.084089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81ca48ee-da6b-46f7-aa93-d6c19f823587 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.085278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81ca48ee-da6b-46f7-aa93-d6c19f823587 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.086398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81ca48ee-da6b-46f7-aa93-d6c19f823587 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.087430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81ca48ee-da6b-46f7-aa93-d6c19f823587 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.216769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-373ec87f-5cbd-406b-bf0f-744ada20aeb0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:02.238413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-373ec87f-5cbd-406b-bf0f-744ada20aeb0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:02.244823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-373ec87f-5cbd-406b-bf0f-744ada20aeb0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:02.249052 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-373ec87f-5cbd-406b-bf0f-744ada20aeb0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 0.639552 Oct 18 13:33:02.269049 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1758/3725] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:01 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:02.279516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f2572ac-1d7e-442f-8f46-17068e53d222 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:02.280367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7f2572ac-1d7e-442f-8f46-17068e53d222 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] [instance: edaa1a81-2913-4817-bd63-18ebf8b5fa2b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:02.288005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f2572ac-1d7e-442f-8f46-17068e53d222 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.289615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f2572ac-1d7e-442f-8f46-17068e53d222 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.290260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f2572ac-1d7e-442f-8f46-17068e53d222 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.291247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f2572ac-1d7e-442f-8f46-17068e53d222 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.291902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f2572ac-1d7e-442f-8f46-17068e53d222 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.292531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f2572ac-1d7e-442f-8f46-17068e53d222 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.313218 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-7f2572ac-1d7e-442f-8f46-17068e53d222 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] HTTP exception thrown: Instance edaa1a81-2913-4817-bd63-18ebf8b5fa2b could not be found. Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f2572ac-1d7e-442f-8f46-17068e53d222 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Request method failure captured: Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b HTTP/1.1 Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqqtQ9fZHDN7Xh7Csc4h5jBXZ9EzJlCqb7YqHz9ULF50n8z5GWi8906crJPM-tWaLDnEiVKzm8VSYGuFMdzp1aQ9hoNN9Qh1E4op37d_QjkD0FlqhVlT0KH1jKnjnG6R7Mvbv3yUWEUhHmnq0-rhl6EC-yjXPc5ZOfG4iPhb2l5vg4o Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 61eb84fa8e2342b8bae22eeae31bcf8d Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ListServerFiltersTestJSON-1766072609 Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/61eb84fa8e2342b8bae22eeae31bcf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/61eb84fa8e2342b8bae22eeae31bcf8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/61eb84fa8e2342b8bae22eeae31bcf8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_61eb84fa8e2342b8bae22eeae31bcf8d"}]}] Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ListServerFiltersTestJSON-1766072609 Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 61eb84fa8e2342b8bae22eeae31bcf8d Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1766072609 Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ListServerFiltersTestJSON-1766072609-project Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 35276a270e8f46a28215737c2dbea762 Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ListServerFiltersTestJSON-1766072609-project Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance edaa1a81-2913-4817-bd63-18ebf8b5fa2b could not be found. Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'edaa1a81-2913-4817-bd63-18ebf8b5fa2b'} Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edaa1a81-2913-4817-bd63-18ebf8b5fa2b could not be found. Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edaa1a81-2913-4817-bd63-18ebf8b5fa2b could not be found. Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:02.315627 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:02.321304 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:02.321304 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:02.321304 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:02.321304 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:02.321304 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:02.321304 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edaa1a81-2913-4817-bd63-18ebf8b5fa2b could not be found. Oct 18 13:33:02.321304 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:02.324174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f2572ac-1d7e-442f-8f46-17068e53d222 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] Returning 404 to user: Instance edaa1a81-2913-4817-bd63-18ebf8b5fa2b could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:02.325349 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7f2572ac-1d7e-442f-8f46-17068e53d222 tempest-ListServerFiltersTestJSON-1766072609 tempest-ListServerFiltersTestJSON-1766072609-project] 10.222.0.40 "GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b" status: 404 len: 111 microversion: 2.1 time: 0.054388 Oct 18 13:33:02.327013 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1759/3726] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:02 2022] GET /compute/v2.1/servers/edaa1a81-2913-4817-bd63-18ebf8b5fa2b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:02.394980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-81ca48ee-da6b-46f7-aa93-d6c19f823587 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:02.406566 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-81ca48ee-da6b-46f7-aa93-d6c19f823587 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1323 microversion: 2.1 time: 0.350801 Oct 18 13:33:02.418622 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1968/3727] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:02 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:02.419306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2d6d4df4-deec-4afb-8b65-79aecce10e83 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:02.421590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2d6d4df4-deec-4afb-8b65-79aecce10e83 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:02.435646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d6d4df4-deec-4afb-8b65-79aecce10e83 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.436612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d6d4df4-deec-4afb-8b65-79aecce10e83 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.440528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d6d4df4-deec-4afb-8b65-79aecce10e83 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.442735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d6d4df4-deec-4afb-8b65-79aecce10e83 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:02.443752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d6d4df4-deec-4afb-8b65-79aecce10e83 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:02.444414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d6d4df4-deec-4afb-8b65-79aecce10e83 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:02.601166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2d6d4df4-deec-4afb-8b65-79aecce10e83 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:02.615616 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2d6d4df4-deec-4afb-8b65-79aecce10e83 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1271 microversion: 2.1 time: 0.203566 Oct 18 13:33:02.620645 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1760/3728] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:02 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:03.029442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-292760044", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:03.115484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b7b448c3-3b99-45fe-b68d-e9c7f330298a req-1640be7f-5d73-499d-bcfc-2db8e26ef2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a8797f-2b84-44d0-b925-5115ecdeea0d", "name": "network-vif-plugged", "status": "completed", "tag": "7d99fb30-ea22-4ee8-aca6-1d4f06679c96"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:03.140893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] validate_networks() for [('97315d5a-8b0e-47cc-9e64-1e8e92c88ddc', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:33:03.142150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b7b448c3-3b99-45fe-b68d-e9c7f330298a req-1640be7f-5d73-499d-bcfc-2db8e26ef2e0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:03.143111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b7b448c3-3b99-45fe-b68d-e9c7f330298a req-1640be7f-5d73-499d-bcfc-2db8e26ef2e0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:03.143786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b7b448c3-3b99-45fe-b68d-e9c7f330298a req-1640be7f-5d73-499d-bcfc-2db8e26ef2e0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:03.166541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:03.168934 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b7b448c3-3b99-45fe-b68d-e9c7f330298a req-1640be7f-5d73-499d-bcfc-2db8e26ef2e0 service nova] Creating event network-vif-plugged:7d99fb30-ea22-4ee8-aca6-1d4f06679c96 for instance d1a8797f-2b84-44d0-b925-5115ecdeea0d on n-h1-858384-13 Oct 18 13:33:03.180399 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b7b448c3-3b99-45fe-b68d-e9c7f330298a req-1640be7f-5d73-499d-bcfc-2db8e26ef2e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069113 Oct 18 13:33:03.181015 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1761/3729] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:03.276866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ecce5c7b-90fb-4a79-a137-b0b09596d726 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:03.277692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ecce5c7b-90fb-4a79-a137-b0b09596d726 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:03.293678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ecce5c7b-90fb-4a79-a137-b0b09596d726 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:03.294169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ecce5c7b-90fb-4a79-a137-b0b09596d726 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:03.294663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ecce5c7b-90fb-4a79-a137-b0b09596d726 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:03.295365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ecce5c7b-90fb-4a79-a137-b0b09596d726 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:03.299396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ecce5c7b-90fb-4a79-a137-b0b09596d726 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:03.300013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ecce5c7b-90fb-4a79-a137-b0b09596d726 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:03.769292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ecce5c7b-90fb-4a79-a137-b0b09596d726 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:03.778502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ecce5c7b-90fb-4a79-a137-b0b09596d726 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:03.779952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ecce5c7b-90fb-4a79-a137-b0b09596d726 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:03.781207 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ecce5c7b-90fb-4a79-a137-b0b09596d726 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 0.508645 Oct 18 13:33:03.793698 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1762/3730] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:03 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:03.808726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0c4e7fc9-74fa-4fb4-9ac2-51ffa4498a8f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:03.810101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0c4e7fc9-74fa-4fb4-9ac2-51ffa4498a8f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:03.823214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c4e7fc9-74fa-4fb4-9ac2-51ffa4498a8f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:03.824384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c4e7fc9-74fa-4fb4-9ac2-51ffa4498a8f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:03.825048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c4e7fc9-74fa-4fb4-9ac2-51ffa4498a8f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:03.826329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c4e7fc9-74fa-4fb4-9ac2-51ffa4498a8f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:03.826967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c4e7fc9-74fa-4fb4-9ac2-51ffa4498a8f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:03.827570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c4e7fc9-74fa-4fb4-9ac2-51ffa4498a8f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:04.123484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0c4e7fc9-74fa-4fb4-9ac2-51ffa4498a8f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:04.140146 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0c4e7fc9-74fa-4fb4-9ac2-51ffa4498a8f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1323 microversion: 2.1 time: 0.344608 Oct 18 13:33:04.188692 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1763/3731] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:03 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1323 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:04.202695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-837a1d4f-0799-4a61-a113-65d428fb35b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:04.203601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-837a1d4f-0799-4a61-a113-65d428fb35b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:04.213793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-837a1d4f-0799-4a61-a113-65d428fb35b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:04.214540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-837a1d4f-0799-4a61-a113-65d428fb35b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:04.215140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-837a1d4f-0799-4a61-a113-65d428fb35b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:04.216660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-837a1d4f-0799-4a61-a113-65d428fb35b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:04.217312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-837a1d4f-0799-4a61-a113-65d428fb35b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:04.217944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-837a1d4f-0799-4a61-a113-65d428fb35b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:04.439548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-837a1d4f-0799-4a61-a113-65d428fb35b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:04.448752 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-837a1d4f-0799-4a61-a113-65d428fb35b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1313 microversion: 2.1 time: 0.258463 Oct 18 13:33:04.450068 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1764/3732] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:04 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:04.455968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-569587661", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "7009cfb7-731a-475d-866b-3727e8f69885"}], "security_groups": [{"name": "tempest-securitygroup--1403542975"}], "key_name": "tempest-keypair-1405522993", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:04.643424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] validate_networks() for [('7009cfb7-731a-475d-866b-3727e8f69885', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:33:05.045786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:33:05.046347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:33:05.046751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:33:05.047693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:33:05.048941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:33:05.065935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.066892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.069763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.072184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.074319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.076106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.146147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Getting quotas for project d72f3fa595014256865e3f5c83df7c6e. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:33:05.154100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Getting quotas for user 99a7a4b4e4c149a28cfbf83a0539f04c and project d72f3fa595014256865e3f5c83df7c6e. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:33:05.170762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:33:05.175339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:33:05.274451 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cc06583f-1da9-4369-93f3-0139c4b19cbc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.358068 Oct 18 13:33:05.276251 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1969/3733] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:33:05.284733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e5412cba-4ca1-4962-bcc0-7fc583e67bf5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:05.287214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e5412cba-4ca1-4962-bcc0-7fc583e67bf5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:05.300784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5412cba-4ca1-4962-bcc0-7fc583e67bf5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.302114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5412cba-4ca1-4962-bcc0-7fc583e67bf5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.302902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5412cba-4ca1-4962-bcc0-7fc583e67bf5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.307416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5412cba-4ca1-4962-bcc0-7fc583e67bf5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.308647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5412cba-4ca1-4962-bcc0-7fc583e67bf5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.310017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5412cba-4ca1-4962-bcc0-7fc583e67bf5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.353786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:33:05.354334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:33:05.354850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:33:05.355492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:33:05.356230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:33:05.380109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.380593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.382589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.385055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.387421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.388109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.437116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Getting quotas for project 3ec155a5641940afb3f80c12e83c57ec. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:33:05.463949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Getting quotas for user eab6be43a2404bf1889cc592466bee4e and project 3ec155a5641940afb3f80c12e83c57ec. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:33:05.502037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:33:05.505153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:33:05.632474 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a66f3658-0436-4850-a7dc-ea255a619256 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.179830 Oct 18 13:33:05.639043 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1765/3734] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:33:05.646238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a899f3f5-ddb8-4163-a393-7798c36b19d4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:05.646854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a899f3f5-ddb8-4163-a393-7798c36b19d4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:05.670917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a899f3f5-ddb8-4163-a393-7798c36b19d4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.670917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a899f3f5-ddb8-4163-a393-7798c36b19d4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.671346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a899f3f5-ddb8-4163-a393-7798c36b19d4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:05.672051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a899f3f5-ddb8-4163-a393-7798c36b19d4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:05.673818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a899f3f5-ddb8-4163-a393-7798c36b19d4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:05.674332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a899f3f5-ddb8-4163-a393-7798c36b19d4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:06.059229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e5412cba-4ca1-4962-bcc0-7fc583e67bf5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:06.071647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e5412cba-4ca1-4962-bcc0-7fc583e67bf5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:06.087715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e5412cba-4ca1-4962-bcc0-7fc583e67bf5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:06.094953 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e5412cba-4ca1-4962-bcc0-7fc583e67bf5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 0.814194 Oct 18 13:33:06.100108 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1970/3735] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:05 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:06.117088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-00b3757c-1f1e-4eb3-9728-031be1d4a4fa tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:06.119349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-00b3757c-1f1e-4eb3-9728-031be1d4a4fa tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:06.262924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-00b3757c-1f1e-4eb3-9728-031be1d4a4fa tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:06.272485 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-00b3757c-1f1e-4eb3-9728-031be1d4a4fa tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1216 microversion: 2.1 time: 0.171060 Oct 18 13:33:06.273080 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1971/3736] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:06 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:06.283781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d261ba7-a407-4166-8d18-776bb0df7ba8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:06.302712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3d261ba7-a407-4166-8d18-776bb0df7ba8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:06.314598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a899f3f5-ddb8-4163-a393-7798c36b19d4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:06.324720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d261ba7-a407-4166-8d18-776bb0df7ba8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:06.325163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d261ba7-a407-4166-8d18-776bb0df7ba8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:06.325642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d261ba7-a407-4166-8d18-776bb0df7ba8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:06.326361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d261ba7-a407-4166-8d18-776bb0df7ba8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:06.326822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d261ba7-a407-4166-8d18-776bb0df7ba8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:06.327254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d261ba7-a407-4166-8d18-776bb0df7ba8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:06.349280 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a899f3f5-ddb8-4163-a393-7798c36b19d4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1520 microversion: 2.1 time: 0.709015 Oct 18 13:33:06.349890 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1766/3737] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:05 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1520 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:06.367141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-281e8a70-38e1-4665-a07d-d2dd92de96e6 req-4466efb3-4774-470b-abef-3efbba0153d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa292c2-3801-4d84-b31a-4d3eeeb41818", "name": "network-vif-plugged", "status": "completed", "tag": "8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:06.403603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-281e8a70-38e1-4665-a07d-d2dd92de96e6 req-4466efb3-4774-470b-abef-3efbba0153d1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:06.425726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-281e8a70-38e1-4665-a07d-d2dd92de96e6 req-4466efb3-4774-470b-abef-3efbba0153d1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:06.425956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-281e8a70-38e1-4665-a07d-d2dd92de96e6 req-4466efb3-4774-470b-abef-3efbba0153d1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:06.497871 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-281e8a70-38e1-4665-a07d-d2dd92de96e6 req-4466efb3-4774-470b-abef-3efbba0153d1 service nova] Creating event network-vif-plugged:8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa for instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 on n-h2-858384-13 Oct 18 13:33:06.523104 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-281e8a70-38e1-4665-a07d-d2dd92de96e6 req-4466efb3-4774-470b-abef-3efbba0153d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169019 Oct 18 13:33:06.524158 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1767/3738] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:06.538822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fc832784-570d-44eb-b86e-4d2c53f27c12 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:06.541939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fc832784-570d-44eb-b86e-4d2c53f27c12 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:06.679398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fc832784-570d-44eb-b86e-4d2c53f27c12 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:06.690552 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fc832784-570d-44eb-b86e-4d2c53f27c12 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1241 microversion: 2.1 time: 0.163130 Oct 18 13:33:06.694412 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1768/3739] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:06 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1241 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:06.698853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ffe499c2-4b8a-449b-ab65-cfc5ce92f863 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-808942715", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "179c2b2e-8f5f-4957-9d40-71ca983fd20f"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ffe499c2-4b8a-449b-ab65-cfc5ce92f863 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Request method failure captured: Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 242 Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqr29E9i7LJa-9KyQZJ0XGHI53Lt91XXDoO8WfTc2iuUNEugrZBDo3z46VQNiL7NZxbPO1R7S0uvsaMHjJn3KK72jIZy0FXHaEzQ5MZVZTydDclpY9XROT2cqXL53t-2-xwVhBu5nQg91xLOwzsF45k3vUcyxMb8abUWnxsowGl3HSI Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_adecadde75c5450cbbacb33a6eed63c6"}]}] Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 6498058370ca4841b84fb6be162573e7 Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-808942715", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "179c2b2e-8f5f-4957-9d40-71ca983fd20f"}]}} Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-808942715', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '179c2b2e-8f5f-4957-9d40-71ca983fd20f'}]}}} Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:06.721865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:06.726716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:06.732438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ffe499c2-4b8a-449b-ab65-cfc5ce92f863 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:06.736755 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ffe499c2-4b8a-449b-ab65-cfc5ce92f863 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.041714 Oct 18 13:33:06.739179 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1769/3740] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:06 2022] POST /compute/v2.1/servers => generated 175 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:33:06.757085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1582f4b6-a730-4070-827a-41ec86db8492 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:06.759492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1582f4b6-a730-4070-827a-41ec86db8492 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: 999fc27b-c69f-4803-bb00-80d75c48de1e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:06.775263 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-1582f4b6-a730-4070-827a-41ec86db8492 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] HTTP exception thrown: Instance 999fc27b-c69f-4803-bb00-80d75c48de1e could not be found. Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1582f4b6-a730-4070-827a-41ec86db8492 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Request method failure captured: Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/999fc27b-c69f-4803-bb00-80d75c48de1e/metadata HTTP/1.1 Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqr29E9i7LJa-9KyQZJ0XGHI53Lt91XXDoO8WfTc2iuUNEugrZBDo3z46VQNiL7NZxbPO1R7S0uvsaMHjJn3KK72jIZy0FXHaEzQ5MZVZTydDclpY9XROT2cqXL53t-2-xwVhBu5nQg91xLOwzsF45k3vUcyxMb8abUWnxsowGl3HSI Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_adecadde75c5450cbbacb33a6eed63c6"}]}] Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 6498058370ca4841b84fb6be162573e7 Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 999fc27b-c69f-4803-bb00-80d75c48de1e could not be found. Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'server_id': '999fc27b-c69f-4803-bb00-80d75c48de1e'} Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999fc27b-c69f-4803-bb00-80d75c48de1e could not be found. Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999fc27b-c69f-4803-bb00-80d75c48de1e could not be found. Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:06.784683 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:06.789835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:06.789835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:06.789835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999fc27b-c69f-4803-bb00-80d75c48de1e could not be found. Oct 18 13:33:06.789835 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:06.789835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1582f4b6-a730-4070-827a-41ec86db8492 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Returning 404 to user: Instance 999fc27b-c69f-4803-bb00-80d75c48de1e could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:06.790766 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1582f4b6-a730-4070-827a-41ec86db8492 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/999fc27b-c69f-4803-bb00-80d75c48de1e/metadata" status: 404 len: 111 microversion: 2.1 time: 0.043590 Oct 18 13:33:06.795887 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1770/3741] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:33:06 2022] GET /compute/v2.1/servers/999fc27b-c69f-4803-bb00-80d75c48de1e/metadata => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:33:07.058643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3d261ba7-a407-4166-8d18-776bb0df7ba8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:07.075134 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3d261ba7-a407-4166-8d18-776bb0df7ba8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1313 microversion: 2.1 time: 0.799945 Oct 18 13:33:07.080349 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1972/3742] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:06 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1313 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:07.129847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-463b19a6-0d6e-413e-b7f4-1a28dd8d144a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:07.130507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-463b19a6-0d6e-413e-b7f4-1a28dd8d144a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:07.137167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0f117ca7-9fba-4ae6-9fe2-aa9cdf7784e4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1617471960", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "179c2b2e-8f5f-4957-9d40-71ca983fd20f"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0f117ca7-9fba-4ae6-9fe2-aa9cdf7784e4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Request method failure captured: Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 499 Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqr29E9i7LJa-9KyQZJ0XGHI53Lt91XXDoO8WfTc2iuUNEugrZBDo3z46VQNiL7NZxbPO1R7S0uvsaMHjJn3KK72jIZy0FXHaEzQ5MZVZTydDclpY9XROT2cqXL53t-2-xwVhBu5nQg91xLOwzsF45k3vUcyxMb8abUWnxsowGl3HSI Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_adecadde75c5450cbbacb33a6eed63c6"}]}] Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6498058370ca4841b84fb6be162573e7 Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1617471960", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "179c2b2e-8f5f-4957-9d40-71ca983fd20f"}]}} Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1617471960', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '179c2b2e-8f5f-4957-9d40-71ca983fd20f'}]}}} Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 13:33:07.144358 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:07.148359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.154374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0f117ca7-9fba-4ae6-9fe2-aa9cdf7784e4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:07.154374 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0f117ca7-9fba-4ae6-9fe2-aa9cdf7784e4 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.022007 Oct 18 13:33:07.157280 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1973/3743] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:07 2022] POST /compute/v2.1/servers => generated 687 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:33:07.186541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-463b19a6-0d6e-413e-b7f4-1a28dd8d144a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:07.191828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-463b19a6-0d6e-413e-b7f4-1a28dd8d144a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:07.192139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-463b19a6-0d6e-413e-b7f4-1a28dd8d144a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:07.198728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-463b19a6-0d6e-413e-b7f4-1a28dd8d144a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:07.203703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-463b19a6-0d6e-413e-b7f4-1a28dd8d144a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:07.205716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-463b19a6-0d6e-413e-b7f4-1a28dd8d144a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:07.300749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b88a6dee-8120-4845-9000-a906825a88c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:07.301930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b88a6dee-8120-4845-9000-a906825a88c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:07.334680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b88a6dee-8120-4845-9000-a906825a88c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:07.335590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b88a6dee-8120-4845-9000-a906825a88c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:07.336272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b88a6dee-8120-4845-9000-a906825a88c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:07.337346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b88a6dee-8120-4845-9000-a906825a88c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:07.337977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b88a6dee-8120-4845-9000-a906825a88c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:07.338639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b88a6dee-8120-4845-9000-a906825a88c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:07.602840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b88a6dee-8120-4845-9000-a906825a88c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:07.619002 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b88a6dee-8120-4845-9000-a906825a88c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1268 microversion: 2.1 time: 0.323858 Oct 18 13:33:07.622136 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1974/3744] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:07 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1268 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:07.638556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2075e5c1-52c9-484a-a504-c241ca584376 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-154033888", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "179c2b2e-8f5f-4957-9d40-71ca983fd20f"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2075e5c1-52c9-484a-a504-c241ca584376 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Request method failure captured: Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 499 Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqr29E9i7LJa-9KyQZJ0XGHI53Lt91XXDoO8WfTc2iuUNEugrZBDo3z46VQNiL7NZxbPO1R7S0uvsaMHjJn3KK72jIZy0FXHaEzQ5MZVZTydDclpY9XROT2cqXL53t-2-xwVhBu5nQg91xLOwzsF45k3vUcyxMb8abUWnxsowGl3HSI Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_adecadde75c5450cbbacb33a6eed63c6"}]}] Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6498058370ca4841b84fb6be162573e7 Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-154033888", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "179c2b2e-8f5f-4957-9d40-71ca983fd20f"}]}} Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-154033888', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '179c2b2e-8f5f-4957-9d40-71ca983fd20f'}]}}} Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 13:33:07.656258 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:07.661379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2075e5c1-52c9-484a-a504-c241ca584376 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:07.665656 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2075e5c1-52c9-484a-a504-c241ca584376 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.039131 Oct 18 13:33:07.677484 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1975/3745] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:07 2022] POST /compute/v2.1/servers => generated 689 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:33:07.714748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-94dbf4c3-28e2-48e5-8ddd-cc26638b3dcf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:07.715533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-94dbf4c3-28e2-48e5-8ddd-cc26638b3dcf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:07.732455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94dbf4c3-28e2-48e5-8ddd-cc26638b3dcf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:07.732995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94dbf4c3-28e2-48e5-8ddd-cc26638b3dcf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:07.733475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94dbf4c3-28e2-48e5-8ddd-cc26638b3dcf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:07.734242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94dbf4c3-28e2-48e5-8ddd-cc26638b3dcf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:07.741813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94dbf4c3-28e2-48e5-8ddd-cc26638b3dcf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:07.742768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94dbf4c3-28e2-48e5-8ddd-cc26638b3dcf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.012865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-463b19a6-0d6e-413e-b7f4-1a28dd8d144a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:08.039185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-463b19a6-0d6e-413e-b7f4-1a28dd8d144a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:08.046678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-463b19a6-0d6e-413e-b7f4-1a28dd8d144a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:08.054836 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-463b19a6-0d6e-413e-b7f4-1a28dd8d144a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1407 microversion: 2.20 time: 0.931365 Oct 18 13:33:08.057526 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1771/3746] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:07 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1407 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:08.072516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2eb20286-a6ee-4d24-b8a0-3b850a5f9962 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1388369285", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "179c2b2e-8f5f-4957-9d40-71ca983fd20f"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2eb20286-a6ee-4d24-b8a0-3b850a5f9962 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Request method failure captured: Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 754 Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqr29E9i7LJa-9KyQZJ0XGHI53Lt91XXDoO8WfTc2iuUNEugrZBDo3z46VQNiL7NZxbPO1R7S0uvsaMHjJn3KK72jIZy0FXHaEzQ5MZVZTydDclpY9XROT2cqXL53t-2-xwVhBu5nQg91xLOwzsF45k3vUcyxMb8abUWnxsowGl3HSI Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_adecadde75c5450cbbacb33a6eed63c6"}]}] Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 6498058370ca4841b84fb6be162573e7 Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1388369285", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "179c2b2e-8f5f-4957-9d40-71ca983fd20f"}]}} Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1388369285', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '179c2b2e-8f5f-4957-9d40-71ca983fd20f'}]}}} Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:33:08.084327 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:33:08.087784 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:33:08.093854 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:08.093854 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.110556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2eb20286-a6ee-4d24-b8a0-3b850a5f9962 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:08.114394 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2eb20286-a6ee-4d24-b8a0-3b850a5f9962 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.055810 Oct 18 13:33:08.116309 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1772/3747] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:08 2022] POST /compute/v2.1/servers => generated 1197 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 18 13:33:08.148202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6392f7a5-2656-4b1c-90f7-d0f7d42948bd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:08.151258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6392f7a5-2656-4b1c-90f7-d0f7d42948bd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:08.178095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6392f7a5-2656-4b1c-90f7-d0f7d42948bd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.178597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6392f7a5-2656-4b1c-90f7-d0f7d42948bd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.179036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6392f7a5-2656-4b1c-90f7-d0f7d42948bd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.179749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6392f7a5-2656-4b1c-90f7-d0f7d42948bd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.180199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6392f7a5-2656-4b1c-90f7-d0f7d42948bd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.185036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6392f7a5-2656-4b1c-90f7-d0f7d42948bd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.218519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-94dbf4c3-28e2-48e5-8ddd-cc26638b3dcf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:08.231937 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-94dbf4c3-28e2-48e5-8ddd-cc26638b3dcf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1293 microversion: 2.1 time: 0.521412 Oct 18 13:33:08.232569 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1976/3748] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:07 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1293 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:08.450885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d5bffbb1-9dc0-4e98-83be-59109ac3f78f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-750179168", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "179c2b2e-8f5f-4957-9d40-71ca983fd20f"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d5bffbb1-9dc0-4e98-83be-59109ac3f78f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Request method failure captured: Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 1265 Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqr29E9i7LJa-9KyQZJ0XGHI53Lt91XXDoO8WfTc2iuUNEugrZBDo3z46VQNiL7NZxbPO1R7S0uvsaMHjJn3KK72jIZy0FXHaEzQ5MZVZTydDclpY9XROT2cqXL53t-2-xwVhBu5nQg91xLOwzsF45k3vUcyxMb8abUWnxsowGl3HSI Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_adecadde75c5450cbbacb33a6eed63c6"}]}] Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6498058370ca4841b84fb6be162573e7 Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-750179168", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "179c2b2e-8f5f-4957-9d40-71ca983fd20f"}]}} Oct 18 13:33:08.462363 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-750179168', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '179c2b2e-8f5f-4957-9d40-71ca983fd20f'}]}}} Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.465241 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:33:08.466755 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:33:08.470936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 18 13:33:08.470936 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.473715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d5bffbb1-9dc0-4e98-83be-59109ac3f78f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:08.474710 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d5bffbb1-9dc0-4e98-83be-59109ac3f78f tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.028236 Oct 18 13:33:08.475302 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1977/3749] 10.222.0.40 () {60 vars in 1148 bytes} [Tue Oct 18 13:33:08 2022] POST /compute/v2.1/servers => generated 2221 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 18 13:33:08.499724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2aff9a05-146a-4209-b89e-cca0acb28996 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:08.506870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2aff9a05-146a-4209-b89e-cca0acb28996 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: 853bf1d8-68a8-494e-ae4c-09130ae03768] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:08.530558 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-2aff9a05-146a-4209-b89e-cca0acb28996 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] HTTP exception thrown: Instance 853bf1d8-68a8-494e-ae4c-09130ae03768 could not be found. Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2aff9a05-146a-4209-b89e-cca0acb28996 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Request method failure captured: Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/853bf1d8-68a8-494e-ae4c-09130ae03768/metadata/test2 HTTP/1.1 Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqr29E9i7LJa-9KyQZJ0XGHI53Lt91XXDoO8WfTc2iuUNEugrZBDo3z46VQNiL7NZxbPO1R7S0uvsaMHjJn3KK72jIZy0FXHaEzQ5MZVZTydDclpY9XROT2cqXL53t-2-xwVhBu5nQg91xLOwzsF45k3vUcyxMb8abUWnxsowGl3HSI Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_adecadde75c5450cbbacb33a6eed63c6"}]}] Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6498058370ca4841b84fb6be162573e7 Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 853bf1d8-68a8-494e-ae4c-09130ae03768 could not be found. Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'server_id': '853bf1d8-68a8-494e-ae4c-09130ae03768', 'id': 'test2'} Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 853bf1d8-68a8-494e-ae4c-09130ae03768 could not be found. Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 853bf1d8-68a8-494e-ae4c-09130ae03768 could not be found. Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:08.533514 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:08.539013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:08.539013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:08.539013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 853bf1d8-68a8-494e-ae4c-09130ae03768 could not be found. Oct 18 13:33:08.539013 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:08.539013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2aff9a05-146a-4209-b89e-cca0acb28996 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Returning 404 to user: Instance 853bf1d8-68a8-494e-ae4c-09130ae03768 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:08.539013 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2aff9a05-146a-4209-b89e-cca0acb28996 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/853bf1d8-68a8-494e-ae4c-09130ae03768/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.045265 Oct 18 13:33:08.565308 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1978/3750] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 18 13:33:08 2022] GET /compute/v2.1/servers/853bf1d8-68a8-494e-ae4c-09130ae03768/metadata/test2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:08.584380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-66f4790d-e9ef-4935-a08a-f77838ce40db tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:08.584882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-66f4790d-e9ef-4935-a08a-f77838ce40db tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:08.603361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66f4790d-e9ef-4935-a08a-f77838ce40db tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.603904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66f4790d-e9ef-4935-a08a-f77838ce40db tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.604300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66f4790d-e9ef-4935-a08a-f77838ce40db tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.605013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66f4790d-e9ef-4935-a08a-f77838ce40db tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:08.611250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66f4790d-e9ef-4935-a08a-f77838ce40db tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:08.611797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66f4790d-e9ef-4935-a08a-f77838ce40db tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:08.738140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-66f4790d-e9ef-4935-a08a-f77838ce40db tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:33:08.990767 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-66f4790d-e9ef-4935-a08a-f77838ce40db tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 204 len: 0 microversion: 2.1 time: 0.423947 Oct 18 13:33:08.997880 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1979/3751] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:33:08 2022] DELETE /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:33:09.010123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b220d8bf-715c-456b-a024-06494b82e5bb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:09.021298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b220d8bf-715c-456b-a024-06494b82e5bb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:09.036955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b220d8bf-715c-456b-a024-06494b82e5bb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.037544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b220d8bf-715c-456b-a024-06494b82e5bb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.038844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b220d8bf-715c-456b-a024-06494b82e5bb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.039807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b220d8bf-715c-456b-a024-06494b82e5bb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.041215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b220d8bf-715c-456b-a024-06494b82e5bb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.041859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b220d8bf-715c-456b-a024-06494b82e5bb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.065771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6392f7a5-2656-4b1c-90f7-d0f7d42948bd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:09.086872 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6392f7a5-2656-4b1c-90f7-d0f7d42948bd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1334 microversion: 2.1 time: 0.965861 Oct 18 13:33:09.101922 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1773/3752] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:08 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1334 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:09.117205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea83158c-5058-4e99-bbab-b9a6822a7f6d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:09.117817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ea83158c-5058-4e99-bbab-b9a6822a7f6d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:09.150788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea83158c-5058-4e99-bbab-b9a6822a7f6d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.151276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea83158c-5058-4e99-bbab-b9a6822a7f6d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.151713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea83158c-5058-4e99-bbab-b9a6822a7f6d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.152583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea83158c-5058-4e99-bbab-b9a6822a7f6d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.153033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea83158c-5058-4e99-bbab-b9a6822a7f6d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.153506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea83158c-5058-4e99-bbab-b9a6822a7f6d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.290775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b220d8bf-715c-456b-a024-06494b82e5bb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:09.300921 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b220d8bf-715c-456b-a024-06494b82e5bb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1274 microversion: 2.1 time: 0.299842 Oct 18 13:33:09.320818 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1980/3753] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:08 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1274 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:09.327408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0fb27995-9160-4bbd-97de-4c3a0ae385b3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:09.328417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0fb27995-9160-4bbd-97de-4c3a0ae385b3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:09.337419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fb27995-9160-4bbd-97de-4c3a0ae385b3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.338548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fb27995-9160-4bbd-97de-4c3a0ae385b3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.342236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fb27995-9160-4bbd-97de-4c3a0ae385b3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.346793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fb27995-9160-4bbd-97de-4c3a0ae385b3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.350674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fb27995-9160-4bbd-97de-4c3a0ae385b3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.351986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fb27995-9160-4bbd-97de-4c3a0ae385b3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.495186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ea83158c-5058-4e99-bbab-b9a6822a7f6d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:09.505658 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ea83158c-5058-4e99-bbab-b9a6822a7f6d tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1526 microversion: 2.1 time: 0.402572 Oct 18 13:33:09.506256 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1774/3754] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:09 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1526 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:09.512950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-394d4c5a-e70a-46c9-ab40-e635f6585446 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:09.513839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-394d4c5a-e70a-46c9-ab40-e635f6585446 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:09.525353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-394d4c5a-e70a-46c9-ab40-e635f6585446 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.525714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-394d4c5a-e70a-46c9-ab40-e635f6585446 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.526183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-394d4c5a-e70a-46c9-ab40-e635f6585446 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.532245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-394d4c5a-e70a-46c9-ab40-e635f6585446 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:09.532865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-394d4c5a-e70a-46c9-ab40-e635f6585446 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:09.538852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-394d4c5a-e70a-46c9-ab40-e635f6585446 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:09.701950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-394d4c5a-e70a-46c9-ab40-e635f6585446 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:09.712582 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-394d4c5a-e70a-46c9-ab40-e635f6585446 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1299 microversion: 2.1 time: 0.203389 Oct 18 13:33:09.730372 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1775/3755] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:09 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1299 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:10.120664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4eadd1f8-53ae-4dd2-a17f-14d4d5656ad7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:10.121782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4eadd1f8-53ae-4dd2-a17f-14d4d5656ad7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:10.141455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4eadd1f8-53ae-4dd2-a17f-14d4d5656ad7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.144384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4eadd1f8-53ae-4dd2-a17f-14d4d5656ad7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.146737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4eadd1f8-53ae-4dd2-a17f-14d4d5656ad7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.148194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4eadd1f8-53ae-4dd2-a17f-14d4d5656ad7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.149154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4eadd1f8-53ae-4dd2-a17f-14d4d5656ad7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.149847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4eadd1f8-53ae-4dd2-a17f-14d4d5656ad7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.169706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0fb27995-9160-4bbd-97de-4c3a0ae385b3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:10.181681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0fb27995-9160-4bbd-97de-4c3a0ae385b3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:10.185523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0fb27995-9160-4bbd-97de-4c3a0ae385b3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:10.189645 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0fb27995-9160-4bbd-97de-4c3a0ae385b3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1599 microversion: 2.20 time: 0.867205 Oct 18 13:33:10.193299 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1981/3756] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:09 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1599 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:10.221586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-22d2bf14-4587-4349-ab6b-d273eaefa6f2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:10.222113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-22d2bf14-4587-4349-ab6b-d273eaefa6f2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:10.228308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22d2bf14-4587-4349-ab6b-d273eaefa6f2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.228788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22d2bf14-4587-4349-ab6b-d273eaefa6f2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.229240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22d2bf14-4587-4349-ab6b-d273eaefa6f2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.229940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22d2bf14-4587-4349-ab6b-d273eaefa6f2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.230381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22d2bf14-4587-4349-ab6b-d273eaefa6f2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.247047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22d2bf14-4587-4349-ab6b-d273eaefa6f2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.496750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4eadd1f8-53ae-4dd2-a17f-14d4d5656ad7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:10.507386 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4eadd1f8-53ae-4dd2-a17f-14d4d5656ad7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1334 microversion: 2.1 time: 0.393910 Oct 18 13:33:10.529000 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1776/3757] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:10 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1334 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:10.536872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-959c0fb6-46e0-4fa2-9daf-a547a3caa8fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:10.537534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-959c0fb6-46e0-4fa2-9daf-a547a3caa8fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:10.543962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-959c0fb6-46e0-4fa2-9daf-a547a3caa8fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.546457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-959c0fb6-46e0-4fa2-9daf-a547a3caa8fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.547148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-959c0fb6-46e0-4fa2-9daf-a547a3caa8fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.549908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-959c0fb6-46e0-4fa2-9daf-a547a3caa8fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.552976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-959c0fb6-46e0-4fa2-9daf-a547a3caa8fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.553422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-959c0fb6-46e0-4fa2-9daf-a547a3caa8fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.668420 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-22d2bf14-4587-4349-ab6b-d273eaefa6f2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.450824 Oct 18 13:33:10.669498 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1982/3758] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 18 13:33:10 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-interface => generated 284 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:33:10.677253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c6ab8c97-1caf-41f9-ac12-f923d51a5ebb tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:10.678151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c6ab8c97-1caf-41f9-ac12-f923d51a5ebb tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:10.712911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6ab8c97-1caf-41f9-ac12-f923d51a5ebb tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.714995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6ab8c97-1caf-41f9-ac12-f923d51a5ebb tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.716782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6ab8c97-1caf-41f9-ac12-f923d51a5ebb tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:10.724167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6ab8c97-1caf-41f9-ac12-f923d51a5ebb tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:10.724874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6ab8c97-1caf-41f9-ac12-f923d51a5ebb tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:10.725876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6ab8c97-1caf-41f9-ac12-f923d51a5ebb tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:11.797891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-959c0fb6-46e0-4fa2-9daf-a547a3caa8fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:11.811636 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-959c0fb6-46e0-4fa2-9daf-a547a3caa8fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1316 microversion: 2.1 time: 1.280794 Oct 18 13:33:11.812241 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1777/3759] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:10 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1316 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:11.829163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a17161d3-1960-454b-895a-e68aa78923f4 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:11.830157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a17161d3-1960-454b-895a-e68aa78923f4 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:11.843750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a17161d3-1960-454b-895a-e68aa78923f4 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:11.844789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a17161d3-1960-454b-895a-e68aa78923f4 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:11.845546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a17161d3-1960-454b-895a-e68aa78923f4 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:11.846288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a17161d3-1960-454b-895a-e68aa78923f4 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:11.846742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a17161d3-1960-454b-895a-e68aa78923f4 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:11.847174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a17161d3-1960-454b-895a-e68aa78923f4 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:12.025064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c6ab8c97-1caf-41f9-ac12-f923d51a5ebb tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:12.055342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:12.065159 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c6ab8c97-1caf-41f9-ac12-f923d51a5ebb tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1526 microversion: 2.1 time: 1.392500 Oct 18 13:33:12.067040 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1983/3760] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:10 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1526 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:12.075542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ff70b5e5-618b-4251-8ffe-26e10ff7ca68 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:12.076967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ff70b5e5-618b-4251-8ffe-26e10ff7ca68 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:12.117048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff70b5e5-618b-4251-8ffe-26e10ff7ca68 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:12.118009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff70b5e5-618b-4251-8ffe-26e10ff7ca68 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:12.119307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff70b5e5-618b-4251-8ffe-26e10ff7ca68 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:12.120416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff70b5e5-618b-4251-8ffe-26e10ff7ca68 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:12.122154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff70b5e5-618b-4251-8ffe-26e10ff7ca68 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:12.122838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff70b5e5-618b-4251-8ffe-26e10ff7ca68 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:12.610567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a17161d3-1960-454b-895a-e68aa78923f4 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:12.619928 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a17161d3-1960-454b-895a-e68aa78923f4 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1367 microversion: 2.1 time: 0.800956 Oct 18 13:33:12.620518 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1778/3761] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:11 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1367 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:12.839240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dd830791-da96-48c5-ab90-0b27400c8abb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:12.840648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dd830791-da96-48c5-ab90-0b27400c8abb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:12.850453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd830791-da96-48c5-ab90-0b27400c8abb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:12.850945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd830791-da96-48c5-ab90-0b27400c8abb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:12.851378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd830791-da96-48c5-ab90-0b27400c8abb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:12.852085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd830791-da96-48c5-ab90-0b27400c8abb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:12.852535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd830791-da96-48c5-ab90-0b27400c8abb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:12.852957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd830791-da96-48c5-ab90-0b27400c8abb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:12.868736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ff70b5e5-618b-4251-8ffe-26e10ff7ca68 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:12.886182 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ff70b5e5-618b-4251-8ffe-26e10ff7ca68 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 0.816585 Oct 18 13:33:12.905722 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1984/3762] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:12 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:13.094599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ef729bca-dc9a-4f18-a918-94d17920d533 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:13.096099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ef729bca-dc9a-4f18-a918-94d17920d533 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:13.103968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef729bca-dc9a-4f18-a918-94d17920d533 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:13.104771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef729bca-dc9a-4f18-a918-94d17920d533 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:13.105483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef729bca-dc9a-4f18-a918-94d17920d533 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:13.106462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef729bca-dc9a-4f18-a918-94d17920d533 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:13.107175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef729bca-dc9a-4f18-a918-94d17920d533 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:13.107841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef729bca-dc9a-4f18-a918-94d17920d533 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:13.238145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ef729bca-dc9a-4f18-a918-94d17920d533 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:13.249248 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ef729bca-dc9a-4f18-a918-94d17920d533 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1484 microversion: 2.1 time: 0.160965 Oct 18 13:33:13.250257 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1985/3763] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:13 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1484 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:13.408059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dd830791-da96-48c5-ab90-0b27400c8abb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:13.423850 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dd830791-da96-48c5-ab90-0b27400c8abb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1316 microversion: 2.1 time: 0.588619 Oct 18 13:33:13.437202 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1779/3764] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:12 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:13.647407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-561bbee8-d0a0-4bf1-a24a-975c523c381a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:13.648606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-561bbee8-d0a0-4bf1-a24a-975c523c381a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:13.689517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-561bbee8-d0a0-4bf1-a24a-975c523c381a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:13.692460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-561bbee8-d0a0-4bf1-a24a-975c523c381a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:13.699488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-561bbee8-d0a0-4bf1-a24a-975c523c381a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:13.700396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-561bbee8-d0a0-4bf1-a24a-975c523c381a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:13.703948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-561bbee8-d0a0-4bf1-a24a-975c523c381a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:13.704520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-561bbee8-d0a0-4bf1-a24a-975c523c381a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:13.912498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a3afa872-7cfd-4024-96d2-9407fbc3bc6e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:13.912969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a3afa872-7cfd-4024-96d2-9407fbc3bc6e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:13.918860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3afa872-7cfd-4024-96d2-9407fbc3bc6e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:13.919892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3afa872-7cfd-4024-96d2-9407fbc3bc6e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:13.920919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3afa872-7cfd-4024-96d2-9407fbc3bc6e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:13.921812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3afa872-7cfd-4024-96d2-9407fbc3bc6e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:13.922963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3afa872-7cfd-4024-96d2-9407fbc3bc6e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:13.923939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3afa872-7cfd-4024-96d2-9407fbc3bc6e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.188007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-561bbee8-d0a0-4bf1-a24a-975c523c381a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:14.207561 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-561bbee8-d0a0-4bf1-a24a-975c523c381a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1367 microversion: 2.1 time: 0.564804 Oct 18 13:33:14.210887 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1986/3765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:13 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1367 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:14.222554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-45a926e4-81f9-42ac-b8aa-3cbf392a3c8a req-66745125-7167-4ec3-920a-ba25126def4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a8797f-2b84-44d0-b925-5115ecdeea0d", "name": "network-vif-deleted", "tag": "7d99fb30-ea22-4ee8-aca6-1d4f06679c96"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:14.233416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-45a926e4-81f9-42ac-b8aa-3cbf392a3c8a req-66745125-7167-4ec3-920a-ba25126def4d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.234277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-45a926e4-81f9-42ac-b8aa-3cbf392a3c8a req-66745125-7167-4ec3-920a-ba25126def4d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.234833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-45a926e4-81f9-42ac-b8aa-3cbf392a3c8a req-66745125-7167-4ec3-920a-ba25126def4d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.261849 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-45a926e4-81f9-42ac-b8aa-3cbf392a3c8a req-66745125-7167-4ec3-920a-ba25126def4d service nova] Creating event network-vif-deleted:7d99fb30-ea22-4ee8-aca6-1d4f06679c96 for instance d1a8797f-2b84-44d0-b925-5115ecdeea0d on n-h1-858384-13 Oct 18 13:33:14.277771 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-45a926e4-81f9-42ac-b8aa-3cbf392a3c8a req-66745125-7167-4ec3-920a-ba25126def4d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061408 Oct 18 13:33:14.277771 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1987/3766] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:14.282337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.283053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:14.305216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.305695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.306307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.307161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.307713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.308146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.385382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.385805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.386238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.394945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lazy-loading 'fault' on Instance uuid d1a8797f-2b84-44d0-b925-5115ecdeea0d {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:14.477961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498058370ca4841b84fb6be162573e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adecadde75c5450cbbacb33a6eed63c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:14.488288 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-61ea5536-88dd-48cb-a891-9759eb0be726 tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 200 len: 1313 microversion: 2.1 time: 0.211252 Oct 18 13:33:14.489078 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1988/3767] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:14 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:14.506869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f3beadb5-aeb5-47fd-b591-64c74a8acd17 req-774c6684-906b-41b8-92f8-4d5cfe536826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bce6f6b-df28-4c34-a17f-4f18eb67d401", "tag": "c5013b3d-167f-494a-9220-7ef368aab635"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:14.541882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f3beadb5-aeb5-47fd-b591-64c74a8acd17 req-774c6684-906b-41b8-92f8-4d5cfe536826 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.548029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f3beadb5-aeb5-47fd-b591-64c74a8acd17 req-774c6684-906b-41b8-92f8-4d5cfe536826 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.553283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f3beadb5-aeb5-47fd-b591-64c74a8acd17 req-774c6684-906b-41b8-92f8-4d5cfe536826 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.593903 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f3beadb5-aeb5-47fd-b591-64c74a8acd17 req-774c6684-906b-41b8-92f8-4d5cfe536826 service nova] Creating event network-changed:c5013b3d-167f-494a-9220-7ef368aab635 for instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 on n-h2-858384-13 Oct 18 13:33:14.608617 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f3beadb5-aeb5-47fd-b591-64c74a8acd17 req-774c6684-906b-41b8-92f8-4d5cfe536826 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117668 Oct 18 13:33:14.612342 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1989/3768] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:14.624934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0753b9d5-d126-4c9f-ac6e-1bf91331131e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:14.626130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0753b9d5-d126-4c9f-ac6e-1bf91331131e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:14.641434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0753b9d5-d126-4c9f-ac6e-1bf91331131e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.644382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0753b9d5-d126-4c9f-ac6e-1bf91331131e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.647691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0753b9d5-d126-4c9f-ac6e-1bf91331131e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.651442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0753b9d5-d126-4c9f-ac6e-1bf91331131e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:14.662484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0753b9d5-d126-4c9f-ac6e-1bf91331131e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:14.662484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0753b9d5-d126-4c9f-ac6e-1bf91331131e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:14.954963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a3afa872-7cfd-4024-96d2-9407fbc3bc6e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:14.963280 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a3afa872-7cfd-4024-96d2-9407fbc3bc6e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 1.055988 Oct 18 13:33:14.963867 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1780/3769] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:13 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:15.124984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:15.139830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0753b9d5-d126-4c9f-ac6e-1bf91331131e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:15.153682 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0753b9d5-d126-4c9f-ac6e-1bf91331131e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1316 microversion: 2.1 time: 0.539628 Oct 18 13:33:15.154529 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1990/3770] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:14 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:15.240621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7bf741a3-85ad-4976-8564-a39a7f06b870 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:15.241344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7bf741a3-85ad-4976-8564-a39a7f06b870 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:15.252225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7bf741a3-85ad-4976-8564-a39a7f06b870 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:15.254780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7bf741a3-85ad-4976-8564-a39a7f06b870 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:15.255412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7bf741a3-85ad-4976-8564-a39a7f06b870 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:15.256846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7bf741a3-85ad-4976-8564-a39a7f06b870 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:15.266336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7bf741a3-85ad-4976-8564-a39a7f06b870 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:15.267110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7bf741a3-85ad-4976-8564-a39a7f06b870 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:15.410965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:15.518226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3e67cb07-98b3-4859-b826-e430dc6171cc tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:15.518846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3e67cb07-98b3-4859-b826-e430dc6171cc tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] [instance: d1a8797f-2b84-44d0-b925-5115ecdeea0d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:15.529560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e67cb07-98b3-4859-b826-e430dc6171cc tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:15.530080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e67cb07-98b3-4859-b826-e430dc6171cc tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:15.530518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e67cb07-98b3-4859-b826-e430dc6171cc tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:15.531215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e67cb07-98b3-4859-b826-e430dc6171cc tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:15.533731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e67cb07-98b3-4859-b826-e430dc6171cc tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:15.537408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e67cb07-98b3-4859-b826-e430dc6171cc tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:15.576466 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-3e67cb07-98b3-4859-b826-e430dc6171cc tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] HTTP exception thrown: Instance d1a8797f-2b84-44d0-b925-5115ecdeea0d could not be found. Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3e67cb07-98b3-4859-b826-e430dc6171cc tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Request method failure captured: Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d HTTP/1.1 Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqr29E9i7LJa-9KyQZJ0XGHI53Lt91XXDoO8WfTc2iuUNEugrZBDo3z46VQNiL7NZxbPO1R7S0uvsaMHjJn3KK72jIZy0FXHaEzQ5MZVZTydDclpY9XROT2cqXL53t-2-xwVhBu5nQg91xLOwzsF45k3vUcyxMb8abUWnxsowGl3HSI Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/adecadde75c5450cbbacb33a6eed63c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_adecadde75c5450cbbacb33a6eed63c6"}]}] Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: adecadde75c5450cbbacb33a6eed63c6 Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1889031057 Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6498058370ca4841b84fb6be162573e7 Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1889031057-project Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance d1a8797f-2b84-44d0-b925-5115ecdeea0d could not be found. Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'd1a8797f-2b84-44d0-b925-5115ecdeea0d'} Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a8797f-2b84-44d0-b925-5115ecdeea0d could not be found. Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a8797f-2b84-44d0-b925-5115ecdeea0d could not be found. Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:15.578896 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:15.583981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:15.583981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:15.583981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:15.583981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:15.583981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:15.583981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:15.583981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a8797f-2b84-44d0-b925-5115ecdeea0d could not be found. Oct 18 13:33:15.583981 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:15.585596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3e67cb07-98b3-4859-b826-e430dc6171cc tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] Returning 404 to user: Instance d1a8797f-2b84-44d0-b925-5115ecdeea0d could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:15.587037 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3e67cb07-98b3-4859-b826-e430dc6171cc tempest-ServerMetadataNegativeTestJSON-1889031057 tempest-ServerMetadataNegativeTestJSON-1889031057-project] 10.222.0.40 "GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d" status: 404 len: 111 microversion: 2.1 time: 0.075811 Oct 18 13:33:15.587786 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1991/3771] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:15 2022] GET /compute/v2.1/servers/d1a8797f-2b84-44d0-b925-5115ecdeea0d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:33:15.686638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7bf741a3-85ad-4976-8564-a39a7f06b870 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:15.695248 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7bf741a3-85ad-4976-8564-a39a7f06b870 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1367 microversion: 2.1 time: 0.458534 Oct 18 13:33:15.705995 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1781/3772] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:15 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1367 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:15.988875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53900211-6485-4316-956c-b1a975c65729 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:15.989560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53900211-6485-4316-956c-b1a975c65729 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:15.992168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:15.998731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53900211-6485-4316-956c-b1a975c65729 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:15.999223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53900211-6485-4316-956c-b1a975c65729 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:15.999657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53900211-6485-4316-956c-b1a975c65729 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.000873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53900211-6485-4316-956c-b1a975c65729 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.001359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53900211-6485-4316-956c-b1a975c65729 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.001784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53900211-6485-4316-956c-b1a975c65729 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.178333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cb5ffc9c-daf0-4a3f-93d2-a681f2ab0773 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:16.178958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cb5ffc9c-daf0-4a3f-93d2-a681f2ab0773 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:16.189789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb5ffc9c-daf0-4a3f-93d2-a681f2ab0773 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.190275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb5ffc9c-daf0-4a3f-93d2-a681f2ab0773 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.191767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb5ffc9c-daf0-4a3f-93d2-a681f2ab0773 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.193430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb5ffc9c-daf0-4a3f-93d2-a681f2ab0773 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.195351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb5ffc9c-daf0-4a3f-93d2-a681f2ab0773 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.195991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb5ffc9c-daf0-4a3f-93d2-a681f2ab0773 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.272601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=16 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:16.345932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-53900211-6485-4316-956c-b1a975c65729 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:16.362343 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53900211-6485-4316-956c-b1a975c65729 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 0.377389 Oct 18 13:33:16.363224 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1992/3773] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:15 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:16.377372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c0175ffe-9560-4be2-aff5-32b254a5a6f9 req-05b29864-ef65-487f-92dc-065173be99a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa292c2-3801-4d84-b31a-4d3eeeb41818", "tag": "8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa"}, {"name": "network-changed", "server_uuid": "a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4", "tag": "558b2b51-37b3-404d-87cd-c2439a035ef3"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:16.396762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c0175ffe-9560-4be2-aff5-32b254a5a6f9 req-05b29864-ef65-487f-92dc-065173be99a9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.397541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c0175ffe-9560-4be2-aff5-32b254a5a6f9 req-05b29864-ef65-487f-92dc-065173be99a9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.397990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c0175ffe-9560-4be2-aff5-32b254a5a6f9 req-05b29864-ef65-487f-92dc-065173be99a9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.420498 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c0175ffe-9560-4be2-aff5-32b254a5a6f9 req-05b29864-ef65-487f-92dc-065173be99a9 service nova] Creating event network-changed:8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa for instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 on n-h2-858384-13 Oct 18 13:33:16.421001 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c0175ffe-9560-4be2-aff5-32b254a5a6f9 req-05b29864-ef65-487f-92dc-065173be99a9 service nova] Creating event network-changed:558b2b51-37b3-404d-87cd-c2439a035ef3 for instance a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 on n-h2-858384-13 Oct 18 13:33:16.446875 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c0175ffe-9560-4be2-aff5-32b254a5a6f9 req-05b29864-ef65-487f-92dc-065173be99a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.082152 Oct 18 13:33:16.448123 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1993/3774] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:16.683564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=12 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:16.722461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-00959dd7-ccb4-4cf7-8235-c9a6f183b892 req-b484441d-be87-42a4-8228-a98cb77da532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4454e71a-3edc-4cc4-8a35-2a148257f003", "tag": "ed870daf-a3bd-42b1-aaa5-bcf18d00f9f9"}, {"name": "network-changed", "server_uuid": "4454e71a-3edc-4cc4-8a35-2a148257f003", "tag": "9c2d2d03-721b-4237-9dcd-8ddc8d43c508"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:16.768825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-00959dd7-ccb4-4cf7-8235-c9a6f183b892 req-b484441d-be87-42a4-8228-a98cb77da532 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.769586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-00959dd7-ccb4-4cf7-8235-c9a6f183b892 req-b484441d-be87-42a4-8228-a98cb77da532 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.770429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-00959dd7-ccb4-4cf7-8235-c9a6f183b892 req-b484441d-be87-42a4-8228-a98cb77da532 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.784418 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-00959dd7-ccb4-4cf7-8235-c9a6f183b892 req-b484441d-be87-42a4-8228-a98cb77da532 service nova] Creating event network-changed:ed870daf-a3bd-42b1-aaa5-bcf18d00f9f9 for instance 4454e71a-3edc-4cc4-8a35-2a148257f003 on n-h1-858384-13 Oct 18 13:33:16.785611 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-00959dd7-ccb4-4cf7-8235-c9a6f183b892 req-b484441d-be87-42a4-8228-a98cb77da532 service nova] Creating event network-changed:9c2d2d03-721b-4237-9dcd-8ddc8d43c508 for instance 4454e71a-3edc-4cc4-8a35-2a148257f003 on n-h1-858384-13 Oct 18 13:33:16.793586 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-00959dd7-ccb4-4cf7-8235-c9a6f183b892 req-b484441d-be87-42a4-8228-a98cb77da532 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077637 Oct 18 13:33:16.798528 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1994/3775] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:16.804910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-37f5d435-b69e-4b75-ac73-e8f93ebacf10 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:16.810118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-37f5d435-b69e-4b75-ac73-e8f93ebacf10 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:16.825008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37f5d435-b69e-4b75-ac73-e8f93ebacf10 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.830313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37f5d435-b69e-4b75-ac73-e8f93ebacf10 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.831915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37f5d435-b69e-4b75-ac73-e8f93ebacf10 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:16.834664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37f5d435-b69e-4b75-ac73-e8f93ebacf10 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:16.836062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37f5d435-b69e-4b75-ac73-e8f93ebacf10 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:16.836510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37f5d435-b69e-4b75-ac73-e8f93ebacf10 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:17.239298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cb5ffc9c-daf0-4a3f-93d2-a681f2ab0773 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:17.250760 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cb5ffc9c-daf0-4a3f-93d2-a681f2ab0773 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1316 microversion: 2.1 time: 1.076644 Oct 18 13:33:17.251965 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1782/3776] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:16 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1316 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:17.386589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-968efa5b-8d3f-4bb5-b11a-8bfc0286b100 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:17.387266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-968efa5b-8d3f-4bb5-b11a-8bfc0286b100 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:17.395236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-968efa5b-8d3f-4bb5-b11a-8bfc0286b100 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:17.395925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-968efa5b-8d3f-4bb5-b11a-8bfc0286b100 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:17.396531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-968efa5b-8d3f-4bb5-b11a-8bfc0286b100 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:17.397907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-968efa5b-8d3f-4bb5-b11a-8bfc0286b100 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:17.398833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-968efa5b-8d3f-4bb5-b11a-8bfc0286b100 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:17.399649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-968efa5b-8d3f-4bb5-b11a-8bfc0286b100 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:17.552759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-37f5d435-b69e-4b75-ac73-e8f93ebacf10 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:17.561993 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-37f5d435-b69e-4b75-ac73-e8f93ebacf10 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1367 microversion: 2.1 time: 0.761670 Oct 18 13:33:17.562600 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1995/3777] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:16 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1367 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:18.277065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1911b45-56a6-436c-8b99-a99d198da98a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:18.277788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1911b45-56a6-436c-8b99-a99d198da98a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:18.285028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1911b45-56a6-436c-8b99-a99d198da98a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.285553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1911b45-56a6-436c-8b99-a99d198da98a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.285994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1911b45-56a6-436c-8b99-a99d198da98a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.286701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1911b45-56a6-436c-8b99-a99d198da98a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.287160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1911b45-56a6-436c-8b99-a99d198da98a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.287586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1911b45-56a6-436c-8b99-a99d198da98a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.423490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d1911b45-56a6-436c-8b99-a99d198da98a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:18.432597 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d1911b45-56a6-436c-8b99-a99d198da98a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1316 microversion: 2.1 time: 0.159399 Oct 18 13:33:18.433422 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1996/3778] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:18 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:18.583571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-968efa5b-8d3f-4bb5-b11a-8bfc0286b100 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:18.585812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:18.592433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e25ef201-f7e8-4365-b591-65bccd18f3d0 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:18.592660 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-968efa5b-8d3f-4bb5-b11a-8bfc0286b100 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 1.210305 Oct 18 13:33:18.593212 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1783/3779] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:17 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:18.593359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e25ef201-f7e8-4365-b591-65bccd18f3d0 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:18.599409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e25ef201-f7e8-4365-b591-65bccd18f3d0 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.599891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e25ef201-f7e8-4365-b591-65bccd18f3d0 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.600322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e25ef201-f7e8-4365-b591-65bccd18f3d0 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.601013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e25ef201-f7e8-4365-b591-65bccd18f3d0 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.601480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e25ef201-f7e8-4365-b591-65bccd18f3d0 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.601904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e25ef201-f7e8-4365-b591-65bccd18f3d0 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.738112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e25ef201-f7e8-4365-b591-65bccd18f3d0 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:18.745821 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e25ef201-f7e8-4365-b591-65bccd18f3d0 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1367 microversion: 2.1 time: 0.157288 Oct 18 13:33:18.746522 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1997/3780] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:18 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:18.858713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d6328a23-34e0-40aa-ab64-13dd9e37307b req-afd30722-d183-4f3a-93d2-776f21b270f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4454e71a-3edc-4cc4-8a35-2a148257f003", "tag": "7bb4fabd-7f93-4713-a14a-30d96ef641d9"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:18.869785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d6328a23-34e0-40aa-ab64-13dd9e37307b req-afd30722-d183-4f3a-93d2-776f21b270f0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:18.870613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d6328a23-34e0-40aa-ab64-13dd9e37307b req-afd30722-d183-4f3a-93d2-776f21b270f0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:18.871266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d6328a23-34e0-40aa-ab64-13dd9e37307b req-afd30722-d183-4f3a-93d2-776f21b270f0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:18.896651 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d6328a23-34e0-40aa-ab64-13dd9e37307b req-afd30722-d183-4f3a-93d2-776f21b270f0 service nova] Creating event network-changed:7bb4fabd-7f93-4713-a14a-30d96ef641d9 for instance 4454e71a-3edc-4cc4-8a35-2a148257f003 on n-h1-858384-13 Oct 18 13:33:18.901820 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d6328a23-34e0-40aa-ab64-13dd9e37307b req-afd30722-d183-4f3a-93d2-776f21b270f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047481 Oct 18 13:33:18.902740 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1784/3781] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:33:19.296085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-027284b3-f020-46e6-b522-18a2a228e286 req-0a515824-3a66-4163-8eef-9b23a075ad0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bce6f6b-df28-4c34-a17f-4f18eb67d401", "name": "network-vif-plugged", "status": "completed", "tag": "c5013b3d-167f-494a-9220-7ef368aab635"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:19.316643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-027284b3-f020-46e6-b522-18a2a228e286 req-0a515824-3a66-4163-8eef-9b23a075ad0f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:19.317500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-027284b3-f020-46e6-b522-18a2a228e286 req-0a515824-3a66-4163-8eef-9b23a075ad0f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:19.318176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-027284b3-f020-46e6-b522-18a2a228e286 req-0a515824-3a66-4163-8eef-9b23a075ad0f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:19.333172 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-027284b3-f020-46e6-b522-18a2a228e286 req-0a515824-3a66-4163-8eef-9b23a075ad0f service nova] Creating event network-vif-plugged:c5013b3d-167f-494a-9220-7ef368aab635 for instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 on n-h2-858384-13 Oct 18 13:33:19.340689 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-027284b3-f020-46e6-b522-18a2a228e286 req-0a515824-3a66-4163-8eef-9b23a075ad0f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049468 Oct 18 13:33:19.342032 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1998/3782] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:19.457466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-46a2e599-ddf3-4bfb-b271-bd703db9fdd6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:19.458311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-46a2e599-ddf3-4bfb-b271-bd703db9fdd6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:19.466556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46a2e599-ddf3-4bfb-b271-bd703db9fdd6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:19.467125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46a2e599-ddf3-4bfb-b271-bd703db9fdd6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:19.467844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46a2e599-ddf3-4bfb-b271-bd703db9fdd6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:19.468789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46a2e599-ddf3-4bfb-b271-bd703db9fdd6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:19.470303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46a2e599-ddf3-4bfb-b271-bd703db9fdd6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:19.470857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46a2e599-ddf3-4bfb-b271-bd703db9fdd6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:19.617275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-27d10f6f-bad0-439f-ba3e-e52b1ee6887c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:19.618060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-27d10f6f-bad0-439f-ba3e-e52b1ee6887c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:19.624705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d10f6f-bad0-439f-ba3e-e52b1ee6887c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:19.625351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d10f6f-bad0-439f-ba3e-e52b1ee6887c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:19.626689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d10f6f-bad0-439f-ba3e-e52b1ee6887c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:19.627520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d10f6f-bad0-439f-ba3e-e52b1ee6887c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:19.628069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d10f6f-bad0-439f-ba3e-e52b1ee6887c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:19.628578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d10f6f-bad0-439f-ba3e-e52b1ee6887c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:19.850118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-27d10f6f-bad0-439f-ba3e-e52b1ee6887c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:19.860482 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-27d10f6f-bad0-439f-ba3e-e52b1ee6887c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 0.247293 Oct 18 13:33:19.861410 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 1999/3783] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:19 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:19.866532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cf15db79-14b2-4778-8e70-4a581a66f176 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:19.867772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cf15db79-14b2-4778-8e70-4a581a66f176 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:19.874643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf15db79-14b2-4778-8e70-4a581a66f176 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:19.875549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf15db79-14b2-4778-8e70-4a581a66f176 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:19.876369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf15db79-14b2-4778-8e70-4a581a66f176 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:19.877588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf15db79-14b2-4778-8e70-4a581a66f176 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:19.878051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf15db79-14b2-4778-8e70-4a581a66f176 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:19.878486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf15db79-14b2-4778-8e70-4a581a66f176 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:20.037476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cf15db79-14b2-4778-8e70-4a581a66f176 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:20.046085 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cf15db79-14b2-4778-8e70-4a581a66f176 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1367 microversion: 2.1 time: 0.183354 Oct 18 13:33:20.047861 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2000/3784] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:19 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:20.485651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-46a2e599-ddf3-4bfb-b271-bd703db9fdd6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:20.497036 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-46a2e599-ddf3-4bfb-b271-bd703db9fdd6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1316 microversion: 2.1 time: 1.044512 Oct 18 13:33:20.508889 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1785/3785] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:19 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1316 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:20.884826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a2eaaaae-f660-47ea-946b-ccd8f0c4affd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:20.885412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a2eaaaae-f660-47ea-946b-ccd8f0c4affd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:20.892453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2eaaaae-f660-47ea-946b-ccd8f0c4affd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:20.892911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2eaaaae-f660-47ea-946b-ccd8f0c4affd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:20.893391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2eaaaae-f660-47ea-946b-ccd8f0c4affd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:20.894113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2eaaaae-f660-47ea-946b-ccd8f0c4affd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:20.895185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2eaaaae-f660-47ea-946b-ccd8f0c4affd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:20.895581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2eaaaae-f660-47ea-946b-ccd8f0c4affd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:21.074437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0be07d5b-7efb-4846-84f3-9faad4d17809 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:21.075048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0be07d5b-7efb-4846-84f3-9faad4d17809 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:21.099007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a2eaaaae-f660-47ea-946b-ccd8f0c4affd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:21.100293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0be07d5b-7efb-4846-84f3-9faad4d17809 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:21.102050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0be07d5b-7efb-4846-84f3-9faad4d17809 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:21.102479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0be07d5b-7efb-4846-84f3-9faad4d17809 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:21.103499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0be07d5b-7efb-4846-84f3-9faad4d17809 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:21.104209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0be07d5b-7efb-4846-84f3-9faad4d17809 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:21.106926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0be07d5b-7efb-4846-84f3-9faad4d17809 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:21.111986 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a2eaaaae-f660-47ea-946b-ccd8f0c4affd tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 0.232094 Oct 18 13:33:21.132041 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2001/3786] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:20 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:21.530774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a17e0e20-1d17-4a15-a392-1d1c44b84eb4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:21.531924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a17e0e20-1d17-4a15-a392-1d1c44b84eb4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:21.543118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a17e0e20-1d17-4a15-a392-1d1c44b84eb4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:21.543619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a17e0e20-1d17-4a15-a392-1d1c44b84eb4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:21.546005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a17e0e20-1d17-4a15-a392-1d1c44b84eb4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:21.547066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a17e0e20-1d17-4a15-a392-1d1c44b84eb4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:21.548529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a17e0e20-1d17-4a15-a392-1d1c44b84eb4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:21.550210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a17e0e20-1d17-4a15-a392-1d1c44b84eb4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:21.839364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0be07d5b-7efb-4846-84f3-9faad4d17809 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:21.854412 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0be07d5b-7efb-4846-84f3-9faad4d17809 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1367 microversion: 2.1 time: 0.779240 Oct 18 13:33:21.855319 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1786/3787] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:21 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1367 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:22.057928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a17e0e20-1d17-4a15-a392-1d1c44b84eb4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:22.090057 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a17e0e20-1d17-4a15-a392-1d1c44b84eb4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1316 microversion: 2.1 time: 0.563054 Oct 18 13:33:22.113929 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2002/3788] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:21 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1316 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:22.143384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ec0ce470-c13d-4118-adf8-774010cce0e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:22.143996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ec0ce470-c13d-4118-adf8-774010cce0e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:22.150338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec0ce470-c13d-4118-adf8-774010cce0e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:22.150814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec0ce470-c13d-4118-adf8-774010cce0e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:22.151245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec0ce470-c13d-4118-adf8-774010cce0e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:22.151938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec0ce470-c13d-4118-adf8-774010cce0e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:22.152387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec0ce470-c13d-4118-adf8-774010cce0e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:22.152800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec0ce470-c13d-4118-adf8-774010cce0e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:22.882334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e568068c-ee2c-44f4-bc50-9606c576dd76 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:22.882957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e568068c-ee2c-44f4-bc50-9606c576dd76 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:22.896974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e568068c-ee2c-44f4-bc50-9606c576dd76 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:22.900459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e568068c-ee2c-44f4-bc50-9606c576dd76 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:22.900947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e568068c-ee2c-44f4-bc50-9606c576dd76 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:22.904425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e568068c-ee2c-44f4-bc50-9606c576dd76 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:22.904946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e568068c-ee2c-44f4-bc50-9606c576dd76 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:22.905416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e568068c-ee2c-44f4-bc50-9606c576dd76 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:23.193509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ec0ce470-c13d-4118-adf8-774010cce0e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:23.205093 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ec0ce470-c13d-4118-adf8-774010cce0e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 1.065690 Oct 18 13:33:23.207155 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1787/3789] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:22 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:23.217666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e568068c-ee2c-44f4-bc50-9606c576dd76 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:23.231555 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e568068c-ee2c-44f4-bc50-9606c576dd76 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1367 microversion: 2.1 time: 0.354154 Oct 18 13:33:23.236926 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2003/3790] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:22 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:23.238061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8c8e5182-d888-4e1a-bd36-d40d2ac53f3c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:23.238993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8c8e5182-d888-4e1a-bd36-d40d2ac53f3c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:23.245693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c8e5182-d888-4e1a-bd36-d40d2ac53f3c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:23.246391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c8e5182-d888-4e1a-bd36-d40d2ac53f3c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:23.247470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c8e5182-d888-4e1a-bd36-d40d2ac53f3c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:23.248344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c8e5182-d888-4e1a-bd36-d40d2ac53f3c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:23.249212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c8e5182-d888-4e1a-bd36-d40d2ac53f3c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:23.250548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c8e5182-d888-4e1a-bd36-d40d2ac53f3c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:23.974043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1daabc20-c757-4183-95d4-01ab5917a30e req-e4b90b64-13d4-4ac5-800a-63f296face02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4", "name": "network-vif-plugged", "status": "completed", "tag": "558b2b51-37b3-404d-87cd-c2439a035ef3"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:23.994244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1daabc20-c757-4183-95d4-01ab5917a30e req-e4b90b64-13d4-4ac5-800a-63f296face02 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:23.995041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1daabc20-c757-4183-95d4-01ab5917a30e req-e4b90b64-13d4-4ac5-800a-63f296face02 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:23.995894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1daabc20-c757-4183-95d4-01ab5917a30e req-e4b90b64-13d4-4ac5-800a-63f296face02 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:24.002690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:24.041525 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1daabc20-c757-4183-95d4-01ab5917a30e req-e4b90b64-13d4-4ac5-800a-63f296face02 service nova] Creating event network-vif-plugged:558b2b51-37b3-404d-87cd-c2439a035ef3 for instance a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 on n-h2-858384-13 Oct 18 13:33:24.059979 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1daabc20-c757-4183-95d4-01ab5917a30e req-e4b90b64-13d4-4ac5-800a-63f296face02 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087265 Oct 18 13:33:24.063799 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2004/3791] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:33:24.232310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d7a859f8-2c21-4389-96e7-13788ee4f856 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:24.234234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d7a859f8-2c21-4389-96e7-13788ee4f856 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:24.244560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7a859f8-2c21-4389-96e7-13788ee4f856 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:24.248285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7a859f8-2c21-4389-96e7-13788ee4f856 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:24.251286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7a859f8-2c21-4389-96e7-13788ee4f856 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:24.252500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7a859f8-2c21-4389-96e7-13788ee4f856 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:24.253211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7a859f8-2c21-4389-96e7-13788ee4f856 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:24.253640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7a859f8-2c21-4389-96e7-13788ee4f856 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:24.311895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8c8e5182-d888-4e1a-bd36-d40d2ac53f3c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:24.322571 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8c8e5182-d888-4e1a-bd36-d40d2ac53f3c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 1.114042 Oct 18 13:33:24.324201 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1788/3792] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:23 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:24.336281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-63327a68-75d2-483f-9f6a-dfeb9b452b0e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:24.337136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-63327a68-75d2-483f-9f6a-dfeb9b452b0e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:24.345095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63327a68-75d2-483f-9f6a-dfeb9b452b0e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:24.349305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63327a68-75d2-483f-9f6a-dfeb9b452b0e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:24.349818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63327a68-75d2-483f-9f6a-dfeb9b452b0e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:24.351035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63327a68-75d2-483f-9f6a-dfeb9b452b0e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:24.351554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63327a68-75d2-483f-9f6a-dfeb9b452b0e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:24.352037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63327a68-75d2-483f-9f6a-dfeb9b452b0e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:24.737764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-63327a68-75d2-483f-9f6a-dfeb9b452b0e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:24.750151 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-63327a68-75d2-483f-9f6a-dfeb9b452b0e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1367 microversion: 2.1 time: 0.424102 Oct 18 13:33:24.751258 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1789/3793] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:24 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:24.757291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1681582641", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:24.823262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] validate_networks() for [('97315d5a-8b0e-47cc-9e64-1e8e92c88ddc', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:33:24.854751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d7a859f8-2c21-4389-96e7-13788ee4f856 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:24.863944 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d7a859f8-2c21-4389-96e7-13788ee4f856 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 0.636620 Oct 18 13:33:24.880075 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2005/3794] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:24 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:25.764636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-861348600", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:25.836621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] validate_networks() for [('307b3828-939b-499c-a529-8f322b47754f', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:33:25.989667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:33:25.990216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:33:25.990480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:33:25.990909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:33:25.991315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:33:26.003036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.003752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.004358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.005146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.006107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.006107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.029043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Getting quotas for project d72f3fa595014256865e3f5c83df7c6e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:33:26.040459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Getting quotas for user 99a7a4b4e4c149a28cfbf83a0539f04c and project d72f3fa595014256865e3f5c83df7c6e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:33:26.066616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:33:26.069676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:33:26.085970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:26.144674 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-45b970d4-7710-4e6c-9fdb-05525ccc1da6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391757 Oct 18 13:33:26.151875 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1790/3795] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:33:26.158571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-513d8b92-fb66-402e-bead-7942dd00ac14 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:26.159467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-513d8b92-fb66-402e-bead-7942dd00ac14 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:26.167167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-513d8b92-fb66-402e-bead-7942dd00ac14 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.168233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-513d8b92-fb66-402e-bead-7942dd00ac14 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.169112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-513d8b92-fb66-402e-bead-7942dd00ac14 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.170156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-513d8b92-fb66-402e-bead-7942dd00ac14 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.170906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-513d8b92-fb66-402e-bead-7942dd00ac14 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.172455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-513d8b92-fb66-402e-bead-7942dd00ac14 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.450971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-513d8b92-fb66-402e-bead-7942dd00ac14 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:26.463924 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-513d8b92-fb66-402e-bead-7942dd00ac14 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1557 microversion: 2.1 time: 0.309945 Oct 18 13:33:26.478101 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1791/3796] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:26 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1557 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:26.483571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42eec771-767d-475c-9416-6a37b20cd64f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:26.487525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-42eec771-767d-475c-9416-6a37b20cd64f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:26.504064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42eec771-767d-475c-9416-6a37b20cd64f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.505773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42eec771-767d-475c-9416-6a37b20cd64f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.507449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42eec771-767d-475c-9416-6a37b20cd64f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.508379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42eec771-767d-475c-9416-6a37b20cd64f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.509927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42eec771-767d-475c-9416-6a37b20cd64f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.510904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42eec771-767d-475c-9416-6a37b20cd64f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.710401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:33:26.713739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:33:26.714278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:33:26.714704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:33:26.716814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:33:26.742588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.743104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.743587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.747737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.748206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.749437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.782875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Getting quotas for project 614abbf6db5d4775a24243632248c89e. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:33:26.789819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Getting quotas for user 6d2af744fd4641e591354166c2b371de and project 614abbf6db5d4775a24243632248c89e. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:33:26.811833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:33:26.814839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:33:26.876208 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ea319b00-4adc-44f9-96fa-d544cd7de88a tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.323825 Oct 18 13:33:26.877686 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2006/3797] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:33:26.882926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0817bec1-0529-455c-9a11-75657d162f49 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:26.885153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0817bec1-0529-455c-9a11-75657d162f49 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:26.895373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0817bec1-0529-455c-9a11-75657d162f49 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.896388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0817bec1-0529-455c-9a11-75657d162f49 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.897442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0817bec1-0529-455c-9a11-75657d162f49 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.898426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0817bec1-0529-455c-9a11-75657d162f49 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:26.899143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0817bec1-0529-455c-9a11-75657d162f49 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:26.899767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0817bec1-0529-455c-9a11-75657d162f49 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:26.983994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0817bec1-0529-455c-9a11-75657d162f49 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:26.996587 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0817bec1-0529-455c-9a11-75657d162f49 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1221 microversion: 2.1 time: 0.117320 Oct 18 13:33:26.997975 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2007/3798] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:26 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1221 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:27.004737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-72492fae-4f88-4d14-bcfc-67b5f9d49ee8 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:27.006431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-72492fae-4f88-4d14-bcfc-67b5f9d49ee8 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:27.023334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72492fae-4f88-4d14-bcfc-67b5f9d49ee8 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:27.024350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72492fae-4f88-4d14-bcfc-67b5f9d49ee8 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:27.027044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72492fae-4f88-4d14-bcfc-67b5f9d49ee8 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:27.028239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72492fae-4f88-4d14-bcfc-67b5f9d49ee8 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:27.029035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72492fae-4f88-4d14-bcfc-67b5f9d49ee8 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:27.033746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72492fae-4f88-4d14-bcfc-67b5f9d49ee8 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:27.038249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-42eec771-767d-475c-9416-6a37b20cd64f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:27.055077 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-42eec771-767d-475c-9416-6a37b20cd64f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 0.580244 Oct 18 13:33:27.055983 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1792/3799] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:26 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:27.069116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-50218273-ff3f-4a15-ac78-db489f7bb169 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:27.069781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-50218273-ff3f-4a15-ac78-db489f7bb169 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:27.161693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-50218273-ff3f-4a15-ac78-db489f7bb169 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:27.170749 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-50218273-ff3f-4a15-ac78-db489f7bb169 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1222 microversion: 2.1 time: 0.112104 Oct 18 13:33:27.171406 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1793/3800] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:27 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:27.228908 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-72492fae-4f88-4d14-bcfc-67b5f9d49ee8 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.229550 Oct 18 13:33:27.235538 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2008/3801] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:33:26 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-interface => generated 284 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:28.026209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-52a07262-f9e7-41f4-93aa-cb4dd92539de tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:28.027017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-52a07262-f9e7-41f4-93aa-cb4dd92539de tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:28.040569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52a07262-f9e7-41f4-93aa-cb4dd92539de tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:28.041888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52a07262-f9e7-41f4-93aa-cb4dd92539de tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:28.043134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52a07262-f9e7-41f4-93aa-cb4dd92539de tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:28.044332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52a07262-f9e7-41f4-93aa-cb4dd92539de tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:28.045097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52a07262-f9e7-41f4-93aa-cb4dd92539de tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:28.045844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52a07262-f9e7-41f4-93aa-cb4dd92539de tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:28.085209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-83bfc759-2379-4d0f-b709-3af5e02087e8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:28.086178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-83bfc759-2379-4d0f-b709-3af5e02087e8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:28.100876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83bfc759-2379-4d0f-b709-3af5e02087e8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:28.103596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83bfc759-2379-4d0f-b709-3af5e02087e8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:28.105319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83bfc759-2379-4d0f-b709-3af5e02087e8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:28.107047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83bfc759-2379-4d0f-b709-3af5e02087e8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:28.108067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83bfc759-2379-4d0f-b709-3af5e02087e8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:28.110128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83bfc759-2379-4d0f-b709-3af5e02087e8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:28.190739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-52a07262-f9e7-41f4-93aa-cb4dd92539de tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:28.202747 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-52a07262-f9e7-41f4-93aa-cb4dd92539de tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1221 microversion: 2.1 time: 0.182517 Oct 18 13:33:28.209485 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1794/3802] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:28 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1221 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:28.209485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-018285d9-19bd-40bc-a08a-2ea0ca931ee1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:28.209485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-018285d9-19bd-40bc-a08a-2ea0ca931ee1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:28.226063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-018285d9-19bd-40bc-a08a-2ea0ca931ee1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:28.228532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-018285d9-19bd-40bc-a08a-2ea0ca931ee1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:28.230888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-018285d9-19bd-40bc-a08a-2ea0ca931ee1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:28.233880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-018285d9-19bd-40bc-a08a-2ea0ca931ee1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:28.237452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-018285d9-19bd-40bc-a08a-2ea0ca931ee1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:28.238317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-018285d9-19bd-40bc-a08a-2ea0ca931ee1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:28.564777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-018285d9-19bd-40bc-a08a-2ea0ca931ee1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:28.573893 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-018285d9-19bd-40bc-a08a-2ea0ca931ee1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1226 microversion: 2.1 time: 0.368676 Oct 18 13:33:28.577711 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1795/3803] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:28 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1226 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:28.784739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-83bfc759-2379-4d0f-b709-3af5e02087e8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:28.799085 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-83bfc759-2379-4d0f-b709-3af5e02087e8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 0.719272 Oct 18 13:33:28.818227 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2009/3804] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:28 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:29.227325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6d7c4d1a-6dee-493b-b1e6-0f62c959b3e3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:29.227962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6d7c4d1a-6dee-493b-b1e6-0f62c959b3e3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:29.248568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d7c4d1a-6dee-493b-b1e6-0f62c959b3e3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:29.252502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d7c4d1a-6dee-493b-b1e6-0f62c959b3e3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:29.254176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d7c4d1a-6dee-493b-b1e6-0f62c959b3e3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:29.256394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d7c4d1a-6dee-493b-b1e6-0f62c959b3e3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:29.259500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d7c4d1a-6dee-493b-b1e6-0f62c959b3e3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:29.261394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d7c4d1a-6dee-493b-b1e6-0f62c959b3e3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:29.600670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0347f55d-3250-4204-baed-6140dd179428 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:29.601306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0347f55d-3250-4204-baed-6140dd179428 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:29.610956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0347f55d-3250-4204-baed-6140dd179428 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:29.611451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0347f55d-3250-4204-baed-6140dd179428 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:29.617584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0347f55d-3250-4204-baed-6140dd179428 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:29.619120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0347f55d-3250-4204-baed-6140dd179428 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:29.619695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0347f55d-3250-4204-baed-6140dd179428 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:29.620125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0347f55d-3250-4204-baed-6140dd179428 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:29.635156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6d7c4d1a-6dee-493b-b1e6-0f62c959b3e3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:29.661581 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6d7c4d1a-6dee-493b-b1e6-0f62c959b3e3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1213 microversion: 2.1 time: 0.436156 Oct 18 13:33:29.664500 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1796/3805] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:29 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1213 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:29.827922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c04a80d6-05f1-4f66-8503-9239a1d624d7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:29.829212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c04a80d6-05f1-4f66-8503-9239a1d624d7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:29.830858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0347f55d-3250-4204-baed-6140dd179428 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:29.843842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c04a80d6-05f1-4f66-8503-9239a1d624d7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:29.845940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c04a80d6-05f1-4f66-8503-9239a1d624d7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:29.846395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c04a80d6-05f1-4f66-8503-9239a1d624d7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:29.849870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c04a80d6-05f1-4f66-8503-9239a1d624d7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:29.850031 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0347f55d-3250-4204-baed-6140dd179428 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1280 microversion: 2.1 time: 0.253108 Oct 18 13:33:29.850426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c04a80d6-05f1-4f66-8503-9239a1d624d7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:29.850876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c04a80d6-05f1-4f66-8503-9239a1d624d7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:29.865922 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2010/3806] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:29 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1280 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:29.939655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-06301c88-89ab-44fa-a2cb-2a4af584a666 req-4a5ed764-9bef-40a7-b6f6-50179d6c8b57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4", "tag": "558b2b51-37b3-404d-87cd-c2439a035ef3"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:29.957070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-06301c88-89ab-44fa-a2cb-2a4af584a666 req-4a5ed764-9bef-40a7-b6f6-50179d6c8b57 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:29.962517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-06301c88-89ab-44fa-a2cb-2a4af584a666 req-4a5ed764-9bef-40a7-b6f6-50179d6c8b57 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:29.963324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-06301c88-89ab-44fa-a2cb-2a4af584a666 req-4a5ed764-9bef-40a7-b6f6-50179d6c8b57 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:29.992527 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-06301c88-89ab-44fa-a2cb-2a4af584a666 req-4a5ed764-9bef-40a7-b6f6-50179d6c8b57 service nova] Creating event network-changed:558b2b51-37b3-404d-87cd-c2439a035ef3 for instance a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 on n-h2-858384-13 Oct 18 13:33:30.005739 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-06301c88-89ab-44fa-a2cb-2a4af584a666 req-4a5ed764-9bef-40a7-b6f6-50179d6c8b57 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068912 Oct 18 13:33:30.007806 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2011/3807] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:33:30.691196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-700a52af-badd-408c-8d6c-066a7a787649 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:30.691969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-700a52af-badd-408c-8d6c-066a7a787649 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:30.722439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-700a52af-badd-408c-8d6c-066a7a787649 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:30.722987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-700a52af-badd-408c-8d6c-066a7a787649 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:30.723424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-700a52af-badd-408c-8d6c-066a7a787649 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:30.724349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-700a52af-badd-408c-8d6c-066a7a787649 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:30.724976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-700a52af-badd-408c-8d6c-066a7a787649 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:30.725727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-700a52af-badd-408c-8d6c-066a7a787649 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:30.897998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-700a52af-badd-408c-8d6c-066a7a787649 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:30.912908 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-700a52af-badd-408c-8d6c-066a7a787649 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1275 microversion: 2.1 time: 0.226344 Oct 18 13:33:30.913541 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2012/3808] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:30 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1275 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:30.938232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3ec2e946-330e-4acb-838b-2c7afa3d4029 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:30.938853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3ec2e946-330e-4acb-838b-2c7afa3d4029 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:30.966208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ec2e946-330e-4acb-838b-2c7afa3d4029 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:30.967411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ec2e946-330e-4acb-838b-2c7afa3d4029 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:30.968425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ec2e946-330e-4acb-838b-2c7afa3d4029 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:30.971163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ec2e946-330e-4acb-838b-2c7afa3d4029 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:30.973326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ec2e946-330e-4acb-838b-2c7afa3d4029 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:30.974514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ec2e946-330e-4acb-838b-2c7afa3d4029 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:31.079890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c04a80d6-05f1-4f66-8503-9239a1d624d7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:31.094636 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c04a80d6-05f1-4f66-8503-9239a1d624d7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 1.271395 Oct 18 13:33:31.095485 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1797/3809] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:29 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:31.179611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ec2e946-330e-4acb-838b-2c7afa3d4029 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:31.189956 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3ec2e946-330e-4acb-838b-2c7afa3d4029 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1280 microversion: 2.1 time: 0.268931 Oct 18 13:33:31.211390 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2013/3810] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:30 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1280 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:31.941946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5ce94a52-269f-4b04-9383-389b3cfcb027 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:31.943121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5ce94a52-269f-4b04-9383-389b3cfcb027 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:31.956314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ce94a52-269f-4b04-9383-389b3cfcb027 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:31.957467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ce94a52-269f-4b04-9383-389b3cfcb027 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:31.960256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ce94a52-269f-4b04-9383-389b3cfcb027 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:31.961367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ce94a52-269f-4b04-9383-389b3cfcb027 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:31.962084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ce94a52-269f-4b04-9383-389b3cfcb027 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:31.962791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ce94a52-269f-4b04-9383-389b3cfcb027 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:32.121650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ecb4feaf-0ecc-4c3b-be4a-7480400235b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:32.122925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ecb4feaf-0ecc-4c3b-be4a-7480400235b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:32.137755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecb4feaf-0ecc-4c3b-be4a-7480400235b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:32.138257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecb4feaf-0ecc-4c3b-be4a-7480400235b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:32.138696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecb4feaf-0ecc-4c3b-be4a-7480400235b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:32.158672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecb4feaf-0ecc-4c3b-be4a-7480400235b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:32.160425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecb4feaf-0ecc-4c3b-be4a-7480400235b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:32.162144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecb4feaf-0ecc-4c3b-be4a-7480400235b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:32.240337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5ce94a52-269f-4b04-9383-389b3cfcb027 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:32.264732 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5ce94a52-269f-4b04-9383-389b3cfcb027 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1275 microversion: 2.1 time: 0.323200 Oct 18 13:33:32.267247 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1798/3811] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:31 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1275 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:32.277345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8f8f2181-ee90-4bd7-8cba-dd4db87f3b07 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:32.277969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8f8f2181-ee90-4bd7-8cba-dd4db87f3b07 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:32.292883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f8f2181-ee90-4bd7-8cba-dd4db87f3b07 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:32.301820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f8f2181-ee90-4bd7-8cba-dd4db87f3b07 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:32.302930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f8f2181-ee90-4bd7-8cba-dd4db87f3b07 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:32.306441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f8f2181-ee90-4bd7-8cba-dd4db87f3b07 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:32.307775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f8f2181-ee90-4bd7-8cba-dd4db87f3b07 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:32.310170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f8f2181-ee90-4bd7-8cba-dd4db87f3b07 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:33.005698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8f8f2181-ee90-4bd7-8cba-dd4db87f3b07 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:33.019867 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8f8f2181-ee90-4bd7-8cba-dd4db87f3b07 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.751339 Oct 18 13:33:33.042788 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1799/3812] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:32 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1322 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:33.272885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ecb4feaf-0ecc-4c3b-be4a-7480400235b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:33.289423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b0dddea1-ab2b-43db-bb39-1fe1eae8cb06 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:33.291073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b0dddea1-ab2b-43db-bb39-1fe1eae8cb06 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:33.313318 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ecb4feaf-0ecc-4c3b-be4a-7480400235b3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 1.188262 Oct 18 13:33:33.317291 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2014/3813] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:32 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:33.319047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0dddea1-ab2b-43db-bb39-1fe1eae8cb06 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:33.321065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0dddea1-ab2b-43db-bb39-1fe1eae8cb06 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:33.322686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0dddea1-ab2b-43db-bb39-1fe1eae8cb06 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:33.324774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0dddea1-ab2b-43db-bb39-1fe1eae8cb06 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:33.327468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0dddea1-ab2b-43db-bb39-1fe1eae8cb06 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:33.331729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0dddea1-ab2b-43db-bb39-1fe1eae8cb06 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:33.661012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b0dddea1-ab2b-43db-bb39-1fe1eae8cb06 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:33.677516 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b0dddea1-ab2b-43db-bb39-1fe1eae8cb06 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1317 microversion: 2.1 time: 0.392231 Oct 18 13:33:33.678113 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1800/3814] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:33 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:34.048371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0c646a88-5090-47fc-bed0-8e6b325064b9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:34.050857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0c646a88-5090-47fc-bed0-8e6b325064b9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:34.057750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c646a88-5090-47fc-bed0-8e6b325064b9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:34.058380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c646a88-5090-47fc-bed0-8e6b325064b9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:34.058933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c646a88-5090-47fc-bed0-8e6b325064b9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:34.060857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c646a88-5090-47fc-bed0-8e6b325064b9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:34.061657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c646a88-5090-47fc-bed0-8e6b325064b9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:34.062366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c646a88-5090-47fc-bed0-8e6b325064b9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:34.340953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-69206fcf-853c-462b-9897-eb9b2ab85573 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:34.343175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-69206fcf-853c-462b-9897-eb9b2ab85573 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:34.360776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69206fcf-853c-462b-9897-eb9b2ab85573 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:34.361703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69206fcf-853c-462b-9897-eb9b2ab85573 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:34.362336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69206fcf-853c-462b-9897-eb9b2ab85573 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:34.367218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69206fcf-853c-462b-9897-eb9b2ab85573 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:34.367882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69206fcf-853c-462b-9897-eb9b2ab85573 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:34.368497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69206fcf-853c-462b-9897-eb9b2ab85573 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:34.572841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0c646a88-5090-47fc-bed0-8e6b325064b9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:34.586044 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0c646a88-5090-47fc-bed0-8e6b325064b9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.539203 Oct 18 13:33:34.586865 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2015/3815] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:34 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1322 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:34.702222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ae470919-4e17-4905-a323-87b6e22277ad tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:34.704052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ae470919-4e17-4905-a323-87b6e22277ad tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:34.720137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae470919-4e17-4905-a323-87b6e22277ad tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:34.722581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae470919-4e17-4905-a323-87b6e22277ad tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:34.723887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae470919-4e17-4905-a323-87b6e22277ad tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:34.727724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae470919-4e17-4905-a323-87b6e22277ad tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:34.732565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae470919-4e17-4905-a323-87b6e22277ad tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:34.733432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae470919-4e17-4905-a323-87b6e22277ad tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:35.207210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ae470919-4e17-4905-a323-87b6e22277ad tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:35.220152 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ae470919-4e17-4905-a323-87b6e22277ad tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1317 microversion: 2.1 time: 0.522137 Oct 18 13:33:35.221494 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2016/3816] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:34 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1317 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:35.239384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-a1e9fc7d-d493-47c2-80ef-8290c6709132 req-0c8c9eaf-3604-4496-9f8f-c3f129663f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f75005a7-f4b9-46a1-bdb9-98d795d0c0a9", "tag": "cd03578d-94c2-4cc7-879e-cd4a553d91c2"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:35.271920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a1e9fc7d-d493-47c2-80ef-8290c6709132 req-0c8c9eaf-3604-4496-9f8f-c3f129663f93 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:35.272510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a1e9fc7d-d493-47c2-80ef-8290c6709132 req-0c8c9eaf-3604-4496-9f8f-c3f129663f93 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:35.273654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a1e9fc7d-d493-47c2-80ef-8290c6709132 req-0c8c9eaf-3604-4496-9f8f-c3f129663f93 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:35.290419 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-a1e9fc7d-d493-47c2-80ef-8290c6709132 req-0c8c9eaf-3604-4496-9f8f-c3f129663f93 service nova] Creating event network-changed:cd03578d-94c2-4cc7-879e-cd4a553d91c2 for instance f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 on n-h1-858384-13 Oct 18 13:33:35.295732 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-a1e9fc7d-d493-47c2-80ef-8290c6709132 req-0c8c9eaf-3604-4496-9f8f-c3f129663f93 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071594 Oct 18 13:33:35.297575 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2017/3817] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:35.356444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-69206fcf-853c-462b-9897-eb9b2ab85573 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:35.369699 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-69206fcf-853c-462b-9897-eb9b2ab85573 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 1.033526 Oct 18 13:33:35.372896 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1801/3818] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:34 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:35.611748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-efba2276-dc81-4443-a3d2-7a330c70cd5d tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:35.613171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-efba2276-dc81-4443-a3d2-7a330c70cd5d tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:35.632391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efba2276-dc81-4443-a3d2-7a330c70cd5d tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:35.633366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efba2276-dc81-4443-a3d2-7a330c70cd5d tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:35.633934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efba2276-dc81-4443-a3d2-7a330c70cd5d tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:35.634798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efba2276-dc81-4443-a3d2-7a330c70cd5d tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:35.635361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efba2276-dc81-4443-a3d2-7a330c70cd5d tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:35.636269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efba2276-dc81-4443-a3d2-7a330c70cd5d tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:35.957544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-efba2276-dc81-4443-a3d2-7a330c70cd5d tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:35.970090 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-efba2276-dc81-4443-a3d2-7a330c70cd5d tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.362836 Oct 18 13:33:35.971896 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2018/3819] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:35 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:36.246830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dbf968ed-b2ef-4d74-b283-87bfdfff032f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:36.250926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dbf968ed-b2ef-4d74-b283-87bfdfff032f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:36.253708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:36.260357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbf968ed-b2ef-4d74-b283-87bfdfff032f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:36.261116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbf968ed-b2ef-4d74-b283-87bfdfff032f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:36.261730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbf968ed-b2ef-4d74-b283-87bfdfff032f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:36.262624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbf968ed-b2ef-4d74-b283-87bfdfff032f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:36.263239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbf968ed-b2ef-4d74-b283-87bfdfff032f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:36.264174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbf968ed-b2ef-4d74-b283-87bfdfff032f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:36.379775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-804e2f45-cc9a-4026-ae17-2d67799b4f55 req-607906ca-21b2-4c15-b4cb-15022e3ecbcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4454e71a-3edc-4cc4-8a35-2a148257f003", "name": "network-vif-plugged", "status": "completed", "tag": "9c2d2d03-721b-4237-9dcd-8ddc8d43c508"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:36.416672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-804e2f45-cc9a-4026-ae17-2d67799b4f55 req-607906ca-21b2-4c15-b4cb-15022e3ecbcf service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:36.417322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-804e2f45-cc9a-4026-ae17-2d67799b4f55 req-607906ca-21b2-4c15-b4cb-15022e3ecbcf service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:36.417806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-804e2f45-cc9a-4026-ae17-2d67799b4f55 req-607906ca-21b2-4c15-b4cb-15022e3ecbcf service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:36.444536 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-804e2f45-cc9a-4026-ae17-2d67799b4f55 req-607906ca-21b2-4c15-b4cb-15022e3ecbcf service nova] Creating event network-vif-plugged:9c2d2d03-721b-4237-9dcd-8ddc8d43c508 for instance 4454e71a-3edc-4cc4-8a35-2a148257f003 on n-h1-858384-13 Oct 18 13:33:36.452363 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-804e2f45-cc9a-4026-ae17-2d67799b4f55 req-607906ca-21b2-4c15-b4cb-15022e3ecbcf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077552 Oct 18 13:33:36.453878 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2019/3820] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:36.460082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b3e99db8-9b2e-45ff-b3fd-c873596ddff2 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:36.460852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b3e99db8-9b2e-45ff-b3fd-c873596ddff2 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:36.469633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3e99db8-9b2e-45ff-b3fd-c873596ddff2 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:36.470389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3e99db8-9b2e-45ff-b3fd-c873596ddff2 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:36.471081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3e99db8-9b2e-45ff-b3fd-c873596ddff2 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:36.471959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3e99db8-9b2e-45ff-b3fd-c873596ddff2 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:36.472595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3e99db8-9b2e-45ff-b3fd-c873596ddff2 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:36.473204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3e99db8-9b2e-45ff-b3fd-c873596ddff2 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:36.543660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dbf968ed-b2ef-4d74-b283-87bfdfff032f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:36.550077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:36.573203 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dbf968ed-b2ef-4d74-b283-87bfdfff032f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1317 microversion: 2.1 time: 0.332503 Oct 18 13:33:36.574710 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1802/3821] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:36 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:36.738521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b3e99db8-9b2e-45ff-b3fd-c873596ddff2 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:36.748834 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b3e99db8-9b2e-45ff-b3fd-c873596ddff2 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 0.293283 Oct 18 13:33:36.750781 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2020/3822] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:36 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:36.994195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dcc5679f-0bbb-4b1b-83c6-d070f9389c77 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:36.995818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dcc5679f-0bbb-4b1b-83c6-d070f9389c77 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:37.004878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcc5679f-0bbb-4b1b-83c6-d070f9389c77 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:37.005936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcc5679f-0bbb-4b1b-83c6-d070f9389c77 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:37.006381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcc5679f-0bbb-4b1b-83c6-d070f9389c77 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:37.008857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcc5679f-0bbb-4b1b-83c6-d070f9389c77 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:37.011157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcc5679f-0bbb-4b1b-83c6-d070f9389c77 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:37.011530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcc5679f-0bbb-4b1b-83c6-d070f9389c77 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:37.167340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=8 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:37.264138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dcc5679f-0bbb-4b1b-83c6-d070f9389c77 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:37.277040 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dcc5679f-0bbb-4b1b-83c6-d070f9389c77 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.286971 Oct 18 13:33:37.279119 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1803/3823] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:36 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:37.456478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-4a1987d1-0041-4513-8192-045779a3525f req-2a912132-aab7-4bdf-ade4-541f64dab16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18dcc6bf-fc63-4063-93f6-d8f7b158aef9", "tag": "09c9753d-8cf9-4d94-baec-f6d8d5abcc80"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:37.464514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:37.466470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:37.490181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4a1987d1-0041-4513-8192-045779a3525f req-2a912132-aab7-4bdf-ade4-541f64dab16c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:37.490673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4a1987d1-0041-4513-8192-045779a3525f req-2a912132-aab7-4bdf-ade4-541f64dab16c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:37.491116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4a1987d1-0041-4513-8192-045779a3525f req-2a912132-aab7-4bdf-ade4-541f64dab16c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:37.521989 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-4a1987d1-0041-4513-8192-045779a3525f req-2a912132-aab7-4bdf-ade4-541f64dab16c service nova] Creating event network-changed:09c9753d-8cf9-4d94-baec-f6d8d5abcc80 for instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 on n-h1-858384-13 Oct 18 13:33:37.534142 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-4a1987d1-0041-4513-8192-045779a3525f req-2a912132-aab7-4bdf-ade4-541f64dab16c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082449 Oct 18 13:33:37.534965 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2021/3824] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:37.603940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-13ce769a-17d4-4523-a20b-3c1db3d51cec tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:37.604561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-13ce769a-17d4-4523-a20b-3c1db3d51cec tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:37.619074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13ce769a-17d4-4523-a20b-3c1db3d51cec tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:37.619561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13ce769a-17d4-4523-a20b-3c1db3d51cec tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:37.623172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13ce769a-17d4-4523-a20b-3c1db3d51cec tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:37.624288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13ce769a-17d4-4523-a20b-3c1db3d51cec tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:37.625743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13ce769a-17d4-4523-a20b-3c1db3d51cec tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:37.629738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13ce769a-17d4-4523-a20b-3c1db3d51cec tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:37.775058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2bd01907-8fc4-462f-bc11-91e8e091607e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:37.777553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2bd01907-8fc4-462f-bc11-91e8e091607e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:37.795490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bd01907-8fc4-462f-bc11-91e8e091607e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:37.797971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bd01907-8fc4-462f-bc11-91e8e091607e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:37.799836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bd01907-8fc4-462f-bc11-91e8e091607e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:37.802121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-13ce769a-17d4-4523-a20b-3c1db3d51cec tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:37.804315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bd01907-8fc4-462f-bc11-91e8e091607e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:37.805686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bd01907-8fc4-462f-bc11-91e8e091607e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:37.806802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bd01907-8fc4-462f-bc11-91e8e091607e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:37.817364 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-13ce769a-17d4-4523-a20b-3c1db3d51cec tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1317 microversion: 2.1 time: 0.212213 Oct 18 13:33:37.833371 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1804/3825] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:37 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:38.308716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7e2aca5e-7423-49b1-946d-092d0f92bbc0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:38.309458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7e2aca5e-7423-49b1-946d-092d0f92bbc0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:38.328445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e2aca5e-7423-49b1-946d-092d0f92bbc0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:38.329039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e2aca5e-7423-49b1-946d-092d0f92bbc0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:38.329550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e2aca5e-7423-49b1-946d-092d0f92bbc0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:38.332331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e2aca5e-7423-49b1-946d-092d0f92bbc0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:38.332331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e2aca5e-7423-49b1-946d-092d0f92bbc0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:38.332331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e2aca5e-7423-49b1-946d-092d0f92bbc0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:38.564841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7e2aca5e-7423-49b1-946d-092d0f92bbc0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:38.585840 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7e2aca5e-7423-49b1-946d-092d0f92bbc0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.283600 Oct 18 13:33:38.593237 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1805/3826] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:38 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:38.614170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-20030efb-63dd-4994-8686-12701aae4481 req-4f940da5-2b48-4a10-9aa0-e03cccc2d08e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4454e71a-3edc-4cc4-8a35-2a148257f003", "name": "network-vif-plugged", "status": "completed", "tag": "ed870daf-a3bd-42b1-aaa5-bcf18d00f9f9"}, {"server_uuid": "4454e71a-3edc-4cc4-8a35-2a148257f003", "name": "network-vif-plugged", "status": "completed", "tag": "7bb4fabd-7f93-4713-a14a-30d96ef641d9"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:38.651199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-20030efb-63dd-4994-8686-12701aae4481 req-4f940da5-2b48-4a10-9aa0-e03cccc2d08e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:38.651731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-20030efb-63dd-4994-8686-12701aae4481 req-4f940da5-2b48-4a10-9aa0-e03cccc2d08e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:38.652162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-20030efb-63dd-4994-8686-12701aae4481 req-4f940da5-2b48-4a10-9aa0-e03cccc2d08e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:38.710713 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-20030efb-63dd-4994-8686-12701aae4481 req-4f940da5-2b48-4a10-9aa0-e03cccc2d08e service nova] Creating event network-vif-plugged:ed870daf-a3bd-42b1-aaa5-bcf18d00f9f9 for instance 4454e71a-3edc-4cc4-8a35-2a148257f003 on n-h1-858384-13 Oct 18 13:33:38.714610 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-20030efb-63dd-4994-8686-12701aae4481 req-4f940da5-2b48-4a10-9aa0-e03cccc2d08e service nova] Creating event network-vif-plugged:7bb4fabd-7f93-4713-a14a-30d96ef641d9 for instance 4454e71a-3edc-4cc4-8a35-2a148257f003 on n-h1-858384-13 Oct 18 13:33:38.717806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2bd01907-8fc4-462f-bc11-91e8e091607e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:38.727598 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-20030efb-63dd-4994-8686-12701aae4481 req-4f940da5-2b48-4a10-9aa0-e03cccc2d08e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.129505 Oct 18 13:33:38.728809 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1806/3827] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:38.730518 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2bd01907-8fc4-462f-bc11-91e8e091607e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 0.960337 Oct 18 13:33:38.756051 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2022/3828] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:37 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:38.848830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3f4c107b-81f4-402a-9ba0-752f5d2dd40e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:38.850157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3f4c107b-81f4-402a-9ba0-752f5d2dd40e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:38.864991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f4c107b-81f4-402a-9ba0-752f5d2dd40e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:38.865831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f4c107b-81f4-402a-9ba0-752f5d2dd40e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:38.870020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f4c107b-81f4-402a-9ba0-752f5d2dd40e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:38.871124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f4c107b-81f4-402a-9ba0-752f5d2dd40e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:38.871786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f4c107b-81f4-402a-9ba0-752f5d2dd40e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:38.872391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f4c107b-81f4-402a-9ba0-752f5d2dd40e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:39.128746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3f4c107b-81f4-402a-9ba0-752f5d2dd40e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:39.139511 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3f4c107b-81f4-402a-9ba0-752f5d2dd40e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1317 microversion: 2.1 time: 0.295747 Oct 18 13:33:39.146296 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1807/3829] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:38 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:39.618513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-94b02364-844b-4da6-aa87-5e3110e416e9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:39.619911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-94b02364-844b-4da6-aa87-5e3110e416e9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:39.628295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94b02364-844b-4da6-aa87-5e3110e416e9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:39.629142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94b02364-844b-4da6-aa87-5e3110e416e9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:39.630225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94b02364-844b-4da6-aa87-5e3110e416e9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:39.630952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94b02364-844b-4da6-aa87-5e3110e416e9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:39.631413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94b02364-844b-4da6-aa87-5e3110e416e9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:39.631844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94b02364-844b-4da6-aa87-5e3110e416e9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:39.755350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aa317eb9-201d-420c-8542-fea6f5e0b476 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:39.757009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aa317eb9-201d-420c-8542-fea6f5e0b476 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:39.766099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa317eb9-201d-420c-8542-fea6f5e0b476 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:39.766973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa317eb9-201d-420c-8542-fea6f5e0b476 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:39.767606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa317eb9-201d-420c-8542-fea6f5e0b476 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:39.769434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa317eb9-201d-420c-8542-fea6f5e0b476 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:39.769880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa317eb9-201d-420c-8542-fea6f5e0b476 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:39.771070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa317eb9-201d-420c-8542-fea6f5e0b476 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:39.991309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-94b02364-844b-4da6-aa87-5e3110e416e9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:40.005035 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-94b02364-844b-4da6-aa87-5e3110e416e9 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.390414 Oct 18 13:33:40.005665 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2023/3830] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:39 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:40.008777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aa317eb9-201d-420c-8542-fea6f5e0b476 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:40.019914 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aa317eb9-201d-420c-8542-fea6f5e0b476 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 0.266193 Oct 18 13:33:40.020551 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1808/3831] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:39 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:40.165258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ec0f37f4-6db0-4761-9685-3a1ec7687f27 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:40.171155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ec0f37f4-6db0-4761-9685-3a1ec7687f27 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:40.178628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0f37f4-6db0-4761-9685-3a1ec7687f27 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:40.179510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0f37f4-6db0-4761-9685-3a1ec7687f27 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:40.180167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0f37f4-6db0-4761-9685-3a1ec7687f27 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:40.183339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0f37f4-6db0-4761-9685-3a1ec7687f27 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:40.184090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0f37f4-6db0-4761-9685-3a1ec7687f27 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:40.184981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0f37f4-6db0-4761-9685-3a1ec7687f27 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:40.478140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ec0f37f4-6db0-4761-9685-3a1ec7687f27 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:40.487065 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ec0f37f4-6db0-4761-9685-3a1ec7687f27 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1317 microversion: 2.1 time: 0.325719 Oct 18 13:33:40.487651 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2024/3832] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:40 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:40.899718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-271137578", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "843d85ac-8a0e-4cb7-9319-ceb8bbaaabea"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:40.958076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] validate_networks() for [('843d85ac-8a0e-4cb7-9319-ceb8bbaaabea', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:33:41.031786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9211cab1-a495-47fb-b17d-b035191fdc0e tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:41.033112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9211cab1-a495-47fb-b17d-b035191fdc0e tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:41.040628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9211cab1-a495-47fb-b17d-b035191fdc0e tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:41.041115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9211cab1-a495-47fb-b17d-b035191fdc0e tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:41.041809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9211cab1-a495-47fb-b17d-b035191fdc0e tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:41.042718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9211cab1-a495-47fb-b17d-b035191fdc0e tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:41.043175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9211cab1-a495-47fb-b17d-b035191fdc0e tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:41.043614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9211cab1-a495-47fb-b17d-b035191fdc0e tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:41.048282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:41.230257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9211cab1-a495-47fb-b17d-b035191fdc0e tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:41.240982 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9211cab1-a495-47fb-b17d-b035191fdc0e tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.216314 Oct 18 13:33:41.242180 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2025/3833] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:41 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:41.248631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-768fac76-f39d-4dfc-a094-1e9ed71be30d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:41.249531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-768fac76-f39d-4dfc-a094-1e9ed71be30d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:41.256197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768fac76-f39d-4dfc-a094-1e9ed71be30d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:41.256929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768fac76-f39d-4dfc-a094-1e9ed71be30d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:41.258033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768fac76-f39d-4dfc-a094-1e9ed71be30d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:41.258739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768fac76-f39d-4dfc-a094-1e9ed71be30d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:41.259364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768fac76-f39d-4dfc-a094-1e9ed71be30d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:41.259973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768fac76-f39d-4dfc-a094-1e9ed71be30d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:41.500377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-768fac76-f39d-4dfc-a094-1e9ed71be30d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:41.503949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:33:41.504663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:33:41.505572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:33:41.506287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:33:41.507073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:33:41.510565 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-768fac76-f39d-4dfc-a094-1e9ed71be30d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1355 microversion: 2.1 time: 0.267068 Oct 18 13:33:41.511397 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2026/3834] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:41 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1355 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:41.518278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b1f69b1c-ed0c-4e52-b5d2-b13dc16a12bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:41.519019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:41.519456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b1f69b1c-ed0c-4e52-b5d2-b13dc16a12bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:41.519700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:41.520240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:41.521088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:41.521776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:41.522315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:41.527265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1f69b1c-ed0c-4e52-b5d2-b13dc16a12bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:41.528063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1f69b1c-ed0c-4e52-b5d2-b13dc16a12bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:41.528686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1f69b1c-ed0c-4e52-b5d2-b13dc16a12bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:41.529441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1f69b1c-ed0c-4e52-b5d2-b13dc16a12bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:41.529903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1f69b1c-ed0c-4e52-b5d2-b13dc16a12bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:41.530326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1f69b1c-ed0c-4e52-b5d2-b13dc16a12bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:41.543846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Getting quotas for project dc2b4569aac3475482a7bd3d44c62d21. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:33:41.550224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Getting quotas for user 5cd671875fd44aaf80984f61f5269744 and project dc2b4569aac3475482a7bd3d44c62d21. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:33:41.565351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:33:41.567882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:33:41.616802 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1e4e268d-5eb8-4d1b-9fb5-de8b1d2be5bd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 0.884795 Oct 18 13:33:41.617667 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1809/3835] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:33:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:33:41.630271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-79670278-e715-4ba2-99ff-5dde6d2df4f9 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:41.630684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-79670278-e715-4ba2-99ff-5dde6d2df4f9 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:41.686054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b1f69b1c-ed0c-4e52-b5d2-b13dc16a12bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:41.688244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-79670278-e715-4ba2-99ff-5dde6d2df4f9 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:41.697223 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b1f69b1c-ed0c-4e52-b5d2-b13dc16a12bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1317 microversion: 2.1 time: 0.184341 Oct 18 13:33:41.698001 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2027/3836] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:41 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:41.699421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-79670278-e715-4ba2-99ff-5dde6d2df4f9 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:41.700862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-79670278-e715-4ba2-99ff-5dde6d2df4f9 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:41.702053 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-79670278-e715-4ba2-99ff-5dde6d2df4f9 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1261 microversion: 2.26 time: 0.076317 Oct 18 13:33:41.702699 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1810/3837] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:41 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1261 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:42.265849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-05261f44-f32b-486e-beeb-2c1bd1b8b75c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:42.267098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-05261f44-f32b-486e-beeb-2c1bd1b8b75c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:42.282367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05261f44-f32b-486e-beeb-2c1bd1b8b75c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.283130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05261f44-f32b-486e-beeb-2c1bd1b8b75c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.283772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05261f44-f32b-486e-beeb-2c1bd1b8b75c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.284663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05261f44-f32b-486e-beeb-2c1bd1b8b75c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.285482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05261f44-f32b-486e-beeb-2c1bd1b8b75c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.286121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05261f44-f32b-486e-beeb-2c1bd1b8b75c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.551563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-731c2c74-7460-4c70-897c-b6715f42efa5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:42.552995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-731c2c74-7460-4c70-897c-b6715f42efa5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:42.578203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-731c2c74-7460-4c70-897c-b6715f42efa5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.586243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-731c2c74-7460-4c70-897c-b6715f42efa5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.587264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-731c2c74-7460-4c70-897c-b6715f42efa5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.589649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-731c2c74-7460-4c70-897c-b6715f42efa5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.590205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-731c2c74-7460-4c70-897c-b6715f42efa5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.590755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-731c2c74-7460-4c70-897c-b6715f42efa5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.655444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-05261f44-f32b-486e-beeb-2c1bd1b8b75c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:42.665993 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-05261f44-f32b-486e-beeb-2c1bd1b8b75c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.404236 Oct 18 13:33:42.667148 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2028/3838] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:42 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:42.722216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-73299223-d182-4354-9a48-87567ee05916 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:42.723194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-73299223-d182-4354-9a48-87567ee05916 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:42.729964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73299223-d182-4354-9a48-87567ee05916 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.730703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73299223-d182-4354-9a48-87567ee05916 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.731327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73299223-d182-4354-9a48-87567ee05916 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.732199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73299223-d182-4354-9a48-87567ee05916 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.732825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73299223-d182-4354-9a48-87567ee05916 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.733494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73299223-d182-4354-9a48-87567ee05916 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.840079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-731c2c74-7460-4c70-897c-b6715f42efa5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:42.855795 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-731c2c74-7460-4c70-897c-b6715f42efa5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1804 microversion: 2.1 time: 0.323634 Oct 18 13:33:42.856502 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1811/3839] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:42 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1804 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:42.861946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ee0ba3c8-0db6-4875-9db1-4ea9dcac76a4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:42.862783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ee0ba3c8-0db6-4875-9db1-4ea9dcac76a4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:42.869002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee0ba3c8-0db6-4875-9db1-4ea9dcac76a4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.869766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee0ba3c8-0db6-4875-9db1-4ea9dcac76a4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.870399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee0ba3c8-0db6-4875-9db1-4ea9dcac76a4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.871284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee0ba3c8-0db6-4875-9db1-4ea9dcac76a4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.871909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee0ba3c8-0db6-4875-9db1-4ea9dcac76a4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.872504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee0ba3c8-0db6-4875-9db1-4ea9dcac76a4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.951218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ee0ba3c8-0db6-4875-9db1-4ea9dcac76a4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:42.960313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ee0ba3c8-0db6-4875-9db1-4ea9dcac76a4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:42.962596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ee0ba3c8-0db6-4875-9db1-4ea9dcac76a4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:42.964689 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ee0ba3c8-0db6-4875-9db1-4ea9dcac76a4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1313 microversion: 2.26 time: 0.106323 Oct 18 13:33:42.965464 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1812/3840] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:42 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1313 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:42.971186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8aa4ed53-0678-46e7-941f-7fd3a323b25a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:42.972330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8aa4ed53-0678-46e7-941f-7fd3a323b25a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:42.984849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8aa4ed53-0678-46e7-941f-7fd3a323b25a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.985548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8aa4ed53-0678-46e7-941f-7fd3a323b25a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.986232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8aa4ed53-0678-46e7-941f-7fd3a323b25a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:42.987126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8aa4ed53-0678-46e7-941f-7fd3a323b25a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:42.987766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8aa4ed53-0678-46e7-941f-7fd3a323b25a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:42.988297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8aa4ed53-0678-46e7-941f-7fd3a323b25a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:43.018916 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8aa4ed53-0678-46e7-941f-7fd3a323b25a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003/ips" status: 200 len: 217 microversion: 2.1 time: 0.051686 Oct 18 13:33:43.019890 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1813/3841] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:33:42 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003/ips => generated 217 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:43.032887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-9562f222-9f71-4ec2-9b22-dab1d2a81365 req-c2f63092-c8f7-4a22-8da4-a9899ebf8d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f75005a7-f4b9-46a1-bdb9-98d795d0c0a9", "name": "network-vif-plugged", "status": "completed", "tag": "cd03578d-94c2-4cc7-879e-cd4a553d91c2"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:43.049579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9562f222-9f71-4ec2-9b22-dab1d2a81365 req-c2f63092-c8f7-4a22-8da4-a9899ebf8d02 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:43.050251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9562f222-9f71-4ec2-9b22-dab1d2a81365 req-c2f63092-c8f7-4a22-8da4-a9899ebf8d02 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:43.051062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9562f222-9f71-4ec2-9b22-dab1d2a81365 req-c2f63092-c8f7-4a22-8da4-a9899ebf8d02 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:43.071317 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-9562f222-9f71-4ec2-9b22-dab1d2a81365 req-c2f63092-c8f7-4a22-8da4-a9899ebf8d02 service nova] Creating event network-vif-plugged:cd03578d-94c2-4cc7-879e-cd4a553d91c2 for instance f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 on n-h1-858384-13 Oct 18 13:33:43.080420 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-9562f222-9f71-4ec2-9b22-dab1d2a81365 req-c2f63092-c8f7-4a22-8da4-a9899ebf8d02 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053944 Oct 18 13:33:43.092710 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1814/3842] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:43.106816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-30810f09-9aba-48ec-98ae-beff391ed61c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:43.107794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-30810f09-9aba-48ec-98ae-beff391ed61c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:43.117502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30810f09-9aba-48ec-98ae-beff391ed61c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:43.118413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30810f09-9aba-48ec-98ae-beff391ed61c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:43.119095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30810f09-9aba-48ec-98ae-beff391ed61c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:43.120145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30810f09-9aba-48ec-98ae-beff391ed61c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:43.120834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30810f09-9aba-48ec-98ae-beff391ed61c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:43.121726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30810f09-9aba-48ec-98ae-beff391ed61c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:43.158692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-30810f09-9aba-48ec-98ae-beff391ed61c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:33:43.309540 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-30810f09-9aba-48ec-98ae-beff391ed61c tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 204 len: 0 microversion: 2.1 time: 0.207484 Oct 18 13:33:43.311182 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1815/3843] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:33:43 2022] DELETE /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:33:43.326119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-25e70e51-fe81-4e35-8c40-ff4315d41784 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:43.330825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-25e70e51-fe81-4e35-8c40-ff4315d41784 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:43.348024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25e70e51-fe81-4e35-8c40-ff4315d41784 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:43.349572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25e70e51-fe81-4e35-8c40-ff4315d41784 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:43.351388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25e70e51-fe81-4e35-8c40-ff4315d41784 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:43.355201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25e70e51-fe81-4e35-8c40-ff4315d41784 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:43.355811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25e70e51-fe81-4e35-8c40-ff4315d41784 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:43.356570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-73299223-d182-4354-9a48-87567ee05916 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:43.357056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25e70e51-fe81-4e35-8c40-ff4315d41784 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:43.368456 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-73299223-d182-4354-9a48-87567ee05916 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1317 microversion: 2.1 time: 0.651134 Oct 18 13:33:43.371142 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2029/3844] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:42 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1317 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:43.639766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-25e70e51-fe81-4e35-8c40-ff4315d41784 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:43.651987 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-25e70e51-fe81-4e35-8c40-ff4315d41784 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1810 microversion: 2.1 time: 0.334471 Oct 18 13:33:43.654344 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1816/3845] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:43 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1810 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:43.690498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5f7d0ce2-3cec-455e-89f9-77512ed280cc tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:43.691631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5f7d0ce2-3cec-455e-89f9-77512ed280cc tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:43.698680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f7d0ce2-3cec-455e-89f9-77512ed280cc tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:43.699501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f7d0ce2-3cec-455e-89f9-77512ed280cc tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:43.699916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f7d0ce2-3cec-455e-89f9-77512ed280cc tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:43.700741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f7d0ce2-3cec-455e-89f9-77512ed280cc tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:43.701528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f7d0ce2-3cec-455e-89f9-77512ed280cc tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:43.702176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f7d0ce2-3cec-455e-89f9-77512ed280cc tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:43.851761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5f7d0ce2-3cec-455e-89f9-77512ed280cc tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:43.861576 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5f7d0ce2-3cec-455e-89f9-77512ed280cc tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.175524 Oct 18 13:33:43.862835 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2030/3846] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:43 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:43.993208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-80424140-5870-4638-a24e-82ba3769ce6b tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:43.994189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-80424140-5870-4638-a24e-82ba3769ce6b tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:44.017972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80424140-5870-4638-a24e-82ba3769ce6b tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:44.018934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80424140-5870-4638-a24e-82ba3769ce6b tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:44.019627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80424140-5870-4638-a24e-82ba3769ce6b tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:44.020832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80424140-5870-4638-a24e-82ba3769ce6b tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:44.021698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80424140-5870-4638-a24e-82ba3769ce6b tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:44.022378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80424140-5870-4638-a24e-82ba3769ce6b tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:44.128818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-80424140-5870-4638-a24e-82ba3769ce6b tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:44.145694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-80424140-5870-4638-a24e-82ba3769ce6b tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:44.147298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-80424140-5870-4638-a24e-82ba3769ce6b tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:44.149034 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-80424140-5870-4638-a24e-82ba3769ce6b tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1319 microversion: 2.26 time: 0.160587 Oct 18 13:33:44.165469 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1817/3847] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:43 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:44.398110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-50af8f72-58ee-4634-b1c9-617d2b67298a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:44.398887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-50af8f72-58ee-4634-b1c9-617d2b67298a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:44.408782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50af8f72-58ee-4634-b1c9-617d2b67298a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:44.409958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50af8f72-58ee-4634-b1c9-617d2b67298a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:44.410626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50af8f72-58ee-4634-b1c9-617d2b67298a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:44.414127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50af8f72-58ee-4634-b1c9-617d2b67298a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:44.415077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50af8f72-58ee-4634-b1c9-617d2b67298a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:44.415795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50af8f72-58ee-4634-b1c9-617d2b67298a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:44.679325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bc1f5f49-117f-49b5-a9cf-4422793ecb3f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:44.679953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bc1f5f49-117f-49b5-a9cf-4422793ecb3f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:44.694544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc1f5f49-117f-49b5-a9cf-4422793ecb3f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:44.695205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc1f5f49-117f-49b5-a9cf-4422793ecb3f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:44.695646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc1f5f49-117f-49b5-a9cf-4422793ecb3f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:44.696353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc1f5f49-117f-49b5-a9cf-4422793ecb3f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:44.696801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc1f5f49-117f-49b5-a9cf-4422793ecb3f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:44.700536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc1f5f49-117f-49b5-a9cf-4422793ecb3f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:44.751082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-50af8f72-58ee-4634-b1c9-617d2b67298a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:44.764320 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-50af8f72-58ee-4634-b1c9-617d2b67298a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1317 microversion: 2.1 time: 0.373017 Oct 18 13:33:44.765781 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2031/3848] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:44 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:44.886344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-12654dfb-89ac-41a5-9abc-aa744f0ad4cb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:44.887111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-12654dfb-89ac-41a5-9abc-aa744f0ad4cb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:44.907965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12654dfb-89ac-41a5-9abc-aa744f0ad4cb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:44.908568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12654dfb-89ac-41a5-9abc-aa744f0ad4cb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:44.909113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12654dfb-89ac-41a5-9abc-aa744f0ad4cb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:44.909965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12654dfb-89ac-41a5-9abc-aa744f0ad4cb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:44.910535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12654dfb-89ac-41a5-9abc-aa744f0ad4cb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:44.911067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12654dfb-89ac-41a5-9abc-aa744f0ad4cb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:45.265055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bc1f5f49-117f-49b5-a9cf-4422793ecb3f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:45.277447 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bc1f5f49-117f-49b5-a9cf-4422793ecb3f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1810 microversion: 2.1 time: 0.599741 Oct 18 13:33:45.294251 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1818/3849] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:44 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1810 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:45.305858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b5016d8b-9056-4f71-9a9d-52ba1990ac08 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:45.308459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b5016d8b-9056-4f71-9a9d-52ba1990ac08 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:45.319743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5016d8b-9056-4f71-9a9d-52ba1990ac08 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:45.322565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5016d8b-9056-4f71-9a9d-52ba1990ac08 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:45.323409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5016d8b-9056-4f71-9a9d-52ba1990ac08 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:45.330182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5016d8b-9056-4f71-9a9d-52ba1990ac08 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:45.331019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5016d8b-9056-4f71-9a9d-52ba1990ac08 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:45.331696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5016d8b-9056-4f71-9a9d-52ba1990ac08 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:45.461653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-12654dfb-89ac-41a5-9abc-aa744f0ad4cb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:45.475284 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-12654dfb-89ac-41a5-9abc-aa744f0ad4cb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.593027 Oct 18 13:33:45.476520 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2032/3850] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:44 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1322 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:45.591050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b5016d8b-9056-4f71-9a9d-52ba1990ac08 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:45.600767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b5016d8b-9056-4f71-9a9d-52ba1990ac08 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:45.602644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b5016d8b-9056-4f71-9a9d-52ba1990ac08 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:45.605558 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b5016d8b-9056-4f71-9a9d-52ba1990ac08 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1361 microversion: 2.26 time: 0.309957 Oct 18 13:33:45.606495 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1819/3851] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:45 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1361 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:45.720948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1db219f7-857f-42fb-a996-30e8c02d9afc req-cee319fd-1a53-4163-893c-4708e01ced27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158bef41-8f92-41e0-ac04-4aa8164611ac", "tag": "675db4dd-937b-4831-8453-adebc2ee1cb1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:45.755147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1db219f7-857f-42fb-a996-30e8c02d9afc req-cee319fd-1a53-4163-893c-4708e01ced27 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:45.755969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1db219f7-857f-42fb-a996-30e8c02d9afc req-cee319fd-1a53-4163-893c-4708e01ced27 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:45.757734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1db219f7-857f-42fb-a996-30e8c02d9afc req-cee319fd-1a53-4163-893c-4708e01ced27 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:45.783553 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1db219f7-857f-42fb-a996-30e8c02d9afc req-cee319fd-1a53-4163-893c-4708e01ced27 service nova] Creating event network-changed:675db4dd-937b-4831-8453-adebc2ee1cb1 for instance 158bef41-8f92-41e0-ac04-4aa8164611ac on n-h2-858384-13 Oct 18 13:33:45.793925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c1a131bf-1a0b-40db-aaf6-6b20ece6c3c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:45.795390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c1a131bf-1a0b-40db-aaf6-6b20ece6c3c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:45.797689 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1db219f7-857f-42fb-a996-30e8c02d9afc req-cee319fd-1a53-4163-893c-4708e01ced27 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078773 Oct 18 13:33:45.798374 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2033/3852] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:45.810425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1a131bf-1a0b-40db-aaf6-6b20ece6c3c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:45.815411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1a131bf-1a0b-40db-aaf6-6b20ece6c3c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:45.816050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1a131bf-1a0b-40db-aaf6-6b20ece6c3c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:45.829022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1a131bf-1a0b-40db-aaf6-6b20ece6c3c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:45.832463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1a131bf-1a0b-40db-aaf6-6b20ece6c3c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:45.834542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1a131bf-1a0b-40db-aaf6-6b20ece6c3c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:46.122788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-6f053d72-de23-408e-8af9-1a46c2ca0bf8 req-38874249-0d56-48a7-ac78-9c2e374756ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4454e71a-3edc-4cc4-8a35-2a148257f003", "name": "network-vif-deleted", "tag": "9c2d2d03-721b-4237-9dcd-8ddc8d43c508"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:46.132576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:46.135439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6f053d72-de23-408e-8af9-1a46c2ca0bf8 req-38874249-0d56-48a7-ac78-9c2e374756ab service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:46.136180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6f053d72-de23-408e-8af9-1a46c2ca0bf8 req-38874249-0d56-48a7-ac78-9c2e374756ab service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:46.137631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6f053d72-de23-408e-8af9-1a46c2ca0bf8 req-38874249-0d56-48a7-ac78-9c2e374756ab service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:46.154284 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-6f053d72-de23-408e-8af9-1a46c2ca0bf8 req-38874249-0d56-48a7-ac78-9c2e374756ab service nova] Creating event network-vif-deleted:9c2d2d03-721b-4237-9dcd-8ddc8d43c508 for instance 4454e71a-3edc-4cc4-8a35-2a148257f003 on n-h1-858384-13 Oct 18 13:33:46.161330 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-6f053d72-de23-408e-8af9-1a46c2ca0bf8 req-38874249-0d56-48a7-ac78-9c2e374756ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042676 Oct 18 13:33:46.162581 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2034/3853] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:46.164164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c1a131bf-1a0b-40db-aaf6-6b20ece6c3c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:46.173274 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c1a131bf-1a0b-40db-aaf6-6b20ece6c3c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1317 microversion: 2.1 time: 0.385050 Oct 18 13:33:46.174645 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1820/3854] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:45 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:46.306493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-efbc6ca6-58a3-4a9d-97f5-bbdb9c8110a0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:46.307473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-efbc6ca6-58a3-4a9d-97f5-bbdb9c8110a0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:46.314650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efbc6ca6-58a3-4a9d-97f5-bbdb9c8110a0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:46.315425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efbc6ca6-58a3-4a9d-97f5-bbdb9c8110a0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:46.316072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efbc6ca6-58a3-4a9d-97f5-bbdb9c8110a0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:46.317408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efbc6ca6-58a3-4a9d-97f5-bbdb9c8110a0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:46.318063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efbc6ca6-58a3-4a9d-97f5-bbdb9c8110a0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:46.321844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efbc6ca6-58a3-4a9d-97f5-bbdb9c8110a0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:46.499145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d1d8702c-2718-4e92-b3d4-b0be0bf07f55 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:46.500044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d1d8702c-2718-4e92-b3d4-b0be0bf07f55 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:46.507421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1d8702c-2718-4e92-b3d4-b0be0bf07f55 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:46.507911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1d8702c-2718-4e92-b3d4-b0be0bf07f55 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:46.508552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1d8702c-2718-4e92-b3d4-b0be0bf07f55 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:46.509492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1d8702c-2718-4e92-b3d4-b0be0bf07f55 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:46.510089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1d8702c-2718-4e92-b3d4-b0be0bf07f55 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:46.510372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1d8702c-2718-4e92-b3d4-b0be0bf07f55 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:46.514856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:46.539062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-efbc6ca6-58a3-4a9d-97f5-bbdb9c8110a0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:46.552039 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-efbc6ca6-58a3-4a9d-97f5-bbdb9c8110a0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1631 microversion: 2.1 time: 0.248910 Oct 18 13:33:46.571838 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2035/3855] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:46 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1631 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:46.636330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa8d1789-db34-41e7-b606-da80aeff2020 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:46.637628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fa8d1789-db34-41e7-b606-da80aeff2020 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:46.647143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa8d1789-db34-41e7-b606-da80aeff2020 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:46.648434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa8d1789-db34-41e7-b606-da80aeff2020 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:46.649492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa8d1789-db34-41e7-b606-da80aeff2020 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:46.650631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa8d1789-db34-41e7-b606-da80aeff2020 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:46.651312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa8d1789-db34-41e7-b606-da80aeff2020 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:46.651943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa8d1789-db34-41e7-b606-da80aeff2020 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:46.811061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d1d8702c-2718-4e92-b3d4-b0be0bf07f55 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:46.822565 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d1d8702c-2718-4e92-b3d4-b0be0bf07f55 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.327259 Oct 18 13:33:46.824194 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1821/3856] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:46 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:46.984205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fa8d1789-db34-41e7-b606-da80aeff2020 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:47.004203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fa8d1789-db34-41e7-b606-da80aeff2020 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:47.010667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fa8d1789-db34-41e7-b606-da80aeff2020 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:47.012547 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fa8d1789-db34-41e7-b606-da80aeff2020 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1361 microversion: 2.26 time: 0.380697 Oct 18 13:33:47.013681 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2036/3857] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:46 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1361 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:33:47.196356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fc388d45-5e53-4f00-9795-bcade0823a1b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:47.197935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fc388d45-5e53-4f00-9795-bcade0823a1b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:47.204751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc388d45-5e53-4f00-9795-bcade0823a1b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:47.205718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc388d45-5e53-4f00-9795-bcade0823a1b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:47.206408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc388d45-5e53-4f00-9795-bcade0823a1b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:47.207333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc388d45-5e53-4f00-9795-bcade0823a1b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:47.208194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc388d45-5e53-4f00-9795-bcade0823a1b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:47.208849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc388d45-5e53-4f00-9795-bcade0823a1b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:47.299681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-be162eb2-4165-461d-8fb6-d39a173540b0 req-f42dd3e6-6661-479d-be86-4345b0b2c11f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18dcc6bf-fc63-4063-93f6-d8f7b158aef9", "name": "network-vif-plugged", "status": "completed", "tag": "09c9753d-8cf9-4d94-baec-f6d8d5abcc80"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:47.322007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-be162eb2-4165-461d-8fb6-d39a173540b0 req-f42dd3e6-6661-479d-be86-4345b0b2c11f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:47.322392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-be162eb2-4165-461d-8fb6-d39a173540b0 req-f42dd3e6-6661-479d-be86-4345b0b2c11f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:47.329901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-be162eb2-4165-461d-8fb6-d39a173540b0 req-f42dd3e6-6661-479d-be86-4345b0b2c11f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:47.371852 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-be162eb2-4165-461d-8fb6-d39a173540b0 req-f42dd3e6-6661-479d-be86-4345b0b2c11f service nova] Creating event network-vif-plugged:09c9753d-8cf9-4d94-baec-f6d8d5abcc80 for instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 on n-h1-858384-13 Oct 18 13:33:47.378010 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-be162eb2-4165-461d-8fb6-d39a173540b0 req-f42dd3e6-6661-479d-be86-4345b0b2c11f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083856 Oct 18 13:33:47.378705 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2037/3858] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:33:47.423023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fc388d45-5e53-4f00-9795-bcade0823a1b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:47.433900 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fc388d45-5e53-4f00-9795-bcade0823a1b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1317 microversion: 2.1 time: 0.241698 Oct 18 13:33:47.435428 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1822/3859] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:47 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:47.580304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:47.582489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:47.592189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:47.593025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:47.594690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:47.595628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:47.596265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:47.597096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:47.637921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:47.638999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:47.639697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:47.640547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lazy-loading 'fault' on Instance uuid 4454e71a-3edc-4cc4-8a35-2a148257f003 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:47.713623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:47.727201 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-58daa803-7363-428a-b2ae-2ece538e1e75 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1303 microversion: 2.1 time: 0.151270 Oct 18 13:33:47.727846 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2038/3860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:47 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:47.848627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-afb3c9e0-a301-400f-a370-33b2666aa5b3 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:47.849354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-afb3c9e0-a301-400f-a370-33b2666aa5b3 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:47.856850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afb3c9e0-a301-400f-a370-33b2666aa5b3 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:47.857380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afb3c9e0-a301-400f-a370-33b2666aa5b3 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:47.857826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afb3c9e0-a301-400f-a370-33b2666aa5b3 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:47.858537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afb3c9e0-a301-400f-a370-33b2666aa5b3 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:47.859804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afb3c9e0-a301-400f-a370-33b2666aa5b3 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:47.860491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afb3c9e0-a301-400f-a370-33b2666aa5b3 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:47.963693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-72940a7f-9524-4167-84e0-f4a59459abda tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:47.964116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-72940a7f-9524-4167-84e0-f4a59459abda tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:47.971825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72940a7f-9524-4167-84e0-f4a59459abda tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:47.972326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72940a7f-9524-4167-84e0-f4a59459abda tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:47.972766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72940a7f-9524-4167-84e0-f4a59459abda tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:47.973514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72940a7f-9524-4167-84e0-f4a59459abda tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:47.973975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72940a7f-9524-4167-84e0-f4a59459abda tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:47.974405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72940a7f-9524-4167-84e0-f4a59459abda tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:48.004117 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-72940a7f-9524-4167-84e0-f4a59459abda tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/ips" status: 200 len: 152 microversion: 2.20 time: 0.044575 Oct 18 13:33:48.004707 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2039/3861] 10.222.0.40 () {60 vars in 1289 bytes} [Tue Oct 18 13:33:47 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:33:48.039341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5aa78952-5c00-49e3-b4a7-825bb8461b61 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:48.040226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5aa78952-5c00-49e3-b4a7-825bb8461b61 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:48.057271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5aa78952-5c00-49e3-b4a7-825bb8461b61 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:48.060474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5aa78952-5c00-49e3-b4a7-825bb8461b61 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:48.061229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5aa78952-5c00-49e3-b4a7-825bb8461b61 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:48.063261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5aa78952-5c00-49e3-b4a7-825bb8461b61 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:48.065661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5aa78952-5c00-49e3-b4a7-825bb8461b61 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:48.066412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5aa78952-5c00-49e3-b4a7-825bb8461b61 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:48.195596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-afb3c9e0-a301-400f-a370-33b2666aa5b3 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:48.206910 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-afb3c9e0-a301-400f-a370-33b2666aa5b3 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1516 microversion: 2.1 time: 0.362581 Oct 18 13:33:48.226102 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1823/3862] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:47 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1516 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:48.234008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-5c1212f0-805a-4fd1-bb3b-966f5f6a8686 req-bb0c0d88-0a39-4c66-93fc-6d50027d2438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4454e71a-3edc-4cc4-8a35-2a148257f003", "name": "network-vif-deleted", "tag": "7bb4fabd-7f93-4713-a14a-30d96ef641d9"}, {"server_uuid": "4454e71a-3edc-4cc4-8a35-2a148257f003", "name": "network-vif-deleted", "tag": "ed870daf-a3bd-42b1-aaa5-bcf18d00f9f9"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:48.246361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5c1212f0-805a-4fd1-bb3b-966f5f6a8686 req-bb0c0d88-0a39-4c66-93fc-6d50027d2438 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:48.247332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5c1212f0-805a-4fd1-bb3b-966f5f6a8686 req-bb0c0d88-0a39-4c66-93fc-6d50027d2438 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:48.248007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5c1212f0-805a-4fd1-bb3b-966f5f6a8686 req-bb0c0d88-0a39-4c66-93fc-6d50027d2438 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:48.269165 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-5c1212f0-805a-4fd1-bb3b-966f5f6a8686 req-bb0c0d88-0a39-4c66-93fc-6d50027d2438 service nova] Creating event network-vif-deleted:7bb4fabd-7f93-4713-a14a-30d96ef641d9 for instance 4454e71a-3edc-4cc4-8a35-2a148257f003 on n-h1-858384-13 Oct 18 13:33:48.270115 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-5c1212f0-805a-4fd1-bb3b-966f5f6a8686 req-bb0c0d88-0a39-4c66-93fc-6d50027d2438 service nova] Creating event network-vif-deleted:ed870daf-a3bd-42b1-aaa5-bcf18d00f9f9 for instance 4454e71a-3edc-4cc4-8a35-2a148257f003 on n-h1-858384-13 Oct 18 13:33:48.280261 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-5c1212f0-805a-4fd1-bb3b-966f5f6a8686 req-bb0c0d88-0a39-4c66-93fc-6d50027d2438 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048845 Oct 18 13:33:48.283523 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1824/3863] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:33:48.294274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-27c19579-7114-4128-8f40-7cec47a3db17 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:48.297705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-27c19579-7114-4128-8f40-7cec47a3db17 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:48.305700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c19579-7114-4128-8f40-7cec47a3db17 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:48.306534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c19579-7114-4128-8f40-7cec47a3db17 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:48.307047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c19579-7114-4128-8f40-7cec47a3db17 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:48.308121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c19579-7114-4128-8f40-7cec47a3db17 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:48.308748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c19579-7114-4128-8f40-7cec47a3db17 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:48.309459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c19579-7114-4128-8f40-7cec47a3db17 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:48.343449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-27c19579-7114-4128-8f40-7cec47a3db17 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lazy-loading 'flavor' on Instance uuid f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:48.377420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5aa78952-5c00-49e3-b4a7-825bb8461b61 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:48.402629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5aa78952-5c00-49e3-b4a7-825bb8461b61 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:48.406968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5aa78952-5c00-49e3-b4a7-825bb8461b61 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:48.409729 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5aa78952-5c00-49e3-b4a7-825bb8461b61 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1361 microversion: 2.26 time: 0.374843 Oct 18 13:33:48.412159 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2040/3864] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:48 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1361 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:48.459776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9de149e2-2fa5-478a-9c2b-d0bccd24ccfb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:48.460507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9de149e2-2fa5-478a-9c2b-d0bccd24ccfb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:48.474945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9de149e2-2fa5-478a-9c2b-d0bccd24ccfb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:48.475591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9de149e2-2fa5-478a-9c2b-d0bccd24ccfb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:48.475781 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-27c19579-7114-4128-8f40-7cec47a3db17 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "POST /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9/action" status: 200 len: 32 microversion: 2.1 time: 0.190736 Oct 18 13:33:48.476223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9de149e2-2fa5-478a-9c2b-d0bccd24ccfb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:48.477036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9de149e2-2fa5-478a-9c2b-d0bccd24ccfb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:48.477533 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1825/3865] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:33:48 2022] POST /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:33:48.482318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9de149e2-2fa5-478a-9c2b-d0bccd24ccfb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:48.482979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9de149e2-2fa5-478a-9c2b-d0bccd24ccfb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:48.493490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-06010843-d399-4c53-8d35-67361a6f8827 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:48.494441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-06010843-d399-4c53-8d35-67361a6f8827 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:48.519179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06010843-d399-4c53-8d35-67361a6f8827 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:48.519691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06010843-d399-4c53-8d35-67361a6f8827 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:48.521624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06010843-d399-4c53-8d35-67361a6f8827 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:48.526574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06010843-d399-4c53-8d35-67361a6f8827 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:48.527160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06010843-d399-4c53-8d35-67361a6f8827 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:48.527582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06010843-d399-4c53-8d35-67361a6f8827 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:48.794930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9de149e2-2fa5-478a-9c2b-d0bccd24ccfb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:48.806304 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9de149e2-2fa5-478a-9c2b-d0bccd24ccfb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1317 microversion: 2.1 time: 0.350654 Oct 18 13:33:48.821209 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2041/3866] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:48 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:48.821209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:48.821209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:48.823321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:48.823884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:48.824432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:48.825417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:48.826393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:48.827304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:48.879110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:48.879663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:48.880164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:48.880750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lazy-loading 'fault' on Instance uuid 4454e71a-3edc-4cc4-8a35-2a148257f003 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:48.903013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-06010843-d399-4c53-8d35-67361a6f8827 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:48.925928 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-06010843-d399-4c53-8d35-67361a6f8827 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.441270 Oct 18 13:33:48.927358 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1826/3867] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:48 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:48.953725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:48.995973 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-34d82f87-4637-4356-92da-14bbca4233e0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 200 len: 1303 microversion: 2.1 time: 0.174835 Oct 18 13:33:48.997115 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2042/3868] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:48 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 1303 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:49.446383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-585d88ca-81fa-4e28-80d4-492aaf20066d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:49.447023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-585d88ca-81fa-4e28-80d4-492aaf20066d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:49.455871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:49.457404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-585d88ca-81fa-4e28-80d4-492aaf20066d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:49.459113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-585d88ca-81fa-4e28-80d4-492aaf20066d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:49.469849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-585d88ca-81fa-4e28-80d4-492aaf20066d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:49.470620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-585d88ca-81fa-4e28-80d4-492aaf20066d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:49.471096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-585d88ca-81fa-4e28-80d4-492aaf20066d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:49.471535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-585d88ca-81fa-4e28-80d4-492aaf20066d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:49.664205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-585d88ca-81fa-4e28-80d4-492aaf20066d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:49.679287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-585d88ca-81fa-4e28-80d4-492aaf20066d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:49.682141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-585d88ca-81fa-4e28-80d4-492aaf20066d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:49.684649 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-585d88ca-81fa-4e28-80d4-492aaf20066d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1361 microversion: 2.26 time: 0.246093 Oct 18 13:33:49.687002 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1827/3869] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:49 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:49.841285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-350fa9e6-f6c9-49f4-a407-0c7d5c719eb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:49.842521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-350fa9e6-f6c9-49f4-a407-0c7d5c719eb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:49.853608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-350fa9e6-f6c9-49f4-a407-0c7d5c719eb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:49.854307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-350fa9e6-f6c9-49f4-a407-0c7d5c719eb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:49.854911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-350fa9e6-f6c9-49f4-a407-0c7d5c719eb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:49.855819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-350fa9e6-f6c9-49f4-a407-0c7d5c719eb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:49.856587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-350fa9e6-f6c9-49f4-a407-0c7d5c719eb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:49.857304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-350fa9e6-f6c9-49f4-a407-0c7d5c719eb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:49.880310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:49.955004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cbac56c4-6dfa-4404-99a1-18d4c86cca49 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:49.955776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cbac56c4-6dfa-4404-99a1-18d4c86cca49 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:49.965512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbac56c4-6dfa-4404-99a1-18d4c86cca49 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:49.966483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbac56c4-6dfa-4404-99a1-18d4c86cca49 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:49.967112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbac56c4-6dfa-4404-99a1-18d4c86cca49 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:49.968049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbac56c4-6dfa-4404-99a1-18d4c86cca49 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:49.968868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbac56c4-6dfa-4404-99a1-18d4c86cca49 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:49.969516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cbac56c4-6dfa-4404-99a1-18d4c86cca49 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:50.066684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-350fa9e6-f6c9-49f4-a407-0c7d5c719eb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:50.077338 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-350fa9e6-f6c9-49f4-a407-0c7d5c719eb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1507 microversion: 2.1 time: 0.243064 Oct 18 13:33:50.078964 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2043/3870] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:49 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:50.086044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-651958bc-e935-4a32-be9c-7fc7e17857d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:50.087121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-651958bc-e935-4a32-be9c-7fc7e17857d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:50.094641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-651958bc-e935-4a32-be9c-7fc7e17857d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:50.101291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-651958bc-e935-4a32-be9c-7fc7e17857d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:50.102190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-651958bc-e935-4a32-be9c-7fc7e17857d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:50.103206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-651958bc-e935-4a32-be9c-7fc7e17857d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:50.103833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-651958bc-e935-4a32-be9c-7fc7e17857d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:50.105144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-651958bc-e935-4a32-be9c-7fc7e17857d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:50.122951 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-651958bc-e935-4a32-be9c-7fc7e17857d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] HTTP exception thrown: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-651958bc-e935-4a32-be9c-7fc7e17857d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Request method failure captured: Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 HTTP/1.1 Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsDbBW4n8JCHtRi0vzkJYelBSj_YO65Z-nMJqY_gchzIXau4JzQ_Ll5GAATjrNFCV9creVhvHtGqvmoG6klhza6bBsSCR4h8zhc1WcOYH-skXNXV2M-6jKg3nUT7o53fxRtvqXd6pibTbfBTevIqmBDCQLkh0swdU_mBXeqsVkesTQ Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 59efb35dab2a4e64924a27d6f255e8ab Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersTestMultiNic-1887316727 Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59efb35dab2a4e64924a27d6f255e8ab"}]}] Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersTestMultiNic-1887316727 Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 59efb35dab2a4e64924a27d6f255e8ab Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersTestMultiNic-1887316727 Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersTestMultiNic-1887316727-project Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e8916fc7da5847e38fb2e4b3b5bdf297 Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersTestMultiNic-1887316727-project Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '4454e71a-3edc-4cc4-8a35-2a148257f003'} Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:50.125807 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:50.133065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:50.133065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:50.133065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:50.133065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:50.133065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:50.133065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:33:50.133065 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:50.133065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-651958bc-e935-4a32-be9c-7fc7e17857d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Returning 404 to user: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:50.134162 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-651958bc-e935-4a32-be9c-7fc7e17857d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 404 len: 111 microversion: 2.1 time: 0.049796 Oct 18 13:33:50.134935 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2044/3871] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:50 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:33:50.141144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-811428ab-5eff-4e50-b8a6-28c89354dea6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:50.141786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-811428ab-5eff-4e50-b8a6-28c89354dea6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:50.149065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-811428ab-5eff-4e50-b8a6-28c89354dea6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:50.150325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-811428ab-5eff-4e50-b8a6-28c89354dea6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:50.151065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-811428ab-5eff-4e50-b8a6-28c89354dea6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:50.152039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-811428ab-5eff-4e50-b8a6-28c89354dea6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:50.152625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-811428ab-5eff-4e50-b8a6-28c89354dea6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:50.153155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-811428ab-5eff-4e50-b8a6-28c89354dea6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:50.190064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-811428ab-5eff-4e50-b8a6-28c89354dea6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:33:50.192365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cbac56c4-6dfa-4404-99a1-18d4c86cca49 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:50.204636 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cbac56c4-6dfa-4404-99a1-18d4c86cca49 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.253298 Oct 18 13:33:50.205614 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1828/3872] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:49 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:50.290283 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-811428ab-5eff-4e50-b8a6-28c89354dea6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "DELETE /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 204 len: 0 microversion: 2.1 time: 0.153461 Oct 18 13:33:50.291064 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2045/3873] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:33:50 2022] DELETE /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:33:50.301710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2af92ec4-bee3-41d7-b6a1-4d80d9611296 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:50.302346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2af92ec4-bee3-41d7-b6a1-4d80d9611296 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:50.309576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2af92ec4-bee3-41d7-b6a1-4d80d9611296 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:50.310379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2af92ec4-bee3-41d7-b6a1-4d80d9611296 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:50.310863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2af92ec4-bee3-41d7-b6a1-4d80d9611296 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:50.312586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2af92ec4-bee3-41d7-b6a1-4d80d9611296 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:50.313376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2af92ec4-bee3-41d7-b6a1-4d80d9611296 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:50.314067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2af92ec4-bee3-41d7-b6a1-4d80d9611296 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:50.517920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2af92ec4-bee3-41d7-b6a1-4d80d9611296 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:50.527069 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2af92ec4-bee3-41d7-b6a1-4d80d9611296 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1513 microversion: 2.1 time: 0.231314 Oct 18 13:33:50.527821 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1829/3874] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:50 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:50.716091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a3db2471-9e2f-4a0d-a3d9-d3d32b32556f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:50.716957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a3db2471-9e2f-4a0d-a3d9-d3d32b32556f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:50.724678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3db2471-9e2f-4a0d-a3d9-d3d32b32556f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:50.725317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3db2471-9e2f-4a0d-a3d9-d3d32b32556f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:50.725874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3db2471-9e2f-4a0d-a3d9-d3d32b32556f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:50.726683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3db2471-9e2f-4a0d-a3d9-d3d32b32556f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:50.727241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3db2471-9e2f-4a0d-a3d9-d3d32b32556f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:50.727809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3db2471-9e2f-4a0d-a3d9-d3d32b32556f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.229941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-69342d62-443a-4f51-a6f9-ed428657e1f7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:51.232189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-69342d62-443a-4f51-a6f9-ed428657e1f7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:51.239043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69342d62-443a-4f51-a6f9-ed428657e1f7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.239579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69342d62-443a-4f51-a6f9-ed428657e1f7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.241979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69342d62-443a-4f51-a6f9-ed428657e1f7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.242707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69342d62-443a-4f51-a6f9-ed428657e1f7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.243165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69342d62-443a-4f51-a6f9-ed428657e1f7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.243597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69342d62-443a-4f51-a6f9-ed428657e1f7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.291229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a3db2471-9e2f-4a0d-a3d9-d3d32b32556f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:51.309605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a3db2471-9e2f-4a0d-a3d9-d3d32b32556f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:51.311571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a3db2471-9e2f-4a0d-a3d9-d3d32b32556f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:51.313536 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a3db2471-9e2f-4a0d-a3d9-d3d32b32556f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1361 microversion: 2.26 time: 0.601986 Oct 18 13:33:51.321653 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2046/3875] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:50 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1361 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:51.364490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4191916-1821-40fd-98c8-c736e7a4f9a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:51.365021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e4191916-1821-40fd-98c8-c736e7a4f9a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:51.372930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4191916-1821-40fd-98c8-c736e7a4f9a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.373455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4191916-1821-40fd-98c8-c736e7a4f9a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.373889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4191916-1821-40fd-98c8-c736e7a4f9a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.375134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4191916-1821-40fd-98c8-c736e7a4f9a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.385911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4191916-1821-40fd-98c8-c736e7a4f9a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.386393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4191916-1821-40fd-98c8-c736e7a4f9a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.435158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-e4191916-1821-40fd-98c8-c736e7a4f9a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lazy-loading 'flavor' on Instance uuid 5fa292c2-3801-4d84-b31a-4d3eeeb41818 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:51.492707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-69342d62-443a-4f51-a6f9-ed428657e1f7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:51.503288 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-69342d62-443a-4f51-a6f9-ed428657e1f7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.279198 Oct 18 13:33:51.505343 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1830/3876] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:51 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:51.526393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-197865d0-0831-49ff-870f-f0b7a0701f92 req-77316f29-bdcf-46c8-96ce-8f676af6bfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158bef41-8f92-41e0-ac04-4aa8164611ac", "name": "network-vif-plugged", "status": "completed", "tag": "675db4dd-937b-4831-8453-adebc2ee1cb1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:51.537338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:51.539913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-197865d0-0831-49ff-870f-f0b7a0701f92 req-77316f29-bdcf-46c8-96ce-8f676af6bfd9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.540392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-197865d0-0831-49ff-870f-f0b7a0701f92 req-77316f29-bdcf-46c8-96ce-8f676af6bfd9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.541004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-197865d0-0831-49ff-870f-f0b7a0701f92 req-77316f29-bdcf-46c8-96ce-8f676af6bfd9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.557824 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-197865d0-0831-49ff-870f-f0b7a0701f92 req-77316f29-bdcf-46c8-96ce-8f676af6bfd9 service nova] Creating event network-vif-plugged:675db4dd-937b-4831-8453-adebc2ee1cb1 for instance 158bef41-8f92-41e0-ac04-4aa8164611ac on n-h2-858384-13 Oct 18 13:33:51.565695 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-197865d0-0831-49ff-870f-f0b7a0701f92 req-77316f29-bdcf-46c8-96ce-8f676af6bfd9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043099 Oct 18 13:33:51.566968 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1831/3877] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:33:51.573449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b0cbb36b-f838-4c41-b85d-75929bef1a2a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:51.574484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b0cbb36b-f838-4c41-b85d-75929bef1a2a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:51.584482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0cbb36b-f838-4c41-b85d-75929bef1a2a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.585494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0cbb36b-f838-4c41-b85d-75929bef1a2a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.586620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0cbb36b-f838-4c41-b85d-75929bef1a2a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.587982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0cbb36b-f838-4c41-b85d-75929bef1a2a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.588668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0cbb36b-f838-4c41-b85d-75929bef1a2a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.589410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0cbb36b-f838-4c41-b85d-75929bef1a2a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.693869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=8 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:51.789609 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e4191916-1821-40fd-98c8-c736e7a4f9a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "POST /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/action" status: 202 len: 0 microversion: 2.20 time: 0.428727 Oct 18 13:33:51.790861 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2047/3878] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:33:51 2022] POST /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:33:51.813721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ccd7a717-4f88-47b5-90f0-f11473425d32 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:51.816914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ccd7a717-4f88-47b5-90f0-f11473425d32 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:51.830266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccd7a717-4f88-47b5-90f0-f11473425d32 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.833344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccd7a717-4f88-47b5-90f0-f11473425d32 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.834497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccd7a717-4f88-47b5-90f0-f11473425d32 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.835498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccd7a717-4f88-47b5-90f0-f11473425d32 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:51.836196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccd7a717-4f88-47b5-90f0-f11473425d32 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:51.836855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccd7a717-4f88-47b5-90f0-f11473425d32 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:51.925694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b0cbb36b-f838-4c41-b85d-75929bef1a2a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:51.936051 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b0cbb36b-f838-4c41-b85d-75929bef1a2a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1513 microversion: 2.1 time: 0.365534 Oct 18 13:33:51.937860 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1832/3879] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:51 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1513 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:52.224261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ccd7a717-4f88-47b5-90f0-f11473425d32 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:52.238182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ccd7a717-4f88-47b5-90f0-f11473425d32 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:52.240737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ccd7a717-4f88-47b5-90f0-f11473425d32 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:52.242793 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ccd7a717-4f88-47b5-90f0-f11473425d32 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1724 microversion: 2.20 time: 0.447378 Oct 18 13:33:52.244149 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2048/3880] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:51 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1724 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:33:52.340806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7677c06f-e828-4f66-a8b4-9250c5471ce2 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:52.341448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7677c06f-e828-4f66-a8b4-9250c5471ce2 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:52.349722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7677c06f-e828-4f66-a8b4-9250c5471ce2 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:52.350496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7677c06f-e828-4f66-a8b4-9250c5471ce2 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:52.350931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7677c06f-e828-4f66-a8b4-9250c5471ce2 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:52.351807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7677c06f-e828-4f66-a8b4-9250c5471ce2 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:52.352420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7677c06f-e828-4f66-a8b4-9250c5471ce2 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:52.353015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7677c06f-e828-4f66-a8b4-9250c5471ce2 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:52.528446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-83ff8a88-8c27-48f8-9a8e-ee6258554395 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:52.529301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-83ff8a88-8c27-48f8-9a8e-ee6258554395 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:52.541520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83ff8a88-8c27-48f8-9a8e-ee6258554395 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:52.543998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83ff8a88-8c27-48f8-9a8e-ee6258554395 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:52.545774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83ff8a88-8c27-48f8-9a8e-ee6258554395 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:52.547758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83ff8a88-8c27-48f8-9a8e-ee6258554395 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:52.548234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83ff8a88-8c27-48f8-9a8e-ee6258554395 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:52.548895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83ff8a88-8c27-48f8-9a8e-ee6258554395 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:52.572344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7677c06f-e828-4f66-a8b4-9250c5471ce2 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:52.581929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7677c06f-e828-4f66-a8b4-9250c5471ce2 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:52.584106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7677c06f-e828-4f66-a8b4-9250c5471ce2 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:52.587107 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7677c06f-e828-4f66-a8b4-9250c5471ce2 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1361 microversion: 2.26 time: 0.250326 Oct 18 13:33:52.587759 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1833/3881] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:52 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:52.963047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-015368f5-a555-4d58-8673-aa84c4de438d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:52.963858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-015368f5-a555-4d58-8673-aa84c4de438d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:52.972431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-015368f5-a555-4d58-8673-aa84c4de438d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:52.973145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-015368f5-a555-4d58-8673-aa84c4de438d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:52.973939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-015368f5-a555-4d58-8673-aa84c4de438d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:52.974744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-015368f5-a555-4d58-8673-aa84c4de438d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:52.975437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-015368f5-a555-4d58-8673-aa84c4de438d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:52.976023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-015368f5-a555-4d58-8673-aa84c4de438d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.036649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-83ff8a88-8c27-48f8-9a8e-ee6258554395 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:53.057914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-015368f5-a555-4d58-8673-aa84c4de438d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:53.074513 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-015368f5-a555-4d58-8673-aa84c4de438d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 200 len: 1471 microversion: 2.1 time: 0.116643 Oct 18 13:33:53.075247 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1834/3882] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:52 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 1471 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:53.083877 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-83ff8a88-8c27-48f8-9a8e-ee6258554395 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.557475 Oct 18 13:33:53.097296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e733d269-1fa6-4651-bbca-2cd7d20906e0 req-27c81973-9678-48a1-9e44-3f00ba3828f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18dcc6bf-fc63-4063-93f6-d8f7b158aef9", "name": "network-vif-deleted", "tag": "09c9753d-8cf9-4d94-baec-f6d8d5abcc80"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:53.105665 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2049/3883] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:52 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:53.123174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e733d269-1fa6-4651-bbca-2cd7d20906e0 req-27c81973-9678-48a1-9e44-3f00ba3828f5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:53.123661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e733d269-1fa6-4651-bbca-2cd7d20906e0 req-27c81973-9678-48a1-9e44-3f00ba3828f5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:53.124096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e733d269-1fa6-4651-bbca-2cd7d20906e0 req-27c81973-9678-48a1-9e44-3f00ba3828f5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.146710 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e733d269-1fa6-4651-bbca-2cd7d20906e0 req-27c81973-9678-48a1-9e44-3f00ba3828f5 service nova] Creating event network-vif-deleted:09c9753d-8cf9-4d94-baec-f6d8d5abcc80 for instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 on n-h1-858384-13 Oct 18 13:33:53.166069 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e733d269-1fa6-4651-bbca-2cd7d20906e0 req-27c81973-9678-48a1-9e44-3f00ba3828f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073165 Oct 18 13:33:53.166306 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1835/3884] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:33:53.275863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8650b68e-ae81-4421-880f-c3788e56fa74 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:53.279134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8650b68e-ae81-4421-880f-c3788e56fa74 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:53.290797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8650b68e-ae81-4421-880f-c3788e56fa74 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:53.291555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8650b68e-ae81-4421-880f-c3788e56fa74 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:53.292159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8650b68e-ae81-4421-880f-c3788e56fa74 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.294089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8650b68e-ae81-4421-880f-c3788e56fa74 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:53.295185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8650b68e-ae81-4421-880f-c3788e56fa74 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:53.296000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8650b68e-ae81-4421-880f-c3788e56fa74 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.586225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8650b68e-ae81-4421-880f-c3788e56fa74 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:53.602961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8650b68e-ae81-4421-880f-c3788e56fa74 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:53.605080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8650b68e-ae81-4421-880f-c3788e56fa74 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:53.607203 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8650b68e-ae81-4421-880f-c3788e56fa74 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1724 microversion: 2.20 time: 0.340260 Oct 18 13:33:53.608293 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2050/3885] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:53 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1724 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:53.617521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a49bb515-4258-4aa3-ab46-4d8e65fb4c25 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:53.618225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a49bb515-4258-4aa3-ab46-4d8e65fb4c25 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:53.627489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a49bb515-4258-4aa3-ab46-4d8e65fb4c25 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:53.627972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a49bb515-4258-4aa3-ab46-4d8e65fb4c25 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:53.628411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a49bb515-4258-4aa3-ab46-4d8e65fb4c25 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.629105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a49bb515-4258-4aa3-ab46-4d8e65fb4c25 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:53.629871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a49bb515-4258-4aa3-ab46-4d8e65fb4c25 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:53.630183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a49bb515-4258-4aa3-ab46-4d8e65fb4c25 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.801166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a49bb515-4258-4aa3-ab46-4d8e65fb4c25 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:53.813111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a49bb515-4258-4aa3-ab46-4d8e65fb4c25 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:53.814776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a49bb515-4258-4aa3-ab46-4d8e65fb4c25 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:53.816551 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a49bb515-4258-4aa3-ab46-4d8e65fb4c25 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1545 microversion: 2.26 time: 0.203644 Oct 18 13:33:53.817118 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1836/3886] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:53 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1545 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:33:53.844313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff617bbea60>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:53.857331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:53.859416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:53.860368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.861577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:53.868562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:53.869130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:53.869735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.870535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:53.871186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:53.871629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.908631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:53.909748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:53.910398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.926894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:53.927652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:53.928264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:53.973668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'flavor' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:53.996565 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3983eafd-d08b-456f-a6de-e576527d1366 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-10498789" status: 201 len: 0 microversion: 2.26 time: 0.157230 Oct 18 13:33:54.003344 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2051/3887] 10.222.0.40 () {62 vars in 1374 bytes} [Tue Oct 18 13:33:53 2022] PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-10498789 => generated 0 bytes in 165 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Oct 18 13:33:54.008602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-51cf840d-2cd6-4eeb-8ab1-99a220d1f1b4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff617a4e430>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:54.017898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51cf840d-2cd6-4eeb-8ab1-99a220d1f1b4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.018384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51cf840d-2cd6-4eeb-8ab1-99a220d1f1b4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.019066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51cf840d-2cd6-4eeb-8ab1-99a220d1f1b4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.041632 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-51cf840d-2cd6-4eeb-8ab1-99a220d1f1b4 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-10498789" status: 204 len: 0 microversion: 2.26 time: 0.037059 Oct 18 13:33:54.042361 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1837/3888] 10.222.0.40 () {60 vars in 1355 bytes} [Tue Oct 18 13:33:54 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-10498789 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:33:54.052868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff617bb9b80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:54.061705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.062736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.063379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.063855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:54.071069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.071954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.073113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.074026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.074496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.075036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.106781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2f8baa6d-fff5-4184-ba8f-f50ceb5221e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:54.107377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2f8baa6d-fff5-4184-ba8f-f50ceb5221e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:54.118056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f8baa6d-fff5-4184-ba8f-f50ceb5221e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.118704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f8baa6d-fff5-4184-ba8f-f50ceb5221e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.119251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f8baa6d-fff5-4184-ba8f-f50ceb5221e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.120303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f8baa6d-fff5-4184-ba8f-f50ceb5221e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.121107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f8baa6d-fff5-4184-ba8f-f50ceb5221e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.121758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f8baa6d-fff5-4184-ba8f-f50ceb5221e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.127506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.128132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.128733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.143158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:54.145972 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-2f8baa6d-fff5-4184-ba8f-f50ceb5221e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2f8baa6d-fff5-4184-ba8f-f50ceb5221e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 HTTP/1.1 Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '18dcc6bf-fc63-4063-93f6-d8f7b158aef9'} Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:54.149989 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:54.155102 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:54.155102 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:54.155102 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:54.155102 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:54.155102 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:54.155102 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:33:54.155102 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:54.155102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2f8baa6d-fff5-4184-ba8f-f50ceb5221e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:54.155102 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2f8baa6d-fff5-4184-ba8f-f50ceb5221e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 404 len: 111 microversion: 2.1 time: 0.054664 Oct 18 13:33:54.155102 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1838/3889] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:54 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:33:54.159168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'flavor' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:54.163223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-143ca62e-5625-4423-9f2a-c7b48faf6e12 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:54.165034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-143ca62e-5625-4423-9f2a-c7b48faf6e12 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:54.174959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-143ca62e-5625-4423-9f2a-c7b48faf6e12 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.175798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-143ca62e-5625-4423-9f2a-c7b48faf6e12 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.176421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-143ca62e-5625-4423-9f2a-c7b48faf6e12 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.177379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-143ca62e-5625-4423-9f2a-c7b48faf6e12 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.178008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-143ca62e-5625-4423-9f2a-c7b48faf6e12 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.178616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-143ca62e-5625-4423-9f2a-c7b48faf6e12 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.183963 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-11d56ec8-1b90-4dd3-b35a-30c0ac23e31a tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags" status: 204 len: 0 microversion: 2.26 time: 0.135785 Oct 18 13:33:54.185983 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2052/3890] 10.222.0.40 () {60 vars in 1295 bytes} [Tue Oct 18 13:33:54 2022] DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:33:54.191582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-90c5c07b-01a7-4be6-bf29-dd4566dbd849 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:54.192518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-90c5c07b-01a7-4be6-bf29-dd4566dbd849 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:54.199388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90c5c07b-01a7-4be6-bf29-dd4566dbd849 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.199872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90c5c07b-01a7-4be6-bf29-dd4566dbd849 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.200571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90c5c07b-01a7-4be6-bf29-dd4566dbd849 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.201604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90c5c07b-01a7-4be6-bf29-dd4566dbd849 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.202229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90c5c07b-01a7-4be6-bf29-dd4566dbd849 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.203362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90c5c07b-01a7-4be6-bf29-dd4566dbd849 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.411006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-90c5c07b-01a7-4be6-bf29-dd4566dbd849 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:54.422208 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-90c5c07b-01a7-4be6-bf29-dd4566dbd849 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.234697 Oct 18 13:33:54.423155 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2053/3891] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:54 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:54.433687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-143ca62e-5625-4423-9f2a-c7b48faf6e12 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:54.443968 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-143ca62e-5625-4423-9f2a-c7b48faf6e12 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.289242 Oct 18 13:33:54.445630 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1839/3892] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:54 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:54.469613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-133e350e-dfe9-4566-b665-b265896efcbe tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff617bbe430>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:54.479800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-133e350e-dfe9-4566-b665-b265896efcbe tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.480720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-133e350e-dfe9-4566-b665-b265896efcbe tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.481444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-133e350e-dfe9-4566-b665-b265896efcbe tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.494267 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-133e350e-dfe9-4566-b665-b265896efcbe tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags" status: 200 len: 12 microversion: 2.26 time: 0.051922 Oct 18 13:33:54.495564 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2054/3893] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 18 13:33:54 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags => generated 12 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:54.507534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff617a4e9d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:54.528029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.528702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.529150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.529650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:54.542631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.543118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.543552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.547726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.550231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.550858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.597687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.598174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.598525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.605137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-49322ae5-cdbe-48da-9671-61937be04594 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-49322ae5-cdbe-48da-9671-61937be04594 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 163 Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": 12345, "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'networks': [{'uuid': '97315d5a-8b0e-47cc-9e64-1e8e92c88ddc'}]}}} Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 12345 Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:33:54.612463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-49322ae5-cdbe-48da-9671-61937be04594 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-49322ae5-cdbe-48da-9671-61937be04594 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.018702 Oct 18 13:33:54.619754 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2055/3894] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:54 2022] POST /compute/v2.1/servers => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:33:54.623012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.624175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.624898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.639277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-127e0d90-8f37-4b98-9ed4-1bc5b9ba5635 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:54.640821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-127e0d90-8f37-4b98-9ed4-1bc5b9ba5635 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:54.660841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-127e0d90-8f37-4b98-9ed4-1bc5b9ba5635 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.661361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-127e0d90-8f37-4b98-9ed4-1bc5b9ba5635 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.661796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-127e0d90-8f37-4b98-9ed4-1bc5b9ba5635 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.664954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'flavor' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:54.678763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-127e0d90-8f37-4b98-9ed4-1bc5b9ba5635 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.679337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-127e0d90-8f37-4b98-9ed4-1bc5b9ba5635 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.679781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-127e0d90-8f37-4b98-9ed4-1bc5b9ba5635 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.733019 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b69698ca-6d42-4d72-881c-88c576c5c950 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-96414388" status: 201 len: 0 microversion: 2.26 time: 0.230881 Oct 18 13:33:54.736725 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1840/3895] 10.222.0.40 () {62 vars in 1374 bytes} [Tue Oct 18 13:33:54 2022] PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-96414388 => generated 0 bytes in 235 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Oct 18 13:33:54.750642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-570657fd-04d2-4e3f-8d5c-af652f5a6aba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:54.754052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-570657fd-04d2-4e3f-8d5c-af652f5a6aba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:54.755479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:54.786447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-570657fd-04d2-4e3f-8d5c-af652f5a6aba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.787609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-570657fd-04d2-4e3f-8d5c-af652f5a6aba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.789041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-570657fd-04d2-4e3f-8d5c-af652f5a6aba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.790002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-570657fd-04d2-4e3f-8d5c-af652f5a6aba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.790819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-570657fd-04d2-4e3f-8d5c-af652f5a6aba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.791489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-570657fd-04d2-4e3f-8d5c-af652f5a6aba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:54.960381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-127e0d90-8f37-4b98-9ed4-1bc5b9ba5635 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:54.974708 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-127e0d90-8f37-4b98-9ed4-1bc5b9ba5635 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.348870 Oct 18 13:33:54.975832 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2056/3896] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:54 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:54.980893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-61971ffb-eac8-4ca5-96f4-a8e4b89af66e tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff617ac4d30>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:54.988990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61971ffb-eac8-4ca5-96f4-a8e4b89af66e tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:54.989802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61971ffb-eac8-4ca5-96f4-a8e4b89af66e tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:54.990444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61971ffb-eac8-4ca5-96f4-a8e4b89af66e tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.005024 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-61971ffb-eac8-4ca5-96f4-a8e4b89af66e tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags" status: 200 len: 34 microversion: 2.26 time: 0.027833 Oct 18 13:33:55.005960 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2057/3897] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 18 13:33:54 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags => generated 34 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:55.011294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f909c05a-6aa1-4544-96ee-a170e41404ab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:55.012332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f909c05a-6aa1-4544-96ee-a170e41404ab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:55.024070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f909c05a-6aa1-4544-96ee-a170e41404ab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.024833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f909c05a-6aa1-4544-96ee-a170e41404ab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.025545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f909c05a-6aa1-4544-96ee-a170e41404ab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.027366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f909c05a-6aa1-4544-96ee-a170e41404ab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.028091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f909c05a-6aa1-4544-96ee-a170e41404ab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.028822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f909c05a-6aa1-4544-96ee-a170e41404ab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.084243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-570657fd-04d2-4e3f-8d5c-af652f5a6aba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:55.095259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-570657fd-04d2-4e3f-8d5c-af652f5a6aba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:55.100687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-570657fd-04d2-4e3f-8d5c-af652f5a6aba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:55.103391 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-570657fd-04d2-4e3f-8d5c-af652f5a6aba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1724 microversion: 2.20 time: 0.365570 Oct 18 13:33:55.105057 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1841/3898] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:54 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:55.117760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff60efaa700>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:55.138200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.138710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.139144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.139742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:55.150646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.151130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.151556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.156704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.159642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.160088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.212333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.213793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.215571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.250640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f909c05a-6aa1-4544-96ee-a170e41404ab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:55.263714 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f909c05a-6aa1-4544-96ee-a170e41404ab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.256334 Oct 18 13:33:55.270916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'flavor' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:55.286245 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2058/3899] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:55 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:55.302696 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9c828986-8f92-409d-afdd-7ed53af6c678 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-96414388" status: 204 len: 0 microversion: 2.26 time: 0.196548 Oct 18 13:33:55.303860 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1842/3900] 10.222.0.40 () {60 vars in 1358 bytes} [Tue Oct 18 13:33:55 2022] DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-96414388 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:33:55.315848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aca17379-5a3d-47a6-ba14-4a18f34c4f89 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff617c86dc0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:55.328255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aca17379-5a3d-47a6-ba14-4a18f34c4f89 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.329709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aca17379-5a3d-47a6-ba14-4a18f34c4f89 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.330254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aca17379-5a3d-47a6-ba14-4a18f34c4f89 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.358034 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aca17379-5a3d-47a6-ba14-4a18f34c4f89 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags" status: 200 len: 12 microversion: 2.26 time: 0.049823 Oct 18 13:33:55.359279 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2059/3901] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 18 13:33:55 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags => generated 12 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:55.369650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff60f789040>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:55.379516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.381208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.381892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.382831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:55.394035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.394608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.395361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.397076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.397784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.398727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.456131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.456625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.457077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.472818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'flavor' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:55.479313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c5d2b55-47b6-48a2-a68b-74731178c04f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:55.479964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c5d2b55-47b6-48a2-a68b-74731178c04f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:55.491824 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-329b32b3-ef0f-4ce3-8391-8b763b85eb6c tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags" status: 204 len: 0 microversion: 2.26 time: 0.126509 Oct 18 13:33:55.494799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c5d2b55-47b6-48a2-a68b-74731178c04f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.497884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c5d2b55-47b6-48a2-a68b-74731178c04f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.498741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c5d2b55-47b6-48a2-a68b-74731178c04f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.499068 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1843/3902] 10.222.0.40 () {60 vars in 1295 bytes} [Tue Oct 18 13:33:55 2022] DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:33:55.502887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c5d2b55-47b6-48a2-a68b-74731178c04f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.503501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c5d2b55-47b6-48a2-a68b-74731178c04f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.504277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c5d2b55-47b6-48a2-a68b-74731178c04f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.506463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff60efaaf70>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:55.518341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.519153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.519768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.520433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:55.528496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.529276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.529954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.531775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.532615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.533319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.657941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.659102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.659978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.676904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.677872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.678549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.712703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'flavor' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:55.732143 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a8a83a81-2fdf-4acc-a46b-3968c8ba99cd tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-372831921" status: 201 len: 0 microversion: 2.26 time: 0.230885 Oct 18 13:33:55.741330 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1844/3903] 10.222.0.40 () {62 vars in 1377 bytes} [Tue Oct 18 13:33:55 2022] PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-372831921 => generated 0 bytes in 235 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 18 13:33:55.744183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3c5d2b55-47b6-48a2-a68b-74731178c04f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:55.748713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff617b69700>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:55.759356 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c5d2b55-47b6-48a2-a68b-74731178c04f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.286517 Oct 18 13:33:55.760736 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2060/3904] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:55 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:55.771853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.774118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.774837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.775575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:55.783327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.784029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.784659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.785404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.785853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.786491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.847777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.848189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.848640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.864440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.865108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.865774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.901866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'flavor' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:55.944950 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1543626d-d1f0-4d47-bdf9-19ee16176530 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-1757044046" status: 201 len: 0 microversion: 2.26 time: 0.202074 Oct 18 13:33:55.947052 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1845/3905] 10.222.0.40 () {62 vars in 1380 bytes} [Tue Oct 18 13:33:55 2022] PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-1757044046 => generated 0 bytes in 205 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 18 13:33:55.959704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff60effbaf0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:55.972278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.973281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.974609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.976192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:55.987636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.988688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.989513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:55.990472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:55.991212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:55.991873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.023512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.024246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.024943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.072888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'flavor' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:56.105156 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-76772966-d5e5-402c-8055-fa3e276fde86 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags" status: 204 len: 0 microversion: 2.26 time: 0.150138 Oct 18 13:33:56.106865 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2061/3906] 10.222.0.40 () {60 vars in 1295 bytes} [Tue Oct 18 13:33:55 2022] DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:33:56.117783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-337462f6-684d-47bc-8adc-2a99ca86746f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff617b698b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:56.139445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8cf4432e-8b58-425f-84f2-482503bb89f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:56.140599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8cf4432e-8b58-425f-84f2-482503bb89f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:56.145014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-337462f6-684d-47bc-8adc-2a99ca86746f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.150537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-337462f6-684d-47bc-8adc-2a99ca86746f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.151011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-337462f6-684d-47bc-8adc-2a99ca86746f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.171804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cf4432e-8b58-425f-84f2-482503bb89f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.172419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cf4432e-8b58-425f-84f2-482503bb89f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.172872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cf4432e-8b58-425f-84f2-482503bb89f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.175966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cf4432e-8b58-425f-84f2-482503bb89f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.176436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cf4432e-8b58-425f-84f2-482503bb89f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.185726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cf4432e-8b58-425f-84f2-482503bb89f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.196139 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-337462f6-684d-47bc-8adc-2a99ca86746f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags" status: 200 len: 12 microversion: 2.26 time: 0.084540 Oct 18 13:33:56.199364 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1846/3907] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 18 13:33:56 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags => generated 12 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:33:56.217420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff617b1b4c0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:56.259331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.259803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.260861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.261750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:56.274093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.282228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.283974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.292349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.292851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.293334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.337034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.342696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.343307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.382443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'flavor' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:56.418562 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-828a2635-28e2-4d12-ba82-7223f2d534e3 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags" status: 204 len: 0 microversion: 2.26 time: 0.211714 Oct 18 13:33:56.419973 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1847/3908] 10.222.0.40 () {60 vars in 1295 bytes} [Tue Oct 18 13:33:56 2022] DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:33:56.428453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1396969446", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "2dce604a-0d66-4cae-a46a-99aede4566d5"}, {"uuid": "8bb9f0e9-ef67-4d65-a048-05b361b992b1"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:56.479682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8cf4432e-8b58-425f-84f2-482503bb89f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:56.494875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8cf4432e-8b58-425f-84f2-482503bb89f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:56.497090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8cf4432e-8b58-425f-84f2-482503bb89f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:56.498925 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8cf4432e-8b58-425f-84f2-482503bb89f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1724 microversion: 2.20 time: 0.365600 Oct 18 13:33:56.500822 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2062/3909] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:56 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:56.506835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff617b81ee0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:56.520149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.520784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.521301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.521789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:56.543838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] validate_networks() for [('2dce604a-0d66-4cae-a46a-99aede4566d5', None, None, None, None, None), ('8bb9f0e9-ef67-4d65-a048-05b361b992b1', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:33:56.553907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.573456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.574693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.575672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.578130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.578272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.659808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.674482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.675202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.688302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.693554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.694681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.730429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'flavor' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:56.753615 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-12c4dd57-e56c-4a3f-b149-d311b39fc07f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-2061864342" status: 201 len: 0 microversion: 2.26 time: 0.251329 Oct 18 13:33:56.755614 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2063/3910] 10.222.0.40 () {62 vars in 1380 bytes} [Tue Oct 18 13:33:56 2022] PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-2061864342 => generated 0 bytes in 254 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 18 13:33:56.766672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff617b815e0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:56.778854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.779751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.781866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.782659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:56.790469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.791629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.792304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.793425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.794216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.795016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.862598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.863469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.864526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.880909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.881433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.881858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.920052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'flavor' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:56.937714 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e3431030-acf0-44c7-8809-d084279b5f17 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-1804951433" status: 201 len: 0 microversion: 2.26 time: 0.175714 Oct 18 13:33:56.938472 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2064/3911] 10.222.0.40 () {62 vars in 1380 bytes} [Tue Oct 18 13:33:56 2022] PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags/tempest-tag-1804951433 => generated 0 bytes in 177 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 18 13:33:56.954107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-de921fe9-b84b-40e9-9137-88e7c570b86c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:56.954753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-de921fe9-b84b-40e9-9137-88e7c570b86c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:56.966023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de921fe9-b84b-40e9-9137-88e7c570b86c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.966530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de921fe9-b84b-40e9-9137-88e7c570b86c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.967072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de921fe9-b84b-40e9-9137-88e7c570b86c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:56.967786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de921fe9-b84b-40e9-9137-88e7c570b86c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:56.968307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de921fe9-b84b-40e9-9137-88e7c570b86c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:56.968777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de921fe9-b84b-40e9-9137-88e7c570b86c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.215749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-de921fe9-b84b-40e9-9137-88e7c570b86c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:57.226520 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-de921fe9-b84b-40e9-9137-88e7c570b86c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.278581 Oct 18 13:33:57.227481 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2065/3912] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:56 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:57.232747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Action: 'update_all', calling method: .version_select at 0x7ff60eeca4c0>, body: {"tags": ["tempest-tag-693171048", "tempest-tag-2165731"]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:57.244794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.258821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.269082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.270805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:57.277728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.278617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.279290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.280285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.281576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.282429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.315290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.316159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.316857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.345713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'flavor' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:57.381637 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aac1dfb0-a9ba-4ca7-9b24-db4dd8491238 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags" status: 200 len: 58 microversion: 2.26 time: 0.152793 Oct 18 13:33:57.383279 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2066/3913] 10.222.0.40 () {62 vars in 1312 bytes} [Tue Oct 18 13:33:57 2022] PUT /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags => generated 58 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:57.406355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-161235e1-484c-47f8-9c73-3517f5330e44 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff60eef43a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:57.417351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-161235e1-484c-47f8-9c73-3517f5330e44 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.422249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-161235e1-484c-47f8-9c73-3517f5330e44 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.423098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-161235e1-484c-47f8-9c73-3517f5330e44 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.450198 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-161235e1-484c-47f8-9c73-3517f5330e44 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags" status: 200 len: 58 microversion: 2.26 time: 0.060506 Oct 18 13:33:57.450906 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2067/3914] 10.222.0.40 () {60 vars in 1292 bytes} [Tue Oct 18 13:33:57 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags => generated 58 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:57.463224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '.version_select at 0x7ff60f0014c0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:57.475867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.476373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.476818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.479594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:57.492953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.493471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.496007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.498614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.501257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.501718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.520483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:33:57.523197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:33:57.523992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:33:57.524893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:33:57.525647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:33:57.539191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.539677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.540819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.541766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.542358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.542616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.542843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.543278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.543589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.564214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'flavor' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:33:57.578401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Getting quotas for project 59efb35dab2a4e64924a27d6f255e8ab. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:33:57.587552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Getting quotas for user e8916fc7da5847e38fb2e4b3b5bdf297 and project 59efb35dab2a4e64924a27d6f255e8ab. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:33:57.590048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:57.599103 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-de26f0d5-dc43-47d3-9d52-e4156c48ee7f tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags" status: 204 len: 0 microversion: 2.26 time: 0.140069 Oct 18 13:33:57.599739 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2068/3915] 10.222.0.40 () {60 vars in 1295 bytes} [Tue Oct 18 13:33:57 2022] DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac/tags => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:33:57.604878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3dc0e6c3-2dc1-4181-9dcf-90e5222b0a0f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:57.605764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3dc0e6c3-2dc1-4181-9dcf-90e5222b0a0f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:57.614064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dc0e6c3-2dc1-4181-9dcf-90e5222b0a0f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.614644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dc0e6c3-2dc1-4181-9dcf-90e5222b0a0f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.615026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:33:57.615170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dc0e6c3-2dc1-4181-9dcf-90e5222b0a0f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.618104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:33:57.618527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dc0e6c3-2dc1-4181-9dcf-90e5222b0a0f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.619013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dc0e6c3-2dc1-4181-9dcf-90e5222b0a0f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.619452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dc0e6c3-2dc1-4181-9dcf-90e5222b0a0f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.677269 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3727aad8-3367-4522-a3c5-be5d464b9543 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.255842 Oct 18 13:33:57.678807 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1848/3916] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:33:57.686146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35b0dfd5-b52d-4862-84a8-da5a37cd5e46 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:57.686985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-35b0dfd5-b52d-4862-84a8-da5a37cd5e46 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:57.694371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35b0dfd5-b52d-4862-84a8-da5a37cd5e46 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.695174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35b0dfd5-b52d-4862-84a8-da5a37cd5e46 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.696091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35b0dfd5-b52d-4862-84a8-da5a37cd5e46 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.697006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35b0dfd5-b52d-4862-84a8-da5a37cd5e46 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.697805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35b0dfd5-b52d-4862-84a8-da5a37cd5e46 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.698414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35b0dfd5-b52d-4862-84a8-da5a37cd5e46 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.721355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:57.755983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-35b0dfd5-b52d-4862-84a8-da5a37cd5e46 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:33:57.797320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3dc0e6c3-2dc1-4181-9dcf-90e5222b0a0f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:57.807386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3dc0e6c3-2dc1-4181-9dcf-90e5222b0a0f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:57.809065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3dc0e6c3-2dc1-4181-9dcf-90e5222b0a0f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:57.811402 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3dc0e6c3-2dc1-4181-9dcf-90e5222b0a0f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1724 microversion: 2.20 time: 0.210663 Oct 18 13:33:57.812566 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2069/3917] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:57 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:57.829023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b84a5820-7428-418b-b13c-a9d1a55e62ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:57.829866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b84a5820-7428-418b-b13c-a9d1a55e62ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:57.901422 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-35b0dfd5-b52d-4862-84a8-da5a37cd5e46 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 204 len: 0 microversion: 2.26 time: 0.220468 Oct 18 13:33:57.917111 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1849/3918] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:33:57 2022] DELETE /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:33:57.929809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-734862ae-9c1b-48ec-8464-3e860ae46442 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:57.931128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-734862ae-9c1b-48ec-8464-3e860ae46442 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:57.940309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-734862ae-9c1b-48ec-8464-3e860ae46442 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.941063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-734862ae-9c1b-48ec-8464-3e860ae46442 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.941782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-734862ae-9c1b-48ec-8464-3e860ae46442 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.942761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-734862ae-9c1b-48ec-8464-3e860ae46442 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:57.943428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-734862ae-9c1b-48ec-8464-3e860ae46442 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:57.944066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-734862ae-9c1b-48ec-8464-3e860ae46442 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:57.962945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b84a5820-7428-418b-b13c-a9d1a55e62ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:57.971856 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b84a5820-7428-418b-b13c-a9d1a55e62ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1213 microversion: 2.1 time: 0.157578 Oct 18 13:33:57.979782 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2070/3919] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:57 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:58.254808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ccf61005-68ac-4fb2-b47c-756e7b6986f1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:58.255570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ccf61005-68ac-4fb2-b47c-756e7b6986f1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:58.270988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-734862ae-9c1b-48ec-8464-3e860ae46442 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:58.277102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccf61005-68ac-4fb2-b47c-756e7b6986f1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.281672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccf61005-68ac-4fb2-b47c-756e7b6986f1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.284608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccf61005-68ac-4fb2-b47c-756e7b6986f1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.286106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccf61005-68ac-4fb2-b47c-756e7b6986f1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.289344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-734862ae-9c1b-48ec-8464-3e860ae46442 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:58.290170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccf61005-68ac-4fb2-b47c-756e7b6986f1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.292047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-734862ae-9c1b-48ec-8464-3e860ae46442 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:58.294575 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-734862ae-9c1b-48ec-8464-3e860ae46442 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1551 microversion: 2.26 time: 0.372407 Oct 18 13:33:58.295158 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1850/3920] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:57 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1551 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:58.308054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccf61005-68ac-4fb2-b47c-756e7b6986f1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.564978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ca2b3a86-d839-45d4-85eb-d647f7e896cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1705443441", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e2fd4b60-a9b4-4b95-ad40-15c47109b26c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:33:58.579152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ccf61005-68ac-4fb2-b47c-756e7b6986f1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:58.591175 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ccf61005-68ac-4fb2-b47c-756e7b6986f1 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.341681 Oct 18 13:33:58.592346 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2071/3921] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:58 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:58.660135 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-ca2b3a86-d839-45d4-85eb-d647f7e896cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Block Device e2fd4b60-a9b4-4b95-ad40-15c47109b26c is not bootable. Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ca2b3a86-d839-45d4-85eb-d647f7e896cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 358 Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1705443441", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e2fd4b60-a9b4-4b95-ad40-15c47109b26c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: exception: Block Device e2fd4b60-a9b4-4b95-ad40-15c47109b26c is not bootable. Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1705443441', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'e2fd4b60-a9b4-4b95-ad40-15c47109b26c'}], 'networks': [{'uuid': '97315d5a-8b0e-47cc-9e64-1e8e92c88ddc'}]}}} Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device e2fd4b60-a9b4-4b95-ad40-15c47109b26c is not bootable. Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:58.680800 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device e2fd4b60-a9b4-4b95-ad40-15c47109b26c is not bootable. Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device e2fd4b60-a9b4-4b95-ad40-15c47109b26c is not bootable. Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ca2b3a86-d839-45d4-85eb-d647f7e896cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Block Device e2fd4b60-a9b4-4b95-ad40-15c47109b26c is not bootable. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ca2b3a86-d839-45d4-85eb-d647f7e896cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.122654 Oct 18 13:33:58.688044 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1851/3922] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:33:58 2022] POST /compute/v2.1/servers => generated 110 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:33:58.692615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b99846a7-35b6-48d6-9d31-10a4a8e311bd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:58.693287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b99846a7-35b6-48d6-9d31-10a4a8e311bd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:58.699418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:33:58.701559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b99846a7-35b6-48d6-9d31-10a4a8e311bd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.702068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b99846a7-35b6-48d6-9d31-10a4a8e311bd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.702711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b99846a7-35b6-48d6-9d31-10a4a8e311bd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.703442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b99846a7-35b6-48d6-9d31-10a4a8e311bd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.703902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b99846a7-35b6-48d6-9d31-10a4a8e311bd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.704329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b99846a7-35b6-48d6-9d31-10a4a8e311bd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.839828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5cce86ec-1589-4509-8b88-fa1ef70d9c6a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:58.840963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5cce86ec-1589-4509-8b88-fa1ef70d9c6a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:58.851951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cce86ec-1589-4509-8b88-fa1ef70d9c6a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.853496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cce86ec-1589-4509-8b88-fa1ef70d9c6a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.854093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cce86ec-1589-4509-8b88-fa1ef70d9c6a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.855103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cce86ec-1589-4509-8b88-fa1ef70d9c6a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.855717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cce86ec-1589-4509-8b88-fa1ef70d9c6a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.856302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cce86ec-1589-4509-8b88-fa1ef70d9c6a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.922671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b99846a7-35b6-48d6-9d31-10a4a8e311bd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:58.951626 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b99846a7-35b6-48d6-9d31-10a4a8e311bd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.263162 Oct 18 13:33:58.954355 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2072/3923] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:58 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:58.981629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e78edd91-15d1-4b83-9dec-e6d08f7e57be tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:58.982438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e78edd91-15d1-4b83-9dec-e6d08f7e57be tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:58.991740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e78edd91-15d1-4b83-9dec-e6d08f7e57be tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.992411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e78edd91-15d1-4b83-9dec-e6d08f7e57be tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.993010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e78edd91-15d1-4b83-9dec-e6d08f7e57be tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:58.993920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e78edd91-15d1-4b83-9dec-e6d08f7e57be tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:58.994875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e78edd91-15d1-4b83-9dec-e6d08f7e57be tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:58.995474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e78edd91-15d1-4b83-9dec-e6d08f7e57be tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.064838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5cce86ec-1589-4509-8b88-fa1ef70d9c6a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:59.112216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5cce86ec-1589-4509-8b88-fa1ef70d9c6a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:59.117450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5cce86ec-1589-4509-8b88-fa1ef70d9c6a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:59.132644 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5cce86ec-1589-4509-8b88-fa1ef70d9c6a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1724 microversion: 2.20 time: 0.297218 Oct 18 13:33:59.133998 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1852/3924] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:58 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:33:59.152612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e9c6a090-5d41-4c69-aa05-013597b5e0e9 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:59.153265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e9c6a090-5d41-4c69-aa05-013597b5e0e9 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:59.170120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9c6a090-5d41-4c69-aa05-013597b5e0e9 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.170660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9c6a090-5d41-4c69-aa05-013597b5e0e9 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.171861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9c6a090-5d41-4c69-aa05-013597b5e0e9 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.172354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9c6a090-5d41-4c69-aa05-013597b5e0e9 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.180276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9c6a090-5d41-4c69-aa05-013597b5e0e9 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.180994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9c6a090-5d41-4c69-aa05-013597b5e0e9 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.299945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e78edd91-15d1-4b83-9dec-e6d08f7e57be tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:59.308045 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e78edd91-15d1-4b83-9dec-e6d08f7e57be tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.331275 Oct 18 13:33:59.318483 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2073/3925] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:58 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:59.324207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e8b8ef71-cce5-49ed-95af-ee66ef7b620d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:59.325115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e8b8ef71-cce5-49ed-95af-ee66ef7b620d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:59.334578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e9c6a090-5d41-4c69-aa05-013597b5e0e9 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:59.336952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8b8ef71-cce5-49ed-95af-ee66ef7b620d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.337517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8b8ef71-cce5-49ed-95af-ee66ef7b620d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.338168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8b8ef71-cce5-49ed-95af-ee66ef7b620d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.339268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8b8ef71-cce5-49ed-95af-ee66ef7b620d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.340228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8b8ef71-cce5-49ed-95af-ee66ef7b620d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.340845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8b8ef71-cce5-49ed-95af-ee66ef7b620d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.353902 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e9c6a090-5d41-4c69-aa05-013597b5e0e9 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1265 microversion: 2.1 time: 0.218513 Oct 18 13:33:59.354991 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1853/3926] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:59 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:33:59.618310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-58b53373-5a83-4fea-a212-15d59e8ddd1f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:33:59.620386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-58b53373-5a83-4fea-a212-15d59e8ddd1f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:33:59.633973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58b53373-5a83-4fea-a212-15d59e8ddd1f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.634476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58b53373-5a83-4fea-a212-15d59e8ddd1f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.638445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58b53373-5a83-4fea-a212-15d59e8ddd1f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.639667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58b53373-5a83-4fea-a212-15d59e8ddd1f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:33:59.641337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58b53373-5a83-4fea-a212-15d59e8ddd1f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:33:59.642086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58b53373-5a83-4fea-a212-15d59e8ddd1f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:33:59.749719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e8b8ef71-cce5-49ed-95af-ee66ef7b620d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:59.762969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e8b8ef71-cce5-49ed-95af-ee66ef7b620d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:59.767399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e8b8ef71-cce5-49ed-95af-ee66ef7b620d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:33:59.775634 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e8b8ef71-cce5-49ed-95af-ee66ef7b620d tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1551 microversion: 2.26 time: 0.455287 Oct 18 13:33:59.779108 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2074/3927] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:33:59 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1551 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:00.145454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-58b53373-5a83-4fea-a212-15d59e8ddd1f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:00.164343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3202db24-c436-43f6-a758-dbb7aeb79840 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:00.167046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3202db24-c436-43f6-a758-dbb7aeb79840 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:00.168682 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-58b53373-5a83-4fea-a212-15d59e8ddd1f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.552682 Oct 18 13:34:00.181268 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1854/3928] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:33:59 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:00.194063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3202db24-c436-43f6-a758-dbb7aeb79840 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.194771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3202db24-c436-43f6-a758-dbb7aeb79840 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.195334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3202db24-c436-43f6-a758-dbb7aeb79840 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.196225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3202db24-c436-43f6-a758-dbb7aeb79840 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.198838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3202db24-c436-43f6-a758-dbb7aeb79840 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.199428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3202db24-c436-43f6-a758-dbb7aeb79840 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.395040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ae088449-0d7f-47d0-b4db-889421d75e96 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:00.395814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ae088449-0d7f-47d0-b4db-889421d75e96 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:00.413655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae088449-0d7f-47d0-b4db-889421d75e96 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.416022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae088449-0d7f-47d0-b4db-889421d75e96 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.416022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae088449-0d7f-47d0-b4db-889421d75e96 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.425958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae088449-0d7f-47d0-b4db-889421d75e96 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.426496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae088449-0d7f-47d0-b4db-889421d75e96 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.427005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae088449-0d7f-47d0-b4db-889421d75e96 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.741944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ae088449-0d7f-47d0-b4db-889421d75e96 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:00.759568 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ae088449-0d7f-47d0-b4db-889421d75e96 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1271 microversion: 2.1 time: 0.375217 Oct 18 13:34:00.760937 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1855/3929] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:00 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1271 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:00.777675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-877ac5eb-6ab9-4baa-b51f-b1eb6e6b7262 req-273e39e8-a0ed-43ad-ad91-51044cf8da8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158bef41-8f92-41e0-ac04-4aa8164611ac", "name": "network-vif-deleted", "tag": "675db4dd-937b-4831-8453-adebc2ee1cb1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:00.815383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-877ac5eb-6ab9-4baa-b51f-b1eb6e6b7262 req-273e39e8-a0ed-43ad-ad91-51044cf8da8d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.818288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-877ac5eb-6ab9-4baa-b51f-b1eb6e6b7262 req-273e39e8-a0ed-43ad-ad91-51044cf8da8d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.820369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-877ac5eb-6ab9-4baa-b51f-b1eb6e6b7262 req-273e39e8-a0ed-43ad-ad91-51044cf8da8d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.833318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3202db24-c436-43f6-a758-dbb7aeb79840 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:00.849412 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-877ac5eb-6ab9-4baa-b51f-b1eb6e6b7262 req-273e39e8-a0ed-43ad-ad91-51044cf8da8d service nova] Creating event network-vif-deleted:675db4dd-937b-4831-8453-adebc2ee1cb1 for instance 158bef41-8f92-41e0-ac04-4aa8164611ac on n-h2-858384-13 Oct 18 13:34:00.865725 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-877ac5eb-6ab9-4baa-b51f-b1eb6e6b7262 req-273e39e8-a0ed-43ad-ad91-51044cf8da8d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102053 Oct 18 13:34:00.866702 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1856/3930] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:00.873292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3202db24-c436-43f6-a758-dbb7aeb79840 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:00.876151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3202db24-c436-43f6-a758-dbb7aeb79840 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:00.883321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:00.884984 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3202db24-c436-43f6-a758-dbb7aeb79840 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1724 microversion: 2.20 time: 0.729136 Oct 18 13:34:00.886671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:00.887328 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2075/3931] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:00 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1724 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:00.916967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.917693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.918305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.919277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.920097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.920772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.988141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:00.988833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:00.989486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:00.990100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'fault' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:01.044346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:01.055680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:01.057685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:01.059349 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fd3d744e-7e51-4555-ae2e-b02f6db9dfa5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1351 microversion: 2.26 time: 0.188993 Oct 18 13:34:01.060363 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1857/3932] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:00 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1351 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:01.199351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb550261-10b8-4c45-8341-5c4464cc1c04 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:01.200115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cb550261-10b8-4c45-8341-5c4464cc1c04 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:01.208084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb550261-10b8-4c45-8341-5c4464cc1c04 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:01.208960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb550261-10b8-4c45-8341-5c4464cc1c04 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:01.209782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb550261-10b8-4c45-8341-5c4464cc1c04 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:01.210480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb550261-10b8-4c45-8341-5c4464cc1c04 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:01.211094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb550261-10b8-4c45-8341-5c4464cc1c04 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:01.211517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb550261-10b8-4c45-8341-5c4464cc1c04 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:01.657967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cb550261-10b8-4c45-8341-5c4464cc1c04 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:01.672762 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cb550261-10b8-4c45-8341-5c4464cc1c04 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.477326 Oct 18 13:34:01.674531 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2076/3933] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:01 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:01.788938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5db8ef4f-5c44-4e39-af1d-4b2fdb1d19b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:01.789588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5db8ef4f-5c44-4e39-af1d-4b2fdb1d19b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:01.797163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5db8ef4f-5c44-4e39-af1d-4b2fdb1d19b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:01.797682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5db8ef4f-5c44-4e39-af1d-4b2fdb1d19b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:01.798126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5db8ef4f-5c44-4e39-af1d-4b2fdb1d19b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:01.798835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5db8ef4f-5c44-4e39-af1d-4b2fdb1d19b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:01.799293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5db8ef4f-5c44-4e39-af1d-4b2fdb1d19b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:01.799725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5db8ef4f-5c44-4e39-af1d-4b2fdb1d19b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:01.925717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c0a522d-99af-4789-91f1-9f1323b9bab0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:01.926554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4c0a522d-99af-4789-91f1-9f1323b9bab0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:01.934289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c0a522d-99af-4789-91f1-9f1323b9bab0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:01.934767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c0a522d-99af-4789-91f1-9f1323b9bab0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:01.935648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c0a522d-99af-4789-91f1-9f1323b9bab0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:01.937334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c0a522d-99af-4789-91f1-9f1323b9bab0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:01.937804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c0a522d-99af-4789-91f1-9f1323b9bab0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:01.938234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c0a522d-99af-4789-91f1-9f1323b9bab0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:01.958656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5db8ef4f-5c44-4e39-af1d-4b2fdb1d19b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:01.973037 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5db8ef4f-5c44-4e39-af1d-4b2fdb1d19b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1313 microversion: 2.1 time: 0.189736 Oct 18 13:34:01.974582 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1858/3934] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:01 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:02.089943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:02.090885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:02.097252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:02.097996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:02.098637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:02.099524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:02.100801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:02.101267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:02.131885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:02.136233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:02.136923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:02.137572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:02.138187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lazy-loading 'fault' on Instance uuid 158bef41-8f92-41e0-ac04-4aa8164611ac {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:02.185816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:02.195274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:02.196972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cd671875fd44aaf80984f61f5269744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2b4569aac3475482a7bd3d44c62d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:02.198413 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fec57132-a3d3-4e03-b1f2-1969b23a75b5 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 200 len: 1351 microversion: 2.26 time: 0.112477 Oct 18 13:34:02.199549 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1859/3935] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:02 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:02.223899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c0a522d-99af-4789-91f1-9f1323b9bab0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:02.239503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c0a522d-99af-4789-91f1-9f1323b9bab0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:02.242212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c0a522d-99af-4789-91f1-9f1323b9bab0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:02.244271 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4c0a522d-99af-4789-91f1-9f1323b9bab0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1724 microversion: 2.20 time: 0.326279 Oct 18 13:34:02.247984 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2077/3936] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:01 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:02.277735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8ae0d171-2884-4ff0-b468-bba9efdb1257 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1959204771", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c5f2027d-2f76-420c-95a8-7bb70182af23", "destination_type": "local"}, {"source_type": "volume", "uuid": "95fec03f-8a00-47a9-a4f5-2aef11ad0bf6", "destination_type": "invalid"}], "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8ae0d171-2884-4ff0-b468-bba9efdb1257 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 495 Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1959204771", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c5f2027d-2f76-420c-95a8-7bb70182af23", "destination_type": "local"}, {"source_type": "volume", "uuid": "95fec03f-8a00-47a9-a4f5-2aef11ad0bf6", "destination_type": "invalid"}], "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1959204771', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '95fec03f-8a00-47a9-a4f5-2aef11ad0bf6', 'destination_type': 'invalid'}], 'networks': [{'uuid': '97315d5a-8b0e-47cc-9e64-1e8e92c88ddc'}]}}} Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'invalid' Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:02.283886 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 18 13:34:02.289158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:02.294075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8ae0d171-2884-4ff0-b468-bba9efdb1257 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:02.295274 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8ae0d171-2884-4ff0-b468-bba9efdb1257 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.021910 Oct 18 13:34:02.296658 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1860/3937] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:02 2022] POST /compute/v2.1/servers => generated 155 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:34:02.307803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-432374f5-f11f-4b7b-b9e1-f5dd583f494b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:02.308439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-432374f5-f11f-4b7b-b9e1-f5dd583f494b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:02.317365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-432374f5-f11f-4b7b-b9e1-f5dd583f494b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:02.318654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-432374f5-f11f-4b7b-b9e1-f5dd583f494b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:02.319096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-432374f5-f11f-4b7b-b9e1-f5dd583f494b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:02.319795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-432374f5-f11f-4b7b-b9e1-f5dd583f494b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:02.320245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-432374f5-f11f-4b7b-b9e1-f5dd583f494b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:02.320811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-432374f5-f11f-4b7b-b9e1-f5dd583f494b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:02.697828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5e8ab113-ca83-4d06-b459-3ca1715a2ea7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:02.698461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5e8ab113-ca83-4d06-b459-3ca1715a2ea7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:02.710492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e8ab113-ca83-4d06-b459-3ca1715a2ea7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:02.711818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e8ab113-ca83-4d06-b459-3ca1715a2ea7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:02.712795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e8ab113-ca83-4d06-b459-3ca1715a2ea7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:02.713986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e8ab113-ca83-4d06-b459-3ca1715a2ea7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:02.714896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e8ab113-ca83-4d06-b459-3ca1715a2ea7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:02.715706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e8ab113-ca83-4d06-b459-3ca1715a2ea7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:02.881773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5e8ab113-ca83-4d06-b459-3ca1715a2ea7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:02.890697 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5e8ab113-ca83-4d06-b459-3ca1715a2ea7 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.196340 Oct 18 13:34:02.891441 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1861/3938] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:02 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:02.996342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6f554a43-71ae-4349-9b33-cb6d94126c10 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:02.997525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6f554a43-71ae-4349-9b33-cb6d94126c10 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:03.005423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f554a43-71ae-4349-9b33-cb6d94126c10 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.006122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f554a43-71ae-4349-9b33-cb6d94126c10 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.006743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f554a43-71ae-4349-9b33-cb6d94126c10 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.007802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f554a43-71ae-4349-9b33-cb6d94126c10 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.008429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f554a43-71ae-4349-9b33-cb6d94126c10 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.009101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f554a43-71ae-4349-9b33-cb6d94126c10 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.046401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-432374f5-f11f-4b7b-b9e1-f5dd583f494b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:03.070471 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-432374f5-f11f-4b7b-b9e1-f5dd583f494b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.769088 Oct 18 13:34:03.082724 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2078/3939] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:02 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:03.110050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b3997cf0-0d6b-452e-9380-a6bc0dd8cd85 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:03.110680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b3997cf0-0d6b-452e-9380-a6bc0dd8cd85 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:03.119475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3997cf0-0d6b-452e-9380-a6bc0dd8cd85 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.120497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3997cf0-0d6b-452e-9380-a6bc0dd8cd85 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.120941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3997cf0-0d6b-452e-9380-a6bc0dd8cd85 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.121684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3997cf0-0d6b-452e-9380-a6bc0dd8cd85 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.122268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3997cf0-0d6b-452e-9380-a6bc0dd8cd85 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.122762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3997cf0-0d6b-452e-9380-a6bc0dd8cd85 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.198863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6f554a43-71ae-4349-9b33-cb6d94126c10 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:03.207598 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6f554a43-71ae-4349-9b33-cb6d94126c10 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1334 microversion: 2.1 time: 0.215444 Oct 18 13:34:03.208183 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1862/3940] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:02 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1334 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:03.226304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b87b37df-c128-487e-b10b-88e56dd8e113 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:03.226939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b87b37df-c128-487e-b10b-88e56dd8e113 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] [instance: 158bef41-8f92-41e0-ac04-4aa8164611ac] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:03.233403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b87b37df-c128-487e-b10b-88e56dd8e113 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.233811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b87b37df-c128-487e-b10b-88e56dd8e113 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.234287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b87b37df-c128-487e-b10b-88e56dd8e113 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.234997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b87b37df-c128-487e-b10b-88e56dd8e113 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.235447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b87b37df-c128-487e-b10b-88e56dd8e113 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.235866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b87b37df-c128-487e-b10b-88e56dd8e113 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.253555 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-b87b37df-c128-487e-b10b-88e56dd8e113 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] HTTP exception thrown: Instance 158bef41-8f92-41e0-ac04-4aa8164611ac could not be found. Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b87b37df-c128-487e-b10b-88e56dd8e113 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Request method failure captured: Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac HTTP/1.1 Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqs0xPY1M39KUWYCk_nUBLjqfqd4DCGJnZXdHB1SWd0aoGuwc5afH6IDZjSekT_DaYZap6bj7AKdMPWrjiOHwy48U5gvXRiNxw8Jdjv2mzpmQTq2dDHKKJ0Y2mKWti0mIoX6RuBUEDAv-eUBtcupOC9GVbR9agGql0ffd2k5yRkaXZM Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.26 Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: dc2b4569aac3475482a7bd3d44c62d21 Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerTagsTestJSON-627559141 Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc2b4569aac3475482a7bd3d44c62d21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc2b4569aac3475482a7bd3d44c62d21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc2b4569aac3475482a7bd3d44c62d21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc2b4569aac3475482a7bd3d44c62d21"}]}] Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerTagsTestJSON-627559141 Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: dc2b4569aac3475482a7bd3d44c62d21 Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerTagsTestJSON-627559141 Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerTagsTestJSON-627559141-project Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 5cd671875fd44aaf80984f61f5269744 Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerTagsTestJSON-627559141-project Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 158bef41-8f92-41e0-ac04-4aa8164611ac could not be found. Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '158bef41-8f92-41e0-ac04-4aa8164611ac'} Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158bef41-8f92-41e0-ac04-4aa8164611ac could not be found. Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158bef41-8f92-41e0-ac04-4aa8164611ac could not be found. Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:03.255187 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:03.261328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:03.261328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:03.261328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:03.261328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:03.261328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:03.261328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158bef41-8f92-41e0-ac04-4aa8164611ac could not be found. Oct 18 13:34:03.261328 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:03.262907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b87b37df-c128-487e-b10b-88e56dd8e113 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] Returning 404 to user: Instance 158bef41-8f92-41e0-ac04-4aa8164611ac could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:03.263774 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b87b37df-c128-487e-b10b-88e56dd8e113 tempest-ServerTagsTestJSON-627559141 tempest-ServerTagsTestJSON-627559141-project] 10.222.0.40 "GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac" status: 404 len: 111 microversion: 2.26 time: 0.041789 Oct 18 13:34:03.264337 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1863/3941] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:03 2022] GET /compute/v2.1/servers/158bef41-8f92-41e0-ac04-4aa8164611ac => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:34:03.274356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad165fa2-c759-4ebe-8e57-f71ff55ea9f7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:03.275410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ad165fa2-c759-4ebe-8e57-f71ff55ea9f7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:03.282841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad165fa2-c759-4ebe-8e57-f71ff55ea9f7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.283569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad165fa2-c759-4ebe-8e57-f71ff55ea9f7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.284238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad165fa2-c759-4ebe-8e57-f71ff55ea9f7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.285704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad165fa2-c759-4ebe-8e57-f71ff55ea9f7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.286397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad165fa2-c759-4ebe-8e57-f71ff55ea9f7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.287051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad165fa2-c759-4ebe-8e57-f71ff55ea9f7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.388833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b3997cf0-0d6b-452e-9380-a6bc0dd8cd85 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:03.406166 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b3997cf0-0d6b-452e-9380-a6bc0dd8cd85 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.302505 Oct 18 13:34:03.412447 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2079/3942] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:03 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:03.482455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-691393d0-b67b-46b4-b7ce-ced2904704a4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-286907313", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-691393d0-b67b-46b4-b7ce-ced2904704a4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 491 Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-286907313", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-286907313', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '97315d5a-8b0e-47cc-9e64-1e8e92c88ddc'}]}}} Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:03.488578 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-691393d0-b67b-46b4-b7ce-ced2904704a4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-691393d0-b67b-46b4-b7ce-ced2904704a4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.011919 Oct 18 13:34:03.492685 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2080/3943] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:03 2022] POST /compute/v2.1/servers => generated 624 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:34:03.506524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-981a44de-cbb2-47a5-82e0-0e042a2cb833 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:03.507890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-981a44de-cbb2-47a5-82e0-0e042a2cb833 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:03.525315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-981a44de-cbb2-47a5-82e0-0e042a2cb833 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.527090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-981a44de-cbb2-47a5-82e0-0e042a2cb833 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.530491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-981a44de-cbb2-47a5-82e0-0e042a2cb833 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.531645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-981a44de-cbb2-47a5-82e0-0e042a2cb833 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.533918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-981a44de-cbb2-47a5-82e0-0e042a2cb833 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.534596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-981a44de-cbb2-47a5-82e0-0e042a2cb833 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.697817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad165fa2-c759-4ebe-8e57-f71ff55ea9f7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:03.717124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad165fa2-c759-4ebe-8e57-f71ff55ea9f7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:03.724613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad165fa2-c759-4ebe-8e57-f71ff55ea9f7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:03.729019 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad165fa2-c759-4ebe-8e57-f71ff55ea9f7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1745 microversion: 2.20 time: 0.459439 Oct 18 13:34:03.745650 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1864/3944] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:03 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1745 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:03.776010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-981a44de-cbb2-47a5-82e0-0e042a2cb833 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:03.788458 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-981a44de-cbb2-47a5-82e0-0e042a2cb833 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.292236 Oct 18 13:34:03.807687 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2081/3945] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:03 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:03.817233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3986ba52-77b6-474f-a4da-b21696c760e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:03.817863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3986ba52-77b6-474f-a4da-b21696c760e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:03.830288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3986ba52-77b6-474f-a4da-b21696c760e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.831475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3986ba52-77b6-474f-a4da-b21696c760e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.832745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3986ba52-77b6-474f-a4da-b21696c760e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.833674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3986ba52-77b6-474f-a4da-b21696c760e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.834987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3986ba52-77b6-474f-a4da-b21696c760e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.835915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3986ba52-77b6-474f-a4da-b21696c760e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.915046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f2efad3b-18e1-4fd6-a941-f4500d9c2760 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:03.916089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f2efad3b-18e1-4fd6-a941-f4500d9c2760 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:03.940778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2efad3b-18e1-4fd6-a941-f4500d9c2760 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.941525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2efad3b-18e1-4fd6-a941-f4500d9c2760 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.942152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2efad3b-18e1-4fd6-a941-f4500d9c2760 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:03.943754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2efad3b-18e1-4fd6-a941-f4500d9c2760 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:03.944221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2efad3b-18e1-4fd6-a941-f4500d9c2760 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:03.946667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2efad3b-18e1-4fd6-a941-f4500d9c2760 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.164952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3986ba52-77b6-474f-a4da-b21696c760e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:04.174167 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3986ba52-77b6-474f-a4da-b21696c760e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.362927 Oct 18 13:34:04.174966 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1865/3946] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:03 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:04.180155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-c90bc251-4cb9-417f-8022-97dee3786d00 req-f4f54be8-2d6b-4726-85a5-6ee6165f5bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4537a22-98b0-4f99-9a5b-ca02dc28c627", "tag": "f9b9fb2f-722c-481d-a8b2-2e5e69d4a920"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:04.191014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c90bc251-4cb9-417f-8022-97dee3786d00 req-f4f54be8-2d6b-4726-85a5-6ee6165f5bd6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.191848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c90bc251-4cb9-417f-8022-97dee3786d00 req-f4f54be8-2d6b-4726-85a5-6ee6165f5bd6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.192514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c90bc251-4cb9-417f-8022-97dee3786d00 req-f4f54be8-2d6b-4726-85a5-6ee6165f5bd6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.208608 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-c90bc251-4cb9-417f-8022-97dee3786d00 req-f4f54be8-2d6b-4726-85a5-6ee6165f5bd6 service nova] Creating event network-changed:f9b9fb2f-722c-481d-a8b2-2e5e69d4a920 for instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 on n-h1-858384-13 Oct 18 13:34:04.214709 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-c90bc251-4cb9-417f-8022-97dee3786d00 req-f4f54be8-2d6b-4726-85a5-6ee6165f5bd6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038188 Oct 18 13:34:04.216002 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1866/3947] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:04.236302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2aaa927b-0a6d-4866-8ccc-988eecf99046 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:04.241943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2aaa927b-0a6d-4866-8ccc-988eecf99046 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:04.247474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2aaa927b-0a6d-4866-8ccc-988eecf99046 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.250474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2aaa927b-0a6d-4866-8ccc-988eecf99046 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.251154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2aaa927b-0a6d-4866-8ccc-988eecf99046 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.255016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2aaa927b-0a6d-4866-8ccc-988eecf99046 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.258136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2aaa927b-0a6d-4866-8ccc-988eecf99046 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.258608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2aaa927b-0a6d-4866-8ccc-988eecf99046 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.291331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:04.354106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f2efad3b-18e1-4fd6-a941-f4500d9c2760 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:04.371685 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f2efad3b-18e1-4fd6-a941-f4500d9c2760 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.459254 Oct 18 13:34:04.372849 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2082/3948] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:03 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:04.389946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a50e4e7a-82f6-4cc4-a30d-5b6c8f6ebd7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a50e4e7a-82f6-4cc4-a30d-5b6c8f6ebd7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 416 Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'networks': [{'uuid': '97315d5a-8b0e-47cc-9e64-1e8e92c88ddc'}]}}} Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:04.397463 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:34:04.402080 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:04.406039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a50e4e7a-82f6-4cc4-a30d-5b6c8f6ebd7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:04.407384 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a50e4e7a-82f6-4cc4-a30d-5b6c8f6ebd7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.033264 Oct 18 13:34:04.408143 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2083/3949] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:04 2022] POST /compute/v2.1/servers => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:34:04.418256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-461a991e-0733-4d60-8f95-b4ec8e0e5b0c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:04.419463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-461a991e-0733-4d60-8f95-b4ec8e0e5b0c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:04.430567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-461a991e-0733-4d60-8f95-b4ec8e0e5b0c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.431405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-461a991e-0733-4d60-8f95-b4ec8e0e5b0c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.432047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-461a991e-0733-4d60-8f95-b4ec8e0e5b0c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:04.432951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-461a991e-0733-4d60-8f95-b4ec8e0e5b0c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:04.433633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-461a991e-0733-4d60-8f95-b4ec8e0e5b0c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:04.434329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-461a991e-0733-4d60-8f95-b4ec8e0e5b0c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:05.072060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-461a991e-0733-4d60-8f95-b4ec8e0e5b0c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:05.109431 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-461a991e-0733-4d60-8f95-b4ec8e0e5b0c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.692637 Oct 18 13:34:05.122267 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2084/3950] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:04 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:05.151209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-78f8fd61-64b7-4593-b484-8bdb0b6f6f99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:05.151834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-78f8fd61-64b7-4593-b484-8bdb0b6f6f99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:05.196776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78f8fd61-64b7-4593-b484-8bdb0b6f6f99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:05.197406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78f8fd61-64b7-4593-b484-8bdb0b6f6f99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:05.197859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78f8fd61-64b7-4593-b484-8bdb0b6f6f99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:05.202954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78f8fd61-64b7-4593-b484-8bdb0b6f6f99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:05.203508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78f8fd61-64b7-4593-b484-8bdb0b6f6f99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:05.203954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78f8fd61-64b7-4593-b484-8bdb0b6f6f99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:05.244759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2aaa927b-0a6d-4866-8ccc-988eecf99046 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:05.261820 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2aaa927b-0a6d-4866-8ccc-988eecf99046 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1334 microversion: 2.1 time: 1.033421 Oct 18 13:34:05.265805 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1867/3951] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:04 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1334 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:05.284037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7cdbe981-8792-4ba7-a5ce-7ffd8a85cc3a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:05.286591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7cdbe981-8792-4ba7-a5ce-7ffd8a85cc3a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:05.311326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cdbe981-8792-4ba7-a5ce-7ffd8a85cc3a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:05.314126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cdbe981-8792-4ba7-a5ce-7ffd8a85cc3a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:05.317533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cdbe981-8792-4ba7-a5ce-7ffd8a85cc3a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:05.318836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cdbe981-8792-4ba7-a5ce-7ffd8a85cc3a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:05.327740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cdbe981-8792-4ba7-a5ce-7ffd8a85cc3a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:05.328204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cdbe981-8792-4ba7-a5ce-7ffd8a85cc3a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:05.629963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-78f8fd61-64b7-4593-b484-8bdb0b6f6f99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:05.645981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-78f8fd61-64b7-4593-b484-8bdb0b6f6f99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:05.652307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-78f8fd61-64b7-4593-b484-8bdb0b6f6f99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:05.653937 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-78f8fd61-64b7-4593-b484-8bdb0b6f6f99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.524325 Oct 18 13:34:05.670187 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2085/3952] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:05 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:05.693431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cab40380-5943-4828-80dd-dce7c6f7cf36 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:05.697108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cab40380-5943-4828-80dd-dce7c6f7cf36 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:05.705301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7cdbe981-8792-4ba7-a5ce-7ffd8a85cc3a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:05.717011 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7cdbe981-8792-4ba7-a5ce-7ffd8a85cc3a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.443845 Oct 18 13:34:05.720487 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1868/3953] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:05 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:05.754974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cab40380-5943-4828-80dd-dce7c6f7cf36 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:05.755593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cab40380-5943-4828-80dd-dce7c6f7cf36 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:05.756287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cab40380-5943-4828-80dd-dce7c6f7cf36 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:05.758476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cab40380-5943-4828-80dd-dce7c6f7cf36 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:05.758961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cab40380-5943-4828-80dd-dce7c6f7cf36 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:05.759396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cab40380-5943-4828-80dd-dce7c6f7cf36 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:05.842484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-816b7f67-a52e-47ec-81f1-e41e05744bb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2052014742", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": -1, "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:05.862685 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-816b7f67-a52e-47ec-81f1-e41e05744bb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Flavor -1 could not be found. Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-816b7f67-a52e-47ec-81f1-e41e05744bb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 206 Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2052014742", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": -1, "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: exception: Flavor -1 could not be found. Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2052014742', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': -1, 'networks': [{'uuid': '97315d5a-8b0e-47cc-9e64-1e8e92c88ddc'}]}}} Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:05.864716 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-816b7f67-a52e-47ec-81f1-e41e05744bb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-816b7f67-a52e-47ec-81f1-e41e05744bb7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.027636 Oct 18 13:34:05.870829 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1869/3954] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:05 2022] POST /compute/v2.1/servers => generated 73 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:05.877604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7993b0ec-ff40-4bc9-85fc-6b4179c48763 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:05.878234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7993b0ec-ff40-4bc9-85fc-6b4179c48763 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:05.919415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7993b0ec-ff40-4bc9-85fc-6b4179c48763 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:05.920057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7993b0ec-ff40-4bc9-85fc-6b4179c48763 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:05.920598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7993b0ec-ff40-4bc9-85fc-6b4179c48763 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:05.922290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7993b0ec-ff40-4bc9-85fc-6b4179c48763 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:05.922924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7993b0ec-ff40-4bc9-85fc-6b4179c48763 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:05.923541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7993b0ec-ff40-4bc9-85fc-6b4179c48763 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:06.250452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cab40380-5943-4828-80dd-dce7c6f7cf36 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:06.263061 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cab40380-5943-4828-80dd-dce7c6f7cf36 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.587976 Oct 18 13:34:06.263753 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2086/3955] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:05 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:06.293564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8173c4a8-39ae-4400-8706-701fa9f7555f req-273f5032-26bf-4b9c-a046-44a6167d2767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa292c2-3801-4d84-b31a-4d3eeeb41818", "name": "network-vif-plugged", "status": "completed", "tag": "8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:06.316095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8173c4a8-39ae-4400-8706-701fa9f7555f req-273f5032-26bf-4b9c-a046-44a6167d2767 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:06.316944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8173c4a8-39ae-4400-8706-701fa9f7555f req-273f5032-26bf-4b9c-a046-44a6167d2767 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:06.317633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8173c4a8-39ae-4400-8706-701fa9f7555f req-273f5032-26bf-4b9c-a046-44a6167d2767 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:06.335661 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8173c4a8-39ae-4400-8706-701fa9f7555f req-273f5032-26bf-4b9c-a046-44a6167d2767 service nova] Creating event network-vif-plugged:8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa for instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 on n-h2-858384-13 Oct 18 13:34:06.338843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7993b0ec-ff40-4bc9-85fc-6b4179c48763 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:06.353620 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8173c4a8-39ae-4400-8706-701fa9f7555f req-273f5032-26bf-4b9c-a046-44a6167d2767 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075033 Oct 18 13:34:06.354387 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7993b0ec-ff40-4bc9-85fc-6b4179c48763 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.483181 Oct 18 13:34:06.354989 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1870/3956] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:05 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:06.365453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dd97bab9-ca8c-4d64-9090-dd3c23ffd52f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:06.365453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dd97bab9-ca8c-4d64-9090-dd3c23ffd52f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:06.368094 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2087/3957] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:06.379441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd97bab9-ca8c-4d64-9090-dd3c23ffd52f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:06.380368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd97bab9-ca8c-4d64-9090-dd3c23ffd52f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:06.381016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd97bab9-ca8c-4d64-9090-dd3c23ffd52f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:06.383990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd97bab9-ca8c-4d64-9090-dd3c23ffd52f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:06.385207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd97bab9-ca8c-4d64-9090-dd3c23ffd52f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:06.387496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd97bab9-ca8c-4d64-9090-dd3c23ffd52f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:06.389256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e56bd4bd-eb9c-4cbe-a370-6aae4a6fb38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:06.402885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e56bd4bd-eb9c-4cbe-a370-6aae4a6fb38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:06.412543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e56bd4bd-eb9c-4cbe-a370-6aae4a6fb38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:06.413471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e56bd4bd-eb9c-4cbe-a370-6aae4a6fb38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:06.414166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e56bd4bd-eb9c-4cbe-a370-6aae4a6fb38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:06.415201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e56bd4bd-eb9c-4cbe-a370-6aae4a6fb38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:06.415904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e56bd4bd-eb9c-4cbe-a370-6aae4a6fb38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:06.416609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e56bd4bd-eb9c-4cbe-a370-6aae4a6fb38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:06.837873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e56bd4bd-eb9c-4cbe-a370-6aae4a6fb38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:06.847391 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e56bd4bd-eb9c-4cbe-a370-6aae4a6fb38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.466244 Oct 18 13:34:06.850208 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2088/3958] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:06 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:06.871941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-dbe24a46-ff3a-4e05-98ee-658b1675ea67 req-512e69a7-d78f-4064-aec4-e899e4d84ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4537a22-98b0-4f99-9a5b-ca02dc28c627", "tag": "a83b44ca-e022-456b-87fc-bd33986aee6f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:06.892388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dbe24a46-ff3a-4e05-98ee-658b1675ea67 req-512e69a7-d78f-4064-aec4-e899e4d84ed4 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:06.893301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dbe24a46-ff3a-4e05-98ee-658b1675ea67 req-512e69a7-d78f-4064-aec4-e899e4d84ed4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:06.893969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dbe24a46-ff3a-4e05-98ee-658b1675ea67 req-512e69a7-d78f-4064-aec4-e899e4d84ed4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:06.897469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:06.910797 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-dbe24a46-ff3a-4e05-98ee-658b1675ea67 req-512e69a7-d78f-4064-aec4-e899e4d84ed4 service nova] Creating event network-changed:a83b44ca-e022-456b-87fc-bd33986aee6f for instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 on n-h1-858384-13 Oct 18 13:34:06.917348 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-dbe24a46-ff3a-4e05-98ee-658b1675ea67 req-512e69a7-d78f-4064-aec4-e899e4d84ed4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056165 Oct 18 13:34:06.918859 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2089/3959] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:06.931497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1249efef-61f8-4d6b-8e2a-a66f200accdb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:06.932452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1249efef-61f8-4d6b-8e2a-a66f200accdb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:06.942678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1249efef-61f8-4d6b-8e2a-a66f200accdb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:06.945707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1249efef-61f8-4d6b-8e2a-a66f200accdb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:06.949232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1249efef-61f8-4d6b-8e2a-a66f200accdb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:06.950573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1249efef-61f8-4d6b-8e2a-a66f200accdb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:06.951598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1249efef-61f8-4d6b-8e2a-a66f200accdb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:06.954647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1249efef-61f8-4d6b-8e2a-a66f200accdb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:07.034455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dd97bab9-ca8c-4d64-9090-dd3c23ffd52f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:07.043177 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dd97bab9-ca8c-4d64-9090-dd3c23ffd52f tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1334 microversion: 2.1 time: 0.687105 Oct 18 13:34:07.046865 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1871/3960] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:06 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1334 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:07.058299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1fc45035-3156-4039-a10e-ee31e1019906 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1584499401", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1fc45035-3156-4039-a10e-ee31e1019906 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 173 Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1584499401", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1584499401', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '97315d5a-8b0e-47cc-9e64-1e8e92c88ddc'}]}}} Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi -1 Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:34:07.068257 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:34:07.073969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:34:07.073969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:34:07.073969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 18 13:34:07.073969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:07.073969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:07.073969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:07.073969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:07.073969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:07.073969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:07.073969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:34:07.073969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:34:07.073969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 18 13:34:07.073969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:07.078203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1fc45035-3156-4039-a10e-ee31e1019906 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:07.079303 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1fc45035-3156-4039-a10e-ee31e1019906 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.029008 Oct 18 13:34:07.086813 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1872/3961] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:07 2022] POST /compute/v2.1/servers => generated 145 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:34:07.095245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a542ee87-fdbe-4860-918c-02b0d29633c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:07.096389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a542ee87-fdbe-4860-918c-02b0d29633c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:07.115178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a542ee87-fdbe-4860-918c-02b0d29633c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:07.116183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a542ee87-fdbe-4860-918c-02b0d29633c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:07.116793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a542ee87-fdbe-4860-918c-02b0d29633c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:07.117737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a542ee87-fdbe-4860-918c-02b0d29633c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:07.118484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a542ee87-fdbe-4860-918c-02b0d29633c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:07.120932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a542ee87-fdbe-4860-918c-02b0d29633c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:07.338364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a542ee87-fdbe-4860-918c-02b0d29633c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:07.351609 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a542ee87-fdbe-4860-918c-02b0d29633c7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.258189 Oct 18 13:34:07.353862 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1873/3962] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:07 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:07.382860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1d9eaa74-7989-49ed-a023-54680c52a896 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:07.389079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1d9eaa74-7989-49ed-a023-54680c52a896 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:07.406385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9eaa74-7989-49ed-a023-54680c52a896 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:07.406699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1249efef-61f8-4d6b-8e2a-a66f200accdb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:07.415035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9eaa74-7989-49ed-a023-54680c52a896 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:07.417595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9eaa74-7989-49ed-a023-54680c52a896 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:07.419560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9eaa74-7989-49ed-a023-54680c52a896 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:07.421815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9eaa74-7989-49ed-a023-54680c52a896 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:07.423962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9eaa74-7989-49ed-a023-54680c52a896 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:07.426161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1249efef-61f8-4d6b-8e2a-a66f200accdb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:07.437739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1249efef-61f8-4d6b-8e2a-a66f200accdb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:07.440036 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1249efef-61f8-4d6b-8e2a-a66f200accdb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.519432 Oct 18 13:34:07.461861 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2090/3963] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:06 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:07.480165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0f7b94bf-beae-4770-8d90-161001a8688f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:07.487242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0f7b94bf-beae-4770-8d90-161001a8688f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:07.513414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f7b94bf-beae-4770-8d90-161001a8688f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:07.513414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f7b94bf-beae-4770-8d90-161001a8688f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:07.513414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f7b94bf-beae-4770-8d90-161001a8688f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:07.514140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f7b94bf-beae-4770-8d90-161001a8688f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:07.515698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f7b94bf-beae-4770-8d90-161001a8688f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:07.516315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f7b94bf-beae-4770-8d90-161001a8688f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:07.584105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:07.598922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:07.973811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:07.993518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1d9eaa74-7989-49ed-a023-54680c52a896 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:08.004609 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1d9eaa74-7989-49ed-a023-54680c52a896 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.638247 Oct 18 13:34:08.005224 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1874/3964] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:07 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:08.068474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6c8e0bf8-4899-46a8-9615-8c2c3d96d352 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:08.069373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6c8e0bf8-4899-46a8-9615-8c2c3d96d352 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:08.079220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c8e0bf8-4899-46a8-9615-8c2c3d96d352 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:08.081625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c8e0bf8-4899-46a8-9615-8c2c3d96d352 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:08.082421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c8e0bf8-4899-46a8-9615-8c2c3d96d352 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:08.083119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c8e0bf8-4899-46a8-9615-8c2c3d96d352 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:08.089933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c8e0bf8-4899-46a8-9615-8c2c3d96d352 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:08.090734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c8e0bf8-4899-46a8-9615-8c2c3d96d352 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:08.239999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0f7b94bf-beae-4770-8d90-161001a8688f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:08.267019 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0f7b94bf-beae-4770-8d90-161001a8688f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.802559 Oct 18 13:34:08.322408 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2091/3965] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:07 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:08.416786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5fcb63bf-96f6-4676-b586-b49e54acbffb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1388781342", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:08.424348 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-5fcb63bf-96f6-4676-b586-b49e54acbffb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5fcb63bf-96f6-4676-b586-b49e54acbffb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 216 Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1388781342", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1388781342', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:08.435371 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:08.441074 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:08.441074 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:08.441074 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:08.441074 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:08.441074 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:08.441074 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 18 13:34:08.441074 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:08.441074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5fcb63bf-96f6-4676-b586-b49e54acbffb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:08.443416 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5fcb63bf-96f6-4676-b586-b49e54acbffb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.030782 Oct 18 13:34:08.450058 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2092/3966] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:08 2022] POST /compute/v2.1/servers => generated 123 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:34:08.475793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c9d4d719-576b-4b41-a964-df01257d9cab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:08.475793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c9d4d719-576b-4b41-a964-df01257d9cab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:08.494073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9d4d719-576b-4b41-a964-df01257d9cab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:08.495811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9d4d719-576b-4b41-a964-df01257d9cab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:08.496426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9d4d719-576b-4b41-a964-df01257d9cab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:08.497976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9d4d719-576b-4b41-a964-df01257d9cab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:08.499951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9d4d719-576b-4b41-a964-df01257d9cab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:08.500598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9d4d719-576b-4b41-a964-df01257d9cab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:08.689230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6c8e0bf8-4899-46a8-9615-8c2c3d96d352 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:08.700812 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6c8e0bf8-4899-46a8-9615-8c2c3d96d352 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1334 microversion: 2.1 time: 0.635859 Oct 18 13:34:08.701217 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1875/3967] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:08 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1334 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:08.728975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3dd2a122-6416-4135-b40d-621fbd76be72 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:08.729623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3dd2a122-6416-4135-b40d-621fbd76be72 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:08.740802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dd2a122-6416-4135-b40d-621fbd76be72 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:08.741313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dd2a122-6416-4135-b40d-621fbd76be72 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:08.741754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dd2a122-6416-4135-b40d-621fbd76be72 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:08.742472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dd2a122-6416-4135-b40d-621fbd76be72 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:08.742919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dd2a122-6416-4135-b40d-621fbd76be72 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:08.743347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dd2a122-6416-4135-b40d-621fbd76be72 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:08.888855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c9d4d719-576b-4b41-a964-df01257d9cab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:08.901402 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c9d4d719-576b-4b41-a964-df01257d9cab tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.444595 Oct 18 13:34:08.902358 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2093/3968] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:08 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:08.917698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b4f33eea-7e81-4438-8f5b-b3bfed5b7981 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd413126-9740-4694-b94a-99db5a1c50e2"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:08.920032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b4f33eea-7e81-4438-8f5b-b3bfed5b7981 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:08.933767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4f33eea-7e81-4438-8f5b-b3bfed5b7981 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:08.934270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4f33eea-7e81-4438-8f5b-b3bfed5b7981 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:08.934706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4f33eea-7e81-4438-8f5b-b3bfed5b7981 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:08.935675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4f33eea-7e81-4438-8f5b-b3bfed5b7981 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:08.936126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4f33eea-7e81-4438-8f5b-b3bfed5b7981 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:08.942238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4f33eea-7e81-4438-8f5b-b3bfed5b7981 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:09.182471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3dd2a122-6416-4135-b40d-621fbd76be72 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:09.193787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3dd2a122-6416-4135-b40d-621fbd76be72 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:09.198297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3dd2a122-6416-4135-b40d-621fbd76be72 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:09.200125 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3dd2a122-6416-4135-b40d-621fbd76be72 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.475988 Oct 18 13:34:09.201295 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1876/3969] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:08 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:09.222354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d4623d9b-3db3-4e84-a923-baaf7b1c988f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:09.222960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d4623d9b-3db3-4e84-a923-baaf7b1c988f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:09.242385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4623d9b-3db3-4e84-a923-baaf7b1c988f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:09.245631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4623d9b-3db3-4e84-a923-baaf7b1c988f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:09.246088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4623d9b-3db3-4e84-a923-baaf7b1c988f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:09.246815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4623d9b-3db3-4e84-a923-baaf7b1c988f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:09.247268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4623d9b-3db3-4e84-a923-baaf7b1c988f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:09.251071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4623d9b-3db3-4e84-a923-baaf7b1c988f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:09.469920 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b4f33eea-7e81-4438-8f5b-b3bfed5b7981 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "POST /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563775 Oct 18 13:34:09.488274 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2094/3970] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:34:08 2022] POST /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments => generated 194 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:09.531370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a4a4a729-53ce-40b9-a650-96270ee26f18 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:09.532095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a4a4a729-53ce-40b9-a650-96270ee26f18 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:09.554959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4a4a729-53ce-40b9-a650-96270ee26f18 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:09.561193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4a4a729-53ce-40b9-a650-96270ee26f18 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:09.565129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4a4a729-53ce-40b9-a650-96270ee26f18 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:09.566896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4a4a729-53ce-40b9-a650-96270ee26f18 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:09.569939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4a4a729-53ce-40b9-a650-96270ee26f18 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:09.572845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4a4a729-53ce-40b9-a650-96270ee26f18 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:09.581948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d4623d9b-3db3-4e84-a923-baaf7b1c988f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:09.594405 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d4623d9b-3db3-4e84-a923-baaf7b1c988f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.391664 Oct 18 13:34:09.601878 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1877/3971] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:09 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:09.725871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2efff7f5-639c-4778-88f2-fde86d2ca353 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:09.726484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2efff7f5-639c-4778-88f2-fde86d2ca353 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:09.745724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2efff7f5-639c-4778-88f2-fde86d2ca353 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:09.746567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2efff7f5-639c-4778-88f2-fde86d2ca353 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:09.747211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2efff7f5-639c-4778-88f2-fde86d2ca353 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:09.748128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2efff7f5-639c-4778-88f2-fde86d2ca353 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:09.751778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2efff7f5-639c-4778-88f2-fde86d2ca353 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:09.752708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2efff7f5-639c-4778-88f2-fde86d2ca353 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:10.162885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a4a4a729-53ce-40b9-a650-96270ee26f18 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:10.182402 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a4a4a729-53ce-40b9-a650-96270ee26f18 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.692158 Oct 18 13:34:10.183054 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2095/3972] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:09 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:10.201106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-805f8b9d-93dc-41cb-8c11-334419f33021 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-396474074", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "key_name": "tempest-key-1863151773", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:10.203099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2efff7f5-639c-4778-88f2-fde86d2ca353 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:10.215545 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2efff7f5-639c-4778-88f2-fde86d2ca353 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1334 microversion: 2.1 time: 0.494502 Oct 18 13:34:10.231487 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1878/3973] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:09 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1334 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:10.259090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f655d336-6062-4e55-94a6-b52fbcecdba8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:10.268490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f655d336-6062-4e55-94a6-b52fbcecdba8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:10.295640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f655d336-6062-4e55-94a6-b52fbcecdba8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:10.296766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f655d336-6062-4e55-94a6-b52fbcecdba8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:10.298564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f655d336-6062-4e55-94a6-b52fbcecdba8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:10.299818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f655d336-6062-4e55-94a6-b52fbcecdba8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:10.300489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f655d336-6062-4e55-94a6-b52fbcecdba8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:10.301131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f655d336-6062-4e55-94a6-b52fbcecdba8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:10.311183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-805f8b9d-93dc-41cb-8c11-334419f33021 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] validate_networks() for [('97315d5a-8b0e-47cc-9e64-1e8e92c88ddc', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:34:10.651863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f655d336-6062-4e55-94a6-b52fbcecdba8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:10.668890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f655d336-6062-4e55-94a6-b52fbcecdba8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:10.673661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f655d336-6062-4e55-94a6-b52fbcecdba8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:10.677350 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f655d336-6062-4e55-94a6-b52fbcecdba8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.443966 Oct 18 13:34:10.683909 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1879/3974] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:10 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:11.215551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0fef235-4be9-48a0-8e43-84867376b8b4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:11.217117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e0fef235-4be9-48a0-8e43-84867376b8b4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:11.227398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0fef235-4be9-48a0-8e43-84867376b8b4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:11.230213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0fef235-4be9-48a0-8e43-84867376b8b4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:11.231661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0fef235-4be9-48a0-8e43-84867376b8b4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:11.235391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0fef235-4be9-48a0-8e43-84867376b8b4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:11.236213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0fef235-4be9-48a0-8e43-84867376b8b4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:11.236993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0fef235-4be9-48a0-8e43-84867376b8b4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:11.460419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e0fef235-4be9-48a0-8e43-84867376b8b4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:11.470982 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e0fef235-4be9-48a0-8e43-84867376b8b4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.259880 Oct 18 13:34:11.472425 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1880/3975] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:11 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:11.479451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5b042e8d-3828-4744-b64f-75059a5f128a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:11.480331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5b042e8d-3828-4744-b64f-75059a5f128a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:11.488301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b042e8d-3828-4744-b64f-75059a5f128a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:11.489561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b042e8d-3828-4744-b64f-75059a5f128a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:11.490247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b042e8d-3828-4744-b64f-75059a5f128a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:11.491176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b042e8d-3828-4744-b64f-75059a5f128a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:11.491995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b042e8d-3828-4744-b64f-75059a5f128a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:11.496376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b042e8d-3828-4744-b64f-75059a5f128a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:11.715597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5b042e8d-3828-4744-b64f-75059a5f128a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:11.726855 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5b042e8d-3828-4744-b64f-75059a5f128a tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1334 microversion: 2.1 time: 0.251904 Oct 18 13:34:11.727944 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1881/3976] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:11 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1334 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:11.736317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d8679792-594c-4545-83fa-b8b357015807 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:11.737335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d8679792-594c-4545-83fa-b8b357015807 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:11.745277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8679792-594c-4545-83fa-b8b357015807 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:11.747081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8679792-594c-4545-83fa-b8b357015807 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:11.747907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8679792-594c-4545-83fa-b8b357015807 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:11.749840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8679792-594c-4545-83fa-b8b357015807 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:11.750717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8679792-594c-4545-83fa-b8b357015807 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:11.752057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8679792-594c-4545-83fa-b8b357015807 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:11.975998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d8679792-594c-4545-83fa-b8b357015807 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:11.987040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d8679792-594c-4545-83fa-b8b357015807 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:11.989507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d8679792-594c-4545-83fa-b8b357015807 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:11.993297 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d8679792-594c-4545-83fa-b8b357015807 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.263916 Oct 18 13:34:11.994675 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1882/3977] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:11 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:12.326746 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-805f8b9d-93dc-41cb-8c11-334419f33021 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Invalid key_name provided. Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-805f8b9d-93dc-41cb-8c11-334419f33021 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 246 Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-396474074", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "key_name": "tempest-key-1863151773", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid key_name provided. Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-396474074', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'key_name': 'tempest-key-1863151773', 'networks': [{'uuid': '97315d5a-8b0e-47cc-9e64-1e8e92c88ddc'}]}}} Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1863151773 not found for user 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:12.338958 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:12.343575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-805f8b9d-93dc-41cb-8c11-334419f33021 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Invalid key_name provided. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:12.346513 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-805f8b9d-93dc-41cb-8c11-334419f33021 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 2.161989 Oct 18 13:34:12.346889 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2096/3978] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:10 2022] POST /compute/v2.1/servers => generated 70 bytes in 2163 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 18 13:34:12.357634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f63ec18-5c47-4f9b-bbff-c353a9b01005 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:12.359709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7f63ec18-5c47-4f9b-bbff-c353a9b01005 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:12.381076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f63ec18-5c47-4f9b-bbff-c353a9b01005 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:12.382111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f63ec18-5c47-4f9b-bbff-c353a9b01005 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:12.385023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f63ec18-5c47-4f9b-bbff-c353a9b01005 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:12.386018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f63ec18-5c47-4f9b-bbff-c353a9b01005 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:12.390958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f63ec18-5c47-4f9b-bbff-c353a9b01005 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:12.391651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f63ec18-5c47-4f9b-bbff-c353a9b01005 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:12.497196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb068e12-2c74-4aa8-815a-c06038fa4746 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:12.498307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cb068e12-2c74-4aa8-815a-c06038fa4746 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:12.534359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb068e12-2c74-4aa8-815a-c06038fa4746 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:12.534886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb068e12-2c74-4aa8-815a-c06038fa4746 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:12.535342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb068e12-2c74-4aa8-815a-c06038fa4746 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:12.536079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb068e12-2c74-4aa8-815a-c06038fa4746 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:12.536541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb068e12-2c74-4aa8-815a-c06038fa4746 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:12.536973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb068e12-2c74-4aa8-815a-c06038fa4746 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:12.769207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7f63ec18-5c47-4f9b-bbff-c353a9b01005 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:12.778524 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7f63ec18-5c47-4f9b-bbff-c353a9b01005 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.426557 Oct 18 13:34:12.788852 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1883/3979] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:12 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:12.820937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-11787245-4392-4d54-a3dd-2bcbc36be728 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:12.826264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-11787245-4392-4d54-a3dd-2bcbc36be728 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:12.860807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11787245-4392-4d54-a3dd-2bcbc36be728 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:12.861338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11787245-4392-4d54-a3dd-2bcbc36be728 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:12.871591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11787245-4392-4d54-a3dd-2bcbc36be728 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:12.872601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11787245-4392-4d54-a3dd-2bcbc36be728 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:12.873074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11787245-4392-4d54-a3dd-2bcbc36be728 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:12.873655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-11787245-4392-4d54-a3dd-2bcbc36be728 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:13.148782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cb068e12-2c74-4aa8-815a-c06038fa4746 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:13.171615 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cb068e12-2c74-4aa8-815a-c06038fa4746 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.679912 Oct 18 13:34:13.186771 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2097/3980] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:12 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:13.205033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-96ba323b-50e3-4bf3-a571-dd6d930682f2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:13.207106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-96ba323b-50e3-4bf3-a571-dd6d930682f2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:13.238657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96ba323b-50e3-4bf3-a571-dd6d930682f2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:13.239996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96ba323b-50e3-4bf3-a571-dd6d930682f2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:13.244266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96ba323b-50e3-4bf3-a571-dd6d930682f2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:13.245259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96ba323b-50e3-4bf3-a571-dd6d930682f2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:13.245920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96ba323b-50e3-4bf3-a571-dd6d930682f2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:13.246551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96ba323b-50e3-4bf3-a571-dd6d930682f2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:13.250539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-11787245-4392-4d54-a3dd-2bcbc36be728 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:13.260000 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-11787245-4392-4d54-a3dd-2bcbc36be728 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1334 microversion: 2.1 time: 0.469929 Oct 18 13:34:13.266483 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1884/3981] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:12 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1334 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:13.271582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a9949c7e-182b-48c9-a3b4-35bdfd5e9eaa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:13.276213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a9949c7e-182b-48c9-a3b4-35bdfd5e9eaa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:13.295706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9949c7e-182b-48c9-a3b4-35bdfd5e9eaa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:13.295706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9949c7e-182b-48c9-a3b4-35bdfd5e9eaa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:13.295706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9949c7e-182b-48c9-a3b4-35bdfd5e9eaa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:13.295706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9949c7e-182b-48c9-a3b4-35bdfd5e9eaa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:13.296890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9949c7e-182b-48c9-a3b4-35bdfd5e9eaa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:13.296890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9949c7e-182b-48c9-a3b4-35bdfd5e9eaa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:13.640542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a9949c7e-182b-48c9-a3b4-35bdfd5e9eaa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:13.652582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a9949c7e-182b-48c9-a3b4-35bdfd5e9eaa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:13.658732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a9949c7e-182b-48c9-a3b4-35bdfd5e9eaa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:13.660149 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a9949c7e-182b-48c9-a3b4-35bdfd5e9eaa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.392464 Oct 18 13:34:13.663667 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1885/3982] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:13 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:13.751397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-96ba323b-50e3-4bf3-a571-dd6d930682f2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:13.772800 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-96ba323b-50e3-4bf3-a571-dd6d930682f2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.583611 Oct 18 13:34:13.775831 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2098/3983] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:13 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:14.078313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-960174af-d7fa-4910-a4c9-c4d672428006 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1745451420", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:14.214178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ef01b6b6-fe18-4d93-b8b3-da4337856cfb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:14.214806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ef01b6b6-fe18-4d93-b8b3-da4337856cfb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:14.228779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef01b6b6-fe18-4d93-b8b3-da4337856cfb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.229144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef01b6b6-fe18-4d93-b8b3-da4337856cfb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.229607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef01b6b6-fe18-4d93-b8b3-da4337856cfb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.230304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef01b6b6-fe18-4d93-b8b3-da4337856cfb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.230753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef01b6b6-fe18-4d93-b8b3-da4337856cfb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.235837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef01b6b6-fe18-4d93-b8b3-da4337856cfb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.330747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.security_group_api [None req-960174af-d7fa-4910-a4c9-c4d672428006 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Neutron security group does_not_exist not found {{(pid=120612) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 18 13:34:14.331493 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-960174af-d7fa-4910-a4c9-c4d672428006 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-960174af-d7fa-4910-a4c9-c4d672428006 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 258 Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1745451420", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1745451420', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '97315d5a-8b0e-47cc-9e64-1e8e92c88ddc'}]}}} Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 18 13:34:14.351280 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:14.356194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-960174af-d7fa-4910-a4c9-c4d672428006 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:14.365696 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-960174af-d7fa-4910-a4c9-c4d672428006 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.279339 Oct 18 13:34:14.365696 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1886/3984] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:14 2022] POST /compute/v2.1/servers => generated 106 bytes in 281 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:34:14.365696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b0a56df5-f0ae-4265-a7f8-d0601c78f0b8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:14.365696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b0a56df5-f0ae-4265-a7f8-d0601c78f0b8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:14.392551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0a56df5-f0ae-4265-a7f8-d0601c78f0b8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.393063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0a56df5-f0ae-4265-a7f8-d0601c78f0b8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.393541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0a56df5-f0ae-4265-a7f8-d0601c78f0b8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.394271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0a56df5-f0ae-4265-a7f8-d0601c78f0b8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.394728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0a56df5-f0ae-4265-a7f8-d0601c78f0b8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.395155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0a56df5-f0ae-4265-a7f8-d0601c78f0b8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.411718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:14.567396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ef01b6b6-fe18-4d93-b8b3-da4337856cfb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:14.576087 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ef01b6b6-fe18-4d93-b8b3-da4337856cfb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.371379 Oct 18 13:34:14.580949 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2099/3985] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:14 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:14.598877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f5d651c5-4a66-4cd2-8824-f93ff82cf38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:14.600805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f5d651c5-4a66-4cd2-8824-f93ff82cf38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:14.626094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5d651c5-4a66-4cd2-8824-f93ff82cf38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.626903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5d651c5-4a66-4cd2-8824-f93ff82cf38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.627522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5d651c5-4a66-4cd2-8824-f93ff82cf38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.628417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5d651c5-4a66-4cd2-8824-f93ff82cf38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.631014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5d651c5-4a66-4cd2-8824-f93ff82cf38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.633242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5d651c5-4a66-4cd2-8824-f93ff82cf38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.814089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b0a56df5-f0ae-4265-a7f8-d0601c78f0b8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:14.824636 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b0a56df5-f0ae-4265-a7f8-d0601c78f0b8 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1334 microversion: 2.1 time: 0.470023 Oct 18 13:34:14.825756 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1887/3986] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:14 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1334 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:14.838147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c8f9acb-9904-4e7f-b522-0844759331ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:14.838854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7c8f9acb-9904-4e7f-b522-0844759331ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:14.856304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8f9acb-9904-4e7f-b522-0844759331ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.857786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8f9acb-9904-4e7f-b522-0844759331ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.860634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8f9acb-9904-4e7f-b522-0844759331ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:14.861635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8f9acb-9904-4e7f-b522-0844759331ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:14.863571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8f9acb-9904-4e7f-b522-0844759331ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:14.864075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c8f9acb-9904-4e7f-b522-0844759331ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:15.136190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7c8f9acb-9904-4e7f-b522-0844759331ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:15.150064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7c8f9acb-9904-4e7f-b522-0844759331ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:15.153540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7c8f9acb-9904-4e7f-b522-0844759331ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:15.155600 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7c8f9acb-9904-4e7f-b522-0844759331ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.328117 Oct 18 13:34:15.157025 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1888/3987] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:14 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:15.238707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f5d651c5-4a66-4cd2-8824-f93ff82cf38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:15.268447 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f5d651c5-4a66-4cd2-8824-f93ff82cf38b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.685565 Oct 18 13:34:15.270692 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2100/3988] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:14 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:15.300075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fff78bc3-448b-4738-82f8-535f22161a9d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:15.301021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fff78bc3-448b-4738-82f8-535f22161a9d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:15.309227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fff78bc3-448b-4738-82f8-535f22161a9d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:15.309950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fff78bc3-448b-4738-82f8-535f22161a9d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:15.310821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fff78bc3-448b-4738-82f8-535f22161a9d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:15.312510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fff78bc3-448b-4738-82f8-535f22161a9d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:15.313137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fff78bc3-448b-4738-82f8-535f22161a9d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:15.313894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fff78bc3-448b-4738-82f8-535f22161a9d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:15.604476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1cf9f35-3d83-41d4-a44a-aae5e4620a99 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:15.605798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e1cf9f35-3d83-41d4-a44a-aae5e4620a99 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:15.623590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1cf9f35-3d83-41d4-a44a-aae5e4620a99 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:15.626759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1cf9f35-3d83-41d4-a44a-aae5e4620a99 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:15.627942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1cf9f35-3d83-41d4-a44a-aae5e4620a99 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:15.631432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1cf9f35-3d83-41d4-a44a-aae5e4620a99 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:15.638213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fff78bc3-448b-4738-82f8-535f22161a9d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:15.640225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1cf9f35-3d83-41d4-a44a-aae5e4620a99 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:15.640717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1cf9f35-3d83-41d4-a44a-aae5e4620a99 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:15.650044 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fff78bc3-448b-4738-82f8-535f22161a9d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.354749 Oct 18 13:34:15.650646 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1889/3989] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:15 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:15.677933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-15575c4a-18e5-4f9f-949d-2f835e8d7a72 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:15.679280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-15575c4a-18e5-4f9f-949d-2f835e8d7a72 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 62ab6e1d-f36e-464d-b0d5-8aa9beb43bc0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:15.687154 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-15575c4a-18e5-4f9f-949d-2f835e8d7a72 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 62ab6e1d-f36e-464d-b0d5-8aa9beb43bc0 could not be found. Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-15575c4a-18e5-4f9f-949d-2f835e8d7a72 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/62ab6e1d-f36e-464d-b0d5-8aa9beb43bc0 HTTP/1.1 Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 62ab6e1d-f36e-464d-b0d5-8aa9beb43bc0 could not be found. Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '62ab6e1d-f36e-464d-b0d5-8aa9beb43bc0'} Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ab6e1d-f36e-464d-b0d5-8aa9beb43bc0 could not be found. Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ab6e1d-f36e-464d-b0d5-8aa9beb43bc0 could not be found. Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:15.689820 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:15.693293 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:15.693293 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:15.693293 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:15.693293 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:15.693293 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:15.693293 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:15.693293 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ab6e1d-f36e-464d-b0d5-8aa9beb43bc0 could not be found. Oct 18 13:34:15.693293 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:15.694725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-15575c4a-18e5-4f9f-949d-2f835e8d7a72 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 62ab6e1d-f36e-464d-b0d5-8aa9beb43bc0 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:15.699486 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-15575c4a-18e5-4f9f-949d-2f835e8d7a72 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "DELETE /compute/v2.1/servers/62ab6e1d-f36e-464d-b0d5-8aa9beb43bc0" status: 404 len: 111 microversion: 2.1 time: 0.028811 Oct 18 13:34:15.704159 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1890/3990] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:34:15 2022] DELETE /compute/v2.1/servers/62ab6e1d-f36e-464d-b0d5-8aa9beb43bc0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:34:15.717664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8b63f657-1b7a-4e3e-a3ed-34c42f2645cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:15.718634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8b63f657-1b7a-4e3e-a3ed-34c42f2645cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:15.755594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b63f657-1b7a-4e3e-a3ed-34c42f2645cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:15.759137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b63f657-1b7a-4e3e-a3ed-34c42f2645cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:15.760465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b63f657-1b7a-4e3e-a3ed-34c42f2645cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:15.766285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b63f657-1b7a-4e3e-a3ed-34c42f2645cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:15.768513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b63f657-1b7a-4e3e-a3ed-34c42f2645cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:15.773820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b63f657-1b7a-4e3e-a3ed-34c42f2645cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:16.089526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e1cf9f35-3d83-41d4-a44a-aae5e4620a99 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:16.110876 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e1cf9f35-3d83-41d4-a44a-aae5e4620a99 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.510835 Oct 18 13:34:16.115453 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2101/3991] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:15 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:16.134533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-afb8e824-b1e5-4848-800f-b4819621d497 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:16.137054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-afb8e824-b1e5-4848-800f-b4819621d497 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:16.159184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afb8e824-b1e5-4848-800f-b4819621d497 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:16.163978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afb8e824-b1e5-4848-800f-b4819621d497 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:16.165782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afb8e824-b1e5-4848-800f-b4819621d497 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:16.168066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afb8e824-b1e5-4848-800f-b4819621d497 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:16.171835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afb8e824-b1e5-4848-800f-b4819621d497 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:16.173991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afb8e824-b1e5-4848-800f-b4819621d497 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:16.272895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8b63f657-1b7a-4e3e-a3ed-34c42f2645cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:16.283403 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8b63f657-1b7a-4e3e-a3ed-34c42f2645cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.578003 Oct 18 13:34:16.289523 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1891/3992] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:15 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:16.337208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6b24376c-50de-48a7-bd60-af9b72a7eb60 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:16.337854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6b24376c-50de-48a7-bd60-af9b72a7eb60 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:16.372184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b24376c-50de-48a7-bd60-af9b72a7eb60 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:16.372697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b24376c-50de-48a7-bd60-af9b72a7eb60 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:16.373161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b24376c-50de-48a7-bd60-af9b72a7eb60 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:16.374635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b24376c-50de-48a7-bd60-af9b72a7eb60 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:16.375119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b24376c-50de-48a7-bd60-af9b72a7eb60 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:16.375554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b24376c-50de-48a7-bd60-af9b72a7eb60 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:16.644028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-afb8e824-b1e5-4848-800f-b4819621d497 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:16.666022 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-afb8e824-b1e5-4848-800f-b4819621d497 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1334 microversion: 2.1 time: 0.542612 Oct 18 13:34:16.681626 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2102/3993] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:16 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1334 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:16.689226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6fd1d260-11fd-4a29-aefd-58ba31344162 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:16.694123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6fd1d260-11fd-4a29-aefd-58ba31344162 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:16.702195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fd1d260-11fd-4a29-aefd-58ba31344162 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:16.703081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fd1d260-11fd-4a29-aefd-58ba31344162 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:16.708909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fd1d260-11fd-4a29-aefd-58ba31344162 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:16.711439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fd1d260-11fd-4a29-aefd-58ba31344162 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:16.712137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fd1d260-11fd-4a29-aefd-58ba31344162 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:16.712737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fd1d260-11fd-4a29-aefd-58ba31344162 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:16.836410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6b24376c-50de-48a7-bd60-af9b72a7eb60 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:16.854891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6b24376c-50de-48a7-bd60-af9b72a7eb60 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:16.863065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6b24376c-50de-48a7-bd60-af9b72a7eb60 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:16.869033 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6b24376c-50de-48a7-bd60-af9b72a7eb60 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.575982 Oct 18 13:34:16.871508 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1892/3994] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:16 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:17.058933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6fd1d260-11fd-4a29-aefd-58ba31344162 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:17.071403 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6fd1d260-11fd-4a29-aefd-58ba31344162 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.388569 Oct 18 13:34:17.076948 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2103/3995] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:16 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:17.084933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9ad7084b-48c9-4eca-b1b1-cd52eee28d77 req-52bbe250-1d6f-466c-b759-8df06bcd07c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4537a22-98b0-4f99-9a5b-ca02dc28c627", "name": "network-vif-plugged", "status": "completed", "tag": "f9b9fb2f-722c-481d-a8b2-2e5e69d4a920"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:17.109232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9ad7084b-48c9-4eca-b1b1-cd52eee28d77 req-52bbe250-1d6f-466c-b759-8df06bcd07c1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:17.110015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9ad7084b-48c9-4eca-b1b1-cd52eee28d77 req-52bbe250-1d6f-466c-b759-8df06bcd07c1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:17.110658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9ad7084b-48c9-4eca-b1b1-cd52eee28d77 req-52bbe250-1d6f-466c-b759-8df06bcd07c1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:17.124866 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9ad7084b-48c9-4eca-b1b1-cd52eee28d77 req-52bbe250-1d6f-466c-b759-8df06bcd07c1 service nova] Creating event network-vif-plugged:f9b9fb2f-722c-481d-a8b2-2e5e69d4a920 for instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 on n-h1-858384-13 Oct 18 13:34:17.132557 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9ad7084b-48c9-4eca-b1b1-cd52eee28d77 req-52bbe250-1d6f-466c-b759-8df06bcd07c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053358 Oct 18 13:34:17.137871 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2104/3996] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:17.145088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7cec3009-3f8e-4f14-8280-e20714c3c511 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:17.145863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7cec3009-3f8e-4f14-8280-e20714c3c511 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:34:17.146884 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-7cec3009-3f8e-4f14-8280-e20714c3c511 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7cec3009-3f8e-4f14-8280-e20714c3c511 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 9223372036854775808 could not be found. Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '9223372036854775808'} Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:17.148785 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:17.152445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:17.152445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:17.152445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:17.152445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 18 13:34:17.152445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:17.153839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7cec3009-3f8e-4f14-8280-e20714c3c511 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:17.156527 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7cec3009-3f8e-4f14-8280-e20714c3c511 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.015605 Oct 18 13:34:17.157695 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2105/3997] 10.222.0.40 () {58 vars in 1188 bytes} [Tue Oct 18 13:34:17 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:34:17.163825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-573de614-557e-4de0-9771-579dfb9c0e6c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:17.164856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-573de614-557e-4de0-9771-579dfb9c0e6c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:17.172432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-573de614-557e-4de0-9771-579dfb9c0e6c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:17.173278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-573de614-557e-4de0-9771-579dfb9c0e6c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:17.173950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-573de614-557e-4de0-9771-579dfb9c0e6c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:17.174880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-573de614-557e-4de0-9771-579dfb9c0e6c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:17.175589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-573de614-557e-4de0-9771-579dfb9c0e6c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:17.176267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-573de614-557e-4de0-9771-579dfb9c0e6c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:17.438058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-573de614-557e-4de0-9771-579dfb9c0e6c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:17.452050 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-573de614-557e-4de0-9771-579dfb9c0e6c tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.292706 Oct 18 13:34:17.454897 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2106/3998] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:17 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:17.459605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f861a243-e810-498e-924e-eaee90def0e2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:17.460220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f861a243-e810-498e-924e-eaee90def0e2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:17.476862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f861a243-e810-498e-924e-eaee90def0e2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:17.481699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f861a243-e810-498e-924e-eaee90def0e2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:17.484682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f861a243-e810-498e-924e-eaee90def0e2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:17.487711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f861a243-e810-498e-924e-eaee90def0e2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:17.488501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f861a243-e810-498e-924e-eaee90def0e2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:17.491152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f861a243-e810-498e-924e-eaee90def0e2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:17.584136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-224089370", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": "none"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:17.687785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:34:17.697634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f861a243-e810-498e-924e-eaee90def0e2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:17.699548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:34:17.700881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:34:17.702572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:34:17.703292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:34:17.712773 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f861a243-e810-498e-924e-eaee90def0e2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.256772 Oct 18 13:34:17.714169 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2107/3999] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:17 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:17.730942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a5630e80-7277-4bd3-b479-a6e182bd84ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:17.732521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a5630e80-7277-4bd3-b479-a6e182bd84ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:17.748357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:17.749430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:17.750149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:17.751450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:17.751946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5630e80-7277-4bd3-b479-a6e182bd84ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:17.752566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5630e80-7277-4bd3-b479-a6e182bd84ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:17.753232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:17.753800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5630e80-7277-4bd3-b479-a6e182bd84ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:17.754623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:17.757078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5630e80-7277-4bd3-b479-a6e182bd84ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:17.757718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5630e80-7277-4bd3-b479-a6e182bd84ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:17.759732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5630e80-7277-4bd3-b479-a6e182bd84ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:17.802111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Getting quotas for project 8d68292a275c4db3a8452ce9bc373452. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:34:17.817285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Getting quotas for user 9253cfaa9e40464e8d3f92fb35352563 and project 8d68292a275c4db3a8452ce9bc373452. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:34:17.863945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:34:17.870980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:34:17.981312 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7a471d90-1bd5-42c5-a182-7996bb836895 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.105674 Oct 18 13:34:18.001232 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1893/4000] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:34:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:34:18.013875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aefc2785-44b3-42b6-a563-2046939c227c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:18.016418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aefc2785-44b3-42b6-a563-2046939c227c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:18.024830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefc2785-44b3-42b6-a563-2046939c227c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.025658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefc2785-44b3-42b6-a563-2046939c227c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.026315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefc2785-44b3-42b6-a563-2046939c227c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.027234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefc2785-44b3-42b6-a563-2046939c227c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.027879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefc2785-44b3-42b6-a563-2046939c227c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.028500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefc2785-44b3-42b6-a563-2046939c227c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.227892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aefc2785-44b3-42b6-a563-2046939c227c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:18.237278 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aefc2785-44b3-42b6-a563-2046939c227c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.234473 Oct 18 13:34:18.257206 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1894/4001] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:18 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:18.266191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-688000b2-c8b3-4e79-bc7d-cefe15789763 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:18.266704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-688000b2-c8b3-4e79-bc7d-cefe15789763 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:18.278745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-688000b2-c8b3-4e79-bc7d-cefe15789763 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.281784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-688000b2-c8b3-4e79-bc7d-cefe15789763 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.284179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-688000b2-c8b3-4e79-bc7d-cefe15789763 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.285019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-688000b2-c8b3-4e79-bc7d-cefe15789763 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.286846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-688000b2-c8b3-4e79-bc7d-cefe15789763 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.287073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-688000b2-c8b3-4e79-bc7d-cefe15789763 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.289746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a5630e80-7277-4bd3-b479-a6e182bd84ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:18.292047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:18.316845 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a5630e80-7277-4bd3-b479-a6e182bd84ee tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1334 microversion: 2.1 time: 0.601357 Oct 18 13:34:18.317854 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2108/4002] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:17 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1334 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:18.322563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b7db754d-4d46-41d2-8ef6-cd95c04aacc4 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:18.323177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7db754d-4d46-41d2-8ef6-cd95c04aacc4 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:18.536409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7db754d-4d46-41d2-8ef6-cd95c04aacc4 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:18.564237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7db754d-4d46-41d2-8ef6-cd95c04aacc4 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:18.567479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7db754d-4d46-41d2-8ef6-cd95c04aacc4 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:18.569544 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b7db754d-4d46-41d2-8ef6-cd95c04aacc4 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1277 microversion: 2.57 time: 0.250612 Oct 18 13:34:18.570657 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2109/4003] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:18 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1277 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:18.581210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2686fe79-8ba0-44ef-98ce-4e82c5c839c8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:18.582422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2686fe79-8ba0-44ef-98ce-4e82c5c839c8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Failed to fetch instance by id -1 {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:34:18.583332 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-2686fe79-8ba0-44ef-98ce-4e82c5c839c8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance -1 could not be found. Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2686fe79-8ba0-44ef-98ce-4e82c5c839c8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance -1 could not be found. Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '-1'} Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:18.585097 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:18.588093 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:18.588093 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:18.588093 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 18 13:34:18.588093 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:18.588093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2686fe79-8ba0-44ef-98ce-4e82c5c839c8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:18.588093 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2686fe79-8ba0-44ef-98ce-4e82c5c839c8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.014364 Oct 18 13:34:18.588093 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2110/4004] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:34:18 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:34:18.598245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4117bcfe-c7f7-4bb3-b24f-aef6c765fa57 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:18.599064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4117bcfe-c7f7-4bb3-b24f-aef6c765fa57 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:18.606925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4117bcfe-c7f7-4bb3-b24f-aef6c765fa57 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.607425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4117bcfe-c7f7-4bb3-b24f-aef6c765fa57 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.607868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4117bcfe-c7f7-4bb3-b24f-aef6c765fa57 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.609520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4117bcfe-c7f7-4bb3-b24f-aef6c765fa57 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.610021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4117bcfe-c7f7-4bb3-b24f-aef6c765fa57 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.610475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4117bcfe-c7f7-4bb3-b24f-aef6c765fa57 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.624087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-688000b2-c8b3-4e79-bc7d-cefe15789763 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:18.635615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-688000b2-c8b3-4e79-bc7d-cefe15789763 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:18.641496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-688000b2-c8b3-4e79-bc7d-cefe15789763 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:18.642853 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-688000b2-c8b3-4e79-bc7d-cefe15789763 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.391050 Oct 18 13:34:18.658850 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1895/4005] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:18 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:18.675612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6541fba4-6869-4126-abe5-76178fda76e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:18.676509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6541fba4-6869-4126-abe5-76178fda76e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:18.692568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6541fba4-6869-4126-abe5-76178fda76e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.695024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6541fba4-6869-4126-abe5-76178fda76e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.696063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6541fba4-6869-4126-abe5-76178fda76e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:18.698137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6541fba4-6869-4126-abe5-76178fda76e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:18.700139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6541fba4-6869-4126-abe5-76178fda76e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:18.701171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6541fba4-6869-4126-abe5-76178fda76e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.020426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6541fba4-6869-4126-abe5-76178fda76e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:19.037719 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6541fba4-6869-4126-abe5-76178fda76e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.377763 Oct 18 13:34:19.064471 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1896/4006] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:18 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:19.071473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-47a551b0-f695-49f8-b54a-badcf6fd1871 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:19.072300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-47a551b0-f695-49f8-b54a-badcf6fd1871 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:19.074467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4117bcfe-c7f7-4bb3-b24f-aef6c765fa57 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:19.079398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47a551b0-f695-49f8-b54a-badcf6fd1871 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.080172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47a551b0-f695-49f8-b54a-badcf6fd1871 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.081230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47a551b0-f695-49f8-b54a-badcf6fd1871 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.082900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47a551b0-f695-49f8-b54a-badcf6fd1871 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.083780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47a551b0-f695-49f8-b54a-badcf6fd1871 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.084899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47a551b0-f695-49f8-b54a-badcf6fd1871 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.088869 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4117bcfe-c7f7-4bb3-b24f-aef6c765fa57 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.499383 Oct 18 13:34:19.089492 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2111/4007] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:18 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:19.151131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1849666e-16d9-48a9-a0cb-25e41a2cbc97 req-d00ca887-d3f5-4fbd-bd31-8b85042c4867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4537a22-98b0-4f99-9a5b-ca02dc28c627", "name": "network-vif-plugged", "status": "completed", "tag": "a83b44ca-e022-456b-87fc-bd33986aee6f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:19.183381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1849666e-16d9-48a9-a0cb-25e41a2cbc97 req-d00ca887-d3f5-4fbd-bd31-8b85042c4867 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.183873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1849666e-16d9-48a9-a0cb-25e41a2cbc97 req-d00ca887-d3f5-4fbd-bd31-8b85042c4867 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.184482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1849666e-16d9-48a9-a0cb-25e41a2cbc97 req-d00ca887-d3f5-4fbd-bd31-8b85042c4867 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.218819 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1849666e-16d9-48a9-a0cb-25e41a2cbc97 req-d00ca887-d3f5-4fbd-bd31-8b85042c4867 service nova] Creating event network-vif-plugged:a83b44ca-e022-456b-87fc-bd33986aee6f for instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 on n-h1-858384-13 Oct 18 13:34:19.233754 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1849666e-16d9-48a9-a0cb-25e41a2cbc97 req-d00ca887-d3f5-4fbd-bd31-8b85042c4867 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084893 Oct 18 13:34:19.235492 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2112/4008] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:34:19.347991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6375d16b-c570-4c78-a682-af313511a24e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:19.348793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6375d16b-c570-4c78-a682-af313511a24e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:19.361006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-47a551b0-f695-49f8-b54a-badcf6fd1871 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:19.366831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6375d16b-c570-4c78-a682-af313511a24e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.368345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6375d16b-c570-4c78-a682-af313511a24e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.369762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6375d16b-c570-4c78-a682-af313511a24e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.371490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6375d16b-c570-4c78-a682-af313511a24e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.372380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6375d16b-c570-4c78-a682-af313511a24e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.372922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6375d16b-c570-4c78-a682-af313511a24e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.379221 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-47a551b0-f695-49f8-b54a-badcf6fd1871 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.312941 Oct 18 13:34:19.403014 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1897/4009] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:19 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:19.421480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe641f6b-7a28-40cc-9a82-6eb4a4978f0f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:19.427685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe641f6b-7a28-40cc-9a82-6eb4a4978f0f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: e75c22ce-2dbb-446a-945a-7bc220788e39] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:19.448211 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-fe641f6b-7a28-40cc-9a82-6eb4a4978f0f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance e75c22ce-2dbb-446a-945a-7bc220788e39 could not be found. Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe641f6b-7a28-40cc-9a82-6eb4a4978f0f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/e75c22ce-2dbb-446a-945a-7bc220788e39/action HTTP/1.1 Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 19 Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: {"forceDelete": {}} Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance e75c22ce-2dbb-446a-945a-7bc220788e39 could not be found. Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'e75c22ce-2dbb-446a-945a-7bc220788e39', 'body': {'forceDelete': {}}} Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e75c22ce-2dbb-446a-945a-7bc220788e39 could not be found. Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e75c22ce-2dbb-446a-945a-7bc220788e39 could not be found. Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:19.472455 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:19.476439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:19.476439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:19.476439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e75c22ce-2dbb-446a-945a-7bc220788e39 could not be found. Oct 18 13:34:19.476439 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:19.476439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe641f6b-7a28-40cc-9a82-6eb4a4978f0f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance e75c22ce-2dbb-446a-945a-7bc220788e39 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:19.476439 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fe641f6b-7a28-40cc-9a82-6eb4a4978f0f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/e75c22ce-2dbb-446a-945a-7bc220788e39/action" status: 404 len: 111 microversion: 2.1 time: 0.067456 Oct 18 13:34:19.478640 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1898/4010] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:19 2022] POST /compute/v2.1/servers/e75c22ce-2dbb-446a-945a-7bc220788e39/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:19.487322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9d042ad1-cdd6-4b28-b58c-12d54f944619 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:19.487948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9d042ad1-cdd6-4b28-b58c-12d54f944619 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:19.502352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d042ad1-cdd6-4b28-b58c-12d54f944619 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.502845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d042ad1-cdd6-4b28-b58c-12d54f944619 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.503285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d042ad1-cdd6-4b28-b58c-12d54f944619 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.503999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d042ad1-cdd6-4b28-b58c-12d54f944619 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.504455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d042ad1-cdd6-4b28-b58c-12d54f944619 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.504885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d042ad1-cdd6-4b28-b58c-12d54f944619 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.694313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6375d16b-c570-4c78-a682-af313511a24e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:19.707276 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6375d16b-c570-4c78-a682-af313511a24e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1334 microversion: 2.1 time: 0.365819 Oct 18 13:34:19.708273 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2113/4011] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:19 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1334 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:19.714744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-715855b2-9213-46f4-ad22-08e2a7b7bf9b tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:19.715820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-715855b2-9213-46f4-ad22-08e2a7b7bf9b tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:19.723457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-715855b2-9213-46f4-ad22-08e2a7b7bf9b tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.724238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-715855b2-9213-46f4-ad22-08e2a7b7bf9b tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.724871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-715855b2-9213-46f4-ad22-08e2a7b7bf9b tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.725876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-715855b2-9213-46f4-ad22-08e2a7b7bf9b tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.726555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-715855b2-9213-46f4-ad22-08e2a7b7bf9b tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.727245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-715855b2-9213-46f4-ad22-08e2a7b7bf9b tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.835428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9d042ad1-cdd6-4b28-b58c-12d54f944619 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:19.851376 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9d042ad1-cdd6-4b28-b58c-12d54f944619 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.369497 Oct 18 13:34:19.869302 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1899/4012] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:19 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:19.892339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b8d9b196-c985-4880-bc80-b7d9e0774b13 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:19.904390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b8d9b196-c985-4880-bc80-b7d9e0774b13 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:19.918321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8d9b196-c985-4880-bc80-b7d9e0774b13 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.918814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8d9b196-c985-4880-bc80-b7d9e0774b13 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.919255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8d9b196-c985-4880-bc80-b7d9e0774b13 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:19.920021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8d9b196-c985-4880-bc80-b7d9e0774b13 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:19.920511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8d9b196-c985-4880-bc80-b7d9e0774b13 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:19.925898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8d9b196-c985-4880-bc80-b7d9e0774b13 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.095399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-715855b2-9213-46f4-ad22-08e2a7b7bf9b tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.117731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-715855b2-9213-46f4-ad22-08e2a7b7bf9b tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.131859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-715855b2-9213-46f4-ad22-08e2a7b7bf9b tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.133196 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-715855b2-9213-46f4-ad22-08e2a7b7bf9b tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1329 microversion: 2.57 time: 0.423388 Oct 18 13:34:20.133785 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2114/4013] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:19 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1329 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:20.151935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4125649c-2ff8-437a-aa4e-f596cfb0c5d3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:20.151935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4125649c-2ff8-437a-aa4e-f596cfb0c5d3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:20.152265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4125649c-2ff8-437a-aa4e-f596cfb0c5d3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.152769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4125649c-2ff8-437a-aa4e-f596cfb0c5d3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.153412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4125649c-2ff8-437a-aa4e-f596cfb0c5d3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.154564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4125649c-2ff8-437a-aa4e-f596cfb0c5d3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.155169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4125649c-2ff8-437a-aa4e-f596cfb0c5d3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.155599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4125649c-2ff8-437a-aa4e-f596cfb0c5d3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.189520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b8d9b196-c985-4880-bc80-b7d9e0774b13 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.219069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b8d9b196-c985-4880-bc80-b7d9e0774b13 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.220799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b8d9b196-c985-4880-bc80-b7d9e0774b13 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.222205 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b8d9b196-c985-4880-bc80-b7d9e0774b13 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.351616 Oct 18 13:34:20.223003 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1900/4014] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:19 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:20.229450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e471a125-e9f1-4b8c-8b5c-37da0c3ded95 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:20.230283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e471a125-e9f1-4b8c-8b5c-37da0c3ded95 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:20.238263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e471a125-e9f1-4b8c-8b5c-37da0c3ded95 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.239081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e471a125-e9f1-4b8c-8b5c-37da0c3ded95 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.239738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e471a125-e9f1-4b8c-8b5c-37da0c3ded95 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.240807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e471a125-e9f1-4b8c-8b5c-37da0c3ded95 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.241539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e471a125-e9f1-4b8c-8b5c-37da0c3ded95 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.242179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e471a125-e9f1-4b8c-8b5c-37da0c3ded95 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.479524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e471a125-e9f1-4b8c-8b5c-37da0c3ded95 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.494799 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e471a125-e9f1-4b8c-8b5c-37da0c3ded95 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1502 microversion: 2.1 time: 0.270425 Oct 18 13:34:20.495947 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1901/4015] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:20 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1502 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:20.518408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd3073a1-99fa-40df-a582-eb968758d31f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Action: 'create', calling method: .version_select at 0x7ff60efc9ee0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1874962921", "description": "tempest-description-1269862929"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:20.614956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4125649c-2ff8-437a-aa4e-f596cfb0c5d3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:20.628752 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4125649c-2ff8-437a-aa4e-f596cfb0c5d3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.493649 Oct 18 13:34:20.629936 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2115/4016] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:20 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:20.665225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d4c5db1-8171-4060-8ce1-95f30b89f18d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:20.672381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3d4c5db1-8171-4060-8ce1-95f30b89f18d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: bdab276f-c92f-4958-bf74-24a8f083b325] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:20.679228 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-3d4c5db1-8171-4060-8ce1-95f30b89f18d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance bdab276f-c92f-4958-bf74-24a8f083b325 could not be found. Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d4c5db1-8171-4060-8ce1-95f30b89f18d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/bdab276f-c92f-4958-bf74-24a8f083b325/action HTTP/1.1 Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 39 Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: {"os-getConsoleOutput": {"length": 10}} Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance bdab276f-c92f-4958-bf74-24a8f083b325 could not be found. Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'bdab276f-c92f-4958-bf74-24a8f083b325', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdab276f-c92f-4958-bf74-24a8f083b325 could not be found. Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdab276f-c92f-4958-bf74-24a8f083b325 could not be found. Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:20.684163 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:20.689259 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:20.689259 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:20.689259 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:20.689259 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:20.689259 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdab276f-c92f-4958-bf74-24a8f083b325 could not be found. Oct 18 13:34:20.689259 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:20.691804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d4c5db1-8171-4060-8ce1-95f30b89f18d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance bdab276f-c92f-4958-bf74-24a8f083b325 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:20.693023 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3d4c5db1-8171-4060-8ce1-95f30b89f18d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/bdab276f-c92f-4958-bf74-24a8f083b325/action" status: 404 len: 111 microversion: 2.1 time: 0.040299 Oct 18 13:34:20.694261 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2116/4017] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:20 2022] POST /compute/v2.1/servers/bdab276f-c92f-4958-bf74-24a8f083b325/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:20.709919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a4bfaec9-6e44-44c9-ab4e-1dcba502caf5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:20.714504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a4bfaec9-6e44-44c9-ab4e-1dcba502caf5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:20.724589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4bfaec9-6e44-44c9-ab4e-1dcba502caf5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.725299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4bfaec9-6e44-44c9-ab4e-1dcba502caf5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.725750 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fd3073a1-99fa-40df-a582-eb968758d31f tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.211087 Oct 18 13:34:20.726195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4bfaec9-6e44-44c9-ab4e-1dcba502caf5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.727227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4bfaec9-6e44-44c9-ab4e-1dcba502caf5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.733237 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1902/4018] 10.222.0.40 () {60 vars in 1180 bytes} [Tue Oct 18 13:34:20 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:34:20.735298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4bfaec9-6e44-44c9-ab4e-1dcba502caf5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.736063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4bfaec9-6e44-44c9-ab4e-1dcba502caf5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.738213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d81de9d2-a918-4a49-9948-dfa8ef36a5f0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:20.739286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d81de9d2-a918-4a49-9948-dfa8ef36a5f0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:20.747794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81de9d2-a918-4a49-9948-dfa8ef36a5f0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.748283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81de9d2-a918-4a49-9948-dfa8ef36a5f0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.749374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81de9d2-a918-4a49-9948-dfa8ef36a5f0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:20.750112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81de9d2-a918-4a49-9948-dfa8ef36a5f0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:20.750565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81de9d2-a918-4a49-9948-dfa8ef36a5f0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:20.750988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d81de9d2-a918-4a49-9948-dfa8ef36a5f0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.002793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d81de9d2-a918-4a49-9948-dfa8ef36a5f0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:21.012751 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d81de9d2-a918-4a49-9948-dfa8ef36a5f0 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1334 microversion: 2.1 time: 0.278677 Oct 18 13:34:21.014770 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1903/4019] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:20 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1334 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:21.019949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-afb67c64-887e-4a1a-b913-666f1168c9bd tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1874962921"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:21.020780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-afb67c64-887e-4a1a-b913-666f1168c9bd tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:21.027422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afb67c64-887e-4a1a-b913-666f1168c9bd tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.028171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afb67c64-887e-4a1a-b913-666f1168c9bd tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.028825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afb67c64-887e-4a1a-b913-666f1168c9bd tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.029888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afb67c64-887e-4a1a-b913-666f1168c9bd tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.030841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afb67c64-887e-4a1a-b913-666f1168c9bd tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.031619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-afb67c64-887e-4a1a-b913-666f1168c9bd tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.074901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a4bfaec9-6e44-44c9-ab4e-1dcba502caf5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:21.088993 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a4bfaec9-6e44-44c9-ab4e-1dcba502caf5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.389963 Oct 18 13:34:21.104188 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2117/4020] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:20 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:21.120643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f118d40e-00b8-4f72-aa5f-ac4f9f9aaacf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:21.128888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f118d40e-00b8-4f72-aa5f-ac4f9f9aaacf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:21.143455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f118d40e-00b8-4f72-aa5f-ac4f9f9aaacf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.144166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f118d40e-00b8-4f72-aa5f-ac4f9f9aaacf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.144750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f118d40e-00b8-4f72-aa5f-ac4f9f9aaacf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.146868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f118d40e-00b8-4f72-aa5f-ac4f9f9aaacf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.148740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f118d40e-00b8-4f72-aa5f-ac4f9f9aaacf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.150644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f118d40e-00b8-4f72-aa5f-ac4f9f9aaacf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.298526 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.network.security_group_api [None req-afb67c64-887e-4a1a-b913-666f1168c9bd tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Adding security group ec394bba-d6ed-4c25-bbc0-2f34fc1b8062 to port cd03578d-94c2-4cc7-879e-cd4a553d91c2 Oct 18 13:34:21.416941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f118d40e-00b8-4f72-aa5f-ac4f9f9aaacf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:21.438868 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f118d40e-00b8-4f72-aa5f-ac4f9f9aaacf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.323043 Oct 18 13:34:21.442408 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2118/4021] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:21 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:21.479825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba25aca1-ed20-4c9b-a208-6bd9118125db tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:21.483591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ba25aca1-ed20-4c9b-a208-6bd9118125db tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:21.509601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba25aca1-ed20-4c9b-a208-6bd9118125db tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.510099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba25aca1-ed20-4c9b-a208-6bd9118125db tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.510734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba25aca1-ed20-4c9b-a208-6bd9118125db tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.511429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba25aca1-ed20-4c9b-a208-6bd9118125db tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.511879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba25aca1-ed20-4c9b-a208-6bd9118125db tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.517569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba25aca1-ed20-4c9b-a208-6bd9118125db tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.666435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba25aca1-ed20-4c9b-a208-6bd9118125db tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:21.682277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba25aca1-ed20-4c9b-a208-6bd9118125db tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:21.686855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba25aca1-ed20-4c9b-a208-6bd9118125db tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:21.689096 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ba25aca1-ed20-4c9b-a208-6bd9118125db tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1335 microversion: 2.57 time: 0.244414 Oct 18 13:34:21.689843 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2119/4022] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:21 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1335 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:21.713410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fbea5dc9-9f06-426b-9142-f4e51340212c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:21.724390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fbea5dc9-9f06-426b-9142-f4e51340212c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:21.735518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fbea5dc9-9f06-426b-9142-f4e51340212c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.736405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fbea5dc9-9f06-426b-9142-f4e51340212c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.736981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fbea5dc9-9f06-426b-9142-f4e51340212c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.738668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fbea5dc9-9f06-426b-9142-f4e51340212c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.739856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fbea5dc9-9f06-426b-9142-f4e51340212c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.740495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fbea5dc9-9f06-426b-9142-f4e51340212c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.834910 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-afb67c64-887e-4a1a-b913-666f1168c9bd tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "POST /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9/action" status: 202 len: 0 microversion: 2.1 time: 0.818798 Oct 18 13:34:21.839857 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1904/4023] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:21 2022] POST /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9/action => generated 0 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:34:21.848250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3f743ead-1105-4832-8362-f31d48b651e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:21.850690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3f743ead-1105-4832-8362-f31d48b651e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: df815243-f4ff-4d5d-83cc-bbb4cfe534e0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:21.854378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:21.858567 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-3f743ead-1105-4832-8362-f31d48b651e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance df815243-f4ff-4d5d-83cc-bbb4cfe534e0 could not be found. Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3f743ead-1105-4832-8362-f31d48b651e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/df815243-f4ff-4d5d-83cc-bbb4cfe534e0 HTTP/1.1 Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance df815243-f4ff-4d5d-83cc-bbb4cfe534e0 could not be found. Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'df815243-f4ff-4d5d-83cc-bbb4cfe534e0'} Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df815243-f4ff-4d5d-83cc-bbb4cfe534e0 could not be found. Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df815243-f4ff-4d5d-83cc-bbb4cfe534e0 could not be found. Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:21.860359 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:21.864283 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:21.864283 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:21.864283 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:21.864283 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df815243-f4ff-4d5d-83cc-bbb4cfe534e0 could not be found. Oct 18 13:34:21.864283 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:21.865418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3f743ead-1105-4832-8362-f31d48b651e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance df815243-f4ff-4d5d-83cc-bbb4cfe534e0 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:21.866596 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3f743ead-1105-4832-8362-f31d48b651e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/df815243-f4ff-4d5d-83cc-bbb4cfe534e0" status: 404 len: 111 microversion: 2.1 time: 0.025522 Oct 18 13:34:21.867341 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1905/4024] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:21 2022] GET /compute/v2.1/servers/df815243-f4ff-4d5d-83cc-bbb4cfe534e0 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:21.873873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6a880b4f-7c47-449b-963b-a76cd77226ad tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1874962921"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:21.876035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6a880b4f-7c47-449b-963b-a76cd77226ad tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:21.886210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a880b4f-7c47-449b-963b-a76cd77226ad tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.887065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a880b4f-7c47-449b-963b-a76cd77226ad tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.887929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a880b4f-7c47-449b-963b-a76cd77226ad tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:21.889040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a880b4f-7c47-449b-963b-a76cd77226ad tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:21.890448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a880b4f-7c47-449b-963b-a76cd77226ad tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:21.891149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a880b4f-7c47-449b-963b-a76cd77226ad tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.154626 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.network.security_group_api [None req-6a880b4f-7c47-449b-963b-a76cd77226ad tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Removing security group ec394bba-d6ed-4c25-bbc0-2f34fc1b8062 from port cd03578d-94c2-4cc7-879e-cd4a553d91c2 Oct 18 13:34:22.316707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fbea5dc9-9f06-426b-9142-f4e51340212c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:22.329495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fbea5dc9-9f06-426b-9142-f4e51340212c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:22.331066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fbea5dc9-9f06-426b-9142-f4e51340212c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:22.332290 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fbea5dc9-9f06-426b-9142-f4e51340212c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.628674 Oct 18 13:34:22.332868 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2120/4025] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:21 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:22.355052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-6f97e866-b4cf-4e93-b4d1-5e8ba0cc81c9 req-648187b2-64bf-45f7-a114-1abb8e745490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f75005a7-f4b9-46a1-bdb9-98d795d0c0a9", "tag": "cd03578d-94c2-4cc7-879e-cd4a553d91c2"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:22.387748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6f97e866-b4cf-4e93-b4d1-5e8ba0cc81c9 req-648187b2-64bf-45f7-a114-1abb8e745490 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.390604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6f97e866-b4cf-4e93-b4d1-5e8ba0cc81c9 req-648187b2-64bf-45f7-a114-1abb8e745490 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.390954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6f97e866-b4cf-4e93-b4d1-5e8ba0cc81c9 req-648187b2-64bf-45f7-a114-1abb8e745490 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.421065 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-6f97e866-b4cf-4e93-b4d1-5e8ba0cc81c9 req-648187b2-64bf-45f7-a114-1abb8e745490 service nova] Creating event network-changed:cd03578d-94c2-4cc7-879e-cd4a553d91c2 for instance f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 on n-h1-858384-13 Oct 18 13:34:22.435785 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-6f97e866-b4cf-4e93-b4d1-5e8ba0cc81c9 req-648187b2-64bf-45f7-a114-1abb8e745490 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095277 Oct 18 13:34:22.436835 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2121/4026] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:22.450913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a83bbc70-ea91-4884-9bd0-cedbfc5133ef tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:22.452353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a83bbc70-ea91-4884-9bd0-cedbfc5133ef tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:22.466135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a83bbc70-ea91-4884-9bd0-cedbfc5133ef tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.469218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a83bbc70-ea91-4884-9bd0-cedbfc5133ef tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.469810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a83bbc70-ea91-4884-9bd0-cedbfc5133ef tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.471402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a83bbc70-ea91-4884-9bd0-cedbfc5133ef tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.473138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a83bbc70-ea91-4884-9bd0-cedbfc5133ef tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.473855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a83bbc70-ea91-4884-9bd0-cedbfc5133ef tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.806600 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6a880b4f-7c47-449b-963b-a76cd77226ad tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "POST /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9/action" status: 202 len: 0 microversion: 2.1 time: 0.937940 Oct 18 13:34:22.807804 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1906/4027] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:21 2022] POST /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9/action => generated 0 bytes in 940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:34:22.816594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3a5aced2-3b42-4e45-ab37-e5d20640d5ca tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:22.817434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3a5aced2-3b42-4e45-ab37-e5d20640d5ca tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:22.841127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5aced2-3b42-4e45-ab37-e5d20640d5ca tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.846599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5aced2-3b42-4e45-ab37-e5d20640d5ca tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.847308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5aced2-3b42-4e45-ab37-e5d20640d5ca tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.848224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5aced2-3b42-4e45-ab37-e5d20640d5ca tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:22.852468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5aced2-3b42-4e45-ab37-e5d20640d5ca tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:22.854821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5aced2-3b42-4e45-ab37-e5d20640d5ca tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:22.954816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a83bbc70-ea91-4884-9bd0-cedbfc5133ef tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:22.991141 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a83bbc70-ea91-4884-9bd0-cedbfc5133ef tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.552947 Oct 18 13:34:23.018282 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2122/4028] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:22 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:23.018282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-625c4985-ac63-4a5f-8f80-546093953967 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:23.018282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-625c4985-ac63-4a5f-8f80-546093953967 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:23.033400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-625c4985-ac63-4a5f-8f80-546093953967 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.033905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-625c4985-ac63-4a5f-8f80-546093953967 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.034355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-625c4985-ac63-4a5f-8f80-546093953967 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.035094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-625c4985-ac63-4a5f-8f80-546093953967 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.035621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-625c4985-ac63-4a5f-8f80-546093953967 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.036081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-625c4985-ac63-4a5f-8f80-546093953967 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.302124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-625c4985-ac63-4a5f-8f80-546093953967 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:23.307365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3a5aced2-3b42-4e45-ab37-e5d20640d5ca tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:23.313276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-625c4985-ac63-4a5f-8f80-546093953967 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:23.324404 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3a5aced2-3b42-4e45-ab37-e5d20640d5ca tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1669 microversion: 2.1 time: 0.515309 Oct 18 13:34:23.325329 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1907/4029] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:22 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1669 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:23.330849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-15ae72ea-d69c-4755-9f04-3695dddf0af0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Action: 'create', calling method: .version_select at 0x7ff60ff475e0>, body: {"pool": null} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:23.349149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-625c4985-ac63-4a5f-8f80-546093953967 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:23.350831 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-625c4985-ac63-4a5f-8f80-546093953967 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1356 microversion: 2.57 time: 0.343505 Oct 18 13:34:23.370372 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2123/4030] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:23 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1356 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:23.381006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6ee35481-a61c-4a8e-a006-ce6980103a44 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:23.381993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6ee35481-a61c-4a8e-a006-ce6980103a44 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:23.390084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ee35481-a61c-4a8e-a006-ce6980103a44 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.390804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ee35481-a61c-4a8e-a006-ce6980103a44 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.391392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ee35481-a61c-4a8e-a006-ce6980103a44 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.392362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ee35481-a61c-4a8e-a006-ce6980103a44 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.392952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ee35481-a61c-4a8e-a006-ce6980103a44 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.393702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ee35481-a61c-4a8e-a006-ce6980103a44 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.750551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ee35481-a61c-4a8e-a006-ce6980103a44 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:23.760505 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6ee35481-a61c-4a8e-a006-ce6980103a44 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.388841 Oct 18 13:34:23.782636 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2124/4031] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:23 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:23.793987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e98192d4-f988-4205-a6eb-8a1f62efb5b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:23.794643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e98192d4-f988-4205-a6eb-8a1f62efb5b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:23.801139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:23.803249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e98192d4-f988-4205-a6eb-8a1f62efb5b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.804100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e98192d4-f988-4205-a6eb-8a1f62efb5b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.804691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e98192d4-f988-4205-a6eb-8a1f62efb5b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.805711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e98192d4-f988-4205-a6eb-8a1f62efb5b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.806870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e98192d4-f988-4205-a6eb-8a1f62efb5b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.807819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e98192d4-f988-4205-a6eb-8a1f62efb5b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.838525 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e98192d4-f988-4205-a6eb-8a1f62efb5b7 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627/ips" status: 200 len: 179 microversion: 2.1 time: 0.054491 Oct 18 13:34:23.839273 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2125/4032] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:34:23 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627/ips => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:23.855432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68ba63e9-dcd7-471b-98c7-7b4220f3a960 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:23.856350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-68ba63e9-dcd7-471b-98c7-7b4220f3a960 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:23.863642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68ba63e9-dcd7-471b-98c7-7b4220f3a960 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.864338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68ba63e9-dcd7-471b-98c7-7b4220f3a960 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.864923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68ba63e9-dcd7-471b-98c7-7b4220f3a960 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:23.866043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68ba63e9-dcd7-471b-98c7-7b4220f3a960 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:23.866684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68ba63e9-dcd7-471b-98c7-7b4220f3a960 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:23.867255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68ba63e9-dcd7-471b-98c7-7b4220f3a960 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.583805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68ba63e9-dcd7-471b-98c7-7b4220f3a960 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:24.604115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68ba63e9-dcd7-471b-98c7-7b4220f3a960 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:24.606174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68ba63e9-dcd7-471b-98c7-7b4220f3a960 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:24.608882 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68ba63e9-dcd7-471b-98c7-7b4220f3a960 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.758448 Oct 18 13:34:24.609789 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2126/4033] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:23 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:24.628466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:24.631531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:24.654468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.655568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.656318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.657037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.657520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.665594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.821493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:34:24.825709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:34:24.827752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:34:24.833158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:34:24.833711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:34:24.975713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:24.986656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.986656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.986656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:24.987281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:24.987737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:24.989760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.050646 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3970ab2d-b085-404f-a535-bc46fa058ccf tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "POST /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728/action" status: 202 len: 1137 microversion: 2.57 time: 0.427747 Oct 18 13:34:25.050646 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2127/4034] 10.222.0.40 () {62 vars in 1320 bytes} [Tue Oct 18 13:34:24 2022] POST /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728/action => generated 1137 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 13:34:25.050646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b18c2cf0-1bad-4eee-bc11-e3de8d46f805 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:25.050646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b18c2cf0-1bad-4eee-bc11-e3de8d46f805 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:25.062099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b18c2cf0-1bad-4eee-bc11-e3de8d46f805 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.062099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b18c2cf0-1bad-4eee-bc11-e3de8d46f805 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.062099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b18c2cf0-1bad-4eee-bc11-e3de8d46f805 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.062099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b18c2cf0-1bad-4eee-bc11-e3de8d46f805 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.063031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b18c2cf0-1bad-4eee-bc11-e3de8d46f805 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.063619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b18c2cf0-1bad-4eee-bc11-e3de8d46f805 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.067388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:25.116614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b18c2cf0-1bad-4eee-bc11-e3de8d46f805 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:34:25.335490 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b18c2cf0-1bad-4eee-bc11-e3de8d46f805 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 204 len: 0 microversion: 2.1 time: 0.293550 Oct 18 13:34:25.341710 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2128/4035] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:34:25 2022] DELETE /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:34:25.361038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1c66b64a-7fa4-4dde-b038-3cb822463d43 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1136444797", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1c66b64a-7fa4-4dde-b038-3cb822463d43 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 238 Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1136444797", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1136444797', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '97315d5a-8b0e-47cc-9e64-1e8e92c88ddc'}]}}} Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:25.394695 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1c66b64a-7fa4-4dde-b038-3cb822463d43 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1c66b64a-7fa4-4dde-b038-3cb822463d43 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.051377 Oct 18 13:34:25.398036 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2129/4036] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:25 2022] POST /compute/v2.1/servers => generated 139 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:34:25.403232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1f4117bd-10be-468d-b1e0-e3bc8519218f req-9654b2b7-0dfe-473f-917d-29c4698f8c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f75005a7-f4b9-46a1-bdb9-98d795d0c0a9", "tag": "cd03578d-94c2-4cc7-879e-cd4a553d91c2"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:25.427915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1f4117bd-10be-468d-b1e0-e3bc8519218f req-9654b2b7-0dfe-473f-917d-29c4698f8c1a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.428480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1f4117bd-10be-468d-b1e0-e3bc8519218f req-9654b2b7-0dfe-473f-917d-29c4698f8c1a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.428943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1f4117bd-10be-468d-b1e0-e3bc8519218f req-9654b2b7-0dfe-473f-917d-29c4698f8c1a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.443808 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1f4117bd-10be-468d-b1e0-e3bc8519218f req-9654b2b7-0dfe-473f-917d-29c4698f8c1a service nova] Creating event network-changed:cd03578d-94c2-4cc7-879e-cd4a553d91c2 for instance f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 on n-h1-858384-13 Oct 18 13:34:25.449304 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1f4117bd-10be-468d-b1e0-e3bc8519218f req-9654b2b7-0dfe-473f-917d-29c4698f8c1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050770 Oct 18 13:34:25.450052 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2130/4037] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:25.457261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c55b74c4-c8ad-4195-b065-ebbf0e88e3ed tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:25.458107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c55b74c4-c8ad-4195-b065-ebbf0e88e3ed tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:25.478898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c55b74c4-c8ad-4195-b065-ebbf0e88e3ed tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.479520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c55b74c4-c8ad-4195-b065-ebbf0e88e3ed tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.480015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c55b74c4-c8ad-4195-b065-ebbf0e88e3ed tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.481073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c55b74c4-c8ad-4195-b065-ebbf0e88e3ed tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.481886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c55b74c4-c8ad-4195-b065-ebbf0e88e3ed tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.483108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c55b74c4-c8ad-4195-b065-ebbf0e88e3ed tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.597606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c55b74c4-c8ad-4195-b065-ebbf0e88e3ed tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:25.610198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c55b74c4-c8ad-4195-b065-ebbf0e88e3ed tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:25.612295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c55b74c4-c8ad-4195-b065-ebbf0e88e3ed tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:25.615543 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c55b74c4-c8ad-4195-b065-ebbf0e88e3ed tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.164101 Oct 18 13:34:25.616568 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2131/4038] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:25 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:25.621774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-208bf2b1-4d5a-455d-b645-4a2e9e2f08be tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:25.622611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-208bf2b1-4d5a-455d-b645-4a2e9e2f08be tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:25.633245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-208bf2b1-4d5a-455d-b645-4a2e9e2f08be tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.634069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-208bf2b1-4d5a-455d-b645-4a2e9e2f08be tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.634699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-208bf2b1-4d5a-455d-b645-4a2e9e2f08be tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.635746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-208bf2b1-4d5a-455d-b645-4a2e9e2f08be tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.636400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-208bf2b1-4d5a-455d-b645-4a2e9e2f08be tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.637079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-208bf2b1-4d5a-455d-b645-4a2e9e2f08be tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.819190 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-15ae72ea-d69c-4755-9f04-3695dddf0af0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.492599 Oct 18 13:34:25.821862 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1908/4039] 10.222.0.40 () {60 vars in 1170 bytes} [Tue Oct 18 13:34:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:25.837114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-808501e2-beb8-4549-b6c2-83a25da5e5f9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:25.838054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-808501e2-beb8-4549-b6c2-83a25da5e5f9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:25.848393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-808501e2-beb8-4549-b6c2-83a25da5e5f9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.849351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-808501e2-beb8-4549-b6c2-83a25da5e5f9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.850050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-808501e2-beb8-4549-b6c2-83a25da5e5f9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.851008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-808501e2-beb8-4549-b6c2-83a25da5e5f9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.852239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-808501e2-beb8-4549-b6c2-83a25da5e5f9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.857306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-208bf2b1-4d5a-455d-b645-4a2e9e2f08be tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:25.869081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-808501e2-beb8-4549-b6c2-83a25da5e5f9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.874235 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-208bf2b1-4d5a-455d-b645-4a2e9e2f08be tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1675 microversion: 2.1 time: 0.255401 Oct 18 13:34:25.877728 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2132/4040] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:25 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1675 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:25.886710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-14a38f64-4cc7-46e0-8dd4-83881ebccfce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:25.891852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-14a38f64-4cc7-46e0-8dd4-83881ebccfce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:25.906468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14a38f64-4cc7-46e0-8dd4-83881ebccfce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.906963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14a38f64-4cc7-46e0-8dd4-83881ebccfce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.907401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14a38f64-4cc7-46e0-8dd4-83881ebccfce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:25.908104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14a38f64-4cc7-46e0-8dd4-83881ebccfce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:25.908556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14a38f64-4cc7-46e0-8dd4-83881ebccfce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:25.912005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14a38f64-4cc7-46e0-8dd4-83881ebccfce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:26.146379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-808501e2-beb8-4549-b6c2-83a25da5e5f9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:26.163576 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-808501e2-beb8-4549-b6c2-83a25da5e5f9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.330832 Oct 18 13:34:26.164303 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1909/4041] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:25 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:26.181080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-14a38f64-4cc7-46e0-8dd4-83881ebccfce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:26.184011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.87"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:26.191124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-14a38f64-4cc7-46e0-8dd4-83881ebccfce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:26.192676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-14a38f64-4cc7-46e0-8dd4-83881ebccfce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:26.193885 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-14a38f64-4cc7-46e0-8dd4-83881ebccfce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.314893 Oct 18 13:34:26.197223 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2133/4042] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:25 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:26.199414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8bd055ec-92cf-42f4-a7b9-748e7c78e658 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:26.200022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8bd055ec-92cf-42f4-a7b9-748e7c78e658 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:26.206556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bd055ec-92cf-42f4-a7b9-748e7c78e658 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:26.207036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bd055ec-92cf-42f4-a7b9-748e7c78e658 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:26.207655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bd055ec-92cf-42f4-a7b9-748e7c78e658 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:26.208450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bd055ec-92cf-42f4-a7b9-748e7c78e658 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:26.208908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bd055ec-92cf-42f4-a7b9-748e7c78e658 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:26.209360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bd055ec-92cf-42f4-a7b9-748e7c78e658 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:26.215810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:26.222571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:26.224307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:26.224912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:26.226979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:26.227613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:26.228195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:26.235796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:26.285860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "refresh_cache-f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:34:26.286260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquired lock "refresh_cache-f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:34:26.449071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8bd055ec-92cf-42f4-a7b9-748e7c78e658 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:26.458554 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8bd055ec-92cf-42f4-a7b9-748e7c78e658 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.262729 Oct 18 13:34:26.469846 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2134/4043] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:26 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:26.552570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb29ae32-6a0b-41a5-a970-33e0973921fb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1551984185", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb29ae32-6a0b-41a5-a970-33e0973921fb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 235 Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1551984185", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1551984185', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '97315d5a-8b0e-47cc-9e64-1e8e92c88ddc'}]}}} Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:26.573803 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 18 13:34:26.578063 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:26.580968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb29ae32-6a0b-41a5-a970-33e0973921fb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:26.586227 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eb29ae32-6a0b-41a5-a970-33e0973921fb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.037797 Oct 18 13:34:26.586961 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2135/4044] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:26 2022] POST /compute/v2.1/servers => generated 133 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:34:26.596335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c546003-6362-453e-b8d7-63e914f0d173 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:26.596943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c546003-6362-453e-b8d7-63e914f0d173 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:26.625943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c546003-6362-453e-b8d7-63e914f0d173 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:26.626581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c546003-6362-453e-b8d7-63e914f0d173 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:26.627008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c546003-6362-453e-b8d7-63e914f0d173 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:26.628226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c546003-6362-453e-b8d7-63e914f0d173 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:26.628687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c546003-6362-453e-b8d7-63e914f0d173 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:26.629117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c546003-6362-453e-b8d7-63e914f0d173 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:26.987924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3c546003-6362-453e-b8d7-63e914f0d173 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:26.996581 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c546003-6362-453e-b8d7-63e914f0d173 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.405166 Oct 18 13:34:27.009626 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2136/4045] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:26 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:27.021432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9aa7ecd8-451c-4650-8375-e8d217373283 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:27.022270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9aa7ecd8-451c-4650-8375-e8d217373283 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:27.032122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9aa7ecd8-451c-4650-8375-e8d217373283 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:27.033421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9aa7ecd8-451c-4650-8375-e8d217373283 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:27.034106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9aa7ecd8-451c-4650-8375-e8d217373283 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:27.034989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9aa7ecd8-451c-4650-8375-e8d217373283 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:27.035671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9aa7ecd8-451c-4650-8375-e8d217373283 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:27.036274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9aa7ecd8-451c-4650-8375-e8d217373283 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:27.228137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9aa7ecd8-451c-4650-8375-e8d217373283 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:27.240405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9aa7ecd8-451c-4650-8375-e8d217373283 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:27.244719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9aa7ecd8-451c-4650-8375-e8d217373283 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:27.246847 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9aa7ecd8-451c-4650-8375-e8d217373283 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.235859 Oct 18 13:34:27.248114 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2137/4046] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:27 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:27.615042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-39591375-f24a-43f5-a3d1-2b41e7e80b90 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1092d7df-cc3c-46f0-b7cd-9141ba561ac7"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:27.620252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-39591375-f24a-43f5-a3d1-2b41e7e80b90 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:27.640702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39591375-f24a-43f5-a3d1-2b41e7e80b90 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:27.649501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39591375-f24a-43f5-a3d1-2b41e7e80b90 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:27.650930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39591375-f24a-43f5-a3d1-2b41e7e80b90 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:27.654809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39591375-f24a-43f5-a3d1-2b41e7e80b90 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:27.656015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39591375-f24a-43f5-a3d1-2b41e7e80b90 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:27.656691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39591375-f24a-43f5-a3d1-2b41e7e80b90 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:27.775049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:27.850178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:27.906832 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-39591375-f24a-43f5-a3d1-2b41e7e80b90 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] HTTP exception thrown: Volume 1092d7df-cc3c-46f0-b7cd-9141ba561ac7 could not be found. Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-39591375-f24a-43f5-a3d1-2b41e7e80b90 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Request method failure captured: Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: request: PUT /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments/fd413126-9740-4694-b94a-99db5a1c50e2 HTTP/1.1 Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 74 Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsIbRjJGhWP9KxHMq1tns4Ii8NEkJWRyJC4QmJ2GHRPpfb3CEW_d3hzQgjO5q1ZV3UeUTWvf7Gq-i3Bk0yldomRXC1t5lpHv4HdknO9qfQyJLyT0TINFKaogYlACA9fUawLd1s8QmvvaNESUfxBRSUZwI7FnFu08jugTSlsMv0MQZI Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 92dd257d3f294e058ed68d73e7f34eca Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-VolumesAdminNegativeTest-1830471866 Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92dd257d3f294e058ed68d73e7f34eca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92dd257d3f294e058ed68d73e7f34eca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92dd257d3f294e058ed68d73e7f34eca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92dd257d3f294e058ed68d73e7f34eca"}]}] Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-VolumesAdminNegativeTest-1830471866 Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 92dd257d3f294e058ed68d73e7f34eca Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1830471866 Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-VolumesAdminNegativeTest-1830471866-project-admin Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1af0a8aa25ea4e6bbbe302326d0bc97f Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-VolumesAdminNegativeTest-1830471866-project-admin Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: {"volumeAttachment": {"volumeId": "1092d7df-cc3c-46f0-b7cd-9141ba561ac7"}} Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: exception: Volume 1092d7df-cc3c-46f0-b7cd-9141ba561ac7 could not be found. Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'server_id': 'a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4', 'id': 'fd413126-9740-4694-b94a-99db5a1c50e2', 'body': {'volumeAttachment': {'volumeId': '1092d7df-cc3c-46f0-b7cd-9141ba561ac7'}}} Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1092d7df-cc3c-46f0-b7cd-9141ba561ac7 could not be found. (HTTP 404) (Request-ID: req-dc1a0a33-d1e3-4ec6-bc28-60fc9e18939f) Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:34:27.910473 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1092d7df-cc3c-46f0-b7cd-9141ba561ac7 could not be found. Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 1092d7df-cc3c-46f0-b7cd-9141ba561ac7 could not be found. Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1092d7df-cc3c-46f0-b7cd-9141ba561ac7 could not be found. Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-39591375-f24a-43f5-a3d1-2b41e7e80b90 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Returning 400 to user: Volume 1092d7df-cc3c-46f0-b7cd-9141ba561ac7 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-39591375-f24a-43f5-a3d1-2b41e7e80b90 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] 10.222.0.40 "PUT /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments/fd413126-9740-4694-b94a-99db5a1c50e2" status: 400 len: 107 microversion: 2.1 time: 0.661345 Oct 18 13:34:27.914176 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2138/4047] 10.222.0.40 () {60 vars in 1433 bytes} [Tue Oct 18 13:34:27 2022] PUT /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments/fd413126-9740-4694-b94a-99db5a1c50e2 => generated 107 bytes in 664 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:34:27.923858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1cdd0ea4-3531-4cc7-9758-af75114416c5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:27.924520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1cdd0ea4-3531-4cc7-9758-af75114416c5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:27.933596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1cdd0ea4-3531-4cc7-9758-af75114416c5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:27.934092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1cdd0ea4-3531-4cc7-9758-af75114416c5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:27.934623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1cdd0ea4-3531-4cc7-9758-af75114416c5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:27.935598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1cdd0ea4-3531-4cc7-9758-af75114416c5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:27.936090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1cdd0ea4-3531-4cc7-9758-af75114416c5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:27.937733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1cdd0ea4-3531-4cc7-9758-af75114416c5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:28.209553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1cdd0ea4-3531-4cc7-9758-af75114416c5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:28.219726 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1cdd0ea4-3531-4cc7-9758-af75114416c5 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1675 microversion: 2.1 time: 0.300234 Oct 18 13:34:28.220908 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2139/4048] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:27 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1675 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:28.226811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-df634dd2-7e86-4193-9468-86b80839af7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:28.227567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-df634dd2-7e86-4193-9468-86b80839af7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:28.235834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df634dd2-7e86-4193-9468-86b80839af7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:28.236317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df634dd2-7e86-4193-9468-86b80839af7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:28.236748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df634dd2-7e86-4193-9468-86b80839af7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:28.237555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df634dd2-7e86-4193-9468-86b80839af7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:28.237994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df634dd2-7e86-4193-9468-86b80839af7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:28.238414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df634dd2-7e86-4193-9468-86b80839af7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:28.511166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-df634dd2-7e86-4193-9468-86b80839af7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:28.523275 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-df634dd2-7e86-4193-9468-86b80839af7f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.299838 Oct 18 13:34:28.524183 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2140/4049] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:28 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:28.540806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Building network info cache for instance {{(pid=120612) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:34:28.544956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-84141d68-b4e8-400b-af8e-72abb904446f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:28.546099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-84141d68-b4e8-400b-af8e-72abb904446f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:28.559797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:28.568115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84141d68-b4e8-400b-af8e-72abb904446f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:28.581307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84141d68-b4e8-400b-af8e-72abb904446f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:28.581972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84141d68-b4e8-400b-af8e-72abb904446f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:28.582777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84141d68-b4e8-400b-af8e-72abb904446f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:28.583204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84141d68-b4e8-400b-af8e-72abb904446f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:28.583632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84141d68-b4e8-400b-af8e-72abb904446f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:28.825970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-84141d68-b4e8-400b-af8e-72abb904446f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:28.841155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-84141d68-b4e8-400b-af8e-72abb904446f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:28.843630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-84141d68-b4e8-400b-af8e-72abb904446f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:28.845826 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-84141d68-b4e8-400b-af8e-72abb904446f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.320564 Oct 18 13:34:28.846617 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2141/4050] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:28 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:28.852655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3f250f72-469b-4a2c-a19f-ec8619136943 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:28.853548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3f250f72-469b-4a2c-a19f-ec8619136943 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:28.862727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f250f72-469b-4a2c-a19f-ec8619136943 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:28.863621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f250f72-469b-4a2c-a19f-ec8619136943 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:28.864990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f250f72-469b-4a2c-a19f-ec8619136943 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:28.865929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f250f72-469b-4a2c-a19f-ec8619136943 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:28.866643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f250f72-469b-4a2c-a19f-ec8619136943 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:28.867289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f250f72-469b-4a2c-a19f-ec8619136943 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:29.056190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-3f250f72-469b-4a2c-a19f-ec8619136943 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lazy-loading 'services' on Instance uuid a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:29.382775 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3f250f72-469b-4a2c-a19f-ec8619136943 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments/fd413126-9740-4694-b94a-99db5a1c50e2" status: 202 len: 0 microversion: 2.1 time: 0.534119 Oct 18 13:34:29.397822 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2142/4051] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:34:28 2022] DELETE /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments/fd413126-9740-4694-b94a-99db5a1c50e2 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:34:29.414354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ec73e681-15a7-44b0-b15e-09689f3fa73d req-c6ad201c-9915-42d4-961a-fe59af893a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4537a22-98b0-4f99-9a5b-ca02dc28c627", "name": "network-vif-deleted", "tag": "f9b9fb2f-722c-481d-a8b2-2e5e69d4a920"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:29.502671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ec73e681-15a7-44b0-b15e-09689f3fa73d req-c6ad201c-9915-42d4-961a-fe59af893a9e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:29.503153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ec73e681-15a7-44b0-b15e-09689f3fa73d req-c6ad201c-9915-42d4-961a-fe59af893a9e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:29.503587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ec73e681-15a7-44b0-b15e-09689f3fa73d req-c6ad201c-9915-42d4-961a-fe59af893a9e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:29.539176 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ec73e681-15a7-44b0-b15e-09689f3fa73d req-c6ad201c-9915-42d4-961a-fe59af893a9e service nova] Creating event network-vif-deleted:f9b9fb2f-722c-481d-a8b2-2e5e69d4a920 for instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 on n-h1-858384-13 Oct 18 13:34:29.573953 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ec73e681-15a7-44b0-b15e-09689f3fa73d req-c6ad201c-9915-42d4-961a-fe59af893a9e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174559 Oct 18 13:34:29.575161 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2143/4052] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:29.583192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c55fa79d-950d-43dd-8716-ef415bddb87c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:29.586092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c55fa79d-950d-43dd-8716-ef415bddb87c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:29.600136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c55fa79d-950d-43dd-8716-ef415bddb87c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:29.600764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c55fa79d-950d-43dd-8716-ef415bddb87c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:29.602401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c55fa79d-950d-43dd-8716-ef415bddb87c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:29.606278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c55fa79d-950d-43dd-8716-ef415bddb87c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:29.606834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c55fa79d-950d-43dd-8716-ef415bddb87c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:29.607285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c55fa79d-950d-43dd-8716-ef415bddb87c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:29.778842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c55fa79d-950d-43dd-8716-ef415bddb87c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:29.789392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c55fa79d-950d-43dd-8716-ef415bddb87c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:29.790842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c55fa79d-950d-43dd-8716-ef415bddb87c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:29.799919 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c55fa79d-950d-43dd-8716-ef415bddb87c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.223495 Oct 18 13:34:29.830646 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2144/4053] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:29 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:29.836319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-834daf7e-b06c-4964-a3e8-94d1f574c0db tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:29.854536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-834daf7e-b06c-4964-a3e8-94d1f574c0db tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 617f7835-47d6-446b-807b-1758bbafe25e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:29.876800 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-834daf7e-b06c-4964-a3e8-94d1f574c0db tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 617f7835-47d6-446b-807b-1758bbafe25e could not be found. Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-834daf7e-b06c-4964-a3e8-94d1f574c0db tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/617f7835-47d6-446b-807b-1758bbafe25e/action HTTP/1.1 Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 13 Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: {"pause": {}} Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 617f7835-47d6-446b-807b-1758bbafe25e could not be found. Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '617f7835-47d6-446b-807b-1758bbafe25e', 'body': {'pause': {}}} Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 617f7835-47d6-446b-807b-1758bbafe25e could not be found. Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 617f7835-47d6-446b-807b-1758bbafe25e could not be found. Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:29.906886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:29.914439 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:29.914439 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:29.914439 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 617f7835-47d6-446b-807b-1758bbafe25e could not be found. Oct 18 13:34:29.914439 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:29.914439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-834daf7e-b06c-4964-a3e8-94d1f574c0db tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 617f7835-47d6-446b-807b-1758bbafe25e could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:29.914439 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-834daf7e-b06c-4964-a3e8-94d1f574c0db tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/617f7835-47d6-446b-807b-1758bbafe25e/action" status: 404 len: 111 microversion: 2.1 time: 0.076141 Oct 18 13:34:29.914439 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2145/4054] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:29 2022] POST /compute/v2.1/servers/617f7835-47d6-446b-807b-1758bbafe25e/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:29.920938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:29.921926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:29.965291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:29.965385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:29.965854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:29.966896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:29.967754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:29.968415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.044563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.045087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.046381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.046993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lazy-loading 'fault' on Instance uuid d4537a22-98b0-4f99-9a5b-ca02dc28c627 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:30.085372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Updating instance_info_cache with network_info: [{"id": "cd03578d-94c2-4cc7-879e-cd4a553d91c2", "address": "fa:16:3e:92:a5:4b", "network": {"id": "307b3828-939b-499c-a529-8f322b47754f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-877143294-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "614abbf6db5d4775a24243632248c89e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcd03578d-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120612) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:34:30.104612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Releasing lock "refresh_cache-f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" {{(pid=120612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:34:30.105533 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5a82ac76-4716-44f5-9286-e293e33018e8 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "POST /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9/action" status: 202 len: 0 microversion: 2.1 time: 3.939440 Oct 18 13:34:30.106153 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1910/4055] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:26 2022] POST /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9/action => generated 0 bytes in 3941 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:34:30.114965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2949a6f-b5c5-4eec-bcf2-fba7476fb04a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:30.127497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d2949a6f-b5c5-4eec-bcf2-fba7476fb04a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:30.152041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2949a6f-b5c5-4eec-bcf2-fba7476fb04a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.154317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2949a6f-b5c5-4eec-bcf2-fba7476fb04a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.162452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2949a6f-b5c5-4eec-bcf2-fba7476fb04a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.163663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2949a6f-b5c5-4eec-bcf2-fba7476fb04a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.165727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2949a6f-b5c5-4eec-bcf2-fba7476fb04a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.167220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2949a6f-b5c5-4eec-bcf2-fba7476fb04a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.173782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8916fc7da5847e38fb2e4b3b5bdf297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59efb35dab2a4e64924a27d6f255e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:30.176134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:30.193588 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b4fa8421-6c8b-44f1-a45f-3bbe98b2c083 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 200 len: 1303 microversion: 2.1 time: 0.281219 Oct 18 13:34:30.210071 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2146/4056] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:29 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 1303 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:30.210071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-335d2f45-7dd6-447b-948b-6130b7a04803 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:30.211091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-335d2f45-7dd6-447b-948b-6130b7a04803 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:30.232365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-335d2f45-7dd6-447b-948b-6130b7a04803 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.234005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-335d2f45-7dd6-447b-948b-6130b7a04803 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.234495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-335d2f45-7dd6-447b-948b-6130b7a04803 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.235164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-335d2f45-7dd6-447b-948b-6130b7a04803 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.235620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-335d2f45-7dd6-447b-948b-6130b7a04803 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.236045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-335d2f45-7dd6-447b-948b-6130b7a04803 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.266144 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d2949a6f-b5c5-4eec-bcf2-fba7476fb04a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155006 Oct 18 13:34:30.266753 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1911/4057] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:34:30 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:30.291423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-63e30d58-594f-419e-95e3-99ee4aef0e3d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:30.292314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-63e30d58-594f-419e-95e3-99ee4aef0e3d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:30.301609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63e30d58-594f-419e-95e3-99ee4aef0e3d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.302361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63e30d58-594f-419e-95e3-99ee4aef0e3d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.302971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63e30d58-594f-419e-95e3-99ee4aef0e3d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.304005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63e30d58-594f-419e-95e3-99ee4aef0e3d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.304634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63e30d58-594f-419e-95e3-99ee4aef0e3d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.305298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63e30d58-594f-419e-95e3-99ee4aef0e3d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.556395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-335d2f45-7dd6-447b-948b-6130b7a04803 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:30.568802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-335d2f45-7dd6-447b-948b-6130b7a04803 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:30.570275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-335d2f45-7dd6-447b-948b-6130b7a04803 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:30.577138 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-335d2f45-7dd6-447b-948b-6130b7a04803 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.380777 Oct 18 13:34:30.597324 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2147/4058] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:30 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:30.597324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.87"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:30.642235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-63e30d58-594f-419e-95e3-99ee4aef0e3d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:30.659296 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-63e30d58-594f-419e-95e3-99ee4aef0e3d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.390685 Oct 18 13:34:30.664144 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1912/4059] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:30 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:30.690896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c5f0110b-6d95-4038-8b62-8cc20ef4bc14 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:30.691961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c5f0110b-6d95-4038-8b62-8cc20ef4bc14 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:30.704919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5f0110b-6d95-4038-8b62-8cc20ef4bc14 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.708612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5f0110b-6d95-4038-8b62-8cc20ef4bc14 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.709278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5f0110b-6d95-4038-8b62-8cc20ef4bc14 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.710179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5f0110b-6d95-4038-8b62-8cc20ef4bc14 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.711259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5f0110b-6d95-4038-8b62-8cc20ef4bc14 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.712785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5f0110b-6d95-4038-8b62-8cc20ef4bc14 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.933828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:30.941939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.942669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.943711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:30.944795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:30.945524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:30.946096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.060157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c5f0110b-6d95-4038-8b62-8cc20ef4bc14 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:31.081705 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c5f0110b-6d95-4038-8b62-8cc20ef4bc14 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.396165 Oct 18 13:34:31.087611 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1913/4060] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:30 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:31.095073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d17e80a3-9ced-46cb-9de7-354c64b72b39 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:31.096727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d17e80a3-9ced-46cb-9de7-354c64b72b39 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:31.106767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d17e80a3-9ced-46cb-9de7-354c64b72b39 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.108485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d17e80a3-9ced-46cb-9de7-354c64b72b39 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.109369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d17e80a3-9ced-46cb-9de7-354c64b72b39 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.110281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d17e80a3-9ced-46cb-9de7-354c64b72b39 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.111040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d17e80a3-9ced-46cb-9de7-354c64b72b39 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.111688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d17e80a3-9ced-46cb-9de7-354c64b72b39 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.227146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d17e80a3-9ced-46cb-9de7-354c64b72b39 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:31.245266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d17e80a3-9ced-46cb-9de7-354c64b72b39 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:31.246865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d17e80a3-9ced-46cb-9de7-354c64b72b39 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:31.248108 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d17e80a3-9ced-46cb-9de7-354c64b72b39 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.158610 Oct 18 13:34:31.255460 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1914/4061] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:31 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:31.273255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2fbbb27b-d371-40b1-b2d3-7e0423fce905 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:31.273977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2fbbb27b-d371-40b1-b2d3-7e0423fce905 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:31.283085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fbbb27b-d371-40b1-b2d3-7e0423fce905 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.283897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fbbb27b-d371-40b1-b2d3-7e0423fce905 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.284495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fbbb27b-d371-40b1-b2d3-7e0423fce905 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.285831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fbbb27b-d371-40b1-b2d3-7e0423fce905 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.286438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fbbb27b-d371-40b1-b2d3-7e0423fce905 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.287005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fbbb27b-d371-40b1-b2d3-7e0423fce905 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.425209 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2fbbb27b-d371-40b1-b2d3-7e0423fce905 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action" status: 202 len: 0 microversion: 2.1 time: 0.168175 Oct 18 13:34:31.427014 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1915/4062] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:31 2022] POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:34:31.434175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e5b5d1f-979c-48d6-a58e-68c129afb71e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:31.436658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4e5b5d1f-979c-48d6-a58e-68c129afb71e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:31.448005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e5b5d1f-979c-48d6-a58e-68c129afb71e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.448728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e5b5d1f-979c-48d6-a58e-68c129afb71e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.450116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e5b5d1f-979c-48d6-a58e-68c129afb71e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.453570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e5b5d1f-979c-48d6-a58e-68c129afb71e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.455096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e5b5d1f-979c-48d6-a58e-68c129afb71e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.456040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e5b5d1f-979c-48d6-a58e-68c129afb71e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.475460 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-4e5b5d1f-979c-48d6-a58e-68c129afb71e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] HTTP exception thrown: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e5b5d1f-979c-48d6-a58e-68c129afb71e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Request method failure captured: Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 HTTP/1.1 Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsDbBW4n8JCHtRi0vzkJYelBSj_YO65Z-nMJqY_gchzIXau4JzQ_Ll5GAATjrNFCV9creVhvHtGqvmoG6klhza6bBsSCR4h8zhc1WcOYH-skXNXV2M-6jKg3nUT7o53fxRtvqXd6pibTbfBTevIqmBDCQLkh0swdU_mBXeqsVkesTQ Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 59efb35dab2a4e64924a27d6f255e8ab Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59efb35dab2a4e64924a27d6f255e8ab"}]}] Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 59efb35dab2a4e64924a27d6f255e8ab Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestMultiNic-1887316727-project Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e8916fc7da5847e38fb2e4b3b5bdf297 Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestMultiNic-1887316727-project Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'd4537a22-98b0-4f99-9a5b-ca02dc28c627'} Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:31.484979 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:31.494761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:31.494761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:31.494761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:31.494761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:31.494761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:31.494761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:31.494761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:31.494761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e5b5d1f-979c-48d6-a58e-68c129afb71e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Returning 404 to user: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:31.494761 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4e5b5d1f-979c-48d6-a58e-68c129afb71e tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 404 len: 111 microversion: 2.1 time: 0.050714 Oct 18 13:34:31.494761 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1916/4063] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:31 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:31.499180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1595bf1c-4fb3-4203-8935-03c506f8830e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:31.501853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1595bf1c-4fb3-4203-8935-03c506f8830e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:31.511166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1595bf1c-4fb3-4203-8935-03c506f8830e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.511885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1595bf1c-4fb3-4203-8935-03c506f8830e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.513108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1595bf1c-4fb3-4203-8935-03c506f8830e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.514514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1595bf1c-4fb3-4203-8935-03c506f8830e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.515200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1595bf1c-4fb3-4203-8935-03c506f8830e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.515946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1595bf1c-4fb3-4203-8935-03c506f8830e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.516723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "refresh_cache-f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 18 13:34:31.517141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquired lock "refresh_cache-f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 18 13:34:31.563837 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1595bf1c-4fb3-4203-8935-03c506f8830e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082552 Oct 18 13:34:31.569521 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1917/4064] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:34:31 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:31.577915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-25a55661-bd1e-425a-a523-bd9038ea9666 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:31.578776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-25a55661-bd1e-425a-a523-bd9038ea9666 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:31.588457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25a55661-bd1e-425a-a523-bd9038ea9666 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.589059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25a55661-bd1e-425a-a523-bd9038ea9666 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.589829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25a55661-bd1e-425a-a523-bd9038ea9666 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.591655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25a55661-bd1e-425a-a523-bd9038ea9666 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.592552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25a55661-bd1e-425a-a523-bd9038ea9666 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.593095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25a55661-bd1e-425a-a523-bd9038ea9666 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.853946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-25a55661-bd1e-425a-a523-bd9038ea9666 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:31.862101 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-25a55661-bd1e-425a-a523-bd9038ea9666 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1511 microversion: 2.1 time: 0.291065 Oct 18 13:34:31.874053 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1918/4065] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:31 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:31.883509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ce13656d-0b4e-48b5-9cb6-28faa3d860ed tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:31.884303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ce13656d-0b4e-48b5-9cb6-28faa3d860ed tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:31.891471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce13656d-0b4e-48b5-9cb6-28faa3d860ed tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.892145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce13656d-0b4e-48b5-9cb6-28faa3d860ed tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.892721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce13656d-0b4e-48b5-9cb6-28faa3d860ed tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:31.893594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce13656d-0b4e-48b5-9cb6-28faa3d860ed tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:31.894179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce13656d-0b4e-48b5-9cb6-28faa3d860ed tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:31.894729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce13656d-0b4e-48b5-9cb6-28faa3d860ed tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:32.278994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ce13656d-0b4e-48b5-9cb6-28faa3d860ed tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:32.293305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ce13656d-0b4e-48b5-9cb6-28faa3d860ed tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:32.299291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ce13656d-0b4e-48b5-9cb6-28faa3d860ed tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:32.303667 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ce13656d-0b4e-48b5-9cb6-28faa3d860ed tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1740 microversion: 2.20 time: 0.428304 Oct 18 13:34:32.305611 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1919/4066] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:31 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1740 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:32.321099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-0f770f7c-2b8e-410f-8bb2-197e2903b1d7 req-6dd8d47e-f54f-4b11-97d5-a35bdc0aaf23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f75005a7-f4b9-46a1-bdb9-98d795d0c0a9", "tag": "cd03578d-94c2-4cc7-879e-cd4a553d91c2"}, {"server_uuid": "d4537a22-98b0-4f99-9a5b-ca02dc28c627", "name": "network-vif-deleted", "tag": "a83b44ca-e022-456b-87fc-bd33986aee6f"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:32.346284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0f770f7c-2b8e-410f-8bb2-197e2903b1d7 req-6dd8d47e-f54f-4b11-97d5-a35bdc0aaf23 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:32.347066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0f770f7c-2b8e-410f-8bb2-197e2903b1d7 req-6dd8d47e-f54f-4b11-97d5-a35bdc0aaf23 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:32.349360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0f770f7c-2b8e-410f-8bb2-197e2903b1d7 req-6dd8d47e-f54f-4b11-97d5-a35bdc0aaf23 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:32.383837 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0f770f7c-2b8e-410f-8bb2-197e2903b1d7 req-6dd8d47e-f54f-4b11-97d5-a35bdc0aaf23 service nova] Creating event network-changed:cd03578d-94c2-4cc7-879e-cd4a553d91c2 for instance f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 on n-h1-858384-13 Oct 18 13:34:32.388689 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0f770f7c-2b8e-410f-8bb2-197e2903b1d7 req-6dd8d47e-f54f-4b11-97d5-a35bdc0aaf23 service nova] Creating event network-vif-deleted:a83b44ca-e022-456b-87fc-bd33986aee6f for instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 on n-h1-858384-13 Oct 18 13:34:32.410891 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-0f770f7c-2b8e-410f-8bb2-197e2903b1d7 req-6dd8d47e-f54f-4b11-97d5-a35bdc0aaf23 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.098861 Oct 18 13:34:32.412149 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1920/4067] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:32.425425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c066dcf-0302-4d77-bbef-303211f6e1e9 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:32.426330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2c066dcf-0302-4d77-bbef-303211f6e1e9 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:32.434052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c066dcf-0302-4d77-bbef-303211f6e1e9 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:32.434821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c066dcf-0302-4d77-bbef-303211f6e1e9 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:32.435750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c066dcf-0302-4d77-bbef-303211f6e1e9 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:32.437539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c066dcf-0302-4d77-bbef-303211f6e1e9 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:32.438212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c066dcf-0302-4d77-bbef-303211f6e1e9 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:32.439412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c066dcf-0302-4d77-bbef-303211f6e1e9 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:32.823786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Building network info cache for instance {{(pid=120611) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 18 13:34:33.170298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2c066dcf-0302-4d77-bbef-303211f6e1e9 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:33.180076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2c066dcf-0302-4d77-bbef-303211f6e1e9 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:33.194608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2c066dcf-0302-4d77-bbef-303211f6e1e9 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:33.196918 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2c066dcf-0302-4d77-bbef-303211f6e1e9 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.781668 Oct 18 13:34:33.200374 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1921/4068] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:32 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:33.208122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-489deda8-0e86-4d37-bafc-3438bc44ab89 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:33.215263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-489deda8-0e86-4d37-bafc-3438bc44ab89 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:33.236294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-489deda8-0e86-4d37-bafc-3438bc44ab89 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:33.237221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-489deda8-0e86-4d37-bafc-3438bc44ab89 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:33.237221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-489deda8-0e86-4d37-bafc-3438bc44ab89 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:33.237923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-489deda8-0e86-4d37-bafc-3438bc44ab89 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:33.238373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-489deda8-0e86-4d37-bafc-3438bc44ab89 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:33.238793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-489deda8-0e86-4d37-bafc-3438bc44ab89 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:33.322883 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-489deda8-0e86-4d37-bafc-3438bc44ab89 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120243 Oct 18 13:34:33.333612 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1922/4069] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:34:33 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:33.338481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0fae018-fc82-4f90-8d18-538e95421580 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:33.339092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c0fae018-fc82-4f90-8d18-538e95421580 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:33.348720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fae018-fc82-4f90-8d18-538e95421580 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:33.357647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fae018-fc82-4f90-8d18-538e95421580 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:33.358231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fae018-fc82-4f90-8d18-538e95421580 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:33.359000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fae018-fc82-4f90-8d18-538e95421580 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:33.359470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fae018-fc82-4f90-8d18-538e95421580 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:33.360327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fae018-fc82-4f90-8d18-538e95421580 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:34.027274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Updating instance_info_cache with network_info: [{"id": "cd03578d-94c2-4cc7-879e-cd4a553d91c2", "address": "fa:16:3e:92:a5:4b", "network": {"id": "307b3828-939b-499c-a529-8f322b47754f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-877143294-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "614abbf6db5d4775a24243632248c89e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcd03578d-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120611) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 18 13:34:34.047833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Releasing lock "refresh_cache-f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" {{(pid=120611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 18 13:34:34.048717 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5c8a7193-2f32-4659-9d8f-fb11c32274bb tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "POST /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9/action" status: 202 len: 0 microversion: 2.1 time: 3.463859 Oct 18 13:34:34.051938 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2148/4070] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:30 2022] POST /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9/action => generated 0 bytes in 3468 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 18 13:34:34.072106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ec44ef24-1e6d-4efa-a75b-b877c12eceea req-13e2bf25-b7e6-47ad-bc7a-fbb6e470a092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f75005a7-f4b9-46a1-bdb9-98d795d0c0a9", "tag": "cd03578d-94c2-4cc7-879e-cd4a553d91c2"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:34.130666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ec44ef24-1e6d-4efa-a75b-b877c12eceea req-13e2bf25-b7e6-47ad-bc7a-fbb6e470a092 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:34.131384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ec44ef24-1e6d-4efa-a75b-b877c12eceea req-13e2bf25-b7e6-47ad-bc7a-fbb6e470a092 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:34.131964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ec44ef24-1e6d-4efa-a75b-b877c12eceea req-13e2bf25-b7e6-47ad-bc7a-fbb6e470a092 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:34.159698 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ec44ef24-1e6d-4efa-a75b-b877c12eceea req-13e2bf25-b7e6-47ad-bc7a-fbb6e470a092 service nova] Creating event network-changed:cd03578d-94c2-4cc7-879e-cd4a553d91c2 for instance f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 on n-h1-858384-13 Oct 18 13:34:34.172275 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ec44ef24-1e6d-4efa-a75b-b877c12eceea req-13e2bf25-b7e6-47ad-bc7a-fbb6e470a092 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118203 Oct 18 13:34:34.173479 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2149/4071] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:34.186522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-72a586b1-872c-49e9-8c73-34e43942fb81 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:34.190486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-72a586b1-872c-49e9-8c73-34e43942fb81 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:34.206199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72a586b1-872c-49e9-8c73-34e43942fb81 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:34.206837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72a586b1-872c-49e9-8c73-34e43942fb81 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:34.207520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72a586b1-872c-49e9-8c73-34e43942fb81 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:34.211339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72a586b1-872c-49e9-8c73-34e43942fb81 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:34.212059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72a586b1-872c-49e9-8c73-34e43942fb81 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:34.213158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72a586b1-872c-49e9-8c73-34e43942fb81 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:34.412344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-72a586b1-872c-49e9-8c73-34e43942fb81 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:34.430213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-72a586b1-872c-49e9-8c73-34e43942fb81 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:34.433893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-72a586b1-872c-49e9-8c73-34e43942fb81 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:34.437055 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-72a586b1-872c-49e9-8c73-34e43942fb81 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1722 microversion: 2.20 time: 0.259477 Oct 18 13:34:34.439925 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2150/4072] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:34 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:34.450953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5d40f147-8067-442b-b152-7f002a5d89fa tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '.version_select at 0x7ff60f0af700>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:35.605426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c0fae018-fc82-4f90-8d18-538e95421580 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:35.625898 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c0fae018-fc82-4f90-8d18-538e95421580 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1491 microversion: 2.1 time: 2.288190 Oct 18 13:34:35.628174 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1923/4073] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:33 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1491 bytes in 2294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:35.645893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0a91e72c-7b45-4e83-8665-1266d3e89d24 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:35.646572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0a91e72c-7b45-4e83-8665-1266d3e89d24 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:35.658581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a91e72c-7b45-4e83-8665-1266d3e89d24 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:35.663188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a91e72c-7b45-4e83-8665-1266d3e89d24 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:35.663841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a91e72c-7b45-4e83-8665-1266d3e89d24 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:35.665783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a91e72c-7b45-4e83-8665-1266d3e89d24 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:35.667232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a91e72c-7b45-4e83-8665-1266d3e89d24 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:35.669967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a91e72c-7b45-4e83-8665-1266d3e89d24 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:35.801233 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5d40f147-8067-442b-b152-7f002a5d89fa tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/9a9b0502-f56e-4f4a-8a83-5d51c3a054fb" status: 202 len: 0 microversion: 2.1 time: 1.359945 Oct 18 13:34:35.808095 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2151/4074] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:34:34 2022] DELETE /compute/v2.1/os-floating-ips/9a9b0502-f56e-4f4a-8a83-5d51c3a054fb => generated 0 bytes in 1367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:34:35.815582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ffdd366e-e660-4d58-8f48-0eab7b0c393c tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:35.819466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ffdd366e-e660-4d58-8f48-0eab7b0c393c tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:35.844373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffdd366e-e660-4d58-8f48-0eab7b0c393c tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:35.844830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffdd366e-e660-4d58-8f48-0eab7b0c393c tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:35.845318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffdd366e-e660-4d58-8f48-0eab7b0c393c tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:35.846054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffdd366e-e660-4d58-8f48-0eab7b0c393c tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:35.853010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffdd366e-e660-4d58-8f48-0eab7b0c393c tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:35.853939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffdd366e-e660-4d58-8f48-0eab7b0c393c tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:35.934129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0a91e72c-7b45-4e83-8665-1266d3e89d24 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:35.938472 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ffdd366e-e660-4d58-8f48-0eab7b0c393c tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128933 Oct 18 13:34:35.939254 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2152/4075] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:34:35 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:35.948591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c9e39c1-adbb-4f58-b7e4-9e3613437ff0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:35.955988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4c9e39c1-adbb-4f58-b7e4-9e3613437ff0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:35.959325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0a91e72c-7b45-4e83-8665-1266d3e89d24 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:35.961850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0a91e72c-7b45-4e83-8665-1266d3e89d24 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:35.963286 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0a91e72c-7b45-4e83-8665-1266d3e89d24 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.332131 Oct 18 13:34:35.964955 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1924/4076] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:35 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:35.970147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c9e39c1-adbb-4f58-b7e4-9e3613437ff0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:35.972528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c9e39c1-adbb-4f58-b7e4-9e3613437ff0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:35.974477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c9e39c1-adbb-4f58-b7e4-9e3613437ff0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:35.976706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c9e39c1-adbb-4f58-b7e4-9e3613437ff0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:35.977386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c9e39c1-adbb-4f58-b7e4-9e3613437ff0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:35.979653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-156c300f-9c48-4484-a809-a94eb91d5c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:35.980004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c9e39c1-adbb-4f58-b7e4-9e3613437ff0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:35.986418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-156c300f-9c48-4484-a809-a94eb91d5c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:36.003447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-156c300f-9c48-4484-a809-a94eb91d5c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:36.004257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-156c300f-9c48-4484-a809-a94eb91d5c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:36.008100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-156c300f-9c48-4484-a809-a94eb91d5c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:36.010830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-156c300f-9c48-4484-a809-a94eb91d5c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:36.011531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-156c300f-9c48-4484-a809-a94eb91d5c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:36.012283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-156c300f-9c48-4484-a809-a94eb91d5c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:36.054065 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-156c300f-9c48-4484-a809-a94eb91d5c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Cannot 'pause' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state paused Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-156c300f-9c48-4484-a809-a94eb91d5c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action HTTP/1.1 Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 13 Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: {"pause": {}} Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: exception: Cannot 'pause' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state paused Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '6bce6f6b-df28-4c34-a17f-4f18eb67d401', 'body': {'pause': {}}} Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 in vm_state paused. Cannot pause while the instance is in this state. Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state paused Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:36.058215 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:36.063378 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:36.063378 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:36.063378 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:36.063378 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state paused Oct 18 13:34:36.063378 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:36.065471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-156c300f-9c48-4484-a809-a94eb91d5c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 409 to user: Cannot 'pause' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state paused {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:36.067220 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-156c300f-9c48-4484-a809-a94eb91d5c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action" status: 409 len: 143 microversion: 2.1 time: 0.100904 Oct 18 13:34:36.068924 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1925/4077] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:35 2022] POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action => generated 143 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:34:36.076867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2534963a-8ef4-4205-a56d-026fc11c3f53 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '.version_select at 0x7ff60f79fdc0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:36.287465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c9e39c1-adbb-4f58-b7e4-9e3613437ff0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:36.301267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c9e39c1-adbb-4f58-b7e4-9e3613437ff0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:36.306275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c9e39c1-adbb-4f58-b7e4-9e3613437ff0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:36.307529 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4c9e39c1-adbb-4f58-b7e4-9e3613437ff0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1722 microversion: 2.20 time: 0.362784 Oct 18 13:34:36.308112 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2153/4078] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:35 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:36.329084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-89466c91-eed3-479b-b350-87ab409c913e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:36.335287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-89466c91-eed3-479b-b350-87ab409c913e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:36.350016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89466c91-eed3-479b-b350-87ab409c913e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:36.350443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89466c91-eed3-479b-b350-87ab409c913e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:36.350887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89466c91-eed3-479b-b350-87ab409c913e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:36.351604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89466c91-eed3-479b-b350-87ab409c913e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:36.352062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89466c91-eed3-479b-b350-87ab409c913e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:36.352496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89466c91-eed3-479b-b350-87ab409c913e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:36.506485 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-89466c91-eed3-479b-b350-87ab409c913e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action" status: 202 len: 0 microversion: 2.1 time: 0.196944 Oct 18 13:34:36.510115 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2154/4079] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:36 2022] POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:34:36.532586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7643648e-c56f-457d-a1a0-3cfb6bbc1c62 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:36.535485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7643648e-c56f-457d-a1a0-3cfb6bbc1c62 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:36.551766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7643648e-c56f-457d-a1a0-3cfb6bbc1c62 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:36.553483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7643648e-c56f-457d-a1a0-3cfb6bbc1c62 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:36.555249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7643648e-c56f-457d-a1a0-3cfb6bbc1c62 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:36.556840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7643648e-c56f-457d-a1a0-3cfb6bbc1c62 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:36.560880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7643648e-c56f-457d-a1a0-3cfb6bbc1c62 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:36.561413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7643648e-c56f-457d-a1a0-3cfb6bbc1c62 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:36.884056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7643648e-c56f-457d-a1a0-3cfb6bbc1c62 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:36.896955 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7643648e-c56f-457d-a1a0-3cfb6bbc1c62 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1498 microversion: 2.1 time: 0.376651 Oct 18 13:34:36.918552 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2155/4080] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:36 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1498 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:36.926172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-33357ffa-8569-4a25-b880-7fbc58cdada8 req-7c6e4401-be25-4cf3-b2c3-db5831344d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa292c2-3801-4d84-b31a-4d3eeeb41818", "name": "network-vif-unplugged", "status": "completed", "tag": "8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:36.948985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-33357ffa-8569-4a25-b880-7fbc58cdada8 req-7c6e4401-be25-4cf3-b2c3-db5831344d2c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:36.952720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-33357ffa-8569-4a25-b880-7fbc58cdada8 req-7c6e4401-be25-4cf3-b2c3-db5831344d2c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:36.953168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-33357ffa-8569-4a25-b880-7fbc58cdada8 req-7c6e4401-be25-4cf3-b2c3-db5831344d2c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:36.973933 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-33357ffa-8569-4a25-b880-7fbc58cdada8 req-7c6e4401-be25-4cf3-b2c3-db5831344d2c service nova] Creating event network-vif-unplugged:8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa for instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 on n-h2-858384-13 Oct 18 13:34:36.998735 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-33357ffa-8569-4a25-b880-7fbc58cdada8 req-7c6e4401-be25-4cf3-b2c3-db5831344d2c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059047 Oct 18 13:34:37.000070 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2156/4081] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:37.006556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-634b8bd4-42a1-4a52-a615-b39a2de81ccf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:37.009731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-634b8bd4-42a1-4a52-a615-b39a2de81ccf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:37.017989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-634b8bd4-42a1-4a52-a615-b39a2de81ccf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.018654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-634b8bd4-42a1-4a52-a615-b39a2de81ccf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.019257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-634b8bd4-42a1-4a52-a615-b39a2de81ccf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.021059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-634b8bd4-42a1-4a52-a615-b39a2de81ccf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.022326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-634b8bd4-42a1-4a52-a615-b39a2de81ccf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.022909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-634b8bd4-42a1-4a52-a615-b39a2de81ccf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.063429 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-634b8bd4-42a1-4a52-a615-b39a2de81ccf tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061893 Oct 18 13:34:37.065303 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2157/4082] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:34:37 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:37.070933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c4f47b19-e9a6-454d-bed5-97959d908de8 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:37.071736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c4f47b19-e9a6-454d-bed5-97959d908de8 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:37.079708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f47b19-e9a6-454d-bed5-97959d908de8 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.080365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f47b19-e9a6-454d-bed5-97959d908de8 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.080943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f47b19-e9a6-454d-bed5-97959d908de8 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.081830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f47b19-e9a6-454d-bed5-97959d908de8 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.082999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f47b19-e9a6-454d-bed5-97959d908de8 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.083700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4f47b19-e9a6-454d-bed5-97959d908de8 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.195916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c4f47b19-e9a6-454d-bed5-97959d908de8 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:37.206230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c4f47b19-e9a6-454d-bed5-97959d908de8 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:37.207903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c4f47b19-e9a6-454d-bed5-97959d908de8 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:37.209298 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c4f47b19-e9a6-454d-bed5-97959d908de8 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.142897 Oct 18 13:34:37.210360 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2158/4083] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:37 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:37.337387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c33ed760-4c24-4872-b1ea-ba2a1fe69d7c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:37.338858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c33ed760-4c24-4872-b1ea-ba2a1fe69d7c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:37.349002 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2534963a-8ef4-4205-a56d-026fc11c3f53 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/ec394bba-d6ed-4c25-bbc0-2f34fc1b8062" status: 202 len: 0 microversion: 2.1 time: 1.278684 Oct 18 13:34:37.350489 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1926/4084] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:34:36 2022] DELETE /compute/v2.1/os-security-groups/ec394bba-d6ed-4c25-bbc0-2f34fc1b8062 => generated 0 bytes in 1281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:34:37.359525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-754380f4-0e6f-4e72-b7b4-d5281590f930 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:37.360463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-754380f4-0e6f-4e72-b7b4-d5281590f930 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:37.370984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c33ed760-4c24-4872-b1ea-ba2a1fe69d7c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.375930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c33ed760-4c24-4872-b1ea-ba2a1fe69d7c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.376980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c33ed760-4c24-4872-b1ea-ba2a1fe69d7c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.377890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c33ed760-4c24-4872-b1ea-ba2a1fe69d7c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.380972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c33ed760-4c24-4872-b1ea-ba2a1fe69d7c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.387163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c33ed760-4c24-4872-b1ea-ba2a1fe69d7c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.391231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-754380f4-0e6f-4e72-b7b4-d5281590f930 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.395479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-754380f4-0e6f-4e72-b7b4-d5281590f930 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.408952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-754380f4-0e6f-4e72-b7b4-d5281590f930 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.410429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-754380f4-0e6f-4e72-b7b4-d5281590f930 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.426225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-754380f4-0e6f-4e72-b7b4-d5281590f930 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.427825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-754380f4-0e6f-4e72-b7b4-d5281590f930 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.473833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-754380f4-0e6f-4e72-b7b4-d5281590f930 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:34:37.480067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:37.646653 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-754380f4-0e6f-4e72-b7b4-d5281590f930 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 204 len: 0 microversion: 2.1 time: 0.289522 Oct 18 13:34:37.650401 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1927/4085] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:34:37 2022] DELETE /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:34:37.664233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-25e61bd8-3177-4235-8e20-92872385a9b0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:37.668888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c33ed760-4c24-4872-b1ea-ba2a1fe69d7c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:37.679503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-25e61bd8-3177-4235-8e20-92872385a9b0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:37.680635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c33ed760-4c24-4872-b1ea-ba2a1fe69d7c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:37.682394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c33ed760-4c24-4872-b1ea-ba2a1fe69d7c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:37.684095 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c33ed760-4c24-4872-b1ea-ba2a1fe69d7c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1722 microversion: 2.20 time: 0.351809 Oct 18 13:34:37.685272 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2159/4086] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:37 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:37.689079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25e61bd8-3177-4235-8e20-92872385a9b0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.689892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25e61bd8-3177-4235-8e20-92872385a9b0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.690513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25e61bd8-3177-4235-8e20-92872385a9b0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.691990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25e61bd8-3177-4235-8e20-92872385a9b0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.692438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25e61bd8-3177-4235-8e20-92872385a9b0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.693011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-25e61bd8-3177-4235-8e20-92872385a9b0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.802053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04961072-3902-4b2f-a95e-d389d06c00d3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:37.802808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04961072-3902-4b2f-a95e-d389d06c00d3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:37.820223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04961072-3902-4b2f-a95e-d389d06c00d3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.823013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04961072-3902-4b2f-a95e-d389d06c00d3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.823480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04961072-3902-4b2f-a95e-d389d06c00d3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.824235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04961072-3902-4b2f-a95e-d389d06c00d3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.824702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04961072-3902-4b2f-a95e-d389d06c00d3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.825128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04961072-3902-4b2f-a95e-d389d06c00d3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.843465 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-04961072-3902-4b2f-a95e-d389d06c00d3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] HTTP exception thrown: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04961072-3902-4b2f-a95e-d389d06c00d3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Request method failure captured: Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 HTTP/1.1 Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsDbBW4n8JCHtRi0vzkJYelBSj_YO65Z-nMJqY_gchzIXau4JzQ_Ll5GAATjrNFCV9creVhvHtGqvmoG6klhza6bBsSCR4h8zhc1WcOYH-skXNXV2M-6jKg3nUT7o53fxRtvqXd6pibTbfBTevIqmBDCQLkh0swdU_mBXeqsVkesTQ Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 59efb35dab2a4e64924a27d6f255e8ab Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59efb35dab2a4e64924a27d6f255e8ab"}]}] Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 59efb35dab2a4e64924a27d6f255e8ab Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersTestMultiNic-1887316727-project Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e8916fc7da5847e38fb2e4b3b5bdf297 Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersTestMultiNic-1887316727-project Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'd4537a22-98b0-4f99-9a5b-ca02dc28c627'} Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:37.845363 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04961072-3902-4b2f-a95e-d389d06c00d3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Returning 404 to user: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04961072-3902-4b2f-a95e-d389d06c00d3 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 404 len: 111 microversion: 2.1 time: 0.049900 Oct 18 13:34:37.849194 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2160/4087] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:34:37 2022] DELETE /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:34:37.860163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8dd1e4ab-9f59-4064-be68-df0b5393e9d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:37.860803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8dd1e4ab-9f59-4064-be68-df0b5393e9d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: d4537a22-98b0-4f99-9a5b-ca02dc28c627] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:37.874549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8dd1e4ab-9f59-4064-be68-df0b5393e9d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.875037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8dd1e4ab-9f59-4064-be68-df0b5393e9d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.875468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8dd1e4ab-9f59-4064-be68-df0b5393e9d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.876171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8dd1e4ab-9f59-4064-be68-df0b5393e9d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.876651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8dd1e4ab-9f59-4064-be68-df0b5393e9d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.877074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8dd1e4ab-9f59-4064-be68-df0b5393e9d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.895347 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-8dd1e4ab-9f59-4064-be68-df0b5393e9d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] HTTP exception thrown: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8dd1e4ab-9f59-4064-be68-df0b5393e9d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Request method failure captured: Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 HTTP/1.1 Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsDbBW4n8JCHtRi0vzkJYelBSj_YO65Z-nMJqY_gchzIXau4JzQ_Ll5GAATjrNFCV9creVhvHtGqvmoG6klhza6bBsSCR4h8zhc1WcOYH-skXNXV2M-6jKg3nUT7o53fxRtvqXd6pibTbfBTevIqmBDCQLkh0swdU_mBXeqsVkesTQ Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 59efb35dab2a4e64924a27d6f255e8ab Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59efb35dab2a4e64924a27d6f255e8ab"}]}] Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 59efb35dab2a4e64924a27d6f255e8ab Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersTestMultiNic-1887316727-project Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e8916fc7da5847e38fb2e4b3b5bdf297 Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersTestMultiNic-1887316727-project Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'd4537a22-98b0-4f99-9a5b-ca02dc28c627'} Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:37.897884 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.901089 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:37.901089 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:37.901089 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:37.901089 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:37.901089 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:37.901089 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. Oct 18 13:34:37.901089 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.903218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8dd1e4ab-9f59-4064-be68-df0b5393e9d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Returning 404 to user: Instance d4537a22-98b0-4f99-9a5b-ca02dc28c627 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:37.904370 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8dd1e4ab-9f59-4064-be68-df0b5393e9d6 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627" status: 404 len: 111 microversion: 2.1 time: 0.050820 Oct 18 13:34:37.905635 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2161/4088] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:37 2022] GET /compute/v2.1/servers/d4537a22-98b0-4f99-9a5b-ca02dc28c627 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:37.913432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f8116508-19b0-4828-95a7-b2d8268fd086 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:37.914086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f8116508-19b0-4828-95a7-b2d8268fd086 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:37.921559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8116508-19b0-4828-95a7-b2d8268fd086 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.922204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8116508-19b0-4828-95a7-b2d8268fd086 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.922753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8116508-19b0-4828-95a7-b2d8268fd086 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.923579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8116508-19b0-4828-95a7-b2d8268fd086 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.924195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8116508-19b0-4828-95a7-b2d8268fd086 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.924705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8116508-19b0-4828-95a7-b2d8268fd086 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.942993 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-f8116508-19b0-4828-95a7-b2d8268fd086 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] HTTP exception thrown: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f8116508-19b0-4828-95a7-b2d8268fd086 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Request method failure captured: Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 HTTP/1.1 Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsDbBW4n8JCHtRi0vzkJYelBSj_YO65Z-nMJqY_gchzIXau4JzQ_Ll5GAATjrNFCV9creVhvHtGqvmoG6klhza6bBsSCR4h8zhc1WcOYH-skXNXV2M-6jKg3nUT7o53fxRtvqXd6pibTbfBTevIqmBDCQLkh0swdU_mBXeqsVkesTQ Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 59efb35dab2a4e64924a27d6f255e8ab Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59efb35dab2a4e64924a27d6f255e8ab"}]}] Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 59efb35dab2a4e64924a27d6f255e8ab Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersTestMultiNic-1887316727-project Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e8916fc7da5847e38fb2e4b3b5bdf297 Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersTestMultiNic-1887316727-project Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '4454e71a-3edc-4cc4-8a35-2a148257f003'} Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:37.944967 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:37.948345 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:34:37.948345 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.948345 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:37.948345 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.948345 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:37.948345 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:37.948345 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:37.948345 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:37.948345 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:37.948345 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:34:37.948345 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:37.948345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f8116508-19b0-4828-95a7-b2d8268fd086 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Returning 404 to user: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:37.948982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-25e61bd8-3177-4235-8e20-92872385a9b0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:37.949147 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f8116508-19b0-4828-95a7-b2d8268fd086 tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 404 len: 111 microversion: 2.1 time: 0.036948 Oct 18 13:34:37.949147 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2162/4089] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:34:37 2022] DELETE /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:37.956718 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-25e61bd8-3177-4235-8e20-92872385a9b0 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1508 microversion: 2.1 time: 0.304650 Oct 18 13:34:37.957483 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1928/4090] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:37 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1508 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:37.957594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4bf3ff4d-7197-4535-b970-4f7478a7ff04 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:37.958543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4bf3ff4d-7197-4535-b970-4f7478a7ff04 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:37.966812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bf3ff4d-7197-4535-b970-4f7478a7ff04 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.967416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bf3ff4d-7197-4535-b970-4f7478a7ff04 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.967962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bf3ff4d-7197-4535-b970-4f7478a7ff04 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.968941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bf3ff4d-7197-4535-b970-4f7478a7ff04 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.969540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bf3ff4d-7197-4535-b970-4f7478a7ff04 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.970071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bf3ff4d-7197-4535-b970-4f7478a7ff04 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.974954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-65dabc07-1172-4970-b396-1480a8a8003d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:37.975955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-65dabc07-1172-4970-b396-1480a8a8003d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] [instance: 4454e71a-3edc-4cc4-8a35-2a148257f003] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:37.983896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65dabc07-1172-4970-b396-1480a8a8003d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.984544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65dabc07-1172-4970-b396-1480a8a8003d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.985283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65dabc07-1172-4970-b396-1480a8a8003d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:37.986327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65dabc07-1172-4970-b396-1480a8a8003d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:37.986886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65dabc07-1172-4970-b396-1480a8a8003d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:37.987405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65dabc07-1172-4970-b396-1480a8a8003d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.003339 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-65dabc07-1172-4970-b396-1480a8a8003d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] HTTP exception thrown: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-65dabc07-1172-4970-b396-1480a8a8003d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Request method failure captured: Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 HTTP/1.1 Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsDbBW4n8JCHtRi0vzkJYelBSj_YO65Z-nMJqY_gchzIXau4JzQ_Ll5GAATjrNFCV9creVhvHtGqvmoG6klhza6bBsSCR4h8zhc1WcOYH-skXNXV2M-6jKg3nUT7o53fxRtvqXd6pibTbfBTevIqmBDCQLkh0swdU_mBXeqsVkesTQ Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 59efb35dab2a4e64924a27d6f255e8ab Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59efb35dab2a4e64924a27d6f255e8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59efb35dab2a4e64924a27d6f255e8ab"}]}] Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 59efb35dab2a4e64924a27d6f255e8ab Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestMultiNic-1887316727 Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestMultiNic-1887316727-project Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e8916fc7da5847e38fb2e4b3b5bdf297 Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestMultiNic-1887316727-project Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '4454e71a-3edc-4cc4-8a35-2a148257f003'} Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:38.005004 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:38.008904 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:38.008904 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:38.008904 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:38.008904 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:38.008904 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:38.008904 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. Oct 18 13:34:38.008904 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:38.008904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-65dabc07-1172-4970-b396-1480a8a8003d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] Returning 404 to user: Instance 4454e71a-3edc-4cc4-8a35-2a148257f003 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:38.008904 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-65dabc07-1172-4970-b396-1480a8a8003d tempest-ServersTestMultiNic-1887316727 tempest-ServersTestMultiNic-1887316727-project] 10.222.0.40 "GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003" status: 404 len: 111 microversion: 2.1 time: 0.044238 Oct 18 13:34:38.008904 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1929/4091] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:37 2022] GET /compute/v2.1/servers/4454e71a-3edc-4cc4-8a35-2a148257f003 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:38.078143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9fce1a61-9fc0-470f-ba09-2c1fa4a660e3 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:38.081072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9fce1a61-9fc0-470f-ba09-2c1fa4a660e3 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:38.087378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fce1a61-9fc0-470f-ba09-2c1fa4a660e3 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.087894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fce1a61-9fc0-470f-ba09-2c1fa4a660e3 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.088330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fce1a61-9fc0-470f-ba09-2c1fa4a660e3 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.089505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fce1a61-9fc0-470f-ba09-2c1fa4a660e3 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.089962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fce1a61-9fc0-470f-ba09-2c1fa4a660e3 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.090553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fce1a61-9fc0-470f-ba09-2c1fa4a660e3 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.128153 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9fce1a61-9fc0-470f-ba09-2c1fa4a660e3 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055245 Oct 18 13:34:38.128651 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1930/4092] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:34:38 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:34:38.236827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4bf3ff4d-7197-4535-b970-4f7478a7ff04 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:38.246116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-64e97455-a23a-4021-93fb-8561c92473dd tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:38.247371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-64e97455-a23a-4021-93fb-8561c92473dd tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:38.248008 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4bf3ff4d-7197-4535-b970-4f7478a7ff04 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.299524 Oct 18 13:34:38.261285 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2163/4093] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:37 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:38.261541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64e97455-a23a-4021-93fb-8561c92473dd tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.261541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64e97455-a23a-4021-93fb-8561c92473dd tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.261541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64e97455-a23a-4021-93fb-8561c92473dd tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.261541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64e97455-a23a-4021-93fb-8561c92473dd tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.261541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64e97455-a23a-4021-93fb-8561c92473dd tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.261541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64e97455-a23a-4021-93fb-8561c92473dd tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.274588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-39bc9df3-d35d-4aa7-997a-0d447bd06d26 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:38.275292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-39bc9df3-d35d-4aa7-997a-0d447bd06d26 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:38.282165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39bc9df3-d35d-4aa7-997a-0d447bd06d26 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.282678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39bc9df3-d35d-4aa7-997a-0d447bd06d26 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.283178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39bc9df3-d35d-4aa7-997a-0d447bd06d26 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.283941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39bc9df3-d35d-4aa7-997a-0d447bd06d26 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.284475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39bc9df3-d35d-4aa7-997a-0d447bd06d26 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.284960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39bc9df3-d35d-4aa7-997a-0d447bd06d26 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.341162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-64e97455-a23a-4021-93fb-8561c92473dd tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:38.353402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-64e97455-a23a-4021-93fb-8561c92473dd tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:38.355138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-64e97455-a23a-4021-93fb-8561c92473dd tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:38.356408 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-64e97455-a23a-4021-93fb-8561c92473dd tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.118357 Oct 18 13:34:38.357160 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1931/4094] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:38 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:38.525390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-39bc9df3-d35d-4aa7-997a-0d447bd06d26 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:38.538978 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-39bc9df3-d35d-4aa7-997a-0d447bd06d26 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.267859 Oct 18 13:34:38.540114 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2164/4095] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:38 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:38.571691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bfad2a66-6ab9-4b40-a852-36a48b3f32fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:38.574341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bfad2a66-6ab9-4b40-a852-36a48b3f32fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:38.588934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfad2a66-6ab9-4b40-a852-36a48b3f32fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.594474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfad2a66-6ab9-4b40-a852-36a48b3f32fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.595092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfad2a66-6ab9-4b40-a852-36a48b3f32fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.596059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfad2a66-6ab9-4b40-a852-36a48b3f32fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.596805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfad2a66-6ab9-4b40-a852-36a48b3f32fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.597338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bfad2a66-6ab9-4b40-a852-36a48b3f32fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.613928 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-bfad2a66-6ab9-4b40-a852-36a48b3f32fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bfad2a66-6ab9-4b40-a852-36a48b3f32fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9/action HTTP/1.1 Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 28 Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: {"reboot": {"type": "SOFT"}} Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '18dcc6bf-fc63-4063-93f6-d8f7b158aef9', 'body': {'reboot': {'type': 'SOFT'}}} Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:38.615712 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:38.619834 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:34:38.619834 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:38.619834 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:38.619834 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:38.619834 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:38.619834 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:38.619834 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:38.619834 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:38.619834 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:38.619834 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:34:38.619834 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:38.619834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bfad2a66-6ab9-4b40-a852-36a48b3f32fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:38.620598 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bfad2a66-6ab9-4b40-a852-36a48b3f32fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9/action" status: 404 len: 111 microversion: 2.1 time: 0.060905 Oct 18 13:34:38.630475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9a64adde-0c05-4b1c-a76a-c567b97b77a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:38.631188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9a64adde-0c05-4b1c-a76a-c567b97b77a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:38.635613 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1932/4096] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:38 2022] POST /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:38.638208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a64adde-0c05-4b1c-a76a-c567b97b77a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.638768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a64adde-0c05-4b1c-a76a-c567b97b77a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.639393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a64adde-0c05-4b1c-a76a-c567b97b77a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.640283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a64adde-0c05-4b1c-a76a-c567b97b77a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.640747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a64adde-0c05-4b1c-a76a-c567b97b77a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.641207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a64adde-0c05-4b1c-a76a-c567b97b77a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.716250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42e77bd6-2242-4a32-9ef9-63ce77ae5e11 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:38.717384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-42e77bd6-2242-4a32-9ef9-63ce77ae5e11 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:38.725712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42e77bd6-2242-4a32-9ef9-63ce77ae5e11 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.726168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42e77bd6-2242-4a32-9ef9-63ce77ae5e11 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.726609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42e77bd6-2242-4a32-9ef9-63ce77ae5e11 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.727310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42e77bd6-2242-4a32-9ef9-63ce77ae5e11 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.727766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42e77bd6-2242-4a32-9ef9-63ce77ae5e11 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:38.728190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42e77bd6-2242-4a32-9ef9-63ce77ae5e11 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:38.915747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-42e77bd6-2242-4a32-9ef9-63ce77ae5e11 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:38.925225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-42e77bd6-2242-4a32-9ef9-63ce77ae5e11 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:38.926916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-42e77bd6-2242-4a32-9ef9-63ce77ae5e11 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:38.928622 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-42e77bd6-2242-4a32-9ef9-63ce77ae5e11 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1725 microversion: 2.20 time: 0.217392 Oct 18 13:34:38.929225 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1933/4097] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:38 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:38.984877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd1ede37-b7c7-471a-931e-7a95dd3894a9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ba37690-e936-43fd-90a5-fea0050ea24f"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:38.987661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fd1ede37-b7c7-471a-931e-7a95dd3894a9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:38.998881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd1ede37-b7c7-471a-931e-7a95dd3894a9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:38.999923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd1ede37-b7c7-471a-931e-7a95dd3894a9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.000577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd1ede37-b7c7-471a-931e-7a95dd3894a9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.001527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd1ede37-b7c7-471a-931e-7a95dd3894a9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.002184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd1ede37-b7c7-471a-931e-7a95dd3894a9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.003279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd1ede37-b7c7-471a-931e-7a95dd3894a9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.217100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9a64adde-0c05-4b1c-a76a-c567b97b77a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:39.221001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:39.226861 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9a64adde-0c05-4b1c-a76a-c567b97b77a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.600788 Oct 18 13:34:39.229880 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2165/4098] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:38 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:39.235206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c37cffc5-6f5e-48f8-8726-7a744789bec4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:39.235991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c37cffc5-6f5e-48f8-8726-7a744789bec4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:39.243054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c37cffc5-6f5e-48f8-8726-7a744789bec4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.246001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c37cffc5-6f5e-48f8-8726-7a744789bec4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.246833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c37cffc5-6f5e-48f8-8726-7a744789bec4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.247890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c37cffc5-6f5e-48f8-8726-7a744789bec4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.249225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c37cffc5-6f5e-48f8-8726-7a744789bec4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.250020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c37cffc5-6f5e-48f8-8726-7a744789bec4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.371928 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fd1ede37-b7c7-471a-931e-7a95dd3894a9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "POST /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.393686 Oct 18 13:34:39.374414 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1934/4099] 10.222.0.40 () {62 vars in 1364 bytes} [Tue Oct 18 13:34:38 2022] POST /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments => generated 188 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:34:39.379953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6fe0bc40-b13f-46b9-b36b-ef943692e7c1 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:39.382673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6fe0bc40-b13f-46b9-b36b-ef943692e7c1 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:39.388755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fe0bc40-b13f-46b9-b36b-ef943692e7c1 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.389635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fe0bc40-b13f-46b9-b36b-ef943692e7c1 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.390057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fe0bc40-b13f-46b9-b36b-ef943692e7c1 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.390795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fe0bc40-b13f-46b9-b36b-ef943692e7c1 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.391250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fe0bc40-b13f-46b9-b36b-ef943692e7c1 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.391676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fe0bc40-b13f-46b9-b36b-ef943692e7c1 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.423516 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6fe0bc40-b13f-46b9-b36b-ef943692e7c1 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047670 Oct 18 13:34:39.424813 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1935/4100] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:34:39 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:34:39.444809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6a5d2a20-dbf4-4d45-b321-b2e4b6a465dd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:39.446962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6a5d2a20-dbf4-4d45-b321-b2e4b6a465dd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:39.461732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a5d2a20-dbf4-4d45-b321-b2e4b6a465dd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.462666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a5d2a20-dbf4-4d45-b321-b2e4b6a465dd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.466666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a5d2a20-dbf4-4d45-b321-b2e4b6a465dd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.468528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a5d2a20-dbf4-4d45-b321-b2e4b6a465dd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.469816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a5d2a20-dbf4-4d45-b321-b2e4b6a465dd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.471214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a5d2a20-dbf4-4d45-b321-b2e4b6a465dd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.492128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c37cffc5-6f5e-48f8-8726-7a744789bec4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:39.503988 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c37cffc5-6f5e-48f8-8726-7a744789bec4 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1508 microversion: 2.1 time: 0.272875 Oct 18 13:34:39.511661 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2166/4101] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:39 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:39.523203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-79f1c2ec-cff5-4218-abd0-91c955b84b82 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:39.525369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-79f1c2ec-cff5-4218-abd0-91c955b84b82 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:39.541035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79f1c2ec-cff5-4218-abd0-91c955b84b82 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.546962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79f1c2ec-cff5-4218-abd0-91c955b84b82 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.548144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79f1c2ec-cff5-4218-abd0-91c955b84b82 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.550960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79f1c2ec-cff5-4218-abd0-91c955b84b82 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.551829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79f1c2ec-cff5-4218-abd0-91c955b84b82 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.552955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79f1c2ec-cff5-4218-abd0-91c955b84b82 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.673852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79f1c2ec-cff5-4218-abd0-91c955b84b82 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:39.684825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79f1c2ec-cff5-4218-abd0-91c955b84b82 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:39.687847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79f1c2ec-cff5-4218-abd0-91c955b84b82 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:39.689275 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-79f1c2ec-cff5-4218-abd0-91c955b84b82 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.176286 Oct 18 13:34:39.690505 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2167/4102] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:39 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:39.697804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aba34bff-f4ef-4c6a-b2bb-7397d67edd9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:39.698842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aba34bff-f4ef-4c6a-b2bb-7397d67edd9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:39.708221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aba34bff-f4ef-4c6a-b2bb-7397d67edd9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.708918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aba34bff-f4ef-4c6a-b2bb-7397d67edd9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.709627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aba34bff-f4ef-4c6a-b2bb-7397d67edd9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.710507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aba34bff-f4ef-4c6a-b2bb-7397d67edd9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.711100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aba34bff-f4ef-4c6a-b2bb-7397d67edd9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.711663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aba34bff-f4ef-4c6a-b2bb-7397d67edd9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.756375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6a5d2a20-dbf4-4d45-b321-b2e4b6a465dd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:39.759532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aba34bff-f4ef-4c6a-b2bb-7397d67edd9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120611) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 13:34:39.766329 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6a5d2a20-dbf4-4d45-b321-b2e4b6a465dd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.340245 Oct 18 13:34:39.769262 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1936/4103] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:39 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:39.772041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1240799795", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "7009cfb7-731a-475d-866b-3727e8f69885"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:39.847513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] validate_networks() for [('7009cfb7-731a-475d-866b-3727e8f69885', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:34:39.862689 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aba34bff-f4ef-4c6a-b2bb-7397d67edd9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "POST /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/action" status: 202 len: 0 microversion: 2.20 time: 0.169669 Oct 18 13:34:39.865231 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2168/4104] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:34:39 2022] POST /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:34:39.871547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c443e648-c701-435c-9090-262c5c908e36 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:39.875726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c443e648-c701-435c-9090-262c5c908e36 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 1f373b26-a359-4aa7-be81-e11535182717] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:39.883285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:39.884951 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-c443e648-c701-435c-9090-262c5c908e36 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 1f373b26-a359-4aa7-be81-e11535182717 could not be found. Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c443e648-c701-435c-9090-262c5c908e36 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/1f373b26-a359-4aa7-be81-e11535182717/action HTTP/1.1 Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 28 Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: {"reboot": {"type": "SOFT"}} Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 1f373b26-a359-4aa7-be81-e11535182717 could not be found. Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '1f373b26-a359-4aa7-be81-e11535182717', 'body': {'reboot': {'type': 'SOFT'}}} Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f373b26-a359-4aa7-be81-e11535182717 could not be found. Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f373b26-a359-4aa7-be81-e11535182717 could not be found. Oct 18 13:34:39.887175 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:39.891536 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:39.891536 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:39.891536 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:39.891536 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:39.891536 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:39.891536 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:39.891536 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:39.891536 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f373b26-a359-4aa7-be81-e11535182717 could not be found. Oct 18 13:34:39.891536 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:39.894474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c443e648-c701-435c-9090-262c5c908e36 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 1f373b26-a359-4aa7-be81-e11535182717 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:39.895979 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c443e648-c701-435c-9090-262c5c908e36 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/1f373b26-a359-4aa7-be81-e11535182717/action" status: 404 len: 111 microversion: 2.1 time: 0.030476 Oct 18 13:34:39.897271 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2169/4105] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:39 2022] POST /compute/v2.1/servers/1f373b26-a359-4aa7-be81-e11535182717/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:39.917668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d78e998c-0ea5-43ef-a831-619117f55788 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:39.921350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d78e998c-0ea5-43ef-a831-619117f55788 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:39.943606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d78e998c-0ea5-43ef-a831-619117f55788 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.944134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d78e998c-0ea5-43ef-a831-619117f55788 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.944898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d78e998c-0ea5-43ef-a831-619117f55788 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:39.949064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d78e998c-0ea5-43ef-a831-619117f55788 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:39.951854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d78e998c-0ea5-43ef-a831-619117f55788 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:39.954005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d78e998c-0ea5-43ef-a831-619117f55788 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:40.479622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d78e998c-0ea5-43ef-a831-619117f55788 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:40.497223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:34:40.498388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:34:40.499367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:34:40.500118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:34:40.500712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:34:40.507576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d78e998c-0ea5-43ef-a831-619117f55788 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:40.516607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d78e998c-0ea5-43ef-a831-619117f55788 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:40.517937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:40.518418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:40.518850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:40.519722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:40.520311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:40.520741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:40.524457 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d78e998c-0ea5-43ef-a831-619117f55788 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1751 microversion: 2.20 time: 0.625845 Oct 18 13:34:40.525115 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2170/4106] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:39 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1751 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:40.537442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-23108d4c-ae71-48bb-99f4-11dd99f91434 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:40.546226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-23108d4c-ae71-48bb-99f4-11dd99f91434 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:40.560142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Getting quotas for project 3ec155a5641940afb3f80c12e83c57ec. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:34:40.566828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Getting quotas for user eab6be43a2404bf1889cc592466bee4e and project 3ec155a5641940afb3f80c12e83c57ec. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:34:40.567506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23108d4c-ae71-48bb-99f4-11dd99f91434 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:40.568561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23108d4c-ae71-48bb-99f4-11dd99f91434 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:40.571217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23108d4c-ae71-48bb-99f4-11dd99f91434 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:40.572050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23108d4c-ae71-48bb-99f4-11dd99f91434 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:40.573097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23108d4c-ae71-48bb-99f4-11dd99f91434 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:40.574441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23108d4c-ae71-48bb-99f4-11dd99f91434 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:40.588694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:34:40.591850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:34:40.708306 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-84c6aef0-eea8-4476-b279-2a2cb34ab1dc tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939886 Oct 18 13:34:40.716044 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1937/4107] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:34:40.722000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7e6cf7f1-a31a-4b7f-ae40-060d6df9b1c5 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:40.723650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7e6cf7f1-a31a-4b7f-ae40-060d6df9b1c5 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:40.743588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e6cf7f1-a31a-4b7f-ae40-060d6df9b1c5 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:40.744082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e6cf7f1-a31a-4b7f-ae40-060d6df9b1c5 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:40.744529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e6cf7f1-a31a-4b7f-ae40-060d6df9b1c5 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:40.779323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e6cf7f1-a31a-4b7f-ae40-060d6df9b1c5 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:40.799546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e6cf7f1-a31a-4b7f-ae40-060d6df9b1c5 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:40.800259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7e6cf7f1-a31a-4b7f-ae40-060d6df9b1c5 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:41.088986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7e6cf7f1-a31a-4b7f-ae40-060d6df9b1c5 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.105877 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7e6cf7f1-a31a-4b7f-ae40-060d6df9b1c5 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1508 microversion: 2.1 time: 0.387725 Oct 18 13:34:41.107025 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1938/4108] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:40 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1508 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:41.117520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-08d0c9ef-e5fe-495a-9b36-4b5cec717d80 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:41.118602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-08d0c9ef-e5fe-495a-9b36-4b5cec717d80 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:41.205070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-08d0c9ef-e5fe-495a-9b36-4b5cec717d80 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.214186 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-08d0c9ef-e5fe-495a-9b36-4b5cec717d80 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1218 microversion: 2.1 time: 0.105491 Oct 18 13:34:41.228679 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1939/4109] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:41 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:41.239728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7bfc0c5a-2ab9-4c7a-b0c9-76393f4d6c52 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:41.240616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7bfc0c5a-2ab9-4c7a-b0c9-76393f4d6c52 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:41.247336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7bfc0c5a-2ab9-4c7a-b0c9-76393f4d6c52 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:41.249128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7bfc0c5a-2ab9-4c7a-b0c9-76393f4d6c52 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:41.249797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7bfc0c5a-2ab9-4c7a-b0c9-76393f4d6c52 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:41.250723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7bfc0c5a-2ab9-4c7a-b0c9-76393f4d6c52 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:41.251339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7bfc0c5a-2ab9-4c7a-b0c9-76393f4d6c52 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:41.251922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7bfc0c5a-2ab9-4c7a-b0c9-76393f4d6c52 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:41.398980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7bfc0c5a-2ab9-4c7a-b0c9-76393f4d6c52 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.408633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7bfc0c5a-2ab9-4c7a-b0c9-76393f4d6c52 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.411791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7bfc0c5a-2ab9-4c7a-b0c9-76393f4d6c52 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.413919 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7bfc0c5a-2ab9-4c7a-b0c9-76393f4d6c52 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.183857 Oct 18 13:34:41.415757 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1940/4110] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:41 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:41.553019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c19ec680-81fe-42f6-b625-bb43dd794323 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:41.553817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c19ec680-81fe-42f6-b625-bb43dd794323 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:41.562601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-23108d4c-ae71-48bb-99f4-11dd99f91434 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.574378 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-23108d4c-ae71-48bb-99f4-11dd99f91434 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 1.047673 Oct 18 13:34:41.589221 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2171/4111] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:40 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:41.589658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c19ec680-81fe-42f6-b625-bb43dd794323 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:41.589658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c19ec680-81fe-42f6-b625-bb43dd794323 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:41.589658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c19ec680-81fe-42f6-b625-bb43dd794323 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:41.589658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c19ec680-81fe-42f6-b625-bb43dd794323 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:41.589658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c19ec680-81fe-42f6-b625-bb43dd794323 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:41.589658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c19ec680-81fe-42f6-b625-bb43dd794323 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:41.602847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f7d8a698-39c9-43bf-beb7-ac419c138ecd req-950f5a7f-5d30-4459-ba1a-0ba957c070ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f75005a7-f4b9-46a1-bdb9-98d795d0c0a9", "name": "network-vif-deleted", "tag": "cd03578d-94c2-4cc7-879e-cd4a553d91c2"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:41.634890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f7d8a698-39c9-43bf-beb7-ac419c138ecd req-950f5a7f-5d30-4459-ba1a-0ba957c070ac service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:41.643904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f7d8a698-39c9-43bf-beb7-ac419c138ecd req-950f5a7f-5d30-4459-ba1a-0ba957c070ac service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:41.645783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f7d8a698-39c9-43bf-beb7-ac419c138ecd req-950f5a7f-5d30-4459-ba1a-0ba957c070ac service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:41.698392 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f7d8a698-39c9-43bf-beb7-ac419c138ecd req-950f5a7f-5d30-4459-ba1a-0ba957c070ac service nova] Creating event network-vif-deleted:cd03578d-94c2-4cc7-879e-cd4a553d91c2 for instance f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 on n-h1-858384-13 Oct 18 13:34:41.728317 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f7d8a698-39c9-43bf-beb7-ac419c138ecd req-950f5a7f-5d30-4459-ba1a-0ba957c070ac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133866 Oct 18 13:34:41.729053 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2172/4112] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:34:41.770293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8efaf6e8-ff39-45c9-bf16-9c83d187d50c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:41.770615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8efaf6e8-ff39-45c9-bf16-9c83d187d50c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:41.787395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8efaf6e8-ff39-45c9-bf16-9c83d187d50c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:41.788159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8efaf6e8-ff39-45c9-bf16-9c83d187d50c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:41.797548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8efaf6e8-ff39-45c9-bf16-9c83d187d50c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:41.798487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8efaf6e8-ff39-45c9-bf16-9c83d187d50c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:41.799169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8efaf6e8-ff39-45c9-bf16-9c83d187d50c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:41.799878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8efaf6e8-ff39-45c9-bf16-9c83d187d50c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:41.923935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c19ec680-81fe-42f6-b625-bb43dd794323 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.938745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c19ec680-81fe-42f6-b625-bb43dd794323 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.944174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c19ec680-81fe-42f6-b625-bb43dd794323 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:41.945769 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c19ec680-81fe-42f6-b625-bb43dd794323 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1751 microversion: 2.20 time: 0.397643 Oct 18 13:34:41.947996 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1941/4113] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:41 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1751 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:42.132301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:42.133026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:42.169134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.171121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.174465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.177653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.184673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.185139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.247120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8efaf6e8-ff39-45c9-bf16-9c83d187d50c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:42.257019 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8efaf6e8-ff39-45c9-bf16-9c83d187d50c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.526761 Oct 18 13:34:42.290338 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2173/4114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:41 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:42.302088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-414357fc-3c35-403c-8601-d00f0995579d tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:42.302701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-414357fc-3c35-403c-8601-d00f0995579d tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:42.324762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-414357fc-3c35-403c-8601-d00f0995579d tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.325278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-414357fc-3c35-403c-8601-d00f0995579d tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.325726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-414357fc-3c35-403c-8601-d00f0995579d tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.326490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-414357fc-3c35-403c-8601-d00f0995579d tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.327327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-414357fc-3c35-403c-8601-d00f0995579d tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.327440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-414357fc-3c35-403c-8601-d00f0995579d tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.343890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.344386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.344836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.345319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lazy-loading 'fault' on Instance uuid f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:42.413979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-414357fc-3c35-403c-8601-d00f0995579d tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:42.423707 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-414357fc-3c35-403c-8601-d00f0995579d tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1214 microversion: 2.1 time: 0.131721 Oct 18 13:34:42.434086 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2174/4115] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:42 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:42.434086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c10d805-f6d7-4db6-ba16-819a6890bf64 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:42.434086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7c10d805-f6d7-4db6-ba16-819a6890bf64 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:42.440455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c10d805-f6d7-4db6-ba16-819a6890bf64 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.440897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c10d805-f6d7-4db6-ba16-819a6890bf64 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.441388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c10d805-f6d7-4db6-ba16-819a6890bf64 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.442073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c10d805-f6d7-4db6-ba16-819a6890bf64 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.442521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c10d805-f6d7-4db6-ba16-819a6890bf64 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.442943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c10d805-f6d7-4db6-ba16-819a6890bf64 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.477862 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-7c10d805-f6d7-4db6-ba16-819a6890bf64 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c10d805-f6d7-4db6-ba16-819a6890bf64 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9/action HTTP/1.1 Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 65 Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '18dcc6bf-fc63-4063-93f6-d8f7b158aef9', 'body': {'rebuild': {'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23'}}} Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 18 13:34:42.479645 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c10d805-f6d7-4db6-ba16-819a6890bf64 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:42.483672 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7c10d805-f6d7-4db6-ba16-819a6890bf64 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9/action" status: 404 len: 111 microversion: 2.1 time: 0.055440 Oct 18 13:34:42.489924 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2175/4116] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:42 2022] POST /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:42.508510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2af744fd4641e591354166c2b371de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614abbf6db5d4775a24243632248c89e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:42.511569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:42.525765 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cd7662a5-2557-4d13-aa99-88b7919b4207 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 200 len: 1312 microversion: 2.1 time: 0.397201 Oct 18 13:34:42.526368 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1942/4117] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:42 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 1312 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:42.543291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bdf95eaa-00ee-4043-bd5a-87e34d93a581 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:42.547940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bdf95eaa-00ee-4043-bd5a-87e34d93a581 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:42.567187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdf95eaa-00ee-4043-bd5a-87e34d93a581 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.569662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdf95eaa-00ee-4043-bd5a-87e34d93a581 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.571372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdf95eaa-00ee-4043-bd5a-87e34d93a581 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.575679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdf95eaa-00ee-4043-bd5a-87e34d93a581 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.576723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdf95eaa-00ee-4043-bd5a-87e34d93a581 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.578769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdf95eaa-00ee-4043-bd5a-87e34d93a581 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.710666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ff237dcd-0c8f-4c83-9263-60df10b233e5 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:42.711252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ff237dcd-0c8f-4c83-9263-60df10b233e5 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:42.719108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff237dcd-0c8f-4c83-9263-60df10b233e5 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.719819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff237dcd-0c8f-4c83-9263-60df10b233e5 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.720432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff237dcd-0c8f-4c83-9263-60df10b233e5 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.721995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff237dcd-0c8f-4c83-9263-60df10b233e5 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.722669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff237dcd-0c8f-4c83-9263-60df10b233e5 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.723462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff237dcd-0c8f-4c83-9263-60df10b233e5 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.726035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bdf95eaa-00ee-4043-bd5a-87e34d93a581 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:42.744971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bdf95eaa-00ee-4043-bd5a-87e34d93a581 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:42.755246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bdf95eaa-00ee-4043-bd5a-87e34d93a581 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:42.760711 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bdf95eaa-00ee-4043-bd5a-87e34d93a581 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.225504 Oct 18 13:34:42.762217 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1943/4118] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:42 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:42.770818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22702e9c-1798-49fb-8601-0b0ff9fb5ab8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:42.778176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-22702e9c-1798-49fb-8601-0b0ff9fb5ab8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:42.796574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22702e9c-1798-49fb-8601-0b0ff9fb5ab8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.800111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22702e9c-1798-49fb-8601-0b0ff9fb5ab8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.815847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22702e9c-1798-49fb-8601-0b0ff9fb5ab8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.816986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22702e9c-1798-49fb-8601-0b0ff9fb5ab8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:42.817647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22702e9c-1798-49fb-8601-0b0ff9fb5ab8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:42.826921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22702e9c-1798-49fb-8601-0b0ff9fb5ab8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:42.829072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ff237dcd-0c8f-4c83-9263-60df10b233e5 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:34:43.013714 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ff237dcd-0c8f-4c83-9263-60df10b233e5 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "DELETE /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 204 len: 0 microversion: 2.32 time: 0.524914 Oct 18 13:34:43.017098 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2176/4119] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:34:42 2022] DELETE /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:34:43.028396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1ed37963-028d-451f-96e1-cfcad45cd9ce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:43.041742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1ed37963-028d-451f-96e1-cfcad45cd9ce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:43.048775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ed37963-028d-451f-96e1-cfcad45cd9ce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.049293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ed37963-028d-451f-96e1-cfcad45cd9ce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.049739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ed37963-028d-451f-96e1-cfcad45cd9ce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:43.050448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ed37963-028d-451f-96e1-cfcad45cd9ce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.050914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ed37963-028d-451f-96e1-cfcad45cd9ce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.051342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ed37963-028d-451f-96e1-cfcad45cd9ce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:43.330333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-22702e9c-1798-49fb-8601-0b0ff9fb5ab8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:43.352241 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-22702e9c-1798-49fb-8601-0b0ff9fb5ab8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.588452 Oct 18 13:34:43.361725 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1944/4120] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:42 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:43.369648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1ed37963-028d-451f-96e1-cfcad45cd9ce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:43.385002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1ed37963-028d-451f-96e1-cfcad45cd9ce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:43.387838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f6eb4a68-0d21-4f06-80e5-5f512d046fb2 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:43.388981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f6eb4a68-0d21-4f06-80e5-5f512d046fb2 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:43.396803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1ed37963-028d-451f-96e1-cfcad45cd9ce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:43.400539 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1ed37963-028d-451f-96e1-cfcad45cd9ce tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1753 microversion: 2.20 time: 0.380503 Oct 18 13:34:43.402231 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2177/4121] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:43 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1753 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:43.405482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:43.420902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e5e02c62-4b42-443c-bc17-746099258397 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:43.424773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e5e02c62-4b42-443c-bc17-746099258397 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:43.429347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6eb4a68-0d21-4f06-80e5-5f512d046fb2 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.429908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6eb4a68-0d21-4f06-80e5-5f512d046fb2 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.430361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6eb4a68-0d21-4f06-80e5-5f512d046fb2 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:43.436385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6eb4a68-0d21-4f06-80e5-5f512d046fb2 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.437678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6eb4a68-0d21-4f06-80e5-5f512d046fb2 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.438136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6eb4a68-0d21-4f06-80e5-5f512d046fb2 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:43.444419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5e02c62-4b42-443c-bc17-746099258397 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.446034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5e02c62-4b42-443c-bc17-746099258397 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.446505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5e02c62-4b42-443c-bc17-746099258397 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:43.449587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5e02c62-4b42-443c-bc17-746099258397 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.450059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5e02c62-4b42-443c-bc17-746099258397 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.450508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5e02c62-4b42-443c-bc17-746099258397 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:43.697740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e5e02c62-4b42-443c-bc17-746099258397 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:43.706981 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e5e02c62-4b42-443c-bc17-746099258397 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.302541 Oct 18 13:34:43.707567 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2178/4122] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:43 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:43.712273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-546c0ba0-2372-4095-bedc-5fb6ccd64443 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:43.713868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-546c0ba0-2372-4095-bedc-5fb6ccd64443 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:43.721071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-546c0ba0-2372-4095-bedc-5fb6ccd64443 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.721867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-546c0ba0-2372-4095-bedc-5fb6ccd64443 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.722526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-546c0ba0-2372-4095-bedc-5fb6ccd64443 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:43.723447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-546c0ba0-2372-4095-bedc-5fb6ccd64443 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.724096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-546c0ba0-2372-4095-bedc-5fb6ccd64443 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.724715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-546c0ba0-2372-4095-bedc-5fb6ccd64443 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:43.797776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-546c0ba0-2372-4095-bedc-5fb6ccd64443 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:43.806557 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-546c0ba0-2372-4095-bedc-5fb6ccd64443 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1278 microversion: 2.1 time: 0.097723 Oct 18 13:34:43.807546 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2179/4123] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:43 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:43.813300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8a38c3c3-21c7-4427-bdc8-1bcea591dd71 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:43.814167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8a38c3c3-21c7-4427-bdc8-1bcea591dd71 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] [instance: f75005a7-f4b9-46a1-bdb9-98d795d0c0a9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:43.827922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a38c3c3-21c7-4427-bdc8-1bcea591dd71 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.829117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a38c3c3-21c7-4427-bdc8-1bcea591dd71 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.830968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a38c3c3-21c7-4427-bdc8-1bcea591dd71 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:43.832074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a38c3c3-21c7-4427-bdc8-1bcea591dd71 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.832741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a38c3c3-21c7-4427-bdc8-1bcea591dd71 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.833423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a38c3c3-21c7-4427-bdc8-1bcea591dd71 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:43.872251 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-8a38c3c3-21c7-4427-bdc8-1bcea591dd71 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] HTTP exception thrown: Instance f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 could not be found. Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8a38c3c3-21c7-4427-bdc8-1bcea591dd71 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Request method failure captured: Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 HTTP/1.1 Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqslIWIRudq58h_WT42tmcw2uJn-ax6GJcYABQFoLfdzMuuUFHddNMDYzqMOTd9LkGSRkH-3ctkiVWQO_ZR0xVLnf7M_VmYcV2d1fVp-lLQLQiX6M4-eLTtaO4KbGkWYp97VgDGtjIZ77eMFFBK73BsibYGSRhpYjUsdZkjN7_QaiPg Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 614abbf6db5d4775a24243632248c89e Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-870534238 Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/614abbf6db5d4775a24243632248c89e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/614abbf6db5d4775a24243632248c89e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/614abbf6db5d4775a24243632248c89e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_614abbf6db5d4775a24243632248c89e"}]}] Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-870534238 Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 614abbf6db5d4775a24243632248c89e Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-870534238 Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerRescueTestJSONUnderV235-870534238-project Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6d2af744fd4641e591354166c2b371de Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-870534238-project Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 could not be found. Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f75005a7-f4b9-46a1-bdb9-98d795d0c0a9'} Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 could not be found. Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 could not be found. Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:43.874049 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:43.877297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:43.877297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:43.877297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:43.877297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:43.877297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:43.877297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:43.877297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 could not be found. Oct 18 13:34:43.877297 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:43.877297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8a38c3c3-21c7-4427-bdc8-1bcea591dd71 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] Returning 404 to user: Instance f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:43.878540 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8a38c3c3-21c7-4427-bdc8-1bcea591dd71 tempest-ServerRescueTestJSONUnderV235-870534238 tempest-ServerRescueTestJSONUnderV235-870534238-project] 10.222.0.40 "GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9" status: 404 len: 111 microversion: 2.1 time: 0.069817 Oct 18 13:34:43.879510 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2180/4124] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:43 2022] GET /compute/v2.1/servers/f75005a7-f4b9-46a1-bdb9-98d795d0c0a9 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:43.885705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d98568b7-08c4-49ec-bee4-c08af1a250f5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:43.889601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d98568b7-08c4-49ec-bee4-c08af1a250f5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 54cd90e0-e1e4-4f96-8908-14cc8e48baf9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:43.896736 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-d98568b7-08c4-49ec-bee4-c08af1a250f5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 54cd90e0-e1e4-4f96-8908-14cc8e48baf9 could not be found. Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d98568b7-08c4-49ec-bee4-c08af1a250f5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/54cd90e0-e1e4-4f96-8908-14cc8e48baf9/action HTTP/1.1 Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 65 Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 54cd90e0-e1e4-4f96-8908-14cc8e48baf9 could not be found. Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '54cd90e0-e1e4-4f96-8908-14cc8e48baf9', 'body': {'rebuild': {'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23'}}} Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54cd90e0-e1e4-4f96-8908-14cc8e48baf9 could not be found. Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 18 13:34:43.899139 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54cd90e0-e1e4-4f96-8908-14cc8e48baf9 could not be found. Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54cd90e0-e1e4-4f96-8908-14cc8e48baf9 could not be found. Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:43.902946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d98568b7-08c4-49ec-bee4-c08af1a250f5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 54cd90e0-e1e4-4f96-8908-14cc8e48baf9 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:43.905858 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d98568b7-08c4-49ec-bee4-c08af1a250f5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/54cd90e0-e1e4-4f96-8908-14cc8e48baf9/action" status: 404 len: 111 microversion: 2.1 time: 0.025077 Oct 18 13:34:43.906981 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2181/4125] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:43 2022] POST /compute/v2.1/servers/54cd90e0-e1e4-4f96-8908-14cc8e48baf9/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:43.912009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1bf593fd-0fdd-4bbe-a54f-04664e640e6a tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:43.912880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1bf593fd-0fdd-4bbe-a54f-04664e640e6a tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:43.921465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bf593fd-0fdd-4bbe-a54f-04664e640e6a tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.922299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bf593fd-0fdd-4bbe-a54f-04664e640e6a tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.922961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bf593fd-0fdd-4bbe-a54f-04664e640e6a tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:43.923863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bf593fd-0fdd-4bbe-a54f-04664e640e6a tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:43.924514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bf593fd-0fdd-4bbe-a54f-04664e640e6a tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:43.925155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bf593fd-0fdd-4bbe-a54f-04664e640e6a tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.079538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1bf593fd-0fdd-4bbe-a54f-04664e640e6a tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.100837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1bf593fd-0fdd-4bbe-a54f-04664e640e6a tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.105990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1bf593fd-0fdd-4bbe-a54f-04664e640e6a tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.109034 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1bf593fd-0fdd-4bbe-a54f-04664e640e6a tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.199063 Oct 18 13:34:44.116712 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2182/4126] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:43 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:44.126579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c486b259-e2ad-4687-a596-020f500aca2e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:44.127214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c486b259-e2ad-4687-a596-020f500aca2e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:44.149650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c486b259-e2ad-4687-a596-020f500aca2e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.150289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c486b259-e2ad-4687-a596-020f500aca2e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.150737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c486b259-e2ad-4687-a596-020f500aca2e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.151459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c486b259-e2ad-4687-a596-020f500aca2e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.151918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c486b259-e2ad-4687-a596-020f500aca2e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.152345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c486b259-e2ad-4687-a596-020f500aca2e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.256068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f6eb4a68-0d21-4f06-80e5-5f512d046fb2 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.273958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f6eb4a68-0d21-4f06-80e5-5f512d046fb2 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.277908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f6eb4a68-0d21-4f06-80e5-5f512d046fb2 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.283053 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f6eb4a68-0d21-4f06-80e5-5f512d046fb2 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2956 microversion: 2.32 time: 0.915201 Oct 18 13:34:44.298705 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1945/4127] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:43 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2956 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:44.417887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c486b259-e2ad-4687-a596-020f500aca2e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.422111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:44.430922 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c486b259-e2ad-4687-a596-020f500aca2e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.310488 Oct 18 13:34:44.432849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-809206ce-7794-4612-a793-a8411022e8d6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:44.433686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-809206ce-7794-4612-a793-a8411022e8d6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:44.433911 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2183/4128] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:44 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:44.447824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-809206ce-7794-4612-a793-a8411022e8d6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.448335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-809206ce-7794-4612-a793-a8411022e8d6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.448781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-809206ce-7794-4612-a793-a8411022e8d6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.449540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-809206ce-7794-4612-a793-a8411022e8d6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.450003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-809206ce-7794-4612-a793-a8411022e8d6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.450435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-809206ce-7794-4612-a793-a8411022e8d6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.467947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53cdef4c-2ba9-48d6-a847-c25a17a0ffea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:44.468991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53cdef4c-2ba9-48d6-a847-c25a17a0ffea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:44.482774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53cdef4c-2ba9-48d6-a847-c25a17a0ffea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.486305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53cdef4c-2ba9-48d6-a847-c25a17a0ffea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.486953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53cdef4c-2ba9-48d6-a847-c25a17a0ffea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.487891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53cdef4c-2ba9-48d6-a847-c25a17a0ffea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.493625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53cdef4c-2ba9-48d6-a847-c25a17a0ffea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.494442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53cdef4c-2ba9-48d6-a847-c25a17a0ffea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.905732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-53cdef4c-2ba9-48d6-a847-c25a17a0ffea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:44.920775 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53cdef4c-2ba9-48d6-a847-c25a17a0ffea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.460686 Oct 18 13:34:44.940745 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2184/4129] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:44 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:34:44.947751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d26ae0a-e32a-4414-a34a-561b5cd5e689 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:44.948610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3d26ae0a-e32a-4414-a34a-561b5cd5e689 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:44.957859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d26ae0a-e32a-4414-a34a-561b5cd5e689 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.958535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d26ae0a-e32a-4414-a34a-561b5cd5e689 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.959128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d26ae0a-e32a-4414-a34a-561b5cd5e689 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:44.960005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d26ae0a-e32a-4414-a34a-561b5cd5e689 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:44.960801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d26ae0a-e32a-4414-a34a-561b5cd5e689 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:44.961580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d26ae0a-e32a-4414-a34a-561b5cd5e689 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.056168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-809206ce-7794-4612-a793-a8411022e8d6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.068417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-809206ce-7794-4612-a793-a8411022e8d6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.070280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-809206ce-7794-4612-a793-a8411022e8d6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.071767 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-809206ce-7794-4612-a793-a8411022e8d6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1753 microversion: 2.20 time: 0.643221 Oct 18 13:34:45.085250 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1946/4130] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:44 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1753 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:45.093239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bb466a27-c08d-4f95-b029-27a337d03861 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:45.093239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bb466a27-c08d-4f95-b029-27a337d03861 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 9b760564-ebeb-4a93-b4dc-c6770c836931] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:45.102293 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-bb466a27-c08d-4f95-b029-27a337d03861 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 9b760564-ebeb-4a93-b4dc-c6770c836931 could not be found. Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bb466a27-c08d-4f95-b029-27a337d03861 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/9b760564-ebeb-4a93-b4dc-c6770c836931/action HTTP/1.1 Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 15 Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: {"restore": {}} Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 9b760564-ebeb-4a93-b4dc-c6770c836931 could not be found. Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '9b760564-ebeb-4a93-b4dc-c6770c836931', 'body': {'restore': {}}} Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b760564-ebeb-4a93-b4dc-c6770c836931 could not be found. Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b760564-ebeb-4a93-b4dc-c6770c836931 could not be found. Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:45.103919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:45.107826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:45.107826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:45.107826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b760564-ebeb-4a93-b4dc-c6770c836931 could not be found. Oct 18 13:34:45.107826 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:45.107826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bb466a27-c08d-4f95-b029-27a337d03861 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 9b760564-ebeb-4a93-b4dc-c6770c836931 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:45.107826 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bb466a27-c08d-4f95-b029-27a337d03861 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/9b760564-ebeb-4a93-b4dc-c6770c836931/action" status: 404 len: 111 microversion: 2.1 time: 0.031505 Oct 18 13:34:45.107826 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1947/4131] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:45 2022] POST /compute/v2.1/servers/9b760564-ebeb-4a93-b4dc-c6770c836931/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:45.116759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2a651c5-648e-47cb-92e6-bdc69e16787d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:45.117418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d2a651c5-648e-47cb-92e6-bdc69e16787d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:45.127330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2a651c5-648e-47cb-92e6-bdc69e16787d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.128539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2a651c5-648e-47cb-92e6-bdc69e16787d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.129599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2a651c5-648e-47cb-92e6-bdc69e16787d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.130384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2a651c5-648e-47cb-92e6-bdc69e16787d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.130908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2a651c5-648e-47cb-92e6-bdc69e16787d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.131531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2a651c5-648e-47cb-92e6-bdc69e16787d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.186902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3d26ae0a-e32a-4414-a34a-561b5cd5e689 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.226455 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3d26ae0a-e32a-4414-a34a-561b5cd5e689 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1278 microversion: 2.1 time: 0.283177 Oct 18 13:34:45.235789 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2185/4132] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:44 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1278 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:45.241099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b9eb6b46-4dc3-41e2-ba40-4b318b71279e tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:45.249798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b9eb6b46-4dc3-41e2-ba40-4b318b71279e tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:45.277393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9eb6b46-4dc3-41e2-ba40-4b318b71279e tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.278012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9eb6b46-4dc3-41e2-ba40-4b318b71279e tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.278545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9eb6b46-4dc3-41e2-ba40-4b318b71279e tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.293478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9eb6b46-4dc3-41e2-ba40-4b318b71279e tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.297752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9eb6b46-4dc3-41e2-ba40-4b318b71279e tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.298396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9eb6b46-4dc3-41e2-ba40-4b318b71279e tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.442237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d2a651c5-648e-47cb-92e6-bdc69e16787d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.457058 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d2a651c5-648e-47cb-92e6-bdc69e16787d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.344120 Oct 18 13:34:45.457706 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1948/4133] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:45 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:45.481450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4dbae15d-4418-400a-a987-6f1bf9530543 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:45.482073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4dbae15d-4418-400a-a987-6f1bf9530543 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:45.489362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dbae15d-4418-400a-a987-6f1bf9530543 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.489860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dbae15d-4418-400a-a987-6f1bf9530543 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.490308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dbae15d-4418-400a-a987-6f1bf9530543 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.491020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dbae15d-4418-400a-a987-6f1bf9530543 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.491477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dbae15d-4418-400a-a987-6f1bf9530543 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.491906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dbae15d-4418-400a-a987-6f1bf9530543 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.660537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b9eb6b46-4dc3-41e2-ba40-4b318b71279e tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.675498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b9eb6b46-4dc3-41e2-ba40-4b318b71279e tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.676954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b9eb6b46-4dc3-41e2-ba40-4b318b71279e tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.683347 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b9eb6b46-4dc3-41e2-ba40-4b318b71279e tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.446069 Oct 18 13:34:45.683948 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2186/4134] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:45 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:45.697055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8dbf17ec-316a-4fec-9c93-e86c81cf702d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:45.698301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8dbf17ec-316a-4fec-9c93-e86c81cf702d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:45.712632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8dbf17ec-316a-4fec-9c93-e86c81cf702d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.713120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8dbf17ec-316a-4fec-9c93-e86c81cf702d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.713579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8dbf17ec-316a-4fec-9c93-e86c81cf702d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.714285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8dbf17ec-316a-4fec-9c93-e86c81cf702d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:45.714734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8dbf17ec-316a-4fec-9c93-e86c81cf702d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:45.715154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8dbf17ec-316a-4fec-9c93-e86c81cf702d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:45.812535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4dbae15d-4418-400a-a987-6f1bf9530543 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.823728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4dbae15d-4418-400a-a987-6f1bf9530543 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.825531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4dbae15d-4418-400a-a987-6f1bf9530543 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:45.827790 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4dbae15d-4418-400a-a987-6f1bf9530543 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2956 microversion: 2.32 time: 0.352794 Oct 18 13:34:45.838987 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1949/4135] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:45 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2956 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:46.105537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6e95bb38-c7d2-4478-bc05-2234b930dcea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:46.106397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6e95bb38-c7d2-4478-bc05-2234b930dcea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:46.114807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e95bb38-c7d2-4478-bc05-2234b930dcea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.115298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e95bb38-c7d2-4478-bc05-2234b930dcea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.115905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e95bb38-c7d2-4478-bc05-2234b930dcea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.116766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e95bb38-c7d2-4478-bc05-2234b930dcea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.117397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e95bb38-c7d2-4478-bc05-2234b930dcea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.120130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e95bb38-c7d2-4478-bc05-2234b930dcea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.378603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6e95bb38-c7d2-4478-bc05-2234b930dcea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:46.393449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6e95bb38-c7d2-4478-bc05-2234b930dcea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:46.400163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6e95bb38-c7d2-4478-bc05-2234b930dcea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:46.401907 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6e95bb38-c7d2-4478-bc05-2234b930dcea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1753 microversion: 2.20 time: 0.302685 Oct 18 13:34:46.403181 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1950/4136] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:46 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1753 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:46.420031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b55959de-298d-4c1d-ac2b-de93fb9c40ac tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:46.420905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b55959de-298d-4c1d-ac2b-de93fb9c40ac tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:46.437806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b55959de-298d-4c1d-ac2b-de93fb9c40ac tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.438308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b55959de-298d-4c1d-ac2b-de93fb9c40ac tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.441168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b55959de-298d-4c1d-ac2b-de93fb9c40ac tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.443208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b55959de-298d-4c1d-ac2b-de93fb9c40ac tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.443776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b55959de-298d-4c1d-ac2b-de93fb9c40ac tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.444133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b55959de-298d-4c1d-ac2b-de93fb9c40ac tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.564426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8dbf17ec-316a-4fec-9c93-e86c81cf702d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:46.573101 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8dbf17ec-316a-4fec-9c93-e86c81cf702d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.888122 Oct 18 13:34:46.605672 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2187/4137] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:45 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:46.617397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cd6feaad-ef32-4be1-b370-1962b06b7386 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:46.617948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cd6feaad-ef32-4be1-b370-1962b06b7386 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:46.633626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b55959de-298d-4c1d-ac2b-de93fb9c40ac tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:46.636891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd6feaad-ef32-4be1-b370-1962b06b7386 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.637428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd6feaad-ef32-4be1-b370-1962b06b7386 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.637874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd6feaad-ef32-4be1-b370-1962b06b7386 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.639116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd6feaad-ef32-4be1-b370-1962b06b7386 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.639926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd6feaad-ef32-4be1-b370-1962b06b7386 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.640369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd6feaad-ef32-4be1-b370-1962b06b7386 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.644774 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b55959de-298d-4c1d-ac2b-de93fb9c40ac tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1276 microversion: 2.1 time: 0.240356 Oct 18 13:34:46.656367 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1951/4138] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:46 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1276 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:46.702018 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-cd6feaad-ef32-4be1-b370-1962b06b7386 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Cannot 'restore' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cd6feaad-ef32-4be1-b370-1962b06b7386 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action HTTP/1.1 Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 15 Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: {"restore": {}} Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: exception: Cannot 'restore' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '6bce6f6b-df28-4c34-a17f-4f18eb67d401', 'body': {'restore': {}}} Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 in vm_state active. Cannot restore while the instance is in this state. Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:46.708445 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:46.711677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:46.711677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:46.711677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:46.711677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:34:46.711677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:46.712551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eefee2c4-730c-4f38-9bf7-ad2231e79aca tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:46.713653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eefee2c4-730c-4f38-9bf7-ad2231e79aca tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:46.714564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cd6feaad-ef32-4be1-b370-1962b06b7386 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 409 to user: Cannot 'restore' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:46.717892 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cd6feaad-ef32-4be1-b370-1962b06b7386 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action" status: 409 len: 145 microversion: 2.1 time: 0.105470 Oct 18 13:34:46.725730 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2188/4139] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:46 2022] POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action => generated 145 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 18 13:34:46.737887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-98a43650-d88e-4786-83ce-02e57fefc084 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:46.739250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-98a43650-d88e-4786-83ce-02e57fefc084 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:46.744626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eefee2c4-730c-4f38-9bf7-ad2231e79aca tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.751258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eefee2c4-730c-4f38-9bf7-ad2231e79aca tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.751771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eefee2c4-730c-4f38-9bf7-ad2231e79aca tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.753517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98a43650-d88e-4786-83ce-02e57fefc084 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.754273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98a43650-d88e-4786-83ce-02e57fefc084 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.754946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98a43650-d88e-4786-83ce-02e57fefc084 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.755857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98a43650-d88e-4786-83ce-02e57fefc084 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.756352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eefee2c4-730c-4f38-9bf7-ad2231e79aca tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.756754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98a43650-d88e-4786-83ce-02e57fefc084 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.756862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eefee2c4-730c-4f38-9bf7-ad2231e79aca tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.757252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eefee2c4-730c-4f38-9bf7-ad2231e79aca tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.758096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98a43650-d88e-4786-83ce-02e57fefc084 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.895049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eefee2c4-730c-4f38-9bf7-ad2231e79aca tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:46.904243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eefee2c4-730c-4f38-9bf7-ad2231e79aca tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:46.908550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eefee2c4-730c-4f38-9bf7-ad2231e79aca tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:46.911832 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eefee2c4-730c-4f38-9bf7-ad2231e79aca tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.203860 Oct 18 13:34:46.916725 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1952/4140] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:46 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:46.922029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2320d429-da34-4c8c-a41c-32a4a09b01d4 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:46.925713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2320d429-da34-4c8c-a41c-32a4a09b01d4 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:46.952421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2320d429-da34-4c8c-a41c-32a4a09b01d4 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.952940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2320d429-da34-4c8c-a41c-32a4a09b01d4 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.953426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2320d429-da34-4c8c-a41c-32a4a09b01d4 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:46.954155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2320d429-da34-4c8c-a41c-32a4a09b01d4 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:46.954609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2320d429-da34-4c8c-a41c-32a4a09b01d4 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:46.955248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2320d429-da34-4c8c-a41c-32a4a09b01d4 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:47.332086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-98a43650-d88e-4786-83ce-02e57fefc084 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:47.346700 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-98a43650-d88e-4786-83ce-02e57fefc084 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.619760 Oct 18 13:34:47.347308 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2189/4141] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:46 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:47.383531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d568331-0e15-4286-98f5-b71d2cf11246 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:47.385146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d568331-0e15-4286-98f5-b71d2cf11246 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:47.392566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d568331-0e15-4286-98f5-b71d2cf11246 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:47.393407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d568331-0e15-4286-98f5-b71d2cf11246 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:47.394438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d568331-0e15-4286-98f5-b71d2cf11246 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:47.395382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d568331-0e15-4286-98f5-b71d2cf11246 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:47.396685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d568331-0e15-4286-98f5-b71d2cf11246 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:47.397376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d568331-0e15-4286-98f5-b71d2cf11246 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:47.427659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2320d429-da34-4c8c-a41c-32a4a09b01d4 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:47.440037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2320d429-da34-4c8c-a41c-32a4a09b01d4 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:47.443639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2320d429-da34-4c8c-a41c-32a4a09b01d4 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:47.453671 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2320d429-da34-4c8c-a41c-32a4a09b01d4 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2956 microversion: 2.32 time: 0.535456 Oct 18 13:34:47.471757 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1953/4142] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:46 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2956 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:47.487097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2074e5cf-de8d-4f62-abab-e850b3dc1af1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:47.487966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2074e5cf-de8d-4f62-abab-e850b3dc1af1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:47.510903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2074e5cf-de8d-4f62-abab-e850b3dc1af1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:47.512288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2074e5cf-de8d-4f62-abab-e850b3dc1af1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:47.513122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2074e5cf-de8d-4f62-abab-e850b3dc1af1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:47.515182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2074e5cf-de8d-4f62-abab-e850b3dc1af1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:47.515833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2074e5cf-de8d-4f62-abab-e850b3dc1af1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:47.516340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2074e5cf-de8d-4f62-abab-e850b3dc1af1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:47.947027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2074e5cf-de8d-4f62-abab-e850b3dc1af1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:47.959099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2074e5cf-de8d-4f62-abab-e850b3dc1af1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:47.963817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2074e5cf-de8d-4f62-abab-e850b3dc1af1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:47.965474 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2074e5cf-de8d-4f62-abab-e850b3dc1af1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1753 microversion: 2.20 time: 0.492429 Oct 18 13:34:47.970569 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1954/4143] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:47 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1753 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:47.975819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ce8aac35-badf-42fc-9b6d-4aad34340379 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:47.981642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ce8aac35-badf-42fc-9b6d-4aad34340379 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:47.999102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce8aac35-badf-42fc-9b6d-4aad34340379 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:48.003658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce8aac35-badf-42fc-9b6d-4aad34340379 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:48.004399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce8aac35-badf-42fc-9b6d-4aad34340379 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:48.005624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce8aac35-badf-42fc-9b6d-4aad34340379 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:48.006310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce8aac35-badf-42fc-9b6d-4aad34340379 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:48.006954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce8aac35-badf-42fc-9b6d-4aad34340379 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:48.009196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d568331-0e15-4286-98f5-b71d2cf11246 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:48.018900 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d568331-0e15-4286-98f5-b71d2cf11246 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.644277 Oct 18 13:34:48.042680 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2190/4144] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:47 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:48.059648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2035312c-e841-46f9-a6fc-21f8058e4a1c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:48.068803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2035312c-e841-46f9-a6fc-21f8058e4a1c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:48.089925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2035312c-e841-46f9-a6fc-21f8058e4a1c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:48.092032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2035312c-e841-46f9-a6fc-21f8058e4a1c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:48.092662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2035312c-e841-46f9-a6fc-21f8058e4a1c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:48.093599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2035312c-e841-46f9-a6fc-21f8058e4a1c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:48.096790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2035312c-e841-46f9-a6fc-21f8058e4a1c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:48.097446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2035312c-e841-46f9-a6fc-21f8058e4a1c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:48.195126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ce8aac35-badf-42fc-9b6d-4aad34340379 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:48.210161 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ce8aac35-badf-42fc-9b6d-4aad34340379 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1276 microversion: 2.1 time: 0.237953 Oct 18 13:34:48.231825 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1955/4145] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:47 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1276 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:48.238965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-781e498b-03b8-4401-b724-ac38cbee3146 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:48.240452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-781e498b-03b8-4401-b724-ac38cbee3146 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 018714ba-9610-4931-abca-391182bd3665] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:48.253624 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-781e498b-03b8-4401-b724-ac38cbee3146 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 018714ba-9610-4931-abca-391182bd3665 could not be found. Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-781e498b-03b8-4401-b724-ac38cbee3146 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/018714ba-9610-4931-abca-391182bd3665/action HTTP/1.1 Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 14 Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: {"resume": {}} Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 018714ba-9610-4931-abca-391182bd3665 could not be found. Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '018714ba-9610-4931-abca-391182bd3665', 'body': {'resume': {}}} Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 018714ba-9610-4931-abca-391182bd3665 could not be found. Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 018714ba-9610-4931-abca-391182bd3665 could not be found. Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:48.261782 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:48.273871 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:48.273871 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:48.273871 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 018714ba-9610-4931-abca-391182bd3665 could not be found. Oct 18 13:34:48.273871 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:48.273871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-781e498b-03b8-4401-b724-ac38cbee3146 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 018714ba-9610-4931-abca-391182bd3665 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:48.273871 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-781e498b-03b8-4401-b724-ac38cbee3146 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/018714ba-9610-4931-abca-391182bd3665/action" status: 404 len: 111 microversion: 2.1 time: 0.029660 Oct 18 13:34:48.273871 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1956/4146] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:48 2022] POST /compute/v2.1/servers/018714ba-9610-4931-abca-391182bd3665/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:34:48.282182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-1cd406f3-583d-48a7-8932-112fb223c853 req-57e5f0d1-d309-42a3-b131-72b8141218a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-unplugged", "status": "completed", "tag": "8f544790-5930-4353-bbad-e9bb309d7d6c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:48.320039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1cd406f3-583d-48a7-8932-112fb223c853 req-57e5f0d1-d309-42a3-b131-72b8141218a5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:48.321121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1cd406f3-583d-48a7-8932-112fb223c853 req-57e5f0d1-d309-42a3-b131-72b8141218a5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:48.322255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1cd406f3-583d-48a7-8932-112fb223c853 req-57e5f0d1-d309-42a3-b131-72b8141218a5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:48.354498 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-1cd406f3-583d-48a7-8932-112fb223c853 req-57e5f0d1-d309-42a3-b131-72b8141218a5 service nova] Creating event network-vif-unplugged:8f544790-5930-4353-bbad-e9bb309d7d6c for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:34:48.368913 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-1cd406f3-583d-48a7-8932-112fb223c853 req-57e5f0d1-d309-42a3-b131-72b8141218a5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102367 Oct 18 13:34:48.371824 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1957/4147] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:48.377739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2035312c-e841-46f9-a6fc-21f8058e4a1c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:48.389326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16938fe2-7559-4518-8e56-1b724e5b5001 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:48.390113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-16938fe2-7559-4518-8e56-1b724e5b5001 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:48.396520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2035312c-e841-46f9-a6fc-21f8058e4a1c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:48.398017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2035312c-e841-46f9-a6fc-21f8058e4a1c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:48.399221 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2035312c-e841-46f9-a6fc-21f8058e4a1c tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.354996 Oct 18 13:34:48.400113 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2191/4148] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:48 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:48.413724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16938fe2-7559-4518-8e56-1b724e5b5001 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:48.420993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16938fe2-7559-4518-8e56-1b724e5b5001 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:48.420993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16938fe2-7559-4518-8e56-1b724e5b5001 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:48.421535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16938fe2-7559-4518-8e56-1b724e5b5001 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:48.422007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16938fe2-7559-4518-8e56-1b724e5b5001 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:48.427407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16938fe2-7559-4518-8e56-1b724e5b5001 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:48.484771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-67bd6c79-546e-48fb-88fb-4d727af9809d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:48.485422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-67bd6c79-546e-48fb-88fb-4d727af9809d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:48.498350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67bd6c79-546e-48fb-88fb-4d727af9809d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:48.499028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67bd6c79-546e-48fb-88fb-4d727af9809d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:48.499477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67bd6c79-546e-48fb-88fb-4d727af9809d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:48.500195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67bd6c79-546e-48fb-88fb-4d727af9809d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:48.500647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67bd6c79-546e-48fb-88fb-4d727af9809d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:48.501066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67bd6c79-546e-48fb-88fb-4d727af9809d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:48.905611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-16938fe2-7559-4518-8e56-1b724e5b5001 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:48.937563 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-16938fe2-7559-4518-8e56-1b724e5b5001 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.563178 Oct 18 13:34:48.939197 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1958/4149] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:48 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:48.980469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-91c78db7-1402-4991-ba24-890c398899d5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:48.980469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-91c78db7-1402-4991-ba24-890c398899d5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:49.011812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c78db7-1402-4991-ba24-890c398899d5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:49.017929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c78db7-1402-4991-ba24-890c398899d5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:49.019020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c78db7-1402-4991-ba24-890c398899d5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:49.024887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c78db7-1402-4991-ba24-890c398899d5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:49.029999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c78db7-1402-4991-ba24-890c398899d5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:49.031437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91c78db7-1402-4991-ba24-890c398899d5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:49.474915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-91c78db7-1402-4991-ba24-890c398899d5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:49.487897 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-91c78db7-1402-4991-ba24-890c398899d5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.525663 Oct 18 13:34:49.488820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-67bd6c79-546e-48fb-88fb-4d727af9809d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:49.496610 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1959/4150] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:48 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:49.503615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ab28a28b-18fb-4c52-894a-ab022c234a76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:49.504212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ab28a28b-18fb-4c52-894a-ab022c234a76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:49.518085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-67bd6c79-546e-48fb-88fb-4d727af9809d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:49.555003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab28a28b-18fb-4c52-894a-ab022c234a76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:49.556006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab28a28b-18fb-4c52-894a-ab022c234a76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:49.556454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab28a28b-18fb-4c52-894a-ab022c234a76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:49.557155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab28a28b-18fb-4c52-894a-ab022c234a76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:49.557635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab28a28b-18fb-4c52-894a-ab022c234a76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:49.561773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab28a28b-18fb-4c52-894a-ab022c234a76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:49.565440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-67bd6c79-546e-48fb-88fb-4d727af9809d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:49.572931 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-67bd6c79-546e-48fb-88fb-4d727af9809d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2935 microversion: 2.32 time: 1.094505 Oct 18 13:34:49.575861 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2192/4151] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:48 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2935 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:49.596207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d324b232-6973-4155-b127-2043c50f2d66 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:49.597844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d324b232-6973-4155-b127-2043c50f2d66 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:49.630254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d324b232-6973-4155-b127-2043c50f2d66 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:49.631055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d324b232-6973-4155-b127-2043c50f2d66 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:49.636281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d324b232-6973-4155-b127-2043c50f2d66 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:49.637294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d324b232-6973-4155-b127-2043c50f2d66 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:49.637766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d324b232-6973-4155-b127-2043c50f2d66 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:49.638193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d324b232-6973-4155-b127-2043c50f2d66 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.443853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ab28a28b-18fb-4c52-894a-ab022c234a76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:50.458925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ab28a28b-18fb-4c52-894a-ab022c234a76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:50.463210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ab28a28b-18fb-4c52-894a-ab022c234a76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:50.464466 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ab28a28b-18fb-4c52-894a-ab022c234a76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1753 microversion: 2.20 time: 0.964771 Oct 18 13:34:50.481364 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1960/4152] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:49 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1753 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:50.481364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d237a585-b6b8-442e-a192-24ae8138a3b5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:50.481364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d237a585-b6b8-442e-a192-24ae8138a3b5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:50.493305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d237a585-b6b8-442e-a192-24ae8138a3b5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.493828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d237a585-b6b8-442e-a192-24ae8138a3b5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.497678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d237a585-b6b8-442e-a192-24ae8138a3b5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.499434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d237a585-b6b8-442e-a192-24ae8138a3b5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.500124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d237a585-b6b8-442e-a192-24ae8138a3b5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.500633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d237a585-b6b8-442e-a192-24ae8138a3b5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.553570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:50.642454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d324b232-6973-4155-b127-2043c50f2d66 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:50.652788 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d324b232-6973-4155-b127-2043c50f2d66 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1318 microversion: 2.1 time: 1.072970 Oct 18 13:34:50.662779 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2193/4153] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:49 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1318 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:50.672873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d237a585-b6b8-442e-a192-24ae8138a3b5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:50.681853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5f0aef80-485b-4e99-940d-ac9d9984e4e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:50.682853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5f0aef80-485b-4e99-940d-ac9d9984e4e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:50.684724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d237a585-b6b8-442e-a192-24ae8138a3b5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:50.695611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f0aef80-485b-4e99-940d-ac9d9984e4e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.702111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f0aef80-485b-4e99-940d-ac9d9984e4e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.702377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d237a585-b6b8-442e-a192-24ae8138a3b5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:50.703038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f0aef80-485b-4e99-940d-ac9d9984e4e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.703534 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d237a585-b6b8-442e-a192-24ae8138a3b5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.232913 Oct 18 13:34:50.704104 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1961/4154] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:50 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:50.714425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f0aef80-485b-4e99-940d-ac9d9984e4e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.715256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f0aef80-485b-4e99-940d-ac9d9984e4e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.715922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f0aef80-485b-4e99-940d-ac9d9984e4e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.727772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-5dda7e72-d22a-4288-8af5-2a2f5a8cf34e req-717d1093-fa65-45fc-ade5-5f833114a4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-unplugged", "status": "completed", "tag": "1e430439-0ec3-424e-b978-369a2167d04b"}, {"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-unplugged", "status": "completed", "tag": "ff507a08-6d1d-489d-9972-88fe76f7ecb0"}, {"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-unplugged", "status": "completed", "tag": "48ef6290-b5a1-4b6a-bfeb-f1656a0b1efb"}, {"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-unplugged", "status": "completed", "tag": "d6206404-f696-46cc-a70b-84728c57e26e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:50.761902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5dda7e72-d22a-4288-8af5-2a2f5a8cf34e req-717d1093-fa65-45fc-ade5-5f833114a4a6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.765550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5dda7e72-d22a-4288-8af5-2a2f5a8cf34e req-717d1093-fa65-45fc-ade5-5f833114a4a6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.766024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5dda7e72-d22a-4288-8af5-2a2f5a8cf34e req-717d1093-fa65-45fc-ade5-5f833114a4a6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.782259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:50.796978 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-5f0aef80-485b-4e99-940d-ac9d9984e4e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Cannot 'resume' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5f0aef80-485b-4e99-940d-ac9d9984e4e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action HTTP/1.1 Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 14 Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: {"resume": {}} Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: exception: Cannot 'resume' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '6bce6f6b-df28-4c34-a17f-4f18eb67d401', 'body': {'resume': {}}} Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 in vm_state active. Cannot resume while the instance is in this state. Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:50.807657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:50.814886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:50.814886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:50.814886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:50.814886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:50.814886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:50.814886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:34:50.814886 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:50.815779 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-5dda7e72-d22a-4288-8af5-2a2f5a8cf34e req-717d1093-fa65-45fc-ade5-5f833114a4a6 service nova] Creating event network-vif-unplugged:1e430439-0ec3-424e-b978-369a2167d04b for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:34:50.815779 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-5dda7e72-d22a-4288-8af5-2a2f5a8cf34e req-717d1093-fa65-45fc-ade5-5f833114a4a6 service nova] Creating event network-vif-unplugged:ff507a08-6d1d-489d-9972-88fe76f7ecb0 for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:34:50.815779 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-5dda7e72-d22a-4288-8af5-2a2f5a8cf34e req-717d1093-fa65-45fc-ade5-5f833114a4a6 service nova] Creating event network-vif-unplugged:48ef6290-b5a1-4b6a-bfeb-f1656a0b1efb for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:34:50.815779 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-5dda7e72-d22a-4288-8af5-2a2f5a8cf34e req-717d1093-fa65-45fc-ade5-5f833114a4a6 service nova] Creating event network-vif-unplugged:d6206404-f696-46cc-a70b-84728c57e26e for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:34:50.817273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5f0aef80-485b-4e99-940d-ac9d9984e4e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 409 to user: Cannot 'resume' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:50.818649 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5f0aef80-485b-4e99-940d-ac9d9984e4e0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action" status: 409 len: 144 microversion: 2.1 time: 0.154593 Oct 18 13:34:50.827183 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2194/4155] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:50 2022] POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action => generated 144 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:34:50.833884 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-5dda7e72-d22a-4288-8af5-2a2f5a8cf34e req-717d1093-fa65-45fc-ade5-5f833114a4a6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.128499 Oct 18 13:34:50.837933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dac2b9bf-c0ba-4ec7-9b77-dd7e23033878 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:50.837933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dac2b9bf-c0ba-4ec7-9b77-dd7e23033878 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:50.839639 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1962/4156] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:50.854687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dac2b9bf-c0ba-4ec7-9b77-dd7e23033878 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.855290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dac2b9bf-c0ba-4ec7-9b77-dd7e23033878 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.857628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dac2b9bf-c0ba-4ec7-9b77-dd7e23033878 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.857628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dac2b9bf-c0ba-4ec7-9b77-dd7e23033878 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.857628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dac2b9bf-c0ba-4ec7-9b77-dd7e23033878 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.857869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dac2b9bf-c0ba-4ec7-9b77-dd7e23033878 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.860671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d42d7582-ed9e-41e8-8228-9201542d0404 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:50.861470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d42d7582-ed9e-41e8-8228-9201542d0404 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:50.871219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d42d7582-ed9e-41e8-8228-9201542d0404 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.871715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d42d7582-ed9e-41e8-8228-9201542d0404 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.872157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d42d7582-ed9e-41e8-8228-9201542d0404 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:50.875356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d42d7582-ed9e-41e8-8228-9201542d0404 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:50.876037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d42d7582-ed9e-41e8-8228-9201542d0404 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:50.878343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d42d7582-ed9e-41e8-8228-9201542d0404 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:51.212824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=8 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:51.619582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dac2b9bf-c0ba-4ec7-9b77-dd7e23033878 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:51.637294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dac2b9bf-c0ba-4ec7-9b77-dd7e23033878 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:51.646706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d42d7582-ed9e-41e8-8228-9201542d0404 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:51.661451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dac2b9bf-c0ba-4ec7-9b77-dd7e23033878 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:51.666220 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dac2b9bf-c0ba-4ec7-9b77-dd7e23033878 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2914 microversion: 2.32 time: 0.832133 Oct 18 13:34:51.668898 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2195/4157] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:50 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2914 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:51.670446 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d42d7582-ed9e-41e8-8228-9201542d0404 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.821758 Oct 18 13:34:51.672876 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1963/4158] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:50 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:51.687426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b7a501a5-c9b0-458f-bdb3-c21a98839168 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:51.690141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7a501a5-c9b0-458f-bdb3-c21a98839168 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:51.692416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a2d0e9ae-ba8f-4c7d-8d00-b19ecc6281a5 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:51.695499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a2d0e9ae-ba8f-4c7d-8d00-b19ecc6281a5 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:51.706990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7a501a5-c9b0-458f-bdb3-c21a98839168 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:51.709927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7a501a5-c9b0-458f-bdb3-c21a98839168 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:51.709927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7a501a5-c9b0-458f-bdb3-c21a98839168 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:51.711413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2d0e9ae-ba8f-4c7d-8d00-b19ecc6281a5 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:51.712614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7a501a5-c9b0-458f-bdb3-c21a98839168 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:51.713617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7a501a5-c9b0-458f-bdb3-c21a98839168 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:51.714088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2d0e9ae-ba8f-4c7d-8d00-b19ecc6281a5 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:51.715267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2d0e9ae-ba8f-4c7d-8d00-b19ecc6281a5 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:51.715806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7a501a5-c9b0-458f-bdb3-c21a98839168 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:51.720387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2d0e9ae-ba8f-4c7d-8d00-b19ecc6281a5 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:51.721886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2d0e9ae-ba8f-4c7d-8d00-b19ecc6281a5 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:51.723463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2d0e9ae-ba8f-4c7d-8d00-b19ecc6281a5 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:51.998672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7a501a5-c9b0-458f-bdb3-c21a98839168 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:52.015186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7a501a5-c9b0-458f-bdb3-c21a98839168 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:52.022676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7a501a5-c9b0-458f-bdb3-c21a98839168 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:52.024196 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b7a501a5-c9b0-458f-bdb3-c21a98839168 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1753 microversion: 2.20 time: 0.351892 Oct 18 13:34:52.025337 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2196/4159] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:51 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1753 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:52.031755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a5141b82-fa6a-4634-b838-15becbe5d5c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:52.032534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a5141b82-fa6a-4634-b838-15becbe5d5c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:52.039582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5141b82-fa6a-4634-b838-15becbe5d5c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.040354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5141b82-fa6a-4634-b838-15becbe5d5c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.040938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5141b82-fa6a-4634-b838-15becbe5d5c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.041912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5141b82-fa6a-4634-b838-15becbe5d5c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.042504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5141b82-fa6a-4634-b838-15becbe5d5c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.043097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5141b82-fa6a-4634-b838-15becbe5d5c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.132794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a2d0e9ae-ba8f-4c7d-8d00-b19ecc6281a5 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:52.150316 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a2d0e9ae-ba8f-4c7d-8d00-b19ecc6281a5 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1318 microversion: 2.1 time: 0.469094 Oct 18 13:34:52.165564 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1964/4160] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:51 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1318 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:52.178656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ce8d6767-3d5f-4b79-8275-a4af53816d97 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:52.182928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ce8d6767-3d5f-4b79-8275-a4af53816d97 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:52.205641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce8d6767-3d5f-4b79-8275-a4af53816d97 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.206470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce8d6767-3d5f-4b79-8275-a4af53816d97 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.207086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce8d6767-3d5f-4b79-8275-a4af53816d97 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.207973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce8d6767-3d5f-4b79-8275-a4af53816d97 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.208601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce8d6767-3d5f-4b79-8275-a4af53816d97 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.209240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce8d6767-3d5f-4b79-8275-a4af53816d97 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.471528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ce8d6767-3d5f-4b79-8275-a4af53816d97 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:52.484015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ce8d6767-3d5f-4b79-8275-a4af53816d97 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:52.489339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ce8d6767-3d5f-4b79-8275-a4af53816d97 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:52.492996 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ce8d6767-3d5f-4b79-8275-a4af53816d97 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1365 microversion: 2.57 time: 0.326191 Oct 18 13:34:52.509214 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1965/4161] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:52 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1365 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:52.509214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7a08e4a4-8ca4-44a2-aad0-cf76d91d1c9b req-c5e7beca-b553-45d6-9c07-988f61b0e653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-deleted", "tag": "1e430439-0ec3-424e-b978-369a2167d04b"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:52.532633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7a08e4a4-8ca4-44a2-aad0-cf76d91d1c9b req-c5e7beca-b553-45d6-9c07-988f61b0e653 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.533402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7a08e4a4-8ca4-44a2-aad0-cf76d91d1c9b req-c5e7beca-b553-45d6-9c07-988f61b0e653 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.533860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7a08e4a4-8ca4-44a2-aad0-cf76d91d1c9b req-c5e7beca-b553-45d6-9c07-988f61b0e653 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.571421 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7a08e4a4-8ca4-44a2-aad0-cf76d91d1c9b req-c5e7beca-b553-45d6-9c07-988f61b0e653 service nova] Creating event network-vif-deleted:1e430439-0ec3-424e-b978-369a2167d04b for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:34:52.588589 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7a08e4a4-8ca4-44a2-aad0-cf76d91d1c9b req-c5e7beca-b553-45d6-9c07-988f61b0e653 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089067 Oct 18 13:34:52.598697 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1966/4162] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:52.726489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2bc89d4b-db65-466b-b021-1c048aa0ba15 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:52.727302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2bc89d4b-db65-466b-b021-1c048aa0ba15 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:52.738234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2bc89d4b-db65-466b-b021-1c048aa0ba15 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.738730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2bc89d4b-db65-466b-b021-1c048aa0ba15 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.739173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2bc89d4b-db65-466b-b021-1c048aa0ba15 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.739897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2bc89d4b-db65-466b-b021-1c048aa0ba15 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:52.740344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2bc89d4b-db65-466b-b021-1c048aa0ba15 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:52.740766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2bc89d4b-db65-466b-b021-1c048aa0ba15 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:52.873450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a5141b82-fa6a-4634-b838-15becbe5d5c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:52.882530 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a5141b82-fa6a-4634-b838-15becbe5d5c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.855828 Oct 18 13:34:52.893686 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2197/4163] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:52 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:53.052546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f04d7611-8226-4d4e-8322-b5cc4c4437ea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:53.053164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f04d7611-8226-4d4e-8322-b5cc4c4437ea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:53.070046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2bc89d4b-db65-466b-b021-1c048aa0ba15 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:53.074109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f04d7611-8226-4d4e-8322-b5cc4c4437ea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.074911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f04d7611-8226-4d4e-8322-b5cc4c4437ea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.075716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f04d7611-8226-4d4e-8322-b5cc4c4437ea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:53.077016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f04d7611-8226-4d4e-8322-b5cc4c4437ea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.077818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f04d7611-8226-4d4e-8322-b5cc4c4437ea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.078490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f04d7611-8226-4d4e-8322-b5cc4c4437ea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:53.089219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2bc89d4b-db65-466b-b021-1c048aa0ba15 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:53.090659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2bc89d4b-db65-466b-b021-1c048aa0ba15 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:53.093122 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2bc89d4b-db65-466b-b021-1c048aa0ba15 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2753 microversion: 2.32 time: 0.370833 Oct 18 13:34:53.113612 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1967/4164] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:52 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2753 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:53.119152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8b5aa101-6489-476f-b568-855db06963fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8b5aa101-6489-476f-b568-855db06963fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 160 Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": "", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "97315d5a-8b0e-47cc-9e64-1e8e92c88ddc"}]}} Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'server': {'name': '', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'networks': [{'uuid': '97315d5a-8b0e-47cc-9e64-1e8e92c88ddc'}]}}} Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi '' Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:34:53.123888 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:34:53.127972 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:34:53.127972 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:34:53.127972 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:53.127972 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:53.127972 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:53.127972 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:53.127972 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:53.127972 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:53.127972 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:34:53.127972 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:34:53.127972 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:34:53.127972 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:34:53.129720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8b5aa101-6489-476f-b568-855db06963fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:53.130818 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8b5aa101-6489-476f-b568-855db06963fc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.016063 Oct 18 13:34:53.131871 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1968/4165] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:34:53 2022] POST /compute/v2.1/servers => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:34:53.141001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5a33bfcf-1fbe-426a-b59c-f59855c3e6a8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:53.142087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5a33bfcf-1fbe-426a-b59c-f59855c3e6a8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:53.150131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a33bfcf-1fbe-426a-b59c-f59855c3e6a8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.150857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a33bfcf-1fbe-426a-b59c-f59855c3e6a8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.151457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a33bfcf-1fbe-426a-b59c-f59855c3e6a8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:53.152321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a33bfcf-1fbe-426a-b59c-f59855c3e6a8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.153083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a33bfcf-1fbe-426a-b59c-f59855c3e6a8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.154670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a33bfcf-1fbe-426a-b59c-f59855c3e6a8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:53.718476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f04d7611-8226-4d4e-8322-b5cc4c4437ea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:53.728903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5a33bfcf-1fbe-426a-b59c-f59855c3e6a8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:53.733572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f04d7611-8226-4d4e-8322-b5cc4c4437ea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:53.735883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f04d7611-8226-4d4e-8322-b5cc4c4437ea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:53.737485 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f04d7611-8226-4d4e-8322-b5cc4c4437ea tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.688935 Oct 18 13:34:53.737623 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5a33bfcf-1fbe-426a-b59c-f59855c3e6a8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.601503 Oct 18 13:34:53.749314 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1969/4166] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:53 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:53.750678 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2198/4167] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:53 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:53.754644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9b940162-2851-42e5-a68d-7366ba48cd8b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:53.760734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9b940162-2851-42e5-a68d-7366ba48cd8b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:53.778345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b940162-2851-42e5-a68d-7366ba48cd8b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.779448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b940162-2851-42e5-a68d-7366ba48cd8b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.779825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b940162-2851-42e5-a68d-7366ba48cd8b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:53.780328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2a933a7b-4587-4c9d-a1ee-682f6c3ffbc6 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:53.780551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b940162-2851-42e5-a68d-7366ba48cd8b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.781010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b940162-2851-42e5-a68d-7366ba48cd8b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.781473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b940162-2851-42e5-a68d-7366ba48cd8b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:53.782521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2a933a7b-4587-4c9d-a1ee-682f6c3ffbc6 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:53.808496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a933a7b-4587-4c9d-a1ee-682f6c3ffbc6 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.809209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a933a7b-4587-4c9d-a1ee-682f6c3ffbc6 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.812127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a933a7b-4587-4c9d-a1ee-682f6c3ffbc6 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:53.814294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a933a7b-4587-4c9d-a1ee-682f6c3ffbc6 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:53.814881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a933a7b-4587-4c9d-a1ee-682f6c3ffbc6 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:53.816649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a933a7b-4587-4c9d-a1ee-682f6c3ffbc6 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.072627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a933a7b-4587-4c9d-a1ee-682f6c3ffbc6 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.095887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a933a7b-4587-4c9d-a1ee-682f6c3ffbc6 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.099117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a933a7b-4587-4c9d-a1ee-682f6c3ffbc6 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.102530 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2a933a7b-4587-4c9d-a1ee-682f6c3ffbc6 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1371 microversion: 2.57 time: 0.350099 Oct 18 13:34:54.104023 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2199/4168] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:53 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1371 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:54.112820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e41b25a9-df47-419f-a8e7-50bcb1a87abe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:54.114614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e41b25a9-df47-419f-a8e7-50bcb1a87abe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:54.117858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9b940162-2851-42e5-a68d-7366ba48cd8b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.125216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41b25a9-df47-419f-a8e7-50bcb1a87abe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.125932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41b25a9-df47-419f-a8e7-50bcb1a87abe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.126428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41b25a9-df47-419f-a8e7-50bcb1a87abe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.127211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41b25a9-df47-419f-a8e7-50bcb1a87abe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.127921 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9b940162-2851-42e5-a68d-7366ba48cd8b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1318 microversion: 2.1 time: 0.377167 Oct 18 13:34:54.128222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41b25a9-df47-419f-a8e7-50bcb1a87abe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.128514 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1970/4169] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:53 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:54.144681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41b25a9-df47-419f-a8e7-50bcb1a87abe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.147095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-684bfcc1-44f4-4fe7-a802-1b3ce27e19c4 req-a19aa77f-8faf-44e2-9a39-2c64575eb8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "765237b0-fcd2-47bd-8622-0246acfdc44e", "tag": "9ec631ad-25ef-4c88-992a-6add95457b66"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:54.161255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-684bfcc1-44f4-4fe7-a802-1b3ce27e19c4 req-a19aa77f-8faf-44e2-9a39-2c64575eb8a9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.167239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-684bfcc1-44f4-4fe7-a802-1b3ce27e19c4 req-a19aa77f-8faf-44e2-9a39-2c64575eb8a9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.167930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-684bfcc1-44f4-4fe7-a802-1b3ce27e19c4 req-a19aa77f-8faf-44e2-9a39-2c64575eb8a9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.196269 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-684bfcc1-44f4-4fe7-a802-1b3ce27e19c4 req-a19aa77f-8faf-44e2-9a39-2c64575eb8a9 service nova] Creating event network-changed:9ec631ad-25ef-4c88-992a-6add95457b66 for instance 765237b0-fcd2-47bd-8622-0246acfdc44e on n-h1-858384-13 Oct 18 13:34:54.208568 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-684bfcc1-44f4-4fe7-a802-1b3ce27e19c4 req-a19aa77f-8faf-44e2-9a39-2c64575eb8a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072206 Oct 18 13:34:54.209878 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1971/4170] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:54.215399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4c21117e-ea2b-4eb4-8d0d-4639c4729947 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:54.226313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4c21117e-ea2b-4eb4-8d0d-4639c4729947 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:54.234854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c21117e-ea2b-4eb4-8d0d-4639c4729947 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.235346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c21117e-ea2b-4eb4-8d0d-4639c4729947 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.235783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c21117e-ea2b-4eb4-8d0d-4639c4729947 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.236499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c21117e-ea2b-4eb4-8d0d-4639c4729947 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.236936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c21117e-ea2b-4eb4-8d0d-4639c4729947 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.243219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c21117e-ea2b-4eb4-8d0d-4639c4729947 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.555352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e41b25a9-df47-419f-a8e7-50bcb1a87abe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.571948 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e41b25a9-df47-419f-a8e7-50bcb1a87abe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.464444 Oct 18 13:34:54.571948 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2200/4171] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:54 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:54.596789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-176ccbd9-4aa4-4181-a127-7684037776cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:54.599360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-176ccbd9-4aa4-4181-a127-7684037776cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 1fecd1a4-616a-4bd3-899b-58e297c71785] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:54.619720 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-176ccbd9-4aa4-4181-a127-7684037776cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 1fecd1a4-616a-4bd3-899b-58e297c71785 could not be found. Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-176ccbd9-4aa4-4181-a127-7684037776cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/1fecd1a4-616a-4bd3-899b-58e297c71785/action HTTP/1.1 Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 14 Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: {"shelve": {}} Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 1fecd1a4-616a-4bd3-899b-58e297c71785 could not be found. Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '1fecd1a4-616a-4bd3-899b-58e297c71785', 'body': {'shelve': {}}} Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fecd1a4-616a-4bd3-899b-58e297c71785 could not be found. Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fecd1a4-616a-4bd3-899b-58e297c71785 could not be found. Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:34:54.639367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:34:54.643552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:34:54.643552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:34:54.643552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fecd1a4-616a-4bd3-899b-58e297c71785 could not be found. Oct 18 13:34:54.643552 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:34:54.648256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-176ccbd9-4aa4-4181-a127-7684037776cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 1fecd1a4-616a-4bd3-899b-58e297c71785 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:34:54.652795 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-176ccbd9-4aa4-4181-a127-7684037776cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/1fecd1a4-616a-4bd3-899b-58e297c71785/action" status: 404 len: 111 microversion: 2.1 time: 0.057675 Oct 18 13:34:54.657668 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2201/4172] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:54 2022] POST /compute/v2.1/servers/1fecd1a4-616a-4bd3-899b-58e297c71785/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:34:54.683176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8e76bac9-7f27-421c-84db-ecfaa5c8997e req-0c550247-9dfe-4587-a8a3-3b8e9672ad9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-deleted", "tag": "48ef6290-b5a1-4b6a-bfeb-f1656a0b1efb"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:54.709417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8e76bac9-7f27-421c-84db-ecfaa5c8997e req-0c550247-9dfe-4587-a8a3-3b8e9672ad9f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.711473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8e76bac9-7f27-421c-84db-ecfaa5c8997e req-0c550247-9dfe-4587-a8a3-3b8e9672ad9f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.713537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8e76bac9-7f27-421c-84db-ecfaa5c8997e req-0c550247-9dfe-4587-a8a3-3b8e9672ad9f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.722158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:54.741222 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8e76bac9-7f27-421c-84db-ecfaa5c8997e req-0c550247-9dfe-4587-a8a3-3b8e9672ad9f service nova] Creating event network-vif-deleted:48ef6290-b5a1-4b6a-bfeb-f1656a0b1efb for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:34:54.754921 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8e76bac9-7f27-421c-84db-ecfaa5c8997e req-0c550247-9dfe-4587-a8a3-3b8e9672ad9f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095998 Oct 18 13:34:54.756390 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2202/4173] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:54.762509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e9a5a12f-8cc9-447f-8ca8-c778ccabb9e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:54.763748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e9a5a12f-8cc9-447f-8ca8-c778ccabb9e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:54.787099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4c21117e-ea2b-4eb4-8d0d-4639c4729947 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.798832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9a5a12f-8cc9-447f-8ca8-c778ccabb9e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.799573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9a5a12f-8cc9-447f-8ca8-c778ccabb9e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.801889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9a5a12f-8cc9-447f-8ca8-c778ccabb9e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.802063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4c21117e-ea2b-4eb4-8d0d-4639c4729947 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.804975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9a5a12f-8cc9-447f-8ca8-c778ccabb9e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.805061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9a5a12f-8cc9-447f-8ca8-c778ccabb9e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.807245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4c21117e-ea2b-4eb4-8d0d-4639c4729947 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:54.809152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9a5a12f-8cc9-447f-8ca8-c778ccabb9e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.810964 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4c21117e-ea2b-4eb4-8d0d-4639c4729947 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2706 microversion: 2.32 time: 0.598225 Oct 18 13:34:54.834138 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1972/4174] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:54 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2706 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:54.843671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f609bd93-eaeb-429a-a9c9-7319d8ebe8ae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:54.849963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f609bd93-eaeb-429a-a9c9-7319d8ebe8ae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:54.866952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f609bd93-eaeb-429a-a9c9-7319d8ebe8ae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.868408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f609bd93-eaeb-429a-a9c9-7319d8ebe8ae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.870353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f609bd93-eaeb-429a-a9c9-7319d8ebe8ae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:54.871563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f609bd93-eaeb-429a-a9c9-7319d8ebe8ae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:54.872245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f609bd93-eaeb-429a-a9c9-7319d8ebe8ae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:54.873084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f609bd93-eaeb-429a-a9c9-7319d8ebe8ae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:55.250684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e9a5a12f-8cc9-447f-8ca8-c778ccabb9e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:55.269478 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e9a5a12f-8cc9-447f-8ca8-c778ccabb9e9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.511550 Oct 18 13:34:55.278406 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2203/4175] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:54 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:55.290653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-62c8d455-e1ce-4db5-97af-c734606b0430 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:55.291357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-62c8d455-e1ce-4db5-97af-c734606b0430 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:55.301974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62c8d455-e1ce-4db5-97af-c734606b0430 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:55.308127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62c8d455-e1ce-4db5-97af-c734606b0430 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:55.308743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62c8d455-e1ce-4db5-97af-c734606b0430 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:55.311557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62c8d455-e1ce-4db5-97af-c734606b0430 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:55.312296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62c8d455-e1ce-4db5-97af-c734606b0430 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:55.313451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62c8d455-e1ce-4db5-97af-c734606b0430 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:55.399582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f609bd93-eaeb-429a-a9c9-7319d8ebe8ae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:55.412909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f609bd93-eaeb-429a-a9c9-7319d8ebe8ae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:55.420294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f609bd93-eaeb-429a-a9c9-7319d8ebe8ae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:55.424979 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f609bd93-eaeb-429a-a9c9-7319d8ebe8ae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.587636 Oct 18 13:34:55.431816 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1973/4176] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:54 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:55.449107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-18a30037-33f8-4c87-a630-214a80d673d7 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:55.449978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-18a30037-33f8-4c87-a630-214a80d673d7 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:55.457152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18a30037-33f8-4c87-a630-214a80d673d7 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:55.457924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18a30037-33f8-4c87-a630-214a80d673d7 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:55.458563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18a30037-33f8-4c87-a630-214a80d673d7 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:55.459492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18a30037-33f8-4c87-a630-214a80d673d7 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:55.460158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18a30037-33f8-4c87-a630-214a80d673d7 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:55.460762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18a30037-33f8-4c87-a630-214a80d673d7 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:55.519344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-62c8d455-e1ce-4db5-97af-c734606b0430 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:55.532475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-62c8d455-e1ce-4db5-97af-c734606b0430 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:55.534451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-62c8d455-e1ce-4db5-97af-c734606b0430 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:55.536543 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-62c8d455-e1ce-4db5-97af-c734606b0430 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1356 microversion: 2.57 time: 0.256738 Oct 18 13:34:55.556933 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2204/4177] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:55 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1356 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:55.572216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1190286c-8130-4e51-8609-f08a597eb93b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:55.573837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1190286c-8130-4e51-8609-f08a597eb93b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:55.591595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1190286c-8130-4e51-8609-f08a597eb93b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:55.592473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1190286c-8130-4e51-8609-f08a597eb93b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:55.593404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1190286c-8130-4e51-8609-f08a597eb93b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:55.594364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1190286c-8130-4e51-8609-f08a597eb93b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:55.595577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1190286c-8130-4e51-8609-f08a597eb93b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:55.596251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1190286c-8130-4e51-8609-f08a597eb93b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:55.964884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1190286c-8130-4e51-8609-f08a597eb93b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:55.985222 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1190286c-8130-4e51-8609-f08a597eb93b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.425267 Oct 18 13:34:56.003424 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2205/4178] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:55 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:56.014651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-321e28ae-52b3-43f3-aa5f-7645dd401b2f tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:56.015542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-321e28ae-52b3-43f3-aa5f-7645dd401b2f tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:56.034466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-321e28ae-52b3-43f3-aa5f-7645dd401b2f tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:56.035268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-321e28ae-52b3-43f3-aa5f-7645dd401b2f tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:56.035709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-321e28ae-52b3-43f3-aa5f-7645dd401b2f tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:56.036839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-321e28ae-52b3-43f3-aa5f-7645dd401b2f tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:56.037976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-321e28ae-52b3-43f3-aa5f-7645dd401b2f tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:56.039380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-321e28ae-52b3-43f3-aa5f-7645dd401b2f tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:56.135921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-321e28ae-52b3-43f3-aa5f-7645dd401b2f tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:34:56.328573 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-321e28ae-52b3-43f3-aa5f-7645dd401b2f tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 204 len: 0 microversion: 2.57 time: 0.323420 Oct 18 13:34:56.333324 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2206/4179] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:34:56 2022] DELETE /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:34:56.349736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-22cf8592-8e73-4f2e-bf07-0455d3ed8d67 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:56.350442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-22cf8592-8e73-4f2e-bf07-0455d3ed8d67 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:56.370858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22cf8592-8e73-4f2e-bf07-0455d3ed8d67 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:56.371918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22cf8592-8e73-4f2e-bf07-0455d3ed8d67 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:56.374334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22cf8592-8e73-4f2e-bf07-0455d3ed8d67 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:56.375488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22cf8592-8e73-4f2e-bf07-0455d3ed8d67 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:56.376322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22cf8592-8e73-4f2e-bf07-0455d3ed8d67 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:56.377871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22cf8592-8e73-4f2e-bf07-0455d3ed8d67 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:56.451685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-18a30037-33f8-4c87-a630-214a80d673d7 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:56.475852 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-18a30037-33f8-4c87-a630-214a80d673d7 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1318 microversion: 2.1 time: 1.042291 Oct 18 13:34:56.476546 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1974/4180] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:55 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1318 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:56.485041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f8d7290c-f7f7-4e84-8fbc-0d9a902cd0b0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:56.488201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f8d7290c-f7f7-4e84-8fbc-0d9a902cd0b0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:56.501083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8d7290c-f7f7-4e84-8fbc-0d9a902cd0b0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:56.503164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8d7290c-f7f7-4e84-8fbc-0d9a902cd0b0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:56.503848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8d7290c-f7f7-4e84-8fbc-0d9a902cd0b0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:56.509917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8d7290c-f7f7-4e84-8fbc-0d9a902cd0b0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:56.510526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8d7290c-f7f7-4e84-8fbc-0d9a902cd0b0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:56.511184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8d7290c-f7f7-4e84-8fbc-0d9a902cd0b0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:56.542537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-f8d7290c-f7f7-4e84-8fbc-0d9a902cd0b0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lazy-loading 'flavor' on Instance uuid 6bce6f6b-df28-4c34-a17f-4f18eb67d401 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:34:56.818806 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f8d7290c-f7f7-4e84-8fbc-0d9a902cd0b0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action" status: 202 len: 0 microversion: 2.1 time: 0.339457 Oct 18 13:34:56.819570 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1975/4181] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:34:56 2022] POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:34:56.832187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-14c57988-74c4-4337-bf5e-7b33c5eba44d tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:56.832904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-14c57988-74c4-4337-bf5e-7b33c5eba44d tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:56.862666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14c57988-74c4-4337-bf5e-7b33c5eba44d tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:56.863537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14c57988-74c4-4337-bf5e-7b33c5eba44d tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:56.863537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14c57988-74c4-4337-bf5e-7b33c5eba44d tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:56.864245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14c57988-74c4-4337-bf5e-7b33c5eba44d tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:56.878744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14c57988-74c4-4337-bf5e-7b33c5eba44d tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:56.879329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14c57988-74c4-4337-bf5e-7b33c5eba44d tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:56.947672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-22cf8592-8e73-4f2e-bf07-0455d3ed8d67 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:56.957809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-22cf8592-8e73-4f2e-bf07-0455d3ed8d67 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:56.959318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-22cf8592-8e73-4f2e-bf07-0455d3ed8d67 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:56.968243 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-22cf8592-8e73-4f2e-bf07-0455d3ed8d67 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2546 microversion: 2.32 time: 0.633384 Oct 18 13:34:56.971280 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2207/4182] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:56 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2546 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:56.983260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d5771dce-ea1b-4419-b2c3-39169184dae9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:56.986867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d5771dce-ea1b-4419-b2c3-39169184dae9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:57.007855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5771dce-ea1b-4419-b2c3-39169184dae9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.008734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5771dce-ea1b-4419-b2c3-39169184dae9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.011974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5771dce-ea1b-4419-b2c3-39169184dae9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.012836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5771dce-ea1b-4419-b2c3-39169184dae9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.013965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5771dce-ea1b-4419-b2c3-39169184dae9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.016396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5771dce-ea1b-4419-b2c3-39169184dae9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.232910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-14c57988-74c4-4337-bf5e-7b33c5eba44d tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:57.244265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-14c57988-74c4-4337-bf5e-7b33c5eba44d tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:57.250062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-14c57988-74c4-4337-bf5e-7b33c5eba44d tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:57.251377 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-14c57988-74c4-4337-bf5e-7b33c5eba44d tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1362 microversion: 2.57 time: 0.430448 Oct 18 13:34:57.253500 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1976/4183] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:56 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1362 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:57.269719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e7f507d0-ac6e-48f5-b060-ae5af184cc55 req-f304b86d-1562-4f58-8d9d-3fd519c514ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa292c2-3801-4d84-b31a-4d3eeeb41818", "tag": "8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:57.290022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e7f507d0-ac6e-48f5-b060-ae5af184cc55 req-f304b86d-1562-4f58-8d9d-3fd519c514ea service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.290122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e7f507d0-ac6e-48f5-b060-ae5af184cc55 req-f304b86d-1562-4f58-8d9d-3fd519c514ea service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.290532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e7f507d0-ac6e-48f5-b060-ae5af184cc55 req-f304b86d-1562-4f58-8d9d-3fd519c514ea service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.318113 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e7f507d0-ac6e-48f5-b060-ae5af184cc55 req-f304b86d-1562-4f58-8d9d-3fd519c514ea service nova] Creating event network-changed:8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa for instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 on n-h1-858384-13 Oct 18 13:34:57.327232 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e7f507d0-ac6e-48f5-b060-ae5af184cc55 req-f304b86d-1562-4f58-8d9d-3fd519c514ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072291 Oct 18 13:34:57.330395 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1977/4184] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:57.341740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f11ea517-696b-4908-8ac4-849c97a1a661 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:57.342483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f11ea517-696b-4908-8ac4-849c97a1a661 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:57.358133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f11ea517-696b-4908-8ac4-849c97a1a661 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.361859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f11ea517-696b-4908-8ac4-849c97a1a661 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.362317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f11ea517-696b-4908-8ac4-849c97a1a661 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.363067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f11ea517-696b-4908-8ac4-849c97a1a661 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.363526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f11ea517-696b-4908-8ac4-849c97a1a661 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.363958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f11ea517-696b-4908-8ac4-849c97a1a661 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.371271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d5771dce-ea1b-4419-b2c3-39169184dae9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:57.386594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d5771dce-ea1b-4419-b2c3-39169184dae9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:57.389320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d5771dce-ea1b-4419-b2c3-39169184dae9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:57.390769 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d5771dce-ea1b-4419-b2c3-39169184dae9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.418536 Oct 18 13:34:57.407661 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2208/4185] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:56 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:57.423974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-03af6884-fa8b-4ee7-8d8c-19cec824125c req-fbf8e5c8-94cc-48ee-85b7-8dfc8d8fde99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-deleted", "tag": "ff507a08-6d1d-489d-9972-88fe76f7ecb0"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:57.434455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-03af6884-fa8b-4ee7-8d8c-19cec824125c req-fbf8e5c8-94cc-48ee-85b7-8dfc8d8fde99 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.435316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-03af6884-fa8b-4ee7-8d8c-19cec824125c req-fbf8e5c8-94cc-48ee-85b7-8dfc8d8fde99 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.436251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-03af6884-fa8b-4ee7-8d8c-19cec824125c req-fbf8e5c8-94cc-48ee-85b7-8dfc8d8fde99 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.485683 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-03af6884-fa8b-4ee7-8d8c-19cec824125c req-fbf8e5c8-94cc-48ee-85b7-8dfc8d8fde99 service nova] Creating event network-vif-deleted:ff507a08-6d1d-489d-9972-88fe76f7ecb0 for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:34:57.502562 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-03af6884-fa8b-4ee7-8d8c-19cec824125c req-fbf8e5c8-94cc-48ee-85b7-8dfc8d8fde99 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093259 Oct 18 13:34:57.503572 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2209/4186] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:34:57.525041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6c21ca2c-f375-4da5-bd5e-9a83271f1858 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:57.526161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6c21ca2c-f375-4da5-bd5e-9a83271f1858 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:57.539108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c21ca2c-f375-4da5-bd5e-9a83271f1858 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.541131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c21ca2c-f375-4da5-bd5e-9a83271f1858 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.541872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c21ca2c-f375-4da5-bd5e-9a83271f1858 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.543737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c21ca2c-f375-4da5-bd5e-9a83271f1858 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:57.544446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c21ca2c-f375-4da5-bd5e-9a83271f1858 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:57.545155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c21ca2c-f375-4da5-bd5e-9a83271f1858 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:57.916487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f11ea517-696b-4908-8ac4-849c97a1a661 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:57.929843 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f11ea517-696b-4908-8ac4-849c97a1a661 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1512 microversion: 2.1 time: 0.598138 Oct 18 13:34:57.941617 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1978/4187] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:57 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1512 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:57.999532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-770288a1-5d1f-4178-8032-a67b3adea14b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:58.000220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-770288a1-5d1f-4178-8032-a67b3adea14b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:58.009976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-770288a1-5d1f-4178-8032-a67b3adea14b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:58.010456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-770288a1-5d1f-4178-8032-a67b3adea14b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:58.010892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-770288a1-5d1f-4178-8032-a67b3adea14b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:58.016457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-770288a1-5d1f-4178-8032-a67b3adea14b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:58.017136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-770288a1-5d1f-4178-8032-a67b3adea14b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:58.021084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-770288a1-5d1f-4178-8032-a67b3adea14b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:58.106525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6c21ca2c-f375-4da5-bd5e-9a83271f1858 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:58.115488 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6c21ca2c-f375-4da5-bd5e-9a83271f1858 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1318 microversion: 2.1 time: 0.609708 Oct 18 13:34:58.120371 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2210/4188] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:57 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1318 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:58.279211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4bfadb5c-0ffa-4b80-b5a1-f3d088c5a3c5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:58.279834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4bfadb5c-0ffa-4b80-b5a1-f3d088c5a3c5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:58.292273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bfadb5c-0ffa-4b80-b5a1-f3d088c5a3c5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:58.292789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bfadb5c-0ffa-4b80-b5a1-f3d088c5a3c5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:58.293289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bfadb5c-0ffa-4b80-b5a1-f3d088c5a3c5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:58.300548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bfadb5c-0ffa-4b80-b5a1-f3d088c5a3c5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:58.301081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bfadb5c-0ffa-4b80-b5a1-f3d088c5a3c5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:58.301561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4bfadb5c-0ffa-4b80-b5a1-f3d088c5a3c5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:58.580932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-770288a1-5d1f-4178-8032-a67b3adea14b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:58.611448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-770288a1-5d1f-4178-8032-a67b3adea14b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:58.624302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-770288a1-5d1f-4178-8032-a67b3adea14b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:58.626010 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-770288a1-5d1f-4178-8032-a67b3adea14b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2341 microversion: 2.32 time: 0.631114 Oct 18 13:34:58.629277 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1979/4189] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:57 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2341 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:58.651281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-039be17b-47fb-4506-8aa3-ad6fe9255c46 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:58.652313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-039be17b-47fb-4506-8aa3-ad6fe9255c46 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:58.661360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-039be17b-47fb-4506-8aa3-ad6fe9255c46 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:58.662872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-039be17b-47fb-4506-8aa3-ad6fe9255c46 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:58.663526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-039be17b-47fb-4506-8aa3-ad6fe9255c46 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:58.664978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-039be17b-47fb-4506-8aa3-ad6fe9255c46 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:58.665686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-039be17b-47fb-4506-8aa3-ad6fe9255c46 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:58.666497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-039be17b-47fb-4506-8aa3-ad6fe9255c46 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:58.690587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:59.040830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4bfadb5c-0ffa-4b80-b5a1-f3d088c5a3c5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:59.057031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4bfadb5c-0ffa-4b80-b5a1-f3d088c5a3c5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:59.058746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4bfadb5c-0ffa-4b80-b5a1-f3d088c5a3c5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9253cfaa9e40464e8d3f92fb35352563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d68292a275c4db3a8452ce9bc373452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:59.060152 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4bfadb5c-0ffa-4b80-b5a1-f3d088c5a3c5 tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 200 len: 1362 microversion: 2.57 time: 0.785223 Oct 18 13:34:59.085605 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2211/4190] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:58 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 1362 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:34:59.228810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-039be17b-47fb-4506-8aa3-ad6fe9255c46 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:59.276195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-039be17b-47fb-4506-8aa3-ad6fe9255c46 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:59.278489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-039be17b-47fb-4506-8aa3-ad6fe9255c46 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:59.282656 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-039be17b-47fb-4506-8aa3-ad6fe9255c46 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.641370 Oct 18 13:34:59.284614 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1980/4191] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:34:58 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:34:59.291202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1a99a7cb-6dd8-40cd-bf76-3d34ff00b4ba tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:59.292105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1a99a7cb-6dd8-40cd-bf76-3d34ff00b4ba tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:59.300202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a99a7cb-6dd8-40cd-bf76-3d34ff00b4ba tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:59.301110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a99a7cb-6dd8-40cd-bf76-3d34ff00b4ba tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:59.301768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a99a7cb-6dd8-40cd-bf76-3d34ff00b4ba tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:59.302845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a99a7cb-6dd8-40cd-bf76-3d34ff00b4ba tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:59.303440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a99a7cb-6dd8-40cd-bf76-3d34ff00b4ba tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:59.304006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a99a7cb-6dd8-40cd-bf76-3d34ff00b4ba tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:59.332710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1070973985", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": "none"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:34:59.467476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:34:59.468189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:34:59.468968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:34:59.471246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:34:59.471872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:34:59.483319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:34:59.497227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:59.498947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:59.499555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:59.500656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:59.503770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:59.504550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:59.535880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Getting quotas for project 5dbb88c7848344559fba9e894c0118e2. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:34:59.545395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Getting quotas for user 5bb5ca1367394a30aef76618ec31ad04 and project 5dbb88c7848344559fba9e894c0118e2. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:34:59.562116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:34:59.566560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: 8ef39d78-9ea7-4121-a6f4-18019e156568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:34:59.659876 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f7350ec6-afb6-4102-b40a-7aacf5f7b31e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.572272 Oct 18 13:34:59.667497 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2212/4192] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:34:59.675812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2699bf09-e5cb-4364-bcc8-31036db5d892 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:34:59.688950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2699bf09-e5cb-4364-bcc8-31036db5d892 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:34:59.702905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2699bf09-e5cb-4364-bcc8-31036db5d892 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:59.703734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2699bf09-e5cb-4364-bcc8-31036db5d892 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:59.704189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2699bf09-e5cb-4364-bcc8-31036db5d892 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:59.705543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2699bf09-e5cb-4364-bcc8-31036db5d892 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:34:59.706108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2699bf09-e5cb-4364-bcc8-31036db5d892 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:34:59.706554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2699bf09-e5cb-4364-bcc8-31036db5d892 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:34:59.941356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1a99a7cb-6dd8-40cd-bf76-3d34ff00b4ba tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:34:59.957273 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1a99a7cb-6dd8-40cd-bf76-3d34ff00b4ba tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1512 microversion: 2.1 time: 0.671191 Oct 18 13:34:59.960329 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1981/4193] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:59 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1512 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:34:59.981578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ca845529-71ef-4811-9aff-53ad56a27125 req-a7dfa82e-856b-48fb-b0a9-46ef212269ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-deleted", "tag": "d6206404-f696-46cc-a70b-84728c57e26e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:00.006259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ca845529-71ef-4811-9aff-53ad56a27125 req-a7dfa82e-856b-48fb-b0a9-46ef212269ee service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.011588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ca845529-71ef-4811-9aff-53ad56a27125 req-a7dfa82e-856b-48fb-b0a9-46ef212269ee service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.012144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ca845529-71ef-4811-9aff-53ad56a27125 req-a7dfa82e-856b-48fb-b0a9-46ef212269ee service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.023270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2699bf09-e5cb-4364-bcc8-31036db5d892 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.031822 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ca845529-71ef-4811-9aff-53ad56a27125 req-a7dfa82e-856b-48fb-b0a9-46ef212269ee service nova] Creating event network-vif-deleted:d6206404-f696-46cc-a70b-84728c57e26e for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:35:00.038963 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2699bf09-e5cb-4364-bcc8-31036db5d892 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1318 microversion: 2.1 time: 0.363968 Oct 18 13:35:00.040645 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2213/4194] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:34:59 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:00.052716 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ca845529-71ef-4811-9aff-53ad56a27125 req-a7dfa82e-856b-48fb-b0a9-46ef212269ee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089015 Oct 18 13:35:00.055846 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1982/4195] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:00.066145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0f926c1d-d170-4952-8f78-07037bf36aaf tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:00.070435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0f926c1d-d170-4952-8f78-07037bf36aaf tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: 8ef39d78-9ea7-4121-a6f4-18019e156568] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:00.093963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53a80a7e-69da-450f-8464-b9ff229973ee tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:00.097031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53a80a7e-69da-450f-8464-b9ff229973ee tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:00.126249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a80a7e-69da-450f-8464-b9ff229973ee tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.127320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a80a7e-69da-450f-8464-b9ff229973ee tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.130328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a80a7e-69da-450f-8464-b9ff229973ee tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.132834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a80a7e-69da-450f-8464-b9ff229973ee tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.134634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a80a7e-69da-450f-8464-b9ff229973ee tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.135297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a80a7e-69da-450f-8464-b9ff229973ee tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.227903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0f926c1d-d170-4952-8f78-07037bf36aaf tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.241166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0f926c1d-d170-4952-8f78-07037bf36aaf tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.243285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0f926c1d-d170-4952-8f78-07037bf36aaf tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.244651 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0f926c1d-d170-4952-8f78-07037bf36aaf tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/8ef39d78-9ea7-4121-a6f4-18019e156568" status: 200 len: 1278 microversion: 2.47 time: 0.185586 Oct 18 13:35:00.248994 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1983/4196] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:00 2022] GET /compute/v2.1/servers/8ef39d78-9ea7-4121-a6f4-18019e156568 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:00.261063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd623a84-7e11-4740-b0a1-77f7a37510ad tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:00.261936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fd623a84-7e11-4740-b0a1-77f7a37510ad tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] [instance: 9b7942b2-7a7e-4386-8ea7-ed2d52112728] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:00.289722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd623a84-7e11-4740-b0a1-77f7a37510ad tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.290218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd623a84-7e11-4740-b0a1-77f7a37510ad tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.290773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd623a84-7e11-4740-b0a1-77f7a37510ad tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.291712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd623a84-7e11-4740-b0a1-77f7a37510ad tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.292313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd623a84-7e11-4740-b0a1-77f7a37510ad tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.292885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd623a84-7e11-4740-b0a1-77f7a37510ad tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.325242 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-fd623a84-7e11-4740-b0a1-77f7a37510ad tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] HTTP exception thrown: Instance 9b7942b2-7a7e-4386-8ea7-ed2d52112728 could not be found. Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd623a84-7e11-4740-b0a1-77f7a37510ad tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Request method failure captured: Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 HTTP/1.1 Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqtXjmqA9ijzD2aekPstUbvSnvaVQmwqCg79dPuVtSWn7UPm2eyRqyUqCVwV-bszqjnAKwoVCnOwzj96tjY03cgf0WQiYRBM3G9XNjTcCbd2ql7Hwcy2aOTiC34tb10FDtfo8jvJmWOondGZG830R9_5Y29wiVrgm5zJso7JtgEDGRI Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.57 Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 8d68292a275c4db3a8452ce9bc373452 Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerShowV257Test-556761270 Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8d68292a275c4db3a8452ce9bc373452"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8d68292a275c4db3a8452ce9bc373452"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8d68292a275c4db3a8452ce9bc373452"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8d68292a275c4db3a8452ce9bc373452"}]}] Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerShowV257Test-556761270 Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 8d68292a275c4db3a8452ce9bc373452 Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerShowV257Test-556761270 Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerShowV257Test-556761270-project Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9253cfaa9e40464e8d3f92fb35352563 Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerShowV257Test-556761270-project Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 9b7942b2-7a7e-4386-8ea7-ed2d52112728 could not be found. Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '9b7942b2-7a7e-4386-8ea7-ed2d52112728'} Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7942b2-7a7e-4386-8ea7-ed2d52112728 could not be found. Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7942b2-7a7e-4386-8ea7-ed2d52112728 could not be found. Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:00.332482 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:00.336919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:00.336919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:00.336919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:00.336919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:00.336919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:00.336919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7942b2-7a7e-4386-8ea7-ed2d52112728 could not be found. Oct 18 13:35:00.336919 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:00.338413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd623a84-7e11-4740-b0a1-77f7a37510ad tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] Returning 404 to user: Instance 9b7942b2-7a7e-4386-8ea7-ed2d52112728 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:00.339446 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fd623a84-7e11-4740-b0a1-77f7a37510ad tempest-ServerShowV257Test-556761270 tempest-ServerShowV257Test-556761270-project] 10.222.0.40 "GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728" status: 404 len: 111 microversion: 2.57 time: 0.089143 Oct 18 13:35:00.341832 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1984/4197] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:00 2022] GET /compute/v2.1/servers/9b7942b2-7a7e-4386-8ea7-ed2d52112728 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:35:00.351563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a80086cc-efd2-4972-886e-5569294d04b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:00.356424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a80086cc-efd2-4972-886e-5569294d04b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:00.367913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a80086cc-efd2-4972-886e-5569294d04b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.368755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a80086cc-efd2-4972-886e-5569294d04b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.369846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a80086cc-efd2-4972-886e-5569294d04b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.371192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a80086cc-efd2-4972-886e-5569294d04b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.374418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a80086cc-efd2-4972-886e-5569294d04b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.375072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a80086cc-efd2-4972-886e-5569294d04b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.531552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-53a80a7e-69da-450f-8464-b9ff229973ee tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.547484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-53a80a7e-69da-450f-8464-b9ff229973ee tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.550212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-53a80a7e-69da-450f-8464-b9ff229973ee tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:00.554334 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53a80a7e-69da-450f-8464-b9ff229973ee tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2227 microversion: 2.32 time: 0.512429 Oct 18 13:35:00.557288 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2214/4198] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:00 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2227 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:00.566215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1657680912", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": "none"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:00.722035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:35:00.722474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:35:00.723053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:35:00.723465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:35:00.723876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:35:00.747615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.748439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.749199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.750089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.750878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.753822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:00.793212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Getting quotas for project 5dbb88c7848344559fba9e894c0118e2. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:35:00.801570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Getting quotas for user 5bb5ca1367394a30aef76618ec31ad04 and project 5dbb88c7848344559fba9e894c0118e2. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:35:00.825145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:35:00.828462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:35:00.927072 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c01a0010-0859-4903-9e96-b25d456e7a84 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.368490 Oct 18 13:35:00.930713 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2215/4199] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:35:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 373 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:35:00.942596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-bce83bc3-8077-4355-a982-ea0bfcf5b9a3 req-be16789a-3ccd-459d-87fe-4defcba1a89e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "765237b0-fcd2-47bd-8622-0246acfdc44e", "name": "network-vif-plugged", "status": "completed", "tag": "9ec631ad-25ef-4c88-992a-6add95457b66"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:00.989250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bce83bc3-8077-4355-a982-ea0bfcf5b9a3 req-be16789a-3ccd-459d-87fe-4defcba1a89e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:00.993706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bce83bc3-8077-4355-a982-ea0bfcf5b9a3 req-be16789a-3ccd-459d-87fe-4defcba1a89e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:00.994095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bce83bc3-8077-4355-a982-ea0bfcf5b9a3 req-be16789a-3ccd-459d-87fe-4defcba1a89e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:01.032644 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-bce83bc3-8077-4355-a982-ea0bfcf5b9a3 req-be16789a-3ccd-459d-87fe-4defcba1a89e service nova] Creating event network-vif-plugged:9ec631ad-25ef-4c88-992a-6add95457b66 for instance 765237b0-fcd2-47bd-8622-0246acfdc44e on n-h1-858384-13 Oct 18 13:35:01.054358 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-bce83bc3-8077-4355-a982-ea0bfcf5b9a3 req-be16789a-3ccd-459d-87fe-4defcba1a89e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122050 Oct 18 13:35:01.056277 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2216/4200] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:01.075129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-09dbe8b6-0a61-4c61-be28-8cc10036f35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:01.081065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-09dbe8b6-0a61-4c61-be28-8cc10036f35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:01.213268 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-09dbe8b6-0a61-4c61-be28-8cc10036f35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "PUT /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 992 microversion: 2.47 time: 0.147903 Oct 18 13:35:01.215634 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2217/4201] 10.222.0.40 () {62 vars in 1297 bytes} [Tue Oct 18 13:35:01 2022] PUT /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 992 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:35:01.224996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c6ce97a3-0365-438a-b716-d8071261157d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:01.226129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c6ce97a3-0365-438a-b716-d8071261157d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:01.237237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6ce97a3-0365-438a-b716-d8071261157d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:01.237888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6ce97a3-0365-438a-b716-d8071261157d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:01.238393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6ce97a3-0365-438a-b716-d8071261157d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:01.239416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6ce97a3-0365-438a-b716-d8071261157d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:01.240719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6ce97a3-0365-438a-b716-d8071261157d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:01.241451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6ce97a3-0365-438a-b716-d8071261157d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:01.499449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a80086cc-efd2-4972-886e-5569294d04b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:01.534411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a80086cc-efd2-4972-886e-5569294d04b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:01.542850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a80086cc-efd2-4972-886e-5569294d04b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:01.553983 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a80086cc-efd2-4972-886e-5569294d04b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 1.206844 Oct 18 13:35:01.571703 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1985/4202] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:00 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:01.584271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-19d94d7f-d3dd-4c0c-b6f0-8d5ff22b053b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:01.591541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-19d94d7f-d3dd-4c0c-b6f0-8d5ff22b053b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:01.628074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19d94d7f-d3dd-4c0c-b6f0-8d5ff22b053b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:01.633634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19d94d7f-d3dd-4c0c-b6f0-8d5ff22b053b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:01.638250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19d94d7f-d3dd-4c0c-b6f0-8d5ff22b053b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:01.643132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19d94d7f-d3dd-4c0c-b6f0-8d5ff22b053b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:01.648568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19d94d7f-d3dd-4c0c-b6f0-8d5ff22b053b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:01.651002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19d94d7f-d3dd-4c0c-b6f0-8d5ff22b053b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:01.955515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c6ce97a3-0365-438a-b716-d8071261157d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:01.970447 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c6ce97a3-0365-438a-b716-d8071261157d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1512 microversion: 2.1 time: 0.748170 Oct 18 13:35:01.972960 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2218/4203] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:01 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1512 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:01.985419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c40f6eb0-6c26-45e4-876e-93c0b81f1e15 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:01.988140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c40f6eb0-6c26-45e4-876e-93c0b81f1e15 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:02.289715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c40f6eb0-6c26-45e4-876e-93c0b81f1e15 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:02.305830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c40f6eb0-6c26-45e4-876e-93c0b81f1e15 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:02.321153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c40f6eb0-6c26-45e4-876e-93c0b81f1e15 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:02.322958 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c40f6eb0-6c26-45e4-876e-93c0b81f1e15 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1278 microversion: 2.47 time: 0.348570 Oct 18 13:35:02.331327 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2219/4204] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:01 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1278 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:02.338911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b3542cf9-93b3-4e49-96cc-b2ca12befe35 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:02.345915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b3542cf9-93b3-4e49-96cc-b2ca12befe35 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:02.371782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3542cf9-93b3-4e49-96cc-b2ca12befe35 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:02.373558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3542cf9-93b3-4e49-96cc-b2ca12befe35 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:02.374199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3542cf9-93b3-4e49-96cc-b2ca12befe35 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:02.375288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3542cf9-93b3-4e49-96cc-b2ca12befe35 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:02.375923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3542cf9-93b3-4e49-96cc-b2ca12befe35 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:02.376527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3542cf9-93b3-4e49-96cc-b2ca12befe35 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:02.594744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b3542cf9-93b3-4e49-96cc-b2ca12befe35 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:02.625666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b3542cf9-93b3-4e49-96cc-b2ca12befe35 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:02.635174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b3542cf9-93b3-4e49-96cc-b2ca12befe35 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:02.636833 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b3542cf9-93b3-4e49-96cc-b2ca12befe35 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2159 microversion: 2.32 time: 0.304157 Oct 18 13:35:02.650002 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2220/4205] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:02 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2159 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:02.655564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cbfee1c2-624b-46ff-b9b0-1e0012b069a5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:02.656458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cbfee1c2-624b-46ff-b9b0-1e0012b069a5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:02.679498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbfee1c2-624b-46ff-b9b0-1e0012b069a5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:02.685345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbfee1c2-624b-46ff-b9b0-1e0012b069a5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:02.691313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbfee1c2-624b-46ff-b9b0-1e0012b069a5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:02.692932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbfee1c2-624b-46ff-b9b0-1e0012b069a5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:02.696068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbfee1c2-624b-46ff-b9b0-1e0012b069a5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:02.696525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbfee1c2-624b-46ff-b9b0-1e0012b069a5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.257593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-19d94d7f-d3dd-4c0c-b6f0-8d5ff22b053b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.268476 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-19d94d7f-d3dd-4c0c-b6f0-8d5ff22b053b tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1318 microversion: 2.1 time: 1.705853 Oct 18 13:35:03.269463 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1986/4206] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:01 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1318 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:03.274778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cd4bdfd7-115a-454c-9fbd-b450bf567d77 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:03.275661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cd4bdfd7-115a-454c-9fbd-b450bf567d77 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:03.279325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cbfee1c2-624b-46ff-b9b0-1e0012b069a5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.284838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd4bdfd7-115a-454c-9fbd-b450bf567d77 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.285686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd4bdfd7-115a-454c-9fbd-b450bf567d77 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.286354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd4bdfd7-115a-454c-9fbd-b450bf567d77 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.287275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd4bdfd7-115a-454c-9fbd-b450bf567d77 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.289400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd4bdfd7-115a-454c-9fbd-b450bf567d77 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.290450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd4bdfd7-115a-454c-9fbd-b450bf567d77 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.292886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cbfee1c2-624b-46ff-b9b0-1e0012b069a5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.294941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cbfee1c2-624b-46ff-b9b0-1e0012b069a5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.318263 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cbfee1c2-624b-46ff-b9b0-1e0012b069a5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.645083 Oct 18 13:35:03.334124 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2221/4207] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:02 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:03.351007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c70635c3-e45c-4d39-9d03-b6db8e90894a req-27ab265a-303f-4eb1-9018-b0144954b3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e23e75-c8b3-4bd9-a8ef-633834d237d1", "name": "network-vif-deleted", "tag": "8f544790-5930-4353-bbad-e9bb309d7d6c"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:03.372755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c70635c3-e45c-4d39-9d03-b6db8e90894a req-27ab265a-303f-4eb1-9018-b0144954b3a4 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.373790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c70635c3-e45c-4d39-9d03-b6db8e90894a req-27ab265a-303f-4eb1-9018-b0144954b3a4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.374911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c70635c3-e45c-4d39-9d03-b6db8e90894a req-27ab265a-303f-4eb1-9018-b0144954b3a4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.389332 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c70635c3-e45c-4d39-9d03-b6db8e90894a req-27ab265a-303f-4eb1-9018-b0144954b3a4 service nova] Creating event network-vif-deleted:8f544790-5930-4353-bbad-e9bb309d7d6c for instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 on n-h1-858384-13 Oct 18 13:35:03.395550 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c70635c3-e45c-4d39-9d03-b6db8e90894a req-27ab265a-303f-4eb1-9018-b0144954b3a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059547 Oct 18 13:35:03.396745 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2222/4208] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:03.402567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8d24a7ea-49d5-425c-a7b2-06213da0b427 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:03.405223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8d24a7ea-49d5-425c-a7b2-06213da0b427 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:03.412437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d24a7ea-49d5-425c-a7b2-06213da0b427 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.413269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d24a7ea-49d5-425c-a7b2-06213da0b427 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.413921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d24a7ea-49d5-425c-a7b2-06213da0b427 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.414966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d24a7ea-49d5-425c-a7b2-06213da0b427 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.415936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d24a7ea-49d5-425c-a7b2-06213da0b427 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.416580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d24a7ea-49d5-425c-a7b2-06213da0b427 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.423275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:03.604638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8d24a7ea-49d5-425c-a7b2-06213da0b427 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.616212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8d24a7ea-49d5-425c-a7b2-06213da0b427 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.632142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8d24a7ea-49d5-425c-a7b2-06213da0b427 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.633546 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8d24a7ea-49d5-425c-a7b2-06213da0b427 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1338 microversion: 2.47 time: 0.235233 Oct 18 13:35:03.634276 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2223/4209] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:03 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1338 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:03.675381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8c0c7535-ea8e-48f2-9880-0709e59a3799 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:03.676075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8c0c7535-ea8e-48f2-9880-0709e59a3799 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:03.684705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c0c7535-ea8e-48f2-9880-0709e59a3799 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.686281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c0c7535-ea8e-48f2-9880-0709e59a3799 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.686895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c0c7535-ea8e-48f2-9880-0709e59a3799 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.687615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c0c7535-ea8e-48f2-9880-0709e59a3799 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:03.688098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c0c7535-ea8e-48f2-9880-0709e59a3799 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:03.688572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c0c7535-ea8e-48f2-9880-0709e59a3799 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:03.819159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8c0c7535-ea8e-48f2-9880-0709e59a3799 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.834835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8c0c7535-ea8e-48f2-9880-0709e59a3799 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.838865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8c0c7535-ea8e-48f2-9880-0709e59a3799 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:03.846153 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8c0c7535-ea8e-48f2-9880-0709e59a3799 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 2159 microversion: 2.32 time: 0.174843 Oct 18 13:35:03.847651 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2224/4210] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:03 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 2159 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:04.079672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cd4bdfd7-115a-454c-9fbd-b450bf567d77 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:04.096348 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cd4bdfd7-115a-454c-9fbd-b450bf567d77 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1512 microversion: 2.1 time: 0.825394 Oct 18 13:35:04.101367 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1987/4211] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:03 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1512 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:04.296094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0ecd919c-4aa7-4bb5-943c-6a42dce82a7f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:04.297631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0ecd919c-4aa7-4bb5-943c-6a42dce82a7f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:04.340766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ecd919c-4aa7-4bb5-943c-6a42dce82a7f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:04.351487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ecd919c-4aa7-4bb5-943c-6a42dce82a7f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:04.352146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-88abd4ee-213c-40c7-99dc-79aebb75a535 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:04.352673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ecd919c-4aa7-4bb5-943c-6a42dce82a7f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:04.353830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-88abd4ee-213c-40c7-99dc-79aebb75a535 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:04.365702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ecd919c-4aa7-4bb5-943c-6a42dce82a7f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:04.370282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ecd919c-4aa7-4bb5-943c-6a42dce82a7f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:04.370901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ecd919c-4aa7-4bb5-943c-6a42dce82a7f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:04.379373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88abd4ee-213c-40c7-99dc-79aebb75a535 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:04.385204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88abd4ee-213c-40c7-99dc-79aebb75a535 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:04.391333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88abd4ee-213c-40c7-99dc-79aebb75a535 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:04.393909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88abd4ee-213c-40c7-99dc-79aebb75a535 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:04.396550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88abd4ee-213c-40c7-99dc-79aebb75a535 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:04.397922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88abd4ee-213c-40c7-99dc-79aebb75a535 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:04.829494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-88abd4ee-213c-40c7-99dc-79aebb75a535 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:04.840696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-88abd4ee-213c-40c7-99dc-79aebb75a535 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:04.843148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-88abd4ee-213c-40c7-99dc-79aebb75a535 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:04.846582 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-88abd4ee-213c-40c7-99dc-79aebb75a535 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.499344 Oct 18 13:35:04.852661 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1988/4212] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:04 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:04.870888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-17780968-3225-4f77-b482-1352df92a693 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:04.871514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-17780968-3225-4f77-b482-1352df92a693 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:04.890424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-17780968-3225-4f77-b482-1352df92a693 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:04.890568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-17780968-3225-4f77-b482-1352df92a693 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:04.891188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-17780968-3225-4f77-b482-1352df92a693 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:04.892211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-17780968-3225-4f77-b482-1352df92a693 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:04.892993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-17780968-3225-4f77-b482-1352df92a693 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:04.894151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-17780968-3225-4f77-b482-1352df92a693 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.097023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-17780968-3225-4f77-b482-1352df92a693 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:05.125783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-17780968-3225-4f77-b482-1352df92a693 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:05.134930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-17780968-3225-4f77-b482-1352df92a693 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:05.140831 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-17780968-3225-4f77-b482-1352df92a693 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1336 microversion: 2.47 time: 0.279039 Oct 18 13:35:05.141788 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1989/4213] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:04 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1336 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:05.148692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9b12114e-9af3-4850-9759-ba5f76700fca tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:05.155379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9b12114e-9af3-4850-9759-ba5f76700fca tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:05.170250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b12114e-9af3-4850-9759-ba5f76700fca tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.170950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b12114e-9af3-4850-9759-ba5f76700fca tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.171673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b12114e-9af3-4850-9759-ba5f76700fca tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.176253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b12114e-9af3-4850-9759-ba5f76700fca tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.177008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b12114e-9af3-4850-9759-ba5f76700fca tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.177672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b12114e-9af3-4850-9759-ba5f76700fca tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.287599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0ecd919c-4aa7-4bb5-943c-6a42dce82a7f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:05.320031 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0ecd919c-4aa7-4bb5-943c-6a42dce82a7f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1508 microversion: 2.1 time: 1.030148 Oct 18 13:35:05.323515 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2225/4214] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:04 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1508 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:05.342811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-334bc53b-6331-4928-b76d-f1449f55f70f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:05.345644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9b12114e-9af3-4850-9759-ba5f76700fca tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:05.348141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-334bc53b-6331-4928-b76d-f1449f55f70f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:05.366282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-334bc53b-6331-4928-b76d-f1449f55f70f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.367281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-334bc53b-6331-4928-b76d-f1449f55f70f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.369282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-334bc53b-6331-4928-b76d-f1449f55f70f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.370514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9b12114e-9af3-4850-9759-ba5f76700fca tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:05.372057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9b12114e-9af3-4850-9759-ba5f76700fca tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:05.373591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-334bc53b-6331-4928-b76d-f1449f55f70f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.378887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-334bc53b-6331-4928-b76d-f1449f55f70f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.379538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-334bc53b-6331-4928-b76d-f1449f55f70f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.392174 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9b12114e-9af3-4850-9759-ba5f76700fca tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.248303 Oct 18 13:35:05.409655 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1990/4215] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:05 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:05.883244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e9bde054-f2d5-4fe4-9f6a-b847e302094b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:05.883770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e9bde054-f2d5-4fe4-9f6a-b847e302094b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:05.898352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9bde054-f2d5-4fe4-9f6a-b847e302094b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.912820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9bde054-f2d5-4fe4-9f6a-b847e302094b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.913297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9bde054-f2d5-4fe4-9f6a-b847e302094b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:05.914041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9bde054-f2d5-4fe4-9f6a-b847e302094b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:05.914490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9bde054-f2d5-4fe4-9f6a-b847e302094b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:05.914912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9bde054-f2d5-4fe4-9f6a-b847e302094b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:06.121965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-334bc53b-6331-4928-b76d-f1449f55f70f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:06.136285 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-334bc53b-6331-4928-b76d-f1449f55f70f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1512 microversion: 2.1 time: 0.804575 Oct 18 13:35:06.136884 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2226/4216] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:05 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1512 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:06.177771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2f246998-6cee-4ac3-8492-eb9bc840ebfd tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:06.193615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2f246998-6cee-4ac3-8492-eb9bc840ebfd tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:06.264514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f246998-6cee-4ac3-8492-eb9bc840ebfd tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:06.267227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f246998-6cee-4ac3-8492-eb9bc840ebfd tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:06.267800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f246998-6cee-4ac3-8492-eb9bc840ebfd tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:06.269203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f246998-6cee-4ac3-8492-eb9bc840ebfd tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:06.271669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f246998-6cee-4ac3-8492-eb9bc840ebfd tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:06.272191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f246998-6cee-4ac3-8492-eb9bc840ebfd tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:06.572946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e9bde054-f2d5-4fe4-9f6a-b847e302094b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:06.590528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e9bde054-f2d5-4fe4-9f6a-b847e302094b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:06.592691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e9bde054-f2d5-4fe4-9f6a-b847e302094b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:06.640954 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e9bde054-f2d5-4fe4-9f6a-b847e302094b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.760361 Oct 18 13:35:06.644397 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1991/4217] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:05 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:06.668546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe9f3d2b-9e7c-4414-b0ca-d3106c575fcf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:06.670091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe9f3d2b-9e7c-4414-b0ca-d3106c575fcf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:06.690540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9f3d2b-9e7c-4414-b0ca-d3106c575fcf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:06.694533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9f3d2b-9e7c-4414-b0ca-d3106c575fcf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:06.695432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9f3d2b-9e7c-4414-b0ca-d3106c575fcf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:06.699134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9f3d2b-9e7c-4414-b0ca-d3106c575fcf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:06.700128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9f3d2b-9e7c-4414-b0ca-d3106c575fcf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:06.702713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9f3d2b-9e7c-4414-b0ca-d3106c575fcf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:06.819849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2f246998-6cee-4ac3-8492-eb9bc840ebfd tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:06.844970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2f246998-6cee-4ac3-8492-eb9bc840ebfd tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:06.846788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2f246998-6cee-4ac3-8492-eb9bc840ebfd tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:06.848190 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2f246998-6cee-4ac3-8492-eb9bc840ebfd tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1336 microversion: 2.47 time: 0.680883 Oct 18 13:35:06.848787 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2227/4218] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:06 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1336 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:07.171753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-950df9e9-ad55-4216-bdcd-57a8e4c74105 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:07.173209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-950df9e9-ad55-4216-bdcd-57a8e4c74105 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:07.218262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-950df9e9-ad55-4216-bdcd-57a8e4c74105 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:07.225896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-950df9e9-ad55-4216-bdcd-57a8e4c74105 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:07.226506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-950df9e9-ad55-4216-bdcd-57a8e4c74105 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:07.227907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-950df9e9-ad55-4216-bdcd-57a8e4c74105 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:07.228475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-950df9e9-ad55-4216-bdcd-57a8e4c74105 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:07.233363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-950df9e9-ad55-4216-bdcd-57a8e4c74105 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:07.275986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe9f3d2b-9e7c-4414-b0ca-d3106c575fcf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:07.314479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe9f3d2b-9e7c-4414-b0ca-d3106c575fcf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:07.323119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe9f3d2b-9e7c-4414-b0ca-d3106c575fcf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:07.330048 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fe9f3d2b-9e7c-4414-b0ca-d3106c575fcf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.683206 Oct 18 13:35:07.336997 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1992/4219] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:06 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:07.673212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ab1adc1b-19be-4933-8f0a-fcaa8a8f6b4e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:07.675370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ab1adc1b-19be-4933-8f0a-fcaa8a8f6b4e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:07.699622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab1adc1b-19be-4933-8f0a-fcaa8a8f6b4e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:07.701836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab1adc1b-19be-4933-8f0a-fcaa8a8f6b4e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:07.703263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab1adc1b-19be-4933-8f0a-fcaa8a8f6b4e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:07.706109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab1adc1b-19be-4933-8f0a-fcaa8a8f6b4e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:07.707905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab1adc1b-19be-4933-8f0a-fcaa8a8f6b4e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:07.709350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab1adc1b-19be-4933-8f0a-fcaa8a8f6b4e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:08.249625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ab1adc1b-19be-4933-8f0a-fcaa8a8f6b4e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.260851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ab1adc1b-19be-4933-8f0a-fcaa8a8f6b4e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.267349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ab1adc1b-19be-4933-8f0a-fcaa8a8f6b4e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.272751 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ab1adc1b-19be-4933-8f0a-fcaa8a8f6b4e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.606158 Oct 18 13:35:08.274139 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1993/4220] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:07 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:08.306976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-950df9e9-ad55-4216-bdcd-57a8e4c74105 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.322817 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-950df9e9-ad55-4216-bdcd-57a8e4c74105 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1512 microversion: 2.1 time: 1.166527 Oct 18 13:35:08.326004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0fa2e676-0014-4178-a88f-03d5273caf6a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:08.327098 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2228/4221] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:07 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1512 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:08.328029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0fa2e676-0014-4178-a88f-03d5273caf6a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:08.344552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fa2e676-0014-4178-a88f-03d5273caf6a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:08.345228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fa2e676-0014-4178-a88f-03d5273caf6a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:08.345808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fa2e676-0014-4178-a88f-03d5273caf6a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:08.346687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fa2e676-0014-4178-a88f-03d5273caf6a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:08.347274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fa2e676-0014-4178-a88f-03d5273caf6a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:08.347823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0fa2e676-0014-4178-a88f-03d5273caf6a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:08.366009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1b92578-aa06-4fd1-a2ed-e4eabbfa155c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:08.366829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1b92578-aa06-4fd1-a2ed-e4eabbfa155c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:08.376348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1b92578-aa06-4fd1-a2ed-e4eabbfa155c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:08.380372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1b92578-aa06-4fd1-a2ed-e4eabbfa155c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:08.387069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1b92578-aa06-4fd1-a2ed-e4eabbfa155c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:08.388850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1b92578-aa06-4fd1-a2ed-e4eabbfa155c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:08.398016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1b92578-aa06-4fd1-a2ed-e4eabbfa155c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:08.398704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1b92578-aa06-4fd1-a2ed-e4eabbfa155c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:08.618310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0fa2e676-0014-4178-a88f-03d5273caf6a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.630177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0fa2e676-0014-4178-a88f-03d5273caf6a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.641487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0fa2e676-0014-4178-a88f-03d5273caf6a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.649680 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0fa2e676-0014-4178-a88f-03d5273caf6a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1357 microversion: 2.47 time: 0.350633 Oct 18 13:35:08.650654 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1994/4222] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:08 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1357 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:08.681582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:08.688112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:08.691521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:08.719873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:08.721874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:08.722444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:08.728460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:08.729270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:08.730009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:08.753011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d1b92578-aa06-4fd1-a2ed-e4eabbfa155c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.783128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d1b92578-aa06-4fd1-a2ed-e4eabbfa155c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.812537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d1b92578-aa06-4fd1-a2ed-e4eabbfa155c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:08.819248 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d1b92578-aa06-4fd1-a2ed-e4eabbfa155c tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.453536 Oct 18 13:35:08.846735 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2229/4223] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:08 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:09.104823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:35:09.105356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:35:09.107581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:35:09.108023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:35:09.108448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:35:09.307364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-20237bc2-7819-445d-b828-c38706f793a0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:09.308646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-20237bc2-7819-445d-b828-c38706f793a0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:09.313612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:09.360055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:09.360551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:09.363598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20237bc2-7819-445d-b828-c38706f793a0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:09.363738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:09.363833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20237bc2-7819-445d-b828-c38706f793a0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:09.363941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:09.364031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20237bc2-7819-445d-b828-c38706f793a0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:09.364116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:09.364200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20237bc2-7819-445d-b828-c38706f793a0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:09.364353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:09.364438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20237bc2-7819-445d-b828-c38706f793a0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:09.364438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20237bc2-7819-445d-b828-c38706f793a0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:09.536631 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-21a30960-4c74-4c24-9047-c6c62054f539 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "POST /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea/action" status: 202 len: 1079 microversion: 2.47 time: 0.859288 Oct 18 13:35:09.565000 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1995/4224] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:35:08 2022] POST /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea/action => generated 1079 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 13:35:09.577415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6b7c4fdc-b885-44ae-9a8c-81928e82f87c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:09.580418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6b7c4fdc-b885-44ae-9a8c-81928e82f87c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:09.623028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b7c4fdc-b885-44ae-9a8c-81928e82f87c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:09.623705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b7c4fdc-b885-44ae-9a8c-81928e82f87c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:09.624171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b7c4fdc-b885-44ae-9a8c-81928e82f87c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:09.624926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b7c4fdc-b885-44ae-9a8c-81928e82f87c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:09.625425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b7c4fdc-b885-44ae-9a8c-81928e82f87c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:09.625859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b7c4fdc-b885-44ae-9a8c-81928e82f87c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:09.975966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-20237bc2-7819-445d-b828-c38706f793a0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:09.988705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-20237bc2-7819-445d-b828-c38706f793a0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:10.003967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-20237bc2-7819-445d-b828-c38706f793a0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:10.010832 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-20237bc2-7819-445d-b828-c38706f793a0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.707900 Oct 18 13:35:10.014806 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2230/4225] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:09 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:10.035324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-90414bf3-cb0c-431a-bf9b-361fbb48df81 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:10.040066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-90414bf3-cb0c-431a-bf9b-361fbb48df81 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:10.074933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90414bf3-cb0c-431a-bf9b-361fbb48df81 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:10.077906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90414bf3-cb0c-431a-bf9b-361fbb48df81 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:10.078689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90414bf3-cb0c-431a-bf9b-361fbb48df81 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:10.079677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90414bf3-cb0c-431a-bf9b-361fbb48df81 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:10.080369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90414bf3-cb0c-431a-bf9b-361fbb48df81 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:10.082736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90414bf3-cb0c-431a-bf9b-361fbb48df81 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:10.232836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:10.334795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6b7c4fdc-b885-44ae-9a8c-81928e82f87c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:10.348776 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6b7c4fdc-b885-44ae-9a8c-81928e82f87c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1512 microversion: 2.1 time: 0.782113 Oct 18 13:35:10.358328 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1996/4226] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:09 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1512 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:10.375291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7ad782cf-7cae-4b09-96b0-f313b2e542f9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:10.377656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7ad782cf-7cae-4b09-96b0-f313b2e542f9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:10.408212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ad782cf-7cae-4b09-96b0-f313b2e542f9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:10.412696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ad782cf-7cae-4b09-96b0-f313b2e542f9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:10.414580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ad782cf-7cae-4b09-96b0-f313b2e542f9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:10.416731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ad782cf-7cae-4b09-96b0-f313b2e542f9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:10.417403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ad782cf-7cae-4b09-96b0-f313b2e542f9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:10.422678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ad782cf-7cae-4b09-96b0-f313b2e542f9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:10.480505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:10.494299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-90414bf3-cb0c-431a-bf9b-361fbb48df81 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:10.504562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-90414bf3-cb0c-431a-bf9b-361fbb48df81 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:10.512178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-90414bf3-cb0c-431a-bf9b-361fbb48df81 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:10.518787 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-90414bf3-cb0c-431a-bf9b-361fbb48df81 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.501413 Oct 18 13:35:10.524976 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2231/4227] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:10 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:10.548885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bf80bde4-9fed-44f9-aef0-7489b499e4a1 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "cfba225c-d0d1-44b9-a35c-f47b663d98dd"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:10.551357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bf80bde4-9fed-44f9-aef0-7489b499e4a1 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:10.595005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf80bde4-9fed-44f9-aef0-7489b499e4a1 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:10.595414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf80bde4-9fed-44f9-aef0-7489b499e4a1 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:10.598466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf80bde4-9fed-44f9-aef0-7489b499e4a1 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:10.599248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf80bde4-9fed-44f9-aef0-7489b499e4a1 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:10.606989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf80bde4-9fed-44f9-aef0-7489b499e4a1 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:10.607617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf80bde4-9fed-44f9-aef0-7489b499e4a1 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:10.770888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:10.871955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ad782cf-7cae-4b09-96b0-f313b2e542f9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:10.895047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ad782cf-7cae-4b09-96b0-f313b2e542f9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:10.897220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ad782cf-7cae-4b09-96b0-f313b2e542f9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:10.913701 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7ad782cf-7cae-4b09-96b0-f313b2e542f9 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.544841 Oct 18 13:35:10.919654 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1997/4228] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:10 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:11.054042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-09de22a3-9acb-45df-adde-ca09602a9d4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:11.054754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-09de22a3-9acb-45df-adde-ca09602a9d4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:11.070640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09de22a3-9acb-45df-adde-ca09602a9d4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:11.077107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09de22a3-9acb-45df-adde-ca09602a9d4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:11.077767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09de22a3-9acb-45df-adde-ca09602a9d4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:11.078544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09de22a3-9acb-45df-adde-ca09602a9d4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:11.079015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09de22a3-9acb-45df-adde-ca09602a9d4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:11.079440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09de22a3-9acb-45df-adde-ca09602a9d4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:11.110381 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-bf80bde4-9fed-44f9-aef0-7489b499e4a1 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] HTTP exception thrown: Volume 3e65f46e-8fea-4ee5-b783-d5402711afb2 could not be found. Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bf80bde4-9fed-44f9-aef0-7489b499e4a1 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Request method failure captured: Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: request: PUT /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e/os-volume_attachments/3e65f46e-8fea-4ee5-b783-d5402711afb2 HTTP/1.1 Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 74 Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsIbRjJGhWP9KxHMq1tns4Ii8NEkJWRyJC4QmJ2GHRPpfb3CEW_d3hzQgjO5q1ZV3UeUTWvf7Gq-i3Bk0yldomRXC1t5lpHv4HdknO9qfQyJLyT0TINFKaogYlACA9fUawLd1s8QmvvaNESUfxBRSUZwI7FnFu08jugTSlsMv0MQZI Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 92dd257d3f294e058ed68d73e7f34eca Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-VolumesAdminNegativeTest-1830471866 Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92dd257d3f294e058ed68d73e7f34eca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/92dd257d3f294e058ed68d73e7f34eca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/92dd257d3f294e058ed68d73e7f34eca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_92dd257d3f294e058ed68d73e7f34eca"}]}] Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-VolumesAdminNegativeTest-1830471866 Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 92dd257d3f294e058ed68d73e7f34eca Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1830471866 Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-VolumesAdminNegativeTest-1830471866-project-admin Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1af0a8aa25ea4e6bbbe302326d0bc97f Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-VolumesAdminNegativeTest-1830471866-project-admin Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: {"volumeAttachment": {"volumeId": "cfba225c-d0d1-44b9-a35c-f47b663d98dd"}} Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: exception: Volume 3e65f46e-8fea-4ee5-b783-d5402711afb2 could not be found. Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'server_id': '765237b0-fcd2-47bd-8622-0246acfdc44e', 'id': '3e65f46e-8fea-4ee5-b783-d5402711afb2', 'body': {'volumeAttachment': {'volumeId': 'cfba225c-d0d1-44b9-a35c-f47b663d98dd'}}} Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3e65f46e-8fea-4ee5-b783-d5402711afb2 could not be found. (HTTP 404) (Request-ID: req-2c280228-7a40-4568-9e71-0392d74af637) Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:35:11.112634 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3e65f46e-8fea-4ee5-b783-d5402711afb2 could not be found. Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3e65f46e-8fea-4ee5-b783-d5402711afb2 could not be found. Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3e65f46e-8fea-4ee5-b783-d5402711afb2 could not be found. Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bf80bde4-9fed-44f9-aef0-7489b499e4a1 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] Returning 404 to user: Volume 3e65f46e-8fea-4ee5-b783-d5402711afb2 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bf80bde4-9fed-44f9-aef0-7489b499e4a1 tempest-VolumesAdminNegativeTest-1830471866 tempest-VolumesAdminNegativeTest-1830471866-project-admin] 10.222.0.40 "PUT /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e/os-volume_attachments/3e65f46e-8fea-4ee5-b783-d5402711afb2" status: 404 len: 109 microversion: 2.1 time: 0.586166 Oct 18 13:35:11.116556 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2232/4229] 10.222.0.40 () {60 vars in 1433 bytes} [Tue Oct 18 13:35:10 2022] PUT /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e/os-volume_attachments/3e65f46e-8fea-4ee5-b783-d5402711afb2 => generated 109 bytes in 587 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:11.391393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2845507e-9d1e-48a9-9195-c620327bde45 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:11.392010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2845507e-9d1e-48a9-9195-c620327bde45 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:11.406088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2845507e-9d1e-48a9-9195-c620327bde45 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:11.426606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2845507e-9d1e-48a9-9195-c620327bde45 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:11.427079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2845507e-9d1e-48a9-9195-c620327bde45 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:11.427839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2845507e-9d1e-48a9-9195-c620327bde45 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:11.428307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2845507e-9d1e-48a9-9195-c620327bde45 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:11.428738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2845507e-9d1e-48a9-9195-c620327bde45 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:11.811961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-09de22a3-9acb-45df-adde-ca09602a9d4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:11.835192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-09de22a3-9acb-45df-adde-ca09602a9d4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:11.841583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-09de22a3-9acb-45df-adde-ca09602a9d4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:11.843193 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-09de22a3-9acb-45df-adde-ca09602a9d4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.795164 Oct 18 13:35:11.865306 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1998/4230] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:11 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:11.876786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0481f24a-fa81-4632-b322-7e3f3c0e5c97 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:11.882484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0481f24a-fa81-4632-b322-7e3f3c0e5c97 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:11.922930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0481f24a-fa81-4632-b322-7e3f3c0e5c97 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:11.922930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0481f24a-fa81-4632-b322-7e3f3c0e5c97 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:11.922930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0481f24a-fa81-4632-b322-7e3f3c0e5c97 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:11.923535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0481f24a-fa81-4632-b322-7e3f3c0e5c97 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:11.924177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0481f24a-fa81-4632-b322-7e3f3c0e5c97 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:11.924615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0481f24a-fa81-4632-b322-7e3f3c0e5c97 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:12.210117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2845507e-9d1e-48a9-9195-c620327bde45 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:12.239449 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2845507e-9d1e-48a9-9195-c620327bde45 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1512 microversion: 2.1 time: 0.852699 Oct 18 13:35:12.241555 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2233/4231] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:11 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1512 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:12.272027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0481f24a-fa81-4632-b322-7e3f3c0e5c97 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:12.290558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0481f24a-fa81-4632-b322-7e3f3c0e5c97 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:12.294351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0481f24a-fa81-4632-b322-7e3f3c0e5c97 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:12.298646 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0481f24a-fa81-4632-b322-7e3f3c0e5c97 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.440975 Oct 18 13:35:12.313750 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 1999/4232] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:11 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:12.314662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=14 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:12.329034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6615b259-057b-4585-a9c7-29a3300f66dd tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:12.334807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6615b259-057b-4585-a9c7-29a3300f66dd tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:12.365797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6615b259-057b-4585-a9c7-29a3300f66dd tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:12.366554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6615b259-057b-4585-a9c7-29a3300f66dd tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:12.373520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6615b259-057b-4585-a9c7-29a3300f66dd tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:12.377987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6615b259-057b-4585-a9c7-29a3300f66dd tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:12.380353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6615b259-057b-4585-a9c7-29a3300f66dd tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:12.385745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6615b259-057b-4585-a9c7-29a3300f66dd tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:12.621166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1034370473", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "1f26170c-5adc-49d1-9280-3f52e1902624"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:12.815127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6615b259-057b-4585-a9c7-29a3300f66dd tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:12.842721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6615b259-057b-4585-a9c7-29a3300f66dd tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:12.844246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6615b259-057b-4585-a9c7-29a3300f66dd tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:12.845580 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6615b259-057b-4585-a9c7-29a3300f66dd tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.538051 Oct 18 13:35:12.885390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] validate_networks() for [('1f26170c-5adc-49d1-9280-3f52e1902624', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:35:12.889688 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2000/4233] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:12 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:12.911064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c5c3647f-55e5-49d3-a0d0-2f9b64b69acf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:12.911673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c5c3647f-55e5-49d3-a0d0-2f9b64b69acf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:12.930861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5c3647f-55e5-49d3-a0d0-2f9b64b69acf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:12.931357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5c3647f-55e5-49d3-a0d0-2f9b64b69acf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:12.931790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5c3647f-55e5-49d3-a0d0-2f9b64b69acf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:12.932496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5c3647f-55e5-49d3-a0d0-2f9b64b69acf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:12.932937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5c3647f-55e5-49d3-a0d0-2f9b64b69acf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:12.945448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5c3647f-55e5-49d3-a0d0-2f9b64b69acf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:14.335310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:35:14.335732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:35:14.336210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:35:14.336622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:35:14.337033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:35:14.354946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:14.355863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:14.356874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:14.358571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:14.362748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:14.363460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:14.451742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Getting quotas for project 48ea1c1d348e4ce8969b2bdeebd8e8ee. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:35:14.473242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Getting quotas for user a5671027395d4a0eaf323bdd1a0676c0 and project 48ea1c1d348e4ce8969b2bdeebd8e8ee. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:35:14.500873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:35:14.503812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:35:14.612353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c5c3647f-55e5-49d3-a0d0-2f9b64b69acf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:14.625288 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9ec047c6-1711-48ca-92a8-556b548cf32b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.381012 Oct 18 13:35:14.627504 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2234/4234] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:35:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2385 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:35:14.645112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c5c3647f-55e5-49d3-a0d0-2f9b64b69acf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:14.649664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5093184d-4a60-4f5f-b4fe-b696168ffa11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:14.653899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5093184d-4a60-4f5f-b4fe-b696168ffa11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:14.656254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c5c3647f-55e5-49d3-a0d0-2f9b64b69acf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:14.661751 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c5c3647f-55e5-49d3-a0d0-2f9b64b69acf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 1.770784 Oct 18 13:35:14.666895 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2001/4235] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:12 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:14.688057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe9d11ae-8de8-412b-8e64-ec656701ff02 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:14.689022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe9d11ae-8de8-412b-8e64-ec656701ff02 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:14.701665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5093184d-4a60-4f5f-b4fe-b696168ffa11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:14.702373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5093184d-4a60-4f5f-b4fe-b696168ffa11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:14.702924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5093184d-4a60-4f5f-b4fe-b696168ffa11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:14.706008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5093184d-4a60-4f5f-b4fe-b696168ffa11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:14.706604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5093184d-4a60-4f5f-b4fe-b696168ffa11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:14.708470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5093184d-4a60-4f5f-b4fe-b696168ffa11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:14.710295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9d11ae-8de8-412b-8e64-ec656701ff02 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:14.712443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9d11ae-8de8-412b-8e64-ec656701ff02 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:14.717707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9d11ae-8de8-412b-8e64-ec656701ff02 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:14.723346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9d11ae-8de8-412b-8e64-ec656701ff02 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:14.724023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9d11ae-8de8-412b-8e64-ec656701ff02 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:14.724625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9d11ae-8de8-412b-8e64-ec656701ff02 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:15.191326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe9d11ae-8de8-412b-8e64-ec656701ff02 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:15.217768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe9d11ae-8de8-412b-8e64-ec656701ff02 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:15.222572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe9d11ae-8de8-412b-8e64-ec656701ff02 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:15.224083 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fe9d11ae-8de8-412b-8e64-ec656701ff02 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.552562 Oct 18 13:35:15.243860 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2002/4236] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:14 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:15.258525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0eeb0d8b-d527-4d6c-9119-5f38d0c6f073 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:15.259163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0eeb0d8b-d527-4d6c-9119-5f38d0c6f073 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:15.283149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5093184d-4a60-4f5f-b4fe-b696168ffa11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:15.283356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0eeb0d8b-d527-4d6c-9119-5f38d0c6f073 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:15.283940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0eeb0d8b-d527-4d6c-9119-5f38d0c6f073 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:15.290384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0eeb0d8b-d527-4d6c-9119-5f38d0c6f073 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:15.291418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0eeb0d8b-d527-4d6c-9119-5f38d0c6f073 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:15.292406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0eeb0d8b-d527-4d6c-9119-5f38d0c6f073 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:15.293058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0eeb0d8b-d527-4d6c-9119-5f38d0c6f073 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:15.299986 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5093184d-4a60-4f5f-b4fe-b696168ffa11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.669895 Oct 18 13:35:15.301161 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2235/4237] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:14 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:15.306497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cf41f97c-de3b-4622-8629-1c6d0051f77c tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:15.307613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cf41f97c-de3b-4622-8629-1c6d0051f77c tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:15.379268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cf41f97c-de3b-4622-8629-1c6d0051f77c tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:15.401771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cf41f97c-de3b-4622-8629-1c6d0051f77c tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:15.405223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cf41f97c-de3b-4622-8629-1c6d0051f77c tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:15.410917 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cf41f97c-de3b-4622-8629-1c6d0051f77c tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1259 microversion: 2.21 time: 0.107087 Oct 18 13:35:15.412075 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2236/4238] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:15 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1259 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:15.699582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0dc267ea-487a-46ed-bc21-0f925eb3a772 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:15.700787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0dc267ea-487a-46ed-bc21-0f925eb3a772 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:15.709200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:15.749872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dc267ea-487a-46ed-bc21-0f925eb3a772 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:15.751688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dc267ea-487a-46ed-bc21-0f925eb3a772 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:15.756865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dc267ea-487a-46ed-bc21-0f925eb3a772 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:15.759957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dc267ea-487a-46ed-bc21-0f925eb3a772 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:15.762560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dc267ea-487a-46ed-bc21-0f925eb3a772 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:15.764595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dc267ea-487a-46ed-bc21-0f925eb3a772 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:15.800742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0eeb0d8b-d527-4d6c-9119-5f38d0c6f073 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:15.827573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0eeb0d8b-d527-4d6c-9119-5f38d0c6f073 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:15.835042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0eeb0d8b-d527-4d6c-9119-5f38d0c6f073 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:15.840449 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0eeb0d8b-d527-4d6c-9119-5f38d0c6f073 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.595012 Oct 18 13:35:15.845321 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2003/4239] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:15 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:16.244658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0dc267ea-487a-46ed-bc21-0f925eb3a772 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:16.252133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f27e3d4-b508-4b67-a6ba-7473749fe3f3 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:16.253212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7f27e3d4-b508-4b67-a6ba-7473749fe3f3 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:16.267334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0dc267ea-487a-46ed-bc21-0f925eb3a772 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:16.271081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0dc267ea-487a-46ed-bc21-0f925eb3a772 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:16.275254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f27e3d4-b508-4b67-a6ba-7473749fe3f3 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:16.276011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f27e3d4-b508-4b67-a6ba-7473749fe3f3 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:16.278618 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0dc267ea-487a-46ed-bc21-0f925eb3a772 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.584761 Oct 18 13:35:16.279297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f27e3d4-b508-4b67-a6ba-7473749fe3f3 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:16.280310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f27e3d4-b508-4b67-a6ba-7473749fe3f3 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:16.280988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f27e3d4-b508-4b67-a6ba-7473749fe3f3 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:16.281610 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2237/4240] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:15 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:16.282220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f27e3d4-b508-4b67-a6ba-7473749fe3f3 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:16.330771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-622e6091-e3fa-4180-9562-67fe7374f029 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:16.331727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-622e6091-e3fa-4180-9562-67fe7374f029 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:16.342561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-622e6091-e3fa-4180-9562-67fe7374f029 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:16.349873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-622e6091-e3fa-4180-9562-67fe7374f029 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:16.359654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-622e6091-e3fa-4180-9562-67fe7374f029 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:16.362610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-622e6091-e3fa-4180-9562-67fe7374f029 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:16.364223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-622e6091-e3fa-4180-9562-67fe7374f029 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:16.365724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-622e6091-e3fa-4180-9562-67fe7374f029 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:16.824442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-622e6091-e3fa-4180-9562-67fe7374f029 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:16.843322 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-622e6091-e3fa-4180-9562-67fe7374f029 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.513917 Oct 18 13:35:16.847107 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2238/4241] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:16 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:16.868754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-645af174-591b-4e0a-b145-aaf8ce2af6f1 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:16.869720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-645af174-591b-4e0a-b145-aaf8ce2af6f1 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:16.951667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-645af174-591b-4e0a-b145-aaf8ce2af6f1 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:16.952283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-645af174-591b-4e0a-b145-aaf8ce2af6f1 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:16.955620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-645af174-591b-4e0a-b145-aaf8ce2af6f1 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:16.956464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-645af174-591b-4e0a-b145-aaf8ce2af6f1 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:16.959298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-645af174-591b-4e0a-b145-aaf8ce2af6f1 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:16.959796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-645af174-591b-4e0a-b145-aaf8ce2af6f1 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:17.034103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7f27e3d4-b508-4b67-a6ba-7473749fe3f3 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.062581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7f27e3d4-b508-4b67-a6ba-7473749fe3f3 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.068934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7f27e3d4-b508-4b67-a6ba-7473749fe3f3 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.076235 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7f27e3d4-b508-4b67-a6ba-7473749fe3f3 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.827278 Oct 18 13:35:17.079283 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2004/4242] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:16 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:17.103764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4b80993f-1a81-4e1c-b2d6-bc2246fe04da tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:17.104385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4b80993f-1a81-4e1c-b2d6-bc2246fe04da tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:17.122981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b80993f-1a81-4e1c-b2d6-bc2246fe04da tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:17.123489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b80993f-1a81-4e1c-b2d6-bc2246fe04da tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:17.123931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b80993f-1a81-4e1c-b2d6-bc2246fe04da tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:17.128445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b80993f-1a81-4e1c-b2d6-bc2246fe04da tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:17.129041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b80993f-1a81-4e1c-b2d6-bc2246fe04da tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:17.129518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b80993f-1a81-4e1c-b2d6-bc2246fe04da tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:17.191062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-645af174-591b-4e0a-b145-aaf8ce2af6f1 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.203631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-645af174-591b-4e0a-b145-aaf8ce2af6f1 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.205128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-645af174-591b-4e0a-b145-aaf8ce2af6f1 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.206319 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-645af174-591b-4e0a-b145-aaf8ce2af6f1 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1311 microversion: 2.21 time: 0.358312 Oct 18 13:35:17.207115 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2239/4243] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:16 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1311 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:17.308220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a9072bab-d4da-4135-8be9-5db5b1811590 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:17.308895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a9072bab-d4da-4135-8be9-5db5b1811590 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:17.318500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9072bab-d4da-4135-8be9-5db5b1811590 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:17.321966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9072bab-d4da-4135-8be9-5db5b1811590 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:17.322611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9072bab-d4da-4135-8be9-5db5b1811590 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:17.323762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9072bab-d4da-4135-8be9-5db5b1811590 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:17.329924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9072bab-d4da-4135-8be9-5db5b1811590 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:17.330638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9072bab-d4da-4135-8be9-5db5b1811590 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:17.398729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4b80993f-1a81-4e1c-b2d6-bc2246fe04da tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.417257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4b80993f-1a81-4e1c-b2d6-bc2246fe04da tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.424527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4b80993f-1a81-4e1c-b2d6-bc2246fe04da tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.426173 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4b80993f-1a81-4e1c-b2d6-bc2246fe04da tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.343558 Oct 18 13:35:17.429366 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2005/4244] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:17 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:17.808641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a9072bab-d4da-4135-8be9-5db5b1811590 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.826742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a9072bab-d4da-4135-8be9-5db5b1811590 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.836827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a9072bab-d4da-4135-8be9-5db5b1811590 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:17.838316 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a9072bab-d4da-4135-8be9-5db5b1811590 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.534214 Oct 18 13:35:17.851122 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2240/4245] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:17 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:17.873774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ba66fa99-46a5-4c7e-b3fd-af8de84cbf69 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:17.875980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ba66fa99-46a5-4c7e-b3fd-af8de84cbf69 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:17.903745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba66fa99-46a5-4c7e-b3fd-af8de84cbf69 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:17.904483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba66fa99-46a5-4c7e-b3fd-af8de84cbf69 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:17.905082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba66fa99-46a5-4c7e-b3fd-af8de84cbf69 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:17.905997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba66fa99-46a5-4c7e-b3fd-af8de84cbf69 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:17.906599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba66fa99-46a5-4c7e-b3fd-af8de84cbf69 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:17.907176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba66fa99-46a5-4c7e-b3fd-af8de84cbf69 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:18.109150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2f9b0a48-b58f-4d8f-ba4a-eb94fe7e4621 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:18.110609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2f9b0a48-b58f-4d8f-ba4a-eb94fe7e4621 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:18.148342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f9b0a48-b58f-4d8f-ba4a-eb94fe7e4621 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:18.157838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f9b0a48-b58f-4d8f-ba4a-eb94fe7e4621 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:18.159061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f9b0a48-b58f-4d8f-ba4a-eb94fe7e4621 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:18.160227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f9b0a48-b58f-4d8f-ba4a-eb94fe7e4621 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:18.162831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f9b0a48-b58f-4d8f-ba4a-eb94fe7e4621 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:18.163500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f9b0a48-b58f-4d8f-ba4a-eb94fe7e4621 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:18.364038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2f9b0a48-b58f-4d8f-ba4a-eb94fe7e4621 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:18.376820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:18.404423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2f9b0a48-b58f-4d8f-ba4a-eb94fe7e4621 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:18.407186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2f9b0a48-b58f-4d8f-ba4a-eb94fe7e4621 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:18.408749 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2f9b0a48-b58f-4d8f-ba4a-eb94fe7e4621 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.304393 Oct 18 13:35:18.410225 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2241/4246] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:18 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:18.435033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c7c2ba6-509b-425e-baa6-e1007e031528 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:18.444073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4c7c2ba6-509b-425e-baa6-e1007e031528 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:18.467004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c7c2ba6-509b-425e-baa6-e1007e031528 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:18.468005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c7c2ba6-509b-425e-baa6-e1007e031528 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:18.470548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c7c2ba6-509b-425e-baa6-e1007e031528 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:18.473307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c7c2ba6-509b-425e-baa6-e1007e031528 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:18.474877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c7c2ba6-509b-425e-baa6-e1007e031528 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:18.489431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c7c2ba6-509b-425e-baa6-e1007e031528 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:18.668062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c7c2ba6-509b-425e-baa6-e1007e031528 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:18.690783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c7c2ba6-509b-425e-baa6-e1007e031528 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:18.693695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c7c2ba6-509b-425e-baa6-e1007e031528 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:18.697859 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4c7c2ba6-509b-425e-baa6-e1007e031528 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1319 microversion: 2.21 time: 0.283864 Oct 18 13:35:18.709925 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2242/4247] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:18 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:18.738916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-41f8ea9d-6a76-4057-851a-57247649838b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:18.740692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-41f8ea9d-6a76-4057-851a-57247649838b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:18.783406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f8ea9d-6a76-4057-851a-57247649838b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:18.785899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f8ea9d-6a76-4057-851a-57247649838b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:18.786676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f8ea9d-6a76-4057-851a-57247649838b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:18.788237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f8ea9d-6a76-4057-851a-57247649838b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:18.836917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f8ea9d-6a76-4057-851a-57247649838b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:18.836917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41f8ea9d-6a76-4057-851a-57247649838b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:19.127133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-41f8ea9d-6a76-4057-851a-57247649838b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:19.144888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-41f8ea9d-6a76-4057-851a-57247649838b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:19.150706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-41f8ea9d-6a76-4057-851a-57247649838b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:19.155302 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-41f8ea9d-6a76-4057-851a-57247649838b tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.443686 Oct 18 13:35:19.190659 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2243/4248] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:18 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:19.205743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fca0e114-15c8-48c2-bf4f-95273844b67e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:19.206512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fca0e114-15c8-48c2-bf4f-95273844b67e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:19.224754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fca0e114-15c8-48c2-bf4f-95273844b67e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:19.225292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fca0e114-15c8-48c2-bf4f-95273844b67e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:19.232652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fca0e114-15c8-48c2-bf4f-95273844b67e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:19.233419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fca0e114-15c8-48c2-bf4f-95273844b67e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:19.233922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fca0e114-15c8-48c2-bf4f-95273844b67e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:19.234386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fca0e114-15c8-48c2-bf4f-95273844b67e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:19.312283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fca0e114-15c8-48c2-bf4f-95273844b67e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:35:19.554228 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fca0e114-15c8-48c2-bf4f-95273844b67e tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "DELETE /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 204 len: 0 microversion: 2.1 time: 0.362056 Oct 18 13:35:19.556337 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2244/4249] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:35:19 2022] DELETE /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:35:19.569996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-e3a70465-701d-46d1-a3ff-23820d980ae6 req-6f3125b9-ec25-4867-9241-59cf84c58adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bce6f6b-df28-4c34-a17f-4f18eb67d401", "name": "network-vif-plugged", "status": "completed", "tag": "c5013b3d-167f-494a-9220-7ef368aab635"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:19.600339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e3a70465-701d-46d1-a3ff-23820d980ae6 req-6f3125b9-ec25-4867-9241-59cf84c58adf service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:19.601082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e3a70465-701d-46d1-a3ff-23820d980ae6 req-6f3125b9-ec25-4867-9241-59cf84c58adf service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:19.602267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e3a70465-701d-46d1-a3ff-23820d980ae6 req-6f3125b9-ec25-4867-9241-59cf84c58adf service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:19.656134 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-e3a70465-701d-46d1-a3ff-23820d980ae6 req-6f3125b9-ec25-4867-9241-59cf84c58adf service nova] Creating event network-vif-plugged:c5013b3d-167f-494a-9220-7ef368aab635 for instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 on n-h2-858384-13 Oct 18 13:35:19.664292 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-e3a70465-701d-46d1-a3ff-23820d980ae6 req-6f3125b9-ec25-4867-9241-59cf84c58adf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106151 Oct 18 13:35:19.670655 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2245/4250] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:19.682851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c68d52fa-018f-4552-9919-fdf839fa2675 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:19.689639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c68d52fa-018f-4552-9919-fdf839fa2675 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:19.709983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c68d52fa-018f-4552-9919-fdf839fa2675 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:19.714013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c68d52fa-018f-4552-9919-fdf839fa2675 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:19.714691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c68d52fa-018f-4552-9919-fdf839fa2675 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:19.716213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c68d52fa-018f-4552-9919-fdf839fa2675 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:19.716834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c68d52fa-018f-4552-9919-fdf839fa2675 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:19.717439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c68d52fa-018f-4552-9919-fdf839fa2675 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.140546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c68d52fa-018f-4552-9919-fdf839fa2675 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.145699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c68d52fa-018f-4552-9919-fdf839fa2675 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.148626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c68d52fa-018f-4552-9919-fdf839fa2675 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.152089 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c68d52fa-018f-4552-9919-fdf839fa2675 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.477851 Oct 18 13:35:20.165708 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2246/4251] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:19 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:20.165830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ba66fa99-46a5-4c7e-b3fd-af8de84cbf69 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.166303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-31cee736-0dcd-4a34-bec3-c89cb160c2ef tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:20.166862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-31cee736-0dcd-4a34-bec3-c89cb160c2ef tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:20.177758 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ba66fa99-46a5-4c7e-b3fd-af8de84cbf69 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 2.307944 Oct 18 13:35:20.178500 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2006/4252] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:17 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 2311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:20.187016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31cee736-0dcd-4a34-bec3-c89cb160c2ef tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:20.187516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31cee736-0dcd-4a34-bec3-c89cb160c2ef tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:20.187958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31cee736-0dcd-4a34-bec3-c89cb160c2ef tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.188700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31cee736-0dcd-4a34-bec3-c89cb160c2ef tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:20.189161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31cee736-0dcd-4a34-bec3-c89cb160c2ef tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:20.189617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31cee736-0dcd-4a34-bec3-c89cb160c2ef tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.190215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a7139edf-bff9-4540-8302-37177fbb5765 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:20.195264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a7139edf-bff9-4540-8302-37177fbb5765 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:20.208043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7139edf-bff9-4540-8302-37177fbb5765 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:20.208944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7139edf-bff9-4540-8302-37177fbb5765 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:20.209636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7139edf-bff9-4540-8302-37177fbb5765 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.212809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7139edf-bff9-4540-8302-37177fbb5765 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:20.213759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7139edf-bff9-4540-8302-37177fbb5765 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:20.221320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7139edf-bff9-4540-8302-37177fbb5765 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.386720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-31cee736-0dcd-4a34-bec3-c89cb160c2ef tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.402806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-31cee736-0dcd-4a34-bec3-c89cb160c2ef tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.404841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-31cee736-0dcd-4a34-bec3-c89cb160c2ef tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.406289 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-31cee736-0dcd-4a34-bec3-c89cb160c2ef tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.243704 Oct 18 13:35:20.406880 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2247/4253] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:20 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:20.420322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-65fa90b1-6cb7-48e6-ad21-3bbe0e605b24 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:20.420322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-65fa90b1-6cb7-48e6-ad21-3bbe0e605b24 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:20.439843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65fa90b1-6cb7-48e6-ad21-3bbe0e605b24 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:20.440342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65fa90b1-6cb7-48e6-ad21-3bbe0e605b24 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:20.440782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65fa90b1-6cb7-48e6-ad21-3bbe0e605b24 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.444876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65fa90b1-6cb7-48e6-ad21-3bbe0e605b24 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:20.454117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65fa90b1-6cb7-48e6-ad21-3bbe0e605b24 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:20.454117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65fa90b1-6cb7-48e6-ad21-3bbe0e605b24 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.623223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-65fa90b1-6cb7-48e6-ad21-3bbe0e605b24 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.665348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-65fa90b1-6cb7-48e6-ad21-3bbe0e605b24 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.677529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-65fa90b1-6cb7-48e6-ad21-3bbe0e605b24 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.678722 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-65fa90b1-6cb7-48e6-ad21-3bbe0e605b24 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1317 microversion: 2.21 time: 0.265637 Oct 18 13:35:20.700427 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2248/4254] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:20 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:20.707865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f39ba148-c70d-4a43-b8ca-6c3094fc71e6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:20.708732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f39ba148-c70d-4a43-b8ca-6c3094fc71e6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:20.728999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f39ba148-c70d-4a43-b8ca-6c3094fc71e6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:20.730257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f39ba148-c70d-4a43-b8ca-6c3094fc71e6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:20.730875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f39ba148-c70d-4a43-b8ca-6c3094fc71e6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.738543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f39ba148-c70d-4a43-b8ca-6c3094fc71e6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:20.739268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f39ba148-c70d-4a43-b8ca-6c3094fc71e6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:20.739906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f39ba148-c70d-4a43-b8ca-6c3094fc71e6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:20.842735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a7139edf-bff9-4540-8302-37177fbb5765 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.855270 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a7139edf-bff9-4540-8302-37177fbb5765 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1514 microversion: 2.1 time: 0.675453 Oct 18 13:35:20.858354 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2007/4255] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:20 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1514 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:20.942835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f39ba148-c70d-4a43-b8ca-6c3094fc71e6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.966190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f39ba148-c70d-4a43-b8ca-6c3094fc71e6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.967838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f39ba148-c70d-4a43-b8ca-6c3094fc71e6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:20.970686 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f39ba148-c70d-4a43-b8ca-6c3094fc71e6 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.266947 Oct 18 13:35:20.970686 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2249/4256] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:20 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:21.186441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-36479388-0321-4033-af2f-57fc4c294cae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:21.187846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-36479388-0321-4033-af2f-57fc4c294cae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:21.207516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-58dfc1af-65e8-4b87-a501-6a83d7fbb462 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:21.208235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-58dfc1af-65e8-4b87-a501-6a83d7fbb462 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:21.209400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36479388-0321-4033-af2f-57fc4c294cae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:21.211001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36479388-0321-4033-af2f-57fc4c294cae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:21.223820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36479388-0321-4033-af2f-57fc4c294cae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:21.231953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36479388-0321-4033-af2f-57fc4c294cae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:21.232532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36479388-0321-4033-af2f-57fc4c294cae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:21.243599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58dfc1af-65e8-4b87-a501-6a83d7fbb462 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:21.244225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58dfc1af-65e8-4b87-a501-6a83d7fbb462 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:21.244690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58dfc1af-65e8-4b87-a501-6a83d7fbb462 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:21.245461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58dfc1af-65e8-4b87-a501-6a83d7fbb462 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:21.245677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36479388-0321-4033-af2f-57fc4c294cae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:21.245836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58dfc1af-65e8-4b87-a501-6a83d7fbb462 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:21.246282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58dfc1af-65e8-4b87-a501-6a83d7fbb462 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:22.244674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36479388-0321-4033-af2f-57fc4c294cae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:22.285469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36479388-0321-4033-af2f-57fc4c294cae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:22.300955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36479388-0321-4033-af2f-57fc4c294cae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:22.302258 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-36479388-0321-4033-af2f-57fc4c294cae tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 1.121980 Oct 18 13:35:22.338033 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2008/4257] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:21 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:22.368130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5427df9f-77c1-402f-9fb2-1063b8f39b62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:22.375973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5427df9f-77c1-402f-9fb2-1063b8f39b62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:22.417906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5427df9f-77c1-402f-9fb2-1063b8f39b62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:22.421569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5427df9f-77c1-402f-9fb2-1063b8f39b62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:22.422727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5427df9f-77c1-402f-9fb2-1063b8f39b62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:22.423505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5427df9f-77c1-402f-9fb2-1063b8f39b62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:22.423979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5427df9f-77c1-402f-9fb2-1063b8f39b62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:22.424409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5427df9f-77c1-402f-9fb2-1063b8f39b62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:22.760526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-58dfc1af-65e8-4b87-a501-6a83d7fbb462 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:22.775350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5427df9f-77c1-402f-9fb2-1063b8f39b62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:22.797471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5427df9f-77c1-402f-9fb2-1063b8f39b62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:22.801848 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-58dfc1af-65e8-4b87-a501-6a83d7fbb462 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 1.585800 Oct 18 13:35:22.804678 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2250/4258] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:21 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:22.812017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5427df9f-77c1-402f-9fb2-1063b8f39b62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:22.819337 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5427df9f-77c1-402f-9fb2-1063b8f39b62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.476917 Oct 18 13:35:22.823626 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2009/4259] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:22 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:22.831689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c4eefb31-fd77-4854-b56c-b6943054cad4 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:22.832587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c4eefb31-fd77-4854-b56c-b6943054cad4 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:22.845065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cc497bb7-4151-4ec7-8786-95f187244e05 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:22.845707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cc497bb7-4151-4ec7-8786-95f187244e05 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:22.866928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4eefb31-fd77-4854-b56c-b6943054cad4 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:22.867727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4eefb31-fd77-4854-b56c-b6943054cad4 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:22.875157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4eefb31-fd77-4854-b56c-b6943054cad4 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:22.877816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4eefb31-fd77-4854-b56c-b6943054cad4 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:22.879584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc497bb7-4151-4ec7-8786-95f187244e05 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:22.880291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc497bb7-4151-4ec7-8786-95f187244e05 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:22.881620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4eefb31-fd77-4854-b56c-b6943054cad4 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:22.882135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4eefb31-fd77-4854-b56c-b6943054cad4 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:22.884307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc497bb7-4151-4ec7-8786-95f187244e05 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:22.893656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc497bb7-4151-4ec7-8786-95f187244e05 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:22.894732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc497bb7-4151-4ec7-8786-95f187244e05 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:22.897104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc497bb7-4151-4ec7-8786-95f187244e05 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:23.411196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c4eefb31-fd77-4854-b56c-b6943054cad4 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:23.427385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c4eefb31-fd77-4854-b56c-b6943054cad4 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:23.429323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c4eefb31-fd77-4854-b56c-b6943054cad4 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:23.435627 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c4eefb31-fd77-4854-b56c-b6943054cad4 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1359 microversion: 2.21 time: 0.627510 Oct 18 13:35:23.436812 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2251/4260] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:22 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1359 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:23.470603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fba6ea8d-f1b9-40d5-84d2-853dc8d15872 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:23.471979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fba6ea8d-f1b9-40d5-84d2-853dc8d15872 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:23.498827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba6ea8d-f1b9-40d5-84d2-853dc8d15872 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:23.500382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba6ea8d-f1b9-40d5-84d2-853dc8d15872 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:23.506727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba6ea8d-f1b9-40d5-84d2-853dc8d15872 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:23.511129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba6ea8d-f1b9-40d5-84d2-853dc8d15872 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:23.511688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba6ea8d-f1b9-40d5-84d2-853dc8d15872 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:23.512143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fba6ea8d-f1b9-40d5-84d2-853dc8d15872 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:23.666745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fba6ea8d-f1b9-40d5-84d2-853dc8d15872 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:23.689547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fba6ea8d-f1b9-40d5-84d2-853dc8d15872 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:23.693341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fba6ea8d-f1b9-40d5-84d2-853dc8d15872 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:23.694805 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fba6ea8d-f1b9-40d5-84d2-853dc8d15872 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.235096 Oct 18 13:35:23.699365 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2252/4261] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:23 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:23.721699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f1f2890b-1da8-4188-826b-e8d5d8ae5275 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:23.722516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f1f2890b-1da8-4188-826b-e8d5d8ae5275 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:23.738624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1f2890b-1da8-4188-826b-e8d5d8ae5275 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:23.742255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1f2890b-1da8-4188-826b-e8d5d8ae5275 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:23.742884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1f2890b-1da8-4188-826b-e8d5d8ae5275 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:23.745817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1f2890b-1da8-4188-826b-e8d5d8ae5275 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:23.747961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1f2890b-1da8-4188-826b-e8d5d8ae5275 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:23.749994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1f2890b-1da8-4188-826b-e8d5d8ae5275 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:23.764528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cc497bb7-4151-4ec7-8786-95f187244e05 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:23.780049 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cc497bb7-4151-4ec7-8786-95f187244e05 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1514 microversion: 2.1 time: 0.950188 Oct 18 13:35:23.787266 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2010/4262] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:22 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1514 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:23.802917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e12891a9-fa63-44f5-9629-43fd2e2d706f req-d6c267c0-ffb4-433f-97a3-b91ea1508f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "765237b0-fcd2-47bd-8622-0246acfdc44e", "name": "network-vif-deleted", "tag": "9ec631ad-25ef-4c88-992a-6add95457b66"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:23.827392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e12891a9-fa63-44f5-9629-43fd2e2d706f req-d6c267c0-ffb4-433f-97a3-b91ea1508f72 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:23.831013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e12891a9-fa63-44f5-9629-43fd2e2d706f req-d6c267c0-ffb4-433f-97a3-b91ea1508f72 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:23.831693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e12891a9-fa63-44f5-9629-43fd2e2d706f req-d6c267c0-ffb4-433f-97a3-b91ea1508f72 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:23.885925 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e12891a9-fa63-44f5-9629-43fd2e2d706f req-d6c267c0-ffb4-433f-97a3-b91ea1508f72 service nova] Creating event network-vif-deleted:9ec631ad-25ef-4c88-992a-6add95457b66 for instance 765237b0-fcd2-47bd-8622-0246acfdc44e on n-h1-858384-13 Oct 18 13:35:23.915674 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e12891a9-fa63-44f5-9629-43fd2e2d706f req-d6c267c0-ffb4-433f-97a3-b91ea1508f72 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121985 Oct 18 13:35:23.922757 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2011/4263] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:23.944536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-550ecaad-b9d1-46a9-8bc2-a186102e7291 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:23.944933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-550ecaad-b9d1-46a9-8bc2-a186102e7291 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:23.970189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550ecaad-b9d1-46a9-8bc2-a186102e7291 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:23.973850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550ecaad-b9d1-46a9-8bc2-a186102e7291 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:23.981119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550ecaad-b9d1-46a9-8bc2-a186102e7291 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:23.984669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550ecaad-b9d1-46a9-8bc2-a186102e7291 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:23.985782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550ecaad-b9d1-46a9-8bc2-a186102e7291 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:23.993756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550ecaad-b9d1-46a9-8bc2-a186102e7291 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:24.175528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f1f2890b-1da8-4188-826b-e8d5d8ae5275 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:24.186430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f1f2890b-1da8-4188-826b-e8d5d8ae5275 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:24.199076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f1f2890b-1da8-4188-826b-e8d5d8ae5275 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:24.201099 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f1f2890b-1da8-4188-826b-e8d5d8ae5275 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.500335 Oct 18 13:35:24.201958 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2253/4264] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:23 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:24.206897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2db30d13-13f5-4c56-8e65-528f553213ac tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:24.218174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2db30d13-13f5-4c56-8e65-528f553213ac tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:24.226156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2db30d13-13f5-4c56-8e65-528f553213ac tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:24.227143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2db30d13-13f5-4c56-8e65-528f553213ac tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:24.227791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2db30d13-13f5-4c56-8e65-528f553213ac tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:24.228709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2db30d13-13f5-4c56-8e65-528f553213ac tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:24.229268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2db30d13-13f5-4c56-8e65-528f553213ac tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:24.229773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2db30d13-13f5-4c56-8e65-528f553213ac tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:24.404811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2db30d13-13f5-4c56-8e65-528f553213ac tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:24.407812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:24.419389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2db30d13-13f5-4c56-8e65-528f553213ac tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:24.421433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2db30d13-13f5-4c56-8e65-528f553213ac tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:24.422940 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2db30d13-13f5-4c56-8e65-528f553213ac tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.219799 Oct 18 13:35:24.424203 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2254/4265] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:24 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:24.467595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-41c390a4-6700-494c-b81f-49066ee00c31 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:24.469058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-41c390a4-6700-494c-b81f-49066ee00c31 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:24.491124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41c390a4-6700-494c-b81f-49066ee00c31 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:24.493939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41c390a4-6700-494c-b81f-49066ee00c31 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:24.495098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41c390a4-6700-494c-b81f-49066ee00c31 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:24.496566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41c390a4-6700-494c-b81f-49066ee00c31 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:24.500008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41c390a4-6700-494c-b81f-49066ee00c31 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:24.502357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-41c390a4-6700-494c-b81f-49066ee00c31 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:24.639092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-550ecaad-b9d1-46a9-8bc2-a186102e7291 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:24.652438 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-550ecaad-b9d1-46a9-8bc2-a186102e7291 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.728119 Oct 18 13:35:24.669995 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2012/4266] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:23 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:24.744927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e5116ab-390f-45b3-9a83-e7ce55a73c1f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:24.746191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1e5116ab-390f-45b3-9a83-e7ce55a73c1f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:24.776724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e5116ab-390f-45b3-9a83-e7ce55a73c1f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:24.780169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e5116ab-390f-45b3-9a83-e7ce55a73c1f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:24.782117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e5116ab-390f-45b3-9a83-e7ce55a73c1f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:24.785507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e5116ab-390f-45b3-9a83-e7ce55a73c1f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:24.789134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e5116ab-390f-45b3-9a83-e7ce55a73c1f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:24.791251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e5116ab-390f-45b3-9a83-e7ce55a73c1f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:24.910133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-41c390a4-6700-494c-b81f-49066ee00c31 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:24.926438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-41c390a4-6700-494c-b81f-49066ee00c31 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:24.929070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-41c390a4-6700-494c-b81f-49066ee00c31 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:24.931478 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-41c390a4-6700-494c-b81f-49066ee00c31 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1359 microversion: 2.21 time: 0.472510 Oct 18 13:35:24.942054 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2255/4267] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:24 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1359 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:24.962854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:24.963539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:24.970505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:24.971518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:24.972121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:24.974893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:24.976409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:24.978058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:25.142484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:25.143974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:25.144425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:25.146593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lazy-loading 'fault' on Instance uuid 765237b0-fcd2-47bd-8622-0246acfdc44e {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:35:25.257401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:25.272232 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f936b3bb-dbc2-47f2-93c0-405bc2fa65aa tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 200 len: 1308 microversion: 2.1 time: 0.322274 Oct 18 13:35:25.292803 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2256/4268] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:24 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 1308 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:25.299015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-70e3f423-b9b6-42be-bdea-f61fa8358e79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:25.299634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-70e3f423-b9b6-42be-bdea-f61fa8358e79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:25.313601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70e3f423-b9b6-42be-bdea-f61fa8358e79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:25.316161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70e3f423-b9b6-42be-bdea-f61fa8358e79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:25.316161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70e3f423-b9b6-42be-bdea-f61fa8358e79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:25.316161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70e3f423-b9b6-42be-bdea-f61fa8358e79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:25.316161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70e3f423-b9b6-42be-bdea-f61fa8358e79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:25.317003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70e3f423-b9b6-42be-bdea-f61fa8358e79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:25.325143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:25.399866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=8 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:25.730887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-70e3f423-b9b6-42be-bdea-f61fa8358e79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:25.745087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-70e3f423-b9b6-42be-bdea-f61fa8358e79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:25.753873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-70e3f423-b9b6-42be-bdea-f61fa8358e79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:25.758333 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-70e3f423-b9b6-42be-bdea-f61fa8358e79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.464237 Oct 18 13:35:25.785398 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2257/4269] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:25 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:25.799095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-75de2844-8000-45c4-bfb1-500f4f57017b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:25.804643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-75de2844-8000-45c4-bfb1-500f4f57017b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:25.827924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75de2844-8000-45c4-bfb1-500f4f57017b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:25.832834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75de2844-8000-45c4-bfb1-500f4f57017b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:25.833709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75de2844-8000-45c4-bfb1-500f4f57017b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:25.834626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75de2844-8000-45c4-bfb1-500f4f57017b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:25.835246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75de2844-8000-45c4-bfb1-500f4f57017b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:25.836014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75de2844-8000-45c4-bfb1-500f4f57017b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:25.975243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-75de2844-8000-45c4-bfb1-500f4f57017b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:26.004822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-75de2844-8000-45c4-bfb1-500f4f57017b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:26.006560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-75de2844-8000-45c4-bfb1-500f4f57017b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:26.007812 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-75de2844-8000-45c4-bfb1-500f4f57017b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.221097 Oct 18 13:35:26.025283 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2258/4270] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:25 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:26.034277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a0af2c77-fec3-489d-bbda-6dfeb91ac23a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:26.035257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a0af2c77-fec3-489d-bbda-6dfeb91ac23a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:26.043366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0af2c77-fec3-489d-bbda-6dfeb91ac23a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.045152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0af2c77-fec3-489d-bbda-6dfeb91ac23a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.046213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0af2c77-fec3-489d-bbda-6dfeb91ac23a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.047739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0af2c77-fec3-489d-bbda-6dfeb91ac23a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.049090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0af2c77-fec3-489d-bbda-6dfeb91ac23a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.050002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0af2c77-fec3-489d-bbda-6dfeb91ac23a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.227588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1e5116ab-390f-45b3-9a83-e7ce55a73c1f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:26.248016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1e5116ab-390f-45b3-9a83-e7ce55a73c1f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:26.249645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1e5116ab-390f-45b3-9a83-e7ce55a73c1f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:26.270657 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1e5116ab-390f-45b3-9a83-e7ce55a73c1f tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 1.547434 Oct 18 13:35:26.277059 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2013/4271] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:24 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:26.289809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c3b4cae0-36ef-45a8-8366-64a591f802de tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:26.290198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a0af2c77-fec3-489d-bbda-6dfeb91ac23a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:26.299906 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a0af2c77-fec3-489d-bbda-6dfeb91ac23a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.271830 Oct 18 13:35:26.301081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c3b4cae0-36ef-45a8-8366-64a591f802de tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:26.304235 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2259/4272] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:26 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:26.311239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-316036c3-abea-415a-8da7-0d216940a85f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:26.311857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-316036c3-abea-415a-8da7-0d216940a85f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: 765237b0-fcd2-47bd-8622-0246acfdc44e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:26.324015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3b4cae0-36ef-45a8-8366-64a591f802de tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.326282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3b4cae0-36ef-45a8-8366-64a591f802de tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.329487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-316036c3-abea-415a-8da7-0d216940a85f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.329986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-316036c3-abea-415a-8da7-0d216940a85f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.330470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3b4cae0-36ef-45a8-8366-64a591f802de tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.331239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-316036c3-abea-415a-8da7-0d216940a85f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.332207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3b4cae0-36ef-45a8-8366-64a591f802de tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.332873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3b4cae0-36ef-45a8-8366-64a591f802de tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.333559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3b4cae0-36ef-45a8-8366-64a591f802de tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.334678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-316036c3-abea-415a-8da7-0d216940a85f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.335197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-316036c3-abea-415a-8da7-0d216940a85f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.336007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-316036c3-abea-415a-8da7-0d216940a85f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.371742 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-316036c3-abea-415a-8da7-0d216940a85f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] HTTP exception thrown: Instance 765237b0-fcd2-47bd-8622-0246acfdc44e could not be found. Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-316036c3-abea-415a-8da7-0d216940a85f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Request method failure captured: Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e HTTP/1.1 Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqrvDX7hfN-eSsVG5bUSmtddxsKUkTSQ3MhU5S1h9Q2F5qEXNwGxe0UEPZyt4lUMmcwKLSPl-hTHB8genIjZkXCWcmc1iOnhpwp0TOqgDjt5cH36UhKsml2PynRVGK6cgeGfH3xtjDbckuGqBUHCAWL_7hmbwtkucimmVdTDyRrtEx8 Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 3ec155a5641940afb3f80c12e83c57ec Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-VolumesAdminNegativeTest-1066076903 Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3ec155a5641940afb3f80c12e83c57ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3ec155a5641940afb3f80c12e83c57ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3ec155a5641940afb3f80c12e83c57ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3ec155a5641940afb3f80c12e83c57ec"}]}] Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-VolumesAdminNegativeTest-1066076903 Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 3ec155a5641940afb3f80c12e83c57ec Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1066076903 Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-VolumesAdminNegativeTest-1066076903-project Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: eab6be43a2404bf1889cc592466bee4e Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-VolumesAdminNegativeTest-1066076903-project Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 765237b0-fcd2-47bd-8622-0246acfdc44e could not be found. Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '765237b0-fcd2-47bd-8622-0246acfdc44e'} Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 765237b0-fcd2-47bd-8622-0246acfdc44e could not be found. Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 765237b0-fcd2-47bd-8622-0246acfdc44e could not be found. Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:26.375984 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:26.379746 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:26.379746 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:26.379746 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:26.379746 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:26.379746 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:26.379746 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 765237b0-fcd2-47bd-8622-0246acfdc44e could not be found. Oct 18 13:35:26.379746 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:26.382983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-316036c3-abea-415a-8da7-0d216940a85f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Returning 404 to user: Instance 765237b0-fcd2-47bd-8622-0246acfdc44e could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:26.384037 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-316036c3-abea-415a-8da7-0d216940a85f tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e" status: 404 len: 111 microversion: 2.1 time: 0.078830 Oct 18 13:35:26.390323 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2260/4273] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:26 2022] GET /compute/v2.1/servers/765237b0-fcd2-47bd-8622-0246acfdc44e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:26.827248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5adfaea6-7045-426a-b8b4-cf7528673dc5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Action: 'create', calling method: .version_select at 0x7ff60eecf1f0>, body: {"keypair": {"name": "tempest-keypair-209150128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAwkqh4unZtX4uf8TndlzRysmjHY9nUh0A9z7JnWIkURO42tABsGP9l3qni6v4JGLzklqTJw6xQrScFsUVH3XlwRzV7EGvykCQZc4axNBaaVvR56q0V7HLoZuAbTbrj4g=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:26.849781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-5adfaea6-7045-426a-b8b4-cf7528673dc5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Getting quotas for project 724386b2d066473fae0dbc9cd16c5802. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:35:26.859400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-5adfaea6-7045-426a-b8b4-cf7528673dc5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Getting quotas for user 3ad869b0447848d7bf332017402442c8 and project 724386b2d066473fae0dbc9cd16c5802. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:35:26.901061 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5adfaea6-7045-426a-b8b4-cf7528673dc5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.206167 Oct 18 13:35:26.902161 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2261/4274] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:35:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:26.917994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3b4cae0-36ef-45a8-8366-64a591f802de tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:26.925649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8ad509e6-70c0-4e56-86b3-2c0b8066d441 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:26.926821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:26.928536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8ad509e6-70c0-4e56-86b3-2c0b8066d441 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:26.939135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3b4cae0-36ef-45a8-8366-64a591f802de tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:26.949337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ad509e6-70c0-4e56-86b3-2c0b8066d441 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.951153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ad509e6-70c0-4e56-86b3-2c0b8066d441 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.952627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ad509e6-70c0-4e56-86b3-2c0b8066d441 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.954792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3b4cae0-36ef-45a8-8366-64a591f802de tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:26.955734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ad509e6-70c0-4e56-86b3-2c0b8066d441 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:26.957136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ad509e6-70c0-4e56-86b3-2c0b8066d441 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:26.957981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ad509e6-70c0-4e56-86b3-2c0b8066d441 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:26.959912 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c3b4cae0-36ef-45a8-8366-64a591f802de tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1359 microversion: 2.21 time: 0.677719 Oct 18 13:35:26.962091 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2014/4275] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:26 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1359 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:27.036316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd3ecea5-ab03-4984-81ce-35a2b79473e5 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:27.036947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fd3ecea5-ab03-4984-81ce-35a2b79473e5 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:27.047967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3ecea5-ab03-4984-81ce-35a2b79473e5 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:27.049460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3ecea5-ab03-4984-81ce-35a2b79473e5 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:27.050314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3ecea5-ab03-4984-81ce-35a2b79473e5 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:27.053577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3ecea5-ab03-4984-81ce-35a2b79473e5 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:27.055213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3ecea5-ab03-4984-81ce-35a2b79473e5 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:27.056931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd3ecea5-ab03-4984-81ce-35a2b79473e5 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:27.178143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fd3ecea5-ab03-4984-81ce-35a2b79473e5 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.189197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fd3ecea5-ab03-4984-81ce-35a2b79473e5 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.190948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fd3ecea5-ab03-4984-81ce-35a2b79473e5 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.192724 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fd3ecea5-ab03-4984-81ce-35a2b79473e5 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.161865 Oct 18 13:35:27.206795 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2015/4276] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:27 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:27.307914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c3871dcc-e219-4274-87ba-0257f5a33d71 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:27.309728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c3871dcc-e219-4274-87ba-0257f5a33d71 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:27.328776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3871dcc-e219-4274-87ba-0257f5a33d71 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:27.330691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3871dcc-e219-4274-87ba-0257f5a33d71 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:27.332477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3871dcc-e219-4274-87ba-0257f5a33d71 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:27.334134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3871dcc-e219-4274-87ba-0257f5a33d71 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:27.338279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3871dcc-e219-4274-87ba-0257f5a33d71 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:27.339220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3871dcc-e219-4274-87ba-0257f5a33d71 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:27.388090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8ad509e6-70c0-4e56-86b3-2c0b8066d441 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.404988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8ad509e6-70c0-4e56-86b3-2c0b8066d441 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.406853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8ad509e6-70c0-4e56-86b3-2c0b8066d441 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.413782 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8ad509e6-70c0-4e56-86b3-2c0b8066d441 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.510164 Oct 18 13:35:27.420943 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2262/4277] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:26 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:27.427778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-962f2f9d-82c1-4287-b56b-abb22ff04af9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:27.428395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-962f2f9d-82c1-4287-b56b-abb22ff04af9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:27.474876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-962f2f9d-82c1-4287-b56b-abb22ff04af9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:27.475377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-962f2f9d-82c1-4287-b56b-abb22ff04af9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:27.475816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-962f2f9d-82c1-4287-b56b-abb22ff04af9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:27.476534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-962f2f9d-82c1-4287-b56b-abb22ff04af9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:27.476978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-962f2f9d-82c1-4287-b56b-abb22ff04af9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:27.478277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-962f2f9d-82c1-4287-b56b-abb22ff04af9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:27.635711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3871dcc-e219-4274-87ba-0257f5a33d71 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.660724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3871dcc-e219-4274-87ba-0257f5a33d71 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.670958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3871dcc-e219-4274-87ba-0257f5a33d71 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.675487 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c3871dcc-e219-4274-87ba-0257f5a33d71 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.371842 Oct 18 13:35:27.703311 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2016/4278] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:27 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:27.726496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-4da4b90b-ae09-4653-9c94-5b92eb44df26 req-efdf1626-38fb-43d6-a967-1e94964276f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4daf2967-5671-49b1-935e-63939b417688", "tag": "c411f650-18c9-4930-a85d-6615276b67a5"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:27.763443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4da4b90b-ae09-4653-9c94-5b92eb44df26 req-efdf1626-38fb-43d6-a967-1e94964276f9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:27.763928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4da4b90b-ae09-4653-9c94-5b92eb44df26 req-efdf1626-38fb-43d6-a967-1e94964276f9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:27.764360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4da4b90b-ae09-4653-9c94-5b92eb44df26 req-efdf1626-38fb-43d6-a967-1e94964276f9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:27.804883 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4da4b90b-ae09-4653-9c94-5b92eb44df26 req-efdf1626-38fb-43d6-a967-1e94964276f9 service nova] Creating event network-changed:c411f650-18c9-4930-a85d-6615276b67a5 for instance 4daf2967-5671-49b1-935e-63939b417688 on n-h1-858384-13 Oct 18 13:35:27.819253 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-4da4b90b-ae09-4653-9c94-5b92eb44df26 req-efdf1626-38fb-43d6-a967-1e94964276f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114582 Oct 18 13:35:27.820806 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2017/4279] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:27.882546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-962f2f9d-82c1-4287-b56b-abb22ff04af9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:27.893672 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-962f2f9d-82c1-4287-b56b-abb22ff04af9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.471329 Oct 18 13:35:27.898681 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2263/4280] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:27 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:27.989921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bbd87ff3-91e1-43b2-baf7-fc5aa1eae10f tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:27.990615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bbd87ff3-91e1-43b2-baf7-fc5aa1eae10f tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:28.004215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbd87ff3-91e1-43b2-baf7-fc5aa1eae10f tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:28.004215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbd87ff3-91e1-43b2-baf7-fc5aa1eae10f tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:28.004758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbd87ff3-91e1-43b2-baf7-fc5aa1eae10f tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:28.005204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbd87ff3-91e1-43b2-baf7-fc5aa1eae10f tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:28.005815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbd87ff3-91e1-43b2-baf7-fc5aa1eae10f tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:28.023273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbd87ff3-91e1-43b2-baf7-fc5aa1eae10f tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:28.221698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-de6ddef7-280b-4ce4-bd05-3fbdc46ab35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:28.222310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-de6ddef7-280b-4ce4-bd05-3fbdc46ab35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:28.238179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de6ddef7-280b-4ce4-bd05-3fbdc46ab35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:28.238677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de6ddef7-280b-4ce4-bd05-3fbdc46ab35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:28.239116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de6ddef7-280b-4ce4-bd05-3fbdc46ab35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:28.251958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de6ddef7-280b-4ce4-bd05-3fbdc46ab35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:28.253662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de6ddef7-280b-4ce4-bd05-3fbdc46ab35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:28.254113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de6ddef7-280b-4ce4-bd05-3fbdc46ab35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:28.526715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-de6ddef7-280b-4ce4-bd05-3fbdc46ab35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:28.543840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-de6ddef7-280b-4ce4-bd05-3fbdc46ab35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:28.551470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-de6ddef7-280b-4ce4-bd05-3fbdc46ab35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:28.558819 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-de6ddef7-280b-4ce4-bd05-3fbdc46ab35b tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.339178 Oct 18 13:35:28.563022 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2264/4281] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:28 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:28.578136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bbd87ff3-91e1-43b2-baf7-fc5aa1eae10f tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:28.585663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e7f13c2-52bd-41e0-aab3-7066571f18b8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:28.586359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7e7f13c2-52bd-41e0-aab3-7066571f18b8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:28.595021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bbd87ff3-91e1-43b2-baf7-fc5aa1eae10f tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:28.596785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bbd87ff3-91e1-43b2-baf7-fc5aa1eae10f tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:28.606534 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bbd87ff3-91e1-43b2-baf7-fc5aa1eae10f tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1359 microversion: 2.21 time: 0.615061 Oct 18 13:35:28.606667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e7f13c2-52bd-41e0-aab3-7066571f18b8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:28.607247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e7f13c2-52bd-41e0-aab3-7066571f18b8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:28.607967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e7f13c2-52bd-41e0-aab3-7066571f18b8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:28.611960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e7f13c2-52bd-41e0-aab3-7066571f18b8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:28.612613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e7f13c2-52bd-41e0-aab3-7066571f18b8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:28.613054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e7f13c2-52bd-41e0-aab3-7066571f18b8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:28.613336 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2018/4282] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:27 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1359 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:28.709523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3d73fd26-6f03-4c4e-889b-5045dad68a76 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:28.710417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3d73fd26-6f03-4c4e-889b-5045dad68a76 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:28.717614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d73fd26-6f03-4c4e-889b-5045dad68a76 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:28.718411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d73fd26-6f03-4c4e-889b-5045dad68a76 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:28.719116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d73fd26-6f03-4c4e-889b-5045dad68a76 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:28.720064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d73fd26-6f03-4c4e-889b-5045dad68a76 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:28.720681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d73fd26-6f03-4c4e-889b-5045dad68a76 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:28.721278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d73fd26-6f03-4c4e-889b-5045dad68a76 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:28.933102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3d73fd26-6f03-4c4e-889b-5045dad68a76 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:28.953388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3d73fd26-6f03-4c4e-889b-5045dad68a76 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:28.955710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3d73fd26-6f03-4c4e-889b-5045dad68a76 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:28.957442 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3d73fd26-6f03-4c4e-889b-5045dad68a76 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.252514 Oct 18 13:35:28.958182 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2019/4283] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:28 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:28.968508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-15a205ca-39e5-4b13-9546-da4ec424dbd5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:28.978215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-15a205ca-39e5-4b13-9546-da4ec424dbd5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:29.009328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15a205ca-39e5-4b13-9546-da4ec424dbd5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.013291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15a205ca-39e5-4b13-9546-da4ec424dbd5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.016470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15a205ca-39e5-4b13-9546-da4ec424dbd5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.017765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15a205ca-39e5-4b13-9546-da4ec424dbd5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.019361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15a205ca-39e5-4b13-9546-da4ec424dbd5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.021807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15a205ca-39e5-4b13-9546-da4ec424dbd5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.170985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7e7f13c2-52bd-41e0-aab3-7066571f18b8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:29.184266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7e7f13c2-52bd-41e0-aab3-7066571f18b8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:29.186123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7e7f13c2-52bd-41e0-aab3-7066571f18b8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:29.197322 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7e7f13c2-52bd-41e0-aab3-7066571f18b8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.632900 Oct 18 13:35:29.224889 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2265/4284] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:28 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:29.442239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-15a205ca-39e5-4b13-9546-da4ec424dbd5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:29.475373 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-15a205ca-39e5-4b13-9546-da4ec424dbd5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.510692 Oct 18 13:35:29.475985 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2020/4285] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:28 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:29.589890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6d7ccd56-736f-4e6f-b838-3eb8d2e7d38e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:29.590676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6d7ccd56-736f-4e6f-b838-3eb8d2e7d38e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:29.613079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d7ccd56-736f-4e6f-b838-3eb8d2e7d38e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.613933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d7ccd56-736f-4e6f-b838-3eb8d2e7d38e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.614674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d7ccd56-736f-4e6f-b838-3eb8d2e7d38e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.615573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d7ccd56-736f-4e6f-b838-3eb8d2e7d38e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.616181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d7ccd56-736f-4e6f-b838-3eb8d2e7d38e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.619029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d7ccd56-736f-4e6f-b838-3eb8d2e7d38e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.636102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-597026ea-27d8-4ca5-84ab-a032e8a2c257 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:29.636721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-597026ea-27d8-4ca5-84ab-a032e8a2c257 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:29.655861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-597026ea-27d8-4ca5-84ab-a032e8a2c257 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.661766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-597026ea-27d8-4ca5-84ab-a032e8a2c257 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.663172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-597026ea-27d8-4ca5-84ab-a032e8a2c257 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:29.665901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-597026ea-27d8-4ca5-84ab-a032e8a2c257 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:29.666371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-597026ea-27d8-4ca5-84ab-a032e8a2c257 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:29.670367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-597026ea-27d8-4ca5-84ab-a032e8a2c257 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:30.030038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-597026ea-27d8-4ca5-84ab-a032e8a2c257 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.045247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-597026ea-27d8-4ca5-84ab-a032e8a2c257 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.049902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-597026ea-27d8-4ca5-84ab-a032e8a2c257 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.051412 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-597026ea-27d8-4ca5-84ab-a032e8a2c257 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1359 microversion: 2.21 time: 0.419429 Oct 18 13:35:30.065302 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2021/4286] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:29 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1359 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:30.074208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-119d1d26-5a88-4d69-b3a8-04cb21be588d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:30.077567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-119d1d26-5a88-4d69-b3a8-04cb21be588d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:30.094131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-119d1d26-5a88-4d69-b3a8-04cb21be588d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:30.094626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-119d1d26-5a88-4d69-b3a8-04cb21be588d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:30.095283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-119d1d26-5a88-4d69-b3a8-04cb21be588d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:30.095996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-119d1d26-5a88-4d69-b3a8-04cb21be588d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:30.096446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-119d1d26-5a88-4d69-b3a8-04cb21be588d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:30.096872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-119d1d26-5a88-4d69-b3a8-04cb21be588d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:30.171511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6d7ccd56-736f-4e6f-b838-3eb8d2e7d38e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.187643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6d7ccd56-736f-4e6f-b838-3eb8d2e7d38e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.187994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-119d1d26-5a88-4d69-b3a8-04cb21be588d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.189117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6d7ccd56-736f-4e6f-b838-3eb8d2e7d38e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.190372 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6d7ccd56-736f-4e6f-b838-3eb8d2e7d38e tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.606618 Oct 18 13:35:30.200232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-119d1d26-5a88-4d69-b3a8-04cb21be588d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.201811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-119d1d26-5a88-4d69-b3a8-04cb21be588d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.203249 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-119d1d26-5a88-4d69-b3a8-04cb21be588d tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.145504 Oct 18 13:35:30.206610 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2022/4287] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:30 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:30.242556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5cec1681-34da-444b-83a3-b4afa128b4f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:30.243365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5cec1681-34da-444b-83a3-b4afa128b4f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:30.250423 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2266/4288] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:29 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:30.255374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cec1681-34da-444b-83a3-b4afa128b4f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:30.256353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cec1681-34da-444b-83a3-b4afa128b4f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:30.256805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cec1681-34da-444b-83a3-b4afa128b4f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:30.257667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cec1681-34da-444b-83a3-b4afa128b4f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:30.258127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cec1681-34da-444b-83a3-b4afa128b4f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:30.259469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cec1681-34da-444b-83a3-b4afa128b4f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:30.476646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5cec1681-34da-444b-83a3-b4afa128b4f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.501276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5cec1681-34da-444b-83a3-b4afa128b4f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.501564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-78eddc44-a4d7-4f16-9bd5-df86acdd1ccf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:30.502790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5cec1681-34da-444b-83a3-b4afa128b4f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:30.503236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-78eddc44-a4d7-4f16-9bd5-df86acdd1ccf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:30.504037 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5cec1681-34da-444b-83a3-b4afa128b4f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.275116 Oct 18 13:35:30.523172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78eddc44-a4d7-4f16-9bd5-df86acdd1ccf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:30.524923 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2023/4289] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:30 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:30.530756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78eddc44-a4d7-4f16-9bd5-df86acdd1ccf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:30.532634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78eddc44-a4d7-4f16-9bd5-df86acdd1ccf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:30.541373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78eddc44-a4d7-4f16-9bd5-df86acdd1ccf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:30.545383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78eddc44-a4d7-4f16-9bd5-df86acdd1ccf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:30.546053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78eddc44-a4d7-4f16-9bd5-df86acdd1ccf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.030417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-78eddc44-a4d7-4f16-9bd5-df86acdd1ccf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:31.053908 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-78eddc44-a4d7-4f16-9bd5-df86acdd1ccf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.554627 Oct 18 13:35:31.056607 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2267/4290] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:30 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:31.115356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0d679f66-a3e0-44c0-acb3-03089f30ee9b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:31.116248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0d679f66-a3e0-44c0-acb3-03089f30ee9b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:31.142582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d679f66-a3e0-44c0-acb3-03089f30ee9b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.143267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d679f66-a3e0-44c0-acb3-03089f30ee9b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.143718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d679f66-a3e0-44c0-acb3-03089f30ee9b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.144851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d679f66-a3e0-44c0-acb3-03089f30ee9b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.144968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d679f66-a3e0-44c0-acb3-03089f30ee9b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.164670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d679f66-a3e0-44c0-acb3-03089f30ee9b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.238339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8b55ee9b-0f0a-4043-89a0-4e4117ecb2eb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:31.239027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8b55ee9b-0f0a-4043-89a0-4e4117ecb2eb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:31.251835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b55ee9b-0f0a-4043-89a0-4e4117ecb2eb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.255834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b55ee9b-0f0a-4043-89a0-4e4117ecb2eb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.261140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b55ee9b-0f0a-4043-89a0-4e4117ecb2eb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.265337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b55ee9b-0f0a-4043-89a0-4e4117ecb2eb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.265337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b55ee9b-0f0a-4043-89a0-4e4117ecb2eb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.273305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b55ee9b-0f0a-4043-89a0-4e4117ecb2eb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.490927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8b55ee9b-0f0a-4043-89a0-4e4117ecb2eb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:31.511384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8b55ee9b-0f0a-4043-89a0-4e4117ecb2eb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:31.512840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8b55ee9b-0f0a-4043-89a0-4e4117ecb2eb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:31.514719 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8b55ee9b-0f0a-4043-89a0-4e4117ecb2eb tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.280397 Oct 18 13:35:31.515623 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2268/4291] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:31 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:31.520569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2e46bbd9-7266-449d-991e-4e279588a839 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:31.521203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2e46bbd9-7266-449d-991e-4e279588a839 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:31.542997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e46bbd9-7266-449d-991e-4e279588a839 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.545548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e46bbd9-7266-449d-991e-4e279588a839 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.546022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e46bbd9-7266-449d-991e-4e279588a839 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.546783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e46bbd9-7266-449d-991e-4e279588a839 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.548967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e46bbd9-7266-449d-991e-4e279588a839 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.549472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2e46bbd9-7266-449d-991e-4e279588a839 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.618041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0d679f66-a3e0-44c0-acb3-03089f30ee9b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:31.628266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0d679f66-a3e0-44c0-acb3-03089f30ee9b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:31.639047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0d679f66-a3e0-44c0-acb3-03089f30ee9b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:31.640995 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0d679f66-a3e0-44c0-acb3-03089f30ee9b tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1359 microversion: 2.21 time: 0.538553 Oct 18 13:35:31.643525 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2024/4292] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:31 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1359 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:31.653835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0ead5050-e551-48f9-854f-c64e43bb8309 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:31.654458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0ead5050-e551-48f9-854f-c64e43bb8309 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:31.671290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ead5050-e551-48f9-854f-c64e43bb8309 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.671791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ead5050-e551-48f9-854f-c64e43bb8309 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.672235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ead5050-e551-48f9-854f-c64e43bb8309 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.672950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ead5050-e551-48f9-854f-c64e43bb8309 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:31.673463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ead5050-e551-48f9-854f-c64e43bb8309 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:31.673895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ead5050-e551-48f9-854f-c64e43bb8309 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:31.749353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2e46bbd9-7266-449d-991e-4e279588a839 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:31.791262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2e46bbd9-7266-449d-991e-4e279588a839 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:31.792883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2e46bbd9-7266-449d-991e-4e279588a839 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:31.810305 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2e46bbd9-7266-449d-991e-4e279588a839 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.291117 Oct 18 13:35:31.826346 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2269/4293] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:31 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:32.099323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3f34040b-4140-468f-90d4-e33f1d0045f7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:32.100153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3f34040b-4140-468f-90d4-e33f1d0045f7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:32.110860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f34040b-4140-468f-90d4-e33f1d0045f7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:32.111380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f34040b-4140-468f-90d4-e33f1d0045f7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:32.111812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f34040b-4140-468f-90d4-e33f1d0045f7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:32.112545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f34040b-4140-468f-90d4-e33f1d0045f7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:32.119088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f34040b-4140-468f-90d4-e33f1d0045f7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:32.129586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f34040b-4140-468f-90d4-e33f1d0045f7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:32.357237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0ead5050-e551-48f9-854f-c64e43bb8309 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:32.381123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0ead5050-e551-48f9-854f-c64e43bb8309 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:32.383926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0ead5050-e551-48f9-854f-c64e43bb8309 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:32.393218 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0ead5050-e551-48f9-854f-c64e43bb8309 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.747863 Oct 18 13:35:32.398669 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2025/4294] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:31 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:32.412405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2115709061", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "edc161cd-a6a2-4332-bb87-a21c809540c9"}], "security_groups": [{"name": "tempest-securitygroup--456567503"}], "key_name": "tempest-keypair-209150128", "user_data": "}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:32.596228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3f34040b-4140-468f-90d4-e33f1d0045f7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:32.607237 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3f34040b-4140-468f-90d4-e33f1d0045f7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.528969 Oct 18 13:35:32.608383 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2270/4295] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:32 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:32.614123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b7c56297-0ec3-456a-bf5b-ab51ddf1d680 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:32.614986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7c56297-0ec3-456a-bf5b-ab51ddf1d680 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:32.626350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7c56297-0ec3-456a-bf5b-ab51ddf1d680 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:32.627848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7c56297-0ec3-456a-bf5b-ab51ddf1d680 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:32.628790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7c56297-0ec3-456a-bf5b-ab51ddf1d680 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:32.633012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7c56297-0ec3-456a-bf5b-ab51ddf1d680 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:32.635391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7c56297-0ec3-456a-bf5b-ab51ddf1d680 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:32.635849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7c56297-0ec3-456a-bf5b-ab51ddf1d680 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:32.773482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7c56297-0ec3-456a-bf5b-ab51ddf1d680 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:32.792867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7c56297-0ec3-456a-bf5b-ab51ddf1d680 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:32.794932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7c56297-0ec3-456a-bf5b-ab51ddf1d680 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:32.796186 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b7c56297-0ec3-456a-bf5b-ab51ddf1d680 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.186616 Oct 18 13:35:32.827263 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2271/4296] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:32 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:32.832760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-23e12f32-a157-4e35-8193-40a703ccb648 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:32.833646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-23e12f32-a157-4e35-8193-40a703ccb648 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:32.841017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23e12f32-a157-4e35-8193-40a703ccb648 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:32.841775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23e12f32-a157-4e35-8193-40a703ccb648 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:32.844730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23e12f32-a157-4e35-8193-40a703ccb648 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:32.845928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23e12f32-a157-4e35-8193-40a703ccb648 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:32.846551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23e12f32-a157-4e35-8193-40a703ccb648 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:32.847136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23e12f32-a157-4e35-8193-40a703ccb648 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.041627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-23e12f32-a157-4e35-8193-40a703ccb648 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:33.056367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-23e12f32-a157-4e35-8193-40a703ccb648 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:33.058394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-23e12f32-a157-4e35-8193-40a703ccb648 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:33.067000 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-23e12f32-a157-4e35-8193-40a703ccb648 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1359 microversion: 2.21 time: 0.238003 Oct 18 13:35:33.067330 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2272/4297] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:32 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:33.077550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-576355cd-a747-43d0-a049-a1ba6b34c33a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:33.078097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-576355cd-a747-43d0-a049-a1ba6b34c33a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:33.087493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-576355cd-a747-43d0-a049-a1ba6b34c33a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.088681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-576355cd-a747-43d0-a049-a1ba6b34c33a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.088681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-576355cd-a747-43d0-a049-a1ba6b34c33a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.088883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-576355cd-a747-43d0-a049-a1ba6b34c33a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.089325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-576355cd-a747-43d0-a049-a1ba6b34c33a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.089755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-576355cd-a747-43d0-a049-a1ba6b34c33a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.250619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-576355cd-a747-43d0-a049-a1ba6b34c33a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:33.265467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-576355cd-a747-43d0-a049-a1ba6b34c33a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:33.267785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-576355cd-a747-43d0-a049-a1ba6b34c33a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:33.269222 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-576355cd-a747-43d0-a049-a1ba6b34c33a tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.200962 Oct 18 13:35:33.272327 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2273/4298] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:33 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:33.433513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e9fd64fe-5bf2-4e98-80eb-078fe33e795e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:33.439623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e9fd64fe-5bf2-4e98-80eb-078fe33e795e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:33.455394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9fd64fe-5bf2-4e98-80eb-078fe33e795e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.456421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9fd64fe-5bf2-4e98-80eb-078fe33e795e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.457463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9fd64fe-5bf2-4e98-80eb-078fe33e795e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.459462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9fd64fe-5bf2-4e98-80eb-078fe33e795e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.461821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9fd64fe-5bf2-4e98-80eb-078fe33e795e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.463820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9fd64fe-5bf2-4e98-80eb-078fe33e795e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.822852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e9fd64fe-5bf2-4e98-80eb-078fe33e795e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:33.841695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e9fd64fe-5bf2-4e98-80eb-078fe33e795e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:33.850334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e9fd64fe-5bf2-4e98-80eb-078fe33e795e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:33.854846 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e9fd64fe-5bf2-4e98-80eb-078fe33e795e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.426027 Oct 18 13:35:33.856499 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2274/4299] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:33 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:33.866816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c434d18a-4931-48dc-b4d8-a1d2990f76d9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:33.872738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c434d18a-4931-48dc-b4d8-a1d2990f76d9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:33.899891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c434d18a-4931-48dc-b4d8-a1d2990f76d9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.900403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c434d18a-4931-48dc-b4d8-a1d2990f76d9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.900843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c434d18a-4931-48dc-b4d8-a1d2990f76d9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.912135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c434d18a-4931-48dc-b4d8-a1d2990f76d9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:33.912810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c434d18a-4931-48dc-b4d8-a1d2990f76d9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:33.913303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c434d18a-4931-48dc-b4d8-a1d2990f76d9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:33.989561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:34.373707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c434d18a-4931-48dc-b4d8-a1d2990f76d9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:34.395357 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c434d18a-4931-48dc-b4d8-a1d2990f76d9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.534524 Oct 18 13:35:34.409238 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2275/4300] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:33 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:34.420525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-034f9ca2-3351-4a45-a10b-b4e0148df01e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:34.423603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-034f9ca2-3351-4a45-a10b-b4e0148df01e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:34.446139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-034f9ca2-3351-4a45-a10b-b4e0148df01e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:34.446725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-034f9ca2-3351-4a45-a10b-b4e0148df01e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:34.447178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-034f9ca2-3351-4a45-a10b-b4e0148df01e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:34.454304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-034f9ca2-3351-4a45-a10b-b4e0148df01e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:34.454815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-034f9ca2-3351-4a45-a10b-b4e0148df01e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:34.455266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-034f9ca2-3351-4a45-a10b-b4e0148df01e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:34.663708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-034f9ca2-3351-4a45-a10b-b4e0148df01e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:34.676750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-034f9ca2-3351-4a45-a10b-b4e0148df01e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:34.678238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-034f9ca2-3351-4a45-a10b-b4e0148df01e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:34.679451 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-034f9ca2-3351-4a45-a10b-b4e0148df01e tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.280810 Oct 18 13:35:34.681310 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2276/4301] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:34 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:34.688105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-71ea7b28-e5aa-4586-bde5-6499d39edfca tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:34.688725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-71ea7b28-e5aa-4586-bde5-6499d39edfca tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:34.706304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71ea7b28-e5aa-4586-bde5-6499d39edfca tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:34.706801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71ea7b28-e5aa-4586-bde5-6499d39edfca tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:34.707776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71ea7b28-e5aa-4586-bde5-6499d39edfca tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:34.708506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71ea7b28-e5aa-4586-bde5-6499d39edfca tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:34.708967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71ea7b28-e5aa-4586-bde5-6499d39edfca tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:34.709424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71ea7b28-e5aa-4586-bde5-6499d39edfca tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:34.912454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-71ea7b28-e5aa-4586-bde5-6499d39edfca tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:34.926308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-71ea7b28-e5aa-4586-bde5-6499d39edfca tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:34.927787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-71ea7b28-e5aa-4586-bde5-6499d39edfca tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:34.928967 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-71ea7b28-e5aa-4586-bde5-6499d39edfca tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1359 microversion: 2.21 time: 0.246680 Oct 18 13:35:34.929647 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2277/4302] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:34 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:34.971020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f81efdad-73a3-4c98-ae9f-48b6387868d8 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:34.978594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f81efdad-73a3-4c98-ae9f-48b6387868d8 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:34.985074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:34.999081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f81efdad-73a3-4c98-ae9f-48b6387868d8 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:34.999725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f81efdad-73a3-4c98-ae9f-48b6387868d8 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.000266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f81efdad-73a3-4c98-ae9f-48b6387868d8 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.003448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f81efdad-73a3-4c98-ae9f-48b6387868d8 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.004037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f81efdad-73a3-4c98-ae9f-48b6387868d8 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.004922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f81efdad-73a3-4c98-ae9f-48b6387868d8 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.133765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f81efdad-73a3-4c98-ae9f-48b6387868d8 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:35.151951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f81efdad-73a3-4c98-ae9f-48b6387868d8 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:35.159890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f81efdad-73a3-4c98-ae9f-48b6387868d8 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:35.161201 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f81efdad-73a3-4c98-ae9f-48b6387868d8 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1366 microversion: 2.47 time: 0.194266 Oct 18 13:35:35.173350 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2278/4303] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:34 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:35.175558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b2409cb2-e8ac-4b25-8a07-e97cc694e2a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:35.176209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b2409cb2-e8ac-4b25-8a07-e97cc694e2a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:35.203427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2409cb2-e8ac-4b25-8a07-e97cc694e2a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.203854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2409cb2-e8ac-4b25-8a07-e97cc694e2a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.204297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2409cb2-e8ac-4b25-8a07-e97cc694e2a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.205015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2409cb2-e8ac-4b25-8a07-e97cc694e2a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.221823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2409cb2-e8ac-4b25-8a07-e97cc694e2a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.222383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2409cb2-e8ac-4b25-8a07-e97cc694e2a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.530146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b2409cb2-e8ac-4b25-8a07-e97cc694e2a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:35.540656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b2409cb2-e8ac-4b25-8a07-e97cc694e2a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:35.546315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b2409cb2-e8ac-4b25-8a07-e97cc694e2a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:35.547548 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b2409cb2-e8ac-4b25-8a07-e97cc694e2a1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.376712 Oct 18 13:35:35.644549 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2279/4304] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:35 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:35.684342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cc8d0dc6-8420-4937-af3d-c31d6a0d9f5b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:35.692351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cc8d0dc6-8420-4937-af3d-c31d6a0d9f5b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:35.722783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc8d0dc6-8420-4937-af3d-c31d6a0d9f5b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.728688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc8d0dc6-8420-4937-af3d-c31d6a0d9f5b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.730085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc8d0dc6-8420-4937-af3d-c31d6a0d9f5b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:35.733842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc8d0dc6-8420-4937-af3d-c31d6a0d9f5b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:35.735984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc8d0dc6-8420-4937-af3d-c31d6a0d9f5b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:35.738995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc8d0dc6-8420-4937-af3d-c31d6a0d9f5b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.058434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cc8d0dc6-8420-4937-af3d-c31d6a0d9f5b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.068600 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cc8d0dc6-8420-4937-af3d-c31d6a0d9f5b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.430707 Oct 18 13:35:36.069243 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2280/4305] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:35 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:36.073836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c79f650c-1fc2-49a9-96cb-8c316229a36a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:36.074524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c79f650c-1fc2-49a9-96cb-8c316229a36a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:36.080988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c79f650c-1fc2-49a9-96cb-8c316229a36a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.081541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c79f650c-1fc2-49a9-96cb-8c316229a36a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.081992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c79f650c-1fc2-49a9-96cb-8c316229a36a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.082691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c79f650c-1fc2-49a9-96cb-8c316229a36a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.083324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c79f650c-1fc2-49a9-96cb-8c316229a36a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.083974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c79f650c-1fc2-49a9-96cb-8c316229a36a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.155078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c79f650c-1fc2-49a9-96cb-8c316229a36a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.164833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c79f650c-1fc2-49a9-96cb-8c316229a36a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.167584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c79f650c-1fc2-49a9-96cb-8c316229a36a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.169638 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c79f650c-1fc2-49a9-96cb-8c316229a36a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.099416 Oct 18 13:35:36.170713 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2281/4306] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:36 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:36.175704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db695693-dde3-4f05-b001-1a80f4577b97 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:36.176502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db695693-dde3-4f05-b001-1a80f4577b97 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:36.182915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db695693-dde3-4f05-b001-1a80f4577b97 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.183622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db695693-dde3-4f05-b001-1a80f4577b97 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.184780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db695693-dde3-4f05-b001-1a80f4577b97 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.186154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db695693-dde3-4f05-b001-1a80f4577b97 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.186750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db695693-dde3-4f05-b001-1a80f4577b97 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.187337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db695693-dde3-4f05-b001-1a80f4577b97 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.393376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db695693-dde3-4f05-b001-1a80f4577b97 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.408311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db695693-dde3-4f05-b001-1a80f4577b97 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.417298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db695693-dde3-4f05-b001-1a80f4577b97 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.432683 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db695693-dde3-4f05-b001-1a80f4577b97 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1359 microversion: 2.21 time: 0.260658 Oct 18 13:35:36.436453 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2282/4307] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:36 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1359 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:36.456874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c469238f-514b-48b0-84ab-ee86ac77dd43 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:36.461499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c469238f-514b-48b0-84ab-ee86ac77dd43 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:36.477554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c469238f-514b-48b0-84ab-ee86ac77dd43 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.479664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c469238f-514b-48b0-84ab-ee86ac77dd43 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.483823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c469238f-514b-48b0-84ab-ee86ac77dd43 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.487922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c469238f-514b-48b0-84ab-ee86ac77dd43 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.488752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c469238f-514b-48b0-84ab-ee86ac77dd43 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.490122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c469238f-514b-48b0-84ab-ee86ac77dd43 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.595243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c469238f-514b-48b0-84ab-ee86ac77dd43 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.608848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c469238f-514b-48b0-84ab-ee86ac77dd43 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.610965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c469238f-514b-48b0-84ab-ee86ac77dd43 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:36.612469 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c469238f-514b-48b0-84ab-ee86ac77dd43 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1384 microversion: 2.47 time: 0.170527 Oct 18 13:35:36.613811 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2283/4308] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:36 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1384 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:36.650028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9a053a3d-0eca-4a0e-a29d-5efcc3cbdb31 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:36.651917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9a053a3d-0eca-4a0e-a29d-5efcc3cbdb31 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:36.665129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a053a3d-0eca-4a0e-a29d-5efcc3cbdb31 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.666127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a053a3d-0eca-4a0e-a29d-5efcc3cbdb31 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.666894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a053a3d-0eca-4a0e-a29d-5efcc3cbdb31 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.671695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a053a3d-0eca-4a0e-a29d-5efcc3cbdb31 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:36.673085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a053a3d-0eca-4a0e-a29d-5efcc3cbdb31 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:36.673805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a053a3d-0eca-4a0e-a29d-5efcc3cbdb31 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:36.869023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:37.049083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9a053a3d-0eca-4a0e-a29d-5efcc3cbdb31 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:37.061468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9a053a3d-0eca-4a0e-a29d-5efcc3cbdb31 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:37.063795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9a053a3d-0eca-4a0e-a29d-5efcc3cbdb31 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:37.064646 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9a053a3d-0eca-4a0e-a29d-5efcc3cbdb31 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.419222 Oct 18 13:35:37.065348 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2284/4309] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:36 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:37.069708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3149635f-9967-4ea8-8d50-5c5759f3a305 req-6740819b-ed72-4f79-b7b9-0f47811e6596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4daf2967-5671-49b1-935e-63939b417688", "name": "network-vif-plugged", "status": "completed", "tag": "c411f650-18c9-4930-a85d-6615276b67a5"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:37.081209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3149635f-9967-4ea8-8d50-5c5759f3a305 req-6740819b-ed72-4f79-b7b9-0f47811e6596 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.081565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3149635f-9967-4ea8-8d50-5c5759f3a305 req-6740819b-ed72-4f79-b7b9-0f47811e6596 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.081999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3149635f-9967-4ea8-8d50-5c5759f3a305 req-6740819b-ed72-4f79-b7b9-0f47811e6596 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:37.116077 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3149635f-9967-4ea8-8d50-5c5759f3a305 req-6740819b-ed72-4f79-b7b9-0f47811e6596 service nova] Creating event network-vif-plugged:c411f650-18c9-4930-a85d-6615276b67a5 for instance 4daf2967-5671-49b1-935e-63939b417688 on n-h1-858384-13 Oct 18 13:35:37.153322 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3149635f-9967-4ea8-8d50-5c5759f3a305 req-6740819b-ed72-4f79-b7b9-0f47811e6596 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079817 Oct 18 13:35:37.154190 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2285/4310] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:37.164220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b368692b-b6d8-4f20-a790-393b47bfe40f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:37.165331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b368692b-b6d8-4f20-a790-393b47bfe40f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:37.193992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b368692b-b6d8-4f20-a790-393b47bfe40f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.194490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b368692b-b6d8-4f20-a790-393b47bfe40f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.194947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b368692b-b6d8-4f20-a790-393b47bfe40f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:37.195733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b368692b-b6d8-4f20-a790-393b47bfe40f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.196250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b368692b-b6d8-4f20-a790-393b47bfe40f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.196775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b368692b-b6d8-4f20-a790-393b47bfe40f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:37.528966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b368692b-b6d8-4f20-a790-393b47bfe40f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:37.546901 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b368692b-b6d8-4f20-a790-393b47bfe40f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.391080 Oct 18 13:35:37.553122 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2286/4311] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:37 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:37.561674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d8e0c4e-d909-4ded-b5b2-315a79166568 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:37.562340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d8e0c4e-d909-4ded-b5b2-315a79166568 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:37.584152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8e0c4e-d909-4ded-b5b2-315a79166568 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.588075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8e0c4e-d909-4ded-b5b2-315a79166568 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.588586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8e0c4e-d909-4ded-b5b2-315a79166568 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:37.589360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8e0c4e-d909-4ded-b5b2-315a79166568 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.589819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8e0c4e-d909-4ded-b5b2-315a79166568 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.597457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8e0c4e-d909-4ded-b5b2-315a79166568 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:37.724133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d8e0c4e-d909-4ded-b5b2-315a79166568 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:37.743935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d8e0c4e-d909-4ded-b5b2-315a79166568 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:37.746166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d8e0c4e-d909-4ded-b5b2-315a79166568 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:37.749128 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d8e0c4e-d909-4ded-b5b2-315a79166568 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.194946 Oct 18 13:35:37.750487 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2287/4312] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:37 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:37.756973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4a4cccb3-e94e-4ddc-bda8-4a35e8842c53 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:37.758686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4a4cccb3-e94e-4ddc-bda8-4a35e8842c53 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:37.768719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a4cccb3-e94e-4ddc-bda8-4a35e8842c53 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.769473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a4cccb3-e94e-4ddc-bda8-4a35e8842c53 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.770625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a4cccb3-e94e-4ddc-bda8-4a35e8842c53 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:37.785476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a4cccb3-e94e-4ddc-bda8-4a35e8842c53 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:37.788035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a4cccb3-e94e-4ddc-bda8-4a35e8842c53 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:37.793575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a4cccb3-e94e-4ddc-bda8-4a35e8842c53 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.008841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4a4cccb3-e94e-4ddc-bda8-4a35e8842c53 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.019411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4a4cccb3-e94e-4ddc-bda8-4a35e8842c53 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.021625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4a4cccb3-e94e-4ddc-bda8-4a35e8842c53 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.023167 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4a4cccb3-e94e-4ddc-bda8-4a35e8842c53 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1359 microversion: 2.21 time: 0.271415 Oct 18 13:35:38.024339 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2288/4313] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:37 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:38.030290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aadb74ed-611b-47cf-be40-726ea8f85f62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:38.031101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aadb74ed-611b-47cf-be40-726ea8f85f62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:38.038602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aadb74ed-611b-47cf-be40-726ea8f85f62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.039298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aadb74ed-611b-47cf-be40-726ea8f85f62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.039900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aadb74ed-611b-47cf-be40-726ea8f85f62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.040754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aadb74ed-611b-47cf-be40-726ea8f85f62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.041462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aadb74ed-611b-47cf-be40-726ea8f85f62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.042016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aadb74ed-611b-47cf-be40-726ea8f85f62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.150747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aadb74ed-611b-47cf-be40-726ea8f85f62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.162474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aadb74ed-611b-47cf-be40-726ea8f85f62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.164471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aadb74ed-611b-47cf-be40-726ea8f85f62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.166873 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aadb74ed-611b-47cf-be40-726ea8f85f62 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1372 microversion: 2.47 time: 0.140754 Oct 18 13:35:38.169066 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2289/4314] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:38 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1372 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:38.177308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1dbc3116-7734-4c41-a9ef-c18ccf3e1250 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:38.178029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1dbc3116-7734-4c41-a9ef-c18ccf3e1250 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:38.185545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dbc3116-7734-4c41-a9ef-c18ccf3e1250 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.186492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dbc3116-7734-4c41-a9ef-c18ccf3e1250 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.187405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dbc3116-7734-4c41-a9ef-c18ccf3e1250 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.188311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dbc3116-7734-4c41-a9ef-c18ccf3e1250 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.188940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dbc3116-7734-4c41-a9ef-c18ccf3e1250 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.189535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dbc3116-7734-4c41-a9ef-c18ccf3e1250 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.229108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1dbc3116-7734-4c41-a9ef-c18ccf3e1250 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:35:38.419373 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1dbc3116-7734-4c41-a9ef-c18ccf3e1250 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 204 len: 0 microversion: 2.1 time: 0.245353 Oct 18 13:35:38.422921 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2290/4315] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:35:38 2022] DELETE /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:35:38.455068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] validate_networks() for [('edc161cd-a6a2-4332-bb87-a21c809540c9', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:35:38.459112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-048740b7-076b-48c8-9f3d-15b751d8e7af tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:38.471885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-048740b7-076b-48c8-9f3d-15b751d8e7af tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:38.487680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-048740b7-076b-48c8-9f3d-15b751d8e7af tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.489886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-048740b7-076b-48c8-9f3d-15b751d8e7af tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.493397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-048740b7-076b-48c8-9f3d-15b751d8e7af tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.495760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-048740b7-076b-48c8-9f3d-15b751d8e7af tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.504846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-048740b7-076b-48c8-9f3d-15b751d8e7af tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.524213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-048740b7-076b-48c8-9f3d-15b751d8e7af tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.533616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:38.862380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=68 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:38.904080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-048740b7-076b-48c8-9f3d-15b751d8e7af tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.915314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-048740b7-076b-48c8-9f3d-15b751d8e7af tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.921040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-048740b7-076b-48c8-9f3d-15b751d8e7af tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:38.926315 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-048740b7-076b-48c8-9f3d-15b751d8e7af tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.501993 Oct 18 13:35:38.937312 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2291/4316] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:38 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:38.945641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eec8558a-7034-4a2c-bff8-620a665c5ccb tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:38.952009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eec8558a-7034-4a2c-bff8-620a665c5ccb tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:38.983188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eec8558a-7034-4a2c-bff8-620a665c5ccb tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.983909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eec8558a-7034-4a2c-bff8-620a665c5ccb tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.984363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eec8558a-7034-4a2c-bff8-620a665c5ccb tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:38.985466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eec8558a-7034-4a2c-bff8-620a665c5ccb tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:38.986385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eec8558a-7034-4a2c-bff8-620a665c5ccb tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:38.987053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eec8558a-7034-4a2c-bff8-620a665c5ccb tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.234173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eec8558a-7034-4a2c-bff8-620a665c5ccb tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:39.243864 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eec8558a-7034-4a2c-bff8-620a665c5ccb tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1681 microversion: 2.1 time: 0.315335 Oct 18 13:35:39.244790 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2292/4317] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:38 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1681 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:39.250771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7cd8fe16-473a-4331-b134-82951b2da3e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:39.251544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7cd8fe16-473a-4331-b134-82951b2da3e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:39.266669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7cd8fe16-473a-4331-b134-82951b2da3e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.267220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7cd8fe16-473a-4331-b134-82951b2da3e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.268118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7cd8fe16-473a-4331-b134-82951b2da3e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.268835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7cd8fe16-473a-4331-b134-82951b2da3e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.269329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7cd8fe16-473a-4331-b134-82951b2da3e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.269897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7cd8fe16-473a-4331-b134-82951b2da3e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.369430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:35:39.370129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:35:39.370761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:35:39.372002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:35:39.372829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:35:39.388667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.389483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.390273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.391345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.392149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.392876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.415295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Getting quotas for project 724386b2d066473fae0dbc9cd16c5802. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:35:39.423198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Getting quotas for user 3ad869b0447848d7bf332017402442c8 and project 724386b2d066473fae0dbc9cd16c5802. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:35:39.442837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:35:39.475708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:35:39.548327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7cd8fe16-473a-4331-b134-82951b2da3e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:39.562773 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7cd8fe16-473a-4331-b134-82951b2da3e7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.316627 Oct 18 13:35:39.563379 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2293/4318] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:39 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:39.581008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f63624c0-705b-4ee9-9a10-9c6d9d268720 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:39.583071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f63624c0-705b-4ee9-9a10-9c6d9d268720 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:39.600821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f63624c0-705b-4ee9-9a10-9c6d9d268720 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.601682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f63624c0-705b-4ee9-9a10-9c6d9d268720 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.602147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f63624c0-705b-4ee9-9a10-9c6d9d268720 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.603171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f63624c0-705b-4ee9-9a10-9c6d9d268720 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.603639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f63624c0-705b-4ee9-9a10-9c6d9d268720 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.604070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f63624c0-705b-4ee9-9a10-9c6d9d268720 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.661819 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a757cdb2-2170-4f6f-b4cf-73095dc425af tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 7.257809 Oct 18 13:35:39.663691 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2026/4319] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:35:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 7265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:35:39.686395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-76fb4bcc-1448-4022-a9f5-8386e3295235 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:39.688366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-76fb4bcc-1448-4022-a9f5-8386e3295235 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:39.716269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76fb4bcc-1448-4022-a9f5-8386e3295235 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.717260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76fb4bcc-1448-4022-a9f5-8386e3295235 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.722284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76fb4bcc-1448-4022-a9f5-8386e3295235 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.723310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76fb4bcc-1448-4022-a9f5-8386e3295235 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.723961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76fb4bcc-1448-4022-a9f5-8386e3295235 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.724573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76fb4bcc-1448-4022-a9f5-8386e3295235 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.778149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f63624c0-705b-4ee9-9a10-9c6d9d268720 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:39.801399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f63624c0-705b-4ee9-9a10-9c6d9d268720 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:39.806958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f63624c0-705b-4ee9-9a10-9c6d9d268720 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:39.806958 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f63624c0-705b-4ee9-9a10-9c6d9d268720 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.237994 Oct 18 13:35:39.817095 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2294/4320] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:39 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:39.840900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-bbd00e56-88e6-4f09-8716-fe2cbddc7c59 req-30e85277-b2a2-43f9-a368-bf720a11088d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa292c2-3801-4d84-b31a-4d3eeeb41818", "name": "network-vif-plugged", "status": "completed", "tag": "8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:39.895347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bbd00e56-88e6-4f09-8716-fe2cbddc7c59 req-30e85277-b2a2-43f9-a368-bf720a11088d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:39.895845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bbd00e56-88e6-4f09-8716-fe2cbddc7c59 req-30e85277-b2a2-43f9-a368-bf720a11088d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:39.896283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bbd00e56-88e6-4f09-8716-fe2cbddc7c59 req-30e85277-b2a2-43f9-a368-bf720a11088d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:39.966426 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-bbd00e56-88e6-4f09-8716-fe2cbddc7c59 req-30e85277-b2a2-43f9-a368-bf720a11088d service nova] Creating event network-vif-plugged:8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa for instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 on n-h1-858384-13 Oct 18 13:35:40.023249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-76fb4bcc-1448-4022-a9f5-8386e3295235 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:40.030578 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-bbd00e56-88e6-4f09-8716-fe2cbddc7c59 req-30e85277-b2a2-43f9-a368-bf720a11088d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206980 Oct 18 13:35:40.032036 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2295/4321] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:40.043927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-76fb4bcc-1448-4022-a9f5-8386e3295235 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:40.048470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-76fb4bcc-1448-4022-a9f5-8386e3295235 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:40.052739 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-76fb4bcc-1448-4022-a9f5-8386e3295235 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1553 microversion: 2.21 time: 0.377101 Oct 18 13:35:40.055403 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2027/4322] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:39 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1553 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:40.057262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-47e35fb2-93a0-40d9-98ba-54900b751489 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:40.059620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-47e35fb2-93a0-40d9-98ba-54900b751489 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:40.068860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d78e6a3f-86d5-4bc2-9891-501b1e0a5a73 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:40.069049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47e35fb2-93a0-40d9-98ba-54900b751489 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.069445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47e35fb2-93a0-40d9-98ba-54900b751489 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.070036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47e35fb2-93a0-40d9-98ba-54900b751489 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.070850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47e35fb2-93a0-40d9-98ba-54900b751489 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.071287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d78e6a3f-86d5-4bc2-9891-501b1e0a5a73 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:40.071619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47e35fb2-93a0-40d9-98ba-54900b751489 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.072065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47e35fb2-93a0-40d9-98ba-54900b751489 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.230338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d78e6a3f-86d5-4bc2-9891-501b1e0a5a73 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:40.236179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-47e35fb2-93a0-40d9-98ba-54900b751489 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:40.247114 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d78e6a3f-86d5-4bc2-9891-501b1e0a5a73 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1237 microversion: 2.1 time: 0.186216 Oct 18 13:35:40.266838 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2028/4323] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:40 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1237 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:40.274292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-47e35fb2-93a0-40d9-98ba-54900b751489 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:40.275745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-47e35fb2-93a0-40d9-98ba-54900b751489 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:40.276929 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-47e35fb2-93a0-40d9-98ba-54900b751489 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1372 microversion: 2.47 time: 0.237419 Oct 18 13:35:40.281898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-92b99e1a-0c9f-4c25-a440-21134b6e518a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:40.282404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-92b99e1a-0c9f-4c25-a440-21134b6e518a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:40.296030 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2296/4324] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:40 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1372 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:40.306942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92b99e1a-0c9f-4c25-a440-21134b6e518a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.307718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92b99e1a-0c9f-4c25-a440-21134b6e518a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.308250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92b99e1a-0c9f-4c25-a440-21134b6e518a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.309372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92b99e1a-0c9f-4c25-a440-21134b6e518a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.309964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92b99e1a-0c9f-4c25-a440-21134b6e518a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.310585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92b99e1a-0c9f-4c25-a440-21134b6e518a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.311841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8fdac8c9-9e76-4b93-861f-5d1ec3cbcfd8 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:40.312480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8fdac8c9-9e76-4b93-861f-5d1ec3cbcfd8 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:40.323557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8fdac8c9-9e76-4b93-861f-5d1ec3cbcfd8 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.324055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8fdac8c9-9e76-4b93-861f-5d1ec3cbcfd8 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.324528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8fdac8c9-9e76-4b93-861f-5d1ec3cbcfd8 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.325309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8fdac8c9-9e76-4b93-861f-5d1ec3cbcfd8 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.325757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8fdac8c9-9e76-4b93-861f-5d1ec3cbcfd8 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.326188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8fdac8c9-9e76-4b93-861f-5d1ec3cbcfd8 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.420833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8fdac8c9-9e76-4b93-861f-5d1ec3cbcfd8 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:35:40.596653 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8fdac8c9-9e76-4b93-861f-5d1ec3cbcfd8 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 204 len: 0 microversion: 2.21 time: 0.298987 Oct 18 13:35:40.602578 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2297/4325] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:35:40 2022] DELETE /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:35:40.618823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a056b56b-0ea1-4ffa-80cb-052c88912c83 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:40.620474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a056b56b-0ea1-4ffa-80cb-052c88912c83 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:40.641154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a056b56b-0ea1-4ffa-80cb-052c88912c83 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.642428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a056b56b-0ea1-4ffa-80cb-052c88912c83 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.645575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a056b56b-0ea1-4ffa-80cb-052c88912c83 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.649376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a056b56b-0ea1-4ffa-80cb-052c88912c83 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.650604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a056b56b-0ea1-4ffa-80cb-052c88912c83 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.654783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a056b56b-0ea1-4ffa-80cb-052c88912c83 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.715472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-92b99e1a-0c9f-4c25-a440-21134b6e518a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:40.732360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-92b99e1a-0c9f-4c25-a440-21134b6e518a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:40.735325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-92b99e1a-0c9f-4c25-a440-21134b6e518a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:40.740686 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-92b99e1a-0c9f-4c25-a440-21134b6e518a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.472594 Oct 18 13:35:40.746035 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2029/4326] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:40 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:40.767111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-74ecf91b-12c0-4b6e-bc2f-967a09edbbbe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:40.768031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-74ecf91b-12c0-4b6e-bc2f-967a09edbbbe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:40.780616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74ecf91b-12c0-4b6e-bc2f-967a09edbbbe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.782220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74ecf91b-12c0-4b6e-bc2f-967a09edbbbe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.782881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74ecf91b-12c0-4b6e-bc2f-967a09edbbbe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:40.783831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74ecf91b-12c0-4b6e-bc2f-967a09edbbbe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:40.784537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74ecf91b-12c0-4b6e-bc2f-967a09edbbbe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:40.785206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74ecf91b-12c0-4b6e-bc2f-967a09edbbbe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.024486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a056b56b-0ea1-4ffa-80cb-052c88912c83 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.037739 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a056b56b-0ea1-4ffa-80cb-052c88912c83 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1681 microversion: 2.1 time: 0.430868 Oct 18 13:35:41.038383 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2298/4327] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:40 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1681 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:41.050346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a883e2d3-918c-49ac-bf77-16a23948ffe9 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:41.052458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a883e2d3-918c-49ac-bf77-16a23948ffe9 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:41.071008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a883e2d3-918c-49ac-bf77-16a23948ffe9 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.071416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a883e2d3-918c-49ac-bf77-16a23948ffe9 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.071865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a883e2d3-918c-49ac-bf77-16a23948ffe9 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.072578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a883e2d3-918c-49ac-bf77-16a23948ffe9 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.073040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a883e2d3-918c-49ac-bf77-16a23948ffe9 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.087367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a883e2d3-918c-49ac-bf77-16a23948ffe9 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.307652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a883e2d3-918c-49ac-bf77-16a23948ffe9 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.320482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a883e2d3-918c-49ac-bf77-16a23948ffe9 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.323239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a883e2d3-918c-49ac-bf77-16a23948ffe9 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.325836 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a883e2d3-918c-49ac-bf77-16a23948ffe9 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1559 microversion: 2.21 time: 0.286429 Oct 18 13:35:41.326959 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2299/4328] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:41 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1559 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:41.332037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-72b787aa-2645-4f6c-9969-9cf0ec0ec7c8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:41.332879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-72b787aa-2645-4f6c-9969-9cf0ec0ec7c8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:41.341255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72b787aa-2645-4f6c-9969-9cf0ec0ec7c8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.342206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72b787aa-2645-4f6c-9969-9cf0ec0ec7c8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.342837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72b787aa-2645-4f6c-9969-9cf0ec0ec7c8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.344688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72b787aa-2645-4f6c-9969-9cf0ec0ec7c8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.345401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72b787aa-2645-4f6c-9969-9cf0ec0ec7c8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.346020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72b787aa-2645-4f6c-9969-9cf0ec0ec7c8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.399394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-74ecf91b-12c0-4b6e-bc2f-967a09edbbbe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.408432 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-74ecf91b-12c0-4b6e-bc2f-967a09edbbbe tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.658757 Oct 18 13:35:41.411643 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2030/4329] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:40 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:41.420976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-72b787aa-2645-4f6c-9969-9cf0ec0ec7c8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.424152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c9d0aa9b-beec-4f8d-95b9-69f8ae6ce93b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:41.424832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c9d0aa9b-beec-4f8d-95b9-69f8ae6ce93b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:41.437498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-72b787aa-2645-4f6c-9969-9cf0ec0ec7c8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.440528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-72b787aa-2645-4f6c-9969-9cf0ec0ec7c8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.442684 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-72b787aa-2645-4f6c-9969-9cf0ec0ec7c8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.114531 Oct 18 13:35:41.444342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d0aa9b-beec-4f8d-95b9-69f8ae6ce93b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.445252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d0aa9b-beec-4f8d-95b9-69f8ae6ce93b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.446099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d0aa9b-beec-4f8d-95b9-69f8ae6ce93b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.446978 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2300/4330] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:41 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:41.447953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d0aa9b-beec-4f8d-95b9-69f8ae6ce93b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.450273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d0aa9b-beec-4f8d-95b9-69f8ae6ce93b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.452688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d0aa9b-beec-4f8d-95b9-69f8ae6ce93b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.458113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-addd0501-3cff-4e2d-889b-07114f707180 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:41.461273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-addd0501-3cff-4e2d-889b-07114f707180 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:41.474824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-addd0501-3cff-4e2d-889b-07114f707180 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.483271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-addd0501-3cff-4e2d-889b-07114f707180 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.484049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-addd0501-3cff-4e2d-889b-07114f707180 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.485346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-addd0501-3cff-4e2d-889b-07114f707180 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.486906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-addd0501-3cff-4e2d-889b-07114f707180 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.487434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-addd0501-3cff-4e2d-889b-07114f707180 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.586680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-addd0501-3cff-4e2d-889b-07114f707180 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.587689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c9d0aa9b-beec-4f8d-95b9-69f8ae6ce93b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.607012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-addd0501-3cff-4e2d-889b-07114f707180 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.607947 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c9d0aa9b-beec-4f8d-95b9-69f8ae6ce93b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1241 microversion: 2.1 time: 0.193650 Oct 18 13:35:41.608808 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2031/4331] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:41 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1241 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:41.610778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-addd0501-3cff-4e2d-889b-07114f707180 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.612640 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-addd0501-3cff-4e2d-889b-07114f707180 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1357 microversion: 2.47 time: 0.163219 Oct 18 13:35:41.613480 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2301/4332] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:41 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:41.648446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:41.661192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:41.662749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Searching by: {'deleted': False, 'project_id': '5dbb88c7848344559fba9e894c0118e2'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:35:41.675496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.676697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.677612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.679013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.679759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.680468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.777499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-305205b6-568a-4dd1-be8b-a106877c9ffe tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:41.779051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-305205b6-568a-4dd1-be8b-a106877c9ffe tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:41.792422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-305205b6-568a-4dd1-be8b-a106877c9ffe tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.796752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-305205b6-568a-4dd1-be8b-a106877c9ffe tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.797415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-305205b6-568a-4dd1-be8b-a106877c9ffe tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.798723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-305205b6-568a-4dd1-be8b-a106877c9ffe tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:41.799815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-305205b6-568a-4dd1-be8b-a106877c9ffe tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:41.800464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-305205b6-568a-4dd1-be8b-a106877c9ffe tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:41.867652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:35:42.034642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.042536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.044242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.045489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.070248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.082498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.191556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-305205b6-568a-4dd1-be8b-a106877c9ffe tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.207807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-305205b6-568a-4dd1-be8b-a106877c9ffe tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.210035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-305205b6-568a-4dd1-be8b-a106877c9ffe tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.211724 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-305205b6-568a-4dd1-be8b-a106877c9ffe tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 0.439832 Oct 18 13:35:42.221111 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2302/4333] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:41 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:42.240204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aafc9abb-9f78-4e50-9e0d-0cfbfbf04d85 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:42.241125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aafc9abb-9f78-4e50-9e0d-0cfbfbf04d85 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:42.253584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aafc9abb-9f78-4e50-9e0d-0cfbfbf04d85 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.254860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aafc9abb-9f78-4e50-9e0d-0cfbfbf04d85 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.255465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aafc9abb-9f78-4e50-9e0d-0cfbfbf04d85 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.256393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aafc9abb-9f78-4e50-9e0d-0cfbfbf04d85 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.256993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aafc9abb-9f78-4e50-9e0d-0cfbfbf04d85 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.257653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aafc9abb-9f78-4e50-9e0d-0cfbfbf04d85 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.270178 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-85dc0eac-4097-453a-94b5-f763c6257779 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.631119 Oct 18 13:35:42.270786 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2032/4334] 10.222.0.40 () {60 vars in 1187 bytes} [Tue Oct 18 13:35:41 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:42.318352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c309130-2c26-4a78-bdcb-a8739070dfea tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:42.319350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7c309130-2c26-4a78-bdcb-a8739070dfea tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:42.329458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c309130-2c26-4a78-bdcb-a8739070dfea tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.330212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c309130-2c26-4a78-bdcb-a8739070dfea tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.330825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c309130-2c26-4a78-bdcb-a8739070dfea tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.331733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c309130-2c26-4a78-bdcb-a8739070dfea tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.332438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c309130-2c26-4a78-bdcb-a8739070dfea tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.336680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c309130-2c26-4a78-bdcb-a8739070dfea tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.352515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:42.381673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aafc9abb-9f78-4e50-9e0d-0cfbfbf04d85 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6be43a2404bf1889cc592466bee4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec155a5641940afb3f80c12e83c57ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.395402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7c309130-2c26-4a78-bdcb-a8739070dfea tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:35:42.402661 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aafc9abb-9f78-4e50-9e0d-0cfbfbf04d85 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 200 len: 1613 microversion: 2.1 time: 0.180059 Oct 18 13:35:42.408703 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2303/4335] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:42 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 1613 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:42.430182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba859c34-ebe8-4a8d-8809-b37a18a688c0 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:42.430808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ba859c34-ebe8-4a8d-8809-b37a18a688c0 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:42.451396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba859c34-ebe8-4a8d-8809-b37a18a688c0 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.451910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba859c34-ebe8-4a8d-8809-b37a18a688c0 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.452333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba859c34-ebe8-4a8d-8809-b37a18a688c0 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.453069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba859c34-ebe8-4a8d-8809-b37a18a688c0 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.457932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba859c34-ebe8-4a8d-8809-b37a18a688c0 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.458423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba859c34-ebe8-4a8d-8809-b37a18a688c0 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.573534 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7c309130-2c26-4a78-bdcb-a8739070dfea tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 204 len: 0 microversion: 2.47 time: 0.265975 Oct 18 13:35:42.573935 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2033/4336] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:35:42 2022] DELETE /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:35:42.581259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-19c41010-617e-4130-aa97-f003fe6eaef5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:42.581526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-19c41010-617e-4130-aa97-f003fe6eaef5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:42.594716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19c41010-617e-4130-aa97-f003fe6eaef5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.595212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19c41010-617e-4130-aa97-f003fe6eaef5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.595654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19c41010-617e-4130-aa97-f003fe6eaef5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.596370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19c41010-617e-4130-aa97-f003fe6eaef5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.596881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19c41010-617e-4130-aa97-f003fe6eaef5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.597282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19c41010-617e-4130-aa97-f003fe6eaef5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.703667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba859c34-ebe8-4a8d-8809-b37a18a688c0 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.715430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba859c34-ebe8-4a8d-8809-b37a18a688c0 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.719675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba859c34-ebe8-4a8d-8809-b37a18a688c0 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.724225 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ba859c34-ebe8-4a8d-8809-b37a18a688c0 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1559 microversion: 2.21 time: 0.311563 Oct 18 13:35:42.725715 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2304/4337] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:42 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1559 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:42.732143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc04db35-6f9e-4e17-a634-b648f2d4da64 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:42.733093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc04db35-6f9e-4e17-a634-b648f2d4da64 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:42.743633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc04db35-6f9e-4e17-a634-b648f2d4da64 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.744439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc04db35-6f9e-4e17-a634-b648f2d4da64 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.745112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc04db35-6f9e-4e17-a634-b648f2d4da64 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.746932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc04db35-6f9e-4e17-a634-b648f2d4da64 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.747726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc04db35-6f9e-4e17-a634-b648f2d4da64 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.748213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc04db35-6f9e-4e17-a634-b648f2d4da64 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.898705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc04db35-6f9e-4e17-a634-b648f2d4da64 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.920249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc04db35-6f9e-4e17-a634-b648f2d4da64 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.924386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc04db35-6f9e-4e17-a634-b648f2d4da64 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:42.926493 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc04db35-6f9e-4e17-a634-b648f2d4da64 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1604 microversion: 2.32 time: 0.199475 Oct 18 13:35:42.931029 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2305/4338] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:42 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1604 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:42.944880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6e57cff3-1892-427c-8047-1aacf89ca42c tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:42.945982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6e57cff3-1892-427c-8047-1aacf89ca42c tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:42.956425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e57cff3-1892-427c-8047-1aacf89ca42c tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.960781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e57cff3-1892-427c-8047-1aacf89ca42c tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.967059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e57cff3-1892-427c-8047-1aacf89ca42c tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:42.968712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e57cff3-1892-427c-8047-1aacf89ca42c tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:42.970489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e57cff3-1892-427c-8047-1aacf89ca42c tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:42.971928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e57cff3-1892-427c-8047-1aacf89ca42c tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:43.147355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6e57cff3-1892-427c-8047-1aacf89ca42c tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:43.151861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:43.161443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6e57cff3-1892-427c-8047-1aacf89ca42c tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:43.163570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6e57cff3-1892-427c-8047-1aacf89ca42c tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:43.165011 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6e57cff3-1892-427c-8047-1aacf89ca42c tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1363 microversion: 2.47 time: 0.232700 Oct 18 13:35:43.165785 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2306/4339] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:42 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:43.191757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5c94e973-ff6e-4267-ab47-38b9ddfc3508 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:43.193104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5c94e973-ff6e-4267-ab47-38b9ddfc3508 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:43.203659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c94e973-ff6e-4267-ab47-38b9ddfc3508 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:43.204325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c94e973-ff6e-4267-ab47-38b9ddfc3508 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:43.204944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c94e973-ff6e-4267-ab47-38b9ddfc3508 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:43.205843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c94e973-ff6e-4267-ab47-38b9ddfc3508 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:43.206455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c94e973-ff6e-4267-ab47-38b9ddfc3508 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:43.207244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c94e973-ff6e-4267-ab47-38b9ddfc3508 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:43.347712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5c94e973-ff6e-4267-ab47-38b9ddfc3508 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:43.357809 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5c94e973-ff6e-4267-ab47-38b9ddfc3508 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1289 microversion: 2.1 time: 0.182861 Oct 18 13:35:43.358648 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2307/4340] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:43 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1289 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:43.363675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ac335629-70c3-4f6c-9e86-91a3dc616689 req-2837b359-a451-4b85-b712-04169b101f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4", "name": "network-vif-deleted", "tag": "558b2b51-37b3-404d-87cd-c2439a035ef3"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:43.389467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ac335629-70c3-4f6c-9e86-91a3dc616689 req-2837b359-a451-4b85-b712-04169b101f70 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:43.389955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ac335629-70c3-4f6c-9e86-91a3dc616689 req-2837b359-a451-4b85-b712-04169b101f70 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:43.390855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ac335629-70c3-4f6c-9e86-91a3dc616689 req-2837b359-a451-4b85-b712-04169b101f70 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:43.418737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-19c41010-617e-4130-aa97-f003fe6eaef5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:43.428028 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-19c41010-617e-4130-aa97-f003fe6eaef5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.851613 Oct 18 13:35:43.444264 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2034/4341] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:42 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:43.465030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-70442828-72c5-4f10-9952-32eba9969cfc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:43.465924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-70442828-72c5-4f10-9952-32eba9969cfc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:43.476115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70442828-72c5-4f10-9952-32eba9969cfc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:43.477144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70442828-72c5-4f10-9952-32eba9969cfc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:43.478049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70442828-72c5-4f10-9952-32eba9969cfc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:43.479175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70442828-72c5-4f10-9952-32eba9969cfc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:43.479867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70442828-72c5-4f10-9952-32eba9969cfc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:43.481097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70442828-72c5-4f10-9952-32eba9969cfc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.004988 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ac335629-70c3-4f6c-9e86-91a3dc616689 req-2837b359-a451-4b85-b712-04169b101f70 service nova] Creating event network-vif-deleted:558b2b51-37b3-404d-87cd-c2439a035ef3 for instance a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 on n-h2-858384-13 Oct 18 13:35:44.013390 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ac335629-70c3-4f6c-9e86-91a3dc616689 req-2837b359-a451-4b85-b712-04169b101f70 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.653539 Oct 18 13:35:44.014660 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2308/4342] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:44.021276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4aeadd50-87db-42f5-b939-059fe207a75a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:44.022482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4aeadd50-87db-42f5-b939-059fe207a75a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] [instance: a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:44.067569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aeadd50-87db-42f5-b939-059fe207a75a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.068204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aeadd50-87db-42f5-b939-059fe207a75a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.068815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aeadd50-87db-42f5-b939-059fe207a75a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.070125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aeadd50-87db-42f5-b939-059fe207a75a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.071912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aeadd50-87db-42f5-b939-059fe207a75a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.073244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aeadd50-87db-42f5-b939-059fe207a75a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.137889 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-4aeadd50-87db-42f5-b939-059fe207a75a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] HTTP exception thrown: Instance a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 could not be found. Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4aeadd50-87db-42f5-b939-059fe207a75a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Request method failure captured: Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 HTTP/1.1 Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqrvDX7hfN-eSsVG5bUSmtddxsKUkTSQ3MhU5S1h9Q2F5qEXNwGxe0UEPZyt4lUMmcwKLSPl-hTHB8genIjZkXCWcmc1iOnhpwp0TOqgDjt5cH36UhKsml2PynRVGK6cgeGfH3xtjDbckuGqBUHCAWL_7hmbwtkucimmVdTDyRrtEx8 Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 3ec155a5641940afb3f80c12e83c57ec Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-VolumesAdminNegativeTest-1066076903 Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3ec155a5641940afb3f80c12e83c57ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3ec155a5641940afb3f80c12e83c57ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3ec155a5641940afb3f80c12e83c57ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3ec155a5641940afb3f80c12e83c57ec"}]}] Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-VolumesAdminNegativeTest-1066076903 Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 3ec155a5641940afb3f80c12e83c57ec Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1066076903 Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-VolumesAdminNegativeTest-1066076903-project Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: eab6be43a2404bf1889cc592466bee4e Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-VolumesAdminNegativeTest-1066076903-project Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 could not be found. Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4'} Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 could not be found. Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 could not be found. Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:44.149275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:44.155458 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:44.155458 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:44.155458 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:44.155458 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:44.155458 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:44.155458 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 could not be found. Oct 18 13:35:44.155458 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:44.155458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4aeadd50-87db-42f5-b939-059fe207a75a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Returning 404 to user: Instance a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:44.157432 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4aeadd50-87db-42f5-b939-059fe207a75a tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4" status: 404 len: 111 microversion: 2.1 time: 0.136765 Oct 18 13:35:44.161454 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2309/4343] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:44 2022] GET /compute/v2.1/servers/a8ee4fb2-3f45-4ce4-943f-87a4902bc8d4 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:35:44.179154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4de37eb7-4be5-4495-b6d1-91193f7d307e tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:44.182217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4de37eb7-4be5-4495-b6d1-91193f7d307e tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:44.209470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4de37eb7-4be5-4495-b6d1-91193f7d307e tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.210048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4de37eb7-4be5-4495-b6d1-91193f7d307e tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.213814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4de37eb7-4be5-4495-b6d1-91193f7d307e tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.215767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4de37eb7-4be5-4495-b6d1-91193f7d307e tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.217042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4de37eb7-4be5-4495-b6d1-91193f7d307e tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.217513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4de37eb7-4be5-4495-b6d1-91193f7d307e tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.381723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4de37eb7-4be5-4495-b6d1-91193f7d307e tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.407092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4de37eb7-4be5-4495-b6d1-91193f7d307e tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.411092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4de37eb7-4be5-4495-b6d1-91193f7d307e tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.417061 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4de37eb7-4be5-4495-b6d1-91193f7d307e tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1517 microversion: 2.21 time: 0.249923 Oct 18 13:35:44.422077 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2310/4344] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:44 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1517 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:44.429500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:44.431502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:44.443030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.446170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.446357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.447159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.447729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.449200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.542092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-70442828-72c5-4f10-9952-32eba9969cfc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.556048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.556641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.557255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.557957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lazy-loading 'fault' on Instance uuid 64e23e75-c8b3-4bd9-a8ef-633834d237d1 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:35:44.558482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-70442828-72c5-4f10-9952-32eba9969cfc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.560108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-70442828-72c5-4f10-9952-32eba9969cfc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.561635 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-70442828-72c5-4f10-9952-32eba9969cfc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1809 microversion: 2.20 time: 1.116226 Oct 18 13:35:44.577592 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2035/4345] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:43 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1809 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:44.585522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4fd210d3-4e23-415b-bb45-625c7bac5061 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] Calling method '.version_select at 0x7ff60ee1e670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:44.632903 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4fd210d3-4e23-415b-bb45-625c7bac5061 tempest-VolumesAdminNegativeTest-1066076903 tempest-VolumesAdminNegativeTest-1066076903-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405522993" status: 202 len: 0 microversion: 2.1 time: 0.054099 Oct 18 13:35:44.661298 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2036/4346] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:35:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405522993 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:35:44.674435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.675997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-27129584-5516-461f-baac-2f841e747a88 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:44.679856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-27129584-5516-461f-baac-2f841e747a88 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:44.689014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.704300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27129584-5516-461f-baac-2f841e747a88 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.705953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27129584-5516-461f-baac-2f841e747a88 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.710805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27129584-5516-461f-baac-2f841e747a88 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.711889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27129584-5516-461f-baac-2f841e747a88 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.712572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27129584-5516-461f-baac-2f841e747a88 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.720066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fb9d8f5b3ea4aab81db501c78ed1dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91a2293232c48fbb6395fe741f745b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.721048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27129584-5516-461f-baac-2f841e747a88 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.721386 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-30696d49-080c-4441-833a-59bee827b16a tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 200 len: 1609 microversion: 2.32 time: 0.297742 Oct 18 13:35:44.721963 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2311/4347] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:44 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 1609 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:44.739439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c73c0f1c-e559-4e9c-8d9c-6a566107ae8e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:44.740077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c73c0f1c-e559-4e9c-8d9c-6a566107ae8e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:44.771413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c73c0f1c-e559-4e9c-8d9c-6a566107ae8e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.771920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c73c0f1c-e559-4e9c-8d9c-6a566107ae8e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.772390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c73c0f1c-e559-4e9c-8d9c-6a566107ae8e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.773117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c73c0f1c-e559-4e9c-8d9c-6a566107ae8e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:44.783260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c73c0f1c-e559-4e9c-8d9c-6a566107ae8e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:44.784751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c73c0f1c-e559-4e9c-8d9c-6a566107ae8e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:44.942301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-27129584-5516-461f-baac-2f841e747a88 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.960322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-27129584-5516-461f-baac-2f841e747a88 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.962246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-27129584-5516-461f-baac-2f841e747a88 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:44.966938 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-27129584-5516-461f-baac-2f841e747a88 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1363 microversion: 2.47 time: 0.304174 Oct 18 13:35:44.970454 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2037/4348] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:44 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:44.976673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4efe991f-2bf9-4e2c-9ecf-ddf18ec3b575 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:44.984116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4efe991f-2bf9-4e2c-9ecf-ddf18ec3b575 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:45.002167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4efe991f-2bf9-4e2c-9ecf-ddf18ec3b575 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:45.003582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4efe991f-2bf9-4e2c-9ecf-ddf18ec3b575 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:45.006397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4efe991f-2bf9-4e2c-9ecf-ddf18ec3b575 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:45.012834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4efe991f-2bf9-4e2c-9ecf-ddf18ec3b575 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:45.013557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4efe991f-2bf9-4e2c-9ecf-ddf18ec3b575 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:45.014149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4efe991f-2bf9-4e2c-9ecf-ddf18ec3b575 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:45.055023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c73c0f1c-e559-4e9c-8d9c-6a566107ae8e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:45.087583 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c73c0f1c-e559-4e9c-8d9c-6a566107ae8e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1295 microversion: 2.1 time: 0.364455 Oct 18 13:35:45.088360 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2312/4349] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:44 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1295 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:45.302400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4efe991f-2bf9-4e2c-9ecf-ddf18ec3b575 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:45.320990 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4efe991f-2bf9-4e2c-9ecf-ddf18ec3b575 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.348417 Oct 18 13:35:45.345226 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2038/4350] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:44 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:45.447590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:45.448122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:45.460671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:45.461408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:45.462723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:45.464205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:45.464675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:45.465153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:45.583347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:45.584065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:45.584712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:45.585923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lazy-loading 'fault' on Instance uuid 4daf2967-5671-49b1-935e-63939b417688 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:35:45.597929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9b6d22cc-915d-47b9-ad6e-a5ada94be20f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:45.598536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9b6d22cc-915d-47b9-ad6e-a5ada94be20f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:45.619861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b6d22cc-915d-47b9-ad6e-a5ada94be20f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:45.629063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b6d22cc-915d-47b9-ad6e-a5ada94be20f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:45.629775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b6d22cc-915d-47b9-ad6e-a5ada94be20f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:45.630702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b6d22cc-915d-47b9-ad6e-a5ada94be20f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:45.632451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b6d22cc-915d-47b9-ad6e-a5ada94be20f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:45.633044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b6d22cc-915d-47b9-ad6e-a5ada94be20f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:45.945424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9b6d22cc-915d-47b9-ad6e-a5ada94be20f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:45.956032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9b6d22cc-915d-47b9-ad6e-a5ada94be20f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:45.958561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9b6d22cc-915d-47b9-ad6e-a5ada94be20f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:45.960258 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9b6d22cc-915d-47b9-ad6e-a5ada94be20f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1796 microversion: 2.20 time: 0.372693 Oct 18 13:35:45.988130 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2039/4351] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:45 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1796 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:45.992894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-73b6f21d-fe76-4407-afc7-1caf3f203742 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:45.993557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-73b6f21d-fe76-4407-afc7-1caf3f203742 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:46.001642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73b6f21d-fe76-4407-afc7-1caf3f203742 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.002351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73b6f21d-fe76-4407-afc7-1caf3f203742 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.002964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73b6f21d-fe76-4407-afc7-1caf3f203742 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.003819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73b6f21d-fe76-4407-afc7-1caf3f203742 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.004416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73b6f21d-fe76-4407-afc7-1caf3f203742 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.004989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73b6f21d-fe76-4407-afc7-1caf3f203742 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.023801 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-73b6f21d-fe76-4407-afc7-1caf3f203742 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] HTTP exception thrown: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-73b6f21d-fe76-4407-afc7-1caf3f203742 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Request method failure captured: Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 HTTP/1.1 Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqoT_FIBiJT-7B3q7CE4T2xaVDlk4Co72N56z6wYlK_othL3qQ7jjCbhpn8GdJh3t05RMjoCpaHFlhgInFaOZat-yo4BZZ7FHOZIiZX2w3gAjR9v2jYtgKwBVL0kty8ZXNS0pwhwzTPaoF0R8flrycIwgF9yLsBjkEV81yqiJEpAcAM Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.32 Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b91a2293232c48fbb6395fe741f745b4 Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TaggedBootDevicesTest-1827533439 Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b91a2293232c48fbb6395fe741f745b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b91a2293232c48fbb6395fe741f745b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b91a2293232c48fbb6395fe741f745b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b91a2293232c48fbb6395fe741f745b4"}]}] Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TaggedBootDevicesTest-1827533439 Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b91a2293232c48fbb6395fe741f745b4 Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1827533439 Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TaggedBootDevicesTest-1827533439-project Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 8fb9d8f5b3ea4aab81db501c78ed1dce Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TaggedBootDevicesTest-1827533439-project Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '64e23e75-c8b3-4bd9-a8ef-633834d237d1'} Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:46.026198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:46.031443 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:46.031443 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:46.031443 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:46.031443 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:46.031443 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:46.031443 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:46.031443 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:46.031443 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:46.033929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-73b6f21d-fe76-4407-afc7-1caf3f203742 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Returning 404 to user: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:46.034948 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-73b6f21d-fe76-4407-afc7-1caf3f203742 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 404 len: 111 microversion: 2.32 time: 0.045797 Oct 18 13:35:46.036152 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2040/4352] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:45 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:35:46.041019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:46.041843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:46.054457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.055161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.055774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.056811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.057638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.058444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.177013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.177715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.178510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.179229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lazy-loading 'fault' on Instance uuid a9dc19bd-df3d-45a0-a6e8-6bc6155611ea {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:35:46.218346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:46.232869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:46.234779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5671027395d4a0eaf323bdd1a0676c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48ea1c1d348e4ce8969b2bdeebd8e8ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:46.239617 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2d3f4641-337c-435b-b236-272b32a4c3cd tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 200 len: 1349 microversion: 2.21 time: 0.796926 Oct 18 13:35:46.240753 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2313/4353] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:45 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 1349 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:46.248048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b4d2e6d1-aade-424f-a763-c6e368b04dd8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '.version_select at 0x7ff60ebe9f70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:46.266342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:46.284354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:46.287708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:46.289143 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c397421c-3ae5-480e-94f3-ed718f2cd175 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 200 len: 1368 microversion: 2.47 time: 0.251824 Oct 18 13:35:46.292570 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2041/4354] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:46 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:46.299702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-6a548185-20f1-46d4-88fb-f71b5efe956f req-c6b9657b-7631-43ef-be83-247cde78d01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4daf2967-5671-49b1-935e-63939b417688", "name": "network-vif-deleted", "tag": "c411f650-18c9-4930-a85d-6615276b67a5"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:46.307730 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b4d2e6d1-aade-424f-a763-c6e368b04dd8 tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547733761" status: 204 len: 0 microversion: 2.32 time: 0.064018 Oct 18 13:35:46.309277 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2314/4355] 10.222.0.40 () {60 vars in 1259 bytes} [Tue Oct 18 13:35:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547733761 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:35:46.335891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6a548185-20f1-46d4-88fb-f71b5efe956f req-c6b9657b-7631-43ef-be83-247cde78d01c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.337475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6a548185-20f1-46d4-88fb-f71b5efe956f req-c6b9657b-7631-43ef-be83-247cde78d01c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.339373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6a548185-20f1-46d4-88fb-f71b5efe956f req-c6b9657b-7631-43ef-be83-247cde78d01c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.341318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6c824a20-f6df-4183-b30c-b8c023027ddf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:46.344948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6c824a20-f6df-4183-b30c-b8c023027ddf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:46.371862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c824a20-f6df-4183-b30c-b8c023027ddf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.372334 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-6a548185-20f1-46d4-88fb-f71b5efe956f req-c6b9657b-7631-43ef-be83-247cde78d01c service nova] Creating event network-vif-deleted:c411f650-18c9-4930-a85d-6615276b67a5 for instance 4daf2967-5671-49b1-935e-63939b417688 on n-h1-858384-13 Oct 18 13:35:46.374026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c824a20-f6df-4183-b30c-b8c023027ddf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.381520 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-6a548185-20f1-46d4-88fb-f71b5efe956f req-c6b9657b-7631-43ef-be83-247cde78d01c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087265 Oct 18 13:35:46.381676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c824a20-f6df-4183-b30c-b8c023027ddf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.382675 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2042/4356] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:46.388210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c824a20-f6df-4183-b30c-b8c023027ddf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.388831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c824a20-f6df-4183-b30c-b8c023027ddf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.389321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c824a20-f6df-4183-b30c-b8c023027ddf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.390614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ce4c80b2-c038-4bb3-9f09-3947fe40b188 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:46.391601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ce4c80b2-c038-4bb3-9f09-3947fe40b188 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:46.400459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce4c80b2-c038-4bb3-9f09-3947fe40b188 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.401325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce4c80b2-c038-4bb3-9f09-3947fe40b188 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.402005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce4c80b2-c038-4bb3-9f09-3947fe40b188 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.403188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce4c80b2-c038-4bb3-9f09-3947fe40b188 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:46.404035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce4c80b2-c038-4bb3-9f09-3947fe40b188 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:46.404707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce4c80b2-c038-4bb3-9f09-3947fe40b188 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:46.721418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ce4c80b2-c038-4bb3-9f09-3947fe40b188 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:46.738303 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ce4c80b2-c038-4bb3-9f09-3947fe40b188 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.354108 Oct 18 13:35:46.772386 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2043/4357] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:46 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:46.820207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6c824a20-f6df-4183-b30c-b8c023027ddf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:46.829100 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6c824a20-f6df-4183-b30c-b8c023027ddf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1362 microversion: 2.1 time: 0.518688 Oct 18 13:35:46.833903 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2315/4358] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:46 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1362 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:47.268710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7e7f0ac-dbeb-4338-9a24-11ff22d6cd01 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:47.269361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f7e7f0ac-dbeb-4338-9a24-11ff22d6cd01 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:47.280722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7e7f0ac-dbeb-4338-9a24-11ff22d6cd01 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.281222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7e7f0ac-dbeb-4338-9a24-11ff22d6cd01 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.281657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7e7f0ac-dbeb-4338-9a24-11ff22d6cd01 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.287988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7e7f0ac-dbeb-4338-9a24-11ff22d6cd01 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.289289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7e7f0ac-dbeb-4338-9a24-11ff22d6cd01 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.289895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7e7f0ac-dbeb-4338-9a24-11ff22d6cd01 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.328553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-801e58fa-c984-4aba-8d0d-818a9293ed94 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:47.329171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-801e58fa-c984-4aba-8d0d-818a9293ed94 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: a9dc19bd-df3d-45a0-a6e8-6bc6155611ea] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:47.331097 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-f7e7f0ac-dbeb-4338-9a24-11ff22d6cd01 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] HTTP exception thrown: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7e7f0ac-dbeb-4338-9a24-11ff22d6cd01 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Request method failure captured: Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 HTTP/1.1 Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTquPghekC1ddaWYNCRG0Q9LnXFq-vrie5eOj-vCIUVp1WRA-oc7_3I6g8iGTBUmfxdOFcA6O_e2biuqOxx2RatfH9UV3DDvnwMXBsbyjIRoeFzmxW9iQL4WKO8MmTSavcHDx4ozRbnfnNzBVgR6yMzuA7iav2sxWJ224XD-v38Og7fI Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.21 Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 48ea1c1d348e4ce8969b2bdeebd8e8ee Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-InstanceActionsV221TestJSON-587485308 Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48ea1c1d348e4ce8969b2bdeebd8e8ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/48ea1c1d348e4ce8969b2bdeebd8e8ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48ea1c1d348e4ce8969b2bdeebd8e8ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_48ea1c1d348e4ce8969b2bdeebd8e8ee"}]}] Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-InstanceActionsV221TestJSON-587485308 Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 48ea1c1d348e4ce8969b2bdeebd8e8ee Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-587485308 Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-InstanceActionsV221TestJSON-587485308-project Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a5671027395d4a0eaf323bdd1a0676c0 Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-InstanceActionsV221TestJSON-587485308-project Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '4daf2967-5671-49b1-935e-63939b417688'} Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.332785 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:47.336251 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.336251 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:47.336251 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:47.336251 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:47.336251 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:47.336251 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:47.336251 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.336251 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.336251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7e7f0ac-dbeb-4338-9a24-11ff22d6cd01 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Returning 404 to user: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:47.336251 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f7e7f0ac-dbeb-4338-9a24-11ff22d6cd01 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 404 len: 111 microversion: 2.21 time: 0.070295 Oct 18 13:35:47.338113 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2044/4359] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:47 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:35:47.343116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-801e58fa-c984-4aba-8d0d-818a9293ed94 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.343618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-801e58fa-c984-4aba-8d0d-818a9293ed94 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.344058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-801e58fa-c984-4aba-8d0d-818a9293ed94 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.344766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-801e58fa-c984-4aba-8d0d-818a9293ed94 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.346614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b248f28e-cb97-45b5-8c9d-d2acfafc99c3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '.version_select at 0x7ff60f7008b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:47.347189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b248f28e-cb97-45b5-8c9d-d2acfafc99c3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:47.356301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-801e58fa-c984-4aba-8d0d-818a9293ed94 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.358759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-801e58fa-c984-4aba-8d0d-818a9293ed94 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.368316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b248f28e-cb97-45b5-8c9d-d2acfafc99c3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.368807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b248f28e-cb97-45b5-8c9d-d2acfafc99c3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.369271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b248f28e-cb97-45b5-8c9d-d2acfafc99c3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.369976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b248f28e-cb97-45b5-8c9d-d2acfafc99c3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.375555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b248f28e-cb97-45b5-8c9d-d2acfafc99c3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.376052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b248f28e-cb97-45b5-8c9d-d2acfafc99c3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.386406 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-801e58fa-c984-4aba-8d0d-818a9293ed94 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] HTTP exception thrown: Instance a9dc19bd-df3d-45a0-a6e8-6bc6155611ea could not be found. Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-801e58fa-c984-4aba-8d0d-818a9293ed94 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Request method failure captured: Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea HTTP/1.1 Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTquCn_JFouSdMQx_rKATa-n90FOsquVJE_5CMQAgV0lqsqqiPN1KokMM7zE2btVUJkZbDz1hsW0Ab0n2KcK7eFKSU3NKaFbc1tikLLz5MoIoiPw1KcsYCl6mRrqaoinGsMxaOxyNF8waikzRG4BmwOTUj9afLzNH_U2FbO6-tqvA-oU Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.47 Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 5dbb88c7848344559fba9e894c0118e2 Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerShowV247Test-1026644076 Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5dbb88c7848344559fba9e894c0118e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5dbb88c7848344559fba9e894c0118e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5dbb88c7848344559fba9e894c0118e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5dbb88c7848344559fba9e894c0118e2"}]}] Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerShowV247Test-1026644076 Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 5dbb88c7848344559fba9e894c0118e2 Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerShowV247Test-1026644076 Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerShowV247Test-1026644076-project Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 5bb5ca1367394a30aef76618ec31ad04 Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerShowV247Test-1026644076-project Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance a9dc19bd-df3d-45a0-a6e8-6bc6155611ea could not be found. Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'a9dc19bd-df3d-45a0-a6e8-6bc6155611ea'} Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9dc19bd-df3d-45a0-a6e8-6bc6155611ea could not be found. Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9dc19bd-df3d-45a0-a6e8-6bc6155611ea could not be found. Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:47.400199 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.403977 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:47.403977 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:47.403977 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:47.403977 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:47.403977 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:47.403977 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9dc19bd-df3d-45a0-a6e8-6bc6155611ea could not be found. Oct 18 13:35:47.403977 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.405868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-801e58fa-c984-4aba-8d0d-818a9293ed94 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Returning 404 to user: Instance a9dc19bd-df3d-45a0-a6e8-6bc6155611ea could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:47.407146 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-801e58fa-c984-4aba-8d0d-818a9293ed94 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea" status: 404 len: 111 microversion: 2.47 time: 0.083013 Oct 18 13:35:47.407952 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2316/4360] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:47 2022] GET /compute/v2.1/servers/a9dc19bd-df3d-45a0-a6e8-6bc6155611ea => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:35:47.415831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ee01834c-e7f4-4645-a754-2a78c4189224 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:47.424587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ee01834c-e7f4-4645-a754-2a78c4189224 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: 8ef39d78-9ea7-4121-a6f4-18019e156568] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:47.445818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee01834c-e7f4-4645-a754-2a78c4189224 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.446680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee01834c-e7f4-4645-a754-2a78c4189224 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.447362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee01834c-e7f4-4645-a754-2a78c4189224 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.448842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee01834c-e7f4-4645-a754-2a78c4189224 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.450665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee01834c-e7f4-4645-a754-2a78c4189224 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.451109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee01834c-e7f4-4645-a754-2a78c4189224 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.537983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ee01834c-e7f4-4645-a754-2a78c4189224 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: 8ef39d78-9ea7-4121-a6f4-18019e156568] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:35:47.633988 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b248f28e-cb97-45b5-8c9d-d2acfafc99c3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.289721 Oct 18 13:35:47.635241 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2045/4361] 10.222.0.40 () {60 vars in 1337 bytes} [Tue Oct 18 13:35:47 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688/os-instance-actions => generated 611 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:35:47.663613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a62bb6ef-9cce-4b6f-b4fd-62f828775ad3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:47.664458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a62bb6ef-9cce-4b6f-b4fd-62f828775ad3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:47.676305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a62bb6ef-9cce-4b6f-b4fd-62f828775ad3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.677133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a62bb6ef-9cce-4b6f-b4fd-62f828775ad3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.679171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a62bb6ef-9cce-4b6f-b4fd-62f828775ad3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.680242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a62bb6ef-9cce-4b6f-b4fd-62f828775ad3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.682631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a62bb6ef-9cce-4b6f-b4fd-62f828775ad3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.683892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a62bb6ef-9cce-4b6f-b4fd-62f828775ad3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.732447 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-a62bb6ef-9cce-4b6f-b4fd-62f828775ad3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] HTTP exception thrown: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a62bb6ef-9cce-4b6f-b4fd-62f828775ad3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Request method failure captured: Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 HTTP/1.1 Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTquPghekC1ddaWYNCRG0Q9LnXFq-vrie5eOj-vCIUVp1WRA-oc7_3I6g8iGTBUmfxdOFcA6O_e2biuqOxx2RatfH9UV3DDvnwMXBsbyjIRoeFzmxW9iQL4WKO8MmTSavcHDx4ozRbnfnNzBVgR6yMzuA7iav2sxWJ224XD-v38Og7fI Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.21 Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 48ea1c1d348e4ce8969b2bdeebd8e8ee Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-InstanceActionsV221TestJSON-587485308 Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48ea1c1d348e4ce8969b2bdeebd8e8ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/48ea1c1d348e4ce8969b2bdeebd8e8ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48ea1c1d348e4ce8969b2bdeebd8e8ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_48ea1c1d348e4ce8969b2bdeebd8e8ee"}]}] Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-InstanceActionsV221TestJSON-587485308 Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 48ea1c1d348e4ce8969b2bdeebd8e8ee Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-587485308 Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-InstanceActionsV221TestJSON-587485308-project Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a5671027395d4a0eaf323bdd1a0676c0 Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-InstanceActionsV221TestJSON-587485308-project Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '4daf2967-5671-49b1-935e-63939b417688'} Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:47.738997 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:47.742956 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.742956 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.742956 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:47.742956 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.742956 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:47.742956 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:47.742956 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:47.742956 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:47.742956 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:47.742956 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.742956 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.750839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a62bb6ef-9cce-4b6f-b4fd-62f828775ad3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Returning 404 to user: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:47.754854 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a62bb6ef-9cce-4b6f-b4fd-62f828775ad3 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 404 len: 111 microversion: 2.21 time: 0.093773 Oct 18 13:35:47.756807 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2046/4362] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:35:47 2022] DELETE /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:35:47.768284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bb5cef3e-60d2-40ab-a29e-ac5c2ec9b534 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:47.771008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bb5cef3e-60d2-40ab-a29e-ac5c2ec9b534 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] [instance: 4daf2967-5671-49b1-935e-63939b417688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:47.788231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb5cef3e-60d2-40ab-a29e-ac5c2ec9b534 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.789255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb5cef3e-60d2-40ab-a29e-ac5c2ec9b534 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.790038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb5cef3e-60d2-40ab-a29e-ac5c2ec9b534 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.791639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb5cef3e-60d2-40ab-a29e-ac5c2ec9b534 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.792412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb5cef3e-60d2-40ab-a29e-ac5c2ec9b534 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.794395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb5cef3e-60d2-40ab-a29e-ac5c2ec9b534 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.815179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:47.826933 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ee01834c-e7f4-4645-a754-2a78c4189224 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8ef39d78-9ea7-4121-a6f4-18019e156568" status: 204 len: 0 microversion: 2.47 time: 0.414577 Oct 18 13:35:47.830544 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-bb5cef3e-60d2-40ab-a29e-ac5c2ec9b534 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] HTTP exception thrown: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.831703 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2317/4363] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:35:47 2022] DELETE /compute/v2.1/servers/8ef39d78-9ea7-4121-a6f4-18019e156568 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bb5cef3e-60d2-40ab-a29e-ac5c2ec9b534 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Request method failure captured: Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 HTTP/1.1 Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTquPghekC1ddaWYNCRG0Q9LnXFq-vrie5eOj-vCIUVp1WRA-oc7_3I6g8iGTBUmfxdOFcA6O_e2biuqOxx2RatfH9UV3DDvnwMXBsbyjIRoeFzmxW9iQL4WKO8MmTSavcHDx4ozRbnfnNzBVgR6yMzuA7iav2sxWJ224XD-v38Og7fI Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.21 Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 48ea1c1d348e4ce8969b2bdeebd8e8ee Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-InstanceActionsV221TestJSON-587485308 Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48ea1c1d348e4ce8969b2bdeebd8e8ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/48ea1c1d348e4ce8969b2bdeebd8e8ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/48ea1c1d348e4ce8969b2bdeebd8e8ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_48ea1c1d348e4ce8969b2bdeebd8e8ee"}]}] Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-InstanceActionsV221TestJSON-587485308 Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 48ea1c1d348e4ce8969b2bdeebd8e8ee Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-587485308 Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-InstanceActionsV221TestJSON-587485308-project Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a5671027395d4a0eaf323bdd1a0676c0 Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-InstanceActionsV221TestJSON-587485308-project Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '4daf2967-5671-49b1-935e-63939b417688'} Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.832912 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:47.836921 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.836921 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:47.836921 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:47.836921 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:47.836921 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:47.836921 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:47.836921 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. Oct 18 13:35:47.836921 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:47.839059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bb5cef3e-60d2-40ab-a29e-ac5c2ec9b534 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] Returning 404 to user: Instance 4daf2967-5671-49b1-935e-63939b417688 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:47.840343 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bb5cef3e-60d2-40ab-a29e-ac5c2ec9b534 tempest-InstanceActionsV221TestJSON-587485308 tempest-InstanceActionsV221TestJSON-587485308-project] 10.222.0.40 "GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688" status: 404 len: 111 microversion: 2.21 time: 0.079869 Oct 18 13:35:47.841581 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2047/4364] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:47 2022] GET /compute/v2.1/servers/4daf2967-5671-49b1-935e-63939b417688 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:35:47.846836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad4e476b-106b-4342-8e82-eb63c90100b6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:47.847815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ad4e476b-106b-4342-8e82-eb63c90100b6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: 8ef39d78-9ea7-4121-a6f4-18019e156568] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:47.852713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32c8b9e5-f673-4764-bc55-dc096c511b25 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:47.853657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-32c8b9e5-f673-4764-bc55-dc096c511b25 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:47.862885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad4e476b-106b-4342-8e82-eb63c90100b6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.864304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad4e476b-106b-4342-8e82-eb63c90100b6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.864954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad4e476b-106b-4342-8e82-eb63c90100b6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.866065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad4e476b-106b-4342-8e82-eb63c90100b6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.866832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad4e476b-106b-4342-8e82-eb63c90100b6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.867510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad4e476b-106b-4342-8e82-eb63c90100b6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.892215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32c8b9e5-f673-4764-bc55-dc096c511b25 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.892734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32c8b9e5-f673-4764-bc55-dc096c511b25 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.893215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32c8b9e5-f673-4764-bc55-dc096c511b25 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:47.893977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32c8b9e5-f673-4764-bc55-dc096c511b25 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:47.894441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32c8b9e5-f673-4764-bc55-dc096c511b25 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:47.894873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32c8b9e5-f673-4764-bc55-dc096c511b25 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:48.343169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-32c8b9e5-f673-4764-bc55-dc096c511b25 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:48.362156 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-32c8b9e5-f673-4764-bc55-dc096c511b25 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.526390 Oct 18 13:35:48.362747 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2318/4365] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:47 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:48.367507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9c51b163-a3a6-443e-80a3-3fc24eaf0087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:48.368315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9c51b163-a3a6-443e-80a3-3fc24eaf0087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:48.391203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c51b163-a3a6-443e-80a3-3fc24eaf0087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:48.391998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c51b163-a3a6-443e-80a3-3fc24eaf0087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:48.392600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c51b163-a3a6-443e-80a3-3fc24eaf0087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:48.393543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c51b163-a3a6-443e-80a3-3fc24eaf0087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:48.394165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c51b163-a3a6-443e-80a3-3fc24eaf0087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:48.394754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c51b163-a3a6-443e-80a3-3fc24eaf0087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:48.512881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad4e476b-106b-4342-8e82-eb63c90100b6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:48.584612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad4e476b-106b-4342-8e82-eb63c90100b6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:48.586366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad4e476b-106b-4342-8e82-eb63c90100b6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:48.588264 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad4e476b-106b-4342-8e82-eb63c90100b6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/8ef39d78-9ea7-4121-a6f4-18019e156568" status: 200 len: 1363 microversion: 2.47 time: 0.745466 Oct 18 13:35:48.590375 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2048/4366] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:47 2022] GET /compute/v2.1/servers/8ef39d78-9ea7-4121-a6f4-18019e156568 => generated 1363 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:48.697123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9c51b163-a3a6-443e-80a3-3fc24eaf0087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:48.711759 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9c51b163-a3a6-443e-80a3-3fc24eaf0087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1362 microversion: 2.1 time: 0.347705 Oct 18 13:35:48.724280 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2319/4367] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:48 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:49.388539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-26651035-7363-47e9-aa75-64c22a8c9fa8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:49.389170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-26651035-7363-47e9-aa75-64c22a8c9fa8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:49.402095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26651035-7363-47e9-aa75-64c22a8c9fa8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:49.402345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26651035-7363-47e9-aa75-64c22a8c9fa8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:49.406719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26651035-7363-47e9-aa75-64c22a8c9fa8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:49.412321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26651035-7363-47e9-aa75-64c22a8c9fa8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:49.412321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26651035-7363-47e9-aa75-64c22a8c9fa8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:49.412321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26651035-7363-47e9-aa75-64c22a8c9fa8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:49.628859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed10f220-bcd0-48e9-833e-02b4df4fc0f6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:49.630749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ed10f220-bcd0-48e9-833e-02b4df4fc0f6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: 8ef39d78-9ea7-4121-a6f4-18019e156568] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:49.649707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed10f220-bcd0-48e9-833e-02b4df4fc0f6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:49.651401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed10f220-bcd0-48e9-833e-02b4df4fc0f6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:49.653754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed10f220-bcd0-48e9-833e-02b4df4fc0f6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:49.654887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed10f220-bcd0-48e9-833e-02b4df4fc0f6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:49.658055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed10f220-bcd0-48e9-833e-02b4df4fc0f6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:49.658707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed10f220-bcd0-48e9-833e-02b4df4fc0f6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:49.937779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ed10f220-bcd0-48e9-833e-02b4df4fc0f6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:49.947363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ed10f220-bcd0-48e9-833e-02b4df4fc0f6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:49.956665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ed10f220-bcd0-48e9-833e-02b4df4fc0f6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:49.958227 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ed10f220-bcd0-48e9-833e-02b4df4fc0f6 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/8ef39d78-9ea7-4121-a6f4-18019e156568" status: 200 len: 1363 microversion: 2.47 time: 0.335982 Oct 18 13:35:49.959924 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2320/4368] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:49 2022] GET /compute/v2.1/servers/8ef39d78-9ea7-4121-a6f4-18019e156568 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:35:49.974343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-31f6bd14-286e-49ad-9544-e1d7b416b62c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:49.975526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-31f6bd14-286e-49ad-9544-e1d7b416b62c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:49.993791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31f6bd14-286e-49ad-9544-e1d7b416b62c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:49.994702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31f6bd14-286e-49ad-9544-e1d7b416b62c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:49.995364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31f6bd14-286e-49ad-9544-e1d7b416b62c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:49.996526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31f6bd14-286e-49ad-9544-e1d7b416b62c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:49.999900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31f6bd14-286e-49ad-9544-e1d7b416b62c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:50.000846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31f6bd14-286e-49ad-9544-e1d7b416b62c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:50.238076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-26651035-7363-47e9-aa75-64c22a8c9fa8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:50.251644 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-26651035-7363-47e9-aa75-64c22a8c9fa8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1528 microversion: 2.1 time: 0.864745 Oct 18 13:35:50.253078 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2049/4369] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:49 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1528 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:50.554483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-31f6bd14-286e-49ad-9544-e1d7b416b62c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:50.575055 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-31f6bd14-286e-49ad-9544-e1d7b416b62c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1362 microversion: 2.1 time: 0.613101 Oct 18 13:35:50.576507 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2321/4370] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:49 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1362 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:50.951548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-357c7b3e-f19e-4352-bf57-9c13d03313a8 req-81e68d33-ace7-4a94-9cf0-2fb3956e1391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbff40e9-4767-4d10-9f02-2777d80dca4b", "tag": "082a74d7-ce60-45fb-ba35-6337ab258986"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:50.969320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-357c7b3e-f19e-4352-bf57-9c13d03313a8 req-81e68d33-ace7-4a94-9cf0-2fb3956e1391 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:50.969802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-357c7b3e-f19e-4352-bf57-9c13d03313a8 req-81e68d33-ace7-4a94-9cf0-2fb3956e1391 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:50.970233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-357c7b3e-f19e-4352-bf57-9c13d03313a8 req-81e68d33-ace7-4a94-9cf0-2fb3956e1391 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:50.989848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:50.990464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: 8ef39d78-9ea7-4121-a6f4-18019e156568] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:51.018326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:51.018831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:51.020339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:51.021267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:51.021893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:51.022477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:51.027722 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-357c7b3e-f19e-4352-bf57-9c13d03313a8 req-81e68d33-ace7-4a94-9cf0-2fb3956e1391 service nova] Creating event network-changed:082a74d7-ce60-45fb-ba35-6337ab258986 for instance fbff40e9-4767-4d10-9f02-2777d80dca4b on n-h1-858384-13 Oct 18 13:35:51.042418 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-357c7b3e-f19e-4352-bf57-9c13d03313a8 req-81e68d33-ace7-4a94-9cf0-2fb3956e1391 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094470 Oct 18 13:35:51.044407 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2050/4371] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:51.106944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:51.107999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:51.109250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:51.110677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lazy-loading 'fault' on Instance uuid 8ef39d78-9ea7-4121-a6f4-18019e156568 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:35:51.243019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:51.259691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:51.264071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb5ca1367394a30aef76618ec31ad04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbb88c7848344559fba9e894c0118e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:51.269790 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2ac3bc68-e137-4935-a7cf-a6fc13a93b54 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/8ef39d78-9ea7-4121-a6f4-18019e156568" status: 200 len: 1368 microversion: 2.47 time: 0.280682 Oct 18 13:35:51.272867 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2322/4372] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:50 2022] GET /compute/v2.1/servers/8ef39d78-9ea7-4121-a6f4-18019e156568 => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:35:51.299742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3da68f4f-3b68-482f-89e6-1ab657830ac9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:51.300456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3da68f4f-3b68-482f-89e6-1ab657830ac9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:51.307344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3da68f4f-3b68-482f-89e6-1ab657830ac9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:51.307983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3da68f4f-3b68-482f-89e6-1ab657830ac9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:51.308655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3da68f4f-3b68-482f-89e6-1ab657830ac9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:51.309581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3da68f4f-3b68-482f-89e6-1ab657830ac9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:51.316250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3da68f4f-3b68-482f-89e6-1ab657830ac9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:51.317776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3da68f4f-3b68-482f-89e6-1ab657830ac9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:51.602073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3fe89814-1065-4ad8-a300-de92fb81f166 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:51.602917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3fe89814-1065-4ad8-a300-de92fb81f166 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:51.612159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fe89814-1065-4ad8-a300-de92fb81f166 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:51.612984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fe89814-1065-4ad8-a300-de92fb81f166 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:51.615315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fe89814-1065-4ad8-a300-de92fb81f166 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:51.617472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fe89814-1065-4ad8-a300-de92fb81f166 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:51.621601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fe89814-1065-4ad8-a300-de92fb81f166 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:51.622355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fe89814-1065-4ad8-a300-de92fb81f166 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:51.694123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3da68f4f-3b68-482f-89e6-1ab657830ac9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:51.704316 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3da68f4f-3b68-482f-89e6-1ab657830ac9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1510 microversion: 2.1 time: 0.432821 Oct 18 13:35:51.723356 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2051/4373] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:51 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1510 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:51.884008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3fe89814-1065-4ad8-a300-de92fb81f166 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:51.889059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:51.894386 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3fe89814-1065-4ad8-a300-de92fb81f166 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1362 microversion: 2.1 time: 0.296557 Oct 18 13:35:51.906493 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2323/4374] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:51 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:52.305953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0b5cafd-2094-4111-8406-1f50bd11e6e7 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:52.307358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e0b5cafd-2094-4111-8406-1f50bd11e6e7 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] [instance: 8ef39d78-9ea7-4121-a6f4-18019e156568] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:52.313130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:52.321084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=10 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:52.327164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0b5cafd-2094-4111-8406-1f50bd11e6e7 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:52.336341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0b5cafd-2094-4111-8406-1f50bd11e6e7 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:52.337135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0b5cafd-2094-4111-8406-1f50bd11e6e7 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:52.338037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0b5cafd-2094-4111-8406-1f50bd11e6e7 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:52.338715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0b5cafd-2094-4111-8406-1f50bd11e6e7 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:52.341352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0b5cafd-2094-4111-8406-1f50bd11e6e7 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:52.364229 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e0b5cafd-2094-4111-8406-1f50bd11e6e7 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] HTTP exception thrown: Instance 8ef39d78-9ea7-4121-a6f4-18019e156568 could not be found. Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0b5cafd-2094-4111-8406-1f50bd11e6e7 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Request method failure captured: Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/8ef39d78-9ea7-4121-a6f4-18019e156568 HTTP/1.1 Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTquCn_JFouSdMQx_rKATa-n90FOsquVJE_5CMQAgV0lqsqqiPN1KokMM7zE2btVUJkZbDz1hsW0Ab0n2KcK7eFKSU3NKaFbc1tikLLz5MoIoiPw1KcsYCl6mRrqaoinGsMxaOxyNF8waikzRG4BmwOTUj9afLzNH_U2FbO6-tqvA-oU Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.47 Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 5dbb88c7848344559fba9e894c0118e2 Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerShowV247Test-1026644076 Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5dbb88c7848344559fba9e894c0118e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5dbb88c7848344559fba9e894c0118e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5dbb88c7848344559fba9e894c0118e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5dbb88c7848344559fba9e894c0118e2"}]}] Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerShowV247Test-1026644076 Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 5dbb88c7848344559fba9e894c0118e2 Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerShowV247Test-1026644076 Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerShowV247Test-1026644076-project Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 5bb5ca1367394a30aef76618ec31ad04 Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerShowV247Test-1026644076-project Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 8ef39d78-9ea7-4121-a6f4-18019e156568 could not be found. Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '8ef39d78-9ea7-4121-a6f4-18019e156568'} Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ef39d78-9ea7-4121-a6f4-18019e156568 could not be found. Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ef39d78-9ea7-4121-a6f4-18019e156568 could not be found. Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:52.366279 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:52.370621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:52.370621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:52.370621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:52.370621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:52.370621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:52.370621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ef39d78-9ea7-4121-a6f4-18019e156568 could not be found. Oct 18 13:35:52.370621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:52.371922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0b5cafd-2094-4111-8406-1f50bd11e6e7 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] Returning 404 to user: Instance 8ef39d78-9ea7-4121-a6f4-18019e156568 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:52.373092 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e0b5cafd-2094-4111-8406-1f50bd11e6e7 tempest-ServerShowV247Test-1026644076 tempest-ServerShowV247Test-1026644076-project] 10.222.0.40 "GET /compute/v2.1/servers/8ef39d78-9ea7-4121-a6f4-18019e156568" status: 404 len: 111 microversion: 2.47 time: 0.072607 Oct 18 13:35:52.377067 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2052/4375] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:52 2022] GET /compute/v2.1/servers/8ef39d78-9ea7-4121-a6f4-18019e156568 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:35:52.728500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5f814748-63b3-4f6d-a1fd-a7addaf01f6f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:52.729851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5f814748-63b3-4f6d-a1fd-a7addaf01f6f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:52.744244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f814748-63b3-4f6d-a1fd-a7addaf01f6f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:52.745215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f814748-63b3-4f6d-a1fd-a7addaf01f6f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:52.747202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f814748-63b3-4f6d-a1fd-a7addaf01f6f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:52.749435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f814748-63b3-4f6d-a1fd-a7addaf01f6f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:52.750190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f814748-63b3-4f6d-a1fd-a7addaf01f6f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:52.752446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f814748-63b3-4f6d-a1fd-a7addaf01f6f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:52.924536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aceb4f83-ed72-4870-8704-11364d193565 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:52.925946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aceb4f83-ed72-4870-8704-11364d193565 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:52.936677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aceb4f83-ed72-4870-8704-11364d193565 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:52.937164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aceb4f83-ed72-4870-8704-11364d193565 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:52.937636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aceb4f83-ed72-4870-8704-11364d193565 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:52.938347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aceb4f83-ed72-4870-8704-11364d193565 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:52.940835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aceb4f83-ed72-4870-8704-11364d193565 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:52.943101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aceb4f83-ed72-4870-8704-11364d193565 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:52.979622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:53.035801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5f814748-63b3-4f6d-a1fd-a7addaf01f6f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:53.046167 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5f814748-63b3-4f6d-a1fd-a7addaf01f6f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1510 microversion: 2.1 time: 0.321848 Oct 18 13:35:53.046763 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2324/4376] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:52 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1510 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:53.892511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aceb4f83-ed72-4870-8704-11364d193565 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:53.904026 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aceb4f83-ed72-4870-8704-11364d193565 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1362 microversion: 2.1 time: 0.983168 Oct 18 13:35:53.918029 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2053/4377] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:52 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1362 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:54.077113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-868c7bfd-824c-498c-b9bd-d32f2fa2023f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:54.077756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-868c7bfd-824c-498c-b9bd-d32f2fa2023f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:54.092334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-868c7bfd-824c-498c-b9bd-d32f2fa2023f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:54.096822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-868c7bfd-824c-498c-b9bd-d32f2fa2023f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:54.097554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-868c7bfd-824c-498c-b9bd-d32f2fa2023f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:54.098492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-868c7bfd-824c-498c-b9bd-d32f2fa2023f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:54.099105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-868c7bfd-824c-498c-b9bd-d32f2fa2023f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:54.099694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-868c7bfd-824c-498c-b9bd-d32f2fa2023f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:54.460078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-5e43ab11-5e96-49af-9b19-512040516dfe req-87b2f3c0-d61c-49b4-8277-bbcfd9c31f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bce6f6b-df28-4c34-a17f-4f18eb67d401", "name": "network-vif-unplugged", "status": "completed", "tag": "c5013b3d-167f-494a-9220-7ef368aab635"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:54.483891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5e43ab11-5e96-49af-9b19-512040516dfe req-87b2f3c0-d61c-49b4-8277-bbcfd9c31f50 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:54.484678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5e43ab11-5e96-49af-9b19-512040516dfe req-87b2f3c0-d61c-49b4-8277-bbcfd9c31f50 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:54.489250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5e43ab11-5e96-49af-9b19-512040516dfe req-87b2f3c0-d61c-49b4-8277-bbcfd9c31f50 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:54.515717 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-5e43ab11-5e96-49af-9b19-512040516dfe req-87b2f3c0-d61c-49b4-8277-bbcfd9c31f50 service nova] Creating event network-vif-unplugged:c5013b3d-167f-494a-9220-7ef368aab635 for instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 on n-h2-858384-13 Oct 18 13:35:54.524974 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-5e43ab11-5e96-49af-9b19-512040516dfe req-87b2f3c0-d61c-49b4-8277-bbcfd9c31f50 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065846 Oct 18 13:35:54.526272 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2054/4378] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:35:54.932640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-227c538a-611e-4167-8e91-20ed290ab509 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:54.933525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-227c538a-611e-4167-8e91-20ed290ab509 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:54.952999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-227c538a-611e-4167-8e91-20ed290ab509 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:54.953547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-227c538a-611e-4167-8e91-20ed290ab509 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:54.953998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-227c538a-611e-4167-8e91-20ed290ab509 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:54.955807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-227c538a-611e-4167-8e91-20ed290ab509 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:54.956918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-227c538a-611e-4167-8e91-20ed290ab509 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:54.957678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-227c538a-611e-4167-8e91-20ed290ab509 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:55.971250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-227c538a-611e-4167-8e91-20ed290ab509 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:55.988499 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-227c538a-611e-4167-8e91-20ed290ab509 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1362 microversion: 2.1 time: 1.059622 Oct 18 13:35:55.992782 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2055/4379] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:54 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1362 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:56.026067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-868c7bfd-824c-498c-b9bd-d32f2fa2023f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:56.038757 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-868c7bfd-824c-498c-b9bd-d32f2fa2023f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1510 microversion: 2.1 time: 1.966592 Oct 18 13:35:56.041374 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2325/4380] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:54 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1510 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:56.851472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-167e947f-15fa-4247-9ad4-ba0fea75dedf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:56.851962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-167e947f-15fa-4247-9ad4-ba0fea75dedf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:56.866236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-167e947f-15fa-4247-9ad4-ba0fea75dedf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:56.867125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-167e947f-15fa-4247-9ad4-ba0fea75dedf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:56.867844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-167e947f-15fa-4247-9ad4-ba0fea75dedf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:56.868787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-167e947f-15fa-4247-9ad4-ba0fea75dedf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:56.871253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-167e947f-15fa-4247-9ad4-ba0fea75dedf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:56.871953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-167e947f-15fa-4247-9ad4-ba0fea75dedf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:56.907037 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-167e947f-15fa-4247-9ad4-ba0fea75dedf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] HTTP exception thrown: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-167e947f-15fa-4247-9ad4-ba0fea75dedf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Request method failure captured: Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 HTTP/1.1 Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqoT_FIBiJT-7B3q7CE4T2xaVDlk4Co72N56z6wYlK_othL3qQ7jjCbhpn8GdJh3t05RMjoCpaHFlhgInFaOZat-yo4BZZ7FHOZIiZX2w3gAjR9v2jYtgKwBVL0kty8ZXNS0pwhwzTPaoF0R8flrycIwgF9yLsBjkEV81yqiJEpAcAM Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.32 Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b91a2293232c48fbb6395fe741f745b4 Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TaggedBootDevicesTest-1827533439 Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b91a2293232c48fbb6395fe741f745b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b91a2293232c48fbb6395fe741f745b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b91a2293232c48fbb6395fe741f745b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b91a2293232c48fbb6395fe741f745b4"}]}] Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TaggedBootDevicesTest-1827533439 Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b91a2293232c48fbb6395fe741f745b4 Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1827533439 Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TaggedBootDevicesTest-1827533439-project Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 8fb9d8f5b3ea4aab81db501c78ed1dce Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TaggedBootDevicesTest-1827533439-project Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '64e23e75-c8b3-4bd9-a8ef-633834d237d1'} Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:56.909425 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:56.913069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:56.913069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:56.913069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:56.913069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:56.913069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:56.913069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:56.913069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:56.913069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:56.913069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:56.913069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:56.913069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:35:56.915860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-167e947f-15fa-4247-9ad4-ba0fea75dedf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Returning 404 to user: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:56.917628 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-167e947f-15fa-4247-9ad4-ba0fea75dedf tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "DELETE /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 404 len: 111 microversion: 2.32 time: 0.069952 Oct 18 13:35:56.919005 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2056/4381] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:35:56 2022] DELETE /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:35:56.927060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2fb8d1c3-7ae0-44fe-8bda-6af2f435acfa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:56.927656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2fb8d1c3-7ae0-44fe-8bda-6af2f435acfa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] [instance: 64e23e75-c8b3-4bd9-a8ef-633834d237d1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:56.940478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb8d1c3-7ae0-44fe-8bda-6af2f435acfa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:56.941289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb8d1c3-7ae0-44fe-8bda-6af2f435acfa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:56.942042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb8d1c3-7ae0-44fe-8bda-6af2f435acfa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:56.943016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb8d1c3-7ae0-44fe-8bda-6af2f435acfa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:56.943846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb8d1c3-7ae0-44fe-8bda-6af2f435acfa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:56.944569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fb8d1c3-7ae0-44fe-8bda-6af2f435acfa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:56.963351 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-2fb8d1c3-7ae0-44fe-8bda-6af2f435acfa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] HTTP exception thrown: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2fb8d1c3-7ae0-44fe-8bda-6af2f435acfa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Request method failure captured: Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 HTTP/1.1 Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqoT_FIBiJT-7B3q7CE4T2xaVDlk4Co72N56z6wYlK_othL3qQ7jjCbhpn8GdJh3t05RMjoCpaHFlhgInFaOZat-yo4BZZ7FHOZIiZX2w3gAjR9v2jYtgKwBVL0kty8ZXNS0pwhwzTPaoF0R8flrycIwgF9yLsBjkEV81yqiJEpAcAM Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.32 Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: b91a2293232c48fbb6395fe741f745b4 Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TaggedBootDevicesTest-1827533439 Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b91a2293232c48fbb6395fe741f745b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b91a2293232c48fbb6395fe741f745b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b91a2293232c48fbb6395fe741f745b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b91a2293232c48fbb6395fe741f745b4"}]}] Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TaggedBootDevicesTest-1827533439 Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: b91a2293232c48fbb6395fe741f745b4 Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1827533439 Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TaggedBootDevicesTest-1827533439-project Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 8fb9d8f5b3ea4aab81db501c78ed1dce Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TaggedBootDevicesTest-1827533439-project Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '64e23e75-c8b3-4bd9-a8ef-633834d237d1'} Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:56.967016 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:56.970784 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:56.970784 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:56.970784 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:56.970784 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:56.970784 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:56.970784 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:56.970784 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. Oct 18 13:35:56.970784 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:56.972157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2fb8d1c3-7ae0-44fe-8bda-6af2f435acfa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] Returning 404 to user: Instance 64e23e75-c8b3-4bd9-a8ef-633834d237d1 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:56.974019 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2fb8d1c3-7ae0-44fe-8bda-6af2f435acfa tempest-TaggedBootDevicesTest-1827533439 tempest-TaggedBootDevicesTest-1827533439-project] 10.222.0.40 "GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1" status: 404 len: 111 microversion: 2.32 time: 0.050933 Oct 18 13:35:56.975290 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2326/4382] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:35:56 2022] GET /compute/v2.1/servers/64e23e75-c8b3-4bd9-a8ef-633834d237d1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:35:57.017008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eacb288f-1e63-4527-80b9-869f46f8dd1d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:57.018729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eacb288f-1e63-4527-80b9-869f46f8dd1d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:57.035273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eacb288f-1e63-4527-80b9-869f46f8dd1d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:57.035778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eacb288f-1e63-4527-80b9-869f46f8dd1d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:57.036317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eacb288f-1e63-4527-80b9-869f46f8dd1d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:57.042143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eacb288f-1e63-4527-80b9-869f46f8dd1d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:57.044960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eacb288f-1e63-4527-80b9-869f46f8dd1d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:57.050533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eacb288f-1e63-4527-80b9-869f46f8dd1d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:57.084898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7db5db03-d99d-4194-86df-8ef750e6e9ea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:57.085723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7db5db03-d99d-4194-86df-8ef750e6e9ea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:57.116514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db5db03-d99d-4194-86df-8ef750e6e9ea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:57.117033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db5db03-d99d-4194-86df-8ef750e6e9ea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:57.117509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db5db03-d99d-4194-86df-8ef750e6e9ea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:57.118227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db5db03-d99d-4194-86df-8ef750e6e9ea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:57.122128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db5db03-d99d-4194-86df-8ef750e6e9ea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:57.127371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7db5db03-d99d-4194-86df-8ef750e6e9ea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:57.615032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eacb288f-1e63-4527-80b9-869f46f8dd1d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:57.648415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7db5db03-d99d-4194-86df-8ef750e6e9ea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:57.654637 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eacb288f-1e63-4527-80b9-869f46f8dd1d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1362 microversion: 2.1 time: 0.630153 Oct 18 13:35:57.655288 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2057/4383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:57 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1362 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:57.678252 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7db5db03-d99d-4194-86df-8ef750e6e9ea tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1453 microversion: 2.1 time: 0.613342 Oct 18 13:35:57.679342 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2327/4384] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:57 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1453 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:35:57.705058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f1cef2de-7a21-4be5-8f15-e029dcb579cf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:57.706052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f1cef2de-7a21-4be5-8f15-e029dcb579cf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:57.713954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1cef2de-7a21-4be5-8f15-e029dcb579cf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:57.725445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1cef2de-7a21-4be5-8f15-e029dcb579cf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:57.726352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1cef2de-7a21-4be5-8f15-e029dcb579cf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:57.727118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1cef2de-7a21-4be5-8f15-e029dcb579cf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:57.727591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1cef2de-7a21-4be5-8f15-e029dcb579cf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:57.728018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f1cef2de-7a21-4be5-8f15-e029dcb579cf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:57.972633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f1cef2de-7a21-4be5-8f15-e029dcb579cf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:57.985372 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f1cef2de-7a21-4be5-8f15-e029dcb579cf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1453 microversion: 2.1 time: 0.284153 Oct 18 13:35:57.986309 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2058/4385] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:57 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1453 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:58.067057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dd8a385b-8ad2-460c-9b2d-7f5ed0902168 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:58.067852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dd8a385b-8ad2-460c-9b2d-7f5ed0902168 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:58.102934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd8a385b-8ad2-460c-9b2d-7f5ed0902168 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:58.103511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd8a385b-8ad2-460c-9b2d-7f5ed0902168 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:58.103838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd8a385b-8ad2-460c-9b2d-7f5ed0902168 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:58.104540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd8a385b-8ad2-460c-9b2d-7f5ed0902168 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:58.105031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd8a385b-8ad2-460c-9b2d-7f5ed0902168 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:58.120354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd8a385b-8ad2-460c-9b2d-7f5ed0902168 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:58.178594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-dd8a385b-8ad2-460c-9b2d-7f5ed0902168 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lazy-loading 'flavor' on Instance uuid 6bce6f6b-df28-4c34-a17f-4f18eb67d401 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:35:58.201053 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-dd8a385b-8ad2-460c-9b2d-7f5ed0902168 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Cannot 'shelve' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state shelved_offloaded Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dd8a385b-8ad2-460c-9b2d-7f5ed0902168 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action HTTP/1.1 Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 14 Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: {"shelve": {}} Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: exception: Cannot 'shelve' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state shelved_offloaded Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '6bce6f6b-df28-4c34-a17f-4f18eb67d401', 'body': {'shelve': {}}} Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:35:58.203187 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:35:58.206778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state shelved_offloaded Oct 18 13:35:58.206778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:58.206778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:35:58.206778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:58.206778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:35:58.206778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:35:58.206778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:35:58.206778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:35:58.206778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:35:58.206778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state shelved_offloaded Oct 18 13:35:58.206778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:35:58.209384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dd8a385b-8ad2-460c-9b2d-7f5ed0902168 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 409 to user: Cannot 'shelve' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state shelved_offloaded {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:35:58.210680 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dd8a385b-8ad2-460c-9b2d-7f5ed0902168 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action" status: 409 len: 155 microversion: 2.1 time: 0.147535 Oct 18 13:35:58.212467 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2328/4386] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:35:58 2022] POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action => generated 155 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:35:58.247395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-59a49907-f1a0-4506-a4ce-280a8948157e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:58.250657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-59a49907-f1a0-4506-a4ce-280a8948157e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:58.262076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59a49907-f1a0-4506-a4ce-280a8948157e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:58.262864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59a49907-f1a0-4506-a4ce-280a8948157e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:58.263452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59a49907-f1a0-4506-a4ce-280a8948157e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:58.265212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59a49907-f1a0-4506-a4ce-280a8948157e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:58.266005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59a49907-f1a0-4506-a4ce-280a8948157e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:58.267023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59a49907-f1a0-4506-a4ce-280a8948157e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:58.422889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-59a49907-f1a0-4506-a4ce-280a8948157e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120612) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 13:35:58.451727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:35:58.588965 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-59a49907-f1a0-4506-a4ce-280a8948157e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action" status: 202 len: 0 microversion: 2.1 time: 0.365037 Oct 18 13:35:58.602170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9fc71ae0-15f5-4b6c-9613-a14b525af586 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:58.603092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9fc71ae0-15f5-4b6c-9613-a14b525af586 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:58.608019 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2059/4387] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:35:58 2022] POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:35:58.611173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fc71ae0-15f5-4b6c-9613-a14b525af586 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:58.611888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fc71ae0-15f5-4b6c-9613-a14b525af586 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:58.612564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fc71ae0-15f5-4b6c-9613-a14b525af586 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:58.613531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fc71ae0-15f5-4b6c-9613-a14b525af586 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:58.614212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fc71ae0-15f5-4b6c-9613-a14b525af586 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:58.614858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fc71ae0-15f5-4b6c-9613-a14b525af586 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:58.682346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ac34b21d-66e3-4a7d-9ef1-211b008ff60f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:35:58.686953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ac34b21d-66e3-4a7d-9ef1-211b008ff60f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:35:58.729424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac34b21d-66e3-4a7d-9ef1-211b008ff60f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:58.732974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac34b21d-66e3-4a7d-9ef1-211b008ff60f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:58.737808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac34b21d-66e3-4a7d-9ef1-211b008ff60f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:58.738871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac34b21d-66e3-4a7d-9ef1-211b008ff60f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:58.740907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac34b21d-66e3-4a7d-9ef1-211b008ff60f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:58.743963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac34b21d-66e3-4a7d-9ef1-211b008ff60f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:59.260225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ac34b21d-66e3-4a7d-9ef1-211b008ff60f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:59.275014 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ac34b21d-66e3-4a7d-9ef1-211b008ff60f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1362 microversion: 2.1 time: 0.597048 Oct 18 13:35:59.276178 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2060/4388] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:58 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1362 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:35:59.287470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-8d55ad5a-c501-401a-9397-1f099ad066ce req-33864a56-3d0e-408a-978f-77c893fb06e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbff40e9-4767-4d10-9f02-2777d80dca4b", "name": "network-vif-plugged", "status": "completed", "tag": "082a74d7-ce60-45fb-ba35-6337ab258986"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:35:59.310351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8d55ad5a-c501-401a-9397-1f099ad066ce req-33864a56-3d0e-408a-978f-77c893fb06e2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:35:59.312231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8d55ad5a-c501-401a-9397-1f099ad066ce req-33864a56-3d0e-408a-978f-77c893fb06e2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:35:59.314456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8d55ad5a-c501-401a-9397-1f099ad066ce req-33864a56-3d0e-408a-978f-77c893fb06e2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:35:59.344658 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-8d55ad5a-c501-401a-9397-1f099ad066ce req-33864a56-3d0e-408a-978f-77c893fb06e2 service nova] Creating event network-vif-plugged:082a74d7-ce60-45fb-ba35-6337ab258986 for instance fbff40e9-4767-4d10-9f02-2777d80dca4b on n-h1-858384-13 Oct 18 13:35:59.357464 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-8d55ad5a-c501-401a-9397-1f099ad066ce req-33864a56-3d0e-408a-978f-77c893fb06e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077957 Oct 18 13:35:59.358760 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2061/4389] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:35:59.596984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9fc71ae0-15f5-4b6c-9613-a14b525af586 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:35:59.628793 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9fc71ae0-15f5-4b6c-9613-a14b525af586 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1461 microversion: 2.1 time: 1.030069 Oct 18 13:35:59.630127 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2329/4390] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:35:58 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1461 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:00.306061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e03a9695-d5de-4ee6-a5de-57ab42051485 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:00.307442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e03a9695-d5de-4ee6-a5de-57ab42051485 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:00.326368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e03a9695-d5de-4ee6-a5de-57ab42051485 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:00.327509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e03a9695-d5de-4ee6-a5de-57ab42051485 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:00.328184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e03a9695-d5de-4ee6-a5de-57ab42051485 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:00.338736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e03a9695-d5de-4ee6-a5de-57ab42051485 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:00.342152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e03a9695-d5de-4ee6-a5de-57ab42051485 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:00.342913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e03a9695-d5de-4ee6-a5de-57ab42051485 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:00.593764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e03a9695-d5de-4ee6-a5de-57ab42051485 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:00.602937 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e03a9695-d5de-4ee6-a5de-57ab42051485 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1362 microversion: 2.1 time: 0.303352 Oct 18 13:36:00.607367 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2062/4391] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:00 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:00.658441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c915814-aa46-4025-9346-9379b51e8b29 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:00.659645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7c915814-aa46-4025-9346-9379b51e8b29 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:00.674591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c915814-aa46-4025-9346-9379b51e8b29 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:00.682997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c915814-aa46-4025-9346-9379b51e8b29 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:00.684013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c915814-aa46-4025-9346-9379b51e8b29 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:00.684940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c915814-aa46-4025-9346-9379b51e8b29 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:00.686685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c915814-aa46-4025-9346-9379b51e8b29 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:00.687306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c915814-aa46-4025-9346-9379b51e8b29 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:01.644623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b312c5eb-a4f6-4a0e-9ef4-c424b6bb3c1a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:01.645285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b312c5eb-a4f6-4a0e-9ef4-c424b6bb3c1a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:01.681682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b312c5eb-a4f6-4a0e-9ef4-c424b6bb3c1a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:01.682184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b312c5eb-a4f6-4a0e-9ef4-c424b6bb3c1a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:01.682624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b312c5eb-a4f6-4a0e-9ef4-c424b6bb3c1a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:01.683892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b312c5eb-a4f6-4a0e-9ef4-c424b6bb3c1a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:01.684358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b312c5eb-a4f6-4a0e-9ef4-c424b6bb3c1a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:01.684900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b312c5eb-a4f6-4a0e-9ef4-c424b6bb3c1a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:01.836494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7c915814-aa46-4025-9346-9379b51e8b29 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:01.847555 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7c915814-aa46-4025-9346-9379b51e8b29 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1461 microversion: 2.1 time: 1.198007 Oct 18 13:36:01.848881 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2330/4392] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:00 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1461 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:02.105624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b312c5eb-a4f6-4a0e-9ef4-c424b6bb3c1a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:02.113624 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b312c5eb-a4f6-4a0e-9ef4-c424b6bb3c1a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1362 microversion: 2.1 time: 0.483487 Oct 18 13:36:02.124078 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2063/4393] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:01 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1362 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:02.875787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-365bd8a1-3262-4ce4-b21c-3c0d0524993d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:02.877931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-365bd8a1-3262-4ce4-b21c-3c0d0524993d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:02.878948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-862149306", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": "none"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:02.892825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-365bd8a1-3262-4ce4-b21c-3c0d0524993d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:02.893380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-365bd8a1-3262-4ce4-b21c-3c0d0524993d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:02.904701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-365bd8a1-3262-4ce4-b21c-3c0d0524993d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:02.911007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-365bd8a1-3262-4ce4-b21c-3c0d0524993d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:02.911706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-365bd8a1-3262-4ce4-b21c-3c0d0524993d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:02.918184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-365bd8a1-3262-4ce4-b21c-3c0d0524993d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:03.024352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:03.025074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:03.025833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:03.026453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:03.027144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:03.052959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:03.053846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:03.055610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:03.056729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:03.060310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:03.061373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:03.118283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Getting quotas for project 3a589e6057344f60a1c7ac674b1a3aa7. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:03.130916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Getting quotas for user 4a88369724c944b0a29a127bcd53df62 and project 3a589e6057344f60a1c7ac674b1a3aa7. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:03.168147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:03.170681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:03.273777 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cbac937b-208e-4b2e-a5a0-4b72376329ce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.715963 Oct 18 13:36:03.281656 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2331/4394] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:36:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:36:03.287347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bf3b26a7-b9b6-48bf-a988-2006d93292c5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:03.288209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bf3b26a7-b9b6-48bf-a988-2006d93292c5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:03.297086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf3b26a7-b9b6-48bf-a988-2006d93292c5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:03.297852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf3b26a7-b9b6-48bf-a988-2006d93292c5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:03.298550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf3b26a7-b9b6-48bf-a988-2006d93292c5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:03.299506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf3b26a7-b9b6-48bf-a988-2006d93292c5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:03.300294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf3b26a7-b9b6-48bf-a988-2006d93292c5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:03.301541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf3b26a7-b9b6-48bf-a988-2006d93292c5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:04.015746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-365bd8a1-3262-4ce4-b21c-3c0d0524993d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:04.041821 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-365bd8a1-3262-4ce4-b21c-3c0d0524993d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 1.175001 Oct 18 13:36:04.043525 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2064/4395] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:02 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:04.049472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2f3a4ebb-d2d4-4005-a3c4-4dcb1fa1682a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:04.060018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2f3a4ebb-d2d4-4005-a3c4-4dcb1fa1682a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:04.406972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bf3b26a7-b9b6-48bf-a988-2006d93292c5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:04.416152 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bf3b26a7-b9b6-48bf-a988-2006d93292c5 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1547 microversion: 2.1 time: 1.133058 Oct 18 13:36:04.426036 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2332/4396] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:03 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1547 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:04.455952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3413f508-e4f6-458f-9372-71cbe36e7832 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:04.459030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3413f508-e4f6-458f-9372-71cbe36e7832 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:04.468847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3413f508-e4f6-458f-9372-71cbe36e7832 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:04.469838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3413f508-e4f6-458f-9372-71cbe36e7832 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:04.470505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3413f508-e4f6-458f-9372-71cbe36e7832 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:04.471572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3413f508-e4f6-458f-9372-71cbe36e7832 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:04.472284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3413f508-e4f6-458f-9372-71cbe36e7832 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:04.472936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3413f508-e4f6-458f-9372-71cbe36e7832 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:04.721022 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3413f508-e4f6-458f-9372-71cbe36e7832 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.268990 Oct 18 13:36:04.732028 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2333/4397] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:36:04 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/os-interface => generated 284 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:05.075751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa31ee41-977b-4309-962c-c37e12afc0dc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:05.076968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fa31ee41-977b-4309-962c-c37e12afc0dc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:05.087455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa31ee41-977b-4309-962c-c37e12afc0dc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:05.098045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa31ee41-977b-4309-962c-c37e12afc0dc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:05.098505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa31ee41-977b-4309-962c-c37e12afc0dc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:05.100373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa31ee41-977b-4309-962c-c37e12afc0dc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:05.100373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa31ee41-977b-4309-962c-c37e12afc0dc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:05.100373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa31ee41-977b-4309-962c-c37e12afc0dc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:05.199887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2f3a4ebb-d2d4-4005-a3c4-4dcb1fa1682a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:05.208938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2f3a4ebb-d2d4-4005-a3c4-4dcb1fa1682a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:05.218802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2f3a4ebb-d2d4-4005-a3c4-4dcb1fa1682a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:05.220019 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2f3a4ebb-d2d4-4005-a3c4-4dcb1fa1682a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] 10.222.0.40 "GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c" status: 200 len: 1280 microversion: 2.47 time: 1.175028 Oct 18 13:36:05.253574 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2065/4398] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:04 2022] GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c => generated 1280 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:36:06.258143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-307f2f59-b41e-4d0e-92ea-b4e653d16605 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:06.258756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-307f2f59-b41e-4d0e-92ea-b4e653d16605 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:06.271940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-307f2f59-b41e-4d0e-92ea-b4e653d16605 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:06.272432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-307f2f59-b41e-4d0e-92ea-b4e653d16605 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:06.272863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-307f2f59-b41e-4d0e-92ea-b4e653d16605 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:06.282163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-307f2f59-b41e-4d0e-92ea-b4e653d16605 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:06.282659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-307f2f59-b41e-4d0e-92ea-b4e653d16605 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:06.283099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-307f2f59-b41e-4d0e-92ea-b4e653d16605 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:06.531018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fa31ee41-977b-4309-962c-c37e12afc0dc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:06.543600 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fa31ee41-977b-4309-962c-c37e12afc0dc tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 1.473166 Oct 18 13:36:06.552993 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2334/4399] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:05 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:06.751654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-307f2f59-b41e-4d0e-92ea-b4e653d16605 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:06.768429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-307f2f59-b41e-4d0e-92ea-b4e653d16605 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:06.770484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-307f2f59-b41e-4d0e-92ea-b4e653d16605 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:06.774316 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-307f2f59-b41e-4d0e-92ea-b4e653d16605 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] 10.222.0.40 "GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c" status: 200 len: 1338 microversion: 2.47 time: 0.520074 Oct 18 13:36:06.789780 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2066/4400] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:06 2022] GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c => generated 1338 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:36:07.570116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dd94351f-4304-47c4-a24c-89847f3c9df4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:07.570729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dd94351f-4304-47c4-a24c-89847f3c9df4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:07.586396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd94351f-4304-47c4-a24c-89847f3c9df4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:07.586895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd94351f-4304-47c4-a24c-89847f3c9df4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:07.589008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd94351f-4304-47c4-a24c-89847f3c9df4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:07.589918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd94351f-4304-47c4-a24c-89847f3c9df4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:07.590351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd94351f-4304-47c4-a24c-89847f3c9df4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:07.593438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd94351f-4304-47c4-a24c-89847f3c9df4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:07.804736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6859243f-f73b-49a6-996b-ff5db41c2bd1 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:07.805951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6859243f-f73b-49a6-996b-ff5db41c2bd1 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:07.819636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6859243f-f73b-49a6-996b-ff5db41c2bd1 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:07.821548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6859243f-f73b-49a6-996b-ff5db41c2bd1 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:07.822000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6859243f-f73b-49a6-996b-ff5db41c2bd1 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:07.822707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6859243f-f73b-49a6-996b-ff5db41c2bd1 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:07.823157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6859243f-f73b-49a6-996b-ff5db41c2bd1 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:07.823685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6859243f-f73b-49a6-996b-ff5db41c2bd1 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:07.993840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6859243f-f73b-49a6-996b-ff5db41c2bd1 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:08.002452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6859243f-f73b-49a6-996b-ff5db41c2bd1 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:08.004091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6859243f-f73b-49a6-996b-ff5db41c2bd1 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:08.005479 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6859243f-f73b-49a6-996b-ff5db41c2bd1 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] 10.222.0.40 "GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c" status: 200 len: 1338 microversion: 2.47 time: 0.204560 Oct 18 13:36:08.023772 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2067/4401] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:07 2022] GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c => generated 1338 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:36:08.111617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dd94351f-4304-47c4-a24c-89847f3c9df4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:08.124736 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dd94351f-4304-47c4-a24c-89847f3c9df4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 0.558389 Oct 18 13:36:08.125748 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2335/4402] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:07 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:08.527557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-f8d2f370-6648-470a-bd4f-b33f189542ff req-e75ebdeb-2e17-4f89-8bd7-f5110cc48459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbff40e9-4767-4d10-9f02-2777d80dca4b", "tag": "082a74d7-ce60-45fb-ba35-6337ab258986"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:08.544722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f8d2f370-6648-470a-bd4f-b33f189542ff req-e75ebdeb-2e17-4f89-8bd7-f5110cc48459 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:08.545756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f8d2f370-6648-470a-bd4f-b33f189542ff req-e75ebdeb-2e17-4f89-8bd7-f5110cc48459 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:08.546353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f8d2f370-6648-470a-bd4f-b33f189542ff req-e75ebdeb-2e17-4f89-8bd7-f5110cc48459 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:08.564905 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f8d2f370-6648-470a-bd4f-b33f189542ff req-e75ebdeb-2e17-4f89-8bd7-f5110cc48459 service nova] Creating event network-changed:082a74d7-ce60-45fb-ba35-6337ab258986 for instance fbff40e9-4767-4d10-9f02-2777d80dca4b on n-h1-858384-13 Oct 18 13:36:08.575492 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-f8d2f370-6648-470a-bd4f-b33f189542ff req-e75ebdeb-2e17-4f89-8bd7-f5110cc48459 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052864 Oct 18 13:36:08.576114 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2068/4403] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:09.032151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d953e873-3cdf-4245-bed5-c3fd34eeffce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:09.032767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d953e873-3cdf-4245-bed5-c3fd34eeffce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:09.049285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d953e873-3cdf-4245-bed5-c3fd34eeffce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:09.050151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d953e873-3cdf-4245-bed5-c3fd34eeffce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:09.079112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d953e873-3cdf-4245-bed5-c3fd34eeffce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:09.080931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d953e873-3cdf-4245-bed5-c3fd34eeffce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:09.084810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d953e873-3cdf-4245-bed5-c3fd34eeffce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:09.085714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d953e873-3cdf-4245-bed5-c3fd34eeffce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:09.149854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fbf26ba5-92ae-404c-9462-923b3706b2c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:09.152536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fbf26ba5-92ae-404c-9462-923b3706b2c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:09.173051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbf26ba5-92ae-404c-9462-923b3706b2c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:09.174901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbf26ba5-92ae-404c-9462-923b3706b2c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:09.175900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbf26ba5-92ae-404c-9462-923b3706b2c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:09.178503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbf26ba5-92ae-404c-9462-923b3706b2c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:09.179257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbf26ba5-92ae-404c-9462-923b3706b2c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:09.181559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbf26ba5-92ae-404c-9462-923b3706b2c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:09.439642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d953e873-3cdf-4245-bed5-c3fd34eeffce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:09.461616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d953e873-3cdf-4245-bed5-c3fd34eeffce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:09.484141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d953e873-3cdf-4245-bed5-c3fd34eeffce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:09.491712 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d953e873-3cdf-4245-bed5-c3fd34eeffce tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] 10.222.0.40 "GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c" status: 200 len: 1359 microversion: 2.47 time: 0.461379 Oct 18 13:36:09.510640 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2336/4404] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:09 2022] GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c => generated 1359 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:36:09.527449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f06094b4-4c20-481b-8cd4-28c449e6e0bb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-882552956"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:09.543292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f06094b4-4c20-481b-8cd4-28c449e6e0bb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:09.556115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f06094b4-4c20-481b-8cd4-28c449e6e0bb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:09.571720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f06094b4-4c20-481b-8cd4-28c449e6e0bb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:09.573985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f06094b4-4c20-481b-8cd4-28c449e6e0bb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:09.579050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f06094b4-4c20-481b-8cd4-28c449e6e0bb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:09.579855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f06094b4-4c20-481b-8cd4-28c449e6e0bb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:09.581642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f06094b4-4c20-481b-8cd4-28c449e6e0bb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:09.760305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fbf26ba5-92ae-404c-9462-923b3706b2c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:09.775694 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fbf26ba5-92ae-404c-9462-923b3706b2c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 0.630157 Oct 18 13:36:09.778890 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2069/4405] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:09 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:10.803983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-32aed1bc-2b20-49b6-b815-9a083c2b8067 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:10.805389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-32aed1bc-2b20-49b6-b815-9a083c2b8067 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:10.820640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32aed1bc-2b20-49b6-b815-9a083c2b8067 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:10.822885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32aed1bc-2b20-49b6-b815-9a083c2b8067 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:10.835998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32aed1bc-2b20-49b6-b815-9a083c2b8067 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:10.837349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32aed1bc-2b20-49b6-b815-9a083c2b8067 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:10.839537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32aed1bc-2b20-49b6-b815-9a083c2b8067 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:10.843849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32aed1bc-2b20-49b6-b815-9a083c2b8067 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:11.059734 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f06094b4-4c20-481b-8cd4-28c449e6e0bb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] 10.222.0.40 "POST /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c/action" status: 202 len: 52 microversion: 2.47 time: 1.538976 Oct 18 13:36:11.081373 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2337/4406] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:36:09 2022] POST /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c/action => generated 52 bytes in 1561 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 18 13:36:11.096086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2af08630-4458-428d-9d0b-fc6ebab2c36c tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:11.100942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2af08630-4458-428d-9d0b-fc6ebab2c36c tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:11.118967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2af08630-4458-428d-9d0b-fc6ebab2c36c tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:11.119840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2af08630-4458-428d-9d0b-fc6ebab2c36c tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:11.120547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2af08630-4458-428d-9d0b-fc6ebab2c36c tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:11.126632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2af08630-4458-428d-9d0b-fc6ebab2c36c tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:11.128314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2af08630-4458-428d-9d0b-fc6ebab2c36c tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:11.129243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2af08630-4458-428d-9d0b-fc6ebab2c36c tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:11.224025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2af08630-4458-428d-9d0b-fc6ebab2c36c tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:36:11.485448 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2af08630-4458-428d-9d0b-fc6ebab2c36c tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c" status: 204 len: 0 microversion: 2.47 time: 0.400034 Oct 18 13:36:11.486421 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2338/4407] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:36:11 2022] DELETE /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:36:11.515565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-deb951fa-f32b-441b-b28e-419f96ea679a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:11.516209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-deb951fa-f32b-441b-b28e-419f96ea679a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:11.548488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-deb951fa-f32b-441b-b28e-419f96ea679a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:11.549345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-deb951fa-f32b-441b-b28e-419f96ea679a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:11.549974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-deb951fa-f32b-441b-b28e-419f96ea679a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:11.550880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-deb951fa-f32b-441b-b28e-419f96ea679a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:11.551487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-deb951fa-f32b-441b-b28e-419f96ea679a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:11.552137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-deb951fa-f32b-441b-b28e-419f96ea679a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:11.570316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:11.748256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-deb951fa-f32b-441b-b28e-419f96ea679a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:11.758462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-deb951fa-f32b-441b-b28e-419f96ea679a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:11.768359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-deb951fa-f32b-441b-b28e-419f96ea679a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:11.773956 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-deb951fa-f32b-441b-b28e-419f96ea679a tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] 10.222.0.40 "GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c" status: 200 len: 1365 microversion: 2.47 time: 0.283489 Oct 18 13:36:11.774720 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2339/4408] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:11 2022] GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c => generated 1365 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:36:12.203625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-32aed1bc-2b20-49b6-b815-9a083c2b8067 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:12.227556 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-32aed1bc-2b20-49b6-b815-9a083c2b8067 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 1.428264 Oct 18 13:36:12.275414 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2070/4409] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:10 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:12.802653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-92f8e383-0e09-4529-8e4c-7fc6b7f11d74 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:12.803916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-92f8e383-0e09-4529-8e4c-7fc6b7f11d74 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:12.821378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92f8e383-0e09-4529-8e4c-7fc6b7f11d74 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:12.822191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92f8e383-0e09-4529-8e4c-7fc6b7f11d74 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:12.822835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92f8e383-0e09-4529-8e4c-7fc6b7f11d74 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:12.823977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92f8e383-0e09-4529-8e4c-7fc6b7f11d74 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:12.829921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92f8e383-0e09-4529-8e4c-7fc6b7f11d74 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:12.830804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92f8e383-0e09-4529-8e4c-7fc6b7f11d74 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:13.013900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-92f8e383-0e09-4529-8e4c-7fc6b7f11d74 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:13.023487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-92f8e383-0e09-4529-8e4c-7fc6b7f11d74 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:13.049278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-92f8e383-0e09-4529-8e4c-7fc6b7f11d74 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:13.050692 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-92f8e383-0e09-4529-8e4c-7fc6b7f11d74 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] 10.222.0.40 "GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c" status: 200 len: 1365 microversion: 2.47 time: 0.252326 Oct 18 13:36:13.056715 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2340/4410] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:12 2022] GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:36:13.284046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3f0fcc80-bca9-401f-a15c-68278226467e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:13.287079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3f0fcc80-bca9-401f-a15c-68278226467e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:13.331232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f0fcc80-bca9-401f-a15c-68278226467e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:13.352989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f0fcc80-bca9-401f-a15c-68278226467e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:13.355753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f0fcc80-bca9-401f-a15c-68278226467e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:13.356753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f0fcc80-bca9-401f-a15c-68278226467e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:13.363663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f0fcc80-bca9-401f-a15c-68278226467e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:13.364557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f0fcc80-bca9-401f-a15c-68278226467e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:13.915582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3f0fcc80-bca9-401f-a15c-68278226467e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:13.924379 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3f0fcc80-bca9-401f-a15c-68278226467e tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 0.651071 Oct 18 13:36:13.933432 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2071/4411] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:13 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:14.087442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:14.088729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:14.096847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-38e5e08f-a23c-4a84-a289-77839e09b5eb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:14.100263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-38e5e08f-a23c-4a84-a289-77839e09b5eb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:14.130439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38e5e08f-a23c-4a84-a289-77839e09b5eb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:14.132676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38e5e08f-a23c-4a84-a289-77839e09b5eb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:14.133381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38e5e08f-a23c-4a84-a289-77839e09b5eb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:14.134505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38e5e08f-a23c-4a84-a289-77839e09b5eb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:14.137541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38e5e08f-a23c-4a84-a289-77839e09b5eb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:14.144307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38e5e08f-a23c-4a84-a289-77839e09b5eb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:14.337509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-38e5e08f-a23c-4a84-a289-77839e09b5eb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:14.390637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-38e5e08f-a23c-4a84-a289-77839e09b5eb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:14.392799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-38e5e08f-a23c-4a84-a289-77839e09b5eb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:14.402777 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-38e5e08f-a23c-4a84-a289-77839e09b5eb tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] 10.222.0.40 "GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c" status: 200 len: 1365 microversion: 2.47 time: 0.315658 Oct 18 13:36:14.413225 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2341/4412] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:14 2022] GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:36:14.961136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ab558fd1-eff8-4c0c-97c5-65368aac9645 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:14.961895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ab558fd1-eff8-4c0c-97c5-65368aac9645 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:15.007762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab558fd1-eff8-4c0c-97c5-65368aac9645 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:15.008783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab558fd1-eff8-4c0c-97c5-65368aac9645 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:15.010646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab558fd1-eff8-4c0c-97c5-65368aac9645 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:15.015330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab558fd1-eff8-4c0c-97c5-65368aac9645 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:15.019509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab558fd1-eff8-4c0c-97c5-65368aac9645 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:15.023725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab558fd1-eff8-4c0c-97c5-65368aac9645 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:15.204158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:15.444997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-95fbbfda-cf92-4125-88e1-21f8976e3be9 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:15.446666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-95fbbfda-cf92-4125-88e1-21f8976e3be9 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:15.468708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95fbbfda-cf92-4125-88e1-21f8976e3be9 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:15.472575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95fbbfda-cf92-4125-88e1-21f8976e3be9 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:15.474884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95fbbfda-cf92-4125-88e1-21f8976e3be9 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:15.477355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95fbbfda-cf92-4125-88e1-21f8976e3be9 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:15.478187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95fbbfda-cf92-4125-88e1-21f8976e3be9 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:15.482797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95fbbfda-cf92-4125-88e1-21f8976e3be9 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:15.720436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-95fbbfda-cf92-4125-88e1-21f8976e3be9 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:15.742552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-95fbbfda-cf92-4125-88e1-21f8976e3be9 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:15.744455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-95fbbfda-cf92-4125-88e1-21f8976e3be9 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:15.750180 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-95fbbfda-cf92-4125-88e1-21f8976e3be9 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] 10.222.0.40 "GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c" status: 200 len: 1365 microversion: 2.47 time: 0.315015 Oct 18 13:36:15.754038 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2342/4413] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:15 2022] GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c => generated 1365 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:36:15.893165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ab558fd1-eff8-4c0c-97c5-65368aac9645 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:15.895836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:15.943115 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ab558fd1-eff8-4c0c-97c5-65368aac9645 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 0.973118 Oct 18 13:36:15.943115 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2072/4414] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:14 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:16.728970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1190643547", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "aa0d4f33-39e0-4d3f-ab36-9b89248d2552"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:16.787127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:16.787950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:16.806938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:16.815923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:16.816624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:16.817535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:16.818319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:16.818866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:16.903017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] validate_networks() for [('aa0d4f33-39e0-4d3f-ab36-9b89248d2552', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:36:16.923782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:16.924426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:16.925051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:16.926448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lazy-loading 'fault' on Instance uuid c0c8443a-056c-469a-801d-dcb2a3059f0c {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:36:17.149171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:17.159205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:17.162866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a88369724c944b0a29a127bcd53df62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a589e6057344f60a1c7ac674b1a3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:17.165630 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31006719-0338-417c-b0e4-80f4362f1cc5 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] 10.222.0.40 "GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c" status: 200 len: 1370 microversion: 2.47 time: 0.389530 Oct 18 13:36:17.169426 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2073/4415] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:16 2022] GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c => generated 1370 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:36:17.178714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a4fb5019-70de-414d-877c-6e337736d0d4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:17.180650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a4fb5019-70de-414d-877c-6e337736d0d4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:17.199211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4fb5019-70de-414d-877c-6e337736d0d4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:17.202646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4fb5019-70de-414d-877c-6e337736d0d4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:17.204163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4fb5019-70de-414d-877c-6e337736d0d4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:17.205957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4fb5019-70de-414d-877c-6e337736d0d4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:17.208098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4fb5019-70de-414d-877c-6e337736d0d4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:17.209481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4fb5019-70de-414d-877c-6e337736d0d4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:17.605667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a4fb5019-70de-414d-877c-6e337736d0d4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:17.616714 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a4fb5019-70de-414d-877c-6e337736d0d4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 0.446044 Oct 18 13:36:17.623837 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2074/4416] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:17 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:18.224697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-26e261fa-0137-4722-8665-27a5cb0789d4 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:18.225152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-26e261fa-0137-4722-8665-27a5cb0789d4 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] [instance: c0c8443a-056c-469a-801d-dcb2a3059f0c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:18.238523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26e261fa-0137-4722-8665-27a5cb0789d4 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:18.239584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26e261fa-0137-4722-8665-27a5cb0789d4 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:18.240830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26e261fa-0137-4722-8665-27a5cb0789d4 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:18.241824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26e261fa-0137-4722-8665-27a5cb0789d4 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:18.242506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26e261fa-0137-4722-8665-27a5cb0789d4 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:18.243185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26e261fa-0137-4722-8665-27a5cb0789d4 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:18.261722 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-26e261fa-0137-4722-8665-27a5cb0789d4 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] HTTP exception thrown: Instance c0c8443a-056c-469a-801d-dcb2a3059f0c could not be found. Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-26e261fa-0137-4722-8665-27a5cb0789d4 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Request method failure captured: Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c HTTP/1.1 Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvCpAv1XVk9DgrFP5pACIfOPlxV4YyVmoLtl9MvnpP29x_a5Y8qHySYfswHQOKM1oA5EIPciKF4NN_kvMS1mczAnAhAjLtMzpInN2NZM-sRw8unjbxpYva0ls9M74ms2K3uyadi_lWKr2UouzF80vJZfV0FllT8-DRi_W_UcBRhPXI Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.47 Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 3a589e6057344f60a1c7ac674b1a3aa7 Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersAaction247Test-902498125 Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3a589e6057344f60a1c7ac674b1a3aa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3a589e6057344f60a1c7ac674b1a3aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3a589e6057344f60a1c7ac674b1a3aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3a589e6057344f60a1c7ac674b1a3aa7"}]}] Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersAaction247Test-902498125 Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 3a589e6057344f60a1c7ac674b1a3aa7 Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersAaction247Test-902498125 Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersAaction247Test-902498125-project Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 4a88369724c944b0a29a127bcd53df62 Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersAaction247Test-902498125-project Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c0c8443a-056c-469a-801d-dcb2a3059f0c could not be found. Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c0c8443a-056c-469a-801d-dcb2a3059f0c'} Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0c8443a-056c-469a-801d-dcb2a3059f0c could not be found. Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c8443a-056c-469a-801d-dcb2a3059f0c could not be found. Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:18.264372 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:18.268538 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:18.268538 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:18.268538 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:18.268538 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:18.268538 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:18.268538 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c8443a-056c-469a-801d-dcb2a3059f0c could not be found. Oct 18 13:36:18.268538 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:18.273411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-26e261fa-0137-4722-8665-27a5cb0789d4 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] Returning 404 to user: Instance c0c8443a-056c-469a-801d-dcb2a3059f0c could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:18.275152 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-26e261fa-0137-4722-8665-27a5cb0789d4 tempest-ServersAaction247Test-902498125 tempest-ServersAaction247Test-902498125-project] 10.222.0.40 "GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c" status: 404 len: 111 microversion: 2.47 time: 0.058486 Oct 18 13:36:18.277079 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2075/4417] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:36:18 2022] GET /compute/v2.1/servers/c0c8443a-056c-469a-801d-dcb2a3059f0c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:36:18.570630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dc27a6c3-0e97-411e-b874-3f5510843ede tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60eb51a60>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:18.627247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:18.627829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:18.628946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:18.629761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:18.631116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:18.633938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:18.661962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:18.662922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:18.663683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:18.663957 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dc27a6c3-0e97-411e-b874-3f5510843ede tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/a704e0bd-694c-4fe2-8938-bea1b26ea85c" status: 200 len: 661 microversion: 2.1 time: 0.095794 Oct 18 13:36:18.673564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:18.673564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:18.673564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:18.676158 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2076/4418] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:18 2022] GET /compute/v2.1/images/a704e0bd-694c-4fe2-8938-bea1b26ea85c => generated 661 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:18.683013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-056f4d45-3fd3-423e-aa61-500d5cc9e802 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:18.687858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-056f4d45-3fd3-423e-aa61-500d5cc9e802 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:18.706718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-056f4d45-3fd3-423e-aa61-500d5cc9e802 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:18.708397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-056f4d45-3fd3-423e-aa61-500d5cc9e802 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:18.709162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-056f4d45-3fd3-423e-aa61-500d5cc9e802 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:18.710825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-056f4d45-3fd3-423e-aa61-500d5cc9e802 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:18.711821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-056f4d45-3fd3-423e-aa61-500d5cc9e802 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:18.714701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-056f4d45-3fd3-423e-aa61-500d5cc9e802 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:18.743155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:18.753976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for user a4856dd5667c4f10aa9ff1ccb1788cc8 and project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:18.780868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:18.785334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:18.906449 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-65ca2e1d-62f4-41d1-8d6e-5175b2a007f7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.479084 Oct 18 13:36:18.909786 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2343/4419] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:36:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:36:18.924511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-390eff40-ed8c-4837-9a2d-e3135d37a560 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ebe7160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:19.038830 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-390eff40-ed8c-4837-9a2d-e3135d37a560 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/a704e0bd-694c-4fe2-8938-bea1b26ea85c" status: 200 len: 661 microversion: 2.1 time: 0.122636 Oct 18 13:36:19.039862 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2344/4420] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:18 2022] GET /compute/v2.1/images/a704e0bd-694c-4fe2-8938-bea1b26ea85c => generated 661 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:19.060871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d0a9a3a4-387d-4443-a640-8aecf0315eea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:19.077709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d0a9a3a4-387d-4443-a640-8aecf0315eea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:19.209459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-056f4d45-3fd3-423e-aa61-500d5cc9e802 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:19.222100 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-056f4d45-3fd3-423e-aa61-500d5cc9e802 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 0.544633 Oct 18 13:36:19.245639 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2077/4421] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:18 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:19.705528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d0a9a3a4-387d-4443-a640-8aecf0315eea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:19.721002 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d0a9a3a4-387d-4443-a640-8aecf0315eea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1193 microversion: 2.1 time: 0.676362 Oct 18 13:36:19.727333 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2345/4422] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:19 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1193 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:20.256496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e8b6ae77-f180-42c6-993e-843a61fbbb40 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:20.257787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e8b6ae77-f180-42c6-993e-843a61fbbb40 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:20.277536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8b6ae77-f180-42c6-993e-843a61fbbb40 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:20.280093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8b6ae77-f180-42c6-993e-843a61fbbb40 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:20.280780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8b6ae77-f180-42c6-993e-843a61fbbb40 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:20.284269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8b6ae77-f180-42c6-993e-843a61fbbb40 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:20.287255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8b6ae77-f180-42c6-993e-843a61fbbb40 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:20.290305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8b6ae77-f180-42c6-993e-843a61fbbb40 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:20.756452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6f4b2f16-f2b5-4356-9adc-d220389b2a64 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:20.758150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6f4b2f16-f2b5-4356-9adc-d220389b2a64 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:20.775790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f4b2f16-f2b5-4356-9adc-d220389b2a64 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:20.785342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f4b2f16-f2b5-4356-9adc-d220389b2a64 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:20.786022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f4b2f16-f2b5-4356-9adc-d220389b2a64 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:20.790123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f4b2f16-f2b5-4356-9adc-d220389b2a64 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:20.790977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f4b2f16-f2b5-4356-9adc-d220389b2a64 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:20.791435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f4b2f16-f2b5-4356-9adc-d220389b2a64 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:21.175384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e8b6ae77-f180-42c6-993e-843a61fbbb40 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:21.190188 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e8b6ae77-f180-42c6-993e-843a61fbbb40 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 0.937836 Oct 18 13:36:21.191502 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2078/4423] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:20 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:21.421976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af3d5d45-cb72-4ea7-9e22-da7494168735 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60eddd8b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:21.513882 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-af3d5d45-cb72-4ea7-9e22-da7494168735 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/3932fd35-f504-4607-8c78-5207be412de8" status: 200 len: 662 microversion: 2.1 time: 0.096700 Oct 18 13:36:21.515420 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2079/4424] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:21 2022] GET /compute/v2.1/images/3932fd35-f504-4607-8c78-5207be412de8 => generated 662 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:36:21.532676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a3d767a7-d3b4-473d-b2aa-2f4649276bf8 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ee4daf0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:21.604143 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a3d767a7-d3b4-473d-b2aa-2f4649276bf8 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/3932fd35-f504-4607-8c78-5207be412de8" status: 200 len: 662 microversion: 2.1 time: 0.078075 Oct 18 13:36:21.609530 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2080/4425] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:21 2022] GET /compute/v2.1/images/3932fd35-f504-4607-8c78-5207be412de8 => generated 662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:22.190346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6f4b2f16-f2b5-4356-9adc-d220389b2a64 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:22.218884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6055fdef-48e3-4fb2-a0ea-87bae574f0a5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:22.219552 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6f4b2f16-f2b5-4356-9adc-d220389b2a64 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1245 microversion: 2.1 time: 1.450238 Oct 18 13:36:22.219668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6055fdef-48e3-4fb2-a0ea-87bae574f0a5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:22.229215 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2346/4426] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:20 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1245 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:22.238706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6055fdef-48e3-4fb2-a0ea-87bae574f0a5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:22.238706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6055fdef-48e3-4fb2-a0ea-87bae574f0a5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:22.238706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6055fdef-48e3-4fb2-a0ea-87bae574f0a5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:22.249879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6055fdef-48e3-4fb2-a0ea-87bae574f0a5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:22.250874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6055fdef-48e3-4fb2-a0ea-87bae574f0a5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:22.251758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6055fdef-48e3-4fb2-a0ea-87bae574f0a5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:23.252283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-59e56dc7-f8d5-490d-a156-e87a8eb59ff0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:23.253063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-59e56dc7-f8d5-490d-a156-e87a8eb59ff0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:23.285676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59e56dc7-f8d5-490d-a156-e87a8eb59ff0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:23.286256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59e56dc7-f8d5-490d-a156-e87a8eb59ff0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:23.287022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59e56dc7-f8d5-490d-a156-e87a8eb59ff0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:23.291304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59e56dc7-f8d5-490d-a156-e87a8eb59ff0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:23.293654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59e56dc7-f8d5-490d-a156-e87a8eb59ff0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:23.295993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59e56dc7-f8d5-490d-a156-e87a8eb59ff0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:23.490831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6055fdef-48e3-4fb2-a0ea-87bae574f0a5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:23.515421 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6055fdef-48e3-4fb2-a0ea-87bae574f0a5 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 1.300270 Oct 18 13:36:23.524207 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2081/4427] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:22 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:23.545272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-59e56dc7-f8d5-490d-a156-e87a8eb59ff0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:23.554055 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-59e56dc7-f8d5-490d-a156-e87a8eb59ff0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1251 microversion: 2.1 time: 0.311404 Oct 18 13:36:23.554657 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2347/4428] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:23 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1251 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:24.271997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-83c83483-f8b4-4aa1-82b0-aa0dacf2a173 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60eddd160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:24.370550 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-83c83483-f8b4-4aa1-82b0-aa0dacf2a173 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/4e663d51-0127-4a2b-bb21-0575f57d2f2b" status: 200 len: 661 microversion: 2.1 time: 0.101962 Oct 18 13:36:24.371222 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2082/4429] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:24 2022] GET /compute/v2.1/images/4e663d51-0127-4a2b-bb21-0575f57d2f2b => generated 661 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:24.385329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13944a87-379e-4ce0-982f-751849dfa57c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60eecf3a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:24.462243 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13944a87-379e-4ce0-982f-751849dfa57c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/4e663d51-0127-4a2b-bb21-0575f57d2f2b" status: 200 len: 661 microversion: 2.1 time: 0.080625 Oct 18 13:36:24.462837 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2348/4430] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:24 2022] GET /compute/v2.1/images/4e663d51-0127-4a2b-bb21-0575f57d2f2b => generated 661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:24.559680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-baa1b109-0ca9-4c85-aab0-90086f6ce3a2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:24.560294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-baa1b109-0ca9-4c85-aab0-90086f6ce3a2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:24.583226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e6230ef5-cebf-4e9a-8b43-eda44f6fc8ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:24.583837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e6230ef5-cebf-4e9a-8b43-eda44f6fc8ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:24.602792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-baa1b109-0ca9-4c85-aab0-90086f6ce3a2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:24.606580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6230ef5-cebf-4e9a-8b43-eda44f6fc8ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:24.609800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-baa1b109-0ca9-4c85-aab0-90086f6ce3a2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:24.613753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-baa1b109-0ca9-4c85-aab0-90086f6ce3a2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:24.617284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-baa1b109-0ca9-4c85-aab0-90086f6ce3a2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:24.626688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-baa1b109-0ca9-4c85-aab0-90086f6ce3a2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:24.627124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6230ef5-cebf-4e9a-8b43-eda44f6fc8ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:24.627855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6230ef5-cebf-4e9a-8b43-eda44f6fc8ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:24.629245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-baa1b109-0ca9-4c85-aab0-90086f6ce3a2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:24.631877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6230ef5-cebf-4e9a-8b43-eda44f6fc8ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:24.637290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6230ef5-cebf-4e9a-8b43-eda44f6fc8ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:24.640080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6230ef5-cebf-4e9a-8b43-eda44f6fc8ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:25.089804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e6230ef5-cebf-4e9a-8b43-eda44f6fc8ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:25.106158 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e6230ef5-cebf-4e9a-8b43-eda44f6fc8ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1251 microversion: 2.1 time: 0.527175 Oct 18 13:36:25.111352 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2349/4431] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:24 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1251 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:25.133200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1365856726", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:25.297662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:36:25.666565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-baa1b109-0ca9-4c85-aab0-90086f6ce3a2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:25.682351 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-baa1b109-0ca9-4c85-aab0-90086f6ce3a2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 1.133240 Oct 18 13:36:25.687667 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2083/4432] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:24 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:25.967321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:25.967833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:25.969937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:25.970441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:25.973304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:26.002566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:26.003124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:26.003709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:26.007564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:26.008048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:26.008486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:26.046128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Getting quotas for project 83bedd11e01645ffa6a7f20bf82a1e0d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:26.067370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Getting quotas for user 859a37ff232745e5b5a429477bf0fb3d and project 83bedd11e01645ffa6a7f20bf82a1e0d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:26.085473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:26.088433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:26.150924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-469f2790-c171-4062-b706-2d983e735b59 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:26.152266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-469f2790-c171-4062-b706-2d983e735b59 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:26.166105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-469f2790-c171-4062-b706-2d983e735b59 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:26.168922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-469f2790-c171-4062-b706-2d983e735b59 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:26.169848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-469f2790-c171-4062-b706-2d983e735b59 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:26.171464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-469f2790-c171-4062-b706-2d983e735b59 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:26.173808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-469f2790-c171-4062-b706-2d983e735b59 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:26.175710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-469f2790-c171-4062-b706-2d983e735b59 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:26.184120 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a221331c-81c2-4391-9394-40e345fc9715 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064823 Oct 18 13:36:26.184850 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2350/4433] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:36:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:36:26.558809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-861695598", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:26.654757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:36:27.249287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-469f2790-c171-4062-b706-2d983e735b59 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:27.265227 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-469f2790-c171-4062-b706-2d983e735b59 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1293 microversion: 2.1 time: 1.131791 Oct 18 13:36:27.270929 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2084/4434] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:26 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1293 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:27.298055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-70b2b419-e45c-4a6c-a59b-5d2022d15b35 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:27.302696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-70b2b419-e45c-4a6c-a59b-5d2022d15b35 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:27.330554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70b2b419-e45c-4a6c-a59b-5d2022d15b35 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.331313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70b2b419-e45c-4a6c-a59b-5d2022d15b35 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.331930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70b2b419-e45c-4a6c-a59b-5d2022d15b35 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.332822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70b2b419-e45c-4a6c-a59b-5d2022d15b35 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.333474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70b2b419-e45c-4a6c-a59b-5d2022d15b35 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.334129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70b2b419-e45c-4a6c-a59b-5d2022d15b35 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.422144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:27.422715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:27.423117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:27.423561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:27.424011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:27.441515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.446735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.447642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.448731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:27.454686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:27.455468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:27.511520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Getting quotas for project 83bedd11e01645ffa6a7f20bf82a1e0d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:27.534913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Getting quotas for user 859a37ff232745e5b5a429477bf0fb3d and project 83bedd11e01645ffa6a7f20bf82a1e0d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:27.559183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:27.561791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:27.631354 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0676ebc6-8825-4046-9b3f-c2287cd05b28 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077740 Oct 18 13:36:27.632723 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2351/4435] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:36:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:36:27.646424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8509f956-a290-47ba-889c-3709558aed98 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:27.647362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8509f956-a290-47ba-889c-3709558aed98 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:27.833041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-70b2b419-e45c-4a6c-a59b-5d2022d15b35 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:27.850193 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-70b2b419-e45c-4a6c-a59b-5d2022d15b35 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 0.572666 Oct 18 13:36:27.851169 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2085/4436] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:27 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:27.925686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8509f956-a290-47ba-889c-3709558aed98 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:27.944154 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8509f956-a290-47ba-889c-3709558aed98 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1217 microversion: 2.1 time: 0.303382 Oct 18 13:36:27.944749 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2352/4437] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:27 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1217 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:28.295878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0776734-7f4d-4b65-999b-ca7ccd509996 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:28.296647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e0776734-7f4d-4b65-999b-ca7ccd509996 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:28.322992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0776734-7f4d-4b65-999b-ca7ccd509996 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:28.325706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0776734-7f4d-4b65-999b-ca7ccd509996 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:28.329827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0776734-7f4d-4b65-999b-ca7ccd509996 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:28.330866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0776734-7f4d-4b65-999b-ca7ccd509996 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:28.331550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0776734-7f4d-4b65-999b-ca7ccd509996 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:28.332193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0776734-7f4d-4b65-999b-ca7ccd509996 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:28.876798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d0f324fa-8cfd-416d-b14a-9729739af7d6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:28.878250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d0f324fa-8cfd-416d-b14a-9729739af7d6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:28.888567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0f324fa-8cfd-416d-b14a-9729739af7d6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:28.889397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0f324fa-8cfd-416d-b14a-9729739af7d6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:28.889998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0f324fa-8cfd-416d-b14a-9729739af7d6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:28.890904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0f324fa-8cfd-416d-b14a-9729739af7d6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:28.892284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0f324fa-8cfd-416d-b14a-9729739af7d6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:28.893539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0f324fa-8cfd-416d-b14a-9729739af7d6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:29.204105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e0776734-7f4d-4b65-999b-ca7ccd509996 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:29.218683 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e0776734-7f4d-4b65-999b-ca7ccd509996 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1293 microversion: 2.1 time: 0.927113 Oct 18 13:36:29.219860 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2086/4438] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:28 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1293 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:29.236211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0d5c4701-594e-40cf-bb7a-e7c6ef9a4472 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:29.237607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0d5c4701-594e-40cf-bb7a-e7c6ef9a4472 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:29.253947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=51 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:29.255446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d5c4701-594e-40cf-bb7a-e7c6ef9a4472 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:29.255943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d5c4701-594e-40cf-bb7a-e7c6ef9a4472 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:29.262286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d5c4701-594e-40cf-bb7a-e7c6ef9a4472 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:29.263231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d5c4701-594e-40cf-bb7a-e7c6ef9a4472 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:29.263787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d5c4701-594e-40cf-bb7a-e7c6ef9a4472 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:29.264237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d5c4701-594e-40cf-bb7a-e7c6ef9a4472 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:29.605165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0d5c4701-594e-40cf-bb7a-e7c6ef9a4472 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:29.618706 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0d5c4701-594e-40cf-bb7a-e7c6ef9a4472 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1269 microversion: 2.1 time: 0.397237 Oct 18 13:36:29.621451 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2087/4439] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:29 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1269 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:29.988374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-9df2082e-7b9d-4764-bc28-e6d4bc59a175 req-1f699fdc-f593-4dd4-9677-8b3136e8cb4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e16abfbb-113b-424e-86a1-bea54f1a4163", "tag": "33594d76-30f8-4217-849d-350d9ace5855"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:30.012640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d0f324fa-8cfd-416d-b14a-9729739af7d6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:30.019179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9df2082e-7b9d-4764-bc28-e6d4bc59a175 req-1f699fdc-f593-4dd4-9677-8b3136e8cb4b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:30.020815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9df2082e-7b9d-4764-bc28-e6d4bc59a175 req-1f699fdc-f593-4dd4-9677-8b3136e8cb4b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:30.027460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9df2082e-7b9d-4764-bc28-e6d4bc59a175 req-1f699fdc-f593-4dd4-9677-8b3136e8cb4b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:30.032250 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d0f324fa-8cfd-416d-b14a-9729739af7d6 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 1.158369 Oct 18 13:36:30.034945 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2353/4440] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:28 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:30.057788 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-9df2082e-7b9d-4764-bc28-e6d4bc59a175 req-1f699fdc-f593-4dd4-9677-8b3136e8cb4b service nova] Creating event network-changed:33594d76-30f8-4217-849d-350d9ace5855 for instance e16abfbb-113b-424e-86a1-bea54f1a4163 on n-h2-858384-13 Oct 18 13:36:30.070498 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-9df2082e-7b9d-4764-bc28-e6d4bc59a175 req-1f699fdc-f593-4dd4-9677-8b3136e8cb4b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083866 Oct 18 13:36:30.071682 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2088/4441] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:30.243869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-42d60ec5-0af2-4be0-9911-e947ed72a373 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:30.245488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-42d60ec5-0af2-4be0-9911-e947ed72a373 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:30.257001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42d60ec5-0af2-4be0-9911-e947ed72a373 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:30.257692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42d60ec5-0af2-4be0-9911-e947ed72a373 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:30.258284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42d60ec5-0af2-4be0-9911-e947ed72a373 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:30.259665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42d60ec5-0af2-4be0-9911-e947ed72a373 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:30.260356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42d60ec5-0af2-4be0-9911-e947ed72a373 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:30.261001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42d60ec5-0af2-4be0-9911-e947ed72a373 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:30.655121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-72359378-6d7b-43cb-86f1-a1866fb56470 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:30.655121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-72359378-6d7b-43cb-86f1-a1866fb56470 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:30.660599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-72359378-6d7b-43cb-86f1-a1866fb56470 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:30.661287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-72359378-6d7b-43cb-86f1-a1866fb56470 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:30.661703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-72359378-6d7b-43cb-86f1-a1866fb56470 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:30.662445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-72359378-6d7b-43cb-86f1-a1866fb56470 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:30.666394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-72359378-6d7b-43cb-86f1-a1866fb56470 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:30.666922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-72359378-6d7b-43cb-86f1-a1866fb56470 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:30.706767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-42d60ec5-0af2-4be0-9911-e947ed72a373 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:30.725496 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-42d60ec5-0af2-4be0-9911-e947ed72a373 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1293 microversion: 2.1 time: 0.477725 Oct 18 13:36:30.726608 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2354/4442] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:30 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1293 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:30.955031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-72359378-6d7b-43cb-86f1-a1866fb56470 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:30.980941 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-72359378-6d7b-43cb-86f1-a1866fb56470 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1275 microversion: 2.1 time: 0.340528 Oct 18 13:36:30.995514 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2089/4443] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:30 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1275 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:31.066023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fee9d36d-d03f-4bc2-8552-93f6e2b2e3f1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:31.067046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fee9d36d-d03f-4bc2-8552-93f6e2b2e3f1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:31.104555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fee9d36d-d03f-4bc2-8552-93f6e2b2e3f1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:31.105064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fee9d36d-d03f-4bc2-8552-93f6e2b2e3f1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:31.105560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fee9d36d-d03f-4bc2-8552-93f6e2b2e3f1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:31.106292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fee9d36d-d03f-4bc2-8552-93f6e2b2e3f1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:31.106756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fee9d36d-d03f-4bc2-8552-93f6e2b2e3f1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:31.107230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fee9d36d-d03f-4bc2-8552-93f6e2b2e3f1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:31.390520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fee9d36d-d03f-4bc2-8552-93f6e2b2e3f1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:31.403562 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fee9d36d-d03f-4bc2-8552-93f6e2b2e3f1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 0.347100 Oct 18 13:36:31.417575 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2355/4444] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:31 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:31.749108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7ed3ceca-7d36-41b6-8eef-456057a828b3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:31.749693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7ed3ceca-7d36-41b6-8eef-456057a828b3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:31.761921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ed3ceca-7d36-41b6-8eef-456057a828b3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:31.762414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ed3ceca-7d36-41b6-8eef-456057a828b3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:31.762857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ed3ceca-7d36-41b6-8eef-456057a828b3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:31.763566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ed3ceca-7d36-41b6-8eef-456057a828b3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:31.764014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ed3ceca-7d36-41b6-8eef-456057a828b3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:31.764444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ed3ceca-7d36-41b6-8eef-456057a828b3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.013310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68db687f-b04e-4c52-abc3-73a2561a2732 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:32.014351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-68db687f-b04e-4c52-abc3-73a2561a2732 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:32.038156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68db687f-b04e-4c52-abc3-73a2561a2732 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:32.041361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68db687f-b04e-4c52-abc3-73a2561a2732 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:32.042896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68db687f-b04e-4c52-abc3-73a2561a2732 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.043727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68db687f-b04e-4c52-abc3-73a2561a2732 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:32.046247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68db687f-b04e-4c52-abc3-73a2561a2732 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:32.046772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68db687f-b04e-4c52-abc3-73a2561a2732 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.194157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68db687f-b04e-4c52-abc3-73a2561a2732 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:32.204543 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68db687f-b04e-4c52-abc3-73a2561a2732 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1275 microversion: 2.1 time: 0.198024 Oct 18 13:36:32.206700 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2356/4445] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:32 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1275 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:32.432165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b70b1047-1ccb-48f5-a016-ca9a7de189bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:32.433520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b70b1047-1ccb-48f5-a016-ca9a7de189bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:32.460627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b70b1047-1ccb-48f5-a016-ca9a7de189bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:32.461986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b70b1047-1ccb-48f5-a016-ca9a7de189bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:32.462750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b70b1047-1ccb-48f5-a016-ca9a7de189bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.464307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b70b1047-1ccb-48f5-a016-ca9a7de189bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:32.465118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b70b1047-1ccb-48f5-a016-ca9a7de189bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:32.467036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b70b1047-1ccb-48f5-a016-ca9a7de189bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.710893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b70b1047-1ccb-48f5-a016-ca9a7de189bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:32.726483 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b70b1047-1ccb-48f5-a016-ca9a7de189bf tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 0.297467 Oct 18 13:36:32.727100 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2357/4446] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:32 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:32.739987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-abad3cbd-7dfd-421b-87c1-b6b88b6469d1 req-4d885962-c00e-4ace-a6fb-f7f4ef0b45ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bce6f6b-df28-4c34-a17f-4f18eb67d401", "name": "network-vif-plugged", "status": "completed", "tag": "c5013b3d-167f-494a-9220-7ef368aab635"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:32.765026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-abad3cbd-7dfd-421b-87c1-b6b88b6469d1 req-4d885962-c00e-4ace-a6fb-f7f4ef0b45ec service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:32.765541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-abad3cbd-7dfd-421b-87c1-b6b88b6469d1 req-4d885962-c00e-4ace-a6fb-f7f4ef0b45ec service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:32.766237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-abad3cbd-7dfd-421b-87c1-b6b88b6469d1 req-4d885962-c00e-4ace-a6fb-f7f4ef0b45ec service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:32.781699 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-abad3cbd-7dfd-421b-87c1-b6b88b6469d1 req-4d885962-c00e-4ace-a6fb-f7f4ef0b45ec service nova] Creating event network-vif-plugged:c5013b3d-167f-494a-9220-7ef368aab635 for instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 on n-h2-858384-13 Oct 18 13:36:32.788341 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-abad3cbd-7dfd-421b-87c1-b6b88b6469d1 req-4d885962-c00e-4ace-a6fb-f7f4ef0b45ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057877 Oct 18 13:36:32.789024 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2358/4447] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:33.030648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ed3ceca-7d36-41b6-8eef-456057a828b3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:33.045714 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7ed3ceca-7d36-41b6-8eef-456057a828b3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1293 microversion: 2.1 time: 1.300848 Oct 18 13:36:33.065935 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2090/4448] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:31 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1293 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:33.232801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6cdabe34-52aa-49a2-827e-e0bc43dc401a tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:33.233564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6cdabe34-52aa-49a2-827e-e0bc43dc401a tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:33.249367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cdabe34-52aa-49a2-827e-e0bc43dc401a tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:33.249847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cdabe34-52aa-49a2-827e-e0bc43dc401a tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:33.252078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cdabe34-52aa-49a2-827e-e0bc43dc401a tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:33.253941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cdabe34-52aa-49a2-827e-e0bc43dc401a tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:33.257465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cdabe34-52aa-49a2-827e-e0bc43dc401a tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:33.258164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cdabe34-52aa-49a2-827e-e0bc43dc401a tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:33.597713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6cdabe34-52aa-49a2-827e-e0bc43dc401a tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:33.610104 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6cdabe34-52aa-49a2-827e-e0bc43dc401a tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1275 microversion: 2.1 time: 0.384029 Oct 18 13:36:33.610884 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2359/4449] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:33 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1275 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:33.751894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-505d546b-a817-46e2-954a-d58e5ad4f90d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:33.752501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-505d546b-a817-46e2-954a-d58e5ad4f90d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:33.763910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-505d546b-a817-46e2-954a-d58e5ad4f90d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:33.766188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-505d546b-a817-46e2-954a-d58e5ad4f90d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:33.766657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-505d546b-a817-46e2-954a-d58e5ad4f90d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:33.767381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-505d546b-a817-46e2-954a-d58e5ad4f90d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:33.767839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-505d546b-a817-46e2-954a-d58e5ad4f90d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:33.768264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-505d546b-a817-46e2-954a-d58e5ad4f90d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:34.076033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-335ee91c-c7f8-4ea1-a179-7adbbb82858b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:34.077845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-335ee91c-c7f8-4ea1-a179-7adbbb82858b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:34.110977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-335ee91c-c7f8-4ea1-a179-7adbbb82858b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:34.121849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-335ee91c-c7f8-4ea1-a179-7adbbb82858b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:34.122570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-335ee91c-c7f8-4ea1-a179-7adbbb82858b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:34.123577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-335ee91c-c7f8-4ea1-a179-7adbbb82858b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:34.124751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-335ee91c-c7f8-4ea1-a179-7adbbb82858b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:34.125453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-335ee91c-c7f8-4ea1-a179-7adbbb82858b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:34.203517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-505d546b-a817-46e2-954a-d58e5ad4f90d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:34.215093 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-505d546b-a817-46e2-954a-d58e5ad4f90d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 0.466942 Oct 18 13:36:34.219814 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2091/4450] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:33 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:34.636201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-71a2c351-3513-4af9-b8b2-205283e1f984 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:34.636984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-71a2c351-3513-4af9-b8b2-205283e1f984 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:34.645704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71a2c351-3513-4af9-b8b2-205283e1f984 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:34.646114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71a2c351-3513-4af9-b8b2-205283e1f984 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:34.646555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71a2c351-3513-4af9-b8b2-205283e1f984 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:34.647254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71a2c351-3513-4af9-b8b2-205283e1f984 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:34.647700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71a2c351-3513-4af9-b8b2-205283e1f984 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:34.648114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71a2c351-3513-4af9-b8b2-205283e1f984 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:34.664403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-335ee91c-c7f8-4ea1-a179-7adbbb82858b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:34.684806 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-335ee91c-c7f8-4ea1-a179-7adbbb82858b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1293 microversion: 2.1 time: 0.611330 Oct 18 13:36:34.688743 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2360/4451] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:34 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1293 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:35.247263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8175f606-11dd-4a49-8497-ca395cbe2da9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:35.250288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8175f606-11dd-4a49-8497-ca395cbe2da9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:35.275818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8175f606-11dd-4a49-8497-ca395cbe2da9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.278068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8175f606-11dd-4a49-8497-ca395cbe2da9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.280099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8175f606-11dd-4a49-8497-ca395cbe2da9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.281901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8175f606-11dd-4a49-8497-ca395cbe2da9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.284466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8175f606-11dd-4a49-8497-ca395cbe2da9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.285463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8175f606-11dd-4a49-8497-ca395cbe2da9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.382733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-71a2c351-3513-4af9-b8b2-205283e1f984 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:35.399660 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-71a2c351-3513-4af9-b8b2-205283e1f984 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1317 microversion: 2.1 time: 0.767463 Oct 18 13:36:35.401097 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2092/4452] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:34 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1317 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:35.718122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1b7217ed-938a-4b16-8bb5-fab487b11ad2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:35.718744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1b7217ed-938a-4b16-8bb5-fab487b11ad2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:35.729754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8175f606-11dd-4a49-8497-ca395cbe2da9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:35.735755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b7217ed-938a-4b16-8bb5-fab487b11ad2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.736246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b7217ed-938a-4b16-8bb5-fab487b11ad2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.741078 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8175f606-11dd-4a49-8497-ca395cbe2da9 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1519 microversion: 2.1 time: 0.501161 Oct 18 13:36:35.753455 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2361/4453] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:35 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1519 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:35.753713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b7217ed-938a-4b16-8bb5-fab487b11ad2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:35.754439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b7217ed-938a-4b16-8bb5-fab487b11ad2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:35.755190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b7217ed-938a-4b16-8bb5-fab487b11ad2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:35.755769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b7217ed-938a-4b16-8bb5-fab487b11ad2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.290301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-6b2925b4-3c2d-40df-99b3-c83f9340383d req-77f287b1-5ccb-4534-a414-4ae39ba685e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9fe15a4-7bd7-40e0-860a-e0769bf38456", "tag": "4c03f362-7416-4c8f-8537-5657edf6a795"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:36.347805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6b2925b4-3c2d-40df-99b3-c83f9340383d req-77f287b1-5ccb-4534-a414-4ae39ba685e3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:36.350624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6b2925b4-3c2d-40df-99b3-c83f9340383d req-77f287b1-5ccb-4534-a414-4ae39ba685e3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:36.354446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6b2925b4-3c2d-40df-99b3-c83f9340383d req-77f287b1-5ccb-4534-a414-4ae39ba685e3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.387541 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-6b2925b4-3c2d-40df-99b3-c83f9340383d req-77f287b1-5ccb-4534-a414-4ae39ba685e3 service nova] Creating event network-changed:4c03f362-7416-4c8f-8537-5657edf6a795 for instance b9fe15a4-7bd7-40e0-860a-e0769bf38456 on n-h1-858384-13 Oct 18 13:36:36.400377 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-6b2925b4-3c2d-40df-99b3-c83f9340383d req-77f287b1-5ccb-4534-a414-4ae39ba685e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113468 Oct 18 13:36:36.402099 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2362/4454] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:36:36.425099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8f93e275-830c-4317-aa00-27837c5e6bdd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:36.426473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8f93e275-830c-4317-aa00-27837c5e6bdd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:36.445037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f93e275-830c-4317-aa00-27837c5e6bdd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:36.446989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f93e275-830c-4317-aa00-27837c5e6bdd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:36.448214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f93e275-830c-4317-aa00-27837c5e6bdd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.453092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f93e275-830c-4317-aa00-27837c5e6bdd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:36.455162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f93e275-830c-4317-aa00-27837c5e6bdd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:36.457038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f93e275-830c-4317-aa00-27837c5e6bdd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.526418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:36.574187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1b7217ed-938a-4b16-8bb5-fab487b11ad2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:36.597892 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1b7217ed-938a-4b16-8bb5-fab487b11ad2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1293 microversion: 2.1 time: 0.886935 Oct 18 13:36:36.599648 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2093/4455] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:35 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1293 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:36.767838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e5b08e7-e203-4b80-9611-1519e45ae166 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:36.768558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0e5b08e7-e203-4b80-9611-1519e45ae166 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:36.783760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e5b08e7-e203-4b80-9611-1519e45ae166 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:36.784409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e5b08e7-e203-4b80-9611-1519e45ae166 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:36.784934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e5b08e7-e203-4b80-9611-1519e45ae166 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.785771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e5b08e7-e203-4b80-9611-1519e45ae166 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:36.786315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e5b08e7-e203-4b80-9611-1519e45ae166 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:36.786835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e5b08e7-e203-4b80-9611-1519e45ae166 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:36.831207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:37.336940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8f93e275-830c-4317-aa00-27837c5e6bdd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:37.352951 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8f93e275-830c-4317-aa00-27837c5e6bdd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1317 microversion: 2.1 time: 0.933174 Oct 18 13:36:37.376724 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2363/4456] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:36 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1317 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:37.383743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-eae5ff9d-c49e-4a8c-bf94-027d3dc8569d req-d9b045d2-2d5d-43b9-b000-a1dd95c6b8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16abfbb-113b-424e-86a1-bea54f1a4163", "name": "network-vif-plugged", "status": "completed", "tag": "33594d76-30f8-4217-849d-350d9ace5855"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:37.426913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-eae5ff9d-c49e-4a8c-bf94-027d3dc8569d req-d9b045d2-2d5d-43b9-b000-a1dd95c6b8e9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:37.428346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-eae5ff9d-c49e-4a8c-bf94-027d3dc8569d req-d9b045d2-2d5d-43b9-b000-a1dd95c6b8e9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:37.429139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-eae5ff9d-c49e-4a8c-bf94-027d3dc8569d req-d9b045d2-2d5d-43b9-b000-a1dd95c6b8e9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:37.451405 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-eae5ff9d-c49e-4a8c-bf94-027d3dc8569d req-d9b045d2-2d5d-43b9-b000-a1dd95c6b8e9 service nova] Creating event network-vif-plugged:33594d76-30f8-4217-849d-350d9ace5855 for instance e16abfbb-113b-424e-86a1-bea54f1a4163 on n-h2-858384-13 Oct 18 13:36:37.463855 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-eae5ff9d-c49e-4a8c-bf94-027d3dc8569d req-d9b045d2-2d5d-43b9-b000-a1dd95c6b8e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083814 Oct 18 13:36:37.471489 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2364/4457] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:37.566340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e5b08e7-e203-4b80-9611-1519e45ae166 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:37.579140 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e5b08e7-e203-4b80-9611-1519e45ae166 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.815279 Oct 18 13:36:37.580068 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2094/4458] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:36 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:37.603199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:37.613503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-37edef98-6fdd-490b-8d5e-9a5432a957c3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:37.614815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-37edef98-6fdd-490b-8d5e-9a5432a957c3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:37.630021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d704c28f-ace1-4aed-9459-a75c7bf7946e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:37.630888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d704c28f-ace1-4aed-9459-a75c7bf7946e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:37.670786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d704c28f-ace1-4aed-9459-a75c7bf7946e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:37.673283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37edef98-6fdd-490b-8d5e-9a5432a957c3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:37.674686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d704c28f-ace1-4aed-9459-a75c7bf7946e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:37.676213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d704c28f-ace1-4aed-9459-a75c7bf7946e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:37.681001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d704c28f-ace1-4aed-9459-a75c7bf7946e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:37.684196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d704c28f-ace1-4aed-9459-a75c7bf7946e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:37.688412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37edef98-6fdd-490b-8d5e-9a5432a957c3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:37.689513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d704c28f-ace1-4aed-9459-a75c7bf7946e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:37.691004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37edef98-6fdd-490b-8d5e-9a5432a957c3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:37.692459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37edef98-6fdd-490b-8d5e-9a5432a957c3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:37.694342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37edef98-6fdd-490b-8d5e-9a5432a957c3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:37.696268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37edef98-6fdd-490b-8d5e-9a5432a957c3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:37.930001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=22 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:38.232448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-37edef98-6fdd-490b-8d5e-9a5432a957c3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:38.240871 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-37edef98-6fdd-490b-8d5e-9a5432a957c3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.638528 Oct 18 13:36:38.245331 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2365/4459] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:37 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:38.255219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-4560fa7f-794a-4157-b620-56124bbdd648 req-04f729cd-d542-40ee-8daa-bf4c9f196b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833b85f4-e854-4a7b-b04d-001cde240eb3", "tag": "83080d1b-68a0-4f1b-a31f-f765e5c6c561"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:38.331355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4560fa7f-794a-4157-b620-56124bbdd648 req-04f729cd-d542-40ee-8daa-bf4c9f196b77 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.333655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4560fa7f-794a-4157-b620-56124bbdd648 req-04f729cd-d542-40ee-8daa-bf4c9f196b77 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.334210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4560fa7f-794a-4157-b620-56124bbdd648 req-04f729cd-d542-40ee-8daa-bf4c9f196b77 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:38.349557 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-4560fa7f-794a-4157-b620-56124bbdd648 req-04f729cd-d542-40ee-8daa-bf4c9f196b77 service nova] Creating event network-changed:83080d1b-68a0-4f1b-a31f-f765e5c6c561 for instance 833b85f4-e854-4a7b-b04d-001cde240eb3 on n-h2-858384-13 Oct 18 13:36:38.354417 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-4560fa7f-794a-4157-b620-56124bbdd648 req-04f729cd-d542-40ee-8daa-bf4c9f196b77 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111768 Oct 18 13:36:38.355670 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2366/4460] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:38.371388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c59ed7ba-a69c-4d7f-b64e-b679921f8ce2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:38.372245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c59ed7ba-a69c-4d7f-b64e-b679921f8ce2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:38.396859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c59ed7ba-a69c-4d7f-b64e-b679921f8ce2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.397844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c59ed7ba-a69c-4d7f-b64e-b679921f8ce2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.398607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c59ed7ba-a69c-4d7f-b64e-b679921f8ce2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:38.403955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c59ed7ba-a69c-4d7f-b64e-b679921f8ce2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.404967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c59ed7ba-a69c-4d7f-b64e-b679921f8ce2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.405671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c59ed7ba-a69c-4d7f-b64e-b679921f8ce2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:38.409784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d704c28f-ace1-4aed-9459-a75c7bf7946e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:38.428157 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d704c28f-ace1-4aed-9459-a75c7bf7946e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1293 microversion: 2.1 time: 0.802382 Oct 18 13:36:38.429111 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2095/4461] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:37 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1293 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:38.434059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d9e30344-88da-4dbb-a869-93a32eb1e266 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:38.439072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d9e30344-88da-4dbb-a869-93a32eb1e266 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:38.455028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9e30344-88da-4dbb-a869-93a32eb1e266 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.456644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9e30344-88da-4dbb-a869-93a32eb1e266 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.457720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9e30344-88da-4dbb-a869-93a32eb1e266 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:38.462192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9e30344-88da-4dbb-a869-93a32eb1e266 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.463205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9e30344-88da-4dbb-a869-93a32eb1e266 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.464020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9e30344-88da-4dbb-a869-93a32eb1e266 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:38.799581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c59ed7ba-a69c-4d7f-b64e-b679921f8ce2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:38.812345 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c59ed7ba-a69c-4d7f-b64e-b679921f8ce2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.455214 Oct 18 13:36:38.829331 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2367/4462] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:38 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:38.834084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d9e30344-88da-4dbb-a869-93a32eb1e266 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:38.836314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fe14bb77-cb62-482e-8b59-a9ef54d755a1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:38.843443 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-fe14bb77-cb62-482e-8b59-a9ef54d755a1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 0972e5a5-4450-4aae-b253-1c6ecca99819 has no mapping to a cell. Oct 18 13:36:38.851562 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d9e30344-88da-4dbb-a869-93a32eb1e266 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1317 microversion: 2.1 time: 0.421122 Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fe14bb77-cb62-482e-8b59-a9ef54d755a1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/0972e5a5-4450-4aae-b253-1c6ecca99819/action HTTP/1.1 Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 15 Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: {"os-stop": {}} Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 0972e5a5-4450-4aae-b253-1c6ecca99819 has no mapping to a cell. Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '0972e5a5-4450-4aae-b253-1c6ecca99819', 'body': {'os-stop': {}}} Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 0972e5a5-4450-4aae-b253-1c6ecca99819 has no mapping to a cell. Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:36:38.852560 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0972e5a5-4450-4aae-b253-1c6ecca99819 has no mapping to a cell. Oct 18 13:36:38.859202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:38.859202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:38.859202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:38.859202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:38.859202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:38.859202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:38.859202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:38.859202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:38.859202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0972e5a5-4450-4aae-b253-1c6ecca99819 has no mapping to a cell. Oct 18 13:36:38.859202 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:38.859202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fe14bb77-cb62-482e-8b59-a9ef54d755a1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 0972e5a5-4450-4aae-b253-1c6ecca99819 has no mapping to a cell. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:38.859202 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fe14bb77-cb62-482e-8b59-a9ef54d755a1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/0972e5a5-4450-4aae-b253-1c6ecca99819/action" status: 404 len: 117 microversion: 2.1 time: 0.021869 Oct 18 13:36:38.860652 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2096/4463] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:38 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:38.860783 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2368/4464] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:36:38 2022] POST /compute/v2.1/servers/0972e5a5-4450-4aae-b253-1c6ecca99819/action => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:36:38.867415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3adb43f4-ad24-4e53-aabf-2c423616c254 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:38.868108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3adb43f4-ad24-4e53-aabf-2c423616c254 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:38.880027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3adb43f4-ad24-4e53-aabf-2c423616c254 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.880585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3adb43f4-ad24-4e53-aabf-2c423616c254 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.881318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3adb43f4-ad24-4e53-aabf-2c423616c254 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:38.882860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3adb43f4-ad24-4e53-aabf-2c423616c254 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:38.883544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3adb43f4-ad24-4e53-aabf-2c423616c254 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:38.884326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3adb43f4-ad24-4e53-aabf-2c423616c254 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.262524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3adb43f4-ad24-4e53-aabf-2c423616c254 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:39.277548 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3adb43f4-ad24-4e53-aabf-2c423616c254 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.415610 Oct 18 13:36:39.283235 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2097/4465] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:38 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:39.309870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-387dffd0-96b3-4ef0-94b1-3df7b6503b68 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:39.310414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-387dffd0-96b3-4ef0-94b1-3df7b6503b68 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:39.318988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-387dffd0-96b3-4ef0-94b1-3df7b6503b68 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.319768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-387dffd0-96b3-4ef0-94b1-3df7b6503b68 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.320423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-387dffd0-96b3-4ef0-94b1-3df7b6503b68 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.321431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-387dffd0-96b3-4ef0-94b1-3df7b6503b68 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.328858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-387dffd0-96b3-4ef0-94b1-3df7b6503b68 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.329630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-387dffd0-96b3-4ef0-94b1-3df7b6503b68 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.454269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-36b7dc55-8430-4e96-b2cd-4c870e603f42 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:39.454992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-36b7dc55-8430-4e96-b2cd-4c870e603f42 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:39.461261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36b7dc55-8430-4e96-b2cd-4c870e603f42 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.463825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36b7dc55-8430-4e96-b2cd-4c870e603f42 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.466683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36b7dc55-8430-4e96-b2cd-4c870e603f42 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.467526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36b7dc55-8430-4e96-b2cd-4c870e603f42 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.470250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36b7dc55-8430-4e96-b2cd-4c870e603f42 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.472003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36b7dc55-8430-4e96-b2cd-4c870e603f42 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.754186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36b7dc55-8430-4e96-b2cd-4c870e603f42 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:39.766150 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-36b7dc55-8430-4e96-b2cd-4c870e603f42 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1474 microversion: 2.1 time: 0.316007 Oct 18 13:36:39.766753 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2098/4466] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:39 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1474 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:39.880382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cecf8c6a-14c5-4c4f-8d2f-ecc18297d2fe tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:39.881094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cecf8c6a-14c5-4c4f-8d2f-ecc18297d2fe tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:39.892325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cecf8c6a-14c5-4c4f-8d2f-ecc18297d2fe tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.892870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cecf8c6a-14c5-4c4f-8d2f-ecc18297d2fe tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.893339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cecf8c6a-14c5-4c4f-8d2f-ecc18297d2fe tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:39.895116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cecf8c6a-14c5-4c4f-8d2f-ecc18297d2fe tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:39.897320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cecf8c6a-14c5-4c4f-8d2f-ecc18297d2fe tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:39.897913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cecf8c6a-14c5-4c4f-8d2f-ecc18297d2fe tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:40.369032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cecf8c6a-14c5-4c4f-8d2f-ecc18297d2fe tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:40.384651 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cecf8c6a-14c5-4c4f-8d2f-ecc18297d2fe tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1317 microversion: 2.1 time: 0.507992 Oct 18 13:36:40.388497 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2099/4467] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:39 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:40.407424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-597503468", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:40.477282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] validate_networks() for [('aa0d4f33-39e0-4d3f-ab36-9b89248d2552', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:36:40.505478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-387dffd0-96b3-4ef0-94b1-3df7b6503b68 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:40.519785 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-387dffd0-96b3-4ef0-94b1-3df7b6503b68 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 1.212389 Oct 18 13:36:40.540572 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2369/4468] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:39 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:40.547725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-26b8be48-2d43-40c6-9a31-3b3b69b624a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:40.548275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-26b8be48-2d43-40c6-9a31-3b3b69b624a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: cfd0ca0b-ead2-4ab2-8c85-2a91c92ca56d] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:40.573503 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-26b8be48-2d43-40c6-9a31-3b3b69b624a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance cfd0ca0b-ead2-4ab2-8c85-2a91c92ca56d could not be found. Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-26b8be48-2d43-40c6-9a31-3b3b69b624a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/cfd0ca0b-ead2-4ab2-8c85-2a91c92ca56d/action HTTP/1.1 Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 15 Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: {"suspend": {}} Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance cfd0ca0b-ead2-4ab2-8c85-2a91c92ca56d could not be found. Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'cfd0ca0b-ead2-4ab2-8c85-2a91c92ca56d', 'body': {'suspend': {}}} Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfd0ca0b-ead2-4ab2-8c85-2a91c92ca56d could not be found. Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfd0ca0b-ead2-4ab2-8c85-2a91c92ca56d could not be found. Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:40.579976 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:40.587172 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:40.587172 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:40.587172 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfd0ca0b-ead2-4ab2-8c85-2a91c92ca56d could not be found. Oct 18 13:36:40.587172 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:40.587172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-26b8be48-2d43-40c6-9a31-3b3b69b624a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance cfd0ca0b-ead2-4ab2-8c85-2a91c92ca56d could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:40.587172 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-26b8be48-2d43-40c6-9a31-3b3b69b624a3 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/cfd0ca0b-ead2-4ab2-8c85-2a91c92ca56d/action" status: 404 len: 111 microversion: 2.1 time: 0.037966 Oct 18 13:36:40.587172 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2370/4469] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:36:40 2022] POST /compute/v2.1/servers/cfd0ca0b-ead2-4ab2-8c85-2a91c92ca56d/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:36:40.603572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a63cf1da-a9fa-4e96-8356-2e93c727b90a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:40.604962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a63cf1da-a9fa-4e96-8356-2e93c727b90a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:40.618152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a63cf1da-a9fa-4e96-8356-2e93c727b90a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:40.618563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a63cf1da-a9fa-4e96-8356-2e93c727b90a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:40.619076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a63cf1da-a9fa-4e96-8356-2e93c727b90a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:40.620461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a63cf1da-a9fa-4e96-8356-2e93c727b90a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:40.620897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a63cf1da-a9fa-4e96-8356-2e93c727b90a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:40.621371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a63cf1da-a9fa-4e96-8356-2e93c727b90a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:41.238146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a63cf1da-a9fa-4e96-8356-2e93c727b90a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:41.266725 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a63cf1da-a9fa-4e96-8356-2e93c727b90a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.673657 Oct 18 13:36:41.268680 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2371/4470] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:40 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:41.299722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dd95cd9e-5544-4e56-87ef-b92a73696aed tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:41.300347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dd95cd9e-5544-4e56-87ef-b92a73696aed tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:41.316943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd95cd9e-5544-4e56-87ef-b92a73696aed tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:41.318042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd95cd9e-5544-4e56-87ef-b92a73696aed tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:41.318500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd95cd9e-5544-4e56-87ef-b92a73696aed tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:41.320873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd95cd9e-5544-4e56-87ef-b92a73696aed tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:41.321370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd95cd9e-5544-4e56-87ef-b92a73696aed tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:41.321875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd95cd9e-5544-4e56-87ef-b92a73696aed tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:41.814080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dd95cd9e-5544-4e56-87ef-b92a73696aed tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:41.838255 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dd95cd9e-5544-4e56-87ef-b92a73696aed tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.542752 Oct 18 13:36:41.839058 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2372/4471] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:41 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:41.860833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7dc9fb55-9d56-4d9f-abe8-bb0333ed3858 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:41.862558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7dc9fb55-9d56-4d9f-abe8-bb0333ed3858 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:41.866765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:41.891207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dc9fb55-9d56-4d9f-abe8-bb0333ed3858 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:41.892139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dc9fb55-9d56-4d9f-abe8-bb0333ed3858 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:41.893160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dc9fb55-9d56-4d9f-abe8-bb0333ed3858 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:41.895322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dc9fb55-9d56-4d9f-abe8-bb0333ed3858 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:41.895977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dc9fb55-9d56-4d9f-abe8-bb0333ed3858 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:41.896585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dc9fb55-9d56-4d9f-abe8-bb0333ed3858 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:42.642120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7dc9fb55-9d56-4d9f-abe8-bb0333ed3858 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:42.655110 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7dc9fb55-9d56-4d9f-abe8-bb0333ed3858 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1317 microversion: 2.1 time: 0.814840 Oct 18 13:36:42.657712 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2373/4472] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:41 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1317 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:42.671799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4d24b63-098f-4d52-b096-d74877e7d79f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:42.675013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e4d24b63-098f-4d52-b096-d74877e7d79f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:42.693616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4d24b63-098f-4d52-b096-d74877e7d79f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:42.694298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4d24b63-098f-4d52-b096-d74877e7d79f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:42.694832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4d24b63-098f-4d52-b096-d74877e7d79f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:42.698791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4d24b63-098f-4d52-b096-d74877e7d79f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:42.699286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4d24b63-098f-4d52-b096-d74877e7d79f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:42.702165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4d24b63-098f-4d52-b096-d74877e7d79f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:42.768785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-e4d24b63-098f-4d52-b096-d74877e7d79f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lazy-loading 'flavor' on Instance uuid 6bce6f6b-df28-4c34-a17f-4f18eb67d401 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:36:42.911778 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e4d24b63-098f-4d52-b096-d74877e7d79f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action" status: 202 len: 0 microversion: 2.1 time: 0.252118 Oct 18 13:36:42.919317 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2374/4473] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:36:42 2022] POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:36:42.927121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3094adca-aa1a-4bdd-8dcf-7a4f186b4278 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:42.928285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3094adca-aa1a-4bdd-8dcf-7a4f186b4278 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:42.942542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3094adca-aa1a-4bdd-8dcf-7a4f186b4278 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:42.944028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3094adca-aa1a-4bdd-8dcf-7a4f186b4278 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:42.945200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3094adca-aa1a-4bdd-8dcf-7a4f186b4278 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:42.946708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3094adca-aa1a-4bdd-8dcf-7a4f186b4278 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:42.947695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3094adca-aa1a-4bdd-8dcf-7a4f186b4278 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:42.948489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3094adca-aa1a-4bdd-8dcf-7a4f186b4278 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:43.112336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:43.114052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:43.114801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:43.115522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:43.116103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:43.134614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:43.135947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:43.136553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:43.137526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:43.138181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:43.139708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:43.208392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:43.219841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for user a4856dd5667c4f10aa9ff1ccb1788cc8 and project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:43.223159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3094adca-aa1a-4bdd-8dcf-7a4f186b4278 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:43.237919 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3094adca-aa1a-4bdd-8dcf-7a4f186b4278 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1514 microversion: 2.1 time: 0.316673 Oct 18 13:36:43.253231 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2375/4474] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:42 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1514 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:43.274207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:43.278442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 9d483b15-33b4-439c-a358-bc8fb175fd88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:43.397681 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e7a947dc-7789-48a8-8359-44f712e16cf7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.000636 Oct 18 13:36:43.398412 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2100/4475] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:36:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:36:43.413164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5efe6ec3-1280-461f-b1d3-5a3ab04344a2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:43.419602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5efe6ec3-1280-461f-b1d3-5a3ab04344a2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 9d483b15-33b4-439c-a358-bc8fb175fd88] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:43.521579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5efe6ec3-1280-461f-b1d3-5a3ab04344a2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 9d483b15-33b4-439c-a358-bc8fb175fd88] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:36:43.838998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-312232758", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:43.940698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] validate_networks() for [('bde0cbc3-fcaa-4a2a-b4ff-70107d3729c8', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:36:44.035299 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5efe6ec3-1280-461f-b1d3-5a3ab04344a2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9d483b15-33b4-439c-a358-bc8fb175fd88" status: 204 len: 0 microversion: 2.1 time: 0.627017 Oct 18 13:36:44.039798 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2376/4476] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:36:43 2022] DELETE /compute/v2.1/servers/9d483b15-33b4-439c-a358-bc8fb175fd88 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:36:44.048406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-35f60e7a-2c74-457e-aa10-6c207a6cade3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:44.049691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-35f60e7a-2c74-457e-aa10-6c207a6cade3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:44.058487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-35f60e7a-2c74-457e-aa10-6c207a6cade3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.059444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-35f60e7a-2c74-457e-aa10-6c207a6cade3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.062122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-35f60e7a-2c74-457e-aa10-6c207a6cade3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.063651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-35f60e7a-2c74-457e-aa10-6c207a6cade3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.064648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-35f60e7a-2c74-457e-aa10-6c207a6cade3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.065770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-35f60e7a-2c74-457e-aa10-6c207a6cade3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.309048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-35f60e7a-2c74-457e-aa10-6c207a6cade3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:44.321274 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-35f60e7a-2c74-457e-aa10-6c207a6cade3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1317 microversion: 2.1 time: 0.280086 Oct 18 13:36:44.335090 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2377/4477] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:44 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:44.335090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13d6568b-9b16-45ca-b1d1-7054854299f2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:44.335090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-13d6568b-9b16-45ca-b1d1-7054854299f2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 9d483b15-33b4-439c-a358-bc8fb175fd88] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:44.346851 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-13d6568b-9b16-45ca-b1d1-7054854299f2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13d6568b-9b16-45ca-b1d1-7054854299f2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/9d483b15-33b4-439c-a358-bc8fb175fd88 HTTP/1.1 Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '9d483b15-33b4-439c-a358-bc8fb175fd88'} Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 9d483b15-33b4-439c-a358-bc8fb175fd88 Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:44.357055 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13d6568b-9b16-45ca-b1d1-7054854299f2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13d6568b-9b16-45ca-b1d1-7054854299f2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/9d483b15-33b4-439c-a358-bc8fb175fd88" status: 404 len: 111 microversion: 2.1 time: 0.035621 Oct 18 13:36:44.361851 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2378/4478] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:44 2022] GET /compute/v2.1/servers/9d483b15-33b4-439c-a358-bc8fb175fd88 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:36:44.369057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fb28aac5-a87a-42a6-a505-629ecb96e0a7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:44.370456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb28aac5-a87a-42a6-a505-629ecb96e0a7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:44.377956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb28aac5-a87a-42a6-a505-629ecb96e0a7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.378500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb28aac5-a87a-42a6-a505-629ecb96e0a7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.378944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb28aac5-a87a-42a6-a505-629ecb96e0a7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.379647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb28aac5-a87a-42a6-a505-629ecb96e0a7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:44.380125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb28aac5-a87a-42a6-a505-629ecb96e0a7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:44.380518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb28aac5-a87a-42a6-a505-629ecb96e0a7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:44.573289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fb28aac5-a87a-42a6-a505-629ecb96e0a7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:44.584531 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fb28aac5-a87a-42a6-a505-629ecb96e0a7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1497 microversion: 2.1 time: 0.223382 Oct 18 13:36:44.594615 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2379/4479] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:44 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1497 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:44.621786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-655198717", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "aa0d4f33-39e0-4d3f-ab36-9b89248d2552"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:44.706877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] validate_networks() for [('aa0d4f33-39e0-4d3f-ab36-9b89248d2552', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:36:45.210168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:45.211131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:45.211785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:45.212665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:45.213955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:45.233975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.234684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.235295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:45.239970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.240788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.241428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:45.281464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Getting quotas for project 0cdfce6f9e86407d883e624dd2c50559. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:45.303676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Getting quotas for user 4113a1418b92488e97bf50aecdd49bb1 and project 0cdfce6f9e86407d883e624dd2c50559. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:45.310040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:45.310549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:45.313591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:45.314033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:45.314524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:45.324739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:45.326966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.327535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.328047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:45.328853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.329427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.329932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:45.334497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:45.354255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:45.360462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for user a4856dd5667c4f10aa9ff1ccb1788cc8 and project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:45.376330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:45.379208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:45.434189 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0144d152-5b69-4b1f-8dd1-96f77f214430 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.932990 Oct 18 13:36:45.441263 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2101/4480] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:36:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:36:45.446791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb7bbc8a-78ac-4e4b-8e5a-4f6eb9b99232 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:45.454630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eb7bbc8a-78ac-4e4b-8e5a-4f6eb9b99232 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:45.466749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb7bbc8a-78ac-4e4b-8e5a-4f6eb9b99232 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.467242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb7bbc8a-78ac-4e4b-8e5a-4f6eb9b99232 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.467680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb7bbc8a-78ac-4e4b-8e5a-4f6eb9b99232 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:45.468906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb7bbc8a-78ac-4e4b-8e5a-4f6eb9b99232 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.469395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb7bbc8a-78ac-4e4b-8e5a-4f6eb9b99232 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.469823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb7bbc8a-78ac-4e4b-8e5a-4f6eb9b99232 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:45.476787 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-75db488e-1b9b-437d-b84b-14904d54973b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880167 Oct 18 13:36:45.477872 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2380/4481] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:36:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:36:45.486260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d2f4072-8bb4-4c8d-85f5-0c980b40adea tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:45.489163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d2f4072-8bb4-4c8d-85f5-0c980b40adea tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:45.529656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d2f4072-8bb4-4c8d-85f5-0c980b40adea tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.537390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d2f4072-8bb4-4c8d-85f5-0c980b40adea tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.537900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d2f4072-8bb4-4c8d-85f5-0c980b40adea tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:45.538655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d2f4072-8bb4-4c8d-85f5-0c980b40adea tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.539129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d2f4072-8bb4-4c8d-85f5-0c980b40adea tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.539571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d2f4072-8bb4-4c8d-85f5-0c980b40adea tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:45.544852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-eb7bbc8a-78ac-4e4b-8e5a-4f6eb9b99232 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lazy-loading 'flavor' on Instance uuid 6bce6f6b-df28-4c34-a17f-4f18eb67d401 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:36:45.576346 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-eb7bbc8a-78ac-4e4b-8e5a-4f6eb9b99232 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Cannot 'suspend' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state suspended Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb7bbc8a-78ac-4e4b-8e5a-4f6eb9b99232 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action HTTP/1.1 Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 15 Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: {"suspend": {}} Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: exception: Cannot 'suspend' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state suspended Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '6bce6f6b-df28-4c34-a17f-4f18eb67d401', 'body': {'suspend': {}}} Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 18 13:36:45.578525 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state suspended Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state suspended Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb7bbc8a-78ac-4e4b-8e5a-4f6eb9b99232 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 409 to user: Cannot 'suspend' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state suspended {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:45.582407 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eb7bbc8a-78ac-4e4b-8e5a-4f6eb9b99232 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action" status: 409 len: 148 microversion: 2.1 time: 0.143397 Oct 18 13:36:45.583277 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2102/4482] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:36:45 2022] POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action => generated 148 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:36:45.590784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b0cd33a3-2b96-4b35-9d65-9214cf9eb725 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:45.594943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b0cd33a3-2b96-4b35-9d65-9214cf9eb725 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:45.896481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b0cd33a3-2b96-4b35-9d65-9214cf9eb725 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:45.904199 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b0cd33a3-2b96-4b35-9d65-9214cf9eb725 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1221 microversion: 2.1 time: 0.318335 Oct 18 13:36:45.908435 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2103/4483] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:45 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1221 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:45.921668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e8d93f87-a8f8-472a-a20b-669b304999a9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:45.922709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e8d93f87-a8f8-472a-a20b-669b304999a9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:45.926986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d2f4072-8bb4-4c8d-85f5-0c980b40adea tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:45.940101 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d2f4072-8bb4-4c8d-85f5-0c980b40adea tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1317 microversion: 2.1 time: 0.459919 Oct 18 13:36:45.941167 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2381/4484] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:45 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:45.948664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-92f6764f-4cf9-4a3a-a0e5-6a1c18e74cf0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:45.949483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-92f6764f-4cf9-4a3a-a0e5-6a1c18e74cf0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:45.957503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92f6764f-4cf9-4a3a-a0e5-6a1c18e74cf0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.958346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92f6764f-4cf9-4a3a-a0e5-6a1c18e74cf0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.958939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92f6764f-4cf9-4a3a-a0e5-6a1c18e74cf0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:45.960113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92f6764f-4cf9-4a3a-a0e5-6a1c18e74cf0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:45.960915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92f6764f-4cf9-4a3a-a0e5-6a1c18e74cf0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:45.961607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92f6764f-4cf9-4a3a-a0e5-6a1c18e74cf0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:46.170853 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-92f6764f-4cf9-4a3a-a0e5-6a1c18e74cf0 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action" status: 202 len: 0 microversion: 2.1 time: 0.227904 Oct 18 13:36:46.171874 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2382/4485] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:36:45 2022] POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:36:46.187317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3b7b8198-f396-4fb9-aad0-63207a7b0e98 req-1cc34506-aedd-4a5e-9ed6-fae303ee6a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fe15a4-7bd7-40e0-860a-e0769bf38456", "name": "network-vif-plugged", "status": "completed", "tag": "4c03f362-7416-4c8f-8537-5657edf6a795"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:46.208167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3b7b8198-f396-4fb9-aad0-63207a7b0e98 req-1cc34506-aedd-4a5e-9ed6-fae303ee6a92 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:46.208608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3b7b8198-f396-4fb9-aad0-63207a7b0e98 req-1cc34506-aedd-4a5e-9ed6-fae303ee6a92 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:46.209054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3b7b8198-f396-4fb9-aad0-63207a7b0e98 req-1cc34506-aedd-4a5e-9ed6-fae303ee6a92 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:46.224700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:46.249214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e8d93f87-a8f8-472a-a20b-669b304999a9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:46.257371 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e8d93f87-a8f8-472a-a20b-669b304999a9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1220 microversion: 2.1 time: 0.347520 Oct 18 13:36:46.261912 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2104/4486] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:45 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1220 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:46.290148 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3b7b8198-f396-4fb9-aad0-63207a7b0e98 req-1cc34506-aedd-4a5e-9ed6-fae303ee6a92 service nova] Creating event network-vif-plugged:4c03f362-7416-4c8f-8537-5657edf6a795 for instance b9fe15a4-7bd7-40e0-860a-e0769bf38456 on n-h1-858384-13 Oct 18 13:36:46.310633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2042895079", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:46.322840 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3b7b8198-f396-4fb9-aad0-63207a7b0e98 req-1cc34506-aedd-4a5e-9ed6-fae303ee6a92 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127316 Oct 18 13:36:46.323664 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2383/4487] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:46.349498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-48a808f2-24cc-4ef2-ac86-939500f7d8c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:46.350149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-48a808f2-24cc-4ef2-ac86-939500f7d8c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:46.413989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a808f2-24cc-4ef2-ac86-939500f7d8c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:46.416547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a808f2-24cc-4ef2-ac86-939500f7d8c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:46.420824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a808f2-24cc-4ef2-ac86-939500f7d8c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:46.424591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a808f2-24cc-4ef2-ac86-939500f7d8c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:46.425844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a808f2-24cc-4ef2-ac86-939500f7d8c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:46.426308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a808f2-24cc-4ef2-ac86-939500f7d8c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:46.460996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] validate_networks() for [('bde0cbc3-fcaa-4a2a-b4ff-70107d3729c8', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:36:47.046654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-48a808f2-24cc-4ef2-ac86-939500f7d8c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:47.056454 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-48a808f2-24cc-4ef2-ac86-939500f7d8c4 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1503 microversion: 2.1 time: 0.731585 Oct 18 13:36:47.060605 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2384/4488] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:46 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1503 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:47.070285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3f83bbe2-9c8c-448b-a605-2a2245160903 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:47.074179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3f83bbe2-9c8c-448b-a605-2a2245160903 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:47.094611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f83bbe2-9c8c-448b-a605-2a2245160903 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:47.095507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f83bbe2-9c8c-448b-a605-2a2245160903 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:47.100013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f83bbe2-9c8c-448b-a605-2a2245160903 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:47.101019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f83bbe2-9c8c-448b-a605-2a2245160903 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:47.106865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f83bbe2-9c8c-448b-a605-2a2245160903 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:47.107463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f83bbe2-9c8c-448b-a605-2a2245160903 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:47.333698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3f83bbe2-9c8c-448b-a605-2a2245160903 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:47.352270 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3f83bbe2-9c8c-448b-a605-2a2245160903 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1317 microversion: 2.1 time: 0.285901 Oct 18 13:36:47.353088 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2385/4489] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:47 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:47.362661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c24cb8d-c17d-456e-8418-ee191b93549e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:47.363284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4c24cb8d-c17d-456e-8418-ee191b93549e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:47.387969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c24cb8d-c17d-456e-8418-ee191b93549e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:47.388666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c24cb8d-c17d-456e-8418-ee191b93549e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:47.389489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c24cb8d-c17d-456e-8418-ee191b93549e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:47.393396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c24cb8d-c17d-456e-8418-ee191b93549e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:47.394124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c24cb8d-c17d-456e-8418-ee191b93549e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:47.396132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c24cb8d-c17d-456e-8418-ee191b93549e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:47.481639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c24cb8d-c17d-456e-8418-ee191b93549e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:47.490642 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4c24cb8d-c17d-456e-8418-ee191b93549e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1272 microversion: 2.1 time: 0.131817 Oct 18 13:36:47.498252 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2386/4490] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:47 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:48.094230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fed77d7f-af3a-4896-b88e-bf4b56548f87 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:48.095128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fed77d7f-af3a-4896-b88e-bf4b56548f87 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:48.105671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fed77d7f-af3a-4896-b88e-bf4b56548f87 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.106171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fed77d7f-af3a-4896-b88e-bf4b56548f87 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.106608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fed77d7f-af3a-4896-b88e-bf4b56548f87 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.107323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fed77d7f-af3a-4896-b88e-bf4b56548f87 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.107784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fed77d7f-af3a-4896-b88e-bf4b56548f87 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.110131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fed77d7f-af3a-4896-b88e-bf4b56548f87 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.298077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:48.298741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:48.299451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:48.317117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:48.332269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:48.339895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fed77d7f-af3a-4896-b88e-bf4b56548f87 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:48.359888 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fed77d7f-af3a-4896-b88e-bf4b56548f87 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1503 microversion: 2.1 time: 0.269103 Oct 18 13:36:48.361642 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2387/4491] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:48 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:48.381310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ebfeec00-0927-46c6-bd55-3c6d919aee18 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:48.382555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ebfeec00-0927-46c6-bd55-3c6d919aee18 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:48.394361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.395175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.397714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.398732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.400044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.401632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.402907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfeec00-0927-46c6-bd55-3c6d919aee18 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.403518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfeec00-0927-46c6-bd55-3c6d919aee18 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.404026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfeec00-0927-46c6-bd55-3c6d919aee18 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.407218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfeec00-0927-46c6-bd55-3c6d919aee18 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.408651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfeec00-0927-46c6-bd55-3c6d919aee18 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.409315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebfeec00-0927-46c6-bd55-3c6d919aee18 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.461760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Getting quotas for project 0cdfce6f9e86407d883e624dd2c50559. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:48.468093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Getting quotas for user 4113a1418b92488e97bf50aecdd49bb1 and project 0cdfce6f9e86407d883e624dd2c50559. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:48.483784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:48.486419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:48.646577 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e6d94949-a24b-4a8e-8c0b-f7c87aa1c682 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.378325 Oct 18 13:36:48.659270 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2105/4492] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:36:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 2394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:36:48.690402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9dd34fb2-21b6-4db9-978f-1ae1677635d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:48.693995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9dd34fb2-21b6-4db9-978f-1ae1677635d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:48.702307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ebfeec00-0927-46c6-bd55-3c6d919aee18 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:48.722159 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ebfeec00-0927-46c6-bd55-3c6d919aee18 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1317 microversion: 2.1 time: 0.344972 Oct 18 13:36:48.742440 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2388/4493] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:48 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:48.745258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dd34fb2-21b6-4db9-978f-1ae1677635d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.746378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dd34fb2-21b6-4db9-978f-1ae1677635d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.747094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dd34fb2-21b6-4db9-978f-1ae1677635d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.748062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dd34fb2-21b6-4db9-978f-1ae1677635d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.753919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d2c8bcab-51a7-4340-8853-7dd64e70de1d req-9ec8d644-10b6-480e-89ac-6ee5a07ced10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833b85f4-e854-4a7b-b04d-001cde240eb3", "name": "network-vif-plugged", "status": "completed", "tag": "83080d1b-68a0-4f1b-a31f-f765e5c6c561"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:48.754967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dd34fb2-21b6-4db9-978f-1ae1677635d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.755529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dd34fb2-21b6-4db9-978f-1ae1677635d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.811222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d2c8bcab-51a7-4340-8853-7dd64e70de1d req-9ec8d644-10b6-480e-89ac-6ee5a07ced10 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:48.812218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d2c8bcab-51a7-4340-8853-7dd64e70de1d req-9ec8d644-10b6-480e-89ac-6ee5a07ced10 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:48.812812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d2c8bcab-51a7-4340-8853-7dd64e70de1d req-9ec8d644-10b6-480e-89ac-6ee5a07ced10 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:48.858404 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d2c8bcab-51a7-4340-8853-7dd64e70de1d req-9ec8d644-10b6-480e-89ac-6ee5a07ced10 service nova] Creating event network-vif-plugged:83080d1b-68a0-4f1b-a31f-f765e5c6c561 for instance 833b85f4-e854-4a7b-b04d-001cde240eb3 on n-h2-858384-13 Oct 18 13:36:48.868991 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d2c8bcab-51a7-4340-8853-7dd64e70de1d req-9ec8d644-10b6-480e-89ac-6ee5a07ced10 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124932 Oct 18 13:36:48.878822 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2389/4494] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:48.896550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a8b94e6-470e-4820-b3ca-d7ac317560bb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:48.903473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1a8b94e6-470e-4820-b3ca-d7ac317560bb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:49.166942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9dd34fb2-21b6-4db9-978f-1ae1677635d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:49.181131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1a8b94e6-470e-4820-b3ca-d7ac317560bb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:49.192215 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1a8b94e6-470e-4820-b3ca-d7ac317560bb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1222 microversion: 2.1 time: 0.310198 Oct 18 13:36:49.193801 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9dd34fb2-21b6-4db9-978f-1ae1677635d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1280 microversion: 2.1 time: 0.523375 Oct 18 13:36:49.205663 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2390/4495] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:48 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1222 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:49.218773 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2106/4496] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:48 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1280 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:49.389111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-433a5150-9b26-4ba7-9c71-b2815903bee7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:49.390225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-433a5150-9b26-4ba7-9c71-b2815903bee7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:49.406452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-433a5150-9b26-4ba7-9c71-b2815903bee7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:49.407501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-433a5150-9b26-4ba7-9c71-b2815903bee7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:49.408501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-433a5150-9b26-4ba7-9c71-b2815903bee7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:49.410980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-433a5150-9b26-4ba7-9c71-b2815903bee7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:49.411884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-433a5150-9b26-4ba7-9c71-b2815903bee7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:49.413782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-433a5150-9b26-4ba7-9c71-b2815903bee7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:49.747278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a2e417d2-84ab-4080-b39b-44f172459a2b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:49.748055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a2e417d2-84ab-4080-b39b-44f172459a2b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:49.762907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2e417d2-84ab-4080-b39b-44f172459a2b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:49.765571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2e417d2-84ab-4080-b39b-44f172459a2b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:49.767026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2e417d2-84ab-4080-b39b-44f172459a2b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:49.770552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2e417d2-84ab-4080-b39b-44f172459a2b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:49.772353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2e417d2-84ab-4080-b39b-44f172459a2b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:49.772776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2e417d2-84ab-4080-b39b-44f172459a2b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:49.862664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-433a5150-9b26-4ba7-9c71-b2815903bee7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:49.876197 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-433a5150-9b26-4ba7-9c71-b2815903bee7 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.491454 Oct 18 13:36:49.887698 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2391/4497] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:49 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:50.258836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ad6b4db6-2c4d-4e23-b705-ffc4cc296f65 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Action: 'create', calling method: .version_select at 0x7ff60eecf8b0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1544812410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6FnaqI8YrsAzx/DJrmcDWr7H4A8CikL3RUTATHA3XR86EtFvXBdYDavQHBW1u2ZU6bcu5yPkbrXsmMToC4Lw7rlAeIjMH/uYB9T15ctOnrBInOkTjMYb8MtiohWDhsmw=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:50.298280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-ad6b4db6-2c4d-4e23-b705-ffc4cc296f65 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Getting quotas for project e52938a8883c4cb99fa736ebf0e5f7e9. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:50.313452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-ad6b4db6-2c4d-4e23-b705-ffc4cc296f65 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Getting quotas for user df9fe702e4894e279c3441e0d6d1111f and project e52938a8883c4cb99fa736ebf0e5f7e9. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:50.330670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a2e417d2-84ab-4080-b39b-44f172459a2b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:50.339386 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a2e417d2-84ab-4080-b39b-44f172459a2b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1317 microversion: 2.1 time: 0.597223 Oct 18 13:36:50.345145 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2107/4498] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:49 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:50.350302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e708a92-961a-4fd4-b2aa-dac8aa8f2341 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:50.354345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0e708a92-961a-4fd4-b2aa-dac8aa8f2341 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:50.361022 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ad6b4db6-2c4d-4e23-b705-ffc4cc296f65 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.454484 Oct 18 13:36:50.362472 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2392/4499] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:36:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:50.368498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7fbd3520-17e3-4e15-a502-ef1b486edbd3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:50.370073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7fbd3520-17e3-4e15-a502-ef1b486edbd3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:50.372375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e708a92-961a-4fd4-b2aa-dac8aa8f2341 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.372950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e708a92-961a-4fd4-b2aa-dac8aa8f2341 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.373575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e708a92-961a-4fd4-b2aa-dac8aa8f2341 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.374497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e708a92-961a-4fd4-b2aa-dac8aa8f2341 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.377998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e708a92-961a-4fd4-b2aa-dac8aa8f2341 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.378675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fbd3520-17e3-4e15-a502-ef1b486edbd3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.378818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e708a92-961a-4fd4-b2aa-dac8aa8f2341 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.379542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fbd3520-17e3-4e15-a502-ef1b486edbd3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.380182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fbd3520-17e3-4e15-a502-ef1b486edbd3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.381099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fbd3520-17e3-4e15-a502-ef1b486edbd3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.381901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fbd3520-17e3-4e15-a502-ef1b486edbd3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.382601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7fbd3520-17e3-4e15-a502-ef1b486edbd3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.435595 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7fbd3520-17e3-4e15-a502-ef1b486edbd3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments/5ba37690-e936-43fd-90a5-fea0050ea24f" status: 200 len: 194 microversion: 2.20 time: 0.071505 Oct 18 13:36:50.437810 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2393/4500] 10.222.0.40 () {60 vars in 1454 bytes} [Tue Oct 18 13:36:50 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments/5ba37690-e936-43fd-90a5-fea0050ea24f => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:36:50.451444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-347747a2-c22c-4af5-99e3-8abff7f6234a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:50.455256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-347747a2-c22c-4af5-99e3-8abff7f6234a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:50.466473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-347747a2-c22c-4af5-99e3-8abff7f6234a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.466967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-347747a2-c22c-4af5-99e3-8abff7f6234a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.467409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-347747a2-c22c-4af5-99e3-8abff7f6234a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.468124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-347747a2-c22c-4af5-99e3-8abff7f6234a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.473127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-347747a2-c22c-4af5-99e3-8abff7f6234a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.473966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-347747a2-c22c-4af5-99e3-8abff7f6234a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.804842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e708a92-961a-4fd4-b2aa-dac8aa8f2341 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:50.813983 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e708a92-961a-4fd4-b2aa-dac8aa8f2341 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.467144 Oct 18 13:36:50.815125 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2108/4501] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:50 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:50.819799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-edbd2f8e-953c-4b46-9ddf-588089bc153b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:50.820683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-edbd2f8e-953c-4b46-9ddf-588089bc153b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:50.835945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edbd2f8e-953c-4b46-9ddf-588089bc153b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.839380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edbd2f8e-953c-4b46-9ddf-588089bc153b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.839871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edbd2f8e-953c-4b46-9ddf-588089bc153b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.840635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edbd2f8e-953c-4b46-9ddf-588089bc153b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.841111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edbd2f8e-953c-4b46-9ddf-588089bc153b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.846831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edbd2f8e-953c-4b46-9ddf-588089bc153b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.847999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-347747a2-c22c-4af5-99e3-8abff7f6234a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:50.878769 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-347747a2-c22c-4af5-99e3-8abff7f6234a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1278 microversion: 2.1 time: 0.439530 Oct 18 13:36:50.912050 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2394/4502] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:50 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1278 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:50.922663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc0bac4f-6a96-487a-b5e0-97d2202a7538 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:50.923495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bc0bac4f-6a96-487a-b5e0-97d2202a7538 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:50.931077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc0bac4f-6a96-487a-b5e0-97d2202a7538 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.932090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc0bac4f-6a96-487a-b5e0-97d2202a7538 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.932736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc0bac4f-6a96-487a-b5e0-97d2202a7538 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:50.933594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc0bac4f-6a96-487a-b5e0-97d2202a7538 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:50.934159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc0bac4f-6a96-487a-b5e0-97d2202a7538 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:50.934687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc0bac4f-6a96-487a-b5e0-97d2202a7538 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.004514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-edbd2f8e-953c-4b46-9ddf-588089bc153b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:51.018252 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-edbd2f8e-953c-4b46-9ddf-588089bc153b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1274 microversion: 2.1 time: 0.199267 Oct 18 13:36:51.018956 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2109/4503] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:50 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:51.032750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-bc0bac4f-6a96-487a-b5e0-97d2202a7538 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lazy-loading 'services' on Instance uuid 5fa292c2-3801-4d84-b31a-4d3eeeb41818 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:36:51.043775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-507b0041-757e-44d2-85cb-46e3202f6e9b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:51.044876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-507b0041-757e-44d2-85cb-46e3202f6e9b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: e94f8958-10d7-4caf-9f28-d696342fa07c] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:51.053408 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-507b0041-757e-44d2-85cb-46e3202f6e9b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance e94f8958-10d7-4caf-9f28-d696342fa07c could not be found. Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-507b0041-757e-44d2-85cb-46e3202f6e9b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/e94f8958-10d7-4caf-9f28-d696342fa07c/action HTTP/1.1 Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 15 Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: {"unpause": {}} Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance e94f8958-10d7-4caf-9f28-d696342fa07c could not be found. Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'e94f8958-10d7-4caf-9f28-d696342fa07c', 'body': {'unpause': {}}} Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e94f8958-10d7-4caf-9f28-d696342fa07c could not be found. Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e94f8958-10d7-4caf-9f28-d696342fa07c could not be found. Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:51.055165 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:51.060294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:51.060294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:51.060294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e94f8958-10d7-4caf-9f28-d696342fa07c could not be found. Oct 18 13:36:51.060294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:51.062500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-507b0041-757e-44d2-85cb-46e3202f6e9b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance e94f8958-10d7-4caf-9f28-d696342fa07c could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:51.063792 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-507b0041-757e-44d2-85cb-46e3202f6e9b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/e94f8958-10d7-4caf-9f28-d696342fa07c/action" status: 404 len: 111 microversion: 2.1 time: 0.043514 Oct 18 13:36:51.064784 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2110/4504] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:36:51 2022] POST /compute/v2.1/servers/e94f8958-10d7-4caf-9f28-d696342fa07c/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:36:51.075280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e04c36bd-4333-42f0-b855-ca9a43a67d11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:51.076384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e04c36bd-4333-42f0-b855-ca9a43a67d11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:51.085515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e04c36bd-4333-42f0-b855-ca9a43a67d11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.086230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e04c36bd-4333-42f0-b855-ca9a43a67d11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.086843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e04c36bd-4333-42f0-b855-ca9a43a67d11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.087759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e04c36bd-4333-42f0-b855-ca9a43a67d11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.088492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e04c36bd-4333-42f0-b855-ca9a43a67d11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.089226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e04c36bd-4333-42f0-b855-ca9a43a67d11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.187513 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bc0bac4f-6a96-487a-b5e0-97d2202a7538 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments/5ba37690-e936-43fd-90a5-fea0050ea24f" status: 202 len: 0 microversion: 2.20 time: 0.271455 Oct 18 13:36:51.190191 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2395/4505] 10.222.0.40 () {60 vars in 1457 bytes} [Tue Oct 18 13:36:50 2022] DELETE /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments/5ba37690-e936-43fd-90a5-fea0050ea24f => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:36:51.206317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c3dee870-bb26-4be6-97f6-d163c205f008 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:51.210238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c3dee870-bb26-4be6-97f6-d163c205f008 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:51.232369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3dee870-bb26-4be6-97f6-d163c205f008 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.235902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3dee870-bb26-4be6-97f6-d163c205f008 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.236961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3dee870-bb26-4be6-97f6-d163c205f008 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.237973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3dee870-bb26-4be6-97f6-d163c205f008 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.241740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3dee870-bb26-4be6-97f6-d163c205f008 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.242450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3dee870-bb26-4be6-97f6-d163c205f008 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.288538 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c3dee870-bb26-4be6-97f6-d163c205f008 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093883 Oct 18 13:36:51.289905 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2396/4506] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:36:51 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:36:51.368292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32bd413b-388e-4fa7-beaf-e10131f8d25c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:51.370752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-32bd413b-388e-4fa7-beaf-e10131f8d25c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:51.385775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32bd413b-388e-4fa7-beaf-e10131f8d25c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.386643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32bd413b-388e-4fa7-beaf-e10131f8d25c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.389561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32bd413b-388e-4fa7-beaf-e10131f8d25c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.396573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32bd413b-388e-4fa7-beaf-e10131f8d25c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.398948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32bd413b-388e-4fa7-beaf-e10131f8d25c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.399790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32bd413b-388e-4fa7-beaf-e10131f8d25c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.570400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e04c36bd-4333-42f0-b855-ca9a43a67d11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:51.599914 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e04c36bd-4333-42f0-b855-ca9a43a67d11 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.530291 Oct 18 13:36:51.601225 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2111/4507] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:51 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:51.629886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-acc4911a-b4b4-4468-936c-b5613b5ab346 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:51.630798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-acc4911a-b4b4-4468-936c-b5613b5ab346 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:51.642110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acc4911a-b4b4-4468-936c-b5613b5ab346 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.642810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acc4911a-b4b4-4468-936c-b5613b5ab346 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.643452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acc4911a-b4b4-4468-936c-b5613b5ab346 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.647462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acc4911a-b4b4-4468-936c-b5613b5ab346 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.648678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acc4911a-b4b4-4468-936c-b5613b5ab346 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.649420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acc4911a-b4b4-4468-936c-b5613b5ab346 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.777845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-32bd413b-388e-4fa7-beaf-e10131f8d25c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:51.793430 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-32bd413b-388e-4fa7-beaf-e10131f8d25c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1467 microversion: 2.1 time: 0.429316 Oct 18 13:36:51.797071 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2397/4508] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:51 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1467 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:51.825950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3bed47a7-edd6-4fbf-800d-b989b3f5972f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:51.827557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3bed47a7-edd6-4fbf-800d-b989b3f5972f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:51.843290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bed47a7-edd6-4fbf-800d-b989b3f5972f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.844687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bed47a7-edd6-4fbf-800d-b989b3f5972f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.845419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bed47a7-edd6-4fbf-800d-b989b3f5972f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:51.846586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bed47a7-edd6-4fbf-800d-b989b3f5972f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:51.849406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bed47a7-edd6-4fbf-800d-b989b3f5972f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:51.851928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bed47a7-edd6-4fbf-800d-b989b3f5972f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:52.174685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-acc4911a-b4b4-4468-936c-b5613b5ab346 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:52.189837 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-acc4911a-b4b4-4468-936c-b5613b5ab346 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.561130 Oct 18 13:36:52.193733 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2112/4509] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:51 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:52.205322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6267110d-8aeb-4136-b15c-b7152d0d5645 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:52.209155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6267110d-8aeb-4136-b15c-b7152d0d5645 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:52.223368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6267110d-8aeb-4136-b15c-b7152d0d5645 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:52.225079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6267110d-8aeb-4136-b15c-b7152d0d5645 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:52.225699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6267110d-8aeb-4136-b15c-b7152d0d5645 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:52.231037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6267110d-8aeb-4136-b15c-b7152d0d5645 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:52.232033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6267110d-8aeb-4136-b15c-b7152d0d5645 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:52.232739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6267110d-8aeb-4136-b15c-b7152d0d5645 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:52.233702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3bed47a7-edd6-4fbf-800d-b989b3f5972f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:52.243799 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3bed47a7-edd6-4fbf-800d-b989b3f5972f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456" status: 200 len: 1467 microversion: 2.1 time: 0.426830 Oct 18 13:36:52.252562 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2398/4510] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:51 2022] GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456 => generated 1467 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:52.259654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8e36fa69-3334-4d44-a1d3-98149920ab73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:52.261916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8e36fa69-3334-4d44-a1d3-98149920ab73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:52.279212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e36fa69-3334-4d44-a1d3-98149920ab73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:52.280098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e36fa69-3334-4d44-a1d3-98149920ab73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:52.280725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e36fa69-3334-4d44-a1d3-98149920ab73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:52.281754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e36fa69-3334-4d44-a1d3-98149920ab73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:52.284018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e36fa69-3334-4d44-a1d3-98149920ab73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:52.284641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e36fa69-3334-4d44-a1d3-98149920ab73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:52.429874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8e36fa69-3334-4d44-a1d3-98149920ab73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:52.442611 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8e36fa69-3334-4d44-a1d3-98149920ab73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1280 microversion: 2.1 time: 0.188083 Oct 18 13:36:52.448956 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2399/4511] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:52 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1280 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:52.459317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6a88de44-aa9b-4151-8305-102a9b2ce23d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:52.459860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6a88de44-aa9b-4151-8305-102a9b2ce23d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:52.472986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a88de44-aa9b-4151-8305-102a9b2ce23d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:52.473523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a88de44-aa9b-4151-8305-102a9b2ce23d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:52.473959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a88de44-aa9b-4151-8305-102a9b2ce23d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:52.474672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a88de44-aa9b-4151-8305-102a9b2ce23d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:52.475128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a88de44-aa9b-4151-8305-102a9b2ce23d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:52.475552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a88de44-aa9b-4151-8305-102a9b2ce23d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:52.539520 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-6a88de44-aa9b-4151-8305-102a9b2ce23d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Cannot 'unpause' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6a88de44-aa9b-4151-8305-102a9b2ce23d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action HTTP/1.1 Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 15 Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: {"unpause": {}} Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: exception: Cannot 'unpause' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '6bce6f6b-df28-4c34-a17f-4f18eb67d401', 'body': {'unpause': {}}} Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 in vm_state active. Cannot unpause while the instance is in this state. Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:52.541830 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:52.548389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:52.548389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:52.548389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:52.548389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:36:52.548389 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:52.548389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6a88de44-aa9b-4151-8305-102a9b2ce23d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 409 to user: Cannot 'unpause' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:52.548389 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6a88de44-aa9b-4151-8305-102a9b2ce23d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action" status: 409 len: 145 microversion: 2.1 time: 0.092866 Oct 18 13:36:52.548389 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2400/4512] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:36:52 2022] POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action => generated 145 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:36:52.562732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-57294ce9-c461-4d20-bfcf-c90d1686736d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2001149056"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:52.565156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-57294ce9-c461-4d20-bfcf-c90d1686736d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:52.570559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:52.587372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57294ce9-c461-4d20-bfcf-c90d1686736d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:52.588267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57294ce9-c461-4d20-bfcf-c90d1686736d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:52.588901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57294ce9-c461-4d20-bfcf-c90d1686736d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:52.598683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57294ce9-c461-4d20-bfcf-c90d1686736d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:52.599360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57294ce9-c461-4d20-bfcf-c90d1686736d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:52.599959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57294ce9-c461-4d20-bfcf-c90d1686736d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:53.039457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:53.107744 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-57294ce9-c461-4d20-bfcf-c90d1686736d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "POST /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456/action" status: 202 len: 0 microversion: 2.1 time: 0.542608 Oct 18 13:36:53.108581 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2401/4513] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:36:52 2022] POST /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:36:53.120546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0f50006f-1381-4655-b4a3-eafae8a478b6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:53.129965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0f50006f-1381-4655-b4a3-eafae8a478b6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:53.148768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f50006f-1381-4655-b4a3-eafae8a478b6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:53.153044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f50006f-1381-4655-b4a3-eafae8a478b6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:53.153565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f50006f-1381-4655-b4a3-eafae8a478b6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:53.159084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f50006f-1381-4655-b4a3-eafae8a478b6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:53.160119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f50006f-1381-4655-b4a3-eafae8a478b6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:53.161979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f50006f-1381-4655-b4a3-eafae8a478b6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:53.231870 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0f50006f-1381-4655-b4a3-eafae8a478b6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.121728 Oct 18 13:36:53.245424 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2402/4514] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:36:53 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:36:53.248800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aaa62a61-6cbb-44e1-95a3-c1fa59ca58d1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:53.254990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aaa62a61-6cbb-44e1-95a3-c1fa59ca58d1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:53.270366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aaa62a61-6cbb-44e1-95a3-c1fa59ca58d1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:53.271741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aaa62a61-6cbb-44e1-95a3-c1fa59ca58d1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:53.274485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aaa62a61-6cbb-44e1-95a3-c1fa59ca58d1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:53.277305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aaa62a61-6cbb-44e1-95a3-c1fa59ca58d1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:53.280613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aaa62a61-6cbb-44e1-95a3-c1fa59ca58d1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:53.281214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aaa62a61-6cbb-44e1-95a3-c1fa59ca58d1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:53.896386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6267110d-8aeb-4136-b15c-b7152d0d5645 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:53.911235 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6267110d-8aeb-4136-b15c-b7152d0d5645 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1320 microversion: 2.1 time: 1.716038 Oct 18 13:36:53.913037 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2113/4515] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:52 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1320 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:53.940153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e2e67d2-4cb6-417a-8236-f4567f1293c5 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e8680d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:53.993455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aaa62a61-6cbb-44e1-95a3-c1fa59ca58d1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:54.027070 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4e2e67d2-4cb6-417a-8236-f4567f1293c5 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.096044 Oct 18 13:36:54.028768 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aaa62a61-6cbb-44e1-95a3-c1fa59ca58d1 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.784691 Oct 18 13:36:54.029642 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2403/4516] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:53 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:54.036243 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2114/4517] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:53 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:54.046126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f9be884d-e637-41b3-a49e-0fbe0169e882 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:54.048160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f9be884d-e637-41b3-a49e-0fbe0169e882 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:54.056507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c84f7abf-04c9-4171-8cca-a6374910dc95 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:54.057278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c84f7abf-04c9-4171-8cca-a6374910dc95 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:54.067087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9be884d-e637-41b3-a49e-0fbe0169e882 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:54.068230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9be884d-e637-41b3-a49e-0fbe0169e882 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:54.070210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:54.075210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9be884d-e637-41b3-a49e-0fbe0169e882 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:54.076067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9be884d-e637-41b3-a49e-0fbe0169e882 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:54.076555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9be884d-e637-41b3-a49e-0fbe0169e882 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:54.076998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9be884d-e637-41b3-a49e-0fbe0169e882 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:54.078381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c84f7abf-04c9-4171-8cca-a6374910dc95 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:54.079636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c84f7abf-04c9-4171-8cca-a6374910dc95 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:54.080280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c84f7abf-04c9-4171-8cca-a6374910dc95 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:54.082994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c84f7abf-04c9-4171-8cca-a6374910dc95 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:54.084779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c84f7abf-04c9-4171-8cca-a6374910dc95 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:54.085435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c84f7abf-04c9-4171-8cca-a6374910dc95 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:54.855006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f9be884d-e637-41b3-a49e-0fbe0169e882 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:54.865518 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f9be884d-e637-41b3-a49e-0fbe0169e882 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1322 microversion: 2.1 time: 0.831594 Oct 18 13:36:54.889021 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2404/4518] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:54 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1322 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:54.894727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4abf0385-91b6-4075-864d-82d61c92e075 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:54.897401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4abf0385-91b6-4075-864d-82d61c92e075 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:54.912077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4abf0385-91b6-4075-864d-82d61c92e075 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:54.919458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4abf0385-91b6-4075-864d-82d61c92e075 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:54.920207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4abf0385-91b6-4075-864d-82d61c92e075 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:54.921371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4abf0385-91b6-4075-864d-82d61c92e075 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:54.923653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4abf0385-91b6-4075-864d-82d61c92e075 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:54.924324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4abf0385-91b6-4075-864d-82d61c92e075 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:54.966335 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4abf0385-91b6-4075-864d-82d61c92e075 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075728 Oct 18 13:36:54.967214 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2405/4519] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:36:54 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:36:54.985837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c84f7abf-04c9-4171-8cca-a6374910dc95 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:54.998870 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c84f7abf-04c9-4171-8cca-a6374910dc95 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.946889 Oct 18 13:36:54.999466 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2115/4520] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:54 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:36:55.016036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a9022073-4840-485e-9fb2-bccbbb9c8649 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:55.016649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a9022073-4840-485e-9fb2-bccbbb9c8649 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:55.030896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9022073-4840-485e-9fb2-bccbbb9c8649 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:55.031397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9022073-4840-485e-9fb2-bccbbb9c8649 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:55.036009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9022073-4840-485e-9fb2-bccbbb9c8649 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:55.040319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9022073-4840-485e-9fb2-bccbbb9c8649 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:55.043090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9022073-4840-485e-9fb2-bccbbb9c8649 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:55.051653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9022073-4840-485e-9fb2-bccbbb9c8649 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:55.297420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1146ffc0-0fc3-4dcf-a1a7-ab79ad6b238f req-67db7ddf-1b92-40e7-ba6a-65336ecda0de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d84248cd-c35f-4af0-b55d-25e8f9055c3b", "tag": "329f87db-5c9f-4b3a-a50e-757cdb071740"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:55.320795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1146ffc0-0fc3-4dcf-a1a7-ab79ad6b238f req-67db7ddf-1b92-40e7-ba6a-65336ecda0de service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:55.321030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1146ffc0-0fc3-4dcf-a1a7-ab79ad6b238f req-67db7ddf-1b92-40e7-ba6a-65336ecda0de service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:55.321397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1146ffc0-0fc3-4dcf-a1a7-ab79ad6b238f req-67db7ddf-1b92-40e7-ba6a-65336ecda0de service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:55.366499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:55.370347 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1146ffc0-0fc3-4dcf-a1a7-ab79ad6b238f req-67db7ddf-1b92-40e7-ba6a-65336ecda0de service nova] Creating event network-changed:329f87db-5c9f-4b3a-a50e-757cdb071740 for instance d84248cd-c35f-4af0-b55d-25e8f9055c3b on n-h1-858384-13 Oct 18 13:36:55.380435 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1146ffc0-0fc3-4dcf-a1a7-ab79ad6b238f req-67db7ddf-1b92-40e7-ba6a-65336ecda0de service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.411251 Oct 18 13:36:55.381300 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2406/4521] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:55.395791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-84f28b32-ca9a-4829-b4a5-915dc86f2c86 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:55.406539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-84f28b32-ca9a-4829-b4a5-915dc86f2c86 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: c186e96b-0062-4d23-9883-0907066588ab] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:55.418901 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-84f28b32-ca9a-4829-b4a5-915dc86f2c86 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance c186e96b-0062-4d23-9883-0907066588ab could not be found. Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-84f28b32-ca9a-4829-b4a5-915dc86f2c86 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/c186e96b-0062-4d23-9883-0907066588ab/action HTTP/1.1 Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 18 Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: {"unshelve": null} Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance c186e96b-0062-4d23-9883-0907066588ab could not be found. Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'c186e96b-0062-4d23-9883-0907066588ab', 'body': {'unshelve': None}} Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c186e96b-0062-4d23-9883-0907066588ab could not be found. Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c186e96b-0062-4d23-9883-0907066588ab could not be found. Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:55.428412 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:55.432883 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:55.432883 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:55.432883 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:55.432883 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:55.432883 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:55.432883 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:55.432883 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c186e96b-0062-4d23-9883-0907066588ab could not be found. Oct 18 13:36:55.432883 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:55.435121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-84f28b32-ca9a-4829-b4a5-915dc86f2c86 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance c186e96b-0062-4d23-9883-0907066588ab could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:55.436215 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-84f28b32-ca9a-4829-b4a5-915dc86f2c86 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/c186e96b-0062-4d23-9883-0907066588ab/action" status: 404 len: 111 microversion: 2.1 time: 0.052137 Oct 18 13:36:55.437327 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2407/4522] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:36:55 2022] POST /compute/v2.1/servers/c186e96b-0062-4d23-9883-0907066588ab/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:36:55.445789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-452c66b6-01de-49d2-9425-a239f2086760 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f0e63a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:55.523593 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-452c66b6-01de-49d2-9425-a239f2086760 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.084003 Oct 18 13:36:55.524661 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2408/4523] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:55 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:55.535721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d88c91d3-34fb-4ad8-8a83-fd480c15b574 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:55.536634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d88c91d3-34fb-4ad8-8a83-fd480c15b574 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:55.547120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d88c91d3-34fb-4ad8-8a83-fd480c15b574 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:55.548191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d88c91d3-34fb-4ad8-8a83-fd480c15b574 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:55.549046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d88c91d3-34fb-4ad8-8a83-fd480c15b574 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:55.550019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d88c91d3-34fb-4ad8-8a83-fd480c15b574 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:55.550684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d88c91d3-34fb-4ad8-8a83-fd480c15b574 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:55.551334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d88c91d3-34fb-4ad8-8a83-fd480c15b574 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:56.082742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a9022073-4840-485e-9fb2-bccbbb9c8649 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:56.100982 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a9022073-4840-485e-9fb2-bccbbb9c8649 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1320 microversion: 2.1 time: 1.098586 Oct 18 13:36:56.101902 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2116/4524] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:55 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1320 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:56.131798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c790f517-2d49-440b-abb7-cea7736f4f91 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:56.132581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c790f517-2d49-440b-abb7-cea7736f4f91 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:56.141031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c790f517-2d49-440b-abb7-cea7736f4f91 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:56.142327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c790f517-2d49-440b-abb7-cea7736f4f91 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:56.142889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c790f517-2d49-440b-abb7-cea7736f4f91 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:56.143869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c790f517-2d49-440b-abb7-cea7736f4f91 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:56.144457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c790f517-2d49-440b-abb7-cea7736f4f91 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:56.145003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c790f517-2d49-440b-abb7-cea7736f4f91 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:56.195025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:56.271330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d88c91d3-34fb-4ad8-8a83-fd480c15b574 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:56.289730 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d88c91d3-34fb-4ad8-8a83-fd480c15b574 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.763131 Oct 18 13:36:56.290331 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2409/4525] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:55 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:56.319765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-103d8d5f-fe5b-45ec-92d4-9e0ad65f6c6f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:56.325665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-103d8d5f-fe5b-45ec-92d4-9e0ad65f6c6f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:56.341285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-103d8d5f-fe5b-45ec-92d4-9e0ad65f6c6f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:56.342834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-103d8d5f-fe5b-45ec-92d4-9e0ad65f6c6f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:56.343746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-103d8d5f-fe5b-45ec-92d4-9e0ad65f6c6f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:56.344963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-103d8d5f-fe5b-45ec-92d4-9e0ad65f6c6f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:56.345602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-103d8d5f-fe5b-45ec-92d4-9e0ad65f6c6f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:56.346590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-103d8d5f-fe5b-45ec-92d4-9e0ad65f6c6f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:56.440459 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-103d8d5f-fe5b-45ec-92d4-9e0ad65f6c6f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133746 Oct 18 13:36:56.449529 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2410/4526] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:36:56 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:36:56.575463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c790f517-2d49-440b-abb7-cea7736f4f91 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:56.577596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-db3fd270-29b4-4103-b4fa-c6c5083b062d req-318ce18e-1459-4b57-989f-b16f13b1801f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "568613ab-c15f-4a59-aa10-8e40b871f918", "tag": "88d9e0f1-76bd-495a-a2d4-62d8d2828b64"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:56.594788 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c790f517-2d49-440b-abb7-cea7736f4f91 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1322 microversion: 2.1 time: 0.460344 Oct 18 13:36:56.596452 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2117/4527] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:56 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:56.602259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-db3fd270-29b4-4103-b4fa-c6c5083b062d req-318ce18e-1459-4b57-989f-b16f13b1801f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:56.603051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-db3fd270-29b4-4103-b4fa-c6c5083b062d req-318ce18e-1459-4b57-989f-b16f13b1801f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:56.604718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-db3fd270-29b4-4103-b4fa-c6c5083b062d req-318ce18e-1459-4b57-989f-b16f13b1801f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:56.611973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-680c0eee-8fd0-422e-91ec-0803f4779fdd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:56.615570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-680c0eee-8fd0-422e-91ec-0803f4779fdd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:56.630844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-680c0eee-8fd0-422e-91ec-0803f4779fdd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:56.633955 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-db3fd270-29b4-4103-b4fa-c6c5083b062d req-318ce18e-1459-4b57-989f-b16f13b1801f service nova] Creating event network-changed:88d9e0f1-76bd-495a-a2d4-62d8d2828b64 for instance 568613ab-c15f-4a59-aa10-8e40b871f918 on n-h1-858384-13 Oct 18 13:36:56.634910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-680c0eee-8fd0-422e-91ec-0803f4779fdd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:56.638400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-680c0eee-8fd0-422e-91ec-0803f4779fdd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:56.639887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-680c0eee-8fd0-422e-91ec-0803f4779fdd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:56.640570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-680c0eee-8fd0-422e-91ec-0803f4779fdd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:56.641361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-680c0eee-8fd0-422e-91ec-0803f4779fdd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:56.649604 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-db3fd270-29b4-4103-b4fa-c6c5083b062d req-318ce18e-1459-4b57-989f-b16f13b1801f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198287 Oct 18 13:36:56.652505 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2411/4528] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:56.667582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-17812533-436c-4dae-b76c-1e4f9da92e33 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e578310>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:56.760825 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-17812533-436c-4dae-b76c-1e4f9da92e33 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.106789 Oct 18 13:36:56.762518 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2412/4529] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:56 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:57.128853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a319cd2d-caff-40bd-a409-ed8c4f5a68c6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:57.129940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a319cd2d-caff-40bd-a409-ed8c4f5a68c6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:57.147005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a319cd2d-caff-40bd-a409-ed8c4f5a68c6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:57.149595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a319cd2d-caff-40bd-a409-ed8c4f5a68c6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:57.150977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a319cd2d-caff-40bd-a409-ed8c4f5a68c6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:57.151846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a319cd2d-caff-40bd-a409-ed8c4f5a68c6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:57.152735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-680c0eee-8fd0-422e-91ec-0803f4779fdd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:57.154270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a319cd2d-caff-40bd-a409-ed8c4f5a68c6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:57.155198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a319cd2d-caff-40bd-a409-ed8c4f5a68c6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:57.165844 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-680c0eee-8fd0-422e-91ec-0803f4779fdd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.567480 Oct 18 13:36:57.170429 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2118/4530] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:56 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:57.196595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fce72e2d-9bf3-4e6c-abc0-f08eeaaaf31f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:57.198117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fce72e2d-9bf3-4e6c-abc0-f08eeaaaf31f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:57.208380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fce72e2d-9bf3-4e6c-abc0-f08eeaaaf31f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:57.214360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fce72e2d-9bf3-4e6c-abc0-f08eeaaaf31f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:57.216782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fce72e2d-9bf3-4e6c-abc0-f08eeaaaf31f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:57.218901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fce72e2d-9bf3-4e6c-abc0-f08eeaaaf31f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:57.219531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fce72e2d-9bf3-4e6c-abc0-f08eeaaaf31f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:57.225340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fce72e2d-9bf3-4e6c-abc0-f08eeaaaf31f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:57.297116 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-fce72e2d-9bf3-4e6c-abc0-f08eeaaaf31f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Cannot 'unshelve' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fce72e2d-9bf3-4e6c-abc0-f08eeaaaf31f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action HTTP/1.1 Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 18 Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: {"unshelve": null} Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: exception: Cannot 'unshelve' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '6bce6f6b-df28-4c34-a17f-4f18eb67d401', 'body': {'unshelve': None}} Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 in vm_state active. Cannot unshelve while the instance is in this state. Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:36:57.305959 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:36:57.312200 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:36:57.312200 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:57.312200 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:57.312200 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:57.312200 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:57.312200 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:57.312200 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:57.312200 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:57.312200 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:57.312200 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active Oct 18 13:36:57.312200 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:36:57.318123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fce72e2d-9bf3-4e6c-abc0-f08eeaaaf31f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 409 to user: Cannot 'unshelve' instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 while it is in vm_state active {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:57.322747 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fce72e2d-9bf3-4e6c-abc0-f08eeaaaf31f tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action" status: 409 len: 146 microversion: 2.1 time: 0.130396 Oct 18 13:36:57.332908 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2119/4531] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:36:57 2022] POST /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401/action => generated 146 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:36:57.339666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fc679ba1-6181-470b-8b8b-45afcd1d8fe2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:57.340357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fc679ba1-6181-470b-8b8b-45afcd1d8fe2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:57.387960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc679ba1-6181-470b-8b8b-45afcd1d8fe2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:57.388451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc679ba1-6181-470b-8b8b-45afcd1d8fe2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:57.398758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc679ba1-6181-470b-8b8b-45afcd1d8fe2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:57.399521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc679ba1-6181-470b-8b8b-45afcd1d8fe2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:57.400195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc679ba1-6181-470b-8b8b-45afcd1d8fe2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:57.401045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc679ba1-6181-470b-8b8b-45afcd1d8fe2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:57.766356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fc679ba1-6181-470b-8b8b-45afcd1d8fe2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:57.786267 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fc679ba1-6181-470b-8b8b-45afcd1d8fe2 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.450898 Oct 18 13:36:57.791591 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2120/4532] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:57 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:57.813617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3b075742-39a8-4098-a111-b13fa71bba99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:57.832587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3b075742-39a8-4098-a111-b13fa71bba99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:57.856214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b075742-39a8-4098-a111-b13fa71bba99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:57.860228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b075742-39a8-4098-a111-b13fa71bba99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:57.864792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b075742-39a8-4098-a111-b13fa71bba99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:57.876311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b075742-39a8-4098-a111-b13fa71bba99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:57.877108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b075742-39a8-4098-a111-b13fa71bba99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:57.877835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b075742-39a8-4098-a111-b13fa71bba99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:57.974462 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3b075742-39a8-4098-a111-b13fa71bba99 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.180670 Oct 18 13:36:57.975392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a319cd2d-caff-40bd-a409-ed8c4f5a68c6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:57.976849 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2121/4533] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:36:57 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:36:57.986321 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a319cd2d-caff-40bd-a409-ed8c4f5a68c6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1320 microversion: 2.1 time: 0.861687 Oct 18 13:36:57.988522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-85843965", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1544812410", "security_groups": [{"name": "tempest-secgroup-smoke-1620790153"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "84ddd8d2-179b-4c06-89c5-8dfc01006771"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:58.006716 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2413/4534] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:57 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1320 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:58.012248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-91be8d11-c5e0-44d5-b495-2cb2eb943363 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:58.013147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-91be8d11-c5e0-44d5-b495-2cb2eb943363 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:58.020962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91be8d11-c5e0-44d5-b495-2cb2eb943363 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:58.021810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91be8d11-c5e0-44d5-b495-2cb2eb943363 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:58.022425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91be8d11-c5e0-44d5-b495-2cb2eb943363 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:58.023382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91be8d11-c5e0-44d5-b495-2cb2eb943363 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:58.025546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91be8d11-c5e0-44d5-b495-2cb2eb943363 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:58.026211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-91be8d11-c5e0-44d5-b495-2cb2eb943363 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:58.234787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] validate_networks() for [('84ddd8d2-179b-4c06-89c5-8dfc01006771', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:36:58.299805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-91be8d11-c5e0-44d5-b495-2cb2eb943363 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:58.312960 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-91be8d11-c5e0-44d5-b495-2cb2eb943363 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1322 microversion: 2.1 time: 0.303424 Oct 18 13:36:58.314112 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2414/4535] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:58 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:58.334169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-48207e6a-ec04-41a5-82f5-f1a6024253af tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617c6c430>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:58.389048 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-48207e6a-ec04-41a5-82f5-f1a6024253af tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.073358 Oct 18 13:36:58.389824 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2415/4536] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:36:58 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:58.397694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-de057c4d-7eb2-45af-85d9-a0753a37a512 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:58.398648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-de057c4d-7eb2-45af-85d9-a0753a37a512 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:58.407650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de057c4d-7eb2-45af-85d9-a0753a37a512 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:58.408509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de057c4d-7eb2-45af-85d9-a0753a37a512 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:58.409113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de057c4d-7eb2-45af-85d9-a0753a37a512 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:58.409965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de057c4d-7eb2-45af-85d9-a0753a37a512 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:58.410539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de057c4d-7eb2-45af-85d9-a0753a37a512 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:58.411102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de057c4d-7eb2-45af-85d9-a0753a37a512 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:58.431807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:58.477272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=22 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:36:58.867369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-de057c4d-7eb2-45af-85d9-a0753a37a512 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:58.883414 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-de057c4d-7eb2-45af-85d9-a0753a37a512 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.492320 Oct 18 13:36:58.884062 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2416/4537] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:58 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:58.895855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-51f4e4b1-9b65-4b37-8c2e-a10fb016ef8c req-3ace141b-486c-42b9-b847-27e2688db28e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f701eed8-faed-494f-987c-cbdd93ed5504", "tag": "7c235f2d-d376-49ee-ac72-2233d159633e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:58.924695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-51f4e4b1-9b65-4b37-8c2e-a10fb016ef8c req-3ace141b-486c-42b9-b847-27e2688db28e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:58.928811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-51f4e4b1-9b65-4b37-8c2e-a10fb016ef8c req-3ace141b-486c-42b9-b847-27e2688db28e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:58.929804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-51f4e4b1-9b65-4b37-8c2e-a10fb016ef8c req-3ace141b-486c-42b9-b847-27e2688db28e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:58.959490 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-51f4e4b1-9b65-4b37-8c2e-a10fb016ef8c req-3ace141b-486c-42b9-b847-27e2688db28e service nova] Creating event network-changed:7c235f2d-d376-49ee-ac72-2233d159633e for instance f701eed8-faed-494f-987c-cbdd93ed5504 on n-h2-858384-13 Oct 18 13:36:58.973103 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-51f4e4b1-9b65-4b37-8c2e-a10fb016ef8c req-3ace141b-486c-42b9-b847-27e2688db28e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080578 Oct 18 13:36:58.974829 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2417/4538] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:36:58.982951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d96fa371-978e-4d46-8a7a-8584e513d787 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1015385083_updated"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:36:58.986413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d96fa371-978e-4d46-8a7a-8584e513d787 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: d51ecd10-8b4d-4a4e-8323-1790e24b9267] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:58.993340 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-d96fa371-978e-4d46-8a7a-8584e513d787 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance d51ecd10-8b4d-4a4e-8323-1790e24b9267 could not be found. Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d96fa371-978e-4d46-8a7a-8584e513d787 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: request: PUT /compute/v2.1/servers/d51ecd10-8b4d-4a4e-8323-1790e24b9267 HTTP/1.1 Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 81 Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1015385083_updated"}} Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance d51ecd10-8b4d-4a4e-8323-1790e24b9267 could not be found. Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'd51ecd10-8b4d-4a4e-8323-1790e24b9267', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1015385083_updated'}}} Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d51ecd10-8b4d-4a4e-8323-1790e24b9267 could not be found. Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 18 13:36:58.995980 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d51ecd10-8b4d-4a4e-8323-1790e24b9267 could not be found. Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d51ecd10-8b4d-4a4e-8323-1790e24b9267 could not be found. Oct 18 13:36:59.000572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:36:59.003423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d96fa371-978e-4d46-8a7a-8584e513d787 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance d51ecd10-8b4d-4a4e-8323-1790e24b9267 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:36:59.004842 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d96fa371-978e-4d46-8a7a-8584e513d787 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "PUT /compute/v2.1/servers/d51ecd10-8b4d-4a4e-8323-1790e24b9267" status: 404 len: 111 microversion: 2.1 time: 0.028679 Oct 18 13:36:59.006016 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2418/4539] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 18 13:36:58 2022] PUT /compute/v2.1/servers/d51ecd10-8b4d-4a4e-8323-1790e24b9267 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:36:59.012063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-96014450-3946-4cc3-af30-1896bb7f887b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:59.015619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-96014450-3946-4cc3-af30-1896bb7f887b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:59.026357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96014450-3946-4cc3-af30-1896bb7f887b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.027157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96014450-3946-4cc3-af30-1896bb7f887b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.027771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96014450-3946-4cc3-af30-1896bb7f887b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.028781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96014450-3946-4cc3-af30-1896bb7f887b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.029430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96014450-3946-4cc3-af30-1896bb7f887b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.030069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96014450-3946-4cc3-af30-1896bb7f887b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.070052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Getting quotas for project e52938a8883c4cb99fa736ebf0e5f7e9. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:59.078149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Getting quotas for user df9fe702e4894e279c3441e0d6d1111f and project e52938a8883c4cb99fa736ebf0e5f7e9. Resources: dict_keys(['metadata_items']) {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:59.098373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:36:59.099093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:36:59.099863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:36:59.100493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:36:59.101089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:36:59.142705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.145074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.148788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.150642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.151493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.153098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.153626 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-96014450-3946-4cc3-af30-1896bb7f887b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.146256 Oct 18 13:36:59.158878 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2419/4540] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:36:59 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:36:59.168562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-51df07e9-9174-484d-94cb-0a8e7bc1b195 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:59.169220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-51df07e9-9174-484d-94cb-0a8e7bc1b195 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:59.190206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51df07e9-9174-484d-94cb-0a8e7bc1b195 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.190772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51df07e9-9174-484d-94cb-0a8e7bc1b195 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.191661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51df07e9-9174-484d-94cb-0a8e7bc1b195 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.192525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51df07e9-9174-484d-94cb-0a8e7bc1b195 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.193042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51df07e9-9174-484d-94cb-0a8e7bc1b195 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.193595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51df07e9-9174-484d-94cb-0a8e7bc1b195 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.205515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Getting quotas for project e52938a8883c4cb99fa736ebf0e5f7e9. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:36:59.221686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Getting quotas for user df9fe702e4894e279c3441e0d6d1111f and project e52938a8883c4cb99fa736ebf0e5f7e9. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:36:59.254057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:36:59.258419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:36:59.372688 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a5c877dc-a403-4493-9c5e-cf1770e0e6be tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.389485 Oct 18 13:36:59.373954 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2122/4541] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:36:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:36:59.386147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-70d1bd7a-6a00-4b72-abb4-0999871746dc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:59.386762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-70d1bd7a-6a00-4b72-abb4-0999871746dc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:59.404834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70d1bd7a-6a00-4b72-abb4-0999871746dc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.408589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70d1bd7a-6a00-4b72-abb4-0999871746dc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.409146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70d1bd7a-6a00-4b72-abb4-0999871746dc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.409949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70d1bd7a-6a00-4b72-abb4-0999871746dc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.410704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70d1bd7a-6a00-4b72-abb4-0999871746dc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.410821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70d1bd7a-6a00-4b72-abb4-0999871746dc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.688532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-51df07e9-9174-484d-94cb-0a8e7bc1b195 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:36:59.703322 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-51df07e9-9174-484d-94cb-0a8e7bc1b195 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.543200 Oct 18 13:36:59.704393 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2420/4542] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:59 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:36:59.713486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e949c867-f4a5-4946-bd69-af027f94ae42 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:36:59.717716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e949c867-f4a5-4946-bd69-af027f94ae42 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:36:59.734387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e949c867-f4a5-4946-bd69-af027f94ae42 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.735051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e949c867-f4a5-4946-bd69-af027f94ae42 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.735590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e949c867-f4a5-4946-bd69-af027f94ae42 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:36:59.736394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e949c867-f4a5-4946-bd69-af027f94ae42 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:36:59.737027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e949c867-f4a5-4946-bd69-af027f94ae42 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:36:59.737575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e949c867-f4a5-4946-bd69-af027f94ae42 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:00.093429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-70d1bd7a-6a00-4b72-abb4-0999871746dc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:00.109028 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-70d1bd7a-6a00-4b72-abb4-0999871746dc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1320 microversion: 2.1 time: 0.733232 Oct 18 13:37:00.110166 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2123/4543] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:59 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1320 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:00.123901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1b60f2c1-7b06-462c-98c3-20b92f3e8da0 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:00.125122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1b60f2c1-7b06-462c-98c3-20b92f3e8da0 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:00.169770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e949c867-f4a5-4946-bd69-af027f94ae42 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:00.189827 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e949c867-f4a5-4946-bd69-af027f94ae42 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1322 microversion: 2.1 time: 0.484208 Oct 18 13:37:00.191541 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2421/4544] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:36:59 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1322 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:00.197760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cffc75d1-a856-4f10-9d1e-f30625acbce0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f7a80d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:00.253886 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cffc75d1-a856-4f10-9d1e-f30625acbce0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.060853 Oct 18 13:37:00.255950 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2422/4545] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:00 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:00.277068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-00948d6c-6400-47e1-9e6f-21bff2ca8937 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:00.278254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-00948d6c-6400-47e1-9e6f-21bff2ca8937 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:00.285612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00948d6c-6400-47e1-9e6f-21bff2ca8937 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:00.286505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00948d6c-6400-47e1-9e6f-21bff2ca8937 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:00.292328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00948d6c-6400-47e1-9e6f-21bff2ca8937 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:00.293426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00948d6c-6400-47e1-9e6f-21bff2ca8937 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:00.294219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00948d6c-6400-47e1-9e6f-21bff2ca8937 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:00.294840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00948d6c-6400-47e1-9e6f-21bff2ca8937 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:00.327257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=14 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:00.359715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1b60f2c1-7b06-462c-98c3-20b92f3e8da0 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:00.370320 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1b60f2c1-7b06-462c-98c3-20b92f3e8da0 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1301 microversion: 2.1 time: 0.250938 Oct 18 13:37:00.373104 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2124/4546] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:00 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1301 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:00.381782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-06bd9444-fb31-438e-84e8-2e45d3f0a4eb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:00.384567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-06bd9444-fb31-438e-84e8-2e45d3f0a4eb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:00.394087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06bd9444-fb31-438e-84e8-2e45d3f0a4eb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:00.394860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06bd9444-fb31-438e-84e8-2e45d3f0a4eb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:00.395511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06bd9444-fb31-438e-84e8-2e45d3f0a4eb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:00.396915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06bd9444-fb31-438e-84e8-2e45d3f0a4eb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:00.397700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06bd9444-fb31-438e-84e8-2e45d3f0a4eb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:00.398575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06bd9444-fb31-438e-84e8-2e45d3f0a4eb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:00.439434 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-06bd9444-fb31-438e-84e8-2e45d3f0a4eb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064743 Oct 18 13:37:00.440489 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2125/4547] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:37:00 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:00.571262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ce59ce0d-621c-4941-a926-399d6c18591d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:00.571795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ce59ce0d-621c-4941-a926-399d6c18591d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:00.589589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce59ce0d-621c-4941-a926-399d6c18591d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:00.590200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce59ce0d-621c-4941-a926-399d6c18591d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:00.590622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce59ce0d-621c-4941-a926-399d6c18591d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:00.591578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce59ce0d-621c-4941-a926-399d6c18591d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:00.593603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce59ce0d-621c-4941-a926-399d6c18591d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:00.594045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce59ce0d-621c-4941-a926-399d6c18591d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:00.665901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ce59ce0d-621c-4941-a926-399d6c18591d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:37:00.912876 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ce59ce0d-621c-4941-a926-399d6c18591d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 204 len: 0 microversion: 2.20 time: 0.346362 Oct 18 13:37:00.918078 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2126/4548] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:37:00 2022] DELETE /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:37:00.932486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a5485074-6210-446a-91c6-6dc2ddcc7f27 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:00.933874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a5485074-6210-446a-91c6-6dc2ddcc7f27 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:00.943053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5485074-6210-446a-91c6-6dc2ddcc7f27 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:00.943715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5485074-6210-446a-91c6-6dc2ddcc7f27 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:00.944267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5485074-6210-446a-91c6-6dc2ddcc7f27 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:00.945366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5485074-6210-446a-91c6-6dc2ddcc7f27 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:00.945989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5485074-6210-446a-91c6-6dc2ddcc7f27 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:00.946572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5485074-6210-446a-91c6-6dc2ddcc7f27 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:01.041591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-00948d6c-6400-47e1-9e6f-21bff2ca8937 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:01.051559 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-00948d6c-6400-47e1-9e6f-21bff2ca8937 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.794345 Oct 18 13:37:01.052160 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2423/4549] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:00 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:01.080301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8b50fd5-f3d3-46cb-8e69-f8c755de844d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8b50fd5-f3d3-46cb-8e69-f8c755de844d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: request: PUT /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 HTTP/1.1 Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 280 Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '6bce6f6b-df28-4c34-a17f-4f18eb67d401', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:01.087188 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 13:37:01.091923 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:01.098099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8b50fd5-f3d3-46cb-8e69-f8c755de844d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:01.106378 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8b50fd5-f3d3-46cb-8e69-f8c755de844d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "PUT /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 400 len: 619 microversion: 2.1 time: 0.030605 Oct 18 13:37:01.108265 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2424/4550] 10.222.0.40 () {60 vars in 1257 bytes} [Tue Oct 18 13:37:01 2022] PUT /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 619 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:37:01.121934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6713f5b3-a0e6-4813-abf1-a52f384a62cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:01.124944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6713f5b3-a0e6-4813-abf1-a52f384a62cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:01.159987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6713f5b3-a0e6-4813-abf1-a52f384a62cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:01.164602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6713f5b3-a0e6-4813-abf1-a52f384a62cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:01.165841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6713f5b3-a0e6-4813-abf1-a52f384a62cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:01.166791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6713f5b3-a0e6-4813-abf1-a52f384a62cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:01.169969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6713f5b3-a0e6-4813-abf1-a52f384a62cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:01.171129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6713f5b3-a0e6-4813-abf1-a52f384a62cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:01.760165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6713f5b3-a0e6-4813-abf1-a52f384a62cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:01.770926 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6713f5b3-a0e6-4813-abf1-a52f384a62cb tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.658107 Oct 18 13:37:01.772670 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2425/4551] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:01 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:01.792950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-526f89c1-933c-4fc9-98b7-7b17a43682cb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:01.793699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-526f89c1-933c-4fc9-98b7-7b17a43682cb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:01.808945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-526f89c1-933c-4fc9-98b7-7b17a43682cb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:01.809482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-526f89c1-933c-4fc9-98b7-7b17a43682cb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:01.810906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-526f89c1-933c-4fc9-98b7-7b17a43682cb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:01.812037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-526f89c1-933c-4fc9-98b7-7b17a43682cb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:01.814373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-526f89c1-933c-4fc9-98b7-7b17a43682cb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:01.815357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-526f89c1-933c-4fc9-98b7-7b17a43682cb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:01.946586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a5485074-6210-446a-91c6-6dc2ddcc7f27 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:01.958495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a5485074-6210-446a-91c6-6dc2ddcc7f27 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:01.960332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a5485074-6210-446a-91c6-6dc2ddcc7f27 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:01.961870 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a5485074-6210-446a-91c6-6dc2ddcc7f27 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1724 microversion: 2.20 time: 1.041272 Oct 18 13:37:01.974540 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2127/4552] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:00 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1724 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:02.011123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2ca8a004-b3f1-47be-b232-13856b1fbd12 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:02.015253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2ca8a004-b3f1-47be-b232-13856b1fbd12 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:02.027492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ca8a004-b3f1-47be-b232-13856b1fbd12 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.028326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ca8a004-b3f1-47be-b232-13856b1fbd12 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.029004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ca8a004-b3f1-47be-b232-13856b1fbd12 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.030705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ca8a004-b3f1-47be-b232-13856b1fbd12 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.036857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ca8a004-b3f1-47be-b232-13856b1fbd12 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.037660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ca8a004-b3f1-47be-b232-13856b1fbd12 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.133891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-526f89c1-933c-4fc9-98b7-7b17a43682cb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:02.142759 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-526f89c1-933c-4fc9-98b7-7b17a43682cb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1320 microversion: 2.1 time: 0.368606 Oct 18 13:37:02.144293 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2426/4553] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:01 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1320 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:02.149224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9abc0d51-e97c-4d32-a5e5-a60923aa2a6f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ebe7040>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:02.214595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2ca8a004-b3f1-47be-b232-13856b1fbd12 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:02.224577 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2ca8a004-b3f1-47be-b232-13856b1fbd12 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1322 microversion: 2.1 time: 0.237342 Oct 18 13:37:02.227481 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9abc0d51-e97c-4d32-a5e5-a60923aa2a6f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.081902 Oct 18 13:37:02.229254 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2427/4554] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:02 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:02.235422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7807be3c-a9dd-48a2-9023-ad695979c183 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:02.236347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7807be3c-a9dd-48a2-9023-ad695979c183 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:02.241278 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2128/4555] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:01 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:02.246374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7807be3c-a9dd-48a2-9023-ad695979c183 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.246979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7807be3c-a9dd-48a2-9023-ad695979c183 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.247420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7807be3c-a9dd-48a2-9023-ad695979c183 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.248227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ba30b237-dd30-4915-ae02-05190258b3b8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:02.248753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7807be3c-a9dd-48a2-9023-ad695979c183 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.249035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ba30b237-dd30-4915-ae02-05190258b3b8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:02.250060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7807be3c-a9dd-48a2-9023-ad695979c183 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.250711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7807be3c-a9dd-48a2-9023-ad695979c183 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.257076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba30b237-dd30-4915-ae02-05190258b3b8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.258362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba30b237-dd30-4915-ae02-05190258b3b8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.258934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba30b237-dd30-4915-ae02-05190258b3b8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.260495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba30b237-dd30-4915-ae02-05190258b3b8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.261087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba30b237-dd30-4915-ae02-05190258b3b8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.261624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba30b237-dd30-4915-ae02-05190258b3b8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.281534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:02.427636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7807be3c-a9dd-48a2-9023-ad695979c183 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:02.438106 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7807be3c-a9dd-48a2-9023-ad695979c183 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1359 microversion: 2.1 time: 0.207379 Oct 18 13:37:02.439040 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2428/4556] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:02 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:02.463639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ba30b237-dd30-4915-ae02-05190258b3b8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:02.482517 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ba30b237-dd30-4915-ae02-05190258b3b8 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.239731 Oct 18 13:37:02.491978 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2129/4557] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:02 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:02.517542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-152c8461-cc25-46f9-aab7-a7fe1f4b367a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-152c8461-cc25-46f9-aab7-a7fe1f4b367a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: request: PUT /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 HTTP/1.1 Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 24 Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: {"server": {"name": ""}} Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '6bce6f6b-df28-4c34-a17f-4f18eb67d401', 'body': {'server': {'name': ''}}} Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi '' Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:37:02.521693 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:37:02.526572 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.526572 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:02.526572 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.526572 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:02.526572 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:02.526572 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:02.526572 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:37:02.526572 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:37:02.526572 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 18 13:37:02.526572 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:02.526572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-152c8461-cc25-46f9-aab7-a7fe1f4b367a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:02.526572 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-152c8461-cc25-46f9-aab7-a7fe1f4b367a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "PUT /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 400 len: 108 microversion: 2.1 time: 0.016302 Oct 18 13:37:02.527866 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2130/4558] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 18 13:37:02 2022] PUT /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:37:02.531226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-06682c0e-7653-4122-ac15-da53e24edc02 req-1e1401c3-65e5-4cb4-a4c8-844e79ed5b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fe15a4-7bd7-40e0-860a-e0769bf38456", "name": "network-vif-plugged", "status": "completed", "tag": "4c03f362-7416-4c8f-8537-5657edf6a795"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:02.531626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cc941b60-d99c-41e1-ae2e-74f8b8064f1d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:02.532241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cc941b60-d99c-41e1-ae2e-74f8b8064f1d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:02.541675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc941b60-d99c-41e1-ae2e-74f8b8064f1d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.542165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc941b60-d99c-41e1-ae2e-74f8b8064f1d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.542605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc941b60-d99c-41e1-ae2e-74f8b8064f1d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.543348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc941b60-d99c-41e1-ae2e-74f8b8064f1d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.543755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc941b60-d99c-41e1-ae2e-74f8b8064f1d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.544098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-06682c0e-7653-4122-ac15-da53e24edc02 req-1e1401c3-65e5-4cb4-a4c8-844e79ed5b71 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:02.544183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc941b60-d99c-41e1-ae2e-74f8b8064f1d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.544486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-06682c0e-7653-4122-ac15-da53e24edc02 req-1e1401c3-65e5-4cb4-a4c8-844e79ed5b71 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:02.544936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-06682c0e-7653-4122-ac15-da53e24edc02 req-1e1401c3-65e5-4cb4-a4c8-844e79ed5b71 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:02.562347 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-06682c0e-7653-4122-ac15-da53e24edc02 req-1e1401c3-65e5-4cb4-a4c8-844e79ed5b71 service nova] Creating event network-vif-plugged:4c03f362-7416-4c8f-8537-5657edf6a795 for instance b9fe15a4-7bd7-40e0-860a-e0769bf38456 on n-h1-858384-13 Oct 18 13:37:02.568419 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-06682c0e-7653-4122-ac15-da53e24edc02 req-1e1401c3-65e5-4cb4-a4c8-844e79ed5b71 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128188 Oct 18 13:37:02.573667 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2429/4559] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:02.688044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cc941b60-d99c-41e1-ae2e-74f8b8064f1d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:02.696027 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cc941b60-d99c-41e1-ae2e-74f8b8064f1d tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1506 microversion: 2.1 time: 0.167933 Oct 18 13:37:02.703949 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2131/4560] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:02 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:02.991899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-40aeadff-95e5-48a4-9b26-41a47d916d45 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:02.992513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-40aeadff-95e5-48a4-9b26-41a47d916d45 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:03.007542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40aeadff-95e5-48a4-9b26-41a47d916d45 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:03.008043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40aeadff-95e5-48a4-9b26-41a47d916d45 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:03.008487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40aeadff-95e5-48a4-9b26-41a47d916d45 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:03.009281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40aeadff-95e5-48a4-9b26-41a47d916d45 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:03.009818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40aeadff-95e5-48a4-9b26-41a47d916d45 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:03.010279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40aeadff-95e5-48a4-9b26-41a47d916d45 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:03.168224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1507bce9-9b44-470e-bcb2-23b84dc12f21 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:03.168964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1507bce9-9b44-470e-bcb2-23b84dc12f21 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:03.180085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1507bce9-9b44-470e-bcb2-23b84dc12f21 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:03.180654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1507bce9-9b44-470e-bcb2-23b84dc12f21 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:03.181926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1507bce9-9b44-470e-bcb2-23b84dc12f21 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:03.182847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1507bce9-9b44-470e-bcb2-23b84dc12f21 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:03.183385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1507bce9-9b44-470e-bcb2-23b84dc12f21 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:03.183874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1507bce9-9b44-470e-bcb2-23b84dc12f21 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:03.231382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-40aeadff-95e5-48a4-9b26-41a47d916d45 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:03.248382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-40aeadff-95e5-48a4-9b26-41a47d916d45 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:03.252426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-40aeadff-95e5-48a4-9b26-41a47d916d45 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:03.254030 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-40aeadff-95e5-48a4-9b26-41a47d916d45 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1724 microversion: 2.20 time: 0.266543 Oct 18 13:37:03.270533 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2430/4561] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:02 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:03.279354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-19cefd58-17e1-45c7-8ad7-0cc199798348 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f7ad3a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:03.330061 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-19cefd58-17e1-45c7-8ad7-0cc199798348 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.058170 Oct 18 13:37:03.331087 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2431/4562] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:03 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:03.344826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-11273e44-9f8e-46ff-941e-77cc3f8b4fed tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:03.345883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-11273e44-9f8e-46ff-941e-77cc3f8b4fed tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:03.352397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11273e44-9f8e-46ff-941e-77cc3f8b4fed tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:03.353737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11273e44-9f8e-46ff-941e-77cc3f8b4fed tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:03.354407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11273e44-9f8e-46ff-941e-77cc3f8b4fed tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:03.355292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11273e44-9f8e-46ff-941e-77cc3f8b4fed tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:03.355913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11273e44-9f8e-46ff-941e-77cc3f8b4fed tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:03.356523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11273e44-9f8e-46ff-941e-77cc3f8b4fed tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:03.372163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1507bce9-9b44-470e-bcb2-23b84dc12f21 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:03.385782 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1507bce9-9b44-470e-bcb2-23b84dc12f21 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1320 microversion: 2.1 time: 0.221208 Oct 18 13:37:03.386465 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2132/4563] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:03 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1320 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:03.465308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-90198f3b-8dd7-4def-8fa8-1c096d9b4290 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:03.474799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-90198f3b-8dd7-4def-8fa8-1c096d9b4290 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:03.481995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90198f3b-8dd7-4def-8fa8-1c096d9b4290 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:03.482488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90198f3b-8dd7-4def-8fa8-1c096d9b4290 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:03.482931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90198f3b-8dd7-4def-8fa8-1c096d9b4290 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:03.483648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90198f3b-8dd7-4def-8fa8-1c096d9b4290 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:03.484099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90198f3b-8dd7-4def-8fa8-1c096d9b4290 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:03.484944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90198f3b-8dd7-4def-8fa8-1c096d9b4290 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:03.725413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-11273e44-9f8e-46ff-941e-77cc3f8b4fed tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:03.735877 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-11273e44-9f8e-46ff-941e-77cc3f8b4fed tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1322 microversion: 2.1 time: 0.395074 Oct 18 13:37:03.738648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-90198f3b-8dd7-4def-8fa8-1c096d9b4290 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:03.754434 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-90198f3b-8dd7-4def-8fa8-1c096d9b4290 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1427 microversion: 2.1 time: 0.294551 Oct 18 13:37:03.756084 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2432/4564] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:03 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:03.756967 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2133/4565] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:03 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1427 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:03.839341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1197586914", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "a87aaa45-a911-4610-9877-a092fd0648b4"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:03.895259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] validate_networks() for [('a87aaa45-a911-4610-9877-a092fd0648b4', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:37:04.288106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22fdadd1-8c44-473a-9324-2c93dd6d3f77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:04.288964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-22fdadd1-8c44-473a-9324-2c93dd6d3f77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:04.308145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22fdadd1-8c44-473a-9324-2c93dd6d3f77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:04.309490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22fdadd1-8c44-473a-9324-2c93dd6d3f77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:04.310136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22fdadd1-8c44-473a-9324-2c93dd6d3f77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:04.312561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22fdadd1-8c44-473a-9324-2c93dd6d3f77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:04.313347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22fdadd1-8c44-473a-9324-2c93dd6d3f77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:04.314092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22fdadd1-8c44-473a-9324-2c93dd6d3f77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:04.518676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-22fdadd1-8c44-473a-9324-2c93dd6d3f77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:04.536650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-22fdadd1-8c44-473a-9324-2c93dd6d3f77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:04.538596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-22fdadd1-8c44-473a-9324-2c93dd6d3f77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:04.542405 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-22fdadd1-8c44-473a-9324-2c93dd6d3f77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1724 microversion: 2.20 time: 0.259640 Oct 18 13:37:04.543702 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2134/4566] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:04 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:37:04.551939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3bc86171-9a00-4bd2-ac3b-ac91c4c4f34e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617b5c5e0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:04.610844 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3bc86171-9a00-4bd2-ac3b-ac91c4c4f34e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.065747 Oct 18 13:37:04.620780 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2135/4567] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:04 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:04.620780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6227f683-11bf-4ba0-8398-59aa1f4d665c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:04.620780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6227f683-11bf-4ba0-8398-59aa1f4d665c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:04.631327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6227f683-11bf-4ba0-8398-59aa1f4d665c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:04.632524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6227f683-11bf-4ba0-8398-59aa1f4d665c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:04.633729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6227f683-11bf-4ba0-8398-59aa1f4d665c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:04.635438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6227f683-11bf-4ba0-8398-59aa1f4d665c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:04.637006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6227f683-11bf-4ba0-8398-59aa1f4d665c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:04.637808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6227f683-11bf-4ba0-8398-59aa1f4d665c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:04.641782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:04.841908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6227f683-11bf-4ba0-8398-59aa1f4d665c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:04.851600 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6227f683-11bf-4ba0-8398-59aa1f4d665c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1320 microversion: 2.1 time: 0.238297 Oct 18 13:37:04.869267 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2136/4568] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:04 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1320 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:04.876964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-39920ced-59bc-40c1-b5ed-f62a6c8b3a66 req-ce2efeef-354d-4daa-b4d0-3b37c7ca184a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f701eed8-faed-494f-987c-cbdd93ed5504", "name": "network-vif-plugged", "status": "completed", "tag": "7c235f2d-d376-49ee-ac72-2233d159633e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:04.888803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-39920ced-59bc-40c1-b5ed-f62a6c8b3a66 req-ce2efeef-354d-4daa-b4d0-3b37c7ca184a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:04.890193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-39920ced-59bc-40c1-b5ed-f62a6c8b3a66 req-ce2efeef-354d-4daa-b4d0-3b37c7ca184a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:04.890632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-39920ced-59bc-40c1-b5ed-f62a6c8b3a66 req-ce2efeef-354d-4daa-b4d0-3b37c7ca184a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:04.909478 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-39920ced-59bc-40c1-b5ed-f62a6c8b3a66 req-ce2efeef-354d-4daa-b4d0-3b37c7ca184a service nova] Creating event network-vif-plugged:7c235f2d-d376-49ee-ac72-2233d159633e for instance f701eed8-faed-494f-987c-cbdd93ed5504 on n-h2-858384-13 Oct 18 13:37:04.919403 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-39920ced-59bc-40c1-b5ed-f62a6c8b3a66 req-ce2efeef-354d-4daa-b4d0-3b37c7ca184a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051220 Oct 18 13:37:04.920510 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2137/4569] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:04.929305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7d93d5bd-853d-4574-b837-2dce546052e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:04.930457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7d93d5bd-853d-4574-b837-2dce546052e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:04.939378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d93d5bd-853d-4574-b837-2dce546052e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:04.940281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d93d5bd-853d-4574-b837-2dce546052e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:04.940881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d93d5bd-853d-4574-b837-2dce546052e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:04.956665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d93d5bd-853d-4574-b837-2dce546052e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:04.961601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d93d5bd-853d-4574-b837-2dce546052e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:04.963943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d93d5bd-853d-4574-b837-2dce546052e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:05.355252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7d93d5bd-853d-4574-b837-2dce546052e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:05.363938 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7d93d5bd-853d-4574-b837-2dce546052e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1322 microversion: 2.1 time: 0.440860 Oct 18 13:37:05.381215 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2138/4570] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:04 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:05.381215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d95ee309-04c7-4062-b5f4-7fb8df9afec5 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:05.381215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d95ee309-04c7-4062-b5f4-7fb8df9afec5 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:05.390511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:37:05.391262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:37:05.392080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:37:05.392505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:37:05.392927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:37:05.398070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d95ee309-04c7-4062-b5f4-7fb8df9afec5 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:05.398921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d95ee309-04c7-4062-b5f4-7fb8df9afec5 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:05.399462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d95ee309-04c7-4062-b5f4-7fb8df9afec5 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:05.400843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d95ee309-04c7-4062-b5f4-7fb8df9afec5 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:05.401448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d95ee309-04c7-4062-b5f4-7fb8df9afec5 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:05.401975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d95ee309-04c7-4062-b5f4-7fb8df9afec5 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:05.416178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:05.416784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:05.417249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:05.424747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:05.429486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:05.430024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:05.508765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Getting quotas for project ca964e337ec4473b980f9e0ea74a19ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:37:05.529649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Getting quotas for user 05ccf811bbad40ff9af7fe83173be66d and project ca964e337ec4473b980f9e0ea74a19ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:37:05.579686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:37:05.591015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:37:05.714050 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a253e979-c290-41ce-8df0-a08c573c1283 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.956556 Oct 18 13:37:05.715126 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2433/4571] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:37:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:37:05.719746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6ab59a8c-b291-485c-bb44-75a5f53caf79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:05.724421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6ab59a8c-b291-485c-bb44-75a5f53caf79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:05.743997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ab59a8c-b291-485c-bb44-75a5f53caf79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:05.744512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ab59a8c-b291-485c-bb44-75a5f53caf79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:05.744949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ab59a8c-b291-485c-bb44-75a5f53caf79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:05.745690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ab59a8c-b291-485c-bb44-75a5f53caf79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:05.746144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ab59a8c-b291-485c-bb44-75a5f53caf79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:05.746570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ab59a8c-b291-485c-bb44-75a5f53caf79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:05.838049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d95ee309-04c7-4062-b5f4-7fb8df9afec5 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:05.852085 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d95ee309-04c7-4062-b5f4-7fb8df9afec5 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1427 microversion: 2.1 time: 0.477847 Oct 18 13:37:05.853616 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2139/4572] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:05 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1427 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:05.863818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6d8f80bb-6c49-4833-8828-288882136aeb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617a5b0d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:05.945346 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6d8f80bb-6c49-4833-8828-288882136aeb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.090220 Oct 18 13:37:05.945945 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2140/4573] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:05 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:05.955637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5f763a13-083a-4fbe-8f96-9c95962baf55 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:05.956267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5f763a13-083a-4fbe-8f96-9c95962baf55 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:06.059144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5f763a13-083a-4fbe-8f96-9c95962baf55 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:06.072791 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5f763a13-083a-4fbe-8f96-9c95962baf55 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1217 microversion: 2.1 time: 0.125770 Oct 18 13:37:06.080718 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2141/4574] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:05 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1217 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:06.114070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9f344cec-ddc7-44ae-bf70-a782711c15f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:06.114686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9f344cec-ddc7-44ae-bf70-a782711c15f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:06.135721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f344cec-ddc7-44ae-bf70-a782711c15f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:06.136200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f344cec-ddc7-44ae-bf70-a782711c15f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:06.136645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f344cec-ddc7-44ae-bf70-a782711c15f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:06.147328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f344cec-ddc7-44ae-bf70-a782711c15f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:06.147931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f344cec-ddc7-44ae-bf70-a782711c15f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:06.148389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f344cec-ddc7-44ae-bf70-a782711c15f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:06.600169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9f344cec-ddc7-44ae-bf70-a782711c15f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:06.609857 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9f344cec-ddc7-44ae-bf70-a782711c15f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1320 microversion: 2.1 time: 0.512394 Oct 18 13:37:06.625526 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2142/4575] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:06 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1320 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:06.630331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e1115458-e21a-4be8-92c1-dcf42653aacb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:06.630940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e1115458-e21a-4be8-92c1-dcf42653aacb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:06.656161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1115458-e21a-4be8-92c1-dcf42653aacb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:06.656845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1115458-e21a-4be8-92c1-dcf42653aacb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:06.657522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1115458-e21a-4be8-92c1-dcf42653aacb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:06.660891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1115458-e21a-4be8-92c1-dcf42653aacb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:06.661586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1115458-e21a-4be8-92c1-dcf42653aacb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:06.662211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e1115458-e21a-4be8-92c1-dcf42653aacb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:06.666273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ab59a8c-b291-485c-bb44-75a5f53caf79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:06.679013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ab59a8c-b291-485c-bb44-75a5f53caf79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:06.680563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ab59a8c-b291-485c-bb44-75a5f53caf79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:06.682126 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6ab59a8c-b291-485c-bb44-75a5f53caf79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1724 microversion: 2.20 time: 0.965891 Oct 18 13:37:06.682786 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2434/4576] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:05 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1724 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:06.882419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2ae73b07-6ce5-4a8f-a64b-af77da633c8e tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:06.883479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2ae73b07-6ce5-4a8f-a64b-af77da633c8e tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:06.904099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ae73b07-6ce5-4a8f-a64b-af77da633c8e tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:06.908552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ae73b07-6ce5-4a8f-a64b-af77da633c8e tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:06.910546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ae73b07-6ce5-4a8f-a64b-af77da633c8e tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:06.915953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ae73b07-6ce5-4a8f-a64b-af77da633c8e tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:06.918421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ae73b07-6ce5-4a8f-a64b-af77da633c8e tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:06.924193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ae73b07-6ce5-4a8f-a64b-af77da633c8e tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:07.151197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e1115458-e21a-4be8-92c1-dcf42653aacb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:07.170634 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e1115458-e21a-4be8-92c1-dcf42653aacb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1322 microversion: 2.1 time: 0.543874 Oct 18 13:37:07.179151 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2143/4577] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:06 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:07.209003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8cb41949-b5ef-4cc7-930c-c04793fe0b66 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f022e50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:07.320213 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8cb41949-b5ef-4cc7-930c-c04793fe0b66 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.139869 Oct 18 13:37:07.323105 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2144/4578] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:07 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:07.332771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7b919693-c1ba-4b74-b0be-74b07bbcb188 req-599c95e1-5509-4417-ad68-73dd57807728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84248cd-c35f-4af0-b55d-25e8f9055c3b", "name": "network-vif-plugged", "status": "completed", "tag": "329f87db-5c9f-4b3a-a50e-757cdb071740"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:07.368463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7b919693-c1ba-4b74-b0be-74b07bbcb188 req-599c95e1-5509-4417-ad68-73dd57807728 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:07.369966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7b919693-c1ba-4b74-b0be-74b07bbcb188 req-599c95e1-5509-4417-ad68-73dd57807728 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:07.373526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7b919693-c1ba-4b74-b0be-74b07bbcb188 req-599c95e1-5509-4417-ad68-73dd57807728 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:07.413119 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7b919693-c1ba-4b74-b0be-74b07bbcb188 req-599c95e1-5509-4417-ad68-73dd57807728 service nova] Creating event network-vif-plugged:329f87db-5c9f-4b3a-a50e-757cdb071740 for instance d84248cd-c35f-4af0-b55d-25e8f9055c3b on n-h1-858384-13 Oct 18 13:37:07.425991 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7b919693-c1ba-4b74-b0be-74b07bbcb188 req-599c95e1-5509-4417-ad68-73dd57807728 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098706 Oct 18 13:37:07.426871 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2145/4579] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:07.449276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ca86846c-e31a-458f-b7c5-42a3548dc665 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:07.450306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ca86846c-e31a-458f-b7c5-42a3548dc665 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:07.485711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca86846c-e31a-458f-b7c5-42a3548dc665 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:07.495222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca86846c-e31a-458f-b7c5-42a3548dc665 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:07.497762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca86846c-e31a-458f-b7c5-42a3548dc665 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:07.501656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca86846c-e31a-458f-b7c5-42a3548dc665 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:07.502332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca86846c-e31a-458f-b7c5-42a3548dc665 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:07.504517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca86846c-e31a-458f-b7c5-42a3548dc665 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:07.631193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2ae73b07-6ce5-4a8f-a64b-af77da633c8e tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:07.650146 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2ae73b07-6ce5-4a8f-a64b-af77da633c8e tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1427 microversion: 2.1 time: 0.771530 Oct 18 13:37:07.652376 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2435/4580] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:06 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1427 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:07.666980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ca86846c-e31a-458f-b7c5-42a3548dc665 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:07.676963 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ca86846c-e31a-458f-b7c5-42a3548dc665 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1269 microversion: 2.1 time: 0.248726 Oct 18 13:37:07.678224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c2f82466-d134-45ba-bd27-297f74b2d207 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:07.679207 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2146/4581] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:07 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1269 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:07.682467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c2f82466-d134-45ba-bd27-297f74b2d207 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:07.708215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2f82466-d134-45ba-bd27-297f74b2d207 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:07.713927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-074e5876-73be-4d18-bd9c-8c1c05915ca5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:07.714699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2f82466-d134-45ba-bd27-297f74b2d207 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:07.715668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-074e5876-73be-4d18-bd9c-8c1c05915ca5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:07.716997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2f82466-d134-45ba-bd27-297f74b2d207 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:07.717982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2f82466-d134-45ba-bd27-297f74b2d207 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:07.718710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2f82466-d134-45ba-bd27-297f74b2d207 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:07.720329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2f82466-d134-45ba-bd27-297f74b2d207 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:07.726944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-074e5876-73be-4d18-bd9c-8c1c05915ca5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:07.731642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-074e5876-73be-4d18-bd9c-8c1c05915ca5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:07.735149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-074e5876-73be-4d18-bd9c-8c1c05915ca5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:07.737736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-074e5876-73be-4d18-bd9c-8c1c05915ca5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:07.738391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-074e5876-73be-4d18-bd9c-8c1c05915ca5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:07.740308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-074e5876-73be-4d18-bd9c-8c1c05915ca5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:07.960871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-074e5876-73be-4d18-bd9c-8c1c05915ca5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:07.984196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-074e5876-73be-4d18-bd9c-8c1c05915ca5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:07.990298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-074e5876-73be-4d18-bd9c-8c1c05915ca5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:07.999007 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-074e5876-73be-4d18-bd9c-8c1c05915ca5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1656 microversion: 2.20 time: 0.288867 Oct 18 13:37:08.002503 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2147/4582] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:07 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1656 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:08.195167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b8c8a867-9bbd-4a15-9a73-6d1bdae066b6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:08.195782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b8c8a867-9bbd-4a15-9a73-6d1bdae066b6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:08.206153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8c8a867-9bbd-4a15-9a73-6d1bdae066b6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:08.210365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8c8a867-9bbd-4a15-9a73-6d1bdae066b6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:08.213428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8c8a867-9bbd-4a15-9a73-6d1bdae066b6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:08.217990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8c8a867-9bbd-4a15-9a73-6d1bdae066b6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:08.218486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8c8a867-9bbd-4a15-9a73-6d1bdae066b6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:08.218957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8c8a867-9bbd-4a15-9a73-6d1bdae066b6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:08.796159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b8c8a867-9bbd-4a15-9a73-6d1bdae066b6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:08.812289 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b8c8a867-9bbd-4a15-9a73-6d1bdae066b6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1516 microversion: 2.1 time: 0.620777 Oct 18 13:37:08.813497 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2148/4583] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:08 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1516 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:08.818561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-3ae855b9-28ea-48d6-9ca5-a6cdec3ea626 req-5dc762dd-429e-47d2-986b-2ae3473d71e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "768feeae-e6f3-4013-a7a9-e69e0bd15a58", "tag": "b3076d90-5db4-402d-9177-41b1a6988b3b"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:08.830463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3ae855b9-28ea-48d6-9ca5-a6cdec3ea626 req-5dc762dd-429e-47d2-986b-2ae3473d71e5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:08.831814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3ae855b9-28ea-48d6-9ca5-a6cdec3ea626 req-5dc762dd-429e-47d2-986b-2ae3473d71e5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:08.832468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3ae855b9-28ea-48d6-9ca5-a6cdec3ea626 req-5dc762dd-429e-47d2-986b-2ae3473d71e5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:08.847446 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-3ae855b9-28ea-48d6-9ca5-a6cdec3ea626 req-5dc762dd-429e-47d2-986b-2ae3473d71e5 service nova] Creating event network-changed:b3076d90-5db4-402d-9177-41b1a6988b3b for instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 on n-h2-858384-13 Oct 18 13:37:08.856912 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-3ae855b9-28ea-48d6-9ca5-a6cdec3ea626 req-5dc762dd-429e-47d2-986b-2ae3473d71e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041392 Oct 18 13:37:08.859259 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2149/4584] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:08.866890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a37317e7-9745-4499-a210-e1bcb972c09f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617a5bca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:08.913789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c2f82466-d134-45ba-bd27-297f74b2d207 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:08.941626 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c2f82466-d134-45ba-bd27-297f74b2d207 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1320 microversion: 2.1 time: 1.286977 Oct 18 13:37:08.943879 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2436/4585] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:07 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1320 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:08.954464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5dd892b3-d816-42d7-8cca-c65f7668c404 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:08.958148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5dd892b3-d816-42d7-8cca-c65f7668c404 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:08.985451 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a37317e7-9745-4499-a210-e1bcb972c09f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.121107 Oct 18 13:37:08.990951 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2150/4586] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:08 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:08.995147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5dd892b3-d816-42d7-8cca-c65f7668c404 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:08.999790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5dd892b3-d816-42d7-8cca-c65f7668c404 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.000263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5dd892b3-d816-42d7-8cca-c65f7668c404 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.001013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5dd892b3-d816-42d7-8cca-c65f7668c404 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:09.006912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5dd892b3-d816-42d7-8cca-c65f7668c404 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.008188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d5003037-ef0c-4e98-9394-da4b1c18028a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:09.008911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5dd892b3-d816-42d7-8cca-c65f7668c404 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.011574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d5003037-ef0c-4e98-9394-da4b1c18028a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:09.039344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5003037-ef0c-4e98-9394-da4b1c18028a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:09.045430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5003037-ef0c-4e98-9394-da4b1c18028a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.049837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5003037-ef0c-4e98-9394-da4b1c18028a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.050605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5003037-ef0c-4e98-9394-da4b1c18028a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:09.051362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5003037-ef0c-4e98-9394-da4b1c18028a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.057558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5003037-ef0c-4e98-9394-da4b1c18028a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.191432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:09.316300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d5003037-ef0c-4e98-9394-da4b1c18028a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:09.326148 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d5003037-ef0c-4e98-9394-da4b1c18028a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1275 microversion: 2.1 time: 0.333808 Oct 18 13:37:09.340058 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2151/4587] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:08 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1275 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:09.370009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a54fc1eb-41c4-41c8-b070-7827031f479f req-10b53689-7508-4322-a895-5de42867f015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa292c2-3801-4d84-b31a-4d3eeeb41818", "name": "network-vif-deleted", "tag": "8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:09.424988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a54fc1eb-41c4-41c8-b070-7827031f479f req-10b53689-7508-4322-a895-5de42867f015 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:09.425220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a54fc1eb-41c4-41c8-b070-7827031f479f req-10b53689-7508-4322-a895-5de42867f015 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.425685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a54fc1eb-41c4-41c8-b070-7827031f479f req-10b53689-7508-4322-a895-5de42867f015 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.442520 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a54fc1eb-41c4-41c8-b070-7827031f479f req-10b53689-7508-4322-a895-5de42867f015 service nova] Creating event network-vif-deleted:8e6d46f1-e9c3-457a-9a0b-d1acc4fae3aa for instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 on n-h1-858384-13 Oct 18 13:37:09.452714 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a54fc1eb-41c4-41c8-b070-7827031f479f req-10b53689-7508-4322-a895-5de42867f015 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111300 Oct 18 13:37:09.454267 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2152/4588] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:09.461883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-12f75f4d-cb8a-4bb9-857e-45e30b111891 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:09.466174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-12f75f4d-cb8a-4bb9-857e-45e30b111891 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:09.478378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:09.482736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12f75f4d-cb8a-4bb9-857e-45e30b111891 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:09.483242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12f75f4d-cb8a-4bb9-857e-45e30b111891 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.483903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12f75f4d-cb8a-4bb9-857e-45e30b111891 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.486032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12f75f4d-cb8a-4bb9-857e-45e30b111891 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:09.486499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12f75f4d-cb8a-4bb9-857e-45e30b111891 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.486973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12f75f4d-cb8a-4bb9-857e-45e30b111891 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.558361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-12f75f4d-cb8a-4bb9-857e-45e30b111891 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lazy-loading 'flavor' on Instance uuid f701eed8-faed-494f-987c-cbdd93ed5504 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:09.748573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5dd892b3-d816-42d7-8cca-c65f7668c404 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:09.762241 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5dd892b3-d816-42d7-8cca-c65f7668c404 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1427 microversion: 2.1 time: 0.814800 Oct 18 13:37:09.774847 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-12f75f4d-cb8a-4bb9-857e-45e30b111891 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504/action" status: 200 len: 32 microversion: 2.1 time: 0.306453 Oct 18 13:37:09.778065 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2437/4589] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:08 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1427 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:09.781413 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2153/4590] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:37:09 2022] POST /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504/action => generated 32 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:37:09.810445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:09.817085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-4a2268a8-2b7e-4f29-bb0b-4c00d4c3d243 req-3d2ab643-ab3d-46fb-9cdd-83f816753a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568613ab-c15f-4a59-aa10-8e40b871f918", "name": "network-vif-plugged", "status": "completed", "tag": "88d9e0f1-76bd-495a-a2d4-62d8d2828b64"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:09.819200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:09.840388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:09.850213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.854138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.860553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:09.861357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.863821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.870428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4a2268a8-2b7e-4f29-bb0b-4c00d4c3d243 req-3d2ab643-ab3d-46fb-9cdd-83f816753a8a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:09.883140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4a2268a8-2b7e-4f29-bb0b-4c00d4c3d243 req-3d2ab643-ab3d-46fb-9cdd-83f816753a8a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:09.883807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4a2268a8-2b7e-4f29-bb0b-4c00d4c3d243 req-3d2ab643-ab3d-46fb-9cdd-83f816753a8a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:09.947422 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4a2268a8-2b7e-4f29-bb0b-4c00d4c3d243 req-3d2ab643-ab3d-46fb-9cdd-83f816753a8a service nova] Creating event network-vif-plugged:88d9e0f1-76bd-495a-a2d4-62d8d2828b64 for instance 568613ab-c15f-4a59-aa10-8e40b871f918 on n-h1-858384-13 Oct 18 13:37:09.971027 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-4a2268a8-2b7e-4f29-bb0b-4c00d4c3d243 req-3d2ab643-ab3d-46fb-9cdd-83f816753a8a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183023 Oct 18 13:37:09.982508 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2154/4591] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:10.017324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-98a6aa9d-30f3-4fc7-9f81-9f04790d6e6a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:10.020400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-98a6aa9d-30f3-4fc7-9f81-9f04790d6e6a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:10.043753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98a6aa9d-30f3-4fc7-9f81-9f04790d6e6a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.044248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98a6aa9d-30f3-4fc7-9f81-9f04790d6e6a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.044796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98a6aa9d-30f3-4fc7-9f81-9f04790d6e6a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:10.045917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98a6aa9d-30f3-4fc7-9f81-9f04790d6e6a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.046324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98a6aa9d-30f3-4fc7-9f81-9f04790d6e6a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.046788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98a6aa9d-30f3-4fc7-9f81-9f04790d6e6a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:10.130180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.131912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.148245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:10.150436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lazy-loading 'fault' on Instance uuid 5fa292c2-3801-4d84-b31a-4d3eeeb41818 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:10.325990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:10.341613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:10.344145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:10.350296 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2d0ffbca-2855-407a-9a09-e376aa2c3899 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 200 len: 1371 microversion: 2.20 time: 0.570663 Oct 18 13:37:10.351120 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2438/4592] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:09 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 1371 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:10.356682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e82fa031-78a9-4372-aca8-79de45de73f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:10.364167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e82fa031-78a9-4372-aca8-79de45de73f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:10.376057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e82fa031-78a9-4372-aca8-79de45de73f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.380070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e82fa031-78a9-4372-aca8-79de45de73f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.380704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e82fa031-78a9-4372-aca8-79de45de73f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:10.383022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e82fa031-78a9-4372-aca8-79de45de73f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.383647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e82fa031-78a9-4372-aca8-79de45de73f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.384289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e82fa031-78a9-4372-aca8-79de45de73f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:10.394805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-98a6aa9d-30f3-4fc7-9f81-9f04790d6e6a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:10.405803 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-98a6aa9d-30f3-4fc7-9f81-9f04790d6e6a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.417107 Oct 18 13:37:10.406397 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2155/4593] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:09 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:10.425872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b2ef36d8-7676-4091-88bc-8c96ab2bb9a4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ea31820>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:10.497037 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b2ef36d8-7676-4091-88bc-8c96ab2bb9a4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.089571 Oct 18 13:37:10.498043 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2156/4594] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:10 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:10.504930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-29a415f3-c985-4cf2-a922-ec1681908c5a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:10.505786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-29a415f3-c985-4cf2-a922-ec1681908c5a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:10.514829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29a415f3-c985-4cf2-a922-ec1681908c5a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.516246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29a415f3-c985-4cf2-a922-ec1681908c5a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.516905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29a415f3-c985-4cf2-a922-ec1681908c5a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:10.517793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29a415f3-c985-4cf2-a922-ec1681908c5a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.518507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29a415f3-c985-4cf2-a922-ec1681908c5a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.519825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29a415f3-c985-4cf2-a922-ec1681908c5a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:10.752193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-29a415f3-c985-4cf2-a922-ec1681908c5a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:10.769274 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-29a415f3-c985-4cf2-a922-ec1681908c5a tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1275 microversion: 2.1 time: 0.269478 Oct 18 13:37:10.770794 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2157/4595] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:10 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1275 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:10.801498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e82fa031-78a9-4372-aca8-79de45de73f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:10.810875 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e82fa031-78a9-4372-aca8-79de45de73f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1500 microversion: 2.1 time: 0.458538 Oct 18 13:37:10.814151 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2439/4596] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:10 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1500 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:10.815178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1791ea42-b7fa-497e-b846-61261e9e3724 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:10.815864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1791ea42-b7fa-497e-b846-61261e9e3724 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:10.828500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1791ea42-b7fa-497e-b846-61261e9e3724 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.830786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1791ea42-b7fa-497e-b846-61261e9e3724 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.831228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1791ea42-b7fa-497e-b846-61261e9e3724 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:10.833392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1791ea42-b7fa-497e-b846-61261e9e3724 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.836014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1791ea42-b7fa-497e-b846-61261e9e3724 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.836505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1791ea42-b7fa-497e-b846-61261e9e3724 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:10.844187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e95e6991-9e00-4b98-a7b4-0b703147c358 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:10.844809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e95e6991-9e00-4b98-a7b4-0b703147c358 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:10.861306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e95e6991-9e00-4b98-a7b4-0b703147c358 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.861811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e95e6991-9e00-4b98-a7b4-0b703147c358 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.862300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e95e6991-9e00-4b98-a7b4-0b703147c358 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:10.870111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e95e6991-9e00-4b98-a7b4-0b703147c358 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:10.870627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e95e6991-9e00-4b98-a7b4-0b703147c358 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:10.871284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e95e6991-9e00-4b98-a7b4-0b703147c358 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:11.337915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e95e6991-9e00-4b98-a7b4-0b703147c358 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:11.347435 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e95e6991-9e00-4b98-a7b4-0b703147c358 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1500 microversion: 2.1 time: 0.507055 Oct 18 13:37:11.356046 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2440/4597] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:10 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1500 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:11.393078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53871da3-2181-4a9e-970b-fa897278f7bf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:11.394713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53871da3-2181-4a9e-970b-fa897278f7bf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:11.412182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53871da3-2181-4a9e-970b-fa897278f7bf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:11.412868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53871da3-2181-4a9e-970b-fa897278f7bf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:11.413336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53871da3-2181-4a9e-970b-fa897278f7bf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:11.416563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53871da3-2181-4a9e-970b-fa897278f7bf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:11.417544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53871da3-2181-4a9e-970b-fa897278f7bf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:11.419228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53871da3-2181-4a9e-970b-fa897278f7bf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:11.456497 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-53871da3-2181-4a9e-970b-fa897278f7bf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] HTTP exception thrown: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53871da3-2181-4a9e-970b-fa897278f7bf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Request method failure captured: Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 HTTP/1.1 Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqrt0ofdZCo_EHSlhT209ekptBsECwpWXCkSOE-tqw6Tt0My7_z3Pf5GhJvWCzn2DHkFBf8h4tLK9BfcVb4SJr_FyNod0P8YhvrV-ufySDoGvuBFy54GIiLix83Eu2Zxpp9ywQEh265C1yM9HGsAYyaN1h6k5TMKcN2YWF-SAGEgmp0 Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 6e2231c4720246789ebb4ae0b1a29128 Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e2231c4720246789ebb4ae0b1a29128"}]}] Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 6e2231c4720246789ebb4ae0b1a29128 Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachVolumeShelveTestJSON-1397393656-project Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 8ffdf91ab1a4414da1ec7fdcd4965bed Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1397393656-project Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '5fa292c2-3801-4d84-b31a-4d3eeeb41818'} Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:11.458933 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:11.464135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:11.464135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:11.464135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:11.464135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:11.464135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:11.464135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:11.464135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:37:11.464135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:11.464135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53871da3-2181-4a9e-970b-fa897278f7bf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Returning 404 to user: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:11.464135 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53871da3-2181-4a9e-970b-fa897278f7bf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 404 len: 111 microversion: 2.20 time: 0.082395 Oct 18 13:37:11.465825 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2441/4598] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:11 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:37:11.471132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-67dd6be3-90eb-495b-bb66-8bf1de377749 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:11.471706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-67dd6be3-90eb-495b-bb66-8bf1de377749 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:11.479810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67dd6be3-90eb-495b-bb66-8bf1de377749 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:11.480304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67dd6be3-90eb-495b-bb66-8bf1de377749 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:11.481066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67dd6be3-90eb-495b-bb66-8bf1de377749 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:11.481877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67dd6be3-90eb-495b-bb66-8bf1de377749 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:11.482334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67dd6be3-90eb-495b-bb66-8bf1de377749 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:11.482772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67dd6be3-90eb-495b-bb66-8bf1de377749 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:11.561109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-67dd6be3-90eb-495b-bb66-8bf1de377749 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:37:11.599181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1791ea42-b7fa-497e-b846-61261e9e3724 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:11.609600 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1791ea42-b7fa-497e-b846-61261e9e3724 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1427 microversion: 2.1 time: 0.806696 Oct 18 13:37:11.636777 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2158/4599] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:10 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1427 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:11.641885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b19e5d42-5889-4e49-aa6d-2dd70351c7c0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:11.647620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b19e5d42-5889-4e49-aa6d-2dd70351c7c0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:11.675041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b19e5d42-5889-4e49-aa6d-2dd70351c7c0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:11.677842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b19e5d42-5889-4e49-aa6d-2dd70351c7c0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:11.678314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b19e5d42-5889-4e49-aa6d-2dd70351c7c0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:11.679026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b19e5d42-5889-4e49-aa6d-2dd70351c7c0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:11.679472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b19e5d42-5889-4e49-aa6d-2dd70351c7c0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:11.679888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b19e5d42-5889-4e49-aa6d-2dd70351c7c0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:11.696382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:11.740974 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-67dd6be3-90eb-495b-bb66-8bf1de377749 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 204 len: 0 microversion: 2.1 time: 0.272873 Oct 18 13:37:11.742171 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2442/4600] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:11 2022] DELETE /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:37:11.753059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4dcc413b-fb3c-44ac-894c-fefb62dae58c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '.version_select at 0x7ff617ba4040>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:11.790407 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4dcc413b-fb3c-44ac-894c-fefb62dae58c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-829305784" status: 204 len: 0 microversion: 2.20 time: 0.045352 Oct 18 13:37:11.796036 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2443/4601] 10.222.0.40 () {60 vars in 1259 bytes} [Tue Oct 18 13:37:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-829305784 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:37:11.802338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c41e49fc-b1de-4ec9-a626-89ff4a77a44e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617b81280>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:11.897974 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c41e49fc-b1de-4ec9-a626-89ff4a77a44e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.100155 Oct 18 13:37:11.902198 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2444/4602] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:11 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:11.915795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-128387fc-43e8-465f-bf55-fdc90195fa12 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:11.916617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-128387fc-43e8-465f-bf55-fdc90195fa12 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:11.931161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-128387fc-43e8-465f-bf55-fdc90195fa12 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:11.933066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-128387fc-43e8-465f-bf55-fdc90195fa12 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:11.933539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-128387fc-43e8-465f-bf55-fdc90195fa12 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:11.937155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-128387fc-43e8-465f-bf55-fdc90195fa12 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:11.937838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-128387fc-43e8-465f-bf55-fdc90195fa12 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:11.938429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-128387fc-43e8-465f-bf55-fdc90195fa12 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:11.938630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b19e5d42-5889-4e49-aa6d-2dd70351c7c0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:11.952791 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b19e5d42-5889-4e49-aa6d-2dd70351c7c0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.314202 Oct 18 13:37:11.955465 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2159/4603] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:11 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:11.965264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cb0fe01e-b45f-4b53-9583-9b4c0c92356d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:11.968060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cb0fe01e-b45f-4b53-9583-9b4c0c92356d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:11.983149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb0fe01e-b45f-4b53-9583-9b4c0c92356d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:11.983893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb0fe01e-b45f-4b53-9583-9b4c0c92356d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:11.985833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb0fe01e-b45f-4b53-9583-9b4c0c92356d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:11.986725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb0fe01e-b45f-4b53-9583-9b4c0c92356d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:11.989288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb0fe01e-b45f-4b53-9583-9b4c0c92356d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:11.989891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb0fe01e-b45f-4b53-9583-9b4c0c92356d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.290870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-128387fc-43e8-465f-bf55-fdc90195fa12 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:12.299525 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-128387fc-43e8-465f-bf55-fdc90195fa12 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1506 microversion: 2.1 time: 0.395939 Oct 18 13:37:12.313959 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2445/4604] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:11 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:12.314073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cb0fe01e-b45f-4b53-9583-9b4c0c92356d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:12.316161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f99b4ec-6817-46ce-8163-fa061a245116 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:12.319537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9f99b4ec-6817-46ce-8163-fa061a245116 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:12.333784 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cb0fe01e-b45f-4b53-9583-9b4c0c92356d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1317 microversion: 2.1 time: 0.373749 Oct 18 13:37:12.335688 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2160/4605] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:11 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:12.336125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f99b4ec-6817-46ce-8163-fa061a245116 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.336630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f99b4ec-6817-46ce-8163-fa061a245116 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.337296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f99b4ec-6817-46ce-8163-fa061a245116 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.338011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f99b4ec-6817-46ce-8163-fa061a245116 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.340648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f99b4ec-6817-46ce-8163-fa061a245116 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.341094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f99b4ec-6817-46ce-8163-fa061a245116 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.365551 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-9f99b4ec-6817-46ce-8163-fa061a245116 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f99b4ec-6817-46ce-8163-fa061a245116 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 HTTP/1.1 Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '18dcc6bf-fc63-4063-93f6-d8f7b158aef9'} Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:12.369062 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:12.373360 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:37:12.373360 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.373360 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:12.373360 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.373360 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:12.373360 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:12.373360 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:12.373360 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:12.373360 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:12.373360 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:37:12.373360 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.374538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f99b4ec-6817-46ce-8163-fa061a245116 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:12.376670 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9f99b4ec-6817-46ce-8163-fa061a245116 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "DELETE /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 404 len: 111 microversion: 2.1 time: 0.072272 Oct 18 13:37:12.377467 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2446/4606] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:12 2022] DELETE /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:12.386260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ccc17031-c817-453e-afab-5f86065ce8cd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:12.386860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ccc17031-c817-453e-afab-5f86065ce8cd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 18dcc6bf-fc63-4063-93f6-d8f7b158aef9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:12.396858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ccc17031-c817-453e-afab-5f86065ce8cd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.398104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ccc17031-c817-453e-afab-5f86065ce8cd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.399071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ccc17031-c817-453e-afab-5f86065ce8cd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.399862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ccc17031-c817-453e-afab-5f86065ce8cd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.404964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ccc17031-c817-453e-afab-5f86065ce8cd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.408171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ccc17031-c817-453e-afab-5f86065ce8cd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.428868 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-ccc17031-c817-453e-afab-5f86065ce8cd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ccc17031-c817-453e-afab-5f86065ce8cd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 HTTP/1.1 Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '18dcc6bf-fc63-4063-93f6-d8f7b158aef9'} Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:12.432311 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.436240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:12.436240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:12.436240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:12.436240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:12.436240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:12.436240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. Oct 18 13:37:12.436240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:12.436240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ccc17031-c817-453e-afab-5f86065ce8cd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 18dcc6bf-fc63-4063-93f6-d8f7b158aef9 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:12.436240 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ccc17031-c817-453e-afab-5f86065ce8cd tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9" status: 404 len: 111 microversion: 2.1 time: 0.052760 Oct 18 13:37:12.439251 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2161/4607] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:12 2022] GET /compute/v2.1/servers/18dcc6bf-fc63-4063-93f6-d8f7b158aef9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:12.444976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-221c31ff-fa90-4dfc-9ace-9117c204ef3b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:12.456213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-221c31ff-fa90-4dfc-9ace-9117c204ef3b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:12.466340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:12.485472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-221c31ff-fa90-4dfc-9ace-9117c204ef3b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.486445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-221c31ff-fa90-4dfc-9ace-9117c204ef3b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.487624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-221c31ff-fa90-4dfc-9ace-9117c204ef3b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.488707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-221c31ff-fa90-4dfc-9ace-9117c204ef3b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.489362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-221c31ff-fa90-4dfc-9ace-9117c204ef3b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.494820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-221c31ff-fa90-4dfc-9ace-9117c204ef3b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.570850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-221c31ff-fa90-4dfc-9ace-9117c204ef3b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:37:12.650268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:12.662692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41a9f692-486f-4d04-a2cb-6e5cc38b8511 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:12.664032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-41a9f692-486f-4d04-a2cb-6e5cc38b8511 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:12.675325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41a9f692-486f-4d04-a2cb-6e5cc38b8511 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.676379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41a9f692-486f-4d04-a2cb-6e5cc38b8511 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.677148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41a9f692-486f-4d04-a2cb-6e5cc38b8511 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.678113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41a9f692-486f-4d04-a2cb-6e5cc38b8511 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.678774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41a9f692-486f-4d04-a2cb-6e5cc38b8511 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.679722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41a9f692-486f-4d04-a2cb-6e5cc38b8511 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.772010 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-221c31ff-fa90-4dfc-9ace-9117c204ef3b tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 204 len: 0 microversion: 2.1 time: 0.330782 Oct 18 13:37:12.780422 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2447/4608] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:12 2022] DELETE /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:37:12.786319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2671c58d-a981-4acc-9dd3-7a31b1dc0c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:12.787041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2671c58d-a981-4acc-9dd3-7a31b1dc0c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:12.811672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2671c58d-a981-4acc-9dd3-7a31b1dc0c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.812029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2671c58d-a981-4acc-9dd3-7a31b1dc0c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.812398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2671c58d-a981-4acc-9dd3-7a31b1dc0c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:12.813123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2671c58d-a981-4acc-9dd3-7a31b1dc0c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:12.813645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2671c58d-a981-4acc-9dd3-7a31b1dc0c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:12.814079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2671c58d-a981-4acc-9dd3-7a31b1dc0c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:13.073554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-41a9f692-486f-4d04-a2cb-6e5cc38b8511 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:13.096636 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-41a9f692-486f-4d04-a2cb-6e5cc38b8511 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1427 microversion: 2.1 time: 0.444779 Oct 18 13:37:13.106139 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2162/4609] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:12 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1427 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:13.135580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e1345323-77a8-47bb-92fc-30df9babaf82 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7cf550>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:13.279316 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e1345323-77a8-47bb-92fc-30df9babaf82 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.171074 Oct 18 13:37:13.292183 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2163/4610] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:13 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:13.313089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-73523083-095a-4942-8ae2-0c006c9e4b11 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:13.315766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-73523083-095a-4942-8ae2-0c006c9e4b11 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:13.330842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73523083-095a-4942-8ae2-0c006c9e4b11 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:13.333024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73523083-095a-4942-8ae2-0c006c9e4b11 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:13.337856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73523083-095a-4942-8ae2-0c006c9e4b11 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:13.340855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73523083-095a-4942-8ae2-0c006c9e4b11 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:13.342569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73523083-095a-4942-8ae2-0c006c9e4b11 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:13.344629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-73523083-095a-4942-8ae2-0c006c9e4b11 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:13.532336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2671c58d-a981-4acc-9dd3-7a31b1dc0c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:13.546699 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2671c58d-a981-4acc-9dd3-7a31b1dc0c6c tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1512 microversion: 2.1 time: 0.763328 Oct 18 13:37:13.570200 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2448/4611] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:12 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1512 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:13.581512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-744e6140-c84c-4fc2-a239-ffa09caa26f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:13.582521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-744e6140-c84c-4fc2-a239-ffa09caa26f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:13.592637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-744e6140-c84c-4fc2-a239-ffa09caa26f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:13.593380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-744e6140-c84c-4fc2-a239-ffa09caa26f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:13.593826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-744e6140-c84c-4fc2-a239-ffa09caa26f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:13.594883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-744e6140-c84c-4fc2-a239-ffa09caa26f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:13.595857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-744e6140-c84c-4fc2-a239-ffa09caa26f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:13.596301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-744e6140-c84c-4fc2-a239-ffa09caa26f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:13.806784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-73523083-095a-4942-8ae2-0c006c9e4b11 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:13.810267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-744e6140-c84c-4fc2-a239-ffa09caa26f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:13.818719 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-73523083-095a-4942-8ae2-0c006c9e4b11 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.518686 Oct 18 13:37:13.821922 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-744e6140-c84c-4fc2-a239-ffa09caa26f9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1506 microversion: 2.1 time: 0.251493 Oct 18 13:37:13.822971 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2449/4612] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:13 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:13.828604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8b597253-d536-4ab8-9e68-7909ca8b13e0 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:13.829434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8b597253-d536-4ab8-9e68-7909ca8b13e0 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:13.834576 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2164/4613] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:13 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:13.836478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b597253-d536-4ab8-9e68-7909ca8b13e0 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:13.837492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b597253-d536-4ab8-9e68-7909ca8b13e0 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:13.837944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b597253-d536-4ab8-9e68-7909ca8b13e0 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:13.838645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b597253-d536-4ab8-9e68-7909ca8b13e0 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:13.839104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b597253-d536-4ab8-9e68-7909ca8b13e0 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:13.839524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b597253-d536-4ab8-9e68-7909ca8b13e0 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:13.841121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7f93ba1e-bf1c-43e8-8ab9-484d4d91f6ae req-226d8fa0-eae8-43bd-bfaf-6f624f3a9ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a45dbe-4f39-47a7-b117-bee5c3bc71d9", "tag": "0686f601-3008-41be-b803-ffec39de6678"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:13.851544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7f93ba1e-bf1c-43e8-8ab9-484d4d91f6ae req-226d8fa0-eae8-43bd-bfaf-6f624f3a9ae2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:13.852242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7f93ba1e-bf1c-43e8-8ab9-484d4d91f6ae req-226d8fa0-eae8-43bd-bfaf-6f624f3a9ae2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:13.853288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7f93ba1e-bf1c-43e8-8ab9-484d4d91f6ae req-226d8fa0-eae8-43bd-bfaf-6f624f3a9ae2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:13.866324 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7f93ba1e-bf1c-43e8-8ab9-484d4d91f6ae req-226d8fa0-eae8-43bd-bfaf-6f624f3a9ae2 service nova] Creating event network-changed:0686f601-3008-41be-b803-ffec39de6678 for instance 73a45dbe-4f39-47a7-b117-bee5c3bc71d9 on n-h2-858384-13 Oct 18 13:37:13.876819 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7f93ba1e-bf1c-43e8-8ab9-484d4d91f6ae req-226d8fa0-eae8-43bd-bfaf-6f624f3a9ae2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040614 Oct 18 13:37:13.880730 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2165/4614] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:13.889398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cbba98be-f120-42c6-96db-ead199e6025e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Action: 'create', calling method: .version_select at 0x7ff617b5cf70>, body: {"keypair": {"name": "tempest-keypair-1418007131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4C63iD3HtxEbehuEMueq8q3a6I8rRbXSGH5Y79e8kPIPzHIvJkw5267LdZdtXVegGwHymuXhbC1ly/DnQDmcuGaxnf9e6kDHPzG8ewSvcX9v1Tl22d/Ez3+CJsa0kUTw=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:13.907320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-cbba98be-f120-42c6-96db-ead199e6025e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Getting quotas for project 6e2231c4720246789ebb4ae0b1a29128. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:37:13.912906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-cbba98be-f120-42c6-96db-ead199e6025e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Getting quotas for user 8ffdf91ab1a4414da1ec7fdcd4965bed and project 6e2231c4720246789ebb4ae0b1a29128. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:37:13.948647 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cbba98be-f120-42c6-96db-ead199e6025e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.064884 Oct 18 13:37:13.955766 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2166/4615] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 18 13:37:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 18 13:37:14.053768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8b597253-d536-4ab8-9e68-7909ca8b13e0 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:14.073783 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8b597253-d536-4ab8-9e68-7909ca8b13e0 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1317 microversion: 2.1 time: 0.248584 Oct 18 13:37:14.074383 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2450/4616] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:13 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:14.133301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-46eb2649-8e00-4c36-99b3-3dd782c8ab75 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:14.135541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-46eb2649-8e00-4c36-99b3-3dd782c8ab75 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:14.162943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46eb2649-8e00-4c36-99b3-3dd782c8ab75 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:14.166777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46eb2649-8e00-4c36-99b3-3dd782c8ab75 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:14.167552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46eb2649-8e00-4c36-99b3-3dd782c8ab75 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:14.171828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46eb2649-8e00-4c36-99b3-3dd782c8ab75 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:14.173737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46eb2649-8e00-4c36-99b3-3dd782c8ab75 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:14.177191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46eb2649-8e00-4c36-99b3-3dd782c8ab75 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:14.315107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4f4da49e-3e3b-4196-b07e-852ac790b706 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617be6160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:14.419728 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4f4da49e-3e3b-4196-b07e-852ac790b706 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.108206 Oct 18 13:37:14.422011 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2451/4617] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:14 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:14.572545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cdd971c0-dd23-426b-b73d-e3fc2df16567 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:14.573312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cdd971c0-dd23-426b-b73d-e3fc2df16567 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:14.586397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdd971c0-dd23-426b-b73d-e3fc2df16567 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:14.586900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdd971c0-dd23-426b-b73d-e3fc2df16567 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:14.587379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdd971c0-dd23-426b-b73d-e3fc2df16567 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:14.588089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdd971c0-dd23-426b-b73d-e3fc2df16567 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:14.588550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdd971c0-dd23-426b-b73d-e3fc2df16567 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:14.588977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdd971c0-dd23-426b-b73d-e3fc2df16567 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:14.983835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cdd971c0-dd23-426b-b73d-e3fc2df16567 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:14.995045 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cdd971c0-dd23-426b-b73d-e3fc2df16567 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1512 microversion: 2.1 time: 0.426967 Oct 18 13:37:15.006341 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2452/4618] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:14 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1512 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:15.022863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6abaa43b-2a0b-4b02-b21a-2e04b71a4b81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:15.023975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6abaa43b-2a0b-4b02-b21a-2e04b71a4b81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:15.057521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6abaa43b-2a0b-4b02-b21a-2e04b71a4b81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:15.058139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6abaa43b-2a0b-4b02-b21a-2e04b71a4b81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:15.058600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6abaa43b-2a0b-4b02-b21a-2e04b71a4b81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:15.059353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6abaa43b-2a0b-4b02-b21a-2e04b71a4b81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:15.059815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6abaa43b-2a0b-4b02-b21a-2e04b71a4b81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:15.060245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6abaa43b-2a0b-4b02-b21a-2e04b71a4b81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:15.203736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-46eb2649-8e00-4c36-99b3-3dd782c8ab75 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:15.213507 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-46eb2649-8e00-4c36-99b3-3dd782c8ab75 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1427 microversion: 2.1 time: 1.085758 Oct 18 13:37:15.226009 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2167/4619] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:14 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1427 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:15.231662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dc1d8611-a85c-4e4f-862e-4cc8e4e90a34 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:15.232567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dc1d8611-a85c-4e4f-862e-4cc8e4e90a34 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:15.240626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc1d8611-a85c-4e4f-862e-4cc8e4e90a34 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:15.247619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc1d8611-a85c-4e4f-862e-4cc8e4e90a34 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:15.248279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc1d8611-a85c-4e4f-862e-4cc8e4e90a34 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:15.249700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc1d8611-a85c-4e4f-862e-4cc8e4e90a34 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:15.250470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc1d8611-a85c-4e4f-862e-4cc8e4e90a34 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:15.251180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc1d8611-a85c-4e4f-862e-4cc8e4e90a34 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:15.457801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:15.548313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6abaa43b-2a0b-4b02-b21a-2e04b71a4b81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:15.557064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:15.590313 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6abaa43b-2a0b-4b02-b21a-2e04b71a4b81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.573485 Oct 18 13:37:15.604607 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2453/4620] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:15 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:15.624409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-73487f3d-2fb7-4838-be3b-d23cf796a9fd tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:15.631342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-73487f3d-2fb7-4838-be3b-d23cf796a9fd tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:15.670673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73487f3d-2fb7-4838-be3b-d23cf796a9fd tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:15.671187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73487f3d-2fb7-4838-be3b-d23cf796a9fd tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:15.673316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73487f3d-2fb7-4838-be3b-d23cf796a9fd tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:15.674247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73487f3d-2fb7-4838-be3b-d23cf796a9fd tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:15.674738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73487f3d-2fb7-4838-be3b-d23cf796a9fd tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:15.675149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73487f3d-2fb7-4838-be3b-d23cf796a9fd tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:15.795756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dc1d8611-a85c-4e4f-862e-4cc8e4e90a34 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:15.808546 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dc1d8611-a85c-4e4f-862e-4cc8e4e90a34 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1506 microversion: 2.1 time: 0.581179 Oct 18 13:37:15.809233 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2168/4621] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:15 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1506 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:15.816797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-cbf870da-245b-464c-bb59-fe8507ba699d req-0bc7839d-ebd6-454c-9f3e-26905db163ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "768feeae-e6f3-4013-a7a9-e69e0bd15a58", "name": "network-vif-plugged", "status": "completed", "tag": "b3076d90-5db4-402d-9177-41b1a6988b3b"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:15.855710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cbf870da-245b-464c-bb59-fe8507ba699d req-0bc7839d-ebd6-454c-9f3e-26905db163ae service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:15.862342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cbf870da-245b-464c-bb59-fe8507ba699d req-0bc7839d-ebd6-454c-9f3e-26905db163ae service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:15.862863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cbf870da-245b-464c-bb59-fe8507ba699d req-0bc7839d-ebd6-454c-9f3e-26905db163ae service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:15.886564 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-cbf870da-245b-464c-bb59-fe8507ba699d req-0bc7839d-ebd6-454c-9f3e-26905db163ae service nova] Creating event network-vif-plugged:b3076d90-5db4-402d-9177-41b1a6988b3b for instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 on n-h2-858384-13 Oct 18 13:37:15.893674 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-cbf870da-245b-464c-bb59-fe8507ba699d req-0bc7839d-ebd6-454c-9f3e-26905db163ae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080251 Oct 18 13:37:15.903020 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2169/4622] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:15.912888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9f6ccee6-c2dd-4d76-9cdd-a0ab0c2856cd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e8308b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:15.965839 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9f6ccee6-c2dd-4d76-9cdd-a0ab0c2856cd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.061460 Oct 18 13:37:15.975303 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2170/4623] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:15 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:16.026140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-78428d37-e3d9-4be7-9308-73b585bed250 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:16.027544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-78428d37-e3d9-4be7-9308-73b585bed250 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:16.039143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78428d37-e3d9-4be7-9308-73b585bed250 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:16.046416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78428d37-e3d9-4be7-9308-73b585bed250 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:16.047086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78428d37-e3d9-4be7-9308-73b585bed250 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:16.048083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78428d37-e3d9-4be7-9308-73b585bed250 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:16.048751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78428d37-e3d9-4be7-9308-73b585bed250 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:16.049462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-78428d37-e3d9-4be7-9308-73b585bed250 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:16.230739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-73487f3d-2fb7-4838-be3b-d23cf796a9fd tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:16.245508 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-73487f3d-2fb7-4838-be3b-d23cf796a9fd tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1317 microversion: 2.1 time: 0.646756 Oct 18 13:37:16.249798 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2454/4624] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:15 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1317 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:16.278064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7a25273e-7eb2-4481-80b0-bb877320c554 req-3fb46abf-7880-4242-93d5-3c2c941dc70a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bce6f6b-df28-4c34-a17f-4f18eb67d401", "name": "network-vif-deleted", "tag": "c5013b3d-167f-494a-9220-7ef368aab635"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:16.311900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7a25273e-7eb2-4481-80b0-bb877320c554 req-3fb46abf-7880-4242-93d5-3c2c941dc70a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:16.329137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7a25273e-7eb2-4481-80b0-bb877320c554 req-3fb46abf-7880-4242-93d5-3c2c941dc70a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:16.329937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7a25273e-7eb2-4481-80b0-bb877320c554 req-3fb46abf-7880-4242-93d5-3c2c941dc70a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:16.354145 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7a25273e-7eb2-4481-80b0-bb877320c554 req-3fb46abf-7880-4242-93d5-3c2c941dc70a service nova] Creating event network-vif-deleted:c5013b3d-167f-494a-9220-7ef368aab635 for instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 on n-h2-858384-13 Oct 18 13:37:16.361758 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7a25273e-7eb2-4481-80b0-bb877320c554 req-3fb46abf-7880-4242-93d5-3c2c941dc70a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108711 Oct 18 13:37:16.363242 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2455/4625] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:16.371324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ddce5d56-7287-463b-ad15-d54925c74bee tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:16.375374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ddce5d56-7287-463b-ad15-d54925c74bee tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:16.385141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddce5d56-7287-463b-ad15-d54925c74bee tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:16.386128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddce5d56-7287-463b-ad15-d54925c74bee tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:16.387017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddce5d56-7287-463b-ad15-d54925c74bee tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:16.387983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddce5d56-7287-463b-ad15-d54925c74bee tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:16.388878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddce5d56-7287-463b-ad15-d54925c74bee tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:16.389602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ddce5d56-7287-463b-ad15-d54925c74bee tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:16.447991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-78428d37-e3d9-4be7-9308-73b585bed250 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:16.480708 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-78428d37-e3d9-4be7-9308-73b585bed250 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1470 microversion: 2.1 time: 0.453254 Oct 18 13:37:16.485371 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2171/4626] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:16 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1470 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:16.547467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7abec6b6-0343-4ec4-9679-566bcfcc6e9d req-08e8ff40-6f97-4b8c-a932-c45a2a78d620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84248cd-c35f-4af0-b55d-25e8f9055c3b", "name": "network-vif-deleted", "tag": "329f87db-5c9f-4b3a-a50e-757cdb071740"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:16.588831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7abec6b6-0343-4ec4-9679-566bcfcc6e9d req-08e8ff40-6f97-4b8c-a932-c45a2a78d620 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:16.590032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7abec6b6-0343-4ec4-9679-566bcfcc6e9d req-08e8ff40-6f97-4b8c-a932-c45a2a78d620 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:16.590032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7abec6b6-0343-4ec4-9679-566bcfcc6e9d req-08e8ff40-6f97-4b8c-a932-c45a2a78d620 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:16.639705 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7abec6b6-0343-4ec4-9679-566bcfcc6e9d req-08e8ff40-6f97-4b8c-a932-c45a2a78d620 service nova] Creating event network-vif-deleted:329f87db-5c9f-4b3a-a50e-757cdb071740 for instance d84248cd-c35f-4af0-b55d-25e8f9055c3b on n-h1-858384-13 Oct 18 13:37:16.656536 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7abec6b6-0343-4ec4-9679-566bcfcc6e9d req-08e8ff40-6f97-4b8c-a932-c45a2a78d620 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101592 Oct 18 13:37:16.658067 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2172/4627] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:16.664870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e351cd9-ca50-4953-90b2-6827f61b8a2d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:16.666175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1e351cd9-ca50-4953-90b2-6827f61b8a2d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:16.679282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e351cd9-ca50-4953-90b2-6827f61b8a2d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:16.680203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e351cd9-ca50-4953-90b2-6827f61b8a2d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:16.682357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e351cd9-ca50-4953-90b2-6827f61b8a2d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:16.683302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e351cd9-ca50-4953-90b2-6827f61b8a2d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:16.684016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e351cd9-ca50-4953-90b2-6827f61b8a2d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:16.684974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e351cd9-ca50-4953-90b2-6827f61b8a2d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:16.909010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1e351cd9-ca50-4953-90b2-6827f61b8a2d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:16.921108 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1e351cd9-ca50-4953-90b2-6827f61b8a2d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.261579 Oct 18 13:37:16.924721 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2173/4628] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:16 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:16.937847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:16.938486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:16.956040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:16.956530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:16.960036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:16.960866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:16.961354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:16.961787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:17.002779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:17.004668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:17.004668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:17.004668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lazy-loading 'fault' on Instance uuid d84248cd-c35f-4af0-b55d-25e8f9055c3b {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:17.089982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:17.106104 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9c1fc94f-3c41-431e-8643-ce363584cea6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 200 len: 1310 microversion: 2.1 time: 0.180171 Oct 18 13:37:17.124800 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2174/4629] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:16 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 1310 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:17.140759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-80e1079d-818f-4254-84f8-1a9d1026d4c5 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e830670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:17.200729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ddce5d56-7287-463b-ad15-d54925c74bee tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:17.211730 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ddce5d56-7287-463b-ad15-d54925c74bee tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1427 microversion: 2.1 time: 0.847013 Oct 18 13:37:17.213074 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2456/4630] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:16 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1427 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:17.234840 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-80e1079d-818f-4254-84f8-1a9d1026d4c5 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.108651 Oct 18 13:37:17.240547 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2175/4631] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:17 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:17.276775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9663b3c9-c506-417c-af40-ca75dc73981e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:17.277802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9663b3c9-c506-417c-af40-ca75dc73981e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:17.297459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9663b3c9-c506-417c-af40-ca75dc73981e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:17.298209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9663b3c9-c506-417c-af40-ca75dc73981e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:17.298915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9663b3c9-c506-417c-af40-ca75dc73981e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:17.299983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9663b3c9-c506-417c-af40-ca75dc73981e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:17.300607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9663b3c9-c506-417c-af40-ca75dc73981e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:17.301210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9663b3c9-c506-417c-af40-ca75dc73981e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:17.510984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:17.511667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:17.521432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:17.521885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:17.522324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:17.523038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:17.523490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:17.528686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:17.564242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9663b3c9-c506-417c-af40-ca75dc73981e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:17.573234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:17.573729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:17.573929 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9663b3c9-c506-417c-af40-ca75dc73981e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1317 microversion: 2.1 time: 0.305331 Oct 18 13:37:17.574204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:17.574603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lazy-loading 'fault' on Instance uuid 6bce6f6b-df28-4c34-a17f-4f18eb67d401 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:17.585880 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2457/4632] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:17 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:17.639157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a7a4b4e4c149a28cfbf83a0539f04c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72f3fa595014256865e3f5c83df7c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:17.650577 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ee8c0444-ff0d-4512-a49e-4653a17c0d6a tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 200 len: 1306 microversion: 2.1 time: 0.144988 Oct 18 13:37:17.667438 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2176/4633] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:17 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 1306 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:17.885640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-149312741", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b76c1c8-1de7-45dc-a1e5-7e21cbe193f0"}], "security_groups": [{"name": "tempest-securitygroup--989487937"}], "key_name": "tempest-keypair-1418007131", "user_data": "}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:17.951429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad7bc671-0813-4705-af78-6c63d5ae14b5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:17.952027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ad7bc671-0813-4705-af78-6c63d5ae14b5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:17.965765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad7bc671-0813-4705-af78-6c63d5ae14b5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:17.966249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad7bc671-0813-4705-af78-6c63d5ae14b5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:17.966677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad7bc671-0813-4705-af78-6c63d5ae14b5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:17.967372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad7bc671-0813-4705-af78-6c63d5ae14b5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:17.967818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad7bc671-0813-4705-af78-6c63d5ae14b5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:17.968240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad7bc671-0813-4705-af78-6c63d5ae14b5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.047389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] validate_networks() for [('3b76c1c8-1de7-45dc-a1e5-7e21cbe193f0', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:37:18.153895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad7bc671-0813-4705-af78-6c63d5ae14b5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:18.164159 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad7bc671-0813-4705-af78-6c63d5ae14b5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.216427 Oct 18 13:37:18.165478 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2177/4634] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:17 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:18.171132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6278d79f-2511-446d-8e5e-885584abb847 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:18.172166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6278d79f-2511-446d-8e5e-885584abb847 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:18.185598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6278d79f-2511-446d-8e5e-885584abb847 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.186364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6278d79f-2511-446d-8e5e-885584abb847 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.190081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6278d79f-2511-446d-8e5e-885584abb847 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.191021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6278d79f-2511-446d-8e5e-885584abb847 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.191642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6278d79f-2511-446d-8e5e-885584abb847 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.192232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6278d79f-2511-446d-8e5e-885584abb847 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.207799 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-6278d79f-2511-446d-8e5e-885584abb847 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6278d79f-2511-446d-8e5e-885584abb847 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b HTTP/1.1 Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'd84248cd-c35f-4af0-b55d-25e8f9055c3b'} Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:18.209937 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:18.214296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:18.214296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:18.214296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:18.214296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:18.214296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:37:18.214296 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:18.218942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6278d79f-2511-446d-8e5e-885584abb847 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:18.219909 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6278d79f-2511-446d-8e5e-885584abb847 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 404 len: 111 microversion: 2.1 time: 0.052440 Oct 18 13:37:18.220580 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2178/4635] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:18 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:18.235551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e5b24ae7-333e-464a-94c6-d5e93ca8c6fb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Action: 'create', calling method: .version_select at 0x7ff60e7cf3a0>, body: {"keypair": {"name": "tempest-key-1927152124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+Li7PlzXduvqmCYYMmnxTHl/8uXTq6tqY63m8y8O95yAD6VwATtJZToud+Xo9obGYSXUFw1O6mzrslcTLGLWerwGe1Se5hUGwqEckHEsoFUGxnpS4TyX/n8EXNwMP/KQ=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:18.254414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e5b24ae7-333e-464a-94c6-d5e93ca8c6fb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for project aa140485af954b1a8c83651a5d122a1a. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:37:18.261545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e5b24ae7-333e-464a-94c6-d5e93ca8c6fb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for user a4856dd5667c4f10aa9ff1ccb1788cc8 and project aa140485af954b1a8c83651a5d122a1a. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:37:18.296170 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e5b24ae7-333e-464a-94c6-d5e93ca8c6fb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.065543 Oct 18 13:37:18.296879 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2179/4636] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:37:18 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:37:18.307739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a0b72010-8487-4af3-b8fb-0671633d48d2 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:18.308372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a0b72010-8487-4af3-b8fb-0671633d48d2 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:18.315384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0b72010-8487-4af3-b8fb-0671633d48d2 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.315887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0b72010-8487-4af3-b8fb-0671633d48d2 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.316527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0b72010-8487-4af3-b8fb-0671633d48d2 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.317481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0b72010-8487-4af3-b8fb-0671633d48d2 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.318104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0b72010-8487-4af3-b8fb-0671633d48d2 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.318689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0b72010-8487-4af3-b8fb-0671633d48d2 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.484061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a0b72010-8487-4af3-b8fb-0671633d48d2 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:18.495866 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a0b72010-8487-4af3-b8fb-0671633d48d2 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1427 microversion: 2.1 time: 0.191740 Oct 18 13:37:18.510198 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2180/4637] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:18 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1427 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:18.520053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f3e6c79a-0f8c-491c-9751-25761fef8cf8 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7cf550>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:18.520709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:37:18.521062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:37:18.521503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:37:18.521919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:37:18.522338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:37:18.534132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.534887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.535779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.536832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.537383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.538076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.559886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Getting quotas for project 6e2231c4720246789ebb4ae0b1a29128. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:37:18.566484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Getting quotas for user 8ffdf91ab1a4414da1ec7fdcd4965bed and project 6e2231c4720246789ebb4ae0b1a29128. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:37:18.581641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:37:18.584591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:37:18.620704 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f3e6c79a-0f8c-491c-9751-25761fef8cf8 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.105129 Oct 18 13:37:18.622519 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2181/4638] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:18 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:18.628875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b804ecc9-dc8d-4b6e-b5d9-bf059afc42e9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '.version_select at 0x7ff60ed25b80>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:18.634509 n-d-858384-13 devstack@n-api.service[120612]: WARNING oslo_db.sqlalchemy.utils [None req-b804ecc9-dc8d-4b6e-b5d9-bf059afc42e9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 18 13:37:18.640384 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b804ecc9-dc8d-4b6e-b5d9-bf059afc42e9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.015331 Oct 18 13:37:18.651741 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2182/4639] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:37:18 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:18.651741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6a3a52b1-3e3c-4290-adb5-1b3e84b6250e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:18.651741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6a3a52b1-3e3c-4290-adb5-1b3e84b6250e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:18.654429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a3a52b1-3e3c-4290-adb5-1b3e84b6250e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.654917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a3a52b1-3e3c-4290-adb5-1b3e84b6250e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.655353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a3a52b1-3e3c-4290-adb5-1b3e84b6250e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.656052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a3a52b1-3e3c-4290-adb5-1b3e84b6250e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.656900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a3a52b1-3e3c-4290-adb5-1b3e84b6250e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.656900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a3a52b1-3e3c-4290-adb5-1b3e84b6250e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.668703 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dd4797e0-e639-46f7-8c5a-522be96aaf4b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.789734 Oct 18 13:37:18.671401 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2458/4640] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:37:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:37:18.683890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-22fd9a61-3bd2-432c-97b6-4f51c5ad9157 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:18.684884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-22fd9a61-3bd2-432c-97b6-4f51c5ad9157 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] [instance: 6bce6f6b-df28-4c34-a17f-4f18eb67d401] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:18.694203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22fd9a61-3bd2-432c-97b6-4f51c5ad9157 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.694831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22fd9a61-3bd2-432c-97b6-4f51c5ad9157 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.695268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22fd9a61-3bd2-432c-97b6-4f51c5ad9157 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.696108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22fd9a61-3bd2-432c-97b6-4f51c5ad9157 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:18.696756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22fd9a61-3bd2-432c-97b6-4f51c5ad9157 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:18.697285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22fd9a61-3bd2-432c-97b6-4f51c5ad9157 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:18.715197 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-22fd9a61-3bd2-432c-97b6-4f51c5ad9157 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] HTTP exception thrown: Instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 could not be found. Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-22fd9a61-3bd2-432c-97b6-4f51c5ad9157 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Request method failure captured: Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 HTTP/1.1 Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqsONEABPrjVFKNt02H22dmfLeRaP0dFknBVPld66dAlakan-HwGY5xZZIcd7eiryzexAM69AuZQcS-d71mKxRI0jwpPtBa_sB1mXvdY7NzzjiSEDf7l6HE_PUD4o66YFUcN0I1D_vb-IBAbUyzLFgPlL7is7Pngc1iUx0lLjKjz-gY Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d72f3fa595014256865e3f5c83df7c6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d72f3fa595014256865e3f5c83df7c6e"}]}] Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: d72f3fa595014256865e3f5c83df7c6e Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-294155133 Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 99a7a4b4e4c149a28cfbf83a0539f04c Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-294155133-project Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 could not be found. Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '6bce6f6b-df28-4c34-a17f-4f18eb67d401'} Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 could not be found. Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 could not be found. Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:18.717110 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:18.720809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:18.720809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:18.720809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:18.720809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:18.720809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:18.720809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 could not be found. Oct 18 13:37:18.720809 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:37:18.720809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-22fd9a61-3bd2-432c-97b6-4f51c5ad9157 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] Returning 404 to user: Instance 6bce6f6b-df28-4c34-a17f-4f18eb67d401 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:18.720809 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-22fd9a61-3bd2-432c-97b6-4f51c5ad9157 tempest-ServersNegativeTestJSON-294155133 tempest-ServersNegativeTestJSON-294155133-project] 10.222.0.40 "GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401" status: 404 len: 111 microversion: 2.1 time: 0.041162 Oct 18 13:37:18.722808 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2459/4641] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:18 2022] GET /compute/v2.1/servers/6bce6f6b-df28-4c34-a17f-4f18eb67d401 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:18.728496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eaaa63ef-5c08-441e-9633-c9c38c88f23a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:18.729131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eaaa63ef-5c08-441e-9633-c9c38c88f23a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:18.881587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eaaa63ef-5c08-441e-9633-c9c38c88f23a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:18.896125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eaaa63ef-5c08-441e-9633-c9c38c88f23a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:18.897618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eaaa63ef-5c08-441e-9633-c9c38c88f23a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:18.908007 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eaaa63ef-5c08-441e-9633-c9c38c88f23a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1281 microversion: 2.20 time: 0.183992 Oct 18 13:37:18.910270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6a3a52b1-3e3c-4290-adb5-1b3e84b6250e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:18.912683 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2460/4642] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:18 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:18.931247 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6a3a52b1-3e3c-4290-adb5-1b3e84b6250e tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1317 microversion: 2.1 time: 0.277658 Oct 18 13:37:18.931594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1219731552", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "key_name": "tempest-key-1927152124", "networks": [{"uuid": "aa0d4f33-39e0-4d3f-ab36-9b89248d2552"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:18.934288 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2183/4643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:18 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:19.046033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] validate_networks() for [('aa0d4f33-39e0-4d3f-ab36-9b89248d2552', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:37:19.187976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b5ec21d3-566e-47ec-9f5b-69cb632718cc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:19.189461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b5ec21d3-566e-47ec-9f5b-69cb632718cc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:19.202755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5ec21d3-566e-47ec-9f5b-69cb632718cc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:19.205757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5ec21d3-566e-47ec-9f5b-69cb632718cc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:19.206213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5ec21d3-566e-47ec-9f5b-69cb632718cc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:19.206957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5ec21d3-566e-47ec-9f5b-69cb632718cc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:19.207412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5ec21d3-566e-47ec-9f5b-69cb632718cc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:19.209110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5ec21d3-566e-47ec-9f5b-69cb632718cc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:19.454462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b5ec21d3-566e-47ec-9f5b-69cb632718cc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:19.463579 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b5ec21d3-566e-47ec-9f5b-69cb632718cc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.279669 Oct 18 13:37:19.465976 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2184/4644] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:19 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:19.522412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-00472d45-ca4f-41b7-a436-8632b592e59b tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:19.523918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-00472d45-ca4f-41b7-a436-8632b592e59b tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:19.536126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00472d45-ca4f-41b7-a436-8632b592e59b tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:19.536936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00472d45-ca4f-41b7-a436-8632b592e59b tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:19.539287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00472d45-ca4f-41b7-a436-8632b592e59b tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:19.542344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00472d45-ca4f-41b7-a436-8632b592e59b tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:19.543044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00472d45-ca4f-41b7-a436-8632b592e59b tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:19.547265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00472d45-ca4f-41b7-a436-8632b592e59b tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:19.579290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:19.729272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-00472d45-ca4f-41b7-a436-8632b592e59b tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:19.738208 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-00472d45-ca4f-41b7-a436-8632b592e59b tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1607 microversion: 2.1 time: 0.220819 Oct 18 13:37:19.753227 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2185/4645] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:19 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1607 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:19.761625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e271b1c4-7ac0-4d88-bdb6-02534fafc9cf tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e80baf0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:19.818240 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e271b1c4-7ac0-4d88-bdb6-02534fafc9cf tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.076430 Oct 18 13:37:19.819031 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2186/4646] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:19 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:19.824536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fbf9d6aa-2b79-4eab-af61-dedec0862feb tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:19.825334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fbf9d6aa-2b79-4eab-af61-dedec0862feb tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:19.833231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbf9d6aa-2b79-4eab-af61-dedec0862feb tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:19.833734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbf9d6aa-2b79-4eab-af61-dedec0862feb tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:19.834172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbf9d6aa-2b79-4eab-af61-dedec0862feb tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:19.835970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbf9d6aa-2b79-4eab-af61-dedec0862feb tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:19.836451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbf9d6aa-2b79-4eab-af61-dedec0862feb tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:19.837257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fbf9d6aa-2b79-4eab-af61-dedec0862feb tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:19.989281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:37:19.991671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:37:19.992382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:37:19.993037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:37:19.993821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:37:20.014428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:20.018306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:20.018912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:20.019859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:20.022501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:20.026238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:20.035807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fbf9d6aa-2b79-4eab-af61-dedec0862feb tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:20.045195 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fbf9d6aa-2b79-4eab-af61-dedec0862feb tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1607 microversion: 2.1 time: 0.225158 Oct 18 13:37:20.046894 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2187/4647] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:19 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1607 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:20.052692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-579cad41-6243-48ec-8f51-10ccd0ab9961 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:20.053427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-579cad41-6243-48ec-8f51-10ccd0ab9961 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:20.061952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-579cad41-6243-48ec-8f51-10ccd0ab9961 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:20.063435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-579cad41-6243-48ec-8f51-10ccd0ab9961 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:20.064477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-579cad41-6243-48ec-8f51-10ccd0ab9961 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:20.065613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-579cad41-6243-48ec-8f51-10ccd0ab9961 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:20.066141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-579cad41-6243-48ec-8f51-10ccd0ab9961 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:20.066651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-579cad41-6243-48ec-8f51-10ccd0ab9961 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:20.078695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:37:20.096742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for user a4856dd5667c4f10aa9ff1ccb1788cc8 and project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:37:20.118250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:37:20.121716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:37:20.147522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-579cad41-6243-48ec-8f51-10ccd0ab9961 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:20.160535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-579cad41-6243-48ec-8f51-10ccd0ab9961 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:20.162521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-579cad41-6243-48ec-8f51-10ccd0ab9961 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:20.164277 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-579cad41-6243-48ec-8f51-10ccd0ab9961 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1333 microversion: 2.20 time: 0.116091 Oct 18 13:37:20.165533 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2188/4648] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:20 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1333 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:20.189977 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6b2165d8-b5fd-4503-8a84-b176f012a6bb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.275776 Oct 18 13:37:20.200288 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2461/4649] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:37:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:37:20.206482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a06cc0d4-2cac-4615-9c7e-b7392bdc7ef9 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:20.207561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a06cc0d4-2cac-4615-9c7e-b7392bdc7ef9 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:20.210273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bf727e75-5fb1-43d8-87b6-26eaeb9d1098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:20.210908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bf727e75-5fb1-43d8-87b6-26eaeb9d1098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:20.216579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a06cc0d4-2cac-4615-9c7e-b7392bdc7ef9 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:20.217494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a06cc0d4-2cac-4615-9c7e-b7392bdc7ef9 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:20.218144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a06cc0d4-2cac-4615-9c7e-b7392bdc7ef9 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:20.219548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a06cc0d4-2cac-4615-9c7e-b7392bdc7ef9 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:20.220231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a06cc0d4-2cac-4615-9c7e-b7392bdc7ef9 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:20.221067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a06cc0d4-2cac-4615-9c7e-b7392bdc7ef9 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:20.233687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf727e75-5fb1-43d8-87b6-26eaeb9d1098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:20.234100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf727e75-5fb1-43d8-87b6-26eaeb9d1098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:20.234531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf727e75-5fb1-43d8-87b6-26eaeb9d1098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:20.235227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf727e75-5fb1-43d8-87b6-26eaeb9d1098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:20.235674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf727e75-5fb1-43d8-87b6-26eaeb9d1098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:20.236088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf727e75-5fb1-43d8-87b6-26eaeb9d1098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:20.568442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bf727e75-5fb1-43d8-87b6-26eaeb9d1098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:20.582890 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bf727e75-5fb1-43d8-87b6-26eaeb9d1098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1317 microversion: 2.1 time: 0.401668 Oct 18 13:37:20.584533 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2189/4650] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:20 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:20.596635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a76a3bea-e0e2-4030-9f0a-1f20df37ef88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:20.603617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a76a3bea-e0e2-4030-9f0a-1f20df37ef88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:20.702147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a06cc0d4-2cac-4615-9c7e-b7392bdc7ef9 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:20.713889 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a06cc0d4-2cac-4615-9c7e-b7392bdc7ef9 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1607 microversion: 2.1 time: 0.511719 Oct 18 13:37:20.714829 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2462/4651] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:20 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1607 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:20.720348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-049814f1-c78a-434b-9769-5e2b1281d631 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:20.721163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-049814f1-c78a-434b-9769-5e2b1281d631 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:20.729603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-049814f1-c78a-434b-9769-5e2b1281d631 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:20.730655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-049814f1-c78a-434b-9769-5e2b1281d631 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:20.731263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-049814f1-c78a-434b-9769-5e2b1281d631 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:20.732138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-049814f1-c78a-434b-9769-5e2b1281d631 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:20.732820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-049814f1-c78a-434b-9769-5e2b1281d631 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:20.734548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-049814f1-c78a-434b-9769-5e2b1281d631 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:20.814927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a76a3bea-e0e2-4030-9f0a-1f20df37ef88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:20.831774 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a76a3bea-e0e2-4030-9f0a-1f20df37ef88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1229 microversion: 2.1 time: 0.243410 Oct 18 13:37:20.832420 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2190/4652] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:20 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1229 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:20.862516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6adca2b5-b3de-410d-af6c-b267940aa49e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7f9c10>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:20.972726 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6adca2b5-b3de-410d-af6c-b267940aa49e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.118154 Oct 18 13:37:20.973649 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2191/4653] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:20 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:21.113856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-049814f1-c78a-434b-9769-5e2b1281d631 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:21.128310 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-049814f1-c78a-434b-9769-5e2b1281d631 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.412025 Oct 18 13:37:21.142295 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2463/4654] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:20 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:21.197880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-36e34351-120b-4100-bfcb-7cef48c46978 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:21.198573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-36e34351-120b-4100-bfcb-7cef48c46978 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:21.220361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36e34351-120b-4100-bfcb-7cef48c46978 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:21.220764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36e34351-120b-4100-bfcb-7cef48c46978 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:21.244320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36e34351-120b-4100-bfcb-7cef48c46978 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:21.245301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36e34351-120b-4100-bfcb-7cef48c46978 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:21.245801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36e34351-120b-4100-bfcb-7cef48c46978 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:21.246439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36e34351-120b-4100-bfcb-7cef48c46978 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:21.456620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36e34351-120b-4100-bfcb-7cef48c46978 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:21.471572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36e34351-120b-4100-bfcb-7cef48c46978 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:21.474486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36e34351-120b-4100-bfcb-7cef48c46978 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:21.477523 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-36e34351-120b-4100-bfcb-7cef48c46978 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1339 microversion: 2.20 time: 0.285862 Oct 18 13:37:21.501696 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2192/4655] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:21 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1339 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:21.608851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f96acd82-d501-4082-8c44-d0e7766ebc3d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:21.609808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f96acd82-d501-4082-8c44-d0e7766ebc3d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:21.620322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f96acd82-d501-4082-8c44-d0e7766ebc3d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:21.629967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f96acd82-d501-4082-8c44-d0e7766ebc3d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:21.630722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f96acd82-d501-4082-8c44-d0e7766ebc3d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:21.631631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f96acd82-d501-4082-8c44-d0e7766ebc3d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:21.632816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f96acd82-d501-4082-8c44-d0e7766ebc3d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:21.633443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f96acd82-d501-4082-8c44-d0e7766ebc3d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:21.861018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad985d5d-6780-4308-b452-e6faa7d9aa47 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:21.861817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ad985d5d-6780-4308-b452-e6faa7d9aa47 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:21.890584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad985d5d-6780-4308-b452-e6faa7d9aa47 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:21.893651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad985d5d-6780-4308-b452-e6faa7d9aa47 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:21.895369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad985d5d-6780-4308-b452-e6faa7d9aa47 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:21.897765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad985d5d-6780-4308-b452-e6faa7d9aa47 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:21.898660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad985d5d-6780-4308-b452-e6faa7d9aa47 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:21.898780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad985d5d-6780-4308-b452-e6faa7d9aa47 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:22.034136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad985d5d-6780-4308-b452-e6faa7d9aa47 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:22.050090 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad985d5d-6780-4308-b452-e6faa7d9aa47 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1281 microversion: 2.1 time: 0.193103 Oct 18 13:37:22.070661 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2193/4656] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:21 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1281 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:22.082922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b53ef326-e794-4b24-bc42-88037a1d11ea tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7f9f70>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:22.168423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f96acd82-d501-4082-8c44-d0e7766ebc3d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:22.177781 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f96acd82-d501-4082-8c44-d0e7766ebc3d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1317 microversion: 2.1 time: 0.572883 Oct 18 13:37:22.182281 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2464/4657] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:21 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:22.199530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cdf8537e-92fa-4a99-96da-430b3d0cf1c7 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:22.200501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cdf8537e-92fa-4a99-96da-430b3d0cf1c7 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:22.204695 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b53ef326-e794-4b24-bc42-88037a1d11ea tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.132556 Oct 18 13:37:22.218462 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2194/4658] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:22 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:22.219001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf8537e-92fa-4a99-96da-430b3d0cf1c7 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:22.219889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf8537e-92fa-4a99-96da-430b3d0cf1c7 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:22.220572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf8537e-92fa-4a99-96da-430b3d0cf1c7 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:22.221669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf8537e-92fa-4a99-96da-430b3d0cf1c7 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:22.222348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf8537e-92fa-4a99-96da-430b3d0cf1c7 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:22.222971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf8537e-92fa-4a99-96da-430b3d0cf1c7 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:22.509252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3a5af514-aec8-47dd-bb1e-23ceaf9a2684 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:22.509963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3a5af514-aec8-47dd-bb1e-23ceaf9a2684 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:22.534299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5af514-aec8-47dd-bb1e-23ceaf9a2684 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:22.534940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5af514-aec8-47dd-bb1e-23ceaf9a2684 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:22.535480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5af514-aec8-47dd-bb1e-23ceaf9a2684 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:22.536306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5af514-aec8-47dd-bb1e-23ceaf9a2684 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:22.536848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5af514-aec8-47dd-bb1e-23ceaf9a2684 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:22.537411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5af514-aec8-47dd-bb1e-23ceaf9a2684 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:23.080871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3a5af514-aec8-47dd-bb1e-23ceaf9a2684 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:23.093933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3a5af514-aec8-47dd-bb1e-23ceaf9a2684 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:23.095426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3a5af514-aec8-47dd-bb1e-23ceaf9a2684 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:23.096562 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3a5af514-aec8-47dd-bb1e-23ceaf9a2684 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1406 microversion: 2.20 time: 0.592523 Oct 18 13:37:23.097144 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2195/4659] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:22 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1406 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:37:23.128556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dea34b9e-9efe-4017-9637-29b0e097ff7d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:23.129072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dea34b9e-9efe-4017-9637-29b0e097ff7d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:23.137574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dea34b9e-9efe-4017-9637-29b0e097ff7d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:23.138060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dea34b9e-9efe-4017-9637-29b0e097ff7d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:23.138517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dea34b9e-9efe-4017-9637-29b0e097ff7d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:23.139216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dea34b9e-9efe-4017-9637-29b0e097ff7d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:23.139672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dea34b9e-9efe-4017-9637-29b0e097ff7d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:23.140101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dea34b9e-9efe-4017-9637-29b0e097ff7d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:23.217364 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dea34b9e-9efe-4017-9637-29b0e097ff7d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/ips" status: 200 len: 144 microversion: 2.1 time: 0.095719 Oct 18 13:37:23.217999 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2196/4660] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:37:23 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/ips => generated 144 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:23.223051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f77e217f-c27e-4b23-9102-343eb5513b88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:23.223538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f77e217f-c27e-4b23-9102-343eb5513b88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:23.238348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f77e217f-c27e-4b23-9102-343eb5513b88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:23.242126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f77e217f-c27e-4b23-9102-343eb5513b88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:23.242621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f77e217f-c27e-4b23-9102-343eb5513b88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:23.247587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f77e217f-c27e-4b23-9102-343eb5513b88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:23.248367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f77e217f-c27e-4b23-9102-343eb5513b88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:23.252115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f77e217f-c27e-4b23-9102-343eb5513b88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:23.393623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f77e217f-c27e-4b23-9102-343eb5513b88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:23.406015 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f77e217f-c27e-4b23-9102-343eb5513b88 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1287 microversion: 2.1 time: 0.186837 Oct 18 13:37:23.409118 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2197/4661] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:23 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1287 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:23.422009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-511c6373-1933-4e46-8c7d-880156c539b1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:23.423339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-511c6373-1933-4e46-8c7d-880156c539b1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:23.433265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:23.453773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-511c6373-1933-4e46-8c7d-880156c539b1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:23.454818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-511c6373-1933-4e46-8c7d-880156c539b1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:23.455600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-511c6373-1933-4e46-8c7d-880156c539b1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:23.456606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-511c6373-1933-4e46-8c7d-880156c539b1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:23.457395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-511c6373-1933-4e46-8c7d-880156c539b1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:23.462074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-511c6373-1933-4e46-8c7d-880156c539b1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:23.659725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cdf8537e-92fa-4a99-96da-430b3d0cf1c7 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:23.670868 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cdf8537e-92fa-4a99-96da-430b3d0cf1c7 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 1.487187 Oct 18 13:37:23.677077 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2465/4662] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:22 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:23.699397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8a473f47-7e4f-44dd-8d91-7974ab0afd4b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f7ad280>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:23.766576 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8a473f47-7e4f-44dd-8d91-7974ab0afd4b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.086305 Oct 18 13:37:23.767975 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2466/4663] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:23 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:23.783760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-bc2b1bfb-93b5-415a-b8f4-f67a8e7800f3 req-e6c60c2c-14a4-47ad-abcb-107a9de7bdbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a45dbe-4f39-47a7-b117-bee5c3bc71d9", "name": "network-vif-plugged", "status": "completed", "tag": "0686f601-3008-41be-b803-ffec39de6678"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:23.800928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bc2b1bfb-93b5-415a-b8f4-f67a8e7800f3 req-e6c60c2c-14a4-47ad-abcb-107a9de7bdbe service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:23.801895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bc2b1bfb-93b5-415a-b8f4-f67a8e7800f3 req-e6c60c2c-14a4-47ad-abcb-107a9de7bdbe service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:23.802599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bc2b1bfb-93b5-415a-b8f4-f67a8e7800f3 req-e6c60c2c-14a4-47ad-abcb-107a9de7bdbe service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:23.820506 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-bc2b1bfb-93b5-415a-b8f4-f67a8e7800f3 req-e6c60c2c-14a4-47ad-abcb-107a9de7bdbe service nova] Creating event network-vif-plugged:0686f601-3008-41be-b803-ffec39de6678 for instance 73a45dbe-4f39-47a7-b117-bee5c3bc71d9 on n-h2-858384-13 Oct 18 13:37:23.827668 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-bc2b1bfb-93b5-415a-b8f4-f67a8e7800f3 req-e6c60c2c-14a4-47ad-abcb-107a9de7bdbe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058116 Oct 18 13:37:23.828883 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2467/4664] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:24.104301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d22d12aa-b6aa-4386-9c83-4a60dcdc8d0d req-86452e64-a343-45c1-9b69-0f2df823316c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c5c389-b7a1-4170-9b5c-321066d048e1", "tag": "74f52242-e00e-46f0-a3ba-47fe1d3cac8e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:24.123435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d22d12aa-b6aa-4386-9c83-4a60dcdc8d0d req-86452e64-a343-45c1-9b69-0f2df823316c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:24.125011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d22d12aa-b6aa-4386-9c83-4a60dcdc8d0d req-86452e64-a343-45c1-9b69-0f2df823316c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:24.125956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d22d12aa-b6aa-4386-9c83-4a60dcdc8d0d req-86452e64-a343-45c1-9b69-0f2df823316c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:24.176233 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d22d12aa-b6aa-4386-9c83-4a60dcdc8d0d req-86452e64-a343-45c1-9b69-0f2df823316c service nova] Creating event network-changed:74f52242-e00e-46f0-a3ba-47fe1d3cac8e for instance 31c5c389-b7a1-4170-9b5c-321066d048e1 on n-h1-858384-13 Oct 18 13:37:24.184568 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d22d12aa-b6aa-4386-9c83-4a60dcdc8d0d req-86452e64-a343-45c1-9b69-0f2df823316c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086895 Oct 18 13:37:24.185937 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2468/4665] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:24.191960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bb0e30b3-d1f2-4555-825d-799371c0c5c0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:24.193364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bb0e30b3-d1f2-4555-825d-799371c0c5c0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:24.201209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb0e30b3-d1f2-4555-825d-799371c0c5c0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:24.202192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb0e30b3-d1f2-4555-825d-799371c0c5c0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:24.202858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb0e30b3-d1f2-4555-825d-799371c0c5c0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:24.203806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb0e30b3-d1f2-4555-825d-799371c0c5c0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:24.204472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb0e30b3-d1f2-4555-825d-799371c0c5c0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:24.205109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb0e30b3-d1f2-4555-825d-799371c0c5c0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:24.271805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-511c6373-1933-4e46-8c7d-880156c539b1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:24.289968 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-511c6373-1933-4e46-8c7d-880156c539b1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1317 microversion: 2.1 time: 0.879311 Oct 18 13:37:24.291601 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2198/4666] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:23 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1317 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:24.441157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5580d19c-2e70-425d-8779-4690a4985210 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:24.441851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5580d19c-2e70-425d-8779-4690a4985210 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:24.453413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5580d19c-2e70-425d-8779-4690a4985210 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:24.469411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5580d19c-2e70-425d-8779-4690a4985210 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:24.470285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5580d19c-2e70-425d-8779-4690a4985210 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:24.471316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5580d19c-2e70-425d-8779-4690a4985210 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:24.471994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5580d19c-2e70-425d-8779-4690a4985210 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:24.472684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5580d19c-2e70-425d-8779-4690a4985210 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:24.662900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5580d19c-2e70-425d-8779-4690a4985210 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:24.675623 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5580d19c-2e70-425d-8779-4690a4985210 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1287 microversion: 2.1 time: 0.239979 Oct 18 13:37:24.678560 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2199/4667] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:24 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1287 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:24.703568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-08f9d54c-dda7-4da1-b438-15b7a82f98e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:24.704538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-08f9d54c-dda7-4da1-b438-15b7a82f98e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:24.712514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08f9d54c-dda7-4da1-b438-15b7a82f98e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:24.713418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08f9d54c-dda7-4da1-b438-15b7a82f98e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:24.714180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08f9d54c-dda7-4da1-b438-15b7a82f98e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:24.715115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08f9d54c-dda7-4da1-b438-15b7a82f98e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:24.715892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08f9d54c-dda7-4da1-b438-15b7a82f98e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:24.716706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08f9d54c-dda7-4da1-b438-15b7a82f98e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:25.004700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-08f9d54c-dda7-4da1-b438-15b7a82f98e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:25.015498 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-08f9d54c-dda7-4da1-b438-15b7a82f98e6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.315878 Oct 18 13:37:25.016817 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2200/4668] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:24 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:25.039318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-da18c977-eb8a-4108-9187-8d0b28c02ec3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7854c0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:25.114230 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-da18c977-eb8a-4108-9187-8d0b28c02ec3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.082969 Oct 18 13:37:25.115070 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2201/4669] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:25 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:25.318442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-742dfeb9-0a53-4bbd-86fb-0aa7fbd0a70d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:25.319106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-742dfeb9-0a53-4bbd-86fb-0aa7fbd0a70d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:25.330953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-742dfeb9-0a53-4bbd-86fb-0aa7fbd0a70d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:25.331441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-742dfeb9-0a53-4bbd-86fb-0aa7fbd0a70d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:25.331872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-742dfeb9-0a53-4bbd-86fb-0aa7fbd0a70d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:25.332566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-742dfeb9-0a53-4bbd-86fb-0aa7fbd0a70d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:25.333007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-742dfeb9-0a53-4bbd-86fb-0aa7fbd0a70d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:25.333657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-742dfeb9-0a53-4bbd-86fb-0aa7fbd0a70d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:25.413851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bb0e30b3-d1f2-4555-825d-799371c0c5c0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:25.433996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bb0e30b3-d1f2-4555-825d-799371c0c5c0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:25.439308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bb0e30b3-d1f2-4555-825d-799371c0c5c0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:25.440494 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bb0e30b3-d1f2-4555-825d-799371c0c5c0 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1406 microversion: 2.20 time: 1.253025 Oct 18 13:37:25.443235 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2469/4670] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:24 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1406 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:25.557678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-742dfeb9-0a53-4bbd-86fb-0aa7fbd0a70d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:25.566820 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-742dfeb9-0a53-4bbd-86fb-0aa7fbd0a70d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1317 microversion: 2.1 time: 0.252251 Oct 18 13:37:25.567416 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2202/4671] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:25 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:25.700667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a9ce3eb0-c919-460f-8575-fd014bd27143 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:25.701817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a9ce3eb0-c919-460f-8575-fd014bd27143 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:25.722155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9ce3eb0-c919-460f-8575-fd014bd27143 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:25.723138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9ce3eb0-c919-460f-8575-fd014bd27143 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:25.723790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9ce3eb0-c919-460f-8575-fd014bd27143 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:25.727875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9ce3eb0-c919-460f-8575-fd014bd27143 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:25.729567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9ce3eb0-c919-460f-8575-fd014bd27143 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:25.730393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9ce3eb0-c919-460f-8575-fd014bd27143 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:25.775998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:25.922353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a9ce3eb0-c919-460f-8575-fd014bd27143 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:25.943549 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a9ce3eb0-c919-460f-8575-fd014bd27143 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1287 microversion: 2.1 time: 0.247452 Oct 18 13:37:25.944839 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2470/4672] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:25 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1287 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:26.047762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bf43e27c-6e6b-47c3-83c4-086be0066318 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:26.047762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bf43e27c-6e6b-47c3-83c4-086be0066318 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:26.057877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf43e27c-6e6b-47c3-83c4-086be0066318 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:26.058490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf43e27c-6e6b-47c3-83c4-086be0066318 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:26.058951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf43e27c-6e6b-47c3-83c4-086be0066318 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:26.063153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf43e27c-6e6b-47c3-83c4-086be0066318 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:26.063882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf43e27c-6e6b-47c3-83c4-086be0066318 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:26.064587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf43e27c-6e6b-47c3-83c4-086be0066318 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:26.132588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d06f531-366f-4a67-b2c0-17c8394203b3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617c6cdc0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:26.231306 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d06f531-366f-4a67-b2c0-17c8394203b3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1451 microversion: 2.1 time: 0.095621 Oct 18 13:37:26.239826 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2471/4673] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:26 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1451 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:26.333093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bf43e27c-6e6b-47c3-83c4-086be0066318 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:26.342889 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bf43e27c-6e6b-47c3-83c4-086be0066318 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.304109 Oct 18 13:37:26.357232 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2203/4674] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:26 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:26.472068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8392375f-4e9e-4322-b7ab-9d38db1d3c71 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:26.473510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8392375f-4e9e-4322-b7ab-9d38db1d3c71 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:26.486217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8392375f-4e9e-4322-b7ab-9d38db1d3c71 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:26.486959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8392375f-4e9e-4322-b7ab-9d38db1d3c71 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:26.487579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8392375f-4e9e-4322-b7ab-9d38db1d3c71 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:26.488783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8392375f-4e9e-4322-b7ab-9d38db1d3c71 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:26.489600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8392375f-4e9e-4322-b7ab-9d38db1d3c71 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:26.503796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8392375f-4e9e-4322-b7ab-9d38db1d3c71 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:26.595801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d18cbf74-0028-4170-a51d-ec6b0befc7d7 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:26.596421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d18cbf74-0028-4170-a51d-ec6b0befc7d7 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:26.604672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d18cbf74-0028-4170-a51d-ec6b0befc7d7 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:26.605163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d18cbf74-0028-4170-a51d-ec6b0befc7d7 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:26.605883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d18cbf74-0028-4170-a51d-ec6b0befc7d7 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:26.606910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d18cbf74-0028-4170-a51d-ec6b0befc7d7 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:26.607369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d18cbf74-0028-4170-a51d-ec6b0befc7d7 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:26.607799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d18cbf74-0028-4170-a51d-ec6b0befc7d7 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:26.829802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d18cbf74-0028-4170-a51d-ec6b0befc7d7 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:26.846371 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d18cbf74-0028-4170-a51d-ec6b0befc7d7 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1506 microversion: 2.1 time: 0.254754 Oct 18 13:37:26.863975 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2204/4675] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:26 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:26.879405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-83227247-4064-451a-bb98-cf21f8840469 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27047369-c2b6-4b04-a83f-7cc688803036"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:26.881890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-83227247-4064-451a-bb98-cf21f8840469 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:26.891449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83227247-4064-451a-bb98-cf21f8840469 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:26.891943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83227247-4064-451a-bb98-cf21f8840469 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:26.892384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83227247-4064-451a-bb98-cf21f8840469 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:26.893166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83227247-4064-451a-bb98-cf21f8840469 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:26.893692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83227247-4064-451a-bb98-cf21f8840469 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:26.894122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83227247-4064-451a-bb98-cf21f8840469 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:27.559543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8392375f-4e9e-4322-b7ab-9d38db1d3c71 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:27.570221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8392375f-4e9e-4322-b7ab-9d38db1d3c71 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:27.572708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8392375f-4e9e-4322-b7ab-9d38db1d3c71 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:27.574207 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8392375f-4e9e-4322-b7ab-9d38db1d3c71 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1406 microversion: 2.20 time: 1.112081 Oct 18 13:37:27.575330 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2472/4676] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:26 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1406 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:27.581676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e94ca48d-b26c-4423-8e70-7ddc070f2367 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:27.583050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e94ca48d-b26c-4423-8e70-7ddc070f2367 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:27.589963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e94ca48d-b26c-4423-8e70-7ddc070f2367 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:27.591542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e94ca48d-b26c-4423-8e70-7ddc070f2367 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:27.592392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e94ca48d-b26c-4423-8e70-7ddc070f2367 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:27.593380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e94ca48d-b26c-4423-8e70-7ddc070f2367 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:27.595336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e94ca48d-b26c-4423-8e70-7ddc070f2367 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:27.596571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e94ca48d-b26c-4423-8e70-7ddc070f2367 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:27.625763 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-83227247-4064-451a-bb98-cf21f8840469 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "POST /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.759998 Oct 18 13:37:27.629300 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2205/4677] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:37:26 2022] POST /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/os-volume_attachments => generated 194 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:27.638976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2517676c-cfed-45a5-8b5c-e32a2bdd7e55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:27.642183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2517676c-cfed-45a5-8b5c-e32a2bdd7e55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:27.666051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2517676c-cfed-45a5-8b5c-e32a2bdd7e55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:27.666556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2517676c-cfed-45a5-8b5c-e32a2bdd7e55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:27.667996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2517676c-cfed-45a5-8b5c-e32a2bdd7e55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:27.668725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2517676c-cfed-45a5-8b5c-e32a2bdd7e55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:27.669300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2517676c-cfed-45a5-8b5c-e32a2bdd7e55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:27.669622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2517676c-cfed-45a5-8b5c-e32a2bdd7e55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:27.673299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e94ca48d-b26c-4423-8e70-7ddc070f2367 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:27.679002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:27.687408 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e94ca48d-b26c-4423-8e70-7ddc070f2367 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9/os-instance-actions/req-a253e979-c290-41ce-8df0-a08c573c1283" status: 200 len: 313 microversion: 2.1 time: 0.107884 Oct 18 13:37:27.693618 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2473/4678] 10.222.0.40 () {58 vars in 1419 bytes} [Tue Oct 18 13:37:27 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9/os-instance-actions/req-a253e979-c290-41ce-8df0-a08c573c1283 => generated 313 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:27.701441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-856faa84-f971-47cf-8515-521389c1382c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f1e9790>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:27.806059 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-856faa84-f971-47cf-8515-521389c1382c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1460 microversion: 2.1 time: 0.098596 Oct 18 13:37:27.807465 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2474/4679] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:27 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1460 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:27.814931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f7a64b75-a910-4728-a42f-b594a6bfbfbc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:27.815769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f7a64b75-a910-4728-a42f-b594a6bfbfbc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:27.830555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7a64b75-a910-4728-a42f-b594a6bfbfbc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:27.831049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7a64b75-a910-4728-a42f-b594a6bfbfbc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:27.833445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7a64b75-a910-4728-a42f-b594a6bfbfbc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:27.836074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7a64b75-a910-4728-a42f-b594a6bfbfbc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:27.836763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7a64b75-a910-4728-a42f-b594a6bfbfbc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:27.838016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7a64b75-a910-4728-a42f-b594a6bfbfbc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.003067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2517676c-cfed-45a5-8b5c-e32a2bdd7e55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:28.011623 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2517676c-cfed-45a5-8b5c-e32a2bdd7e55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1329 microversion: 2.1 time: 0.380503 Oct 18 13:37:28.012225 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2206/4680] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:27 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1329 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:28.017043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d829cd6f-d765-4663-8449-2b9f6a236e76 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:28.019554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d829cd6f-d765-4663-8449-2b9f6a236e76 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:28.027047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d829cd6f-d765-4663-8449-2b9f6a236e76 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.027731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d829cd6f-d765-4663-8449-2b9f6a236e76 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.028324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d829cd6f-d765-4663-8449-2b9f6a236e76 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.029226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d829cd6f-d765-4663-8449-2b9f6a236e76 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.029824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d829cd6f-d765-4663-8449-2b9f6a236e76 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.030395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d829cd6f-d765-4663-8449-2b9f6a236e76 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.125258 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d829cd6f-d765-4663-8449-2b9f6a236e76 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "POST /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9/action" status: 202 len: 0 microversion: 2.1 time: 0.111498 Oct 18 13:37:28.126536 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2207/4681] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:37:28 2022] POST /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:37:28.134133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bab7b88c-06fe-4d76-844a-c2ce9282b9a0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e81da60>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:28.191404 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bab7b88c-06fe-4d76-844a-c2ce9282b9a0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 200 len: 1460 microversion: 2.1 time: 0.063176 Oct 18 13:37:28.192496 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2208/4682] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:28 2022] GET /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 1460 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:28.206671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-198ff13c-612d-473c-b456-02f5bd99d18d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:28.207405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-198ff13c-612d-473c-b456-02f5bd99d18d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:28.215690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-198ff13c-612d-473c-b456-02f5bd99d18d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.215690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-198ff13c-612d-473c-b456-02f5bd99d18d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.215690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-198ff13c-612d-473c-b456-02f5bd99d18d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.216491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-198ff13c-612d-473c-b456-02f5bd99d18d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.217144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-198ff13c-612d-473c-b456-02f5bd99d18d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.218046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-198ff13c-612d-473c-b456-02f5bd99d18d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.419242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f7a64b75-a910-4728-a42f-b594a6bfbfbc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:28.434759 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f7a64b75-a910-4728-a42f-b594a6bfbfbc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.625377 Oct 18 13:37:28.451643 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2475/4683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:27 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:28.461606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-da34f309-c380-49ef-983b-3532688cb81d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:28.463708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-da34f309-c380-49ef-983b-3532688cb81d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:28.483483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da34f309-c380-49ef-983b-3532688cb81d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.483985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da34f309-c380-49ef-983b-3532688cb81d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.484428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da34f309-c380-49ef-983b-3532688cb81d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.485152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da34f309-c380-49ef-983b-3532688cb81d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.485635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da34f309-c380-49ef-983b-3532688cb81d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.486064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da34f309-c380-49ef-983b-3532688cb81d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.823079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-198ff13c-612d-473c-b456-02f5bd99d18d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:28.831488 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-198ff13c-612d-473c-b456-02f5bd99d18d tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1508 microversion: 2.1 time: 0.632411 Oct 18 13:37:28.832062 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2209/4684] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:28 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1508 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:28.856338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9ca2bc57-c813-4146-b89a-d7a7d17c84ec tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:28.856962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9ca2bc57-c813-4146-b89a-d7a7d17c84ec tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:28.865867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ca2bc57-c813-4146-b89a-d7a7d17c84ec tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.868698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ca2bc57-c813-4146-b89a-d7a7d17c84ec tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.870179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ca2bc57-c813-4146-b89a-d7a7d17c84ec tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:28.871107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ca2bc57-c813-4146-b89a-d7a7d17c84ec tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:28.873008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ca2bc57-c813-4146-b89a-d7a7d17c84ec tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:28.875518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ca2bc57-c813-4146-b89a-d7a7d17c84ec tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:29.107740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-da34f309-c380-49ef-983b-3532688cb81d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:29.124361 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-da34f309-c380-49ef-983b-3532688cb81d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456" status: 200 len: 1480 microversion: 2.1 time: 0.669931 Oct 18 13:37:29.131040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9ca2bc57-c813-4146-b89a-d7a7d17c84ec tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:29.148525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9ca2bc57-c813-4146-b89a-d7a7d17c84ec tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:29.151670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9ca2bc57-c813-4146-b89a-d7a7d17c84ec tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:29.163858 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9ca2bc57-c813-4146-b89a-d7a7d17c84ec tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1406 microversion: 2.20 time: 0.325740 Oct 18 13:37:29.165466 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2210/4685] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:28 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:29.170485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a59f17dd-b745-4e45-a1ff-64c9f3ba5818 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:29.171499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a59f17dd-b745-4e45-a1ff-64c9f3ba5818 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:29.171635 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2476/4686] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:28 2022] GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456 => generated 1480 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:29.184754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a59f17dd-b745-4e45-a1ff-64c9f3ba5818 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:29.187599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a59f17dd-b745-4e45-a1ff-64c9f3ba5818 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:29.187906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a59f17dd-b745-4e45-a1ff-64c9f3ba5818 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:29.188639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a59f17dd-b745-4e45-a1ff-64c9f3ba5818 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:29.190201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a59f17dd-b745-4e45-a1ff-64c9f3ba5818 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:29.190640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a59f17dd-b745-4e45-a1ff-64c9f3ba5818 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:29.427546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f9d329b8-f1ac-4838-98c0-522a3ae633c5 req-395be9c1-cc8a-4937-9839-7a44c04f58c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "768feeae-e6f3-4013-a7a9-e69e0bd15a58", "tag": "b3076d90-5db4-402d-9177-41b1a6988b3b"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:29.454866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f9d329b8-f1ac-4838-98c0-522a3ae633c5 req-395be9c1-cc8a-4937-9839-7a44c04f58c9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:29.458632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f9d329b8-f1ac-4838-98c0-522a3ae633c5 req-395be9c1-cc8a-4937-9839-7a44c04f58c9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:29.460949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f9d329b8-f1ac-4838-98c0-522a3ae633c5 req-395be9c1-cc8a-4937-9839-7a44c04f58c9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:29.484169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a59f17dd-b745-4e45-a1ff-64c9f3ba5818 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:29.497671 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a59f17dd-b745-4e45-a1ff-64c9f3ba5818 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1329 microversion: 2.1 time: 0.329624 Oct 18 13:37:29.498811 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2211/4687] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:29 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1329 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:29.501608 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f9d329b8-f1ac-4838-98c0-522a3ae633c5 req-395be9c1-cc8a-4937-9839-7a44c04f58c9 service nova] Creating event network-changed:b3076d90-5db4-402d-9177-41b1a6988b3b for instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 on n-h2-858384-13 Oct 18 13:37:29.507912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f810a455-85f4-4cc4-9b45-0559d078b301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:29.512753 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f9d329b8-f1ac-4838-98c0-522a3ae633c5 req-395be9c1-cc8a-4937-9839-7a44c04f58c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089384 Oct 18 13:37:29.513402 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2477/4688] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:37:29.514118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f810a455-85f4-4cc4-9b45-0559d078b301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:29.530358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f810a455-85f4-4cc4-9b45-0559d078b301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:29.532013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f810a455-85f4-4cc4-9b45-0559d078b301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:29.533327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f810a455-85f4-4cc4-9b45-0559d078b301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:29.534926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f810a455-85f4-4cc4-9b45-0559d078b301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:29.537751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f810a455-85f4-4cc4-9b45-0559d078b301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:29.539243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f810a455-85f4-4cc4-9b45-0559d078b301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:29.858718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db264a05-8ff0-4a5e-8632-b539879d2bca tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:29.859682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db264a05-8ff0-4a5e-8632-b539879d2bca tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:29.876740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db264a05-8ff0-4a5e-8632-b539879d2bca tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:29.877709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db264a05-8ff0-4a5e-8632-b539879d2bca tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:29.879045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db264a05-8ff0-4a5e-8632-b539879d2bca tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:29.881212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db264a05-8ff0-4a5e-8632-b539879d2bca tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:29.884599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db264a05-8ff0-4a5e-8632-b539879d2bca tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:29.885680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db264a05-8ff0-4a5e-8632-b539879d2bca tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:30.022979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f810a455-85f4-4cc4-9b45-0559d078b301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:30.032585 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f810a455-85f4-4cc4-9b45-0559d078b301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.531531 Oct 18 13:37:30.041604 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2212/4689] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:29 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:30.051130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:30.112310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=14 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:30.147780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-81f574e5-50b2-4790-a746-d9282bdde4cc tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:30.148990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-81f574e5-50b2-4790-a746-d9282bdde4cc tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:30.158535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81f574e5-50b2-4790-a746-d9282bdde4cc tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:30.162613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81f574e5-50b2-4790-a746-d9282bdde4cc tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:30.163935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81f574e5-50b2-4790-a746-d9282bdde4cc tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:30.170001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81f574e5-50b2-4790-a746-d9282bdde4cc tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:30.170895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81f574e5-50b2-4790-a746-d9282bdde4cc tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:30.173074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81f574e5-50b2-4790-a746-d9282bdde4cc tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:30.425778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-81f574e5-50b2-4790-a746-d9282bdde4cc tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:30.436387 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-81f574e5-50b2-4790-a746-d9282bdde4cc tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456" status: 200 len: 1467 microversion: 2.1 time: 0.292337 Oct 18 13:37:30.439522 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2213/4690] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:30 2022] GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456 => generated 1467 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:30.543131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-20309bf3-28be-4254-9dff-1153d43c1dcc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:30.543982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-20309bf3-28be-4254-9dff-1153d43c1dcc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:30.552364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20309bf3-28be-4254-9dff-1153d43c1dcc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:30.553132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20309bf3-28be-4254-9dff-1153d43c1dcc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:30.553849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20309bf3-28be-4254-9dff-1153d43c1dcc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:30.556235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20309bf3-28be-4254-9dff-1153d43c1dcc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:30.556973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20309bf3-28be-4254-9dff-1153d43c1dcc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:30.558004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20309bf3-28be-4254-9dff-1153d43c1dcc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:30.714550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db264a05-8ff0-4a5e-8632-b539879d2bca tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:30.726122 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db264a05-8ff0-4a5e-8632-b539879d2bca tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1508 microversion: 2.1 time: 0.871693 Oct 18 13:37:30.727637 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2478/4691] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:29 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1508 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:30.741412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4f7057ed-026a-4ffd-9593-0f47010b79c0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-281984668"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:30.744351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4f7057ed-026a-4ffd-9593-0f47010b79c0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:30.761102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f7057ed-026a-4ffd-9593-0f47010b79c0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:30.761649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f7057ed-026a-4ffd-9593-0f47010b79c0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:30.762094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f7057ed-026a-4ffd-9593-0f47010b79c0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:30.762809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f7057ed-026a-4ffd-9593-0f47010b79c0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:30.763270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f7057ed-026a-4ffd-9593-0f47010b79c0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:30.763707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f7057ed-026a-4ffd-9593-0f47010b79c0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:30.826388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=24 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:31.089391 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4f7057ed-026a-4ffd-9593-0f47010b79c0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "POST /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3/action" status: 202 len: 0 microversion: 2.1 time: 0.360265 Oct 18 13:37:31.090891 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2479/4692] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:37:30 2022] POST /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:37:31.103228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-22cf8053-3a61-4633-81d1-475a9cdaf30d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:31.113657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-22cf8053-3a61-4633-81d1-475a9cdaf30d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:31.126902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22cf8053-3a61-4633-81d1-475a9cdaf30d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.129024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22cf8053-3a61-4633-81d1-475a9cdaf30d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.129790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22cf8053-3a61-4633-81d1-475a9cdaf30d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:31.131014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22cf8053-3a61-4633-81d1-475a9cdaf30d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.131407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22cf8053-3a61-4633-81d1-475a9cdaf30d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.132926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22cf8053-3a61-4633-81d1-475a9cdaf30d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:31.185431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-20309bf3-28be-4254-9dff-1153d43c1dcc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:31.200701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-20309bf3-28be-4254-9dff-1153d43c1dcc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:31.202194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-20309bf3-28be-4254-9dff-1153d43c1dcc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:31.214603 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-20309bf3-28be-4254-9dff-1153d43c1dcc tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1406 microversion: 2.20 time: 0.764298 Oct 18 13:37:31.230112 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2214/4693] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:30 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1406 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:31.230112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a6364d6f-509a-4f43-8fd7-084f0e5bce14 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:31.230112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a6364d6f-509a-4f43-8fd7-084f0e5bce14 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:31.234862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a6364d6f-509a-4f43-8fd7-084f0e5bce14 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.235022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a6364d6f-509a-4f43-8fd7-084f0e5bce14 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.235970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a6364d6f-509a-4f43-8fd7-084f0e5bce14 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:31.245895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a6364d6f-509a-4f43-8fd7-084f0e5bce14 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.248519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a6364d6f-509a-4f43-8fd7-084f0e5bce14 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.249761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a6364d6f-509a-4f43-8fd7-084f0e5bce14 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:31.385130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-22cf8053-3a61-4633-81d1-475a9cdaf30d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:31.394569 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-22cf8053-3a61-4633-81d1-475a9cdaf30d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1329 microversion: 2.1 time: 0.302028 Oct 18 13:37:31.398753 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2480/4694] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:31 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1329 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:31.411756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4fd29566-57a7-4252-bb17-d7934e8900ff tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f0af1f0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:31.482912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a6364d6f-509a-4f43-8fd7-084f0e5bce14 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:31.494427 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a6364d6f-509a-4f43-8fd7-084f0e5bce14 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.277604 Oct 18 13:37:31.496750 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2215/4695] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:31 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:31.502505 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4fd29566-57a7-4252-bb17-d7934e8900ff tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.096506 Oct 18 13:37:31.512041 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2481/4696] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:31 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:31.591639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-92cef5f8-1d85-41fc-a9c1-542de485da1a req-457ad725-3567-4e32-885f-e2d2f23952c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c563a787-e0b9-4e58-a44c-dde199eba836", "tag": "d32b7970-b8d0-4343-9264-5409d93513d3"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:31.604724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-92cef5f8-1d85-41fc-a9c1-542de485da1a req-457ad725-3567-4e32-885f-e2d2f23952c2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.605224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-92cef5f8-1d85-41fc-a9c1-542de485da1a req-457ad725-3567-4e32-885f-e2d2f23952c2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.605665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-92cef5f8-1d85-41fc-a9c1-542de485da1a req-457ad725-3567-4e32-885f-e2d2f23952c2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:31.645580 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-92cef5f8-1d85-41fc-a9c1-542de485da1a req-457ad725-3567-4e32-885f-e2d2f23952c2 service nova] Creating event network-changed:d32b7970-b8d0-4343-9264-5409d93513d3 for instance c563a787-e0b9-4e58-a44c-dde199eba836 on n-h1-858384-13 Oct 18 13:37:31.654362 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-92cef5f8-1d85-41fc-a9c1-542de485da1a req-457ad725-3567-4e32-885f-e2d2f23952c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066318 Oct 18 13:37:31.655936 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2216/4697] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:31.679481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d77477b7-7189-46c4-887a-6ef55f9ba14a req-722d6d16-16a1-48fe-833d-17784d4de8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c5c389-b7a1-4170-9b5c-321066d048e1", "name": "network-vif-plugged", "status": "completed", "tag": "74f52242-e00e-46f0-a3ba-47fe1d3cac8e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:31.692453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:31.706607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d77477b7-7189-46c4-887a-6ef55f9ba14a req-722d6d16-16a1-48fe-833d-17784d4de8dd service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.707342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d77477b7-7189-46c4-887a-6ef55f9ba14a req-722d6d16-16a1-48fe-833d-17784d4de8dd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.708182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d77477b7-7189-46c4-887a-6ef55f9ba14a req-722d6d16-16a1-48fe-833d-17784d4de8dd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:31.737507 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d77477b7-7189-46c4-887a-6ef55f9ba14a req-722d6d16-16a1-48fe-833d-17784d4de8dd service nova] Creating event network-vif-plugged:74f52242-e00e-46f0-a3ba-47fe1d3cac8e for instance 31c5c389-b7a1-4170-9b5c-321066d048e1 on n-h1-858384-13 Oct 18 13:37:31.746726 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d77477b7-7189-46c4-887a-6ef55f9ba14a req-722d6d16-16a1-48fe-833d-17784d4de8dd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070593 Oct 18 13:37:31.747889 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2482/4698] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:31.755855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ada6ec13-a5d3-4eda-8b52-3d8773761156 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:31.756577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ada6ec13-a5d3-4eda-8b52-3d8773761156 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:31.766960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ada6ec13-a5d3-4eda-8b52-3d8773761156 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.767335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ada6ec13-a5d3-4eda-8b52-3d8773761156 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.767911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ada6ec13-a5d3-4eda-8b52-3d8773761156 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:31.769706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ada6ec13-a5d3-4eda-8b52-3d8773761156 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:31.770248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ada6ec13-a5d3-4eda-8b52-3d8773761156 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:31.770734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ada6ec13-a5d3-4eda-8b52-3d8773761156 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.249015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-baa19727-3594-4948-981b-534ec120aea8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:32.249751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-baa19727-3594-4948-981b-534ec120aea8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:32.255969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ada6ec13-a5d3-4eda-8b52-3d8773761156 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:32.259541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baa19727-3594-4948-981b-534ec120aea8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.260040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baa19727-3594-4948-981b-534ec120aea8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.260503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baa19727-3594-4948-981b-534ec120aea8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.261237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baa19727-3594-4948-981b-534ec120aea8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.261702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baa19727-3594-4948-981b-534ec120aea8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.262133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baa19727-3594-4948-981b-534ec120aea8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.269538 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ada6ec13-a5d3-4eda-8b52-3d8773761156 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1506 microversion: 2.1 time: 0.521570 Oct 18 13:37:32.270249 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2217/4699] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:31 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:32.297581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6d70ee0e-87f0-482d-add0-bb72baac2a69 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '.version_select at 0x7ff60e7d71f0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:32.298138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6d70ee0e-87f0-482d-add0-bb72baac2a69 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:32.304452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d70ee0e-87f0-482d-add0-bb72baac2a69 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.305292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d70ee0e-87f0-482d-add0-bb72baac2a69 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.305960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d70ee0e-87f0-482d-add0-bb72baac2a69 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.307156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d70ee0e-87f0-482d-add0-bb72baac2a69 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.307741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d70ee0e-87f0-482d-add0-bb72baac2a69 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.308167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d70ee0e-87f0-482d-add0-bb72baac2a69 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.352881 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6d70ee0e-87f0-482d-add0-bb72baac2a69 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.061069 Oct 18 13:37:32.353800 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2218/4700] 10.222.0.40 () {58 vars in 1296 bytes} [Tue Oct 18 13:37:32 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9/os-instance-actions => generated 611 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:32.375750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-88560d5d-c357-4369-83a4-c4c40b9218e1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:32.377198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-88560d5d-c357-4369-83a4-c4c40b9218e1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:32.391707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88560d5d-c357-4369-83a4-c4c40b9218e1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.394346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88560d5d-c357-4369-83a4-c4c40b9218e1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.394837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88560d5d-c357-4369-83a4-c4c40b9218e1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.395571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88560d5d-c357-4369-83a4-c4c40b9218e1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.400423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88560d5d-c357-4369-83a4-c4c40b9218e1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.400423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88560d5d-c357-4369-83a4-c4c40b9218e1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.426531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-baa19727-3594-4948-981b-534ec120aea8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:32.438171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-88560d5d-c357-4369-83a4-c4c40b9218e1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:37:32.441339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-baa19727-3594-4948-981b-534ec120aea8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:32.443519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-baa19727-3594-4948-981b-534ec120aea8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:32.444785 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-baa19727-3594-4948-981b-534ec120aea8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1406 microversion: 2.20 time: 0.201154 Oct 18 13:37:32.458037 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2483/4701] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:32 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:32.473289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93576a69-0864-4148-a4b7-9fe447efecaa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:32.473936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-93576a69-0864-4148-a4b7-9fe447efecaa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:32.482215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93576a69-0864-4148-a4b7-9fe447efecaa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.483429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93576a69-0864-4148-a4b7-9fe447efecaa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.484071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93576a69-0864-4148-a4b7-9fe447efecaa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.484649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93576a69-0864-4148-a4b7-9fe447efecaa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.485083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93576a69-0864-4148-a4b7-9fe447efecaa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.485543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93576a69-0864-4148-a4b7-9fe447efecaa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.553625 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-88560d5d-c357-4369-83a4-c4c40b9218e1 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "DELETE /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 204 len: 0 microversion: 2.1 time: 0.186888 Oct 18 13:37:32.554750 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2219/4702] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:32 2022] DELETE /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:37:32.563060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f259495f-f55d-49d9-9056-8db6289e7d98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:32.563752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f259495f-f55d-49d9-9056-8db6289e7d98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:32.571212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f259495f-f55d-49d9-9056-8db6289e7d98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.571954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f259495f-f55d-49d9-9056-8db6289e7d98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.572703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f259495f-f55d-49d9-9056-8db6289e7d98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.573690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f259495f-f55d-49d9-9056-8db6289e7d98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.574512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f259495f-f55d-49d9-9056-8db6289e7d98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.574940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f259495f-f55d-49d9-9056-8db6289e7d98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.659484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-93576a69-0864-4148-a4b7-9fe447efecaa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:32.672772 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-93576a69-0864-4148-a4b7-9fe447efecaa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1329 microversion: 2.1 time: 0.213359 Oct 18 13:37:32.673897 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2484/4703] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:32 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1329 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:32.679539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f6d33236-4d32-4d4a-958c-866327098f99 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ebd0790>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:32.744610 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f6d33236-4d32-4d4a-958c-866327098f99 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.069011 Oct 18 13:37:32.745257 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2485/4704] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:32 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:32.750756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f259495f-f55d-49d9-9056-8db6289e7d98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:32.754504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-760d3338-0f06-482b-ab06-147faf2f4098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:32.756517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-760d3338-0f06-482b-ab06-147faf2f4098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:32.761500 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f259495f-f55d-49d9-9056-8db6289e7d98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.205030 Oct 18 13:37:32.762096 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2220/4705] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:32 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:32.763556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-760d3338-0f06-482b-ab06-147faf2f4098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.764036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-760d3338-0f06-482b-ab06-147faf2f4098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.764664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-760d3338-0f06-482b-ab06-147faf2f4098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.765562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-760d3338-0f06-482b-ab06-147faf2f4098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:32.766166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-760d3338-0f06-482b-ab06-147faf2f4098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:32.766751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-760d3338-0f06-482b-ab06-147faf2f4098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:32.780604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f259495f-f55d-49d9-9056-8db6289e7d98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:32.781912 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f259495f-f55d-49d9-9056-8db6289e7d98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001630 Oct 18 13:37:32.782705 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2221/4706] 10.222.0.40 () {56 vars in 886 bytes} [Tue Oct 18 13:37:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 18 13:37:32.929206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-760d3338-0f06-482b-ab06-147faf2f4098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:32.939096 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-760d3338-0f06-482b-ab06-147faf2f4098 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1512 microversion: 2.1 time: 0.192368 Oct 18 13:37:32.940030 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2486/4707] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:32 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1512 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:33.472909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad2007d6-73b3-4248-8180-a0ecd5573b76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:33.473644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ad2007d6-73b3-4248-8180-a0ecd5573b76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:33.480895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad2007d6-73b3-4248-8180-a0ecd5573b76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:33.481431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad2007d6-73b3-4248-8180-a0ecd5573b76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:33.481904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad2007d6-73b3-4248-8180-a0ecd5573b76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:33.482573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad2007d6-73b3-4248-8180-a0ecd5573b76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:33.483319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad2007d6-73b3-4248-8180-a0ecd5573b76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:33.483709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad2007d6-73b3-4248-8180-a0ecd5573b76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:33.661043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad2007d6-73b3-4248-8180-a0ecd5573b76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:33.663542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:33.673573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad2007d6-73b3-4248-8180-a0ecd5573b76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:33.675025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad2007d6-73b3-4248-8180-a0ecd5573b76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:33.676160 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad2007d6-73b3-4248-8180-a0ecd5573b76 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1406 microversion: 2.20 time: 0.208431 Oct 18 13:37:33.676805 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2222/4708] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:33 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:33.696323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-28381fdf-c563-435d-8d57-1020a39ab737 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:33.697557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-28381fdf-c563-435d-8d57-1020a39ab737 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:33.704852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28381fdf-c563-435d-8d57-1020a39ab737 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:33.705588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28381fdf-c563-435d-8d57-1020a39ab737 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:33.706204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28381fdf-c563-435d-8d57-1020a39ab737 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:33.707071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28381fdf-c563-435d-8d57-1020a39ab737 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:33.707680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28381fdf-c563-435d-8d57-1020a39ab737 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:33.708259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28381fdf-c563-435d-8d57-1020a39ab737 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:33.760378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bc52c096-7f36-4ce9-b79f-b6dc75d5a64f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7f9a60>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:33.826368 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bc52c096-7f36-4ce9-b79f-b6dc75d5a64f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.070230 Oct 18 13:37:33.827106 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2223/4709] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:33 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:33.831710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ef68a96d-013b-4b75-b0ab-442c1206127b req-b456f55d-1005-4a6e-8cc9-62bdc20e1ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fe15a4-7bd7-40e0-860a-e0769bf38456", "name": "network-vif-unplugged", "status": "completed", "tag": "4c03f362-7416-4c8f-8537-5657edf6a795"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:33.857162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ef68a96d-013b-4b75-b0ab-442c1206127b req-b456f55d-1005-4a6e-8cc9-62bdc20e1ab5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:33.857666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ef68a96d-013b-4b75-b0ab-442c1206127b req-b456f55d-1005-4a6e-8cc9-62bdc20e1ab5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:33.858101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ef68a96d-013b-4b75-b0ab-442c1206127b req-b456f55d-1005-4a6e-8cc9-62bdc20e1ab5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:33.880853 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ef68a96d-013b-4b75-b0ab-442c1206127b req-b456f55d-1005-4a6e-8cc9-62bdc20e1ab5 service nova] Creating event network-vif-unplugged:4c03f362-7416-4c8f-8537-5657edf6a795 for instance b9fe15a4-7bd7-40e0-860a-e0769bf38456 on n-h1-858384-13 Oct 18 13:37:33.898542 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ef68a96d-013b-4b75-b0ab-442c1206127b req-b456f55d-1005-4a6e-8cc9-62bdc20e1ab5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065238 Oct 18 13:37:33.898542 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2224/4710] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:33.901400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-28381fdf-c563-435d-8d57-1020a39ab737 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:33.906744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d4af7f21-6a8d-417c-8c6a-af0f35469111 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:33.907455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d4af7f21-6a8d-417c-8c6a-af0f35469111 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:33.910925 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-28381fdf-c563-435d-8d57-1020a39ab737 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1329 microversion: 2.1 time: 0.218473 Oct 18 13:37:33.913802 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2487/4711] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:33 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1329 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:33.920963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4af7f21-6a8d-417c-8c6a-af0f35469111 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:33.921533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4af7f21-6a8d-417c-8c6a-af0f35469111 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:33.921958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4af7f21-6a8d-417c-8c6a-af0f35469111 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:33.922655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4af7f21-6a8d-417c-8c6a-af0f35469111 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:33.923100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4af7f21-6a8d-417c-8c6a-af0f35469111 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:33.923524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4af7f21-6a8d-417c-8c6a-af0f35469111 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:33.963228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-872c3029-b4e7-4bce-9995-c08409d4f740 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:33.963755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-872c3029-b4e7-4bce-9995-c08409d4f740 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:33.970762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-872c3029-b4e7-4bce-9995-c08409d4f740 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:33.971644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-872c3029-b4e7-4bce-9995-c08409d4f740 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:33.972275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-872c3029-b4e7-4bce-9995-c08409d4f740 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:33.973218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-872c3029-b4e7-4bce-9995-c08409d4f740 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:33.973862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-872c3029-b4e7-4bce-9995-c08409d4f740 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:33.974475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-872c3029-b4e7-4bce-9995-c08409d4f740 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:34.111141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d4af7f21-6a8d-417c-8c6a-af0f35469111 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:34.123161 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d4af7f21-6a8d-417c-8c6a-af0f35469111 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1522 microversion: 2.1 time: 0.224517 Oct 18 13:37:34.124142 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2225/4712] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:33 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:34.214609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-872c3029-b4e7-4bce-9995-c08409d4f740 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:34.224993 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-872c3029-b4e7-4bce-9995-c08409d4f740 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1512 microversion: 2.1 time: 0.265707 Oct 18 13:37:34.240960 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2488/4713] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:33 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:34.532779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0af5b8da-4b27-4e15-91a4-e8fac0f4cba5 tempest-ExtensionsTest-2083084159 tempest-ExtensionsTest-2083084159-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:34.538438 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0af5b8da-4b27-4e15-91a4-e8fac0f4cba5 tempest-ExtensionsTest-2083084159 tempest-ExtensionsTest-2083084159-project] 10.222.0.40 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.156173 Oct 18 13:37:34.540679 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2226/4714] 10.222.0.40 () {58 vars in 1170 bytes} [Tue Oct 18 13:37:34 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:34.550157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6336294c-bf4d-40e0-97ab-f124f4b5181c tempest-ExtensionsTest-2083084159 tempest-ExtensionsTest-2083084159-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:34.552520 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6336294c-bf4d-40e0-97ab-f124f4b5181c tempest-ExtensionsTest-2083084159 tempest-ExtensionsTest-2083084159-project] 10.222.0.40 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006420 Oct 18 13:37:34.553660 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2489/4715] 10.222.0.40 () {58 vars in 1134 bytes} [Tue Oct 18 13:37:34 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:37:34.703628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-abfa731c-1f30-4311-85e4-7aa0d33ffac4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:34.704232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-abfa731c-1f30-4311-85e4-7aa0d33ffac4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:34.710434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abfa731c-1f30-4311-85e4-7aa0d33ffac4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:34.710910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abfa731c-1f30-4311-85e4-7aa0d33ffac4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:34.711372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abfa731c-1f30-4311-85e4-7aa0d33ffac4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:34.712090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abfa731c-1f30-4311-85e4-7aa0d33ffac4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:34.712626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abfa731c-1f30-4311-85e4-7aa0d33ffac4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:34.713125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abfa731c-1f30-4311-85e4-7aa0d33ffac4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:34.843184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0d7196ea-ef38-41e4-a4cc-7014dfc9d31d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f7a8310>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:34.888120 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0d7196ea-ef38-41e4-a4cc-7014dfc9d31d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.049956 Oct 18 13:37:34.889336 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2490/4716] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:34 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:34.936279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6edb447d-2144-4742-a892-920fc51bc69e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:34.937225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6edb447d-2144-4742-a892-920fc51bc69e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:34.944469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6edb447d-2144-4742-a892-920fc51bc69e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:34.944960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6edb447d-2144-4742-a892-920fc51bc69e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:34.945434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6edb447d-2144-4742-a892-920fc51bc69e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:34.946403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6edb447d-2144-4742-a892-920fc51bc69e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:34.946972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6edb447d-2144-4742-a892-920fc51bc69e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:34.947410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6edb447d-2144-4742-a892-920fc51bc69e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:34.981762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-abfa731c-1f30-4311-85e4-7aa0d33ffac4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:34.998810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-abfa731c-1f30-4311-85e4-7aa0d33ffac4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:35.000913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-abfa731c-1f30-4311-85e4-7aa0d33ffac4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:35.002377 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-abfa731c-1f30-4311-85e4-7aa0d33ffac4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1406 microversion: 2.20 time: 0.302715 Oct 18 13:37:35.003342 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2227/4717] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:34 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:35.155745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8cdc0ba9-9ecf-40a9-8b2e-ef04b40287ba tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:35.156657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8cdc0ba9-9ecf-40a9-8b2e-ef04b40287ba tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:35.168000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cdc0ba9-9ecf-40a9-8b2e-ef04b40287ba tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.169783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cdc0ba9-9ecf-40a9-8b2e-ef04b40287ba tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.170243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cdc0ba9-9ecf-40a9-8b2e-ef04b40287ba tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.171372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cdc0ba9-9ecf-40a9-8b2e-ef04b40287ba tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.172113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cdc0ba9-9ecf-40a9-8b2e-ef04b40287ba tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.172927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cdc0ba9-9ecf-40a9-8b2e-ef04b40287ba tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.185997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6edb447d-2144-4742-a892-920fc51bc69e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:35.195323 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6edb447d-2144-4742-a892-920fc51bc69e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1329 microversion: 2.1 time: 0.262895 Oct 18 13:37:35.214277 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2491/4718] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:34 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1329 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:35.248766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-508fa841-a84d-4885-96c8-31778f23d503 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:35.250553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-508fa841-a84d-4885-96c8-31778f23d503 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:35.259511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-508fa841-a84d-4885-96c8-31778f23d503 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.260294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-508fa841-a84d-4885-96c8-31778f23d503 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.260954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-508fa841-a84d-4885-96c8-31778f23d503 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.261938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-508fa841-a84d-4885-96c8-31778f23d503 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.262646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-508fa841-a84d-4885-96c8-31778f23d503 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.263294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-508fa841-a84d-4885-96c8-31778f23d503 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.428715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-508fa841-a84d-4885-96c8-31778f23d503 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ccf811bbad40ff9af7fe83173be66d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca964e337ec4473b980f9e0ea74a19ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:35.440097 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-508fa841-a84d-4885-96c8-31778f23d503 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 200 len: 1512 microversion: 2.1 time: 0.195143 Oct 18 13:37:35.441465 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2492/4719] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:35 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:35.461651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8cdc0ba9-9ecf-40a9-8b2e-ef04b40287ba tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:35.473085 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8cdc0ba9-9ecf-40a9-8b2e-ef04b40287ba tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1502 microversion: 2.1 time: 0.328285 Oct 18 13:37:35.474535 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2228/4720] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:35 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1502 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:35.501933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1771fc0e-4ef1-48ce-a9d2-4a8b85a47385 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:35.502809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1771fc0e-4ef1-48ce-a9d2-4a8b85a47385 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:35.510781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1771fc0e-4ef1-48ce-a9d2-4a8b85a47385 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.511490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1771fc0e-4ef1-48ce-a9d2-4a8b85a47385 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.512102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1771fc0e-4ef1-48ce-a9d2-4a8b85a47385 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.513018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1771fc0e-4ef1-48ce-a9d2-4a8b85a47385 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.513668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1771fc0e-4ef1-48ce-a9d2-4a8b85a47385 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.514293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1771fc0e-4ef1-48ce-a9d2-4a8b85a47385 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.519324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:35.538945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-afa85e9d-bcec-42e8-b309-10ad7e4804f9 req-121cc280-4129-4440-9230-c098677dc235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a45dbe-4f39-47a7-b117-bee5c3bc71d9", "name": "network-vif-deleted", "tag": "0686f601-3008-41be-b803-ffec39de6678"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:35.552921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-afa85e9d-bcec-42e8-b309-10ad7e4804f9 req-121cc280-4129-4440-9230-c098677dc235 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.553801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-afa85e9d-bcec-42e8-b309-10ad7e4804f9 req-121cc280-4129-4440-9230-c098677dc235 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.554440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-afa85e9d-bcec-42e8-b309-10ad7e4804f9 req-121cc280-4129-4440-9230-c098677dc235 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.570886 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-afa85e9d-bcec-42e8-b309-10ad7e4804f9 req-121cc280-4129-4440-9230-c098677dc235 service nova] Creating event network-vif-deleted:0686f601-3008-41be-b803-ffec39de6678 for instance 73a45dbe-4f39-47a7-b117-bee5c3bc71d9 on n-h2-858384-13 Oct 18 13:37:35.577614 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-afa85e9d-bcec-42e8-b309-10ad7e4804f9 req-121cc280-4129-4440-9230-c098677dc235 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043181 Oct 18 13:37:35.578758 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2229/4721] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:35.829445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1771fc0e-4ef1-48ce-a9d2-4a8b85a47385 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:35.843384 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1771fc0e-4ef1-48ce-a9d2-4a8b85a47385 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1514 microversion: 2.1 time: 0.342752 Oct 18 13:37:35.844503 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2493/4722] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:35 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1514 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:35.868843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bd67d9d2-f5a8-4892-a43f-61e495c65e6e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:35.871991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bd67d9d2-f5a8-4892-a43f-61e495c65e6e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 9dd31993-9800-479d-86df-94ee40358589] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:35.882492 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-bd67d9d2-f5a8-4892-a43f-61e495c65e6e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] HTTP exception thrown: Instance 9dd31993-9800-479d-86df-94ee40358589 could not be found. Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bd67d9d2-f5a8-4892-a43f-61e495c65e6e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Request method failure captured: Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/9dd31993-9800-479d-86df-94ee40358589/action HTTP/1.1 Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 14 Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvrqX_zkCEhVydfvHZBeTI6vdRWUcUOpxttnLcg2aIsaFsLlHnFjovxQI4kcc3Myi8lwAHRAsf2wLTn_JlgKXt7GIy8E5du_6bYylQ1wRbIaq_CdQtpXoiOxia-B1issY5UDMjn_CVSSo9PM6M7QgZo_y7FdWj0xg611rUe51cUCao Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0cdfce6f9e86407d883e624dd2c50559"}]}] Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 4113a1418b92488e97bf50aecdd49bb1 Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: {"rescue": {}} Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 9dd31993-9800-479d-86df-94ee40358589 could not be found. Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '9dd31993-9800-479d-86df-94ee40358589', 'body': {'rescue': {}}} Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd31993-9800-479d-86df-94ee40358589 could not be found. Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd31993-9800-479d-86df-94ee40358589 could not be found. Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:35.897548 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:35.903981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:35.903981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:35.903981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:35.903981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:35.903981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd31993-9800-479d-86df-94ee40358589 could not be found. Oct 18 13:37:35.903981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:35.905408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d8a80bf0-cd80-434f-a177-d8124f3e9880 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617ad5040>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:35.905812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bd67d9d2-f5a8-4892-a43f-61e495c65e6e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Returning 404 to user: Instance 9dd31993-9800-479d-86df-94ee40358589 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:35.906719 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bd67d9d2-f5a8-4892-a43f-61e495c65e6e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers/9dd31993-9800-479d-86df-94ee40358589/action" status: 404 len: 111 microversion: 2.1 time: 0.042846 Oct 18 13:37:35.907309 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2230/4723] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:37:35 2022] POST /compute/v2.1/servers/9dd31993-9800-479d-86df-94ee40358589/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:35.938979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7fe7221b-67ed-4a34-8ab3-37f36891e7df tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:35.939588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7fe7221b-67ed-4a34-8ab3-37f36891e7df tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:35.956116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fe7221b-67ed-4a34-8ab3-37f36891e7df tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.959640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fe7221b-67ed-4a34-8ab3-37f36891e7df tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.960456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fe7221b-67ed-4a34-8ab3-37f36891e7df tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.962023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fe7221b-67ed-4a34-8ab3-37f36891e7df tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:35.962957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fe7221b-67ed-4a34-8ab3-37f36891e7df tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:35.963668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fe7221b-67ed-4a34-8ab3-37f36891e7df tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:35.970972 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d8a80bf0-cd80-434f-a177-d8124f3e9880 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.070300 Oct 18 13:37:35.973338 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2494/4724] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:35 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:36.028432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9cb5d49d-4fb4-4000-995a-4b5b0743d438 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:36.029046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9cb5d49d-4fb4-4000-995a-4b5b0743d438 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:36.045866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cb5d49d-4fb4-4000-995a-4b5b0743d438 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:36.046365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cb5d49d-4fb4-4000-995a-4b5b0743d438 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:36.046803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cb5d49d-4fb4-4000-995a-4b5b0743d438 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:36.047691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cb5d49d-4fb4-4000-995a-4b5b0743d438 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:36.048154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cb5d49d-4fb4-4000-995a-4b5b0743d438 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:36.048578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cb5d49d-4fb4-4000-995a-4b5b0743d438 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:36.083140 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7fe7221b-67ed-4a34-8ab3-37f36891e7df tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/action" status: 202 len: 0 microversion: 2.1 time: 0.154233 Oct 18 13:37:36.088963 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2231/4725] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:37:35 2022] POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:37:36.095012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2085ea8-9786-4323-81e0-caba7aa30fad tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:36.095940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d2085ea8-9786-4323-81e0-caba7aa30fad tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:36.102724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2085ea8-9786-4323-81e0-caba7aa30fad tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:36.103423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2085ea8-9786-4323-81e0-caba7aa30fad tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:36.104040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2085ea8-9786-4323-81e0-caba7aa30fad tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:36.105749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2085ea8-9786-4323-81e0-caba7aa30fad tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:36.106207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2085ea8-9786-4323-81e0-caba7aa30fad tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:36.106631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2085ea8-9786-4323-81e0-caba7aa30fad tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:36.325373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d2085ea8-9786-4323-81e0-caba7aa30fad tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:36.335431 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d2085ea8-9786-4323-81e0-caba7aa30fad tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1519 microversion: 2.1 time: 0.244371 Oct 18 13:37:36.336775 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2232/4726] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:36 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:36.346203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b72a2739-e9ec-4c47-ad93-bb850cbdd612 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:36.347247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b72a2739-e9ec-4c47-ad93-bb850cbdd612 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:36.365443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b72a2739-e9ec-4c47-ad93-bb850cbdd612 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:36.366318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b72a2739-e9ec-4c47-ad93-bb850cbdd612 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:36.367009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b72a2739-e9ec-4c47-ad93-bb850cbdd612 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:36.369211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b72a2739-e9ec-4c47-ad93-bb850cbdd612 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:36.370283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b72a2739-e9ec-4c47-ad93-bb850cbdd612 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:36.370952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b72a2739-e9ec-4c47-ad93-bb850cbdd612 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:36.646818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b72a2739-e9ec-4c47-ad93-bb850cbdd612 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:36.667158 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b72a2739-e9ec-4c47-ad93-bb850cbdd612 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1329 microversion: 2.1 time: 0.326091 Oct 18 13:37:36.668503 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2233/4727] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:36 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1329 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:36.700643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea0ae96a-cf08-4495-9b29-d837f2a0bef9 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:36.702968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ea0ae96a-cf08-4495-9b29-d837f2a0bef9 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] [instance: 73a45dbe-4f39-47a7-b117-bee5c3bc71d9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:36.718108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0ae96a-cf08-4495-9b29-d837f2a0bef9 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:36.721817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0ae96a-cf08-4495-9b29-d837f2a0bef9 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:36.723006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0ae96a-cf08-4495-9b29-d837f2a0bef9 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:36.724999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0ae96a-cf08-4495-9b29-d837f2a0bef9 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:36.726165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0ae96a-cf08-4495-9b29-d837f2a0bef9 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:36.726882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea0ae96a-cf08-4495-9b29-d837f2a0bef9 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:36.730687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9cb5d49d-4fb4-4000-995a-4b5b0743d438 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:36.743375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9cb5d49d-4fb4-4000-995a-4b5b0743d438 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:36.745641 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-ea0ae96a-cf08-4495-9b29-d837f2a0bef9 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] HTTP exception thrown: Instance 73a45dbe-4f39-47a7-b117-bee5c3bc71d9 could not be found. Oct 18 13:37:36.746101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9cb5d49d-4fb4-4000-995a-4b5b0743d438 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea0ae96a-cf08-4495-9b29-d837f2a0bef9 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Request method failure captured: Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 HTTP/1.1 Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqv_3yq9JXefay3PMWSNO_aArc8ss9m3pKBRk9BVk7MutNAR9qEGm-jcTYBwJP71idpy-bvyLRmHkwGKNOvPfPQOX0myqYD04VcJlMOo1r1qjQxvlQk69-LVHStbW2yNX5Xvmm9AcNbUe_6sGs2JBQWiFzZO7Ty2NiLiKWhi_v209OY Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: ca964e337ec4473b980f9e0ea74a19ac Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-InstanceActionsTestJSON-1892857059 Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ca964e337ec4473b980f9e0ea74a19ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ca964e337ec4473b980f9e0ea74a19ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ca964e337ec4473b980f9e0ea74a19ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ca964e337ec4473b980f9e0ea74a19ac"}]}] Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-InstanceActionsTestJSON-1892857059 Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: ca964e337ec4473b980f9e0ea74a19ac Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1892857059 Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-InstanceActionsTestJSON-1892857059-project Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 05ccf811bbad40ff9af7fe83173be66d Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-InstanceActionsTestJSON-1892857059-project Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 73a45dbe-4f39-47a7-b117-bee5c3bc71d9 could not be found. Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '73a45dbe-4f39-47a7-b117-bee5c3bc71d9'} Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a45dbe-4f39-47a7-b117-bee5c3bc71d9 could not be found. Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a45dbe-4f39-47a7-b117-bee5c3bc71d9 could not be found. Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:36.747856 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:36.752231 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:36.752231 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:36.752231 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:36.752231 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:36.752231 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:36.752231 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a45dbe-4f39-47a7-b117-bee5c3bc71d9 could not be found. Oct 18 13:37:36.752231 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:36.752231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea0ae96a-cf08-4495-9b29-d837f2a0bef9 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] Returning 404 to user: Instance 73a45dbe-4f39-47a7-b117-bee5c3bc71d9 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:36.752231 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ea0ae96a-cf08-4495-9b29-d837f2a0bef9 tempest-InstanceActionsTestJSON-1892857059 tempest-InstanceActionsTestJSON-1892857059-project] 10.222.0.40 "GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9" status: 404 len: 111 microversion: 2.1 time: 0.079477 Oct 18 13:37:36.752231 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2234/4728] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:36 2022] GET /compute/v2.1/servers/73a45dbe-4f39-47a7-b117-bee5c3bc71d9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:36.756897 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9cb5d49d-4fb4-4000-995a-4b5b0743d438 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1406 microversion: 2.20 time: 0.733257 Oct 18 13:37:36.758026 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2495/4729] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:36 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1406 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:36.987318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-80350c0a-affe-48f8-a120-7ba46f83c48f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7be940>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:37.051359 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-80350c0a-affe-48f8-a120-7ba46f83c48f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.068231 Oct 18 13:37:37.060824 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2235/4730] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:36 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:37.360547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db3ffd3d-a343-4af2-b424-6514893be17d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:37.361205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db3ffd3d-a343-4af2-b424-6514893be17d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:37.370259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db3ffd3d-a343-4af2-b424-6514893be17d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.370954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db3ffd3d-a343-4af2-b424-6514893be17d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.371567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db3ffd3d-a343-4af2-b424-6514893be17d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.372445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db3ffd3d-a343-4af2-b424-6514893be17d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.373064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db3ffd3d-a343-4af2-b424-6514893be17d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.374113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db3ffd3d-a343-4af2-b424-6514893be17d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.606146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db3ffd3d-a343-4af2-b424-6514893be17d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:37.616800 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db3ffd3d-a343-4af2-b424-6514893be17d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1499 microversion: 2.1 time: 0.260706 Oct 18 13:37:37.621129 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2496/4731] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:37 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1499 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:37.656033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7eacaab-27d9-4548-ae44-1a9bc62927d5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:37.659815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f7eacaab-27d9-4548-ae44-1a9bc62927d5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:37.690199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7eacaab-27d9-4548-ae44-1a9bc62927d5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.696638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-598fbe35-6194-4f8a-a6bf-936406188988 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:37.697457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-598fbe35-6194-4f8a-a6bf-936406188988 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:37.704582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7eacaab-27d9-4548-ae44-1a9bc62927d5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.707922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-598fbe35-6194-4f8a-a6bf-936406188988 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.708888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7eacaab-27d9-4548-ae44-1a9bc62927d5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.710602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7eacaab-27d9-4548-ae44-1a9bc62927d5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.714669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-598fbe35-6194-4f8a-a6bf-936406188988 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.715468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7eacaab-27d9-4548-ae44-1a9bc62927d5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.716027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7eacaab-27d9-4548-ae44-1a9bc62927d5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.716559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-598fbe35-6194-4f8a-a6bf-936406188988 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.719235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-598fbe35-6194-4f8a-a6bf-936406188988 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.719836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-598fbe35-6194-4f8a-a6bf-936406188988 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.720534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-598fbe35-6194-4f8a-a6bf-936406188988 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.795560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-f7eacaab-27d9-4548-ae44-1a9bc62927d5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lazy-loading 'flavor' on Instance uuid 568613ab-c15f-4a59-aa10-8e40b871f918 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:37.828614 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-f7eacaab-27d9-4548-ae44-1a9bc62927d5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] HTTP exception thrown: Cannot 'rescue' instance 568613ab-c15f-4a59-aa10-8e40b871f918 while it is in vm_state paused Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7eacaab-27d9-4548-ae44-1a9bc62927d5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Request method failure captured: Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/action HTTP/1.1 Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 14 Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvrqX_zkCEhVydfvHZBeTI6vdRWUcUOpxttnLcg2aIsaFsLlHnFjovxQI4kcc3Myi8lwAHRAsf2wLTn_JlgKXt7GIy8E5du_6bYylQ1wRbIaq_CdQtpXoiOxia-B1issY5UDMjn_CVSSo9PM6M7QgZo_y7FdWj0xg611rUe51cUCao Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0cdfce6f9e86407d883e624dd2c50559"}]}] Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 4113a1418b92488e97bf50aecdd49bb1 Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: {"rescue": {}} Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: exception: Cannot 'rescue' instance 568613ab-c15f-4a59-aa10-8e40b871f918 while it is in vm_state paused Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '568613ab-c15f-4a59-aa10-8e40b871f918', 'body': {'rescue': {}}} Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 568613ab-c15f-4a59-aa10-8e40b871f918 in vm_state paused. Cannot rescue while the instance is in this state. Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 568613ab-c15f-4a59-aa10-8e40b871f918 while it is in vm_state paused Oct 18 13:37:37.834290 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:37.840798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:37.840798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:37.840798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:37.840798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:37.840798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:37.840798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:37.840798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:37.840798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 568613ab-c15f-4a59-aa10-8e40b871f918 while it is in vm_state paused Oct 18 13:37:37.840798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:37.840798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7eacaab-27d9-4548-ae44-1a9bc62927d5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Returning 409 to user: Cannot 'rescue' instance 568613ab-c15f-4a59-aa10-8e40b871f918 while it is in vm_state paused {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:37.842902 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f7eacaab-27d9-4548-ae44-1a9bc62927d5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/action" status: 409 len: 144 microversion: 2.1 time: 0.194079 Oct 18 13:37:37.844479 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2236/4732] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:37:37 2022] POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/action => generated 144 bytes in 198 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:37:37.854473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b12b86fb-718f-4328-a210-39c79173510b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:37.857466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b12b86fb-718f-4328-a210-39c79173510b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:37.870241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12b86fb-718f-4328-a210-39c79173510b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.873486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12b86fb-718f-4328-a210-39c79173510b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.874159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12b86fb-718f-4328-a210-39c79173510b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:37.876146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12b86fb-718f-4328-a210-39c79173510b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:37.876833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12b86fb-718f-4328-a210-39c79173510b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:37.879599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12b86fb-718f-4328-a210-39c79173510b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.074977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-598fbe35-6194-4f8a-a6bf-936406188988 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:38.105416 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-598fbe35-6194-4f8a-a6bf-936406188988 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1329 microversion: 2.1 time: 0.413103 Oct 18 13:37:38.106083 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2497/4733] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:37 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1329 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:38.124774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b12b86fb-718f-4328-a210-39c79173510b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:38.131235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-61168bd4-d406-4713-9e12-1256c21027a6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:38.131783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-61168bd4-d406-4713-9e12-1256c21027a6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:38.137304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b12b86fb-718f-4328-a210-39c79173510b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:38.139155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b12b86fb-718f-4328-a210-39c79173510b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:38.141129 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b12b86fb-718f-4328-a210-39c79173510b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1598 microversion: 2.20 time: 0.295095 Oct 18 13:37:38.144917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61168bd4-d406-4713-9e12-1256c21027a6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:38.145702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61168bd4-d406-4713-9e12-1256c21027a6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:38.146525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61168bd4-d406-4713-9e12-1256c21027a6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.147451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61168bd4-d406-4713-9e12-1256c21027a6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:38.148114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61168bd4-d406-4713-9e12-1256c21027a6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:38.149403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61168bd4-d406-4713-9e12-1256c21027a6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.161527 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2237/4734] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:37:37 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1598 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:37:38.183110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-5d0bd9f3-bf3d-497a-a90b-aa6fa88621f1 req-ced0c819-fa8c-4b23-8801-19413d549cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833b85f4-e854-4a7b-b04d-001cde240eb3", "name": "network-vif-plugged", "status": "completed", "tag": "83080d1b-68a0-4f1b-a31f-f765e5c6c561"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:38.213603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5d0bd9f3-bf3d-497a-a90b-aa6fa88621f1 req-ced0c819-fa8c-4b23-8801-19413d549cb7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:38.214092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5d0bd9f3-bf3d-497a-a90b-aa6fa88621f1 req-ced0c819-fa8c-4b23-8801-19413d549cb7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:38.214532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5d0bd9f3-bf3d-497a-a90b-aa6fa88621f1 req-ced0c819-fa8c-4b23-8801-19413d549cb7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.252771 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-5d0bd9f3-bf3d-497a-a90b-aa6fa88621f1 req-ced0c819-fa8c-4b23-8801-19413d549cb7 service nova] Creating event network-vif-plugged:83080d1b-68a0-4f1b-a31f-f765e5c6c561 for instance 833b85f4-e854-4a7b-b04d-001cde240eb3 on n-h2-858384-13 Oct 18 13:37:38.263648 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-5d0bd9f3-bf3d-497a-a90b-aa6fa88621f1 req-ced0c819-fa8c-4b23-8801-19413d549cb7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090699 Oct 18 13:37:38.265715 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2238/4735] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:38.276627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3abd07e8-f38c-470d-b919-5c762df6c933 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e74b550>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:38.334084 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-61168bd4-d406-4713-9e12-1256c21027a6 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/action" status: 202 len: 0 microversion: 2.1 time: 0.224698 Oct 18 13:37:38.338751 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2498/4736] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:37:38 2022] POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:37:38.352321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bb948132-60d6-4480-a9d8-028066dc26d7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:38.353423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bb948132-60d6-4480-a9d8-028066dc26d7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:38.364418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb948132-60d6-4480-a9d8-028066dc26d7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:38.365966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb948132-60d6-4480-a9d8-028066dc26d7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:38.366938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb948132-60d6-4480-a9d8-028066dc26d7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.368173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb948132-60d6-4480-a9d8-028066dc26d7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:38.369343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb948132-60d6-4480-a9d8-028066dc26d7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:38.370037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb948132-60d6-4480-a9d8-028066dc26d7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.381212 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3abd07e8-f38c-470d-b919-5c762df6c933 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.112493 Oct 18 13:37:38.389828 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2239/4737] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:38 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:38.395158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad98fa4e-0583-4460-a304-d45d3424a375 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:38.396531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ad98fa4e-0583-4460-a304-d45d3424a375 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:38.408908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad98fa4e-0583-4460-a304-d45d3424a375 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:38.409440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad98fa4e-0583-4460-a304-d45d3424a375 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:38.409887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad98fa4e-0583-4460-a304-d45d3424a375 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.410599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad98fa4e-0583-4460-a304-d45d3424a375 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:38.413210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad98fa4e-0583-4460-a304-d45d3424a375 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:38.416590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad98fa4e-0583-4460-a304-d45d3424a375 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:38.584909 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bb948132-60d6-4480-a9d8-028066dc26d7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.244445 Oct 18 13:37:38.585666 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2499/4738] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 18 13:37:38 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/os-interface => generated 284 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:37:38.679684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad98fa4e-0583-4460-a304-d45d3424a375 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:38.690936 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad98fa4e-0583-4460-a304-d45d3424a375 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1506 microversion: 2.1 time: 0.306294 Oct 18 13:37:38.692503 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2240/4739] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:38 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:39.128108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-16b51d7b-d7cf-4d3f-864e-347857ab2feb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:39.129088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-16b51d7b-d7cf-4d3f-864e-347857ab2feb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:39.141750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16b51d7b-d7cf-4d3f-864e-347857ab2feb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:39.142255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16b51d7b-d7cf-4d3f-864e-347857ab2feb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:39.142700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16b51d7b-d7cf-4d3f-864e-347857ab2feb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:39.143414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16b51d7b-d7cf-4d3f-864e-347857ab2feb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:39.143872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16b51d7b-d7cf-4d3f-864e-347857ab2feb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:39.144307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16b51d7b-d7cf-4d3f-864e-347857ab2feb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:39.399661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e387eef-31ba-43e8-948b-d76c9dab4b98 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7be160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:39.476181 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1e387eef-31ba-43e8-948b-d76c9dab4b98 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.081855 Oct 18 13:37:39.477669 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2241/4740] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:39 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:39.606370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-16b51d7b-d7cf-4d3f-864e-347857ab2feb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:39.615532 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-16b51d7b-d7cf-4d3f-864e-347857ab2feb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1329 microversion: 2.1 time: 0.491475 Oct 18 13:37:39.616376 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2500/4741] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:39 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1329 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:39.721769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dbc9d6dc-0413-4db5-948a-83081e7fe8ab tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:39.722382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dbc9d6dc-0413-4db5-948a-83081e7fe8ab tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:39.744428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbc9d6dc-0413-4db5-948a-83081e7fe8ab tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:39.745436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbc9d6dc-0413-4db5-948a-83081e7fe8ab tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:39.746061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbc9d6dc-0413-4db5-948a-83081e7fe8ab tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:39.746960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbc9d6dc-0413-4db5-948a-83081e7fe8ab tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:39.747922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbc9d6dc-0413-4db5-948a-83081e7fe8ab tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:39.748522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbc9d6dc-0413-4db5-948a-83081e7fe8ab tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:40.028254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dbc9d6dc-0413-4db5-948a-83081e7fe8ab tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:40.038667 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dbc9d6dc-0413-4db5-948a-83081e7fe8ab tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1514 microversion: 2.1 time: 0.320625 Oct 18 13:37:40.041534 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2242/4742] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:39 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1514 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:40.310437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-12b359a4-5f90-4f72-a929-53553191b078 req-3ba2fe72-a232-48f2-972d-7ed66e2e8cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c563a787-e0b9-4e58-a44c-dde199eba836", "name": "network-vif-plugged", "status": "completed", "tag": "d32b7970-b8d0-4343-9264-5409d93513d3"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:40.337733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-12b359a4-5f90-4f72-a929-53553191b078 req-3ba2fe72-a232-48f2-972d-7ed66e2e8cac service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:40.338601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-12b359a4-5f90-4f72-a929-53553191b078 req-3ba2fe72-a232-48f2-972d-7ed66e2e8cac service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:40.339862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-12b359a4-5f90-4f72-a929-53553191b078 req-3ba2fe72-a232-48f2-972d-7ed66e2e8cac service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:40.391180 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-12b359a4-5f90-4f72-a929-53553191b078 req-3ba2fe72-a232-48f2-972d-7ed66e2e8cac service nova] Creating event network-vif-plugged:d32b7970-b8d0-4343-9264-5409d93513d3 for instance c563a787-e0b9-4e58-a44c-dde199eba836 on n-h1-858384-13 Oct 18 13:37:40.408880 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-12b359a4-5f90-4f72-a929-53553191b078 req-3ba2fe72-a232-48f2-972d-7ed66e2e8cac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102636 Oct 18 13:37:40.417421 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2501/4743] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:40.496877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1401fc46-1c2a-47cb-92b6-50f8791c9bc1 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7cf160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:40.583192 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1401fc46-1c2a-47cb-92b6-50f8791c9bc1 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.091814 Oct 18 13:37:40.585495 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2243/4744] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:40 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:40.641795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a99c9d3d-50d0-4164-9d1e-2d45c90b54ce tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:40.643747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a99c9d3d-50d0-4164-9d1e-2d45c90b54ce tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:40.663294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a99c9d3d-50d0-4164-9d1e-2d45c90b54ce tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:40.666000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a99c9d3d-50d0-4164-9d1e-2d45c90b54ce tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:40.666856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a99c9d3d-50d0-4164-9d1e-2d45c90b54ce tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:40.668623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a99c9d3d-50d0-4164-9d1e-2d45c90b54ce tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:40.672066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a99c9d3d-50d0-4164-9d1e-2d45c90b54ce tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:40.672739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a99c9d3d-50d0-4164-9d1e-2d45c90b54ce tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:41.290165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35a26478-b7b3-4152-b1cb-349687a70bea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:41.310514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35a26478-b7b3-4152-b1cb-349687a70bea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:41.311262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35a26478-b7b3-4152-b1cb-349687a70bea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:41.312149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35a26478-b7b3-4152-b1cb-349687a70bea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:41.366409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-35a26478-b7b3-4152-b1cb-349687a70bea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Going to try to stop instance {{(pid=120612) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:37:41.397862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a99c9d3d-50d0-4164-9d1e-2d45c90b54ce tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:41.412198 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a99c9d3d-50d0-4164-9d1e-2d45c90b54ce tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1329 microversion: 2.1 time: 0.770999 Oct 18 13:37:41.421388 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2502/4745] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:40 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1329 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:41.467101 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-35a26478-b7b3-4152-b1cb-349687a70bea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "POST /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/action" status: 202 len: 0 microversion: 2.1 time: 0.182024 Oct 18 13:37:41.468020 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2244/4746] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:37:41 2022] POST /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:37:41.479103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d4ce928f-96a4-4b99-8a9d-edfcbcab6e77 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:41.480275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d4ce928f-96a4-4b99-8a9d-edfcbcab6e77 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:41.500288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ce928f-96a4-4b99-8a9d-edfcbcab6e77 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:41.502686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ce928f-96a4-4b99-8a9d-edfcbcab6e77 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:41.503532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ce928f-96a4-4b99-8a9d-edfcbcab6e77 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:41.505776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ce928f-96a4-4b99-8a9d-edfcbcab6e77 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:41.506559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ce928f-96a4-4b99-8a9d-edfcbcab6e77 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:41.507774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ce928f-96a4-4b99-8a9d-edfcbcab6e77 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:41.602221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b0c6d6d4-837f-41f3-b947-3e24ade4ffe2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e78baf0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:41.682641 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b0c6d6d4-837f-41f3-b947-3e24ade4ffe2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.082665 Oct 18 13:37:41.693121 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2245/4747] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:41 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:42.116976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a7051ef1-feb6-4053-99c6-aa04a750aef8 req-c464acdb-a0bf-4d7a-95a8-3b9d32aa82d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c5c389-b7a1-4170-9b5c-321066d048e1", "tag": "74f52242-e00e-46f0-a3ba-47fe1d3cac8e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:42.154511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a7051ef1-feb6-4053-99c6-aa04a750aef8 req-c464acdb-a0bf-4d7a-95a8-3b9d32aa82d2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.154995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a7051ef1-feb6-4053-99c6-aa04a750aef8 req-c464acdb-a0bf-4d7a-95a8-3b9d32aa82d2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.155428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a7051ef1-feb6-4053-99c6-aa04a750aef8 req-c464acdb-a0bf-4d7a-95a8-3b9d32aa82d2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.173806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d4ce928f-96a4-4b99-8a9d-edfcbcab6e77 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:42.188391 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d4ce928f-96a4-4b99-8a9d-edfcbcab6e77 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1721 microversion: 2.1 time: 0.715525 Oct 18 13:37:42.191509 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2503/4748] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:41 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1721 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:42.205127 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a7051ef1-feb6-4053-99c6-aa04a750aef8 req-c464acdb-a0bf-4d7a-95a8-3b9d32aa82d2 service nova] Creating event network-changed:74f52242-e00e-46f0-a3ba-47fe1d3cac8e for instance 31c5c389-b7a1-4170-9b5c-321066d048e1 on n-h1-858384-13 Oct 18 13:37:42.205431 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a7051ef1-feb6-4053-99c6-aa04a750aef8 req-c464acdb-a0bf-4d7a-95a8-3b9d32aa82d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092393 Oct 18 13:37:42.205931 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2246/4749] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:42.437989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5200c46e-d050-464f-9920-5c72e7a96e6d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:42.439176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5200c46e-d050-464f-9920-5c72e7a96e6d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:42.448856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5200c46e-d050-464f-9920-5c72e7a96e6d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.449415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5200c46e-d050-464f-9920-5c72e7a96e6d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.449765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5200c46e-d050-464f-9920-5c72e7a96e6d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.450471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5200c46e-d050-464f-9920-5c72e7a96e6d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:42.450921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5200c46e-d050-464f-9920-5c72e7a96e6d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:42.453787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5200c46e-d050-464f-9920-5c72e7a96e6d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:42.702338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6e9039a4-bfd5-4a8e-98b9-1106a2d511e3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f1abe50>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:42.800035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5200c46e-d050-464f-9920-5c72e7a96e6d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:42.814200 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5200c46e-d050-464f-9920-5c72e7a96e6d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1329 microversion: 2.1 time: 0.381054 Oct 18 13:37:42.816777 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2247/4750] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:42 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1329 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:42.836736 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6e9039a4-bfd5-4a8e-98b9-1106a2d511e3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.139505 Oct 18 13:37:42.838278 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2504/4751] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:42 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:43.042879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-832f071f-1240-4859-bfc8-707aac010d0c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:43.046275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-832f071f-1240-4859-bfc8-707aac010d0c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:43.055642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-832f071f-1240-4859-bfc8-707aac010d0c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.056408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-832f071f-1240-4859-bfc8-707aac010d0c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.057692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-832f071f-1240-4859-bfc8-707aac010d0c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.058591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-832f071f-1240-4859-bfc8-707aac010d0c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.059234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-832f071f-1240-4859-bfc8-707aac010d0c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.059882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-832f071f-1240-4859-bfc8-707aac010d0c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.093353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-832f071f-1240-4859-bfc8-707aac010d0c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lazy-loading 'flavor' on Instance uuid 568613ab-c15f-4a59-aa10-8e40b871f918 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:43.118906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:43.217856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-90213e7f-b9fd-4967-8ac0-d2cd772de55d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:43.218939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-90213e7f-b9fd-4967-8ac0-d2cd772de55d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:43.285117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90213e7f-b9fd-4967-8ac0-d2cd772de55d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.287152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90213e7f-b9fd-4967-8ac0-d2cd772de55d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.294477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90213e7f-b9fd-4967-8ac0-d2cd772de55d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.296725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90213e7f-b9fd-4967-8ac0-d2cd772de55d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.299757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90213e7f-b9fd-4967-8ac0-d2cd772de55d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.302408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90213e7f-b9fd-4967-8ac0-d2cd772de55d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.315869 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-832f071f-1240-4859-bfc8-707aac010d0c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/action" status: 200 len: 32 microversion: 2.1 time: 0.275313 Oct 18 13:37:43.324556 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2248/4752] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:37:43 2022] POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/action => generated 32 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:37:43.351322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4817387-9a40-466e-bc0e-1c94b83076a4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:43.352573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e4817387-9a40-466e-bc0e-1c94b83076a4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:43.393688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4817387-9a40-466e-bc0e-1c94b83076a4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.401408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4817387-9a40-466e-bc0e-1c94b83076a4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.402791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4817387-9a40-466e-bc0e-1c94b83076a4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.407142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4817387-9a40-466e-bc0e-1c94b83076a4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.407632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4817387-9a40-466e-bc0e-1c94b83076a4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.408078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4817387-9a40-466e-bc0e-1c94b83076a4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.889893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-90213e7f-b9fd-4967-8ac0-d2cd772de55d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:43.904425 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-90213e7f-b9fd-4967-8ac0-d2cd772de55d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1721 microversion: 2.1 time: 0.691145 Oct 18 13:37:43.912783 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2505/4753] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:43 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1721 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:43.928229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c82623e-e85a-444d-ae47-2848f7819e08 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:43.928859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7c82623e-e85a-444d-ae47-2848f7819e08 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:43.955977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c82623e-e85a-444d-ae47-2848f7819e08 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.956484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c82623e-e85a-444d-ae47-2848f7819e08 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.956929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c82623e-e85a-444d-ae47-2848f7819e08 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.957683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c82623e-e85a-444d-ae47-2848f7819e08 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:43.958143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c82623e-e85a-444d-ae47-2848f7819e08 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:43.958577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c82623e-e85a-444d-ae47-2848f7819e08 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:43.962481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e4817387-9a40-466e-bc0e-1c94b83076a4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:43.974908 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e4817387-9a40-466e-bc0e-1c94b83076a4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1520 microversion: 2.1 time: 0.641863 Oct 18 13:37:43.979777 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2249/4754] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:43 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1520 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:43.999527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a0a51c18-922a-42ca-907f-f93a04dc5142 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7d7790>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:44.102137 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a0a51c18-922a-42ca-907f-f93a04dc5142 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.120414 Oct 18 13:37:44.106778 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2250/4755] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:43 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:44.466157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7c82623e-e85a-444d-ae47-2848f7819e08 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:44.477841 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7c82623e-e85a-444d-ae47-2848f7819e08 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1510 microversion: 2.1 time: 0.562413 Oct 18 13:37:44.480104 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2506/4756] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:43 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1510 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:44.512469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0b2716a3-3ca2-49d1-8499-a6f08f0340ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:44.513659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0b2716a3-3ca2-49d1-8499-a6f08f0340ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:44.522407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b2716a3-3ca2-49d1-8499-a6f08f0340ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.523108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b2716a3-3ca2-49d1-8499-a6f08f0340ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.524329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b2716a3-3ca2-49d1-8499-a6f08f0340ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.525457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b2716a3-3ca2-49d1-8499-a6f08f0340ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.526232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b2716a3-3ca2-49d1-8499-a6f08f0340ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.526852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b2716a3-3ca2-49d1-8499-a6f08f0340ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.899595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0b2716a3-3ca2-49d1-8499-a6f08f0340ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:44.908183 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0b2716a3-3ca2-49d1-8499-a6f08f0340ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1510 microversion: 2.1 time: 0.401757 Oct 18 13:37:44.909331 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2251/4757] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:44 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1510 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:44.932677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e99a89f-7dd5-4af6-9b8b-9e116bea57ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:44.933575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4e99a89f-7dd5-4af6-9b8b-9e116bea57ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:44.944498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8e484082-d2d7-4933-ad8e-9b1f74bdd7b8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:44.945149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8e484082-d2d7-4933-ad8e-9b1f74bdd7b8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:44.952740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e99a89f-7dd5-4af6-9b8b-9e116bea57ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.953715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e99a89f-7dd5-4af6-9b8b-9e116bea57ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.954817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e99a89f-7dd5-4af6-9b8b-9e116bea57ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.956288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e99a89f-7dd5-4af6-9b8b-9e116bea57ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.958374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e99a89f-7dd5-4af6-9b8b-9e116bea57ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.959690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e99a89f-7dd5-4af6-9b8b-9e116bea57ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.962866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e484082-d2d7-4933-ad8e-9b1f74bdd7b8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.964629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e484082-d2d7-4933-ad8e-9b1f74bdd7b8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.968774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e484082-d2d7-4933-ad8e-9b1f74bdd7b8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:44.969713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e484082-d2d7-4933-ad8e-9b1f74bdd7b8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:44.970600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e484082-d2d7-4933-ad8e-9b1f74bdd7b8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:44.972503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e484082-d2d7-4933-ad8e-9b1f74bdd7b8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.019444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4e99a89f-7dd5-4af6-9b8b-9e116bea57ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:37:45.195557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8e484082-d2d7-4933-ad8e-9b1f74bdd7b8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:45.210458 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8e484082-d2d7-4933-ad8e-9b1f74bdd7b8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1721 microversion: 2.1 time: 0.274346 Oct 18 13:37:45.229759 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2252/4758] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:44 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1721 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:45.239851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f43ba077-b8d4-4a6b-aed5-cfde2e7827ce tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:45.240731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f43ba077-b8d4-4a6b-aed5-cfde2e7827ce tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:45.248860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f43ba077-b8d4-4a6b-aed5-cfde2e7827ce tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:45.249969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f43ba077-b8d4-4a6b-aed5-cfde2e7827ce tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:45.250784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f43ba077-b8d4-4a6b-aed5-cfde2e7827ce tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.251826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f43ba077-b8d4-4a6b-aed5-cfde2e7827ce tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:45.252539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f43ba077-b8d4-4a6b-aed5-cfde2e7827ce tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:45.253309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f43ba077-b8d4-4a6b-aed5-cfde2e7827ce tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.276374 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4e99a89f-7dd5-4af6-9b8b-9e116bea57ba tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 204 len: 0 microversion: 2.1 time: 0.343431 Oct 18 13:37:45.283840 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2507/4759] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:37:44 2022] DELETE /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:37:45.300014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-88a03168-401a-4d2b-9fcc-2f9f3dc337af tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617c5b940>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:45.413987 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-88a03168-401a-4d2b-9fcc-2f9f3dc337af tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.126974 Oct 18 13:37:45.415818 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2508/4760] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:45 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:45.432549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-50d80c64-7515-49dd-b8b8-9bbaf898822f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:45.434190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-50d80c64-7515-49dd-b8b8-9bbaf898822f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:45.455987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50d80c64-7515-49dd-b8b8-9bbaf898822f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:45.456484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50d80c64-7515-49dd-b8b8-9bbaf898822f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:45.456927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50d80c64-7515-49dd-b8b8-9bbaf898822f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.457666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50d80c64-7515-49dd-b8b8-9bbaf898822f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:45.458117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50d80c64-7515-49dd-b8b8-9bbaf898822f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:45.466287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50d80c64-7515-49dd-b8b8-9bbaf898822f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:45.556246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f43ba077-b8d4-4a6b-aed5-cfde2e7827ce tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:45.585530 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f43ba077-b8d4-4a6b-aed5-cfde2e7827ce tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1520 microversion: 2.1 time: 0.350413 Oct 18 13:37:45.588498 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2253/4761] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:45 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:45.801146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-50d80c64-7515-49dd-b8b8-9bbaf898822f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:45.814382 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-50d80c64-7515-49dd-b8b8-9bbaf898822f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1516 microversion: 2.1 time: 0.397262 Oct 18 13:37:45.815525 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2509/4762] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:45 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1516 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:46.235292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2111602-d302-4969-8b87-55127bdac4d7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:46.235899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d2111602-d302-4969-8b87-55127bdac4d7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:46.244480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2111602-d302-4969-8b87-55127bdac4d7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.244901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2111602-d302-4969-8b87-55127bdac4d7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.248759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2111602-d302-4969-8b87-55127bdac4d7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.250167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2111602-d302-4969-8b87-55127bdac4d7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.251060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2111602-d302-4969-8b87-55127bdac4d7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.251734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2111602-d302-4969-8b87-55127bdac4d7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.437156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e672a0dc-dca1-4107-a2d3-e05dfce7a19e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617be6550>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:46.500756 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e672a0dc-dca1-4107-a2d3-e05dfce7a19e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.074468 Oct 18 13:37:46.503256 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2510/4763] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:46 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:46.518991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d2111602-d302-4969-8b87-55127bdac4d7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:46.533699 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d2111602-d302-4969-8b87-55127bdac4d7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1721 microversion: 2.1 time: 0.302230 Oct 18 13:37:46.534292 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2254/4764] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:46 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1721 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:46.612080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9bc414ee-d626-4373-b7a5-1381fe81cc98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:46.612729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9bc414ee-d626-4373-b7a5-1381fe81cc98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:46.627575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bc414ee-d626-4373-b7a5-1381fe81cc98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.628050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bc414ee-d626-4373-b7a5-1381fe81cc98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.630752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bc414ee-d626-4373-b7a5-1381fe81cc98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.635022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bc414ee-d626-4373-b7a5-1381fe81cc98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.635536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bc414ee-d626-4373-b7a5-1381fe81cc98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.635969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bc414ee-d626-4373-b7a5-1381fe81cc98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.840332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9929ec02-ae53-46ea-83c3-24af36e2eb00 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:46.841130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9929ec02-ae53-46ea-83c3-24af36e2eb00 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:46.856432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9929ec02-ae53-46ea-83c3-24af36e2eb00 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.863193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9929ec02-ae53-46ea-83c3-24af36e2eb00 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.863650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9929ec02-ae53-46ea-83c3-24af36e2eb00 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.864852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9929ec02-ae53-46ea-83c3-24af36e2eb00 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:46.865374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9929ec02-ae53-46ea-83c3-24af36e2eb00 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:46.865977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9929ec02-ae53-46ea-83c3-24af36e2eb00 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:46.875197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9bc414ee-d626-4373-b7a5-1381fe81cc98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:46.888870 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9bc414ee-d626-4373-b7a5-1381fe81cc98 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1520 microversion: 2.1 time: 0.279824 Oct 18 13:37:46.891250 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2511/4765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:46 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:47.503440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9929ec02-ae53-46ea-83c3-24af36e2eb00 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:47.518769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c3f9eede-ca07-48ca-8803-ddba1d770c10 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617a85e50>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:47.539813 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9929ec02-ae53-46ea-83c3-24af36e2eb00 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1516 microversion: 2.1 time: 0.704992 Oct 18 13:37:47.543158 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2255/4766] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:46 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1516 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:47.564730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4cd0820a-4cb8-4687-b1cf-6853bfe43101 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:47.565664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4cd0820a-4cb8-4687-b1cf-6853bfe43101 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:47.587980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:47.597282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cd0820a-4cb8-4687-b1cf-6853bfe43101 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.597803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cd0820a-4cb8-4687-b1cf-6853bfe43101 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.600142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cd0820a-4cb8-4687-b1cf-6853bfe43101 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.601064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cd0820a-4cb8-4687-b1cf-6853bfe43101 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.604907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cd0820a-4cb8-4687-b1cf-6853bfe43101 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.605401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cd0820a-4cb8-4687-b1cf-6853bfe43101 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.609374 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c3f9eede-ca07-48ca-8803-ddba1d770c10 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.095260 Oct 18 13:37:47.612602 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2512/4767] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:47 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:47.643117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-66c971fc-ce1a-49bd-9b11-2df25ebefc43 req-7dd0bce5-05ed-40d6-91f4-352fa51482c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c563a787-e0b9-4e58-a44c-dde199eba836", "name": "network-vif-deleted", "tag": "d32b7970-b8d0-4343-9264-5409d93513d3"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:47.689761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-66c971fc-ce1a-49bd-9b11-2df25ebefc43 req-7dd0bce5-05ed-40d6-91f4-352fa51482c0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.697594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-66c971fc-ce1a-49bd-9b11-2df25ebefc43 req-7dd0bce5-05ed-40d6-91f4-352fa51482c0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.700003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-66c971fc-ce1a-49bd-9b11-2df25ebefc43 req-7dd0bce5-05ed-40d6-91f4-352fa51482c0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.765933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:47.771872 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-66c971fc-ce1a-49bd-9b11-2df25ebefc43 req-7dd0bce5-05ed-40d6-91f4-352fa51482c0 service nova] Creating event network-vif-deleted:d32b7970-b8d0-4343-9264-5409d93513d3 for instance c563a787-e0b9-4e58-a44c-dde199eba836 on n-h1-858384-13 Oct 18 13:37:47.793329 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-66c971fc-ce1a-49bd-9b11-2df25ebefc43 req-7dd0bce5-05ed-40d6-91f4-352fa51482c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160587 Oct 18 13:37:47.802268 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2513/4768] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:37:47.917430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6ed0224b-4c84-49e4-8e25-1b977e4b2147 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:47.918227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6ed0224b-4c84-49e4-8e25-1b977e4b2147 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:47.951865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ed0224b-4c84-49e4-8e25-1b977e4b2147 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.952695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ed0224b-4c84-49e4-8e25-1b977e4b2147 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.955986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ed0224b-4c84-49e4-8e25-1b977e4b2147 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.957391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ed0224b-4c84-49e4-8e25-1b977e4b2147 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:47.963386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ed0224b-4c84-49e4-8e25-1b977e4b2147 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:47.964807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ed0224b-4c84-49e4-8e25-1b977e4b2147 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:47.980036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4cd0820a-4cb8-4687-b1cf-6853bfe43101 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:47.995942 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4cd0820a-4cb8-4687-b1cf-6853bfe43101 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1721 microversion: 2.1 time: 0.436684 Oct 18 13:37:47.997313 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2256/4769] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:47 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1721 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:48.270923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ed0224b-4c84-49e4-8e25-1b977e4b2147 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:48.290595 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6ed0224b-4c84-49e4-8e25-1b977e4b2147 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1520 microversion: 2.1 time: 0.379381 Oct 18 13:37:48.292532 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2514/4770] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:47 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:48.568099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:48.569023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:48.577712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.579939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.580377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.582249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.582951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.587749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.634601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5054b7de-fab9-481d-9f1a-eaae676f6dd1 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ee24c10>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:48.663350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:48.665595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:48.667240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:48.667734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lazy-loading 'fault' on Instance uuid c563a787-e0b9-4e58-a44c-dde199eba836 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:37:48.729918 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5054b7de-fab9-481d-9f1a-eaae676f6dd1 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.101264 Oct 18 13:37:48.731346 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2515/4771] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:48 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:48.746335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:48.759468 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f9a9343c-7f8d-4ff8-9054-e206e55dda2d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 200 len: 1319 microversion: 2.1 time: 0.194871 Oct 18 13:37:48.770741 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2257/4772] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:48 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:49.025019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a21a95b-3bc1-43ed-b411-a565cfbe1f7e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:49.025927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1a21a95b-3bc1-43ed-b411-a565cfbe1f7e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:49.035118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a21a95b-3bc1-43ed-b411-a565cfbe1f7e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.036160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a21a95b-3bc1-43ed-b411-a565cfbe1f7e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.037426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a21a95b-3bc1-43ed-b411-a565cfbe1f7e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.039550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a21a95b-3bc1-43ed-b411-a565cfbe1f7e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.041237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a21a95b-3bc1-43ed-b411-a565cfbe1f7e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.041854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a21a95b-3bc1-43ed-b411-a565cfbe1f7e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.239787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1a21a95b-3bc1-43ed-b411-a565cfbe1f7e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:49.250760 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1a21a95b-3bc1-43ed-b411-a565cfbe1f7e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1721 microversion: 2.1 time: 0.230062 Oct 18 13:37:49.252150 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2516/4773] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:49 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:49.318982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5a8557cf-540f-47df-b6d4-fe8e52f9064c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:49.319594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5a8557cf-540f-47df-b6d4-fe8e52f9064c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:49.328443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a8557cf-540f-47df-b6d4-fe8e52f9064c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.328928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a8557cf-540f-47df-b6d4-fe8e52f9064c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.329407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a8557cf-540f-47df-b6d4-fe8e52f9064c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.330094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a8557cf-540f-47df-b6d4-fe8e52f9064c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.330543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a8557cf-540f-47df-b6d4-fe8e52f9064c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.330961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a8557cf-540f-47df-b6d4-fe8e52f9064c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.544212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5a8557cf-540f-47df-b6d4-fe8e52f9064c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:49.571307 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5a8557cf-540f-47df-b6d4-fe8e52f9064c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1520 microversion: 2.1 time: 0.255218 Oct 18 13:37:49.573759 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2258/4774] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:49 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:49.749696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87fcfa1d-c25f-4116-b688-392bf36d6242 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617ac4790>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:49.803347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fdfeaa9e-c8f3-4d37-afce-29259669cca5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:49.804128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fdfeaa9e-c8f3-4d37-afce-29259669cca5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:49.816542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdfeaa9e-c8f3-4d37-afce-29259669cca5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.820534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdfeaa9e-c8f3-4d37-afce-29259669cca5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.826478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdfeaa9e-c8f3-4d37-afce-29259669cca5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.828121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdfeaa9e-c8f3-4d37-afce-29259669cca5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:49.829754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdfeaa9e-c8f3-4d37-afce-29259669cca5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:49.830568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdfeaa9e-c8f3-4d37-afce-29259669cca5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:49.870764 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-fdfeaa9e-c8f3-4d37-afce-29259669cca5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fdfeaa9e-c8f3-4d37-afce-29259669cca5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 HTTP/1.1 Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c563a787-e0b9-4e58-a44c-dde199eba836'} Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:49.878105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:37:49.882292 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:37:49.882292 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:37:49.882292 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:37:49.882292 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:37:49.882292 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:37:49.882292 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:37:49.883823 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-87fcfa1d-c25f-4116-b688-392bf36d6242 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.138306 Oct 18 13:37:49.883823 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2517/4775] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:49 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:49.889516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fdfeaa9e-c8f3-4d37-afce-29259669cca5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:37:49.890653 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fdfeaa9e-c8f3-4d37-afce-29259669cca5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 404 len: 111 microversion: 2.1 time: 0.102467 Oct 18 13:37:49.913298 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2259/4776] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:49 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:37:49.936947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-79c64756-c22b-4c71-bb4b-9a4eb767fe78 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '.version_select at 0x7ff617ad3040>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:49.985848 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-79c64756-c22b-4c71-bb4b-9a4eb767fe78 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-key-1927152124" status: 202 len: 0 microversion: 2.1 time: 0.069127 Oct 18 13:37:49.987205 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2518/4777] 10.222.0.40 () {58 vars in 1209 bytes} [Tue Oct 18 13:37:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1927152124 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:37:50.144036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1056684836", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "aa0d4f33-39e0-4d3f-ab36-9b89248d2552"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:50.218093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] validate_networks() for [('aa0d4f33-39e0-4d3f-ab36-9b89248d2552', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:37:50.279854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-33213fdb-d600-4b4b-b208-f0b5e066aaea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:50.281050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-33213fdb-d600-4b4b-b208-f0b5e066aaea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:50.290935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33213fdb-d600-4b4b-b208-f0b5e066aaea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.293297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33213fdb-d600-4b4b-b208-f0b5e066aaea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.294659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33213fdb-d600-4b4b-b208-f0b5e066aaea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.296766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33213fdb-d600-4b4b-b208-f0b5e066aaea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.297856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33213fdb-d600-4b4b-b208-f0b5e066aaea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.298992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33213fdb-d600-4b4b-b208-f0b5e066aaea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.508177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-33213fdb-d600-4b4b-b208-f0b5e066aaea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:50.527846 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-33213fdb-d600-4b4b-b208-f0b5e066aaea tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1721 microversion: 2.1 time: 0.251436 Oct 18 13:37:50.531119 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2519/4778] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:50 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:50.598230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8f0e0165-37e4-4223-a3d8-de44652a9dff tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:50.598859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8f0e0165-37e4-4223-a3d8-de44652a9dff tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:50.615362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f0e0165-37e4-4223-a3d8-de44652a9dff tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.628575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f0e0165-37e4-4223-a3d8-de44652a9dff tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.629572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f0e0165-37e4-4223-a3d8-de44652a9dff tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.632952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f0e0165-37e4-4223-a3d8-de44652a9dff tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:50.635277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f0e0165-37e4-4223-a3d8-de44652a9dff tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:50.637823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f0e0165-37e4-4223-a3d8-de44652a9dff tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:50.955043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8f0e0165-37e4-4223-a3d8-de44652a9dff tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:50.965229 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8f0e0165-37e4-4223-a3d8-de44652a9dff tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1520 microversion: 2.1 time: 0.370956 Oct 18 13:37:50.969430 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2520/4779] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:50 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:50.974437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0023b190-be2e-4eee-9b5c-38ca20be206d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617ad5dc0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:51.040659 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0023b190-be2e-4eee-9b5c-38ca20be206d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.069850 Oct 18 13:37:51.041978 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2521/4780] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:50 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:51.120837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:37:51.121427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:37:51.121760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:37:51.122180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:37:51.122709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:37:51.135217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:51.135707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:51.142005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:51.143830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:51.144319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:51.144779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:51.245984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:37:51.258293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for user a4856dd5667c4f10aa9ff1ccb1788cc8 and project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:37:51.319362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:37:51.321908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:37:51.410408 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2372d304-2fad-470c-9e7f-b22fbb07ec89 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.270098 Oct 18 13:37:51.411921 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2260/4781] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:37:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:37:51.424485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5e18ed92-adf8-419b-b7f1-adbb532e8d4b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:51.425172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e18ed92-adf8-419b-b7f1-adbb532e8d4b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:51.522077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5e18ed92-adf8-419b-b7f1-adbb532e8d4b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:51.532859 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5e18ed92-adf8-419b-b7f1-adbb532e8d4b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1209 microversion: 2.1 time: 0.112946 Oct 18 13:37:51.537092 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2522/4782] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:51 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1209 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:51.560740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb89aeec-c40f-478e-b1af-f006e7336f02 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:51.561388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb89aeec-c40f-478e-b1af-f006e7336f02 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:51.571947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb89aeec-c40f-478e-b1af-f006e7336f02 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:51.573950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb89aeec-c40f-478e-b1af-f006e7336f02 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:51.574992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb89aeec-c40f-478e-b1af-f006e7336f02 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:51.579004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb89aeec-c40f-478e-b1af-f006e7336f02 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:51.579531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb89aeec-c40f-478e-b1af-f006e7336f02 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:51.579964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb89aeec-c40f-478e-b1af-f006e7336f02 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:51.847156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fb89aeec-c40f-478e-b1af-f006e7336f02 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:51.868753 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb89aeec-c40f-478e-b1af-f006e7336f02 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1721 microversion: 2.1 time: 0.315169 Oct 18 13:37:51.872174 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2261/4783] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:51 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1721 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:51.998379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0ecb7dd0-a63f-4a51-92ba-445730e6ba18 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:52.000100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0ecb7dd0-a63f-4a51-92ba-445730e6ba18 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:52.016443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ecb7dd0-a63f-4a51-92ba-445730e6ba18 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:52.018476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ecb7dd0-a63f-4a51-92ba-445730e6ba18 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:52.022768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ecb7dd0-a63f-4a51-92ba-445730e6ba18 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:52.023980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ecb7dd0-a63f-4a51-92ba-445730e6ba18 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:52.027785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ecb7dd0-a63f-4a51-92ba-445730e6ba18 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:52.030880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ecb7dd0-a63f-4a51-92ba-445730e6ba18 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:52.058667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cd4bc747-09c9-4eff-bd2e-898770e2fc48 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e763040>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:52.162783 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cd4bc747-09c9-4eff-bd2e-898770e2fc48 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.109948 Oct 18 13:37:52.163415 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2262/4784] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:52 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:52.523829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0ecb7dd0-a63f-4a51-92ba-445730e6ba18 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:52.533860 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0ecb7dd0-a63f-4a51-92ba-445730e6ba18 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1520 microversion: 2.1 time: 0.539994 Oct 18 13:37:52.536570 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2523/4785] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:51 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1520 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:52.564478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-680a4124-afd7-4749-bfad-50f98207523e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:52.565397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-680a4124-afd7-4749-bfad-50f98207523e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:52.573349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-680a4124-afd7-4749-bfad-50f98207523e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:52.578847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-680a4124-afd7-4749-bfad-50f98207523e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:52.578847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-680a4124-afd7-4749-bfad-50f98207523e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:52.579453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-680a4124-afd7-4749-bfad-50f98207523e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:52.580949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-680a4124-afd7-4749-bfad-50f98207523e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:52.581418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-680a4124-afd7-4749-bfad-50f98207523e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:52.734896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-680a4124-afd7-4749-bfad-50f98207523e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:52.751519 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-680a4124-afd7-4749-bfad-50f98207523e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1213 microversion: 2.1 time: 0.191684 Oct 18 13:37:52.753083 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2263/4786] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:52 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1213 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:52.897629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0914174c-6623-4793-92a3-2526f28b8b53 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:52.898625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0914174c-6623-4793-92a3-2526f28b8b53 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:52.905452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0914174c-6623-4793-92a3-2526f28b8b53 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:52.906290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0914174c-6623-4793-92a3-2526f28b8b53 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:52.906876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0914174c-6623-4793-92a3-2526f28b8b53 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:52.907938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0914174c-6623-4793-92a3-2526f28b8b53 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:52.908553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0914174c-6623-4793-92a3-2526f28b8b53 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:52.909355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0914174c-6623-4793-92a3-2526f28b8b53 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:53.115266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0914174c-6623-4793-92a3-2526f28b8b53 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:53.133389 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0914174c-6623-4793-92a3-2526f28b8b53 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1721 microversion: 2.1 time: 0.240374 Oct 18 13:37:53.134541 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2524/4787] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:52 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:53.180946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-801d11fc-df79-4962-bdca-84ebb379e7a8 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e763ca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:53.275416 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-801d11fc-df79-4962-bdca-84ebb379e7a8 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.099258 Oct 18 13:37:53.276242 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2264/4788] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:53 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:53.567633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8c71a221-a02d-40b3-a964-234458354e29 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:53.568661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8c71a221-a02d-40b3-a964-234458354e29 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:53.599340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c71a221-a02d-40b3-a964-234458354e29 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:53.599830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c71a221-a02d-40b3-a964-234458354e29 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:53.600274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c71a221-a02d-40b3-a964-234458354e29 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:53.600993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c71a221-a02d-40b3-a964-234458354e29 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:53.601536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c71a221-a02d-40b3-a964-234458354e29 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:53.601967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8c71a221-a02d-40b3-a964-234458354e29 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:53.775884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-87a26e07-edc4-4dcf-ae9b-20ed56e61794 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:53.776886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-87a26e07-edc4-4dcf-ae9b-20ed56e61794 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:53.809272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87a26e07-edc4-4dcf-ae9b-20ed56e61794 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:53.810010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87a26e07-edc4-4dcf-ae9b-20ed56e61794 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:53.812504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87a26e07-edc4-4dcf-ae9b-20ed56e61794 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:53.824363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87a26e07-edc4-4dcf-ae9b-20ed56e61794 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:53.825565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87a26e07-edc4-4dcf-ae9b-20ed56e61794 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:53.830196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87a26e07-edc4-4dcf-ae9b-20ed56e61794 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:54.091737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-87a26e07-edc4-4dcf-ae9b-20ed56e61794 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:54.094609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8c71a221-a02d-40b3-a964-234458354e29 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:54.108668 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8c71a221-a02d-40b3-a964-234458354e29 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1520 microversion: 2.1 time: 0.545369 Oct 18 13:37:54.122781 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-87a26e07-edc4-4dcf-ae9b-20ed56e61794 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1279 microversion: 2.1 time: 0.344996 Oct 18 13:37:54.123691 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2525/4789] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:53 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1520 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:54.130392 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2265/4790] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:53 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1279 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:54.160443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8593a6c8-c90a-4a39-9fef-630c63790d13 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:54.161516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8593a6c8-c90a-4a39-9fef-630c63790d13 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:54.201879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8593a6c8-c90a-4a39-9fef-630c63790d13 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:54.204303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8593a6c8-c90a-4a39-9fef-630c63790d13 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:54.205311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8593a6c8-c90a-4a39-9fef-630c63790d13 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:54.206338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8593a6c8-c90a-4a39-9fef-630c63790d13 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:54.207702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8593a6c8-c90a-4a39-9fef-630c63790d13 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:54.208815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8593a6c8-c90a-4a39-9fef-630c63790d13 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:54.292602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9f593e13-0ad6-43a9-88a5-32ee728cc5b4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7f9dc0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:54.353645 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9f593e13-0ad6-43a9-88a5-32ee728cc5b4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.066773 Oct 18 13:37:54.363469 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2266/4791] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:54 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:54.490092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8593a6c8-c90a-4a39-9fef-630c63790d13 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:54.507295 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8593a6c8-c90a-4a39-9fef-630c63790d13 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1721 microversion: 2.1 time: 0.351793 Oct 18 13:37:54.510205 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2526/4792] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:54 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1721 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:55.138735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a5f5a340-8dc6-4438-975b-377912f6ec55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:55.139033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a5f5a340-8dc6-4438-975b-377912f6ec55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:55.155666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6a959925-9707-4817-ba2d-405f1429f923 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:55.156702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6a959925-9707-4817-ba2d-405f1429f923 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:55.174613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5f5a340-8dc6-4438-975b-377912f6ec55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:55.182386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a959925-9707-4817-ba2d-405f1429f923 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:55.182909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5f5a340-8dc6-4438-975b-377912f6ec55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:55.184185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5f5a340-8dc6-4438-975b-377912f6ec55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:55.185666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a959925-9707-4817-ba2d-405f1429f923 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:55.188824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a959925-9707-4817-ba2d-405f1429f923 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:55.191491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5f5a340-8dc6-4438-975b-377912f6ec55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:55.192434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5f5a340-8dc6-4438-975b-377912f6ec55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:55.193488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a959925-9707-4817-ba2d-405f1429f923 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:55.195052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5f5a340-8dc6-4438-975b-377912f6ec55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:55.196719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a959925-9707-4817-ba2d-405f1429f923 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:55.198771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a959925-9707-4817-ba2d-405f1429f923 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:55.467133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6a959925-9707-4817-ba2d-405f1429f923 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:55.474988 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6a959925-9707-4817-ba2d-405f1429f923 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1309 microversion: 2.1 time: 0.325139 Oct 18 13:37:55.478403 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2527/4793] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:55 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1309 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:55.489458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8fa256ce-80a9-49c3-ab88-924c7f1940ab tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617b7f9d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:55.593746 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8fa256ce-80a9-49c3-ab88-924c7f1940ab tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.114003 Oct 18 13:37:55.594417 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2528/4794] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:55 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:55.606894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ae801410-74b2-4e0d-8731-c335f5eb0872 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:55.607651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ae801410-74b2-4e0d-8731-c335f5eb0872 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:55.619539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae801410-74b2-4e0d-8731-c335f5eb0872 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:55.625945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae801410-74b2-4e0d-8731-c335f5eb0872 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:55.626792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae801410-74b2-4e0d-8731-c335f5eb0872 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:55.628011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae801410-74b2-4e0d-8731-c335f5eb0872 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:55.629981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae801410-74b2-4e0d-8731-c335f5eb0872 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:55.631435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ae801410-74b2-4e0d-8731-c335f5eb0872 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:55.876594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ae801410-74b2-4e0d-8731-c335f5eb0872 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:55.888778 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ae801410-74b2-4e0d-8731-c335f5eb0872 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1721 microversion: 2.1 time: 0.291779 Oct 18 13:37:55.889400 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2529/4795] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:55 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1721 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:55.953872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a5f5a340-8dc6-4438-975b-377912f6ec55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:55.970174 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a5f5a340-8dc6-4438-975b-377912f6ec55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1520 microversion: 2.1 time: 0.836195 Oct 18 13:37:55.976844 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2267/4796] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:55 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1520 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:56.505024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a3deedb9-35ca-44e2-8823-6a3eaab53c5b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:56.505816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a3deedb9-35ca-44e2-8823-6a3eaab53c5b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:56.517222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3deedb9-35ca-44e2-8823-6a3eaab53c5b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:56.518701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3deedb9-35ca-44e2-8823-6a3eaab53c5b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:56.519474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3deedb9-35ca-44e2-8823-6a3eaab53c5b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:56.521975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3deedb9-35ca-44e2-8823-6a3eaab53c5b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:56.525532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3deedb9-35ca-44e2-8823-6a3eaab53c5b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:56.526187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3deedb9-35ca-44e2-8823-6a3eaab53c5b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:56.609889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0100d322-2637-4b62-8b0f-d37bfb109adb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e74ad30>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:56.697250 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0100d322-2637-4b62-8b0f-d37bfb109adb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.090984 Oct 18 13:37:56.702079 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2268/4797] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:56 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:56.835075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a3deedb9-35ca-44e2-8823-6a3eaab53c5b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:56.850474 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a3deedb9-35ca-44e2-8823-6a3eaab53c5b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1309 microversion: 2.1 time: 0.349236 Oct 18 13:37:56.852263 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2530/4798] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:56 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1309 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:56.912412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7156386-7fa9-4221-8161-15569032f3e4 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:56.913148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f7156386-7fa9-4221-8161-15569032f3e4 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:56.935267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7156386-7fa9-4221-8161-15569032f3e4 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:56.935847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7156386-7fa9-4221-8161-15569032f3e4 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:56.937457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7156386-7fa9-4221-8161-15569032f3e4 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:56.938357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7156386-7fa9-4221-8161-15569032f3e4 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:56.938982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7156386-7fa9-4221-8161-15569032f3e4 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:56.951462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7156386-7fa9-4221-8161-15569032f3e4 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:56.995010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-15bb90c0-ec3d-426b-8be0-9a5febd70cf8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:56.995730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-15bb90c0-ec3d-426b-8be0-9a5febd70cf8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:57.005062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15bb90c0-ec3d-426b-8be0-9a5febd70cf8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:57.017619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15bb90c0-ec3d-426b-8be0-9a5febd70cf8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:57.018266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15bb90c0-ec3d-426b-8be0-9a5febd70cf8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:57.019182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15bb90c0-ec3d-426b-8be0-9a5febd70cf8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:57.019717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:57.020224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15bb90c0-ec3d-426b-8be0-9a5febd70cf8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:57.020224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15bb90c0-ec3d-426b-8be0-9a5febd70cf8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:57.779159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f7156386-7fa9-4221-8161-15569032f3e4 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:57.793767 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f7156386-7fa9-4221-8161-15569032f3e4 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1721 microversion: 2.1 time: 0.881820 Oct 18 13:37:57.796779 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2269/4799] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:56 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1721 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:57.803888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dc564804-32ac-4c11-a4ae-05d2e4005021 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e80b4c0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:58.138360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-15bb90c0-ec3d-426b-8be0-9a5febd70cf8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:58.150473 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-15bb90c0-ec3d-426b-8be0-9a5febd70cf8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1520 microversion: 2.1 time: 1.160002 Oct 18 13:37:58.151810 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2531/4800] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:56 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1520 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:37:58.156867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-706b2a6b-0fef-42b7-ac3a-945304730439 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:58.158005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-706b2a6b-0fef-42b7-ac3a-945304730439 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:58.166352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-706b2a6b-0fef-42b7-ac3a-945304730439 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.167600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-706b2a6b-0fef-42b7-ac3a-945304730439 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.173617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-706b2a6b-0fef-42b7-ac3a-945304730439 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.174734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-706b2a6b-0fef-42b7-ac3a-945304730439 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.175434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-706b2a6b-0fef-42b7-ac3a-945304730439 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.176129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-706b2a6b-0fef-42b7-ac3a-945304730439 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.426869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-706b2a6b-0fef-42b7-ac3a-945304730439 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:58.439083 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-706b2a6b-0fef-42b7-ac3a-945304730439 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1309 microversion: 2.1 time: 0.282976 Oct 18 13:37:58.441683 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2532/4801] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:58 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1309 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:58.582578 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dc564804-32ac-4c11-a4ae-05d2e4005021 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1450 microversion: 2.1 time: 0.784291 Oct 18 13:37:58.583665 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2270/4802] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:37:57 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1450 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:58.826872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4a83a122-fd18-4004-b34e-b1c726c64c2e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:58.828080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4a83a122-fd18-4004-b34e-b1c726c64c2e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:58.838657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a83a122-fd18-4004-b34e-b1c726c64c2e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.839510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a83a122-fd18-4004-b34e-b1c726c64c2e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.840321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a83a122-fd18-4004-b34e-b1c726c64c2e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:58.842184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a83a122-fd18-4004-b34e-b1c726c64c2e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:58.843556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a83a122-fd18-4004-b34e-b1c726c64c2e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:58.844216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a83a122-fd18-4004-b34e-b1c726c64c2e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.103664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4a83a122-fd18-4004-b34e-b1c726c64c2e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:59.114844 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4a83a122-fd18-4004-b34e-b1c726c64c2e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1698 microversion: 2.1 time: 0.294830 Oct 18 13:37:59.115604 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2533/4803] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:58 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1698 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:59.126221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-800823236", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "b6e1dd83-7923-485b-ac1d-08b508732aa8"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:59.146260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-775fbc97-8c59-42db-9f87-301c88ffd09e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:37:59.155582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-775fbc97-8c59-42db-9f87-301c88ffd09e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.156349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-775fbc97-8c59-42db-9f87-301c88ffd09e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.157165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-775fbc97-8c59-42db-9f87-301c88ffd09e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.191656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-775fbc97-8c59-42db-9f87-301c88ffd09e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Going to try to start instance {{(pid=120611) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 13:37:59.202953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] validate_networks() for [('b6e1dd83-7923-485b-ac1d-08b508732aa8', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:37:59.283991 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-775fbc97-8c59-42db-9f87-301c88ffd09e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "POST /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/action" status: 202 len: 0 microversion: 2.1 time: 0.144126 Oct 18 13:37:59.284926 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2534/4804] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:37:59 2022] POST /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:37:59.291308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-00d36241-0488-457a-948b-b0a4417b3c81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:59.292882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-00d36241-0488-457a-948b-b0a4417b3c81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:59.313032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00d36241-0488-457a-948b-b0a4417b3c81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.313968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00d36241-0488-457a-948b-b0a4417b3c81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.314628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00d36241-0488-457a-948b-b0a4417b3c81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.315925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00d36241-0488-457a-948b-b0a4417b3c81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.318782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00d36241-0488-457a-948b-b0a4417b3c81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.319930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00d36241-0488-457a-948b-b0a4417b3c81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.373783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:37:59.616463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-00d36241-0488-457a-948b-b0a4417b3c81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:59.625365 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-00d36241-0488-457a-948b-b0a4417b3c81 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1520 microversion: 2.1 time: 0.338753 Oct 18 13:37:59.628345 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2535/4805] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:59 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:37:59.637773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d946065-5a98-4dce-b6b2-5171c8c53527 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:37:59.637773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d946065-5a98-4dce-b6b2-5171c8c53527 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:37:59.661262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d946065-5a98-4dce-b6b2-5171c8c53527 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.669749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d946065-5a98-4dce-b6b2-5171c8c53527 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.673802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d946065-5a98-4dce-b6b2-5171c8c53527 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.674572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d946065-5a98-4dce-b6b2-5171c8c53527 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:37:59.675025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d946065-5a98-4dce-b6b2-5171c8c53527 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:37:59.677590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d946065-5a98-4dce-b6b2-5171c8c53527 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:37:59.963480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d946065-5a98-4dce-b6b2-5171c8c53527 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:37:59.975183 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d946065-5a98-4dce-b6b2-5171c8c53527 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1707 microversion: 2.1 time: 0.345755 Oct 18 13:37:59.984689 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2536/4806] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:59 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1707 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:00.003676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-476d744b-0068-468c-aabe-e31dbedb30db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:00.004300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-476d744b-0068-468c-aabe-e31dbedb30db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:00.012212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-476d744b-0068-468c-aabe-e31dbedb30db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.013113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-476d744b-0068-468c-aabe-e31dbedb30db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.013574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-476d744b-0068-468c-aabe-e31dbedb30db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.014266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-476d744b-0068-468c-aabe-e31dbedb30db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.015537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-476d744b-0068-468c-aabe-e31dbedb30db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.016588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-476d744b-0068-468c-aabe-e31dbedb30db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.139029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:38:00.140131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:38:00.142086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:38:00.143000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:38:00.144064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:38:00.167432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.167838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.168281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.169028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.169515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.173415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.242783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Getting quotas for project c8b2b1d06aa146df9714ab1430c8f623. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:00.258720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Getting quotas for user d3682bfef32247e4b72a46e8206a3c8b and project c8b2b1d06aa146df9714ab1430c8f623. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:00.304500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:38:00.307398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:00.390294 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d89a87b6-e5a7-4b4b-9590-dc4e2f72e844 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.480552 Oct 18 13:38:00.393943 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2271/4807] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:37:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:38:00.400142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ff72bdab-8ee2-419c-bda3-bdbbc53e1c71 req-cd3bcfa1-01cc-48ca-a76c-429ff9fb31be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98fd0182-30e6-4a86-9b90-a70a91ee36a6", "tag": "0ad57bd5-5e53-49c8-84e8-00579e72deec"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:00.424031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ff72bdab-8ee2-419c-bda3-bdbbc53e1c71 req-cd3bcfa1-01cc-48ca-a76c-429ff9fb31be service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.424767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ff72bdab-8ee2-419c-bda3-bdbbc53e1c71 req-cd3bcfa1-01cc-48ca-a76c-429ff9fb31be service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.425411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ff72bdab-8ee2-419c-bda3-bdbbc53e1c71 req-cd3bcfa1-01cc-48ca-a76c-429ff9fb31be service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.452348 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ff72bdab-8ee2-419c-bda3-bdbbc53e1c71 req-cd3bcfa1-01cc-48ca-a76c-429ff9fb31be service nova] Creating event network-changed:0ad57bd5-5e53-49c8-84e8-00579e72deec for instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 on n-h1-858384-13 Oct 18 13:38:00.466305 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ff72bdab-8ee2-419c-bda3-bdbbc53e1c71 req-cd3bcfa1-01cc-48ca-a76c-429ff9fb31be service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064130 Oct 18 13:38:00.467295 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2272/4808] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:00.473025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-20bdc5ba-0f9d-49d7-bc42-a9cca8ee2bbb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e78b040>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:00.502072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-476d744b-0068-468c-aabe-e31dbedb30db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:00.513839 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-476d744b-0068-468c-aabe-e31dbedb30db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1309 microversion: 2.1 time: 0.525251 Oct 18 13:38:00.515660 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2537/4809] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:37:59 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1309 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:00.524007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5448afc6-c453-45b2-a5e4-836080e0ac86 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:00.524865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5448afc6-c453-45b2-a5e4-836080e0ac86 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:00.547983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:00.569954 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-20bdc5ba-0f9d-49d7-bc42-a9cca8ee2bbb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1459 microversion: 2.1 time: 0.101203 Oct 18 13:38:00.570553 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2273/4810] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:00 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1459 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:00.595228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-876c441b-ff04-4639-a466-76f85e9bd01f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e766790>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:00.630392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5448afc6-c453-45b2-a5e4-836080e0ac86 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:00.642211 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5448afc6-c453-45b2-a5e4-836080e0ac86 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1216 microversion: 2.1 time: 0.122988 Oct 18 13:38:00.643832 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2538/4811] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:00 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1216 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:00.652100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-892257fa-e301-46bf-b99b-102184b8bdb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:00.653074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-892257fa-e301-46bf-b99b-102184b8bdb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:00.661076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-892257fa-e301-46bf-b99b-102184b8bdb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.661692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-892257fa-e301-46bf-b99b-102184b8bdb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.662382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-892257fa-e301-46bf-b99b-102184b8bdb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.663247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-892257fa-e301-46bf-b99b-102184b8bdb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.664144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-892257fa-e301-46bf-b99b-102184b8bdb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.664878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-892257fa-e301-46bf-b99b-102184b8bdb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.688978 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-876c441b-ff04-4639-a466-76f85e9bd01f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 200 len: 1459 microversion: 2.1 time: 0.104753 Oct 18 13:38:00.699115 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2274/4812] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:00 2022] GET /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 1459 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:00.708886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aefe5adc-e892-4dac-a005-41117ec677f4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:00.710481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aefe5adc-e892-4dac-a005-41117ec677f4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:00.724132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefe5adc-e892-4dac-a005-41117ec677f4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.725103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefe5adc-e892-4dac-a005-41117ec677f4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.726232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefe5adc-e892-4dac-a005-41117ec677f4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.727433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefe5adc-e892-4dac-a005-41117ec677f4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.728202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefe5adc-e892-4dac-a005-41117ec677f4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.729052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefe5adc-e892-4dac-a005-41117ec677f4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.886455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-892257fa-e301-46bf-b99b-102184b8bdb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:00.897217 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-892257fa-e301-46bf-b99b-102184b8bdb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1500 microversion: 2.1 time: 0.249699 Oct 18 13:38:00.916114 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2539/4813] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:00 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1500 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:00.934731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba851ad9-a166-4aae-acdd-e3f99c1b368c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f156890-c53d-4749-867f-1664c5e7acf0"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:00.954482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ba851ad9-a166-4aae-acdd-e3f99c1b368c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:00.978205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba851ad9-a166-4aae-acdd-e3f99c1b368c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.978909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba851ad9-a166-4aae-acdd-e3f99c1b368c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.979556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba851ad9-a166-4aae-acdd-e3f99c1b368c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:00.980264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba851ad9-a166-4aae-acdd-e3f99c1b368c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:00.980776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba851ad9-a166-4aae-acdd-e3f99c1b368c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:00.981283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba851ad9-a166-4aae-acdd-e3f99c1b368c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.011086 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-ba851ad9-a166-4aae-acdd-e3f99c1b368c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] HTTP exception thrown: Cannot 'attach_volume' instance 568613ab-c15f-4a59-aa10-8e40b871f918 while it is in vm_state rescued Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba851ad9-a166-4aae-acdd-e3f99c1b368c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Request method failure captured: Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/os-volume_attachments HTTP/1.1 Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 74 Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqvrqX_zkCEhVydfvHZBeTI6vdRWUcUOpxttnLcg2aIsaFsLlHnFjovxQI4kcc3Myi8lwAHRAsf2wLTn_JlgKXt7GIy8E5du_6bYylQ1wRbIaq_CdQtpXoiOxia-B1issY5UDMjn_CVSSo9PM6M7QgZo_y7FdWj0xg611rUe51cUCao Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0cdfce6f9e86407d883e624dd2c50559"}]}] Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 4113a1418b92488e97bf50aecdd49bb1 Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: {"volumeAttachment": {"volumeId": "0f156890-c53d-4749-867f-1664c5e7acf0"}} Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: exception: Cannot 'attach_volume' instance 568613ab-c15f-4a59-aa10-8e40b871f918 while it is in vm_state rescued Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'server_id': '568613ab-c15f-4a59-aa10-8e40b871f918', 'body': {'volumeAttachment': {'volumeId': '0f156890-c53d-4749-867f-1664c5e7acf0'}}} Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 568613ab-c15f-4a59-aa10-8e40b871f918 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 18 13:38:01.013319 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:38:01.018765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:38:01.018765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:38:01.018765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 568613ab-c15f-4a59-aa10-8e40b871f918 while it is in vm_state rescued Oct 18 13:38:01.018765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:01.018765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:01.018765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:01.018765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:01.018765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:01.018765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:01.018765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:01.018765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:01.018765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 568613ab-c15f-4a59-aa10-8e40b871f918 while it is in vm_state rescued Oct 18 13:38:01.018765 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:01.020783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba851ad9-a166-4aae-acdd-e3f99c1b368c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Returning 409 to user: Cannot 'attach_volume' instance 568613ab-c15f-4a59-aa10-8e40b871f918 while it is in vm_state rescued {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:01.022161 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ba851ad9-a166-4aae-acdd-e3f99c1b368c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.101838 Oct 18 13:38:01.024119 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2540/4814] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:38:00 2022] POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/os-volume_attachments => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:38:01.033796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2d7dc367-e3c2-4106-b25c-0ae06ed55aa7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:01.036939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2d7dc367-e3c2-4106-b25c-0ae06ed55aa7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:01.044735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d7dc367-e3c2-4106-b25c-0ae06ed55aa7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.045494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d7dc367-e3c2-4106-b25c-0ae06ed55aa7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.046120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d7dc367-e3c2-4106-b25c-0ae06ed55aa7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.047066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d7dc367-e3c2-4106-b25c-0ae06ed55aa7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.047851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d7dc367-e3c2-4106-b25c-0ae06ed55aa7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.048669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d7dc367-e3c2-4106-b25c-0ae06ed55aa7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.398838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aefe5adc-e892-4dac-a005-41117ec677f4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:01.409477 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aefe5adc-e892-4dac-a005-41117ec677f4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1467 microversion: 2.1 time: 0.708583 Oct 18 13:38:01.425579 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2275/4815] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:00 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1467 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:01.444080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f493e66f-e192-4395-800f-785a4e5f9e61 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:01.446079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f493e66f-e192-4395-800f-785a4e5f9e61 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:01.454499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2d7dc367-e3c2-4106-b25c-0ae06ed55aa7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:01.468327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f493e66f-e192-4395-800f-785a4e5f9e61 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.468810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f493e66f-e192-4395-800f-785a4e5f9e61 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.471382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f493e66f-e192-4395-800f-785a4e5f9e61 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.472510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f493e66f-e192-4395-800f-785a4e5f9e61 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.475269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f493e66f-e192-4395-800f-785a4e5f9e61 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.476388 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2d7dc367-e3c2-4106-b25c-0ae06ed55aa7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1707 microversion: 2.1 time: 0.447750 Oct 18 13:38:01.477309 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2541/4816] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:01 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1707 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:01.484336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f493e66f-e192-4395-800f-785a4e5f9e61 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.488052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-94566fda-e4fb-49ac-a64b-f34ae4946791 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1098792853"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:01.492585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-94566fda-e4fb-49ac-a64b-f34ae4946791 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:01.525050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94566fda-e4fb-49ac-a64b-f34ae4946791 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.525745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94566fda-e4fb-49ac-a64b-f34ae4946791 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.526162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94566fda-e4fb-49ac-a64b-f34ae4946791 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.527140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94566fda-e4fb-49ac-a64b-f34ae4946791 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.527856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94566fda-e4fb-49ac-a64b-f34ae4946791 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.528556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94566fda-e4fb-49ac-a64b-f34ae4946791 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.616492 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f493e66f-e192-4395-800f-785a4e5f9e61 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/action" status: 202 len: 0 microversion: 2.1 time: 0.189167 Oct 18 13:38:01.622527 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2276/4817] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:38:01 2022] POST /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:38:01.638332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-94b5b3f7-90ea-47d8-a3cb-bbd1dba31487 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:01.641669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-94b5b3f7-90ea-47d8-a3cb-bbd1dba31487 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:01.650674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94b5b3f7-90ea-47d8-a3cb-bbd1dba31487 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.651595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94b5b3f7-90ea-47d8-a3cb-bbd1dba31487 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.652566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94b5b3f7-90ea-47d8-a3cb-bbd1dba31487 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.653960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94b5b3f7-90ea-47d8-a3cb-bbd1dba31487 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.656165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94b5b3f7-90ea-47d8-a3cb-bbd1dba31487 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.657445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94b5b3f7-90ea-47d8-a3cb-bbd1dba31487 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:01.968146 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-94566fda-e4fb-49ac-a64b-f34ae4946791 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "POST /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456/action" status: 202 len: 0 microversion: 2.1 time: 0.489725 Oct 18 13:38:01.974336 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2542/4818] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:38:01 2022] POST /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 13:38:01.980795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cedb82f0-c302-4b45-ad5e-39dbe0cbeb55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:01.981759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cedb82f0-c302-4b45-ad5e-39dbe0cbeb55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:01.987976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-94b5b3f7-90ea-47d8-a3cb-bbd1dba31487 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:01.998778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cedb82f0-c302-4b45-ad5e-39dbe0cbeb55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:01.999382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cedb82f0-c302-4b45-ad5e-39dbe0cbeb55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:01.999943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cedb82f0-c302-4b45-ad5e-39dbe0cbeb55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.000847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cedb82f0-c302-4b45-ad5e-39dbe0cbeb55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.000970 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-94b5b3f7-90ea-47d8-a3cb-bbd1dba31487 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1309 microversion: 2.1 time: 0.373410 Oct 18 13:38:02.001688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cedb82f0-c302-4b45-ad5e-39dbe0cbeb55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.002322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cedb82f0-c302-4b45-ad5e-39dbe0cbeb55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.004427 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2277/4819] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:01 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1309 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:02.011411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c6d7eab5-f2f2-4dfc-96a7-f1f84d61c07f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:02.012028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c6d7eab5-f2f2-4dfc-96a7-f1f84d61c07f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:02.028260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6d7eab5-f2f2-4dfc-96a7-f1f84d61c07f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.028757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6d7eab5-f2f2-4dfc-96a7-f1f84d61c07f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.029219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6d7eab5-f2f2-4dfc-96a7-f1f84d61c07f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.029939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6d7eab5-f2f2-4dfc-96a7-f1f84d61c07f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.030395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6d7eab5-f2f2-4dfc-96a7-f1f84d61c07f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.030823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6d7eab5-f2f2-4dfc-96a7-f1f84d61c07f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.137414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c6d7eab5-f2f2-4dfc-96a7-f1f84d61c07f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:02.146468 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c6d7eab5-f2f2-4dfc-96a7-f1f84d61c07f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1268 microversion: 2.1 time: 0.140889 Oct 18 13:38:02.147169 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2278/4820] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:02 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1268 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:02.160764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1f0d1b56-56db-446e-946f-fcaebd0f6e48 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e785040>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:02.209403 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1f0d1b56-56db-446e-946f-fcaebd0f6e48 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.060994 Oct 18 13:38:02.210004 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2279/4821] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:02 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:02.224756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cedb82f0-c302-4b45-ad5e-39dbe0cbeb55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:02.236208 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cedb82f0-c302-4b45-ad5e-39dbe0cbeb55 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1508 microversion: 2.1 time: 0.259561 Oct 18 13:38:02.237004 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2543/4822] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:01 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:02.511202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a62ab7df-6b43-4875-ba46-a61232bd86c8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:02.511654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a62ab7df-6b43-4875-ba46-a61232bd86c8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:02.518138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a62ab7df-6b43-4875-ba46-a61232bd86c8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.518622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a62ab7df-6b43-4875-ba46-a61232bd86c8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.519072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a62ab7df-6b43-4875-ba46-a61232bd86c8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.519747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a62ab7df-6b43-4875-ba46-a61232bd86c8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:02.520393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a62ab7df-6b43-4875-ba46-a61232bd86c8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:02.520816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a62ab7df-6b43-4875-ba46-a61232bd86c8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:02.921360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a62ab7df-6b43-4875-ba46-a61232bd86c8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:02.940720 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a62ab7df-6b43-4875-ba46-a61232bd86c8 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1707 microversion: 2.1 time: 0.434552 Oct 18 13:38:02.946170 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2280/4823] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:02 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1707 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:03.031648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3749e13d-8148-48f4-b5b1-a7cbdca15d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:03.032412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3749e13d-8148-48f4-b5b1-a7cbdca15d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:03.042305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3749e13d-8148-48f4-b5b1-a7cbdca15d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.042936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3749e13d-8148-48f4-b5b1-a7cbdca15d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.043722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3749e13d-8148-48f4-b5b1-a7cbdca15d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.045236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3749e13d-8148-48f4-b5b1-a7cbdca15d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.046568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3749e13d-8148-48f4-b5b1-a7cbdca15d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.048075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3749e13d-8148-48f4-b5b1-a7cbdca15d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.170227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0ef6308c-6d48-46bf-827a-e09185b381ce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:03.170842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0ef6308c-6d48-46bf-827a-e09185b381ce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:03.189040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ef6308c-6d48-46bf-827a-e09185b381ce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.189562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ef6308c-6d48-46bf-827a-e09185b381ce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.190002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ef6308c-6d48-46bf-827a-e09185b381ce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.190712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ef6308c-6d48-46bf-827a-e09185b381ce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.191165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ef6308c-6d48-46bf-827a-e09185b381ce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.191585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ef6308c-6d48-46bf-827a-e09185b381ce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.316689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3749e13d-8148-48f4-b5b1-a7cbdca15d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:03.325093 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3749e13d-8148-48f4-b5b1-a7cbdca15d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1309 microversion: 2.1 time: 0.298676 Oct 18 13:38:03.328183 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2544/4824] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:03 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1309 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:03.332977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-223d0f7b-480e-4889-9b59-14320c490b4f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617ad59d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:03.391473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0ef6308c-6d48-46bf-827a-e09185b381ce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:03.407392 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0ef6308c-6d48-46bf-827a-e09185b381ce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1274 microversion: 2.1 time: 0.240911 Oct 18 13:38:03.417290 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2281/4825] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:03 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1274 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:03.419849 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-223d0f7b-480e-4889-9b59-14320c490b4f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.090405 Oct 18 13:38:03.427753 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2545/4826] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:03 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:03.434124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d3f30b5c-76ee-4515-9115-abfbd4bd0e73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:03.435243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d3f30b5c-76ee-4515-9115-abfbd4bd0e73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:03.442446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3f30b5c-76ee-4515-9115-abfbd4bd0e73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.443243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3f30b5c-76ee-4515-9115-abfbd4bd0e73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.444059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3f30b5c-76ee-4515-9115-abfbd4bd0e73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.445502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3f30b5c-76ee-4515-9115-abfbd4bd0e73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.446168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3f30b5c-76ee-4515-9115-abfbd4bd0e73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.447132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3f30b5c-76ee-4515-9115-abfbd4bd0e73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.768591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d3f30b5c-76ee-4515-9115-abfbd4bd0e73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:03.781887 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d3f30b5c-76ee-4515-9115-abfbd4bd0e73 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1508 microversion: 2.1 time: 0.363307 Oct 18 13:38:03.784871 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2282/4827] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:03 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:03.818793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-44894ea7-199c-494e-a71d-2fcdaabb45c4 req-9a885def-35a7-49e8-ba88-2f8f020654ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833b85f4-e854-4a7b-b04d-001cde240eb3", "name": "network-vif-unplugged", "status": "completed", "tag": "83080d1b-68a0-4f1b-a31f-f765e5c6c561"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:03.833454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-44894ea7-199c-494e-a71d-2fcdaabb45c4 req-9a885def-35a7-49e8-ba88-2f8f020654ab service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.834481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-44894ea7-199c-494e-a71d-2fcdaabb45c4 req-9a885def-35a7-49e8-ba88-2f8f020654ab service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.835176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-44894ea7-199c-494e-a71d-2fcdaabb45c4 req-9a885def-35a7-49e8-ba88-2f8f020654ab service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.848708 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-44894ea7-199c-494e-a71d-2fcdaabb45c4 req-9a885def-35a7-49e8-ba88-2f8f020654ab service nova] Creating event network-vif-unplugged:83080d1b-68a0-4f1b-a31f-f765e5c6c561 for instance 833b85f4-e854-4a7b-b04d-001cde240eb3 on n-h2-858384-13 Oct 18 13:38:03.858246 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-44894ea7-199c-494e-a71d-2fcdaabb45c4 req-9a885def-35a7-49e8-ba88-2f8f020654ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052036 Oct 18 13:38:03.859247 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2546/4828] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:03.978145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3458e43e-ef23-4d45-8fdc-f50321f9b687 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:03.978835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3458e43e-ef23-4d45-8fdc-f50321f9b687 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:03.990320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3458e43e-ef23-4d45-8fdc-f50321f9b687 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.993370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3458e43e-ef23-4d45-8fdc-f50321f9b687 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:03.994009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3458e43e-ef23-4d45-8fdc-f50321f9b687 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:03.996244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3458e43e-ef23-4d45-8fdc-f50321f9b687 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:03.996879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3458e43e-ef23-4d45-8fdc-f50321f9b687 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:04.000472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3458e43e-ef23-4d45-8fdc-f50321f9b687 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:04.355847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2f407ba3-71e0-41c4-bc21-7a0380bf206c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:04.356557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2f407ba3-71e0-41c4-bc21-7a0380bf206c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:04.371896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f407ba3-71e0-41c4-bc21-7a0380bf206c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:04.374839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f407ba3-71e0-41c4-bc21-7a0380bf206c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:04.381902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f407ba3-71e0-41c4-bc21-7a0380bf206c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:04.383645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f407ba3-71e0-41c4-bc21-7a0380bf206c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:04.384499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f407ba3-71e0-41c4-bc21-7a0380bf206c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:04.385227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f407ba3-71e0-41c4-bc21-7a0380bf206c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:04.612218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2f407ba3-71e0-41c4-bc21-7a0380bf206c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:04.620544 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2f407ba3-71e0-41c4-bc21-7a0380bf206c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1309 microversion: 2.1 time: 0.270568 Oct 18 13:38:04.624178 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2547/4829] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:04 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1309 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:04.636420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-30dbdd09-897e-4757-8b35-286f93502b75 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f001b80>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:04.660787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3458e43e-ef23-4d45-8fdc-f50321f9b687 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:04.673773 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3458e43e-ef23-4d45-8fdc-f50321f9b687 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1711 microversion: 2.1 time: 0.708755 Oct 18 13:38:04.683073 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2283/4830] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:03 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1711 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:04.690492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1b9a1263-a10e-4dc3-84b0-35a1cffe0ec3 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:04.692045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1b9a1263-a10e-4dc3-84b0-35a1cffe0ec3 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:04.700722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b9a1263-a10e-4dc3-84b0-35a1cffe0ec3 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:04.701412 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-30dbdd09-897e-4757-8b35-286f93502b75 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.078691 Oct 18 13:38:04.701986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b9a1263-a10e-4dc3-84b0-35a1cffe0ec3 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:04.702581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b9a1263-a10e-4dc3-84b0-35a1cffe0ec3 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:04.703496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b9a1263-a10e-4dc3-84b0-35a1cffe0ec3 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:04.704176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b9a1263-a10e-4dc3-84b0-35a1cffe0ec3 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:04.704739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b9a1263-a10e-4dc3-84b0-35a1cffe0ec3 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:04.709779 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2548/4831] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:04 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:04.716191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-390d9c39-c301-4a7d-be7b-f4e3b9991fa7 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:04.717120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-390d9c39-c301-4a7d-be7b-f4e3b9991fa7 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:04.738665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-390d9c39-c301-4a7d-be7b-f4e3b9991fa7 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:04.739316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-390d9c39-c301-4a7d-be7b-f4e3b9991fa7 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:04.739757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-390d9c39-c301-4a7d-be7b-f4e3b9991fa7 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:04.740932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-390d9c39-c301-4a7d-be7b-f4e3b9991fa7 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:04.742155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-390d9c39-c301-4a7d-be7b-f4e3b9991fa7 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:04.742632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-390d9c39-c301-4a7d-be7b-f4e3b9991fa7 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:04.774688 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-390d9c39-c301-4a7d-be7b-f4e3b9991fa7 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.062929 Oct 18 13:38:04.775626 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2549/4832] 10.222.0.40 () {58 vars in 1293 bytes} [Tue Oct 18 13:38:04 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58/os-server-password => generated 116 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:04.812206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a3da19f3-09b9-492c-bf89-e3c2576f4cd0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:04.812938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a3da19f3-09b9-492c-bf89-e3c2576f4cd0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:04.819563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3da19f3-09b9-492c-bf89-e3c2576f4cd0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:04.819563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3da19f3-09b9-492c-bf89-e3c2576f4cd0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:04.819924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3da19f3-09b9-492c-bf89-e3c2576f4cd0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:04.820793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3da19f3-09b9-492c-bf89-e3c2576f4cd0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:04.821420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3da19f3-09b9-492c-bf89-e3c2576f4cd0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:04.822003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3da19f3-09b9-492c-bf89-e3c2576f4cd0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:04.948089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1b9a1263-a10e-4dc3-84b0-35a1cffe0ec3 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:04.956574 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1b9a1263-a10e-4dc3-84b0-35a1cffe0ec3 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1316 microversion: 2.1 time: 0.270854 Oct 18 13:38:04.957733 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2284/4833] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:04 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:04.999532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a3da19f3-09b9-492c-bf89-e3c2576f4cd0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:05.008934 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a3da19f3-09b9-492c-bf89-e3c2576f4cd0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1508 microversion: 2.1 time: 0.200862 Oct 18 13:38:05.009893 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2550/4834] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:04 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:05.414948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-bb40ce0e-fe97-42b0-9deb-e527a36e8aac req-c3ad7675-71f7-40d4-99c8-6ccb46d4bb7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c9ed1e-db22-42ef-90ef-63352e533062", "tag": "781c5a7c-a252-47d6-9630-14d04f9e553b"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:05.439881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bb40ce0e-fe97-42b0-9deb-e527a36e8aac req-c3ad7675-71f7-40d4-99c8-6ccb46d4bb7a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:05.440767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bb40ce0e-fe97-42b0-9deb-e527a36e8aac req-c3ad7675-71f7-40d4-99c8-6ccb46d4bb7a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:05.441284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bb40ce0e-fe97-42b0-9deb-e527a36e8aac req-c3ad7675-71f7-40d4-99c8-6ccb46d4bb7a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:05.455031 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-bb40ce0e-fe97-42b0-9deb-e527a36e8aac req-c3ad7675-71f7-40d4-99c8-6ccb46d4bb7a service nova] Creating event network-changed:781c5a7c-a252-47d6-9630-14d04f9e553b for instance e8c9ed1e-db22-42ef-90ef-63352e533062 on n-h2-858384-13 Oct 18 13:38:05.460991 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-bb40ce0e-fe97-42b0-9deb-e527a36e8aac req-c3ad7675-71f7-40d4-99c8-6ccb46d4bb7a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050688 Oct 18 13:38:05.462207 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2285/4835] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:05.645564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9c890430-60fc-45a5-8c85-2326cf9139b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:05.647022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9c890430-60fc-45a5-8c85-2326cf9139b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:05.657895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c890430-60fc-45a5-8c85-2326cf9139b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:05.660008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c890430-60fc-45a5-8c85-2326cf9139b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:05.661235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c890430-60fc-45a5-8c85-2326cf9139b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:05.662165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c890430-60fc-45a5-8c85-2326cf9139b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:05.663118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c890430-60fc-45a5-8c85-2326cf9139b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:05.664040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c890430-60fc-45a5-8c85-2326cf9139b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:05.717820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ebdcaaf6-d811-4cb3-ab72-ddc3493d8e55 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7beca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:05.767014 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ebdcaaf6-d811-4cb3-ab72-ddc3493d8e55 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.053744 Oct 18 13:38:05.769333 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2286/4836] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:05 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:05.830993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9c890430-60fc-45a5-8c85-2326cf9139b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:05.840040 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9c890430-60fc-45a5-8c85-2326cf9139b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1309 microversion: 2.1 time: 0.199194 Oct 18 13:38:05.840932 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2551/4837] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:05 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1309 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:05.989289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e454956c-2003-404d-888a-bdbeeafd6a72 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:05.990126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e454956c-2003-404d-888a-bdbeeafd6a72 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:06.003296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e454956c-2003-404d-888a-bdbeeafd6a72 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.004188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e454956c-2003-404d-888a-bdbeeafd6a72 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.004790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e454956c-2003-404d-888a-bdbeeafd6a72 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:06.005793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e454956c-2003-404d-888a-bdbeeafd6a72 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.006735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e454956c-2003-404d-888a-bdbeeafd6a72 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.008104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e454956c-2003-404d-888a-bdbeeafd6a72 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:06.034110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f9fed13a-515c-4de3-b918-160a8e567b34 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:06.035547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f9fed13a-515c-4de3-b918-160a8e567b34 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:06.047779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9fed13a-515c-4de3-b918-160a8e567b34 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.048288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9fed13a-515c-4de3-b918-160a8e567b34 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.048735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9fed13a-515c-4de3-b918-160a8e567b34 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:06.053470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9fed13a-515c-4de3-b918-160a8e567b34 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.054667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9fed13a-515c-4de3-b918-160a8e567b34 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.055671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9fed13a-515c-4de3-b918-160a8e567b34 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:06.246721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f9fed13a-515c-4de3-b918-160a8e567b34 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:06.257595 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f9fed13a-515c-4de3-b918-160a8e567b34 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1508 microversion: 2.1 time: 0.227489 Oct 18 13:38:06.258552 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2552/4838] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:06 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:06.302166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e454956c-2003-404d-888a-bdbeeafd6a72 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:06.310208 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e454956c-2003-404d-888a-bdbeeafd6a72 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1316 microversion: 2.1 time: 0.332814 Oct 18 13:38:06.310959 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2287/4839] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:05 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:06.746175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-adaa98a8-9446-451c-9b49-c15fd55da1a9 req-c0cca27f-97b7-43ff-8515-b76d552872b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98fd0182-30e6-4a86-9b90-a70a91ee36a6", "name": "network-vif-plugged", "status": "completed", "tag": "0ad57bd5-5e53-49c8-84e8-00579e72deec"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:06.759193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-adaa98a8-9446-451c-9b49-c15fd55da1a9 req-c0cca27f-97b7-43ff-8515-b76d552872b9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.760367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-adaa98a8-9446-451c-9b49-c15fd55da1a9 req-c0cca27f-97b7-43ff-8515-b76d552872b9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.760800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-adaa98a8-9446-451c-9b49-c15fd55da1a9 req-c0cca27f-97b7-43ff-8515-b76d552872b9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:06.774696 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-adaa98a8-9446-451c-9b49-c15fd55da1a9 req-c0cca27f-97b7-43ff-8515-b76d552872b9 service nova] Creating event network-vif-plugged:0ad57bd5-5e53-49c8-84e8-00579e72deec for instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 on n-h1-858384-13 Oct 18 13:38:06.785529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f29ef200-0e9c-422f-a5fa-efacce286942 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617a5be50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:06.792477 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-adaa98a8-9446-451c-9b49-c15fd55da1a9 req-c0cca27f-97b7-43ff-8515-b76d552872b9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050957 Oct 18 13:38:06.794411 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2553/4840] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:06.842541 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f29ef200-0e9c-422f-a5fa-efacce286942 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.060710 Oct 18 13:38:06.843195 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2288/4841] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:06 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:06.864513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-10304b55-55b8-46c3-bb4f-65fee59b705a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:06.865433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-10304b55-55b8-46c3-bb4f-65fee59b705a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:06.872012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10304b55-55b8-46c3-bb4f-65fee59b705a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.872703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10304b55-55b8-46c3-bb4f-65fee59b705a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.873342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10304b55-55b8-46c3-bb4f-65fee59b705a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:06.874038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10304b55-55b8-46c3-bb4f-65fee59b705a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:06.874495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10304b55-55b8-46c3-bb4f-65fee59b705a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:06.874921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10304b55-55b8-46c3-bb4f-65fee59b705a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:07.017936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-10304b55-55b8-46c3-bb4f-65fee59b705a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:07.026049 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-10304b55-55b8-46c3-bb4f-65fee59b705a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1309 microversion: 2.1 time: 0.165748 Oct 18 13:38:07.026723 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2554/4842] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:06 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1309 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:07.282685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d86b6598-7a55-4fad-ba64-88d3012a7ab5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:07.283406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d86b6598-7a55-4fad-ba64-88d3012a7ab5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:07.290205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d86b6598-7a55-4fad-ba64-88d3012a7ab5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:07.290688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d86b6598-7a55-4fad-ba64-88d3012a7ab5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:07.291118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d86b6598-7a55-4fad-ba64-88d3012a7ab5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:07.291801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d86b6598-7a55-4fad-ba64-88d3012a7ab5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:07.292246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d86b6598-7a55-4fad-ba64-88d3012a7ab5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:07.292673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d86b6598-7a55-4fad-ba64-88d3012a7ab5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:07.333655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a7e003d1-e630-4166-a4e2-03e30a30912a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:07.334283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a7e003d1-e630-4166-a4e2-03e30a30912a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:07.345818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7e003d1-e630-4166-a4e2-03e30a30912a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:07.346307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7e003d1-e630-4166-a4e2-03e30a30912a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:07.346738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7e003d1-e630-4166-a4e2-03e30a30912a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:07.347435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7e003d1-e630-4166-a4e2-03e30a30912a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:07.347890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7e003d1-e630-4166-a4e2-03e30a30912a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:07.348301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7e003d1-e630-4166-a4e2-03e30a30912a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:07.493997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a7e003d1-e630-4166-a4e2-03e30a30912a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:07.498168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:07.503715 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a7e003d1-e630-4166-a4e2-03e30a30912a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1316 microversion: 2.1 time: 0.174298 Oct 18 13:38:07.504494 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2555/4843] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:07 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:07.562137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d86b6598-7a55-4fad-ba64-88d3012a7ab5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:07.570336 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d86b6598-7a55-4fad-ba64-88d3012a7ab5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1508 microversion: 2.1 time: 0.292202 Oct 18 13:38:07.571041 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2289/4844] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:07 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:07.858892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-88a4a0b8-60eb-451e-9565-d3163ab6eff6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617a85e50>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:07.908549 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-88a4a0b8-60eb-451e-9565-d3163ab6eff6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.053559 Oct 18 13:38:07.909139 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2556/4845] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:07 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:08.049348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68972c8d-6ced-4f9e-a841-8d95e44463aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:08.049940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-68972c8d-6ced-4f9e-a841-8d95e44463aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:08.058433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68972c8d-6ced-4f9e-a841-8d95e44463aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:08.059078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68972c8d-6ced-4f9e-a841-8d95e44463aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:08.059614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68972c8d-6ced-4f9e-a841-8d95e44463aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:08.060840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68972c8d-6ced-4f9e-a841-8d95e44463aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:08.061443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68972c8d-6ced-4f9e-a841-8d95e44463aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:08.062256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68972c8d-6ced-4f9e-a841-8d95e44463aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:08.297161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-68972c8d-6ced-4f9e-a841-8d95e44463aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:08.305407 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-68972c8d-6ced-4f9e-a841-8d95e44463aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1309 microversion: 2.1 time: 0.259686 Oct 18 13:38:08.305991 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2290/4846] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:08 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1309 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:08.528700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-96548119-9faf-42a8-980f-4e2d892269a8 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:08.529366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-96548119-9faf-42a8-980f-4e2d892269a8 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:08.536520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96548119-9faf-42a8-980f-4e2d892269a8 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:08.537011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96548119-9faf-42a8-980f-4e2d892269a8 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:08.537512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96548119-9faf-42a8-980f-4e2d892269a8 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:08.538219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96548119-9faf-42a8-980f-4e2d892269a8 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:08.538821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96548119-9faf-42a8-980f-4e2d892269a8 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:08.539106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96548119-9faf-42a8-980f-4e2d892269a8 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:08.597689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-43f7f71b-17eb-4047-8389-dc3a5cc4b502 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:08.598368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-43f7f71b-17eb-4047-8389-dc3a5cc4b502 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:08.606977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43f7f71b-17eb-4047-8389-dc3a5cc4b502 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:08.607778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43f7f71b-17eb-4047-8389-dc3a5cc4b502 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:08.608412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43f7f71b-17eb-4047-8389-dc3a5cc4b502 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:08.609477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43f7f71b-17eb-4047-8389-dc3a5cc4b502 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:08.610151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43f7f71b-17eb-4047-8389-dc3a5cc4b502 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:08.610937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43f7f71b-17eb-4047-8389-dc3a5cc4b502 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:08.707985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-96548119-9faf-42a8-980f-4e2d892269a8 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:08.718192 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-96548119-9faf-42a8-980f-4e2d892269a8 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1316 microversion: 2.1 time: 0.195383 Oct 18 13:38:08.719198 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2557/4847] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:08 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:08.803364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-43f7f71b-17eb-4047-8389-dc3a5cc4b502 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:08.812651 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-43f7f71b-17eb-4047-8389-dc3a5cc4b502 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1514 microversion: 2.1 time: 0.221541 Oct 18 13:38:08.813285 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2291/4848] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:08 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:08.926784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a74408c8-40ef-4d97-bc42-7193815d01ef tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617ad3af0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:08.987665 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a74408c8-40ef-4d97-bc42-7193815d01ef tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.065502 Oct 18 13:38:08.988373 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2558/4849] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:08 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:09.328559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c5322652-a777-48ac-a0e1-4b0cc7b80b43 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:09.329295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c5322652-a777-48ac-a0e1-4b0cc7b80b43 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:09.337322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5322652-a777-48ac-a0e1-4b0cc7b80b43 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:09.337799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5322652-a777-48ac-a0e1-4b0cc7b80b43 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:09.338407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5322652-a777-48ac-a0e1-4b0cc7b80b43 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:09.339098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5322652-a777-48ac-a0e1-4b0cc7b80b43 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:09.339543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5322652-a777-48ac-a0e1-4b0cc7b80b43 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:09.339963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c5322652-a777-48ac-a0e1-4b0cc7b80b43 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:09.495243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c5322652-a777-48ac-a0e1-4b0cc7b80b43 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:09.503158 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c5322652-a777-48ac-a0e1-4b0cc7b80b43 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1309 microversion: 2.1 time: 0.179063 Oct 18 13:38:09.503740 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2292/4850] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:09 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1309 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:09.742503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dadef267-4a17-42e8-b884-d4516ec23028 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:09.743468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dadef267-4a17-42e8-b884-d4516ec23028 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:09.755730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dadef267-4a17-42e8-b884-d4516ec23028 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:09.760885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dadef267-4a17-42e8-b884-d4516ec23028 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:09.763989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dadef267-4a17-42e8-b884-d4516ec23028 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:09.764812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dadef267-4a17-42e8-b884-d4516ec23028 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:09.768397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dadef267-4a17-42e8-b884-d4516ec23028 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:09.768854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dadef267-4a17-42e8-b884-d4516ec23028 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:09.977379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dadef267-4a17-42e8-b884-d4516ec23028 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:09.988648 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dadef267-4a17-42e8-b884-d4516ec23028 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1316 microversion: 2.1 time: 0.250093 Oct 18 13:38:10.002514 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2559/4851] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:09 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:10.011010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8a5f9e54-ccc7-4f58-87bd-c6b6ce73138d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e703e50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:10.068662 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8a5f9e54-ccc7-4f58-87bd-c6b6ce73138d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.067382 Oct 18 13:38:10.077848 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2293/4852] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:10 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:10.221670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-44b9c657-8c61-444f-88b4-d6d20bc06423 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'create', calling method: .version_select at 0x7ff617ad33a0>, body: {"keypair": {"name": "tempest-keypair-2112811030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/nuC5RHKcArYtO8fuk2yaYKNBsSrguqP+yREWBk/21qYRM7BUeBfCmnry6g9RsSeYNYjWSK58yA/XX0tXA1i0X554FcrZgpoYukWJOzacltQbVMT1rruxgjv8bMoRWaA=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:10.240932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-44b9c657-8c61-444f-88b4-d6d20bc06423 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Getting quotas for project 0cdfce6f9e86407d883e624dd2c50559. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:10.246972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-44b9c657-8c61-444f-88b4-d6d20bc06423 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Getting quotas for user 4113a1418b92488e97bf50aecdd49bb1 and project 0cdfce6f9e86407d883e624dd2c50559. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:10.270745 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-44b9c657-8c61-444f-88b4-d6d20bc06423 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053051 Oct 18 13:38:10.271349 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2560/4853] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:38:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:10.534872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c87e278d-86af-4310-93db-beed60af5c48 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:10.536315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c87e278d-86af-4310-93db-beed60af5c48 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:10.546749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:10.548502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=12 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:10.551828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c87e278d-86af-4310-93db-beed60af5c48 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:10.553498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c87e278d-86af-4310-93db-beed60af5c48 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:10.554563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c87e278d-86af-4310-93db-beed60af5c48 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:10.555739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c87e278d-86af-4310-93db-beed60af5c48 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:10.558169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c87e278d-86af-4310-93db-beed60af5c48 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:10.558861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c87e278d-86af-4310-93db-beed60af5c48 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:10.566289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:10.654889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-33fe8bdf-c1ed-4a95-afd0-139eb7332128 req-70ef8fb4-e1cd-4952-b82d-6d29ec508a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fe15a4-7bd7-40e0-860a-e0769bf38456", "name": "network-vif-plugged", "status": "completed", "tag": "4c03f362-7416-4c8f-8537-5657edf6a795"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:10.678819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-33fe8bdf-c1ed-4a95-afd0-139eb7332128 req-70ef8fb4-e1cd-4952-b82d-6d29ec508a46 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:10.679696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-33fe8bdf-c1ed-4a95-afd0-139eb7332128 req-70ef8fb4-e1cd-4952-b82d-6d29ec508a46 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:10.680290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-33fe8bdf-c1ed-4a95-afd0-139eb7332128 req-70ef8fb4-e1cd-4952-b82d-6d29ec508a46 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:10.699816 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-33fe8bdf-c1ed-4a95-afd0-139eb7332128 req-70ef8fb4-e1cd-4952-b82d-6d29ec508a46 service nova] Creating event network-vif-plugged:4c03f362-7416-4c8f-8537-5657edf6a795 for instance b9fe15a4-7bd7-40e0-860a-e0769bf38456 on n-h1-858384-13 Oct 18 13:38:10.713503 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-33fe8bdf-c1ed-4a95-afd0-139eb7332128 req-70ef8fb4-e1cd-4952-b82d-6d29ec508a46 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062259 Oct 18 13:38:10.714437 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2561/4854] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:38:10.809459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c87e278d-86af-4310-93db-beed60af5c48 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:10.821327 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c87e278d-86af-4310-93db-beed60af5c48 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1489 microversion: 2.1 time: 0.293881 Oct 18 13:38:10.822162 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2294/4855] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:10 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1489 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:10.962151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1056684836", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "aa0d4f33-39e0-4d3f-ab36-9b89248d2552"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:11.020297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] validate_networks() for [('aa0d4f33-39e0-4d3f-ab36-9b89248d2552', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:38:11.032033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3877a31c-ad08-4d71-bf8a-33e0ddd40f25 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:11.033810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3877a31c-ad08-4d71-bf8a-33e0ddd40f25 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:11.043188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3877a31c-ad08-4d71-bf8a-33e0ddd40f25 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:11.044112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3877a31c-ad08-4d71-bf8a-33e0ddd40f25 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:11.045023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3877a31c-ad08-4d71-bf8a-33e0ddd40f25 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:11.045998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3877a31c-ad08-4d71-bf8a-33e0ddd40f25 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:11.047158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3877a31c-ad08-4d71-bf8a-33e0ddd40f25 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:11.047887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3877a31c-ad08-4d71-bf8a-33e0ddd40f25 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:11.305031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3877a31c-ad08-4d71-bf8a-33e0ddd40f25 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:11.320854 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3877a31c-ad08-4d71-bf8a-33e0ddd40f25 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1316 microversion: 2.1 time: 0.298520 Oct 18 13:38:11.321779 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2295/4856] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:11 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:11.328657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6708664c-9abe-4109-989a-d6056ba8060e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e74a670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:11.387182 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6708664c-9abe-4109-989a-d6056ba8060e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.064203 Oct 18 13:38:11.388035 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2296/4857] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:11 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:11.778723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:38:11.779610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:38:11.780334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:38:11.781116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:38:11.781748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:38:11.792291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:11.792825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:11.793451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:11.794454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:11.794912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:11.795487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:11.816146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:11.822010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for user a4856dd5667c4f10aa9ff1ccb1788cc8 and project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:11.834923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:38:11.838211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:11.910584 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d023999-ffdc-4813-af3f-0a7a68d2c9ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954353 Oct 18 13:38:11.911503 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2562/4858] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:38:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:38:11.924977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6265a395-545a-462e-a5f7-3b881a04f38c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:11.925892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6265a395-545a-462e-a5f7-3b881a04f38c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:12.022760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6265a395-545a-462e-a5f7-3b881a04f38c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:12.030418 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6265a395-545a-462e-a5f7-3b881a04f38c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1209 microversion: 2.1 time: 0.111351 Oct 18 13:38:12.031405 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2297/4859] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:11 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:12.086152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-362629575", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bde0cbc3-fcaa-4a2a-b4ff-70107d3729c8"}], "security_groups": [{"name": "tempest-securitygroup--626377366"}], "key_name": "tempest-keypair-2112811030", "user_data": "}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:12.206763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] validate_networks() for [('bde0cbc3-fcaa-4a2a-b4ff-70107d3729c8', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:38:12.348568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a3272b65-80ef-4bdd-a3a7-a733ba6534f2 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:12.349406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a3272b65-80ef-4bdd-a3a7-a733ba6534f2 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:12.356855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3272b65-80ef-4bdd-a3a7-a733ba6534f2 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:12.357720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3272b65-80ef-4bdd-a3a7-a733ba6534f2 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:12.358379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3272b65-80ef-4bdd-a3a7-a733ba6534f2 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:12.359300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3272b65-80ef-4bdd-a3a7-a733ba6534f2 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:12.360012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3272b65-80ef-4bdd-a3a7-a733ba6534f2 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:12.360678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3272b65-80ef-4bdd-a3a7-a733ba6534f2 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:12.612948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a3272b65-80ef-4bdd-a3a7-a733ba6534f2 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:12.624527 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a3272b65-80ef-4bdd-a3a7-a733ba6534f2 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1316 microversion: 2.1 time: 0.280004 Oct 18 13:38:12.625377 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2298/4860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:12 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:12.630302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e07115a-d2ac-4732-98b9-a94ff74c836b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e703a60>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:12.675993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:38:12.676464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:38:12.676969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:38:12.677807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:38:12.678611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:38:12.691966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:12.692457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:12.692897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:12.693701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:12.698004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:12.700526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:12.725416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Getting quotas for project 0cdfce6f9e86407d883e624dd2c50559. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:12.733890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Getting quotas for user 4113a1418b92488e97bf50aecdd49bb1 and project 0cdfce6f9e86407d883e624dd2c50559. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:12.752021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:38:12.755086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:12.811263 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4e07115a-d2ac-4732-98b9-a94ff74c836b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.184672 Oct 18 13:38:12.812359 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2299/4861] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:12 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:12.824196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-dc6eda8b-0853-4d6e-8d2a-75367f4a2207 req-b71f5c45-6b07-4baa-a3e7-87adce6e6130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c9ed1e-db22-42ef-90ef-63352e533062", "name": "network-vif-plugged", "status": "completed", "tag": "781c5a7c-a252-47d6-9630-14d04f9e553b"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:12.837392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-dc6eda8b-0853-4d6e-8d2a-75367f4a2207 req-b71f5c45-6b07-4baa-a3e7-87adce6e6130 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:12.838214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-dc6eda8b-0853-4d6e-8d2a-75367f4a2207 req-b71f5c45-6b07-4baa-a3e7-87adce6e6130 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:12.838823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-dc6eda8b-0853-4d6e-8d2a-75367f4a2207 req-b71f5c45-6b07-4baa-a3e7-87adce6e6130 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:12.839384 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2b84f158-e383-4814-b79d-a12952ec2726 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.760707 Oct 18 13:38:12.847982 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2563/4862] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:38:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:38:12.854600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dfd43fc4-f487-4d65-a743-d882e9d7807b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:12.855355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dfd43fc4-f487-4d65-a743-d882e9d7807b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:12.863030 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-dc6eda8b-0853-4d6e-8d2a-75367f4a2207 req-b71f5c45-6b07-4baa-a3e7-87adce6e6130 service nova] Creating event network-vif-plugged:781c5a7c-a252-47d6-9630-14d04f9e553b for instance e8c9ed1e-db22-42ef-90ef-63352e533062 on n-h2-858384-13 Oct 18 13:38:12.871875 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-dc6eda8b-0853-4d6e-8d2a-75367f4a2207 req-b71f5c45-6b07-4baa-a3e7-87adce6e6130 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056753 Oct 18 13:38:12.872829 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2300/4863] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:12.945763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dfd43fc4-f487-4d65-a743-d882e9d7807b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:12.961168 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dfd43fc4-f487-4d65-a743-d882e9d7807b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1245 microversion: 2.1 time: 0.110882 Oct 18 13:38:12.976818 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2564/4864] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:12 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1245 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:13.057840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7ba999bf-87b9-4f21-8580-9fae655a0868 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:13.058572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7ba999bf-87b9-4f21-8580-9fae655a0868 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:13.070593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ba999bf-87b9-4f21-8580-9fae655a0868 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:13.072533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ba999bf-87b9-4f21-8580-9fae655a0868 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:13.073159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ba999bf-87b9-4f21-8580-9fae655a0868 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:13.074095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ba999bf-87b9-4f21-8580-9fae655a0868 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:13.074943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ba999bf-87b9-4f21-8580-9fae655a0868 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:13.075680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ba999bf-87b9-4f21-8580-9fae655a0868 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:13.174013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ba999bf-87b9-4f21-8580-9fae655a0868 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:13.184084 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7ba999bf-87b9-4f21-8580-9fae655a0868 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1261 microversion: 2.1 time: 0.131732 Oct 18 13:38:13.185234 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2301/4865] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:13 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1261 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:13.651742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b7d3a187-dde8-432e-9f21-c3ed2098da27 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:13.653009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7d3a187-dde8-432e-9f21-c3ed2098da27 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:13.667263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7d3a187-dde8-432e-9f21-c3ed2098da27 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:13.668323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7d3a187-dde8-432e-9f21-c3ed2098da27 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:13.668979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7d3a187-dde8-432e-9f21-c3ed2098da27 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:13.670383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7d3a187-dde8-432e-9f21-c3ed2098da27 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:13.671021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7d3a187-dde8-432e-9f21-c3ed2098da27 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:13.671466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7d3a187-dde8-432e-9f21-c3ed2098da27 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:13.828167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2bc23a49-2771-4653-ae57-1abffccb5fb0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e703430>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:13.846581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7d3a187-dde8-432e-9f21-c3ed2098da27 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:13.855908 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b7d3a187-dde8-432e-9f21-c3ed2098da27 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1316 microversion: 2.1 time: 0.209455 Oct 18 13:38:13.856494 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2565/4866] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:13 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:13.985859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6510712b-73fa-4821-8f6e-09df72ceff08 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:13.986488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6510712b-73fa-4821-8f6e-09df72ceff08 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:13.996250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6510712b-73fa-4821-8f6e-09df72ceff08 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:13.998122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6510712b-73fa-4821-8f6e-09df72ceff08 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:13.998631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6510712b-73fa-4821-8f6e-09df72ceff08 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:14.002102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6510712b-73fa-4821-8f6e-09df72ceff08 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:14.002793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6510712b-73fa-4821-8f6e-09df72ceff08 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:14.005295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6510712b-73fa-4821-8f6e-09df72ceff08 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:14.124259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6510712b-73fa-4821-8f6e-09df72ceff08 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:14.137569 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6510712b-73fa-4821-8f6e-09df72ceff08 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1297 microversion: 2.1 time: 0.157284 Oct 18 13:38:14.138725 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2566/4867] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:13 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1297 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:14.208858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d124966c-a8da-42f7-9d34-3cebd1e6a345 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:14.209763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d124966c-a8da-42f7-9d34-3cebd1e6a345 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:14.233325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d124966c-a8da-42f7-9d34-3cebd1e6a345 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:14.234215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d124966c-a8da-42f7-9d34-3cebd1e6a345 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:14.235035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d124966c-a8da-42f7-9d34-3cebd1e6a345 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:14.238176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d124966c-a8da-42f7-9d34-3cebd1e6a345 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:14.239511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d124966c-a8da-42f7-9d34-3cebd1e6a345 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:14.240178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d124966c-a8da-42f7-9d34-3cebd1e6a345 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:14.291873 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2bc23a49-2771-4653-ae57-1abffccb5fb0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.468178 Oct 18 13:38:14.293496 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2302/4868] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:13 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:14.356728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d124966c-a8da-42f7-9d34-3cebd1e6a345 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:14.374174 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d124966c-a8da-42f7-9d34-3cebd1e6a345 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1267 microversion: 2.1 time: 0.169417 Oct 18 13:38:14.375113 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2567/4869] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:14 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:14.881611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-079dbc30-f0b0-46cf-b6dd-68d6a822c59d tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:14.882227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-079dbc30-f0b0-46cf-b6dd-68d6a822c59d tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:14.891266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-079dbc30-f0b0-46cf-b6dd-68d6a822c59d tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:14.892060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-079dbc30-f0b0-46cf-b6dd-68d6a822c59d tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:14.892746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-079dbc30-f0b0-46cf-b6dd-68d6a822c59d tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:14.893965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-079dbc30-f0b0-46cf-b6dd-68d6a822c59d tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:14.894626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-079dbc30-f0b0-46cf-b6dd-68d6a822c59d tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:14.895271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-079dbc30-f0b0-46cf-b6dd-68d6a822c59d tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.167536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb4255ea-3147-43b1-8a84-bcc0e67c675c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:15.169797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cb4255ea-3147-43b1-8a84-bcc0e67c675c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:15.183530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb4255ea-3147-43b1-8a84-bcc0e67c675c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.184615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb4255ea-3147-43b1-8a84-bcc0e67c675c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.186053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb4255ea-3147-43b1-8a84-bcc0e67c675c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.187501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb4255ea-3147-43b1-8a84-bcc0e67c675c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.188541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb4255ea-3147-43b1-8a84-bcc0e67c675c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.189262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb4255ea-3147-43b1-8a84-bcc0e67c675c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.272045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-079dbc30-f0b0-46cf-b6dd-68d6a822c59d tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:15.286699 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-079dbc30-f0b0-46cf-b6dd-68d6a822c59d tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1505 microversion: 2.1 time: 0.409156 Oct 18 13:38:15.292730 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2303/4870] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:14 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:15.310413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68469fa9-426c-4ca7-8220-9afbd28ffd76 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e712c10>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:15.361864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cb4255ea-3147-43b1-8a84-bcc0e67c675c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:15.374117 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cb4255ea-3147-43b1-8a84-bcc0e67c675c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1303 microversion: 2.1 time: 0.214205 Oct 18 13:38:15.375068 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2568/4871] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:15 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1303 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:15.401693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-acdc91fe-1031-4071-a292-85c5b6189abd tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:15.401693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-acdc91fe-1031-4071-a292-85c5b6189abd tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:15.416590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acdc91fe-1031-4071-a292-85c5b6189abd tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.417140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acdc91fe-1031-4071-a292-85c5b6189abd tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.417607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acdc91fe-1031-4071-a292-85c5b6189abd tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.419053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acdc91fe-1031-4071-a292-85c5b6189abd tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.419735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acdc91fe-1031-4071-a292-85c5b6189abd tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.420317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-acdc91fe-1031-4071-a292-85c5b6189abd tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.425102 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-68469fa9-426c-4ca7-8220-9afbd28ffd76 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.121013 Oct 18 13:38:15.427066 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2304/4872] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:15 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:15.438655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2e41516d-e923-4679-881c-6d502af4074f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:15.440040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2e41516d-e923-4679-881c-6d502af4074f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:15.459188 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-acdc91fe-1031-4071-a292-85c5b6189abd tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062/ips" status: 200 len: 109 microversion: 2.1 time: 0.082262 Oct 18 13:38:15.460891 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2569/4873] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:38:15 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062/ips => generated 109 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:15.462264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:15.469918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e41516d-e923-4679-881c-6d502af4074f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.471321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e41516d-e923-4679-881c-6d502af4074f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.477714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e41516d-e923-4679-881c-6d502af4074f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.478870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e41516d-e923-4679-881c-6d502af4074f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.479678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e41516d-e923-4679-881c-6d502af4074f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.480011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8758e7ef-d30a-484f-a3da-d94243081810 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:15.480565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8758e7ef-d30a-484f-a3da-d94243081810 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:15.480899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e41516d-e923-4679-881c-6d502af4074f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.492980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8758e7ef-d30a-484f-a3da-d94243081810 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.493579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8758e7ef-d30a-484f-a3da-d94243081810 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.496745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8758e7ef-d30a-484f-a3da-d94243081810 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.497603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8758e7ef-d30a-484f-a3da-d94243081810 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.498276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8758e7ef-d30a-484f-a3da-d94243081810 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.498737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8758e7ef-d30a-484f-a3da-d94243081810 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.569840 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8758e7ef-d30a-484f-a3da-d94243081810 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062/ips" status: 200 len: 109 microversion: 2.1 time: 0.096437 Oct 18 13:38:15.570628 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2570/4874] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:38:15 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062/ips => generated 109 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:38:15.582005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8250e9ce-0021-4c19-8aec-5c679b96e28e tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:15.586222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8250e9ce-0021-4c19-8aec-5c679b96e28e tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:15.595612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:15.609219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8250e9ce-0021-4c19-8aec-5c679b96e28e tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.610859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8250e9ce-0021-4c19-8aec-5c679b96e28e tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.611320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8250e9ce-0021-4c19-8aec-5c679b96e28e tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.614394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8250e9ce-0021-4c19-8aec-5c679b96e28e tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.614979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8250e9ce-0021-4c19-8aec-5c679b96e28e tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.615427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8250e9ce-0021-4c19-8aec-5c679b96e28e tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.747408 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8250e9ce-0021-4c19-8aec-5c679b96e28e tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062/ips/tempest-ServerAddressesTestJSON-1540947353-network" status: 200 len: 94 microversion: 2.1 time: 0.169382 Oct 18 13:38:15.751714 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2571/4875] 10.222.0.40 () {58 vars in 1401 bytes} [Tue Oct 18 13:38:15 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062/ips/tempest-ServerAddressesTestJSON-1540947353-network => generated 94 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:38:15.765230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5e791e98-714e-403a-abd8-1e12117bc935 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:15.765833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e791e98-714e-403a-abd8-1e12117bc935 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:15.780156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e791e98-714e-403a-abd8-1e12117bc935 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.780838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e791e98-714e-403a-abd8-1e12117bc935 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.781941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e791e98-714e-403a-abd8-1e12117bc935 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.783903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e791e98-714e-403a-abd8-1e12117bc935 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:15.784379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e791e98-714e-403a-abd8-1e12117bc935 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:15.787728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e791e98-714e-403a-abd8-1e12117bc935 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:15.868751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e791e98-714e-403a-abd8-1e12117bc935 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:16.061581 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5e791e98-714e-403a-abd8-1e12117bc935 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 204 len: 0 microversion: 2.1 time: 0.299590 Oct 18 13:38:16.063067 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2572/4876] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:38:15 2022] DELETE /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:38:16.110497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f3675723-07ae-4178-bf7a-d0201922126f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:16.111166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f3675723-07ae-4178-bf7a-d0201922126f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:16.119147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3675723-07ae-4178-bf7a-d0201922126f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:16.119744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3675723-07ae-4178-bf7a-d0201922126f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:16.120306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3675723-07ae-4178-bf7a-d0201922126f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:16.121122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3675723-07ae-4178-bf7a-d0201922126f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:16.121771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3675723-07ae-4178-bf7a-d0201922126f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:16.122503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3675723-07ae-4178-bf7a-d0201922126f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:16.214802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2e41516d-e923-4679-881c-6d502af4074f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:16.232022 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2e41516d-e923-4679-881c-6d502af4074f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1309 microversion: 2.1 time: 0.802107 Oct 18 13:38:16.235929 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2305/4877] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:15 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1309 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:16.328060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f3675723-07ae-4178-bf7a-d0201922126f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:16.341768 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f3675723-07ae-4178-bf7a-d0201922126f tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1511 microversion: 2.1 time: 0.237440 Oct 18 13:38:16.342893 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2573/4878] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:16 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:16.399916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e7b204b-6406-4784-adf2-8a148b906be0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:16.400701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0e7b204b-6406-4784-adf2-8a148b906be0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:16.411779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e7b204b-6406-4784-adf2-8a148b906be0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:16.412795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e7b204b-6406-4784-adf2-8a148b906be0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:16.415655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e7b204b-6406-4784-adf2-8a148b906be0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:16.416873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e7b204b-6406-4784-adf2-8a148b906be0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:16.418328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e7b204b-6406-4784-adf2-8a148b906be0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:16.419179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e7b204b-6406-4784-adf2-8a148b906be0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:16.442431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-401c8e24-b325-4a29-8f5c-3583909a46ce tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f1e9430>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:16.538638 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-401c8e24-b325-4a29-8f5c-3583909a46ce tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.100146 Oct 18 13:38:16.541011 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2574/4879] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:16 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:16.547216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e7b204b-6406-4784-adf2-8a148b906be0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:16.563639 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e7b204b-6406-4784-adf2-8a148b906be0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1303 microversion: 2.1 time: 0.169480 Oct 18 13:38:16.567718 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2306/4880] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:16 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1303 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:17.260601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cad248e5-de24-43aa-b28e-f6f0fb40d66f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:17.261241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cad248e5-de24-43aa-b28e-f6f0fb40d66f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:17.269920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cad248e5-de24-43aa-b28e-f6f0fb40d66f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:17.270335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cad248e5-de24-43aa-b28e-f6f0fb40d66f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:17.270954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cad248e5-de24-43aa-b28e-f6f0fb40d66f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:17.271817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cad248e5-de24-43aa-b28e-f6f0fb40d66f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:17.272626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cad248e5-de24-43aa-b28e-f6f0fb40d66f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:17.273269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cad248e5-de24-43aa-b28e-f6f0fb40d66f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:17.365540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-204422ce-6768-4d01-b481-281162cfaf3a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:17.366860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-204422ce-6768-4d01-b481-281162cfaf3a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:17.391117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-204422ce-6768-4d01-b481-281162cfaf3a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:17.394035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-204422ce-6768-4d01-b481-281162cfaf3a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:17.395538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-204422ce-6768-4d01-b481-281162cfaf3a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:17.396440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-204422ce-6768-4d01-b481-281162cfaf3a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:17.397523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-204422ce-6768-4d01-b481-281162cfaf3a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:17.400711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-204422ce-6768-4d01-b481-281162cfaf3a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:17.530941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cad248e5-de24-43aa-b28e-f6f0fb40d66f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:17.546562 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cad248e5-de24-43aa-b28e-f6f0fb40d66f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1309 microversion: 2.1 time: 0.290174 Oct 18 13:38:17.549908 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2575/4881] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:17 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1309 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:17.557886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-70654983-43a6-4382-86c9-b0449d89913e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f23b790>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:17.632928 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-70654983-43a6-4382-86c9-b0449d89913e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.079804 Oct 18 13:38:17.634169 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2576/4882] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:17 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:17.639495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a3313054-7e75-4998-ab26-70f12c995562 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:17.640408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a3313054-7e75-4998-ab26-70f12c995562 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:17.648280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3313054-7e75-4998-ab26-70f12c995562 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:17.649343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3313054-7e75-4998-ab26-70f12c995562 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:17.650059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3313054-7e75-4998-ab26-70f12c995562 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:17.651013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3313054-7e75-4998-ab26-70f12c995562 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:17.651684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3313054-7e75-4998-ab26-70f12c995562 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:17.652385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3313054-7e75-4998-ab26-70f12c995562 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:17.859209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a3313054-7e75-4998-ab26-70f12c995562 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:17.871240 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a3313054-7e75-4998-ab26-70f12c995562 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1370 microversion: 2.1 time: 0.235733 Oct 18 13:38:17.872772 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2577/4883] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:17 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:18.205653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8c0f1270-0c57-464b-bb23-d61b24de9065 req-33d1cb78-10f8-463b-9ba5-974f93e2db0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c049bc0a-fc7b-4d5a-8bca-c4ef951070e5", "tag": "9be30cdd-bd27-4c52-9b51-d5a1268ca085"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:18.229254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8c0f1270-0c57-464b-bb23-d61b24de9065 req-33d1cb78-10f8-463b-9ba5-974f93e2db0e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:18.230273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8c0f1270-0c57-464b-bb23-d61b24de9065 req-33d1cb78-10f8-463b-9ba5-974f93e2db0e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:18.230402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8c0f1270-0c57-464b-bb23-d61b24de9065 req-33d1cb78-10f8-463b-9ba5-974f93e2db0e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:18.247550 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8c0f1270-0c57-464b-bb23-d61b24de9065 req-33d1cb78-10f8-463b-9ba5-974f93e2db0e service nova] Creating event network-changed:9be30cdd-bd27-4c52-9b51-d5a1268ca085 for instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 on n-h2-858384-13 Oct 18 13:38:18.251107 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8c0f1270-0c57-464b-bb23-d61b24de9065 req-33d1cb78-10f8-463b-9ba5-974f93e2db0e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049806 Oct 18 13:38:18.252089 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2578/4884] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:38:18.343215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-204422ce-6768-4d01-b481-281162cfaf3a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:18.358017 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-204422ce-6768-4d01-b481-281162cfaf3a tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1511 microversion: 2.1 time: 0.996423 Oct 18 13:38:18.358617 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2307/4885] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:17 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1511 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:18.575856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bcef5446-11a1-4b05-ad2e-dd55e3424569 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:18.577201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bcef5446-11a1-4b05-ad2e-dd55e3424569 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:18.590670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bcef5446-11a1-4b05-ad2e-dd55e3424569 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:18.593482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bcef5446-11a1-4b05-ad2e-dd55e3424569 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:18.594136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bcef5446-11a1-4b05-ad2e-dd55e3424569 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:18.595452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bcef5446-11a1-4b05-ad2e-dd55e3424569 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:18.598751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bcef5446-11a1-4b05-ad2e-dd55e3424569 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:18.599390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bcef5446-11a1-4b05-ad2e-dd55e3424569 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:18.648978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22d130d8-3558-4394-9266-e529b5ffcf4c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7564c0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:18.721032 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-22d130d8-3558-4394-9266-e529b5ffcf4c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.075951 Oct 18 13:38:18.722168 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2308/4886] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:18 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:18.895937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f80bed8d-641b-482c-a3ed-4b910fead736 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:18.896549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f80bed8d-641b-482c-a3ed-4b910fead736 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:18.921590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f80bed8d-641b-482c-a3ed-4b910fead736 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:18.922591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f80bed8d-641b-482c-a3ed-4b910fead736 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:18.923771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f80bed8d-641b-482c-a3ed-4b910fead736 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:18.924805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f80bed8d-641b-482c-a3ed-4b910fead736 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:18.925459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f80bed8d-641b-482c-a3ed-4b910fead736 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:18.925968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f80bed8d-641b-482c-a3ed-4b910fead736 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:19.021612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bcef5446-11a1-4b05-ad2e-dd55e3424569 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:19.040307 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bcef5446-11a1-4b05-ad2e-dd55e3424569 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1309 microversion: 2.1 time: 0.469778 Oct 18 13:38:19.057250 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2579/4887] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:18 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1309 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:19.389411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a195ba72-340b-4599-873f-200bf3f9acce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:19.390512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a195ba72-340b-4599-873f-200bf3f9acce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:19.397076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a195ba72-340b-4599-873f-200bf3f9acce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:19.400197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a195ba72-340b-4599-873f-200bf3f9acce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:19.402639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a195ba72-340b-4599-873f-200bf3f9acce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:19.403722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a195ba72-340b-4599-873f-200bf3f9acce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:19.406764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a195ba72-340b-4599-873f-200bf3f9acce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:19.407409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a195ba72-340b-4599-873f-200bf3f9acce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:19.464368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:19.556809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f80bed8d-641b-482c-a3ed-4b910fead736 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:19.579779 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f80bed8d-641b-482c-a3ed-4b910fead736 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1370 microversion: 2.1 time: 0.687677 Oct 18 13:38:19.586393 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2309/4888] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:18 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1370 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:19.737935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-17539b43-cba1-4da7-9b11-4067e98464c2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7bedc0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:19.813112 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-17539b43-cba1-4da7-9b11-4067e98464c2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.079509 Oct 18 13:38:19.813740 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2310/4889] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:19 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:20.005864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a195ba72-340b-4599-873f-200bf3f9acce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3682bfef32247e4b72a46e8206a3c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b2b1d06aa146df9714ab1430c8f623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:20.014235 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a195ba72-340b-4599-873f-200bf3f9acce tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 200 len: 1469 microversion: 2.1 time: 0.633922 Oct 18 13:38:20.015036 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2580/4890] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:19 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 1469 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:20.073774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b1052150-73ed-45c4-aa52-16edcb1bc446 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:20.075590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b1052150-73ed-45c4-aa52-16edcb1bc446 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:20.117986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1052150-73ed-45c4-aa52-16edcb1bc446 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:20.118482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1052150-73ed-45c4-aa52-16edcb1bc446 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:20.119106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1052150-73ed-45c4-aa52-16edcb1bc446 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:20.120646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1052150-73ed-45c4-aa52-16edcb1bc446 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:20.121298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1052150-73ed-45c4-aa52-16edcb1bc446 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:20.121929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1052150-73ed-45c4-aa52-16edcb1bc446 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:20.289383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9e401f92-7b5d-4a3a-a35a-1504611656b7 req-32f27ee3-219e-4fb2-9a3e-b098605ac718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c9ed1e-db22-42ef-90ef-63352e533062", "name": "network-vif-deleted", "tag": "781c5a7c-a252-47d6-9630-14d04f9e553b"}, {"name": "network-changed", "server_uuid": "60a18df7-1403-4f6a-8c6c-5f3e0eaaf739", "tag": "e71918e1-9c7b-4c0b-907f-a8dbe92a0c97"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:20.310405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9e401f92-7b5d-4a3a-a35a-1504611656b7 req-32f27ee3-219e-4fb2-9a3e-b098605ac718 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:20.311570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9e401f92-7b5d-4a3a-a35a-1504611656b7 req-32f27ee3-219e-4fb2-9a3e-b098605ac718 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:20.312414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9e401f92-7b5d-4a3a-a35a-1504611656b7 req-32f27ee3-219e-4fb2-9a3e-b098605ac718 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:20.327834 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9e401f92-7b5d-4a3a-a35a-1504611656b7 req-32f27ee3-219e-4fb2-9a3e-b098605ac718 service nova] Creating event network-vif-deleted:781c5a7c-a252-47d6-9630-14d04f9e553b for instance e8c9ed1e-db22-42ef-90ef-63352e533062 on n-h2-858384-13 Oct 18 13:38:20.331513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b1052150-73ed-45c4-aa52-16edcb1bc446 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:20.332235 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9e401f92-7b5d-4a3a-a35a-1504611656b7 req-32f27ee3-219e-4fb2-9a3e-b098605ac718 service nova] Creating event network-changed:e71918e1-9c7b-4c0b-907f-a8dbe92a0c97 for instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 on n-h1-858384-13 Oct 18 13:38:20.344815 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9e401f92-7b5d-4a3a-a35a-1504611656b7 req-32f27ee3-219e-4fb2-9a3e-b098605ac718 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.062707 Oct 18 13:38:20.346290 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2581/4891] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:38:20.351777 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b1052150-73ed-45c4-aa52-16edcb1bc446 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1309 microversion: 2.1 time: 0.285440 Oct 18 13:38:20.352565 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2311/4892] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:20 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1309 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:20.607962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-23ce020c-c9c6-491f-9ec8-12be519c5fdf tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:20.608712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-23ce020c-c9c6-491f-9ec8-12be519c5fdf tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:20.630921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23ce020c-c9c6-491f-9ec8-12be519c5fdf tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:20.632710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23ce020c-c9c6-491f-9ec8-12be519c5fdf tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:20.633792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23ce020c-c9c6-491f-9ec8-12be519c5fdf tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:20.634752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23ce020c-c9c6-491f-9ec8-12be519c5fdf tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:20.635597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23ce020c-c9c6-491f-9ec8-12be519c5fdf tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:20.636277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-23ce020c-c9c6-491f-9ec8-12be519c5fdf tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:20.830426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e328d518-0046-4056-b169-c9be7e557df5 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e712af0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:20.836721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-23ce020c-c9c6-491f-9ec8-12be519c5fdf tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:20.847867 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-23ce020c-c9c6-491f-9ec8-12be519c5fdf tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1370 microversion: 2.1 time: 0.247619 Oct 18 13:38:20.848658 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2582/4893] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:20 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:20.902113 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e328d518-0046-4056-b169-c9be7e557df5 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.076691 Oct 18 13:38:20.911315 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2312/4894] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:20 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:21.041705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d086156-59cc-4f85-87a3-8873c9bd4ac7 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:21.042797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3d086156-59cc-4f85-87a3-8873c9bd4ac7 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] [instance: e8c9ed1e-db22-42ef-90ef-63352e533062] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:21.070451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d086156-59cc-4f85-87a3-8873c9bd4ac7 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:21.075029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d086156-59cc-4f85-87a3-8873c9bd4ac7 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:21.075783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d086156-59cc-4f85-87a3-8873c9bd4ac7 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:21.097901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d086156-59cc-4f85-87a3-8873c9bd4ac7 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:21.103532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d086156-59cc-4f85-87a3-8873c9bd4ac7 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:21.117472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d086156-59cc-4f85-87a3-8873c9bd4ac7 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:21.177310 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-3d086156-59cc-4f85-87a3-8873c9bd4ac7 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] HTTP exception thrown: Instance e8c9ed1e-db22-42ef-90ef-63352e533062 could not be found. Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d086156-59cc-4f85-87a3-8873c9bd4ac7 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Request method failure captured: Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 HTTP/1.1 Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqw2zfN-6upEw4oMxYONMKTv_yaethv5OGo8o4B4CgpHSTvbn_H0QFwbIaW01Qw-UhTvjN1IhRwpKN7daraCH4kaA1a3k6kELm7oKgJuB1VJTq09XAhDfcGlSMmE5DA32abb3rLmG-pApG-ULC4V6R225HGu9sPXXieJTwywmce4_SE Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: c8b2b1d06aa146df9714ab1430c8f623 Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerAddressesTestJSON-2140663185 Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8b2b1d06aa146df9714ab1430c8f623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c8b2b1d06aa146df9714ab1430c8f623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8b2b1d06aa146df9714ab1430c8f623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c8b2b1d06aa146df9714ab1430c8f623"}]}] Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerAddressesTestJSON-2140663185 Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: c8b2b1d06aa146df9714ab1430c8f623 Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2140663185 Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerAddressesTestJSON-2140663185-project Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: d3682bfef32247e4b72a46e8206a3c8b Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerAddressesTestJSON-2140663185-project Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance e8c9ed1e-db22-42ef-90ef-63352e533062 could not be found. Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'e8c9ed1e-db22-42ef-90ef-63352e533062'} Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c9ed1e-db22-42ef-90ef-63352e533062 could not be found. Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c9ed1e-db22-42ef-90ef-63352e533062 could not be found. Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:21.180919 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:21.185882 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:21.185882 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:21.185882 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:21.185882 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:21.185882 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:21.185882 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c9ed1e-db22-42ef-90ef-63352e533062 could not be found. Oct 18 13:38:21.185882 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:21.188047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d086156-59cc-4f85-87a3-8873c9bd4ac7 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] Returning 404 to user: Instance e8c9ed1e-db22-42ef-90ef-63352e533062 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:21.189138 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3d086156-59cc-4f85-87a3-8873c9bd4ac7 tempest-ServerAddressesTestJSON-2140663185 tempest-ServerAddressesTestJSON-2140663185-project] 10.222.0.40 "GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062" status: 404 len: 111 microversion: 2.1 time: 0.153439 Oct 18 13:38:21.191096 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2583/4895] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:21 2022] GET /compute/v2.1/servers/e8c9ed1e-db22-42ef-90ef-63352e533062 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:38:21.377165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7b5608c8-fa1e-4565-932e-7c4417e1ab1d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:21.377812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7b5608c8-fa1e-4565-932e-7c4417e1ab1d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:21.388560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b5608c8-fa1e-4565-932e-7c4417e1ab1d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:21.391054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b5608c8-fa1e-4565-932e-7c4417e1ab1d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:21.391501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b5608c8-fa1e-4565-932e-7c4417e1ab1d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:21.392217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b5608c8-fa1e-4565-932e-7c4417e1ab1d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:21.392673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b5608c8-fa1e-4565-932e-7c4417e1ab1d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:21.393093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b5608c8-fa1e-4565-932e-7c4417e1ab1d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:21.623874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7b5608c8-fa1e-4565-932e-7c4417e1ab1d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:21.652366 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7b5608c8-fa1e-4565-932e-7c4417e1ab1d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1309 microversion: 2.1 time: 0.279286 Oct 18 13:38:21.673875 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2313/4896] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:21 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1309 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:21.872290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-90f976e2-a545-401f-9b41-ff2059233b82 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:21.873131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-90f976e2-a545-401f-9b41-ff2059233b82 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:21.887715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90f976e2-a545-401f-9b41-ff2059233b82 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:21.889462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90f976e2-a545-401f-9b41-ff2059233b82 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:21.892764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90f976e2-a545-401f-9b41-ff2059233b82 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:21.894109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90f976e2-a545-401f-9b41-ff2059233b82 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:21.897130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90f976e2-a545-401f-9b41-ff2059233b82 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:21.900057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90f976e2-a545-401f-9b41-ff2059233b82 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:21.918302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2ad63351-b695-4f4b-8952-41a0550a2f91 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e716af0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:22.006236 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2ad63351-b695-4f4b-8952-41a0550a2f91 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.092048 Oct 18 13:38:22.010446 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2314/4897] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:21 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:22.358120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-90f976e2-a545-401f-9b41-ff2059233b82 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:22.368315 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-90f976e2-a545-401f-9b41-ff2059233b82 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1370 microversion: 2.1 time: 0.500528 Oct 18 13:38:22.369573 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2584/4898] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:21 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1370 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:22.679993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-80f81e37-8695-43da-8b03-a7bec12206a4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:22.680699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-80f81e37-8695-43da-8b03-a7bec12206a4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:22.697395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:22.702668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80f81e37-8695-43da-8b03-a7bec12206a4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:22.704910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80f81e37-8695-43da-8b03-a7bec12206a4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:22.707184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80f81e37-8695-43da-8b03-a7bec12206a4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:22.708179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80f81e37-8695-43da-8b03-a7bec12206a4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:22.708791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80f81e37-8695-43da-8b03-a7bec12206a4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:22.713123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80f81e37-8695-43da-8b03-a7bec12206a4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:23.026041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eacac3d0-be1b-49d0-abc9-b29bb76a169b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ebd0160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:23.042779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:23.045165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=22 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:23.124422 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eacac3d0-be1b-49d0-abc9-b29bb76a169b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.102824 Oct 18 13:38:23.126637 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2585/4899] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:23 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:23.395658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c6404097-4f48-4b3d-9cd2-ea5060daeebd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:23.397092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c6404097-4f48-4b3d-9cd2-ea5060daeebd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:23.419869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6404097-4f48-4b3d-9cd2-ea5060daeebd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:23.421674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6404097-4f48-4b3d-9cd2-ea5060daeebd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:23.422390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6404097-4f48-4b3d-9cd2-ea5060daeebd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:23.423326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6404097-4f48-4b3d-9cd2-ea5060daeebd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:23.424010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6404097-4f48-4b3d-9cd2-ea5060daeebd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:23.424666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6404097-4f48-4b3d-9cd2-ea5060daeebd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:23.479751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-80f81e37-8695-43da-8b03-a7bec12206a4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:23.498852 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-80f81e37-8695-43da-8b03-a7bec12206a4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1309 microversion: 2.1 time: 0.819614 Oct 18 13:38:23.499956 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2315/4900] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:22 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1309 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:24.063923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c6404097-4f48-4b3d-9cd2-ea5060daeebd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:24.141009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d883e1e-42db-40aa-8010-f2c7c7a729b8 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e716280>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:24.160526 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c6404097-4f48-4b3d-9cd2-ea5060daeebd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1370 microversion: 2.1 time: 0.761189 Oct 18 13:38:24.164078 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2586/4901] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:23 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1370 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:24.271915 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d883e1e-42db-40aa-8010-f2c7c7a729b8 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.135763 Oct 18 13:38:24.277384 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2316/4902] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:24 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:24.364289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-043a7898-4011-49a9-9457-c005b6c205c1 req-39377f88-164e-4007-bff5-ec4f8c3b4a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c049bc0a-fc7b-4d5a-8bca-c4ef951070e5", "name": "network-vif-plugged", "status": "completed", "tag": "9be30cdd-bd27-4c52-9b51-d5a1268ca085"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:24.393413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-043a7898-4011-49a9-9457-c005b6c205c1 req-39377f88-164e-4007-bff5-ec4f8c3b4a0d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:24.393807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-043a7898-4011-49a9-9457-c005b6c205c1 req-39377f88-164e-4007-bff5-ec4f8c3b4a0d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:24.398620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-043a7898-4011-49a9-9457-c005b6c205c1 req-39377f88-164e-4007-bff5-ec4f8c3b4a0d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:24.440457 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-043a7898-4011-49a9-9457-c005b6c205c1 req-39377f88-164e-4007-bff5-ec4f8c3b4a0d service nova] Creating event network-vif-plugged:9be30cdd-bd27-4c52-9b51-d5a1268ca085 for instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 on n-h2-858384-13 Oct 18 13:38:24.455866 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-043a7898-4011-49a9-9457-c005b6c205c1 req-39377f88-164e-4007-bff5-ec4f8c3b4a0d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095681 Oct 18 13:38:24.457034 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2587/4903] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:24.524664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3628dc14-b657-4873-b4f3-589fd75bd7ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:24.525361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3628dc14-b657-4873-b4f3-589fd75bd7ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:24.540842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3628dc14-b657-4873-b4f3-589fd75bd7ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:24.541858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3628dc14-b657-4873-b4f3-589fd75bd7ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:24.542455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3628dc14-b657-4873-b4f3-589fd75bd7ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:24.543349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3628dc14-b657-4873-b4f3-589fd75bd7ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:24.543950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3628dc14-b657-4873-b4f3-589fd75bd7ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:24.546714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3628dc14-b657-4873-b4f3-589fd75bd7ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:25.131277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3628dc14-b657-4873-b4f3-589fd75bd7ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:25.144344 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3628dc14-b657-4873-b4f3-589fd75bd7ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1309 microversion: 2.1 time: 0.624325 Oct 18 13:38:25.144942 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2317/4904] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:24 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1309 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:25.189892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-575fea1e-7055-455b-999c-c708f8b508e4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:25.190859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-575fea1e-7055-455b-999c-c708f8b508e4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:25.213715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-575fea1e-7055-455b-999c-c708f8b508e4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:25.216783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-575fea1e-7055-455b-999c-c708f8b508e4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:25.220700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-575fea1e-7055-455b-999c-c708f8b508e4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:25.221741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-575fea1e-7055-455b-999c-c708f8b508e4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:25.222432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-575fea1e-7055-455b-999c-c708f8b508e4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:25.223038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-575fea1e-7055-455b-999c-c708f8b508e4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:25.292165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3c232dea-bcc9-4559-8d1e-3af81de5dbbd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e756790>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:25.368356 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3c232dea-bcc9-4559-8d1e-3af81de5dbbd tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.080338 Oct 18 13:38:25.376266 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2318/4905] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:25 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:25.535160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-575fea1e-7055-455b-999c-c708f8b508e4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:25.547202 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-575fea1e-7055-455b-999c-c708f8b508e4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1370 microversion: 2.1 time: 0.362303 Oct 18 13:38:25.568710 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2588/4906] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:25 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1370 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:26.169661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e8d9228-bd3b-4af4-825a-e3ef2407de4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:26.170345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4e8d9228-bd3b-4af4-825a-e3ef2407de4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:26.179984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e8d9228-bd3b-4af4-825a-e3ef2407de4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:26.184262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e8d9228-bd3b-4af4-825a-e3ef2407de4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:26.185199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e8d9228-bd3b-4af4-825a-e3ef2407de4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:26.189823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e8d9228-bd3b-4af4-825a-e3ef2407de4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:26.190481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e8d9228-bd3b-4af4-825a-e3ef2407de4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:26.191091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e8d9228-bd3b-4af4-825a-e3ef2407de4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:26.384374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-21fd56a3-208b-413f-a10f-4e3ce1f5402b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ebd0790>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:26.443211 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-21fd56a3-208b-413f-a10f-4e3ce1f5402b tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.063002 Oct 18 13:38:26.461755 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2589/4907] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:26 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:26.515084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4e8d9228-bd3b-4af4-825a-e3ef2407de4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:26.527033 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4e8d9228-bd3b-4af4-825a-e3ef2407de4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1309 microversion: 2.1 time: 0.362002 Oct 18 13:38:26.527993 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2319/4908] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:26 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:26.576481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-78536a62-e6ca-4f03-92df-ad3597dc7fde tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:26.578019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-78536a62-e6ca-4f03-92df-ad3597dc7fde tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:26.592473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78536a62-e6ca-4f03-92df-ad3597dc7fde tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:26.593341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78536a62-e6ca-4f03-92df-ad3597dc7fde tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:26.594002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78536a62-e6ca-4f03-92df-ad3597dc7fde tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:26.595084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78536a62-e6ca-4f03-92df-ad3597dc7fde tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:26.595966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78536a62-e6ca-4f03-92df-ad3597dc7fde tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:26.596718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78536a62-e6ca-4f03-92df-ad3597dc7fde tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:26.911270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-78536a62-e6ca-4f03-92df-ad3597dc7fde tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:26.927098 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-78536a62-e6ca-4f03-92df-ad3597dc7fde tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1370 microversion: 2.1 time: 0.354968 Oct 18 13:38:26.942056 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2590/4909] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:26 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1370 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:27.465154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6f31a37d-0558-4c77-b977-cf706783b320 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7f9ca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:27.539524 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6f31a37d-0558-4c77-b977-cf706783b320 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.079665 Oct 18 13:38:27.542458 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2320/4910] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:27 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:27.555815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-02329314-5879-4557-9ae1-ced4aea196ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:27.563898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-02329314-5879-4557-9ae1-ced4aea196ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:27.571910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02329314-5879-4557-9ae1-ced4aea196ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:27.572825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02329314-5879-4557-9ae1-ced4aea196ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:27.573471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02329314-5879-4557-9ae1-ced4aea196ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:27.574538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02329314-5879-4557-9ae1-ced4aea196ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:27.575299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02329314-5879-4557-9ae1-ced4aea196ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:27.576014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02329314-5879-4557-9ae1-ced4aea196ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:27.714360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac5a8d29-82f5-4bdf-bc2b-517c897b96c1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041-project-admin] Calling method '.version_select at 0x7ff60ebe84c0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:27.716198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac5a8d29-82f5-4bdf-bc2b-517c897b96c1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:27.716767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac5a8d29-82f5-4bdf-bc2b-517c897b96c1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:27.717343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac5a8d29-82f5-4bdf-bc2b-517c897b96c1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:27.737121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac5a8d29-82f5-4bdf-bc2b-517c897b96c1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:27.738161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac5a8d29-82f5-4bdf-bc2b-517c897b96c1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:27.738783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac5a8d29-82f5-4bdf-bc2b-517c897b96c1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:27.759370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac5a8d29-82f5-4bdf-bc2b-517c897b96c1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:27.760161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac5a8d29-82f5-4bdf-bc2b-517c897b96c1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:27.760862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac5a8d29-82f5-4bdf-bc2b-517c897b96c1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:27.769379 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ac5a8d29-82f5-4bdf-bc2b-517c897b96c1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1439899041-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.287946 Oct 18 13:38:27.771513 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2591/4911] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:38:27 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:27.812477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1faea61b-ffc0-457e-9956-884905cdd269 req-8f5dc8e0-459f-448b-ab01-026e5998d9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a18df7-1403-4f6a-8c6c-5f3e0eaaf739", "name": "network-vif-plugged", "status": "completed", "tag": "e71918e1-9c7b-4c0b-907f-a8dbe92a0c97"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:27.829779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1faea61b-ffc0-457e-9956-884905cdd269 req-8f5dc8e0-459f-448b-ab01-026e5998d9c0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:27.830860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1faea61b-ffc0-457e-9956-884905cdd269 req-8f5dc8e0-459f-448b-ab01-026e5998d9c0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:27.832730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1faea61b-ffc0-457e-9956-884905cdd269 req-8f5dc8e0-459f-448b-ab01-026e5998d9c0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:27.855352 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1faea61b-ffc0-457e-9956-884905cdd269 req-8f5dc8e0-459f-448b-ab01-026e5998d9c0 service nova] Creating event network-vif-plugged:e71918e1-9c7b-4c0b-907f-a8dbe92a0c97 for instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 on n-h1-858384-13 Oct 18 13:38:27.862872 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1faea61b-ffc0-457e-9956-884905cdd269 req-8f5dc8e0-459f-448b-ab01-026e5998d9c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068607 Oct 18 13:38:27.863769 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2592/4912] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:27.956485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a5fcb95-9801-45ef-be59-c1011275f23b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:27.957603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1a5fcb95-9801-45ef-be59-c1011275f23b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:27.973658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a5fcb95-9801-45ef-be59-c1011275f23b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:27.973658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a5fcb95-9801-45ef-be59-c1011275f23b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:27.977200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a5fcb95-9801-45ef-be59-c1011275f23b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:27.980066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a5fcb95-9801-45ef-be59-c1011275f23b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:27.980594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a5fcb95-9801-45ef-be59-c1011275f23b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:27.982184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a5fcb95-9801-45ef-be59-c1011275f23b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:28.206843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-02329314-5879-4557-9ae1-ced4aea196ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:28.218496 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-02329314-5879-4557-9ae1-ced4aea196ff tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1490 microversion: 2.1 time: 0.667530 Oct 18 13:38:28.220001 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2321/4913] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:27 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1490 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:28.245771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-550963ab-04ec-4baa-afc9-fa32beb1e8d5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:28.246895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-550963ab-04ec-4baa-afc9-fa32beb1e8d5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:28.253368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550963ab-04ec-4baa-afc9-fa32beb1e8d5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:28.254568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550963ab-04ec-4baa-afc9-fa32beb1e8d5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:28.257602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550963ab-04ec-4baa-afc9-fa32beb1e8d5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:28.258650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550963ab-04ec-4baa-afc9-fa32beb1e8d5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:28.259286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550963ab-04ec-4baa-afc9-fa32beb1e8d5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:28.259884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-550963ab-04ec-4baa-afc9-fa32beb1e8d5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:28.486273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-550963ab-04ec-4baa-afc9-fa32beb1e8d5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:28.498001 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-550963ab-04ec-4baa-afc9-fa32beb1e8d5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1489 microversion: 2.1 time: 0.258825 Oct 18 13:38:28.499163 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2322/4914] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:28 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1489 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:28.520781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ee5fb5ae-dae6-491f-b275-ebbaf1810f86 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:28.521556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ee5fb5ae-dae6-491f-b275-ebbaf1810f86 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:28.529284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee5fb5ae-dae6-491f-b275-ebbaf1810f86 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:28.530143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee5fb5ae-dae6-491f-b275-ebbaf1810f86 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:28.530883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee5fb5ae-dae6-491f-b275-ebbaf1810f86 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:28.531787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee5fb5ae-dae6-491f-b275-ebbaf1810f86 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:28.532674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee5fb5ae-dae6-491f-b275-ebbaf1810f86 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:28.533462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee5fb5ae-dae6-491f-b275-ebbaf1810f86 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:28.552531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:28.617107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1a5fcb95-9801-45ef-be59-c1011275f23b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:28.638614 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1a5fcb95-9801-45ef-be59-c1011275f23b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1370 microversion: 2.1 time: 0.687040 Oct 18 13:38:28.654955 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2593/4915] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:27 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1370 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:28.662408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3771a69d-7bce-415c-8dbf-b1569b0f4907 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ebd0160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:28.708942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ee5fb5ae-dae6-491f-b275-ebbaf1810f86 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:28.719097 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ee5fb5ae-dae6-491f-b275-ebbaf1810f86 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1490 microversion: 2.1 time: 0.202427 Oct 18 13:38:28.720382 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2323/4916] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:28 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1490 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:28.735448 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3771a69d-7bce-415c-8dbf-b1569b0f4907 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.078997 Oct 18 13:38:28.740545 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2594/4917] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:28 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:28.754454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1cafa438-0279-46da-8f28-6080538d79c4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:28.755820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1cafa438-0279-46da-8f28-6080538d79c4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:28.763765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cafa438-0279-46da-8f28-6080538d79c4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:28.765096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cafa438-0279-46da-8f28-6080538d79c4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:28.765801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cafa438-0279-46da-8f28-6080538d79c4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:28.766720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cafa438-0279-46da-8f28-6080538d79c4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:28.767379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cafa438-0279-46da-8f28-6080538d79c4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:28.768013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cafa438-0279-46da-8f28-6080538d79c4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:28.802788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1cafa438-0279-46da-8f28-6080538d79c4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:28.898830 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1cafa438-0279-46da-8f28-6080538d79c4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 204 len: 0 microversion: 2.1 time: 0.147819 Oct 18 13:38:28.903481 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2324/4918] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:38:28 2022] DELETE /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:38:28.911393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6ab2dd79-3fc8-40ab-ba34-a796fe96297e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:28.912464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6ab2dd79-3fc8-40ab-ba34-a796fe96297e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:28.921856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ab2dd79-3fc8-40ab-ba34-a796fe96297e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:28.922762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ab2dd79-3fc8-40ab-ba34-a796fe96297e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:28.923481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ab2dd79-3fc8-40ab-ba34-a796fe96297e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:28.924706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ab2dd79-3fc8-40ab-ba34-a796fe96297e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:28.925489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ab2dd79-3fc8-40ab-ba34-a796fe96297e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:28.926210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ab2dd79-3fc8-40ab-ba34-a796fe96297e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:29.325413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ab2dd79-3fc8-40ab-ba34-a796fe96297e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:29.335327 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6ab2dd79-3fc8-40ab-ba34-a796fe96297e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1496 microversion: 2.1 time: 0.429370 Oct 18 13:38:29.335987 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2595/4919] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:28 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1496 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:29.673856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a90bb83-f1ea-4522-a73e-fff9da941e0a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:29.674631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4a90bb83-f1ea-4522-a73e-fff9da941e0a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:29.684058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a90bb83-f1ea-4522-a73e-fff9da941e0a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:29.684551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a90bb83-f1ea-4522-a73e-fff9da941e0a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:29.684988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a90bb83-f1ea-4522-a73e-fff9da941e0a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:29.685749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a90bb83-f1ea-4522-a73e-fff9da941e0a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:29.686439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a90bb83-f1ea-4522-a73e-fff9da941e0a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:29.688049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a90bb83-f1ea-4522-a73e-fff9da941e0a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:29.752714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6b38216c-cf27-4548-8047-66b1bdf7840e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ec37a60>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:29.821073 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6b38216c-cf27-4548-8047-66b1bdf7840e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.072887 Oct 18 13:38:29.829098 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2596/4920] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:29 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:29.876217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a90bb83-f1ea-4522-a73e-fff9da941e0a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:29.885576 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4a90bb83-f1ea-4522-a73e-fff9da941e0a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1370 microversion: 2.1 time: 0.220602 Oct 18 13:38:29.890502 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2325/4921] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:29 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:30.363773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0c9d2afb-1983-47d3-bfb5-c55a6930aeca tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:30.367103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0c9d2afb-1983-47d3-bfb5-c55a6930aeca tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:30.384642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c9d2afb-1983-47d3-bfb5-c55a6930aeca tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:30.386152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c9d2afb-1983-47d3-bfb5-c55a6930aeca tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:30.387638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c9d2afb-1983-47d3-bfb5-c55a6930aeca tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:30.389721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c9d2afb-1983-47d3-bfb5-c55a6930aeca tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:30.391063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c9d2afb-1983-47d3-bfb5-c55a6930aeca tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:30.391839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c9d2afb-1983-47d3-bfb5-c55a6930aeca tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:30.697572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0c9d2afb-1983-47d3-bfb5-c55a6930aeca tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:30.705492 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0c9d2afb-1983-47d3-bfb5-c55a6930aeca tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1496 microversion: 2.1 time: 0.345779 Oct 18 13:38:30.709144 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2597/4922] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:30 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1496 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:30.857028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d494de73-41da-43fb-b487-c8e44e43e957 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7f9670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:30.915515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-07e8771e-bd1d-4030-9c44-e780556e3186 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:30.916447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-07e8771e-bd1d-4030-9c44-e780556e3186 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:30.934688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e8771e-bd1d-4030-9c44-e780556e3186 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:30.935185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e8771e-bd1d-4030-9c44-e780556e3186 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:30.935824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e8771e-bd1d-4030-9c44-e780556e3186 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:30.936538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e8771e-bd1d-4030-9c44-e780556e3186 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:30.937942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e8771e-bd1d-4030-9c44-e780556e3186 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:30.938392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e8771e-bd1d-4030-9c44-e780556e3186 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:30.999124 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d494de73-41da-43fb-b487-c8e44e43e957 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1451 microversion: 2.1 time: 0.165744 Oct 18 13:38:31.010916 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2326/4923] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:30 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:31.018019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-cab096b5-4403-4046-b672-f37ef4598d7c req-2f2477f6-0ac6-4809-ac25-eae435095a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c049bc0a-fc7b-4d5a-8bca-c4ef951070e5", "name": "network-vif-deleted", "tag": "9be30cdd-bd27-4c52-9b51-d5a1268ca085"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:31.039608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cab096b5-4403-4046-b672-f37ef4598d7c req-2f2477f6-0ac6-4809-ac25-eae435095a31 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.040394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cab096b5-4403-4046-b672-f37ef4598d7c req-2f2477f6-0ac6-4809-ac25-eae435095a31 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.040991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cab096b5-4403-4046-b672-f37ef4598d7c req-2f2477f6-0ac6-4809-ac25-eae435095a31 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:31.056174 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-cab096b5-4403-4046-b672-f37ef4598d7c req-2f2477f6-0ac6-4809-ac25-eae435095a31 service nova] Creating event network-vif-deleted:9be30cdd-bd27-4c52-9b51-d5a1268ca085 for instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 on n-h2-858384-13 Oct 18 13:38:31.063720 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-cab096b5-4403-4046-b672-f37ef4598d7c req-2f2477f6-0ac6-4809-ac25-eae435095a31 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051313 Oct 18 13:38:31.064608 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2327/4924] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:31.355188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-07e8771e-bd1d-4030-9c44-e780556e3186 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:31.370494 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-07e8771e-bd1d-4030-9c44-e780556e3186 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1564 microversion: 2.1 time: 0.459521 Oct 18 13:38:31.372463 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2598/4925] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:30 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1564 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:31.397375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d5b02bd1-23ce-4608-b5d8-1392b9882729 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:31.410628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d5b02bd1-23ce-4608-b5d8-1392b9882729 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:31.430909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5b02bd1-23ce-4608-b5d8-1392b9882729 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.431559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5b02bd1-23ce-4608-b5d8-1392b9882729 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.432477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5b02bd1-23ce-4608-b5d8-1392b9882729 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:31.433863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5b02bd1-23ce-4608-b5d8-1392b9882729 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.434864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5b02bd1-23ce-4608-b5d8-1392b9882729 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.435414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5b02bd1-23ce-4608-b5d8-1392b9882729 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:31.568045 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d5b02bd1-23ce-4608-b5d8-1392b9882729 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.176358 Oct 18 13:38:31.568655 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2328/4926] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:38:31 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-interface => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:31.736025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:31.736734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:31.749293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.750161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.750822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:31.751902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.752575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.753312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:31.810148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:31.813262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:31.813899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:31.814467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lazy-loading 'fault' on Instance uuid c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:31.891591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:31.900867 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-84702f0a-2be2-468f-98ff-b754d0612118 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 200 len: 1299 microversion: 2.1 time: 0.170281 Oct 18 13:38:31.902462 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2599/4927] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:31 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:32.015817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0ac3d24b-f730-4928-8cc7-6f35ed4e8310 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e756c10>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:32.072343 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0ac3d24b-f730-4928-8cc7-6f35ed4e8310 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1460 microversion: 2.1 time: 0.061116 Oct 18 13:38:32.073049 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2329/4928] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:32 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1460 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:32.089328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1cd07e71-c656-46e3-bea8-101b5a0dd324 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617a85d30>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:32.153895 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1cd07e71-c656-46e3-bea8-101b5a0dd324 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 200 len: 1460 microversion: 2.1 time: 0.069041 Oct 18 13:38:32.154826 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2600/4929] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:32 2022] GET /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 1460 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:32.170461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-553ed966-c43b-4d46-8e56-49b4d2a5a491 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:32.171794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-553ed966-c43b-4d46-8e56-49b4d2a5a491 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:32.188033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-553ed966-c43b-4d46-8e56-49b4d2a5a491 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:32.188532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-553ed966-c43b-4d46-8e56-49b4d2a5a491 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:32.188971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-553ed966-c43b-4d46-8e56-49b4d2a5a491 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:32.192273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-553ed966-c43b-4d46-8e56-49b4d2a5a491 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:32.197435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-553ed966-c43b-4d46-8e56-49b4d2a5a491 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:32.197591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-553ed966-c43b-4d46-8e56-49b4d2a5a491 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:32.563283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-553ed966-c43b-4d46-8e56-49b4d2a5a491 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:32.582587 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-553ed966-c43b-4d46-8e56-49b4d2a5a491 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456" status: 200 len: 1467 microversion: 2.1 time: 0.417399 Oct 18 13:38:32.584698 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2330/4930] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:32 2022] GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456 => generated 1467 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:32.606692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-97568b1c-66bc-448a-9a0c-3ceee02bd963 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f8723a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:32.731856 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-97568b1c-66bc-448a-9a0c-3ceee02bd963 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images?changes-since=2022-10-18T13%3A36%3A22Z" status: 200 len: 1902 microversion: 2.1 time: 0.128881 Oct 18 13:38:32.732903 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2601/4931] 10.222.0.40 () {58 vars in 1199 bytes} [Tue Oct 18 13:38:32 2022] GET /compute/v2.1/images?changes-since=2022-10-18T13%3A36%3A22Z => generated 1902 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:32.751671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0dda9132-1703-4afa-9120-a6ccf4c42140 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7171f0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:32.810188 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0dda9132-1703-4afa-9120-a6ccf4c42140 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-531433900" status: 200 len: 484 microversion: 2.1 time: 0.064390 Oct 18 13:38:32.812413 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2331/4932] 10.222.0.40 () {58 vars in 1229 bytes} [Tue Oct 18 13:38:32 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-531433900 => generated 484 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:32.825566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-691a97ea-f984-4a3a-a60e-6c799139bcde tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60efe0160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:32.925520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6354d1ce-ff8c-49a1-bca6-dc95d977d063 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:32.927253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6354d1ce-ff8c-49a1-bca6-dc95d977d063 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:32.941000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6354d1ce-ff8c-49a1-bca6-dc95d977d063 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:32.941950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6354d1ce-ff8c-49a1-bca6-dc95d977d063 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:32.942675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6354d1ce-ff8c-49a1-bca6-dc95d977d063 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:32.945055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6354d1ce-ff8c-49a1-bca6-dc95d977d063 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:32.945928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6354d1ce-ff8c-49a1-bca6-dc95d977d063 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:32.946988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6354d1ce-ff8c-49a1-bca6-dc95d977d063 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:32.955634 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-691a97ea-f984-4a3a-a60e-6c799139bcde tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images?server=b9fe15a4-7bd7-40e0-860a-e0769bf38456" status: 200 len: 958 microversion: 2.1 time: 0.134096 Oct 18 13:38:32.956246 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2602/4933] 10.222.0.40 () {58 vars in 1209 bytes} [Tue Oct 18 13:38:32 2022] GET /compute/v2.1/images?server=b9fe15a4-7bd7-40e0-860a-e0769bf38456 => generated 958 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:32.971262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f82ee77-7f58-4756-8a37-2bfd54113552 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60eeb8790>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:32.984234 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-6354d1ce-ff8c-49a1-bca6-dc95d977d063 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6354d1ce-ff8c-49a1-bca6-dc95d977d063 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 HTTP/1.1 Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c049bc0a-fc7b-4d5a-8bca-c4ef951070e5'} Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:32.991815 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:32.996995 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:32.996995 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:32.996995 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:32.996995 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:32.996995 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:38:32.996995 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:32.996995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6354d1ce-ff8c-49a1-bca6-dc95d977d063 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:32.998488 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6354d1ce-ff8c-49a1-bca6-dc95d977d063 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 404 len: 111 microversion: 2.1 time: 0.075380 Oct 18 13:38:33.000741 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2332/4934] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:32 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:38:33.016482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0c8bee03-8914-4231-8d32-8a224394482f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:33.016482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0c8bee03-8914-4231-8d32-8a224394482f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:33.039582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c8bee03-8914-4231-8d32-8a224394482f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:33.039955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c8bee03-8914-4231-8d32-8a224394482f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:33.040900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c8bee03-8914-4231-8d32-8a224394482f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:33.043343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c8bee03-8914-4231-8d32-8a224394482f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:33.043826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c8bee03-8914-4231-8d32-8a224394482f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:33.044264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0c8bee03-8914-4231-8d32-8a224394482f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:33.055377 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9f82ee77-7f58-4756-8a37-2bfd54113552 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2F833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 484 microversion: 2.1 time: 0.089142 Oct 18 13:38:33.056483 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2603/4935] 10.222.0.40 () {58 vars in 1317 bytes} [Tue Oct 18 13:38:32 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2F833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 484 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:33.070623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4bd321e3-0758-4923-929f-1c0f0c2321c4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ef4de50>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:33.138239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0c8bee03-8914-4231-8d32-8a224394482f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:33.182692 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4bd321e3-0758-4923-929f-1c0f0c2321c4 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2F833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 484 microversion: 2.1 time: 0.116253 Oct 18 13:38:33.184195 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2604/4936] 10.222.0.40 () {58 vars in 1303 bytes} [Tue Oct 18 13:38:33 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2F833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 484 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:33.200452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c274bec7-2d41-4ebf-a851-b7c32879b881 req-b9b2dde7-01a3-4007-91c7-b83a4e96c6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a18df7-1403-4f6a-8c6c-5f3e0eaaf739", "tag": "e71918e1-9c7b-4c0b-907f-a8dbe92a0c97"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:33.214397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c274bec7-2d41-4ebf-a851-b7c32879b881 req-b9b2dde7-01a3-4007-91c7-b83a4e96c6c8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:33.215196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c274bec7-2d41-4ebf-a851-b7c32879b881 req-b9b2dde7-01a3-4007-91c7-b83a4e96c6c8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:33.215920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c274bec7-2d41-4ebf-a851-b7c32879b881 req-b9b2dde7-01a3-4007-91c7-b83a4e96c6c8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:33.233996 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c274bec7-2d41-4ebf-a851-b7c32879b881 req-b9b2dde7-01a3-4007-91c7-b83a4e96c6c8 service nova] Creating event network-changed:e71918e1-9c7b-4c0b-907f-a8dbe92a0c97 for instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 on n-h1-858384-13 Oct 18 13:38:33.262423 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c274bec7-2d41-4ebf-a851-b7c32879b881 req-b9b2dde7-01a3-4007-91c7-b83a4e96c6c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065722 Oct 18 13:38:33.264227 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2605/4937] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:38:33.277520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-06fcbf01-f62f-454f-96b7-9731d6f5f4a1 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60fe9c940>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:33.317796 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0c8bee03-8914-4231-8d32-8a224394482f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 204 len: 0 microversion: 2.1 time: 0.312847 Oct 18 13:38:33.318925 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2333/4938] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:38:33 2022] DELETE /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:38:33.343910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8c495b8c-bad9-42bb-8326-5ea8b817a7f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:33.347892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8c495b8c-bad9-42bb-8326-5ea8b817a7f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:33.367491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c495b8c-bad9-42bb-8326-5ea8b817a7f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:33.370840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c495b8c-bad9-42bb-8326-5ea8b817a7f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:33.375630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c495b8c-bad9-42bb-8326-5ea8b817a7f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:33.376667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c495b8c-bad9-42bb-8326-5ea8b817a7f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:33.377335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c495b8c-bad9-42bb-8326-5ea8b817a7f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:33.377933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c495b8c-bad9-42bb-8326-5ea8b817a7f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:33.493398 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-06fcbf01-f62f-454f-96b7-9731d6f5f4a1 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.226313 Oct 18 13:38:33.495804 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2606/4939] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 18 13:38:33 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:33.512495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2063b94f-5434-4e3a-8489-3600558d5e62 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ef4d9d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:33.619464 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2063b94f-5434-4e3a-8489-3600558d5e62 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.110099 Oct 18 13:38:33.621560 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2607/4940] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 18 13:38:33 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:33.637464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-516e41ea-9978-4a13-9122-fd3ba39f72d8 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617ad30d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:33.704745 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-516e41ea-9978-4a13-9122-fd3ba39f72d8 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.073571 Oct 18 13:38:33.705931 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2608/4941] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:38:33 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:33.720711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68514848-7699-4bef-b8d3-5d6d75408374 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60fe9c940>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:33.815236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8c495b8c-bad9-42bb-8326-5ea8b817a7f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:33.826117 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8c495b8c-bad9-42bb-8326-5ea8b817a7f1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1495 microversion: 2.1 time: 0.502867 Oct 18 13:38:33.826858 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2334/4942] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:33 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1495 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:33.899112 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68514848-7699-4bef-b8d3-5d6d75408374 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/detail?changes-since=2022-10-18T13%3A36%3A16Z" status: 200 len: 6321 microversion: 2.1 time: 0.183160 Oct 18 13:38:33.903816 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2609/4943] 10.222.0.40 () {58 vars in 1220 bytes} [Tue Oct 18 13:38:33 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-18T13%3A36%3A16Z => generated 6321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:33.920527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-995877d6-f6a3-4bb6-b707-9f3aa30369ef tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7f9040>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:34.061596 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-995877d6-f6a3-4bb6-b707-9f3aa30369ef tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-531433900" status: 200 len: 664 microversion: 2.1 time: 0.145171 Oct 18 13:38:34.062517 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2335/4944] 10.222.0.40 () {58 vars in 1250 bytes} [Tue Oct 18 13:38:33 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-531433900 => generated 664 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:34.078367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5771eeb0-4b85-4a22-9c96-6f5b67823e98 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60eeb88b0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:34.163916 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5771eeb0-4b85-4a22-9c96-6f5b67823e98 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2F833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1462 microversion: 2.1 time: 0.089345 Oct 18 13:38:34.164518 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2610/4945] 10.222.0.40 () {58 vars in 1338 bytes} [Tue Oct 18 13:38:34 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2F833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1462 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:34.182745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-271f8f1f-c8f5-4fa9-af8d-63d78906a32c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e763a60>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:34.276715 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-271f8f1f-c8f5-4fa9-af8d-63d78906a32c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2F833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1462 microversion: 2.1 time: 0.098977 Oct 18 13:38:34.278138 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2336/4946] 10.222.0.40 () {58 vars in 1324 bytes} [Tue Oct 18 13:38:34 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2F833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1462 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:34.296862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a2e6eb31-8fe0-4d3c-ad02-a52ad202adb6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60eeb89d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:34.474035 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a2e6eb31-8fe0-4d3c-ad02-a52ad202adb6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7096 microversion: 2.1 time: 0.183402 Oct 18 13:38:34.490633 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2611/4947] 10.222.0.40 () {58 vars in 1170 bytes} [Tue Oct 18 13:38:34 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7096 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:34.498082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f0ef5899-77d5-4720-b92a-b3ad5c8c3eb0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7f9d30>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:34.625360 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f0ef5899-77d5-4720-b92a-b3ad5c8c3eb0 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4364 microversion: 2.1 time: 0.132087 Oct 18 13:38:34.633576 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2337/4948] 10.222.0.40 () {58 vars in 1170 bytes} [Tue Oct 18 13:38:34 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4364 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:34.643340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed82464e-b977-4afc-beaa-c915c31767ca tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60f23b1f0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:34.706734 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ed82464e-b977-4afc-beaa-c915c31767ca tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/c5f2027d-2f76-420c-95a8-7bb70182af23" status: 200 len: 784 microversion: 2.1 time: 0.067248 Oct 18 13:38:34.707550 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2612/4949] 10.222.0.40 () {58 vars in 1233 bytes} [Tue Oct 18 13:38:34 2022] GET /compute/v2.1/images/c5f2027d-2f76-420c-95a8-7bb70182af23 => generated 784 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:34.723065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1445d808-b4f9-4dba-935b-5eb94909360c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60e7635e0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:34.794395 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1445d808-b4f9-4dba-935b-5eb94909360c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1607 microversion: 2.1 time: 0.075155 Oct 18 13:38:34.795275 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2338/4950] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:38:34 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1607 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:34.812429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-61456f25-1e5b-4956-97ce-ac9796f8c830 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ef4d700>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:34.851448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5055a6bd-910c-4479-998b-69c351dee926 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:34.852062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5055a6bd-910c-4479-998b-69c351dee926 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:34.859434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5055a6bd-910c-4479-998b-69c351dee926 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:34.864058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5055a6bd-910c-4479-998b-69c351dee926 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:34.864568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5055a6bd-910c-4479-998b-69c351dee926 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:34.868054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5055a6bd-910c-4479-998b-69c351dee926 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:34.869197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5055a6bd-910c-4479-998b-69c351dee926 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:34.870272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5055a6bd-910c-4479-998b-69c351dee926 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:35.468286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5055a6bd-910c-4479-998b-69c351dee926 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:35.483596 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5055a6bd-910c-4479-998b-69c351dee926 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1495 microversion: 2.1 time: 0.634505 Oct 18 13:38:35.504638 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2339/4951] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:34 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1495 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:35.873945 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-61456f25-1e5b-4956-97ce-ac9796f8c830 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "DELETE /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea" status: 204 len: 0 microversion: 2.1 time: 1.065619 Oct 18 13:38:35.878952 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2613/4952] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:34 2022] DELETE /compute/v2.1/images/71783ff7-2491-4f1a-8485-70467a50f1ea => generated 0 bytes in 1068 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:38:35.883990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b92bd71c-4486-4a1c-9a6f-59716eb8c21e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff617b5c430>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:36.097582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c325905a-c113-49b7-9893-3a539cedc633 req-5a1d7740-378b-42cd-a9c6-56d7baf56036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fe15a4-7bd7-40e0-860a-e0769bf38456", "name": "network-vif-unplugged", "status": "completed", "tag": "4c03f362-7416-4c8f-8537-5657edf6a795"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:36.118869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c325905a-c113-49b7-9893-3a539cedc633 req-5a1d7740-378b-42cd-a9c6-56d7baf56036 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:36.121352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c325905a-c113-49b7-9893-3a539cedc633 req-5a1d7740-378b-42cd-a9c6-56d7baf56036 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:36.121884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c325905a-c113-49b7-9893-3a539cedc633 req-5a1d7740-378b-42cd-a9c6-56d7baf56036 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:36.148358 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c325905a-c113-49b7-9893-3a539cedc633 req-5a1d7740-378b-42cd-a9c6-56d7baf56036 service nova] Creating event network-vif-unplugged:4c03f362-7416-4c8f-8537-5657edf6a795 for instance b9fe15a4-7bd7-40e0-860a-e0769bf38456 on n-h1-858384-13 Oct 18 13:38:36.160164 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c325905a-c113-49b7-9893-3a539cedc633 req-5a1d7740-378b-42cd-a9c6-56d7baf56036 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064676 Oct 18 13:38:36.161663 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2614/4953] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:38:36.516684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-153dc6a2-e5d4-45d5-a363-772a2a3d9d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:36.517774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-153dc6a2-e5d4-45d5-a363-772a2a3d9d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:36.531244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-153dc6a2-e5d4-45d5-a363-772a2a3d9d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:36.533221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-153dc6a2-e5d4-45d5-a363-772a2a3d9d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:36.534394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-153dc6a2-e5d4-45d5-a363-772a2a3d9d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:36.536698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-153dc6a2-e5d4-45d5-a363-772a2a3d9d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:36.537578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-153dc6a2-e5d4-45d5-a363-772a2a3d9d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:36.542628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-153dc6a2-e5d4-45d5-a363-772a2a3d9d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:36.550640 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b92bd71c-4486-4a1c-9a6f-59716eb8c21e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "DELETE /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f" status: 204 len: 0 microversion: 2.1 time: 0.670459 Oct 18 13:38:36.555101 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2340/4954] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:35 2022] DELETE /compute/v2.1/images/e6ed749c-0602-46d5-93ab-f92216049d5f => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:38:36.559826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b1de4b37-9778-44c5-91b4-a3aa6fd9b24d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ee5d310>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:36.704045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-153dc6a2-e5d4-45d5-a363-772a2a3d9d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:36.725379 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-153dc6a2-e5d4-45d5-a363-772a2a3d9d70 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 200 len: 1453 microversion: 2.1 time: 0.210646 Oct 18 13:38:36.729632 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2615/4955] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:36 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 1453 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:36.757498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-dbcbbebd-05fc-4d04-9bd0-0bb6fab3d6df req-d06220ae-8693-4b88-8da4-defaf7722d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98fd0182-30e6-4a86-9b90-a70a91ee36a6", "name": "network-vif-deleted", "tag": "0ad57bd5-5e53-49c8-84e8-00579e72deec"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:36.797091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dbcbbebd-05fc-4d04-9bd0-0bb6fab3d6df req-d06220ae-8693-4b88-8da4-defaf7722d3b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:36.800530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dbcbbebd-05fc-4d04-9bd0-0bb6fab3d6df req-d06220ae-8693-4b88-8da4-defaf7722d3b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:36.802327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dbcbbebd-05fc-4d04-9bd0-0bb6fab3d6df req-d06220ae-8693-4b88-8da4-defaf7722d3b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:36.847025 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-dbcbbebd-05fc-4d04-9bd0-0bb6fab3d6df req-d06220ae-8693-4b88-8da4-defaf7722d3b service nova] Creating event network-vif-deleted:0ad57bd5-5e53-49c8-84e8-00579e72deec for instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 on n-h1-858384-13 Oct 18 13:38:36.881482 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-dbcbbebd-05fc-4d04-9bd0-0bb6fab3d6df req-d06220ae-8693-4b88-8da4-defaf7722d3b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130851 Oct 18 13:38:36.886803 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2616/4956] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:37.317163 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b1de4b37-9778-44c5-91b4-a3aa6fd9b24d tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "DELETE /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659" status: 204 len: 0 microversion: 2.1 time: 0.761067 Oct 18 13:38:37.317868 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2341/4957] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:36 2022] DELETE /compute/v2.1/images/c8cdfcca-2a57-4bac-af85-0a7fee616659 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:38:37.331051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ef91f424-fb12-4327-9ee3-705142ddca1f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:37.331907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ef91f424-fb12-4327-9ee3-705142ddca1f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:37.343999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef91f424-fb12-4327-9ee3-705142ddca1f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.344766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef91f424-fb12-4327-9ee3-705142ddca1f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.345396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef91f424-fb12-4327-9ee3-705142ddca1f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.346404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef91f424-fb12-4327-9ee3-705142ddca1f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.348165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef91f424-fb12-4327-9ee3-705142ddca1f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.348781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef91f424-fb12-4327-9ee3-705142ddca1f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.413105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ef91f424-fb12-4327-9ee3-705142ddca1f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:37.449388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:37.515611 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ef91f424-fb12-4327-9ee3-705142ddca1f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "DELETE /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 204 len: 0 microversion: 2.1 time: 0.191974 Oct 18 13:38:37.517351 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2617/4958] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:38:37 2022] DELETE /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:38:37.528205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0f3ad150-19ca-472e-9e6b-61ed367f7d25 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:37.529692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0f3ad150-19ca-472e-9e6b-61ed367f7d25 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:37.541149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f3ad150-19ca-472e-9e6b-61ed367f7d25 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.541977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f3ad150-19ca-472e-9e6b-61ed367f7d25 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.542687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f3ad150-19ca-472e-9e6b-61ed367f7d25 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.543593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f3ad150-19ca-472e-9e6b-61ed367f7d25 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.544232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f3ad150-19ca-472e-9e6b-61ed367f7d25 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.544874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f3ad150-19ca-472e-9e6b-61ed367f7d25 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.756150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e05bd619-a8f2-41e7-847e-27fc7434094b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:37.756871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e05bd619-a8f2-41e7-847e-27fc7434094b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:37.769034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e05bd619-a8f2-41e7-847e-27fc7434094b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.769573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e05bd619-a8f2-41e7-847e-27fc7434094b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.770015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e05bd619-a8f2-41e7-847e-27fc7434094b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.773741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e05bd619-a8f2-41e7-847e-27fc7434094b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:37.774251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e05bd619-a8f2-41e7-847e-27fc7434094b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:37.774701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e05bd619-a8f2-41e7-847e-27fc7434094b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:37.803279 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-e05bd619-a8f2-41e7-847e-27fc7434094b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e05bd619-a8f2-41e7-847e-27fc7434094b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 HTTP/1.1 Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '98fd0182-30e6-4a86-9b90-a70a91ee36a6'} Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:37.812082 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:37.817271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:37.817271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:37.817271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:37.817271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:37.817271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:38:37.817271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:37.817271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e05bd619-a8f2-41e7-847e-27fc7434094b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:37.817271 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e05bd619-a8f2-41e7-847e-27fc7434094b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 404 len: 111 microversion: 2.1 time: 0.062206 Oct 18 13:38:37.819447 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2618/4959] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:37 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:38:37.854498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0f3ad150-19ca-472e-9e6b-61ed367f7d25 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:37.883457 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0f3ad150-19ca-472e-9e6b-61ed367f7d25 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1473 microversion: 2.1 time: 0.361253 Oct 18 13:38:37.907562 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2342/4960] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:37 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1473 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:38.058677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1163492939", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "aa0d4f33-39e0-4d3f-ab36-9b89248d2552"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:38.156747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] validate_networks() for [('aa0d4f33-39e0-4d3f-ab36-9b89248d2552', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:38:38.605330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:38:38.605829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:38:38.606371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:38:38.607144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:38:38.607661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:38:38.617768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:38.618323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:38.618878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:38.619662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:38.620808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:38.621346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:38.640089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:38.645952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for user a4856dd5667c4f10aa9ff1ccb1788cc8 and project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:38.660183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:38:38.662673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:38.720352 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db56891d-6a4e-460f-a509-4e9ed2834eda tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665545 Oct 18 13:38:38.721886 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2619/4961] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:38:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:38:38.739972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c75b692a-1f6b-4e67-a3cd-6e8ef9ef503f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:38.743268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c75b692a-1f6b-4e67-a3cd-6e8ef9ef503f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:38.913483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c75b692a-1f6b-4e67-a3cd-6e8ef9ef503f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:38.919321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fb10b89a-e9a2-4570-966c-a72169581309 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:38.920368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb10b89a-e9a2-4570-966c-a72169581309 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:38.924080 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c75b692a-1f6b-4e67-a3cd-6e8ef9ef503f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1209 microversion: 2.1 time: 0.194890 Oct 18 13:38:38.925149 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2343/4962] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:38 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1209 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:38.958521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb10b89a-e9a2-4570-966c-a72169581309 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:38.959400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb10b89a-e9a2-4570-966c-a72169581309 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:38.960910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb10b89a-e9a2-4570-966c-a72169581309 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:38.963919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb10b89a-e9a2-4570-966c-a72169581309 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:38.964618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb10b89a-e9a2-4570-966c-a72169581309 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:38.968016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb10b89a-e9a2-4570-966c-a72169581309 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:39.238472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fb10b89a-e9a2-4570-966c-a72169581309 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:39.253443 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fb10b89a-e9a2-4570-966c-a72169581309 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1473 microversion: 2.1 time: 0.343598 Oct 18 13:38:39.272034 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2620/4963] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:38 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1473 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:39.952702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-69ea86dd-cc54-4467-bba1-a5626c0106a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:39.953833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-69ea86dd-cc54-4467-bba1-a5626c0106a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:39.980560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69ea86dd-cc54-4467-bba1-a5626c0106a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:39.981056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69ea86dd-cc54-4467-bba1-a5626c0106a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:39.986481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69ea86dd-cc54-4467-bba1-a5626c0106a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:39.991036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69ea86dd-cc54-4467-bba1-a5626c0106a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:39.992574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69ea86dd-cc54-4467-bba1-a5626c0106a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:39.995668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69ea86dd-cc54-4467-bba1-a5626c0106a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:40.010102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1290530814", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "422a81ce-2092-44b1-a5e6-c6de1e6de5c4"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:40.096625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] validate_networks() for [('422a81ce-2092-44b1-a5e6-c6de1e6de5c4', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:38:40.137847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-69ea86dd-cc54-4467-bba1-a5626c0106a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:40.149650 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-69ea86dd-cc54-4467-bba1-a5626c0106a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1261 microversion: 2.1 time: 0.202739 Oct 18 13:38:40.150358 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2621/4964] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:39 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1261 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:40.204901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-2150c648-78dd-4450-9090-4bb8a6f1234a req-58bca8d7-e834-4b68-93f4-8305bec01926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833b85f4-e854-4a7b-b04d-001cde240eb3", "name": "network-vif-deleted", "tag": "83080d1b-68a0-4f1b-a31f-f765e5c6c561"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:40.222576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2150c648-78dd-4450-9090-4bb8a6f1234a req-58bca8d7-e834-4b68-93f4-8305bec01926 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:40.224950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2150c648-78dd-4450-9090-4bb8a6f1234a req-58bca8d7-e834-4b68-93f4-8305bec01926 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:40.225469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2150c648-78dd-4450-9090-4bb8a6f1234a req-58bca8d7-e834-4b68-93f4-8305bec01926 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:40.240108 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-2150c648-78dd-4450-9090-4bb8a6f1234a req-58bca8d7-e834-4b68-93f4-8305bec01926 service nova] Creating event network-vif-deleted:83080d1b-68a0-4f1b-a31f-f765e5c6c561 for instance 833b85f4-e854-4a7b-b04d-001cde240eb3 on n-h2-858384-13 Oct 18 13:38:40.246288 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-2150c648-78dd-4450-9090-4bb8a6f1234a req-58bca8d7-e834-4b68-93f4-8305bec01926 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053322 Oct 18 13:38:40.247346 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2622/4965] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:40.284749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:40.286335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:40.297053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:40.297645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:40.298111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:40.298812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:40.299267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:40.299741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:40.334583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:40.335062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:40.335680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:40.336127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lazy-loading 'fault' on Instance uuid 833b85f4-e854-4a7b-b04d-001cde240eb3 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:40.399317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:40.410058 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3d8c19a2-5a02-4017-b65b-8117c583d2f3 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 200 len: 1307 microversion: 2.1 time: 0.132756 Oct 18 13:38:40.411494 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2623/4966] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:40 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 1307 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:40.996926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:38:40.998378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:38:40.998958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:38:40.999588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:38:41.000107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:38:41.010779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:41.011410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:41.011785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:41.012513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:41.012967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:41.013446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:41.033453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Getting quotas for project 3added60d53241c9ba439247ad0bf32f. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:41.040557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Getting quotas for user b3500641e62b488c9263533c5341cdbb and project 3added60d53241c9ba439247ad0bf32f. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:41.058097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:38:41.060434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:41.142371 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7997d0ce-3eff-4bae-9423-8e2f96378717 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.427152 Oct 18 13:38:41.143835 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2344/4967] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:38:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:38:41.157025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-20c87ab4-f086-45b3-a83f-8a7cb9395e2f tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:41.159219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-20c87ab4-f086-45b3-a83f-8a7cb9395e2f tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:41.168168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:41.189617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2de31bd6-7f6e-4593-86a8-c9a6610c1164 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:41.190306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2de31bd6-7f6e-4593-86a8-c9a6610c1164 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:41.206583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2de31bd6-7f6e-4593-86a8-c9a6610c1164 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:41.207730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2de31bd6-7f6e-4593-86a8-c9a6610c1164 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:41.210414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2de31bd6-7f6e-4593-86a8-c9a6610c1164 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:41.212663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2de31bd6-7f6e-4593-86a8-c9a6610c1164 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:41.213960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2de31bd6-7f6e-4593-86a8-c9a6610c1164 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:41.214518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2de31bd6-7f6e-4593-86a8-c9a6610c1164 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:41.285679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-20c87ab4-f086-45b3-a83f-8a7cb9395e2f tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:41.295113 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-20c87ab4-f086-45b3-a83f-8a7cb9395e2f tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1225 microversion: 2.1 time: 0.143441 Oct 18 13:38:41.297070 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2624/4968] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:41 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:41.362715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2de31bd6-7f6e-4593-86a8-c9a6610c1164 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:41.375572 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2de31bd6-7f6e-4593-86a8-c9a6610c1164 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1267 microversion: 2.1 time: 0.203841 Oct 18 13:38:41.376419 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2345/4969] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:41 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:41.438147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a0de947a-321c-4331-ba78-00ccdfe421fb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:41.438921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a0de947a-321c-4331-ba78-00ccdfe421fb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: 833b85f4-e854-4a7b-b04d-001cde240eb3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:41.453983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0de947a-321c-4331-ba78-00ccdfe421fb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:41.455416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0de947a-321c-4331-ba78-00ccdfe421fb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:41.456090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0de947a-321c-4331-ba78-00ccdfe421fb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:41.458231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0de947a-321c-4331-ba78-00ccdfe421fb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:41.459607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0de947a-321c-4331-ba78-00ccdfe421fb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:41.460672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0de947a-321c-4331-ba78-00ccdfe421fb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:41.499180 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-a0de947a-321c-4331-ba78-00ccdfe421fb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] HTTP exception thrown: Instance 833b85f4-e854-4a7b-b04d-001cde240eb3 could not be found. Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a0de947a-321c-4331-ba78-00ccdfe421fb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Request method failure captured: Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 HTTP/1.1 Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqvPQFnum_gMhliAnacj4AMBOS-Y38Q5i-PSQ_epz0YW7RCLC-uNORz-OVsaT6JRTpbg88iZ2A1LATFxIS2sNUE6vBCP60ZUL5Vgpc1ovZEPge1j-440Nzh1uNVDfoavfsIPlGi2TIYu5cUMHNM6M0GKp1SNLsgWGfjdOM7loOnN5TY Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 83bedd11e01645ffa6a7f20bf82a1e0d Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ListImageFiltersTestJSON-81507190 Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83bedd11e01645ffa6a7f20bf82a1e0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/83bedd11e01645ffa6a7f20bf82a1e0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83bedd11e01645ffa6a7f20bf82a1e0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_83bedd11e01645ffa6a7f20bf82a1e0d"}]}] Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ListImageFiltersTestJSON-81507190 Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 83bedd11e01645ffa6a7f20bf82a1e0d Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-81507190 Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ListImageFiltersTestJSON-81507190-project Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 859a37ff232745e5b5a429477bf0fb3d Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ListImageFiltersTestJSON-81507190-project Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 833b85f4-e854-4a7b-b04d-001cde240eb3 could not be found. Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '833b85f4-e854-4a7b-b04d-001cde240eb3'} Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833b85f4-e854-4a7b-b04d-001cde240eb3 could not be found. Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833b85f4-e854-4a7b-b04d-001cde240eb3 could not be found. Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:41.501280 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:41.505135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:41.505135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:41.505135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:41.505135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:41.505135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:41.505135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833b85f4-e854-4a7b-b04d-001cde240eb3 could not be found. Oct 18 13:38:41.505135 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:41.508394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a0de947a-321c-4331-ba78-00ccdfe421fb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Returning 404 to user: Instance 833b85f4-e854-4a7b-b04d-001cde240eb3 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:41.513370 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a0de947a-321c-4331-ba78-00ccdfe421fb tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3" status: 404 len: 111 microversion: 2.1 time: 0.077579 Oct 18 13:38:41.513370 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2625/4970] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:41 2022] GET /compute/v2.1/servers/833b85f4-e854-4a7b-b04d-001cde240eb3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:38:41.519635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f9121a99-05aa-4382-9581-db5757a943e6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:41.520140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f9121a99-05aa-4382-9581-db5757a943e6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:41.548495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9121a99-05aa-4382-9581-db5757a943e6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:41.550988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9121a99-05aa-4382-9581-db5757a943e6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:41.555425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9121a99-05aa-4382-9581-db5757a943e6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:41.556314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9121a99-05aa-4382-9581-db5757a943e6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:41.556853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9121a99-05aa-4382-9581-db5757a943e6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:41.557530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9121a99-05aa-4382-9581-db5757a943e6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:41.629121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f9121a99-05aa-4382-9581-db5757a943e6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:41.854127 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f9121a99-05aa-4382-9581-db5757a943e6 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456" status: 204 len: 0 microversion: 2.1 time: 0.337391 Oct 18 13:38:41.857488 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2346/4971] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:38:41 2022] DELETE /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:38:41.866483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-111165b7-b9c9-4ff4-9608-07987c46db24 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:41.867477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-111165b7-b9c9-4ff4-9608-07987c46db24 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:41.882593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-111165b7-b9c9-4ff4-9608-07987c46db24 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:41.883092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-111165b7-b9c9-4ff4-9608-07987c46db24 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:41.883527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-111165b7-b9c9-4ff4-9608-07987c46db24 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:41.889014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-111165b7-b9c9-4ff4-9608-07987c46db24 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:41.889713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-111165b7-b9c9-4ff4-9608-07987c46db24 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:41.890315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-111165b7-b9c9-4ff4-9608-07987c46db24 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:42.139673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-111165b7-b9c9-4ff4-9608-07987c46db24 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:42.154586 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-111165b7-b9c9-4ff4-9608-07987c46db24 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456" status: 200 len: 1473 microversion: 2.1 time: 0.291507 Oct 18 13:38:42.155210 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2626/4972] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:41 2022] GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456 => generated 1473 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:42.320675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cfb28da5-19c4-4496-adb4-5d4ee31222d7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:42.321583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cfb28da5-19c4-4496-adb4-5d4ee31222d7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:42.340800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cfb28da5-19c4-4496-adb4-5d4ee31222d7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:42.341494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cfb28da5-19c4-4496-adb4-5d4ee31222d7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:42.342066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cfb28da5-19c4-4496-adb4-5d4ee31222d7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:42.346003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cfb28da5-19c4-4496-adb4-5d4ee31222d7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:42.348046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cfb28da5-19c4-4496-adb4-5d4ee31222d7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:42.351257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cfb28da5-19c4-4496-adb4-5d4ee31222d7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:42.397888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:42.402461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-97e32297-2087-407f-8b0d-1c1065ce3045 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:42.403142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-97e32297-2087-407f-8b0d-1c1065ce3045 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:42.418540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97e32297-2087-407f-8b0d-1c1065ce3045 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:42.420247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97e32297-2087-407f-8b0d-1c1065ce3045 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:42.422755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97e32297-2087-407f-8b0d-1c1065ce3045 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:42.423613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97e32297-2087-407f-8b0d-1c1065ce3045 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:42.424151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97e32297-2087-407f-8b0d-1c1065ce3045 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:42.426157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97e32297-2087-407f-8b0d-1c1065ce3045 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:42.519906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cfb28da5-19c4-4496-adb4-5d4ee31222d7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:42.529132 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cfb28da5-19c4-4496-adb4-5d4ee31222d7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1221 microversion: 2.1 time: 0.213753 Oct 18 13:38:42.545207 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2347/4973] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:42 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1221 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:42.662261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-97e32297-2087-407f-8b0d-1c1065ce3045 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:42.670998 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-97e32297-2087-407f-8b0d-1c1065ce3045 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1309 microversion: 2.1 time: 0.273325 Oct 18 13:38:42.683263 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2627/4974] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:42 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:43.180794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-28931051-8137-4c21-aa2c-e7e11cc8c9f2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:43.181820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-28931051-8137-4c21-aa2c-e7e11cc8c9f2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:43.191381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28931051-8137-4c21-aa2c-e7e11cc8c9f2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:43.192072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28931051-8137-4c21-aa2c-e7e11cc8c9f2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:43.192514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28931051-8137-4c21-aa2c-e7e11cc8c9f2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:43.193248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28931051-8137-4c21-aa2c-e7e11cc8c9f2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:43.194665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28931051-8137-4c21-aa2c-e7e11cc8c9f2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:43.195402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28931051-8137-4c21-aa2c-e7e11cc8c9f2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:43.403534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-183c7032-5df0-458c-b3fc-f42484f85393 req-8e1a19b3-876a-42c0-a40f-b7e20bf08f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf413a26-7de3-4662-acbf-b8434b9a73b8", "tag": "76007bfa-6547-4f52-bf60-87e93369b307"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:43.425215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-183c7032-5df0-458c-b3fc-f42484f85393 req-8e1a19b3-876a-42c0-a40f-b7e20bf08f22 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:43.425697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-183c7032-5df0-458c-b3fc-f42484f85393 req-8e1a19b3-876a-42c0-a40f-b7e20bf08f22 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:43.426126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-183c7032-5df0-458c-b3fc-f42484f85393 req-8e1a19b3-876a-42c0-a40f-b7e20bf08f22 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:43.448553 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-183c7032-5df0-458c-b3fc-f42484f85393 req-8e1a19b3-876a-42c0-a40f-b7e20bf08f22 service nova] Creating event network-changed:76007bfa-6547-4f52-bf60-87e93369b307 for instance bf413a26-7de3-4662-acbf-b8434b9a73b8 on n-h2-858384-13 Oct 18 13:38:43.465823 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-183c7032-5df0-458c-b3fc-f42484f85393 req-8e1a19b3-876a-42c0-a40f-b7e20bf08f22 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065859 Oct 18 13:38:43.469663 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2628/4975] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:43.562999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f71f1926-bdc0-4273-9e35-7da8bfba5a91 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:43.563916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f71f1926-bdc0-4273-9e35-7da8bfba5a91 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:43.577422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f71f1926-bdc0-4273-9e35-7da8bfba5a91 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:43.580425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f71f1926-bdc0-4273-9e35-7da8bfba5a91 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:43.581685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f71f1926-bdc0-4273-9e35-7da8bfba5a91 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:43.582780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f71f1926-bdc0-4273-9e35-7da8bfba5a91 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:43.584430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f71f1926-bdc0-4273-9e35-7da8bfba5a91 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:43.588726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f71f1926-bdc0-4273-9e35-7da8bfba5a91 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:43.744157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f71f1926-bdc0-4273-9e35-7da8bfba5a91 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:43.766787 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f71f1926-bdc0-4273-9e35-7da8bfba5a91 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1283 microversion: 2.1 time: 0.209662 Oct 18 13:38:43.775242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-28931051-8137-4c21-aa2c-e7e11cc8c9f2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:43.787822 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2629/4976] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:43 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1283 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:43.810721 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-28931051-8137-4c21-aa2c-e7e11cc8c9f2 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456" status: 200 len: 1473 microversion: 2.1 time: 0.633885 Oct 18 13:38:43.811374 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2348/4977] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:43 2022] GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456 => generated 1473 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:43.813056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87c04fcb-4ce4-4518-93ac-25a135f3fc55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:43.814063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-87c04fcb-4ce4-4518-93ac-25a135f3fc55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:43.825330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87c04fcb-4ce4-4518-93ac-25a135f3fc55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:43.826139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87c04fcb-4ce4-4518-93ac-25a135f3fc55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:43.826765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87c04fcb-4ce4-4518-93ac-25a135f3fc55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:43.827682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87c04fcb-4ce4-4518-93ac-25a135f3fc55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:43.829750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87c04fcb-4ce4-4518-93ac-25a135f3fc55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:43.830570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87c04fcb-4ce4-4518-93ac-25a135f3fc55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.003623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3366943b-3063-46b4-9a56-d59fc725ba86 tempest-PortsAdminExtendedAttrsTestJSON-316051554 tempest-PortsAdminExtendedAttrsTestJSON-316051554-project-admin] Calling method '.version_select at 0x7ff60efdf670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:44.009838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3366943b-3063-46b4-9a56-d59fc725ba86 tempest-PortsAdminExtendedAttrsTestJSON-316051554 tempest-PortsAdminExtendedAttrsTestJSON-316051554-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:44.010427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3366943b-3063-46b4-9a56-d59fc725ba86 tempest-PortsAdminExtendedAttrsTestJSON-316051554 tempest-PortsAdminExtendedAttrsTestJSON-316051554-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:44.014013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3366943b-3063-46b4-9a56-d59fc725ba86 tempest-PortsAdminExtendedAttrsTestJSON-316051554 tempest-PortsAdminExtendedAttrsTestJSON-316051554-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.038893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3366943b-3063-46b4-9a56-d59fc725ba86 tempest-PortsAdminExtendedAttrsTestJSON-316051554 tempest-PortsAdminExtendedAttrsTestJSON-316051554-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:44.039696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3366943b-3063-46b4-9a56-d59fc725ba86 tempest-PortsAdminExtendedAttrsTestJSON-316051554 tempest-PortsAdminExtendedAttrsTestJSON-316051554-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:44.040400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3366943b-3063-46b4-9a56-d59fc725ba86 tempest-PortsAdminExtendedAttrsTestJSON-316051554 tempest-PortsAdminExtendedAttrsTestJSON-316051554-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.058156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-87c04fcb-4ce4-4518-93ac-25a135f3fc55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:44.066131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3366943b-3063-46b4-9a56-d59fc725ba86 tempest-PortsAdminExtendedAttrsTestJSON-316051554 tempest-PortsAdminExtendedAttrsTestJSON-316051554-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:44.069044 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-87c04fcb-4ce4-4518-93ac-25a135f3fc55 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1309 microversion: 2.1 time: 0.264022 Oct 18 13:38:44.069691 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2630/4978] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:43 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1309 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:44.070460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3366943b-3063-46b4-9a56-d59fc725ba86 tempest-PortsAdminExtendedAttrsTestJSON-316051554 tempest-PortsAdminExtendedAttrsTestJSON-316051554-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:44.070856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3366943b-3063-46b4-9a56-d59fc725ba86 tempest-PortsAdminExtendedAttrsTestJSON-316051554 tempest-PortsAdminExtendedAttrsTestJSON-316051554-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.077892 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3366943b-3063-46b4-9a56-d59fc725ba86 tempest-PortsAdminExtendedAttrsTestJSON-316051554 tempest-PortsAdminExtendedAttrsTestJSON-316051554-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.244850 Oct 18 13:38:44.079000 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2349/4979] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:38:43 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:38:44.806382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e92a95ce-4507-4ce5-9f74-d379676b944c tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:44.807002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e92a95ce-4507-4ce5-9f74-d379676b944c tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:44.816304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e92a95ce-4507-4ce5-9f74-d379676b944c tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:44.816832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e92a95ce-4507-4ce5-9f74-d379676b944c tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:44.817287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e92a95ce-4507-4ce5-9f74-d379676b944c tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.819821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e92a95ce-4507-4ce5-9f74-d379676b944c tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:44.820279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e92a95ce-4507-4ce5-9f74-d379676b944c tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:44.820705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e92a95ce-4507-4ce5-9f74-d379676b944c tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.835345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-08f978a7-2c03-46a5-b9fc-26e61c651080 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:44.836560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-08f978a7-2c03-46a5-b9fc-26e61c651080 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:44.843725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08f978a7-2c03-46a5-b9fc-26e61c651080 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:44.844519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08f978a7-2c03-46a5-b9fc-26e61c651080 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:44.845242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08f978a7-2c03-46a5-b9fc-26e61c651080 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.846054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08f978a7-2c03-46a5-b9fc-26e61c651080 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:44.846587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08f978a7-2c03-46a5-b9fc-26e61c651080 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:44.847109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08f978a7-2c03-46a5-b9fc-26e61c651080 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:44.915390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e92a95ce-4507-4ce5-9f74-d379676b944c tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:44.939013 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e92a95ce-4507-4ce5-9f74-d379676b944c tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1283 microversion: 2.1 time: 0.137610 Oct 18 13:38:44.953977 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2631/4980] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:44 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1283 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:45.095863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04a400ce-fffa-4647-9fa5-f0a6e0024bc8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:45.096092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04a400ce-fffa-4647-9fa5-f0a6e0024bc8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:45.108221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04a400ce-fffa-4647-9fa5-f0a6e0024bc8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:45.108964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04a400ce-fffa-4647-9fa5-f0a6e0024bc8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:45.109610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04a400ce-fffa-4647-9fa5-f0a6e0024bc8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:45.111084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04a400ce-fffa-4647-9fa5-f0a6e0024bc8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:45.111554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04a400ce-fffa-4647-9fa5-f0a6e0024bc8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:45.111989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04a400ce-fffa-4647-9fa5-f0a6e0024bc8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:45.177579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-08f978a7-2c03-46a5-b9fc-26e61c651080 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:45.187691 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-08f978a7-2c03-46a5-b9fc-26e61c651080 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456" status: 200 len: 1473 microversion: 2.1 time: 0.356343 Oct 18 13:38:45.188612 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2350/4981] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:44 2022] GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456 => generated 1473 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:45.354554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04a400ce-fffa-4647-9fa5-f0a6e0024bc8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:45.364491 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04a400ce-fffa-4647-9fa5-f0a6e0024bc8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1309 microversion: 2.1 time: 0.273318 Oct 18 13:38:45.365098 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2632/4982] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:45 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1309 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:45.583013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-35a32f24-387e-416c-87b7-6a76e7ff4bde req-41959cc4-d177-4c87-8611-a27b9ffb878f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9fe15a4-7bd7-40e0-860a-e0769bf38456", "name": "network-vif-deleted", "tag": "4c03f362-7416-4c8f-8537-5657edf6a795"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:45.589204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:45.596269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-35a32f24-387e-416c-87b7-6a76e7ff4bde req-41959cc4-d177-4c87-8611-a27b9ffb878f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:45.596676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-35a32f24-387e-416c-87b7-6a76e7ff4bde req-41959cc4-d177-4c87-8611-a27b9ffb878f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:45.597102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-35a32f24-387e-416c-87b7-6a76e7ff4bde req-41959cc4-d177-4c87-8611-a27b9ffb878f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:45.613328 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-35a32f24-387e-416c-87b7-6a76e7ff4bde req-41959cc4-d177-4c87-8611-a27b9ffb878f service nova] Creating event network-vif-deleted:4c03f362-7416-4c8f-8537-5657edf6a795 for instance b9fe15a4-7bd7-40e0-860a-e0769bf38456 on n-h1-858384-13 Oct 18 13:38:45.622246 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-35a32f24-387e-416c-87b7-6a76e7ff4bde req-41959cc4-d177-4c87-8611-a27b9ffb878f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042810 Oct 18 13:38:45.623252 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2351/4983] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:45.964943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cdc91b6c-e8cc-4d31-8e0a-42be19ced660 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:45.966489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cdc91b6c-e8cc-4d31-8e0a-42be19ced660 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:45.975227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdc91b6c-e8cc-4d31-8e0a-42be19ced660 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:45.976042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdc91b6c-e8cc-4d31-8e0a-42be19ced660 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:45.976882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdc91b6c-e8cc-4d31-8e0a-42be19ced660 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:45.977702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdc91b6c-e8cc-4d31-8e0a-42be19ced660 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:45.978236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdc91b6c-e8cc-4d31-8e0a-42be19ced660 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:45.978921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdc91b6c-e8cc-4d31-8e0a-42be19ced660 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:46.213350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:46.214695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:46.219328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cdc91b6c-e8cc-4d31-8e0a-42be19ced660 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:46.229666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:46.230143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:46.232223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:46.232921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:46.235611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:46.238183 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cdc91b6c-e8cc-4d31-8e0a-42be19ced660 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1325 microversion: 2.1 time: 0.279498 Oct 18 13:38:46.252995 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2633/4984] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:45 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1325 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:46.253523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:46.300190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:46.303322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:46.304281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:46.304771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lazy-loading 'fault' on Instance uuid b9fe15a4-7bd7-40e0-860a-e0769bf38456 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:38:46.391690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859a37ff232745e5b5a429477bf0fb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bedd11e01645ffa6a7f20bf82a1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:46.395747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8b76f933-0104-4781-83de-35a04ac6c0a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:46.397841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8b76f933-0104-4781-83de-35a04ac6c0a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:46.412860 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7ce3b75d-c394-4396-9940-03b66db48b13 tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456" status: 200 len: 1308 microversion: 2.1 time: 0.205250 Oct 18 13:38:46.415518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b76f933-0104-4781-83de-35a04ac6c0a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:46.416239 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2352/4985] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:46 2022] GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456 => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:46.429534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b76f933-0104-4781-83de-35a04ac6c0a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:46.429534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b76f933-0104-4781-83de-35a04ac6c0a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:46.429534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b76f933-0104-4781-83de-35a04ac6c0a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:46.429534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b76f933-0104-4781-83de-35a04ac6c0a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:46.429534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b76f933-0104-4781-83de-35a04ac6c0a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:46.623951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8b76f933-0104-4781-83de-35a04ac6c0a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:46.633409 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8b76f933-0104-4781-83de-35a04ac6c0a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1309 microversion: 2.1 time: 0.247665 Oct 18 13:38:46.634447 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2634/4986] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:46 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1309 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:47.263054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-91855cf4-9910-4ec4-9196-31a54f8c98b7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:47.263653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-91855cf4-9910-4ec4-9196-31a54f8c98b7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:47.274490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91855cf4-9910-4ec4-9196-31a54f8c98b7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:47.274964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91855cf4-9910-4ec4-9196-31a54f8c98b7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:47.275395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91855cf4-9910-4ec4-9196-31a54f8c98b7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:47.276090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91855cf4-9910-4ec4-9196-31a54f8c98b7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:47.276537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91855cf4-9910-4ec4-9196-31a54f8c98b7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:47.276973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91855cf4-9910-4ec4-9196-31a54f8c98b7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:47.445574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c874e80b-c016-4d98-9f02-70134403daed tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:47.446971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c874e80b-c016-4d98-9f02-70134403daed tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] [instance: b9fe15a4-7bd7-40e0-860a-e0769bf38456] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:47.453927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c874e80b-c016-4d98-9f02-70134403daed tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:47.454412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c874e80b-c016-4d98-9f02-70134403daed tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:47.454842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c874e80b-c016-4d98-9f02-70134403daed tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:47.455536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c874e80b-c016-4d98-9f02-70134403daed tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:47.455993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c874e80b-c016-4d98-9f02-70134403daed tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:47.456413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c874e80b-c016-4d98-9f02-70134403daed tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:47.470882 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-c874e80b-c016-4d98-9f02-70134403daed tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] HTTP exception thrown: Instance b9fe15a4-7bd7-40e0-860a-e0769bf38456 could not be found. Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c874e80b-c016-4d98-9f02-70134403daed tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Request method failure captured: Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456 HTTP/1.1 Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqvPQFnum_gMhliAnacj4AMBOS-Y38Q5i-PSQ_epz0YW7RCLC-uNORz-OVsaT6JRTpbg88iZ2A1LATFxIS2sNUE6vBCP60ZUL5Vgpc1ovZEPge1j-440Nzh1uNVDfoavfsIPlGi2TIYu5cUMHNM6M0GKp1SNLsgWGfjdOM7loOnN5TY Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 83bedd11e01645ffa6a7f20bf82a1e0d Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ListImageFiltersTestJSON-81507190 Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83bedd11e01645ffa6a7f20bf82a1e0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/83bedd11e01645ffa6a7f20bf82a1e0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83bedd11e01645ffa6a7f20bf82a1e0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_83bedd11e01645ffa6a7f20bf82a1e0d"}]}] Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ListImageFiltersTestJSON-81507190 Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 83bedd11e01645ffa6a7f20bf82a1e0d Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-81507190 Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ListImageFiltersTestJSON-81507190-project Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 859a37ff232745e5b5a429477bf0fb3d Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ListImageFiltersTestJSON-81507190-project Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance b9fe15a4-7bd7-40e0-860a-e0769bf38456 could not be found. Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'b9fe15a4-7bd7-40e0-860a-e0769bf38456'} Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9fe15a4-7bd7-40e0-860a-e0769bf38456 could not be found. Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9fe15a4-7bd7-40e0-860a-e0769bf38456 could not be found. Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:47.472548 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:47.477171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:47.477171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:47.477171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:47.477171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:47.477171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:47.477171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9fe15a4-7bd7-40e0-860a-e0769bf38456 could not be found. Oct 18 13:38:47.477171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:47.477171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c874e80b-c016-4d98-9f02-70134403daed tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Returning 404 to user: Instance b9fe15a4-7bd7-40e0-860a-e0769bf38456 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:47.477171 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c874e80b-c016-4d98-9f02-70134403daed tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456" status: 404 len: 111 microversion: 2.1 time: 0.033237 Oct 18 13:38:47.480064 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2635/4987] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:47 2022] GET /compute/v2.1/servers/b9fe15a4-7bd7-40e0-860a-e0769bf38456 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:38:47.484188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b490a5a7-7213-495d-be7c-c5556632946f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ec373a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:47.514242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-91855cf4-9910-4ec4-9196-31a54f8c98b7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:47.527214 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-91855cf4-9910-4ec4-9196-31a54f8c98b7 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1325 microversion: 2.1 time: 0.267611 Oct 18 13:38:47.540033 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2353/4988] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:47 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1325 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:47.642423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e0d2e02d-ab6f-45d1-8ca7-2a75e1b06972 req-1522cd12-59ae-43f8-a34e-2039f1c20f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a877a2-59f3-40aa-9832-709a74af1c40", "tag": "801be081-db7a-413b-9a2e-bc8b8d88ca72"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:47.680421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e0d2e02d-ab6f-45d1-8ca7-2a75e1b06972 req-1522cd12-59ae-43f8-a34e-2039f1c20f41 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:47.680909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e0d2e02d-ab6f-45d1-8ca7-2a75e1b06972 req-1522cd12-59ae-43f8-a34e-2039f1c20f41 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:47.683653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e0d2e02d-ab6f-45d1-8ca7-2a75e1b06972 req-1522cd12-59ae-43f8-a34e-2039f1c20f41 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:47.716187 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e0d2e02d-ab6f-45d1-8ca7-2a75e1b06972 req-1522cd12-59ae-43f8-a34e-2039f1c20f41 service nova] Creating event network-changed:801be081-db7a-413b-9a2e-bc8b8d88ca72 for instance c1a877a2-59f3-40aa-9832-709a74af1c40 on n-h2-858384-13 Oct 18 13:38:47.731176 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e0d2e02d-ab6f-45d1-8ca7-2a75e1b06972 req-1522cd12-59ae-43f8-a34e-2039f1c20f41 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095337 Oct 18 13:38:47.732876 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2354/4989] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:47.744624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0a3f4c51-8e7a-4722-b392-90e34eb5fcfb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:47.745363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0a3f4c51-8e7a-4722-b392-90e34eb5fcfb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:47.752355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a3f4c51-8e7a-4722-b392-90e34eb5fcfb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:47.752997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a3f4c51-8e7a-4722-b392-90e34eb5fcfb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:47.753667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a3f4c51-8e7a-4722-b392-90e34eb5fcfb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:47.755194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a3f4c51-8e7a-4722-b392-90e34eb5fcfb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:47.756194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a3f4c51-8e7a-4722-b392-90e34eb5fcfb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:47.757668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a3f4c51-8e7a-4722-b392-90e34eb5fcfb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:47.957727 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b490a5a7-7213-495d-be7c-c5556632946f tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "DELETE /compute/v2.1/images/4e663d51-0127-4a2b-bb21-0575f57d2f2b" status: 204 len: 0 microversion: 2.1 time: 0.477731 Oct 18 13:38:47.958484 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2636/4990] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:47 2022] DELETE /compute/v2.1/images/4e663d51-0127-4a2b-bb21-0575f57d2f2b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:38:47.966775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b34147f0-e417-480c-b719-82263104472c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ec12940>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:47.967534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0a3f4c51-8e7a-4722-b392-90e34eb5fcfb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:47.978232 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0a3f4c51-8e7a-4722-b392-90e34eb5fcfb tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1309 microversion: 2.1 time: 0.240847 Oct 18 13:38:47.981158 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2355/4991] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:47 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1309 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:48.222261 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b34147f0-e417-480c-b719-82263104472c tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "DELETE /compute/v2.1/images/3932fd35-f504-4607-8c78-5207be412de8" status: 204 len: 0 microversion: 2.1 time: 0.259267 Oct 18 13:38:48.223014 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2637/4992] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:47 2022] DELETE /compute/v2.1/images/3932fd35-f504-4607-8c78-5207be412de8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:38:48.231551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-921c9a71-86e2-4ff7-9e86-c0f600f3326e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] Calling method '.version_select at 0x7ff60ecf61f0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:48.468795 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-921c9a71-86e2-4ff7-9e86-c0f600f3326e tempest-ListImageFiltersTestJSON-81507190 tempest-ListImageFiltersTestJSON-81507190-project] 10.222.0.40 "DELETE /compute/v2.1/images/a704e0bd-694c-4fe2-8938-bea1b26ea85c" status: 204 len: 0 microversion: 2.1 time: 0.240974 Oct 18 13:38:48.469498 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2356/4993] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:48 2022] DELETE /compute/v2.1/images/a704e0bd-694c-4fe2-8938-bea1b26ea85c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:38:48.557669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-67274e00-cbfc-463b-97e7-e42c6ad6cc63 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:48.558894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-67274e00-cbfc-463b-97e7-e42c6ad6cc63 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:48.566284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67274e00-cbfc-463b-97e7-e42c6ad6cc63 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:48.566781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67274e00-cbfc-463b-97e7-e42c6ad6cc63 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:48.567223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67274e00-cbfc-463b-97e7-e42c6ad6cc63 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:48.567930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67274e00-cbfc-463b-97e7-e42c6ad6cc63 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:48.568978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67274e00-cbfc-463b-97e7-e42c6ad6cc63 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:48.569714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67274e00-cbfc-463b-97e7-e42c6ad6cc63 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:48.629975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:48.814458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-67274e00-cbfc-463b-97e7-e42c6ad6cc63 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:48.828862 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-67274e00-cbfc-463b-97e7-e42c6ad6cc63 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1325 microversion: 2.1 time: 0.276437 Oct 18 13:38:48.830989 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2638/4994] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:48 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1325 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:49.004745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-175179b2-e14b-4bcb-ae10-729cc5221142 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:49.006074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-175179b2-e14b-4bcb-ae10-729cc5221142 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:49.012396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-175179b2-e14b-4bcb-ae10-729cc5221142 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:49.013228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-175179b2-e14b-4bcb-ae10-729cc5221142 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:49.013827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-175179b2-e14b-4bcb-ae10-729cc5221142 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:49.014745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-175179b2-e14b-4bcb-ae10-729cc5221142 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:49.015193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-175179b2-e14b-4bcb-ae10-729cc5221142 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:49.015821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-175179b2-e14b-4bcb-ae10-729cc5221142 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:49.312818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-175179b2-e14b-4bcb-ae10-729cc5221142 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:49.321771 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-175179b2-e14b-4bcb-ae10-729cc5221142 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1309 microversion: 2.1 time: 0.321851 Oct 18 13:38:49.336418 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2357/4995] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:48 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1309 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:49.852197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-49c01eb6-b63a-4a1a-95a8-8edb2d2c28ee tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:49.853469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-49c01eb6-b63a-4a1a-95a8-8edb2d2c28ee tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:49.861387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-49c01eb6-b63a-4a1a-95a8-8edb2d2c28ee tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:49.862271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-49c01eb6-b63a-4a1a-95a8-8edb2d2c28ee tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:49.862942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-49c01eb6-b63a-4a1a-95a8-8edb2d2c28ee tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:49.864202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-49c01eb6-b63a-4a1a-95a8-8edb2d2c28ee tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:49.864884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-49c01eb6-b63a-4a1a-95a8-8edb2d2c28ee tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:49.866096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-49c01eb6-b63a-4a1a-95a8-8edb2d2c28ee tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.036639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d86857cf-a94c-446a-b515-b86b2b8a684e req-e1e9ff8c-eb01-48f4-911c-47baf60210e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf413a26-7de3-4662-acbf-b8434b9a73b8", "name": "network-vif-plugged", "status": "completed", "tag": "76007bfa-6547-4f52-bf60-87e93369b307"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:50.042076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-49c01eb6-b63a-4a1a-95a8-8edb2d2c28ee tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:50.054634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d86857cf-a94c-446a-b515-b86b2b8a684e req-e1e9ff8c-eb01-48f4-911c-47baf60210e3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.055040 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-49c01eb6-b63a-4a1a-95a8-8edb2d2c28ee tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1325 microversion: 2.1 time: 0.206600 Oct 18 13:38:50.057216 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2639/4996] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:49 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:50.057676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d86857cf-a94c-446a-b515-b86b2b8a684e req-e1e9ff8c-eb01-48f4-911c-47baf60210e3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.058210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d86857cf-a94c-446a-b515-b86b2b8a684e req-e1e9ff8c-eb01-48f4-911c-47baf60210e3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.081058 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d86857cf-a94c-446a-b515-b86b2b8a684e req-e1e9ff8c-eb01-48f4-911c-47baf60210e3 service nova] Creating event network-vif-plugged:76007bfa-6547-4f52-bf60-87e93369b307 for instance bf413a26-7de3-4662-acbf-b8434b9a73b8 on n-h2-858384-13 Oct 18 13:38:50.107130 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d86857cf-a94c-446a-b515-b86b2b8a684e req-e1e9ff8c-eb01-48f4-911c-47baf60210e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074147 Oct 18 13:38:50.108113 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2358/4997] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:38:50.346979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1ed28ed3-7b2b-4b1b-8508-a849b681bfe2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:50.347985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1ed28ed3-7b2b-4b1b-8508-a849b681bfe2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:50.356629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ed28ed3-7b2b-4b1b-8508-a849b681bfe2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.357620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ed28ed3-7b2b-4b1b-8508-a849b681bfe2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.358063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ed28ed3-7b2b-4b1b-8508-a849b681bfe2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.358763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ed28ed3-7b2b-4b1b-8508-a849b681bfe2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.359216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ed28ed3-7b2b-4b1b-8508-a849b681bfe2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.359802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ed28ed3-7b2b-4b1b-8508-a849b681bfe2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.399571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f6c3ea72-61f9-4f9d-84d0-ec6612f65100 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] Calling method '.version_select at 0x7ff60ec7c430>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:50.417989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6c3ea72-61f9-4f9d-84d0-ec6612f65100 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.419267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6c3ea72-61f9-4f9d-84d0-ec6612f65100 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.420881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6c3ea72-61f9-4f9d-84d0-ec6612f65100 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.422385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6c3ea72-61f9-4f9d-84d0-ec6612f65100 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:50.423009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6c3ea72-61f9-4f9d-84d0-ec6612f65100 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:50.424338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6c3ea72-61f9-4f9d-84d0-ec6612f65100 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:50.436772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:50.459938 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f6c3ea72-61f9-4f9d-84d0-ec6612f65100 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] 10.222.0.40 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.188257 Oct 18 13:38:50.470029 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2640/4998] 10.222.0.40 () {58 vars in 1122 bytes} [Tue Oct 18 13:38:50 2022] GET /compute/v2.1/limits => generated 511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:50.525516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d59c7aa1-19d0-4caf-97a4-6d2797e6afc7 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2136537046", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:50.534435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1ed28ed3-7b2b-4b1b-8508-a849b681bfe2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:50.546058 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1ed28ed3-7b2b-4b1b-8508-a849b681bfe2 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1309 microversion: 2.1 time: 0.203177 Oct 18 13:38:50.547568 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2359/4999] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:50 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1309 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:50.595281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-d59c7aa1-19d0-4caf-97a4-6d2797e6afc7 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:38:50.812562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-d59c7aa1-19d0-4caf-97a4-6d2797e6afc7 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] Getting quotas for project 3dfea3a980e049c6aca2f6058d6ed5f3. Resources: dict_keys(['metadata_items']) {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:50.818041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-d59c7aa1-19d0-4caf-97a4-6d2797e6afc7 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] Getting quotas for user 5b4ba0bfc8a846d289b22f513e298ef2 and project 3dfea3a980e049c6aca2f6058d6ed5f3. Resources: dict_keys(['metadata_items']) {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:50.831374 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-d59c7aa1-19d0-4caf-97a4-6d2797e6afc7 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d59c7aa1-19d0-4caf-97a4-6d2797e6afc7 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] Request method failure captured: Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 1752 Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqxqFP-LNCXEKXLnrvHXkgs5xXtjkyFpuGESHpyaE79xiWOfORtgusAfmR1HH9BTyessk5v3PHUyJ3Ym95lSSCIHb_Gna_Na3WPqhC3lJqYKYPrrmv9XMC6mnxk6EApZzegl29IH_M0A448ME2LWnZd_dpb3ZjSbDNMK8lACE3yUvbM Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 3dfea3a980e049c6aca2f6058d6ed5f3 Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-2025966889 Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3dfea3a980e049c6aca2f6058d6ed5f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3dfea3a980e049c6aca2f6058d6ed5f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3dfea3a980e049c6aca2f6058d6ed5f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3dfea3a980e049c6aca2f6058d6ed5f3"}]}] Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-2025966889 Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 3dfea3a980e049c6aca2f6058d6ed5f3 Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-2025966889 Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 5b4ba0bfc8a846d289b22f513e298ef2 Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2136537046", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:38:50.833393 n-d-858384-13 devstack@n-api.service[120611]: exception: Maximum number of metadata items exceeds 128 Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-2136537046', 'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:50.836315 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d59c7aa1-19d0-4caf-97a4-6d2797e6afc7 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d59c7aa1-19d0-4caf-97a4-6d2797e6afc7 tempest-AbsoluteLimitsNegativeTestJSON-2025966889 tempest-AbsoluteLimitsNegativeTestJSON-2025966889-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.315238 Oct 18 13:38:50.839606 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2641/5000] 10.222.0.40 () {60 vars in 1148 bytes} [Tue Oct 18 13:38:50 2022] POST /compute/v2.1/servers => generated 87 bytes in 317 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:38:51.080556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8329d079-ef85-4d98-ac81-0de555deed78 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:51.081863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8329d079-ef85-4d98-ac81-0de555deed78 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:51.086435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:51.087490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=8 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:51.092882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8329d079-ef85-4d98-ac81-0de555deed78 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:51.093713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8329d079-ef85-4d98-ac81-0de555deed78 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:51.094495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8329d079-ef85-4d98-ac81-0de555deed78 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:51.095472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8329d079-ef85-4d98-ac81-0de555deed78 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:51.096495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8329d079-ef85-4d98-ac81-0de555deed78 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:51.096983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8329d079-ef85-4d98-ac81-0de555deed78 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:51.255161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8329d079-ef85-4d98-ac81-0de555deed78 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:51.264697 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8329d079-ef85-4d98-ac81-0de555deed78 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1325 microversion: 2.1 time: 0.188130 Oct 18 13:38:51.266129 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2360/5001] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:51 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1325 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:51.570178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2f73e827-f6cb-4302-94e6-86b851ca7e54 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:51.572057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2f73e827-f6cb-4302-94e6-86b851ca7e54 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:51.579389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f73e827-f6cb-4302-94e6-86b851ca7e54 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:51.580140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f73e827-f6cb-4302-94e6-86b851ca7e54 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:51.580823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f73e827-f6cb-4302-94e6-86b851ca7e54 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:51.581822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f73e827-f6cb-4302-94e6-86b851ca7e54 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:51.582404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f73e827-f6cb-4302-94e6-86b851ca7e54 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:51.583261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f73e827-f6cb-4302-94e6-86b851ca7e54 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:51.762720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2f73e827-f6cb-4302-94e6-86b851ca7e54 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:51.772323 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2f73e827-f6cb-4302-94e6-86b851ca7e54 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1489 microversion: 2.1 time: 0.206239 Oct 18 13:38:51.773624 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2642/5002] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:51 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1489 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:51.795957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-751367b6-ef80-44a1-bfa5-bc6a81496216 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:51.798765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-751367b6-ef80-44a1-bfa5-bc6a81496216 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:51.807053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-751367b6-ef80-44a1-bfa5-bc6a81496216 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:51.807889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-751367b6-ef80-44a1-bfa5-bc6a81496216 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:51.808509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-751367b6-ef80-44a1-bfa5-bc6a81496216 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:51.809390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-751367b6-ef80-44a1-bfa5-bc6a81496216 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:51.810031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-751367b6-ef80-44a1-bfa5-bc6a81496216 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:51.810661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-751367b6-ef80-44a1-bfa5-bc6a81496216 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:51.890937 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-751367b6-ef80-44a1-bfa5-bc6a81496216 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "PUT /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1084 microversion: 2.1 time: 0.098813 Oct 18 13:38:51.893240 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2361/5003] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 18 13:38:51 2022] PUT /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1084 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:51.912128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d7454c91-812b-43c7-866d-413b5be40ad5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:51.913146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d7454c91-812b-43c7-866d-413b5be40ad5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:51.926949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7454c91-812b-43c7-866d-413b5be40ad5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:51.927606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7454c91-812b-43c7-866d-413b5be40ad5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:51.928252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7454c91-812b-43c7-866d-413b5be40ad5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:51.928989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7454c91-812b-43c7-866d-413b5be40ad5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:51.929491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7454c91-812b-43c7-866d-413b5be40ad5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:51.929916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7454c91-812b-43c7-866d-413b5be40ad5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.111674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d7454c91-812b-43c7-866d-413b5be40ad5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:52.125315 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d7454c91-812b-43c7-866d-413b5be40ad5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1510 microversion: 2.1 time: 0.216844 Oct 18 13:38:52.126015 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2643/5004] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:51 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:52.129371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-f117e7c8-6f3f-4da4-85cc-65a46608cb57 req-5e9776b2-9a45-40a2-af57-89693ccda443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a877a2-59f3-40aa-9832-709a74af1c40", "name": "network-vif-plugged", "status": "completed", "tag": "801be081-db7a-413b-9a2e-bc8b8d88ca72"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:52.137843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f117e7c8-6f3f-4da4-85cc-65a46608cb57 req-5e9776b2-9a45-40a2-af57-89693ccda443 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.138597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f117e7c8-6f3f-4da4-85cc-65a46608cb57 req-5e9776b2-9a45-40a2-af57-89693ccda443 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.139284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f117e7c8-6f3f-4da4-85cc-65a46608cb57 req-5e9776b2-9a45-40a2-af57-89693ccda443 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.150558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-efe0c281-516f-49bb-b4bc-107e0b52dd2c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:52.151184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-efe0c281-516f-49bb-b4bc-107e0b52dd2c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:52.153564 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f117e7c8-6f3f-4da4-85cc-65a46608cb57 req-5e9776b2-9a45-40a2-af57-89693ccda443 service nova] Creating event network-vif-plugged:801be081-db7a-413b-9a2e-bc8b8d88ca72 for instance c1a877a2-59f3-40aa-9832-709a74af1c40 on n-h2-858384-13 Oct 18 13:38:52.158911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efe0c281-516f-49bb-b4bc-107e0b52dd2c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.159463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efe0c281-516f-49bb-b4bc-107e0b52dd2c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.159582 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-f117e7c8-6f3f-4da4-85cc-65a46608cb57 req-5e9776b2-9a45-40a2-af57-89693ccda443 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036200 Oct 18 13:38:52.159913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efe0c281-516f-49bb-b4bc-107e0b52dd2c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.160555 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2362/5005] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:38:52.160677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efe0c281-516f-49bb-b4bc-107e0b52dd2c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.161200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efe0c281-516f-49bb-b4bc-107e0b52dd2c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.161630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efe0c281-516f-49bb-b4bc-107e0b52dd2c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.292228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-effeb5c1-6a6e-4872-8bee-7df035887d98 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:52.293112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-effeb5c1-6a6e-4872-8bee-7df035887d98 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:52.300289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-effeb5c1-6a6e-4872-8bee-7df035887d98 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.300956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-effeb5c1-6a6e-4872-8bee-7df035887d98 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.301729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-effeb5c1-6a6e-4872-8bee-7df035887d98 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.303245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-effeb5c1-6a6e-4872-8bee-7df035887d98 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.303706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-effeb5c1-6a6e-4872-8bee-7df035887d98 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.304161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-effeb5c1-6a6e-4872-8bee-7df035887d98 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.405654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-efe0c281-516f-49bb-b4bc-107e0b52dd2c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:52.414438 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-efe0c281-516f-49bb-b4bc-107e0b52dd2c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1510 microversion: 2.1 time: 0.269793 Oct 18 13:38:52.415050 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2644/5006] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:52 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:52.437754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1e596b2-c372-4147-9c0c-92946a211ef5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:52.438247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e1e596b2-c372-4147-9c0c-92946a211ef5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:52.444476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1e596b2-c372-4147-9c0c-92946a211ef5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.445222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1e596b2-c372-4147-9c0c-92946a211ef5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.445655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1e596b2-c372-4147-9c0c-92946a211ef5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.446749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1e596b2-c372-4147-9c0c-92946a211ef5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.447210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1e596b2-c372-4147-9c0c-92946a211ef5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.447630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1e596b2-c372-4147-9c0c-92946a211ef5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.475721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e1e596b2-c372-4147-9c0c-92946a211ef5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:52.489559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-effeb5c1-6a6e-4872-8bee-7df035887d98 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:52.501457 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-effeb5c1-6a6e-4872-8bee-7df035887d98 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1325 microversion: 2.1 time: 0.215442 Oct 18 13:38:52.502067 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2363/5007] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:52 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1325 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:52.562537 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e1e596b2-c372-4147-9c0c-92946a211ef5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 204 len: 0 microversion: 2.1 time: 0.128322 Oct 18 13:38:52.563133 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2645/5008] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:38:52 2022] DELETE /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:38:52.573627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ebd4dc4d-95f9-433c-91d7-4f20a9f8d7cc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:52.575344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ebd4dc4d-95f9-433c-91d7-4f20a9f8d7cc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:52.582690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebd4dc4d-95f9-433c-91d7-4f20a9f8d7cc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.583201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebd4dc4d-95f9-433c-91d7-4f20a9f8d7cc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.583670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebd4dc4d-95f9-433c-91d7-4f20a9f8d7cc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.584442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebd4dc4d-95f9-433c-91d7-4f20a9f8d7cc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.584895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebd4dc4d-95f9-433c-91d7-4f20a9f8d7cc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.585346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebd4dc4d-95f9-433c-91d7-4f20a9f8d7cc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.663698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d1de2e58-d3e0-4484-a4e9-6124d413572a tempest-AZV2TestJSON-1308721863 tempest-AZV2TestJSON-1308721863-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:52.665274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1de2e58-d3e0-4484-a4e9-6124d413572a tempest-AZV2TestJSON-1308721863 tempest-AZV2TestJSON-1308721863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.665758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1de2e58-d3e0-4484-a4e9-6124d413572a tempest-AZV2TestJSON-1308721863 tempest-AZV2TestJSON-1308721863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.666198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1de2e58-d3e0-4484-a4e9-6124d413572a tempest-AZV2TestJSON-1308721863 tempest-AZV2TestJSON-1308721863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.666931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1de2e58-d3e0-4484-a4e9-6124d413572a tempest-AZV2TestJSON-1308721863 tempest-AZV2TestJSON-1308721863-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:52.667387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1de2e58-d3e0-4484-a4e9-6124d413572a tempest-AZV2TestJSON-1308721863 tempest-AZV2TestJSON-1308721863-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:52.667820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1de2e58-d3e0-4484-a4e9-6124d413572a tempest-AZV2TestJSON-1308721863 tempest-AZV2TestJSON-1308721863-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:52.691819 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d1de2e58-d3e0-4484-a4e9-6124d413572a tempest-AZV2TestJSON-1308721863 tempest-AZV2TestJSON-1308721863-project] 10.222.0.40 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.170218 Oct 18 13:38:52.692487 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2364/5009] 10.222.0.40 () {58 vars in 1164 bytes} [Tue Oct 18 13:38:52 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:38:52.771056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ebd4dc4d-95f9-433c-91d7-4f20a9f8d7cc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:52.782362 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ebd4dc4d-95f9-433c-91d7-4f20a9f8d7cc tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1516 microversion: 2.1 time: 0.214596 Oct 18 13:38:52.783193 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2646/5010] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:52 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1516 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:38:53.534848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-129ce72c-888a-401e-a9af-329e1eccd991 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:53.535598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-129ce72c-888a-401e-a9af-329e1eccd991 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:53.544007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-129ce72c-888a-401e-a9af-329e1eccd991 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:53.544549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-129ce72c-888a-401e-a9af-329e1eccd991 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:53.545044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-129ce72c-888a-401e-a9af-329e1eccd991 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:53.546169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-129ce72c-888a-401e-a9af-329e1eccd991 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:53.546714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-129ce72c-888a-401e-a9af-329e1eccd991 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:53.547207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-129ce72c-888a-401e-a9af-329e1eccd991 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:53.728913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-129ce72c-888a-401e-a9af-329e1eccd991 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:53.738123 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-129ce72c-888a-401e-a9af-329e1eccd991 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1325 microversion: 2.1 time: 0.207683 Oct 18 13:38:53.738698 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2365/5011] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:53 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:53.807240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f181d33e-06ec-4256-8c22-c2b6ebdd9b4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:53.807861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f181d33e-06ec-4256-8c22-c2b6ebdd9b4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:53.814818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f181d33e-06ec-4256-8c22-c2b6ebdd9b4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:53.815307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f181d33e-06ec-4256-8c22-c2b6ebdd9b4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:53.815747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f181d33e-06ec-4256-8c22-c2b6ebdd9b4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:53.816446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f181d33e-06ec-4256-8c22-c2b6ebdd9b4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:53.816907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f181d33e-06ec-4256-8c22-c2b6ebdd9b4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:53.817368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f181d33e-06ec-4256-8c22-c2b6ebdd9b4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:54.007070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f181d33e-06ec-4256-8c22-c2b6ebdd9b4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:54.016030 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f181d33e-06ec-4256-8c22-c2b6ebdd9b4c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1516 microversion: 2.1 time: 0.212633 Oct 18 13:38:54.016622 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2647/5012] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:53 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1516 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:54.761864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8a8c3f59-cbd0-4453-90b4-858365b2d9ff tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:54.762522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8a8c3f59-cbd0-4453-90b4-858365b2d9ff tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:54.770073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a8c3f59-cbd0-4453-90b4-858365b2d9ff tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:54.770942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a8c3f59-cbd0-4453-90b4-858365b2d9ff tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:54.771698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a8c3f59-cbd0-4453-90b4-858365b2d9ff tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:54.772660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a8c3f59-cbd0-4453-90b4-858365b2d9ff tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:54.773378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a8c3f59-cbd0-4453-90b4-858365b2d9ff tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:54.774011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a8c3f59-cbd0-4453-90b4-858365b2d9ff tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.040409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04efdcc5-6562-46a1-9746-afc40eb4c051 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:55.041021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04efdcc5-6562-46a1-9746-afc40eb4c051 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:55.049368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04efdcc5-6562-46a1-9746-afc40eb4c051 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.050503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04efdcc5-6562-46a1-9746-afc40eb4c051 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.050952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04efdcc5-6562-46a1-9746-afc40eb4c051 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.051648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04efdcc5-6562-46a1-9746-afc40eb4c051 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.052099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04efdcc5-6562-46a1-9746-afc40eb4c051 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.053134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04efdcc5-6562-46a1-9746-afc40eb4c051 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.134884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8a8c3f59-cbd0-4453-90b4-858365b2d9ff tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:55.143214 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8a8c3f59-cbd0-4453-90b4-858365b2d9ff tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1523 microversion: 2.1 time: 0.385302 Oct 18 13:38:55.158326 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2366/5013] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:54 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:55.168421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aaa4d5fd-b411-4fd3-a16e-3fb772593b59 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:55.169156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aaa4d5fd-b411-4fd3-a16e-3fb772593b59 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:55.179122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaa4d5fd-b411-4fd3-a16e-3fb772593b59 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.180044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaa4d5fd-b411-4fd3-a16e-3fb772593b59 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.180510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaa4d5fd-b411-4fd3-a16e-3fb772593b59 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.181691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaa4d5fd-b411-4fd3-a16e-3fb772593b59 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.182184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaa4d5fd-b411-4fd3-a16e-3fb772593b59 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.183037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaa4d5fd-b411-4fd3-a16e-3fb772593b59 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.210068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:38:55.219750 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-aaa4d5fd-b411-4fd3-a16e-3fb772593b59 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] HTTP exception thrown: Instance is not a member of specified network Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aaa4d5fd-b411-4fd3-a16e-3fb772593b59 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Request method failure captured: Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40/ips/invalid HTTP/1.1 Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqxfT6eAfi2OVq4O2syuiYWoLnSj6qfVvkd40nkHltY85abcmca9e1Ajo10zRUepE2CahQJ3Mj23pFAqeO3SIhRhdqLlrD8e2lSKi59x9YGoVNSUaqBkWRBdloYcSMqzwD1uC0j9_YmW3USm4bjsjRrLYGQ8Kdi9t6ZKZw18yrSW4kk Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 3added60d53241c9ba439247ad0bf32f Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1696675952 Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3added60d53241c9ba439247ad0bf32f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3added60d53241c9ba439247ad0bf32f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3added60d53241c9ba439247ad0bf32f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3added60d53241c9ba439247ad0bf32f"}]}] Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1696675952 Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 3added60d53241c9ba439247ad0bf32f Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1696675952 Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerAddressesNegativeTestJSON-1696675952-project Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: b3500641e62b488c9263533c5341cdbb Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1696675952-project Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance is not a member of specified network Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'server_id': 'c1a877a2-59f3-40aa-9832-709a74af1c40', 'id': 'invalid'} Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 18 13:38:55.224889 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:55.233693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aaa4d5fd-b411-4fd3-a16e-3fb772593b59 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:55.233693 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aaa4d5fd-b411-4fd3-a16e-3fb772593b59 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.062641 Oct 18 13:38:55.233693 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2367/5014] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 13:38:55 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40/ips/invalid => generated 91 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:38:55.242287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-03164fed-04f0-4f9c-b8e5-b9bf7bb09894 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:55.242772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-03164fed-04f0-4f9c-b8e5-b9bf7bb09894 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Failed to fetch instance by id 999 {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 18 13:38:55.243611 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-03164fed-04f0-4f9c-b8e5-b9bf7bb09894 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] HTTP exception thrown: Instance 999 could not be found. Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-03164fed-04f0-4f9c-b8e5-b9bf7bb09894 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Request method failure captured: Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqxfT6eAfi2OVq4O2syuiYWoLnSj6qfVvkd40nkHltY85abcmca9e1Ajo10zRUepE2CahQJ3Mj23pFAqeO3SIhRhdqLlrD8e2lSKi59x9YGoVNSUaqBkWRBdloYcSMqzwD1uC0j9_YmW3USm4bjsjRrLYGQ8Kdi9t6ZKZw18yrSW4kk Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 3added60d53241c9ba439247ad0bf32f Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1696675952 Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3added60d53241c9ba439247ad0bf32f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3added60d53241c9ba439247ad0bf32f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3added60d53241c9ba439247ad0bf32f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3added60d53241c9ba439247ad0bf32f"}]}] Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1696675952 Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 3added60d53241c9ba439247ad0bf32f Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1696675952 Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerAddressesNegativeTestJSON-1696675952-project Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: b3500641e62b488c9263533c5341cdbb Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1696675952-project Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 999 could not be found. Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'server_id': '999'} Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 18 13:38:55.246981 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:55.258078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-03164fed-04f0-4f9c-b8e5-b9bf7bb09894 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:55.258078 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-03164fed-04f0-4f9c-b8e5-b9bf7bb09894 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.012453 Oct 18 13:38:55.258078 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2368/5015] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 18 13:38:55 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:38:55.259748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-07af0b5f-8378-4da3-b7e2-f12a2fd8d054 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:55.260307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-07af0b5f-8378-4da3-b7e2-f12a2fd8d054 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:55.284775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07af0b5f-8378-4da3-b7e2-f12a2fd8d054 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.285629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07af0b5f-8378-4da3-b7e2-f12a2fd8d054 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.286157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07af0b5f-8378-4da3-b7e2-f12a2fd8d054 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.286929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07af0b5f-8378-4da3-b7e2-f12a2fd8d054 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.287391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07af0b5f-8378-4da3-b7e2-f12a2fd8d054 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.287822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07af0b5f-8378-4da3-b7e2-f12a2fd8d054 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.293098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04efdcc5-6562-46a1-9746-afc40eb4c051 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:55.305558 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04efdcc5-6562-46a1-9746-afc40eb4c051 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1516 microversion: 2.1 time: 0.269495 Oct 18 13:38:55.306958 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2648/5016] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:55 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1516 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:55.328090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-07af0b5f-8378-4da3-b7e2-f12a2fd8d054 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:38:55.455149 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-07af0b5f-8378-4da3-b7e2-f12a2fd8d054 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 204 len: 0 microversion: 2.1 time: 0.200085 Oct 18 13:38:55.460736 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2369/5017] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:38:55 2022] DELETE /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:38:55.467777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a5d6bef9-e0d7-47bc-bef7-2e81a8aa8555 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:55.468739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a5d6bef9-e0d7-47bc-bef7-2e81a8aa8555 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:55.479192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5d6bef9-e0d7-47bc-bef7-2e81a8aa8555 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.479835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5d6bef9-e0d7-47bc-bef7-2e81a8aa8555 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.480536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5d6bef9-e0d7-47bc-bef7-2e81a8aa8555 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.482459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5d6bef9-e0d7-47bc-bef7-2e81a8aa8555 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.483005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5d6bef9-e0d7-47bc-bef7-2e81a8aa8555 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.484382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5d6bef9-e0d7-47bc-bef7-2e81a8aa8555 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.498852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-57f43a30-f467-4d35-b937-268520411efc req-6c9589a1-6fec-4dbe-856e-0e9980ebb24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf413a26-7de3-4662-acbf-b8434b9a73b8", "name": "network-vif-deleted", "tag": "76007bfa-6547-4f52-bf60-87e93369b307"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:55.520107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-57f43a30-f467-4d35-b937-268520411efc req-6c9589a1-6fec-4dbe-856e-0e9980ebb24e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:55.522544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-57f43a30-f467-4d35-b937-268520411efc req-6c9589a1-6fec-4dbe-856e-0e9980ebb24e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:55.523990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-57f43a30-f467-4d35-b937-268520411efc req-6c9589a1-6fec-4dbe-856e-0e9980ebb24e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:55.549082 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-57f43a30-f467-4d35-b937-268520411efc req-6c9589a1-6fec-4dbe-856e-0e9980ebb24e service nova] Creating event network-vif-deleted:76007bfa-6547-4f52-bf60-87e93369b307 for instance bf413a26-7de3-4662-acbf-b8434b9a73b8 on n-h2-858384-13 Oct 18 13:38:55.567792 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-57f43a30-f467-4d35-b937-268520411efc req-6c9589a1-6fec-4dbe-856e-0e9980ebb24e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068070 Oct 18 13:38:55.569296 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2370/5018] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:56.093213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a5d6bef9-e0d7-47bc-bef7-2e81a8aa8555 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:56.102864 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a5d6bef9-e0d7-47bc-bef7-2e81a8aa8555 tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1529 microversion: 2.1 time: 0.640941 Oct 18 13:38:56.105219 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2649/5019] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:55 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1529 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:56.330927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0422c1e-c6d7-4b1b-9356-9bf223b0f8ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:56.331624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c0422c1e-c6d7-4b1b-9356-9bf223b0f8ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:56.338104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0422c1e-c6d7-4b1b-9356-9bf223b0f8ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:56.338580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0422c1e-c6d7-4b1b-9356-9bf223b0f8ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:56.339011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0422c1e-c6d7-4b1b-9356-9bf223b0f8ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:56.339727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0422c1e-c6d7-4b1b-9356-9bf223b0f8ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:56.340172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0422c1e-c6d7-4b1b-9356-9bf223b0f8ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:56.340591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0422c1e-c6d7-4b1b-9356-9bf223b0f8ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:56.421976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c0422c1e-c6d7-4b1b-9356-9bf223b0f8ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:56.432954 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c0422c1e-c6d7-4b1b-9356-9bf223b0f8ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 200 len: 1474 microversion: 2.1 time: 0.106451 Oct 18 13:38:56.433991 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2371/5020] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:56 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 1474 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:57.130529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1677ba9c-120a-44c3-ac4d-3d1b89f064bc tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:57.131580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1677ba9c-120a-44c3-ac4d-3d1b89f064bc tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:57.139573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1677ba9c-120a-44c3-ac4d-3d1b89f064bc tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:57.140539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1677ba9c-120a-44c3-ac4d-3d1b89f064bc tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:57.141497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1677ba9c-120a-44c3-ac4d-3d1b89f064bc tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:57.142429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1677ba9c-120a-44c3-ac4d-3d1b89f064bc tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:57.143053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1677ba9c-120a-44c3-ac4d-3d1b89f064bc tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:57.143647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1677ba9c-120a-44c3-ac4d-3d1b89f064bc tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:57.460294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e2991a06-3c29-4d5e-94a6-13476b485a90 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:57.461683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e2991a06-3c29-4d5e-94a6-13476b485a90 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:57.476810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2991a06-3c29-4d5e-94a6-13476b485a90 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:57.480140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2991a06-3c29-4d5e-94a6-13476b485a90 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:57.480911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2991a06-3c29-4d5e-94a6-13476b485a90 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:57.482001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2991a06-3c29-4d5e-94a6-13476b485a90 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:57.482625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2991a06-3c29-4d5e-94a6-13476b485a90 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:57.483235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2991a06-3c29-4d5e-94a6-13476b485a90 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:57.543765 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e2991a06-3c29-4d5e-94a6-13476b485a90 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e2991a06-3c29-4d5e-94a6-13476b485a90 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 HTTP/1.1 Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'bf413a26-7de3-4662-acbf-b8434b9a73b8'} Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:57.545528 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:57.550678 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:57.550678 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:57.550678 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:57.550678 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:57.550678 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:38:57.550678 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:57.550678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e2991a06-3c29-4d5e-94a6-13476b485a90 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:57.550678 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e2991a06-3c29-4d5e-94a6-13476b485a90 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 404 len: 111 microversion: 2.1 time: 0.093722 Oct 18 13:38:57.557685 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2372/5021] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:57 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:38:57.588683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1677ba9c-120a-44c3-ac4d-3d1b89f064bc tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3500641e62b488c9263533c5341cdbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3added60d53241c9ba439247ad0bf32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:57.594810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-aaae4888-977a-4283-b1e0-34de40c8e31b req-e2c739af-ad83-4b5b-b7e3-ad7c84a8c026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a877a2-59f3-40aa-9832-709a74af1c40", "name": "network-vif-deleted", "tag": "801be081-db7a-413b-9a2e-bc8b8d88ca72"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:57.614464 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1677ba9c-120a-44c3-ac4d-3d1b89f064bc tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 200 len: 1529 microversion: 2.1 time: 0.481467 Oct 18 13:38:57.616321 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2650/5022] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:57 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 1529 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:38:57.628440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-aaae4888-977a-4283-b1e0-34de40c8e31b req-e2c739af-ad83-4b5b-b7e3-ad7c84a8c026 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:57.632636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-aaae4888-977a-4283-b1e0-34de40c8e31b req-e2c739af-ad83-4b5b-b7e3-ad7c84a8c026 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:57.633097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-aaae4888-977a-4283-b1e0-34de40c8e31b req-e2c739af-ad83-4b5b-b7e3-ad7c84a8c026 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:57.668096 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-aaae4888-977a-4283-b1e0-34de40c8e31b req-e2c739af-ad83-4b5b-b7e3-ad7c84a8c026 service nova] Creating event network-vif-deleted:801be081-db7a-413b-9a2e-bc8b8d88ca72 for instance c1a877a2-59f3-40aa-9832-709a74af1c40 on n-h2-858384-13 Oct 18 13:38:57.675079 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-aaae4888-977a-4283-b1e0-34de40c8e31b req-e2c739af-ad83-4b5b-b7e3-ad7c84a8c026 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090805 Oct 18 13:38:57.676196 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2373/5023] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:38:57.747721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1255255515", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "aa0d4f33-39e0-4d3f-ab36-9b89248d2552"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:38:57.820001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] validate_networks() for [('aa0d4f33-39e0-4d3f-ab36-9b89248d2552', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:38:58.054703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-85295232-2e80-4d9b-a9ad-bf91d7090843 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:58.055500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-85295232-2e80-4d9b-a9ad-bf91d7090843 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:58.062327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85295232-2e80-4d9b-a9ad-bf91d7090843 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:58.063003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85295232-2e80-4d9b-a9ad-bf91d7090843 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:58.063502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85295232-2e80-4d9b-a9ad-bf91d7090843 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:58.064273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85295232-2e80-4d9b-a9ad-bf91d7090843 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:58.064782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85295232-2e80-4d9b-a9ad-bf91d7090843 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:58.065408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85295232-2e80-4d9b-a9ad-bf91d7090843 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:58.095060 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-85295232-2e80-4d9b-a9ad-bf91d7090843 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/ips" status: 200 len: 151 microversion: 2.20 time: 0.045303 Oct 18 13:38:58.101072 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2374/5024] 10.222.0.40 () {60 vars in 1289 bytes} [Tue Oct 18 13:38:58 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:38:58.643872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a09faa68-7fb8-4ede-abdc-c955a150d6da tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:58.645307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a09faa68-7fb8-4ede-abdc-c955a150d6da tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] [instance: c1a877a2-59f3-40aa-9832-709a74af1c40] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:58.654878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a09faa68-7fb8-4ede-abdc-c955a150d6da tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:58.655367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a09faa68-7fb8-4ede-abdc-c955a150d6da tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:58.655805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a09faa68-7fb8-4ede-abdc-c955a150d6da tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:58.656513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a09faa68-7fb8-4ede-abdc-c955a150d6da tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:58.656970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a09faa68-7fb8-4ede-abdc-c955a150d6da tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:58.657431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a09faa68-7fb8-4ede-abdc-c955a150d6da tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:58.690929 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-a09faa68-7fb8-4ede-abdc-c955a150d6da tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] HTTP exception thrown: Instance c1a877a2-59f3-40aa-9832-709a74af1c40 could not be found. Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a09faa68-7fb8-4ede-abdc-c955a150d6da tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Request method failure captured: Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 HTTP/1.1 Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqxfT6eAfi2OVq4O2syuiYWoLnSj6qfVvkd40nkHltY85abcmca9e1Ajo10zRUepE2CahQJ3Mj23pFAqeO3SIhRhdqLlrD8e2lSKi59x9YGoVNSUaqBkWRBdloYcSMqzwD1uC0j9_YmW3USm4bjsjRrLYGQ8Kdi9t6ZKZw18yrSW4kk Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 3added60d53241c9ba439247ad0bf32f Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1696675952 Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3added60d53241c9ba439247ad0bf32f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3added60d53241c9ba439247ad0bf32f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3added60d53241c9ba439247ad0bf32f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3added60d53241c9ba439247ad0bf32f"}]}] Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1696675952 Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 3added60d53241c9ba439247ad0bf32f Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1696675952 Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerAddressesNegativeTestJSON-1696675952-project Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: b3500641e62b488c9263533c5341cdbb Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1696675952-project Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c1a877a2-59f3-40aa-9832-709a74af1c40 could not be found. Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c1a877a2-59f3-40aa-9832-709a74af1c40'} Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a877a2-59f3-40aa-9832-709a74af1c40 could not be found. Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a877a2-59f3-40aa-9832-709a74af1c40 could not be found. Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.695117 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:38:58.700371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.700371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:38:58.700371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:38:58.700371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:38:58.700371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:38:58.700371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:38:58.700371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a877a2-59f3-40aa-9832-709a74af1c40 could not be found. Oct 18 13:38:58.700371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:38:58.704804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a09faa68-7fb8-4ede-abdc-c955a150d6da tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] Returning 404 to user: Instance c1a877a2-59f3-40aa-9832-709a74af1c40 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:38:58.718467 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a09faa68-7fb8-4ede-abdc-c955a150d6da tempest-ServerAddressesNegativeTestJSON-1696675952 tempest-ServerAddressesNegativeTestJSON-1696675952-project] 10.222.0.40 "GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40" status: 404 len: 111 microversion: 2.1 time: 0.078347 Oct 18 13:38:58.719809 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2375/5025] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:58 2022] GET /compute/v2.1/servers/c1a877a2-59f3-40aa-9832-709a74af1c40 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:38:58.866499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:38:58.867548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:38:58.868115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:38:58.868538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:38:58.868958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:38:58.887451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:58.890819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:58.891495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:58.892675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:38:58.893154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:38:58.893618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:38:58.936572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:38:58.951949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Getting quotas for user a4856dd5667c4f10aa9ff1ccb1788cc8 and project aa140485af954b1a8c83651a5d122a1a. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:38:58.968684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:38:58.971761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:38:59.047534 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bf7f9f84-1d9c-469e-867e-53b1b8d5b659 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.312811 Oct 18 13:38:59.057036 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2651/5026] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:38:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:38:59.061790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-49d4d388-1e89-4bd6-8b66-042a28d975e0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:38:59.062700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-49d4d388-1e89-4bd6-8b66-042a28d975e0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:38:59.286388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-49d4d388-1e89-4bd6-8b66-042a28d975e0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:38:59.296660 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-49d4d388-1e89-4bd6-8b66-042a28d975e0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1209 microversion: 2.1 time: 0.237340 Oct 18 13:38:59.316963 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2376/5027] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:38:59 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1209 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:00.325962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-323e842f-75ea-4269-9abd-00eb6deb7090 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:00.326697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-323e842f-75ea-4269-9abd-00eb6deb7090 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:00.346126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-323e842f-75ea-4269-9abd-00eb6deb7090 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:00.346943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-323e842f-75ea-4269-9abd-00eb6deb7090 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:00.347601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-323e842f-75ea-4269-9abd-00eb6deb7090 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:00.348539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-323e842f-75ea-4269-9abd-00eb6deb7090 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:00.349942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-323e842f-75ea-4269-9abd-00eb6deb7090 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:00.350602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-323e842f-75ea-4269-9abd-00eb6deb7090 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:00.487580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-323e842f-75ea-4269-9abd-00eb6deb7090 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:00.501719 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-323e842f-75ea-4269-9abd-00eb6deb7090 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1205 microversion: 2.1 time: 0.180686 Oct 18 13:39:00.520455 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2652/5028] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:00 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1205 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:01.193789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d95ddeb-e769-4f03-9d8e-09c2e90caec6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:01.195086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4d95ddeb-e769-4f03-9d8e-09c2e90caec6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:01.219361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d95ddeb-e769-4f03-9d8e-09c2e90caec6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:01.220196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d95ddeb-e769-4f03-9d8e-09c2e90caec6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:01.220642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d95ddeb-e769-4f03-9d8e-09c2e90caec6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:01.221414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d95ddeb-e769-4f03-9d8e-09c2e90caec6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:01.221880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d95ddeb-e769-4f03-9d8e-09c2e90caec6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:01.222313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d95ddeb-e769-4f03-9d8e-09c2e90caec6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:01.276065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-4d95ddeb-e769-4f03-9d8e-09c2e90caec6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lazy-loading 'flavor' on Instance uuid 31c5c389-b7a1-4170-9b5c-321066d048e1 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:39:01.541387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-45b15f7a-dba0-4ba9-aa53-14385c169123 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:01.542961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-45b15f7a-dba0-4ba9-aa53-14385c169123 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:01.566055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45b15f7a-dba0-4ba9-aa53-14385c169123 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:01.572657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45b15f7a-dba0-4ba9-aa53-14385c169123 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:01.577631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45b15f7a-dba0-4ba9-aa53-14385c169123 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:01.578386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45b15f7a-dba0-4ba9-aa53-14385c169123 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:01.578847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45b15f7a-dba0-4ba9-aa53-14385c169123 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:01.580164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45b15f7a-dba0-4ba9-aa53-14385c169123 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:01.716107 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d95ddeb-e769-4f03-9d8e-09c2e90caec6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "POST /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/action" status: 202 len: 0 microversion: 2.20 time: 0.528782 Oct 18 13:39:01.716735 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2377/5029] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:39:01 2022] POST /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:39:01.729695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-356956c2-fdd7-473b-ae1b-8010f0daebd9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:01.734527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-356956c2-fdd7-473b-ae1b-8010f0daebd9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:01.757133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-45b15f7a-dba0-4ba9-aa53-14385c169123 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:01.766191 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-45b15f7a-dba0-4ba9-aa53-14385c169123 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1267 microversion: 2.1 time: 0.233298 Oct 18 13:39:01.769940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-356956c2-fdd7-473b-ae1b-8010f0daebd9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:01.771853 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2653/5030] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:01 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:01.772629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-356956c2-fdd7-473b-ae1b-8010f0daebd9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:01.773431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-356956c2-fdd7-473b-ae1b-8010f0daebd9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:01.774600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-356956c2-fdd7-473b-ae1b-8010f0daebd9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:01.775311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-356956c2-fdd7-473b-ae1b-8010f0daebd9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:01.776019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-356956c2-fdd7-473b-ae1b-8010f0daebd9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:02.360908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-356956c2-fdd7-473b-ae1b-8010f0daebd9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:02.374945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-356956c2-fdd7-473b-ae1b-8010f0daebd9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:02.382053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-356956c2-fdd7-473b-ae1b-8010f0daebd9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:02.387992 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-356956c2-fdd7-473b-ae1b-8010f0daebd9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1722 microversion: 2.20 time: 0.665351 Oct 18 13:39:02.388607 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2378/5031] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:01 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1722 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:02.796487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-51be2283-8409-4854-b16b-4841d479f10f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:02.797118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-51be2283-8409-4854-b16b-4841d479f10f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:02.811341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51be2283-8409-4854-b16b-4841d479f10f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:02.812370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51be2283-8409-4854-b16b-4841d479f10f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:02.814688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51be2283-8409-4854-b16b-4841d479f10f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:02.817169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51be2283-8409-4854-b16b-4841d479f10f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:02.818854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51be2283-8409-4854-b16b-4841d479f10f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:02.819997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51be2283-8409-4854-b16b-4841d479f10f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:02.981727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-51be2283-8409-4854-b16b-4841d479f10f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:02.994743 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-51be2283-8409-4854-b16b-4841d479f10f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1267 microversion: 2.1 time: 0.203671 Oct 18 13:39:02.996202 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2654/5032] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:02 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:03.420087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-393fd9e7-23c2-42ec-9096-6e01f40d3b9e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:03.421958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-393fd9e7-23c2-42ec-9096-6e01f40d3b9e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:03.441104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:03.446545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-393fd9e7-23c2-42ec-9096-6e01f40d3b9e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:03.448713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-393fd9e7-23c2-42ec-9096-6e01f40d3b9e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:03.451281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-393fd9e7-23c2-42ec-9096-6e01f40d3b9e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:03.452657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-393fd9e7-23c2-42ec-9096-6e01f40d3b9e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:03.457787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-393fd9e7-23c2-42ec-9096-6e01f40d3b9e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:03.459410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-393fd9e7-23c2-42ec-9096-6e01f40d3b9e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:04.024231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0a6a646f-89de-42b1-8fed-664ab5fa4f92 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:04.025534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0a6a646f-89de-42b1-8fed-664ab5fa4f92 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:04.049964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a6a646f-89de-42b1-8fed-664ab5fa4f92 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:04.050577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a6a646f-89de-42b1-8fed-664ab5fa4f92 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:04.051217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a6a646f-89de-42b1-8fed-664ab5fa4f92 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:04.053093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a6a646f-89de-42b1-8fed-664ab5fa4f92 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:04.053678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a6a646f-89de-42b1-8fed-664ab5fa4f92 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:04.055277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a6a646f-89de-42b1-8fed-664ab5fa4f92 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:04.158560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0a6a646f-89de-42b1-8fed-664ab5fa4f92 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:04.168220 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0a6a646f-89de-42b1-8fed-664ab5fa4f92 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1267 microversion: 2.1 time: 0.148326 Oct 18 13:39:04.169869 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2655/5033] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:04 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:04.293804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-393fd9e7-23c2-42ec-9096-6e01f40d3b9e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:04.308358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-393fd9e7-23c2-42ec-9096-6e01f40d3b9e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:04.316261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-393fd9e7-23c2-42ec-9096-6e01f40d3b9e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:04.320055 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-393fd9e7-23c2-42ec-9096-6e01f40d3b9e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1722 microversion: 2.20 time: 0.905377 Oct 18 13:39:04.321724 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2379/5034] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:03 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1722 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:05.193913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2bbd3973-e760-44f7-b4dd-7b87c8f3c0b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:05.195303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2bbd3973-e760-44f7-b4dd-7b87c8f3c0b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:05.204825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bbd3973-e760-44f7-b4dd-7b87c8f3c0b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:05.205810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bbd3973-e760-44f7-b4dd-7b87c8f3c0b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:05.206515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bbd3973-e760-44f7-b4dd-7b87c8f3c0b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:05.207860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bbd3973-e760-44f7-b4dd-7b87c8f3c0b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:05.208573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bbd3973-e760-44f7-b4dd-7b87c8f3c0b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:05.209635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bbd3973-e760-44f7-b4dd-7b87c8f3c0b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:05.346992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5c554097-6be2-46a5-8149-348e26468b77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:05.348398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5c554097-6be2-46a5-8149-348e26468b77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:05.361724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c554097-6be2-46a5-8149-348e26468b77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:05.370148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c554097-6be2-46a5-8149-348e26468b77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:05.373119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c554097-6be2-46a5-8149-348e26468b77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:05.374465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c554097-6be2-46a5-8149-348e26468b77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:05.375099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c554097-6be2-46a5-8149-348e26468b77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:05.376320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c554097-6be2-46a5-8149-348e26468b77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:05.511230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2bbd3973-e760-44f7-b4dd-7b87c8f3c0b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:05.522455 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2bbd3973-e760-44f7-b4dd-7b87c8f3c0b7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1309 microversion: 2.1 time: 0.330821 Oct 18 13:39:05.525105 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2656/5035] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:05 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:06.187155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5c554097-6be2-46a5-8149-348e26468b77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:06.199508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5c554097-6be2-46a5-8149-348e26468b77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:06.200969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5c554097-6be2-46a5-8149-348e26468b77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:06.202228 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5c554097-6be2-46a5-8149-348e26468b77 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1722 microversion: 2.20 time: 0.859352 Oct 18 13:39:06.209456 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2380/5036] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:05 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1722 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:06.550879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bb63ebf7-9b61-46ee-887a-7b34e8c955a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:06.551628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bb63ebf7-9b61-46ee-887a-7b34e8c955a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:06.567325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb63ebf7-9b61-46ee-887a-7b34e8c955a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:06.568267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb63ebf7-9b61-46ee-887a-7b34e8c955a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:06.569561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb63ebf7-9b61-46ee-887a-7b34e8c955a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:06.571470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb63ebf7-9b61-46ee-887a-7b34e8c955a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:06.573681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb63ebf7-9b61-46ee-887a-7b34e8c955a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:06.574253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb63ebf7-9b61-46ee-887a-7b34e8c955a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:06.654651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:07.031798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bb63ebf7-9b61-46ee-887a-7b34e8c955a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:07.048872 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bb63ebf7-9b61-46ee-887a-7b34e8c955a5 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1309 microversion: 2.1 time: 0.500543 Oct 18 13:39:07.073497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-fffcab41-d2e4-40c2-a462-d16929c66cb1 req-53b35479-70e2-4c16-9fc7-9a742e249c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a865aaeb-2ccf-4e3b-8173-3cecee1686ca", "tag": "5dfedc45-3aa3-41f1-aab3-0bd985a2297a"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:07.074230 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2657/5037] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:06 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1309 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:07.108351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fffcab41-d2e4-40c2-a462-d16929c66cb1 req-53b35479-70e2-4c16-9fc7-9a742e249c0c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:07.108969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fffcab41-d2e4-40c2-a462-d16929c66cb1 req-53b35479-70e2-4c16-9fc7-9a742e249c0c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:07.109297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fffcab41-d2e4-40c2-a462-d16929c66cb1 req-53b35479-70e2-4c16-9fc7-9a742e249c0c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:07.136252 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-fffcab41-d2e4-40c2-a462-d16929c66cb1 req-53b35479-70e2-4c16-9fc7-9a742e249c0c service nova] Creating event network-changed:5dfedc45-3aa3-41f1-aab3-0bd985a2297a for instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca on n-h2-858384-13 Oct 18 13:39:07.142506 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-fffcab41-d2e4-40c2-a462-d16929c66cb1 req-53b35479-70e2-4c16-9fc7-9a742e249c0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081573 Oct 18 13:39:07.143767 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2381/5038] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:07.233942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-01eede11-3403-4f92-a8fe-c43243a17a18 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:07.234959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-01eede11-3403-4f92-a8fe-c43243a17a18 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:07.248407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01eede11-3403-4f92-a8fe-c43243a17a18 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:07.249361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01eede11-3403-4f92-a8fe-c43243a17a18 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:07.249972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01eede11-3403-4f92-a8fe-c43243a17a18 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:07.251049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01eede11-3403-4f92-a8fe-c43243a17a18 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:07.252013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01eede11-3403-4f92-a8fe-c43243a17a18 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:07.252726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01eede11-3403-4f92-a8fe-c43243a17a18 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:07.420190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-df935958-59db-49ff-90de-15291b6e1be6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Action: 'create', calling method: .version_select at 0x7ff60ef58550>, body: {"keypair": {"name": "tempest-keypair-1331111645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBe++rWk2XRbYO8gXwtIjbsRVmFyDvHG62BmxN6giTA4QEHfjBjaBAWrG5+QQ+pywquIjisr741TLCFOysAu8WtWVO8xgayihN1gRo0zyxQGquZRE6921HBZAB4y06ZcKQ=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:07.442267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:07.449849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=21 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:07.451693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-df935958-59db-49ff-90de-15291b6e1be6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Getting quotas for project f983dc605d28409f93a8f4234519773c. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:39:07.464900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-df935958-59db-49ff-90de-15291b6e1be6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Getting quotas for user b4bf03bdfd0e4cecb7e90ca3c7c97ad4 and project f983dc605d28409f93a8f4234519773c. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:39:07.504331 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-df935958-59db-49ff-90de-15291b6e1be6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.316180 Oct 18 13:39:07.512381 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2658/5039] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:39:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:07.610539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-01eede11-3403-4f92-a8fe-c43243a17a18 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:07.625879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-01eede11-3403-4f92-a8fe-c43243a17a18 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:07.627647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-01eede11-3403-4f92-a8fe-c43243a17a18 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:07.629796 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-01eede11-3403-4f92-a8fe-c43243a17a18 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1722 microversion: 2.20 time: 0.400954 Oct 18 13:39:07.631725 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2382/5040] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:07 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1722 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:39:08.097830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7be5be0a-c6ea-4501-b545-6b40977d3798 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:08.098554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7be5be0a-c6ea-4501-b545-6b40977d3798 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:08.119320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7be5be0a-c6ea-4501-b545-6b40977d3798 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:08.119833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7be5be0a-c6ea-4501-b545-6b40977d3798 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:08.120417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7be5be0a-c6ea-4501-b545-6b40977d3798 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:08.121272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7be5be0a-c6ea-4501-b545-6b40977d3798 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:08.121729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7be5be0a-c6ea-4501-b545-6b40977d3798 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:08.122286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7be5be0a-c6ea-4501-b545-6b40977d3798 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:08.349957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7be5be0a-c6ea-4501-b545-6b40977d3798 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:08.361050 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7be5be0a-c6ea-4501-b545-6b40977d3798 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1309 microversion: 2.1 time: 0.278084 Oct 18 13:39:08.376547 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2659/5041] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:08 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:08.658416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9eaa993f-5d4b-454a-8d00-33d7e5fd914e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:08.659157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9eaa993f-5d4b-454a-8d00-33d7e5fd914e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:08.666608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eaa993f-5d4b-454a-8d00-33d7e5fd914e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:08.667561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eaa993f-5d4b-454a-8d00-33d7e5fd914e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:08.668160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eaa993f-5d4b-454a-8d00-33d7e5fd914e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:08.669036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eaa993f-5d4b-454a-8d00-33d7e5fd914e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:08.669921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eaa993f-5d4b-454a-8d00-33d7e5fd914e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:08.670518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eaa993f-5d4b-454a-8d00-33d7e5fd914e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:09.294856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:09.385718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9eaa993f-5d4b-454a-8d00-33d7e5fd914e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:09.394808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-282f4c83-8bee-49bc-a146-3cbd3185f3aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:09.396779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-282f4c83-8bee-49bc-a146-3cbd3185f3aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:09.411731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:09.422145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9eaa993f-5d4b-454a-8d00-33d7e5fd914e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:09.423629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9eaa993f-5d4b-454a-8d00-33d7e5fd914e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:09.424868 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9eaa993f-5d4b-454a-8d00-33d7e5fd914e tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1722 microversion: 2.20 time: 0.771305 Oct 18 13:39:09.433860 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2383/5042] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:08 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1722 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:09.437825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-282f4c83-8bee-49bc-a146-3cbd3185f3aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:09.438320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-282f4c83-8bee-49bc-a146-3cbd3185f3aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:09.438756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-282f4c83-8bee-49bc-a146-3cbd3185f3aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:09.439455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-282f4c83-8bee-49bc-a146-3cbd3185f3aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:09.440074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-282f4c83-8bee-49bc-a146-3cbd3185f3aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:09.446536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-282f4c83-8bee-49bc-a146-3cbd3185f3aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:09.771990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-282f4c83-8bee-49bc-a146-3cbd3185f3aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:09.799782 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-282f4c83-8bee-49bc-a146-3cbd3185f3aa tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1309 microversion: 2.1 time: 0.419397 Oct 18 13:39:09.801018 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2660/5043] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:09 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1309 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:10.456468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5bca3cd1-2d25-4f7b-852a-2b486ebd3006 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:10.457095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5bca3cd1-2d25-4f7b-852a-2b486ebd3006 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:10.490361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bca3cd1-2d25-4f7b-852a-2b486ebd3006 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:10.492164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bca3cd1-2d25-4f7b-852a-2b486ebd3006 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:10.494614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bca3cd1-2d25-4f7b-852a-2b486ebd3006 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:10.497257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bca3cd1-2d25-4f7b-852a-2b486ebd3006 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:10.500570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bca3cd1-2d25-4f7b-852a-2b486ebd3006 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:10.501274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bca3cd1-2d25-4f7b-852a-2b486ebd3006 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:10.826101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f440fc2-e20e-4f6d-ac8a-ec3870591526 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:10.827396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9f440fc2-e20e-4f6d-ac8a-ec3870591526 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:10.837767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f440fc2-e20e-4f6d-ac8a-ec3870591526 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:10.841254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f440fc2-e20e-4f6d-ac8a-ec3870591526 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:10.841924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f440fc2-e20e-4f6d-ac8a-ec3870591526 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:10.844795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f440fc2-e20e-4f6d-ac8a-ec3870591526 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:10.845660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f440fc2-e20e-4f6d-ac8a-ec3870591526 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:10.848799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f440fc2-e20e-4f6d-ac8a-ec3870591526 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:10.960524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5bca3cd1-2d25-4f7b-852a-2b486ebd3006 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:10.982914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5bca3cd1-2d25-4f7b-852a-2b486ebd3006 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:10.984739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5bca3cd1-2d25-4f7b-852a-2b486ebd3006 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:10.986418 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5bca3cd1-2d25-4f7b-852a-2b486ebd3006 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1722 microversion: 2.20 time: 0.534044 Oct 18 13:39:10.987832 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2384/5044] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:10 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1722 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:11.219421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9f440fc2-e20e-4f6d-ac8a-ec3870591526 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:11.235135 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9f440fc2-e20e-4f6d-ac8a-ec3870591526 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1309 microversion: 2.1 time: 0.413661 Oct 18 13:39:11.245513 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2661/5045] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:10 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1309 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:11.748498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1ff117f2-d41f-4523-9691-5dd218c29e0e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:11.755876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1ff117f2-d41f-4523-9691-5dd218c29e0e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:11.774761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ff117f2-d41f-4523-9691-5dd218c29e0e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:11.775262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ff117f2-d41f-4523-9691-5dd218c29e0e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:11.775770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ff117f2-d41f-4523-9691-5dd218c29e0e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:11.776489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ff117f2-d41f-4523-9691-5dd218c29e0e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:11.776950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ff117f2-d41f-4523-9691-5dd218c29e0e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:11.777423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ff117f2-d41f-4523-9691-5dd218c29e0e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:12.020711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d2771bbd-fd76-4059-9fbf-837384c23425 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:12.021440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d2771bbd-fd76-4059-9fbf-837384c23425 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:12.039859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2771bbd-fd76-4059-9fbf-837384c23425 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:12.040051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-1ff117f2-d41f-4523-9691-5dd218c29e0e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lazy-loading 'services' on Instance uuid fbff40e9-4767-4d10-9f02-2777d80dca4b {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:39:12.040295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2771bbd-fd76-4059-9fbf-837384c23425 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:12.040755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2771bbd-fd76-4059-9fbf-837384c23425 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:12.043872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2771bbd-fd76-4059-9fbf-837384c23425 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:12.044371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2771bbd-fd76-4059-9fbf-837384c23425 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:12.045940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2771bbd-fd76-4059-9fbf-837384c23425 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:12.211481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:12.236853 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1ff117f2-d41f-4523-9691-5dd218c29e0e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/os-volume_attachments/27047369-c2b6-4b04-a83f-7cc688803036" status: 202 len: 0 microversion: 2.1 time: 0.496526 Oct 18 13:39:12.239623 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2385/5046] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:39:11 2022] DELETE /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/os-volume_attachments/27047369-c2b6-4b04-a83f-7cc688803036 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:39:12.276476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-15fcffac-b8a3-4314-bd77-9104335c864b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:12.278874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-15fcffac-b8a3-4314-bd77-9104335c864b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:12.297438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15fcffac-b8a3-4314-bd77-9104335c864b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:12.304362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15fcffac-b8a3-4314-bd77-9104335c864b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:12.305761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15fcffac-b8a3-4314-bd77-9104335c864b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:12.308343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15fcffac-b8a3-4314-bd77-9104335c864b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:12.309852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15fcffac-b8a3-4314-bd77-9104335c864b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:12.311061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15fcffac-b8a3-4314-bd77-9104335c864b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:12.413728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d2771bbd-fd76-4059-9fbf-837384c23425 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:12.426630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d2771bbd-fd76-4059-9fbf-837384c23425 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:12.430961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d2771bbd-fd76-4059-9fbf-837384c23425 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:12.435466 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d2771bbd-fd76-4059-9fbf-837384c23425 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1722 microversion: 2.20 time: 0.420944 Oct 18 13:39:12.437202 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2662/5047] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:12 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1722 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:39:12.765459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-15fcffac-b8a3-4314-bd77-9104335c864b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:12.778997 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-15fcffac-b8a3-4314-bd77-9104335c864b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1309 microversion: 2.1 time: 0.516242 Oct 18 13:39:12.783213 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2386/5048] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:12 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1309 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:13.466272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2a8e9eaa-62a1-4d9c-81b6-0c6936ed81c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:13.467602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2a8e9eaa-62a1-4d9c-81b6-0c6936ed81c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:13.482805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a8e9eaa-62a1-4d9c-81b6-0c6936ed81c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.485630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a8e9eaa-62a1-4d9c-81b6-0c6936ed81c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.486933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a8e9eaa-62a1-4d9c-81b6-0c6936ed81c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.490779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a8e9eaa-62a1-4d9c-81b6-0c6936ed81c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.491277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a8e9eaa-62a1-4d9c-81b6-0c6936ed81c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.491724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a8e9eaa-62a1-4d9c-81b6-0c6936ed81c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.810359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c9d4872b-2c11-40c0-a8da-5114c4ce05db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:13.814378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c9d4872b-2c11-40c0-a8da-5114c4ce05db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:13.844744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d4872b-2c11-40c0-a8da-5114c4ce05db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.845317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d4872b-2c11-40c0-a8da-5114c4ce05db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.848872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d4872b-2c11-40c0-a8da-5114c4ce05db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:13.852437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d4872b-2c11-40c0-a8da-5114c4ce05db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:13.852938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d4872b-2c11-40c0-a8da-5114c4ce05db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:13.853414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9d4872b-2c11-40c0-a8da-5114c4ce05db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:14.075033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a8e9eaa-62a1-4d9c-81b6-0c6936ed81c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:14.086098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a8e9eaa-62a1-4d9c-81b6-0c6936ed81c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:14.097409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a8e9eaa-62a1-4d9c-81b6-0c6936ed81c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:14.107616 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2a8e9eaa-62a1-4d9c-81b6-0c6936ed81c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1743 microversion: 2.20 time: 0.646764 Oct 18 13:39:14.126669 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2663/5049] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:13 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1743 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:14.525172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c9d4872b-2c11-40c0-a8da-5114c4ce05db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:14.542428 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c9d4872b-2c11-40c0-a8da-5114c4ce05db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1309 microversion: 2.1 time: 0.741905 Oct 18 13:39:14.546428 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2387/5050] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:13 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1309 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:15.130465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-72e4a021-95e8-435b-b624-5e01437caa57 req-130608ed-2e9a-4e61-aed6-bb605cd6a2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a865aaeb-2ccf-4e3b-8173-3cecee1686ca", "name": "network-vif-plugged", "status": "completed", "tag": "5dfedc45-3aa3-41f1-aab3-0bd985a2297a"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:15.145643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c3aeb51f-2502-44f6-8975-06ee25599eba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:15.146568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c3aeb51f-2502-44f6-8975-06ee25599eba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:15.152015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-72e4a021-95e8-435b-b624-5e01437caa57 req-130608ed-2e9a-4e61-aed6-bb605cd6a2b8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:15.154164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-72e4a021-95e8-435b-b624-5e01437caa57 req-130608ed-2e9a-4e61-aed6-bb605cd6a2b8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:15.157675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-72e4a021-95e8-435b-b624-5e01437caa57 req-130608ed-2e9a-4e61-aed6-bb605cd6a2b8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:15.170703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3aeb51f-2502-44f6-8975-06ee25599eba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:15.172987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3aeb51f-2502-44f6-8975-06ee25599eba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:15.179228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3aeb51f-2502-44f6-8975-06ee25599eba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:15.180063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3aeb51f-2502-44f6-8975-06ee25599eba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:15.180552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3aeb51f-2502-44f6-8975-06ee25599eba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:15.189731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3aeb51f-2502-44f6-8975-06ee25599eba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:15.204748 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-72e4a021-95e8-435b-b624-5e01437caa57 req-130608ed-2e9a-4e61-aed6-bb605cd6a2b8 service nova] Creating event network-vif-plugged:5dfedc45-3aa3-41f1-aab3-0bd985a2297a for instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca on n-h2-858384-13 Oct 18 13:39:15.214888 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-72e4a021-95e8-435b-b624-5e01437caa57 req-130608ed-2e9a-4e61-aed6-bb605cd6a2b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086489 Oct 18 13:39:15.216548 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2664/5051] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:15.572453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c8d9f157-bbd6-4009-a71e-517a3049f4ac tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:15.573165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c8d9f157-bbd6-4009-a71e-517a3049f4ac tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:15.586022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8d9f157-bbd6-4009-a71e-517a3049f4ac tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:15.588732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8d9f157-bbd6-4009-a71e-517a3049f4ac tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:15.594806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8d9f157-bbd6-4009-a71e-517a3049f4ac tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:15.596266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8d9f157-bbd6-4009-a71e-517a3049f4ac tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:15.596916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8d9f157-bbd6-4009-a71e-517a3049f4ac tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:15.597831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8d9f157-bbd6-4009-a71e-517a3049f4ac tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:15.638130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3aeb51f-2502-44f6-8975-06ee25599eba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:15.648020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3aeb51f-2502-44f6-8975-06ee25599eba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:15.657394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3aeb51f-2502-44f6-8975-06ee25599eba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:15.659858 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c3aeb51f-2502-44f6-8975-06ee25599eba tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1743 microversion: 2.20 time: 0.519720 Oct 18 13:39:15.665902 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2388/5052] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:15 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1743 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:39:16.074618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c8d9f157-bbd6-4009-a71e-517a3049f4ac tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:16.087363 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c8d9f157-bbd6-4009-a71e-517a3049f4ac tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1309 microversion: 2.1 time: 0.520222 Oct 18 13:39:16.090879 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2665/5053] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:15 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1309 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:16.695645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-213bcb1c-6836-48e8-b00e-0aa6ca661c37 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:16.696559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-213bcb1c-6836-48e8-b00e-0aa6ca661c37 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:16.699655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:16.712885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-213bcb1c-6836-48e8-b00e-0aa6ca661c37 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:16.714757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-213bcb1c-6836-48e8-b00e-0aa6ca661c37 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:16.716578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-213bcb1c-6836-48e8-b00e-0aa6ca661c37 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:16.718251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-213bcb1c-6836-48e8-b00e-0aa6ca661c37 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:16.720684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-213bcb1c-6836-48e8-b00e-0aa6ca661c37 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:16.723422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-213bcb1c-6836-48e8-b00e-0aa6ca661c37 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:17.122960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8fc88c7-a64f-429c-bd4d-86af7756251b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:17.124131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8fc88c7-a64f-429c-bd4d-86af7756251b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:17.144300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8fc88c7-a64f-429c-bd4d-86af7756251b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:17.144814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8fc88c7-a64f-429c-bd4d-86af7756251b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:17.145431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8fc88c7-a64f-429c-bd4d-86af7756251b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:17.146821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8fc88c7-a64f-429c-bd4d-86af7756251b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:17.147542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8fc88c7-a64f-429c-bd4d-86af7756251b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:17.157067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8fc88c7-a64f-429c-bd4d-86af7756251b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:17.330932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-213bcb1c-6836-48e8-b00e-0aa6ca661c37 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:17.344291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-213bcb1c-6836-48e8-b00e-0aa6ca661c37 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:17.347901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-213bcb1c-6836-48e8-b00e-0aa6ca661c37 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:17.352360 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-213bcb1c-6836-48e8-b00e-0aa6ca661c37 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1743 microversion: 2.20 time: 0.661206 Oct 18 13:39:17.357513 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2389/5054] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:16 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1743 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:17.481013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:17.632991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b8fc88c7-a64f-429c-bd4d-86af7756251b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:17.649025 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8fc88c7-a64f-429c-bd4d-86af7756251b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1309 microversion: 2.1 time: 0.523483 Oct 18 13:39:17.654062 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2666/5055] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:17 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1309 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:18.218743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d1d02ff1-cda3-4eb0-bc33-28ba5cc32a22 tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] Action: 'create', calling method: .version_select at 0x7ff60e763670>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:18.261587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-d1d02ff1-cda3-4eb0-bc33-28ba5cc32a22 tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] Getting quotas for project 623e9f39e16a4326a2cf4250382fd7ba. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:39:18.286588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-d1d02ff1-cda3-4eb0-bc33-28ba5cc32a22 tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] Getting quotas for user ecdbe93baaf84380a8d8fed5b04857b9 and project 623e9f39e16a4326a2cf4250382fd7ba. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:39:18.376454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-d1d02ff1-cda3-4eb0-bc33-28ba5cc32a22 tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] Getting quotas for project 623e9f39e16a4326a2cf4250382fd7ba. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:39:18.383556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ebe05985-8b4e-47a7-90a9-4345b07f558d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:18.385082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ebe05985-8b4e-47a7-90a9-4345b07f558d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:18.399823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebe05985-8b4e-47a7-90a9-4345b07f558d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:18.401808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-d1d02ff1-cda3-4eb0-bc33-28ba5cc32a22 tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] Getting quotas for user ecdbe93baaf84380a8d8fed5b04857b9 and project 623e9f39e16a4326a2cf4250382fd7ba. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:39:18.402210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebe05985-8b4e-47a7-90a9-4345b07f558d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:18.403806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebe05985-8b4e-47a7-90a9-4345b07f558d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:18.407725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebe05985-8b4e-47a7-90a9-4345b07f558d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:18.408705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebe05985-8b4e-47a7-90a9-4345b07f558d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:18.409418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebe05985-8b4e-47a7-90a9-4345b07f558d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:18.441770 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d1d02ff1-cda3-4eb0-bc33-28ba5cc32a22 tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.344963 Oct 18 13:39:18.453565 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2390/5056] 10.222.0.40 () {62 vars in 1214 bytes} [Tue Oct 18 13:39:18 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:39:18.462098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c3256919-a237-4163-8b70-226f3ff815d7 tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:18.489172 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c3256919-a237-4163-8b70-226f3ff815d7 tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.033799 Oct 18 13:39:18.492092 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2391/5057] 10.222.0.40 () {60 vars in 1193 bytes} [Tue Oct 18 13:39:18 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:39:18.503722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-601a9fbc-ae00-43e2-93d9-39dcdc8c90d4 tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:18.525584 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-601a9fbc-ae00-43e2-93d9-39dcdc8c90d4 tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/84aef3b8-dfdb-4d27-86e8-ff21ce4c08be" status: 200 len: 235 microversion: 2.64 time: 0.026165 Oct 18 13:39:18.526486 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2392/5058] 10.222.0.40 () {60 vars in 1304 bytes} [Tue Oct 18 13:39:18 2022] GET /compute/v2.1/os-server-groups/84aef3b8-dfdb-4d27-86e8-ff21ce4c08be => generated 235 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:39:18.538510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bc9d9e8e-9b16-4a8c-954a-5b2c3db7a914 tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:18.606630 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bc9d9e8e-9b16-4a8c-954a-5b2c3db7a914 tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/84aef3b8-dfdb-4d27-86e8-ff21ce4c08be" status: 204 len: 0 microversion: 2.64 time: 0.072624 Oct 18 13:39:18.607892 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2393/5059] 10.222.0.40 () {60 vars in 1307 bytes} [Tue Oct 18 13:39:18 2022] DELETE /compute/v2.1/os-server-groups/84aef3b8-dfdb-4d27-86e8-ff21ce4c08be => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 18 13:39:18.617386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c5fbb70f-5b67-4bd0-9ee4-98c16c03c10a tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:18.630966 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-c5fbb70f-5b67-4bd0-9ee4-98c16c03c10a tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] HTTP exception thrown: Instance group 84aef3b8-dfdb-4d27-86e8-ff21ce4c08be could not be found. Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c5fbb70f-5b67-4bd0-9ee4-98c16c03c10a tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] Request method failure captured: Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-server-groups/84aef3b8-dfdb-4d27-86e8-ff21ce4c08be HTTP/1.1 Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqyFq-wGTYgYDwEZRtPgy12f0Biz0CTjoYC0vGN5hD4VWaBuUbSgrfpt28qB9qWa58bjI4HexAX5s6W--aaQnfKObIDsQ-l6bxTN-GXmBH2dKufs_ITYpmQEnSiEgIlcZAzMEwWUEaJml3UmAD6PKSNwvAkOgCf2SjLd9GE1ZNs0XGc Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.64 Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 623e9f39e16a4326a2cf4250382fd7ba Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerGroup264TestJSON-631266660 Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/623e9f39e16a4326a2cf4250382fd7ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/623e9f39e16a4326a2cf4250382fd7ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/623e9f39e16a4326a2cf4250382fd7ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_623e9f39e16a4326a2cf4250382fd7ba"}]}] Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerGroup264TestJSON-631266660 Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 623e9f39e16a4326a2cf4250382fd7ba Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerGroup264TestJSON-631266660 Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerGroup264TestJSON-631266660-project Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: ecdbe93baaf84380a8d8fed5b04857b9 Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerGroup264TestJSON-631266660-project Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance group 84aef3b8-dfdb-4d27-86e8-ff21ce4c08be could not be found. Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '84aef3b8-dfdb-4d27-86e8-ff21ce4c08be'} Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 84aef3b8-dfdb-4d27-86e8-ff21ce4c08be could not be found. Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 84aef3b8-dfdb-4d27-86e8-ff21ce4c08be could not be found. Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:18.645023 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:18.649731 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:18.649731 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:18.649731 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:18.649731 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:18.649731 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 84aef3b8-dfdb-4d27-86e8-ff21ce4c08be could not be found. Oct 18 13:39:18.649731 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:18.651005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ebe05985-8b4e-47a7-90a9-4345b07f558d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:18.651999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c5fbb70f-5b67-4bd0-9ee4-98c16c03c10a tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] Returning 404 to user: Instance group 84aef3b8-dfdb-4d27-86e8-ff21ce4c08be could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:18.653099 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c5fbb70f-5b67-4bd0-9ee4-98c16c03c10a tempest-ServerGroup264TestJSON-631266660 tempest-ServerGroup264TestJSON-631266660-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/84aef3b8-dfdb-4d27-86e8-ff21ce4c08be" status: 404 len: 117 microversion: 2.64 time: 0.039681 Oct 18 13:39:18.654214 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2394/5060] 10.222.0.40 () {60 vars in 1307 bytes} [Tue Oct 18 13:39:18 2022] DELETE /compute/v2.1/os-server-groups/84aef3b8-dfdb-4d27-86e8-ff21ce4c08be => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:39:18.666158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ebe05985-8b4e-47a7-90a9-4345b07f558d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:18.675801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-12a35364-8361-47c1-abe0-b5f9efaf95ad tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:18.676025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ebe05985-8b4e-47a7-90a9-4345b07f558d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:18.677042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-12a35364-8361-47c1-abe0-b5f9efaf95ad tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:18.679392 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ebe05985-8b4e-47a7-90a9-4345b07f558d tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1743 microversion: 2.20 time: 0.299741 Oct 18 13:39:18.679997 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2667/5061] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:18 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1743 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:39:18.702877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12a35364-8361-47c1-abe0-b5f9efaf95ad tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:18.705930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12a35364-8361-47c1-abe0-b5f9efaf95ad tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:18.708531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12a35364-8361-47c1-abe0-b5f9efaf95ad tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:18.714479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12a35364-8361-47c1-abe0-b5f9efaf95ad tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:18.719292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12a35364-8361-47c1-abe0-b5f9efaf95ad tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:18.720066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12a35364-8361-47c1-abe0-b5f9efaf95ad tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.164256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-12a35364-8361-47c1-abe0-b5f9efaf95ad tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:19.181002 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-12a35364-8361-47c1-abe0-b5f9efaf95ad tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1489 microversion: 2.1 time: 0.508872 Oct 18 13:39:19.183739 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2395/5062] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:18 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1489 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:19.209392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b6a1c680-32a0-4fdf-b9de-fbcbb4db595a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2085996779"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:19.211917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b6a1c680-32a0-4fdf-b9de-fbcbb4db595a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:19.219583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6a1c680-32a0-4fdf-b9de-fbcbb4db595a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.220279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6a1c680-32a0-4fdf-b9de-fbcbb4db595a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.220880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6a1c680-32a0-4fdf-b9de-fbcbb4db595a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.222170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6a1c680-32a0-4fdf-b9de-fbcbb4db595a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.222980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6a1c680-32a0-4fdf-b9de-fbcbb4db595a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.223785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6a1c680-32a0-4fdf-b9de-fbcbb4db595a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.372283 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b6a1c680-32a0-4fdf-b9de-fbcbb4db595a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "PUT /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1074 microversion: 2.1 time: 0.168422 Oct 18 13:39:19.385655 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2668/5063] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 18 13:39:19 2022] PUT /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1074 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:19.392364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e9d85aaa-04d3-4222-89b1-282d509bc78a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:19.393985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e9d85aaa-04d3-4222-89b1-282d509bc78a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:19.404735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9d85aaa-04d3-4222-89b1-282d509bc78a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.405257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9d85aaa-04d3-4222-89b1-282d509bc78a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.405702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9d85aaa-04d3-4222-89b1-282d509bc78a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.407864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9d85aaa-04d3-4222-89b1-282d509bc78a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.408340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9d85aaa-04d3-4222-89b1-282d509bc78a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.410323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9d85aaa-04d3-4222-89b1-282d509bc78a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.710560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-482d00a7-a7f5-45c1-bc53-f12c1353c200 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:19.711179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-482d00a7-a7f5-45c1-bc53-f12c1353c200 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:19.727265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-482d00a7-a7f5-45c1-bc53-f12c1353c200 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.730915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-482d00a7-a7f5-45c1-bc53-f12c1353c200 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.732517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-482d00a7-a7f5-45c1-bc53-f12c1353c200 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.734140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-482d00a7-a7f5-45c1-bc53-f12c1353c200 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.737293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-482d00a7-a7f5-45c1-bc53-f12c1353c200 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.737927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-482d00a7-a7f5-45c1-bc53-f12c1353c200 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.864849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e9d85aaa-04d3-4222-89b1-282d509bc78a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:19.881075 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e9d85aaa-04d3-4222-89b1-282d509bc78a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1500 microversion: 2.1 time: 0.492844 Oct 18 13:39:19.883380 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2396/5064] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:19 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1500 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:19.907955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6b0dd636-b9cb-474a-a73f-fbfc91c05765 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:19.909456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6b0dd636-b9cb-474a-a73f-fbfc91c05765 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:19.923905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b0dd636-b9cb-474a-a73f-fbfc91c05765 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.925567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b0dd636-b9cb-474a-a73f-fbfc91c05765 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.926266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b0dd636-b9cb-474a-a73f-fbfc91c05765 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:19.928622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b0dd636-b9cb-474a-a73f-fbfc91c05765 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:19.930038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b0dd636-b9cb-474a-a73f-fbfc91c05765 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:19.930687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b0dd636-b9cb-474a-a73f-fbfc91c05765 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:20.298630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6b0dd636-b9cb-474a-a73f-fbfc91c05765 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:20.313658 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6b0dd636-b9cb-474a-a73f-fbfc91c05765 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1500 microversion: 2.1 time: 0.408866 Oct 18 13:39:20.317711 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2397/5065] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:19 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1500 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:20.337146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ca970929-4cb5-4294-8887-15a7e8d28f86 req-7dabec03-6b65-46d1-8d96-5528acb3d309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c5c389-b7a1-4170-9b5c-321066d048e1", "name": "network-vif-plugged", "status": "completed", "tag": "74f52242-e00e-46f0-a3ba-47fe1d3cac8e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:20.376991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ca970929-4cb5-4294-8887-15a7e8d28f86 req-7dabec03-6b65-46d1-8d96-5528acb3d309 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:20.382623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ca970929-4cb5-4294-8887-15a7e8d28f86 req-7dabec03-6b65-46d1-8d96-5528acb3d309 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:20.383096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ca970929-4cb5-4294-8887-15a7e8d28f86 req-7dabec03-6b65-46d1-8d96-5528acb3d309 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:20.422357 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ca970929-4cb5-4294-8887-15a7e8d28f86 req-7dabec03-6b65-46d1-8d96-5528acb3d309 service nova] Creating event network-vif-plugged:74f52242-e00e-46f0-a3ba-47fe1d3cac8e for instance 31c5c389-b7a1-4170-9b5c-321066d048e1 on n-h1-858384-13 Oct 18 13:39:20.437909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-482d00a7-a7f5-45c1-bc53-f12c1353c200 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:20.438434 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ca970929-4cb5-4294-8887-15a7e8d28f86 req-7dabec03-6b65-46d1-8d96-5528acb3d309 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116114 Oct 18 13:39:20.439252 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2398/5066] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:20.452558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-482d00a7-a7f5-45c1-bc53-f12c1353c200 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:20.455381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-727eda09-e125-45a1-befe-243dbdc1b862 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:20.463557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-482d00a7-a7f5-45c1-bc53-f12c1353c200 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:20.464793 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-482d00a7-a7f5-45c1-bc53-f12c1353c200 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.760129 Oct 18 13:39:20.466742 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2669/5067] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:19 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:39:20.493404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-727eda09-e125-45a1-befe-243dbdc1b862 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:20.493901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-727eda09-e125-45a1-befe-243dbdc1b862 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:20.494340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-727eda09-e125-45a1-befe-243dbdc1b862 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:20.531446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-727eda09-e125-45a1-befe-243dbdc1b862 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Going to try to stop instance {{(pid=120612) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:39:20.601580 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-727eda09-e125-45a1-befe-243dbdc1b862 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "POST /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca/action" status: 202 len: 0 microversion: 2.1 time: 0.160298 Oct 18 13:39:20.618397 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2399/5068] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:39:20 2022] POST /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:39:20.629371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3ba706b7-4a54-41c3-8fa6-839dfb16d264 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:20.630920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3ba706b7-4a54-41c3-8fa6-839dfb16d264 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:20.645528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ba706b7-4a54-41c3-8fa6-839dfb16d264 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:20.646036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ba706b7-4a54-41c3-8fa6-839dfb16d264 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:20.648555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ba706b7-4a54-41c3-8fa6-839dfb16d264 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:20.650144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ba706b7-4a54-41c3-8fa6-839dfb16d264 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:20.650984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ba706b7-4a54-41c3-8fa6-839dfb16d264 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:20.656134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ba706b7-4a54-41c3-8fa6-839dfb16d264 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:21.352490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ba706b7-4a54-41c3-8fa6-839dfb16d264 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:21.368731 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3ba706b7-4a54-41c3-8fa6-839dfb16d264 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.743976 Oct 18 13:39:21.371390 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2670/5069] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:20 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:21.500914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f854bf4e-2d6e-4915-b5e9-3d3b8086ea20 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:21.505470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f854bf4e-2d6e-4915-b5e9-3d3b8086ea20 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:21.540026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f854bf4e-2d6e-4915-b5e9-3d3b8086ea20 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:21.543810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f854bf4e-2d6e-4915-b5e9-3d3b8086ea20 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:21.549160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f854bf4e-2d6e-4915-b5e9-3d3b8086ea20 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:21.550304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f854bf4e-2d6e-4915-b5e9-3d3b8086ea20 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:21.553862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f854bf4e-2d6e-4915-b5e9-3d3b8086ea20 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:21.554581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f854bf4e-2d6e-4915-b5e9-3d3b8086ea20 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:22.188771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f854bf4e-2d6e-4915-b5e9-3d3b8086ea20 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:22.209054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f854bf4e-2d6e-4915-b5e9-3d3b8086ea20 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:22.210936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f854bf4e-2d6e-4915-b5e9-3d3b8086ea20 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:22.227134 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f854bf4e-2d6e-4915-b5e9-3d3b8086ea20 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.732390 Oct 18 13:39:22.228014 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2400/5070] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:21 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:22.397811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c9440aad-0097-4c16-8a48-4ef5b66970b4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:22.398421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c9440aad-0097-4c16-8a48-4ef5b66970b4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:22.411473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9440aad-0097-4c16-8a48-4ef5b66970b4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:22.411971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9440aad-0097-4c16-8a48-4ef5b66970b4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:22.412415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9440aad-0097-4c16-8a48-4ef5b66970b4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:22.413146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9440aad-0097-4c16-8a48-4ef5b66970b4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:22.421772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9440aad-0097-4c16-8a48-4ef5b66970b4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:22.424487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9440aad-0097-4c16-8a48-4ef5b66970b4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:23.231693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c9440aad-0097-4c16-8a48-4ef5b66970b4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:23.245877 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c9440aad-0097-4c16-8a48-4ef5b66970b4 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.852743 Oct 18 13:39:23.249115 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2671/5071] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:22 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:23.256955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3c629b22-6ee0-4ae2-9039-e2fc9ad56ee4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:23.258514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3c629b22-6ee0-4ae2-9039-e2fc9ad56ee4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:23.279075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c629b22-6ee0-4ae2-9039-e2fc9ad56ee4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:23.280505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c629b22-6ee0-4ae2-9039-e2fc9ad56ee4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:23.281723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c629b22-6ee0-4ae2-9039-e2fc9ad56ee4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:23.283629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c629b22-6ee0-4ae2-9039-e2fc9ad56ee4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:23.285075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c629b22-6ee0-4ae2-9039-e2fc9ad56ee4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:23.287395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c629b22-6ee0-4ae2-9039-e2fc9ad56ee4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:23.720249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3c629b22-6ee0-4ae2-9039-e2fc9ad56ee4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:23.738028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3c629b22-6ee0-4ae2-9039-e2fc9ad56ee4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:23.740003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3c629b22-6ee0-4ae2-9039-e2fc9ad56ee4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:23.773086 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3c629b22-6ee0-4ae2-9039-e2fc9ad56ee4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.506876 Oct 18 13:39:23.776734 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2401/5072] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:23 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:23.818185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba624c2f-fe0b-41d4-98fc-a0fe1308db38 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:23.849013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba624c2f-fe0b-41d4-98fc-a0fe1308db38 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:23.858588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba624c2f-fe0b-41d4-98fc-a0fe1308db38 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:23.861980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba624c2f-fe0b-41d4-98fc-a0fe1308db38 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:23.983197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ba624c2f-fe0b-41d4-98fc-a0fe1308db38 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Going to try to stop instance {{(pid=120611) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 13:39:24.133933 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ba624c2f-fe0b-41d4-98fc-a0fe1308db38 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "POST /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/action" status: 202 len: 0 microversion: 2.1 time: 0.319409 Oct 18 13:39:24.135963 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2672/5073] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:39:23 2022] POST /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:39:24.143991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ac53375a-3830-4612-af9b-eab4c140f456 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:24.144611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ac53375a-3830-4612-af9b-eab4c140f456 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:24.163509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac53375a-3830-4612-af9b-eab4c140f456 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:24.164596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac53375a-3830-4612-af9b-eab4c140f456 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:24.164596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac53375a-3830-4612-af9b-eab4c140f456 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:24.165150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac53375a-3830-4612-af9b-eab4c140f456 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:24.165633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac53375a-3830-4612-af9b-eab4c140f456 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:24.166067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac53375a-3830-4612-af9b-eab4c140f456 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:24.286773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-410ee1da-2528-435f-9eb4-84faf9b90b19 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:24.287622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-410ee1da-2528-435f-9eb4-84faf9b90b19 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:24.311349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-410ee1da-2528-435f-9eb4-84faf9b90b19 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:24.316436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-410ee1da-2528-435f-9eb4-84faf9b90b19 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:24.319136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-410ee1da-2528-435f-9eb4-84faf9b90b19 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:24.324627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-410ee1da-2528-435f-9eb4-84faf9b90b19 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:24.325726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-410ee1da-2528-435f-9eb4-84faf9b90b19 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:24.327531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-410ee1da-2528-435f-9eb4-84faf9b90b19 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:24.748615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-410ee1da-2528-435f-9eb4-84faf9b90b19 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:24.759338 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-410ee1da-2528-435f-9eb4-84faf9b90b19 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.486585 Oct 18 13:39:24.784268 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2673/5074] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:24 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:24.811179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6e2b3159-04be-4cac-ad0b-b462033c24ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:24.812283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6e2b3159-04be-4cac-ad0b-b462033c24ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:24.820415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e2b3159-04be-4cac-ad0b-b462033c24ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:24.821708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e2b3159-04be-4cac-ad0b-b462033c24ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:24.822336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e2b3159-04be-4cac-ad0b-b462033c24ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:24.823240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e2b3159-04be-4cac-ad0b-b462033c24ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:24.824585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e2b3159-04be-4cac-ad0b-b462033c24ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:24.826480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e2b3159-04be-4cac-ad0b-b462033c24ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:24.833370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:24.912064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ac53375a-3830-4612-af9b-eab4c140f456 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:24.920431 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ac53375a-3830-4612-af9b-eab4c140f456 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1675 microversion: 2.1 time: 0.780308 Oct 18 13:39:24.929668 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2402/5075] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:24 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1675 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:25.438602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6e2b3159-04be-4cac-ad0b-b462033c24ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:25.463178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6e2b3159-04be-4cac-ad0b-b462033c24ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:25.466963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6e2b3159-04be-4cac-ad0b-b462033c24ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:25.468223 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6e2b3159-04be-4cac-ad0b-b462033c24ab tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.661208 Oct 18 13:39:25.468804 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2674/5076] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:24 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:25.783358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-86176387-524f-4264-8c78-eb4a15a214a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:25.784208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-86176387-524f-4264-8c78-eb4a15a214a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:25.815045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86176387-524f-4264-8c78-eb4a15a214a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:25.815842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86176387-524f-4264-8c78-eb4a15a214a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:25.816453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86176387-524f-4264-8c78-eb4a15a214a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:25.818206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86176387-524f-4264-8c78-eb4a15a214a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:25.818936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86176387-524f-4264-8c78-eb4a15a214a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:25.819607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86176387-524f-4264-8c78-eb4a15a214a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:25.947529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c51d9cb9-1e35-4b57-962a-cf3634c65366 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:25.948159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c51d9cb9-1e35-4b57-962a-cf3634c65366 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:25.961503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c51d9cb9-1e35-4b57-962a-cf3634c65366 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:25.962050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c51d9cb9-1e35-4b57-962a-cf3634c65366 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:25.962498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c51d9cb9-1e35-4b57-962a-cf3634c65366 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:25.963241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c51d9cb9-1e35-4b57-962a-cf3634c65366 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:25.963698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c51d9cb9-1e35-4b57-962a-cf3634c65366 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:25.964123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c51d9cb9-1e35-4b57-962a-cf3634c65366 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:26.083953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-86176387-524f-4264-8c78-eb4a15a214a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:26.106391 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-86176387-524f-4264-8c78-eb4a15a214a7 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.326842 Oct 18 13:39:26.114408 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2403/5077] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:25 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:26.358544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c51d9cb9-1e35-4b57-962a-cf3634c65366 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:26.372941 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c51d9cb9-1e35-4b57-962a-cf3634c65366 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1675 microversion: 2.1 time: 0.429353 Oct 18 13:39:26.374699 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2675/5078] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:25 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1675 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:26.499290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-381c5b4f-65b2-48c9-912e-68e0c1eff4f4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:26.499934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-381c5b4f-65b2-48c9-912e-68e0c1eff4f4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:26.510490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-381c5b4f-65b2-48c9-912e-68e0c1eff4f4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:26.511000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-381c5b4f-65b2-48c9-912e-68e0c1eff4f4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:26.511449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-381c5b4f-65b2-48c9-912e-68e0c1eff4f4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:26.525731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-381c5b4f-65b2-48c9-912e-68e0c1eff4f4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:26.526348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-381c5b4f-65b2-48c9-912e-68e0c1eff4f4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:26.526833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-381c5b4f-65b2-48c9-912e-68e0c1eff4f4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:27.141134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-da0450ad-762c-479e-b293-2aa702ab83db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:27.141801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-da0450ad-762c-479e-b293-2aa702ab83db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:27.152722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da0450ad-762c-479e-b293-2aa702ab83db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:27.158325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da0450ad-762c-479e-b293-2aa702ab83db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:27.158811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da0450ad-762c-479e-b293-2aa702ab83db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:27.159581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da0450ad-762c-479e-b293-2aa702ab83db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:27.166803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da0450ad-762c-479e-b293-2aa702ab83db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:27.169445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da0450ad-762c-479e-b293-2aa702ab83db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:27.486988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-381c5b4f-65b2-48c9-912e-68e0c1eff4f4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:27.509790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-381c5b4f-65b2-48c9-912e-68e0c1eff4f4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:27.512112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-381c5b4f-65b2-48c9-912e-68e0c1eff4f4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:27.513590 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-381c5b4f-65b2-48c9-912e-68e0c1eff4f4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 1.019277 Oct 18 13:39:27.514347 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2404/5079] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:26 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:27.521460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e8d3c884-67be-4c43-8002-35666a10cec2 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:27.525372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e8d3c884-67be-4c43-8002-35666a10cec2 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:27.528829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-da0450ad-762c-479e-b293-2aa702ab83db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:27.539967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8d3c884-67be-4c43-8002-35666a10cec2 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:27.541575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8d3c884-67be-4c43-8002-35666a10cec2 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:27.544536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8d3c884-67be-4c43-8002-35666a10cec2 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:27.546147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8d3c884-67be-4c43-8002-35666a10cec2 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:27.547419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8d3c884-67be-4c43-8002-35666a10cec2 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:27.549418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8d3c884-67be-4c43-8002-35666a10cec2 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:27.556619 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-da0450ad-762c-479e-b293-2aa702ab83db tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.419458 Oct 18 13:39:27.577809 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2676/5080] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:27 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:27.954390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e8d3c884-67be-4c43-8002-35666a10cec2 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:27.970084 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e8d3c884-67be-4c43-8002-35666a10cec2 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1675 microversion: 2.1 time: 0.454253 Oct 18 13:39:27.973520 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2405/5081] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:27 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1675 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:28.553449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53f09268-e59a-4d0a-aed6-81fd16bd4f9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:28.554089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53f09268-e59a-4d0a-aed6-81fd16bd4f9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:28.576132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53f09268-e59a-4d0a-aed6-81fd16bd4f9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:28.579214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53f09268-e59a-4d0a-aed6-81fd16bd4f9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:28.584328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53f09268-e59a-4d0a-aed6-81fd16bd4f9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:28.585874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f330b34b-5355-4da8-9053-b4f267406058 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:28.586680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53f09268-e59a-4d0a-aed6-81fd16bd4f9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:28.588681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f330b34b-5355-4da8-9053-b4f267406058 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:28.590385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53f09268-e59a-4d0a-aed6-81fd16bd4f9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:28.592311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53f09268-e59a-4d0a-aed6-81fd16bd4f9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:28.601679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=8 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:28.605679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f330b34b-5355-4da8-9053-b4f267406058 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:28.607004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f330b34b-5355-4da8-9053-b4f267406058 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:28.608755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f330b34b-5355-4da8-9053-b4f267406058 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:28.611705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f330b34b-5355-4da8-9053-b4f267406058 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:28.612431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f330b34b-5355-4da8-9053-b4f267406058 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:28.614449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f330b34b-5355-4da8-9053-b4f267406058 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:28.927871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f330b34b-5355-4da8-9053-b4f267406058 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:28.947290 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f330b34b-5355-4da8-9053-b4f267406058 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.366585 Oct 18 13:39:28.948852 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2406/5082] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:28 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:29.000798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-330e328c-1a96-4234-850f-0d7e685c5227 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:29.001629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-330e328c-1a96-4234-850f-0d7e685c5227 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:29.027755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-330e328c-1a96-4234-850f-0d7e685c5227 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:29.028266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-330e328c-1a96-4234-850f-0d7e685c5227 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:29.029431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-330e328c-1a96-4234-850f-0d7e685c5227 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:29.030217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-330e328c-1a96-4234-850f-0d7e685c5227 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:29.030681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-330e328c-1a96-4234-850f-0d7e685c5227 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:29.031114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-330e328c-1a96-4234-850f-0d7e685c5227 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:29.139736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:29.185404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-53f09268-e59a-4d0a-aed6-81fd16bd4f9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:29.206193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-53f09268-e59a-4d0a-aed6-81fd16bd4f9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:29.210782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-53f09268-e59a-4d0a-aed6-81fd16bd4f9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:29.216619 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53f09268-e59a-4d0a-aed6-81fd16bd4f9c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.679269 Oct 18 13:39:29.234777 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2677/5083] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:28 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:29.545271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-330e328c-1a96-4234-850f-0d7e685c5227 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:29.584898 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-330e328c-1a96-4234-850f-0d7e685c5227 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1675 microversion: 2.1 time: 0.588472 Oct 18 13:39:29.588642 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2407/5084] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:28 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1675 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:29.972218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fb868ec0-1d1b-4168-8d54-630970d068d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:29.974863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb868ec0-1d1b-4168-8d54-630970d068d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:29.990847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb868ec0-1d1b-4168-8d54-630970d068d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:29.991767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb868ec0-1d1b-4168-8d54-630970d068d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:29.994694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb868ec0-1d1b-4168-8d54-630970d068d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:29.996045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb868ec0-1d1b-4168-8d54-630970d068d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:29.996879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb868ec0-1d1b-4168-8d54-630970d068d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:29.997692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb868ec0-1d1b-4168-8d54-630970d068d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:30.250410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b5f43ded-c61c-4c1f-8042-57631cf13ca2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:30.259444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b5f43ded-c61c-4c1f-8042-57631cf13ca2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:30.273657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5f43ded-c61c-4c1f-8042-57631cf13ca2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:30.274153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5f43ded-c61c-4c1f-8042-57631cf13ca2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:30.274596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5f43ded-c61c-4c1f-8042-57631cf13ca2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:30.281212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5f43ded-c61c-4c1f-8042-57631cf13ca2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:30.283896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5f43ded-c61c-4c1f-8042-57631cf13ca2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:30.284528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5f43ded-c61c-4c1f-8042-57631cf13ca2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:30.568870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fb868ec0-1d1b-4168-8d54-630970d068d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:30.600874 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fb868ec0-1d1b-4168-8d54-630970d068d1 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.632705 Oct 18 13:39:30.602741 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2678/5085] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:29 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:30.619633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68f53acc-10fb-4f04-99ea-89df8623ce2b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:30.620827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-68f53acc-10fb-4f04-99ea-89df8623ce2b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:30.634542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b5f43ded-c61c-4c1f-8042-57631cf13ca2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:30.642452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68f53acc-10fb-4f04-99ea-89df8623ce2b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:30.647092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68f53acc-10fb-4f04-99ea-89df8623ce2b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:30.647657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68f53acc-10fb-4f04-99ea-89df8623ce2b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:30.648651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68f53acc-10fb-4f04-99ea-89df8623ce2b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:30.650506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b5f43ded-c61c-4c1f-8042-57631cf13ca2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:30.652344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b5f43ded-c61c-4c1f-8042-57631cf13ca2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:30.652504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68f53acc-10fb-4f04-99ea-89df8623ce2b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:30.653049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68f53acc-10fb-4f04-99ea-89df8623ce2b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:30.656985 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b5f43ded-c61c-4c1f-8042-57631cf13ca2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.411342 Oct 18 13:39:30.660239 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2408/5086] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:30 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:30.879857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68f53acc-10fb-4f04-99ea-89df8623ce2b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:30.892898 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68f53acc-10fb-4f04-99ea-89df8623ce2b tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1675 microversion: 2.1 time: 0.282924 Oct 18 13:39:30.906358 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2679/5087] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:30 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1675 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:31.631560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9d504669-b2d8-4883-ba50-97544afa6b8d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:31.632228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9d504669-b2d8-4883-ba50-97544afa6b8d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:31.649090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d504669-b2d8-4883-ba50-97544afa6b8d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:31.657467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d504669-b2d8-4883-ba50-97544afa6b8d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:31.658080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d504669-b2d8-4883-ba50-97544afa6b8d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:31.661821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d504669-b2d8-4883-ba50-97544afa6b8d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:31.661821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d504669-b2d8-4883-ba50-97544afa6b8d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:31.665164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d504669-b2d8-4883-ba50-97544afa6b8d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:31.692982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f80887a2-0654-4390-b93d-4b762d9c57e1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:31.694764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f80887a2-0654-4390-b93d-4b762d9c57e1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:31.714320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f80887a2-0654-4390-b93d-4b762d9c57e1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:31.716158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f80887a2-0654-4390-b93d-4b762d9c57e1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:31.717864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f80887a2-0654-4390-b93d-4b762d9c57e1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:31.720303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f80887a2-0654-4390-b93d-4b762d9c57e1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:31.723072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f80887a2-0654-4390-b93d-4b762d9c57e1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:31.723989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f80887a2-0654-4390-b93d-4b762d9c57e1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:32.191399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9d504669-b2d8-4883-ba50-97544afa6b8d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:32.203890 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9d504669-b2d8-4883-ba50-97544afa6b8d tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.576524 Oct 18 13:39:32.204853 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2409/5088] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:31 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:32.211985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-510fd4d2-c41a-4d37-bedd-8fe9ed857162 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:32.213383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-510fd4d2-c41a-4d37-bedd-8fe9ed857162 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:32.220142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-510fd4d2-c41a-4d37-bedd-8fe9ed857162 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:32.220959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-510fd4d2-c41a-4d37-bedd-8fe9ed857162 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:32.221781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-510fd4d2-c41a-4d37-bedd-8fe9ed857162 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:32.222659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-510fd4d2-c41a-4d37-bedd-8fe9ed857162 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:32.223905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-510fd4d2-c41a-4d37-bedd-8fe9ed857162 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:32.224677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-510fd4d2-c41a-4d37-bedd-8fe9ed857162 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:32.508269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-510fd4d2-c41a-4d37-bedd-8fe9ed857162 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:32.518612 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-510fd4d2-c41a-4d37-bedd-8fe9ed857162 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1675 microversion: 2.1 time: 0.312521 Oct 18 13:39:32.519169 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2410/5089] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:32 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1675 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:32.658235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f80887a2-0654-4390-b93d-4b762d9c57e1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:32.669407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f80887a2-0654-4390-b93d-4b762d9c57e1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:32.727413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f80887a2-0654-4390-b93d-4b762d9c57e1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:32.775590 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f80887a2-0654-4390-b93d-4b762d9c57e1 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 1.085381 Oct 18 13:39:32.804308 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2680/5090] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:31 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:39:33.229690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bba3f8df-ea6b-4d3f-8c3e-2a359e9eeb41 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:33.230318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bba3f8df-ea6b-4d3f-8c3e-2a359e9eeb41 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:33.240652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bba3f8df-ea6b-4d3f-8c3e-2a359e9eeb41 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:33.241069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bba3f8df-ea6b-4d3f-8c3e-2a359e9eeb41 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:33.241547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bba3f8df-ea6b-4d3f-8c3e-2a359e9eeb41 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:33.242263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bba3f8df-ea6b-4d3f-8c3e-2a359e9eeb41 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:33.242709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bba3f8df-ea6b-4d3f-8c3e-2a359e9eeb41 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:33.243129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bba3f8df-ea6b-4d3f-8c3e-2a359e9eeb41 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:33.546409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d2a9e2e4-3fa6-43ab-ba12-59af025e4e14 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:33.547915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d2a9e2e4-3fa6-43ab-ba12-59af025e4e14 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:33.565243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a9e2e4-3fa6-43ab-ba12-59af025e4e14 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:33.566221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a9e2e4-3fa6-43ab-ba12-59af025e4e14 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:33.566925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a9e2e4-3fa6-43ab-ba12-59af025e4e14 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:33.570031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a9e2e4-3fa6-43ab-ba12-59af025e4e14 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:33.570699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a9e2e4-3fa6-43ab-ba12-59af025e4e14 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:33.571322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a9e2e4-3fa6-43ab-ba12-59af025e4e14 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:33.956681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d2a9e2e4-3fa6-43ab-ba12-59af025e4e14 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:33.980959 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d2a9e2e4-3fa6-43ab-ba12-59af025e4e14 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1675 microversion: 2.1 time: 0.438597 Oct 18 13:39:33.982847 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2681/5091] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:33 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1675 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:34.001888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1530b989-1313-4ce7-b88a-f10a3c8c90ff tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:34.010847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1530b989-1313-4ce7-b88a-f10a3c8c90ff tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:34.046238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1530b989-1313-4ce7-b88a-f10a3c8c90ff tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:34.062583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1530b989-1313-4ce7-b88a-f10a3c8c90ff tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:34.063821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1530b989-1313-4ce7-b88a-f10a3c8c90ff tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:34.065689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1530b989-1313-4ce7-b88a-f10a3c8c90ff tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:34.072847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1530b989-1313-4ce7-b88a-f10a3c8c90ff tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:34.075095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1530b989-1313-4ce7-b88a-f10a3c8c90ff tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:34.147927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bba3f8df-ea6b-4d3f-8c3e-2a359e9eeb41 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:34.179701 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bba3f8df-ea6b-4d3f-8c3e-2a359e9eeb41 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.952370 Oct 18 13:39:34.182389 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2411/5092] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:33 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:34.603055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1530b989-1313-4ce7-b88a-f10a3c8c90ff tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:34.622793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1530b989-1313-4ce7-b88a-f10a3c8c90ff tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:34.625325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1530b989-1313-4ce7-b88a-f10a3c8c90ff tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:34.627184 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1530b989-1313-4ce7-b88a-f10a3c8c90ff tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.642839 Oct 18 13:39:34.628623 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2682/5093] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:33 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:35.010841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7b1cb3e2-4cb2-4fa4-9249-cf3e75e2edfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:35.011455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7b1cb3e2-4cb2-4fa4-9249-cf3e75e2edfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:35.027359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1cb3e2-4cb2-4fa4-9249-cf3e75e2edfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:35.027855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1cb3e2-4cb2-4fa4-9249-cf3e75e2edfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:35.028291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1cb3e2-4cb2-4fa4-9249-cf3e75e2edfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:35.029000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1cb3e2-4cb2-4fa4-9249-cf3e75e2edfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:35.037685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1cb3e2-4cb2-4fa4-9249-cf3e75e2edfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:35.038475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1cb3e2-4cb2-4fa4-9249-cf3e75e2edfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:35.206007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8be502ec-228f-4faa-a391-c8e5b88705ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:35.206625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8be502ec-228f-4faa-a391-c8e5b88705ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:35.225923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8be502ec-228f-4faa-a391-c8e5b88705ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:35.226429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8be502ec-228f-4faa-a391-c8e5b88705ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:35.226867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8be502ec-228f-4faa-a391-c8e5b88705ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:35.227583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8be502ec-228f-4faa-a391-c8e5b88705ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:35.228061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8be502ec-228f-4faa-a391-c8e5b88705ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:35.228502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8be502ec-228f-4faa-a391-c8e5b88705ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:35.767318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8be502ec-228f-4faa-a391-c8e5b88705ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:35.784685 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8be502ec-228f-4faa-a391-c8e5b88705ea tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.582511 Oct 18 13:39:35.786298 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2683/5094] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:35 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:35.807368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-24e9f274-befe-44d4-a63f-940128d89453 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:35.808017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-24e9f274-befe-44d4-a63f-940128d89453 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:35.817436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24e9f274-befe-44d4-a63f-940128d89453 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:35.817827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24e9f274-befe-44d4-a63f-940128d89453 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:35.818269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24e9f274-befe-44d4-a63f-940128d89453 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:35.818989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24e9f274-befe-44d4-a63f-940128d89453 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:35.819447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24e9f274-befe-44d4-a63f-940128d89453 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:35.819903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24e9f274-befe-44d4-a63f-940128d89453 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:35.925631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7b1cb3e2-4cb2-4fa4-9249-cf3e75e2edfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:35.940649 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7b1cb3e2-4cb2-4fa4-9249-cf3e75e2edfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1652 microversion: 2.1 time: 0.928884 Oct 18 13:39:35.942653 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2412/5095] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:35 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1652 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:35.966375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1f97e85d-0875-450c-9d99-5b044b74869e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:35.978070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f97e85d-0875-450c-9d99-5b044b74869e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:35.979178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f97e85d-0875-450c-9d99-5b044b74869e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:35.980981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f97e85d-0875-450c-9d99-5b044b74869e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:36.053345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1f97e85d-0875-450c-9d99-5b044b74869e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Going to try to start instance {{(pid=120612) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 13:39:36.171987 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1f97e85d-0875-450c-9d99-5b044b74869e tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "POST /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/action" status: 202 len: 0 microversion: 2.1 time: 0.209858 Oct 18 13:39:36.174797 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2413/5096] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:39:35 2022] POST /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:39:36.189338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3a08739c-f584-49c1-a02f-6c8dd0989c39 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:36.191374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3a08739c-f584-49c1-a02f-6c8dd0989c39 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:36.207585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a08739c-f584-49c1-a02f-6c8dd0989c39 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:36.208082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a08739c-f584-49c1-a02f-6c8dd0989c39 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:36.208521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a08739c-f584-49c1-a02f-6c8dd0989c39 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:36.209599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a08739c-f584-49c1-a02f-6c8dd0989c39 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:36.211086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a08739c-f584-49c1-a02f-6c8dd0989c39 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:36.211719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a08739c-f584-49c1-a02f-6c8dd0989c39 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:36.368136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-24e9f274-befe-44d4-a63f-940128d89453 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:36.380900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-24e9f274-befe-44d4-a63f-940128d89453 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:36.385351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-24e9f274-befe-44d4-a63f-940128d89453 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:36.388374 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-24e9f274-befe-44d4-a63f-940128d89453 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.600967 Oct 18 13:39:36.397285 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2684/5097] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:35 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:36.812876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-17982ddc-6f55-4e39-a483-3d7c5e2501e6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:36.813858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-17982ddc-6f55-4e39-a483-3d7c5e2501e6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:36.827211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17982ddc-6f55-4e39-a483-3d7c5e2501e6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:36.834377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17982ddc-6f55-4e39-a483-3d7c5e2501e6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:36.835205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17982ddc-6f55-4e39-a483-3d7c5e2501e6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:36.836319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17982ddc-6f55-4e39-a483-3d7c5e2501e6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:36.837362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17982ddc-6f55-4e39-a483-3d7c5e2501e6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:36.838191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17982ddc-6f55-4e39-a483-3d7c5e2501e6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:37.273343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-17982ddc-6f55-4e39-a483-3d7c5e2501e6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:37.281274 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-17982ddc-6f55-4e39-a483-3d7c5e2501e6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.475064 Oct 18 13:39:37.282115 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2685/5098] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:36 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:37.431028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c152b9b3-60eb-4fc3-bcc1-7c8cf34520a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:37.431791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c152b9b3-60eb-4fc3-bcc1-7c8cf34520a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:37.451399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c152b9b3-60eb-4fc3-bcc1-7c8cf34520a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:37.455127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c152b9b3-60eb-4fc3-bcc1-7c8cf34520a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:37.455944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c152b9b3-60eb-4fc3-bcc1-7c8cf34520a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:37.456998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c152b9b3-60eb-4fc3-bcc1-7c8cf34520a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:37.464578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c152b9b3-60eb-4fc3-bcc1-7c8cf34520a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:37.465371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c152b9b3-60eb-4fc3-bcc1-7c8cf34520a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:37.793973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c152b9b3-60eb-4fc3-bcc1-7c8cf34520a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:37.805539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3a08739c-f584-49c1-a02f-6c8dd0989c39 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:37.806057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c152b9b3-60eb-4fc3-bcc1-7c8cf34520a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:37.807469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c152b9b3-60eb-4fc3-bcc1-7c8cf34520a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:37.813529 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c152b9b3-60eb-4fc3-bcc1-7c8cf34520a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.383726 Oct 18 13:39:37.816093 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3a08739c-f584-49c1-a02f-6c8dd0989c39 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1661 microversion: 2.1 time: 1.636344 Oct 18 13:39:37.821704 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2414/5099] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:36 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1661 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:37.827328 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2686/5100] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:37 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:38.310902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b38afa67-ca5a-486e-badb-6a15fec27f0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:38.313651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b38afa67-ca5a-486e-badb-6a15fec27f0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:38.323059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38afa67-ca5a-486e-badb-6a15fec27f0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:38.323555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38afa67-ca5a-486e-badb-6a15fec27f0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:38.323995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38afa67-ca5a-486e-badb-6a15fec27f0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:38.324848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38afa67-ca5a-486e-badb-6a15fec27f0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:38.325335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38afa67-ca5a-486e-badb-6a15fec27f0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:38.328082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38afa67-ca5a-486e-badb-6a15fec27f0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:38.845632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c00f9b9e-8b44-44c5-a3d6-f7c04e4684c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:38.850354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c00f9b9e-8b44-44c5-a3d6-f7c04e4684c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:38.876076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:38.913705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c00f9b9e-8b44-44c5-a3d6-f7c04e4684c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:38.914207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c00f9b9e-8b44-44c5-a3d6-f7c04e4684c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:38.914905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c00f9b9e-8b44-44c5-a3d6-f7c04e4684c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:38.916856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c00f9b9e-8b44-44c5-a3d6-f7c04e4684c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:38.918902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c00f9b9e-8b44-44c5-a3d6-f7c04e4684c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:38.926686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c00f9b9e-8b44-44c5-a3d6-f7c04e4684c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:39.094777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b38afa67-ca5a-486e-badb-6a15fec27f0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:39.134184 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b38afa67-ca5a-486e-badb-6a15fec27f0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.830967 Oct 18 13:39:39.135450 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2415/5101] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:38 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:39.150289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-589423f9-eae6-4779-86d9-315c5c4db890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:39.151310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-589423f9-eae6-4779-86d9-315c5c4db890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:39.192270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589423f9-eae6-4779-86d9-315c5c4db890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:39.193855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589423f9-eae6-4779-86d9-315c5c4db890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:39.194487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589423f9-eae6-4779-86d9-315c5c4db890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:39.195412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589423f9-eae6-4779-86d9-315c5c4db890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:39.196099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589423f9-eae6-4779-86d9-315c5c4db890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:39.196722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589423f9-eae6-4779-86d9-315c5c4db890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:39.711039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-589423f9-eae6-4779-86d9-315c5c4db890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:39.741217 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-589423f9-eae6-4779-86d9-315c5c4db890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1661 microversion: 2.1 time: 0.603746 Oct 18 13:39:39.742064 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2416/5102] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:39 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1661 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:40.136077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c00f9b9e-8b44-44c5-a3d6-f7c04e4684c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:40.146106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c00f9b9e-8b44-44c5-a3d6-f7c04e4684c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:40.151382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c00f9b9e-8b44-44c5-a3d6-f7c04e4684c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:40.155580 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c00f9b9e-8b44-44c5-a3d6-f7c04e4684c2 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 1.316487 Oct 18 13:39:40.159908 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2687/5103] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:38 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:39:40.171067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bb800c71-ae6d-4fc1-9b21-c1b4015a6c2f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:40.172435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bb800c71-ae6d-4fc1-9b21-c1b4015a6c2f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:40.183570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb800c71-ae6d-4fc1-9b21-c1b4015a6c2f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:40.187431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb800c71-ae6d-4fc1-9b21-c1b4015a6c2f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:40.189477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb800c71-ae6d-4fc1-9b21-c1b4015a6c2f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:40.191093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb800c71-ae6d-4fc1-9b21-c1b4015a6c2f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:40.192684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb800c71-ae6d-4fc1-9b21-c1b4015a6c2f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:40.193731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb800c71-ae6d-4fc1-9b21-c1b4015a6c2f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:40.550372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bb800c71-ae6d-4fc1-9b21-c1b4015a6c2f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:40.567305 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bb800c71-ae6d-4fc1-9b21-c1b4015a6c2f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.398536 Oct 18 13:39:40.589033 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2417/5104] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:40 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:40.764129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c8cae3c-f53f-40ba-bb9d-6c0d635a7251 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:40.765161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2c8cae3c-f53f-40ba-bb9d-6c0d635a7251 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:40.778642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c8cae3c-f53f-40ba-bb9d-6c0d635a7251 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:40.779256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c8cae3c-f53f-40ba-bb9d-6c0d635a7251 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:40.779795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c8cae3c-f53f-40ba-bb9d-6c0d635a7251 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:40.786768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c8cae3c-f53f-40ba-bb9d-6c0d635a7251 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:40.787408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c8cae3c-f53f-40ba-bb9d-6c0d635a7251 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:40.787975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c8cae3c-f53f-40ba-bb9d-6c0d635a7251 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:41.192369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-faad869e-524e-416f-a57e-7d6c59303058 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:41.193734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-faad869e-524e-416f-a57e-7d6c59303058 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:41.219964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faad869e-524e-416f-a57e-7d6c59303058 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:41.223141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faad869e-524e-416f-a57e-7d6c59303058 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:41.228345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faad869e-524e-416f-a57e-7d6c59303058 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:41.231541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faad869e-524e-416f-a57e-7d6c59303058 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:41.235067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faad869e-524e-416f-a57e-7d6c59303058 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:41.238010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-faad869e-524e-416f-a57e-7d6c59303058 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:41.265408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2c8cae3c-f53f-40ba-bb9d-6c0d635a7251 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:41.279987 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2c8cae3c-f53f-40ba-bb9d-6c0d635a7251 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1665 microversion: 2.1 time: 0.519709 Oct 18 13:39:41.284841 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2688/5105] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:40 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1665 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:41.595708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5021a64e-64f0-4813-8b58-959b9a34467e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:41.598196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5021a64e-64f0-4813-8b58-959b9a34467e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:41.612867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5021a64e-64f0-4813-8b58-959b9a34467e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:41.613927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5021a64e-64f0-4813-8b58-959b9a34467e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:41.615086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5021a64e-64f0-4813-8b58-959b9a34467e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:41.624312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5021a64e-64f0-4813-8b58-959b9a34467e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:41.625951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5021a64e-64f0-4813-8b58-959b9a34467e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:41.629589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5021a64e-64f0-4813-8b58-959b9a34467e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:41.810973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-faad869e-524e-416f-a57e-7d6c59303058 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:41.829294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-faad869e-524e-416f-a57e-7d6c59303058 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:41.841581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-faad869e-524e-416f-a57e-7d6c59303058 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:41.850349 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-faad869e-524e-416f-a57e-7d6c59303058 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.657036 Oct 18 13:39:41.855211 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2418/5106] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:41 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:42.446571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5021a64e-64f0-4813-8b58-959b9a34467e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:42.465034 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5021a64e-64f0-4813-8b58-959b9a34467e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.873213 Oct 18 13:39:42.492049 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2689/5107] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:41 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:42.884749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-758817ac-f18b-4ba0-a516-5f82a309a703 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:42.889590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-758817ac-f18b-4ba0-a516-5f82a309a703 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:42.913991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-758817ac-f18b-4ba0-a516-5f82a309a703 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:42.914789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-758817ac-f18b-4ba0-a516-5f82a309a703 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:42.915413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-758817ac-f18b-4ba0-a516-5f82a309a703 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:42.916361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-758817ac-f18b-4ba0-a516-5f82a309a703 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:42.917081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-758817ac-f18b-4ba0-a516-5f82a309a703 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:42.917796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-758817ac-f18b-4ba0-a516-5f82a309a703 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:43.291552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-758817ac-f18b-4ba0-a516-5f82a309a703 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:43.305658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-758817ac-f18b-4ba0-a516-5f82a309a703 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:43.309624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-758817ac-f18b-4ba0-a516-5f82a309a703 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:43.312909 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-758817ac-f18b-4ba0-a516-5f82a309a703 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.432045 Oct 18 13:39:43.315272 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2419/5108] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:42 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:43.515059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-03667215-3d75-499f-8a86-286afe08cd30 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:43.515676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-03667215-3d75-499f-8a86-286afe08cd30 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:43.537566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03667215-3d75-499f-8a86-286afe08cd30 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:43.538383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03667215-3d75-499f-8a86-286afe08cd30 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:43.539146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03667215-3d75-499f-8a86-286afe08cd30 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:43.540112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03667215-3d75-499f-8a86-286afe08cd30 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:43.540737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03667215-3d75-499f-8a86-286afe08cd30 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:43.541363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03667215-3d75-499f-8a86-286afe08cd30 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:44.132898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-03667215-3d75-499f-8a86-286afe08cd30 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:44.137326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:44.148122 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-03667215-3d75-499f-8a86-286afe08cd30 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.636946 Oct 18 13:39:44.155537 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2690/5109] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:43 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:44.346558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3aaa6b93-a5c5-456c-a30f-4722702ba356 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:44.349386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3aaa6b93-a5c5-456c-a30f-4722702ba356 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:44.362268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aaa6b93-a5c5-456c-a30f-4722702ba356 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:44.363192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aaa6b93-a5c5-456c-a30f-4722702ba356 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:44.364934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aaa6b93-a5c5-456c-a30f-4722702ba356 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:44.366005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aaa6b93-a5c5-456c-a30f-4722702ba356 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:44.366708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aaa6b93-a5c5-456c-a30f-4722702ba356 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:44.367372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3aaa6b93-a5c5-456c-a30f-4722702ba356 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:44.627249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3aaa6b93-a5c5-456c-a30f-4722702ba356 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:44.648151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3aaa6b93-a5c5-456c-a30f-4722702ba356 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:44.653742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3aaa6b93-a5c5-456c-a30f-4722702ba356 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:44.658828 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3aaa6b93-a5c5-456c-a30f-4722702ba356 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.316887 Oct 18 13:39:44.660149 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2420/5110] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:44 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:44.826945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-03667215-3d75-499f-8a86-286afe08cd30 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:44.828219 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-03667215-3d75-499f-8a86-286afe08cd30 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001606 Oct 18 13:39:44.837249 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2691/5111] 10.222.0.40 () {56 vars in 886 bytes} [Tue Oct 18 13:39:44 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 18 13:39:45.172251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e94ac232-520c-4c3c-a2d6-03398f4d3289 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:45.173356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e94ac232-520c-4c3c-a2d6-03398f4d3289 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:45.182616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e94ac232-520c-4c3c-a2d6-03398f4d3289 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:45.183511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e94ac232-520c-4c3c-a2d6-03398f4d3289 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:45.184309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e94ac232-520c-4c3c-a2d6-03398f4d3289 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:45.185905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e94ac232-520c-4c3c-a2d6-03398f4d3289 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:45.186557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e94ac232-520c-4c3c-a2d6-03398f4d3289 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:45.187852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e94ac232-520c-4c3c-a2d6-03398f4d3289 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:45.422461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1217800707", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "af7886d4-5701-4709-8d7d-aa61a460b5af"}], "security_groups": [{"name": "tempest-securitygroup--1598249116"}], "key_name": "tempest-keypair-1331111645", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "224e16be-099a-439a-b235-2abd43436e6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:45.812839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] validate_networks() for [('af7886d4-5701-4709-8d7d-aa61a460b5af', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:39:45.847130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e94ac232-520c-4c3c-a2d6-03398f4d3289 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:45.858574 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e94ac232-520c-4c3c-a2d6-03398f4d3289 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.690358 Oct 18 13:39:45.883332 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2421/5112] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:45 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:45.889343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0d1d5055-dc9e-43f1-92f1-d72f1080f50f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:45.894477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0d1d5055-dc9e-43f1-92f1-d72f1080f50f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:45.907314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d1d5055-dc9e-43f1-92f1-d72f1080f50f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:45.908009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d1d5055-dc9e-43f1-92f1-d72f1080f50f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:45.911334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d1d5055-dc9e-43f1-92f1-d72f1080f50f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:45.912363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d1d5055-dc9e-43f1-92f1-d72f1080f50f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:45.913009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d1d5055-dc9e-43f1-92f1-d72f1080f50f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:45.917509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d1d5055-dc9e-43f1-92f1-d72f1080f50f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:46.261750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0d1d5055-dc9e-43f1-92f1-d72f1080f50f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:46.265319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:46.276096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0d1d5055-dc9e-43f1-92f1-d72f1080f50f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:46.277576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0d1d5055-dc9e-43f1-92f1-d72f1080f50f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:46.291746 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0d1d5055-dc9e-43f1-92f1-d72f1080f50f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.406805 Oct 18 13:39:46.293658 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2422/5113] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:45 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:46.889806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b270a1f2-2d74-4a7c-8fae-6198964a3db9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:46.890470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b270a1f2-2d74-4a7c-8fae-6198964a3db9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:46.904334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:46.906204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b270a1f2-2d74-4a7c-8fae-6198964a3db9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:46.906699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b270a1f2-2d74-4a7c-8fae-6198964a3db9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:46.907135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b270a1f2-2d74-4a7c-8fae-6198964a3db9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:46.911345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b270a1f2-2d74-4a7c-8fae-6198964a3db9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:46.912114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b270a1f2-2d74-4a7c-8fae-6198964a3db9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:46.913378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b270a1f2-2d74-4a7c-8fae-6198964a3db9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:47.261736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Getting quotas for project f983dc605d28409f93a8f4234519773c. Resources: dict_keys(['metadata_items']) {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:39:47.278909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Getting quotas for user b4bf03bdfd0e4cecb7e90ca3c7c97ad4 and project f983dc605d28409f93a8f4234519773c. Resources: dict_keys(['metadata_items']) {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:39:47.314995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:39:47.322167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:39:47.322928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:39:47.323536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:39:47.324723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:39:47.352966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:47.354114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:47.354574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:47.355332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:47.355796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:47.356229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:47.435623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Getting quotas for project f983dc605d28409f93a8f4234519773c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:39:47.472031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Getting quotas for user b4bf03bdfd0e4cecb7e90ca3c7c97ad4 and project f983dc605d28409f93a8f4234519773c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:39:47.610222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:39:47.612569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='224e16be-099a-439a-b235-2abd43436e6b',volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:39:47.627107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b270a1f2-2d74-4a7c-8fae-6198964a3db9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:47.644654 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b270a1f2-2d74-4a7c-8fae-6198964a3db9 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.758192 Oct 18 13:39:47.661715 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2423/5114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:46 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:47.677993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-feee2157-f5de-469f-9662-1590188b2c68 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b7a1ed8-130b-42ad-86b4-bbb9799840d4"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:47.687249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-feee2157-f5de-469f-9662-1590188b2c68 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:47.703939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-feee2157-f5de-469f-9662-1590188b2c68 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:47.705342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-feee2157-f5de-469f-9662-1590188b2c68 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:47.706154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-feee2157-f5de-469f-9662-1590188b2c68 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:47.707855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-feee2157-f5de-469f-9662-1590188b2c68 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:47.708658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-feee2157-f5de-469f-9662-1590188b2c68 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:47.709618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-feee2157-f5de-469f-9662-1590188b2c68 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:47.949349 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ef0106ef-7b28-431d-a8da-3f43dfb56ee9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.532096 Oct 18 13:39:47.950016 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2692/5115] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:39:45 2022] POST /compute/v2.1/servers => generated 407 bytes in 2534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:39:47.955237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f3e22a42-7bd8-4dbb-8573-a7fb34037ccb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:47.963427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f3e22a42-7bd8-4dbb-8573-a7fb34037ccb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:47.983799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3e22a42-7bd8-4dbb-8573-a7fb34037ccb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:47.985481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3e22a42-7bd8-4dbb-8573-a7fb34037ccb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:47.986242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3e22a42-7bd8-4dbb-8573-a7fb34037ccb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:47.987164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3e22a42-7bd8-4dbb-8573-a7fb34037ccb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:47.992027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3e22a42-7bd8-4dbb-8573-a7fb34037ccb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:47.992983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3e22a42-7bd8-4dbb-8573-a7fb34037ccb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:48.264772 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-feee2157-f5de-469f-9662-1590188b2c68 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601637 Oct 18 13:39:48.265858 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2424/5116] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:39:47 2022] POST /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments => generated 194 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:48.302103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8ba1e08f-30de-49e4-aede-9e98d3f3b0ae tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:48.302927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8ba1e08f-30de-49e4-aede-9e98d3f3b0ae tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:48.433572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8ba1e08f-30de-49e4-aede-9e98d3f3b0ae tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:48.443933 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8ba1e08f-30de-49e4-aede-9e98d3f3b0ae tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1122 microversion: 2.1 time: 0.176600 Oct 18 13:39:48.444551 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2425/5117] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:48 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1122 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:48.529132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f3e22a42-7bd8-4dbb-8573-a7fb34037ccb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:48.546769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f3e22a42-7bd8-4dbb-8573-a7fb34037ccb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:48.548706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f3e22a42-7bd8-4dbb-8573-a7fb34037ccb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:48.552932 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f3e22a42-7bd8-4dbb-8573-a7fb34037ccb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1738 microversion: 2.20 time: 0.601616 Oct 18 13:39:48.559775 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2693/5118] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:47 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1738 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:48.678802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-502b352f-566c-4835-bd16-73446f9c709f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:48.679797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-502b352f-566c-4835-bd16-73446f9c709f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:48.697149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-502b352f-566c-4835-bd16-73446f9c709f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:48.698300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-502b352f-566c-4835-bd16-73446f9c709f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:48.699813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-502b352f-566c-4835-bd16-73446f9c709f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:48.702167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-502b352f-566c-4835-bd16-73446f9c709f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:48.704274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-502b352f-566c-4835-bd16-73446f9c709f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:48.704924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-502b352f-566c-4835-bd16-73446f9c709f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:49.313164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-502b352f-566c-4835-bd16-73446f9c709f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:49.324874 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-502b352f-566c-4835-bd16-73446f9c709f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.655211 Oct 18 13:39:49.337961 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2426/5119] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:48 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:49.477879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-086dcb94-f284-45a5-bd92-6e6ff8877262 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:49.478507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-086dcb94-f284-45a5-bd92-6e6ff8877262 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:49.508162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-086dcb94-f284-45a5-bd92-6e6ff8877262 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:49.508970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-086dcb94-f284-45a5-bd92-6e6ff8877262 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:49.513922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-086dcb94-f284-45a5-bd92-6e6ff8877262 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:49.518315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-086dcb94-f284-45a5-bd92-6e6ff8877262 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:49.521554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-086dcb94-f284-45a5-bd92-6e6ff8877262 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:49.523822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-086dcb94-f284-45a5-bd92-6e6ff8877262 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:49.587956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a25e4566-3c48-48bc-b55a-c5c65792b914 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:49.588767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a25e4566-3c48-48bc-b55a-c5c65792b914 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:49.599834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25e4566-3c48-48bc-b55a-c5c65792b914 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:49.607461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25e4566-3c48-48bc-b55a-c5c65792b914 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:49.607738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25e4566-3c48-48bc-b55a-c5c65792b914 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:49.608835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25e4566-3c48-48bc-b55a-c5c65792b914 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:49.610712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25e4566-3c48-48bc-b55a-c5c65792b914 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:49.614809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25e4566-3c48-48bc-b55a-c5c65792b914 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:49.735983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-086dcb94-f284-45a5-bd92-6e6ff8877262 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:49.772015 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-086dcb94-f284-45a5-bd92-6e6ff8877262 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1164 microversion: 2.1 time: 0.294651 Oct 18 13:39:49.775992 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2694/5120] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:49 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1164 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:50.350098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cad76486-a4ca-4971-bd60-e3c87fef1b8f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:50.350728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cad76486-a4ca-4971-bd60-e3c87fef1b8f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:50.360368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cad76486-a4ca-4971-bd60-e3c87fef1b8f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:50.360867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cad76486-a4ca-4971-bd60-e3c87fef1b8f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:50.361344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cad76486-a4ca-4971-bd60-e3c87fef1b8f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:50.362056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cad76486-a4ca-4971-bd60-e3c87fef1b8f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:50.362513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cad76486-a4ca-4971-bd60-e3c87fef1b8f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:50.363017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cad76486-a4ca-4971-bd60-e3c87fef1b8f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:50.448047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a25e4566-3c48-48bc-b55a-c5c65792b914 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:50.459491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a25e4566-3c48-48bc-b55a-c5c65792b914 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:50.460952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a25e4566-3c48-48bc-b55a-c5c65792b914 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:50.462197 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a25e4566-3c48-48bc-b55a-c5c65792b914 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1720 microversion: 2.20 time: 0.878508 Oct 18 13:39:50.479494 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2427/5121] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:49 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1720 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:50.709744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cad76486-a4ca-4971-bd60-e3c87fef1b8f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:50.720968 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cad76486-a4ca-4971-bd60-e3c87fef1b8f tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1510 microversion: 2.1 time: 0.375056 Oct 18 13:39:50.722070 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2695/5122] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:50 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:50.802688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f44db0e5-7aa7-4ce0-b234-bda9e0b57513 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:50.803324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f44db0e5-7aa7-4ce0-b234-bda9e0b57513 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:50.813251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f44db0e5-7aa7-4ce0-b234-bda9e0b57513 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:50.813757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f44db0e5-7aa7-4ce0-b234-bda9e0b57513 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:50.819497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f44db0e5-7aa7-4ce0-b234-bda9e0b57513 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:50.820599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f44db0e5-7aa7-4ce0-b234-bda9e0b57513 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:50.825686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f44db0e5-7aa7-4ce0-b234-bda9e0b57513 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:50.826419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f44db0e5-7aa7-4ce0-b234-bda9e0b57513 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:51.036345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f44db0e5-7aa7-4ce0-b234-bda9e0b57513 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:51.053480 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f44db0e5-7aa7-4ce0-b234-bda9e0b57513 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1228 microversion: 2.1 time: 0.256088 Oct 18 13:39:51.056244 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2428/5123] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:50 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1228 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:51.492316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-40ee056e-fcef-4ac0-94f8-b166e636a7d3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:51.492934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-40ee056e-fcef-4ac0-94f8-b166e636a7d3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:51.517396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40ee056e-fcef-4ac0-94f8-b166e636a7d3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:51.517919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40ee056e-fcef-4ac0-94f8-b166e636a7d3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:51.518354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40ee056e-fcef-4ac0-94f8-b166e636a7d3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:51.519964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40ee056e-fcef-4ac0-94f8-b166e636a7d3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:51.522158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40ee056e-fcef-4ac0-94f8-b166e636a7d3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:51.532422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40ee056e-fcef-4ac0-94f8-b166e636a7d3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:51.750826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-08b0f46e-7a1c-49fb-b35e-3fe824aa0f10 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:51.751482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-08b0f46e-7a1c-49fb-b35e-3fe824aa0f10 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:51.763274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08b0f46e-7a1c-49fb-b35e-3fe824aa0f10 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:51.764064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08b0f46e-7a1c-49fb-b35e-3fe824aa0f10 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:51.765345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08b0f46e-7a1c-49fb-b35e-3fe824aa0f10 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:51.768730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08b0f46e-7a1c-49fb-b35e-3fe824aa0f10 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:51.770071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08b0f46e-7a1c-49fb-b35e-3fe824aa0f10 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:51.775702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08b0f46e-7a1c-49fb-b35e-3fe824aa0f10 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:52.147161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-08b0f46e-7a1c-49fb-b35e-3fe824aa0f10 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:52.158300 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-08b0f46e-7a1c-49fb-b35e-3fe824aa0f10 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1487 microversion: 2.1 time: 0.411509 Oct 18 13:39:52.162281 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2429/5124] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:51 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1487 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:52.168569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-957c80bd-d006-4c77-818e-0a14c459f606 req-8bacfdbb-7b41-4912-8bb1-d613b2c9fbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c5c389-b7a1-4170-9b5c-321066d048e1", "name": "network-vif-unplugged", "status": "completed", "tag": "74f52242-e00e-46f0-a3ba-47fe1d3cac8e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:52.206009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-957c80bd-d006-4c77-818e-0a14c459f606 req-8bacfdbb-7b41-4912-8bb1-d613b2c9fbd3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:52.208698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-957c80bd-d006-4c77-818e-0a14c459f606 req-8bacfdbb-7b41-4912-8bb1-d613b2c9fbd3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:52.209360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-957c80bd-d006-4c77-818e-0a14c459f606 req-8bacfdbb-7b41-4912-8bb1-d613b2c9fbd3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:52.236347 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-957c80bd-d006-4c77-818e-0a14c459f606 req-8bacfdbb-7b41-4912-8bb1-d613b2c9fbd3 service nova] Creating event network-vif-unplugged:74f52242-e00e-46f0-a3ba-47fe1d3cac8e for instance 31c5c389-b7a1-4170-9b5c-321066d048e1 on n-h1-858384-13 Oct 18 13:39:52.251238 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-957c80bd-d006-4c77-818e-0a14c459f606 req-8bacfdbb-7b41-4912-8bb1-d613b2c9fbd3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085286 Oct 18 13:39:52.252061 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2430/5125] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:52.267179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9b21fad2-a816-4c0e-bd35-d33343391a67 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:52.268128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9b21fad2-a816-4c0e-bd35-d33343391a67 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:52.288176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b21fad2-a816-4c0e-bd35-d33343391a67 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:52.288915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b21fad2-a816-4c0e-bd35-d33343391a67 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:52.289560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b21fad2-a816-4c0e-bd35-d33343391a67 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:52.290441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b21fad2-a816-4c0e-bd35-d33343391a67 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:52.291066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b21fad2-a816-4c0e-bd35-d33343391a67 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:52.291846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b21fad2-a816-4c0e-bd35-d33343391a67 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:52.478587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-40ee056e-fcef-4ac0-94f8-b166e636a7d3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:52.482803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9b21fad2-a816-4c0e-bd35-d33343391a67 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:52.491862 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9b21fad2-a816-4c0e-bd35-d33343391a67 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1238 microversion: 2.1 time: 0.235733 Oct 18 13:39:52.492141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-40ee056e-fcef-4ac0-94f8-b166e636a7d3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:52.493362 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2431/5126] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:52 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1238 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:52.494179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-40ee056e-fcef-4ac0-94f8-b166e636a7d3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:52.495695 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-40ee056e-fcef-4ac0-94f8-b166e636a7d3 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1720 microversion: 2.20 time: 1.012347 Oct 18 13:39:52.506380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-428622a2-d017-4a0b-a7ef-3e70240cc309 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-286953088"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:52.509691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-428622a2-d017-4a0b-a7ef-3e70240cc309 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:52.509988 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2696/5127] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:51 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1720 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:52.516544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-428622a2-d017-4a0b-a7ef-3e70240cc309 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:52.517641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-428622a2-d017-4a0b-a7ef-3e70240cc309 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:52.519620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-428622a2-d017-4a0b-a7ef-3e70240cc309 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:52.521208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-428622a2-d017-4a0b-a7ef-3e70240cc309 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:52.521909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-428622a2-d017-4a0b-a7ef-3e70240cc309 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:52.522826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-428622a2-d017-4a0b-a7ef-3e70240cc309 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:52.623300 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-428622a2-d017-4a0b-a7ef-3e70240cc309 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "PUT /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1059 microversion: 2.1 time: 0.127722 Oct 18 13:39:52.623959 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2432/5128] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 18 13:39:52 2022] PUT /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1059 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:52.645795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c5eceab4-34f5-402d-aea9-aeaa17a134ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:52.646654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c5eceab4-34f5-402d-aea9-aeaa17a134ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:52.659036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5eceab4-34f5-402d-aea9-aeaa17a134ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:52.661154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5eceab4-34f5-402d-aea9-aeaa17a134ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:52.662251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5eceab4-34f5-402d-aea9-aeaa17a134ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:52.663402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5eceab4-34f5-402d-aea9-aeaa17a134ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:52.664536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5eceab4-34f5-402d-aea9-aeaa17a134ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:52.670991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5eceab4-34f5-402d-aea9-aeaa17a134ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:53.293438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c5eceab4-34f5-402d-aea9-aeaa17a134ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:53.309028 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c5eceab4-34f5-402d-aea9-aeaa17a134ec tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1486 microversion: 2.1 time: 0.668317 Oct 18 13:39:53.317440 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2697/5129] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:52 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1486 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:53.346689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5563e75e-655d-4d7f-b6c9-d710e8b31521 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:53.347860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5563e75e-655d-4d7f-b6c9-d710e8b31521 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:53.361043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5563e75e-655d-4d7f-b6c9-d710e8b31521 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:53.363907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5563e75e-655d-4d7f-b6c9-d710e8b31521 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:53.364555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5563e75e-655d-4d7f-b6c9-d710e8b31521 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:53.366717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5563e75e-655d-4d7f-b6c9-d710e8b31521 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:53.367482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5563e75e-655d-4d7f-b6c9-d710e8b31521 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:53.373748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5563e75e-655d-4d7f-b6c9-d710e8b31521 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:53.515680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-354b4d0c-0c13-48ee-aa3d-a8340706d0b3 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:53.516982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-354b4d0c-0c13-48ee-aa3d-a8340706d0b3 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:53.530443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-354b4d0c-0c13-48ee-aa3d-a8340706d0b3 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:53.538424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-354b4d0c-0c13-48ee-aa3d-a8340706d0b3 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:53.539794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-354b4d0c-0c13-48ee-aa3d-a8340706d0b3 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:53.544374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-354b4d0c-0c13-48ee-aa3d-a8340706d0b3 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:53.548846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-354b4d0c-0c13-48ee-aa3d-a8340706d0b3 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:53.549581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-354b4d0c-0c13-48ee-aa3d-a8340706d0b3 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:53.718852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5563e75e-655d-4d7f-b6c9-d710e8b31521 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:53.732450 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5563e75e-655d-4d7f-b6c9-d710e8b31521 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1486 microversion: 2.1 time: 0.390498 Oct 18 13:39:53.735353 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2433/5130] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:53 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1486 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:53.748975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f753431-cb43-4ce4-a0f8-1f9a3b7949a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:53.750128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7f753431-cb43-4ce4-a0f8-1f9a3b7949a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:53.764984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f753431-cb43-4ce4-a0f8-1f9a3b7949a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:53.766668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f753431-cb43-4ce4-a0f8-1f9a3b7949a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:53.767290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f753431-cb43-4ce4-a0f8-1f9a3b7949a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:53.769478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f753431-cb43-4ce4-a0f8-1f9a3b7949a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:53.772046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f753431-cb43-4ce4-a0f8-1f9a3b7949a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:53.774053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f753431-cb43-4ce4-a0f8-1f9a3b7949a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:53.964852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7f753431-cb43-4ce4-a0f8-1f9a3b7949a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:53.979627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7f753431-cb43-4ce4-a0f8-1f9a3b7949a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:53.981905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7f753431-cb43-4ce4-a0f8-1f9a3b7949a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:53.983266 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7f753431-cb43-4ce4-a0f8-1f9a3b7949a7 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1663 microversion: 2.20 time: 0.244409 Oct 18 13:39:53.984498 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2434/5131] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:39:53 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1663 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:39:53.990672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-019cb49d-9ecb-463d-9cb5-1a7d7fdd5669 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:53.991446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-019cb49d-9ecb-463d-9cb5-1a7d7fdd5669 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:53.998506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-019cb49d-9ecb-463d-9cb5-1a7d7fdd5669 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:53.999514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-019cb49d-9ecb-463d-9cb5-1a7d7fdd5669 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:54.000316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-019cb49d-9ecb-463d-9cb5-1a7d7fdd5669 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:54.001254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-019cb49d-9ecb-463d-9cb5-1a7d7fdd5669 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:54.001909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-019cb49d-9ecb-463d-9cb5-1a7d7fdd5669 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:54.002559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-019cb49d-9ecb-463d-9cb5-1a7d7fdd5669 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:54.018218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-354b4d0c-0c13-48ee-aa3d-a8340706d0b3 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:54.035132 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-354b4d0c-0c13-48ee-aa3d-a8340706d0b3 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1238 microversion: 2.1 time: 0.518882 Oct 18 13:39:54.035264 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2698/5132] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:53 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1238 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:54.043915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-768cead2-3e79-4101-8027-e2ca05be0461 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba198014-a757-4928-95ff-f49326a7c56c"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:54.055905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-768cead2-3e79-4101-8027-e2ca05be0461 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:54.072305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-019cb49d-9ecb-463d-9cb5-1a7d7fdd5669 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:39:54.073272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768cead2-3e79-4101-8027-e2ca05be0461 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:54.073969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768cead2-3e79-4101-8027-e2ca05be0461 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:54.077073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768cead2-3e79-4101-8027-e2ca05be0461 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:54.078046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768cead2-3e79-4101-8027-e2ca05be0461 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:54.078676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768cead2-3e79-4101-8027-e2ca05be0461 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:54.079293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768cead2-3e79-4101-8027-e2ca05be0461 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:54.244784 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-019cb49d-9ecb-463d-9cb5-1a7d7fdd5669 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 204 len: 0 microversion: 2.1 time: 0.258612 Oct 18 13:39:54.246182 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2435/5133] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:39:53 2022] DELETE /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:39:54.261611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9eb7a0b5-288e-48b1-9d9a-374085b1bbe3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:54.262630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9eb7a0b5-288e-48b1-9d9a-374085b1bbe3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:54.270858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eb7a0b5-288e-48b1-9d9a-374085b1bbe3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:54.271379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eb7a0b5-288e-48b1-9d9a-374085b1bbe3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:54.271820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eb7a0b5-288e-48b1-9d9a-374085b1bbe3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:54.272553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eb7a0b5-288e-48b1-9d9a-374085b1bbe3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:54.273009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eb7a0b5-288e-48b1-9d9a-374085b1bbe3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:54.273733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eb7a0b5-288e-48b1-9d9a-374085b1bbe3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:54.450836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9eb7a0b5-288e-48b1-9d9a-374085b1bbe3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:54.466118 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9eb7a0b5-288e-48b1-9d9a-374085b1bbe3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1492 microversion: 2.1 time: 0.210597 Oct 18 13:39:54.470260 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2436/5134] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:54 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1492 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:54.835249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d40018ff-2403-43e9-9d18-90f2f9e0e87d tempest-QuotasTestJSON-1010724598 tempest-QuotasTestJSON-1010724598-project] Calling method '.version_select at 0x7ff60ee3bf70>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:54.908158 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d40018ff-2403-43e9-9d18-90f2f9e0e87d tempest-QuotasTestJSON-1010724598 tempest-QuotasTestJSON-1010724598-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4f34f0d5770b41899fdb131953b9c514/defaults" status: 200 len: 371 microversion: 2.1 time: 0.277955 Oct 18 13:39:54.910093 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2437/5135] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:39:54 2022] GET /compute/v2.1/os-quota-sets/4f34f0d5770b41899fdb131953b9c514/defaults => generated 371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:39:54.922334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-58c2da9c-7e80-4f44-963b-9e0be2e40e28 tempest-QuotasTestJSON-1010724598 tempest-QuotasTestJSON-1010724598-project] Calling method '.version_select at 0x7ff60f727a60>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:55.019844 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-58c2da9c-7e80-4f44-963b-9e0be2e40e28 tempest-QuotasTestJSON-1010724598 tempest-QuotasTestJSON-1010724598-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4f34f0d5770b41899fdb131953b9c514" status: 200 len: 371 microversion: 2.1 time: 0.101617 Oct 18 13:39:55.029258 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2438/5136] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 18 13:39:54 2022] GET /compute/v2.1/os-quota-sets/4f34f0d5770b41899fdb131953b9c514 => generated 371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:55.045015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8aac892e-a335-441d-9ad5-806d7a27bc8d tempest-QuotasTestJSON-1010724598 tempest-QuotasTestJSON-1010724598-project] Calling method '.version_select at 0x7ff60f05fd30>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:55.135522 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8aac892e-a335-441d-9ad5-806d7a27bc8d tempest-QuotasTestJSON-1010724598 tempest-QuotasTestJSON-1010724598-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4f34f0d5770b41899fdb131953b9c514/defaults" status: 200 len: 371 microversion: 2.1 time: 0.095119 Oct 18 13:39:55.136133 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2439/5137] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:39:55 2022] GET /compute/v2.1/os-quota-sets/4f34f0d5770b41899fdb131953b9c514/defaults => generated 371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:39:55.154515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d7bcc53c-9b12-4fdf-9915-ae0fcd12c5bb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:55.155239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d7bcc53c-9b12-4fdf-9915-ae0fcd12c5bb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:55.164819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7bcc53c-9b12-4fdf-9915-ae0fcd12c5bb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:55.165578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7bcc53c-9b12-4fdf-9915-ae0fcd12c5bb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:55.166202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7bcc53c-9b12-4fdf-9915-ae0fcd12c5bb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:55.167138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7bcc53c-9b12-4fdf-9915-ae0fcd12c5bb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:55.167759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7bcc53c-9b12-4fdf-9915-ae0fcd12c5bb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:55.168347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7bcc53c-9b12-4fdf-9915-ae0fcd12c5bb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:55.217325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:55.579886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d7bcc53c-9b12-4fdf-9915-ae0fcd12c5bb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:55.596038 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d7bcc53c-9b12-4fdf-9915-ae0fcd12c5bb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1306 microversion: 2.1 time: 0.458622 Oct 18 13:39:55.599115 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2440/5138] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:55 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1306 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:55.616750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-60447af0-d6f5-4bbf-a196-dcef26e720ca tempest-QuotasTestJSON-1010724598 tempest-QuotasTestJSON-1010724598-project] Calling method '.version_select at 0x7ff60ecf6ee0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:55.718647 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-60447af0-d6f5-4bbf-a196-dcef26e720ca tempest-QuotasTestJSON-1010724598 tempest-QuotasTestJSON-1010724598-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4f34f0d5770b41899fdb131953b9c514" status: 200 len: 371 microversion: 2.1 time: 0.116103 Oct 18 13:39:55.719318 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2441/5139] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 18 13:39:55 2022] GET /compute/v2.1/os-quota-sets/4f34f0d5770b41899fdb131953b9c514 => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:55.725433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-55125b2a-8a03-4235-ad9a-bbc11fe1a09b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:55.726541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-55125b2a-8a03-4235-ad9a-bbc11fe1a09b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:55.734503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55125b2a-8a03-4235-ad9a-bbc11fe1a09b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:55.735004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55125b2a-8a03-4235-ad9a-bbc11fe1a09b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:55.735445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55125b2a-8a03-4235-ad9a-bbc11fe1a09b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:55.736156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55125b2a-8a03-4235-ad9a-bbc11fe1a09b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:55.737072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55125b2a-8a03-4235-ad9a-bbc11fe1a09b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:55.738282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55125b2a-8a03-4235-ad9a-bbc11fe1a09b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:55.965342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-55125b2a-8a03-4235-ad9a-bbc11fe1a09b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:55.980255 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-55125b2a-8a03-4235-ad9a-bbc11fe1a09b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1492 microversion: 2.1 time: 0.259408 Oct 18 13:39:55.980784 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2442/5140] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:55 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1492 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:56.007418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-750679a7-3f78-48af-aa69-9922481b4bb5 req-f1f4f103-8827-4b58-b874-6c938c6f0e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38401f91-0034-4290-b61d-0a09ae076c2e", "tag": "1c58069a-78e6-4d67-9725-0f6c1f442cb7"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:56.020035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-750679a7-3f78-48af-aa69-9922481b4bb5 req-f1f4f103-8827-4b58-b874-6c938c6f0e78 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:56.020498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-750679a7-3f78-48af-aa69-9922481b4bb5 req-f1f4f103-8827-4b58-b874-6c938c6f0e78 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:56.020938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-750679a7-3f78-48af-aa69-9922481b4bb5 req-f1f4f103-8827-4b58-b874-6c938c6f0e78 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:56.036013 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-750679a7-3f78-48af-aa69-9922481b4bb5 req-f1f4f103-8827-4b58-b874-6c938c6f0e78 service nova] Creating event network-changed:1c58069a-78e6-4d67-9725-0f6c1f442cb7 for instance 38401f91-0034-4290-b61d-0a09ae076c2e on n-h1-858384-13 Oct 18 13:39:56.041293 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-750679a7-3f78-48af-aa69-9922481b4bb5 req-f1f4f103-8827-4b58-b874-6c938c6f0e78 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049860 Oct 18 13:39:56.042042 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2443/5141] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:56.047330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6fb0e860-43dc-4281-974c-0abfad18c4ea tempest-QuotasTestJSON-1010724598 tempest-QuotasTestJSON-1010724598-project] Calling method '.version_select at 0x7ff60f700f70>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:56.151568 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6fb0e860-43dc-4281-974c-0abfad18c4ea tempest-QuotasTestJSON-1010724598 tempest-QuotasTestJSON-1010724598-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/4f34f0d5770b41899fdb131953b9c514?user_id=46a162406ad14856891502597beec36f" status: 200 len: 371 microversion: 2.1 time: 0.108131 Oct 18 13:39:56.166193 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2444/5142] 10.222.0.40 () {58 vars in 1323 bytes} [Tue Oct 18 13:39:56 2022] GET /compute/v2.1/os-quota-sets/4f34f0d5770b41899fdb131953b9c514?user_id=46a162406ad14856891502597beec36f => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:56.508465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-1bd3b802-5a08-419a-a333-bde76bea9fe7 req-fce2522f-9276-4c4b-8ddc-499f3b356c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a865aaeb-2ccf-4e3b-8173-3cecee1686ca", "name": "network-vif-deleted", "tag": "5dfedc45-3aa3-41f1-aab3-0bd985a2297a"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:39:56.536697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1bd3b802-5a08-419a-a333-bde76bea9fe7 req-fce2522f-9276-4c4b-8ddc-499f3b356c83 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:56.537200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1bd3b802-5a08-419a-a333-bde76bea9fe7 req-fce2522f-9276-4c4b-8ddc-499f3b356c83 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:56.554033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1bd3b802-5a08-419a-a333-bde76bea9fe7 req-fce2522f-9276-4c4b-8ddc-499f3b356c83 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:56.572169 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-1bd3b802-5a08-419a-a333-bde76bea9fe7 req-fce2522f-9276-4c4b-8ddc-499f3b356c83 service nova] Creating event network-vif-deleted:5dfedc45-3aa3-41f1-aab3-0bd985a2297a for instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca on n-h2-858384-13 Oct 18 13:39:56.598348 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-1bd3b802-5a08-419a-a333-bde76bea9fe7 req-fce2522f-9276-4c4b-8ddc-499f3b356c83 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093682 Oct 18 13:39:56.599305 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2445/5143] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:39:56.637210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-889d5bb2-2ca7-41f0-b89e-694c6e1e61f5 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:56.638235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-889d5bb2-2ca7-41f0-b89e-694c6e1e61f5 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:56.648916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-889d5bb2-2ca7-41f0-b89e-694c6e1e61f5 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:56.653503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-889d5bb2-2ca7-41f0-b89e-694c6e1e61f5 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:56.654288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-889d5bb2-2ca7-41f0-b89e-694c6e1e61f5 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:56.655214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-889d5bb2-2ca7-41f0-b89e-694c6e1e61f5 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:56.659073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-889d5bb2-2ca7-41f0-b89e-694c6e1e61f5 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:56.659941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-889d5bb2-2ca7-41f0-b89e-694c6e1e61f5 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:56.983589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-889d5bb2-2ca7-41f0-b89e-694c6e1e61f5 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:56.996399 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-889d5bb2-2ca7-41f0-b89e-694c6e1e61f5 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1306 microversion: 2.1 time: 0.374103 Oct 18 13:39:56.997405 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2446/5144] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:56 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1306 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:57.016667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:57.017474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:57.027225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:57.027774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:57.028556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:57.030243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:57.031646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:57.032343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:57.078626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:57.079415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:57.080166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:57.080770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lazy-loading 'fault' on Instance uuid a865aaeb-2ccf-4e3b-8173-3cecee1686ca {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:39:57.281143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:57.297967 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-04a8d4d2-f6ac-4686-bcfc-34c692f6fe0e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 200 len: 1309 microversion: 2.1 time: 0.295231 Oct 18 13:39:57.298785 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2447/5145] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:57 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 1309 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:39:57.387594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:57.501908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=10 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:58.021274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ba8fd55a-8289-4f4a-869d-bfa6fd931680 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.021893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ba8fd55a-8289-4f4a-869d-bfa6fd931680 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.030914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba8fd55a-8289-4f4a-869d-bfa6fd931680 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.033783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba8fd55a-8289-4f4a-869d-bfa6fd931680 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.036332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba8fd55a-8289-4f4a-869d-bfa6fd931680 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.041409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba8fd55a-8289-4f4a-869d-bfa6fd931680 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.042494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba8fd55a-8289-4f4a-869d-bfa6fd931680 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.044716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba8fd55a-8289-4f4a-869d-bfa6fd931680 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.258840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ba8fd55a-8289-4f4a-869d-bfa6fd931680 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:58.270758 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ba8fd55a-8289-4f4a-869d-bfa6fd931680 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1306 microversion: 2.1 time: 0.253844 Oct 18 13:39:58.271651 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2448/5146] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:58 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1306 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:58.322911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-638fb76f-3d47-4be7-be37-e08dfc175278 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.323929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-638fb76f-3d47-4be7-be37-e08dfc175278 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.330364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-638fb76f-3d47-4be7-be37-e08dfc175278 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.331052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-638fb76f-3d47-4be7-be37-e08dfc175278 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.332304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-638fb76f-3d47-4be7-be37-e08dfc175278 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.333381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-638fb76f-3d47-4be7-be37-e08dfc175278 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.333838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-638fb76f-3d47-4be7-be37-e08dfc175278 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.334435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-638fb76f-3d47-4be7-be37-e08dfc175278 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.351351 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-638fb76f-3d47-4be7-be37-e08dfc175278 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-638fb76f-3d47-4be7-be37-e08dfc175278 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca HTTP/1.1 Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'a865aaeb-2ccf-4e3b-8173-3cecee1686ca'} Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.353477 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.358571 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.358571 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.358571 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:58.358571 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:58.358571 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.358571 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.360408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-638fb76f-3d47-4be7-be37-e08dfc175278 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:58.361918 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-638fb76f-3d47-4be7-be37-e08dfc175278 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 404 len: 111 microversion: 2.1 time: 0.043031 Oct 18 13:39:58.363539 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2449/5147] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:58 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:39:58.383246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68d4fca1-0010-4460-8afa-c73046419d6e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.383995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-68d4fca1-0010-4460-8afa-c73046419d6e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.392788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68d4fca1-0010-4460-8afa-c73046419d6e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.393562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68d4fca1-0010-4460-8afa-c73046419d6e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.395233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68d4fca1-0010-4460-8afa-c73046419d6e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.396207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68d4fca1-0010-4460-8afa-c73046419d6e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.397229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68d4fca1-0010-4460-8afa-c73046419d6e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.398026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68d4fca1-0010-4460-8afa-c73046419d6e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.424733 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-68d4fca1-0010-4460-8afa-c73046419d6e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68d4fca1-0010-4460-8afa-c73046419d6e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca HTTP/1.1 Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'a865aaeb-2ccf-4e3b-8173-3cecee1686ca'} Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:58.426647 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.430927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.430927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.430927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.430927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.430927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.430927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.430927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:58.430927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:58.430927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.430927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.431669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68d4fca1-0010-4460-8afa-c73046419d6e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:58.432598 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-68d4fca1-0010-4460-8afa-c73046419d6e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 404 len: 111 microversion: 2.1 time: 0.054826 Oct 18 13:39:58.438926 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2450/5148] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:39:58 2022] DELETE /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:58.448188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7fc2958c-b147-400a-8cd2-680ebf1d726c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.449356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7fc2958c-b147-400a-8cd2-680ebf1d726c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: a865aaeb-2ccf-4e3b-8173-3cecee1686ca] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.462529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fc2958c-b147-400a-8cd2-680ebf1d726c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.463304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fc2958c-b147-400a-8cd2-680ebf1d726c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.464158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fc2958c-b147-400a-8cd2-680ebf1d726c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.465239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fc2958c-b147-400a-8cd2-680ebf1d726c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.465983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fc2958c-b147-400a-8cd2-680ebf1d726c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.466630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fc2958c-b147-400a-8cd2-680ebf1d726c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.486871 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-7fc2958c-b147-400a-8cd2-680ebf1d726c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7fc2958c-b147-400a-8cd2-680ebf1d726c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca HTTP/1.1 Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'a865aaeb-2ccf-4e3b-8173-3cecee1686ca'} Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.489115 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.493209 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.493209 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.493209 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:58.493209 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:58.493209 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. Oct 18 13:39:58.493209 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.495351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7fc2958c-b147-400a-8cd2-680ebf1d726c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance a865aaeb-2ccf-4e3b-8173-3cecee1686ca could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:58.496451 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7fc2958c-b147-400a-8cd2-680ebf1d726c tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca" status: 404 len: 111 microversion: 2.1 time: 0.056092 Oct 18 13:39:58.500578 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2451/5149] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:58 2022] GET /compute/v2.1/servers/a865aaeb-2ccf-4e3b-8173-3cecee1686ca => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:58.507255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b63c05ce-2fa0-4e71-bc00-9069a3c1bb32 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.507978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b63c05ce-2fa0-4e71-bc00-9069a3c1bb32 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.516020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b63c05ce-2fa0-4e71-bc00-9069a3c1bb32 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.517072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b63c05ce-2fa0-4e71-bc00-9069a3c1bb32 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.517959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b63c05ce-2fa0-4e71-bc00-9069a3c1bb32 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.519535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b63c05ce-2fa0-4e71-bc00-9069a3c1bb32 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.521029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b63c05ce-2fa0-4e71-bc00-9069a3c1bb32 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.521677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b63c05ce-2fa0-4e71-bc00-9069a3c1bb32 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.545672 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-b63c05ce-2fa0-4e71-bc00-9069a3c1bb32 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b63c05ce-2fa0-4e71-bc00-9069a3c1bb32 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 HTTP/1.1 Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'bf413a26-7de3-4662-acbf-b8434b9a73b8'} Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:58.548376 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:39:58.552663 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.552663 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.552663 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.552663 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.552663 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.552663 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.552663 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:58.552663 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:58.552663 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:39:58.552663 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.556852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b63c05ce-2fa0-4e71-bc00-9069a3c1bb32 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:58.558023 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b63c05ce-2fa0-4e71-bc00-9069a3c1bb32 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 404 len: 111 microversion: 2.1 time: 0.056196 Oct 18 13:39:58.559151 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2452/5150] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:39:58 2022] DELETE /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:58.569292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d761492c-fa03-4dc4-9980-05d8896d177b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.570298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d761492c-fa03-4dc4-9980-05d8896d177b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: bf413a26-7de3-4662-acbf-b8434b9a73b8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.576873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d761492c-fa03-4dc4-9980-05d8896d177b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.577544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d761492c-fa03-4dc4-9980-05d8896d177b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.578056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d761492c-fa03-4dc4-9980-05d8896d177b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.578833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d761492c-fa03-4dc4-9980-05d8896d177b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.579360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d761492c-fa03-4dc4-9980-05d8896d177b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.579884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d761492c-fa03-4dc4-9980-05d8896d177b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.596411 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-d761492c-fa03-4dc4-9980-05d8896d177b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d761492c-fa03-4dc4-9980-05d8896d177b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 HTTP/1.1 Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'bf413a26-7de3-4662-acbf-b8434b9a73b8'} Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.598451 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.603134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.603134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.603134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:58.603134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:58.603134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. Oct 18 13:39:58.603134 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.603134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d761492c-fa03-4dc4-9980-05d8896d177b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance bf413a26-7de3-4662-acbf-b8434b9a73b8 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:58.603134 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d761492c-fa03-4dc4-9980-05d8896d177b tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8" status: 404 len: 111 microversion: 2.1 time: 0.036660 Oct 18 13:39:58.603134 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2453/5151] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:58 2022] GET /compute/v2.1/servers/bf413a26-7de3-4662-acbf-b8434b9a73b8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:58.609267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4787c1af-f467-4844-a913-59ec968119a3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.609901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4787c1af-f467-4844-a913-59ec968119a3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.619497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4787c1af-f467-4844-a913-59ec968119a3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.620882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4787c1af-f467-4844-a913-59ec968119a3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.621484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4787c1af-f467-4844-a913-59ec968119a3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.622753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4787c1af-f467-4844-a913-59ec968119a3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.622917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4787c1af-f467-4844-a913-59ec968119a3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.623513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4787c1af-f467-4844-a913-59ec968119a3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.645760 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-4787c1af-f467-4844-a913-59ec968119a3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4787c1af-f467-4844-a913-59ec968119a3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 HTTP/1.1 Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c049bc0a-fc7b-4d5a-8bca-c4ef951070e5'} Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:58.647609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:39:58.652333 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.652333 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.652333 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.652333 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.652333 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.652333 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.652333 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:58.652333 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:58.652333 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:39:58.652333 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.652333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4787c1af-f467-4844-a913-59ec968119a3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:58.652333 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4787c1af-f467-4844-a913-59ec968119a3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 404 len: 111 microversion: 2.1 time: 0.045398 Oct 18 13:39:58.654402 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2454/5152] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:39:58 2022] DELETE /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:39:58.664064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f9712b80-0bdb-40a7-bdf3-8f6705ef191a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.664622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f9712b80-0bdb-40a7-bdf3-8f6705ef191a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c049bc0a-fc7b-4d5a-8bca-c4ef951070e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.670879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9712b80-0bdb-40a7-bdf3-8f6705ef191a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.671399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9712b80-0bdb-40a7-bdf3-8f6705ef191a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.671795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9712b80-0bdb-40a7-bdf3-8f6705ef191a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.672502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9712b80-0bdb-40a7-bdf3-8f6705ef191a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.672951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9712b80-0bdb-40a7-bdf3-8f6705ef191a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.673411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9712b80-0bdb-40a7-bdf3-8f6705ef191a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.689698 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-f9712b80-0bdb-40a7-bdf3-8f6705ef191a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f9712b80-0bdb-40a7-bdf3-8f6705ef191a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 HTTP/1.1 Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c049bc0a-fc7b-4d5a-8bca-c4ef951070e5'} Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.690550 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.695609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.695609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.695609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:58.695609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:58.695609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. Oct 18 13:39:58.695609 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.695609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f9712b80-0bdb-40a7-bdf3-8f6705ef191a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:58.695609 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f9712b80-0bdb-40a7-bdf3-8f6705ef191a tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5" status: 404 len: 111 microversion: 2.1 time: 0.032891 Oct 18 13:39:58.695609 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2455/5153] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:58 2022] GET /compute/v2.1/servers/c049bc0a-fc7b-4d5a-8bca-c4ef951070e5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:58.705554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-44685283-82e1-44be-b124-c8309c187bf8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.706059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-44685283-82e1-44be-b124-c8309c187bf8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.712986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44685283-82e1-44be-b124-c8309c187bf8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.713506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44685283-82e1-44be-b124-c8309c187bf8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.713940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44685283-82e1-44be-b124-c8309c187bf8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.714919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44685283-82e1-44be-b124-c8309c187bf8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.715377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44685283-82e1-44be-b124-c8309c187bf8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.715801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44685283-82e1-44be-b124-c8309c187bf8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.735388 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-44685283-82e1-44be-b124-c8309c187bf8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-44685283-82e1-44be-b124-c8309c187bf8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 HTTP/1.1 Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '98fd0182-30e6-4a86-9b90-a70a91ee36a6'} Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:58.736983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:39:58.743379 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.743379 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.743379 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.743379 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.743379 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.743379 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.743379 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:58.743379 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:58.743379 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:39:58.743379 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.743379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-44685283-82e1-44be-b124-c8309c187bf8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:58.743379 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-44685283-82e1-44be-b124-c8309c187bf8 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 404 len: 111 microversion: 2.1 time: 0.037799 Oct 18 13:39:58.743379 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2456/5154] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:39:58 2022] DELETE /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:58.747945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dbe798d9-df05-425f-81f5-26384b7f782e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.748688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dbe798d9-df05-425f-81f5-26384b7f782e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 98fd0182-30e6-4a86-9b90-a70a91ee36a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.758880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbe798d9-df05-425f-81f5-26384b7f782e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.759374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbe798d9-df05-425f-81f5-26384b7f782e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.759809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbe798d9-df05-425f-81f5-26384b7f782e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.760511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbe798d9-df05-425f-81f5-26384b7f782e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.761073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbe798d9-df05-425f-81f5-26384b7f782e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.761422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbe798d9-df05-425f-81f5-26384b7f782e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.781691 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-dbe798d9-df05-425f-81f5-26384b7f782e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dbe798d9-df05-425f-81f5-26384b7f782e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 HTTP/1.1 Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '98fd0182-30e6-4a86-9b90-a70a91ee36a6'} Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.783303 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.789128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.789128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.789128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:58.789128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:58.789128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. Oct 18 13:39:58.789128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.789128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dbe798d9-df05-425f-81f5-26384b7f782e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance 98fd0182-30e6-4a86-9b90-a70a91ee36a6 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:58.789128 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dbe798d9-df05-425f-81f5-26384b7f782e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6" status: 404 len: 111 microversion: 2.1 time: 0.040878 Oct 18 13:39:58.789128 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2457/5155] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:58 2022] GET /compute/v2.1/servers/98fd0182-30e6-4a86-9b90-a70a91ee36a6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:58.793351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-138c6fa7-a745-4b70-8589-e36a6239a506 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.793745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-138c6fa7-a745-4b70-8589-e36a6239a506 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.804053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-138c6fa7-a745-4b70-8589-e36a6239a506 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.804550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-138c6fa7-a745-4b70-8589-e36a6239a506 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.804982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-138c6fa7-a745-4b70-8589-e36a6239a506 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.806154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-138c6fa7-a745-4b70-8589-e36a6239a506 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.806620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-138c6fa7-a745-4b70-8589-e36a6239a506 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.807049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-138c6fa7-a745-4b70-8589-e36a6239a506 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.837133 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-138c6fa7-a745-4b70-8589-e36a6239a506 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-138c6fa7-a745-4b70-8589-e36a6239a506 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 HTTP/1.1 Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c563a787-e0b9-4e58-a44c-dde199eba836'} Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:58.838868 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:39:58.842899 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.842899 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.842899 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.842899 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.842899 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.842899 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.842899 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:58.842899 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:58.842899 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:39:58.842899 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.842899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-138c6fa7-a745-4b70-8589-e36a6239a506 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:58.842899 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-138c6fa7-a745-4b70-8589-e36a6239a506 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 404 len: 111 microversion: 2.1 time: 0.052400 Oct 18 13:39:58.842899 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2458/5156] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:39:58 2022] DELETE /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:39:58.853113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb22bb91-b706-4dc5-ba74-8ab0960b0b27 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.853724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eb22bb91-b706-4dc5-ba74-8ab0960b0b27 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: c563a787-e0b9-4e58-a44c-dde199eba836] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.866093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb22bb91-b706-4dc5-ba74-8ab0960b0b27 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.866578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb22bb91-b706-4dc5-ba74-8ab0960b0b27 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.867015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb22bb91-b706-4dc5-ba74-8ab0960b0b27 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.867821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb22bb91-b706-4dc5-ba74-8ab0960b0b27 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.868207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb22bb91-b706-4dc5-ba74-8ab0960b0b27 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.868874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb22bb91-b706-4dc5-ba74-8ab0960b0b27 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.885720 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-eb22bb91-b706-4dc5-ba74-8ab0960b0b27 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb22bb91-b706-4dc5-ba74-8ab0960b0b27 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 HTTP/1.1 Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c563a787-e0b9-4e58-a44c-dde199eba836'} Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.887375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.896189 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.896189 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.896189 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:58.896189 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:58.896189 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. Oct 18 13:39:58.896189 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.896189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb22bb91-b706-4dc5-ba74-8ab0960b0b27 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance c563a787-e0b9-4e58-a44c-dde199eba836 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:58.896189 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eb22bb91-b706-4dc5-ba74-8ab0960b0b27 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836" status: 404 len: 111 microversion: 2.1 time: 0.039707 Oct 18 13:39:58.896189 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2459/5157] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:58 2022] GET /compute/v2.1/servers/c563a787-e0b9-4e58-a44c-dde199eba836 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:58.898763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-62612a51-db26-4a75-a938-8cfb1fa59a69 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.899829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-62612a51-db26-4a75-a938-8cfb1fa59a69 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.907641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62612a51-db26-4a75-a938-8cfb1fa59a69 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.908125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62612a51-db26-4a75-a938-8cfb1fa59a69 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.908611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62612a51-db26-4a75-a938-8cfb1fa59a69 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.909511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62612a51-db26-4a75-a938-8cfb1fa59a69 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.910012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62612a51-db26-4a75-a938-8cfb1fa59a69 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.910609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62612a51-db26-4a75-a938-8cfb1fa59a69 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.945192 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-62612a51-db26-4a75-a938-8cfb1fa59a69 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-62612a51-db26-4a75-a938-8cfb1fa59a69 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b HTTP/1.1 Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'd84248cd-c35f-4af0-b55d-25e8f9055c3b'} Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:58.952514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:39:58.956764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.956764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:58.956764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.956764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:58.956764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:58.956764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:58.956764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:58.956764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:58.956764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:39:58.956764 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:58.956764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-62612a51-db26-4a75-a938-8cfb1fa59a69 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:58.956764 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-62612a51-db26-4a75-a938-8cfb1fa59a69 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 404 len: 111 microversion: 2.1 time: 0.059962 Oct 18 13:39:58.956764 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2460/5158] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:39:58 2022] DELETE /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:58.968211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-43c46c0f-8da5-46d4-ba0b-b895d5b71fa0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:58.968908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-43c46c0f-8da5-46d4-ba0b-b895d5b71fa0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: d84248cd-c35f-4af0-b55d-25e8f9055c3b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:58.976454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43c46c0f-8da5-46d4-ba0b-b895d5b71fa0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.977585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43c46c0f-8da5-46d4-ba0b-b895d5b71fa0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.978025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43c46c0f-8da5-46d4-ba0b-b895d5b71fa0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:58.978799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43c46c0f-8da5-46d4-ba0b-b895d5b71fa0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:58.979265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43c46c0f-8da5-46d4-ba0b-b895d5b71fa0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:58.979876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43c46c0f-8da5-46d4-ba0b-b895d5b71fa0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.007221 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-43c46c0f-8da5-46d4-ba0b-b895d5b71fa0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-43c46c0f-8da5-46d4-ba0b-b895d5b71fa0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b HTTP/1.1 Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'd84248cd-c35f-4af0-b55d-25e8f9055c3b'} Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.010063 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:59.014198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:59.014198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:59.014198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:59.014198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:59.014198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. Oct 18 13:39:59.014198 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.014198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-43c46c0f-8da5-46d4-ba0b-b895d5b71fa0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance d84248cd-c35f-4af0-b55d-25e8f9055c3b could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:59.014198 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-43c46c0f-8da5-46d4-ba0b-b895d5b71fa0 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b" status: 404 len: 111 microversion: 2.1 time: 0.051051 Oct 18 13:39:59.014198 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2461/5159] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:58 2022] GET /compute/v2.1/servers/d84248cd-c35f-4af0-b55d-25e8f9055c3b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:59.021109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-635a8d44-3621-4ba8-b49e-dccddb341c39 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:59.021627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-635a8d44-3621-4ba8-b49e-dccddb341c39 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 9d483b15-33b4-439c-a358-bc8fb175fd88] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:59.028169 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-635a8d44-3621-4ba8-b49e-dccddb341c39 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-635a8d44-3621-4ba8-b49e-dccddb341c39 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/9d483b15-33b4-439c-a358-bc8fb175fd88 HTTP/1.1 Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '9d483b15-33b4-439c-a358-bc8fb175fd88'} Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:59.030031 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.034153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:59.034153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:59.034153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:59.034153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:59.034153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:59.034153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:39:59.034153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.034153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-635a8d44-3621-4ba8-b49e-dccddb341c39 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:59.034153 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-635a8d44-3621-4ba8-b49e-dccddb341c39 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9d483b15-33b4-439c-a358-bc8fb175fd88" status: 404 len: 111 microversion: 2.1 time: 0.014937 Oct 18 13:39:59.035706 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2462/5160] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:39:59 2022] DELETE /compute/v2.1/servers/9d483b15-33b4-439c-a358-bc8fb175fd88 => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:59.041665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16e2fa3d-6ce3-4d17-96dd-b91178f4a176 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:59.042273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-16e2fa3d-6ce3-4d17-96dd-b91178f4a176 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: 9d483b15-33b4-439c-a358-bc8fb175fd88] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:59.052238 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-16e2fa3d-6ce3-4d17-96dd-b91178f4a176 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16e2fa3d-6ce3-4d17-96dd-b91178f4a176 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/9d483b15-33b4-439c-a358-bc8fb175fd88 HTTP/1.1 Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '9d483b15-33b4-439c-a358-bc8fb175fd88'} Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:39:59.055480 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:39:59.060614 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:39:59.060614 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:39:59.060614 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. Oct 18 13:39:59.060614 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:39:59.060614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16e2fa3d-6ce3-4d17-96dd-b91178f4a176 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance 9d483b15-33b4-439c-a358-bc8fb175fd88 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:39:59.060614 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-16e2fa3d-6ce3-4d17-96dd-b91178f4a176 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/9d483b15-33b4-439c-a358-bc8fb175fd88" status: 404 len: 111 microversion: 2.1 time: 0.020312 Oct 18 13:39:59.061614 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2463/5161] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:59 2022] GET /compute/v2.1/servers/9d483b15-33b4-439c-a358-bc8fb175fd88 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:39:59.069217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-88fba28b-8510-42a0-b6f4-56baa13a8ae3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:59.069707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-88fba28b-8510-42a0-b6f4-56baa13a8ae3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:59.071727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:39:59.082609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88fba28b-8510-42a0-b6f4-56baa13a8ae3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.083022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88fba28b-8510-42a0-b6f4-56baa13a8ae3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.083463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88fba28b-8510-42a0-b6f4-56baa13a8ae3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.084472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88fba28b-8510-42a0-b6f4-56baa13a8ae3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.084932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88fba28b-8510-42a0-b6f4-56baa13a8ae3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.085737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-88fba28b-8510-42a0-b6f4-56baa13a8ae3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.130161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-88fba28b-8510-42a0-b6f4-56baa13a8ae3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:39:59.273959 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-88fba28b-8510-42a0-b6f4-56baa13a8ae3 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 204 len: 0 microversion: 2.1 time: 0.210330 Oct 18 13:39:59.274560 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2464/5162] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:39:59 2022] DELETE /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:39:59.311405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-633ccf59-cd50-45d8-8494-d6929e2862d6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:59.312290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-633ccf59-cd50-45d8-8494-d6929e2862d6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:59.324283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-633ccf59-cd50-45d8-8494-d6929e2862d6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.325072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-633ccf59-cd50-45d8-8494-d6929e2862d6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.325836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-633ccf59-cd50-45d8-8494-d6929e2862d6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.327126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-633ccf59-cd50-45d8-8494-d6929e2862d6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.327842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-633ccf59-cd50-45d8-8494-d6929e2862d6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.328515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-633ccf59-cd50-45d8-8494-d6929e2862d6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.575133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-633ccf59-cd50-45d8-8494-d6929e2862d6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:59.590277 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-633ccf59-cd50-45d8-8494-d6929e2862d6 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1480 microversion: 2.1 time: 0.310538 Oct 18 13:39:59.618464 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2465/5163] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:59 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1480 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:39:59.634150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dc3fb2cd-ee0e-458b-9dc6-23945c99822d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:39:59.634921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dc3fb2cd-ee0e-458b-9dc6-23945c99822d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:39:59.641845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc3fb2cd-ee0e-458b-9dc6-23945c99822d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.642484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc3fb2cd-ee0e-458b-9dc6-23945c99822d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.643318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc3fb2cd-ee0e-458b-9dc6-23945c99822d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.644682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc3fb2cd-ee0e-458b-9dc6-23945c99822d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:39:59.645353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc3fb2cd-ee0e-458b-9dc6-23945c99822d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:39:59.646066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc3fb2cd-ee0e-458b-9dc6-23945c99822d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:39:59.955945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dc3fb2cd-ee0e-458b-9dc6-23945c99822d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:39:59.969237 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dc3fb2cd-ee0e-458b-9dc6-23945c99822d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1306 microversion: 2.1 time: 0.348481 Oct 18 13:39:59.970428 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2466/5164] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:39:59 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1306 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:00.630574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fc8da803-b13d-4942-87c8-211ffddc841e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:00.631269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fc8da803-b13d-4942-87c8-211ffddc841e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:00.653228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc8da803-b13d-4942-87c8-211ffddc841e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:00.657852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc8da803-b13d-4942-87c8-211ffddc841e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:00.658309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc8da803-b13d-4942-87c8-211ffddc841e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:00.659051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc8da803-b13d-4942-87c8-211ffddc841e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:00.671103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc8da803-b13d-4942-87c8-211ffddc841e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:00.671563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc8da803-b13d-4942-87c8-211ffddc841e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:01.430878 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-768cead2-3e79-4101-8027-e2ca05be0461 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "POST /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 7.394266 Oct 18 13:40:01.431815 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2699/5165] 10.222.0.40 () {62 vars in 1364 bytes} [Tue Oct 18 13:39:54 2022] POST /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/os-volume_attachments => generated 188 bytes in 7396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:40:01.441858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-613ec111-1728-4c4a-b4af-02cca0eff6e8 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:01.442498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-613ec111-1728-4c4a-b4af-02cca0eff6e8 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:01.458469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-613ec111-1728-4c4a-b4af-02cca0eff6e8 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:01.460492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-613ec111-1728-4c4a-b4af-02cca0eff6e8 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:01.461415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-613ec111-1728-4c4a-b4af-02cca0eff6e8 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:01.462530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-613ec111-1728-4c4a-b4af-02cca0eff6e8 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:01.463500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-613ec111-1728-4c4a-b4af-02cca0eff6e8 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:01.464564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-613ec111-1728-4c4a-b4af-02cca0eff6e8 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:01.625735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fc8da803-b13d-4942-87c8-211ffddc841e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:01.652025 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fc8da803-b13d-4942-87c8-211ffddc841e tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1480 microversion: 2.1 time: 1.024101 Oct 18 13:40:01.652025 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2467/5166] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:00 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1480 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:01.672735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4f669bbc-693e-43ac-a70e-ff7b685352b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:01.673277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4f669bbc-693e-43ac-a70e-ff7b685352b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:01.682716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f669bbc-693e-43ac-a70e-ff7b685352b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:01.683117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f669bbc-693e-43ac-a70e-ff7b685352b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:01.683554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f669bbc-693e-43ac-a70e-ff7b685352b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:01.684254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f669bbc-693e-43ac-a70e-ff7b685352b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:01.684700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f669bbc-693e-43ac-a70e-ff7b685352b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:01.685121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f669bbc-693e-43ac-a70e-ff7b685352b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:01.870069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:02.178575 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4f669bbc-693e-43ac-a70e-ff7b685352b9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "DELETE /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/os-volume_attachments/ba198014-a757-4928-95ff-f49326a7c56c" status: 202 len: 0 microversion: 2.20 time: 0.515447 Oct 18 13:40:02.181264 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2468/5167] 10.222.0.40 () {60 vars in 1457 bytes} [Tue Oct 18 13:40:01 2022] DELETE /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/os-volume_attachments/ba198014-a757-4928-95ff-f49326a7c56c => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:40:02.193264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7cdf1b1f-87e1-4b92-80bc-48c87407a2c7 req-11d35103-6a03-416d-8b4e-ed7b78183a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16abfbb-113b-424e-86a1-bea54f1a4163", "name": "network-vif-deleted", "tag": "33594d76-30f8-4217-849d-350d9ace5855"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:02.251586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7cdf1b1f-87e1-4b92-80bc-48c87407a2c7 req-11d35103-6a03-416d-8b4e-ed7b78183a02 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:02.254514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7cdf1b1f-87e1-4b92-80bc-48c87407a2c7 req-11d35103-6a03-416d-8b4e-ed7b78183a02 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:02.255109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7cdf1b1f-87e1-4b92-80bc-48c87407a2c7 req-11d35103-6a03-416d-8b4e-ed7b78183a02 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:02.281234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-613ec111-1728-4c4a-b4af-02cca0eff6e8 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:02.291795 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-613ec111-1728-4c4a-b4af-02cca0eff6e8 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1306 microversion: 2.1 time: 0.858811 Oct 18 13:40:02.308108 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7cdf1b1f-87e1-4b92-80bc-48c87407a2c7 req-11d35103-6a03-416d-8b4e-ed7b78183a02 service nova] Creating event network-vif-deleted:33594d76-30f8-4217-849d-350d9ace5855 for instance e16abfbb-113b-424e-86a1-bea54f1a4163 on n-h2-858384-13 Oct 18 13:40:02.308975 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2700/5168] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:01 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1306 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:02.335625 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7cdf1b1f-87e1-4b92-80bc-48c87407a2c7 req-11d35103-6a03-416d-8b4e-ed7b78183a02 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152826 Oct 18 13:40:02.341005 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2469/5169] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:02.367140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-75046edf-f51d-4946-86f6-e667578494f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:02.368826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-75046edf-f51d-4946-86f6-e667578494f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:02.388606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75046edf-f51d-4946-86f6-e667578494f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:02.391702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75046edf-f51d-4946-86f6-e667578494f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:02.398496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75046edf-f51d-4946-86f6-e667578494f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:02.399571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75046edf-f51d-4946-86f6-e667578494f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:02.400284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75046edf-f51d-4946-86f6-e667578494f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:02.401296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75046edf-f51d-4946-86f6-e667578494f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:02.457387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-75046edf-f51d-4946-86f6-e667578494f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120611) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 13:40:02.642817 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-75046edf-f51d-4946-86f6-e667578494f6 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "POST /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/action" status: 202 len: 0 microversion: 2.20 time: 0.289788 Oct 18 13:40:02.643585 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2701/5170] 10.222.0.40 () {62 vars in 1319 bytes} [Tue Oct 18 13:40:02 2022] POST /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:40:02.653548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9b6a4566-0214-45c6-b32a-498872d44931 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:02.654436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9b6a4566-0214-45c6-b32a-498872d44931 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:02.663835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b6a4566-0214-45c6-b32a-498872d44931 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:02.664597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b6a4566-0214-45c6-b32a-498872d44931 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:02.665138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b6a4566-0214-45c6-b32a-498872d44931 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:02.666174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b6a4566-0214-45c6-b32a-498872d44931 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:02.666831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b6a4566-0214-45c6-b32a-498872d44931 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:02.667393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9b6a4566-0214-45c6-b32a-498872d44931 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:02.681274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:02.681274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:02.691653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:02.694995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:02.695550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:02.696373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:02.699068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:02.700850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:02.812532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:02.814249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:02.814714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:02.816313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lazy-loading 'fault' on Instance uuid e16abfbb-113b-424e-86a1-bea54f1a4163 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:40:02.878681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4856dd5667c4f10aa9ff1ccb1788cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa140485af954b1a8c83651a5d122a1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:02.887419 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fd25df22-90b0-41f4-985c-18cd9fa24875 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 200 len: 1283 microversion: 2.1 time: 0.212601 Oct 18 13:40:02.892779 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2702/5171] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:02 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 1283 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:03.185390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9b6a4566-0214-45c6-b32a-498872d44931 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:03.196718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9b6a4566-0214-45c6-b32a-498872d44931 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:03.199957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9b6a4566-0214-45c6-b32a-498872d44931 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:03.203530 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9b6a4566-0214-45c6-b32a-498872d44931 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1671 microversion: 2.20 time: 0.554616 Oct 18 13:40:03.205903 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2470/5172] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:02 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1671 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:03.334360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-382aa404-b81a-42b0-8662-a8eb6f99bd95 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:03.335489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-382aa404-b81a-42b0-8662-a8eb6f99bd95 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:03.343070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-382aa404-b81a-42b0-8662-a8eb6f99bd95 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:03.343970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-382aa404-b81a-42b0-8662-a8eb6f99bd95 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:03.344635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-382aa404-b81a-42b0-8662-a8eb6f99bd95 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:03.345605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-382aa404-b81a-42b0-8662-a8eb6f99bd95 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:03.346292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-382aa404-b81a-42b0-8662-a8eb6f99bd95 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:03.347432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-382aa404-b81a-42b0-8662-a8eb6f99bd95 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:03.698448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-382aa404-b81a-42b0-8662-a8eb6f99bd95 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:03.715205 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-382aa404-b81a-42b0-8662-a8eb6f99bd95 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1306 microversion: 2.1 time: 0.386719 Oct 18 13:40:03.717073 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2703/5173] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:03 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1306 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:03.918596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b92eac80-3702-4f65-aab3-fa5cd826f545 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:03.919217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b92eac80-3702-4f65-aab3-fa5cd826f545 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] [instance: e16abfbb-113b-424e-86a1-bea54f1a4163] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:03.927034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b92eac80-3702-4f65-aab3-fa5cd826f545 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:03.927520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b92eac80-3702-4f65-aab3-fa5cd826f545 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:03.928149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b92eac80-3702-4f65-aab3-fa5cd826f545 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:03.928851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b92eac80-3702-4f65-aab3-fa5cd826f545 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:03.929331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b92eac80-3702-4f65-aab3-fa5cd826f545 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:03.930141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b92eac80-3702-4f65-aab3-fa5cd826f545 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:03.947185 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-b92eac80-3702-4f65-aab3-fa5cd826f545 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] HTTP exception thrown: Instance e16abfbb-113b-424e-86a1-bea54f1a4163 could not be found. Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b92eac80-3702-4f65-aab3-fa5cd826f545 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Request method failure captured: Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 HTTP/1.1 Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvQirOi8b8h9HBwshUIU86y_mMpJt3CSlHqghxAm5iTgc0gosJYXDtAnq3i7WDDFQj-sL6l_l_9MVVE9VhwEL-A1T-l8dEUwfNs5UEeZvJbErL8hwkX8A7TN4mBInF7R7Av7BTHQunFeCr6Z9cAoBpQdqTkp3SyX77sOI-SGXslviA Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersTestJSON-212734912 Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aa140485af954b1a8c83651a5d122a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aa140485af954b1a8c83651a5d122a1a"}]}] Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersTestJSON-212734912 Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: aa140485af954b1a8c83651a5d122a1a Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersTestJSON-212734912 Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersTestJSON-212734912-project Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a4856dd5667c4f10aa9ff1ccb1788cc8 Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersTestJSON-212734912-project Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance e16abfbb-113b-424e-86a1-bea54f1a4163 could not be found. Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'e16abfbb-113b-424e-86a1-bea54f1a4163'} Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e16abfbb-113b-424e-86a1-bea54f1a4163 could not be found. Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e16abfbb-113b-424e-86a1-bea54f1a4163 could not be found. Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:03.949036 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:03.953728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:03.953728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:03.953728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:03.953728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:03.953728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e16abfbb-113b-424e-86a1-bea54f1a4163 could not be found. Oct 18 13:40:03.953728 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:03.954845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b92eac80-3702-4f65-aab3-fa5cd826f545 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] Returning 404 to user: Instance e16abfbb-113b-424e-86a1-bea54f1a4163 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:03.955711 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b92eac80-3702-4f65-aab3-fa5cd826f545 tempest-ServersTestJSON-212734912 tempest-ServersTestJSON-212734912-project] 10.222.0.40 "GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163" status: 404 len: 111 microversion: 2.1 time: 0.041251 Oct 18 13:40:03.956889 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2471/5174] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:03 2022] GET /compute/v2.1/servers/e16abfbb-113b-424e-86a1-bea54f1a4163 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:40:04.236457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f510561-a721-43a3-9704-894cd6510654 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:04.237076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9f510561-a721-43a3-9704-894cd6510654 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:04.253662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f510561-a721-43a3-9704-894cd6510654 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:04.254212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f510561-a721-43a3-9704-894cd6510654 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:04.256125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f510561-a721-43a3-9704-894cd6510654 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:04.257566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f510561-a721-43a3-9704-894cd6510654 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:04.258251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f510561-a721-43a3-9704-894cd6510654 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:04.258896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f510561-a721-43a3-9704-894cd6510654 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:04.582916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9f510561-a721-43a3-9704-894cd6510654 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:04.597369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9f510561-a721-43a3-9704-894cd6510654 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:04.599698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9f510561-a721-43a3-9704-894cd6510654 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:04.601543 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9f510561-a721-43a3-9704-894cd6510654 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1671 microversion: 2.20 time: 0.369885 Oct 18 13:40:04.606410 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2704/5175] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:04 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1671 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:04.742215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a05377d1-13cc-4290-a0fd-878a8e4fd68d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:04.750090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a05377d1-13cc-4290-a0fd-878a8e4fd68d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:04.760153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a05377d1-13cc-4290-a0fd-878a8e4fd68d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:04.760663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a05377d1-13cc-4290-a0fd-878a8e4fd68d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:04.761332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a05377d1-13cc-4290-a0fd-878a8e4fd68d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:04.762356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a05377d1-13cc-4290-a0fd-878a8e4fd68d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:04.762924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a05377d1-13cc-4290-a0fd-878a8e4fd68d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:04.763674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a05377d1-13cc-4290-a0fd-878a8e4fd68d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:05.014331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a05377d1-13cc-4290-a0fd-878a8e4fd68d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:05.023264 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a05377d1-13cc-4290-a0fd-878a8e4fd68d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1294 microversion: 2.1 time: 0.286922 Oct 18 13:40:05.029841 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2472/5176] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:04 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1294 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:05.628972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d765045f-74dc-4f09-ad21-b84a2455a7db tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:05.629622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d765045f-74dc-4f09-ad21-b84a2455a7db tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:05.637018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d765045f-74dc-4f09-ad21-b84a2455a7db tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:05.647010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d765045f-74dc-4f09-ad21-b84a2455a7db tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:05.647919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d765045f-74dc-4f09-ad21-b84a2455a7db tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:05.651386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d765045f-74dc-4f09-ad21-b84a2455a7db tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:05.654097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d765045f-74dc-4f09-ad21-b84a2455a7db tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:05.655437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d765045f-74dc-4f09-ad21-b84a2455a7db tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:05.670996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:05.988131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d765045f-74dc-4f09-ad21-b84a2455a7db tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:06.002410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d765045f-74dc-4f09-ad21-b84a2455a7db tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:06.007474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d765045f-74dc-4f09-ad21-b84a2455a7db tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:06.009328 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d765045f-74dc-4f09-ad21-b84a2455a7db tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.384967 Oct 18 13:40:06.011675 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2705/5177] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:05 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:06.058182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-85c4d133-3237-43ac-aecb-fd7873ca4212 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:06.059468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-85c4d133-3237-43ac-aecb-fd7873ca4212 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:06.075169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85c4d133-3237-43ac-aecb-fd7873ca4212 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:06.076055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85c4d133-3237-43ac-aecb-fd7873ca4212 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:06.077791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85c4d133-3237-43ac-aecb-fd7873ca4212 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:06.082495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85c4d133-3237-43ac-aecb-fd7873ca4212 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:06.083208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85c4d133-3237-43ac-aecb-fd7873ca4212 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:06.085154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85c4d133-3237-43ac-aecb-fd7873ca4212 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:06.171941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=10 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:06.845081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-85c4d133-3237-43ac-aecb-fd7873ca4212 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:06.853861 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-85c4d133-3237-43ac-aecb-fd7873ca4212 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1294 microversion: 2.1 time: 0.805392 Oct 18 13:40:06.857459 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2473/5178] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:06 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1294 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:07.040282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d8ae97d-1c95-4abe-ad6d-ced1c94126c9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:07.041047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d8ae97d-1c95-4abe-ad6d-ced1c94126c9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:07.065748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8ae97d-1c95-4abe-ad6d-ced1c94126c9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:07.072784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8ae97d-1c95-4abe-ad6d-ced1c94126c9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:07.073326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8ae97d-1c95-4abe-ad6d-ced1c94126c9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:07.079202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8ae97d-1c95-4abe-ad6d-ced1c94126c9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:07.079699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8ae97d-1c95-4abe-ad6d-ced1c94126c9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:07.080139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d8ae97d-1c95-4abe-ad6d-ced1c94126c9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:07.381051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-4c1e3407-ebff-4ea6-aaac-2a1339c60514 req-47879aa8-c185-4e14-b5c7-c86553aac139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c5c389-b7a1-4170-9b5c-321066d048e1", "tag": "74f52242-e00e-46f0-a3ba-47fe1d3cac8e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:07.404046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4c1e3407-ebff-4ea6-aaac-2a1339c60514 req-47879aa8-c185-4e14-b5c7-c86553aac139 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:07.406787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4c1e3407-ebff-4ea6-aaac-2a1339c60514 req-47879aa8-c185-4e14-b5c7-c86553aac139 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:07.408667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4c1e3407-ebff-4ea6-aaac-2a1339c60514 req-47879aa8-c185-4e14-b5c7-c86553aac139 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:07.443849 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4c1e3407-ebff-4ea6-aaac-2a1339c60514 req-47879aa8-c185-4e14-b5c7-c86553aac139 service nova] Creating event network-changed:74f52242-e00e-46f0-a3ba-47fe1d3cac8e for instance 31c5c389-b7a1-4170-9b5c-321066d048e1 on n-h2-858384-13 Oct 18 13:40:07.457104 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-4c1e3407-ebff-4ea6-aaac-2a1339c60514 req-47879aa8-c185-4e14-b5c7-c86553aac139 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079667 Oct 18 13:40:07.458461 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2474/5179] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:07.780735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d8ae97d-1c95-4abe-ad6d-ced1c94126c9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:07.793275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d8ae97d-1c95-4abe-ad6d-ced1c94126c9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:07.797395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d8ae97d-1c95-4abe-ad6d-ced1c94126c9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:07.801999 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d8ae97d-1c95-4abe-ad6d-ced1c94126c9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.765927 Oct 18 13:40:07.802701 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2706/5180] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:07 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:07.880973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0493388d-6c2f-420e-bf4b-d71d6d50352c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:07.880973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0493388d-6c2f-420e-bf4b-d71d6d50352c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:07.883205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc39c3af-6cc7-4726-a59c-d5b6a3b70ec7 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:07.883829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bc39c3af-6cc7-4726-a59c-d5b6a3b70ec7 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:07.888664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0493388d-6c2f-420e-bf4b-d71d6d50352c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:07.889299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0493388d-6c2f-420e-bf4b-d71d6d50352c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:07.889861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0493388d-6c2f-420e-bf4b-d71d6d50352c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:07.890806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0493388d-6c2f-420e-bf4b-d71d6d50352c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:07.891363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0493388d-6c2f-420e-bf4b-d71d6d50352c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:07.891918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0493388d-6c2f-420e-bf4b-d71d6d50352c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:07.896412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc39c3af-6cc7-4726-a59c-d5b6a3b70ec7 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:07.897462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc39c3af-6cc7-4726-a59c-d5b6a3b70ec7 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:07.899745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc39c3af-6cc7-4726-a59c-d5b6a3b70ec7 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:07.900777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc39c3af-6cc7-4726-a59c-d5b6a3b70ec7 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:07.902188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc39c3af-6cc7-4726-a59c-d5b6a3b70ec7 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:07.903780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc39c3af-6cc7-4726-a59c-d5b6a3b70ec7 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:07.930834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-0493388d-6c2f-420e-bf4b-d71d6d50352c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lazy-loading 'flavor' on Instance uuid 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:40:08.212389 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0493388d-6c2f-420e-bf4b-d71d6d50352c tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/action" status: 200 len: 32 microversion: 2.1 time: 0.333160 Oct 18 13:40:08.213138 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2475/5181] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:40:07 2022] POST /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/action => generated 32 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:40:08.232173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2a71aeed-d8da-4cea-b6ff-bc5278c5c9fa tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:08.232906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2a71aeed-d8da-4cea-b6ff-bc5278c5c9fa tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:08.258177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a71aeed-d8da-4cea-b6ff-bc5278c5c9fa tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:08.260065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a71aeed-d8da-4cea-b6ff-bc5278c5c9fa tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:08.261497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a71aeed-d8da-4cea-b6ff-bc5278c5c9fa tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:08.282949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a71aeed-d8da-4cea-b6ff-bc5278c5c9fa tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:08.284827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a71aeed-d8da-4cea-b6ff-bc5278c5c9fa tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:08.286685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a71aeed-d8da-4cea-b6ff-bc5278c5c9fa tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:08.371359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bc39c3af-6cc7-4726-a59c-d5b6a3b70ec7 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:08.383179 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bc39c3af-6cc7-4726-a59c-d5b6a3b70ec7 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1294 microversion: 2.1 time: 0.504525 Oct 18 13:40:08.397770 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2707/5182] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:07 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1294 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:08.540346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2a71aeed-d8da-4cea-b6ff-bc5278c5c9fa tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:08.581857 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2a71aeed-d8da-4cea-b6ff-bc5278c5c9fa tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.353345 Oct 18 13:40:08.584909 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2476/5183] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:08 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:08.830804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-810ad641-2fcd-4557-99b3-22363ec0835c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:08.831707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-810ad641-2fcd-4557-99b3-22363ec0835c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:08.842279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-810ad641-2fcd-4557-99b3-22363ec0835c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:08.843645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-810ad641-2fcd-4557-99b3-22363ec0835c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:08.844429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-810ad641-2fcd-4557-99b3-22363ec0835c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:08.846121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-810ad641-2fcd-4557-99b3-22363ec0835c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:08.847446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-810ad641-2fcd-4557-99b3-22363ec0835c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:08.848259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-810ad641-2fcd-4557-99b3-22363ec0835c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:09.408780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c48706a-b795-4b0f-8f42-5f7d7efbd2e4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:09.410821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7c48706a-b795-4b0f-8f42-5f7d7efbd2e4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:09.427967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c48706a-b795-4b0f-8f42-5f7d7efbd2e4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:09.431230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c48706a-b795-4b0f-8f42-5f7d7efbd2e4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:09.435316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c48706a-b795-4b0f-8f42-5f7d7efbd2e4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:09.436320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c48706a-b795-4b0f-8f42-5f7d7efbd2e4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:09.440986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c48706a-b795-4b0f-8f42-5f7d7efbd2e4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:09.442183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c48706a-b795-4b0f-8f42-5f7d7efbd2e4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:10.182648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7c48706a-b795-4b0f-8f42-5f7d7efbd2e4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:10.203147 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7c48706a-b795-4b0f-8f42-5f7d7efbd2e4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1294 microversion: 2.1 time: 0.788786 Oct 18 13:40:10.204603 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2477/5184] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:09 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1294 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:10.209784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84d24b23-20ba-48a0-8bb7-6b98cb1a2df0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:10.210657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-84d24b23-20ba-48a0-8bb7-6b98cb1a2df0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:10.232396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84d24b23-20ba-48a0-8bb7-6b98cb1a2df0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:10.232770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84d24b23-20ba-48a0-8bb7-6b98cb1a2df0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:10.235996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84d24b23-20ba-48a0-8bb7-6b98cb1a2df0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:10.238082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84d24b23-20ba-48a0-8bb7-6b98cb1a2df0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:10.238633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84d24b23-20ba-48a0-8bb7-6b98cb1a2df0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:10.240268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84d24b23-20ba-48a0-8bb7-6b98cb1a2df0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:10.294365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-810ad641-2fcd-4557-99b3-22363ec0835c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:10.319963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-810ad641-2fcd-4557-99b3-22363ec0835c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:10.321784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-810ad641-2fcd-4557-99b3-22363ec0835c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:10.324356 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-810ad641-2fcd-4557-99b3-22363ec0835c tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 1.497885 Oct 18 13:40:10.325481 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2708/5185] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:08 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:10.592662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-84d24b23-20ba-48a0-8bb7-6b98cb1a2df0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:10.617536 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-84d24b23-20ba-48a0-8bb7-6b98cb1a2df0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.411514 Oct 18 13:40:10.625951 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2478/5186] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:10 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:11.229689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5d7a62df-3ca9-4e95-9075-f5df132cddba tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:11.230458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5d7a62df-3ca9-4e95-9075-f5df132cddba tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:11.243793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:11.257142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d7a62df-3ca9-4e95-9075-f5df132cddba tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:11.260570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d7a62df-3ca9-4e95-9075-f5df132cddba tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:11.261380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d7a62df-3ca9-4e95-9075-f5df132cddba tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:11.263756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d7a62df-3ca9-4e95-9075-f5df132cddba tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:11.265154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d7a62df-3ca9-4e95-9075-f5df132cddba tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:11.265858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d7a62df-3ca9-4e95-9075-f5df132cddba tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:11.350943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e796b4b8-2dbe-40ea-b29a-18fe50fd08f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:11.351605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e796b4b8-2dbe-40ea-b29a-18fe50fd08f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:11.371346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e796b4b8-2dbe-40ea-b29a-18fe50fd08f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:11.372327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e796b4b8-2dbe-40ea-b29a-18fe50fd08f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:11.373087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e796b4b8-2dbe-40ea-b29a-18fe50fd08f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:11.381359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e796b4b8-2dbe-40ea-b29a-18fe50fd08f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:11.382137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e796b4b8-2dbe-40ea-b29a-18fe50fd08f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:11.394418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e796b4b8-2dbe-40ea-b29a-18fe50fd08f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:11.855218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5d7a62df-3ca9-4e95-9075-f5df132cddba tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:11.870842 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5d7a62df-3ca9-4e95-9075-f5df132cddba tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1294 microversion: 2.1 time: 0.645166 Oct 18 13:40:11.874293 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2709/5187] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:11 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1294 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:11.883513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-da40dc81-e3f2-41c2-a8bf-bcdefb181747 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:11.886911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-da40dc81-e3f2-41c2-a8bf-bcdefb181747 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:11.901798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da40dc81-e3f2-41c2-a8bf-bcdefb181747 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:11.904948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da40dc81-e3f2-41c2-a8bf-bcdefb181747 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:11.905664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da40dc81-e3f2-41c2-a8bf-bcdefb181747 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:11.906623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da40dc81-e3f2-41c2-a8bf-bcdefb181747 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:11.906744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e796b4b8-2dbe-40ea-b29a-18fe50fd08f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:11.907656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da40dc81-e3f2-41c2-a8bf-bcdefb181747 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:11.908433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da40dc81-e3f2-41c2-a8bf-bcdefb181747 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:11.928544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e796b4b8-2dbe-40ea-b29a-18fe50fd08f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:11.935806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e796b4b8-2dbe-40ea-b29a-18fe50fd08f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:11.941030 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e796b4b8-2dbe-40ea-b29a-18fe50fd08f5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.594118 Oct 18 13:40:11.947092 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2479/5188] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:11 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:12.481576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-da40dc81-e3f2-41c2-a8bf-bcdefb181747 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:12.504374 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-da40dc81-e3f2-41c2-a8bf-bcdefb181747 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.627394 Oct 18 13:40:12.505590 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2710/5189] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:11 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:12.902930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bea61d2a-6c13-43e8-8600-5abf92e6c4cc tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:12.904310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bea61d2a-6c13-43e8-8600-5abf92e6c4cc tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:12.918460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bea61d2a-6c13-43e8-8600-5abf92e6c4cc tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:12.919340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bea61d2a-6c13-43e8-8600-5abf92e6c4cc tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:12.921801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bea61d2a-6c13-43e8-8600-5abf92e6c4cc tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:12.924274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bea61d2a-6c13-43e8-8600-5abf92e6c4cc tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:12.927628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bea61d2a-6c13-43e8-8600-5abf92e6c4cc tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:12.929903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bea61d2a-6c13-43e8-8600-5abf92e6c4cc tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:12.982809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c346731f-5f5a-496e-a5b9-76d8f145d26a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:12.984251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c346731f-5f5a-496e-a5b9-76d8f145d26a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:12.991908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c346731f-5f5a-496e-a5b9-76d8f145d26a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:12.992758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c346731f-5f5a-496e-a5b9-76d8f145d26a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:12.993481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c346731f-5f5a-496e-a5b9-76d8f145d26a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:12.994530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c346731f-5f5a-496e-a5b9-76d8f145d26a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:12.995281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c346731f-5f5a-496e-a5b9-76d8f145d26a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:12.995989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c346731f-5f5a-496e-a5b9-76d8f145d26a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:13.351637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bea61d2a-6c13-43e8-8600-5abf92e6c4cc tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:13.371005 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bea61d2a-6c13-43e8-8600-5abf92e6c4cc tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1294 microversion: 2.1 time: 0.471848 Oct 18 13:40:13.372173 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2480/5190] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:12 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1294 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:13.535214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-677da14a-f348-4a88-a24a-8516ff8b10dc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:13.536809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-677da14a-f348-4a88-a24a-8516ff8b10dc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:13.553734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-677da14a-f348-4a88-a24a-8516ff8b10dc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:13.554100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-677da14a-f348-4a88-a24a-8516ff8b10dc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:13.554541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-677da14a-f348-4a88-a24a-8516ff8b10dc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:13.555456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-677da14a-f348-4a88-a24a-8516ff8b10dc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:13.556078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-677da14a-f348-4a88-a24a-8516ff8b10dc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:13.557169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-677da14a-f348-4a88-a24a-8516ff8b10dc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:13.766539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c346731f-5f5a-496e-a5b9-76d8f145d26a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:13.776363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c346731f-5f5a-496e-a5b9-76d8f145d26a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:13.780444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c346731f-5f5a-496e-a5b9-76d8f145d26a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:13.782317 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c346731f-5f5a-496e-a5b9-76d8f145d26a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.807288 Oct 18 13:40:13.786835 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2711/5191] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:12 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:14.397418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c67a528-5bca-4810-b2fb-5a6be2cb2f55 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:14.398223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4c67a528-5bca-4810-b2fb-5a6be2cb2f55 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:14.410608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c67a528-5bca-4810-b2fb-5a6be2cb2f55 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:14.411165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c67a528-5bca-4810-b2fb-5a6be2cb2f55 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:14.414009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c67a528-5bca-4810-b2fb-5a6be2cb2f55 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:14.414806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c67a528-5bca-4810-b2fb-5a6be2cb2f55 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:14.415300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c67a528-5bca-4810-b2fb-5a6be2cb2f55 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:14.415678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c67a528-5bca-4810-b2fb-5a6be2cb2f55 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:14.944783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4c67a528-5bca-4810-b2fb-5a6be2cb2f55 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:14.952143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-677da14a-f348-4a88-a24a-8516ff8b10dc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:14.965069 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4c67a528-5bca-4810-b2fb-5a6be2cb2f55 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1294 microversion: 2.1 time: 0.571127 Oct 18 13:40:14.968363 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2712/5192] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:14 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1294 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:14.976203 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-677da14a-f348-4a88-a24a-8516ff8b10dc tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 1.445720 Oct 18 13:40:14.977429 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2481/5193] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:13 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:14.997664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-25a7e15f-8ce1-46c1-b59f-b6f3bef5d4bd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:15.000091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-25a7e15f-8ce1-46c1-b59f-b6f3bef5d4bd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:15.018274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25a7e15f-8ce1-46c1-b59f-b6f3bef5d4bd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:15.021490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25a7e15f-8ce1-46c1-b59f-b6f3bef5d4bd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:15.023152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25a7e15f-8ce1-46c1-b59f-b6f3bef5d4bd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:15.025124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25a7e15f-8ce1-46c1-b59f-b6f3bef5d4bd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:15.026969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25a7e15f-8ce1-46c1-b59f-b6f3bef5d4bd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:15.028455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-25a7e15f-8ce1-46c1-b59f-b6f3bef5d4bd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:15.335223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-25a7e15f-8ce1-46c1-b59f-b6f3bef5d4bd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:15.347387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-25a7e15f-8ce1-46c1-b59f-b6f3bef5d4bd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:15.353577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-25a7e15f-8ce1-46c1-b59f-b6f3bef5d4bd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:15.355006 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-25a7e15f-8ce1-46c1-b59f-b6f3bef5d4bd tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.381779 Oct 18 13:40:15.360122 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2713/5194] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:14 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:15.993367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0b361fec-ec9c-499d-b23d-1be571072077 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:15.993948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0b361fec-ec9c-499d-b23d-1be571072077 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:16.003794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2b749f3a-d33d-49f5-948f-93cbfffd60f1 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:16.005519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2b749f3a-d33d-49f5-948f-93cbfffd60f1 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:16.012052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b361fec-ec9c-499d-b23d-1be571072077 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:16.019525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b361fec-ec9c-499d-b23d-1be571072077 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:16.020618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b749f3a-d33d-49f5-948f-93cbfffd60f1 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:16.021089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b361fec-ec9c-499d-b23d-1be571072077 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:16.021930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b361fec-ec9c-499d-b23d-1be571072077 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:16.022412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b361fec-ec9c-499d-b23d-1be571072077 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:16.022853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b361fec-ec9c-499d-b23d-1be571072077 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:16.023374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b749f3a-d33d-49f5-948f-93cbfffd60f1 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:16.024448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b749f3a-d33d-49f5-948f-93cbfffd60f1 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:16.030026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b749f3a-d33d-49f5-948f-93cbfffd60f1 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:16.030930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b749f3a-d33d-49f5-948f-93cbfffd60f1 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:16.031657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b749f3a-d33d-49f5-948f-93cbfffd60f1 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:16.322513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2b749f3a-d33d-49f5-948f-93cbfffd60f1 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:16.338750 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2b749f3a-d33d-49f5-948f-93cbfffd60f1 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.339676 Oct 18 13:40:16.340185 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2714/5195] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:15 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:16.360241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-fa2d86eb-dbf9-46dd-b176-1726a84c3fad req-d73f3285-7724-4655-aa49-c1b3c620e538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38401f91-0034-4290-b61d-0a09ae076c2e", "name": "network-vif-plugged", "status": "completed", "tag": "1c58069a-78e6-4d67-9725-0f6c1f442cb7"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:16.388071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fa2d86eb-dbf9-46dd-b176-1726a84c3fad req-d73f3285-7724-4655-aa49-c1b3c620e538 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:16.389338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fa2d86eb-dbf9-46dd-b176-1726a84c3fad req-d73f3285-7724-4655-aa49-c1b3c620e538 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:16.389994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fa2d86eb-dbf9-46dd-b176-1726a84c3fad req-d73f3285-7724-4655-aa49-c1b3c620e538 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:16.413687 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-fa2d86eb-dbf9-46dd-b176-1726a84c3fad req-d73f3285-7724-4655-aa49-c1b3c620e538 service nova] Creating event network-vif-plugged:1c58069a-78e6-4d67-9725-0f6c1f442cb7 for instance 38401f91-0034-4290-b61d-0a09ae076c2e on n-h1-858384-13 Oct 18 13:40:16.428825 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-fa2d86eb-dbf9-46dd-b176-1726a84c3fad req-d73f3285-7724-4655-aa49-c1b3c620e538 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079606 Oct 18 13:40:16.435120 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2715/5196] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:16.442145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-563e8da0-7bd1-4701-81f9-e844a8267e17 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:16.444966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-563e8da0-7bd1-4701-81f9-e844a8267e17 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:16.471890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-563e8da0-7bd1-4701-81f9-e844a8267e17 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:16.472683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-563e8da0-7bd1-4701-81f9-e844a8267e17 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:16.473315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-563e8da0-7bd1-4701-81f9-e844a8267e17 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:16.474265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-563e8da0-7bd1-4701-81f9-e844a8267e17 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:16.474893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-563e8da0-7bd1-4701-81f9-e844a8267e17 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:16.477924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-563e8da0-7bd1-4701-81f9-e844a8267e17 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:17.144614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-563e8da0-7bd1-4701-81f9-e844a8267e17 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:17.189152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-563e8da0-7bd1-4701-81f9-e844a8267e17 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:17.194151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-563e8da0-7bd1-4701-81f9-e844a8267e17 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:17.197283 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-563e8da0-7bd1-4701-81f9-e844a8267e17 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.760007 Oct 18 13:40:17.209735 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2716/5197] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:16 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:17.315926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0b361fec-ec9c-499d-b23d-1be571072077 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:17.324344 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0b361fec-ec9c-499d-b23d-1be571072077 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1294 microversion: 2.1 time: 1.335177 Oct 18 13:40:17.328206 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2482/5198] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:15 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1294 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:17.367794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6791442a-fb5a-4301-a812-b82d83b6a083 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:17.368510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6791442a-fb5a-4301-a812-b82d83b6a083 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:17.387168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6791442a-fb5a-4301-a812-b82d83b6a083 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:17.387855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6791442a-fb5a-4301-a812-b82d83b6a083 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:17.389448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6791442a-fb5a-4301-a812-b82d83b6a083 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:17.390491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6791442a-fb5a-4301-a812-b82d83b6a083 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:17.391367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6791442a-fb5a-4301-a812-b82d83b6a083 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:17.393505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6791442a-fb5a-4301-a812-b82d83b6a083 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:17.441623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:17.768055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1340687423", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": "none"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:17.884140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6791442a-fb5a-4301-a812-b82d83b6a083 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:17.893169 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6791442a-fb5a-4301-a812-b82d83b6a083 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.529143 Oct 18 13:40:17.905548 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2483/5199] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:17 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:17.963770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:40:17.964233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:40:17.964740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:40:17.973866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:40:17.974337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:40:17.987293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:17.988767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:17.989780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:17.990933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:17.991849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:17.992566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:18.034984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Getting quotas for project 61422a6c4c2b497ca4d3d1eb17fc9a04. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:40:18.044188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Getting quotas for user 3e9326462c824768b94607692baee58d and project 61422a6c4c2b497ca4d3d1eb17fc9a04. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:40:18.075088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:40:18.079397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:40:18.172954 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e7d250c1-0026-4aa8-ac93-437e8e4034eb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.969019 Oct 18 13:40:18.182790 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2717/5200] 10.222.0.40 () {62 vars in 1188 bytes} [Tue Oct 18 13:40:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 18 13:40:18.187924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-77994b0a-331e-41b7-833a-95ebf1d9f6c0 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:18.188546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-77994b0a-331e-41b7-833a-95ebf1d9f6c0 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:18.233088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5fe23c48-0dea-4381-8b1f-a654aacbd5fa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:18.234244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5fe23c48-0dea-4381-8b1f-a654aacbd5fa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:18.245799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe23c48-0dea-4381-8b1f-a654aacbd5fa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:18.246403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe23c48-0dea-4381-8b1f-a654aacbd5fa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:18.246987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe23c48-0dea-4381-8b1f-a654aacbd5fa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:18.247857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe23c48-0dea-4381-8b1f-a654aacbd5fa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:18.248867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe23c48-0dea-4381-8b1f-a654aacbd5fa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:18.249649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe23c48-0dea-4381-8b1f-a654aacbd5fa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:18.470197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-77994b0a-331e-41b7-833a-95ebf1d9f6c0 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:18.478922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-77994b0a-331e-41b7-833a-95ebf1d9f6c0 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:18.480781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-77994b0a-331e-41b7-833a-95ebf1d9f6c0 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:18.492377 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-77994b0a-331e-41b7-833a-95ebf1d9f6c0 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1278 microversion: 2.54 time: 0.298753 Oct 18 13:40:18.493040 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2484/5201] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:18 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1278 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:18.511296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bcfced74-efca-41bb-8736-8ece2faf1f41 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:18.512006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bcfced74-efca-41bb-8736-8ece2faf1f41 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:18.538869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcfced74-efca-41bb-8736-8ece2faf1f41 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:18.539373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcfced74-efca-41bb-8736-8ece2faf1f41 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:18.539806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcfced74-efca-41bb-8736-8ece2faf1f41 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:18.540526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcfced74-efca-41bb-8736-8ece2faf1f41 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:18.540979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcfced74-efca-41bb-8736-8ece2faf1f41 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:18.541436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcfced74-efca-41bb-8736-8ece2faf1f41 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:18.634764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5fe23c48-0dea-4381-8b1f-a654aacbd5fa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:18.650154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5fe23c48-0dea-4381-8b1f-a654aacbd5fa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:18.651782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5fe23c48-0dea-4381-8b1f-a654aacbd5fa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:18.656426 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5fe23c48-0dea-4381-8b1f-a654aacbd5fa tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.429639 Oct 18 13:40:18.672318 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2718/5202] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:18 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:18.919252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-735100d3-64a6-4fd8-a6b7-4c8f4b04a2eb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:18.920002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-735100d3-64a6-4fd8-a6b7-4c8f4b04a2eb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:18.949605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-735100d3-64a6-4fd8-a6b7-4c8f4b04a2eb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:18.950664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-735100d3-64a6-4fd8-a6b7-4c8f4b04a2eb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:18.953755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-735100d3-64a6-4fd8-a6b7-4c8f4b04a2eb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:18.954879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-735100d3-64a6-4fd8-a6b7-4c8f4b04a2eb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:18.955419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-735100d3-64a6-4fd8-a6b7-4c8f4b04a2eb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:18.955980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-735100d3-64a6-4fd8-a6b7-4c8f4b04a2eb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:19.246906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bcfced74-efca-41bb-8736-8ece2faf1f41 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:19.260149 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bcfced74-efca-41bb-8736-8ece2faf1f41 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1294 microversion: 2.1 time: 0.765846 Oct 18 13:40:19.260715 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2485/5203] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:18 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1294 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:19.397703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-735100d3-64a6-4fd8-a6b7-4c8f4b04a2eb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:19.410406 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-735100d3-64a6-4fd8-a6b7-4c8f4b04a2eb tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.495791 Oct 18 13:40:19.426887 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2719/5204] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:18 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:19.529210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-da9046af-bfa2-4ea7-8a2e-23b6aa359954 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:19.530028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-da9046af-bfa2-4ea7-8a2e-23b6aa359954 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:19.537888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da9046af-bfa2-4ea7-8a2e-23b6aa359954 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:19.538569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da9046af-bfa2-4ea7-8a2e-23b6aa359954 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:19.539737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da9046af-bfa2-4ea7-8a2e-23b6aa359954 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:19.540563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da9046af-bfa2-4ea7-8a2e-23b6aa359954 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:19.541334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da9046af-bfa2-4ea7-8a2e-23b6aa359954 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:19.541911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da9046af-bfa2-4ea7-8a2e-23b6aa359954 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:19.635272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-da9046af-bfa2-4ea7-8a2e-23b6aa359954 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:19.645091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-da9046af-bfa2-4ea7-8a2e-23b6aa359954 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:19.646599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-da9046af-bfa2-4ea7-8a2e-23b6aa359954 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:19.664148 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-da9046af-bfa2-4ea7-8a2e-23b6aa359954 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1274 microversion: 2.54 time: 0.138883 Oct 18 13:40:19.664812 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2486/5205] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:19 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1274 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:19.691979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-51b66e48-d897-47e6-8567-446e5e043b5a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:19.692730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-51b66e48-d897-47e6-8567-446e5e043b5a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:19.712304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51b66e48-d897-47e6-8567-446e5e043b5a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:19.715049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51b66e48-d897-47e6-8567-446e5e043b5a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:19.717302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51b66e48-d897-47e6-8567-446e5e043b5a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:19.720482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51b66e48-d897-47e6-8567-446e5e043b5a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:19.725330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51b66e48-d897-47e6-8567-446e5e043b5a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:19.727351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51b66e48-d897-47e6-8567-446e5e043b5a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.028835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-51b66e48-d897-47e6-8567-446e5e043b5a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:20.042363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-51b66e48-d897-47e6-8567-446e5e043b5a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:20.044608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-51b66e48-d897-47e6-8567-446e5e043b5a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:20.046258 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-51b66e48-d897-47e6-8567-446e5e043b5a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.359550 Oct 18 13:40:20.047176 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2720/5206] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:19 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:20.284101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c97364c8-0055-46ef-8115-11fced4a0401 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:20.284722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c97364c8-0055-46ef-8115-11fced4a0401 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:20.299489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c97364c8-0055-46ef-8115-11fced4a0401 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:20.300051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c97364c8-0055-46ef-8115-11fced4a0401 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:20.300557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c97364c8-0055-46ef-8115-11fced4a0401 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.301322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c97364c8-0055-46ef-8115-11fced4a0401 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:20.303654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c97364c8-0055-46ef-8115-11fced4a0401 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:20.306412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c97364c8-0055-46ef-8115-11fced4a0401 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.439702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4c8526b-bbac-489d-8d8f-8bf6cce4fa35 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:20.441679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e4c8526b-bbac-489d-8d8f-8bf6cce4fa35 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:20.454775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4c8526b-bbac-489d-8d8f-8bf6cce4fa35 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:20.455589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4c8526b-bbac-489d-8d8f-8bf6cce4fa35 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:20.456877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4c8526b-bbac-489d-8d8f-8bf6cce4fa35 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.459751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4c8526b-bbac-489d-8d8f-8bf6cce4fa35 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:20.460877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4c8526b-bbac-489d-8d8f-8bf6cce4fa35 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:20.462904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4c8526b-bbac-489d-8d8f-8bf6cce4fa35 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.705366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c97364c8-0055-46ef-8115-11fced4a0401 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:20.718767 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c97364c8-0055-46ef-8115-11fced4a0401 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1484 microversion: 2.1 time: 0.438572 Oct 18 13:40:20.733810 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2487/5207] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:20 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1484 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:20.744485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1f47f30d-9a86-4663-8901-9ade48375332 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:20.747867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1f47f30d-9a86-4663-8901-9ade48375332 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:20.754807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f47f30d-9a86-4663-8901-9ade48375332 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:20.755402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f47f30d-9a86-4663-8901-9ade48375332 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:20.756080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f47f30d-9a86-4663-8901-9ade48375332 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.756998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f47f30d-9a86-4663-8901-9ade48375332 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:20.757695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f47f30d-9a86-4663-8901-9ade48375332 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:20.758232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f47f30d-9a86-4663-8901-9ade48375332 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.784029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e4c8526b-bbac-489d-8d8f-8bf6cce4fa35 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:20.794416 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e4c8526b-bbac-489d-8d8f-8bf6cce4fa35 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.359914 Oct 18 13:40:20.796963 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2721/5208] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:20 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:20.803680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b797acab-8ef2-4894-8cbf-dd5b20fe5d32 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:20.804455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b797acab-8ef2-4894-8cbf-dd5b20fe5d32 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:20.828020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b797acab-8ef2-4894-8cbf-dd5b20fe5d32 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:20.828715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b797acab-8ef2-4894-8cbf-dd5b20fe5d32 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:20.830742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b797acab-8ef2-4894-8cbf-dd5b20fe5d32 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.834438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b797acab-8ef2-4894-8cbf-dd5b20fe5d32 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:20.835068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b797acab-8ef2-4894-8cbf-dd5b20fe5d32 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:20.835636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b797acab-8ef2-4894-8cbf-dd5b20fe5d32 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:20.877466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1f47f30d-9a86-4663-8901-9ade48375332 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:20.887636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1f47f30d-9a86-4663-8901-9ade48375332 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:20.889362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1f47f30d-9a86-4663-8901-9ade48375332 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:20.890643 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1f47f30d-9a86-4663-8901-9ade48375332 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1330 microversion: 2.54 time: 0.155594 Oct 18 13:40:20.891421 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2488/5209] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:20 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1330 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:20.996335 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b797acab-8ef2-4894-8cbf-dd5b20fe5d32 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.197928 Oct 18 13:40:20.997857 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2722/5210] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:40:20 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:21.078233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c65ce4f1-437a-4293-bbba-f7e1144e08e8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:21.079276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c65ce4f1-437a-4293-bbba-f7e1144e08e8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:21.085978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c65ce4f1-437a-4293-bbba-f7e1144e08e8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:21.086703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c65ce4f1-437a-4293-bbba-f7e1144e08e8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:21.087330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c65ce4f1-437a-4293-bbba-f7e1144e08e8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:21.088221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c65ce4f1-437a-4293-bbba-f7e1144e08e8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:21.088842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c65ce4f1-437a-4293-bbba-f7e1144e08e8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:21.089461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c65ce4f1-437a-4293-bbba-f7e1144e08e8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:21.470886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c65ce4f1-437a-4293-bbba-f7e1144e08e8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:21.486485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c65ce4f1-437a-4293-bbba-f7e1144e08e8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:21.488557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c65ce4f1-437a-4293-bbba-f7e1144e08e8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:21.490144 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c65ce4f1-437a-4293-bbba-f7e1144e08e8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.416628 Oct 18 13:40:21.505824 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2489/5211] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:21 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:21.827548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9e780127-9fec-4a1d-a27a-53bb65f3e248 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:21.828172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9e780127-9fec-4a1d-a27a-53bb65f3e248 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:21.837414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e780127-9fec-4a1d-a27a-53bb65f3e248 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:21.837968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e780127-9fec-4a1d-a27a-53bb65f3e248 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:21.838473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e780127-9fec-4a1d-a27a-53bb65f3e248 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:21.839181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e780127-9fec-4a1d-a27a-53bb65f3e248 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:21.839633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e780127-9fec-4a1d-a27a-53bb65f3e248 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:21.840373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e780127-9fec-4a1d-a27a-53bb65f3e248 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:21.864778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:21.923005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68135e66-c282-44bb-92da-300e1314468f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:21.924874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-68135e66-c282-44bb-92da-300e1314468f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:21.931507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68135e66-c282-44bb-92da-300e1314468f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:21.932353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68135e66-c282-44bb-92da-300e1314468f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:21.933017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68135e66-c282-44bb-92da-300e1314468f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:21.933782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68135e66-c282-44bb-92da-300e1314468f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:21.934415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68135e66-c282-44bb-92da-300e1314468f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:21.935040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68135e66-c282-44bb-92da-300e1314468f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:22.027041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9e780127-9fec-4a1d-a27a-53bb65f3e248 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:22.038587 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9e780127-9fec-4a1d-a27a-53bb65f3e248 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.216195 Oct 18 13:40:22.039513 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2723/5212] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:21 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:22.292698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-68135e66-c282-44bb-92da-300e1314468f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:22.306622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-68135e66-c282-44bb-92da-300e1314468f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:22.308886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-68135e66-c282-44bb-92da-300e1314468f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:22.310609 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-68135e66-c282-44bb-92da-300e1314468f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1336 microversion: 2.54 time: 0.392540 Oct 18 13:40:22.311378 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2490/5213] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:21 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1336 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:22.516929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b95caabb-75ef-4799-a413-f2f6aaa8f767 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:22.517943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b95caabb-75ef-4799-a413-f2f6aaa8f767 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:22.529127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b95caabb-75ef-4799-a413-f2f6aaa8f767 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:22.529891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b95caabb-75ef-4799-a413-f2f6aaa8f767 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:22.530337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b95caabb-75ef-4799-a413-f2f6aaa8f767 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:22.531072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b95caabb-75ef-4799-a413-f2f6aaa8f767 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:22.531605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b95caabb-75ef-4799-a413-f2f6aaa8f767 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:22.534809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b95caabb-75ef-4799-a413-f2f6aaa8f767 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:22.821832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b95caabb-75ef-4799-a413-f2f6aaa8f767 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:22.834168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b95caabb-75ef-4799-a413-f2f6aaa8f767 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:22.841043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b95caabb-75ef-4799-a413-f2f6aaa8f767 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:22.842616 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b95caabb-75ef-4799-a413-f2f6aaa8f767 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.329728 Oct 18 13:40:22.848549 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2724/5214] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:22 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:23.080346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-519e3b4a-b8a2-4940-b319-235237c2b66d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:23.081957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-519e3b4a-b8a2-4940-b319-235237c2b66d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:23.082853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cc4977dd-a88c-4dec-9721-49dc9418b3c3 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:23.084014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cc4977dd-a88c-4dec-9721-49dc9418b3c3 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:23.100973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-519e3b4a-b8a2-4940-b319-235237c2b66d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.101571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-519e3b4a-b8a2-4940-b319-235237c2b66d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.102018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-519e3b4a-b8a2-4940-b319-235237c2b66d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.102728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-519e3b4a-b8a2-4940-b319-235237c2b66d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.103150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4977dd-a88c-4dec-9721-49dc9418b3c3 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.103275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-519e3b4a-b8a2-4940-b319-235237c2b66d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.103767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-519e3b4a-b8a2-4940-b319-235237c2b66d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.104021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4977dd-a88c-4dec-9721-49dc9418b3c3 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.104811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4977dd-a88c-4dec-9721-49dc9418b3c3 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.105657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4977dd-a88c-4dec-9721-49dc9418b3c3 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.106122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4977dd-a88c-4dec-9721-49dc9418b3c3 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.106550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4977dd-a88c-4dec-9721-49dc9418b3c3 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.309036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cc4977dd-a88c-4dec-9721-49dc9418b3c3 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:23.327002 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cc4977dd-a88c-4dec-9721-49dc9418b3c3 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.267156 Oct 18 13:40:23.330110 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2491/5215] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:23 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:23.336720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ca2ae257-d652-4321-a99d-3fb4948bc8c1 req-4addc683-613d-469b-97d7-f1b00b662dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38401f91-0034-4290-b61d-0a09ae076c2e", "tag": "1c58069a-78e6-4d67-9725-0f6c1f442cb7"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:23.348575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ca2ae257-d652-4321-a99d-3fb4948bc8c1 req-4addc683-613d-469b-97d7-f1b00b662dd2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.349845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ca2ae257-d652-4321-a99d-3fb4948bc8c1 req-4addc683-613d-469b-97d7-f1b00b662dd2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.350928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ca2ae257-d652-4321-a99d-3fb4948bc8c1 req-4addc683-613d-469b-97d7-f1b00b662dd2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.366364 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ca2ae257-d652-4321-a99d-3fb4948bc8c1 req-4addc683-613d-469b-97d7-f1b00b662dd2 service nova] Creating event network-changed:1c58069a-78e6-4d67-9725-0f6c1f442cb7 for instance 38401f91-0034-4290-b61d-0a09ae076c2e on n-h1-858384-13 Oct 18 13:40:23.375604 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ca2ae257-d652-4321-a99d-3fb4948bc8c1 req-4addc683-613d-469b-97d7-f1b00b662dd2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043200 Oct 18 13:40:23.379562 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2492/5216] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:23.391417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4ba4eb86-b010-46e8-b086-444532220bfc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:23.393920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4ba4eb86-b010-46e8-b086-444532220bfc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:23.401704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ba4eb86-b010-46e8-b086-444532220bfc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.403443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ba4eb86-b010-46e8-b086-444532220bfc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.404091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ba4eb86-b010-46e8-b086-444532220bfc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.405031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ba4eb86-b010-46e8-b086-444532220bfc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.405967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ba4eb86-b010-46e8-b086-444532220bfc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.406728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ba4eb86-b010-46e8-b086-444532220bfc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.498828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4ba4eb86-b010-46e8-b086-444532220bfc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:23.509875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4ba4eb86-b010-46e8-b086-444532220bfc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:23.511771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4ba4eb86-b010-46e8-b086-444532220bfc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:23.513617 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4ba4eb86-b010-46e8-b086-444532220bfc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1336 microversion: 2.54 time: 0.132305 Oct 18 13:40:23.531035 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2493/5217] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:23 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1336 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:23.543619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-519e3b4a-b8a2-4940-b319-235237c2b66d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:23.552902 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-519e3b4a-b8a2-4940-b319-235237c2b66d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1484 microversion: 2.1 time: 0.476520 Oct 18 13:40:23.554364 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2725/5218] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:23 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1484 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:23.882043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-230cf363-1c06-47ca-b5bc-ea10585504de tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:23.882798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-230cf363-1c06-47ca-b5bc-ea10585504de tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:23.889255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-230cf363-1c06-47ca-b5bc-ea10585504de tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.890154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-230cf363-1c06-47ca-b5bc-ea10585504de tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.890751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-230cf363-1c06-47ca-b5bc-ea10585504de tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:23.891935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-230cf363-1c06-47ca-b5bc-ea10585504de tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:23.892592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-230cf363-1c06-47ca-b5bc-ea10585504de tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:23.893299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-230cf363-1c06-47ca-b5bc-ea10585504de tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.107707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-230cf363-1c06-47ca-b5bc-ea10585504de tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:24.121816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-230cf363-1c06-47ca-b5bc-ea10585504de tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:24.123578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-230cf363-1c06-47ca-b5bc-ea10585504de tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:24.125171 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-230cf363-1c06-47ca-b5bc-ea10585504de tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.247678 Oct 18 13:40:24.126342 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2494/5219] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:23 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:24.360349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b1122073-4a28-452a-b9b8-6a37b466f4d8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:24.361078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b1122073-4a28-452a-b9b8-6a37b466f4d8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:24.380050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1122073-4a28-452a-b9b8-6a37b466f4d8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.380643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1122073-4a28-452a-b9b8-6a37b466f4d8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.381168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1122073-4a28-452a-b9b8-6a37b466f4d8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.382771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1122073-4a28-452a-b9b8-6a37b466f4d8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.383827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1122073-4a28-452a-b9b8-6a37b466f4d8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.384469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b1122073-4a28-452a-b9b8-6a37b466f4d8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.545217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9bf9d881-1845-492a-999a-c334ce92a504 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:24.545889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9bf9d881-1845-492a-999a-c334ce92a504 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:24.562749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9bf9d881-1845-492a-999a-c334ce92a504 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.563480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9bf9d881-1845-492a-999a-c334ce92a504 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.566656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9bf9d881-1845-492a-999a-c334ce92a504 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.568873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9bf9d881-1845-492a-999a-c334ce92a504 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.570716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9bf9d881-1845-492a-999a-c334ce92a504 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.571355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9bf9d881-1845-492a-999a-c334ce92a504 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.683877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9bf9d881-1845-492a-999a-c334ce92a504 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:24.695384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9bf9d881-1845-492a-999a-c334ce92a504 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:24.696853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9bf9d881-1845-492a-999a-c334ce92a504 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:24.698095 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9bf9d881-1845-492a-999a-c334ce92a504 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1357 microversion: 2.54 time: 0.158829 Oct 18 13:40:24.702414 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2495/5220] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:24 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:24.734128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-01375f11-1b84-4c0f-9e83-15bec4e12209 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Action: 'create', calling method: .version_select at 0x7ff614312160>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-111258775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaAJTIsq82P86hpVMv25OTno4ObE9b1hqzMnPtEYit8crI7GSPKcgWSPYTaXHvqPrRkcOopBY9oTAOrlfoo1LFB3PXq/t9OqBxMsgqPhhdve8bfuLEau29bEemyrN1G+A=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:24.765993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-01375f11-1b84-4c0f-9e83-15bec4e12209 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Getting quotas for project 61422a6c4c2b497ca4d3d1eb17fc9a04. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:40:24.780324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-01375f11-1b84-4c0f-9e83-15bec4e12209 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Getting quotas for user 3e9326462c824768b94607692baee58d and project 61422a6c4c2b497ca4d3d1eb17fc9a04. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:40:24.819870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b1122073-4a28-452a-b9b8-6a37b466f4d8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:24.829040 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-01375f11-1b84-4c0f-9e83-15bec4e12209 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.099166 Oct 18 13:40:24.829686 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2496/5221] 10.222.0.40 () {62 vars in 1200 bytes} [Tue Oct 18 13:40:24 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 18 13:40:24.836712 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b1122073-4a28-452a-b9b8-6a37b466f4d8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.479571 Oct 18 13:40:24.836712 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2726/5222] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:24 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:24.857219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-111258775", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:24.859505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:24.873683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.874814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.875419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.876294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:24.876919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:24.878081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:24.988816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:40:24.989583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:40:24.990322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:40:24.991323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:40:24.991932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:40:25.125308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:25.135626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.136205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.136716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.137731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.138391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.139018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.163277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-691f709e-aa25-4ba2-8a62-12f8aa39d2e5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:25.164166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-691f709e-aa25-4ba2-8a62-12f8aa39d2e5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:25.191641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-691f709e-aa25-4ba2-8a62-12f8aa39d2e5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.193096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-691f709e-aa25-4ba2-8a62-12f8aa39d2e5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.195054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-691f709e-aa25-4ba2-8a62-12f8aa39d2e5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.198148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-691f709e-aa25-4ba2-8a62-12f8aa39d2e5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.199205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-691f709e-aa25-4ba2-8a62-12f8aa39d2e5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.205263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-691f709e-aa25-4ba2-8a62-12f8aa39d2e5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.232821 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-589292f7-5e3b-481e-ba6a-7c975283a95a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "POST /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b/action" status: 202 len: 1139 microversion: 2.54 time: 0.385897 Oct 18 13:40:25.237935 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2497/5223] 10.222.0.40 () {62 vars in 1320 bytes} [Tue Oct 18 13:40:24 2022] POST /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b/action => generated 1139 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 18 13:40:25.264199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-350d2f2e-7f50-44ac-9678-c74ba6ca9742 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:25.265619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-350d2f2e-7f50-44ac-9678-c74ba6ca9742 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:25.275586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-350d2f2e-7f50-44ac-9678-c74ba6ca9742 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.278356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-350d2f2e-7f50-44ac-9678-c74ba6ca9742 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.279317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-350d2f2e-7f50-44ac-9678-c74ba6ca9742 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.280424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-350d2f2e-7f50-44ac-9678-c74ba6ca9742 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.281433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-350d2f2e-7f50-44ac-9678-c74ba6ca9742 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.282107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-350d2f2e-7f50-44ac-9678-c74ba6ca9742 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.397255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-350d2f2e-7f50-44ac-9678-c74ba6ca9742 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:25.429528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-350d2f2e-7f50-44ac-9678-c74ba6ca9742 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:25.432777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-350d2f2e-7f50-44ac-9678-c74ba6ca9742 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:25.434398 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-350d2f2e-7f50-44ac-9678-c74ba6ca9742 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.178693 Oct 18 13:40:25.435525 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2498/5224] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:25 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:25.700877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-691f709e-aa25-4ba2-8a62-12f8aa39d2e5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:25.713382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-691f709e-aa25-4ba2-8a62-12f8aa39d2e5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:25.714832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-691f709e-aa25-4ba2-8a62-12f8aa39d2e5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:25.719622 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-691f709e-aa25-4ba2-8a62-12f8aa39d2e5 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.567246 Oct 18 13:40:25.726167 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2727/5225] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:25 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:25.863799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-61e41a30-36dc-4a53-b26e-efd37a99ad04 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:25.865161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-61e41a30-36dc-4a53-b26e-efd37a99ad04 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:25.875758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61e41a30-36dc-4a53-b26e-efd37a99ad04 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.876509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61e41a30-36dc-4a53-b26e-efd37a99ad04 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.877695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61e41a30-36dc-4a53-b26e-efd37a99ad04 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:25.878752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61e41a30-36dc-4a53-b26e-efd37a99ad04 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:25.879387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61e41a30-36dc-4a53-b26e-efd37a99ad04 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:25.880434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61e41a30-36dc-4a53-b26e-efd37a99ad04 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.092448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-61e41a30-36dc-4a53-b26e-efd37a99ad04 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:26.106137 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-61e41a30-36dc-4a53-b26e-efd37a99ad04 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.247868 Oct 18 13:40:26.107475 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2499/5226] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:25 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:26.470587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7bc550c6-edc1-492c-a9c9-5727bca75562 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:26.472785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7bc550c6-edc1-492c-a9c9-5727bca75562 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:26.506295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7bc550c6-edc1-492c-a9c9-5727bca75562 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:26.517146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7bc550c6-edc1-492c-a9c9-5727bca75562 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:26.519152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7bc550c6-edc1-492c-a9c9-5727bca75562 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.520019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7bc550c6-edc1-492c-a9c9-5727bca75562 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:26.521104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7bc550c6-edc1-492c-a9c9-5727bca75562 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:26.522689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7bc550c6-edc1-492c-a9c9-5727bca75562 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.603549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-6cb60039-bf4a-4943-bdde-f5a32be4fb14 req-77603dc9-78ed-4e6b-8d70-9ebad45d94fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c5c389-b7a1-4170-9b5c-321066d048e1", "name": "network-vif-plugged", "status": "completed", "tag": "74f52242-e00e-46f0-a3ba-47fe1d3cac8e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:26.619468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7bc550c6-edc1-492c-a9c9-5727bca75562 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:26.627082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6cb60039-bf4a-4943-bdde-f5a32be4fb14 req-77603dc9-78ed-4e6b-8d70-9ebad45d94fa service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:26.627705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6cb60039-bf4a-4943-bdde-f5a32be4fb14 req-77603dc9-78ed-4e6b-8d70-9ebad45d94fa service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:26.628337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6cb60039-bf4a-4943-bdde-f5a32be4fb14 req-77603dc9-78ed-4e6b-8d70-9ebad45d94fa service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.630987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7bc550c6-edc1-492c-a9c9-5727bca75562 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:26.633491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7bc550c6-edc1-492c-a9c9-5727bca75562 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:26.636189 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7bc550c6-edc1-492c-a9c9-5727bca75562 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.173317 Oct 18 13:40:26.636632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:26.638658 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2728/5227] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:26 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:26.656304 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-6cb60039-bf4a-4943-bdde-f5a32be4fb14 req-77603dc9-78ed-4e6b-8d70-9ebad45d94fa service nova] Creating event network-vif-plugged:74f52242-e00e-46f0-a3ba-47fe1d3cac8e for instance 31c5c389-b7a1-4170-9b5c-321066d048e1 on n-h2-858384-13 Oct 18 13:40:26.663454 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-6cb60039-bf4a-4943-bdde-f5a32be4fb14 req-77603dc9-78ed-4e6b-8d70-9ebad45d94fa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063674 Oct 18 13:40:26.664584 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2500/5228] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:26.758100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-47889bbe-9cf1-40ee-9a37-2249f08f5582 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:26.758796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-47889bbe-9cf1-40ee-9a37-2249f08f5582 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:26.774643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47889bbe-9cf1-40ee-9a37-2249f08f5582 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:26.777985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47889bbe-9cf1-40ee-9a37-2249f08f5582 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:26.778518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47889bbe-9cf1-40ee-9a37-2249f08f5582 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.780087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47889bbe-9cf1-40ee-9a37-2249f08f5582 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:26.781173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47889bbe-9cf1-40ee-9a37-2249f08f5582 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:26.782556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47889bbe-9cf1-40ee-9a37-2249f08f5582 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:26.974235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-47889bbe-9cf1-40ee-9a37-2249f08f5582 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:26.985669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-47889bbe-9cf1-40ee-9a37-2249f08f5582 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:26.988528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-47889bbe-9cf1-40ee-9a37-2249f08f5582 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:26.990400 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-47889bbe-9cf1-40ee-9a37-2249f08f5582 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.238314 Oct 18 13:40:26.991495 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2729/5229] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:26 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:27.136665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8dd45741-dec7-4739-b4f2-58fd9eab866f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:27.137689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8dd45741-dec7-4739-b4f2-58fd9eab866f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:27.146004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8dd45741-dec7-4739-b4f2-58fd9eab866f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:27.146853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8dd45741-dec7-4739-b4f2-58fd9eab866f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:27.147299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8dd45741-dec7-4739-b4f2-58fd9eab866f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:27.148009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8dd45741-dec7-4739-b4f2-58fd9eab866f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:27.148459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8dd45741-dec7-4739-b4f2-58fd9eab866f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:27.148884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8dd45741-dec7-4739-b4f2-58fd9eab866f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:27.408080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8dd45741-dec7-4739-b4f2-58fd9eab866f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:27.421332 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8dd45741-dec7-4739-b4f2-58fd9eab866f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.289748 Oct 18 13:40:27.422508 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2501/5230] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:27 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:27.670500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8df98158-7792-4c3f-9d5d-57cc9736a138 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:27.671937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8df98158-7792-4c3f-9d5d-57cc9736a138 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:27.684347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8df98158-7792-4c3f-9d5d-57cc9736a138 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:27.684934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8df98158-7792-4c3f-9d5d-57cc9736a138 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:27.685982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8df98158-7792-4c3f-9d5d-57cc9736a138 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:27.686726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8df98158-7792-4c3f-9d5d-57cc9736a138 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:27.689104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8df98158-7792-4c3f-9d5d-57cc9736a138 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:27.689610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8df98158-7792-4c3f-9d5d-57cc9736a138 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:27.806771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8df98158-7792-4c3f-9d5d-57cc9736a138 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:27.820864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8df98158-7792-4c3f-9d5d-57cc9736a138 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:27.823291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8df98158-7792-4c3f-9d5d-57cc9736a138 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:27.824946 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8df98158-7792-4c3f-9d5d-57cc9736a138 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.160891 Oct 18 13:40:27.825867 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2730/5231] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:27 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:28.099091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-44b11e97-b7d9-49d9-be4b-beb86dfa4512 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:28.100959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-44b11e97-b7d9-49d9-be4b-beb86dfa4512 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:28.108726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:28.111293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44b11e97-b7d9-49d9-be4b-beb86dfa4512 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.115101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44b11e97-b7d9-49d9-be4b-beb86dfa4512 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.116216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44b11e97-b7d9-49d9-be4b-beb86dfa4512 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.117665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44b11e97-b7d9-49d9-be4b-beb86dfa4512 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.118784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44b11e97-b7d9-49d9-be4b-beb86dfa4512 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.120066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44b11e97-b7d9-49d9-be4b-beb86dfa4512 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.386325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-44b11e97-b7d9-49d9-be4b-beb86dfa4512 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:28.395353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-44b11e97-b7d9-49d9-be4b-beb86dfa4512 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:28.396812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-44b11e97-b7d9-49d9-be4b-beb86dfa4512 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:28.404847 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-44b11e97-b7d9-49d9-be4b-beb86dfa4512 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.310964 Oct 18 13:40:28.406049 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2502/5232] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:28 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:28.447561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bd3c7af2-1e35-4f9f-8c80-55cb6084b418 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:28.448410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bd3c7af2-1e35-4f9f-8c80-55cb6084b418 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:28.451875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:28.454499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:28.466394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd3c7af2-1e35-4f9f-8c80-55cb6084b418 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.468167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd3c7af2-1e35-4f9f-8c80-55cb6084b418 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.469601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd3c7af2-1e35-4f9f-8c80-55cb6084b418 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.473369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd3c7af2-1e35-4f9f-8c80-55cb6084b418 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.476297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd3c7af2-1e35-4f9f-8c80-55cb6084b418 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.476741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd3c7af2-1e35-4f9f-8c80-55cb6084b418 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.650940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bd3c7af2-1e35-4f9f-8c80-55cb6084b418 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:28.662474 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bd3c7af2-1e35-4f9f-8c80-55cb6084b418 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.219772 Oct 18 13:40:28.663762 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2731/5233] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:28 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:28.859335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3570a8cb-8e3b-4a27-8bd6-1f514533292e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:28.860688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3570a8cb-8e3b-4a27-8bd6-1f514533292e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:28.867591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3570a8cb-8e3b-4a27-8bd6-1f514533292e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.868339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3570a8cb-8e3b-4a27-8bd6-1f514533292e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.869351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3570a8cb-8e3b-4a27-8bd6-1f514533292e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:28.870392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3570a8cb-8e3b-4a27-8bd6-1f514533292e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:28.870856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3570a8cb-8e3b-4a27-8bd6-1f514533292e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:28.871341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3570a8cb-8e3b-4a27-8bd6-1f514533292e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.019480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3570a8cb-8e3b-4a27-8bd6-1f514533292e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:29.028355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3570a8cb-8e3b-4a27-8bd6-1f514533292e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:29.041629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3570a8cb-8e3b-4a27-8bd6-1f514533292e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:29.043345 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3570a8cb-8e3b-4a27-8bd6-1f514533292e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.194976 Oct 18 13:40:29.047213 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2503/5234] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:28 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:29.436621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cd975bdc-64da-4c31-8473-38b4e0ad92e9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:29.437618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cd975bdc-64da-4c31-8473-38b4e0ad92e9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:29.452266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd975bdc-64da-4c31-8473-38b4e0ad92e9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.453043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd975bdc-64da-4c31-8473-38b4e0ad92e9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.453970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd975bdc-64da-4c31-8473-38b4e0ad92e9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.454942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd975bdc-64da-4c31-8473-38b4e0ad92e9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.455806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd975bdc-64da-4c31-8473-38b4e0ad92e9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.456736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd975bdc-64da-4c31-8473-38b4e0ad92e9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.692387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-82bf9279-c139-4438-a1b4-70b1f5341a00 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:29.693411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-82bf9279-c139-4438-a1b4-70b1f5341a00 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:29.703941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82bf9279-c139-4438-a1b4-70b1f5341a00 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.704611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82bf9279-c139-4438-a1b4-70b1f5341a00 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.705046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82bf9279-c139-4438-a1b4-70b1f5341a00 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.706661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82bf9279-c139-4438-a1b4-70b1f5341a00 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:29.707144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82bf9279-c139-4438-a1b4-70b1f5341a00 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:29.707547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82bf9279-c139-4438-a1b4-70b1f5341a00 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:29.716142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cd975bdc-64da-4c31-8473-38b4e0ad92e9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:29.732593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cd975bdc-64da-4c31-8473-38b4e0ad92e9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:29.734466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cd975bdc-64da-4c31-8473-38b4e0ad92e9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:29.735928 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cd975bdc-64da-4c31-8473-38b4e0ad92e9 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1729 microversion: 2.20 time: 0.303588 Oct 18 13:40:29.749156 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2732/5235] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:29 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1729 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:29.895744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-82bf9279-c139-4438-a1b4-70b1f5341a00 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:29.906819 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-82bf9279-c139-4438-a1b4-70b1f5341a00 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1735 microversion: 2.1 time: 0.219559 Oct 18 13:40:29.937607 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2504/5236] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:29 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:30.073857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-858af702-1c59-4dc3-ac9e-d83de804eaf2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:30.074486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-858af702-1c59-4dc3-ac9e-d83de804eaf2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:30.088780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-858af702-1c59-4dc3-ac9e-d83de804eaf2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.089759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-858af702-1c59-4dc3-ac9e-d83de804eaf2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.090456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-858af702-1c59-4dc3-ac9e-d83de804eaf2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.102637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-858af702-1c59-4dc3-ac9e-d83de804eaf2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.104152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-858af702-1c59-4dc3-ac9e-d83de804eaf2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.105171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-858af702-1c59-4dc3-ac9e-d83de804eaf2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.398634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-858af702-1c59-4dc3-ac9e-d83de804eaf2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:30.412135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-858af702-1c59-4dc3-ac9e-d83de804eaf2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:30.415021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-858af702-1c59-4dc3-ac9e-d83de804eaf2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:30.416422 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-858af702-1c59-4dc3-ac9e-d83de804eaf2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.347256 Oct 18 13:40:30.417025 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2733/5237] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:30 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:30.772534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-990fd464-3566-49c1-8fd6-b8b18ecf790b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:30.775481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-990fd464-3566-49c1-8fd6-b8b18ecf790b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:30.790912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-990fd464-3566-49c1-8fd6-b8b18ecf790b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.791410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-990fd464-3566-49c1-8fd6-b8b18ecf790b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.792436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-990fd464-3566-49c1-8fd6-b8b18ecf790b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.793233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-990fd464-3566-49c1-8fd6-b8b18ecf790b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.795835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-990fd464-3566-49c1-8fd6-b8b18ecf790b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.796783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-990fd464-3566-49c1-8fd6-b8b18ecf790b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.946582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b35cf755-9256-48d5-b973-6dd0cda23b28 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:30.951514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b35cf755-9256-48d5-b973-6dd0cda23b28 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:30.962420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b35cf755-9256-48d5-b973-6dd0cda23b28 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.963265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b35cf755-9256-48d5-b973-6dd0cda23b28 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.963933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b35cf755-9256-48d5-b973-6dd0cda23b28 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:30.965043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b35cf755-9256-48d5-b973-6dd0cda23b28 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:30.965871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b35cf755-9256-48d5-b973-6dd0cda23b28 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:30.966412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b35cf755-9256-48d5-b973-6dd0cda23b28 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.079562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-990fd464-3566-49c1-8fd6-b8b18ecf790b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:31.100766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-990fd464-3566-49c1-8fd6-b8b18ecf790b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:31.102286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-990fd464-3566-49c1-8fd6-b8b18ecf790b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:31.103512 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-990fd464-3566-49c1-8fd6-b8b18ecf790b tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1716 microversion: 2.20 time: 0.339529 Oct 18 13:40:31.109336 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2505/5238] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:30 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1716 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:31.206949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b35cf755-9256-48d5-b973-6dd0cda23b28 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:31.224513 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b35cf755-9256-48d5-b973-6dd0cda23b28 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1715 microversion: 2.1 time: 0.282685 Oct 18 13:40:31.233656 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2734/5239] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:30 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1715 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:31.390048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-52007039-1a81-43b8-a296-50187adbbd30 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.390549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-52007039-1a81-43b8-a296-50187adbbd30 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:31.397726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52007039-1a81-43b8-a296-50187adbbd30 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.398512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52007039-1a81-43b8-a296-50187adbbd30 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.399206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52007039-1a81-43b8-a296-50187adbbd30 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.400148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52007039-1a81-43b8-a296-50187adbbd30 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.400849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52007039-1a81-43b8-a296-50187adbbd30 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.401734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52007039-1a81-43b8-a296-50187adbbd30 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.452137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c68789b9-948b-49e2-90d7-904f43de7929 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.453082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c68789b9-948b-49e2-90d7-904f43de7929 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:31.464438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c68789b9-948b-49e2-90d7-904f43de7929 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.464940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c68789b9-948b-49e2-90d7-904f43de7929 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.466767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c68789b9-948b-49e2-90d7-904f43de7929 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.469371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c68789b9-948b-49e2-90d7-904f43de7929 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.471617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c68789b9-948b-49e2-90d7-904f43de7929 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.472295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c68789b9-948b-49e2-90d7-904f43de7929 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.562630 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-52007039-1a81-43b8-a296-50187adbbd30 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] HTTP exception thrown: Cannot 'detach_volume' instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 while it is in vm_state rescued Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-52007039-1a81-43b8-a296-50187adbbd30 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Request method failure captured: Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments/4b7a1ed8-130b-42ad-86b4-bbb9799840d4 HTTP/1.1 Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvrqX_zkCEhVydfvHZBeTI6vdRWUcUOpxttnLcg2aIsaFsLlHnFjovxQI4kcc3Myi8lwAHRAsf2wLTn_JlgKXt7GIy8E5du_6bYylQ1wRbIaq_CdQtpXoiOxia-B1issY5UDMjn_CVSSo9PM6M7QgZo_y7FdWj0xg611rUe51cUCao Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0cdfce6f9e86407d883e624dd2c50559"}]}] Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 4113a1418b92488e97bf50aecdd49bb1 Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: exception: Cannot 'detach_volume' instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 while it is in vm_state rescued Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'server_id': '60a18df7-1403-4f6a-8c6c-5f3e0eaaf739', 'id': '4b7a1ed8-130b-42ad-86b4-bbb9799840d4'} Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 while it is in vm_state rescued Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:31.564103 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:31.569771 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:31.569771 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:31.569771 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:31.569771 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:31.569771 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 while it is in vm_state rescued Oct 18 13:40:31.569771 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:31.574512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-52007039-1a81-43b8-a296-50187adbbd30 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Returning 409 to user: Cannot 'detach_volume' instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 while it is in vm_state rescued {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:31.575412 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-52007039-1a81-43b8-a296-50187adbbd30 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "DELETE /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments/4b7a1ed8-130b-42ad-86b4-bbb9799840d4" status: 409 len: 152 microversion: 2.1 time: 0.190024 Oct 18 13:40:31.579566 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2506/5240] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:40:31 2022] DELETE /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments/4b7a1ed8-130b-42ad-86b4-bbb9799840d4 => generated 152 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:40:31.585540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-80d672e1-df4d-4976-af33-8a62f7a39436 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:31.586296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-80d672e1-df4d-4976-af33-8a62f7a39436 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:31.592650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80d672e1-df4d-4976-af33-8a62f7a39436 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.593421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80d672e1-df4d-4976-af33-8a62f7a39436 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.594054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80d672e1-df4d-4976-af33-8a62f7a39436 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.594949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80d672e1-df4d-4976-af33-8a62f7a39436 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.595578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80d672e1-df4d-4976-af33-8a62f7a39436 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.596214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80d672e1-df4d-4976-af33-8a62f7a39436 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.599399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c68789b9-948b-49e2-90d7-904f43de7929 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:31.616460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c68789b9-948b-49e2-90d7-904f43de7929 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:31.618113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c68789b9-948b-49e2-90d7-904f43de7929 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:31.620272 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c68789b9-948b-49e2-90d7-904f43de7929 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.172163 Oct 18 13:40:31.621084 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2735/5241] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:31.694137 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-80d672e1-df4d-4976-af33-8a62f7a39436 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/action" status: 202 len: 0 microversion: 2.1 time: 0.112494 Oct 18 13:40:31.695765 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2507/5242] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:40:31 2022] POST /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:40:31.705311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6c8f9404-c080-4e22-a8a2-7adcfa016fb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:31.706030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6c8f9404-c080-4e22-a8a2-7adcfa016fb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:31.713039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c8f9404-c080-4e22-a8a2-7adcfa016fb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.713893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c8f9404-c080-4e22-a8a2-7adcfa016fb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.714857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c8f9404-c080-4e22-a8a2-7adcfa016fb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.715990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c8f9404-c080-4e22-a8a2-7adcfa016fb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:31.716751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c8f9404-c080-4e22-a8a2-7adcfa016fb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:31.717595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c8f9404-c080-4e22-a8a2-7adcfa016fb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:31.953247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6c8f9404-c080-4e22-a8a2-7adcfa016fb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:31.973094 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6c8f9404-c080-4e22-a8a2-7adcfa016fb5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1723 microversion: 2.1 time: 0.272928 Oct 18 13:40:31.974423 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2736/5243] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:31 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:32.650944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2fc5f08a-43d0-4127-ab49-d75cff937b75 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:32.651784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2fc5f08a-43d0-4127-ab49-d75cff937b75 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:32.659170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fc5f08a-43d0-4127-ab49-d75cff937b75 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:32.659874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fc5f08a-43d0-4127-ab49-d75cff937b75 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:32.660407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fc5f08a-43d0-4127-ab49-d75cff937b75 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:32.661428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fc5f08a-43d0-4127-ab49-d75cff937b75 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:32.661968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fc5f08a-43d0-4127-ab49-d75cff937b75 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:32.662748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fc5f08a-43d0-4127-ab49-d75cff937b75 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:32.742794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2fc5f08a-43d0-4127-ab49-d75cff937b75 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:32.752068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2fc5f08a-43d0-4127-ab49-d75cff937b75 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:32.753668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2fc5f08a-43d0-4127-ab49-d75cff937b75 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:32.755164 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2fc5f08a-43d0-4127-ab49-d75cff937b75 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.110269 Oct 18 13:40:32.756733 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2508/5244] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:32 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:33.004910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ce1a02ad-6991-4453-b8fd-bb8ca098d6be tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:33.006405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ce1a02ad-6991-4453-b8fd-bb8ca098d6be tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:33.013978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce1a02ad-6991-4453-b8fd-bb8ca098d6be tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:33.014544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce1a02ad-6991-4453-b8fd-bb8ca098d6be tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:33.015080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce1a02ad-6991-4453-b8fd-bb8ca098d6be tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:33.015850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce1a02ad-6991-4453-b8fd-bb8ca098d6be tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:33.016382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce1a02ad-6991-4453-b8fd-bb8ca098d6be tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:33.016993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce1a02ad-6991-4453-b8fd-bb8ca098d6be tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:33.241163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ce1a02ad-6991-4453-b8fd-bb8ca098d6be tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:33.255898 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ce1a02ad-6991-4453-b8fd-bb8ca098d6be tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1723 microversion: 2.1 time: 0.256086 Oct 18 13:40:33.269675 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2737/5245] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:32 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:33.789703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f78488a6-54c9-42c8-a3fd-a9b703c12d62 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:33.790333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f78488a6-54c9-42c8-a3fd-a9b703c12d62 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:33.815269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f78488a6-54c9-42c8-a3fd-a9b703c12d62 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:33.817847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f78488a6-54c9-42c8-a3fd-a9b703c12d62 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:33.821084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f78488a6-54c9-42c8-a3fd-a9b703c12d62 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:33.821869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f78488a6-54c9-42c8-a3fd-a9b703c12d62 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:33.822332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f78488a6-54c9-42c8-a3fd-a9b703c12d62 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:33.822761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f78488a6-54c9-42c8-a3fd-a9b703c12d62 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:33.908982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f78488a6-54c9-42c8-a3fd-a9b703c12d62 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:33.921807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f78488a6-54c9-42c8-a3fd-a9b703c12d62 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:33.924695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f78488a6-54c9-42c8-a3fd-a9b703c12d62 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:33.926454 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f78488a6-54c9-42c8-a3fd-a9b703c12d62 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.148001 Oct 18 13:40:33.927717 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2509/5246] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:33 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:34.279926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d70111ed-5e26-43cd-a603-858fcd25e8d2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:34.280539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d70111ed-5e26-43cd-a603-858fcd25e8d2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:34.288258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d70111ed-5e26-43cd-a603-858fcd25e8d2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:34.289111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d70111ed-5e26-43cd-a603-858fcd25e8d2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:34.289636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d70111ed-5e26-43cd-a603-858fcd25e8d2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:34.290590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d70111ed-5e26-43cd-a603-858fcd25e8d2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:34.291280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d70111ed-5e26-43cd-a603-858fcd25e8d2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:34.291772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d70111ed-5e26-43cd-a603-858fcd25e8d2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:34.504930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d70111ed-5e26-43cd-a603-858fcd25e8d2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:34.514175 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d70111ed-5e26-43cd-a603-858fcd25e8d2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1723 microversion: 2.1 time: 0.238067 Oct 18 13:40:34.515179 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2738/5247] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:34 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:34.956031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2e0df79e-7f2d-451d-bc11-21d13cfb6fc9 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:34.957216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2e0df79e-7f2d-451d-bc11-21d13cfb6fc9 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:34.966917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:34.972268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e0df79e-7f2d-451d-bc11-21d13cfb6fc9 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:34.973610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e0df79e-7f2d-451d-bc11-21d13cfb6fc9 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:34.974199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e0df79e-7f2d-451d-bc11-21d13cfb6fc9 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:34.975410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e0df79e-7f2d-451d-bc11-21d13cfb6fc9 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:34.975640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e0df79e-7f2d-451d-bc11-21d13cfb6fc9 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:34.976031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e0df79e-7f2d-451d-bc11-21d13cfb6fc9 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.102725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2e0df79e-7f2d-451d-bc11-21d13cfb6fc9 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:35.112555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2e0df79e-7f2d-451d-bc11-21d13cfb6fc9 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:35.115561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2e0df79e-7f2d-451d-bc11-21d13cfb6fc9 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:35.117385 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2e0df79e-7f2d-451d-bc11-21d13cfb6fc9 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.165776 Oct 18 13:40:35.121402 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2510/5248] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:34 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:35.538697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b786bc84-a276-472f-84c7-7de317ee0c0e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:35.539312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b786bc84-a276-472f-84c7-7de317ee0c0e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:35.547348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b786bc84-a276-472f-84c7-7de317ee0c0e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:35.547837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b786bc84-a276-472f-84c7-7de317ee0c0e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:35.548266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b786bc84-a276-472f-84c7-7de317ee0c0e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.549770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b786bc84-a276-472f-84c7-7de317ee0c0e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:35.550410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b786bc84-a276-472f-84c7-7de317ee0c0e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:35.550834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b786bc84-a276-472f-84c7-7de317ee0c0e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.709477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b786bc84-a276-472f-84c7-7de317ee0c0e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:35.719211 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b786bc84-a276-472f-84c7-7de317ee0c0e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1729 microversion: 2.1 time: 0.184253 Oct 18 13:40:35.720068 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2739/5249] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:35 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:35.744835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-55401193-5ddb-4927-a527-3c5b7a8c9e56 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:35.746023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-55401193-5ddb-4927-a527-3c5b7a8c9e56 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:35.754698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55401193-5ddb-4927-a527-3c5b7a8c9e56 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:35.755629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55401193-5ddb-4927-a527-3c5b7a8c9e56 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:35.756228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55401193-5ddb-4927-a527-3c5b7a8c9e56 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.758289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55401193-5ddb-4927-a527-3c5b7a8c9e56 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:35.758926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55401193-5ddb-4927-a527-3c5b7a8c9e56 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:35.759368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-55401193-5ddb-4927-a527-3c5b7a8c9e56 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:35.873355 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-55401193-5ddb-4927-a527-3c5b7a8c9e56 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133341 Oct 18 13:40:35.882827 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2511/5250] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:40:35 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:40:36.145662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc98bd76-8f96-4628-9bff-86abf154764c tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:36.146297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc98bd76-8f96-4628-9bff-86abf154764c tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:36.159542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc98bd76-8f96-4628-9bff-86abf154764c tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:36.160036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc98bd76-8f96-4628-9bff-86abf154764c tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:36.160473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc98bd76-8f96-4628-9bff-86abf154764c tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:36.161203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc98bd76-8f96-4628-9bff-86abf154764c tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:36.161651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc98bd76-8f96-4628-9bff-86abf154764c tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:36.162079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc98bd76-8f96-4628-9bff-86abf154764c tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:36.175297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:36.381724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc98bd76-8f96-4628-9bff-86abf154764c tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:36.391528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc98bd76-8f96-4628-9bff-86abf154764c tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:36.393561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc98bd76-8f96-4628-9bff-86abf154764c tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:36.394765 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc98bd76-8f96-4628-9bff-86abf154764c tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.254768 Oct 18 13:40:36.417205 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2740/5251] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:36 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:36.984830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-41332b61-78f9-4db5-b320-0f151c017732 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:36.988784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-41332b61-78f9-4db5-b320-0f151c017732 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:36.999916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41332b61-78f9-4db5-b320-0f151c017732 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.005542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41332b61-78f9-4db5-b320-0f151c017732 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.006964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41332b61-78f9-4db5-b320-0f151c017732 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.007733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41332b61-78f9-4db5-b320-0f151c017732 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.010046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41332b61-78f9-4db5-b320-0f151c017732 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.010500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-41332b61-78f9-4db5-b320-0f151c017732 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.099447 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-41332b61-78f9-4db5-b320-0f151c017732 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120587 Oct 18 13:40:37.106372 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2512/5252] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:40:36 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:40:37.248645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53c8e274-d72f-4925-bae8-e7f5371ae7c7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:37.249541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53c8e274-d72f-4925-bae8-e7f5371ae7c7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:37.263944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53c8e274-d72f-4925-bae8-e7f5371ae7c7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.264599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53c8e274-d72f-4925-bae8-e7f5371ae7c7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.265337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53c8e274-d72f-4925-bae8-e7f5371ae7c7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.266793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53c8e274-d72f-4925-bae8-e7f5371ae7c7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.269549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53c8e274-d72f-4925-bae8-e7f5371ae7c7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.270230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53c8e274-d72f-4925-bae8-e7f5371ae7c7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.328398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53c8e274-d72f-4925-bae8-e7f5371ae7c7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:40:37.427782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6a227e6f-a354-4911-9a90-35e9d312a006 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:37.429135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6a227e6f-a354-4911-9a90-35e9d312a006 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:37.445523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a227e6f-a354-4911-9a90-35e9d312a006 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.446237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a227e6f-a354-4911-9a90-35e9d312a006 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.446686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a227e6f-a354-4911-9a90-35e9d312a006 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.447410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a227e6f-a354-4911-9a90-35e9d312a006 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.454245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a227e6f-a354-4911-9a90-35e9d312a006 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.454616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a227e6f-a354-4911-9a90-35e9d312a006 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.473533 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53c8e274-d72f-4925-bae8-e7f5371ae7c7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 204 len: 0 microversion: 2.1 time: 0.228705 Oct 18 13:40:37.474138 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2741/5253] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:40:37 2022] DELETE /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:40:37.484464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1dfa789e-482c-45d8-8f36-8ccf4db7b132 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:37.489940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1dfa789e-482c-45d8-8f36-8ccf4db7b132 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:37.502268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dfa789e-482c-45d8-8f36-8ccf4db7b132 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.502972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dfa789e-482c-45d8-8f36-8ccf4db7b132 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.503604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dfa789e-482c-45d8-8f36-8ccf4db7b132 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.504334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dfa789e-482c-45d8-8f36-8ccf4db7b132 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.504799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dfa789e-482c-45d8-8f36-8ccf4db7b132 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.505248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1dfa789e-482c-45d8-8f36-8ccf4db7b132 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.592422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6a227e6f-a354-4911-9a90-35e9d312a006 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:37.603809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6a227e6f-a354-4911-9a90-35e9d312a006 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:37.605405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6a227e6f-a354-4911-9a90-35e9d312a006 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:37.609322 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6a227e6f-a354-4911-9a90-35e9d312a006 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.185608 Oct 18 13:40:37.610334 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2513/5254] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:37 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:37.789791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1dfa789e-482c-45d8-8f36-8ccf4db7b132 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:37.808410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a96c1519-9e31-48b2-93b9-aa545aeab1e1 req-ca2cfb1a-b644-446f-96fc-9796e38a01f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a18df7-1403-4f6a-8c6c-5f3e0eaaf739", "tag": "e71918e1-9c7b-4c0b-907f-a8dbe92a0c97"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:37.818045 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1dfa789e-482c-45d8-8f36-8ccf4db7b132 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1671 microversion: 2.1 time: 0.338580 Oct 18 13:40:37.818753 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2742/5255] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:37 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1671 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:37.833753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a96c1519-9e31-48b2-93b9-aa545aeab1e1 req-ca2cfb1a-b644-446f-96fc-9796e38a01f8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:37.835023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a96c1519-9e31-48b2-93b9-aa545aeab1e1 req-ca2cfb1a-b644-446f-96fc-9796e38a01f8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:37.836354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a96c1519-9e31-48b2-93b9-aa545aeab1e1 req-ca2cfb1a-b644-446f-96fc-9796e38a01f8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:37.853746 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a96c1519-9e31-48b2-93b9-aa545aeab1e1 req-ca2cfb1a-b644-446f-96fc-9796e38a01f8 service nova] Creating event network-changed:e71918e1-9c7b-4c0b-907f-a8dbe92a0c97 for instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 on n-h1-858384-13 Oct 18 13:40:37.859675 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a96c1519-9e31-48b2-93b9-aa545aeab1e1 req-ca2cfb1a-b644-446f-96fc-9796e38a01f8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057390 Oct 18 13:40:37.860621 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2514/5256] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:40:38.636886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cfe0534e-c9ca-4c12-aebb-95f4dcd094b3 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:38.638288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cfe0534e-c9ca-4c12-aebb-95f4dcd094b3 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:38.647474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfe0534e-c9ca-4c12-aebb-95f4dcd094b3 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:38.648297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfe0534e-c9ca-4c12-aebb-95f4dcd094b3 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:38.648897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfe0534e-c9ca-4c12-aebb-95f4dcd094b3 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:38.650112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfe0534e-c9ca-4c12-aebb-95f4dcd094b3 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:38.650760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfe0534e-c9ca-4c12-aebb-95f4dcd094b3 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:38.651354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfe0534e-c9ca-4c12-aebb-95f4dcd094b3 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:38.752337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cfe0534e-c9ca-4c12-aebb-95f4dcd094b3 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:38.761039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cfe0534e-c9ca-4c12-aebb-95f4dcd094b3 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:38.762513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cfe0534e-c9ca-4c12-aebb-95f4dcd094b3 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:38.763702 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cfe0534e-c9ca-4c12-aebb-95f4dcd094b3 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.131594 Oct 18 13:40:38.764276 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2743/5257] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:38 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:38.854645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-146c5784-0628-4119-8cf8-3bdbe0e442bb tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:38.855928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-146c5784-0628-4119-8cf8-3bdbe0e442bb tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:38.870649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-146c5784-0628-4119-8cf8-3bdbe0e442bb tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:38.871184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-146c5784-0628-4119-8cf8-3bdbe0e442bb tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:38.871660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-146c5784-0628-4119-8cf8-3bdbe0e442bb tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:38.872539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-146c5784-0628-4119-8cf8-3bdbe0e442bb tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:38.873053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-146c5784-0628-4119-8cf8-3bdbe0e442bb tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:38.873651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-146c5784-0628-4119-8cf8-3bdbe0e442bb tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:39.055333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-146c5784-0628-4119-8cf8-3bdbe0e442bb tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:39.063391 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-146c5784-0628-4119-8cf8-3bdbe0e442bb tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1671 microversion: 2.1 time: 0.224695 Oct 18 13:40:39.063957 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2515/5258] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:38 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1671 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:39.790715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cbc225df-00ea-4dcf-b01e-27b437e2238f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:39.791357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cbc225df-00ea-4dcf-b01e-27b437e2238f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:39.806100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbc225df-00ea-4dcf-b01e-27b437e2238f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:39.806765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbc225df-00ea-4dcf-b01e-27b437e2238f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:39.807294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbc225df-00ea-4dcf-b01e-27b437e2238f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:39.808678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbc225df-00ea-4dcf-b01e-27b437e2238f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:39.809292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbc225df-00ea-4dcf-b01e-27b437e2238f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:39.810020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbc225df-00ea-4dcf-b01e-27b437e2238f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:39.899102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-517f84c8-8393-409f-ad5e-21f1f40760d0 req-ad12ccc9-f516-440b-afcc-d43fd9c90eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a18df7-1403-4f6a-8c6c-5f3e0eaaf739", "tag": "e71918e1-9c7b-4c0b-907f-a8dbe92a0c97"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:39.901854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cbc225df-00ea-4dcf-b01e-27b437e2238f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:39.911320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-517f84c8-8393-409f-ad5e-21f1f40760d0 req-ad12ccc9-f516-440b-afcc-d43fd9c90eb0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:39.912149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-517f84c8-8393-409f-ad5e-21f1f40760d0 req-ad12ccc9-f516-440b-afcc-d43fd9c90eb0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:39.912816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-517f84c8-8393-409f-ad5e-21f1f40760d0 req-ad12ccc9-f516-440b-afcc-d43fd9c90eb0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:39.928948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cbc225df-00ea-4dcf-b01e-27b437e2238f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:39.941274 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-517f84c8-8393-409f-ad5e-21f1f40760d0 req-ad12ccc9-f516-440b-afcc-d43fd9c90eb0 service nova] Creating event network-changed:e71918e1-9c7b-4c0b-907f-a8dbe92a0c97 for instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 on n-h1-858384-13 Oct 18 13:40:39.942894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cbc225df-00ea-4dcf-b01e-27b437e2238f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:39.946919 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cbc225df-00ea-4dcf-b01e-27b437e2238f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.159484 Oct 18 13:40:39.947192 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-517f84c8-8393-409f-ad5e-21f1f40760d0 req-ad12ccc9-f516-440b-afcc-d43fd9c90eb0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052296 Oct 18 13:40:39.948224 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2516/5259] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:40:39.967343 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2744/5260] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:39 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:40.096674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-db76e1d4-2ef9-4733-8e0e-3e03add9af3c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:40.097793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-db76e1d4-2ef9-4733-8e0e-3e03add9af3c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:40.106465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db76e1d4-2ef9-4733-8e0e-3e03add9af3c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:40.107276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db76e1d4-2ef9-4733-8e0e-3e03add9af3c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:40.108060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db76e1d4-2ef9-4733-8e0e-3e03add9af3c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:40.109296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db76e1d4-2ef9-4733-8e0e-3e03add9af3c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:40.109967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db76e1d4-2ef9-4733-8e0e-3e03add9af3c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:40.110606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db76e1d4-2ef9-4733-8e0e-3e03add9af3c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:40.416812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-db76e1d4-2ef9-4733-8e0e-3e03add9af3c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:40.434001 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-db76e1d4-2ef9-4733-8e0e-3e03add9af3c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1671 microversion: 2.1 time: 0.347490 Oct 18 13:40:40.435054 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2517/5261] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:40 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1671 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:40.978301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f2811f52-b630-4eec-83a2-230c3bf13477 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:40.978924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f2811f52-b630-4eec-83a2-230c3bf13477 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:41.004084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2811f52-b630-4eec-83a2-230c3bf13477 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.006851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2811f52-b630-4eec-83a2-230c3bf13477 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.013320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2811f52-b630-4eec-83a2-230c3bf13477 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.014350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2811f52-b630-4eec-83a2-230c3bf13477 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.015900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2811f52-b630-4eec-83a2-230c3bf13477 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.016342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f2811f52-b630-4eec-83a2-230c3bf13477 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.147944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f2811f52-b630-4eec-83a2-230c3bf13477 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:41.163468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f2811f52-b630-4eec-83a2-230c3bf13477 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:41.164928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f2811f52-b630-4eec-83a2-230c3bf13477 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:41.166194 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f2811f52-b630-4eec-83a2-230c3bf13477 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.192915 Oct 18 13:40:41.166973 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2745/5262] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:40 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:41.461168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:41.461849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:41.470242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.470953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.471672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.472469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.473096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.473755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.481328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:41.526413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.527266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.527803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:41.528500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lazy-loading 'fault' on Instance uuid fbff40e9-4767-4d10-9f02-2777d80dca4b {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:40:41.581689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:41.590642 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5720f147-2c24-49ea-96a2-ff0e1e8de4d1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 200 len: 1327 microversion: 2.1 time: 0.134398 Oct 18 13:40:41.601976 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2518/5263] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:41 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 1327 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:41.974633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-e16f7471-f4a6-4267-8469-385fd0f08faf req-83309a64-d65b-4f77-ac8c-22bcb99240cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbff40e9-4767-4d10-9f02-2777d80dca4b", "name": "network-vif-deleted", "tag": "082a74d7-ce60-45fb-ba35-6337ab258986"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:41.990200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:41.995984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e16f7471-f4a6-4267-8469-385fd0f08faf req-83309a64-d65b-4f77-ac8c-22bcb99240cd service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:41.997649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e16f7471-f4a6-4267-8469-385fd0f08faf req-83309a64-d65b-4f77-ac8c-22bcb99240cd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:41.998384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e16f7471-f4a6-4267-8469-385fd0f08faf req-83309a64-d65b-4f77-ac8c-22bcb99240cd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:42.016929 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-e16f7471-f4a6-4267-8469-385fd0f08faf req-83309a64-d65b-4f77-ac8c-22bcb99240cd service nova] Creating event network-vif-deleted:082a74d7-ce60-45fb-ba35-6337ab258986 for instance fbff40e9-4767-4d10-9f02-2777d80dca4b on n-h1-858384-13 Oct 18 13:40:42.032016 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-e16f7471-f4a6-4267-8469-385fd0f08faf req-83309a64-d65b-4f77-ac8c-22bcb99240cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064696 Oct 18 13:40:42.033819 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2746/5264] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:42.194602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7588b5b-c263-4477-9e84-b47c8f5ea5dc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:42.195663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f7588b5b-c263-4477-9e84-b47c8f5ea5dc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:42.204848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7588b5b-c263-4477-9e84-b47c8f5ea5dc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:42.205948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7588b5b-c263-4477-9e84-b47c8f5ea5dc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:42.206591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7588b5b-c263-4477-9e84-b47c8f5ea5dc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:42.207642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7588b5b-c263-4477-9e84-b47c8f5ea5dc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:42.208494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7588b5b-c263-4477-9e84-b47c8f5ea5dc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:42.209632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7588b5b-c263-4477-9e84-b47c8f5ea5dc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:42.315596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f7588b5b-c263-4477-9e84-b47c8f5ea5dc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:42.328999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f7588b5b-c263-4477-9e84-b47c8f5ea5dc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:42.333052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f7588b5b-c263-4477-9e84-b47c8f5ea5dc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:42.337880 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f7588b5b-c263-4477-9e84-b47c8f5ea5dc tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.148449 Oct 18 13:40:42.339161 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2519/5265] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:42 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:42.616361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6c6495ec-53c7-45d8-abc6-559a1de9e326 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:42.617169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6c6495ec-53c7-45d8-abc6-559a1de9e326 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:42.624641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c6495ec-53c7-45d8-abc6-559a1de9e326 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:42.625290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c6495ec-53c7-45d8-abc6-559a1de9e326 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:42.625975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c6495ec-53c7-45d8-abc6-559a1de9e326 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:42.627579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c6495ec-53c7-45d8-abc6-559a1de9e326 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:42.628671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c6495ec-53c7-45d8-abc6-559a1de9e326 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:42.629607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c6495ec-53c7-45d8-abc6-559a1de9e326 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:42.653510 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-6c6495ec-53c7-45d8-abc6-559a1de9e326 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] HTTP exception thrown: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6c6495ec-53c7-45d8-abc6-559a1de9e326 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Request method failure captured: Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b HTTP/1.1 Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqueWuZxmAzQFdjCybRIxmi55p-XkVuduN-YiHDLoMpYHpTNvOGVVTueKbsLLdar59Kecntc8pWZpOSDVOgKSY_mspF9Kr_p58GNPepdfumkoHWJ0uhxeEhZXSWv8gGSSGBvYfgeOrKfigJRAs5zGZQ5oHeBpwxjr_9qVED6f0NcJJg Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 724386b2d066473fae0dbc9cd16c5802 Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_724386b2d066473fae0dbc9cd16c5802"}]}] Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 724386b2d066473fae0dbc9cd16c5802 Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachVolumeTestJSON-1656930574-project Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3ad869b0447848d7bf332017402442c8 Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachVolumeTestJSON-1656930574-project Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'fbff40e9-4767-4d10-9f02-2777d80dca4b'} Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:42.655943 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:40:42.662605 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:42.662605 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:42.662605 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:42.662605 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:42.662605 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:42.662605 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:40:42.662605 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:40:42.662605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6c6495ec-53c7-45d8-abc6-559a1de9e326 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Returning 404 to user: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:42.662605 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6c6495ec-53c7-45d8-abc6-559a1de9e326 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 404 len: 111 microversion: 2.1 time: 0.045974 Oct 18 13:40:42.662605 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2747/5266] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:42 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:40:42.668182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5cd68efc-0be8-4155-854c-b813522c3634 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '.version_select at 0x7ff60f806160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:42.694409 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5cd68efc-0be8-4155-854c-b813522c3634 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-209150128" status: 202 len: 0 microversion: 2.1 time: 0.030612 Oct 18 13:40:42.695534 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2520/5267] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 18 13:40:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-209150128 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:40:43.368537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6f2291c1-da7c-4a5e-9f45-ab3aa154920f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:43.370252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6f2291c1-da7c-4a5e-9f45-ab3aa154920f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:43.383768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f2291c1-da7c-4a5e-9f45-ab3aa154920f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:43.385794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f2291c1-da7c-4a5e-9f45-ab3aa154920f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:43.387002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f2291c1-da7c-4a5e-9f45-ab3aa154920f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:43.388275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f2291c1-da7c-4a5e-9f45-ab3aa154920f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:43.388752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f2291c1-da7c-4a5e-9f45-ab3aa154920f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:43.390527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f2291c1-da7c-4a5e-9f45-ab3aa154920f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:43.440604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-43dbf531-9496-47e6-b9ec-ec0b1b229a3a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Action: 'create', calling method: .version_select at 0x7ff6148bd4c0>, body: {"keypair": {"name": "tempest-keypair-1545170069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnHJ6kstM875sFY4oj5Iq0+QyunkYJuR0zE+4KRtEBa87EYWkFl5jsHovfQuSa4XgmunH/wccseDXNlUjGQ8iG2upDzHjwQeTiTQHY62dSURDq2OChqU6M3T/SQGGKFvw=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:43.483866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6f2291c1-da7c-4a5e-9f45-ab3aa154920f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:43.488759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-43dbf531-9496-47e6-b9ec-ec0b1b229a3a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Getting quotas for project 724386b2d066473fae0dbc9cd16c5802. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:40:43.488983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6f2291c1-da7c-4a5e-9f45-ab3aa154920f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:43.489525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6f2291c1-da7c-4a5e-9f45-ab3aa154920f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:43.491168 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6f2291c1-da7c-4a5e-9f45-ab3aa154920f tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.126853 Oct 18 13:40:43.492662 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2748/5268] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:43 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:43.498362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-43dbf531-9496-47e6-b9ec-ec0b1b229a3a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Getting quotas for user 3ad869b0447848d7bf332017402442c8 and project 724386b2d066473fae0dbc9cd16c5802. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:40:43.548081 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-43dbf531-9496-47e6-b9ec-ec0b1b229a3a tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112743 Oct 18 13:40:43.549480 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2521/5269] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:40:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:44.526393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fce4a858-c2fd-419d-87df-03792735a92a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:44.527086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fce4a858-c2fd-419d-87df-03792735a92a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:44.540325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce4a858-c2fd-419d-87df-03792735a92a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:44.540848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce4a858-c2fd-419d-87df-03792735a92a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:44.541306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce4a858-c2fd-419d-87df-03792735a92a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:44.542476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce4a858-c2fd-419d-87df-03792735a92a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:44.543262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce4a858-c2fd-419d-87df-03792735a92a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:44.543917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce4a858-c2fd-419d-87df-03792735a92a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:44.682649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fce4a858-c2fd-419d-87df-03792735a92a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:44.697017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fce4a858-c2fd-419d-87df-03792735a92a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:44.698954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fce4a858-c2fd-419d-87df-03792735a92a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:44.700443 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fce4a858-c2fd-419d-87df-03792735a92a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.178787 Oct 18 13:40:44.701286 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2749/5270] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:44 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:45.197517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1340224073", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "edc161cd-a6a2-4332-bb87-a21c809540c9"}], "security_groups": [{"name": "tempest-securitygroup--1287381925"}], "key_name": "tempest-keypair-1545170069", "user_data": "}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:45.309190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] validate_networks() for [('edc161cd-a6a2-4332-bb87-a21c809540c9', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:40:45.725970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:40:45.726950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:40:45.727695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:40:45.728038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0b696831-ae05-4488-926e-cc8ae2339ecb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:45.729151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0b696831-ae05-4488-926e-cc8ae2339ecb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:45.729743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:40:45.730185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:40:45.736334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b696831-ae05-4488-926e-cc8ae2339ecb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:45.737510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b696831-ae05-4488-926e-cc8ae2339ecb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:45.738215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b696831-ae05-4488-926e-cc8ae2339ecb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:45.739198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b696831-ae05-4488-926e-cc8ae2339ecb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:45.739976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b696831-ae05-4488-926e-cc8ae2339ecb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:45.740582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b696831-ae05-4488-926e-cc8ae2339ecb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:45.741959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:45.742617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:45.743230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:45.744238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:45.745033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:45.745637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:45.773754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Getting quotas for project 724386b2d066473fae0dbc9cd16c5802. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:40:45.779949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Getting quotas for user 3ad869b0447848d7bf332017402442c8 and project 724386b2d066473fae0dbc9cd16c5802. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:40:45.794291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:40:45.798013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:40:45.823370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0b696831-ae05-4488-926e-cc8ae2339ecb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:45.837757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0b696831-ae05-4488-926e-cc8ae2339ecb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:45.839591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0b696831-ae05-4488-926e-cc8ae2339ecb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:45.840962 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0b696831-ae05-4488-926e-cc8ae2339ecb tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.117367 Oct 18 13:40:45.868067 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-87307973-b77b-4bcc-90e2-1b59789dd955 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.677582 Oct 18 13:40:45.868733 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2522/5271] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:40:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:40:45.875525 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2750/5272] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:45 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:45.883332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fbffea5a-a976-44ae-a90a-36834d4717b3 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:45.883949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fbffea5a-a976-44ae-a90a-36834d4717b3 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:45.954969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fbffea5a-a976-44ae-a90a-36834d4717b3 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:45.964759 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fbffea5a-a976-44ae-a90a-36834d4717b3 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 200 len: 1238 microversion: 2.1 time: 0.085229 Oct 18 13:40:45.965591 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2523/5273] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:45 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:46.869325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a88d9720-27b4-4727-ac7b-5436c4d9d47e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:46.870986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a88d9720-27b4-4727-ac7b-5436c4d9d47e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:46.881803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a88d9720-27b4-4727-ac7b-5436c4d9d47e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:46.882640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a88d9720-27b4-4727-ac7b-5436c4d9d47e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:46.883545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a88d9720-27b4-4727-ac7b-5436c4d9d47e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:46.884265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a88d9720-27b4-4727-ac7b-5436c4d9d47e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:46.885337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a88d9720-27b4-4727-ac7b-5436c4d9d47e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:46.885995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a88d9720-27b4-4727-ac7b-5436c4d9d47e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:46.976540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a88d9720-27b4-4727-ac7b-5436c4d9d47e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:46.988006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a88d9720-27b4-4727-ac7b-5436c4d9d47e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:46.990092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a88d9720-27b4-4727-ac7b-5436c4d9d47e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:46.991360 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a88d9720-27b4-4727-ac7b-5436c4d9d47e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.127750 Oct 18 13:40:47.002654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-70d27fae-02bc-4758-9d67-3e2dfcf37735 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:47.002654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-70d27fae-02bc-4758-9d67-3e2dfcf37735 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:47.012242 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2751/5274] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:46 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:47.016183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70d27fae-02bc-4758-9d67-3e2dfcf37735 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:47.018375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70d27fae-02bc-4758-9d67-3e2dfcf37735 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:47.018979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70d27fae-02bc-4758-9d67-3e2dfcf37735 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:47.019835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70d27fae-02bc-4758-9d67-3e2dfcf37735 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:47.020860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70d27fae-02bc-4758-9d67-3e2dfcf37735 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:47.021433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70d27fae-02bc-4758-9d67-3e2dfcf37735 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:47.116928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-70d27fae-02bc-4758-9d67-3e2dfcf37735 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:47.126920 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-70d27fae-02bc-4758-9d67-3e2dfcf37735 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 200 len: 1290 microversion: 2.1 time: 0.141371 Oct 18 13:40:47.127836 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2524/5275] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:46 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 1290 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:48.019711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6ba1deec-0cde-4607-998a-1be3420891b1 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:48.021435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6ba1deec-0cde-4607-998a-1be3420891b1 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:48.031825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ba1deec-0cde-4607-998a-1be3420891b1 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:48.033491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ba1deec-0cde-4607-998a-1be3420891b1 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:48.034208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ba1deec-0cde-4607-998a-1be3420891b1 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:48.035133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ba1deec-0cde-4607-998a-1be3420891b1 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:48.035706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ba1deec-0cde-4607-998a-1be3420891b1 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:48.036385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ba1deec-0cde-4607-998a-1be3420891b1 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:48.135283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ba1deec-0cde-4607-998a-1be3420891b1 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:48.151315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d058ecae-3c94-416d-9de4-2de341fb2087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:48.152608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d058ecae-3c94-416d-9de4-2de341fb2087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:48.153558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ba1deec-0cde-4607-998a-1be3420891b1 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:48.155254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ba1deec-0cde-4607-998a-1be3420891b1 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:48.156578 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6ba1deec-0cde-4607-998a-1be3420891b1 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.141080 Oct 18 13:40:48.157146 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2752/5276] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:48 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:48.166822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d058ecae-3c94-416d-9de4-2de341fb2087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:48.167412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d058ecae-3c94-416d-9de4-2de341fb2087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:48.167886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d058ecae-3c94-416d-9de4-2de341fb2087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:48.170505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d058ecae-3c94-416d-9de4-2de341fb2087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:48.170997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d058ecae-3c94-416d-9de4-2de341fb2087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:48.172185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d058ecae-3c94-416d-9de4-2de341fb2087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:48.528218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d058ecae-3c94-416d-9de4-2de341fb2087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:48.540532 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d058ecae-3c94-416d-9de4-2de341fb2087 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 200 len: 1364 microversion: 2.1 time: 0.393524 Oct 18 13:40:48.541820 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2525/5277] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:48 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 1364 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:49.189605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0ca0e044-ec86-48aa-be52-d9e37d4dce78 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:49.192120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0ca0e044-ec86-48aa-be52-d9e37d4dce78 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:49.218913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca0e044-ec86-48aa-be52-d9e37d4dce78 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:49.222338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca0e044-ec86-48aa-be52-d9e37d4dce78 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:49.223082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca0e044-ec86-48aa-be52-d9e37d4dce78 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:49.226587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca0e044-ec86-48aa-be52-d9e37d4dce78 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:49.227354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca0e044-ec86-48aa-be52-d9e37d4dce78 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:49.228503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ca0e044-ec86-48aa-be52-d9e37d4dce78 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:49.306014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a2db1f67-160a-4db9-a7d2-0ffff37d6474 req-40004123-9420-46e9-8373-077e4fdb1f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d012ca89-c83f-482f-9747-a63468ecdca4", "tag": "9317fed9-1961-4956-ad6d-9135f8e8b1d1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:49.339586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a2db1f67-160a-4db9-a7d2-0ffff37d6474 req-40004123-9420-46e9-8373-077e4fdb1f10 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:49.340492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a2db1f67-160a-4db9-a7d2-0ffff37d6474 req-40004123-9420-46e9-8373-077e4fdb1f10 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:49.341102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a2db1f67-160a-4db9-a7d2-0ffff37d6474 req-40004123-9420-46e9-8373-077e4fdb1f10 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:49.412567 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a2db1f67-160a-4db9-a7d2-0ffff37d6474 req-40004123-9420-46e9-8373-077e4fdb1f10 service nova] Creating event network-changed:9317fed9-1961-4956-ad6d-9135f8e8b1d1 for instance d012ca89-c83f-482f-9747-a63468ecdca4 on n-h2-858384-13 Oct 18 13:40:49.424422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0ca0e044-ec86-48aa-be52-d9e37d4dce78 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:49.428032 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a2db1f67-160a-4db9-a7d2-0ffff37d6474 req-40004123-9420-46e9-8373-077e4fdb1f10 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124826 Oct 18 13:40:49.431125 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2526/5278] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:49.435916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0ca0e044-ec86-48aa-be52-d9e37d4dce78 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:49.443393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0ca0e044-ec86-48aa-be52-d9e37d4dce78 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:49.446520 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0ca0e044-ec86-48aa-be52-d9e37d4dce78 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.266155 Oct 18 13:40:49.468698 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2753/5279] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:49 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:49.571081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2617848a-c160-4c4b-99cd-9414368f6478 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:49.572237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2617848a-c160-4c4b-99cd-9414368f6478 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:49.584258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2617848a-c160-4c4b-99cd-9414368f6478 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:49.590393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2617848a-c160-4c4b-99cd-9414368f6478 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:49.591697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2617848a-c160-4c4b-99cd-9414368f6478 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:49.594419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2617848a-c160-4c4b-99cd-9414368f6478 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:49.595653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2617848a-c160-4c4b-99cd-9414368f6478 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:49.597699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2617848a-c160-4c4b-99cd-9414368f6478 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:49.871114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2617848a-c160-4c4b-99cd-9414368f6478 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:49.887762 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2617848a-c160-4c4b-99cd-9414368f6478 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 200 len: 1364 microversion: 2.1 time: 0.320572 Oct 18 13:40:49.901815 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2527/5280] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:49 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 1364 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:50.482084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9878748c-1aa2-42ab-9f98-bc3c7cedc4f7 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:50.482845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9878748c-1aa2-42ab-9f98-bc3c7cedc4f7 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:50.492336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9878748c-1aa2-42ab-9f98-bc3c7cedc4f7 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:50.492837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9878748c-1aa2-42ab-9f98-bc3c7cedc4f7 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:50.493414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9878748c-1aa2-42ab-9f98-bc3c7cedc4f7 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:50.494288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9878748c-1aa2-42ab-9f98-bc3c7cedc4f7 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:50.494788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9878748c-1aa2-42ab-9f98-bc3c7cedc4f7 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:50.495223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9878748c-1aa2-42ab-9f98-bc3c7cedc4f7 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:50.586196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9878748c-1aa2-42ab-9f98-bc3c7cedc4f7 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:50.598215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9878748c-1aa2-42ab-9f98-bc3c7cedc4f7 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:50.598215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9878748c-1aa2-42ab-9f98-bc3c7cedc4f7 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:50.598728 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9878748c-1aa2-42ab-9f98-bc3c7cedc4f7 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.121352 Oct 18 13:40:50.599441 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2754/5281] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:50 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:50.916314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-75455427-6066-46e0-86d0-8c3efb9e088f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:50.917246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-75455427-6066-46e0-86d0-8c3efb9e088f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:50.924462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75455427-6066-46e0-86d0-8c3efb9e088f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:50.925099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75455427-6066-46e0-86d0-8c3efb9e088f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:50.925651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75455427-6066-46e0-86d0-8c3efb9e088f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:50.926582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75455427-6066-46e0-86d0-8c3efb9e088f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:50.927101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75455427-6066-46e0-86d0-8c3efb9e088f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:50.927593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75455427-6066-46e0-86d0-8c3efb9e088f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:51.088087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-75455427-6066-46e0-86d0-8c3efb9e088f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:51.098641 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-75455427-6066-46e0-86d0-8c3efb9e088f tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 200 len: 1364 microversion: 2.1 time: 0.186821 Oct 18 13:40:51.099615 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2528/5282] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:50 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:51.625549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-682b4395-5c14-4583-84ba-11b7dfc9fd4d tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:51.626195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-682b4395-5c14-4583-84ba-11b7dfc9fd4d tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:51.634463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-682b4395-5c14-4583-84ba-11b7dfc9fd4d tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:51.635076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-682b4395-5c14-4583-84ba-11b7dfc9fd4d tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:51.635824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-682b4395-5c14-4583-84ba-11b7dfc9fd4d tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:51.637152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-682b4395-5c14-4583-84ba-11b7dfc9fd4d tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:51.637702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-682b4395-5c14-4583-84ba-11b7dfc9fd4d tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:51.638188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-682b4395-5c14-4583-84ba-11b7dfc9fd4d tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:51.717207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-682b4395-5c14-4583-84ba-11b7dfc9fd4d tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:51.727085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-682b4395-5c14-4583-84ba-11b7dfc9fd4d tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:51.728709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-682b4395-5c14-4583-84ba-11b7dfc9fd4d tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:51.729959 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-682b4395-5c14-4583-84ba-11b7dfc9fd4d tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1408 microversion: 2.54 time: 0.109798 Oct 18 13:40:51.730952 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2755/5283] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:51 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1408 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:52.131496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1ac65888-6090-488f-89e7-86458b609654 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:52.133536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1ac65888-6090-488f-89e7-86458b609654 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:52.152376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ac65888-6090-488f-89e7-86458b609654 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:52.165909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ac65888-6090-488f-89e7-86458b609654 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:52.166367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ac65888-6090-488f-89e7-86458b609654 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:52.167108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ac65888-6090-488f-89e7-86458b609654 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:52.167565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ac65888-6090-488f-89e7-86458b609654 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:52.167992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ac65888-6090-488f-89e7-86458b609654 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:52.471191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1ac65888-6090-488f-89e7-86458b609654 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:52.482959 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1ac65888-6090-488f-89e7-86458b609654 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 200 len: 1364 microversion: 2.1 time: 0.359584 Oct 18 13:40:52.483592 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2529/5284] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:52 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 1364 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:52.758071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3aef2ee2-ca7b-4171-be50-9d83576f57a8 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:52.759263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3aef2ee2-ca7b-4171-be50-9d83576f57a8 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:52.771409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3aef2ee2-ca7b-4171-be50-9d83576f57a8 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:52.772147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3aef2ee2-ca7b-4171-be50-9d83576f57a8 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:52.772804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3aef2ee2-ca7b-4171-be50-9d83576f57a8 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:52.773906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3aef2ee2-ca7b-4171-be50-9d83576f57a8 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:52.774582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3aef2ee2-ca7b-4171-be50-9d83576f57a8 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:52.775518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3aef2ee2-ca7b-4171-be50-9d83576f57a8 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:52.806868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:52.874060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3aef2ee2-ca7b-4171-be50-9d83576f57a8 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:52.885215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3aef2ee2-ca7b-4171-be50-9d83576f57a8 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:52.887419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3aef2ee2-ca7b-4171-be50-9d83576f57a8 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:52.888718 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3aef2ee2-ca7b-4171-be50-9d83576f57a8 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1414 microversion: 2.54 time: 0.137599 Oct 18 13:40:52.893425 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2756/5285] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:52 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:53.508429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-65a06b0e-7619-40d0-9900-222114e3efb7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:53.509050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-65a06b0e-7619-40d0-9900-222114e3efb7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:53.521611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65a06b0e-7619-40d0-9900-222114e3efb7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:53.522445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65a06b0e-7619-40d0-9900-222114e3efb7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:53.523317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65a06b0e-7619-40d0-9900-222114e3efb7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:53.524566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65a06b0e-7619-40d0-9900-222114e3efb7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:53.525482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65a06b0e-7619-40d0-9900-222114e3efb7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:53.526202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65a06b0e-7619-40d0-9900-222114e3efb7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:53.745211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-65a06b0e-7619-40d0-9900-222114e3efb7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:53.754373 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-65a06b0e-7619-40d0-9900-222114e3efb7 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 200 len: 1364 microversion: 2.1 time: 0.250537 Oct 18 13:40:53.754951 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2530/5286] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:53 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:53.921561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-50419641-ca3b-4ad4-919c-e41ad243013b tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:53.922356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-50419641-ca3b-4ad4-919c-e41ad243013b tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:53.931915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50419641-ca3b-4ad4-919c-e41ad243013b tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:53.932516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50419641-ca3b-4ad4-919c-e41ad243013b tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:53.933023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50419641-ca3b-4ad4-919c-e41ad243013b tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:53.933858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50419641-ca3b-4ad4-919c-e41ad243013b tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:53.934532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50419641-ca3b-4ad4-919c-e41ad243013b tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:53.935162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50419641-ca3b-4ad4-919c-e41ad243013b tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:54.024046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-50419641-ca3b-4ad4-919c-e41ad243013b tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:54.034112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-50419641-ca3b-4ad4-919c-e41ad243013b tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:54.035814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-50419641-ca3b-4ad4-919c-e41ad243013b tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:54.037150 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-50419641-ca3b-4ad4-919c-e41ad243013b tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1414 microversion: 2.54 time: 0.120730 Oct 18 13:40:54.046688 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2757/5287] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:53 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:54.694875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-72aa2119-f4d0-4b4a-995f-31114338332d req-f9432220-7f02-4ccf-96ed-b5f8a6e76eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d012ca89-c83f-482f-9747-a63468ecdca4", "name": "network-vif-plugged", "status": "completed", "tag": "9317fed9-1961-4956-ad6d-9135f8e8b1d1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:54.715916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-72aa2119-f4d0-4b4a-995f-31114338332d req-f9432220-7f02-4ccf-96ed-b5f8a6e76eae service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:54.716569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-72aa2119-f4d0-4b4a-995f-31114338332d req-f9432220-7f02-4ccf-96ed-b5f8a6e76eae service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:54.718031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-72aa2119-f4d0-4b4a-995f-31114338332d req-f9432220-7f02-4ccf-96ed-b5f8a6e76eae service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:54.760750 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-72aa2119-f4d0-4b4a-995f-31114338332d req-f9432220-7f02-4ccf-96ed-b5f8a6e76eae service nova] Creating event network-vif-plugged:9317fed9-1961-4956-ad6d-9135f8e8b1d1 for instance d012ca89-c83f-482f-9747-a63468ecdca4 on n-h2-858384-13 Oct 18 13:40:54.779126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-97631c98-4bc3-4a7e-bec4-c2d77d3a3656 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:54.780401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-97631c98-4bc3-4a7e-bec4-c2d77d3a3656 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:54.792804 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-72aa2119-f4d0-4b4a-995f-31114338332d req-f9432220-7f02-4ccf-96ed-b5f8a6e76eae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097156 Oct 18 13:40:54.795849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97631c98-4bc3-4a7e-bec4-c2d77d3a3656 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:54.797289 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2531/5288] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:40:54.799493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97631c98-4bc3-4a7e-bec4-c2d77d3a3656 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:54.802345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97631c98-4bc3-4a7e-bec4-c2d77d3a3656 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:54.804349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97631c98-4bc3-4a7e-bec4-c2d77d3a3656 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:54.806444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97631c98-4bc3-4a7e-bec4-c2d77d3a3656 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:54.807236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97631c98-4bc3-4a7e-bec4-c2d77d3a3656 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:55.009227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-97631c98-4bc3-4a7e-bec4-c2d77d3a3656 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:55.021930 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-97631c98-4bc3-4a7e-bec4-c2d77d3a3656 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 200 len: 1364 microversion: 2.1 time: 0.247778 Oct 18 13:40:55.023061 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2758/5289] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:54 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:40:55.066752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bd187dab-523f-428f-a9c1-e2971d9fa544 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:55.067643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bd187dab-523f-428f-a9c1-e2971d9fa544 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:55.076029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd187dab-523f-428f-a9c1-e2971d9fa544 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:55.076496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd187dab-523f-428f-a9c1-e2971d9fa544 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:55.077100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd187dab-523f-428f-a9c1-e2971d9fa544 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:55.078014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd187dab-523f-428f-a9c1-e2971d9fa544 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:55.078932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd187dab-523f-428f-a9c1-e2971d9fa544 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:55.080367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd187dab-523f-428f-a9c1-e2971d9fa544 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:55.164803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bd187dab-523f-428f-a9c1-e2971d9fa544 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:55.175450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bd187dab-523f-428f-a9c1-e2971d9fa544 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:55.176897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bd187dab-523f-428f-a9c1-e2971d9fa544 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:55.178125 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bd187dab-523f-428f-a9c1-e2971d9fa544 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1399 microversion: 2.54 time: 0.117664 Oct 18 13:40:55.180583 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2532/5290] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:55 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1399 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:40:55.205034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8cf0d354-65cb-4163-bba0-9f57aedf560a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '.version_select at 0x7ff60ef58790>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:55.233537 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8cf0d354-65cb-4163-bba0-9f57aedf560a tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-111258775" status: 204 len: 0 microversion: 2.54 time: 0.033226 Oct 18 13:40:55.234458 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2759/5291] 10.222.0.40 () {60 vars in 1316 bytes} [Tue Oct 18 13:40:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-111258775 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:40:55.249169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22a0ec23-5bb2-44e6-88f9-bd644f9ae060 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:55.249686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-22a0ec23-5bb2-44e6-88f9-bd644f9ae060 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:55.257710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22a0ec23-5bb2-44e6-88f9-bd644f9ae060 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:55.258199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22a0ec23-5bb2-44e6-88f9-bd644f9ae060 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:55.258795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22a0ec23-5bb2-44e6-88f9-bd644f9ae060 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:55.259775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22a0ec23-5bb2-44e6-88f9-bd644f9ae060 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:55.260381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22a0ec23-5bb2-44e6-88f9-bd644f9ae060 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:55.261009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22a0ec23-5bb2-44e6-88f9-bd644f9ae060 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:55.290889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-22a0ec23-5bb2-44e6-88f9-bd644f9ae060 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:40:55.374515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:55.381759 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-22a0ec23-5bb2-44e6-88f9-bd644f9ae060 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "DELETE /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 204 len: 0 microversion: 2.54 time: 0.136452 Oct 18 13:40:55.383106 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2533/5292] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:40:55 2022] DELETE /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:40:55.392788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-79927f07-ba0f-4cb0-b8bc-590b6be1e301 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:55.393828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-79927f07-ba0f-4cb0-b8bc-590b6be1e301 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:55.402532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79927f07-ba0f-4cb0-b8bc-590b6be1e301 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:55.403298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79927f07-ba0f-4cb0-b8bc-590b6be1e301 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:55.403954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79927f07-ba0f-4cb0-b8bc-590b6be1e301 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:55.405018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79927f07-ba0f-4cb0-b8bc-590b6be1e301 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:55.405725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79927f07-ba0f-4cb0-b8bc-590b6be1e301 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:55.406667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79927f07-ba0f-4cb0-b8bc-590b6be1e301 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:55.489739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79927f07-ba0f-4cb0-b8bc-590b6be1e301 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:55.506022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79927f07-ba0f-4cb0-b8bc-590b6be1e301 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:55.509876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79927f07-ba0f-4cb0-b8bc-590b6be1e301 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:55.511708 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-79927f07-ba0f-4cb0-b8bc-590b6be1e301 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1405 microversion: 2.54 time: 0.124176 Oct 18 13:40:55.523138 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2760/5293] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:55 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:56.048280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c8e2c33f-af4d-4696-af3b-94c2836d7d85 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:56.050047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c8e2c33f-af4d-4696-af3b-94c2836d7d85 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:56.054161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:56.055084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=12 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:40:56.060545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8e2c33f-af4d-4696-af3b-94c2836d7d85 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:56.061701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8e2c33f-af4d-4696-af3b-94c2836d7d85 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:56.062560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8e2c33f-af4d-4696-af3b-94c2836d7d85 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:56.063695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8e2c33f-af4d-4696-af3b-94c2836d7d85 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:56.064315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8e2c33f-af4d-4696-af3b-94c2836d7d85 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:56.066062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8e2c33f-af4d-4696-af3b-94c2836d7d85 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:56.314728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c8e2c33f-af4d-4696-af3b-94c2836d7d85 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:56.326079 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c8e2c33f-af4d-4696-af3b-94c2836d7d85 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 200 len: 1364 microversion: 2.1 time: 0.282284 Oct 18 13:40:56.327005 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2534/5294] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:56 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:56.539925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d64e35a4-b7bf-4599-9487-b69e15af0813 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:56.540518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d64e35a4-b7bf-4599-9487-b69e15af0813 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:56.551139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d64e35a4-b7bf-4599-9487-b69e15af0813 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:56.551658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d64e35a4-b7bf-4599-9487-b69e15af0813 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:56.552120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d64e35a4-b7bf-4599-9487-b69e15af0813 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:56.553051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d64e35a4-b7bf-4599-9487-b69e15af0813 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:56.553530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d64e35a4-b7bf-4599-9487-b69e15af0813 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:56.554039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d64e35a4-b7bf-4599-9487-b69e15af0813 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:56.632196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d64e35a4-b7bf-4599-9487-b69e15af0813 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:56.641277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d64e35a4-b7bf-4599-9487-b69e15af0813 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:56.643399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d64e35a4-b7bf-4599-9487-b69e15af0813 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:56.644612 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d64e35a4-b7bf-4599-9487-b69e15af0813 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1405 microversion: 2.54 time: 0.108836 Oct 18 13:40:56.645217 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2761/5295] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:56 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1405 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:57.354933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a11b3233-5ed5-4c96-b4d2-c19df43a0d87 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:57.355734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a11b3233-5ed5-4c96-b4d2-c19df43a0d87 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:57.364420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a11b3233-5ed5-4c96-b4d2-c19df43a0d87 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:57.365700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a11b3233-5ed5-4c96-b4d2-c19df43a0d87 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:57.366766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a11b3233-5ed5-4c96-b4d2-c19df43a0d87 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:57.367687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a11b3233-5ed5-4c96-b4d2-c19df43a0d87 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:57.368339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a11b3233-5ed5-4c96-b4d2-c19df43a0d87 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:57.368761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a11b3233-5ed5-4c96-b4d2-c19df43a0d87 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:57.603670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a11b3233-5ed5-4c96-b4d2-c19df43a0d87 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:57.614330 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a11b3233-5ed5-4c96-b4d2-c19df43a0d87 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 200 len: 1549 microversion: 2.1 time: 0.265608 Oct 18 13:40:57.615191 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2535/5296] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:40:57 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 1549 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:40:57.637766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53ad39d0-0b81-423c-8ee0-0eca0f426ac0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:57.638388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53ad39d0-0b81-423c-8ee0-0eca0f426ac0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:57.647084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53ad39d0-0b81-423c-8ee0-0eca0f426ac0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:57.647584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53ad39d0-0b81-423c-8ee0-0eca0f426ac0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:57.648028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53ad39d0-0b81-423c-8ee0-0eca0f426ac0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:57.648989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53ad39d0-0b81-423c-8ee0-0eca0f426ac0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:57.649662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53ad39d0-0b81-423c-8ee0-0eca0f426ac0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:57.650298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53ad39d0-0b81-423c-8ee0-0eca0f426ac0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:57.677200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-43e212ab-6019-4872-a017-ddb6b6a8c8c2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:57.677829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-43e212ab-6019-4872-a017-ddb6b6a8c8c2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:57.689844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43e212ab-6019-4872-a017-ddb6b6a8c8c2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:57.691186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43e212ab-6019-4872-a017-ddb6b6a8c8c2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:57.692094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43e212ab-6019-4872-a017-ddb6b6a8c8c2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:57.693007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43e212ab-6019-4872-a017-ddb6b6a8c8c2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:57.693676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43e212ab-6019-4872-a017-ddb6b6a8c8c2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:57.694301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43e212ab-6019-4872-a017-ddb6b6a8c8c2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:57.797722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-43e212ab-6019-4872-a017-ddb6b6a8c8c2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:57.809059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-43e212ab-6019-4872-a017-ddb6b6a8c8c2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:57.814466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-43e212ab-6019-4872-a017-ddb6b6a8c8c2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e9326462c824768b94607692baee58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61422a6c4c2b497ca4d3d1eb17fc9a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:40:57.817867 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-43e212ab-6019-4872-a017-ddb6b6a8c8c2 tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 200 len: 1405 microversion: 2.54 time: 0.144488 Oct 18 13:40:57.819159 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2536/5297] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:57 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 18 13:40:57.869641 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53ad39d0-0b81-423c-8ee0-0eca0f426ac0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.235599 Oct 18 13:40:57.879461 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2762/5298] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:40:57 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:40:58.852426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af2eff58-663b-4d1c-92dd-bb839f37fa8e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:40:58.853918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-af2eff58-663b-4d1c-92dd-bb839f37fa8e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] [instance: 217f68fe-fe0a-4a82-963b-f4f0b48d106b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:40:58.866999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af2eff58-663b-4d1c-92dd-bb839f37fa8e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:58.867961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af2eff58-663b-4d1c-92dd-bb839f37fa8e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:58.868946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af2eff58-663b-4d1c-92dd-bb839f37fa8e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:58.870347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af2eff58-663b-4d1c-92dd-bb839f37fa8e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:58.871049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af2eff58-663b-4d1c-92dd-bb839f37fa8e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:58.871925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af2eff58-663b-4d1c-92dd-bb839f37fa8e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:58.939543 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-af2eff58-663b-4d1c-92dd-bb839f37fa8e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] HTTP exception thrown: Instance 217f68fe-fe0a-4a82-963b-f4f0b48d106b could not be found. Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af2eff58-663b-4d1c-92dd-bb839f37fa8e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Request method failure captured: Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b HTTP/1.1 Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqzAvbWZUOgckMNGwDQ8-B8lBeLcj96XDD5Z7Wquypr_E854UGk6s5tX3ovZ8mnJuGRuHIv5T9jl-fSvMt0hT6SAlmFNIS3TPEhrCTIZVvrxekU4gaDQleo4kw2kdZh5vj4GA3X4LQ-8Y0DzqgHFV20S_tbK3MMFyLuqJN-P6Y0SLOg Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.54 Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 61422a6c4c2b497ca4d3d1eb17fc9a04 Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerShowV254Test-996830003 Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/61422a6c4c2b497ca4d3d1eb17fc9a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/61422a6c4c2b497ca4d3d1eb17fc9a04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/61422a6c4c2b497ca4d3d1eb17fc9a04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_61422a6c4c2b497ca4d3d1eb17fc9a04"}]}] Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerShowV254Test-996830003 Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 61422a6c4c2b497ca4d3d1eb17fc9a04 Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerShowV254Test-996830003 Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerShowV254Test-996830003-project Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 3e9326462c824768b94607692baee58d Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerShowV254Test-996830003-project Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 217f68fe-fe0a-4a82-963b-f4f0b48d106b could not be found. Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '217f68fe-fe0a-4a82-963b-f4f0b48d106b'} Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 217f68fe-fe0a-4a82-963b-f4f0b48d106b could not be found. Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 217f68fe-fe0a-4a82-963b-f4f0b48d106b could not be found. Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:40:58.941517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:58.949727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:40:58.949727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:40:58.949727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:40:58.949727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:40:58.949727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:40:58.949727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 217f68fe-fe0a-4a82-963b-f4f0b48d106b could not be found. Oct 18 13:40:58.949727 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:40:58.949727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af2eff58-663b-4d1c-92dd-bb839f37fa8e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] Returning 404 to user: Instance 217f68fe-fe0a-4a82-963b-f4f0b48d106b could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:40:58.949727 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-af2eff58-663b-4d1c-92dd-bb839f37fa8e tempest-ServerShowV254Test-996830003 tempest-ServerShowV254Test-996830003-project] 10.222.0.40 "GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b" status: 404 len: 111 microversion: 2.54 time: 0.096497 Oct 18 13:40:58.949727 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2537/5299] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:40:58 2022] GET /compute/v2.1/servers/217f68fe-fe0a-4a82-963b-f4f0b48d106b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 18 13:40:59.241471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3d4c5ca6-d0f8-4a29-853b-436297271ed2 req-bdc2e760-7c2c-4a33-b293-ec0d893d98bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d012ca89-c83f-482f-9747-a63468ecdca4", "tag": "9317fed9-1961-4956-ad6d-9135f8e8b1d1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:40:59.261031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3d4c5ca6-d0f8-4a29-853b-436297271ed2 req-bdc2e760-7c2c-4a33-b293-ec0d893d98bd service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:40:59.261537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3d4c5ca6-d0f8-4a29-853b-436297271ed2 req-bdc2e760-7c2c-4a33-b293-ec0d893d98bd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:40:59.261970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3d4c5ca6-d0f8-4a29-853b-436297271ed2 req-bdc2e760-7c2c-4a33-b293-ec0d893d98bd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:40:59.283172 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3d4c5ca6-d0f8-4a29-853b-436297271ed2 req-bdc2e760-7c2c-4a33-b293-ec0d893d98bd service nova] Creating event network-changed:9317fed9-1961-4956-ad6d-9135f8e8b1d1 for instance d012ca89-c83f-482f-9747-a63468ecdca4 on n-h2-858384-13 Oct 18 13:40:59.294349 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3d4c5ca6-d0f8-4a29-853b-436297271ed2 req-bdc2e760-7c2c-4a33-b293-ec0d893d98bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056984 Oct 18 13:40:59.300725 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2763/5300] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:01.210130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c8eb001c-f39e-4efe-b50a-7095b78d3738 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:01.228803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c8eb001c-f39e-4efe-b50a-7095b78d3738 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:01.232748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c8eb001c-f39e-4efe-b50a-7095b78d3738 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Searching by: {'deleted': False, 'project_id': 'f983dc605d28409f93a8f4234519773c'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:41:01.244349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8eb001c-f39e-4efe-b50a-7095b78d3738 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:01.244849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8eb001c-f39e-4efe-b50a-7095b78d3738 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:01.250266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8eb001c-f39e-4efe-b50a-7095b78d3738 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:01.251144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8eb001c-f39e-4efe-b50a-7095b78d3738 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:01.251620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8eb001c-f39e-4efe-b50a-7095b78d3738 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:01.252054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8eb001c-f39e-4efe-b50a-7095b78d3738 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:01.307572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-c8eb001c-f39e-4efe-b50a-7095b78d3738 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:41:01.312749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:01.349851 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c8eb001c-f39e-4efe-b50a-7095b78d3738 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.150492 Oct 18 13:41:01.351054 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2538/5301] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 13:41:01 2022] GET /compute/v2.1/servers => generated 344 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:01.369472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:01.377486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:01.379184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Searching by: {'deleted': False, 'project_id': 'f983dc605d28409f93a8f4234519773c'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:41:01.386622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:01.387689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:01.388280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:01.389208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:01.389720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:01.390201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:01.424928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:41:01.474645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:01.482701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:01.483414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:01.484558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:01.667998 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-398cf3c6-1638-4e79-9ec7-137f09240820 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.306603 Oct 18 13:41:01.685496 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2764/5302] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:41:01 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:01.703231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ab04c337-c3ba-43e7-aa0f-1d936021623e tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:01.715909 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ab04c337-c3ba-43e7-aa0f-1d936021623e tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019083 Oct 18 13:41:01.717110 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2539/5303] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:41:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:41:01.880224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a9f9f1b7-56da-4e52-b262-99678b486a40 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:01.882681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a9f9f1b7-56da-4e52-b262-99678b486a40 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:01.890802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9f9f1b7-56da-4e52-b262-99678b486a40 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:01.891697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9f9f1b7-56da-4e52-b262-99678b486a40 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:01.892315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9f9f1b7-56da-4e52-b262-99678b486a40 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:01.893704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9f9f1b7-56da-4e52-b262-99678b486a40 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:01.894520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9f9f1b7-56da-4e52-b262-99678b486a40 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:01.895168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9f9f1b7-56da-4e52-b262-99678b486a40 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:01.954555 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a9f9f1b7-56da-4e52-b262-99678b486a40 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079196 Oct 18 13:41:01.955744 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2765/5304] 10.222.0.40 () {60 vars in 1343 bytes} [Tue Oct 18 13:41:01 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:02.047665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-131a6504-4005-4eae-9f28-90861f0024cb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:02.048954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-131a6504-4005-4eae-9f28-90861f0024cb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:02.057753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-131a6504-4005-4eae-9f28-90861f0024cb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.058532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-131a6504-4005-4eae-9f28-90861f0024cb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.059156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-131a6504-4005-4eae-9f28-90861f0024cb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.059849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-131a6504-4005-4eae-9f28-90861f0024cb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.060296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-131a6504-4005-4eae-9f28-90861f0024cb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.060868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-131a6504-4005-4eae-9f28-90861f0024cb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.092022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-131a6504-4005-4eae-9f28-90861f0024cb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:41:02.193940 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-131a6504-4005-4eae-9f28-90861f0024cb tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "DELETE /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 204 len: 0 microversion: 2.20 time: 0.149970 Oct 18 13:41:02.195141 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2540/5305] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:41:02 2022] DELETE /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:41:02.206105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-12625720-6f32-44c5-96c5-ed237ff87c79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:02.206744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-12625720-6f32-44c5-96c5-ed237ff87c79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:02.213410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12625720-6f32-44c5-96c5-ed237ff87c79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.213898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12625720-6f32-44c5-96c5-ed237ff87c79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.214528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12625720-6f32-44c5-96c5-ed237ff87c79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.215353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12625720-6f32-44c5-96c5-ed237ff87c79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.215944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12625720-6f32-44c5-96c5-ed237ff87c79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.216446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12625720-6f32-44c5-96c5-ed237ff87c79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.299337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-10d5aa38-a889-4d8f-9972-e36d8f0f005f tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:02.299921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-10d5aa38-a889-4d8f-9972-e36d8f0f005f tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:02.311800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10d5aa38-a889-4d8f-9972-e36d8f0f005f tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.312734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10d5aa38-a889-4d8f-9972-e36d8f0f005f tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.314195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10d5aa38-a889-4d8f-9972-e36d8f0f005f tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.315278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10d5aa38-a889-4d8f-9972-e36d8f0f005f tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.315983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10d5aa38-a889-4d8f-9972-e36d8f0f005f tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.316730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10d5aa38-a889-4d8f-9972-e36d8f0f005f tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.350823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-10d5aa38-a889-4d8f-9972-e36d8f0f005f tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:41:02.391277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-12625720-6f32-44c5-96c5-ed237ff87c79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:02.403313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-12625720-6f32-44c5-96c5-ed237ff87c79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:02.405012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-12625720-6f32-44c5-96c5-ed237ff87c79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:02.406269 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-12625720-6f32-44c5-96c5-ed237ff87c79 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1722 microversion: 2.20 time: 0.207263 Oct 18 13:41:02.406889 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2766/5306] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:41:02 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:41:02.475075 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-10d5aa38-a889-4d8f-9972-e36d8f0f005f tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "DELETE /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 204 len: 0 microversion: 2.1 time: 0.180092 Oct 18 13:41:02.475746 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2541/5307] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:41:02 2022] DELETE /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:41:02.484267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-451f1c29-f9f8-4b25-b509-7d4c26dced26 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:02.484903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-451f1c29-f9f8-4b25-b509-7d4c26dced26 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:02.491725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-451f1c29-f9f8-4b25-b509-7d4c26dced26 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.492203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-451f1c29-f9f8-4b25-b509-7d4c26dced26 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.492715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-451f1c29-f9f8-4b25-b509-7d4c26dced26 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.493391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-451f1c29-f9f8-4b25-b509-7d4c26dced26 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:02.493843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-451f1c29-f9f8-4b25-b509-7d4c26dced26 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:02.494306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-451f1c29-f9f8-4b25-b509-7d4c26dced26 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:02.651359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-451f1c29-f9f8-4b25-b509-7d4c26dced26 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:02.660483 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-451f1c29-f9f8-4b25-b509-7d4c26dced26 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1609 microversion: 2.1 time: 0.179893 Oct 18 13:41:02.661081 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2767/5308] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:02 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1609 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:03.434137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5553e650-4bdf-4c73-8be4-92d7492e0fcf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:03.435177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5553e650-4bdf-4c73-8be4-92d7492e0fcf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:03.445220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5553e650-4bdf-4c73-8be4-92d7492e0fcf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:03.445936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5553e650-4bdf-4c73-8be4-92d7492e0fcf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:03.446641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5553e650-4bdf-4c73-8be4-92d7492e0fcf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:03.447283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5553e650-4bdf-4c73-8be4-92d7492e0fcf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:03.447727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5553e650-4bdf-4c73-8be4-92d7492e0fcf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:03.448329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5553e650-4bdf-4c73-8be4-92d7492e0fcf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:03.683781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bab42609-8dc5-4e7c-94e9-4048e30217d2 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:03.685058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bab42609-8dc5-4e7c-94e9-4048e30217d2 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:03.695706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bab42609-8dc5-4e7c-94e9-4048e30217d2 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:03.707690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bab42609-8dc5-4e7c-94e9-4048e30217d2 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:03.708511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bab42609-8dc5-4e7c-94e9-4048e30217d2 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:03.711522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bab42609-8dc5-4e7c-94e9-4048e30217d2 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:03.712269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bab42609-8dc5-4e7c-94e9-4048e30217d2 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:03.723513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bab42609-8dc5-4e7c-94e9-4048e30217d2 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:04.003393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5553e650-4bdf-4c73-8be4-92d7492e0fcf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:04.016243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5553e650-4bdf-4c73-8be4-92d7492e0fcf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:04.020745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5553e650-4bdf-4c73-8be4-92d7492e0fcf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:04.022021 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5553e650-4bdf-4c73-8be4-92d7492e0fcf tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1722 microversion: 2.20 time: 0.592139 Oct 18 13:41:04.023026 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2542/5309] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:41:03 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1722 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:41:04.064506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bab42609-8dc5-4e7c-94e9-4048e30217d2 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:04.074743 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bab42609-8dc5-4e7c-94e9-4048e30217d2 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1609 microversion: 2.1 time: 0.394633 Oct 18 13:41:04.091520 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2768/5310] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:03 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1609 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:05.058780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-765b7739-36f4-4b07-b81d-d2a7a277e742 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:05.059386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-765b7739-36f4-4b07-b81d-d2a7a277e742 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:05.070567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-765b7739-36f4-4b07-b81d-d2a7a277e742 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:05.071063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-765b7739-36f4-4b07-b81d-d2a7a277e742 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:05.077401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-765b7739-36f4-4b07-b81d-d2a7a277e742 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:05.078270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-765b7739-36f4-4b07-b81d-d2a7a277e742 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:05.078817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-765b7739-36f4-4b07-b81d-d2a7a277e742 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:05.080394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-765b7739-36f4-4b07-b81d-d2a7a277e742 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:05.105641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dcf0a562-91c0-4a7e-8f9c-fadc4595ecd9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:05.107011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dcf0a562-91c0-4a7e-8f9c-fadc4595ecd9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:05.124105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcf0a562-91c0-4a7e-8f9c-fadc4595ecd9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:05.125536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcf0a562-91c0-4a7e-8f9c-fadc4595ecd9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:05.128605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcf0a562-91c0-4a7e-8f9c-fadc4595ecd9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:05.134863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcf0a562-91c0-4a7e-8f9c-fadc4595ecd9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:05.138660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcf0a562-91c0-4a7e-8f9c-fadc4595ecd9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:05.140643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcf0a562-91c0-4a7e-8f9c-fadc4595ecd9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:05.281964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-765b7739-36f4-4b07-b81d-d2a7a277e742 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:05.304210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-765b7739-36f4-4b07-b81d-d2a7a277e742 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:05.306812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-765b7739-36f4-4b07-b81d-d2a7a277e742 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ffdf91ab1a4414da1ec7fdcd4965bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2231c4720246789ebb4ae0b1a29128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:05.308244 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-765b7739-36f4-4b07-b81d-d2a7a277e742 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 200 len: 1655 microversion: 2.20 time: 0.256609 Oct 18 13:41:05.311870 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2543/5311] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:41:05 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 1655 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 18 13:41:05.321799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-5da1a792-c1d8-4402-a504-69df0eba16b9 req-eb4a611c-f401-4aa9-8a28-2e9f86d26fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c5c389-b7a1-4170-9b5c-321066d048e1", "name": "network-vif-deleted", "tag": "74f52242-e00e-46f0-a3ba-47fe1d3cac8e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:05.338793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5da1a792-c1d8-4402-a504-69df0eba16b9 req-eb4a611c-f401-4aa9-8a28-2e9f86d26fcd service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:05.340066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5da1a792-c1d8-4402-a504-69df0eba16b9 req-eb4a611c-f401-4aa9-8a28-2e9f86d26fcd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:05.340804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5da1a792-c1d8-4402-a504-69df0eba16b9 req-eb4a611c-f401-4aa9-8a28-2e9f86d26fcd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:05.379214 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-5da1a792-c1d8-4402-a504-69df0eba16b9 req-eb4a611c-f401-4aa9-8a28-2e9f86d26fcd service nova] Creating event network-vif-deleted:74f52242-e00e-46f0-a3ba-47fe1d3cac8e for instance 31c5c389-b7a1-4170-9b5c-321066d048e1 on n-h2-858384-13 Oct 18 13:41:05.387256 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-5da1a792-c1d8-4402-a504-69df0eba16b9 req-eb4a611c-f401-4aa9-8a28-2e9f86d26fcd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073355 Oct 18 13:41:05.393016 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2544/5312] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:05.722781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dcf0a562-91c0-4a7e-8f9c-fadc4595ecd9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:05.731879 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dcf0a562-91c0-4a7e-8f9c-fadc4595ecd9 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1609 microversion: 2.1 time: 0.632934 Oct 18 13:41:05.753276 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2769/5313] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:05 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1609 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:06.343285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d83b84f2-0cab-40a5-9e42-8f71f2e10c89 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:06.344129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d83b84f2-0cab-40a5-9e42-8f71f2e10c89 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:06.361487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d83b84f2-0cab-40a5-9e42-8f71f2e10c89 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:06.363002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d83b84f2-0cab-40a5-9e42-8f71f2e10c89 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:06.365789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d83b84f2-0cab-40a5-9e42-8f71f2e10c89 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:06.367103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d83b84f2-0cab-40a5-9e42-8f71f2e10c89 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:06.367504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d83b84f2-0cab-40a5-9e42-8f71f2e10c89 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:06.367727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d83b84f2-0cab-40a5-9e42-8f71f2e10c89 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:06.421658 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-d83b84f2-0cab-40a5-9e42-8f71f2e10c89 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] HTTP exception thrown: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d83b84f2-0cab-40a5-9e42-8f71f2e10c89 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Request method failure captured: Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 HTTP/1.1 Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqrt0ofdZCo_EHSlhT209ekptBsECwpWXCkSOE-tqw6Tt0My7_z3Pf5GhJvWCzn2DHkFBf8h4tLK9BfcVb4SJr_FyNod0P8YhvrV-ufySDoGvuBFy54GIiLix83Eu2Zxpp9ywQEh265C1yM9HGsAYyaN1h6k5TMKcN2YWF-SAGEgmp0 Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 6e2231c4720246789ebb4ae0b1a29128 Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e2231c4720246789ebb4ae0b1a29128"}]}] Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 6e2231c4720246789ebb4ae0b1a29128 Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeShelveTestJSON-1397393656-project Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 8ffdf91ab1a4414da1ec7fdcd4965bed Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1397393656-project Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '31c5c389-b7a1-4170-9b5c-321066d048e1'} Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:06.436067 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:06.441291 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:06.441291 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:06.441291 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:06.441291 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:06.441291 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:06.441291 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:06.441291 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:06.441291 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:06.441291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d83b84f2-0cab-40a5-9e42-8f71f2e10c89 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Returning 404 to user: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:06.441291 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d83b84f2-0cab-40a5-9e42-8f71f2e10c89 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 404 len: 111 microversion: 2.20 time: 0.098445 Oct 18 13:41:06.441291 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2545/5314] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:41:06 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:41:06.454490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3429e6f2-1a02-4d67-9118-8a35f166da5f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '.version_select at 0x7ff60ec09160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:06.544846 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3429e6f2-1a02-4d67-9118-8a35f166da5f tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418007131" status: 204 len: 0 microversion: 2.20 time: 0.100970 Oct 18 13:41:06.545844 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2770/5315] 10.222.0.40 () {60 vars in 1262 bytes} [Tue Oct 18 13:41:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418007131 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 18 13:41:06.758738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8b4436e5-e06d-40b8-9dad-9898cc0219b4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:06.759380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8b4436e5-e06d-40b8-9dad-9898cc0219b4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:06.769171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b4436e5-e06d-40b8-9dad-9898cc0219b4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:06.769695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b4436e5-e06d-40b8-9dad-9898cc0219b4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:06.770136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b4436e5-e06d-40b8-9dad-9898cc0219b4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:06.777419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b4436e5-e06d-40b8-9dad-9898cc0219b4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:06.782970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b4436e5-e06d-40b8-9dad-9898cc0219b4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:06.783585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8b4436e5-e06d-40b8-9dad-9898cc0219b4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:06.939656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-6d0455ed-a02a-41f1-ad49-e31d07e418c9 req-af7a0187-fbe9-4f4b-b96c-06f1589172b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38401f91-0034-4290-b61d-0a09ae076c2e", "name": "network-vif-deleted", "tag": "1c58069a-78e6-4d67-9725-0f6c1f442cb7"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:06.966752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6d0455ed-a02a-41f1-ad49-e31d07e418c9 req-af7a0187-fbe9-4f4b-b96c-06f1589172b9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:06.967492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6d0455ed-a02a-41f1-ad49-e31d07e418c9 req-af7a0187-fbe9-4f4b-b96c-06f1589172b9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:06.971034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6d0455ed-a02a-41f1-ad49-e31d07e418c9 req-af7a0187-fbe9-4f4b-b96c-06f1589172b9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:06.983571 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-6d0455ed-a02a-41f1-ad49-e31d07e418c9 req-af7a0187-fbe9-4f4b-b96c-06f1589172b9 service nova] Creating event network-vif-deleted:1c58069a-78e6-4d67-9725-0f6c1f442cb7 for instance 38401f91-0034-4290-b61d-0a09ae076c2e on n-h1-858384-13 Oct 18 13:41:06.993600 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-6d0455ed-a02a-41f1-ad49-e31d07e418c9 req-af7a0187-fbe9-4f4b-b96c-06f1589172b9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058866 Oct 18 13:41:06.999612 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2771/5316] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:41:07.114790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8b4436e5-e06d-40b8-9dad-9898cc0219b4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:07.131792 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8b4436e5-e06d-40b8-9dad-9898cc0219b4 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1541 microversion: 2.1 time: 0.376921 Oct 18 13:41:07.135106 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2546/5317] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:06 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1541 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:08.164746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-46a0a7f7-ddfd-420a-9b02-bf0c69585bbb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:08.165626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-46a0a7f7-ddfd-420a-9b02-bf0c69585bbb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:08.182611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46a0a7f7-ddfd-420a-9b02-bf0c69585bbb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:08.183045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46a0a7f7-ddfd-420a-9b02-bf0c69585bbb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:08.183491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46a0a7f7-ddfd-420a-9b02-bf0c69585bbb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:08.184237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46a0a7f7-ddfd-420a-9b02-bf0c69585bbb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:08.184712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46a0a7f7-ddfd-420a-9b02-bf0c69585bbb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:08.193128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46a0a7f7-ddfd-420a-9b02-bf0c69585bbb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:08.429874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-46a0a7f7-ddfd-420a-9b02-bf0c69585bbb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:08.454923 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-46a0a7f7-ddfd-420a-9b02-bf0c69585bbb tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1253 microversion: 2.1 time: 0.294773 Oct 18 13:41:08.479100 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2772/5318] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:08 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1253 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:09.488082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7114527-cbeb-4811-9b14-2993dc6b73e6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:09.488844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f7114527-cbeb-4811-9b14-2993dc6b73e6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:09.503343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7114527-cbeb-4811-9b14-2993dc6b73e6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:09.504807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7114527-cbeb-4811-9b14-2993dc6b73e6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:09.505286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7114527-cbeb-4811-9b14-2993dc6b73e6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:09.508190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7114527-cbeb-4811-9b14-2993dc6b73e6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:09.508672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7114527-cbeb-4811-9b14-2993dc6b73e6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:09.509120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7114527-cbeb-4811-9b14-2993dc6b73e6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:09.674911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f7114527-cbeb-4811-9b14-2993dc6b73e6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:09.684252 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f7114527-cbeb-4811-9b14-2993dc6b73e6 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1253 microversion: 2.1 time: 0.200763 Oct 18 13:41:09.689861 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2547/5319] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:09 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1253 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:10.714521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7958d93b-7323-463d-b7f6-c42048090d69 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:10.715816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7958d93b-7323-463d-b7f6-c42048090d69 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:10.730125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7958d93b-7323-463d-b7f6-c42048090d69 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:10.731522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7958d93b-7323-463d-b7f6-c42048090d69 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:10.732411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7958d93b-7323-463d-b7f6-c42048090d69 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:10.735799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7958d93b-7323-463d-b7f6-c42048090d69 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:10.737697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7958d93b-7323-463d-b7f6-c42048090d69 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:10.738259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7958d93b-7323-463d-b7f6-c42048090d69 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:11.327898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7958d93b-7323-463d-b7f6-c42048090d69 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:11.348113 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7958d93b-7323-463d-b7f6-c42048090d69 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1253 microversion: 2.1 time: 0.638309 Oct 18 13:41:11.350964 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2773/5320] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:10 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1253 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:11.794224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-76c686ab-dfed-4267-b810-89c1d0a59ac8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:11.795468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-76c686ab-dfed-4267-b810-89c1d0a59ac8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:11.809565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:11.818522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76c686ab-dfed-4267-b810-89c1d0a59ac8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:11.819876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76c686ab-dfed-4267-b810-89c1d0a59ac8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:11.822900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76c686ab-dfed-4267-b810-89c1d0a59ac8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:11.824233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76c686ab-dfed-4267-b810-89c1d0a59ac8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:11.828981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76c686ab-dfed-4267-b810-89c1d0a59ac8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:11.830306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76c686ab-dfed-4267-b810-89c1d0a59ac8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:11.854860 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-76c686ab-dfed-4267-b810-89c1d0a59ac8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] HTTP exception thrown: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-76c686ab-dfed-4267-b810-89c1d0a59ac8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Request method failure captured: Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 HTTP/1.1 Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqrt0ofdZCo_EHSlhT209ekptBsECwpWXCkSOE-tqw6Tt0My7_z3Pf5GhJvWCzn2DHkFBf8h4tLK9BfcVb4SJr_FyNod0P8YhvrV-ufySDoGvuBFy54GIiLix83Eu2Zxpp9ywQEh265C1yM9HGsAYyaN1h6k5TMKcN2YWF-SAGEgmp0 Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 6e2231c4720246789ebb4ae0b1a29128 Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e2231c4720246789ebb4ae0b1a29128"}]}] Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 6e2231c4720246789ebb4ae0b1a29128 Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeShelveTestJSON-1397393656-project Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 8ffdf91ab1a4414da1ec7fdcd4965bed Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1397393656-project Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '31c5c389-b7a1-4170-9b5c-321066d048e1'} Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:41:11.857003 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:11.862870 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:11.862870 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:11.862870 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:11.862870 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:11.862870 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:11.862870 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:11.862870 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:11.862870 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:11.862870 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:11.862870 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:11.862870 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:11.865595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-76c686ab-dfed-4267-b810-89c1d0a59ac8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Returning 404 to user: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:11.866877 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-76c686ab-dfed-4267-b810-89c1d0a59ac8 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "DELETE /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 404 len: 111 microversion: 2.20 time: 0.082195 Oct 18 13:41:11.868215 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2548/5321] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:41:11 2022] DELETE /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:41:11.876948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8b1879a2-5d6c-4688-99f1-0ef824632c0a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:11.878912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8b1879a2-5d6c-4688-99f1-0ef824632c0a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 31c5c389-b7a1-4170-9b5c-321066d048e1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:11.887475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:11.890731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:11.896119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b1879a2-5d6c-4688-99f1-0ef824632c0a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:11.896575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b1879a2-5d6c-4688-99f1-0ef824632c0a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:11.897016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b1879a2-5d6c-4688-99f1-0ef824632c0a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:11.897765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b1879a2-5d6c-4688-99f1-0ef824632c0a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:11.898222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b1879a2-5d6c-4688-99f1-0ef824632c0a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:11.898658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b1879a2-5d6c-4688-99f1-0ef824632c0a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:11.945339 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-8b1879a2-5d6c-4688-99f1-0ef824632c0a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] HTTP exception thrown: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8b1879a2-5d6c-4688-99f1-0ef824632c0a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Request method failure captured: Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 HTTP/1.1 Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqrt0ofdZCo_EHSlhT209ekptBsECwpWXCkSOE-tqw6Tt0My7_z3Pf5GhJvWCzn2DHkFBf8h4tLK9BfcVb4SJr_FyNod0P8YhvrV-ufySDoGvuBFy54GIiLix83Eu2Zxpp9ywQEh265C1yM9HGsAYyaN1h6k5TMKcN2YWF-SAGEgmp0 Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 6e2231c4720246789ebb4ae0b1a29128 Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e2231c4720246789ebb4ae0b1a29128"}]}] Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 6e2231c4720246789ebb4ae0b1a29128 Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachVolumeShelveTestJSON-1397393656-project Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 8ffdf91ab1a4414da1ec7fdcd4965bed Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1397393656-project Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '31c5c389-b7a1-4170-9b5c-321066d048e1'} Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:11.947189 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:11.952411 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:11.952411 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:11.952411 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:11.952411 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:11.952411 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:11.952411 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:11.952411 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. Oct 18 13:41:11.952411 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:11.954876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8b1879a2-5d6c-4688-99f1-0ef824632c0a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Returning 404 to user: Instance 31c5c389-b7a1-4170-9b5c-321066d048e1 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:11.955999 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8b1879a2-5d6c-4688-99f1-0ef824632c0a tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1" status: 404 len: 111 microversion: 2.20 time: 0.083842 Oct 18 13:41:11.957393 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2774/5322] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:41:11 2022] GET /compute/v2.1/servers/31c5c389-b7a1-4170-9b5c-321066d048e1 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:41:12.373985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2ddbc0e8-11fe-4198-86cf-f5d12409716d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:12.375130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2ddbc0e8-11fe-4198-86cf-f5d12409716d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:12.384172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ddbc0e8-11fe-4198-86cf-f5d12409716d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:12.385125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ddbc0e8-11fe-4198-86cf-f5d12409716d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:12.385941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ddbc0e8-11fe-4198-86cf-f5d12409716d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:12.388051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ddbc0e8-11fe-4198-86cf-f5d12409716d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:12.389662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ddbc0e8-11fe-4198-86cf-f5d12409716d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:12.393906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ddbc0e8-11fe-4198-86cf-f5d12409716d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:12.484205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2ddbc0e8-11fe-4198-86cf-f5d12409716d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:12.493495 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2ddbc0e8-11fe-4198-86cf-f5d12409716d tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1253 microversion: 2.1 time: 0.124598 Oct 18 13:41:12.495840 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2549/5323] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:12 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1253 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:13.520955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b6e7c260-fcee-4677-9e05-d715cc1f5d92 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:13.521653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b6e7c260-fcee-4677-9e05-d715cc1f5d92 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:13.538585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:13.542676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6e7c260-fcee-4677-9e05-d715cc1f5d92 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:13.543484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6e7c260-fcee-4677-9e05-d715cc1f5d92 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:13.544867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6e7c260-fcee-4677-9e05-d715cc1f5d92 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:13.546031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6e7c260-fcee-4677-9e05-d715cc1f5d92 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:13.546897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6e7c260-fcee-4677-9e05-d715cc1f5d92 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:13.548291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6e7c260-fcee-4677-9e05-d715cc1f5d92 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:13.658240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b6e7c260-fcee-4677-9e05-d715cc1f5d92 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:13.666945 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b6e7c260-fcee-4677-9e05-d715cc1f5d92 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1253 microversion: 2.1 time: 0.152639 Oct 18 13:41:13.668178 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2775/5324] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:13 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1253 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:14.693490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-230f4104-02f5-41c5-9401-9981fbc6753b tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:14.694118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-230f4104-02f5-41c5-9401-9981fbc6753b tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:14.714949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-230f4104-02f5-41c5-9401-9981fbc6753b tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:14.715487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-230f4104-02f5-41c5-9401-9981fbc6753b tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:14.715893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-230f4104-02f5-41c5-9401-9981fbc6753b tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:14.716594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-230f4104-02f5-41c5-9401-9981fbc6753b tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:14.717111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-230f4104-02f5-41c5-9401-9981fbc6753b tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:14.717493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-230f4104-02f5-41c5-9401-9981fbc6753b tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:14.874861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-230f4104-02f5-41c5-9401-9981fbc6753b tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4bf03bdfd0e4cecb7e90ca3c7c97ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f983dc605d28409f93a8f4234519773c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:14.885963 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-230f4104-02f5-41c5-9401-9981fbc6753b tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 200 len: 1253 microversion: 2.1 time: 0.198765 Oct 18 13:41:14.887477 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2550/5325] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:14 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 1253 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:15.910443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db3f36ba-118d-4837-9f79-c35f931c5a30 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:15.911736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db3f36ba-118d-4837-9f79-c35f931c5a30 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] [instance: 38401f91-0034-4290-b61d-0a09ae076c2e] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:15.926371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db3f36ba-118d-4837-9f79-c35f931c5a30 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:15.928172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db3f36ba-118d-4837-9f79-c35f931c5a30 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:15.929210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db3f36ba-118d-4837-9f79-c35f931c5a30 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:15.931577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db3f36ba-118d-4837-9f79-c35f931c5a30 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:15.933084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db3f36ba-118d-4837-9f79-c35f931c5a30 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:15.933812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db3f36ba-118d-4837-9f79-c35f931c5a30 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:15.973968 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-db3f36ba-118d-4837-9f79-c35f931c5a30 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] HTTP exception thrown: Instance 38401f91-0034-4290-b61d-0a09ae076c2e could not be found. Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db3f36ba-118d-4837-9f79-c35f931c5a30 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Request method failure captured: Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e HTTP/1.1 Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqx7qQCTzgPjwvU3o7_03byXS7_6wlG2ous7CcG2-UbUzU54GdvwFp_I-BZ1YM8hlRkxTLeFyZfdtUgxAh50AqSiD1hwWZTnd7Q6GmhiihaUUUJQ-ukyfjs9MS_QkRbD9C-yZWnd-fVTbETIgBiHjTzL5CHalDkBeyUoLBbb35OO65w Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: f983dc605d28409f93a8f4234519773c Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersTestBootFromVolume-1709898922 Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f983dc605d28409f93a8f4234519773c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f983dc605d28409f93a8f4234519773c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f983dc605d28409f93a8f4234519773c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f983dc605d28409f93a8f4234519773c"}]}] Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersTestBootFromVolume-1709898922 Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: f983dc605d28409f93a8f4234519773c Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1709898922 Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersTestBootFromVolume-1709898922-project Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: b4bf03bdfd0e4cecb7e90ca3c7c97ad4 Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersTestBootFromVolume-1709898922-project Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 38401f91-0034-4290-b61d-0a09ae076c2e could not be found. Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '38401f91-0034-4290-b61d-0a09ae076c2e'} Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38401f91-0034-4290-b61d-0a09ae076c2e could not be found. Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38401f91-0034-4290-b61d-0a09ae076c2e could not be found. Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:15.978265 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:15.983518 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:15.983518 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:15.983518 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:15.983518 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:15.983518 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:15.983518 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38401f91-0034-4290-b61d-0a09ae076c2e could not be found. Oct 18 13:41:15.983518 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:15.987933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db3f36ba-118d-4837-9f79-c35f931c5a30 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Returning 404 to user: Instance 38401f91-0034-4290-b61d-0a09ae076c2e could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:15.989116 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db3f36ba-118d-4837-9f79-c35f931c5a30 tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e" status: 404 len: 111 microversion: 2.1 time: 0.083585 Oct 18 13:41:15.992108 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2776/5326] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:15 2022] GET /compute/v2.1/servers/38401f91-0034-4290-b61d-0a09ae076c2e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:41:16.001823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b7bcc5a9-dc24-42da-8aae-6d5b896d632f tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] Calling method '.version_select at 0x7ff614312160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:16.044576 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b7bcc5a9-dc24-42da-8aae-6d5b896d632f tempest-ServersTestBootFromVolume-1709898922 tempest-ServersTestBootFromVolume-1709898922-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331111645" status: 202 len: 0 microversion: 2.1 time: 0.048294 Oct 18 13:41:16.046450 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2551/5327] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:41:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331111645 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:41:19.900203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca35f99c-b350-494d-94dd-162db04da121 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:19.900704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca35f99c-b350-494d-94dd-162db04da121 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:19.926559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca35f99c-b350-494d-94dd-162db04da121 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:19.926961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca35f99c-b350-494d-94dd-162db04da121 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:19.927801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca35f99c-b350-494d-94dd-162db04da121 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:19.930231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca35f99c-b350-494d-94dd-162db04da121 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:19.932314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca35f99c-b350-494d-94dd-162db04da121 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:19.932761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca35f99c-b350-494d-94dd-162db04da121 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:19.978230 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-ca35f99c-b350-494d-94dd-162db04da121 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] HTTP exception thrown: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca35f99c-b350-494d-94dd-162db04da121 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Request method failure captured: Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 HTTP/1.1 Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqrt0ofdZCo_EHSlhT209ekptBsECwpWXCkSOE-tqw6Tt0My7_z3Pf5GhJvWCzn2DHkFBf8h4tLK9BfcVb4SJr_FyNod0P8YhvrV-ufySDoGvuBFy54GIiLix83Eu2Zxpp9ywQEh265C1yM9HGsAYyaN1h6k5TMKcN2YWF-SAGEgmp0 Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 6e2231c4720246789ebb4ae0b1a29128 Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e2231c4720246789ebb4ae0b1a29128"}]}] Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 6e2231c4720246789ebb4ae0b1a29128 Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachVolumeShelveTestJSON-1397393656-project Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 8ffdf91ab1a4414da1ec7fdcd4965bed Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1397393656-project Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '5fa292c2-3801-4d84-b31a-4d3eeeb41818'} Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:41:19.979879 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca35f99c-b350-494d-94dd-162db04da121 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Returning 404 to user: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca35f99c-b350-494d-94dd-162db04da121 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 404 len: 111 microversion: 2.20 time: 0.085607 Oct 18 13:41:19.987208 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2777/5328] 10.222.0.40 () {60 vars in 1280 bytes} [Tue Oct 18 13:41:19 2022] DELETE /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:41:19.995400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bac1dfb5-ed63-443d-994d-f68e5dec64b4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:19.996574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bac1dfb5-ed63-443d-994d-f68e5dec64b4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] [instance: 5fa292c2-3801-4d84-b31a-4d3eeeb41818] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:20.007868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bac1dfb5-ed63-443d-994d-f68e5dec64b4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:20.008374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bac1dfb5-ed63-443d-994d-f68e5dec64b4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:20.008805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bac1dfb5-ed63-443d-994d-f68e5dec64b4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:20.014946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bac1dfb5-ed63-443d-994d-f68e5dec64b4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:20.015551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bac1dfb5-ed63-443d-994d-f68e5dec64b4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:20.016550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bac1dfb5-ed63-443d-994d-f68e5dec64b4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:20.060491 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-bac1dfb5-ed63-443d-994d-f68e5dec64b4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] HTTP exception thrown: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bac1dfb5-ed63-443d-994d-f68e5dec64b4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Request method failure captured: Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 HTTP/1.1 Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqrt0ofdZCo_EHSlhT209ekptBsECwpWXCkSOE-tqw6Tt0My7_z3Pf5GhJvWCzn2DHkFBf8h4tLK9BfcVb4SJr_FyNod0P8YhvrV-ufySDoGvuBFy54GIiLix83Eu2Zxpp9ywQEh265C1yM9HGsAYyaN1h6k5TMKcN2YWF-SAGEgmp0 Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Openstack-Nova-Api-Version: 2.20 Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 6e2231c4720246789ebb4ae0b1a29128 Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6e2231c4720246789ebb4ae0b1a29128"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6e2231c4720246789ebb4ae0b1a29128"}]}] Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 6e2231c4720246789ebb4ae0b1a29128 Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1397393656 Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeShelveTestJSON-1397393656-project Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 8ffdf91ab1a4414da1ec7fdcd4965bed Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1397393656-project Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '5fa292c2-3801-4d84-b31a-4d3eeeb41818'} Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:20.077166 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:20.086288 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:20.086288 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:20.086288 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:20.086288 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:20.086288 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:20.086288 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:20.086288 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. Oct 18 13:41:20.086288 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:20.086288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bac1dfb5-ed63-443d-994d-f68e5dec64b4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] Returning 404 to user: Instance 5fa292c2-3801-4d84-b31a-4d3eeeb41818 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:20.086288 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bac1dfb5-ed63-443d-994d-f68e5dec64b4 tempest-AttachVolumeShelveTestJSON-1397393656 tempest-AttachVolumeShelveTestJSON-1397393656-project] 10.222.0.40 "GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818" status: 404 len: 111 microversion: 2.20 time: 0.093055 Oct 18 13:41:20.086288 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2552/5329] 10.222.0.40 () {60 vars in 1277 bytes} [Tue Oct 18 13:41:19 2022] GET /compute/v2.1/servers/5fa292c2-3801-4d84-b31a-4d3eeeb41818 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:41:31.050064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-637ce0c1-57a8-4624-85c0-914dd752e578 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:31.051325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-637ce0c1-57a8-4624-85c0-914dd752e578 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:31.066741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=5 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:31.068929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:31.075489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-637ce0c1-57a8-4624-85c0-914dd752e578 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:31.076500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-637ce0c1-57a8-4624-85c0-914dd752e578 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:31.077787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-637ce0c1-57a8-4624-85c0-914dd752e578 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:31.093230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-637ce0c1-57a8-4624-85c0-914dd752e578 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:31.102530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-637ce0c1-57a8-4624-85c0-914dd752e578 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:31.103280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-637ce0c1-57a8-4624-85c0-914dd752e578 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:31.175844 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-637ce0c1-57a8-4624-85c0-914dd752e578 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/ips" status: 200 len: 145 microversion: 2.1 time: 0.129886 Oct 18 13:41:31.176928 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2778/5330] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:41:31 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/ips => generated 145 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:33.141986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-21ce065c-b63c-4745-baa6-ac1b08786cd5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:33.143090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-21ce065c-b63c-4745-baa6-ac1b08786cd5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:33.154279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:33.155674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:33.170615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21ce065c-b63c-4745-baa6-ac1b08786cd5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:33.171444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21ce065c-b63c-4745-baa6-ac1b08786cd5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:33.173221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21ce065c-b63c-4745-baa6-ac1b08786cd5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:33.177515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21ce065c-b63c-4745-baa6-ac1b08786cd5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:33.178166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21ce065c-b63c-4745-baa6-ac1b08786cd5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:33.178775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21ce065c-b63c-4745-baa6-ac1b08786cd5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:33.496174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-21ce065c-b63c-4745-baa6-ac1b08786cd5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lazy-loading 'services' on Instance uuid 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:41:33.754372 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-21ce065c-b63c-4745-baa6-ac1b08786cd5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "DELETE /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments/4b7a1ed8-130b-42ad-86b4-bbb9799840d4" status: 202 len: 0 microversion: 2.1 time: 0.621295 Oct 18 13:41:33.762187 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2553/5331] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:41:33 2022] DELETE /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments/4b7a1ed8-130b-42ad-86b4-bbb9799840d4 => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:41:33.769820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e91cc476-d7fc-4233-bc99-e928b5d6004d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:33.773801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e91cc476-d7fc-4233-bc99-e928b5d6004d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:33.810730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e91cc476-d7fc-4233-bc99-e928b5d6004d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:33.817443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e91cc476-d7fc-4233-bc99-e928b5d6004d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:33.823487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e91cc476-d7fc-4233-bc99-e928b5d6004d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:33.824661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e91cc476-d7fc-4233-bc99-e928b5d6004d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:33.826589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e91cc476-d7fc-4233-bc99-e928b5d6004d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:33.828330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e91cc476-d7fc-4233-bc99-e928b5d6004d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:33.911360 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e91cc476-d7fc-4233-bc99-e928b5d6004d tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148046 Oct 18 13:41:33.922026 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2779/5332] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:41:33 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:34.930658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6266e0c5-d4a5-4496-9759-7cf6cf1711a2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:34.933192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6266e0c5-d4a5-4496-9759-7cf6cf1711a2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:34.952777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6266e0c5-d4a5-4496-9759-7cf6cf1711a2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:34.953296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6266e0c5-d4a5-4496-9759-7cf6cf1711a2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:34.959409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6266e0c5-d4a5-4496-9759-7cf6cf1711a2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:34.960630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6266e0c5-d4a5-4496-9759-7cf6cf1711a2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:34.962617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6266e0c5-d4a5-4496-9759-7cf6cf1711a2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:34.963321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6266e0c5-d4a5-4496-9759-7cf6cf1711a2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:35.083828 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6266e0c5-d4a5-4496-9759-7cf6cf1711a2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151892 Oct 18 13:41:35.085020 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2554/5333] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:41:34 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:35.246643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bda827e1-a0b2-4e98-ae55-be7f2019ce19 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "218c398f-12f8-4e1d-8227-2ec0a841c25a"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:35.249701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bda827e1-a0b2-4e98-ae55-be7f2019ce19 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:35.272486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bda827e1-a0b2-4e98-ae55-be7f2019ce19 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:35.272971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bda827e1-a0b2-4e98-ae55-be7f2019ce19 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:35.273432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bda827e1-a0b2-4e98-ae55-be7f2019ce19 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:35.274142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bda827e1-a0b2-4e98-ae55-be7f2019ce19 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:35.274597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bda827e1-a0b2-4e98-ae55-be7f2019ce19 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:35.275020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bda827e1-a0b2-4e98-ae55-be7f2019ce19 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:35.831717 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bda827e1-a0b2-4e98-ae55-be7f2019ce19 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "POST /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.589077 Oct 18 13:41:35.850781 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2780/5334] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:41:35 2022] POST /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments => generated 194 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:36.096840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b96c4384-7a08-43ce-b035-ba042ea24ac2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:36.099344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b96c4384-7a08-43ce-b035-ba042ea24ac2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:36.125758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b96c4384-7a08-43ce-b035-ba042ea24ac2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:36.128586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b96c4384-7a08-43ce-b035-ba042ea24ac2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:36.129351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b96c4384-7a08-43ce-b035-ba042ea24ac2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:36.131022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b96c4384-7a08-43ce-b035-ba042ea24ac2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:36.132923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b96c4384-7a08-43ce-b035-ba042ea24ac2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:36.134845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b96c4384-7a08-43ce-b035-ba042ea24ac2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:36.231023 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b96c4384-7a08-43ce-b035-ba042ea24ac2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138332 Oct 18 13:41:36.235640 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2555/5335] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:41:36 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:37.247931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-befb1bbe-9077-470f-9003-a1b995a80119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:37.251478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-befb1bbe-9077-470f-9003-a1b995a80119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:37.274765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-befb1bbe-9077-470f-9003-a1b995a80119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:37.284421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-befb1bbe-9077-470f-9003-a1b995a80119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:37.285193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-befb1bbe-9077-470f-9003-a1b995a80119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:37.286141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-befb1bbe-9077-470f-9003-a1b995a80119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:37.289829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-befb1bbe-9077-470f-9003-a1b995a80119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:37.290501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-befb1bbe-9077-470f-9003-a1b995a80119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:37.398372 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-befb1bbe-9077-470f-9003-a1b995a80119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154752 Oct 18 13:41:37.410033 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2781/5336] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:41:37 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:38.415501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d27a1908-dcd7-4961-bf2a-a7b1879bcef2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:38.418053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d27a1908-dcd7-4961-bf2a-a7b1879bcef2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:38.444080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d27a1908-dcd7-4961-bf2a-a7b1879bcef2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:38.444687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d27a1908-dcd7-4961-bf2a-a7b1879bcef2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:38.446195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d27a1908-dcd7-4961-bf2a-a7b1879bcef2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:38.447888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d27a1908-dcd7-4961-bf2a-a7b1879bcef2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:38.450806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d27a1908-dcd7-4961-bf2a-a7b1879bcef2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:38.452258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d27a1908-dcd7-4961-bf2a-a7b1879bcef2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:38.508668 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d27a1908-dcd7-4961-bf2a-a7b1879bcef2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097894 Oct 18 13:41:38.509777 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2556/5337] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:41:38 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:39.542011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ffe1bb4c-3474-45ba-90c7-9ef0492063bd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:39.545155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ffe1bb4c-3474-45ba-90c7-9ef0492063bd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:39.568558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffe1bb4c-3474-45ba-90c7-9ef0492063bd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:39.595917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffe1bb4c-3474-45ba-90c7-9ef0492063bd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:39.596763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffe1bb4c-3474-45ba-90c7-9ef0492063bd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:39.597891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffe1bb4c-3474-45ba-90c7-9ef0492063bd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:39.598526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffe1bb4c-3474-45ba-90c7-9ef0492063bd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:39.599134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffe1bb4c-3474-45ba-90c7-9ef0492063bd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:39.634565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1586694888", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "c230beb5-91db-4f6c-b661-4ec1b04f607f"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:39.739523 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ffe1bb4c-3474-45ba-90c7-9ef0492063bd tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221967 Oct 18 13:41:39.749007 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2557/5338] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:41:39 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:39.758462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] validate_networks() for [('c230beb5-91db-4f6c-b661-4ec1b04f607f', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:41:40.755644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6f9d9820-1874-47af-8b1c-521a5f12a36f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:40.762419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6f9d9820-1874-47af-8b1c-521a5f12a36f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:40.784372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f9d9820-1874-47af-8b1c-521a5f12a36f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:40.787635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f9d9820-1874-47af-8b1c-521a5f12a36f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:40.794789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f9d9820-1874-47af-8b1c-521a5f12a36f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:40.802305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f9d9820-1874-47af-8b1c-521a5f12a36f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:40.803064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f9d9820-1874-47af-8b1c-521a5f12a36f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:40.806621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f9d9820-1874-47af-8b1c-521a5f12a36f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:40.903241 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6f9d9820-1874-47af-8b1c-521a5f12a36f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154752 Oct 18 13:41:40.910061 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2558/5339] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:41:40 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:41:41.502321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:41:41.503363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:41:41.504878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:41:41.505509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:41:41.506354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:41:41.541497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:41.542246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:41.542898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:41.545147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:41.547085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:41.547859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:41.610592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Getting quotas for project e6de1618a1114061a2eec611fda58597. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:41:41.622796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Getting quotas for user 618157f10c2e44fd8a10ac432be4146b and project e6de1618a1114061a2eec611fda58597. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:41:41.662360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:41:41.665276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:41:41.790385 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e5856841-726d-4d05-b09f-2b07ef7f28ae tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.667192 Oct 18 13:41:41.802389 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2782/5340] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:41:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:41:41.815809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a6e84f44-b229-4694-89bf-efc57ac9de9b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:41.816927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a6e84f44-b229-4694-89bf-efc57ac9de9b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:41.915912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f5bb66bf-59db-4023-af2e-4dc8336d67e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:41.919459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f5bb66bf-59db-4023-af2e-4dc8336d67e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:41.932097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5bb66bf-59db-4023-af2e-4dc8336d67e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:41.935842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5bb66bf-59db-4023-af2e-4dc8336d67e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:41.936501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5bb66bf-59db-4023-af2e-4dc8336d67e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:41.940720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5bb66bf-59db-4023-af2e-4dc8336d67e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:41.941479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5bb66bf-59db-4023-af2e-4dc8336d67e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:41.943545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5bb66bf-59db-4023-af2e-4dc8336d67e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:41.958799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a6e84f44-b229-4694-89bf-efc57ac9de9b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618157f10c2e44fd8a10ac432be4146b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6de1618a1114061a2eec611fda58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:41.979415 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a6e84f44-b229-4694-89bf-efc57ac9de9b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 200 len: 1225 microversion: 2.1 time: 0.169744 Oct 18 13:41:41.994606 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2559/5341] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:41 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 1225 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:42.024216 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f5bb66bf-59db-4023-af2e-4dc8336d67e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111698 Oct 18 13:41:42.026009 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2783/5342] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:41:41 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:43.004434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-378decd4-e80b-424c-9912-0ea256073846 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:43.004984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-378decd4-e80b-424c-9912-0ea256073846 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:43.021278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-378decd4-e80b-424c-9912-0ea256073846 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:43.023868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-378decd4-e80b-424c-9912-0ea256073846 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:43.024616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-378decd4-e80b-424c-9912-0ea256073846 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:43.025680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-378decd4-e80b-424c-9912-0ea256073846 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:43.027661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-378decd4-e80b-424c-9912-0ea256073846 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:43.028377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-378decd4-e80b-424c-9912-0ea256073846 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:43.037501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-101cc572-ce27-4853-970f-2dbd83480195 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:43.040350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-101cc572-ce27-4853-970f-2dbd83480195 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:43.068732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-101cc572-ce27-4853-970f-2dbd83480195 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:43.073714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-101cc572-ce27-4853-970f-2dbd83480195 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:43.074392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-101cc572-ce27-4853-970f-2dbd83480195 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:43.084687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-101cc572-ce27-4853-970f-2dbd83480195 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:43.085745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-101cc572-ce27-4853-970f-2dbd83480195 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:43.086469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-101cc572-ce27-4853-970f-2dbd83480195 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:43.163680 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-101cc572-ce27-4853-970f-2dbd83480195 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130468 Oct 18 13:41:43.167941 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2784/5343] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:41:43 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:43.355614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-378decd4-e80b-424c-9912-0ea256073846 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618157f10c2e44fd8a10ac432be4146b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6de1618a1114061a2eec611fda58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:43.370472 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-378decd4-e80b-424c-9912-0ea256073846 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 200 len: 1221 microversion: 2.1 time: 0.370632 Oct 18 13:41:43.378709 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2560/5344] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:42 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 1221 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:44.406402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5dedcbbb-08b2-4cb8-a072-690501d10613 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:44.407942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5dedcbbb-08b2-4cb8-a072-690501d10613 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:44.421764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5dedcbbb-08b2-4cb8-a072-690501d10613 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.424680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5dedcbbb-08b2-4cb8-a072-690501d10613 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.428452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5dedcbbb-08b2-4cb8-a072-690501d10613 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.430747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5dedcbbb-08b2-4cb8-a072-690501d10613 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.435062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5dedcbbb-08b2-4cb8-a072-690501d10613 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.438249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5dedcbbb-08b2-4cb8-a072-690501d10613 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.576420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc0d4176-794c-4daa-b52a-3daef30c1ede tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:44.579920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc0d4176-794c-4daa-b52a-3daef30c1ede tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:44.594968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0d4176-794c-4daa-b52a-3daef30c1ede tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.596409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0d4176-794c-4daa-b52a-3daef30c1ede tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.598045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0d4176-794c-4daa-b52a-3daef30c1ede tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.600028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0d4176-794c-4daa-b52a-3daef30c1ede tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.603238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0d4176-794c-4daa-b52a-3daef30c1ede tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.605867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0d4176-794c-4daa-b52a-3daef30c1ede tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.676836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5dedcbbb-08b2-4cb8-a072-690501d10613 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618157f10c2e44fd8a10ac432be4146b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6de1618a1114061a2eec611fda58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:44.686923 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5dedcbbb-08b2-4cb8-a072-690501d10613 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 200 len: 1283 microversion: 2.1 time: 0.285112 Oct 18 13:41:44.704149 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2561/5345] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:44 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 1283 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:44.726172 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc0d4176-794c-4daa-b52a-3daef30c1ede tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.551493 Oct 18 13:41:44.726796 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2785/5346] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:41:44 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739/os-volume_attachments => generated 25 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:41:44.925850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e11b2f38-b2da-4d16-9759-810788d9ae15 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:44.928654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e11b2f38-b2da-4d16-9759-810788d9ae15 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:44.942018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e11b2f38-b2da-4d16-9759-810788d9ae15 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.945332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e11b2f38-b2da-4d16-9759-810788d9ae15 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.945972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e11b2f38-b2da-4d16-9759-810788d9ae15 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:44.946875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e11b2f38-b2da-4d16-9759-810788d9ae15 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:44.948423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e11b2f38-b2da-4d16-9759-810788d9ae15 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:44.949028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e11b2f38-b2da-4d16-9759-810788d9ae15 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.022822 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e11b2f38-b2da-4d16-9759-810788d9ae15 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] HTTP exception thrown: Cannot 'reboot' instance f701eed8-faed-494f-987c-cbdd93ed5504 while it is in vm_state rescued Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e11b2f38-b2da-4d16-9759-810788d9ae15 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Request method failure captured: Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504/action HTTP/1.1 Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 28 Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvrqX_zkCEhVydfvHZBeTI6vdRWUcUOpxttnLcg2aIsaFsLlHnFjovxQI4kcc3Myi8lwAHRAsf2wLTn_JlgKXt7GIy8E5du_6bYylQ1wRbIaq_CdQtpXoiOxia-B1issY5UDMjn_CVSSo9PM6M7QgZo_y7FdWj0xg611rUe51cUCao Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0cdfce6f9e86407d883e624dd2c50559"}]}] Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 4113a1418b92488e97bf50aecdd49bb1 Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: {"reboot": {"type": "HARD"}} Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: exception: Cannot 'reboot' instance f701eed8-faed-494f-987c-cbdd93ed5504 while it is in vm_state rescued Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'f701eed8-faed-494f-987c-cbdd93ed5504', 'body': {'reboot': {'type': 'HARD'}}} Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f701eed8-faed-494f-987c-cbdd93ed5504 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:41:45.028448 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:41:45.034774 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance f701eed8-faed-494f-987c-cbdd93ed5504 while it is in vm_state rescued Oct 18 13:41:45.034774 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:45.034774 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:45.034774 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:45.034774 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:45.034774 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:45.034774 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:45.034774 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:45.034774 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:45.034774 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance f701eed8-faed-494f-987c-cbdd93ed5504 while it is in vm_state rescued Oct 18 13:41:45.034774 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:45.040428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e11b2f38-b2da-4d16-9759-810788d9ae15 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Returning 409 to user: Cannot 'reboot' instance f701eed8-faed-494f-987c-cbdd93ed5504 while it is in vm_state rescued {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:45.041609 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e11b2f38-b2da-4d16-9759-810788d9ae15 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504/action" status: 409 len: 145 microversion: 2.1 time: 0.121262 Oct 18 13:41:45.042421 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2562/5347] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:41:44 2022] POST /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504/action => generated 145 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:41:45.053291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9ab8c1d4-de2b-4b7b-a4c6-58b51112c9b4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:45.056448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9ab8c1d4-de2b-4b7b-a4c6-58b51112c9b4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:45.078637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ab8c1d4-de2b-4b7b-a4c6-58b51112c9b4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:45.079236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ab8c1d4-de2b-4b7b-a4c6-58b51112c9b4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:45.085892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ab8c1d4-de2b-4b7b-a4c6-58b51112c9b4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.086824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ab8c1d4-de2b-4b7b-a4c6-58b51112c9b4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:45.087321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ab8c1d4-de2b-4b7b-a4c6-58b51112c9b4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:45.093942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ab8c1d4-de2b-4b7b-a4c6-58b51112c9b4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.173365 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-9ab8c1d4-de2b-4b7b-a4c6-58b51112c9b4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] HTTP exception thrown: Cannot 'rebuild' instance f701eed8-faed-494f-987c-cbdd93ed5504 while it is in vm_state rescued Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9ab8c1d4-de2b-4b7b-a4c6-58b51112c9b4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Request method failure captured: Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504/action HTTP/1.1 Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 65 Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqvrqX_zkCEhVydfvHZBeTI6vdRWUcUOpxttnLcg2aIsaFsLlHnFjovxQI4kcc3Myi8lwAHRAsf2wLTn_JlgKXt7GIy8E5du_6bYylQ1wRbIaq_CdQtpXoiOxia-B1issY5UDMjn_CVSSo9PM6M7QgZo_y7FdWj0xg611rUe51cUCao Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0cdfce6f9e86407d883e624dd2c50559"}]}] Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 4113a1418b92488e97bf50aecdd49bb1 Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: exception: Cannot 'rebuild' instance f701eed8-faed-494f-987c-cbdd93ed5504 while it is in vm_state rescued Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f701eed8-faed-494f-987c-cbdd93ed5504', 'body': {'rebuild': {'imageRef': 'c5f2027d-2f76-420c-95a8-7bb70182af23'}}} Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f701eed8-faed-494f-987c-cbdd93ed5504 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:41:45.178704 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance f701eed8-faed-494f-987c-cbdd93ed5504 while it is in vm_state rescued Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance f701eed8-faed-494f-987c-cbdd93ed5504 while it is in vm_state rescued Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9ab8c1d4-de2b-4b7b-a4c6-58b51112c9b4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Returning 409 to user: Cannot 'rebuild' instance f701eed8-faed-494f-987c-cbdd93ed5504 while it is in vm_state rescued {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:45.184154 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9ab8c1d4-de2b-4b7b-a4c6-58b51112c9b4 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "POST /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504/action" status: 409 len: 146 microversion: 2.1 time: 0.132768 Oct 18 13:41:45.191200 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2786/5348] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:41:45 2022] POST /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504/action => generated 146 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:41:45.206053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fdafdd85-a7ab-44b0-9be6-922568043a23 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:45.206589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fdafdd85-a7ab-44b0-9be6-922568043a23 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:45.224503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdafdd85-a7ab-44b0-9be6-922568043a23 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:45.225033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdafdd85-a7ab-44b0-9be6-922568043a23 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:45.225526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdafdd85-a7ab-44b0-9be6-922568043a23 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.226246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdafdd85-a7ab-44b0-9be6-922568043a23 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:45.227213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdafdd85-a7ab-44b0-9be6-922568043a23 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:45.228146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fdafdd85-a7ab-44b0-9be6-922568043a23 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.279327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fdafdd85-a7ab-44b0-9be6-922568043a23 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:41:45.502084 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fdafdd85-a7ab-44b0-9be6-922568043a23 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "DELETE /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 204 len: 0 microversion: 2.1 time: 0.301442 Oct 18 13:41:45.502670 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2563/5349] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:41:45 2022] DELETE /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:41:45.513223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f6abf122-0d13-44be-8d68-06c06b5a9598 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:45.514036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f6abf122-0d13-44be-8d68-06c06b5a9598 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:45.537816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6abf122-0d13-44be-8d68-06c06b5a9598 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:45.540419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6abf122-0d13-44be-8d68-06c06b5a9598 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:45.541128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6abf122-0d13-44be-8d68-06c06b5a9598 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.544107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6abf122-0d13-44be-8d68-06c06b5a9598 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:45.547417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6abf122-0d13-44be-8d68-06c06b5a9598 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:45.548997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f6abf122-0d13-44be-8d68-06c06b5a9598 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.716915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1f3e3c5d-414d-424e-a840-4555d5ce634e tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:45.718368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1f3e3c5d-414d-424e-a840-4555d5ce634e tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:45.731068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f3e3c5d-414d-424e-a840-4555d5ce634e tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:45.731914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f3e3c5d-414d-424e-a840-4555d5ce634e tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:45.732597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f3e3c5d-414d-424e-a840-4555d5ce634e tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.733626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f3e3c5d-414d-424e-a840-4555d5ce634e tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:45.735284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f3e3c5d-414d-424e-a840-4555d5ce634e tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:45.735981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f3e3c5d-414d-424e-a840-4555d5ce634e tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:45.929974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1f3e3c5d-414d-424e-a840-4555d5ce634e tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618157f10c2e44fd8a10ac432be4146b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6de1618a1114061a2eec611fda58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:45.940857 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1f3e3c5d-414d-424e-a840-4555d5ce634e tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 200 len: 1283 microversion: 2.1 time: 0.228943 Oct 18 13:41:45.965208 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2564/5350] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:45 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 1283 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:46.614930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f6abf122-0d13-44be-8d68-06c06b5a9598 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:46.625284 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f6abf122-0d13-44be-8d68-06c06b5a9598 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1689 microversion: 2.1 time: 1.117452 Oct 18 13:41:46.629355 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2787/5351] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:45 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1689 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:46.972012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3822bba8-8767-4c5a-a487-757de4c0f119 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:46.972628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3822bba8-8767-4c5a-a487-757de4c0f119 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:46.991078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3822bba8-8767-4c5a-a487-757de4c0f119 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:46.993800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3822bba8-8767-4c5a-a487-757de4c0f119 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:46.996984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3822bba8-8767-4c5a-a487-757de4c0f119 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:47.004680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3822bba8-8767-4c5a-a487-757de4c0f119 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:47.005463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3822bba8-8767-4c5a-a487-757de4c0f119 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:47.007073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3822bba8-8767-4c5a-a487-757de4c0f119 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:47.652142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7a10e662-6208-44b1-af02-1ee7ec704a20 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:47.652727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7a10e662-6208-44b1-af02-1ee7ec704a20 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:47.668379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a10e662-6208-44b1-af02-1ee7ec704a20 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:47.669554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a10e662-6208-44b1-af02-1ee7ec704a20 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:47.670801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a10e662-6208-44b1-af02-1ee7ec704a20 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:47.672771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a10e662-6208-44b1-af02-1ee7ec704a20 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:47.673971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a10e662-6208-44b1-af02-1ee7ec704a20 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:47.675092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7a10e662-6208-44b1-af02-1ee7ec704a20 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:47.973265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3822bba8-8767-4c5a-a487-757de4c0f119 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618157f10c2e44fd8a10ac432be4146b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6de1618a1114061a2eec611fda58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:47.999729 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3822bba8-8767-4c5a-a487-757de4c0f119 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 200 len: 1325 microversion: 2.1 time: 1.031339 Oct 18 13:41:48.002411 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2565/5352] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:46 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 1325 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:48.101373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7a10e662-6208-44b1-af02-1ee7ec704a20 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:48.114965 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7a10e662-6208-44b1-af02-1ee7ec704a20 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1689 microversion: 2.1 time: 0.469020 Oct 18 13:41:48.117702 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2788/5353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:47 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1689 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:49.028133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1494853d-8c33-4b91-838d-8f62809fcfc4 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:49.030005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1494853d-8c33-4b91-838d-8f62809fcfc4 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:49.045121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1494853d-8c33-4b91-838d-8f62809fcfc4 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:49.047988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1494853d-8c33-4b91-838d-8f62809fcfc4 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:49.048621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1494853d-8c33-4b91-838d-8f62809fcfc4 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:49.049804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1494853d-8c33-4b91-838d-8f62809fcfc4 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:49.050521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1494853d-8c33-4b91-838d-8f62809fcfc4 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:49.051150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1494853d-8c33-4b91-838d-8f62809fcfc4 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:49.146081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2ba4a66f-7615-46b0-abcc-d6c5ab54411a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:49.146703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2ba4a66f-7615-46b0-abcc-d6c5ab54411a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:49.172976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ba4a66f-7615-46b0-abcc-d6c5ab54411a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:49.173865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ba4a66f-7615-46b0-abcc-d6c5ab54411a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:49.175268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ba4a66f-7615-46b0-abcc-d6c5ab54411a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:49.177689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ba4a66f-7615-46b0-abcc-d6c5ab54411a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:49.178371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ba4a66f-7615-46b0-abcc-d6c5ab54411a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:49.180873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ba4a66f-7615-46b0-abcc-d6c5ab54411a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:49.836895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2ba4a66f-7615-46b0-abcc-d6c5ab54411a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:49.854263 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2ba4a66f-7615-46b0-abcc-d6c5ab54411a tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1689 microversion: 2.1 time: 0.712707 Oct 18 13:41:49.857202 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2789/5354] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:49 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1689 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:50.421712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1494853d-8c33-4b91-838d-8f62809fcfc4 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618157f10c2e44fd8a10ac432be4146b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6de1618a1114061a2eec611fda58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:50.439889 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1494853d-8c33-4b91-838d-8f62809fcfc4 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 200 len: 1325 microversion: 2.1 time: 1.415223 Oct 18 13:41:50.440987 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2566/5355] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:49 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 1325 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:50.524319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-82f34769-3994-4f76-bb2b-65d5d9d03548 req-18388ada-7dbc-4bc5-bec8-e4cf0aa1392c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967f408c-a46d-45a2-8407-48ce72822e11", "tag": "ecb6e565-0f78-45ee-8b0c-a05d43ce31fe"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:50.539470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-82f34769-3994-4f76-bb2b-65d5d9d03548 req-18388ada-7dbc-4bc5-bec8-e4cf0aa1392c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:50.540201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-82f34769-3994-4f76-bb2b-65d5d9d03548 req-18388ada-7dbc-4bc5-bec8-e4cf0aa1392c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:50.541111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-82f34769-3994-4f76-bb2b-65d5d9d03548 req-18388ada-7dbc-4bc5-bec8-e4cf0aa1392c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:50.556507 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-82f34769-3994-4f76-bb2b-65d5d9d03548 req-18388ada-7dbc-4bc5-bec8-e4cf0aa1392c service nova] Creating event network-changed:ecb6e565-0f78-45ee-8b0c-a05d43ce31fe for instance 967f408c-a46d-45a2-8407-48ce72822e11 on n-h1-858384-13 Oct 18 13:41:50.565066 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-82f34769-3994-4f76-bb2b-65d5d9d03548 req-18388ada-7dbc-4bc5-bec8-e4cf0aa1392c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045361 Oct 18 13:41:50.566002 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2790/5356] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:50.885583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2599a5fa-a416-4e2f-a0c5-591867dfbce8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:50.886711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2599a5fa-a416-4e2f-a0c5-591867dfbce8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:50.901196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2599a5fa-a416-4e2f-a0c5-591867dfbce8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:50.903422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2599a5fa-a416-4e2f-a0c5-591867dfbce8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:50.904753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2599a5fa-a416-4e2f-a0c5-591867dfbce8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:50.907790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2599a5fa-a416-4e2f-a0c5-591867dfbce8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:50.909499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2599a5fa-a416-4e2f-a0c5-591867dfbce8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:50.912074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2599a5fa-a416-4e2f-a0c5-591867dfbce8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:51.472800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-636f0819-a1c0-49ef-aac9-b07eaab4a49f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:51.474045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-636f0819-a1c0-49ef-aac9-b07eaab4a49f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:51.486983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-636f0819-a1c0-49ef-aac9-b07eaab4a49f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:51.487775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-636f0819-a1c0-49ef-aac9-b07eaab4a49f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:51.487903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-636f0819-a1c0-49ef-aac9-b07eaab4a49f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:51.488690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-636f0819-a1c0-49ef-aac9-b07eaab4a49f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:51.489048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-636f0819-a1c0-49ef-aac9-b07eaab4a49f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:51.502894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-636f0819-a1c0-49ef-aac9-b07eaab4a49f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:51.589100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:51.684727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:51.964013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:52.300247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-636f0819-a1c0-49ef-aac9-b07eaab4a49f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618157f10c2e44fd8a10ac432be4146b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6de1618a1114061a2eec611fda58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:52.387382 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-636f0819-a1c0-49ef-aac9-b07eaab4a49f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 200 len: 1325 microversion: 2.1 time: 0.917947 Oct 18 13:41:52.408190 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2791/5357] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:51 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 1325 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:52.566569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2599a5fa-a416-4e2f-a0c5-591867dfbce8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:52.584544 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2599a5fa-a416-4e2f-a0c5-591867dfbce8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1689 microversion: 2.1 time: 1.706227 Oct 18 13:41:52.592288 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2567/5358] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:50 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1689 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:53.004136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-cfb1aa1c-1be8-409d-b22e-9ce3e4d766d2 req-020033d1-2365-41ce-b424-73c9246a301e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a18df7-1403-4f6a-8c6c-5f3e0eaaf739", "name": "network-vif-deleted", "tag": "e71918e1-9c7b-4c0b-907f-a8dbe92a0c97"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:53.024276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-cfb1aa1c-1be8-409d-b22e-9ce3e4d766d2 req-020033d1-2365-41ce-b424-73c9246a301e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:53.024883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-cfb1aa1c-1be8-409d-b22e-9ce3e4d766d2 req-020033d1-2365-41ce-b424-73c9246a301e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:53.025504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-cfb1aa1c-1be8-409d-b22e-9ce3e4d766d2 req-020033d1-2365-41ce-b424-73c9246a301e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.049574 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-cfb1aa1c-1be8-409d-b22e-9ce3e4d766d2 req-020033d1-2365-41ce-b424-73c9246a301e service nova] Creating event network-vif-deleted:e71918e1-9c7b-4c0b-907f-a8dbe92a0c97 for instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 on n-h1-858384-13 Oct 18 13:41:53.063383 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-cfb1aa1c-1be8-409d-b22e-9ce3e4d766d2 req-020033d1-2365-41ce-b424-73c9246a301e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062971 Oct 18 13:41:53.064827 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2792/5359] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:53.416636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8071aa5e-f1ef-431b-b84e-f600e7e21cba tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:53.419543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8071aa5e-f1ef-431b-b84e-f600e7e21cba tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:53.430780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8071aa5e-f1ef-431b-b84e-f600e7e21cba tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:53.431286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8071aa5e-f1ef-431b-b84e-f600e7e21cba tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:53.431779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8071aa5e-f1ef-431b-b84e-f600e7e21cba tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.435026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8071aa5e-f1ef-431b-b84e-f600e7e21cba tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:53.436029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8071aa5e-f1ef-431b-b84e-f600e7e21cba tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:53.438617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8071aa5e-f1ef-431b-b84e-f600e7e21cba tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.481532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:53.620647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:53.621723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:53.636053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:53.639096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:53.639898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.641909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:53.648002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:53.648370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.727397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:53.728194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:53.728923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:53.729837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lazy-loading 'fault' on Instance uuid 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:41:53.874516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:53.892980 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-43c75dbb-419d-4376-83ee-05f9371baee0 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 200 len: 1335 microversion: 2.1 time: 0.276038 Oct 18 13:41:53.912658 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2793/5360] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:53 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 1335 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:41:54.086848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8071aa5e-f1ef-431b-b84e-f600e7e21cba tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618157f10c2e44fd8a10ac432be4146b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6de1618a1114061a2eec611fda58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:54.101280 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8071aa5e-f1ef-431b-b84e-f600e7e21cba tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 200 len: 1325 microversion: 2.1 time: 0.689210 Oct 18 13:41:54.103285 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2568/5361] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:53 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 1325 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:54.920340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f0fbef9-9aa6-4757-9749-820b5f0e6119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:54.921685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7f0fbef9-9aa6-4757-9749-820b5f0e6119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:54.930539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f0fbef9-9aa6-4757-9749-820b5f0e6119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:54.931397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f0fbef9-9aa6-4757-9749-820b5f0e6119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:54.932079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f0fbef9-9aa6-4757-9749-820b5f0e6119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:54.933382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f0fbef9-9aa6-4757-9749-820b5f0e6119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:54.934083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f0fbef9-9aa6-4757-9749-820b5f0e6119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:54.934751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f0fbef9-9aa6-4757-9749-820b5f0e6119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:54.970324 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-7f0fbef9-9aa6-4757-9749-820b5f0e6119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] HTTP exception thrown: Instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 could not be found. Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f0fbef9-9aa6-4757-9749-820b5f0e6119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Request method failure captured: Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 HTTP/1.1 Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqvrqX_zkCEhVydfvHZBeTI6vdRWUcUOpxttnLcg2aIsaFsLlHnFjovxQI4kcc3Myi8lwAHRAsf2wLTn_JlgKXt7GIy8E5du_6bYylQ1wRbIaq_CdQtpXoiOxia-B1issY5UDMjn_CVSSo9PM6M7QgZo_y7FdWj0xg611rUe51cUCao Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0cdfce6f9e86407d883e624dd2c50559"}]}] Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 4113a1418b92488e97bf50aecdd49bb1 Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 could not be found. Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '60a18df7-1403-4f6a-8c6c-5f3e0eaaf739'} Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 could not be found. Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 could not be found. Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:54.975253 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:54.980335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:54.980335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:54.980335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:54.980335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:54.980335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:54.980335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:54.980335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 could not be found. Oct 18 13:41:54.980335 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:54.986247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f0fbef9-9aa6-4757-9749-820b5f0e6119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Returning 404 to user: Instance 60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:54.990292 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7f0fbef9-9aa6-4757-9749-820b5f0e6119 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739" status: 404 len: 111 microversion: 2.1 time: 0.074854 Oct 18 13:41:54.994993 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2794/5362] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:54 2022] GET /compute/v2.1/servers/60a18df7-1403-4f6a-8c6c-5f3e0eaaf739 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:41:55.004883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-797dbd1c-8c98-40e2-85ef-bd8faf7d1b34 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '.version_select at 0x7ff617b1bee0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:55.039294 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-797dbd1c-8c98-40e2-85ef-bd8faf7d1b34 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112811030" status: 202 len: 0 microversion: 2.1 time: 0.039588 Oct 18 13:41:55.046006 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2569/5363] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:41:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112811030 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:41:55.128811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ee9190db-1b53-43e4-9836-99b139af667c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:55.129651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ee9190db-1b53-43e4-9836-99b139af667c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:55.156169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee9190db-1b53-43e4-9836-99b139af667c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:55.156877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee9190db-1b53-43e4-9836-99b139af667c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:55.157387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee9190db-1b53-43e4-9836-99b139af667c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:55.164550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee9190db-1b53-43e4-9836-99b139af667c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:55.165072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee9190db-1b53-43e4-9836-99b139af667c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:55.168808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee9190db-1b53-43e4-9836-99b139af667c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:56.355956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ee9190db-1b53-43e4-9836-99b139af667c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618157f10c2e44fd8a10ac432be4146b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6de1618a1114061a2eec611fda58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:56.376635 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ee9190db-1b53-43e4-9836-99b139af667c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 200 len: 1325 microversion: 2.1 time: 1.253287 Oct 18 13:41:56.396368 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2795/5364] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:55 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 1325 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:56.554052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-afcd814b-437b-46c0-91bb-f943b691da8f req-6a66d0c9-b7de-46f9-ae20-d04d11f440d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967f408c-a46d-45a2-8407-48ce72822e11", "name": "network-vif-plugged", "status": "completed", "tag": "ecb6e565-0f78-45ee-8b0c-a05d43ce31fe"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:41:56.583980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-afcd814b-437b-46c0-91bb-f943b691da8f req-6a66d0c9-b7de-46f9-ae20-d04d11f440d5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:56.589394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-afcd814b-437b-46c0-91bb-f943b691da8f req-6a66d0c9-b7de-46f9-ae20-d04d11f440d5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:56.590632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-afcd814b-437b-46c0-91bb-f943b691da8f req-6a66d0c9-b7de-46f9-ae20-d04d11f440d5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:56.626661 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-afcd814b-437b-46c0-91bb-f943b691da8f req-6a66d0c9-b7de-46f9-ae20-d04d11f440d5 service nova] Creating event network-vif-plugged:ecb6e565-0f78-45ee-8b0c-a05d43ce31fe for instance 967f408c-a46d-45a2-8407-48ce72822e11 on n-h1-858384-13 Oct 18 13:41:56.636773 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-afcd814b-437b-46c0-91bb-f943b691da8f req-6a66d0c9-b7de-46f9-ae20-d04d11f440d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088532 Oct 18 13:41:56.644166 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2570/5365] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:57.404229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d7f4d516-f68c-4a62-b29b-ec97a326a49c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:57.406898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d7f4d516-f68c-4a62-b29b-ec97a326a49c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:57.423566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7f4d516-f68c-4a62-b29b-ec97a326a49c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:57.424341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7f4d516-f68c-4a62-b29b-ec97a326a49c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:57.426413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7f4d516-f68c-4a62-b29b-ec97a326a49c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:57.428259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7f4d516-f68c-4a62-b29b-ec97a326a49c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:57.429575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7f4d516-f68c-4a62-b29b-ec97a326a49c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:57.430956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7f4d516-f68c-4a62-b29b-ec97a326a49c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:57.440526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:41:57.996243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d7f4d516-f68c-4a62-b29b-ec97a326a49c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618157f10c2e44fd8a10ac432be4146b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6de1618a1114061a2eec611fda58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:58.022327 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d7f4d516-f68c-4a62-b29b-ec97a326a49c tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 200 len: 1325 microversion: 2.1 time: 0.620272 Oct 18 13:41:58.025146 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2796/5366] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:57 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 1325 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:58.960550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e06d3ee4-28a4-4c68-9570-f44415c33024 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:58.962912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e06d3ee4-28a4-4c68-9570-f44415c33024 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:58.973350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e06d3ee4-28a4-4c68-9570-f44415c33024 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:58.974438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e06d3ee4-28a4-4c68-9570-f44415c33024 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:58.975203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e06d3ee4-28a4-4c68-9570-f44415c33024 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:58.976349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e06d3ee4-28a4-4c68-9570-f44415c33024 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:58.977701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e06d3ee4-28a4-4c68-9570-f44415c33024 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:58.978610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e06d3ee4-28a4-4c68-9570-f44415c33024 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:59.052232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-19e1b582-6976-409e-8314-1fa242454f3b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:59.052849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-19e1b582-6976-409e-8314-1fa242454f3b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:59.067034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19e1b582-6976-409e-8314-1fa242454f3b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:59.072382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19e1b582-6976-409e-8314-1fa242454f3b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:59.072918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19e1b582-6976-409e-8314-1fa242454f3b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:59.076657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19e1b582-6976-409e-8314-1fa242454f3b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:59.079316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19e1b582-6976-409e-8314-1fa242454f3b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:59.080536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-19e1b582-6976-409e-8314-1fa242454f3b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:59.088266 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e06d3ee4-28a4-4c68-9570-f44415c33024 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131125 Oct 18 13:41:59.088975 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2571/5367] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:41:58 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:59.112885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af859264-82ba-4f57-849d-d2f9f20bf33d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:59.114446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-af859264-82ba-4f57-849d-d2f9f20bf33d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:59.131443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af859264-82ba-4f57-849d-d2f9f20bf33d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:59.135781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af859264-82ba-4f57-849d-d2f9f20bf33d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:59.137434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af859264-82ba-4f57-849d-d2f9f20bf33d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:59.147347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af859264-82ba-4f57-849d-d2f9f20bf33d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:59.148063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af859264-82ba-4f57-849d-d2f9f20bf33d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:59.149855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af859264-82ba-4f57-849d-d2f9f20bf33d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:59.201802 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-af859264-82ba-4f57-849d-d2f9f20bf33d tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments/218c398f-12f8-4e1d-8227-2ec0a841c25a" status: 200 len: 194 microversion: 2.1 time: 0.104532 Oct 18 13:41:59.203638 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2572/5368] 10.222.0.40 () {58 vars in 1413 bytes} [Tue Oct 18 13:41:59 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments/218c398f-12f8-4e1d-8227-2ec0a841c25a => generated 194 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:41:59.511360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-19e1b582-6976-409e-8314-1fa242454f3b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618157f10c2e44fd8a10ac432be4146b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6de1618a1114061a2eec611fda58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:41:59.527591 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-19e1b582-6976-409e-8314-1fa242454f3b tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 200 len: 1522 microversion: 2.1 time: 0.476048 Oct 18 13:41:59.530815 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2797/5369] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:59 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:41:59.557219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cf606dab-3a15-4adf-83b9-06c485792413 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:59.557961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cf606dab-3a15-4adf-83b9-06c485792413 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:59.565519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf606dab-3a15-4adf-83b9-06c485792413 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:59.566364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf606dab-3a15-4adf-83b9-06c485792413 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:59.567530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf606dab-3a15-4adf-83b9-06c485792413 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:59.569109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf606dab-3a15-4adf-83b9-06c485792413 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:59.569834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf606dab-3a15-4adf-83b9-06c485792413 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:59.570998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf606dab-3a15-4adf-83b9-06c485792413 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:59.626844 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-cf606dab-3a15-4adf-83b9-06c485792413 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] HTTP exception thrown: Action 999 not found Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cf606dab-3a15-4adf-83b9-06c485792413 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Request method failure captured: Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11/os-instance-actions/999 HTTP/1.1 Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq0S02XZSkiFXHoiaxRNX2_ZNz766wXlbfEfK-dyyU-R25K1bf-Kw4qGx9lMu7VO_8wEGuz4rr1eX3rqkVMrzIaQqMW6fqmjUv3uTkCd1Q2ymoeyEKiUkJqeOgPBROWLXbZYVZJTYBLI42t7HsssuZO95naCKrbnBUSa90PKX-2TLVk Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: e6de1618a1114061a2eec611fda58597 Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-853129474 Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e6de1618a1114061a2eec611fda58597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e6de1618a1114061a2eec611fda58597"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e6de1618a1114061a2eec611fda58597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e6de1618a1114061a2eec611fda58597"}]}] Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-853129474 Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: e6de1618a1114061a2eec611fda58597 Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-853129474 Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-InstanceActionsNegativeTestJSON-853129474-project Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 618157f10c2e44fd8a10ac432be4146b Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-853129474-project Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: exception: Action 999 not found Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'server_id': '967f408c-a46d-45a2-8407-48ce72822e11', 'id': '999'} Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 18 13:41:59.634714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:41:59.645582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cf606dab-3a15-4adf-83b9-06c485792413 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Returning 404 to user: Action 999 not found {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:59.646868 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cf606dab-3a15-4adf-83b9-06c485792413 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.095041 Oct 18 13:41:59.654094 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2573/5370] 10.222.0.40 () {58 vars in 1308 bytes} [Tue Oct 18 13:41:59 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11/os-instance-actions/999 => generated 66 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:41:59.659059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed64b935-3eb0-4ae3-8099-c5dbf1515c3f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '.version_select at 0x7ff60ef04dc0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:59.659632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ed64b935-3eb0-4ae3-8099-c5dbf1515c3f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 04a88a8b-a06f-437a-8161-8a44c6f17bd1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:59.673633 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-ed64b935-3eb0-4ae3-8099-c5dbf1515c3f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] HTTP exception thrown: Instance 04a88a8b-a06f-437a-8161-8a44c6f17bd1 could not be found. Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed64b935-3eb0-4ae3-8099-c5dbf1515c3f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Request method failure captured: Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/04a88a8b-a06f-437a-8161-8a44c6f17bd1/os-instance-actions HTTP/1.1 Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq0S02XZSkiFXHoiaxRNX2_ZNz766wXlbfEfK-dyyU-R25K1bf-Kw4qGx9lMu7VO_8wEGuz4rr1eX3rqkVMrzIaQqMW6fqmjUv3uTkCd1Q2ymoeyEKiUkJqeOgPBROWLXbZYVZJTYBLI42t7HsssuZO95naCKrbnBUSa90PKX-2TLVk Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: e6de1618a1114061a2eec611fda58597 Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-853129474 Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e6de1618a1114061a2eec611fda58597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e6de1618a1114061a2eec611fda58597"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e6de1618a1114061a2eec611fda58597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e6de1618a1114061a2eec611fda58597"}]}] Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-853129474 Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: e6de1618a1114061a2eec611fda58597 Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-853129474 Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-InstanceActionsNegativeTestJSON-853129474-project Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 618157f10c2e44fd8a10ac432be4146b Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-853129474-project Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 04a88a8b-a06f-437a-8161-8a44c6f17bd1 could not be found. Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'server_id': '04a88a8b-a06f-437a-8161-8a44c6f17bd1'} Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a88a8b-a06f-437a-8161-8a44c6f17bd1 could not be found. Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:41:59.676171 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:41:59.683796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a88a8b-a06f-437a-8161-8a44c6f17bd1 could not be found. Oct 18 13:41:59.683796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:59.683796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:41:59.683796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:59.683796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:41:59.683796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:41:59.683796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:41:59.683796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:41:59.683796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:41:59.683796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a88a8b-a06f-437a-8161-8a44c6f17bd1 could not be found. Oct 18 13:41:59.683796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:41:59.683796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed64b935-3eb0-4ae3-8099-c5dbf1515c3f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Returning 404 to user: Instance 04a88a8b-a06f-437a-8161-8a44c6f17bd1 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:41:59.692581 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ed64b935-3eb0-4ae3-8099-c5dbf1515c3f tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/04a88a8b-a06f-437a-8161-8a44c6f17bd1/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.038648 Oct 18 13:41:59.698648 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2798/5371] 10.222.0.40 () {58 vars in 1296 bytes} [Tue Oct 18 13:41:59 2022] GET /compute/v2.1/servers/04a88a8b-a06f-437a-8161-8a44c6f17bd1/os-instance-actions => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:41:59.715911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-34264264-803a-43de-b1e8-e4a250f58cc5 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:41:59.719332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-34264264-803a-43de-b1e8-e4a250f58cc5 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:41:59.740305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34264264-803a-43de-b1e8-e4a250f58cc5 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:59.741523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34264264-803a-43de-b1e8-e4a250f58cc5 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:59.743108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34264264-803a-43de-b1e8-e4a250f58cc5 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:59.744670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34264264-803a-43de-b1e8-e4a250f58cc5 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:41:59.746588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34264264-803a-43de-b1e8-e4a250f58cc5 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:41:59.747825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34264264-803a-43de-b1e8-e4a250f58cc5 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:41:59.811902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-34264264-803a-43de-b1e8-e4a250f58cc5 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:41:59.991362 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-34264264-803a-43de-b1e8-e4a250f58cc5 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "DELETE /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 204 len: 0 microversion: 2.1 time: 0.286211 Oct 18 13:41:59.996771 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2574/5372] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:41:59 2022] DELETE /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:42:00.005304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d9e23d65-b9f8-47aa-8229-6c45f524ee8a tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:00.006128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d9e23d65-b9f8-47aa-8229-6c45f524ee8a tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:00.058447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9e23d65-b9f8-47aa-8229-6c45f524ee8a tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:00.062775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9e23d65-b9f8-47aa-8229-6c45f524ee8a tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:00.063298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9e23d65-b9f8-47aa-8229-6c45f524ee8a tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:00.064063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9e23d65-b9f8-47aa-8229-6c45f524ee8a tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:00.064536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9e23d65-b9f8-47aa-8229-6c45f524ee8a tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:00.080483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d9e23d65-b9f8-47aa-8229-6c45f524ee8a tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:00.883734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d9e23d65-b9f8-47aa-8229-6c45f524ee8a tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618157f10c2e44fd8a10ac432be4146b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6de1618a1114061a2eec611fda58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:00.899409 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d9e23d65-b9f8-47aa-8229-6c45f524ee8a tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 200 len: 1528 microversion: 2.1 time: 0.901819 Oct 18 13:42:00.914014 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2799/5373] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:41:59 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 1528 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:01.956428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f6562d92-8e71-4818-9e3c-8ee5d6c0f998 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:01.957135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f6562d92-8e71-4818-9e3c-8ee5d6c0f998 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:01.976249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6562d92-8e71-4818-9e3c-8ee5d6c0f998 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:01.976826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6562d92-8e71-4818-9e3c-8ee5d6c0f998 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:01.977299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6562d92-8e71-4818-9e3c-8ee5d6c0f998 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:01.978037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6562d92-8e71-4818-9e3c-8ee5d6c0f998 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:01.978490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6562d92-8e71-4818-9e3c-8ee5d6c0f998 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:01.978913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f6562d92-8e71-4818-9e3c-8ee5d6c0f998 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:02.123501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b23b765c-526e-45c4-b298-49435a3e49a9 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dab0e946-9aa6-4015-be0e-8634c3e8c3f4"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:02.127091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b23b765c-526e-45c4-b298-49435a3e49a9 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:02.140094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:02.143372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b23b765c-526e-45c4-b298-49435a3e49a9 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:02.144316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b23b765c-526e-45c4-b298-49435a3e49a9 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:02.145147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b23b765c-526e-45c4-b298-49435a3e49a9 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:02.146390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b23b765c-526e-45c4-b298-49435a3e49a9 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:02.147140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b23b765c-526e-45c4-b298-49435a3e49a9 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:02.147945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b23b765c-526e-45c4-b298-49435a3e49a9 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:02.768745 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b23b765c-526e-45c4-b298-49435a3e49a9 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "POST /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.649022 Oct 18 13:42:02.770162 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2800/5374] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:42:02 2022] POST /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments => generated 194 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:04.049902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f6562d92-8e71-4818-9e3c-8ee5d6c0f998 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618157f10c2e44fd8a10ac432be4146b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6de1618a1114061a2eec611fda58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:04.061773 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f6562d92-8e71-4818-9e3c-8ee5d6c0f998 tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 200 len: 1528 microversion: 2.1 time: 2.106871 Oct 18 13:42:04.081492 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2575/5375] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:01 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 1528 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:04.588403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7dda2372-053f-44e7-8607-73e28c05687d req-af2c4c78-1a3b-4f55-86cf-c800e3c9d4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967f408c-a46d-45a2-8407-48ce72822e11", "name": "network-vif-deleted", "tag": "ecb6e565-0f78-45ee-8b0c-a05d43ce31fe"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:04.610958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7dda2372-053f-44e7-8607-73e28c05687d req-af2c4c78-1a3b-4f55-86cf-c800e3c9d4f6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:04.611441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7dda2372-053f-44e7-8607-73e28c05687d req-af2c4c78-1a3b-4f55-86cf-c800e3c9d4f6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:04.611885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7dda2372-053f-44e7-8607-73e28c05687d req-af2c4c78-1a3b-4f55-86cf-c800e3c9d4f6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:04.623833 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7dda2372-053f-44e7-8607-73e28c05687d req-af2c4c78-1a3b-4f55-86cf-c800e3c9d4f6 service nova] Creating event network-vif-deleted:ecb6e565-0f78-45ee-8b0c-a05d43ce31fe for instance 967f408c-a46d-45a2-8407-48ce72822e11 on n-h1-858384-13 Oct 18 13:42:04.630081 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7dda2372-053f-44e7-8607-73e28c05687d req-af2c4c78-1a3b-4f55-86cf-c800e3c9d4f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.569202 Oct 18 13:42:04.631004 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2801/5376] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:05.089167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-256235c1-c938-47de-a262-b812e45ac4eb tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:05.089802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-256235c1-c938-47de-a262-b812e45ac4eb tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] [instance: 967f408c-a46d-45a2-8407-48ce72822e11] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:05.109142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:05.111609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-256235c1-c938-47de-a262-b812e45ac4eb tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:05.114459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-256235c1-c938-47de-a262-b812e45ac4eb tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:05.120355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-256235c1-c938-47de-a262-b812e45ac4eb tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:05.121338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-256235c1-c938-47de-a262-b812e45ac4eb tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:05.123773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-256235c1-c938-47de-a262-b812e45ac4eb tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:05.124227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-256235c1-c938-47de-a262-b812e45ac4eb tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:05.189401 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-256235c1-c938-47de-a262-b812e45ac4eb tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] HTTP exception thrown: Instance 967f408c-a46d-45a2-8407-48ce72822e11 could not be found. Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-256235c1-c938-47de-a262-b812e45ac4eb tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Request method failure captured: Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 HTTP/1.1 Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq0S02XZSkiFXHoiaxRNX2_ZNz766wXlbfEfK-dyyU-R25K1bf-Kw4qGx9lMu7VO_8wEGuz4rr1eX3rqkVMrzIaQqMW6fqmjUv3uTkCd1Q2ymoeyEKiUkJqeOgPBROWLXbZYVZJTYBLI42t7HsssuZO95naCKrbnBUSa90PKX-2TLVk Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: e6de1618a1114061a2eec611fda58597 Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-853129474 Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e6de1618a1114061a2eec611fda58597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e6de1618a1114061a2eec611fda58597"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e6de1618a1114061a2eec611fda58597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e6de1618a1114061a2eec611fda58597"}]}] Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-853129474 Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: e6de1618a1114061a2eec611fda58597 Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-853129474 Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-InstanceActionsNegativeTestJSON-853129474-project Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 618157f10c2e44fd8a10ac432be4146b Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-853129474-project Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 967f408c-a46d-45a2-8407-48ce72822e11 could not be found. Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '967f408c-a46d-45a2-8407-48ce72822e11'} Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967f408c-a46d-45a2-8407-48ce72822e11 could not be found. Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967f408c-a46d-45a2-8407-48ce72822e11 could not be found. Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:05.195721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:05.200772 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:05.200772 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:05.200772 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:05.200772 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:05.200772 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:05.200772 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:05.200772 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967f408c-a46d-45a2-8407-48ce72822e11 could not be found. Oct 18 13:42:05.200772 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:05.202394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-256235c1-c938-47de-a262-b812e45ac4eb tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] Returning 404 to user: Instance 967f408c-a46d-45a2-8407-48ce72822e11 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:05.203025 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-256235c1-c938-47de-a262-b812e45ac4eb tempest-InstanceActionsNegativeTestJSON-853129474 tempest-InstanceActionsNegativeTestJSON-853129474-project] 10.222.0.40 "GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11" status: 404 len: 111 microversion: 2.1 time: 0.116970 Oct 18 13:42:05.203625 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2576/5377] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:05 2022] GET /compute/v2.1/servers/967f408c-a46d-45a2-8407-48ce72822e11 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:05.897377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8577ac82-7c8b-432f-b490-1eb0462e953b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:05.897965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8577ac82-7c8b-432f-b490-1eb0462e953b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:05.914730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8577ac82-7c8b-432f-b490-1eb0462e953b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:05.915304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8577ac82-7c8b-432f-b490-1eb0462e953b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:05.915744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8577ac82-7c8b-432f-b490-1eb0462e953b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:05.916458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8577ac82-7c8b-432f-b490-1eb0462e953b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:05.916914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8577ac82-7c8b-432f-b490-1eb0462e953b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:05.917388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8577ac82-7c8b-432f-b490-1eb0462e953b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:05.979661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8577ac82-7c8b-432f-b490-1eb0462e953b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:42:06.172838 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8577ac82-7c8b-432f-b490-1eb0462e953b tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 204 len: 0 microversion: 2.1 time: 0.281639 Oct 18 13:42:06.173820 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2802/5378] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:05 2022] DELETE /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:42:06.182594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3c0d3d53-139f-43b0-9afa-02f5787963e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:06.183901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3c0d3d53-139f-43b0-9afa-02f5787963e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:06.198823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c0d3d53-139f-43b0-9afa-02f5787963e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:06.199581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c0d3d53-139f-43b0-9afa-02f5787963e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:06.200203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c0d3d53-139f-43b0-9afa-02f5787963e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:06.201090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c0d3d53-139f-43b0-9afa-02f5787963e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:06.203140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c0d3d53-139f-43b0-9afa-02f5787963e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:06.203910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c0d3d53-139f-43b0-9afa-02f5787963e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:06.687467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3c0d3d53-139f-43b0-9afa-02f5787963e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:06.707843 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3c0d3d53-139f-43b0-9afa-02f5787963e5 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1508 microversion: 2.1 time: 0.529533 Oct 18 13:42:06.711115 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2577/5379] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:06 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1508 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:07.740808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04e28927-75f7-4d77-b347-175543256ac8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:07.741801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04e28927-75f7-4d77-b347-175543256ac8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:07.765274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04e28927-75f7-4d77-b347-175543256ac8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:07.765730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04e28927-75f7-4d77-b347-175543256ac8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:07.766176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04e28927-75f7-4d77-b347-175543256ac8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:07.770475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04e28927-75f7-4d77-b347-175543256ac8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:07.770970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04e28927-75f7-4d77-b347-175543256ac8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:07.772762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04e28927-75f7-4d77-b347-175543256ac8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:08.741518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04e28927-75f7-4d77-b347-175543256ac8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:08.756602 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04e28927-75f7-4d77-b347-175543256ac8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1508 microversion: 2.1 time: 1.020162 Oct 18 13:42:08.759270 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2803/5380] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:07 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1508 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:08.832653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b95c8dd7-b119-4f3a-8510-7a605b5eafa4 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:08.833965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b95c8dd7-b119-4f3a-8510-7a605b5eafa4 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:08.846469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b95c8dd7-b119-4f3a-8510-7a605b5eafa4 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:08.848244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b95c8dd7-b119-4f3a-8510-7a605b5eafa4 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:08.849555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b95c8dd7-b119-4f3a-8510-7a605b5eafa4 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:08.853575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b95c8dd7-b119-4f3a-8510-7a605b5eafa4 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:08.854447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b95c8dd7-b119-4f3a-8510-7a605b5eafa4 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:08.855122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b95c8dd7-b119-4f3a-8510-7a605b5eafa4 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:08.937952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b95c8dd7-b119-4f3a-8510-7a605b5eafa4 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:42:09.176543 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b95c8dd7-b119-4f3a-8510-7a605b5eafa4 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "DELETE /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 204 len: 0 microversion: 2.1 time: 0.828214 Oct 18 13:42:09.178686 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2578/5381] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:08 2022] DELETE /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:42:09.189052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b79987dd-05ee-40bc-a68c-c54bed600fe3 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:09.190367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b79987dd-05ee-40bc-a68c-c54bed600fe3 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:09.210260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b79987dd-05ee-40bc-a68c-c54bed600fe3 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:09.215702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b79987dd-05ee-40bc-a68c-c54bed600fe3 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:09.221882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b79987dd-05ee-40bc-a68c-c54bed600fe3 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:09.223211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b79987dd-05ee-40bc-a68c-c54bed600fe3 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:09.228468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b79987dd-05ee-40bc-a68c-c54bed600fe3 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:09.229275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b79987dd-05ee-40bc-a68c-c54bed600fe3 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:09.481389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ae055b74-94ec-4658-adf5-5282364071d7 req-48eb7c6a-e707-415e-b3af-e89f1b5c14b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f701eed8-faed-494f-987c-cbdd93ed5504", "name": "network-vif-deleted", "tag": "7c235f2d-d376-49ee-ac72-2233d159633e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:09.528105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ae055b74-94ec-4658-adf5-5282364071d7 req-48eb7c6a-e707-415e-b3af-e89f1b5c14b8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:09.528890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ae055b74-94ec-4658-adf5-5282364071d7 req-48eb7c6a-e707-415e-b3af-e89f1b5c14b8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:09.529591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ae055b74-94ec-4658-adf5-5282364071d7 req-48eb7c6a-e707-415e-b3af-e89f1b5c14b8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:09.580186 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ae055b74-94ec-4658-adf5-5282364071d7 req-48eb7c6a-e707-415e-b3af-e89f1b5c14b8 service nova] Creating event network-vif-deleted:7c235f2d-d376-49ee-ac72-2233d159633e for instance f701eed8-faed-494f-987c-cbdd93ed5504 on n-h2-858384-13 Oct 18 13:42:09.601574 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ae055b74-94ec-4658-adf5-5282364071d7 req-48eb7c6a-e707-415e-b3af-e89f1b5c14b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124078 Oct 18 13:42:09.603151 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2579/5382] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:09.804016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-03706ded-7248-4608-8fb2-37b44a103730 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:09.814481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-03706ded-7248-4608-8fb2-37b44a103730 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:09.859212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03706ded-7248-4608-8fb2-37b44a103730 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:09.859802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03706ded-7248-4608-8fb2-37b44a103730 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:09.860220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03706ded-7248-4608-8fb2-37b44a103730 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:09.860962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03706ded-7248-4608-8fb2-37b44a103730 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:09.875507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03706ded-7248-4608-8fb2-37b44a103730 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:09.876724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03706ded-7248-4608-8fb2-37b44a103730 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:10.412808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-03706ded-7248-4608-8fb2-37b44a103730 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:10.427547 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-03706ded-7248-4608-8fb2-37b44a103730 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1466 microversion: 2.1 time: 0.642267 Oct 18 13:42:10.429898 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2580/5383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:09 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1466 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:11.098758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b79987dd-05ee-40bc-a68c-c54bed600fe3 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:11.110829 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b79987dd-05ee-40bc-a68c-c54bed600fe3 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1731 microversion: 2.1 time: 1.926913 Oct 18 13:42:11.130152 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2804/5384] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:09 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1731 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:11.472297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:11.472920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:11.491503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:11.491999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:11.492438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:11.493149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:11.493615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:11.494131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:11.615949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:11.616462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:11.617061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:11.619361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lazy-loading 'fault' on Instance uuid f701eed8-faed-494f-987c-cbdd93ed5504 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:42:11.746680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:11.761622 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d893ccca-9a36-410a-add0-0272c2bbb301 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 200 len: 1312 microversion: 2.1 time: 0.309271 Oct 18 13:42:11.764604 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2581/5385] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:11 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 1312 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:12.143843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9829d6e2-8e5b-48b4-b142-3caea2f895c1 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:12.144702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9829d6e2-8e5b-48b4-b142-3caea2f895c1 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:12.157562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9829d6e2-8e5b-48b4-b142-3caea2f895c1 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:12.158054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9829d6e2-8e5b-48b4-b142-3caea2f895c1 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:12.158487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9829d6e2-8e5b-48b4-b142-3caea2f895c1 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:12.164604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9829d6e2-8e5b-48b4-b142-3caea2f895c1 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:12.165200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9829d6e2-8e5b-48b4-b142-3caea2f895c1 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:12.165647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9829d6e2-8e5b-48b4-b142-3caea2f895c1 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:12.793970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a4e39f4a-9c80-480f-b828-5846ae0f274e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:12.794868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a4e39f4a-9c80-480f-b828-5846ae0f274e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: f701eed8-faed-494f-987c-cbdd93ed5504] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:12.814060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9829d6e2-8e5b-48b4-b142-3caea2f895c1 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:12.818515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4e39f4a-9c80-480f-b828-5846ae0f274e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:12.819940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4e39f4a-9c80-480f-b828-5846ae0f274e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:12.820390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4e39f4a-9c80-480f-b828-5846ae0f274e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:12.821110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4e39f4a-9c80-480f-b828-5846ae0f274e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:12.821599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4e39f4a-9c80-480f-b828-5846ae0f274e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:12.823051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4e39f4a-9c80-480f-b828-5846ae0f274e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:12.825786 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9829d6e2-8e5b-48b4-b142-3caea2f895c1 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1663 microversion: 2.1 time: 0.686137 Oct 18 13:42:12.827029 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2805/5386] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:12 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1663 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:12.876659 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-a4e39f4a-9c80-480f-b828-5846ae0f274e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] HTTP exception thrown: Instance f701eed8-faed-494f-987c-cbdd93ed5504 could not be found. Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a4e39f4a-9c80-480f-b828-5846ae0f274e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Request method failure captured: Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 HTTP/1.1 Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvrqX_zkCEhVydfvHZBeTI6vdRWUcUOpxttnLcg2aIsaFsLlHnFjovxQI4kcc3Myi8lwAHRAsf2wLTn_JlgKXt7GIy8E5du_6bYylQ1wRbIaq_CdQtpXoiOxia-B1issY5UDMjn_CVSSo9PM6M7QgZo_y7FdWj0xg611rUe51cUCao Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0cdfce6f9e86407d883e624dd2c50559"}]}] Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 4113a1418b92488e97bf50aecdd49bb1 Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance f701eed8-faed-494f-987c-cbdd93ed5504 could not be found. Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'f701eed8-faed-494f-987c-cbdd93ed5504'} Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f701eed8-faed-494f-987c-cbdd93ed5504 could not be found. Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f701eed8-faed-494f-987c-cbdd93ed5504 could not be found. Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:12.881420 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:12.886781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:12.886781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:12.886781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:12.886781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:12.886781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:12.886781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:12.886781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f701eed8-faed-494f-987c-cbdd93ed5504 could not be found. Oct 18 13:42:12.886781 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:12.893335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a4e39f4a-9c80-480f-b828-5846ae0f274e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Returning 404 to user: Instance f701eed8-faed-494f-987c-cbdd93ed5504 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:12.895013 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a4e39f4a-9c80-480f-b828-5846ae0f274e tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504" status: 404 len: 111 microversion: 2.1 time: 0.106456 Oct 18 13:42:12.896379 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2582/5387] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:12 2022] GET /compute/v2.1/servers/f701eed8-faed-494f-987c-cbdd93ed5504 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:12.907169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-36a64b84-2e46-48bb-92da-feeb7908748f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:12.907674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-36a64b84-2e46-48bb-92da-feeb7908748f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:12.918761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36a64b84-2e46-48bb-92da-feeb7908748f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:12.919188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36a64b84-2e46-48bb-92da-feeb7908748f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:12.922750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36a64b84-2e46-48bb-92da-feeb7908748f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:12.923567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36a64b84-2e46-48bb-92da-feeb7908748f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:12.926765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36a64b84-2e46-48bb-92da-feeb7908748f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:12.927193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-36a64b84-2e46-48bb-92da-feeb7908748f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:13.009155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-36a64b84-2e46-48bb-92da-feeb7908748f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:42:13.310839 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-36a64b84-2e46-48bb-92da-feeb7908748f tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "DELETE /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 204 len: 0 microversion: 2.1 time: 0.407746 Oct 18 13:42:13.312530 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2806/5388] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:12 2022] DELETE /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:42:13.321630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-39773d0a-06d0-4617-8756-317cb85f7c33 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:13.322395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-39773d0a-06d0-4617-8756-317cb85f7c33 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:13.340400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39773d0a-06d0-4617-8756-317cb85f7c33 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:13.341261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39773d0a-06d0-4617-8756-317cb85f7c33 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:13.343782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39773d0a-06d0-4617-8756-317cb85f7c33 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:13.348798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39773d0a-06d0-4617-8756-317cb85f7c33 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:13.356318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39773d0a-06d0-4617-8756-317cb85f7c33 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:13.369730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39773d0a-06d0-4617-8756-317cb85f7c33 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:13.854683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e7d4dbcc-8972-42c0-8b72-f5be48ba1446 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:13.855630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e7d4dbcc-8972-42c0-8b72-f5be48ba1446 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:13.867027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e7d4dbcc-8972-42c0-8b72-f5be48ba1446 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:13.867525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e7d4dbcc-8972-42c0-8b72-f5be48ba1446 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:13.867963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e7d4dbcc-8972-42c0-8b72-f5be48ba1446 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:13.868674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e7d4dbcc-8972-42c0-8b72-f5be48ba1446 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:13.869130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e7d4dbcc-8972-42c0-8b72-f5be48ba1446 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:13.878601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e7d4dbcc-8972-42c0-8b72-f5be48ba1446 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:14.113730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-39773d0a-06d0-4617-8756-317cb85f7c33 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:14.124641 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-39773d0a-06d0-4617-8756-317cb85f7c33 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1520 microversion: 2.1 time: 0.807299 Oct 18 13:42:14.129612 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2583/5389] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:13 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1520 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:14.135193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-fd2bbb65-4ffa-487b-97de-0533528d743b req-efe7b8ef-d669-47c1-b837-b4cf625bd0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "768feeae-e6f3-4013-a7a9-e69e0bd15a58", "name": "network-vif-deleted", "tag": "b3076d90-5db4-402d-9177-41b1a6988b3b"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:14.162254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fd2bbb65-4ffa-487b-97de-0533528d743b req-efe7b8ef-d669-47c1-b837-b4cf625bd0fa service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:14.167302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fd2bbb65-4ffa-487b-97de-0533528d743b req-efe7b8ef-d669-47c1-b837-b4cf625bd0fa service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:14.168100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fd2bbb65-4ffa-487b-97de-0533528d743b req-efe7b8ef-d669-47c1-b837-b4cf625bd0fa service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:14.197518 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-fd2bbb65-4ffa-487b-97de-0533528d743b req-efe7b8ef-d669-47c1-b837-b4cf625bd0fa service nova] Creating event network-vif-deleted:b3076d90-5db4-402d-9177-41b1a6988b3b for instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 on n-h2-858384-13 Oct 18 13:42:14.212849 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-fd2bbb65-4ffa-487b-97de-0533528d743b req-efe7b8ef-d669-47c1-b837-b4cf625bd0fa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081515 Oct 18 13:42:14.213911 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2584/5390] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:14.239995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e7d4dbcc-8972-42c0-8b72-f5be48ba1446 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9fe702e4894e279c3441e0d6d1111f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52938a8883c4cb99fa736ebf0e5f7e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:14.274988 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e7d4dbcc-8972-42c0-8b72-f5be48ba1446 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 200 len: 1663 microversion: 2.1 time: 0.424796 Oct 18 13:42:14.275817 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2807/5391] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:13 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 1663 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:15.153973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5247c982-4ad5-4bf2-944e-4a1740a882e2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:15.154860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5247c982-4ad5-4bf2-944e-4a1740a882e2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:15.164369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5247c982-4ad5-4bf2-944e-4a1740a882e2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:15.173633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5247c982-4ad5-4bf2-944e-4a1740a882e2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:15.174537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5247c982-4ad5-4bf2-944e-4a1740a882e2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:15.176091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5247c982-4ad5-4bf2-944e-4a1740a882e2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:15.177753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5247c982-4ad5-4bf2-944e-4a1740a882e2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:15.181789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5247c982-4ad5-4bf2-944e-4a1740a882e2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:15.307856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5f65d6f9-d7c4-43e6-a2eb-4ed4f868083c tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:15.308483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5f65d6f9-d7c4-43e6-a2eb-4ed4f868083c tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:15.323472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f65d6f9-d7c4-43e6-a2eb-4ed4f868083c tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:15.323962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f65d6f9-d7c4-43e6-a2eb-4ed4f868083c tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:15.324396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f65d6f9-d7c4-43e6-a2eb-4ed4f868083c tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:15.325098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f65d6f9-d7c4-43e6-a2eb-4ed4f868083c tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:15.342561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f65d6f9-d7c4-43e6-a2eb-4ed4f868083c tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:15.343330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f65d6f9-d7c4-43e6-a2eb-4ed4f868083c tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:15.374661 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-5f65d6f9-d7c4-43e6-a2eb-4ed4f868083c tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] HTTP exception thrown: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5f65d6f9-d7c4-43e6-a2eb-4ed4f868083c tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Request method failure captured: Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 HTTP/1.1 Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqvfSeVY0phvpAZyanrkfUC63bKml7NTHEWjtlzYXd8Wb12jIeVQrAv9iOXZixrLHu4B6bGZgK4YqqbKRpTe0ZIqNPj9FP7klpMDDEPazAYpAjMTVnb6qJjHJ-iE2w8zVwDlhMshV78NRyBob0I_3rfJkQjZDRsJyDSLXczjpcvRR7A Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: e52938a8883c4cb99fa736ebf0e5f7e9 Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestServerBasicOps-81092900 Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52938a8883c4cb99fa736ebf0e5f7e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e52938a8883c4cb99fa736ebf0e5f7e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52938a8883c4cb99fa736ebf0e5f7e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e52938a8883c4cb99fa736ebf0e5f7e9"}]}] Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestServerBasicOps-81092900 Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: e52938a8883c4cb99fa736ebf0e5f7e9 Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestServerBasicOps-81092900 Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestServerBasicOps-81092900-project Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: df9fe702e4894e279c3441e0d6d1111f Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestServerBasicOps-81092900-project Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '768feeae-e6f3-4013-a7a9-e69e0bd15a58'} Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:15.381384 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:15.387141 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:15.387141 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:15.387141 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:15.387141 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:15.387141 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:15.387141 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:15.387141 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:15.389313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5f65d6f9-d7c4-43e6-a2eb-4ed4f868083c tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Returning 404 to user: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:15.390451 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5f65d6f9-d7c4-43e6-a2eb-4ed4f868083c tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 404 len: 111 microversion: 2.1 time: 0.087561 Oct 18 13:42:15.393039 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2808/5392] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:15 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:42:16.176328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5247c982-4ad5-4bf2-944e-4a1740a882e2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:16.185373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:16.193357 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5247c982-4ad5-4bf2-944e-4a1740a882e2 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1520 microversion: 2.1 time: 1.043824 Oct 18 13:42:16.212002 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2585/5393] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:15 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1520 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:17.223960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4b2e3b4d-2b9a-417f-99a6-dd554a0aa775 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:17.223960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4b2e3b4d-2b9a-417f-99a6-dd554a0aa775 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:17.246511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b2e3b4d-2b9a-417f-99a6-dd554a0aa775 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:17.259288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b2e3b4d-2b9a-417f-99a6-dd554a0aa775 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:17.259815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b2e3b4d-2b9a-417f-99a6-dd554a0aa775 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:17.260523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b2e3b4d-2b9a-417f-99a6-dd554a0aa775 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:17.260989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b2e3b4d-2b9a-417f-99a6-dd554a0aa775 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:17.261452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b2e3b4d-2b9a-417f-99a6-dd554a0aa775 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:17.360462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-301b0d6f-7f54-4bbf-b35e-8b9ae61cb4f2 req-03006148-2397-4666-97a9-e453e42902f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568613ab-c15f-4a59-aa10-8e40b871f918", "name": "network-vif-deleted", "tag": "88d9e0f1-76bd-495a-a2d4-62d8d2828b64"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:17.412444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-301b0d6f-7f54-4bbf-b35e-8b9ae61cb4f2 req-03006148-2397-4666-97a9-e453e42902f4 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:17.412927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-301b0d6f-7f54-4bbf-b35e-8b9ae61cb4f2 req-03006148-2397-4666-97a9-e453e42902f4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:17.421624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-301b0d6f-7f54-4bbf-b35e-8b9ae61cb4f2 req-03006148-2397-4666-97a9-e453e42902f4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:17.465524 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-301b0d6f-7f54-4bbf-b35e-8b9ae61cb4f2 req-03006148-2397-4666-97a9-e453e42902f4 service nova] Creating event network-vif-deleted:88d9e0f1-76bd-495a-a2d4-62d8d2828b64 for instance 568613ab-c15f-4a59-aa10-8e40b871f918 on n-h1-858384-13 Oct 18 13:42:17.480346 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-301b0d6f-7f54-4bbf-b35e-8b9ae61cb4f2 req-03006148-2397-4666-97a9-e453e42902f4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123696 Oct 18 13:42:17.481508 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2586/5394] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:17.491852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4647b501-54c1-4ff0-835f-aa378881d8aa tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:17.492530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4647b501-54c1-4ff0-835f-aa378881d8aa tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:17.523159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4647b501-54c1-4ff0-835f-aa378881d8aa tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:17.524784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4647b501-54c1-4ff0-835f-aa378881d8aa tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:17.525494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4647b501-54c1-4ff0-835f-aa378881d8aa tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:17.526588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4647b501-54c1-4ff0-835f-aa378881d8aa tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:17.530418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4647b501-54c1-4ff0-835f-aa378881d8aa tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:17.533942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4647b501-54c1-4ff0-835f-aa378881d8aa tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:17.561747 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-4647b501-54c1-4ff0-835f-aa378881d8aa tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] HTTP exception thrown: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4647b501-54c1-4ff0-835f-aa378881d8aa tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Request method failure captured: Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 HTTP/1.1 Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvfSeVY0phvpAZyanrkfUC63bKml7NTHEWjtlzYXd8Wb12jIeVQrAv9iOXZixrLHu4B6bGZgK4YqqbKRpTe0ZIqNPj9FP7klpMDDEPazAYpAjMTVnb6qJjHJ-iE2w8zVwDlhMshV78NRyBob0I_3rfJkQjZDRsJyDSLXczjpcvRR7A Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: e52938a8883c4cb99fa736ebf0e5f7e9 Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestServerBasicOps-81092900 Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52938a8883c4cb99fa736ebf0e5f7e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e52938a8883c4cb99fa736ebf0e5f7e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52938a8883c4cb99fa736ebf0e5f7e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e52938a8883c4cb99fa736ebf0e5f7e9"}]}] Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestServerBasicOps-81092900 Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: e52938a8883c4cb99fa736ebf0e5f7e9 Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestServerBasicOps-81092900 Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestServerBasicOps-81092900-project Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: df9fe702e4894e279c3441e0d6d1111f Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestServerBasicOps-81092900-project Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '768feeae-e6f3-4013-a7a9-e69e0bd15a58'} Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:17.568191 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:17.572843 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:17.572843 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:17.572843 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:17.572843 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:17.572843 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:17.572843 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:17.572843 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:17.572843 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:17.572843 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:17.572843 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:17.572843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4647b501-54c1-4ff0-835f-aa378881d8aa tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Returning 404 to user: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:17.574543 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4647b501-54c1-4ff0-835f-aa378881d8aa tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "DELETE /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 404 len: 111 microversion: 2.1 time: 0.091314 Oct 18 13:42:17.583280 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2587/5395] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:17 2022] DELETE /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:17.588883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-09bea2d4-a0e7-44fb-ab61-f991321a4ddf tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:17.589520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-09bea2d4-a0e7-44fb-ab61-f991321a4ddf tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] [instance: 768feeae-e6f3-4013-a7a9-e69e0bd15a58] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:17.611614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09bea2d4-a0e7-44fb-ab61-f991321a4ddf tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:17.612110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09bea2d4-a0e7-44fb-ab61-f991321a4ddf tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:17.612541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09bea2d4-a0e7-44fb-ab61-f991321a4ddf tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:17.613260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09bea2d4-a0e7-44fb-ab61-f991321a4ddf tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:17.613711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09bea2d4-a0e7-44fb-ab61-f991321a4ddf tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:17.614145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09bea2d4-a0e7-44fb-ab61-f991321a4ddf tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:17.642225 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-09bea2d4-a0e7-44fb-ab61-f991321a4ddf tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] HTTP exception thrown: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-09bea2d4-a0e7-44fb-ab61-f991321a4ddf tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Request method failure captured: Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 HTTP/1.1 Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqvfSeVY0phvpAZyanrkfUC63bKml7NTHEWjtlzYXd8Wb12jIeVQrAv9iOXZixrLHu4B6bGZgK4YqqbKRpTe0ZIqNPj9FP7klpMDDEPazAYpAjMTVnb6qJjHJ-iE2w8zVwDlhMshV78NRyBob0I_3rfJkQjZDRsJyDSLXczjpcvRR7A Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: e52938a8883c4cb99fa736ebf0e5f7e9 Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestServerBasicOps-81092900 Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52938a8883c4cb99fa736ebf0e5f7e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e52938a8883c4cb99fa736ebf0e5f7e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e52938a8883c4cb99fa736ebf0e5f7e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e52938a8883c4cb99fa736ebf0e5f7e9"}]}] Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestServerBasicOps-81092900 Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: e52938a8883c4cb99fa736ebf0e5f7e9 Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestServerBasicOps-81092900 Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestServerBasicOps-81092900-project Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: df9fe702e4894e279c3441e0d6d1111f Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestServerBasicOps-81092900-project Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '768feeae-e6f3-4013-a7a9-e69e0bd15a58'} Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:17.643838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:17.650806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:17.650806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:17.650806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:17.650806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:17.650806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:17.650806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. Oct 18 13:42:17.650806 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:42:17.652897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-09bea2d4-a0e7-44fb-ab61-f991321a4ddf tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Returning 404 to user: Instance 768feeae-e6f3-4013-a7a9-e69e0bd15a58 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:17.654019 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-09bea2d4-a0e7-44fb-ab61-f991321a4ddf tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58" status: 404 len: 111 microversion: 2.1 time: 0.069694 Oct 18 13:42:17.654713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b2e3b4d-2b9a-417f-99a6-dd554a0aa775 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113a1418b92488e97bf50aecdd49bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdfce6f9e86407d883e624dd2c50559', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:17.655180 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2588/5396] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:17 2022] GET /compute/v2.1/servers/768feeae-e6f3-4013-a7a9-e69e0bd15a58 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:17.670572 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4b2e3b4d-2b9a-417f-99a6-dd554a0aa775 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 200 len: 1478 microversion: 2.1 time: 0.453608 Oct 18 13:42:17.671873 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2809/5397] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:17 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 1478 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:18.515491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f3a055c8-ae68-4ff8-a1ee-de894ad23ff1 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] Calling method '.version_select at 0x7ff60ea41ca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:18.566962 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f3a055c8-ae68-4ff8-a1ee-de894ad23ff1 tempest-TestServerBasicOps-81092900 tempest-TestServerBasicOps-81092900-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1544812410" status: 202 len: 0 microversion: 2.1 time: 0.057442 Oct 18 13:42:18.567551 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2589/5398] 10.222.0.40 () {58 vars in 1254 bytes} [Tue Oct 18 13:42:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1544812410 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:42:18.698999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7b227a81-03aa-453a-9ca2-2837a2c232a8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:18.699692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7b227a81-03aa-453a-9ca2-2837a2c232a8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] [instance: 568613ab-c15f-4a59-aa10-8e40b871f918] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:18.715122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b227a81-03aa-453a-9ca2-2837a2c232a8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:18.715987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b227a81-03aa-453a-9ca2-2837a2c232a8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:18.717689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b227a81-03aa-453a-9ca2-2837a2c232a8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:18.720844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b227a81-03aa-453a-9ca2-2837a2c232a8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:18.721833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b227a81-03aa-453a-9ca2-2837a2c232a8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:18.722644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b227a81-03aa-453a-9ca2-2837a2c232a8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:18.764609 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-7b227a81-03aa-453a-9ca2-2837a2c232a8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] HTTP exception thrown: Instance 568613ab-c15f-4a59-aa10-8e40b871f918 could not be found. Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7b227a81-03aa-453a-9ca2-2837a2c232a8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Request method failure captured: Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 HTTP/1.1 Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqvrqX_zkCEhVydfvHZBeTI6vdRWUcUOpxttnLcg2aIsaFsLlHnFjovxQI4kcc3Myi8lwAHRAsf2wLTn_JlgKXt7GIy8E5du_6bYylQ1wRbIaq_CdQtpXoiOxia-B1issY5UDMjn_CVSSo9PM6M7QgZo_y7FdWj0xg611rUe51cUCao Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0cdfce6f9e86407d883e624dd2c50559"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0cdfce6f9e86407d883e624dd2c50559"}]}] Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 0cdfce6f9e86407d883e624dd2c50559 Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953287899 Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 4113a1418b92488e97bf50aecdd49bb1 Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953287899-project Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 568613ab-c15f-4a59-aa10-8e40b871f918 could not be found. Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '568613ab-c15f-4a59-aa10-8e40b871f918'} Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 568613ab-c15f-4a59-aa10-8e40b871f918 could not be found. Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 568613ab-c15f-4a59-aa10-8e40b871f918 could not be found. Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:18.768622 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:18.774872 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:18.774872 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:18.774872 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:18.774872 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:18.774872 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:18.774872 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:18.774872 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 568613ab-c15f-4a59-aa10-8e40b871f918 could not be found. Oct 18 13:42:18.774872 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:18.774872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7b227a81-03aa-453a-9ca2-2837a2c232a8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] Returning 404 to user: Instance 568613ab-c15f-4a59-aa10-8e40b871f918 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:18.774872 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7b227a81-03aa-453a-9ca2-2837a2c232a8 tempest-ServerRescueNegativeTestJSON-953287899 tempest-ServerRescueNegativeTestJSON-953287899-project] 10.222.0.40 "GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918" status: 404 len: 111 microversion: 2.1 time: 0.077019 Oct 18 13:42:18.774872 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2810/5399] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:18 2022] GET /compute/v2.1/servers/568613ab-c15f-4a59-aa10-8e40b871f918 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:21.313519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0ea54975-0525-48f0-98c6-beebb3f8d930 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:21.320047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0ea54975-0525-48f0-98c6-beebb3f8d930 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:21.343759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ea54975-0525-48f0-98c6-beebb3f8d930 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:21.347692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ea54975-0525-48f0-98c6-beebb3f8d930 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:21.348896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ea54975-0525-48f0-98c6-beebb3f8d930 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:21.353774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ea54975-0525-48f0-98c6-beebb3f8d930 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:21.354577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ea54975-0525-48f0-98c6-beebb3f8d930 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:21.356354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ea54975-0525-48f0-98c6-beebb3f8d930 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:21.436630 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0ea54975-0525-48f0-98c6-beebb3f8d930 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.126737 Oct 18 13:42:21.439126 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2590/5400] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:42:21 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:21.584024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f4ab4868-c843-432b-8acc-648aad7f0890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:21.585634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f4ab4868-c843-432b-8acc-648aad7f0890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:21.597801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4ab4868-c843-432b-8acc-648aad7f0890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:21.598848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4ab4868-c843-432b-8acc-648aad7f0890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:21.599641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4ab4868-c843-432b-8acc-648aad7f0890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:21.600772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4ab4868-c843-432b-8acc-648aad7f0890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:21.601970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4ab4868-c843-432b-8acc-648aad7f0890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:21.602755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4ab4868-c843-432b-8acc-648aad7f0890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:21.658327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:21.694235 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f4ab4868-c843-432b-8acc-648aad7f0890 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments/218c398f-12f8-4e1d-8227-2ec0a841c25a" status: 200 len: 194 microversion: 2.1 time: 0.114634 Oct 18 13:42:21.699517 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2811/5401] 10.222.0.40 () {58 vars in 1413 bytes} [Tue Oct 18 13:42:21 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments/218c398f-12f8-4e1d-8227-2ec0a841c25a => generated 194 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:21.709655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3af052df-b435-4fe2-ba46-c89b46af1a89 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:21.711192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3af052df-b435-4fe2-ba46-c89b46af1a89 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:21.718439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3af052df-b435-4fe2-ba46-c89b46af1a89 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:21.719817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3af052df-b435-4fe2-ba46-c89b46af1a89 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:21.721228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3af052df-b435-4fe2-ba46-c89b46af1a89 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:21.722406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3af052df-b435-4fe2-ba46-c89b46af1a89 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:21.723439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3af052df-b435-4fe2-ba46-c89b46af1a89 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:21.724140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3af052df-b435-4fe2-ba46-c89b46af1a89 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:21.890208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-3af052df-b435-4fe2-ba46-c89b46af1a89 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lazy-loading 'services' on Instance uuid d012ca89-c83f-482f-9747-a63468ecdca4 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:42:22.057294 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3af052df-b435-4fe2-ba46-c89b46af1a89 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments/218c398f-12f8-4e1d-8227-2ec0a841c25a" status: 202 len: 0 microversion: 2.1 time: 0.351096 Oct 18 13:42:22.060089 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2591/5402] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:42:21 2022] DELETE /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments/218c398f-12f8-4e1d-8227-2ec0a841c25a => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:42:32.489478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-181235ae-7e38-4927-bf3e-53bd8c63af5c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:32.490001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-181235ae-7e38-4927-bf3e-53bd8c63af5c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:32.493387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:32.537530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-181235ae-7e38-4927-bf3e-53bd8c63af5c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:32.538044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-181235ae-7e38-4927-bf3e-53bd8c63af5c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:32.538494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-181235ae-7e38-4927-bf3e-53bd8c63af5c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:32.545505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-181235ae-7e38-4927-bf3e-53bd8c63af5c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:32.546190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-181235ae-7e38-4927-bf3e-53bd8c63af5c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:32.550855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-181235ae-7e38-4927-bf3e-53bd8c63af5c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:32.628789 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-181235ae-7e38-4927-bf3e-53bd8c63af5c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments/dab0e946-9aa6-4015-be0e-8634c3e8c3f4" status: 200 len: 194 microversion: 2.1 time: 0.143735 Oct 18 13:42:32.630855 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2812/5403] 10.222.0.40 () {58 vars in 1413 bytes} [Tue Oct 18 13:42:32 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments/dab0e946-9aa6-4015-be0e-8634c3e8c3f4 => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:32.640292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:32.641874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:32.646722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-23c34c95-b38d-42cc-8ea1-4899289bf260 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:32.647324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-23c34c95-b38d-42cc-8ea1-4899289bf260 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:32.675120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23c34c95-b38d-42cc-8ea1-4899289bf260 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:32.675659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23c34c95-b38d-42cc-8ea1-4899289bf260 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:32.676078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23c34c95-b38d-42cc-8ea1-4899289bf260 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:32.676803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23c34c95-b38d-42cc-8ea1-4899289bf260 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:32.677285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23c34c95-b38d-42cc-8ea1-4899289bf260 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:32.677719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23c34c95-b38d-42cc-8ea1-4899289bf260 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:32.842212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-23c34c95-b38d-42cc-8ea1-4899289bf260 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lazy-loading 'services' on Instance uuid d012ca89-c83f-482f-9747-a63468ecdca4 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:42:33.000354 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-23c34c95-b38d-42cc-8ea1-4899289bf260 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments/dab0e946-9aa6-4015-be0e-8634c3e8c3f4" status: 202 len: 0 microversion: 2.1 time: 0.362509 Oct 18 13:42:33.008242 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2592/5404] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:42:32 2022] DELETE /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments/dab0e946-9aa6-4015-be0e-8634c3e8c3f4 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:42:37.635155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5dc7f841-4b85-48e3-9eff-87da262f5809 tempest-ComputeTenantNetworksTest-206430185 tempest-ComputeTenantNetworksTest-206430185-project] Calling method '.version_select at 0x7ff60e627c10>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:38.030549 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5dc7f841-4b85-48e3-9eff-87da262f5809 tempest-ComputeTenantNetworksTest-206430185 tempest-ComputeTenantNetworksTest-206430185-project] 10.222.0.40 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.718110 Oct 18 13:42:38.031638 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2813/5405] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 13:42:37 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:38.043041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5df8edee-ab9a-47bf-bb43-4193cd8242f4 tempest-ComputeTenantNetworksTest-206430185 tempest-ComputeTenantNetworksTest-206430185-project] Calling method '.version_select at 0x7ff60efaa790>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:38.275143 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5df8edee-ab9a-47bf-bb43-4193cd8242f4 tempest-ComputeTenantNetworksTest-206430185 tempest-ComputeTenantNetworksTest-206430185-project] 10.222.0.40 "GET /compute/v2.1/os-tenant-networks/22358a3e-4b56-4cf3-afb0-fc2d5e8ebc08" status: 200 len: 140 microversion: 2.1 time: 0.236469 Oct 18 13:42:38.276915 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2593/5406] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 13:42:38 2022] GET /compute/v2.1/os-tenant-networks/22358a3e-4b56-4cf3-afb0-fc2d5e8ebc08 => generated 140 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:43.041948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:43.043086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=10 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:43.877068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-630948035", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "3ededbe5-2f90-4a85-9244-a210480a02b7"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:43.976226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] validate_networks() for [('3ededbe5-2f90-4a85-9244-a210480a02b7', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:42:45.865582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:45.867098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:45.873392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-779f0606-7e6e-4b45-a230-b77dbda311f0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:45.887413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-779f0606-7e6e-4b45-a230-b77dbda311f0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:45.911712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-779f0606-7e6e-4b45-a230-b77dbda311f0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:45.912528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-779f0606-7e6e-4b45-a230-b77dbda311f0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:45.913928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-779f0606-7e6e-4b45-a230-b77dbda311f0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:45.917015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-779f0606-7e6e-4b45-a230-b77dbda311f0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:45.917921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-779f0606-7e6e-4b45-a230-b77dbda311f0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:45.919393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-779f0606-7e6e-4b45-a230-b77dbda311f0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:46.001949 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-779f0606-7e6e-4b45-a230-b77dbda311f0 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.138631 Oct 18 13:42:46.003173 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2594/5407] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:42:45 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:42:46.248569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a7397355-3eed-4c73-af7b-a873efa1fcdf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:46.251269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a7397355-3eed-4c73-af7b-a873efa1fcdf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:46.268952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7397355-3eed-4c73-af7b-a873efa1fcdf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:46.269883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7397355-3eed-4c73-af7b-a873efa1fcdf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:46.270785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7397355-3eed-4c73-af7b-a873efa1fcdf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:46.271727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7397355-3eed-4c73-af7b-a873efa1fcdf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:46.272399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7397355-3eed-4c73-af7b-a873efa1fcdf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:46.273041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7397355-3eed-4c73-af7b-a873efa1fcdf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:46.349592 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a7397355-3eed-4c73-af7b-a873efa1fcdf tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104834 Oct 18 13:42:46.354531 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2595/5408] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:42:46 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 18 13:42:46.530918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-63bd5601-651a-4e8e-8e42-7421237427a6 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:46.532154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-63bd5601-651a-4e8e-8e42-7421237427a6 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:46.548705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63bd5601-651a-4e8e-8e42-7421237427a6 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:46.553614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63bd5601-651a-4e8e-8e42-7421237427a6 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:46.555080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63bd5601-651a-4e8e-8e42-7421237427a6 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:46.559168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63bd5601-651a-4e8e-8e42-7421237427a6 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:46.564060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63bd5601-651a-4e8e-8e42-7421237427a6 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:46.567631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63bd5601-651a-4e8e-8e42-7421237427a6 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:46.677478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-63bd5601-651a-4e8e-8e42-7421237427a6 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:42:46.894589 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-63bd5601-651a-4e8e-8e42-7421237427a6 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 204 len: 0 microversion: 2.1 time: 0.375675 Oct 18 13:42:46.896201 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2596/5409] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:42:46 2022] DELETE /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:42:46.911287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ddffb8b0-b8f9-4bbe-b441-8c33ab19189c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:46.914423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:42:46.914861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:42:46.915320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:42:46.915916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:42:46.916658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:42:46.917044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ddffb8b0-b8f9-4bbe-b441-8c33ab19189c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:46.943208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddffb8b0-b8f9-4bbe-b441-8c33ab19189c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:46.944015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:46.945398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:46.947326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:46.948213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:46.950720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:46.952176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddffb8b0-b8f9-4bbe-b441-8c33ab19189c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:46.952715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:46.953864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddffb8b0-b8f9-4bbe-b441-8c33ab19189c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:46.962301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddffb8b0-b8f9-4bbe-b441-8c33ab19189c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:46.962907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddffb8b0-b8f9-4bbe-b441-8c33ab19189c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:46.963428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddffb8b0-b8f9-4bbe-b441-8c33ab19189c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:47.053815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Getting quotas for project 79ff3cc659af487d9387ac2e03328b30. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:42:47.064676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Getting quotas for user 46ad8ddc30274c16bb211a68b6050ef7 and project 79ff3cc659af487d9387ac2e03328b30. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:42:47.088646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Going to run 3 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:42:47.092939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: 227cb6da-2e03-4184-b08b-e56a7501d244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:42:47.155499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: be3232df-b49d-4443-9fea-d9a5ec5c5424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=227cb6da-2e03-4184-b08b-e56a7501d244,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:42:47.206879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=be3232df-b49d-4443-9fea-d9a5ec5c5424,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:42:47.317318 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ce6db8ba-22c0-4396-a78c-72c9d2c02451 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.277333 Oct 18 13:42:47.318607 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2814/5410] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:42:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:42:47.332387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a751f361-804c-47de-bf40-0ccad7a87d98 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] Calling method '.version_select at 0x7ff60e4de430>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:47.472092 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a751f361-804c-47de-bf40-0ccad7a87d98 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ff8a299d-b129-4e38-b19f-7449844f6a21" status: 200 len: 351 microversion: 2.1 time: 0.151956 Oct 18 13:42:47.472818 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2815/5411] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:47 2022] GET /compute/v2.1/os-volumes/ff8a299d-b129-4e38-b19f-7449844f6a21 => generated 351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:47.495338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-17c7aa11-c27d-4ced-90b1-9d47fc8afc76 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:47.504673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-17c7aa11-c27d-4ced-90b1-9d47fc8afc76 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:47.509323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-17c7aa11-c27d-4ced-90b1-9d47fc8afc76 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Searching by: {'deleted': False, 'project_id': '79ff3cc659af487d9387ac2e03328b30'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:42:47.572652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17c7aa11-c27d-4ced-90b1-9d47fc8afc76 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:47.573965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17c7aa11-c27d-4ced-90b1-9d47fc8afc76 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:47.574412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17c7aa11-c27d-4ced-90b1-9d47fc8afc76 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:47.575991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17c7aa11-c27d-4ced-90b1-9d47fc8afc76 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:47.576563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17c7aa11-c27d-4ced-90b1-9d47fc8afc76 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:47.576993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17c7aa11-c27d-4ced-90b1-9d47fc8afc76 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:47.636156 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-17c7aa11-c27d-4ced-90b1-9d47fc8afc76 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.146204 Oct 18 13:42:47.636415 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2816/5412] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 13:42:47 2022] GET /compute/v2.1/servers => generated 1015 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:47.649355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2895ba93-a031-4b46-b074-fea7cda6d538 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:47.649973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2895ba93-a031-4b46-b074-fea7cda6d538 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:47.913388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2895ba93-a031-4b46-b074-fea7cda6d538 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:47.922393 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2895ba93-a031-4b46-b074-fea7cda6d538 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1222 microversion: 2.1 time: 0.277356 Oct 18 13:42:47.928720 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2817/5413] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:47 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1222 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:48.661608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ddffb8b0-b8f9-4bbe-b441-8c33ab19189c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:48.678417 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ddffb8b0-b8f9-4bbe-b441-8c33ab19189c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 200 len: 1674 microversion: 2.1 time: 1.777506 Oct 18 13:42:48.690839 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2597/5414] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:46 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 1674 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:48.952803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0da80d02-b846-45f1-83cd-abce095592ce tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:48.958441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0da80d02-b846-45f1-83cd-abce095592ce tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:49.359110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0da80d02-b846-45f1-83cd-abce095592ce tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:49.374369 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0da80d02-b846-45f1-83cd-abce095592ce tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1222 microversion: 2.1 time: 0.421057 Oct 18 13:42:49.375977 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2818/5415] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:48 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1222 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:49.716856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a1df1dc4-34c8-4664-a52c-9ade8de2e0e1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:49.717548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a1df1dc4-34c8-4664-a52c-9ade8de2e0e1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:49.734278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1df1dc4-34c8-4664-a52c-9ade8de2e0e1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:49.734870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1df1dc4-34c8-4664-a52c-9ade8de2e0e1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:49.735535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1df1dc4-34c8-4664-a52c-9ade8de2e0e1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:49.739576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1df1dc4-34c8-4664-a52c-9ade8de2e0e1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:49.740348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1df1dc4-34c8-4664-a52c-9ade8de2e0e1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:49.741153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1df1dc4-34c8-4664-a52c-9ade8de2e0e1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:50.360320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a1df1dc4-34c8-4664-a52c-9ade8de2e0e1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:50.378726 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a1df1dc4-34c8-4664-a52c-9ade8de2e0e1 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 200 len: 1674 microversion: 2.1 time: 0.666403 Oct 18 13:42:50.392433 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2598/5416] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:49 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 1674 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:50.407640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a4ccad38-fe18-46a9-b0dd-bce38de0d127 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:50.410226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a4ccad38-fe18-46a9-b0dd-bce38de0d127 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:50.452554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4ccad38-fe18-46a9-b0dd-bce38de0d127 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:50.463679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4ccad38-fe18-46a9-b0dd-bce38de0d127 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:50.467240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4ccad38-fe18-46a9-b0dd-bce38de0d127 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:50.469598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4ccad38-fe18-46a9-b0dd-bce38de0d127 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:50.473834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4ccad38-fe18-46a9-b0dd-bce38de0d127 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:50.478223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4ccad38-fe18-46a9-b0dd-bce38de0d127 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:50.560790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c8747b8e-a27f-44dd-ac1c-138b50c9cf8a tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] Calling method '.version_select at 0x7ff60ecc1f70>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:50.764714 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c8747b8e-a27f-44dd-ac1c-138b50c9cf8a tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6d0acd3c-448a-404c-9d06-a588c87f8a4f" status: 200 len: 351 microversion: 2.1 time: 0.207787 Oct 18 13:42:50.766264 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2599/5417] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:50 2022] GET /compute/v2.1/os-volumes/6d0acd3c-448a-404c-9d06-a588c87f8a4f => generated 351 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:50.953108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a4ccad38-fe18-46a9-b0dd-bce38de0d127 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:50.982799 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a4ccad38-fe18-46a9-b0dd-bce38de0d127 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1218 microversion: 2.1 time: 0.586514 Oct 18 13:42:51.012024 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2819/5418] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:50 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1218 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:51.406230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f5851e8f-63d8-4e4d-bcf6-7d54aed04bfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:51.406630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f5851e8f-63d8-4e4d-bcf6-7d54aed04bfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:51.427537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5851e8f-63d8-4e4d-bcf6-7d54aed04bfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:51.428194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5851e8f-63d8-4e4d-bcf6-7d54aed04bfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:51.429061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5851e8f-63d8-4e4d-bcf6-7d54aed04bfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:51.429882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5851e8f-63d8-4e4d-bcf6-7d54aed04bfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:51.431687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5851e8f-63d8-4e4d-bcf6-7d54aed04bfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:51.432247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5851e8f-63d8-4e4d-bcf6-7d54aed04bfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:51.957845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-706d9cda-9322-4248-8dba-a89ec7fd6bb2 req-371cabaf-b032-407e-b322-c66a67d9dd4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d012ca89-c83f-482f-9747-a63468ecdca4", "name": "network-vif-deleted", "tag": "9317fed9-1961-4956-ad6d-9135f8e8b1d1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:51.959996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f5851e8f-63d8-4e4d-bcf6-7d54aed04bfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad869b0447848d7bf332017402442c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724386b2d066473fae0dbc9cd16c5802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:51.979496 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f5851e8f-63d8-4e4d-bcf6-7d54aed04bfc tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 200 len: 1606 microversion: 2.1 time: 0.578816 Oct 18 13:42:51.993234 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2600/5419] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:51 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 1606 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:51.993498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-706d9cda-9322-4248-8dba-a89ec7fd6bb2 req-371cabaf-b032-407e-b322-c66a67d9dd4f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:51.993498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-706d9cda-9322-4248-8dba-a89ec7fd6bb2 req-371cabaf-b032-407e-b322-c66a67d9dd4f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:51.993498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-706d9cda-9322-4248-8dba-a89ec7fd6bb2 req-371cabaf-b032-407e-b322-c66a67d9dd4f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:52.024838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4c65c9dd-ca6b-4492-8dc9-9b8367de29e0 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:52.025952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4c65c9dd-ca6b-4492-8dc9-9b8367de29e0 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:52.042472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c65c9dd-ca6b-4492-8dc9-9b8367de29e0 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:52.051748 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-706d9cda-9322-4248-8dba-a89ec7fd6bb2 req-371cabaf-b032-407e-b322-c66a67d9dd4f service nova] Creating event network-vif-deleted:9317fed9-1961-4956-ad6d-9135f8e8b1d1 for instance d012ca89-c83f-482f-9747-a63468ecdca4 on n-h2-858384-13 Oct 18 13:42:52.054887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c65c9dd-ca6b-4492-8dc9-9b8367de29e0 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:52.055645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c65c9dd-ca6b-4492-8dc9-9b8367de29e0 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:52.057530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c65c9dd-ca6b-4492-8dc9-9b8367de29e0 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:52.058836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c65c9dd-ca6b-4492-8dc9-9b8367de29e0 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:52.062398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c65c9dd-ca6b-4492-8dc9-9b8367de29e0 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:52.074183 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-706d9cda-9322-4248-8dba-a89ec7fd6bb2 req-371cabaf-b032-407e-b322-c66a67d9dd4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126930 Oct 18 13:42:52.078984 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2820/5420] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:52.245575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4c65c9dd-ca6b-4492-8dc9-9b8367de29e0 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:52.260891 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4c65c9dd-ca6b-4492-8dc9-9b8367de29e0 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1280 microversion: 2.1 time: 0.239831 Oct 18 13:42:52.264545 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2601/5421] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:52 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:53.015786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f04050c-312f-49d9-933d-16abf7637572 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:53.016631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9f04050c-312f-49d9-933d-16abf7637572 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:53.036543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f04050c-312f-49d9-933d-16abf7637572 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:53.040107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f04050c-312f-49d9-933d-16abf7637572 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:53.040838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f04050c-312f-49d9-933d-16abf7637572 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:53.048825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f04050c-312f-49d9-933d-16abf7637572 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:53.049689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f04050c-312f-49d9-933d-16abf7637572 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:53.050603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f04050c-312f-49d9-933d-16abf7637572 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:53.112653 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-9f04050c-312f-49d9-933d-16abf7637572 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] HTTP exception thrown: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f04050c-312f-49d9-933d-16abf7637572 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Request method failure captured: Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 HTTP/1.1 Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqueWuZxmAzQFdjCybRIxmi55p-XkVuduN-YiHDLoMpYHpTNvOGVVTueKbsLLdar59Kecntc8pWZpOSDVOgKSY_mspF9Kr_p58GNPepdfumkoHWJ0uhxeEhZXSWv8gGSSGBvYfgeOrKfigJRAs5zGZQ5oHeBpwxjr_9qVED6f0NcJJg Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 724386b2d066473fae0dbc9cd16c5802 Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_724386b2d066473fae0dbc9cd16c5802"}]}] Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 724386b2d066473fae0dbc9cd16c5802 Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachVolumeTestJSON-1656930574-project Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3ad869b0447848d7bf332017402442c8 Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachVolumeTestJSON-1656930574-project Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'd012ca89-c83f-482f-9747-a63468ecdca4'} Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:42:53.114543 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:53.120370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:42:53.120370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:42:53.120370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:42:53.120370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:42:53.120370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:42:53.120370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:42:53.120370 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:42:53.122483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f04050c-312f-49d9-933d-16abf7637572 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Returning 404 to user: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:42:53.130534 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9f04050c-312f-49d9-933d-16abf7637572 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 404 len: 111 microversion: 2.1 time: 0.116213 Oct 18 13:42:53.135599 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2821/5422] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:53 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:42:53.145435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4fd3f0ee-c17a-4c45-badf-4f07a81fc907 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '.version_select at 0x7ff614056790>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:53.189290 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4fd3f0ee-c17a-4c45-badf-4f07a81fc907 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545170069" status: 202 len: 0 microversion: 2.1 time: 0.052076 Oct 18 13:42:53.190791 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2602/5423] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:42:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545170069 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:42:53.289685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bdf09a6a-1d73-418a-a05d-c6410356f90f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:53.290459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bdf09a6a-1d73-418a-a05d-c6410356f90f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:53.302098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdf09a6a-1d73-418a-a05d-c6410356f90f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:53.302735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdf09a6a-1d73-418a-a05d-c6410356f90f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:53.303264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdf09a6a-1d73-418a-a05d-c6410356f90f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:53.304287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdf09a6a-1d73-418a-a05d-c6410356f90f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:53.305675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdf09a6a-1d73-418a-a05d-c6410356f90f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:53.307210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdf09a6a-1d73-418a-a05d-c6410356f90f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:53.862080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-00aa6d0e-9c03-4783-8015-fde2591efd51 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] Calling method '.version_select at 0x7ff617b1b160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:53.931376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bdf09a6a-1d73-418a-a05d-c6410356f90f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:53.948962 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bdf09a6a-1d73-418a-a05d-c6410356f90f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1322 microversion: 2.1 time: 0.661397 Oct 18 13:42:53.949753 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2822/5424] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:53 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1322 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:54.012552 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-00aa6d0e-9c03-4783-8015-fde2591efd51 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c3466bea-8e52-4e69-8f12-17e674bf1d53" status: 200 len: 351 microversion: 2.1 time: 0.156340 Oct 18 13:42:54.013513 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2603/5425] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:42:53 2022] GET /compute/v2.1/os-volumes/c3466bea-8e52-4e69-8f12-17e674bf1d53 => generated 351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:54.027017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-721d7c5b-7f37-4ad5-833d-1dfbd0a76f7f tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] Calling method '.version_select at 0x7ff60e994af0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:54.321494 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-721d7c5b-7f37-4ad5-833d-1dfbd0a76f7f tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.298638 Oct 18 13:42:54.322237 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2823/5426] 10.222.0.40 () {58 vars in 1134 bytes} [Tue Oct 18 13:42:54 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:54.339695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ef77c80f-aca0-41f6-acf1-e4000901a242 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] Calling method '.version_select at 0x7ff60f6839d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:54.501830 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ef77c80f-aca0-41f6-acf1-e4000901a242 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.166528 Oct 18 13:42:54.503348 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2604/5427] 10.222.0.40 () {58 vars in 1149 bytes} [Tue Oct 18 13:42:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:54.519582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a7a486d0-4496-4268-8ce9-6fa48daf85a0 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] Calling method '.version_select at 0x7ff60e46d4c0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:54.788517 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a7a486d0-4496-4268-8ce9-6fa48daf85a0 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.270411 Oct 18 13:42:54.789212 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2824/5428] 10.222.0.40 () {58 vars in 1134 bytes} [Tue Oct 18 13:42:54 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:54.803873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-88f0ab87-ef10-4f76-8d14-e925345ce7e3 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] Calling method '.version_select at 0x7ff60f6ceca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:54.971719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a6780e71-c1ba-4a41-94a5-f59fb54a135f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:54.972750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a6780e71-c1ba-4a41-94a5-f59fb54a135f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:54.981073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6780e71-c1ba-4a41-94a5-f59fb54a135f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:54.986866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6780e71-c1ba-4a41-94a5-f59fb54a135f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:54.987557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6780e71-c1ba-4a41-94a5-f59fb54a135f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:54.988544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6780e71-c1ba-4a41-94a5-f59fb54a135f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:54.989274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6780e71-c1ba-4a41-94a5-f59fb54a135f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:54.990265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6780e71-c1ba-4a41-94a5-f59fb54a135f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:55.024397 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-88f0ab87-ef10-4f76-8d14-e925345ce7e3 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.224658 Oct 18 13:42:55.034352 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2605/5429] 10.222.0.40 () {58 vars in 1167 bytes} [Tue Oct 18 13:42:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:55.039578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1d4881d7-b798-4372-9d9b-3d26f9d86dcb tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] Calling method '.version_select at 0x7ff617a4eb80>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:55.195720 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1d4881d7-b798-4372-9d9b-3d26f9d86dcb tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.159988 Oct 18 13:42:55.196306 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2606/5430] 10.222.0.40 () {58 vars in 1170 bytes} [Tue Oct 18 13:42:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:55.211856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f853707a-1410-486d-9760-c698c45e6bb3 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] Calling method '.version_select at 0x7ff60f6838b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:55.332235 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f853707a-1410-486d-9760-c698c45e6bb3 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.124503 Oct 18 13:42:55.333595 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2607/5431] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:42:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:55.349242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-babce570-76a2-498f-a014-e502b737f015 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] Calling method '.version_select at 0x7ff60ecc1f70>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:55.486776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a6780e71-c1ba-4a41-94a5-f59fb54a135f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:55.502372 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a6780e71-c1ba-4a41-94a5-f59fb54a135f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1322 microversion: 2.1 time: 0.533762 Oct 18 13:42:55.504143 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2825/5432] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:54 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1322 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:55.546379 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-babce570-76a2-498f-a014-e502b737f015 tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.202185 Oct 18 13:42:55.547469 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2608/5433] 10.222.0.40 () {58 vars in 1188 bytes} [Tue Oct 18 13:42:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:42:55.562335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-09f29ec9-4752-418f-9282-e2c71a9bca0b tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] Calling method '.version_select at 0x7ff60e46df70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:55.799547 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-09f29ec9-4752-418f-9282-e2c71a9bca0b tempest-VolumesTestJSON-343159816 tempest-VolumesTestJSON-343159816-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.242770 Oct 18 13:42:55.801367 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2826/5434] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:42:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:42:56.525469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b473ce3c-1336-4c52-9af5-7bc26dd73e1e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:56.526093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b473ce3c-1336-4c52-9af5-7bc26dd73e1e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:56.536642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b473ce3c-1336-4c52-9af5-7bc26dd73e1e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:56.537165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b473ce3c-1336-4c52-9af5-7bc26dd73e1e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:56.537662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b473ce3c-1336-4c52-9af5-7bc26dd73e1e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:56.538418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b473ce3c-1336-4c52-9af5-7bc26dd73e1e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:56.548663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b473ce3c-1336-4c52-9af5-7bc26dd73e1e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:56.549624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b473ce3c-1336-4c52-9af5-7bc26dd73e1e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:57.859540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:57.960389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b473ce3c-1336-4c52-9af5-7bc26dd73e1e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:57.972177 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b473ce3c-1336-4c52-9af5-7bc26dd73e1e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1322 microversion: 2.1 time: 1.450497 Oct 18 13:42:57.978275 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2609/5435] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:56 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1322 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:58.353991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-2bcff35e-11ca-4ead-8995-17f695ded046 req-770fdf3f-f00e-42e8-880e-76679c5cb3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4", "tag": "d7621e47-01ba-4285-b3b2-076e6bf4f254"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:42:58.370289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2bcff35e-11ca-4ead-8995-17f695ded046 req-770fdf3f-f00e-42e8-880e-76679c5cb3f6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:58.370774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2bcff35e-11ca-4ead-8995-17f695ded046 req-770fdf3f-f00e-42e8-880e-76679c5cb3f6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:58.371208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2bcff35e-11ca-4ead-8995-17f695ded046 req-770fdf3f-f00e-42e8-880e-76679c5cb3f6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:58.409510 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-2bcff35e-11ca-4ead-8995-17f695ded046 req-770fdf3f-f00e-42e8-880e-76679c5cb3f6 service nova] Creating event network-changed:d7621e47-01ba-4285-b3b2-076e6bf4f254 for instance aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 on n-h1-858384-13 Oct 18 13:42:58.421720 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-2bcff35e-11ca-4ead-8995-17f695ded046 req-770fdf3f-f00e-42e8-880e-76679c5cb3f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.563616 Oct 18 13:42:58.422975 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2827/5436] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:42:59.011298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4c09a0fc-ccc7-4607-ada0-21a7c1d2619f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:42:59.014559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4c09a0fc-ccc7-4607-ada0-21a7c1d2619f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:42:59.030368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c09a0fc-ccc7-4607-ada0-21a7c1d2619f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:59.045250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c09a0fc-ccc7-4607-ada0-21a7c1d2619f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:59.046008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c09a0fc-ccc7-4607-ada0-21a7c1d2619f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:59.047134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c09a0fc-ccc7-4607-ada0-21a7c1d2619f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:42:59.047810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c09a0fc-ccc7-4607-ada0-21a7c1d2619f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:42:59.049381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c09a0fc-ccc7-4607-ada0-21a7c1d2619f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:42:59.723836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4c09a0fc-ccc7-4607-ada0-21a7c1d2619f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:42:59.736799 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4c09a0fc-ccc7-4607-ada0-21a7c1d2619f tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1322 microversion: 2.1 time: 0.736426 Oct 18 13:42:59.742456 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2610/5437] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:42:58 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1322 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:42:59.971607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=10 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:42:59.977495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d449d1dd-4e07-4754-a8d5-b823de6604a5 req-aae281ce-5fef-47c0-8088-a68a20f8cc49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be3232df-b49d-4443-9fea-d9a5ec5c5424", "tag": "433ece07-11bf-46bf-a910-6b251c616966"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:00.001965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d449d1dd-4e07-4754-a8d5-b823de6604a5 req-aae281ce-5fef-47c0-8088-a68a20f8cc49 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:00.005839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d449d1dd-4e07-4754-a8d5-b823de6604a5 req-aae281ce-5fef-47c0-8088-a68a20f8cc49 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:00.006540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d449d1dd-4e07-4754-a8d5-b823de6604a5 req-aae281ce-5fef-47c0-8088-a68a20f8cc49 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:00.035123 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d449d1dd-4e07-4754-a8d5-b823de6604a5 req-aae281ce-5fef-47c0-8088-a68a20f8cc49 service nova] Creating event network-changed:433ece07-11bf-46bf-a910-6b251c616966 for instance be3232df-b49d-4443-9fea-d9a5ec5c5424 on n-h2-858384-13 Oct 18 13:43:00.046282 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d449d1dd-4e07-4754-a8d5-b823de6604a5 req-aae281ce-5fef-47c0-8088-a68a20f8cc49 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074805 Oct 18 13:43:00.048729 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2828/5438] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:43:00.771429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-848804c8-086f-4100-9c9a-2ee2ffb75791 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:00.773524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-848804c8-086f-4100-9c9a-2ee2ffb75791 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:00.784716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-848804c8-086f-4100-9c9a-2ee2ffb75791 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:00.788476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-848804c8-086f-4100-9c9a-2ee2ffb75791 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:00.789285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-848804c8-086f-4100-9c9a-2ee2ffb75791 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:00.790248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-848804c8-086f-4100-9c9a-2ee2ffb75791 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:00.794027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-848804c8-086f-4100-9c9a-2ee2ffb75791 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:00.794770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-848804c8-086f-4100-9c9a-2ee2ffb75791 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:02.158575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-58944fc0-d172-420c-8336-22f20b6e6bcc req-4816796a-0787-49df-90a7-b47aa2d3f14d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "227cb6da-2e03-4184-b08b-e56a7501d244", "tag": "c0b3cc30-0e66-4fee-bcf1-4740d0202d85"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:02.178181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-58944fc0-d172-420c-8336-22f20b6e6bcc req-4816796a-0787-49df-90a7-b47aa2d3f14d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:02.193440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-58944fc0-d172-420c-8336-22f20b6e6bcc req-4816796a-0787-49df-90a7-b47aa2d3f14d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:02.194213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-58944fc0-d172-420c-8336-22f20b6e6bcc req-4816796a-0787-49df-90a7-b47aa2d3f14d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:02.224648 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-58944fc0-d172-420c-8336-22f20b6e6bcc req-4816796a-0787-49df-90a7-b47aa2d3f14d service nova] Creating event network-changed:c0b3cc30-0e66-4fee-bcf1-4740d0202d85 for instance 227cb6da-2e03-4184-b08b-e56a7501d244 on n-h1-858384-13 Oct 18 13:43:02.241148 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-58944fc0-d172-420c-8336-22f20b6e6bcc req-4816796a-0787-49df-90a7-b47aa2d3f14d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083656 Oct 18 13:43:02.242613 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2829/5439] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:43:02.882701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-848804c8-086f-4100-9c9a-2ee2ffb75791 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:02.892237 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-848804c8-086f-4100-9c9a-2ee2ffb75791 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1322 microversion: 2.1 time: 2.125003 Oct 18 13:43:02.925795 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2611/5440] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:00 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1322 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:03.974748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ff71cde3-bc1b-4933-a1ad-59c448ef4e38 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:03.975495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ff71cde3-bc1b-4933-a1ad-59c448ef4e38 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:04.032283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff71cde3-bc1b-4933-a1ad-59c448ef4e38 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:04.032825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff71cde3-bc1b-4933-a1ad-59c448ef4e38 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:04.047788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff71cde3-bc1b-4933-a1ad-59c448ef4e38 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:04.053967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff71cde3-bc1b-4933-a1ad-59c448ef4e38 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:04.054461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff71cde3-bc1b-4933-a1ad-59c448ef4e38 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:04.054904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff71cde3-bc1b-4933-a1ad-59c448ef4e38 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:05.268647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ff71cde3-bc1b-4933-a1ad-59c448ef4e38 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:05.278099 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ff71cde3-bc1b-4933-a1ad-59c448ef4e38 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1322 microversion: 2.1 time: 1.323164 Oct 18 13:43:05.310360 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2830/5441] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:03 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1322 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:06.322010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-004a8501-c8e7-4cc3-a937-b8360f56a6cb tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:06.324803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-004a8501-c8e7-4cc3-a937-b8360f56a6cb tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:06.338709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-004a8501-c8e7-4cc3-a937-b8360f56a6cb tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:06.350084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-004a8501-c8e7-4cc3-a937-b8360f56a6cb tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:06.352368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-004a8501-c8e7-4cc3-a937-b8360f56a6cb tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:06.353453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-004a8501-c8e7-4cc3-a937-b8360f56a6cb tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:06.356200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-004a8501-c8e7-4cc3-a937-b8360f56a6cb tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:06.357691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-004a8501-c8e7-4cc3-a937-b8360f56a6cb tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:06.974143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-004a8501-c8e7-4cc3-a937-b8360f56a6cb tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:06.983413 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-004a8501-c8e7-4cc3-a937-b8360f56a6cb tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1322 microversion: 2.1 time: 0.665636 Oct 18 13:43:06.989560 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2612/5442] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:06 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1322 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:08.020852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0c561a28-cf7b-412e-9eb4-2df8feda2ee3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:08.022096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0c561a28-cf7b-412e-9eb4-2df8feda2ee3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:08.047232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c561a28-cf7b-412e-9eb4-2df8feda2ee3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:08.050233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c561a28-cf7b-412e-9eb4-2df8feda2ee3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:08.050693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c561a28-cf7b-412e-9eb4-2df8feda2ee3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:08.051441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c561a28-cf7b-412e-9eb4-2df8feda2ee3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:08.051901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c561a28-cf7b-412e-9eb4-2df8feda2ee3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:08.052327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c561a28-cf7b-412e-9eb4-2df8feda2ee3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:08.827911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0c561a28-cf7b-412e-9eb4-2df8feda2ee3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:08.843402 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0c561a28-cf7b-412e-9eb4-2df8feda2ee3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1322 microversion: 2.1 time: 0.828087 Oct 18 13:43:08.846960 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2831/5443] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:08 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1322 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:09.873484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-394c8d1a-1beb-47f4-8184-b0fbd8bfe5a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:09.874088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-394c8d1a-1beb-47f4-8184-b0fbd8bfe5a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:09.890951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-394c8d1a-1beb-47f4-8184-b0fbd8bfe5a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:09.891970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-394c8d1a-1beb-47f4-8184-b0fbd8bfe5a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:09.891970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-394c8d1a-1beb-47f4-8184-b0fbd8bfe5a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:09.899340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-394c8d1a-1beb-47f4-8184-b0fbd8bfe5a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:09.899844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-394c8d1a-1beb-47f4-8184-b0fbd8bfe5a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:09.900296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-394c8d1a-1beb-47f4-8184-b0fbd8bfe5a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:10.290329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3fb5f2dc-512a-47ab-a4da-749f0611904f req-984aa9d9-7200-43ae-9fe4-7accd6be7728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4", "name": "network-vif-plugged", "status": "completed", "tag": "d7621e47-01ba-4285-b3b2-076e6bf4f254"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:10.311674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3fb5f2dc-512a-47ab-a4da-749f0611904f req-984aa9d9-7200-43ae-9fe4-7accd6be7728 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:10.320782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3fb5f2dc-512a-47ab-a4da-749f0611904f req-984aa9d9-7200-43ae-9fe4-7accd6be7728 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:10.324243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-394c8d1a-1beb-47f4-8184-b0fbd8bfe5a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:10.333762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3fb5f2dc-512a-47ab-a4da-749f0611904f req-984aa9d9-7200-43ae-9fe4-7accd6be7728 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:10.340865 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-394c8d1a-1beb-47f4-8184-b0fbd8bfe5a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1322 microversion: 2.1 time: 0.466012 Oct 18 13:43:10.342371 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2613/5444] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:09 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1322 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:10.359498 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3fb5f2dc-512a-47ab-a4da-749f0611904f req-984aa9d9-7200-43ae-9fe4-7accd6be7728 service nova] Creating event network-vif-plugged:d7621e47-01ba-4285-b3b2-076e6bf4f254 for instance aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 on n-h1-858384-13 Oct 18 13:43:10.370482 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3fb5f2dc-512a-47ab-a4da-749f0611904f req-984aa9d9-7200-43ae-9fe4-7accd6be7728 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206252 Oct 18 13:43:10.376745 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2832/5445] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:43:10.475809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d860b352-d56d-45ae-b5f2-ba3a105e1159 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:10.476626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d860b352-d56d-45ae-b5f2-ba3a105e1159 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:10.487467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d860b352-d56d-45ae-b5f2-ba3a105e1159 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:10.489880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d860b352-d56d-45ae-b5f2-ba3a105e1159 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:10.490566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d860b352-d56d-45ae-b5f2-ba3a105e1159 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:10.492877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d860b352-d56d-45ae-b5f2-ba3a105e1159 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:10.494760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d860b352-d56d-45ae-b5f2-ba3a105e1159 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:10.496491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d860b352-d56d-45ae-b5f2-ba3a105e1159 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:10.550080 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-d860b352-d56d-45ae-b5f2-ba3a105e1159 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] HTTP exception thrown: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d860b352-d56d-45ae-b5f2-ba3a105e1159 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Request method failure captured: Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 HTTP/1.1 Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqueWuZxmAzQFdjCybRIxmi55p-XkVuduN-YiHDLoMpYHpTNvOGVVTueKbsLLdar59Kecntc8pWZpOSDVOgKSY_mspF9Kr_p58GNPepdfumkoHWJ0uhxeEhZXSWv8gGSSGBvYfgeOrKfigJRAs5zGZQ5oHeBpwxjr_9qVED6f0NcJJg Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 724386b2d066473fae0dbc9cd16c5802 Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_724386b2d066473fae0dbc9cd16c5802"}]}] Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 724386b2d066473fae0dbc9cd16c5802 Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeTestJSON-1656930574-project Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 3ad869b0447848d7bf332017402442c8 Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeTestJSON-1656930574-project Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'd012ca89-c83f-482f-9747-a63468ecdca4'} Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:10.552008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:10.560220 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:43:10.560220 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:10.560220 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:10.560220 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:10.560220 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:10.560220 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:10.560220 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:10.560220 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:10.560220 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:10.560220 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:43:10.560220 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:10.560220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d860b352-d56d-45ae-b5f2-ba3a105e1159 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Returning 404 to user: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:10.560220 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d860b352-d56d-45ae-b5f2-ba3a105e1159 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 404 len: 111 microversion: 2.1 time: 0.082203 Oct 18 13:43:10.572288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-74c69470-8ca9-4654-9d88-dbd711c11e28 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:10.573072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-74c69470-8ca9-4654-9d88-dbd711c11e28 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: d012ca89-c83f-482f-9747-a63468ecdca4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:10.576387 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2614/5446] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:43:10 2022] DELETE /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:43:10.587314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-74c69470-8ca9-4654-9d88-dbd711c11e28 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:10.589112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-74c69470-8ca9-4654-9d88-dbd711c11e28 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:10.590224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-74c69470-8ca9-4654-9d88-dbd711c11e28 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:10.592289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-74c69470-8ca9-4654-9d88-dbd711c11e28 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:10.598151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-74c69470-8ca9-4654-9d88-dbd711c11e28 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:10.598916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-74c69470-8ca9-4654-9d88-dbd711c11e28 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:10.626909 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-74c69470-8ca9-4654-9d88-dbd711c11e28 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] HTTP exception thrown: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-74c69470-8ca9-4654-9d88-dbd711c11e28 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Request method failure captured: Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 HTTP/1.1 Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqueWuZxmAzQFdjCybRIxmi55p-XkVuduN-YiHDLoMpYHpTNvOGVVTueKbsLLdar59Kecntc8pWZpOSDVOgKSY_mspF9Kr_p58GNPepdfumkoHWJ0uhxeEhZXSWv8gGSSGBvYfgeOrKfigJRAs5zGZQ5oHeBpwxjr_9qVED6f0NcJJg Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 724386b2d066473fae0dbc9cd16c5802 Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_724386b2d066473fae0dbc9cd16c5802"}]}] Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 724386b2d066473fae0dbc9cd16c5802 Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachVolumeTestJSON-1656930574-project Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3ad869b0447848d7bf332017402442c8 Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachVolumeTestJSON-1656930574-project Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'd012ca89-c83f-482f-9747-a63468ecdca4'} Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:10.642609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:10.649580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:10.649580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:10.649580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:10.649580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:10.649580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:10.649580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. Oct 18 13:43:10.649580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:10.658412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-74c69470-8ca9-4654-9d88-dbd711c11e28 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Returning 404 to user: Instance d012ca89-c83f-482f-9747-a63468ecdca4 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:10.659613 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-74c69470-8ca9-4654-9d88-dbd711c11e28 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4" status: 404 len: 111 microversion: 2.1 time: 0.096297 Oct 18 13:43:10.679072 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2833/5447] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:10 2022] GET /compute/v2.1/servers/d012ca89-c83f-482f-9747-a63468ecdca4 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:43:11.364108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-320436d5-796a-4dbd-87d1-cb83cb1d5225 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:11.364736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-320436d5-796a-4dbd-87d1-cb83cb1d5225 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:11.376657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-320436d5-796a-4dbd-87d1-cb83cb1d5225 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:11.387288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-320436d5-796a-4dbd-87d1-cb83cb1d5225 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:11.394761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-320436d5-796a-4dbd-87d1-cb83cb1d5225 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:11.395845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-320436d5-796a-4dbd-87d1-cb83cb1d5225 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:11.396501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-320436d5-796a-4dbd-87d1-cb83cb1d5225 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:11.397445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-320436d5-796a-4dbd-87d1-cb83cb1d5225 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:12.474377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-5efde3af-fa8f-4886-8c95-ca1a747ed833 req-b9dabf14-8b64-42fd-b296-9074dda09b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3232df-b49d-4443-9fea-d9a5ec5c5424", "name": "network-vif-plugged", "status": "completed", "tag": "433ece07-11bf-46bf-a910-6b251c616966"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:12.524902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5efde3af-fa8f-4886-8c95-ca1a747ed833 req-b9dabf14-8b64-42fd-b296-9074dda09b72 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:12.526084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5efde3af-fa8f-4886-8c95-ca1a747ed833 req-b9dabf14-8b64-42fd-b296-9074dda09b72 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:12.526988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5efde3af-fa8f-4886-8c95-ca1a747ed833 req-b9dabf14-8b64-42fd-b296-9074dda09b72 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:12.571372 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-5efde3af-fa8f-4886-8c95-ca1a747ed833 req-b9dabf14-8b64-42fd-b296-9074dda09b72 service nova] Creating event network-vif-plugged:433ece07-11bf-46bf-a910-6b251c616966 for instance be3232df-b49d-4443-9fea-d9a5ec5c5424 on n-h2-858384-13 Oct 18 13:43:12.584984 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-5efde3af-fa8f-4886-8c95-ca1a747ed833 req-b9dabf14-8b64-42fd-b296-9074dda09b72 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114301 Oct 18 13:43:12.587080 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2834/5448] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:13.530625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-320436d5-796a-4dbd-87d1-cb83cb1d5225 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:13.548852 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-320436d5-796a-4dbd-87d1-cb83cb1d5225 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1322 microversion: 2.1 time: 2.188776 Oct 18 13:43:13.550327 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2615/5449] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:11 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1322 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:14.584291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5c5e39a4-59c1-4522-8b97-628e3726d3a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:14.597935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5c5e39a4-59c1-4522-8b97-628e3726d3a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:14.614596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=9 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:14.618075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c5e39a4-59c1-4522-8b97-628e3726d3a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:14.622829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c5e39a4-59c1-4522-8b97-628e3726d3a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:14.623568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c5e39a4-59c1-4522-8b97-628e3726d3a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:14.627175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c5e39a4-59c1-4522-8b97-628e3726d3a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:14.627923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c5e39a4-59c1-4522-8b97-628e3726d3a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:14.628539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c5e39a4-59c1-4522-8b97-628e3726d3a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:14.654349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=51 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:15.883817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5c5e39a4-59c1-4522-8b97-628e3726d3a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:15.907786 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5c5e39a4-59c1-4522-8b97-628e3726d3a2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 200 len: 1516 microversion: 2.1 time: 1.339497 Oct 18 13:43:15.910844 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2835/5450] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:14 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 1516 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:15.934368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b002c046-2180-487b-a653-96e0917384bf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:15.934983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b002c046-2180-487b-a653-96e0917384bf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: be3232df-b49d-4443-9fea-d9a5ec5c5424] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:15.950744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:15.968836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b002c046-2180-487b-a653-96e0917384bf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:15.969387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b002c046-2180-487b-a653-96e0917384bf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:15.969833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b002c046-2180-487b-a653-96e0917384bf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:15.974377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b002c046-2180-487b-a653-96e0917384bf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:15.976116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b002c046-2180-487b-a653-96e0917384bf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:15.977196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b002c046-2180-487b-a653-96e0917384bf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:16.038106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:16.517152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b002c046-2180-487b-a653-96e0917384bf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:16.529121 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b002c046-2180-487b-a653-96e0917384bf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/be3232df-b49d-4443-9fea-d9a5ec5c5424" status: 200 len: 1515 microversion: 2.1 time: 0.599804 Oct 18 13:43:16.529746 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2616/5451] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:15 2022] GET /compute/v2.1/servers/be3232df-b49d-4443-9fea-d9a5ec5c5424 => generated 1515 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:16.553767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c1b0d83-56b5-4c9d-87f3-77082225c13e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:16.554653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c1b0d83-56b5-4c9d-87f3-77082225c13e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: 227cb6da-2e03-4184-b08b-e56a7501d244] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:16.564331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c1b0d83-56b5-4c9d-87f3-77082225c13e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:16.565081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c1b0d83-56b5-4c9d-87f3-77082225c13e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:16.565721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c1b0d83-56b5-4c9d-87f3-77082225c13e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:16.566950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c1b0d83-56b5-4c9d-87f3-77082225c13e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:16.567592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c1b0d83-56b5-4c9d-87f3-77082225c13e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:16.568219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c1b0d83-56b5-4c9d-87f3-77082225c13e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:16.935373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b1ed4ebb-625c-4f6c-823d-a25920d86f9f tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Action: 'create', calling method: .version_select at 0x7ff60f07aee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1800778282", "metadata": {"Type": "work"}}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b1ed4ebb-625c-4f6c-823d-a25920d86f9f tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Request method failure captured: Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 122 Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq10TFJLFVuz02JRhYNAPNEPZ-9iD1C0f4jghDIQY32Ek06KNy4waZceapDHh8RrGgE3PG0XcJ6GKh1p_PpqzP2nmA-BzPIT2tXaPlrrMqGrKXRsQb9oLaaHo3VQIdEci3WVJaDX_5_wiut-O27oiyZGasuo2vOho8t9p7flAQlZ7hs Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 9c5f7429ae834792becbf542513e4512 Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c5f7429ae834792becbf542513e4512"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c5f7429ae834792becbf542513e4512"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c5f7429ae834792becbf542513e4512"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c5f7429ae834792becbf542513e4512"}]}] Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 9c5f7429ae834792becbf542513e4512 Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-VolumesNegativeTest-565870152-project Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 114bb66028d84625b3f97885232e68b4 Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-VolumesNegativeTest-565870152-project Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1800778282", "metadata": {"Type": "work"}}} Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1800778282', 'metadata': {'Type': 'work'}}}} Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi '#$%' Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:43:16.957240 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:43:16.962030 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 13:43:16.962030 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.962030 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:16.962030 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.962030 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:16.962030 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:16.962030 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:16.962030 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:43:16.962030 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:43:16.962030 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 18 13:43:16.962030 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.962030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b1ed4ebb-625c-4f6c-823d-a25920d86f9f tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:16.962030 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b1ed4ebb-625c-4f6c-823d-a25920d86f9f tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.264698 Oct 18 13:43:16.963706 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2617/5452] 10.222.0.40 () {60 vars in 1156 bytes} [Tue Oct 18 13:43:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 270 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:43:16.969541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-855a3c10-5bb8-4895-b032-e291149ede0d tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Action: 'create', calling method: .version_select at 0x7ff60f73bdc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-906049259", "metadata": {"Type": "work"}}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-855a3c10-5bb8-4895-b032-e291149ede0d tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Request method failure captured: Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 119 Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq10TFJLFVuz02JRhYNAPNEPZ-9iD1C0f4jghDIQY32Ek06KNy4waZceapDHh8RrGgE3PG0XcJ6GKh1p_PpqzP2nmA-BzPIT2tXaPlrrMqGrKXRsQb9oLaaHo3VQIdEci3WVJaDX_5_wiut-O27oiyZGasuo2vOho8t9p7flAQlZ7hs Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 9c5f7429ae834792becbf542513e4512 Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c5f7429ae834792becbf542513e4512"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c5f7429ae834792becbf542513e4512"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c5f7429ae834792becbf542513e4512"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c5f7429ae834792becbf542513e4512"}]}] Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 9c5f7429ae834792becbf542513e4512 Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-VolumesNegativeTest-565870152-project Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 114bb66028d84625b3f97885232e68b4 Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-VolumesNegativeTest-565870152-project Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-906049259", "metadata": {"Type": "work"}}} Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-906049259', 'metadata': {'Type': 'work'}}}} Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi '0' Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:43:16.973714 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:43:16.980555 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 13:43:16.980555 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.980555 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:16.980555 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.980555 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:16.980555 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:16.980555 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:16.980555 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:43:16.980555 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:43:16.980555 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 18 13:43:16.980555 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:16.989475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-855a3c10-5bb8-4895-b032-e291149ede0d tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:16.989475 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-855a3c10-5bb8-4895-b032-e291149ede0d tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019313 Oct 18 13:43:16.989475 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2618/5453] 10.222.0.40 () {60 vars in 1156 bytes} [Tue Oct 18 13:43:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:43:16.997915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1f4a60bf-02dc-4950-82f7-0ba75a8ce0ab tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Action: 'create', calling method: .version_select at 0x7ff60e717b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1830304040", "metadata": {"Type": "work"}}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1f4a60bf-02dc-4950-82f7-0ba75a8ce0ab tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Request method failure captured: Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 119 Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq10TFJLFVuz02JRhYNAPNEPZ-9iD1C0f4jghDIQY32Ek06KNy4waZceapDHh8RrGgE3PG0XcJ6GKh1p_PpqzP2nmA-BzPIT2tXaPlrrMqGrKXRsQb9oLaaHo3VQIdEci3WVJaDX_5_wiut-O27oiyZGasuo2vOho8t9p7flAQlZ7hs Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 9c5f7429ae834792becbf542513e4512 Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c5f7429ae834792becbf542513e4512"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c5f7429ae834792becbf542513e4512"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c5f7429ae834792becbf542513e4512"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c5f7429ae834792becbf542513e4512"}]}] Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 9c5f7429ae834792becbf542513e4512 Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-VolumesNegativeTest-565870152-project Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 114bb66028d84625b3f97885232e68b4 Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-VolumesNegativeTest-565870152-project Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1830304040", "metadata": {"Type": "work"}}} Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1830304040', 'metadata': {'Type': 'work'}}}} Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi '' Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:43:17.014060 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:43:17.018927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 13:43:17.018927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.018927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:17.018927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.018927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.018927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:17.018927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:17.018927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:43:17.018927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:43:17.018927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 18 13:43:17.018927 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.021383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1f4a60bf-02dc-4950-82f7-0ba75a8ce0ab tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:17.022484 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1f4a60bf-02dc-4950-82f7-0ba75a8ce0ab tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030354 Oct 18 13:43:17.023286 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2619/5454] 10.222.0.40 () {60 vars in 1156 bytes} [Tue Oct 18 13:43:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:43:17.036434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-569ed112-1536-4932-b18f-6388141163d0 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Calling method '.version_select at 0x7ff60ee1e0d0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:17.053893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3c1b0d83-56b5-4c9d-87f3-77082225c13e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:17.065880 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c1b0d83-56b5-4c9d-87f3-77082225c13e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244" status: 200 len: 1322 microversion: 2.1 time: 0.516597 Oct 18 13:43:17.085331 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2836/5455] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:16 2022] GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 => generated 1322 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:17.143056 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-569ed112-1536-4932-b18f-6388141163d0 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] HTTP exception thrown: Volume tempest-invalid-630642685 could not be found. Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-569ed112-1536-4932-b18f-6388141163d0 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Request method failure captured: Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-630642685 HTTP/1.1 Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq10TFJLFVuz02JRhYNAPNEPZ-9iD1C0f4jghDIQY32Ek06KNy4waZceapDHh8RrGgE3PG0XcJ6GKh1p_PpqzP2nmA-BzPIT2tXaPlrrMqGrKXRsQb9oLaaHo3VQIdEci3WVJaDX_5_wiut-O27oiyZGasuo2vOho8t9p7flAQlZ7hs Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 9c5f7429ae834792becbf542513e4512 Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c5f7429ae834792becbf542513e4512"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c5f7429ae834792becbf542513e4512"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c5f7429ae834792becbf542513e4512"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c5f7429ae834792becbf542513e4512"}]}] Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 9c5f7429ae834792becbf542513e4512 Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-VolumesNegativeTest-565870152-project Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 114bb66028d84625b3f97885232e68b4 Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-VolumesNegativeTest-565870152-project Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: exception: Volume tempest-invalid-630642685 could not be found. Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'tempest-invalid-630642685'} Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-630642685 could not be found. (HTTP 404) (Request-ID: req-1dd8a273-1a23-41e2-80ce-1529a10a98a5) Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:43:17.150120 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-630642685 could not be found. Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-630642685 could not be found. Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-630642685 could not be found. Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-569ed112-1536-4932-b18f-6388141163d0 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Returning 404 to user: Volume tempest-invalid-630642685 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-569ed112-1536-4932-b18f-6388141163d0 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-630642685" status: 404 len: 98 microversion: 2.1 time: 0.122195 Oct 18 13:43:17.165076 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2620/5456] 10.222.0.40 () {58 vars in 1215 bytes} [Tue Oct 18 13:43:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-630642685 => generated 98 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 18 13:43:17.174700 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8a2110df-8240-4867-8ec4-aa36b354d89b tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004050 Oct 18 13:43:17.174700 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2837/5457] 10.222.0.40 () {58 vars in 1140 bytes} [Tue Oct 18 13:43:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 13:43:17.175267 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e18ace7a-482b-4e61-b0c5-67ccb5936e19 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004047 Oct 18 13:43:17.175267 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2621/5458] 10.222.0.40 () {58 vars in 1137 bytes} [Tue Oct 18 13:43:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 18 13:43:17.186760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e6a2534-7f40-45b0-9258-43a4101c9393 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Calling method '.version_select at 0x7ff60e460ca0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:17.302976 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-7e6a2534-7f40-45b0-9258-43a4101c9393 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] HTTP exception thrown: Volume f0b863b1-9513-4e98-908b-72427a48c740 could not be found. Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e6a2534-7f40-45b0-9258-43a4101c9393 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Request method failure captured: Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/os-volumes/f0b863b1-9513-4e98-908b-72427a48c740 HTTP/1.1 Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq10TFJLFVuz02JRhYNAPNEPZ-9iD1C0f4jghDIQY32Ek06KNy4waZceapDHh8RrGgE3PG0XcJ6GKh1p_PpqzP2nmA-BzPIT2tXaPlrrMqGrKXRsQb9oLaaHo3VQIdEci3WVJaDX_5_wiut-O27oiyZGasuo2vOho8t9p7flAQlZ7hs Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 9c5f7429ae834792becbf542513e4512 Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c5f7429ae834792becbf542513e4512"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c5f7429ae834792becbf542513e4512"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c5f7429ae834792becbf542513e4512"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c5f7429ae834792becbf542513e4512"}]}] Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 9c5f7429ae834792becbf542513e4512 Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-VolumesNegativeTest-565870152-project Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 114bb66028d84625b3f97885232e68b4 Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-VolumesNegativeTest-565870152-project Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: method: Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: exception: Volume f0b863b1-9513-4e98-908b-72427a48c740 could not be found. Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f0b863b1-9513-4e98-908b-72427a48c740'} Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0b863b1-9513-4e98-908b-72427a48c740 could not be found. (HTTP 404) (Request-ID: req-38d27fd7-0ac4-460a-a752-3984c7110391) Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:43:17.306343 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0b863b1-9513-4e98-908b-72427a48c740 could not be found. Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0b863b1-9513-4e98-908b-72427a48c740 could not be found. Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0b863b1-9513-4e98-908b-72427a48c740 could not be found. Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e6a2534-7f40-45b0-9258-43a4101c9393 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Returning 404 to user: Volume f0b863b1-9513-4e98-908b-72427a48c740 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7e6a2534-7f40-45b0-9258-43a4101c9393 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/f0b863b1-9513-4e98-908b-72427a48c740" status: 404 len: 109 microversion: 2.1 time: 0.128493 Oct 18 13:43:17.311739 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2838/5459] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:43:17 2022] DELETE /compute/v2.1/os-volumes/f0b863b1-9513-4e98-908b-72427a48c740 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:43:17.321151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-34c2e36a-600f-4248-a82d-db8238fadf27 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Calling method '.version_select at 0x7ff617a4eca0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:17.389780 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-34c2e36a-600f-4248-a82d-db8238fadf27 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] HTTP exception thrown: Volume 05ffe741-6c59-4b39-b97e-ddeba22111a4 could not be found. Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-34c2e36a-600f-4248-a82d-db8238fadf27 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Request method failure captured: Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/os-volumes/05ffe741-6c59-4b39-b97e-ddeba22111a4 HTTP/1.1 Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq10TFJLFVuz02JRhYNAPNEPZ-9iD1C0f4jghDIQY32Ek06KNy4waZceapDHh8RrGgE3PG0XcJ6GKh1p_PpqzP2nmA-BzPIT2tXaPlrrMqGrKXRsQb9oLaaHo3VQIdEci3WVJaDX_5_wiut-O27oiyZGasuo2vOho8t9p7flAQlZ7hs Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 9c5f7429ae834792becbf542513e4512 Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c5f7429ae834792becbf542513e4512"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9c5f7429ae834792becbf542513e4512"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9c5f7429ae834792becbf542513e4512"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9c5f7429ae834792becbf542513e4512"}]}] Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 9c5f7429ae834792becbf542513e4512 Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-VolumesNegativeTest-565870152 Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-VolumesNegativeTest-565870152-project Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 114bb66028d84625b3f97885232e68b4 Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-VolumesNegativeTest-565870152-project Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: method: Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: exception: Volume 05ffe741-6c59-4b39-b97e-ddeba22111a4 could not be found. Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '05ffe741-6c59-4b39-b97e-ddeba22111a4'} Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05ffe741-6c59-4b39-b97e-ddeba22111a4 could not be found. (HTTP 404) (Request-ID: req-d60c1652-d55a-4f1c-aba0-9243894c1c17) Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 18 13:43:17.393248 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05ffe741-6c59-4b39-b97e-ddeba22111a4 could not be found. Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05ffe741-6c59-4b39-b97e-ddeba22111a4 could not be found. Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05ffe741-6c59-4b39-b97e-ddeba22111a4 could not be found. Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-34c2e36a-600f-4248-a82d-db8238fadf27 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] Returning 404 to user: Volume 05ffe741-6c59-4b39-b97e-ddeba22111a4 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-34c2e36a-600f-4248-a82d-db8238fadf27 tempest-VolumesNegativeTest-565870152 tempest-VolumesNegativeTest-565870152-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/05ffe741-6c59-4b39-b97e-ddeba22111a4" status: 404 len: 109 microversion: 2.1 time: 0.077873 Oct 18 13:43:17.397730 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2622/5460] 10.222.0.40 () {58 vars in 1245 bytes} [Tue Oct 18 13:43:17 2022] GET /compute/v2.1/os-volumes/05ffe741-6c59-4b39-b97e-ddeba22111a4 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:43:17.651031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-b8820ccb-d749-4f9c-8a9d-916d3d5bbdf7 req-6bdc441f-c9ee-4a32-a332-f5dcd77883fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227cb6da-2e03-4184-b08b-e56a7501d244", "name": "network-vif-plugged", "status": "completed", "tag": "c0b3cc30-0e66-4fee-bcf1-4740d0202d85"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:17.680494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b8820ccb-d749-4f9c-8a9d-916d3d5bbdf7 req-6bdc441f-c9ee-4a32-a332-f5dcd77883fe service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:17.681603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b8820ccb-d749-4f9c-8a9d-916d3d5bbdf7 req-6bdc441f-c9ee-4a32-a332-f5dcd77883fe service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:17.682543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b8820ccb-d749-4f9c-8a9d-916d3d5bbdf7 req-6bdc441f-c9ee-4a32-a332-f5dcd77883fe service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:17.709528 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-b8820ccb-d749-4f9c-8a9d-916d3d5bbdf7 req-6bdc441f-c9ee-4a32-a332-f5dcd77883fe service nova] Creating event network-vif-plugged:c0b3cc30-0e66-4fee-bcf1-4740d0202d85 for instance 227cb6da-2e03-4184-b08b-e56a7501d244 on n-h1-858384-13 Oct 18 13:43:17.722389 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-b8820ccb-d749-4f9c-8a9d-916d3d5bbdf7 req-6bdc441f-c9ee-4a32-a332-f5dcd77883fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076318 Oct 18 13:43:17.726167 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2839/5461] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:43:17.772567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c5871d0-9885-4e0f-bf99-5419b4030223 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:17.773222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7c5871d0-9885-4e0f-bf99-5419b4030223 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:17.825926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c5871d0-9885-4e0f-bf99-5419b4030223 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:17.826483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c5871d0-9885-4e0f-bf99-5419b4030223 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:17.826963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c5871d0-9885-4e0f-bf99-5419b4030223 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:17.831110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c5871d0-9885-4e0f-bf99-5419b4030223 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:17.832467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c5871d0-9885-4e0f-bf99-5419b4030223 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:17.833304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c5871d0-9885-4e0f-bf99-5419b4030223 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:17.873081 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-7c5871d0-9885-4e0f-bf99-5419b4030223 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] HTTP exception thrown: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c5871d0-9885-4e0f-bf99-5419b4030223 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Request method failure captured: Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b HTTP/1.1 Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTqueWuZxmAzQFdjCybRIxmi55p-XkVuduN-YiHDLoMpYHpTNvOGVVTueKbsLLdar59Kecntc8pWZpOSDVOgKSY_mspF9Kr_p58GNPepdfumkoHWJ0uhxeEhZXSWv8gGSSGBvYfgeOrKfigJRAs5zGZQ5oHeBpwxjr_9qVED6f0NcJJg Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 724386b2d066473fae0dbc9cd16c5802 Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_724386b2d066473fae0dbc9cd16c5802"}]}] Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 724386b2d066473fae0dbc9cd16c5802 Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeTestJSON-1656930574-project Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 3ad869b0447848d7bf332017402442c8 Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeTestJSON-1656930574-project Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'fbff40e9-4767-4d10-9f02-2777d80dca4b'} Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:17.876318 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:17.882300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:43:17.882300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.882300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:17.882300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.882300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:17.882300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:17.882300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:17.882300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:17.882300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:17.882300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:43:17.882300 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:17.887708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c5871d0-9885-4e0f-bf99-5419b4030223 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Returning 404 to user: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:17.889775 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7c5871d0-9885-4e0f-bf99-5419b4030223 tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 404 len: 111 microversion: 2.1 time: 0.130743 Oct 18 13:43:17.896139 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2623/5462] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:43:17 2022] DELETE /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:43:17.908705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c98a110a-0463-4a67-b6c1-9de6b27bc61c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:17.909456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c98a110a-0463-4a67-b6c1-9de6b27bc61c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] [instance: fbff40e9-4767-4d10-9f02-2777d80dca4b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:17.928100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c98a110a-0463-4a67-b6c1-9de6b27bc61c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:17.930702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c98a110a-0463-4a67-b6c1-9de6b27bc61c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:17.931202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c98a110a-0463-4a67-b6c1-9de6b27bc61c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:17.939826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c98a110a-0463-4a67-b6c1-9de6b27bc61c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:17.941100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c98a110a-0463-4a67-b6c1-9de6b27bc61c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:17.943388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c98a110a-0463-4a67-b6c1-9de6b27bc61c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:17.998972 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-c98a110a-0463-4a67-b6c1-9de6b27bc61c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] HTTP exception thrown: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c98a110a-0463-4a67-b6c1-9de6b27bc61c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Request method failure captured: Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b HTTP/1.1 Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTqueWuZxmAzQFdjCybRIxmi55p-XkVuduN-YiHDLoMpYHpTNvOGVVTueKbsLLdar59Kecntc8pWZpOSDVOgKSY_mspF9Kr_p58GNPepdfumkoHWJ0uhxeEhZXSWv8gGSSGBvYfgeOrKfigJRAs5zGZQ5oHeBpwxjr_9qVED6f0NcJJg Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 724386b2d066473fae0dbc9cd16c5802 Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/724386b2d066473fae0dbc9cd16c5802"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_724386b2d066473fae0dbc9cd16c5802"}]}] Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 724386b2d066473fae0dbc9cd16c5802 Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1656930574 Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachVolumeTestJSON-1656930574-project Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 3ad869b0447848d7bf332017402442c8 Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachVolumeTestJSON-1656930574-project Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'fbff40e9-4767-4d10-9f02-2777d80dca4b'} Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:18.002144 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:18.007586 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:18.007586 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:18.007586 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:18.007586 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:18.007586 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:18.007586 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. Oct 18 13:43:18.007586 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:18.007586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c98a110a-0463-4a67-b6c1-9de6b27bc61c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] Returning 404 to user: Instance fbff40e9-4767-4d10-9f02-2777d80dca4b could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:18.007586 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c98a110a-0463-4a67-b6c1-9de6b27bc61c tempest-AttachVolumeTestJSON-1656930574 tempest-AttachVolumeTestJSON-1656930574-project] 10.222.0.40 "GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b" status: 404 len: 111 microversion: 2.1 time: 0.106266 Oct 18 13:43:18.008383 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2840/5463] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:17 2022] GET /compute/v2.1/servers/fbff40e9-4767-4d10-9f02-2777d80dca4b => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:43:18.096537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-04249708-1dcb-4c82-8dcd-519ea82dee65 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:18.097937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-04249708-1dcb-4c82-8dcd-519ea82dee65 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: 227cb6da-2e03-4184-b08b-e56a7501d244] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:18.108877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04249708-1dcb-4c82-8dcd-519ea82dee65 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:18.114045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04249708-1dcb-4c82-8dcd-519ea82dee65 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:18.114739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04249708-1dcb-4c82-8dcd-519ea82dee65 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:18.115588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04249708-1dcb-4c82-8dcd-519ea82dee65 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:18.118578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04249708-1dcb-4c82-8dcd-519ea82dee65 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:18.119224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-04249708-1dcb-4c82-8dcd-519ea82dee65 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:18.590788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-04249708-1dcb-4c82-8dcd-519ea82dee65 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:18.605420 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-04249708-1dcb-4c82-8dcd-519ea82dee65 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244" status: 200 len: 1322 microversion: 2.1 time: 0.511662 Oct 18 13:43:18.608856 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2624/5464] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:18 2022] GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:19.638610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-386af632-936d-423b-a6ed-8aa9294f93dd tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:19.639237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-386af632-936d-423b-a6ed-8aa9294f93dd tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: 227cb6da-2e03-4184-b08b-e56a7501d244] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:19.658639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-386af632-936d-423b-a6ed-8aa9294f93dd tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:19.659391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-386af632-936d-423b-a6ed-8aa9294f93dd tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:19.660659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-386af632-936d-423b-a6ed-8aa9294f93dd tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:19.662013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-386af632-936d-423b-a6ed-8aa9294f93dd tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:19.665096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-386af632-936d-423b-a6ed-8aa9294f93dd tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:19.667476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-386af632-936d-423b-a6ed-8aa9294f93dd tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:20.261399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-386af632-936d-423b-a6ed-8aa9294f93dd tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:20.279393 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-386af632-936d-423b-a6ed-8aa9294f93dd tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244" status: 200 len: 1322 microversion: 2.1 time: 0.647593 Oct 18 13:43:20.281637 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2841/5465] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:19 2022] GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 => generated 1322 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:21.305877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6694530f-31e8-4c6d-ab85-c2d80e225fc8 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:21.307360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6694530f-31e8-4c6d-ab85-c2d80e225fc8 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: 227cb6da-2e03-4184-b08b-e56a7501d244] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:21.324881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6694530f-31e8-4c6d-ab85-c2d80e225fc8 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.326366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6694530f-31e8-4c6d-ab85-c2d80e225fc8 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.327540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6694530f-31e8-4c6d-ab85-c2d80e225fc8 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.328529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6694530f-31e8-4c6d-ab85-c2d80e225fc8 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:21.329287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6694530f-31e8-4c6d-ab85-c2d80e225fc8 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:21.329947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6694530f-31e8-4c6d-ab85-c2d80e225fc8 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:21.927250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6694530f-31e8-4c6d-ab85-c2d80e225fc8 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:21.940203 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6694530f-31e8-4c6d-ab85-c2d80e225fc8 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244" status: 200 len: 1516 microversion: 2.1 time: 0.638960 Oct 18 13:43:21.940801 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2625/5466] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:21 2022] GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 => generated 1516 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:21.972056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0fa2f8e7-9b2f-4f7b-ad64-a48701ffdf48 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:21.975304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0fa2f8e7-9b2f-4f7b-ad64-a48701ffdf48 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: 227cb6da-2e03-4184-b08b-e56a7501d244] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:22.008871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa2f8e7-9b2f-4f7b-ad64-a48701ffdf48 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:22.011475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa2f8e7-9b2f-4f7b-ad64-a48701ffdf48 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:22.012316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa2f8e7-9b2f-4f7b-ad64-a48701ffdf48 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:22.013703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa2f8e7-9b2f-4f7b-ad64-a48701ffdf48 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:22.014387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa2f8e7-9b2f-4f7b-ad64-a48701ffdf48 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:22.014978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa2f8e7-9b2f-4f7b-ad64-a48701ffdf48 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:22.081409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0fa2f8e7-9b2f-4f7b-ad64-a48701ffdf48 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: 227cb6da-2e03-4184-b08b-e56a7501d244] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:43:22.268257 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0fa2f8e7-9b2f-4f7b-ad64-a48701ffdf48 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244" status: 204 len: 0 microversion: 2.1 time: 0.299814 Oct 18 13:43:22.269402 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2842/5467] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:43:21 2022] DELETE /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:43:22.277550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dda1b8c0-91ab-4b10-8bee-72b7ebfd1054 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:22.278163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dda1b8c0-91ab-4b10-8bee-72b7ebfd1054 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: 227cb6da-2e03-4184-b08b-e56a7501d244] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:22.287071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dda1b8c0-91ab-4b10-8bee-72b7ebfd1054 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:22.287571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dda1b8c0-91ab-4b10-8bee-72b7ebfd1054 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:22.288009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dda1b8c0-91ab-4b10-8bee-72b7ebfd1054 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:22.291591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dda1b8c0-91ab-4b10-8bee-72b7ebfd1054 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:22.292168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dda1b8c0-91ab-4b10-8bee-72b7ebfd1054 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:22.293349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dda1b8c0-91ab-4b10-8bee-72b7ebfd1054 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:23.194215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dda1b8c0-91ab-4b10-8bee-72b7ebfd1054 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:23.205041 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dda1b8c0-91ab-4b10-8bee-72b7ebfd1054 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244" status: 200 len: 1522 microversion: 2.1 time: 0.931580 Oct 18 13:43:23.205673 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2626/5468] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:22 2022] GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 => generated 1522 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:24.231429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1557ae89-cef0-4fae-933b-09f4657084f5 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:24.232143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1557ae89-cef0-4fae-933b-09f4657084f5 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: 227cb6da-2e03-4184-b08b-e56a7501d244] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:24.249938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1557ae89-cef0-4fae-933b-09f4657084f5 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:24.250795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1557ae89-cef0-4fae-933b-09f4657084f5 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:24.251386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1557ae89-cef0-4fae-933b-09f4657084f5 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:24.252398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1557ae89-cef0-4fae-933b-09f4657084f5 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:24.253049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1557ae89-cef0-4fae-933b-09f4657084f5 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:24.257912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1557ae89-cef0-4fae-933b-09f4657084f5 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:25.430748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1557ae89-cef0-4fae-933b-09f4657084f5 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:25.446266 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1557ae89-cef0-4fae-933b-09f4657084f5 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244" status: 200 len: 1522 microversion: 2.1 time: 1.219545 Oct 18 13:43:25.446872 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2843/5469] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:24 2022] GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 => generated 1522 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:26.259819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-9b1fadeb-8257-419a-8f79-8d357aae28d7 req-82e56fa3-e5f2-43f9-9842-03f7f788dc1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227cb6da-2e03-4184-b08b-e56a7501d244", "name": "network-vif-deleted", "tag": "c0b3cc30-0e66-4fee-bcf1-4740d0202d85"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:26.271766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9b1fadeb-8257-419a-8f79-8d357aae28d7 req-82e56fa3-e5f2-43f9-9842-03f7f788dc1d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:26.275167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9b1fadeb-8257-419a-8f79-8d357aae28d7 req-82e56fa3-e5f2-43f9-9842-03f7f788dc1d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:26.276112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9b1fadeb-8257-419a-8f79-8d357aae28d7 req-82e56fa3-e5f2-43f9-9842-03f7f788dc1d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:26.312726 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-9b1fadeb-8257-419a-8f79-8d357aae28d7 req-82e56fa3-e5f2-43f9-9842-03f7f788dc1d service nova] Creating event network-vif-deleted:c0b3cc30-0e66-4fee-bcf1-4740d0202d85 for instance 227cb6da-2e03-4184-b08b-e56a7501d244 on n-h1-858384-13 Oct 18 13:43:26.324569 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-9b1fadeb-8257-419a-8f79-8d357aae28d7 req-82e56fa3-e5f2-43f9-9842-03f7f788dc1d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074504 Oct 18 13:43:26.328911 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2627/5470] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:43:26.470697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:26.471313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: 227cb6da-2e03-4184-b08b-e56a7501d244] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:26.478625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:26.478625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:26.478978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:26.479657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:26.480756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:26.481209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:26.550279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:26.550773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:26.551200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:26.551659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lazy-loading 'fault' on Instance uuid 227cb6da-2e03-4184-b08b-e56a7501d244 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:43:26.888570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:26.901101 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-76dc39c8-32e0-4fbe-b7f1-d5fd4c11215a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244" status: 200 len: 1312 microversion: 2.1 time: 0.434286 Oct 18 13:43:26.902617 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2844/5471] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:26 2022] GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 => generated 1312 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:27.927015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-402184c8-b32c-4b89-bdf9-0e059349f8a9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:27.927798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-402184c8-b32c-4b89-bdf9-0e059349f8a9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: 227cb6da-2e03-4184-b08b-e56a7501d244] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:27.954525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-402184c8-b32c-4b89-bdf9-0e059349f8a9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:27.955047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-402184c8-b32c-4b89-bdf9-0e059349f8a9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:27.957322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-402184c8-b32c-4b89-bdf9-0e059349f8a9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:27.966140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-402184c8-b32c-4b89-bdf9-0e059349f8a9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:27.969565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-402184c8-b32c-4b89-bdf9-0e059349f8a9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:27.970844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-402184c8-b32c-4b89-bdf9-0e059349f8a9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:28.035105 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-402184c8-b32c-4b89-bdf9-0e059349f8a9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] HTTP exception thrown: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-402184c8-b32c-4b89-bdf9-0e059349f8a9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Request method failure captured: Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 HTTP/1.1 Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq1SlqUsXVQkIDCljHGtWvLh6NP2CfNq5Q-fjUkv8C9dcmqWNVL2wPl3P1y9jbHol_iKOrVmt5J_hQjkvpzoTYUoLBODCH04vsQWfkyGwC26ZQZf6r-N2IBpEqWHzMc6Sueo3Zoks0NvgTp3EyfzZxGVpUDVX5agYiuOaAam3qBU3po Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79ff3cc659af487d9387ac2e03328b30"}]}] Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 46ad8ddc30274c16bb211a68b6050ef7 Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '227cb6da-2e03-4184-b08b-e56a7501d244'} Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.038294 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:28.041337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.041337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:28.041337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:28.041337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:28.041337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:28.041337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:28.041337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:28.041337 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.041337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-402184c8-b32c-4b89-bdf9-0e059349f8a9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Returning 404 to user: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:28.045722 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-402184c8-b32c-4b89-bdf9-0e059349f8a9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244" status: 404 len: 111 microversion: 2.1 time: 0.120952 Oct 18 13:43:28.046394 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2628/5472] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:27 2022] GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:43:28.055426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-644ba93f-5ee2-41d7-970d-e960f477d035 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:28.063658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-644ba93f-5ee2-41d7-970d-e960f477d035 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:28.064854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-644ba93f-5ee2-41d7-970d-e960f477d035 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '79ff3cc659af487d9387ac2e03328b30'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:43:28.077596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-644ba93f-5ee2-41d7-970d-e960f477d035 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:28.078582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-644ba93f-5ee2-41d7-970d-e960f477d035 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:28.079775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-644ba93f-5ee2-41d7-970d-e960f477d035 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:28.089517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-644ba93f-5ee2-41d7-970d-e960f477d035 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:28.090423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-644ba93f-5ee2-41d7-970d-e960f477d035 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:28.091107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-644ba93f-5ee2-41d7-970d-e960f477d035 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:28.308883 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-644ba93f-5ee2-41d7-970d-e960f477d035 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.256513 Oct 18 13:43:28.309894 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2845/5473] 10.222.0.40 () {58 vars in 1230 bytes} [Tue Oct 18 13:43:28 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:43:28.327828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-921db2a0-df5a-46e0-b75d-11453ac625cf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-921db2a0-df5a-46e0-b75d-11453ac625cf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Request method failure captured: Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq1SlqUsXVQkIDCljHGtWvLh6NP2CfNq5Q-fjUkv8C9dcmqWNVL2wPl3P1y9jbHol_iKOrVmt5J_hQjkvpzoTYUoLBODCH04vsQWfkyGwC26ZQZf6r-N2IBpEqWHzMc6Sueo3Zoks0NvgTp3EyfzZxGVpUDVX5agYiuOaAam3qBU3po Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79ff3cc659af487d9387ac2e03328b30"}]}] Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 46ad8ddc30274c16bb211a68b6050ef7 Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: action_args: {} Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 18 13:43:28.332095 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 18 13:43:28.335640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.341305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-921db2a0-df5a-46e0-b75d-11453ac625cf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:28.344608 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-921db2a0-df5a-46e0-b75d-11453ac625cf tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.021743 Oct 18 13:43:28.345253 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2629/5474] 10.222.0.40 () {58 vars in 1182 bytes} [Tue Oct 18 13:43:28 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:43:28.356255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a1e58431-0ba4-4e85-aca4-d957166acd8a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:28.367275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a1e58431-0ba4-4e85-aca4-d957166acd8a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:28.374154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a1e58431-0ba4-4e85-aca4-d957166acd8a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Searching by: {'deleted': False, 'project_id': '79ff3cc659af487d9387ac2e03328b30'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:43:28.380199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1e58431-0ba4-4e85-aca4-d957166acd8a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:28.382209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1e58431-0ba4-4e85-aca4-d957166acd8a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:28.383227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1e58431-0ba4-4e85-aca4-d957166acd8a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:28.384257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1e58431-0ba4-4e85-aca4-d957166acd8a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:28.386273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1e58431-0ba4-4e85-aca4-d957166acd8a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:28.387044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1e58431-0ba4-4e85-aca4-d957166acd8a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:28.463941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-a1e58431-0ba4-4e85-aca4-d957166acd8a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:43:28.562659 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a1e58431-0ba4-4e85-aca4-d957166acd8a tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.205419 Oct 18 13:43:28.563270 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2846/5475] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 13:43:28 2022] GET /compute/v2.1/servers => generated 681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:28.577722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d6d763ce-5135-4287-831c-50a290e5d3f2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:28.603264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d6d763ce-5135-4287-831c-50a290e5d3f2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:28.605799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.compute.servers [None req-d6d763ce-5135-4287-831c-50a290e5d3f2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Removing options 'limit' from query {{(pid=120612) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 18 13:43:28.618266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d6d763ce-5135-4287-831c-50a290e5d3f2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Searching by: {'deleted': False, 'project_id': '79ff3cc659af487d9387ac2e03328b30'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:43:28.634373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6d763ce-5135-4287-831c-50a290e5d3f2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:28.637869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6d763ce-5135-4287-831c-50a290e5d3f2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:28.638802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6d763ce-5135-4287-831c-50a290e5d3f2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:28.645108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6d763ce-5135-4287-831c-50a290e5d3f2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:28.645959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6d763ce-5135-4287-831c-50a290e5d3f2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:28.648353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6d763ce-5135-4287-831c-50a290e5d3f2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:28.719274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-d6d763ce-5135-4287-831c-50a290e5d3f2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:43:28.786547 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d6d763ce-5135-4287-831c-50a290e5d3f2 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.215162 Oct 18 13:43:28.787732 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2630/5476] 10.222.0.40 () {58 vars in 1144 bytes} [Tue Oct 18 13:43:28 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:28.801630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1445cb06-ff70-4db5-a30d-ada92987dde9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1445cb06-ff70-4db5-a30d-ada92987dde9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Request method failure captured: Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq1SlqUsXVQkIDCljHGtWvLh6NP2CfNq5Q-fjUkv8C9dcmqWNVL2wPl3P1y9jbHol_iKOrVmt5J_hQjkvpzoTYUoLBODCH04vsQWfkyGwC26ZQZf6r-N2IBpEqWHzMc6Sueo3Zoks0NvgTp3EyfzZxGVpUDVX5agYiuOaAam3qBU3po Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79ff3cc659af487d9387ac2e03328b30"}]}] Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 46ad8ddc30274c16bb211a68b6050ef7 Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: action_args: {} Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi '-1' Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 18 13:43:28.806153 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1445cb06-ff70-4db5-a30d-ada92987dde9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:28.810271 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1445cb06-ff70-4db5-a30d-ada92987dde9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010834 Oct 18 13:43:28.816274 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2847/5477] 10.222.0.40 () {58 vars in 1142 bytes} [Tue Oct 18 13:43:28 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:43:28.824020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-933ba881-c209-4ee3-8bd9-ba9bf1f2cb68 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-933ba881-c209-4ee3-8bd9-ba9bf1f2cb68 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Request method failure captured: Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq1SlqUsXVQkIDCljHGtWvLh6NP2CfNq5Q-fjUkv8C9dcmqWNVL2wPl3P1y9jbHol_iKOrVmt5J_hQjkvpzoTYUoLBODCH04vsQWfkyGwC26ZQZf6r-N2IBpEqWHzMc6Sueo3Zoks0NvgTp3EyfzZxGVpUDVX5agYiuOaAam3qBU3po Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79ff3cc659af487d9387ac2e03328b30"}]}] Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 46ad8ddc30274c16bb211a68b6050ef7 Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: action_args: {} Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi 'testing' Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 18 13:43:28.829582 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 18 13:43:28.832983 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:28.838938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-933ba881-c209-4ee3-8bd9-ba9bf1f2cb68 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:28.840910 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-933ba881-c209-4ee3-8bd9-ba9bf1f2cb68 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.022909 Oct 18 13:43:28.842335 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2631/5478] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:43:28 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:43:28.853367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-79bb741a-1630-4944-808d-69e0d0fb27ed tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:28.858772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79bb741a-1630-4944-808d-69e0d0fb27ed tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:28.859451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-79bb741a-1630-4944-808d-69e0d0fb27ed tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '79ff3cc659af487d9387ac2e03328b30'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:43:28.876677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.compute.servers [None req-79bb741a-1630-4944-808d-69e0d0fb27ed tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Flavor 'non_existing_flavor' could not be found {{(pid=120611) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 18 13:43:28.878401 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-79bb741a-1630-4944-808d-69e0d0fb27ed tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.030601 Oct 18 13:43:28.880335 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2848/5479] 10.222.0.40 () {58 vars in 1178 bytes} [Tue Oct 18 13:43:28 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:43:28.896810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2647e4be-bfbe-4e16-afa2-eb7476f91ac9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:28.904230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2647e4be-bfbe-4e16-afa2-eb7476f91ac9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:28.905372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2647e4be-bfbe-4e16-afa2-eb7476f91ac9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '79ff3cc659af487d9387ac2e03328b30'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:43:28.914358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2647e4be-bfbe-4e16-afa2-eb7476f91ac9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:28.915346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2647e4be-bfbe-4e16-afa2-eb7476f91ac9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:28.916084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2647e4be-bfbe-4e16-afa2-eb7476f91ac9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:28.917238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2647e4be-bfbe-4e16-afa2-eb7476f91ac9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:28.918200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2647e4be-bfbe-4e16-afa2-eb7476f91ac9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:28.919862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2647e4be-bfbe-4e16-afa2-eb7476f91ac9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:29.056952 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2647e4be-bfbe-4e16-afa2-eb7476f91ac9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.163717 Oct 18 13:43:29.059787 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2632/5480] 10.222.0.40 () {58 vars in 1174 bytes} [Tue Oct 18 13:43:28 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:43:29.079830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c232e84e-5762-46b0-a035-22e843bb8088 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:29.109943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c232e84e-5762-46b0-a035-22e843bb8088 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:29.110650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c232e84e-5762-46b0-a035-22e843bb8088 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '79ff3cc659af487d9387ac2e03328b30'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:43:29.119235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c232e84e-5762-46b0-a035-22e843bb8088 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:29.119723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c232e84e-5762-46b0-a035-22e843bb8088 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:29.120162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c232e84e-5762-46b0-a035-22e843bb8088 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:29.121024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c232e84e-5762-46b0-a035-22e843bb8088 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:29.122365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c232e84e-5762-46b0-a035-22e843bb8088 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:29.128898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c232e84e-5762-46b0-a035-22e843bb8088 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:29.334536 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c232e84e-5762-46b0-a035-22e843bb8088 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.262080 Oct 18 13:43:29.334536 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2849/5481] 10.222.0.40 () {58 vars in 1184 bytes} [Tue Oct 18 13:43:29 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:43:29.347932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:29.355864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:29.357169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Searching by: {'deleted': False, 'project_id': '79ff3cc659af487d9387ac2e03328b30'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:43:29.367969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:29.368615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:29.369397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:29.370404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:29.371019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:29.371595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:29.421226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:43:29.511829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:29.532065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:29.545820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:29.546367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:30.426485 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-273df376-b255-4040-a245-8bc90c191786 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 1.083276 Oct 18 13:43:30.427932 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2633/5482] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 13:43:29 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:30.462422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-48ef0c63-c287-46d4-82e9-c47c3090d186 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:30.469781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-48ef0c63-c287-46d4-82e9-c47c3090d186 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:30.470853 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-48ef0c63-c287-46d4-82e9-c47c3090d186 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.012477 Oct 18 13:43:30.483933 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2850/5483] 10.222.0.40 () {58 vars in 1178 bytes} [Tue Oct 18 13:43:30 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:43:30.497456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-65a32375-7844-4f52-8519-8c3725bf307e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:30.504589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-65a32375-7844-4f52-8519-8c3725bf307e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:30.505315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-65a32375-7844-4f52-8519-8c3725bf307e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Searching by: {'deleted': False, 'project_id': '79ff3cc659af487d9387ac2e03328b30'} {{(pid=120612) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:43:30.515931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65a32375-7844-4f52-8519-8c3725bf307e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:30.516424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65a32375-7844-4f52-8519-8c3725bf307e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:30.516856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65a32375-7844-4f52-8519-8c3725bf307e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:30.523653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65a32375-7844-4f52-8519-8c3725bf307e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:30.524442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65a32375-7844-4f52-8519-8c3725bf307e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:30.526185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65a32375-7844-4f52-8519-8c3725bf307e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:30.571160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.multi_cell_list [None req-65a32375-7844-4f52-8519-8c3725bf307e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120612) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:43:30.640665 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-65a32375-7844-4f52-8519-8c3725bf307e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.147732 Oct 18 13:43:30.654294 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2634/5484] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 13:43:30 2022] GET /compute/v2.1/servers => generated 681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:30.670244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c5dd6e8f-6308-44f3-ad4a-4c108faaddf3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:30.670769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c5dd6e8f-6308-44f3-ad4a-4c108faaddf3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: 227cb6da-2e03-4184-b08b-e56a7501d244] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:30.684728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5dd6e8f-6308-44f3-ad4a-4c108faaddf3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:30.685502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5dd6e8f-6308-44f3-ad4a-4c108faaddf3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:30.687596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5dd6e8f-6308-44f3-ad4a-4c108faaddf3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:30.688574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5dd6e8f-6308-44f3-ad4a-4c108faaddf3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:30.690402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5dd6e8f-6308-44f3-ad4a-4c108faaddf3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:30.692471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5dd6e8f-6308-44f3-ad4a-4c108faaddf3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:30.722649 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-c5dd6e8f-6308-44f3-ad4a-4c108faaddf3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] HTTP exception thrown: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c5dd6e8f-6308-44f3-ad4a-4c108faaddf3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Request method failure captured: Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 HTTP/1.1 Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq1SlqUsXVQkIDCljHGtWvLh6NP2CfNq5Q-fjUkv8C9dcmqWNVL2wPl3P1y9jbHol_iKOrVmt5J_hQjkvpzoTYUoLBODCH04vsQWfkyGwC26ZQZf6r-N2IBpEqWHzMc6Sueo3Zoks0NvgTp3EyfzZxGVpUDVX5agYiuOaAam3qBU3po Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79ff3cc659af487d9387ac2e03328b30"}]}] Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 46ad8ddc30274c16bb211a68b6050ef7 Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '227cb6da-2e03-4184-b08b-e56a7501d244'} Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:30.724271 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:30.727739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:30.727739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:30.727739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:30.727739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:30.727739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:30.727739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:30.727739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:30.727739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:30.727739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:30.727739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:30.727739 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:30.727739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c5dd6e8f-6308-44f3-ad4a-4c108faaddf3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Returning 404 to user: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:30.727739 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c5dd6e8f-6308-44f3-ad4a-4c108faaddf3 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244" status: 404 len: 111 microversion: 2.1 time: 0.061709 Oct 18 13:43:30.736235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ff062471-64d9-4d20-9aa7-1856acf6dc6c tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:30.736740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ff062471-64d9-4d20-9aa7-1856acf6dc6c tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: be3232df-b49d-4443-9fea-d9a5ec5c5424] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:30.741353 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2851/5485] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:43:30 2022] DELETE /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:43:30.748678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff062471-64d9-4d20-9aa7-1856acf6dc6c tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:30.749341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff062471-64d9-4d20-9aa7-1856acf6dc6c tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:30.749843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff062471-64d9-4d20-9aa7-1856acf6dc6c tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:30.750479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff062471-64d9-4d20-9aa7-1856acf6dc6c tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:30.750933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff062471-64d9-4d20-9aa7-1856acf6dc6c tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:30.751358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff062471-64d9-4d20-9aa7-1856acf6dc6c tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:30.822075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ff062471-64d9-4d20-9aa7-1856acf6dc6c tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: be3232df-b49d-4443-9fea-d9a5ec5c5424] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:43:30.954058 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ff062471-64d9-4d20-9aa7-1856acf6dc6c tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/be3232df-b49d-4443-9fea-d9a5ec5c5424" status: 204 len: 0 microversion: 2.1 time: 0.221387 Oct 18 13:43:30.958107 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2635/5486] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:43:30 2022] DELETE /compute/v2.1/servers/be3232df-b49d-4443-9fea-d9a5ec5c5424 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:43:30.968501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e49ba194-1f6f-4d64-a84f-2f1d18ce3cb6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:30.969153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e49ba194-1f6f-4d64-a84f-2f1d18ce3cb6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:30.982328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e49ba194-1f6f-4d64-a84f-2f1d18ce3cb6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:30.983514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e49ba194-1f6f-4d64-a84f-2f1d18ce3cb6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:30.984269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e49ba194-1f6f-4d64-a84f-2f1d18ce3cb6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:30.985826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e49ba194-1f6f-4d64-a84f-2f1d18ce3cb6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:30.986652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e49ba194-1f6f-4d64-a84f-2f1d18ce3cb6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:30.987294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e49ba194-1f6f-4d64-a84f-2f1d18ce3cb6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:31.042038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e49ba194-1f6f-4d64-a84f-2f1d18ce3cb6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:43:31.302734 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e49ba194-1f6f-4d64-a84f-2f1d18ce3cb6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 204 len: 0 microversion: 2.1 time: 0.339804 Oct 18 13:43:31.307383 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2852/5487] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:43:30 2022] DELETE /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:43:31.333491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68e79802-9264-4e51-8bee-914d75e098a6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:31.341798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-68e79802-9264-4e51-8bee-914d75e098a6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: 227cb6da-2e03-4184-b08b-e56a7501d244] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:31.395974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68e79802-9264-4e51-8bee-914d75e098a6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:31.396839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68e79802-9264-4e51-8bee-914d75e098a6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:31.397003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68e79802-9264-4e51-8bee-914d75e098a6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:31.398050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68e79802-9264-4e51-8bee-914d75e098a6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:31.398536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68e79802-9264-4e51-8bee-914d75e098a6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:31.398960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68e79802-9264-4e51-8bee-914d75e098a6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:31.432133 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-68e79802-9264-4e51-8bee-914d75e098a6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] HTTP exception thrown: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68e79802-9264-4e51-8bee-914d75e098a6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Request method failure captured: Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 HTTP/1.1 Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq1SlqUsXVQkIDCljHGtWvLh6NP2CfNq5Q-fjUkv8C9dcmqWNVL2wPl3P1y9jbHol_iKOrVmt5J_hQjkvpzoTYUoLBODCH04vsQWfkyGwC26ZQZf6r-N2IBpEqWHzMc6Sueo3Zoks0NvgTp3EyfzZxGVpUDVX5agYiuOaAam3qBU3po Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79ff3cc659af487d9387ac2e03328b30"}]}] Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 46ad8ddc30274c16bb211a68b6050ef7 Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '227cb6da-2e03-4184-b08b-e56a7501d244'} Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:31.440059 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:31.443838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:31.443838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:31.443838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:31.443838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:31.443838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:31.443838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:31.443838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. Oct 18 13:43:31.443838 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:31.453288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68e79802-9264-4e51-8bee-914d75e098a6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Returning 404 to user: Instance 227cb6da-2e03-4184-b08b-e56a7501d244 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:31.461120 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-68e79802-9264-4e51-8bee-914d75e098a6 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244" status: 404 len: 111 microversion: 2.1 time: 0.150918 Oct 18 13:43:31.466819 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2636/5488] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:31 2022] GET /compute/v2.1/servers/227cb6da-2e03-4184-b08b-e56a7501d244 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:43:31.475924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d4bf88dc-d51f-4535-90f5-6ff63f60b3d9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:31.477454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d4bf88dc-d51f-4535-90f5-6ff63f60b3d9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: be3232df-b49d-4443-9fea-d9a5ec5c5424] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:31.484761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bf88dc-d51f-4535-90f5-6ff63f60b3d9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:31.485608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bf88dc-d51f-4535-90f5-6ff63f60b3d9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:31.486287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bf88dc-d51f-4535-90f5-6ff63f60b3d9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:31.487204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bf88dc-d51f-4535-90f5-6ff63f60b3d9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:31.487863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bf88dc-d51f-4535-90f5-6ff63f60b3d9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:31.488956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bf88dc-d51f-4535-90f5-6ff63f60b3d9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:32.019598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d4bf88dc-d51f-4535-90f5-6ff63f60b3d9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:32.032113 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d4bf88dc-d51f-4535-90f5-6ff63f60b3d9 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/be3232df-b49d-4443-9fea-d9a5ec5c5424" status: 200 len: 1521 microversion: 2.1 time: 0.560390 Oct 18 13:43:32.035822 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2853/5489] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:31 2022] GET /compute/v2.1/servers/be3232df-b49d-4443-9fea-d9a5ec5c5424 => generated 1521 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:33.066333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d14d6f3e-cd6c-4ee8-aad7-b9931473f633 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:33.068350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d14d6f3e-cd6c-4ee8-aad7-b9931473f633 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: be3232df-b49d-4443-9fea-d9a5ec5c5424] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:33.086745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d14d6f3e-cd6c-4ee8-aad7-b9931473f633 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:33.087643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d14d6f3e-cd6c-4ee8-aad7-b9931473f633 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:33.089020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d14d6f3e-cd6c-4ee8-aad7-b9931473f633 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:33.093873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d14d6f3e-cd6c-4ee8-aad7-b9931473f633 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:33.094706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d14d6f3e-cd6c-4ee8-aad7-b9931473f633 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:33.095913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d14d6f3e-cd6c-4ee8-aad7-b9931473f633 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:34.434018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d14d6f3e-cd6c-4ee8-aad7-b9931473f633 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:34.450881 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d14d6f3e-cd6c-4ee8-aad7-b9931473f633 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/be3232df-b49d-4443-9fea-d9a5ec5c5424" status: 200 len: 1521 microversion: 2.1 time: 1.393559 Oct 18 13:43:34.451553 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2637/5490] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:33 2022] GET /compute/v2.1/servers/be3232df-b49d-4443-9fea-d9a5ec5c5424 => generated 1521 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:34.755950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-826241cf-8b85-4a4a-987c-b9652ecb4886 req-a7de3379-f44c-4c6d-af30-871c36b4f5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3232df-b49d-4443-9fea-d9a5ec5c5424", "name": "network-vif-deleted", "tag": "433ece07-11bf-46bf-a910-6b251c616966"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:34.778160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-826241cf-8b85-4a4a-987c-b9652ecb4886 req-a7de3379-f44c-4c6d-af30-871c36b4f5f2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:34.789149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-826241cf-8b85-4a4a-987c-b9652ecb4886 req-a7de3379-f44c-4c6d-af30-871c36b4f5f2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:34.789686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-826241cf-8b85-4a4a-987c-b9652ecb4886 req-a7de3379-f44c-4c6d-af30-871c36b4f5f2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:34.822936 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-826241cf-8b85-4a4a-987c-b9652ecb4886 req-a7de3379-f44c-4c6d-af30-871c36b4f5f2 service nova] Creating event network-vif-deleted:433ece07-11bf-46bf-a910-6b251c616966 for instance be3232df-b49d-4443-9fea-d9a5ec5c5424 on n-h2-858384-13 Oct 18 13:43:34.836142 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-826241cf-8b85-4a4a-987c-b9652ecb4886 req-a7de3379-f44c-4c6d-af30-871c36b4f5f2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084258 Oct 18 13:43:34.841501 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2854/5491] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:35.479056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:35.481676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: be3232df-b49d-4443-9fea-d9a5ec5c5424] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:35.496827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:35.500145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:35.502790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:35.504502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:35.506024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:35.507879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:35.625963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:35.627726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:35.629004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:35.629883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lazy-loading 'fault' on Instance uuid be3232df-b49d-4443-9fea-d9a5ec5c5424 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:43:35.786063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ad8ddc30274c16bb211a68b6050ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ff3cc659af487d9387ac2e03328b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:43:35.793905 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-92521e66-ac14-48b8-bd05-b801e7434a9e tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/be3232df-b49d-4443-9fea-d9a5ec5c5424" status: 200 len: 1312 microversion: 2.1 time: 0.319526 Oct 18 13:43:35.797884 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2638/5492] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:35 2022] GET /compute/v2.1/servers/be3232df-b49d-4443-9fea-d9a5ec5c5424 => generated 1312 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:43:36.821727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-adeed44e-c998-4c51-97fd-3506bc0937f1 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:36.822435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-adeed44e-c998-4c51-97fd-3506bc0937f1 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: be3232df-b49d-4443-9fea-d9a5ec5c5424] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:36.841092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adeed44e-c998-4c51-97fd-3506bc0937f1 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:36.841586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adeed44e-c998-4c51-97fd-3506bc0937f1 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:36.842187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adeed44e-c998-4c51-97fd-3506bc0937f1 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:36.843192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adeed44e-c998-4c51-97fd-3506bc0937f1 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:36.843827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adeed44e-c998-4c51-97fd-3506bc0937f1 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:36.844438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adeed44e-c998-4c51-97fd-3506bc0937f1 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:36.869420 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-adeed44e-c998-4c51-97fd-3506bc0937f1 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] HTTP exception thrown: Instance be3232df-b49d-4443-9fea-d9a5ec5c5424 could not be found. Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-adeed44e-c998-4c51-97fd-3506bc0937f1 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Request method failure captured: Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/be3232df-b49d-4443-9fea-d9a5ec5c5424 HTTP/1.1 Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq1SlqUsXVQkIDCljHGtWvLh6NP2CfNq5Q-fjUkv8C9dcmqWNVL2wPl3P1y9jbHol_iKOrVmt5J_hQjkvpzoTYUoLBODCH04vsQWfkyGwC26ZQZf6r-N2IBpEqWHzMc6Sueo3Zoks0NvgTp3EyfzZxGVpUDVX5agYiuOaAam3qBU3po Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79ff3cc659af487d9387ac2e03328b30"}]}] Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 46ad8ddc30274c16bb211a68b6050ef7 Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance be3232df-b49d-4443-9fea-d9a5ec5c5424 could not be found. Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'be3232df-b49d-4443-9fea-d9a5ec5c5424'} Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be3232df-b49d-4443-9fea-d9a5ec5c5424 could not be found. Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be3232df-b49d-4443-9fea-d9a5ec5c5424 could not be found. Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:36.871741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:36.876193 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:36.876193 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:36.876193 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:36.876193 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:36.876193 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:36.876193 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:36.876193 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be3232df-b49d-4443-9fea-d9a5ec5c5424 could not be found. Oct 18 13:43:36.876193 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:43:36.876193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-adeed44e-c998-4c51-97fd-3506bc0937f1 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Returning 404 to user: Instance be3232df-b49d-4443-9fea-d9a5ec5c5424 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:36.878619 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-adeed44e-c998-4c51-97fd-3506bc0937f1 tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/be3232df-b49d-4443-9fea-d9a5ec5c5424" status: 404 len: 111 microversion: 2.1 time: 0.055719 Oct 18 13:43:36.884245 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2855/5493] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:36 2022] GET /compute/v2.1/servers/be3232df-b49d-4443-9fea-d9a5ec5c5424 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:43:36.890213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6bc82035-0040-4aeb-8de3-d17eb584fcef tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:43:36.891374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6bc82035-0040-4aeb-8de3-d17eb584fcef tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] [instance: aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:43:36.905294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bc82035-0040-4aeb-8de3-d17eb584fcef tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:36.906290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bc82035-0040-4aeb-8de3-d17eb584fcef tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:36.906894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bc82035-0040-4aeb-8de3-d17eb584fcef tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:36.909765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bc82035-0040-4aeb-8de3-d17eb584fcef tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:36.910388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bc82035-0040-4aeb-8de3-d17eb584fcef tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:36.910992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bc82035-0040-4aeb-8de3-d17eb584fcef tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:36.952886 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-6bc82035-0040-4aeb-8de3-d17eb584fcef tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] HTTP exception thrown: Instance aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 could not be found. Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6bc82035-0040-4aeb-8de3-d17eb584fcef tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Request method failure captured: Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 HTTP/1.1 Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq1SlqUsXVQkIDCljHGtWvLh6NP2CfNq5Q-fjUkv8C9dcmqWNVL2wPl3P1y9jbHol_iKOrVmt5J_hQjkvpzoTYUoLBODCH04vsQWfkyGwC26ZQZf6r-N2IBpEqWHzMc6Sueo3Zoks0NvgTp3EyfzZxGVpUDVX5agYiuOaAam3qBU3po Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79ff3cc659af487d9387ac2e03328b30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79ff3cc659af487d9387ac2e03328b30"}]}] Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 79ff3cc659af487d9387ac2e03328b30 Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-483912914 Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 46ad8ddc30274c16bb211a68b6050ef7 Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ListServersNegativeTestJSON-483912914-project Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 could not be found. Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4'} Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 could not be found. Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 could not be found. Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:36.955133 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:43:36.958721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:36.958721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:43:36.958721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:43:36.958721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:43:36.958721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:43:36.958721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:43:36.958721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 could not be found. Oct 18 13:43:36.958721 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:43:36.960367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6bc82035-0040-4aeb-8de3-d17eb584fcef tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] Returning 404 to user: Instance aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:43:36.961458 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6bc82035-0040-4aeb-8de3-d17eb584fcef tempest-ListServersNegativeTestJSON-483912914 tempest-ListServersNegativeTestJSON-483912914-project] 10.222.0.40 "GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4" status: 404 len: 111 microversion: 2.1 time: 0.075948 Oct 18 13:43:36.969719 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2639/5494] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:43:36 2022] GET /compute/v2.1/servers/aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:43:37.150574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-a84d2d42-bf6a-477a-b1c7-85d1316f7398 req-6a8bebd8-c87b-4cfa-b489-67d121db127a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4", "name": "network-vif-deleted", "tag": "d7621e47-01ba-4285-b3b2-076e6bf4f254"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:37.180489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a84d2d42-bf6a-477a-b1c7-85d1316f7398 req-6a8bebd8-c87b-4cfa-b489-67d121db127a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:43:37.180976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a84d2d42-bf6a-477a-b1c7-85d1316f7398 req-6a8bebd8-c87b-4cfa-b489-67d121db127a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:43:37.188229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a84d2d42-bf6a-477a-b1c7-85d1316f7398 req-6a8bebd8-c87b-4cfa-b489-67d121db127a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:43:37.209809 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-a84d2d42-bf6a-477a-b1c7-85d1316f7398 req-6a8bebd8-c87b-4cfa-b489-67d121db127a service nova] Creating event network-vif-deleted:d7621e47-01ba-4285-b3b2-076e6bf4f254 for instance aaf2dd48-2d9c-49ee-ae7b-3259dd565ea4 on n-h1-858384-13 Oct 18 13:43:37.217749 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-a84d2d42-bf6a-477a-b1c7-85d1316f7398 req-6a8bebd8-c87b-4cfa-b489-67d121db127a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073662 Oct 18 13:43:37.221018 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2856/5495] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:43:51.343876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:51.345474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=8 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:51.346645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:51.350567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:43:51.632680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-99887585-6f11-4098-9ca5-256c0b6cd72d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Action: 'create', calling method: .version_select at 0x7ff60f07aee0>, body: {"keypair": {"name": "tempest-keypair-1479360903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBveEMCRZ/cs0i3bq/Q8zi1A2C0ovLpnveWv/RlFc5Fj9d7/8ATTk0hZEoRUeLp5ZJ0TbupndRDfaio8RLdbiqKrV6cRMPc6GHN9aCPedpk95anpnjT2qha3Mt6vrtW5Gw=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:43:51.696802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-99887585-6f11-4098-9ca5-256c0b6cd72d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for project b134786f443e4760b57d3cb5842daa89. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:43:51.722923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-99887585-6f11-4098-9ca5-256c0b6cd72d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for user e1fdfb4e43ca40eabb58abe0e9bd4ea3 and project b134786f443e4760b57d3cb5842daa89. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:43:51.783176 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-99887585-6f11-4098-9ca5-256c0b6cd72d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.446207 Oct 18 13:43:51.791232 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2640/5496] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:43:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:02.638181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:02.640150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:02.641236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:02.649765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-913241501", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e79f1988-366e-4b47-8001-6022e690ef28"}], "security_groups": [{"name": "tempest-securitygroup--1693729071"}], "key_name": "tempest-keypair-1479360903", "user_data": "}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:02.972789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] validate_networks() for [('e79f1988-366e-4b47-8001-6022e690ef28', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:44:05.012602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:44:05.013160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:44:05.015443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:44:05.015884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:44:05.016323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:44:05.044432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:05.044921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:05.045386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:05.051912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:05.052700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:05.053160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:05.104714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for project b134786f443e4760b57d3cb5842daa89. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:44:05.122315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for user e1fdfb4e43ca40eabb58abe0e9bd4ea3 and project b134786f443e4760b57d3cb5842daa89. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:44:05.145687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:44:05.149689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:44:05.293119 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-27d2ffec-6aa0-49ae-8584-5f7651a75cc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.657029 Oct 18 13:44:05.302290 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2857/5497] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 2667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:44:05.313337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:05.314550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:05.324358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0d756602-5f1e-4584-860d-498dc734883e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:05.329441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0d756602-5f1e-4584-860d-498dc734883e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:05.658773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0d756602-5f1e-4584-860d-498dc734883e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:05.668367 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0d756602-5f1e-4584-860d-498dc734883e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1241 microversion: 2.1 time: 0.358091 Oct 18 13:44:05.670499 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2641/5498] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:05 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1241 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:06.694089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-67c6aa64-c156-43ae-ac5d-3dac8e5c72f2 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:06.694731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-67c6aa64-c156-43ae-ac5d-3dac8e5c72f2 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:06.723352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67c6aa64-c156-43ae-ac5d-3dac8e5c72f2 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:06.724078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67c6aa64-c156-43ae-ac5d-3dac8e5c72f2 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:06.724779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67c6aa64-c156-43ae-ac5d-3dac8e5c72f2 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:06.726310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67c6aa64-c156-43ae-ac5d-3dac8e5c72f2 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:06.727758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67c6aa64-c156-43ae-ac5d-3dac8e5c72f2 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:06.728394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67c6aa64-c156-43ae-ac5d-3dac8e5c72f2 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:06.917816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-67c6aa64-c156-43ae-ac5d-3dac8e5c72f2 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:06.939312 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-67c6aa64-c156-43ae-ac5d-3dac8e5c72f2 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1293 microversion: 2.1 time: 0.250851 Oct 18 13:44:06.943550 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2858/5499] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:06 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1293 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:07.971412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-493d48a3-472a-4786-82cd-5fad9830d5db tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:07.972019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-493d48a3-472a-4786-82cd-5fad9830d5db tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:07.978741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-493d48a3-472a-4786-82cd-5fad9830d5db tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:07.979217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-493d48a3-472a-4786-82cd-5fad9830d5db tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:07.979651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-493d48a3-472a-4786-82cd-5fad9830d5db tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:07.980428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-493d48a3-472a-4786-82cd-5fad9830d5db tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:07.980782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-493d48a3-472a-4786-82cd-5fad9830d5db tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:07.981245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-493d48a3-472a-4786-82cd-5fad9830d5db tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:08.229696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-493d48a3-472a-4786-82cd-5fad9830d5db tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:08.246426 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-493d48a3-472a-4786-82cd-5fad9830d5db tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1299 microversion: 2.1 time: 0.281835 Oct 18 13:44:08.249687 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2642/5500] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:07 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1299 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:09.274734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e02e3548-659c-42d2-acb5-4a206fbee8b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:09.276358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e02e3548-659c-42d2-acb5-4a206fbee8b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:09.296263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e02e3548-659c-42d2-acb5-4a206fbee8b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:09.297742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e02e3548-659c-42d2-acb5-4a206fbee8b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:09.298183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e02e3548-659c-42d2-acb5-4a206fbee8b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:09.300380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e02e3548-659c-42d2-acb5-4a206fbee8b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:09.300872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e02e3548-659c-42d2-acb5-4a206fbee8b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:09.302307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e02e3548-659c-42d2-acb5-4a206fbee8b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:10.017543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e02e3548-659c-42d2-acb5-4a206fbee8b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:10.031442 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e02e3548-659c-42d2-acb5-4a206fbee8b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1367 microversion: 2.1 time: 0.760713 Oct 18 13:44:10.033767 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2859/5501] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:09 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1367 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:11.061113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9ad25f0f-a595-42ed-bb5d-da291339f886 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:11.062684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9ad25f0f-a595-42ed-bb5d-da291339f886 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:11.075968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ad25f0f-a595-42ed-bb5d-da291339f886 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:11.076701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ad25f0f-a595-42ed-bb5d-da291339f886 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:11.077585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ad25f0f-a595-42ed-bb5d-da291339f886 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:11.085042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ad25f0f-a595-42ed-bb5d-da291339f886 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:11.085739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ad25f0f-a595-42ed-bb5d-da291339f886 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:11.086324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ad25f0f-a595-42ed-bb5d-da291339f886 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:11.942853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9ad25f0f-a595-42ed-bb5d-da291339f886 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:11.958379 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9ad25f0f-a595-42ed-bb5d-da291339f886 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1367 microversion: 2.1 time: 0.902437 Oct 18 13:44:11.983739 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2643/5502] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:11 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1367 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:13.015900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-44d63a22-d577-484e-8fb4-89b381169630 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:13.016563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-44d63a22-d577-484e-8fb4-89b381169630 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:13.070802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-44d63a22-d577-484e-8fb4-89b381169630 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:13.078224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-44d63a22-d577-484e-8fb4-89b381169630 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:13.083106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-44d63a22-d577-484e-8fb4-89b381169630 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:13.084601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-44d63a22-d577-484e-8fb4-89b381169630 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:13.085737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-44d63a22-d577-484e-8fb4-89b381169630 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:13.090849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-44d63a22-d577-484e-8fb4-89b381169630 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:13.930583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-44d63a22-d577-484e-8fb4-89b381169630 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:13.965430 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-44d63a22-d577-484e-8fb4-89b381169630 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1367 microversion: 2.1 time: 0.970698 Oct 18 13:44:13.966275 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2860/5503] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:12 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1367 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:14.992670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e78872c1-2d2f-45af-a314-6f1cae36a517 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:14.994472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e78872c1-2d2f-45af-a314-6f1cae36a517 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:15.038807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e78872c1-2d2f-45af-a314-6f1cae36a517 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:15.041218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e78872c1-2d2f-45af-a314-6f1cae36a517 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:15.041218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e78872c1-2d2f-45af-a314-6f1cae36a517 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:15.041218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e78872c1-2d2f-45af-a314-6f1cae36a517 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:15.043038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e78872c1-2d2f-45af-a314-6f1cae36a517 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:15.043508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e78872c1-2d2f-45af-a314-6f1cae36a517 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:15.663322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:15.899905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:15.903259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:16.444009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1184496778", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "bd77ba9d-3148-4782-bde0-6863ddecfe49"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:16.561920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] validate_networks() for [('bd77ba9d-3148-4782-bde0-6863ddecfe49', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:44:16.783465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e78872c1-2d2f-45af-a314-6f1cae36a517 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:16.792367 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e78872c1-2d2f-45af-a314-6f1cae36a517 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1367 microversion: 2.1 time: 1.804280 Oct 18 13:44:16.792965 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2644/5504] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:14 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1367 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:17.100588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-76e6fb7e-1584-4d1c-8878-ee3d4d683943 req-9e6fd7c5-e632-491d-9ee0-732e5af4f959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee304341-74a8-4ded-a4a4-0ddb13f16002", "tag": "7a31afc9-ee4a-4c22-97a1-875b9e65a1b3"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:17.126671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-76e6fb7e-1584-4d1c-8878-ee3d4d683943 req-9e6fd7c5-e632-491d-9ee0-732e5af4f959 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:17.129796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-76e6fb7e-1584-4d1c-8878-ee3d4d683943 req-9e6fd7c5-e632-491d-9ee0-732e5af4f959 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:17.130451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-76e6fb7e-1584-4d1c-8878-ee3d4d683943 req-9e6fd7c5-e632-491d-9ee0-732e5af4f959 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:17.177858 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-76e6fb7e-1584-4d1c-8878-ee3d4d683943 req-9e6fd7c5-e632-491d-9ee0-732e5af4f959 service nova] Creating event network-changed:7a31afc9-ee4a-4c22-97a1-875b9e65a1b3 for instance ee304341-74a8-4ded-a4a4-0ddb13f16002 on n-h1-858384-13 Oct 18 13:44:17.197328 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-76e6fb7e-1584-4d1c-8878-ee3d4d683943 req-9e6fd7c5-e632-491d-9ee0-732e5af4f959 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093494 Oct 18 13:44:17.200019 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2645/5505] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:44:17.587331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:44:17.588076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:44:17.588721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:44:17.589247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:44:17.589906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:44:17.624507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:17.625021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:17.629693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:17.633357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:17.635412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:17.635896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:17.700033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Getting quotas for project 643c51d6505446ec8b122fb00a0ecc9d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:44:17.715297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Getting quotas for user 6fefa11f2d5b4562a5799c1ed2174e5e and project 643c51d6505446ec8b122fb00a0ecc9d. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:44:17.748639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Going to run 2 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:44:17.752513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 404908b7-8abf-4e2c-b894-70002cf94cd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:44:17.817574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-83dcd61e-8694-4e08-aafd-cf9803b776bf tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:17.819064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-83dcd61e-8694-4e08-aafd-cf9803b776bf tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:17.829008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83dcd61e-8694-4e08-aafd-cf9803b776bf tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:17.839903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83dcd61e-8694-4e08-aafd-cf9803b776bf tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:17.840927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83dcd61e-8694-4e08-aafd-cf9803b776bf tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:17.843083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=404908b7-8abf-4e2c-b894-70002cf94cd0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:44:17.844152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83dcd61e-8694-4e08-aafd-cf9803b776bf tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:17.845489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83dcd61e-8694-4e08-aafd-cf9803b776bf tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:17.847225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83dcd61e-8694-4e08-aafd-cf9803b776bf tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:17.941246 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-245c6db6-ca85-4a39-95bc-2e6ad745f2d6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.045471 Oct 18 13:44:17.942752 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2861/5506] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:44:17.960782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-875bb2f6-3a6a-41af-bd1f-ef44dc90f1e8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:17.969132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-875bb2f6-3a6a-41af-bd1f-ef44dc90f1e8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:17.971317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-875bb2f6-3a6a-41af-bd1f-ef44dc90f1e8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Searching by: {'deleted': False, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:44:18.000731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-875bb2f6-3a6a-41af-bd1f-ef44dc90f1e8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:18.002846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-875bb2f6-3a6a-41af-bd1f-ef44dc90f1e8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:18.004333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-875bb2f6-3a6a-41af-bd1f-ef44dc90f1e8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:18.006063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-875bb2f6-3a6a-41af-bd1f-ef44dc90f1e8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:18.008695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-875bb2f6-3a6a-41af-bd1f-ef44dc90f1e8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:18.010018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-875bb2f6-3a6a-41af-bd1f-ef44dc90f1e8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:18.055681 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-875bb2f6-3a6a-41af-bd1f-ef44dc90f1e8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.099330 Oct 18 13:44:18.068214 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2862/5507] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 13:44:17 2022] GET /compute/v2.1/servers => generated 677 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:18.085878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-18bca0a9-bd7f-45bc-8745-a52ec7f241dd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:18.086664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-18bca0a9-bd7f-45bc-8745-a52ec7f241dd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:18.366388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-18bca0a9-bd7f-45bc-8745-a52ec7f241dd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:18.385145 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-18bca0a9-bd7f-45bc-8745-a52ec7f241dd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1220 microversion: 2.1 time: 0.305607 Oct 18 13:44:18.386169 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2863/5508] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:18 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1220 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:18.795237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-83dcd61e-8694-4e08-aafd-cf9803b776bf tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:18.817357 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-83dcd61e-8694-4e08-aafd-cf9803b776bf tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1367 microversion: 2.1 time: 1.003268 Oct 18 13:44:18.819422 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2646/5509] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:17 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1367 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:19.408176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8bd3d148-2a1b-44ca-826c-6654da1774f8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:19.409518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8bd3d148-2a1b-44ca-826c-6654da1774f8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:19.690585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8bd3d148-2a1b-44ca-826c-6654da1774f8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:19.732313 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8bd3d148-2a1b-44ca-826c-6654da1774f8 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1220 microversion: 2.1 time: 0.323515 Oct 18 13:44:19.735431 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2864/5510] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:19 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1220 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:19.850537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b969d62b-d07f-49b5-b913-e2167557b626 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:19.866230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b969d62b-d07f-49b5-b913-e2167557b626 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:19.881131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b969d62b-d07f-49b5-b913-e2167557b626 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:19.882619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b969d62b-d07f-49b5-b913-e2167557b626 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:19.883191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b969d62b-d07f-49b5-b913-e2167557b626 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:19.886387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b969d62b-d07f-49b5-b913-e2167557b626 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:19.887007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b969d62b-d07f-49b5-b913-e2167557b626 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:19.887544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b969d62b-d07f-49b5-b913-e2167557b626 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:20.593788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b969d62b-d07f-49b5-b913-e2167557b626 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:20.608390 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b969d62b-d07f-49b5-b913-e2167557b626 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1367 microversion: 2.1 time: 0.763871 Oct 18 13:44:20.609747 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2647/5511] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:19 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1367 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:20.763330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-946bdd30-5b14-4989-93ef-4051195401ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:20.763938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-946bdd30-5b14-4989-93ef-4051195401ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:20.784040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946bdd30-5b14-4989-93ef-4051195401ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:20.784592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946bdd30-5b14-4989-93ef-4051195401ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:20.788608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946bdd30-5b14-4989-93ef-4051195401ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:20.789394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946bdd30-5b14-4989-93ef-4051195401ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:20.790033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946bdd30-5b14-4989-93ef-4051195401ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:20.790716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-946bdd30-5b14-4989-93ef-4051195401ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:21.203777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-946bdd30-5b14-4989-93ef-4051195401ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:21.235299 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-946bdd30-5b14-4989-93ef-4051195401ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1224 microversion: 2.1 time: 0.470083 Oct 18 13:44:21.239093 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2865/5512] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:20 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1224 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:21.631907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-be389376-df3a-46d3-aa03-57d721dcc594 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:21.633343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-be389376-df3a-46d3-aa03-57d721dcc594 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:21.648344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be389376-df3a-46d3-aa03-57d721dcc594 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:21.649276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be389376-df3a-46d3-aa03-57d721dcc594 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:21.652748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be389376-df3a-46d3-aa03-57d721dcc594 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:21.653874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be389376-df3a-46d3-aa03-57d721dcc594 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:21.654500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be389376-df3a-46d3-aa03-57d721dcc594 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:21.656492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be389376-df3a-46d3-aa03-57d721dcc594 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:22.266821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-efe0bf02-4e76-461f-9247-65e47177d164 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:22.268640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-efe0bf02-4e76-461f-9247-65e47177d164 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:22.288534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efe0bf02-4e76-461f-9247-65e47177d164 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:22.293154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efe0bf02-4e76-461f-9247-65e47177d164 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:22.295137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efe0bf02-4e76-461f-9247-65e47177d164 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:22.298139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efe0bf02-4e76-461f-9247-65e47177d164 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:22.299449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efe0bf02-4e76-461f-9247-65e47177d164 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:22.302064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-be389376-df3a-46d3-aa03-57d721dcc594 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:22.303062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efe0bf02-4e76-461f-9247-65e47177d164 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:22.317110 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-be389376-df3a-46d3-aa03-57d721dcc594 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1367 microversion: 2.1 time: 0.689003 Oct 18 13:44:22.317760 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2648/5513] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:21 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1367 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:22.563408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-efe0bf02-4e76-461f-9247-65e47177d164 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:22.575654 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-efe0bf02-4e76-461f-9247-65e47177d164 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1272 microversion: 2.1 time: 0.316316 Oct 18 13:44:22.579884 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2866/5514] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:22 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1272 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:23.345405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-19f43bc3-8cdb-4cb4-b4d4-9f439e9a6d52 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:23.346521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-19f43bc3-8cdb-4cb4-b4d4-9f439e9a6d52 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:23.356593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19f43bc3-8cdb-4cb4-b4d4-9f439e9a6d52 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:23.359438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19f43bc3-8cdb-4cb4-b4d4-9f439e9a6d52 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:23.361743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19f43bc3-8cdb-4cb4-b4d4-9f439e9a6d52 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:23.362681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19f43bc3-8cdb-4cb4-b4d4-9f439e9a6d52 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:23.363661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19f43bc3-8cdb-4cb4-b4d4-9f439e9a6d52 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:23.366768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19f43bc3-8cdb-4cb4-b4d4-9f439e9a6d52 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:23.604178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-24f73b4d-9b82-4dc1-a401-6ab6abb4d5ea tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:23.604922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-24f73b4d-9b82-4dc1-a401-6ab6abb4d5ea tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:23.616002 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 13:44:23.616809 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 13:44:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 (ip 10.222.0.40) !!! Oct 18 13:44:23.625610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24f73b4d-9b82-4dc1-a401-6ab6abb4d5ea tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:23.626454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24f73b4d-9b82-4dc1-a401-6ab6abb4d5ea tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:23.627267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24f73b4d-9b82-4dc1-a401-6ab6abb4d5ea tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:23.629569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24f73b4d-9b82-4dc1-a401-6ab6abb4d5ea tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:23.630257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24f73b4d-9b82-4dc1-a401-6ab6abb4d5ea tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:23.631304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24f73b4d-9b82-4dc1-a401-6ab6abb4d5ea tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:23.889349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-24f73b4d-9b82-4dc1-a401-6ab6abb4d5ea tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:23.901115 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-24f73b4d-9b82-4dc1-a401-6ab6abb4d5ea tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1278 microversion: 2.1 time: 0.299728 Oct 18 13:44:23.903072 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2867/5515] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:23 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1278 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:24.325050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-19f43bc3-8cdb-4cb4-b4d4-9f439e9a6d52 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:24.335974 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-19f43bc3-8cdb-4cb4-b4d4-9f439e9a6d52 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1367 microversion: 2.1 time: 0.995359 Oct 18 13:44:24.341514 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2649/5516] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:23 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1367 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:24.930228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b98b6282-62b1-4bc7-9390-f67ecd1b2eff tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:24.935041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b98b6282-62b1-4bc7-9390-f67ecd1b2eff tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:24.959426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b98b6282-62b1-4bc7-9390-f67ecd1b2eff tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:24.961216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b98b6282-62b1-4bc7-9390-f67ecd1b2eff tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:24.963244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b98b6282-62b1-4bc7-9390-f67ecd1b2eff tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:24.966654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b98b6282-62b1-4bc7-9390-f67ecd1b2eff tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:24.967383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b98b6282-62b1-4bc7-9390-f67ecd1b2eff tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:24.968901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b98b6282-62b1-4bc7-9390-f67ecd1b2eff tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:25.367618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-03687c3b-edc6-49bb-89b2-a00b36451df9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:25.368917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-03687c3b-edc6-49bb-89b2-a00b36451df9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:25.405040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03687c3b-edc6-49bb-89b2-a00b36451df9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:25.411115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03687c3b-edc6-49bb-89b2-a00b36451df9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:25.413493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03687c3b-edc6-49bb-89b2-a00b36451df9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:25.414413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03687c3b-edc6-49bb-89b2-a00b36451df9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:25.416068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03687c3b-edc6-49bb-89b2-a00b36451df9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:25.449831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03687c3b-edc6-49bb-89b2-a00b36451df9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:25.929055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b98b6282-62b1-4bc7-9390-f67ecd1b2eff tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:25.942283 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b98b6282-62b1-4bc7-9390-f67ecd1b2eff tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1278 microversion: 2.1 time: 1.016855 Oct 18 13:44:25.942965 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2868/5517] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:24 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1278 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:26.105327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-03687c3b-edc6-49bb-89b2-a00b36451df9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:26.119792 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-03687c3b-edc6-49bb-89b2-a00b36451df9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1367 microversion: 2.1 time: 0.757933 Oct 18 13:44:26.122945 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2650/5518] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:25 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1367 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:26.968149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-221cfda3-d96d-45eb-b930-bd08a41d5f1a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:26.969526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-221cfda3-d96d-45eb-b930-bd08a41d5f1a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:26.979188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-221cfda3-d96d-45eb-b930-bd08a41d5f1a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:26.979944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-221cfda3-d96d-45eb-b930-bd08a41d5f1a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:26.980541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-221cfda3-d96d-45eb-b930-bd08a41d5f1a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:26.981466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-221cfda3-d96d-45eb-b930-bd08a41d5f1a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:26.985880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-221cfda3-d96d-45eb-b930-bd08a41d5f1a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:26.986556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-221cfda3-d96d-45eb-b930-bd08a41d5f1a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:27.160262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e80068c5-1cd7-4976-a402-001fa7ae5007 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:27.161241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e80068c5-1cd7-4976-a402-001fa7ae5007 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:27.190220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e80068c5-1cd7-4976-a402-001fa7ae5007 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:27.192431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e80068c5-1cd7-4976-a402-001fa7ae5007 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:27.193677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e80068c5-1cd7-4976-a402-001fa7ae5007 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:27.212699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e80068c5-1cd7-4976-a402-001fa7ae5007 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:27.214845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e80068c5-1cd7-4976-a402-001fa7ae5007 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:27.217903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e80068c5-1cd7-4976-a402-001fa7ae5007 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:27.515515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-221cfda3-d96d-45eb-b930-bd08a41d5f1a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:27.527740 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-221cfda3-d96d-45eb-b930-bd08a41d5f1a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1278 microversion: 2.1 time: 0.563364 Oct 18 13:44:27.559857 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2869/5519] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:26 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1278 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:28.567439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dab157b3-2a25-4667-819d-91a3f1948d54 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:28.568068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dab157b3-2a25-4667-819d-91a3f1948d54 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:28.572747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:28.588738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dab157b3-2a25-4667-819d-91a3f1948d54 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:28.589569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dab157b3-2a25-4667-819d-91a3f1948d54 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:28.590216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dab157b3-2a25-4667-819d-91a3f1948d54 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:28.591123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dab157b3-2a25-4667-819d-91a3f1948d54 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:28.591750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dab157b3-2a25-4667-819d-91a3f1948d54 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:28.592335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dab157b3-2a25-4667-819d-91a3f1948d54 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:29.069945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e80068c5-1cd7-4976-a402-001fa7ae5007 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:29.100242 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e80068c5-1cd7-4976-a402-001fa7ae5007 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1367 microversion: 2.1 time: 1.938697 Oct 18 13:44:29.102910 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2651/5520] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:27 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1367 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:29.180072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dab157b3-2a25-4667-819d-91a3f1948d54 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:29.213991 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dab157b3-2a25-4667-819d-91a3f1948d54 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1320 microversion: 2.1 time: 0.650604 Oct 18 13:44:29.235403 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2870/5521] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:28 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1320 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:44:29.240435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-92b0242e-ecc9-493f-8a1e-9e2837c6b7d9 req-9d95e2f6-59ad-40bd-a35d-682bab28b377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee304341-74a8-4ded-a4a4-0ddb13f16002", "name": "network-vif-plugged", "status": "completed", "tag": "7a31afc9-ee4a-4c22-97a1-875b9e65a1b3"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:29.267320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-92b0242e-ecc9-493f-8a1e-9e2837c6b7d9 req-9d95e2f6-59ad-40bd-a35d-682bab28b377 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:29.268281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-92b0242e-ecc9-493f-8a1e-9e2837c6b7d9 req-9d95e2f6-59ad-40bd-a35d-682bab28b377 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:29.269958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-92b0242e-ecc9-493f-8a1e-9e2837c6b7d9 req-9d95e2f6-59ad-40bd-a35d-682bab28b377 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:29.306789 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-92b0242e-ecc9-493f-8a1e-9e2837c6b7d9 req-9d95e2f6-59ad-40bd-a35d-682bab28b377 service nova] Creating event network-vif-plugged:7a31afc9-ee4a-4c22-97a1-875b9e65a1b3 for instance ee304341-74a8-4ded-a4a4-0ddb13f16002 on n-h1-858384-13 Oct 18 13:44:29.318350 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-92b0242e-ecc9-493f-8a1e-9e2837c6b7d9 req-9d95e2f6-59ad-40bd-a35d-682bab28b377 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082568 Oct 18 13:44:29.321802 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2652/5522] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:30.132591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-112e2986-c6c4-4db4-8aff-1ed1c74c59a7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:30.134385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-112e2986-c6c4-4db4-8aff-1ed1c74c59a7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:30.151092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=10 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:30.162654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-112e2986-c6c4-4db4-8aff-1ed1c74c59a7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:30.163285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-112e2986-c6c4-4db4-8aff-1ed1c74c59a7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:30.163576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-112e2986-c6c4-4db4-8aff-1ed1c74c59a7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:30.168240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-112e2986-c6c4-4db4-8aff-1ed1c74c59a7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:30.169091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-112e2986-c6c4-4db4-8aff-1ed1c74c59a7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:30.169271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-112e2986-c6c4-4db4-8aff-1ed1c74c59a7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:30.247592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-086d8816-3975-4218-9797-241692d0c043 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:30.248828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-086d8816-3975-4218-9797-241692d0c043 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:30.270447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-086d8816-3975-4218-9797-241692d0c043 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:30.270946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-086d8816-3975-4218-9797-241692d0c043 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:30.271380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-086d8816-3975-4218-9797-241692d0c043 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:30.277475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-086d8816-3975-4218-9797-241692d0c043 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:30.277966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-086d8816-3975-4218-9797-241692d0c043 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:30.278430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-086d8816-3975-4218-9797-241692d0c043 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:30.934725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-112e2986-c6c4-4db4-8aff-1ed1c74c59a7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:30.949990 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-112e2986-c6c4-4db4-8aff-1ed1c74c59a7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1367 microversion: 2.1 time: 0.825573 Oct 18 13:44:30.950599 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2871/5523] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:30 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1367 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:30.966876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-086d8816-3975-4218-9797-241692d0c043 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:30.975538 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-086d8816-3975-4218-9797-241692d0c043 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1320 microversion: 2.1 time: 0.736060 Oct 18 13:44:30.998990 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2653/5524] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:30 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1320 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:31.368371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-37c5ad15-cd7c-4cdf-9ad6-7538ac1def2d req-5d690753-4459-4cc4-a107-13c4cfece379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404908b7-8abf-4e2c-b894-70002cf94cd0", "tag": "5f210485-0806-48a4-bef0-b92250aa8f25"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:31.403292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-37c5ad15-cd7c-4cdf-9ad6-7538ac1def2d req-5d690753-4459-4cc4-a107-13c4cfece379 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:31.403787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-37c5ad15-cd7c-4cdf-9ad6-7538ac1def2d req-5d690753-4459-4cc4-a107-13c4cfece379 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:31.404222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-37c5ad15-cd7c-4cdf-9ad6-7538ac1def2d req-5d690753-4459-4cc4-a107-13c4cfece379 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:31.435247 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-37c5ad15-cd7c-4cdf-9ad6-7538ac1def2d req-5d690753-4459-4cc4-a107-13c4cfece379 service nova] Creating event network-changed:5f210485-0806-48a4-bef0-b92250aa8f25 for instance 404908b7-8abf-4e2c-b894-70002cf94cd0 on n-h2-858384-13 Oct 18 13:44:31.443122 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-37c5ad15-cd7c-4cdf-9ad6-7538ac1def2d req-5d690753-4459-4cc4-a107-13c4cfece379 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078864 Oct 18 13:44:31.443731 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2872/5525] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:31.673113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e9346940-49bf-4c4a-ba0e-922153c8f193 req-afc39da7-c9d3-4096-829d-bb7f6add8ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16c7458-63f3-4573-be23-ad3e8d856560", "tag": "5c0fb521-951e-4e74-b1fc-738820256522"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:31.693698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e9346940-49bf-4c4a-ba0e-922153c8f193 req-afc39da7-c9d3-4096-829d-bb7f6add8ad8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:31.694972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e9346940-49bf-4c4a-ba0e-922153c8f193 req-afc39da7-c9d3-4096-829d-bb7f6add8ad8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:31.699695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e9346940-49bf-4c4a-ba0e-922153c8f193 req-afc39da7-c9d3-4096-829d-bb7f6add8ad8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:31.732017 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e9346940-49bf-4c4a-ba0e-922153c8f193 req-afc39da7-c9d3-4096-829d-bb7f6add8ad8 service nova] Creating event network-changed:5c0fb521-951e-4e74-b1fc-738820256522 for instance f16c7458-63f3-4573-be23-ad3e8d856560 on n-h1-858384-13 Oct 18 13:44:31.741599 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e9346940-49bf-4c4a-ba0e-922153c8f193 req-afc39da7-c9d3-4096-829d-bb7f6add8ad8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074353 Oct 18 13:44:31.742869 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2654/5526] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:44:31.974186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-66a80a23-d635-47bf-b86b-b1ed7ec574bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:31.975155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-66a80a23-d635-47bf-b86b-b1ed7ec574bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:31.986432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66a80a23-d635-47bf-b86b-b1ed7ec574bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:31.994099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66a80a23-d635-47bf-b86b-b1ed7ec574bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:31.994747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66a80a23-d635-47bf-b86b-b1ed7ec574bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:31.995656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66a80a23-d635-47bf-b86b-b1ed7ec574bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:31.996323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66a80a23-d635-47bf-b86b-b1ed7ec574bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:31.996915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66a80a23-d635-47bf-b86b-b1ed7ec574bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:32.006828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7d114da7-e91d-4ffc-b2af-c54e7499a498 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:32.007536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7d114da7-e91d-4ffc-b2af-c54e7499a498 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:32.021009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d114da7-e91d-4ffc-b2af-c54e7499a498 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:32.024093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d114da7-e91d-4ffc-b2af-c54e7499a498 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:32.024579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d114da7-e91d-4ffc-b2af-c54e7499a498 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:32.025331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d114da7-e91d-4ffc-b2af-c54e7499a498 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:32.025804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d114da7-e91d-4ffc-b2af-c54e7499a498 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:32.026244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d114da7-e91d-4ffc-b2af-c54e7499a498 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:33.073465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7d114da7-e91d-4ffc-b2af-c54e7499a498 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:33.117207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-66a80a23-d635-47bf-b86b-b1ed7ec574bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:33.125279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=73 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:33.126335 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7d114da7-e91d-4ffc-b2af-c54e7499a498 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1320 microversion: 2.1 time: 1.114547 Oct 18 13:44:33.130579 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2655/5527] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:32 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1320 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:33.132628 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-66a80a23-d635-47bf-b86b-b1ed7ec574bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1556 microversion: 2.1 time: 1.161098 Oct 18 13:44:33.133707 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2873/5528] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:31 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1556 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:33.169509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16b0a627-921b-4ada-b8b6-34d8d43e0a97 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:33.170452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-16b0a627-921b-4ada-b8b6-34d8d43e0a97 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:33.190117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b0a627-921b-4ada-b8b6-34d8d43e0a97 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:33.190840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b0a627-921b-4ada-b8b6-34d8d43e0a97 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:33.191288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b0a627-921b-4ada-b8b6-34d8d43e0a97 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:33.193099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b0a627-921b-4ada-b8b6-34d8d43e0a97 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:33.194188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b0a627-921b-4ada-b8b6-34d8d43e0a97 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:33.194492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b0a627-921b-4ada-b8b6-34d8d43e0a97 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:33.535995 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-16b0a627-921b-4ada-b8b6-34d8d43e0a97 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.372468 Oct 18 13:44:33.537284 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2656/5529] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:44:33 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-interface => generated 284 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:34.156621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-78bd84e0-be4c-4f14-aaab-af76503ddb22 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:34.158060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-78bd84e0-be4c-4f14-aaab-af76503ddb22 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:34.195792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=9 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:34.198712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78bd84e0-be4c-4f14-aaab-af76503ddb22 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:34.199486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78bd84e0-be4c-4f14-aaab-af76503ddb22 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:34.200158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78bd84e0-be4c-4f14-aaab-af76503ddb22 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:34.202765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78bd84e0-be4c-4f14-aaab-af76503ddb22 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:34.205387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78bd84e0-be4c-4f14-aaab-af76503ddb22 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:34.206123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78bd84e0-be4c-4f14-aaab-af76503ddb22 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:34.888670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-78bd84e0-be4c-4f14-aaab-af76503ddb22 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:34.902230 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-78bd84e0-be4c-4f14-aaab-af76503ddb22 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1320 microversion: 2.1 time: 0.750766 Oct 18 13:44:34.903073 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2874/5530] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:34 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1320 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:35.935111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad4aaac4-0598-428c-b9a9-9a37fc761c09 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:35.935726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ad4aaac4-0598-428c-b9a9-9a37fc761c09 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:35.954926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=35 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:35.957166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad4aaac4-0598-428c-b9a9-9a37fc761c09 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:35.957697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad4aaac4-0598-428c-b9a9-9a37fc761c09 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:35.958139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad4aaac4-0598-428c-b9a9-9a37fc761c09 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:35.958898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad4aaac4-0598-428c-b9a9-9a37fc761c09 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:35.959350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad4aaac4-0598-428c-b9a9-9a37fc761c09 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:35.959775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad4aaac4-0598-428c-b9a9-9a37fc761c09 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:35.972648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=77 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:44:36.897010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad4aaac4-0598-428c-b9a9-9a37fc761c09 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:36.913045 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad4aaac4-0598-428c-b9a9-9a37fc761c09 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1320 microversion: 2.1 time: 0.979007 Oct 18 13:44:36.913985 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2657/5531] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:35 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1320 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:37.853148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-19fc9be8-72a6-4c2b-9217-8e00a9ba983e req-15f48263-5bed-4aaf-ba5e-5cdce99e6a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404908b7-8abf-4e2c-b894-70002cf94cd0", "name": "network-vif-plugged", "status": "completed", "tag": "5f210485-0806-48a4-bef0-b92250aa8f25"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:37.877499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-19fc9be8-72a6-4c2b-9217-8e00a9ba983e req-15f48263-5bed-4aaf-ba5e-5cdce99e6a1a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:37.877985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-19fc9be8-72a6-4c2b-9217-8e00a9ba983e req-15f48263-5bed-4aaf-ba5e-5cdce99e6a1a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:37.878420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-19fc9be8-72a6-4c2b-9217-8e00a9ba983e req-15f48263-5bed-4aaf-ba5e-5cdce99e6a1a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:37.899195 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-19fc9be8-72a6-4c2b-9217-8e00a9ba983e req-15f48263-5bed-4aaf-ba5e-5cdce99e6a1a service nova] Creating event network-vif-plugged:5f210485-0806-48a4-bef0-b92250aa8f25 for instance 404908b7-8abf-4e2c-b894-70002cf94cd0 on n-h2-858384-13 Oct 18 13:44:37.917437 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-19fc9be8-72a6-4c2b-9217-8e00a9ba983e req-15f48263-5bed-4aaf-ba5e-5cdce99e6a1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068753 Oct 18 13:44:37.918333 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2875/5532] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:37.939782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ba6c2c39-d423-4fe5-a482-1c61bdba1531 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:37.940406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ba6c2c39-d423-4fe5-a482-1c61bdba1531 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:37.962571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba6c2c39-d423-4fe5-a482-1c61bdba1531 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:37.964229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba6c2c39-d423-4fe5-a482-1c61bdba1531 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:37.965769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba6c2c39-d423-4fe5-a482-1c61bdba1531 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:37.968962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba6c2c39-d423-4fe5-a482-1c61bdba1531 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:37.969645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba6c2c39-d423-4fe5-a482-1c61bdba1531 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:37.972128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba6c2c39-d423-4fe5-a482-1c61bdba1531 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:38.587435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-2ff95e73-f540-404e-b077-f08b9dd37c6c req-1f77f3f8-3eb5-443b-a44d-63f37e17d8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee304341-74a8-4ded-a4a4-0ddb13f16002", "tag": "7a31afc9-ee4a-4c22-97a1-875b9e65a1b3"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:38.587721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ba6c2c39-d423-4fe5-a482-1c61bdba1531 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:38.597775 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ba6c2c39-d423-4fe5-a482-1c61bdba1531 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1320 microversion: 2.1 time: 0.662878 Oct 18 13:44:38.618389 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2658/5533] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:37 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1320 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:38.618579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2ff95e73-f540-404e-b077-f08b9dd37c6c req-1f77f3f8-3eb5-443b-a44d-63f37e17d8e5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:38.619129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2ff95e73-f540-404e-b077-f08b9dd37c6c req-1f77f3f8-3eb5-443b-a44d-63f37e17d8e5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:38.619671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2ff95e73-f540-404e-b077-f08b9dd37c6c req-1f77f3f8-3eb5-443b-a44d-63f37e17d8e5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:38.652284 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-2ff95e73-f540-404e-b077-f08b9dd37c6c req-1f77f3f8-3eb5-443b-a44d-63f37e17d8e5 service nova] Creating event network-changed:7a31afc9-ee4a-4c22-97a1-875b9e65a1b3 for instance ee304341-74a8-4ded-a4a4-0ddb13f16002 on n-h1-858384-13 Oct 18 13:44:38.683306 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-2ff95e73-f540-404e-b077-f08b9dd37c6c req-1f77f3f8-3eb5-443b-a44d-63f37e17d8e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101317 Oct 18 13:44:38.684567 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2876/5534] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:44:39.625640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d04737e2-a95a-4414-b191-7247c35ff5ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:39.626270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d04737e2-a95a-4414-b191-7247c35ff5ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:39.654064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d04737e2-a95a-4414-b191-7247c35ff5ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:39.654763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d04737e2-a95a-4414-b191-7247c35ff5ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:39.655466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d04737e2-a95a-4414-b191-7247c35ff5ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:39.656324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d04737e2-a95a-4414-b191-7247c35ff5ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:39.656973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d04737e2-a95a-4414-b191-7247c35ff5ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:39.657426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d04737e2-a95a-4414-b191-7247c35ff5ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:39.928483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d04737e2-a95a-4414-b191-7247c35ff5ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:39.952715 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d04737e2-a95a-4414-b191-7247c35ff5ef tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1320 microversion: 2.1 time: 0.331836 Oct 18 13:44:39.953708 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2659/5535] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:39 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1320 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:40.987735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-720a22d1-5bca-4afe-bdbd-04c1209bf1fc tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:40.990031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-720a22d1-5bca-4afe-bdbd-04c1209bf1fc tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:41.007254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-720a22d1-5bca-4afe-bdbd-04c1209bf1fc tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:41.009676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-720a22d1-5bca-4afe-bdbd-04c1209bf1fc tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:41.010542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-720a22d1-5bca-4afe-bdbd-04c1209bf1fc tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:41.016488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-720a22d1-5bca-4afe-bdbd-04c1209bf1fc tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:41.018281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-720a22d1-5bca-4afe-bdbd-04c1209bf1fc tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:41.030694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-720a22d1-5bca-4afe-bdbd-04c1209bf1fc tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:41.373685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-720a22d1-5bca-4afe-bdbd-04c1209bf1fc tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:41.390866 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-720a22d1-5bca-4afe-bdbd-04c1209bf1fc tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1320 microversion: 2.1 time: 0.418220 Oct 18 13:44:41.393908 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2877/5536] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:40 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1320 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:42.416751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-317f3f43-2495-452e-9e7f-165337802450 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:42.417490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-317f3f43-2495-452e-9e7f-165337802450 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:42.442763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-317f3f43-2495-452e-9e7f-165337802450 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:42.443257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-317f3f43-2495-452e-9e7f-165337802450 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:42.443890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-317f3f43-2495-452e-9e7f-165337802450 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:42.444770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-317f3f43-2495-452e-9e7f-165337802450 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:42.445410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-317f3f43-2495-452e-9e7f-165337802450 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:42.446032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-317f3f43-2495-452e-9e7f-165337802450 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:42.450886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d88c4a2b-5895-42ae-a65c-ee18a95afbac req-309cb2ae-e31b-4e4c-8642-285f23018547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c7458-63f3-4573-be23-ad3e8d856560", "name": "network-vif-plugged", "status": "completed", "tag": "5c0fb521-951e-4e74-b1fc-738820256522"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:42.473652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d88c4a2b-5895-42ae-a65c-ee18a95afbac req-309cb2ae-e31b-4e4c-8642-285f23018547 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:42.474413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d88c4a2b-5895-42ae-a65c-ee18a95afbac req-309cb2ae-e31b-4e4c-8642-285f23018547 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:42.475052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d88c4a2b-5895-42ae-a65c-ee18a95afbac req-309cb2ae-e31b-4e4c-8642-285f23018547 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:42.498613 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d88c4a2b-5895-42ae-a65c-ee18a95afbac req-309cb2ae-e31b-4e4c-8642-285f23018547 service nova] Creating event network-vif-plugged:5c0fb521-951e-4e74-b1fc-738820256522 for instance f16c7458-63f3-4573-be23-ad3e8d856560 on n-h1-858384-13 Oct 18 13:44:42.508324 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d88c4a2b-5895-42ae-a65c-ee18a95afbac req-309cb2ae-e31b-4e4c-8642-285f23018547 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063623 Oct 18 13:44:42.510138 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2878/5537] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:42.899681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-317f3f43-2495-452e-9e7f-165337802450 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:42.932640 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-317f3f43-2495-452e-9e7f-165337802450 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1320 microversion: 2.1 time: 0.520080 Oct 18 13:44:42.935695 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2660/5538] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:42 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1320 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:43.960739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0d75d0a9-be23-40b0-a2ce-b40122b9cd38 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:43.962405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0d75d0a9-be23-40b0-a2ce-b40122b9cd38 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:43.981837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d75d0a9-be23-40b0-a2ce-b40122b9cd38 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:43.982034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d75d0a9-be23-40b0-a2ce-b40122b9cd38 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:43.982515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d75d0a9-be23-40b0-a2ce-b40122b9cd38 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:43.985471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d75d0a9-be23-40b0-a2ce-b40122b9cd38 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:43.986319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d75d0a9-be23-40b0-a2ce-b40122b9cd38 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:43.986905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d75d0a9-be23-40b0-a2ce-b40122b9cd38 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:45.154514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0d75d0a9-be23-40b0-a2ce-b40122b9cd38 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:45.163875 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0d75d0a9-be23-40b0-a2ce-b40122b9cd38 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1320 microversion: 2.1 time: 1.207957 Oct 18 13:44:45.178743 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2879/5539] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:43 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1320 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:46.191220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a8f55fce-cf52-4688-b148-a609391922ca tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:46.191824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a8f55fce-cf52-4688-b148-a609391922ca tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:46.201957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8f55fce-cf52-4688-b148-a609391922ca tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:46.202457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8f55fce-cf52-4688-b148-a609391922ca tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:46.204095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8f55fce-cf52-4688-b148-a609391922ca tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:46.206401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8f55fce-cf52-4688-b148-a609391922ca tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:46.206552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8f55fce-cf52-4688-b148-a609391922ca tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:46.206940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8f55fce-cf52-4688-b148-a609391922ca tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:46.406781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a8f55fce-cf52-4688-b148-a609391922ca tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:46.417409 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a8f55fce-cf52-4688-b148-a609391922ca tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 200 len: 1509 microversion: 2.1 time: 0.231550 Oct 18 13:44:46.430261 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2661/5540] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:46 2022] GET /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:46.441690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-259f0337-9fd1-4b8f-a9cf-6be4a1d41f75 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:46.442887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-259f0337-9fd1-4b8f-a9cf-6be4a1d41f75 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 404908b7-8abf-4e2c-b894-70002cf94cd0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:46.456070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-259f0337-9fd1-4b8f-a9cf-6be4a1d41f75 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:46.456724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-259f0337-9fd1-4b8f-a9cf-6be4a1d41f75 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:46.457167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-259f0337-9fd1-4b8f-a9cf-6be4a1d41f75 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:46.457887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-259f0337-9fd1-4b8f-a9cf-6be4a1d41f75 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:46.459436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-259f0337-9fd1-4b8f-a9cf-6be4a1d41f75 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:46.459859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-259f0337-9fd1-4b8f-a9cf-6be4a1d41f75 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:46.805029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-259f0337-9fd1-4b8f-a9cf-6be4a1d41f75 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:46.826426 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-259f0337-9fd1-4b8f-a9cf-6be4a1d41f75 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/404908b7-8abf-4e2c-b894-70002cf94cd0" status: 200 len: 1508 microversion: 2.1 time: 0.387406 Oct 18 13:44:46.830386 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2880/5541] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:46 2022] GET /compute/v2.1/servers/404908b7-8abf-4e2c-b894-70002cf94cd0 => generated 1508 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:46.855023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-303cd56e-71ac-4642-ba70-27128a90386a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:46.855583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-303cd56e-71ac-4642-ba70-27128a90386a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 404908b7-8abf-4e2c-b894-70002cf94cd0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:46.863036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-303cd56e-71ac-4642-ba70-27128a90386a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:46.863529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-303cd56e-71ac-4642-ba70-27128a90386a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:46.864008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-303cd56e-71ac-4642-ba70-27128a90386a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:46.864740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-303cd56e-71ac-4642-ba70-27128a90386a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:46.865282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-303cd56e-71ac-4642-ba70-27128a90386a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:46.865656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-303cd56e-71ac-4642-ba70-27128a90386a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:46.912344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-303cd56e-71ac-4642-ba70-27128a90386a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 404908b7-8abf-4e2c-b894-70002cf94cd0] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:44:47.030510 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-303cd56e-71ac-4642-ba70-27128a90386a tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "DELETE /compute/v2.1/servers/404908b7-8abf-4e2c-b894-70002cf94cd0" status: 204 len: 0 microversion: 2.1 time: 0.179327 Oct 18 13:44:47.032261 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2662/5542] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:46 2022] DELETE /compute/v2.1/servers/404908b7-8abf-4e2c-b894-70002cf94cd0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:44:47.046940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-78960e31-4bad-4ddf-80aa-57f4aaeed7db tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:47.047471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-78960e31-4bad-4ddf-80aa-57f4aaeed7db tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:47.063826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78960e31-4bad-4ddf-80aa-57f4aaeed7db tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:47.065198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78960e31-4bad-4ddf-80aa-57f4aaeed7db tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:47.067170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78960e31-4bad-4ddf-80aa-57f4aaeed7db tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:47.073242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78960e31-4bad-4ddf-80aa-57f4aaeed7db tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:47.076375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78960e31-4bad-4ddf-80aa-57f4aaeed7db tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:47.077430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78960e31-4bad-4ddf-80aa-57f4aaeed7db tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:47.180996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-78960e31-4bad-4ddf-80aa-57f4aaeed7db tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: f16c7458-63f3-4573-be23-ad3e8d856560] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:44:47.313758 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-78960e31-4bad-4ddf-80aa-57f4aaeed7db tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560" status: 204 len: 0 microversion: 2.1 time: 0.275769 Oct 18 13:44:47.328220 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2881/5543] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:44:47 2022] DELETE /compute/v2.1/servers/f16c7458-63f3-4573-be23-ad3e8d856560 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:44:47.448030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1255489073", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "bd77ba9d-3148-4782-bde0-6863ddecfe49"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:47.530273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] validate_networks() for [('bd77ba9d-3148-4782-bde0-6863ddecfe49', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:44:49.573276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:44:49.573944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:44:49.574369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:44:49.574874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:44:49.575378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:44:49.594400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:49.595036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:49.595560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:49.596546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:49.597251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:49.597887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:49.633489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Getting quotas for project 643c51d6505446ec8b122fb00a0ecc9d. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:44:49.639967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Getting quotas for user 6fefa11f2d5b4562a5799c1ed2174e5e and project 643c51d6505446ec8b122fb00a0ecc9d. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:44:49.655486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Going to run 2 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:44:49.658233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 5285fbb2-e253-4c84-b238-5c08e5d04d96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:44:49.700856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=5285fbb2-e253-4c84-b238-5c08e5d04d96,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:44:49.776164 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb8df6bf-727d-485e-bef5-35663da257e6 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.333782 Oct 18 13:44:49.780726 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2663/5544] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:44:47 2022] POST /compute/v2.1/servers => generated 32 bytes in 2339 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 18 13:44:49.790517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-85c8f623-a00b-4558-84bf-a64ef97d08f3 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:49.797538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-85c8f623-a00b-4558-84bf-a64ef97d08f3 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:49.799594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-85c8f623-a00b-4558-84bf-a64ef97d08f3 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Searching by: {'deleted': False, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 13:44:49.866679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85c8f623-a00b-4558-84bf-a64ef97d08f3 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:49.871152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85c8f623-a00b-4558-84bf-a64ef97d08f3 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:49.873344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85c8f623-a00b-4558-84bf-a64ef97d08f3 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:49.875583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85c8f623-a00b-4558-84bf-a64ef97d08f3 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:49.881232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85c8f623-a00b-4558-84bf-a64ef97d08f3 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:49.883715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-85c8f623-a00b-4558-84bf-a64ef97d08f3 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:49.954630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-85c8f623-a00b-4558-84bf-a64ef97d08f3 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 13:44:50.050833 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-85c8f623-a00b-4558-84bf-a64ef97d08f3 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.268809 Oct 18 13:44:50.053630 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2882/5545] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 13:44:49 2022] GET /compute/v2.1/servers => generated 1337 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:50.068562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b3d4bd32-1b04-4915-8628-1cce224570cd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:50.071085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b3d4bd32-1b04-4915-8628-1cce224570cd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:50.177771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b3d4bd32-1b04-4915-8628-1cce224570cd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:50.195129 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b3d4bd32-1b04-4915-8628-1cce224570cd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1218 microversion: 2.1 time: 0.132726 Oct 18 13:44:50.211683 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2664/5546] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:50 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:50.378107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f0830f5c-c430-40d9-b9cc-dcc2b203946d req-b2d9982d-2f34-4a75-b14d-26fb1e44e3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404908b7-8abf-4e2c-b894-70002cf94cd0", "name": "network-vif-deleted", "tag": "5f210485-0806-48a4-bef0-b92250aa8f25"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:50.397057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f0830f5c-c430-40d9-b9cc-dcc2b203946d req-b2d9982d-2f34-4a75-b14d-26fb1e44e3b5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:50.400364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f0830f5c-c430-40d9-b9cc-dcc2b203946d req-b2d9982d-2f34-4a75-b14d-26fb1e44e3b5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:50.401018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f0830f5c-c430-40d9-b9cc-dcc2b203946d req-b2d9982d-2f34-4a75-b14d-26fb1e44e3b5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:50.423636 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f0830f5c-c430-40d9-b9cc-dcc2b203946d req-b2d9982d-2f34-4a75-b14d-26fb1e44e3b5 service nova] Creating event network-vif-deleted:5f210485-0806-48a4-bef0-b92250aa8f25 for instance 404908b7-8abf-4e2c-b894-70002cf94cd0 on n-h2-858384-13 Oct 18 13:44:50.434322 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f0830f5c-c430-40d9-b9cc-dcc2b203946d req-b2d9982d-2f34-4a75-b14d-26fb1e44e3b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060853 Oct 18 13:44:50.437906 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2883/5547] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:51.222413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a6ab898e-16a5-47ad-8277-9cc0e34ed50f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:51.223657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a6ab898e-16a5-47ad-8277-9cc0e34ed50f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:51.236395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a6ab898e-16a5-47ad-8277-9cc0e34ed50f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:51.237166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a6ab898e-16a5-47ad-8277-9cc0e34ed50f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:51.237789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a6ab898e-16a5-47ad-8277-9cc0e34ed50f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:51.241266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a6ab898e-16a5-47ad-8277-9cc0e34ed50f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:51.241742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a6ab898e-16a5-47ad-8277-9cc0e34ed50f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:51.244134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a6ab898e-16a5-47ad-8277-9cc0e34ed50f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:51.409227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a6ab898e-16a5-47ad-8277-9cc0e34ed50f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:51.418051 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a6ab898e-16a5-47ad-8277-9cc0e34ed50f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1222 microversion: 2.1 time: 0.199406 Oct 18 13:44:51.418655 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2665/5548] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:51 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1222 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:51.457752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8f841ed3-4baf-403b-81b6-68d90b44a11a req-fde34aad-5b3b-4b63-ab71-b8e4d482d880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c7458-63f3-4573-be23-ad3e8d856560", "name": "network-vif-deleted", "tag": "5c0fb521-951e-4e74-b1fc-738820256522"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:51.507187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8f841ed3-4baf-403b-81b6-68d90b44a11a req-fde34aad-5b3b-4b63-ab71-b8e4d482d880 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:51.512350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8f841ed3-4baf-403b-81b6-68d90b44a11a req-fde34aad-5b3b-4b63-ab71-b8e4d482d880 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:51.514671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8f841ed3-4baf-403b-81b6-68d90b44a11a req-fde34aad-5b3b-4b63-ab71-b8e4d482d880 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:51.556031 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8f841ed3-4baf-403b-81b6-68d90b44a11a req-fde34aad-5b3b-4b63-ab71-b8e4d482d880 service nova] Creating event network-vif-deleted:5c0fb521-951e-4e74-b1fc-738820256522 for instance f16c7458-63f3-4573-be23-ad3e8d856560 on n-h1-858384-13 Oct 18 13:44:51.572262 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8f841ed3-4baf-403b-81b6-68d90b44a11a req-fde34aad-5b3b-4b63-ab71-b8e4d482d880 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122888 Oct 18 13:44:51.575521 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2884/5549] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:44:52.441103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8a3ec3d9-be3a-4bc6-9cb4-1e0b03ad2ac0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:52.441755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8a3ec3d9-be3a-4bc6-9cb4-1e0b03ad2ac0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:52.452304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a3ec3d9-be3a-4bc6-9cb4-1e0b03ad2ac0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:52.458979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a3ec3d9-be3a-4bc6-9cb4-1e0b03ad2ac0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:52.459670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a3ec3d9-be3a-4bc6-9cb4-1e0b03ad2ac0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:52.460630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a3ec3d9-be3a-4bc6-9cb4-1e0b03ad2ac0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:52.461848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a3ec3d9-be3a-4bc6-9cb4-1e0b03ad2ac0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:52.462332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a3ec3d9-be3a-4bc6-9cb4-1e0b03ad2ac0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:52.611791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8a3ec3d9-be3a-4bc6-9cb4-1e0b03ad2ac0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:52.623305 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8a3ec3d9-be3a-4bc6-9cb4-1e0b03ad2ac0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1214 microversion: 2.1 time: 0.186655 Oct 18 13:44:52.624515 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2666/5550] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:52 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:53.652803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b59297ff-d15d-4df2-acf7-bf17623d6d78 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:53.654295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b59297ff-d15d-4df2-acf7-bf17623d6d78 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:53.669019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b59297ff-d15d-4df2-acf7-bf17623d6d78 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.670116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b59297ff-d15d-4df2-acf7-bf17623d6d78 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.670755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b59297ff-d15d-4df2-acf7-bf17623d6d78 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.671636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b59297ff-d15d-4df2-acf7-bf17623d6d78 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:53.672306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b59297ff-d15d-4df2-acf7-bf17623d6d78 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:53.672893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b59297ff-d15d-4df2-acf7-bf17623d6d78 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:53.856697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b59297ff-d15d-4df2-acf7-bf17623d6d78 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:53.870250 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b59297ff-d15d-4df2-acf7-bf17623d6d78 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1288 microversion: 2.1 time: 0.225361 Oct 18 13:44:53.870857 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2885/5551] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:53 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1288 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:54.896166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d4b3a526-1e0b-40a0-a800-427b848ead29 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:54.897929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d4b3a526-1e0b-40a0-a800-427b848ead29 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:54.912286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4b3a526-1e0b-40a0-a800-427b848ead29 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:54.912774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4b3a526-1e0b-40a0-a800-427b848ead29 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:54.914304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4b3a526-1e0b-40a0-a800-427b848ead29 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:54.915239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4b3a526-1e0b-40a0-a800-427b848ead29 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:54.915697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4b3a526-1e0b-40a0-a800-427b848ead29 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:54.916123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4b3a526-1e0b-40a0-a800-427b848ead29 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:55.338246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d4b3a526-1e0b-40a0-a800-427b848ead29 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:55.349006 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d4b3a526-1e0b-40a0-a800-427b848ead29 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1276 microversion: 2.1 time: 0.457318 Oct 18 13:44:55.351192 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2667/5552] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:54 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1276 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:56.374168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f1bcf102-0cc6-4dd6-bfb8-f674c4baa80f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:56.374789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f1bcf102-0cc6-4dd6-bfb8-f674c4baa80f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:56.388534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1bcf102-0cc6-4dd6-bfb8-f674c4baa80f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:56.389033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1bcf102-0cc6-4dd6-bfb8-f674c4baa80f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:56.389501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1bcf102-0cc6-4dd6-bfb8-f674c4baa80f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:56.390213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1bcf102-0cc6-4dd6-bfb8-f674c4baa80f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:56.390669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1bcf102-0cc6-4dd6-bfb8-f674c4baa80f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:56.391097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f1bcf102-0cc6-4dd6-bfb8-f674c4baa80f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:56.702840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-3caf8bd1-54c4-45a3-a254-d33a33655e96 req-effb7a16-636d-4e29-b965-80a1c5c05559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5285fbb2-e253-4c84-b238-5c08e5d04d96", "tag": "439afa34-c89f-4f6f-abaf-7add66bbecfc"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:56.745120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3caf8bd1-54c4-45a3-a254-d33a33655e96 req-effb7a16-636d-4e29-b965-80a1c5c05559 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:56.746462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3caf8bd1-54c4-45a3-a254-d33a33655e96 req-effb7a16-636d-4e29-b965-80a1c5c05559 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:56.747742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3caf8bd1-54c4-45a3-a254-d33a33655e96 req-effb7a16-636d-4e29-b965-80a1c5c05559 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:56.766185 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-3caf8bd1-54c4-45a3-a254-d33a33655e96 req-effb7a16-636d-4e29-b965-80a1c5c05559 service nova] Creating event network-changed:439afa34-c89f-4f6f-abaf-7add66bbecfc for instance 5285fbb2-e253-4c84-b238-5c08e5d04d96 on n-h2-858384-13 Oct 18 13:44:56.773376 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-3caf8bd1-54c4-45a3-a254-d33a33655e96 req-effb7a16-636d-4e29-b965-80a1c5c05559 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074394 Oct 18 13:44:56.774495 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2668/5553] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:44:56.893305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f1bcf102-0cc6-4dd6-bfb8-f674c4baa80f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:56.905314 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f1bcf102-0cc6-4dd6-bfb8-f674c4baa80f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1318 microversion: 2.1 time: 0.535038 Oct 18 13:44:56.906742 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2886/5554] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:56 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:57.933246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2285ae67-1ce0-4e27-a2e0-27a560a5d86e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:57.934694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2285ae67-1ce0-4e27-a2e0-27a560a5d86e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:57.954844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2285ae67-1ce0-4e27-a2e0-27a560a5d86e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:57.961428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2285ae67-1ce0-4e27-a2e0-27a560a5d86e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:57.962258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2285ae67-1ce0-4e27-a2e0-27a560a5d86e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:57.963177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2285ae67-1ce0-4e27-a2e0-27a560a5d86e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:57.963815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2285ae67-1ce0-4e27-a2e0-27a560a5d86e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:57.964609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2285ae67-1ce0-4e27-a2e0-27a560a5d86e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:57.997929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8b2ef557-cec6-4fbf-a640-3f2f82642107 req-cdeb6536-3fff-4ffb-8f75-ea02d5be57f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "559e780e-d9dd-4575-a7ed-a808de3fdd07", "tag": "e127cb68-481c-4320-bc6a-b7113581a6ca"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:44:58.055910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8b2ef557-cec6-4fbf-a640-3f2f82642107 req-cdeb6536-3fff-4ffb-8f75-ea02d5be57f6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:58.056569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8b2ef557-cec6-4fbf-a640-3f2f82642107 req-cdeb6536-3fff-4ffb-8f75-ea02d5be57f6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:58.090485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8b2ef557-cec6-4fbf-a640-3f2f82642107 req-cdeb6536-3fff-4ffb-8f75-ea02d5be57f6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:58.121919 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8b2ef557-cec6-4fbf-a640-3f2f82642107 req-cdeb6536-3fff-4ffb-8f75-ea02d5be57f6 service nova] Creating event network-changed:e127cb68-481c-4320-bc6a-b7113581a6ca for instance 559e780e-d9dd-4575-a7ed-a808de3fdd07 on n-h1-858384-13 Oct 18 13:44:58.128002 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8b2ef557-cec6-4fbf-a640-3f2f82642107 req-cdeb6536-3fff-4ffb-8f75-ea02d5be57f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140810 Oct 18 13:44:58.129883 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2887/5555] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:44:58.500958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2285ae67-1ce0-4e27-a2e0-27a560a5d86e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:44:58.510688 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2285ae67-1ce0-4e27-a2e0-27a560a5d86e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1318 microversion: 2.1 time: 0.583851 Oct 18 13:44:58.512288 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2669/5556] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:57 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:44:59.539385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-48a3d47a-2459-4e55-ba57-b6495337740b tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:44:59.540200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-48a3d47a-2459-4e55-ba57-b6495337740b tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:44:59.553759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a3d47a-2459-4e55-ba57-b6495337740b tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:59.554559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a3d47a-2459-4e55-ba57-b6495337740b tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:59.555497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a3d47a-2459-4e55-ba57-b6495337740b tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:59.559003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a3d47a-2459-4e55-ba57-b6495337740b tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:44:59.565581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a3d47a-2459-4e55-ba57-b6495337740b tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:44:59.566832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a3d47a-2459-4e55-ba57-b6495337740b tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:44:59.899179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:00.083311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-48a3d47a-2459-4e55-ba57-b6495337740b tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:00.092615 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-48a3d47a-2459-4e55-ba57-b6495337740b tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1318 microversion: 2.1 time: 0.557390 Oct 18 13:45:00.114134 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2888/5557] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:44:59 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:01.119455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7fa4d75f-0b84-4f54-b4a9-e1d4f0818923 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:01.120676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7fa4d75f-0b84-4f54-b4a9-e1d4f0818923 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:01.124727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:01.125576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=8 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:01.141255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fa4d75f-0b84-4f54-b4a9-e1d4f0818923 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:01.141983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fa4d75f-0b84-4f54-b4a9-e1d4f0818923 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:01.142593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fa4d75f-0b84-4f54-b4a9-e1d4f0818923 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:01.143816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fa4d75f-0b84-4f54-b4a9-e1d4f0818923 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:01.144463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fa4d75f-0b84-4f54-b4a9-e1d4f0818923 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:01.145375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fa4d75f-0b84-4f54-b4a9-e1d4f0818923 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:01.506334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7fa4d75f-0b84-4f54-b4a9-e1d4f0818923 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:01.517888 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7fa4d75f-0b84-4f54-b4a9-e1d4f0818923 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1318 microversion: 2.1 time: 0.401823 Oct 18 13:45:01.538630 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2670/5558] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:01 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:02.544945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-449fd93b-fd3b-4a98-9a95-11eb3a21e302 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:02.545726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-449fd93b-fd3b-4a98-9a95-11eb3a21e302 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:02.562225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-449fd93b-fd3b-4a98-9a95-11eb3a21e302 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:02.562733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-449fd93b-fd3b-4a98-9a95-11eb3a21e302 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:02.563184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-449fd93b-fd3b-4a98-9a95-11eb3a21e302 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:02.563893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-449fd93b-fd3b-4a98-9a95-11eb3a21e302 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:02.564356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-449fd93b-fd3b-4a98-9a95-11eb3a21e302 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:02.564785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-449fd93b-fd3b-4a98-9a95-11eb3a21e302 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:02.939871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-449fd93b-fd3b-4a98-9a95-11eb3a21e302 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:02.951530 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-449fd93b-fd3b-4a98-9a95-11eb3a21e302 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1318 microversion: 2.1 time: 0.410367 Oct 18 13:45:02.953360 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2889/5559] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:02 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:03.981115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b6f07790-dee5-4177-9a63-a1d73e4c3829 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:03.982718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b6f07790-dee5-4177-9a63-a1d73e4c3829 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:03.990123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6f07790-dee5-4177-9a63-a1d73e4c3829 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:03.991549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6f07790-dee5-4177-9a63-a1d73e4c3829 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:03.992815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6f07790-dee5-4177-9a63-a1d73e4c3829 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:03.993771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6f07790-dee5-4177-9a63-a1d73e4c3829 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:03.994610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6f07790-dee5-4177-9a63-a1d73e4c3829 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:03.995250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b6f07790-dee5-4177-9a63-a1d73e4c3829 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:04.326745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b6f07790-dee5-4177-9a63-a1d73e4c3829 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:04.357857 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b6f07790-dee5-4177-9a63-a1d73e4c3829 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1318 microversion: 2.1 time: 0.381542 Oct 18 13:45:04.359708 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2671/5560] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:03 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:05.385111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c3280719-6e22-4877-b22c-f0ed0d119053 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:05.385764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c3280719-6e22-4877-b22c-f0ed0d119053 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:05.398550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:05.400080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3280719-6e22-4877-b22c-f0ed0d119053 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:05.400601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3280719-6e22-4877-b22c-f0ed0d119053 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:05.401089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3280719-6e22-4877-b22c-f0ed0d119053 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:05.401859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3280719-6e22-4877-b22c-f0ed0d119053 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:05.402323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3280719-6e22-4877-b22c-f0ed0d119053 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:05.402757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3280719-6e22-4877-b22c-f0ed0d119053 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:05.454671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:05.564710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a1cc9ccc-56a3-4aa0-a948-7254d84677b0 req-47e91009-0c66-45ec-ba36-88daa2c15778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5285fbb2-e253-4c84-b238-5c08e5d04d96", "name": "network-vif-plugged", "status": "completed", "tag": "439afa34-c89f-4f6f-abaf-7add66bbecfc"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:05.579952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a1cc9ccc-56a3-4aa0-a948-7254d84677b0 req-47e91009-0c66-45ec-ba36-88daa2c15778 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:05.580713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a1cc9ccc-56a3-4aa0-a948-7254d84677b0 req-47e91009-0c66-45ec-ba36-88daa2c15778 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:05.581728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a1cc9ccc-56a3-4aa0-a948-7254d84677b0 req-47e91009-0c66-45ec-ba36-88daa2c15778 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:05.596408 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a1cc9ccc-56a3-4aa0-a948-7254d84677b0 req-47e91009-0c66-45ec-ba36-88daa2c15778 service nova] Creating event network-vif-plugged:439afa34-c89f-4f6f-abaf-7add66bbecfc for instance 5285fbb2-e253-4c84-b238-5c08e5d04d96 on n-h2-858384-13 Oct 18 13:45:05.603232 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a1cc9ccc-56a3-4aa0-a948-7254d84677b0 req-47e91009-0c66-45ec-ba36-88daa2c15778 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046771 Oct 18 13:45:05.604834 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2672/5561] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:45:05.959611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c3280719-6e22-4877-b22c-f0ed0d119053 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:05.972251 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c3280719-6e22-4877-b22c-f0ed0d119053 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1318 microversion: 2.1 time: 0.589310 Oct 18 13:45:05.973447 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2890/5562] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:05 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1318 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:07.003941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-df282709-b95e-48dd-9766-82d345f5086e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:07.011006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-df282709-b95e-48dd-9766-82d345f5086e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:07.034801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:07.037427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df282709-b95e-48dd-9766-82d345f5086e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:07.043791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df282709-b95e-48dd-9766-82d345f5086e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:07.047811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df282709-b95e-48dd-9766-82d345f5086e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:07.049783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df282709-b95e-48dd-9766-82d345f5086e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:07.050836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df282709-b95e-48dd-9766-82d345f5086e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:07.051380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df282709-b95e-48dd-9766-82d345f5086e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:07.058284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:07.681672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-df282709-b95e-48dd-9766-82d345f5086e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:07.693379 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-df282709-b95e-48dd-9766-82d345f5086e tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1318 microversion: 2.1 time: 0.697149 Oct 18 13:45:07.694246 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2673/5563] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:06 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1318 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:45:08.642576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-75e714d4-2de3-4958-b574-657a5e17e14a req-b447bc5d-15e0-4ec3-937a-6309524a12f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "559e780e-d9dd-4575-a7ed-a808de3fdd07", "name": "network-vif-plugged", "status": "completed", "tag": "e127cb68-481c-4320-bc6a-b7113581a6ca"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:08.667081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-75e714d4-2de3-4958-b574-657a5e17e14a req-b447bc5d-15e0-4ec3-937a-6309524a12f9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:08.667838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-75e714d4-2de3-4958-b574-657a5e17e14a req-b447bc5d-15e0-4ec3-937a-6309524a12f9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:08.670232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-75e714d4-2de3-4958-b574-657a5e17e14a req-b447bc5d-15e0-4ec3-937a-6309524a12f9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:08.698664 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-75e714d4-2de3-4958-b574-657a5e17e14a req-b447bc5d-15e0-4ec3-937a-6309524a12f9 service nova] Creating event network-vif-plugged:e127cb68-481c-4320-bc6a-b7113581a6ca for instance 559e780e-d9dd-4575-a7ed-a808de3fdd07 on n-h1-858384-13 Oct 18 13:45:08.712511 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-75e714d4-2de3-4958-b574-657a5e17e14a req-b447bc5d-15e0-4ec3-937a-6309524a12f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075909 Oct 18 13:45:08.713907 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2891/5564] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:45:08.722413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68bed911-5b26-44cf-acc4-c3fe4608a424 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:08.723023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-68bed911-5b26-44cf-acc4-c3fe4608a424 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:08.736366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68bed911-5b26-44cf-acc4-c3fe4608a424 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:08.740892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68bed911-5b26-44cf-acc4-c3fe4608a424 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:08.744113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68bed911-5b26-44cf-acc4-c3fe4608a424 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:08.745057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68bed911-5b26-44cf-acc4-c3fe4608a424 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:08.745713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68bed911-5b26-44cf-acc4-c3fe4608a424 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:08.747564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68bed911-5b26-44cf-acc4-c3fe4608a424 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:09.214268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-68bed911-5b26-44cf-acc4-c3fe4608a424 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:09.238192 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-68bed911-5b26-44cf-acc4-c3fe4608a424 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1318 microversion: 2.1 time: 0.517612 Oct 18 13:45:09.255761 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2674/5565] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:08 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:10.270946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8d7e41f4-dc58-4b72-b5a6-18290fc4daed tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:10.271759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8d7e41f4-dc58-4b72-b5a6-18290fc4daed tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:10.302280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d7e41f4-dc58-4b72-b5a6-18290fc4daed tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:10.302875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d7e41f4-dc58-4b72-b5a6-18290fc4daed tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:10.303316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d7e41f4-dc58-4b72-b5a6-18290fc4daed tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:10.305569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d7e41f4-dc58-4b72-b5a6-18290fc4daed tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:10.306276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d7e41f4-dc58-4b72-b5a6-18290fc4daed tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:10.306995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d7e41f4-dc58-4b72-b5a6-18290fc4daed tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:10.929916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8d7e41f4-dc58-4b72-b5a6-18290fc4daed tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:10.940920 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8d7e41f4-dc58-4b72-b5a6-18290fc4daed tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1318 microversion: 2.1 time: 0.677588 Oct 18 13:45:10.942976 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2892/5566] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:10 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1318 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:11.972691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0aa76392-a1e4-43d3-9fa3-be840433cfc9 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:11.975563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0aa76392-a1e4-43d3-9fa3-be840433cfc9 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:12.003688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0aa76392-a1e4-43d3-9fa3-be840433cfc9 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:12.009651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0aa76392-a1e4-43d3-9fa3-be840433cfc9 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:12.010368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0aa76392-a1e4-43d3-9fa3-be840433cfc9 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:12.011284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0aa76392-a1e4-43d3-9fa3-be840433cfc9 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:12.011900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0aa76392-a1e4-43d3-9fa3-be840433cfc9 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:12.012512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0aa76392-a1e4-43d3-9fa3-be840433cfc9 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:12.376782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0aa76392-a1e4-43d3-9fa3-be840433cfc9 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:12.385209 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0aa76392-a1e4-43d3-9fa3-be840433cfc9 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1507 microversion: 2.1 time: 0.417477 Oct 18 13:45:12.392015 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2675/5567] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:11 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1507 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:12.414929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-97b1c858-f077-4fe4-bcac-613ebfa1ee71 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:12.417741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-97b1c858-f077-4fe4-bcac-613ebfa1ee71 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 5285fbb2-e253-4c84-b238-5c08e5d04d96] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:12.425743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b1c858-f077-4fe4-bcac-613ebfa1ee71 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:12.427145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b1c858-f077-4fe4-bcac-613ebfa1ee71 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:12.427795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b1c858-f077-4fe4-bcac-613ebfa1ee71 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:12.428717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b1c858-f077-4fe4-bcac-613ebfa1ee71 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:12.430007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b1c858-f077-4fe4-bcac-613ebfa1ee71 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:12.430624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b1c858-f077-4fe4-bcac-613ebfa1ee71 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:12.698224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-97b1c858-f077-4fe4-bcac-613ebfa1ee71 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:12.713718 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-97b1c858-f077-4fe4-bcac-613ebfa1ee71 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/5285fbb2-e253-4c84-b238-5c08e5d04d96" status: 200 len: 1507 microversion: 2.1 time: 0.299942 Oct 18 13:45:12.714726 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2893/5568] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:12 2022] GET /compute/v2.1/servers/5285fbb2-e253-4c84-b238-5c08e5d04d96 => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:12.746618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4114eaf-a73a-407d-ae7e-f553c1538dcf tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:12.747368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e4114eaf-a73a-407d-ae7e-f553c1538dcf tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 5285fbb2-e253-4c84-b238-5c08e5d04d96] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:12.758116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4114eaf-a73a-407d-ae7e-f553c1538dcf tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:12.762421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4114eaf-a73a-407d-ae7e-f553c1538dcf tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:12.763272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4114eaf-a73a-407d-ae7e-f553c1538dcf tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:12.764361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4114eaf-a73a-407d-ae7e-f553c1538dcf tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:12.766227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4114eaf-a73a-407d-ae7e-f553c1538dcf tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:12.766835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4114eaf-a73a-407d-ae7e-f553c1538dcf tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:12.842533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e4114eaf-a73a-407d-ae7e-f553c1538dcf tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 5285fbb2-e253-4c84-b238-5c08e5d04d96] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:45:13.058102 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e4114eaf-a73a-407d-ae7e-f553c1538dcf tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5285fbb2-e253-4c84-b238-5c08e5d04d96" status: 204 len: 0 microversion: 2.1 time: 0.316925 Oct 18 13:45:13.060071 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2676/5569] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:45:12 2022] DELETE /compute/v2.1/servers/5285fbb2-e253-4c84-b238-5c08e5d04d96 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:45:13.068595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e0b329b7-e0d8-4161-8545-239389cbbca5 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:13.069105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e0b329b7-e0d8-4161-8545-239389cbbca5 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:13.080381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0b329b7-e0d8-4161-8545-239389cbbca5 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:13.080887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0b329b7-e0d8-4161-8545-239389cbbca5 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:13.081366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0b329b7-e0d8-4161-8545-239389cbbca5 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:13.082102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0b329b7-e0d8-4161-8545-239389cbbca5 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:13.082573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0b329b7-e0d8-4161-8545-239389cbbca5 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:13.083001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0b329b7-e0d8-4161-8545-239389cbbca5 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:13.120805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e0b329b7-e0d8-4161-8545-239389cbbca5 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:45:13.692595 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e0b329b7-e0d8-4161-8545-239389cbbca5 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "DELETE /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 204 len: 0 microversion: 2.1 time: 0.627611 Oct 18 13:45:13.694890 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2894/5570] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:45:13 2022] DELETE /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:45:13.705285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-656e2d8d-ff7c-44a4-9288-d8f50b719bf0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:13.706413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-656e2d8d-ff7c-44a4-9288-d8f50b719bf0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 5285fbb2-e253-4c84-b238-5c08e5d04d96] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:13.735741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-656e2d8d-ff7c-44a4-9288-d8f50b719bf0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:13.737463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-656e2d8d-ff7c-44a4-9288-d8f50b719bf0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:13.738678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-656e2d8d-ff7c-44a4-9288-d8f50b719bf0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:13.739676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-656e2d8d-ff7c-44a4-9288-d8f50b719bf0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:13.740385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-656e2d8d-ff7c-44a4-9288-d8f50b719bf0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:13.740980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-656e2d8d-ff7c-44a4-9288-d8f50b719bf0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:14.041509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-656e2d8d-ff7c-44a4-9288-d8f50b719bf0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:14.067198 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-656e2d8d-ff7c-44a4-9288-d8f50b719bf0 tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/5285fbb2-e253-4c84-b238-5c08e5d04d96" status: 200 len: 1513 microversion: 2.1 time: 0.364637 Oct 18 13:45:14.077595 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2677/5571] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:13 2022] GET /compute/v2.1/servers/5285fbb2-e253-4c84-b238-5c08e5d04d96 => generated 1513 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:15.095910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3dc586fa-7811-48d8-9515-3c6cd6909eac tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:15.097686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3dc586fa-7811-48d8-9515-3c6cd6909eac tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 5285fbb2-e253-4c84-b238-5c08e5d04d96] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:15.121882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dc586fa-7811-48d8-9515-3c6cd6909eac tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:15.124682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dc586fa-7811-48d8-9515-3c6cd6909eac tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:15.126149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dc586fa-7811-48d8-9515-3c6cd6909eac tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:15.128862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dc586fa-7811-48d8-9515-3c6cd6909eac tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:15.130198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dc586fa-7811-48d8-9515-3c6cd6909eac tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:15.133012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dc586fa-7811-48d8-9515-3c6cd6909eac tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:15.603405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b678eff8-29b3-4df5-9a5a-4a9a851f634e req-44b2bc70-34b4-4fea-b143-5cad1bc631c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5285fbb2-e253-4c84-b238-5c08e5d04d96", "name": "network-vif-deleted", "tag": "439afa34-c89f-4f6f-abaf-7add66bbecfc"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:15.623089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b678eff8-29b3-4df5-9a5a-4a9a851f634e req-44b2bc70-34b4-4fea-b143-5cad1bc631c8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:15.624612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b678eff8-29b3-4df5-9a5a-4a9a851f634e req-44b2bc70-34b4-4fea-b143-5cad1bc631c8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:15.625752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b678eff8-29b3-4df5-9a5a-4a9a851f634e req-44b2bc70-34b4-4fea-b143-5cad1bc631c8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:15.644792 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b678eff8-29b3-4df5-9a5a-4a9a851f634e req-44b2bc70-34b4-4fea-b143-5cad1bc631c8 service nova] Creating event network-vif-deleted:439afa34-c89f-4f6f-abaf-7add66bbecfc for instance 5285fbb2-e253-4c84-b238-5c08e5d04d96 on n-h2-858384-13 Oct 18 13:45:15.655268 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b678eff8-29b3-4df5-9a5a-4a9a851f634e req-44b2bc70-34b4-4fea-b143-5cad1bc631c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056027 Oct 18 13:45:15.657578 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2678/5572] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:45:16.186034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3dc586fa-7811-48d8-9515-3c6cd6909eac tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:16.199977 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3dc586fa-7811-48d8-9515-3c6cd6909eac tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/5285fbb2-e253-4c84-b238-5c08e5d04d96" status: 200 len: 1513 microversion: 2.1 time: 1.109680 Oct 18 13:45:16.201856 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2895/5573] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:15 2022] GET /compute/v2.1/servers/5285fbb2-e253-4c84-b238-5c08e5d04d96 => generated 1513 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:17.224344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-66fb1028-4c74-434b-a745-01576564cacd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:17.225047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-66fb1028-4c74-434b-a745-01576564cacd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 5285fbb2-e253-4c84-b238-5c08e5d04d96] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:17.240139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66fb1028-4c74-434b-a745-01576564cacd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:17.240639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66fb1028-4c74-434b-a745-01576564cacd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:17.249009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66fb1028-4c74-434b-a745-01576564cacd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:17.249973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66fb1028-4c74-434b-a745-01576564cacd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:17.250454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66fb1028-4c74-434b-a745-01576564cacd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:17.251096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66fb1028-4c74-434b-a745-01576564cacd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:17.284229 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-66fb1028-4c74-434b-a745-01576564cacd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] HTTP exception thrown: Instance 5285fbb2-e253-4c84-b238-5c08e5d04d96 could not be found. Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-66fb1028-4c74-434b-a745-01576564cacd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Request method failure captured: Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/5285fbb2-e253-4c84-b238-5c08e5d04d96 HTTP/1.1 Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq2vTvkHWctIC27tDXAMOdn0PrCpIrPIOrew-cROUkilYPUyqNV15_BT4I1l2wNjT84V6HUvp3A9tJJ2kDMLEA4nyGdAT6_PzcLfLLaYvxkfLspY_fhf31WD0MXrLmKSMM_FVJfZIWUbcTyW3PrdOSn33f0vAXUbzdThjK26f6AK1BY Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 643c51d6505446ec8b122fb00a0ecc9d Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-MultipleCreateTestJSON-80057859 Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/643c51d6505446ec8b122fb00a0ecc9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/643c51d6505446ec8b122fb00a0ecc9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/643c51d6505446ec8b122fb00a0ecc9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_643c51d6505446ec8b122fb00a0ecc9d"}]}] Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-MultipleCreateTestJSON-80057859 Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 643c51d6505446ec8b122fb00a0ecc9d Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-MultipleCreateTestJSON-80057859 Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-MultipleCreateTestJSON-80057859-project Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 6fefa11f2d5b4562a5799c1ed2174e5e Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-MultipleCreateTestJSON-80057859-project Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 5285fbb2-e253-4c84-b238-5c08e5d04d96 could not be found. Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '5285fbb2-e253-4c84-b238-5c08e5d04d96'} Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5285fbb2-e253-4c84-b238-5c08e5d04d96 could not be found. Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5285fbb2-e253-4c84-b238-5c08e5d04d96 could not be found. Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:17.285954 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:45:17.291397 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:17.291397 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:17.291397 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:17.291397 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:17.291397 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:17.291397 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5285fbb2-e253-4c84-b238-5c08e5d04d96 could not be found. Oct 18 13:45:17.291397 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:45:17.291397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-66fb1028-4c74-434b-a745-01576564cacd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Returning 404 to user: Instance 5285fbb2-e253-4c84-b238-5c08e5d04d96 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:17.291397 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-66fb1028-4c74-434b-a745-01576564cacd tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/5285fbb2-e253-4c84-b238-5c08e5d04d96" status: 404 len: 111 microversion: 2.1 time: 0.067545 Oct 18 13:45:17.291397 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2679/5574] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:17 2022] GET /compute/v2.1/servers/5285fbb2-e253-4c84-b238-5c08e5d04d96 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:17.296694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1ae9dced-407a-4934-bd5c-7d699de8f22f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:17.297341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1ae9dced-407a-4934-bd5c-7d699de8f22f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:17.316759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ae9dced-407a-4934-bd5c-7d699de8f22f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:17.317361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ae9dced-407a-4934-bd5c-7d699de8f22f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:17.317727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ae9dced-407a-4934-bd5c-7d699de8f22f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:17.318452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ae9dced-407a-4934-bd5c-7d699de8f22f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:17.318914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ae9dced-407a-4934-bd5c-7d699de8f22f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:17.320139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ae9dced-407a-4934-bd5c-7d699de8f22f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:18.594642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1ae9dced-407a-4934-bd5c-7d699de8f22f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fefa11f2d5b4562a5799c1ed2174e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643c51d6505446ec8b122fb00a0ecc9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:18.611643 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1ae9dced-407a-4934-bd5c-7d699de8f22f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 200 len: 1513 microversion: 2.1 time: 1.316914 Oct 18 13:45:18.612823 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2896/5575] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:17 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 1513 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:18.773067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-c4293c51-67be-4469-8ffb-24178668a5cd req-986b8416-24d2-4325-af4d-a943a1d382b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "559e780e-d9dd-4575-a7ed-a808de3fdd07", "name": "network-vif-deleted", "tag": "e127cb68-481c-4320-bc6a-b7113581a6ca"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:18.809444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c4293c51-67be-4469-8ffb-24178668a5cd req-986b8416-24d2-4325-af4d-a943a1d382b2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:18.809949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c4293c51-67be-4469-8ffb-24178668a5cd req-986b8416-24d2-4325-af4d-a943a1d382b2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:18.810395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-c4293c51-67be-4469-8ffb-24178668a5cd req-986b8416-24d2-4325-af4d-a943a1d382b2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:18.847001 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-c4293c51-67be-4469-8ffb-24178668a5cd req-986b8416-24d2-4325-af4d-a943a1d382b2 service nova] Creating event network-vif-deleted:e127cb68-481c-4320-bc6a-b7113581a6ca for instance 559e780e-d9dd-4575-a7ed-a808de3fdd07 on n-h1-858384-13 Oct 18 13:45:18.868061 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-c4293c51-67be-4469-8ffb-24178668a5cd req-986b8416-24d2-4325-af4d-a943a1d382b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103182 Oct 18 13:45:18.872011 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2680/5576] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:45:19.638337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8bec3c7-c292-4a4d-b42d-f8f3bf06532f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:19.639617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8bec3c7-c292-4a4d-b42d-f8f3bf06532f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] [instance: 559e780e-d9dd-4575-a7ed-a808de3fdd07] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:19.670750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8bec3c7-c292-4a4d-b42d-f8f3bf06532f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:19.671521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8bec3c7-c292-4a4d-b42d-f8f3bf06532f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:19.672652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8bec3c7-c292-4a4d-b42d-f8f3bf06532f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:19.674651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8bec3c7-c292-4a4d-b42d-f8f3bf06532f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:19.676906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8bec3c7-c292-4a4d-b42d-f8f3bf06532f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:19.677567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8bec3c7-c292-4a4d-b42d-f8f3bf06532f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:19.734451 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-b8bec3c7-c292-4a4d-b42d-f8f3bf06532f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] HTTP exception thrown: Instance 559e780e-d9dd-4575-a7ed-a808de3fdd07 could not be found. Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8bec3c7-c292-4a4d-b42d-f8f3bf06532f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Request method failure captured: Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 HTTP/1.1 Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq2vTvkHWctIC27tDXAMOdn0PrCpIrPIOrew-cROUkilYPUyqNV15_BT4I1l2wNjT84V6HUvp3A9tJJ2kDMLEA4nyGdAT6_PzcLfLLaYvxkfLspY_fhf31WD0MXrLmKSMM_FVJfZIWUbcTyW3PrdOSn33f0vAXUbzdThjK26f6AK1BY Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 643c51d6505446ec8b122fb00a0ecc9d Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-MultipleCreateTestJSON-80057859 Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/643c51d6505446ec8b122fb00a0ecc9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/643c51d6505446ec8b122fb00a0ecc9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/643c51d6505446ec8b122fb00a0ecc9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_643c51d6505446ec8b122fb00a0ecc9d"}]}] Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-MultipleCreateTestJSON-80057859 Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 643c51d6505446ec8b122fb00a0ecc9d Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-MultipleCreateTestJSON-80057859 Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-MultipleCreateTestJSON-80057859-project Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 6fefa11f2d5b4562a5799c1ed2174e5e Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-MultipleCreateTestJSON-80057859-project Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 559e780e-d9dd-4575-a7ed-a808de3fdd07 could not be found. Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '559e780e-d9dd-4575-a7ed-a808de3fdd07'} Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 559e780e-d9dd-4575-a7ed-a808de3fdd07 could not be found. Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 559e780e-d9dd-4575-a7ed-a808de3fdd07 could not be found. Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:45:19.736330 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:45:19.740698 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:45:19.740698 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:45:19.740698 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:45:19.740698 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:45:19.740698 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:45:19.740698 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 559e780e-d9dd-4575-a7ed-a808de3fdd07 could not be found. Oct 18 13:45:19.740698 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:45:19.741886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8bec3c7-c292-4a4d-b42d-f8f3bf06532f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] Returning 404 to user: Instance 559e780e-d9dd-4575-a7ed-a808de3fdd07 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:45:19.742958 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8bec3c7-c292-4a4d-b42d-f8f3bf06532f tempest-MultipleCreateTestJSON-80057859 tempest-MultipleCreateTestJSON-80057859-project] 10.222.0.40 "GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07" status: 404 len: 111 microversion: 2.1 time: 0.111201 Oct 18 13:45:19.743626 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2897/5577] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:19 2022] GET /compute/v2.1/servers/559e780e-d9dd-4575-a7ed-a808de3fdd07 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:45:39.074959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:39.076708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:39.082523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e69e45db-da7d-461e-8fcb-2df79ea46584 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:39.083672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e69e45db-da7d-461e-8fcb-2df79ea46584 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:39.101563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e69e45db-da7d-461e-8fcb-2df79ea46584 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:39.102879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e69e45db-da7d-461e-8fcb-2df79ea46584 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:39.104163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e69e45db-da7d-461e-8fcb-2df79ea46584 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:39.106468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e69e45db-da7d-461e-8fcb-2df79ea46584 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:39.107169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e69e45db-da7d-461e-8fcb-2df79ea46584 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:39.107774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e69e45db-da7d-461e-8fcb-2df79ea46584 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:39.139752 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e69e45db-da7d-461e-8fcb-2df79ea46584 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/ips" status: 200 len: 147 microversion: 2.1 time: 0.066817 Oct 18 13:45:39.140888 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2681/5578] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:45:39 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/ips => generated 147 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:45:41.951303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca0d23dd-9b2d-4b92-8514-c30f5d87896d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "159a34e6-06bc-4bd7-9f8a-11a565262b0b"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:41.954537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca0d23dd-9b2d-4b92-8514-c30f5d87896d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:41.963460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:41.967190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:41.996155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0d23dd-9b2d-4b92-8514-c30f5d87896d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:41.998840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0d23dd-9b2d-4b92-8514-c30f5d87896d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:42.004154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0d23dd-9b2d-4b92-8514-c30f5d87896d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:42.008871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0d23dd-9b2d-4b92-8514-c30f5d87896d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:42.009643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0d23dd-9b2d-4b92-8514-c30f5d87896d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:42.010271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0d23dd-9b2d-4b92-8514-c30f5d87896d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:42.574599 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca0d23dd-9b2d-4b92-8514-c30f5d87896d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "POST /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626532 Oct 18 13:45:42.597752 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2898/5579] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:45:41 2022] POST /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments => generated 194 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:45:50.681061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:50.682650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:51.028144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ce79b903-6203-4072-9893-587418091c16 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Action: 'create', calling method: .version_select at 0x7ff60e7be4c0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-490132192", "policies": ["affinity"]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:51.100653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ce79b903-6203-4072-9893-587418091c16 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:51.128923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ce79b903-6203-4072-9893-587418091c16 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for user c51264420cfa4ac8a0d36eb28ef964bb and project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:51.274869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ce79b903-6203-4072-9893-587418091c16 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:51.281306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ce79b903-6203-4072-9893-587418091c16 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for user c51264420cfa4ac8a0d36eb28ef964bb and project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:51.313469 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ce79b903-6203-4072-9893-587418091c16 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.638889 Oct 18 13:45:51.314355 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2682/5580] 10.222.0.40 () {60 vars in 1174 bytes} [Tue Oct 18 13:45:50 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:45:51.338603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-444fe36c-a856-4e54-ad5a-a107b851990c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Action: 'create', calling method: .version_select at 0x7ff60e453940>, body: {"server_group": {"name": "tempest-server-group-2044393283", "policies": ["affinity"]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:51.398757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-444fe36c-a856-4e54-ad5a-a107b851990c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:51.413275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-444fe36c-a856-4e54-ad5a-a107b851990c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for user c51264420cfa4ac8a0d36eb28ef964bb and project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:51.623976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-444fe36c-a856-4e54-ad5a-a107b851990c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:51.640249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-444fe36c-a856-4e54-ad5a-a107b851990c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for user c51264420cfa4ac8a0d36eb28ef964bb and project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:51.672345 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-444fe36c-a856-4e54-ad5a-a107b851990c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.348793 Oct 18 13:45:51.693725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2affcb2b-cfe2-4000-88f3-3327f9a6f06a tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Action: 'create', calling method: .version_select at 0x7ff60ebba9d0>, body: {"server_group": {"name": "tempest-server-group-2044393283", "policies": ["affinity"]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:51.699757 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2899/5581] 10.222.0.40 () {60 vars in 1173 bytes} [Tue Oct 18 13:45:51 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:45:51.754085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-2affcb2b-cfe2-4000-88f3-3327f9a6f06a tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:51.777344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-2affcb2b-cfe2-4000-88f3-3327f9a6f06a tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for user c51264420cfa4ac8a0d36eb28ef964bb and project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:51.878698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-2affcb2b-cfe2-4000-88f3-3327f9a6f06a tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:51.891278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-2affcb2b-cfe2-4000-88f3-3327f9a6f06a tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for user c51264420cfa4ac8a0d36eb28ef964bb and project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:51.922683 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2affcb2b-cfe2-4000-88f3-3327f9a6f06a tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.242031 Oct 18 13:45:51.925951 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2683/5582] 10.222.0.40 () {60 vars in 1173 bytes} [Tue Oct 18 13:45:51 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:45:51.938654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b35ab687-21bb-4867-8131-74cc94afb523 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:51.983616 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b35ab687-21bb-4867-8131-74cc94afb523 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/c88a2a03-36d2-4ce3-93a3-0ede0cd19bca" status: 204 len: 0 microversion: 2.1 time: 0.049306 Oct 18 13:45:51.984787 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2900/5583] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 18 13:45:51 2022] DELETE /compute/v2.1/os-server-groups/c88a2a03-36d2-4ce3-93a3-0ede0cd19bca => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:45:51.996186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2dac2511-6031-40e4-be9b-e94bd0bf87b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:52.017148 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2dac2511-6031-40e4-be9b-e94bd0bf87b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.028165 Oct 18 13:45:52.018888 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2684/5584] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:45:51 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:45:52.030088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ff3d20a2-2c95-4591-ac4b-050e8567cc84 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:52.090884 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ff3d20a2-2c95-4591-ac4b-050e8567cc84 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/083187b0-c956-4548-892b-81c4d8c6032c" status: 204 len: 0 microversion: 2.1 time: 0.064972 Oct 18 13:45:52.094517 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2901/5585] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 18 13:45:52 2022] DELETE /compute/v2.1/os-server-groups/083187b0-c956-4548-892b-81c4d8c6032c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:45:52.100203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a012a61c-0a03-4aad-b69c-69b4baaf9030 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:52.112158 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a012a61c-0a03-4aad-b69c-69b4baaf9030 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.016288 Oct 18 13:45:52.113403 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2685/5586] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:45:52 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:45:52.128300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-532c6f34-452f-41ab-8f02-5613b87d66ca tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Action: 'create', calling method: .version_select at 0x7ff60e4503a0>, body: {"server_group": {"name": "tempest-server-group-177441301", "policies": ["affinity"]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:52.167799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-532c6f34-452f-41ab-8f02-5613b87d66ca tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:52.180846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-532c6f34-452f-41ab-8f02-5613b87d66ca tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for user c51264420cfa4ac8a0d36eb28ef964bb and project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:52.320935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-532c6f34-452f-41ab-8f02-5613b87d66ca tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:52.332564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-532c6f34-452f-41ab-8f02-5613b87d66ca tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for user c51264420cfa4ac8a0d36eb28ef964bb and project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:52.385586 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-532c6f34-452f-41ab-8f02-5613b87d66ca tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.262628 Oct 18 13:45:52.388326 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2902/5587] 10.222.0.40 () {60 vars in 1173 bytes} [Tue Oct 18 13:45:52 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:45:52.398351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4fbcb3b5-8790-48e5-8a88-2835749baa49 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:52.452537 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4fbcb3b5-8790-48e5-8a88-2835749baa49 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/a5683e34-8e1a-40a1-a146-4f25dcfd18e3" status: 204 len: 0 microversion: 2.1 time: 0.058480 Oct 18 13:45:52.453788 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2686/5588] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 18 13:45:52 2022] DELETE /compute/v2.1/os-server-groups/a5683e34-8e1a-40a1-a146-4f25dcfd18e3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:45:52.462834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d3a7a722-e0c7-4ca4-af90-e62f0fdf8c5a tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:52.494214 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d3a7a722-e0c7-4ca4-af90-e62f0fdf8c5a tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.036309 Oct 18 13:45:52.497242 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2903/5589] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:45:52 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:45:52.508718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0f310152-30b4-4186-8108-986add3d29f5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Action: 'create', calling method: .version_select at 0x7ff60e7beaf0>, body: {"server_group": {"name": "tempest-server-group-909294427", "policies": ["anti-affinity"]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:52.559979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0f310152-30b4-4186-8108-986add3d29f5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:52.569321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0f310152-30b4-4186-8108-986add3d29f5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for user c51264420cfa4ac8a0d36eb28ef964bb and project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:52.705466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0f310152-30b4-4186-8108-986add3d29f5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:52.713765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0f310152-30b4-4186-8108-986add3d29f5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for user c51264420cfa4ac8a0d36eb28ef964bb and project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_groups'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:52.732164 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0f310152-30b4-4186-8108-986add3d29f5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.227645 Oct 18 13:45:52.733460 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2687/5590] 10.222.0.40 () {60 vars in 1173 bytes} [Tue Oct 18 13:45:52 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:45:52.743752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-431ee736-c3ef-4a44-ad56-0e8ea72dd407 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:52.752239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:52.804246 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-431ee736-c3ef-4a44-ad56-0e8ea72dd407 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/2c48e440-0b96-4168-8d19-a612891e0ae6" status: 204 len: 0 microversion: 2.1 time: 0.064242 Oct 18 13:45:52.807943 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2904/5591] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 18 13:45:52 2022] DELETE /compute/v2.1/os-server-groups/2c48e440-0b96-4168-8d19-a612891e0ae6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:45:52.814000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-53c71d22-0870-4e3f-9ebe-85bcee3edcea tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:52.835680 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-53c71d22-0870-4e3f-9ebe-85bcee3edcea tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.025300 Oct 18 13:45:52.851469 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2688/5592] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:45:52 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:45:52.960203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-993639430", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "a97774ab-20b6-4d06-9af0-02f71dca6ced"}]}, "os:scheduler_hints": {"group": "d3b04da3-39ce-4766-a4a7-fe4c1d83cf51"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:53.132546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] validate_networks() for [('a97774ab-20b6-4d06-9af0-02f71dca6ced', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:45:54.292899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:45:54.293672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:45:54.294166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:45:54.294610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:45:54.295165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:45:54.342683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:54.345963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:54.347862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:54.348687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:54.359399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:54.360029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:54.401818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for project c55a201743844504ae6ca3556a1b5a1e. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:54.415134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for user c51264420cfa4ac8a0d36eb28ef964bb and project c55a201743844504ae6ca3556a1b5a1e. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:54.460863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:45:54.463256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:45:54.537061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:54.570559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_group_members'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:54.577602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for user c51264420cfa4ac8a0d36eb28ef964bb and project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_group_members'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:54.650548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_group_members'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:54.663040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Getting quotas for user c51264420cfa4ac8a0d36eb28ef964bb and project c55a201743844504ae6ca3556a1b5a1e. Resources: {'server_group_members'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:54.770788 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c09386b-a9cf-483b-a29f-3ff28ad6c2b1 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.816790 Oct 18 13:45:54.781960 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2905/5593] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:45:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:45:54.785595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6ba7b9bb-831a-4d02-8c49-b99e619e944f tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:54.786867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6ba7b9bb-831a-4d02-8c49-b99e619e944f tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:54.895538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6ba7b9bb-831a-4d02-8c49-b99e619e944f tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:54.903169 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6ba7b9bb-831a-4d02-8c49-b99e619e944f tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1212 microversion: 2.1 time: 0.124093 Oct 18 13:45:54.903755 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2689/5594] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:54 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1212 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:45:55.930910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dc528b0c-1d42-4d0a-98ea-6ab81806e7b3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:55.931698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dc528b0c-1d42-4d0a-98ea-6ab81806e7b3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:55.961467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc528b0c-1d42-4d0a-98ea-6ab81806e7b3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:55.963959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc528b0c-1d42-4d0a-98ea-6ab81806e7b3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:55.964534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc528b0c-1d42-4d0a-98ea-6ab81806e7b3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:55.966943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc528b0c-1d42-4d0a-98ea-6ab81806e7b3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:55.969350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc528b0c-1d42-4d0a-98ea-6ab81806e7b3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:55.969886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc528b0c-1d42-4d0a-98ea-6ab81806e7b3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:56.225107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc528b0c-1d42-4d0a-98ea-6ab81806e7b3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:56.235356 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dc528b0c-1d42-4d0a-98ea-6ab81806e7b3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1264 microversion: 2.1 time: 0.310326 Oct 18 13:45:56.235941 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2906/5595] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:55 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1264 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:57.263071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ff9cd720-bda6-4fa9-aabf-667d7f601f1d tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:57.264293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ff9cd720-bda6-4fa9-aabf-667d7f601f1d tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:57.266417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:45:57.276346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff9cd720-bda6-4fa9-aabf-667d7f601f1d tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:57.284763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff9cd720-bda6-4fa9-aabf-667d7f601f1d tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:57.285317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff9cd720-bda6-4fa9-aabf-667d7f601f1d tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:57.286138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff9cd720-bda6-4fa9-aabf-667d7f601f1d tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:57.288102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff9cd720-bda6-4fa9-aabf-667d7f601f1d tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:57.288609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff9cd720-bda6-4fa9-aabf-667d7f601f1d tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:57.617395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ff9cd720-bda6-4fa9-aabf-667d7f601f1d tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:57.633623 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ff9cd720-bda6-4fa9-aabf-667d7f601f1d tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1270 microversion: 2.1 time: 0.374856 Oct 18 13:45:57.638167 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2690/5596] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:57 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1270 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:58.671523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1fc9a975-c58c-4f84-a962-ee06dda3e9da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:58.673339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1fc9a975-c58c-4f84-a962-ee06dda3e9da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:58.685084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1fc9a975-c58c-4f84-a962-ee06dda3e9da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:58.685600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1fc9a975-c58c-4f84-a962-ee06dda3e9da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:58.686051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1fc9a975-c58c-4f84-a962-ee06dda3e9da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:58.686738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1fc9a975-c58c-4f84-a962-ee06dda3e9da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:58.687449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1fc9a975-c58c-4f84-a962-ee06dda3e9da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:58.687870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1fc9a975-c58c-4f84-a962-ee06dda3e9da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:58.877761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1fc9a975-c58c-4f84-a962-ee06dda3e9da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:45:58.891726 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1fc9a975-c58c-4f84-a962-ee06dda3e9da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1270 microversion: 2.1 time: 0.227814 Oct 18 13:45:58.892450 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2907/5597] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:58 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1270 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:45:59.894462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d6f10d6b-3b1c-4da0-b0e1-0b73ed697504 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Action: 'create', calling method: .version_select at 0x7ff60f7b9550>, body: {"keypair": {"name": "tempest-keypair-1516185963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHSyXOccSzKEPXuIm+E66vc5SriO419WDRn/kw0+7sWElCJmVca3i+Y5xQxOLBiDlplLQnTNW2UBbYx65dRs2mxn5fZAXElWUengWAkn9w+rorXhXaETmtlhqkfhKO2eg=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:45:59.920727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-97b87ee4-1b58-4295-a7be-b8d088de4de8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:45:59.922330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-97b87ee4-1b58-4295-a7be-b8d088de4de8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:45:59.923492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-d6f10d6b-3b1c-4da0-b0e1-0b73ed697504 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for project b134786f443e4760b57d3cb5842daa89. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:45:59.935660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b87ee4-1b58-4295-a7be-b8d088de4de8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:59.938556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-d6f10d6b-3b1c-4da0-b0e1-0b73ed697504 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for user e1fdfb4e43ca40eabb58abe0e9bd4ea3 and project b134786f443e4760b57d3cb5842daa89. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:45:59.942219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b87ee4-1b58-4295-a7be-b8d088de4de8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:59.943486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b87ee4-1b58-4295-a7be-b8d088de4de8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:45:59.944770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b87ee4-1b58-4295-a7be-b8d088de4de8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:45:59.946743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b87ee4-1b58-4295-a7be-b8d088de4de8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:45:59.947949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97b87ee4-1b58-4295-a7be-b8d088de4de8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:00.003839 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d6f10d6b-3b1c-4da0-b0e1-0b73ed697504 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113113 Oct 18 13:46:00.013330 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2691/5598] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:45:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:46:00.592430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-97b87ee4-1b58-4295-a7be-b8d088de4de8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:00.611169 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-97b87ee4-1b58-4295-a7be-b8d088de4de8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1312 microversion: 2.1 time: 0.690110 Oct 18 13:46:00.613450 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2908/5599] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:45:59 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1312 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:01.640510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3b056da7-6201-46e5-a853-2e549fecacad tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:01.641111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3b056da7-6201-46e5-a853-2e549fecacad tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:01.653036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b056da7-6201-46e5-a853-2e549fecacad tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:01.656473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b056da7-6201-46e5-a853-2e549fecacad tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:01.657099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b056da7-6201-46e5-a853-2e549fecacad tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:01.658489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b056da7-6201-46e5-a853-2e549fecacad tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:01.659623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b056da7-6201-46e5-a853-2e549fecacad tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:01.669320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b056da7-6201-46e5-a853-2e549fecacad tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:02.634291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3b056da7-6201-46e5-a853-2e549fecacad tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:02.653227 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3b056da7-6201-46e5-a853-2e549fecacad tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1312 microversion: 2.1 time: 1.017642 Oct 18 13:46:02.655267 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2692/5600] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:01 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1312 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:03.676158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dced696a-7a3d-4049-bc0a-22911d3bb521 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:03.677517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dced696a-7a3d-4049-bc0a-22911d3bb521 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:03.697273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dced696a-7a3d-4049-bc0a-22911d3bb521 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:03.698066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dced696a-7a3d-4049-bc0a-22911d3bb521 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:03.698662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dced696a-7a3d-4049-bc0a-22911d3bb521 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:03.699561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dced696a-7a3d-4049-bc0a-22911d3bb521 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:03.700024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dced696a-7a3d-4049-bc0a-22911d3bb521 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:03.700464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dced696a-7a3d-4049-bc0a-22911d3bb521 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:03.890477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a3c41971-0bf4-48ba-b9d1-d9ef9ba61196 req-af78cd7c-e9db-415c-805b-440ca4a41636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d0a52d-d8cb-486d-9c25-21ef57e40113", "tag": "c6f4ffc8-e834-4fcf-a14d-2b92aaf40b81"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:03.913621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a3c41971-0bf4-48ba-b9d1-d9ef9ba61196 req-af78cd7c-e9db-415c-805b-440ca4a41636 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:03.914474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a3c41971-0bf4-48ba-b9d1-d9ef9ba61196 req-af78cd7c-e9db-415c-805b-440ca4a41636 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:03.917401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a3c41971-0bf4-48ba-b9d1-d9ef9ba61196 req-af78cd7c-e9db-415c-805b-440ca4a41636 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:03.940748 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a3c41971-0bf4-48ba-b9d1-d9ef9ba61196 req-af78cd7c-e9db-415c-805b-440ca4a41636 service nova] Creating event network-changed:c6f4ffc8-e834-4fcf-a14d-2b92aaf40b81 for instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 on n-h2-858384-13 Oct 18 13:46:03.963035 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a3c41971-0bf4-48ba-b9d1-d9ef9ba61196 req-af78cd7c-e9db-415c-805b-440ca4a41636 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076061 Oct 18 13:46:03.963969 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2693/5601] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:46:04.251065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dced696a-7a3d-4049-bc0a-22911d3bb521 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:04.264426 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dced696a-7a3d-4049-bc0a-22911d3bb521 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1312 microversion: 2.1 time: 0.588250 Oct 18 13:46:04.265614 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2909/5602] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:03 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1312 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:04.897877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1982648535", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e79f1988-366e-4b47-8001-6022e690ef28"}], "security_groups": [{"name": "tempest-securitygroup--1235931307"}], "key_name": "tempest-keypair-1516185963", "user_data": "}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:05.301554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-566ad62a-ea6b-460f-8345-26879172bf36 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:05.304617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-566ad62a-ea6b-460f-8345-26879172bf36 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:05.309977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:05.314714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=30 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:05.343823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-566ad62a-ea6b-460f-8345-26879172bf36 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:05.345545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-566ad62a-ea6b-460f-8345-26879172bf36 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:05.346185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-566ad62a-ea6b-460f-8345-26879172bf36 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:05.348310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-566ad62a-ea6b-460f-8345-26879172bf36 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:05.351200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-566ad62a-ea6b-460f-8345-26879172bf36 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:05.352468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-566ad62a-ea6b-460f-8345-26879172bf36 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:05.602552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] validate_networks() for [('e79f1988-366e-4b47-8001-6022e690ef28', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:46:06.014653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-566ad62a-ea6b-460f-8345-26879172bf36 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:06.033035 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-566ad62a-ea6b-460f-8345-26879172bf36 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1312 microversion: 2.1 time: 0.747255 Oct 18 13:46:06.033786 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2910/5603] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:05 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1312 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:07.070530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a149062c-e9b9-489a-8f39-398ad6c4c5c3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:07.072205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a149062c-e9b9-489a-8f39-398ad6c4c5c3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:07.098083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a149062c-e9b9-489a-8f39-398ad6c4c5c3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:07.100159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a149062c-e9b9-489a-8f39-398ad6c4c5c3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:07.101720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a149062c-e9b9-489a-8f39-398ad6c4c5c3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:07.102778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a149062c-e9b9-489a-8f39-398ad6c4c5c3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:07.104011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a149062c-e9b9-489a-8f39-398ad6c4c5c3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:07.104613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a149062c-e9b9-489a-8f39-398ad6c4c5c3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:07.104736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:46:07.105152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:46:07.105530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:46:07.106386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:46:07.106810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:46:07.123880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:07.124288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:07.124749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:07.125492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:07.125933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:07.136801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:07.160051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for project b134786f443e4760b57d3cb5842daa89. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:46:07.166613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for user e1fdfb4e43ca40eabb58abe0e9bd4ea3 and project b134786f443e4760b57d3cb5842daa89. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:46:07.189277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:46:07.191738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:46:07.252690 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2241afaf-69b7-402a-ab44-13874f0f3800 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.361161 Oct 18 13:46:07.254089 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2694/5604] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:46:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:46:07.265543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-901b70f8-e792-4f92-bc5e-27a127d8d9e1 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:07.266414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-901b70f8-e792-4f92-bc5e-27a127d8d9e1 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:07.366188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-901b70f8-e792-4f92-bc5e-27a127d8d9e1 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:07.380403 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-901b70f8-e792-4f92-bc5e-27a127d8d9e1 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1242 microversion: 2.1 time: 0.119255 Oct 18 13:46:07.386314 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2695/5605] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:07 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:46:07.824902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a149062c-e9b9-489a-8f39-398ad6c4c5c3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:07.843294 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a149062c-e9b9-489a-8f39-398ad6c4c5c3 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1312 microversion: 2.1 time: 0.786630 Oct 18 13:46:07.844719 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2911/5606] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:07 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1312 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:46:08.413925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4596473e-c841-40a1-85cc-d43088695e8d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:08.414852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4596473e-c841-40a1-85cc-d43088695e8d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:08.440790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4596473e-c841-40a1-85cc-d43088695e8d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:08.444607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4596473e-c841-40a1-85cc-d43088695e8d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:08.446076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4596473e-c841-40a1-85cc-d43088695e8d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:08.449145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4596473e-c841-40a1-85cc-d43088695e8d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:08.453387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4596473e-c841-40a1-85cc-d43088695e8d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:08.457428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4596473e-c841-40a1-85cc-d43088695e8d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:08.619131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4596473e-c841-40a1-85cc-d43088695e8d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:08.628717 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4596473e-c841-40a1-85cc-d43088695e8d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1294 microversion: 2.1 time: 0.219183 Oct 18 13:46:08.631859 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2696/5607] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:08 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1294 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:08.877430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c3e80e57-7d55-46b9-a0d9-cee55690659e tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:08.879206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c3e80e57-7d55-46b9-a0d9-cee55690659e tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:08.899991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3e80e57-7d55-46b9-a0d9-cee55690659e tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:08.900725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3e80e57-7d55-46b9-a0d9-cee55690659e tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:08.901892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3e80e57-7d55-46b9-a0d9-cee55690659e tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:08.904889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3e80e57-7d55-46b9-a0d9-cee55690659e tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:08.905641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3e80e57-7d55-46b9-a0d9-cee55690659e tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:08.906274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3e80e57-7d55-46b9-a0d9-cee55690659e tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:09.663202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-614f7923-507e-44b4-9449-4d7dfd7d5c89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:09.663928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-614f7923-507e-44b4-9449-4d7dfd7d5c89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:09.681751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-614f7923-507e-44b4-9449-4d7dfd7d5c89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:09.682151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-614f7923-507e-44b4-9449-4d7dfd7d5c89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:09.682595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-614f7923-507e-44b4-9449-4d7dfd7d5c89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:09.689687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-614f7923-507e-44b4-9449-4d7dfd7d5c89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:09.690422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-614f7923-507e-44b4-9449-4d7dfd7d5c89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:09.691444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-614f7923-507e-44b4-9449-4d7dfd7d5c89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:09.762012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c3e80e57-7d55-46b9-a0d9-cee55690659e tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:09.772896 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c3e80e57-7d55-46b9-a0d9-cee55690659e tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1312 microversion: 2.1 time: 0.900270 Oct 18 13:46:09.779719 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2912/5608] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:08 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1312 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:09.839425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-614f7923-507e-44b4-9449-4d7dfd7d5c89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:09.841784 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-614f7923-507e-44b4-9449-4d7dfd7d5c89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1300 microversion: 2.1 time: 0.189445 Oct 18 13:46:09.853754 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2697/5609] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:09 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1300 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:46:10.795799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f605a670-d45d-4641-86e0-c9dc5b52232b tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:10.796429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f605a670-d45d-4641-86e0-c9dc5b52232b tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:10.820391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f605a670-d45d-4641-86e0-c9dc5b52232b tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:10.820896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f605a670-d45d-4641-86e0-c9dc5b52232b tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:10.821369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f605a670-d45d-4641-86e0-c9dc5b52232b tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:10.822090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f605a670-d45d-4641-86e0-c9dc5b52232b tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:10.822538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f605a670-d45d-4641-86e0-c9dc5b52232b tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:10.823175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f605a670-d45d-4641-86e0-c9dc5b52232b tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:10.866603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c48a872-0e52-4554-83ed-7a62b3dd4de3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:10.867223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7c48a872-0e52-4554-83ed-7a62b3dd4de3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:10.878690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c48a872-0e52-4554-83ed-7a62b3dd4de3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:10.879189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c48a872-0e52-4554-83ed-7a62b3dd4de3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:10.880162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c48a872-0e52-4554-83ed-7a62b3dd4de3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:10.880876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c48a872-0e52-4554-83ed-7a62b3dd4de3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:10.881470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c48a872-0e52-4554-83ed-7a62b3dd4de3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:10.881907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c48a872-0e52-4554-83ed-7a62b3dd4de3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:11.042461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7c48a872-0e52-4554-83ed-7a62b3dd4de3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:11.055812 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7c48a872-0e52-4554-83ed-7a62b3dd4de3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1300 microversion: 2.1 time: 0.193155 Oct 18 13:46:11.065307 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2698/5610] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:10 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1300 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:12.083689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9f31883f-214a-442d-9c91-2aa6d8e59458 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:12.083689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9f31883f-214a-442d-9c91-2aa6d8e59458 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:12.110014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f31883f-214a-442d-9c91-2aa6d8e59458 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:12.110014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f31883f-214a-442d-9c91-2aa6d8e59458 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:12.110014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f31883f-214a-442d-9c91-2aa6d8e59458 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:12.111410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f31883f-214a-442d-9c91-2aa6d8e59458 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:12.111410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f31883f-214a-442d-9c91-2aa6d8e59458 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:12.111410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f31883f-214a-442d-9c91-2aa6d8e59458 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:12.221940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9f31883f-214a-442d-9c91-2aa6d8e59458 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:12.236675 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9f31883f-214a-442d-9c91-2aa6d8e59458 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1300 microversion: 2.1 time: 0.160800 Oct 18 13:46:12.238132 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2699/5611] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:12 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1300 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:46:12.288686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f605a670-d45d-4641-86e0-c9dc5b52232b tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:12.303297 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f605a670-d45d-4641-86e0-c9dc5b52232b tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1312 microversion: 2.1 time: 1.511100 Oct 18 13:46:12.304691 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2913/5612] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:10 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1312 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:46:12.751696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-86cf54a5-5f4c-474a-afcc-5fe2c58fc453 req-704a04f3-e6ec-43ae-90dd-92096ce15676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d0a52d-d8cb-486d-9c25-21ef57e40113", "name": "network-vif-plugged", "status": "completed", "tag": "c6f4ffc8-e834-4fcf-a14d-2b92aaf40b81"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:12.771714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-86cf54a5-5f4c-474a-afcc-5fe2c58fc453 req-704a04f3-e6ec-43ae-90dd-92096ce15676 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:12.772421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-86cf54a5-5f4c-474a-afcc-5fe2c58fc453 req-704a04f3-e6ec-43ae-90dd-92096ce15676 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:12.773032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-86cf54a5-5f4c-474a-afcc-5fe2c58fc453 req-704a04f3-e6ec-43ae-90dd-92096ce15676 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:12.791717 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-86cf54a5-5f4c-474a-afcc-5fe2c58fc453 req-704a04f3-e6ec-43ae-90dd-92096ce15676 service nova] Creating event network-vif-plugged:c6f4ffc8-e834-4fcf-a14d-2b92aaf40b81 for instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 on n-h2-858384-13 Oct 18 13:46:12.799818 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-86cf54a5-5f4c-474a-afcc-5fe2c58fc453 req-704a04f3-e6ec-43ae-90dd-92096ce15676 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052462 Oct 18 13:46:12.801091 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2700/5613] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:46:13.261096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-35added2-1854-4eab-a4ee-b07aff41f7b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:13.261834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-35added2-1854-4eab-a4ee-b07aff41f7b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:13.270025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-35added2-1854-4eab-a4ee-b07aff41f7b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:13.271029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-35added2-1854-4eab-a4ee-b07aff41f7b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:13.271711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-35added2-1854-4eab-a4ee-b07aff41f7b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:13.272696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-35added2-1854-4eab-a4ee-b07aff41f7b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:13.273417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-35added2-1854-4eab-a4ee-b07aff41f7b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:13.274074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-35added2-1854-4eab-a4ee-b07aff41f7b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:13.333241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d117f937-310d-4048-8b7a-48cca2b8d900 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:13.335265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d117f937-310d-4048-8b7a-48cca2b8d900 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:13.342639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d117f937-310d-4048-8b7a-48cca2b8d900 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:13.343120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d117f937-310d-4048-8b7a-48cca2b8d900 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:13.343721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d117f937-310d-4048-8b7a-48cca2b8d900 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:13.344582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d117f937-310d-4048-8b7a-48cca2b8d900 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:13.345223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d117f937-310d-4048-8b7a-48cca2b8d900 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:13.345812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d117f937-310d-4048-8b7a-48cca2b8d900 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:13.505470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d117f937-310d-4048-8b7a-48cca2b8d900 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:13.516855 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d117f937-310d-4048-8b7a-48cca2b8d900 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1312 microversion: 2.1 time: 0.188250 Oct 18 13:46:13.534376 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2701/5614] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:13 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1312 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:14.034993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-35added2-1854-4eab-a4ee-b07aff41f7b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:14.051712 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-35added2-1854-4eab-a4ee-b07aff41f7b4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1368 microversion: 2.1 time: 0.795320 Oct 18 13:46:14.080172 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2914/5615] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:13 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1368 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:14.544456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1a9054fc-863f-4d64-a52d-39557498929c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:14.548206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1a9054fc-863f-4d64-a52d-39557498929c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:14.557623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a9054fc-863f-4d64-a52d-39557498929c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:14.558866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a9054fc-863f-4d64-a52d-39557498929c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:14.559942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a9054fc-863f-4d64-a52d-39557498929c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:14.561170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a9054fc-863f-4d64-a52d-39557498929c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:14.562443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a9054fc-863f-4d64-a52d-39557498929c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:14.576937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a9054fc-863f-4d64-a52d-39557498929c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:15.079152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-24af2f75-51ba-4149-8b29-7d11a9976787 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:15.079897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-24af2f75-51ba-4149-8b29-7d11a9976787 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:15.093387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24af2f75-51ba-4149-8b29-7d11a9976787 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:15.093999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24af2f75-51ba-4149-8b29-7d11a9976787 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:15.095178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24af2f75-51ba-4149-8b29-7d11a9976787 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:15.097575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24af2f75-51ba-4149-8b29-7d11a9976787 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:15.099148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24af2f75-51ba-4149-8b29-7d11a9976787 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:15.099667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24af2f75-51ba-4149-8b29-7d11a9976787 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:15.116037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1a9054fc-863f-4d64-a52d-39557498929c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:15.133774 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1a9054fc-863f-4d64-a52d-39557498929c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1497 microversion: 2.1 time: 0.596509 Oct 18 13:46:15.136976 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2702/5616] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:14 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1497 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:15.163238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9188a8f5-057a-47d5-b590-5de10c405a5f tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:15.196906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.compute.server_groups [None req-9188a8f5-057a-47d5-b590-5de10c405a5f tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Querying cell a8e216eb-ce73-4101-a62e-f9159a9c2bcf(cell1) for 1 instances {{(pid=120612) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 13:46:15.198349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9188a8f5-057a-47d5-b590-5de10c405a5f tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:15.199539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9188a8f5-057a-47d5-b590-5de10c405a5f tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:15.200741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9188a8f5-057a-47d5-b590-5de10c405a5f tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:15.248183 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9188a8f5-057a-47d5-b590-5de10c405a5f tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/d3b04da3-39ce-4766-a4a7-fe4c1d83cf51" status: 200 len: 221 microversion: 2.1 time: 0.092329 Oct 18 13:46:15.250030 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2703/5617] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:46:15 2022] GET /compute/v2.1/os-server-groups/d3b04da3-39ce-4766-a4a7-fe4c1d83cf51 => generated 221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:46:15.273609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-08e8189d-8c0a-45f4-9092-a9626bda05a5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:15.273829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-08e8189d-8c0a-45f4-9092-a9626bda05a5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:15.280591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08e8189d-8c0a-45f4-9092-a9626bda05a5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:15.281343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08e8189d-8c0a-45f4-9092-a9626bda05a5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:15.282302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08e8189d-8c0a-45f4-9092-a9626bda05a5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:15.283341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08e8189d-8c0a-45f4-9092-a9626bda05a5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:15.295308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08e8189d-8c0a-45f4-9092-a9626bda05a5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:15.296171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08e8189d-8c0a-45f4-9092-a9626bda05a5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:15.374559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-08e8189d-8c0a-45f4-9092-a9626bda05a5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:46:15.497732 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-08e8189d-8c0a-45f4-9092-a9626bda05a5 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 204 len: 0 microversion: 2.1 time: 0.235988 Oct 18 13:46:15.499149 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2704/5618] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:46:15 2022] DELETE /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:46:15.517447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-acce73fe-65e5-45a4-bd11-873159bd6630 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:15.518466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-acce73fe-65e5-45a4-bd11-873159bd6630 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:15.531694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acce73fe-65e5-45a4-bd11-873159bd6630 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:15.532428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acce73fe-65e5-45a4-bd11-873159bd6630 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:15.533069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acce73fe-65e5-45a4-bd11-873159bd6630 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:15.534187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acce73fe-65e5-45a4-bd11-873159bd6630 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:15.534947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acce73fe-65e5-45a4-bd11-873159bd6630 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:15.535732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-acce73fe-65e5-45a4-bd11-873159bd6630 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:15.880148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-24af2f75-51ba-4149-8b29-7d11a9976787 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:15.892961 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-24af2f75-51ba-4149-8b29-7d11a9976787 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1368 microversion: 2.1 time: 0.818141 Oct 18 13:46:15.894381 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2915/5619] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:15 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1368 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:15.926078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-acce73fe-65e5-45a4-bd11-873159bd6630 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:15.939256 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-acce73fe-65e5-45a4-bd11-873159bd6630 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1503 microversion: 2.1 time: 0.434474 Oct 18 13:46:15.939871 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2705/5620] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:15 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1503 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:15.981833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-cb275bc3-be20-4b85-9787-c7d82600a2d6 req-6a9cd33b-11ef-4c65-8d51-c82ad03d4fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71970dc-22e3-42e6-bb9f-bf0c8699bbfa", "tag": "ce9d94ca-172f-4f87-bf85-67f2a01d8e72"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:15.999617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-cb275bc3-be20-4b85-9787-c7d82600a2d6 req-6a9cd33b-11ef-4c65-8d51-c82ad03d4fc6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:16.000365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-cb275bc3-be20-4b85-9787-c7d82600a2d6 req-6a9cd33b-11ef-4c65-8d51-c82ad03d4fc6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:16.015025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-cb275bc3-be20-4b85-9787-c7d82600a2d6 req-6a9cd33b-11ef-4c65-8d51-c82ad03d4fc6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:16.039024 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-cb275bc3-be20-4b85-9787-c7d82600a2d6 req-6a9cd33b-11ef-4c65-8d51-c82ad03d4fc6 service nova] Creating event network-changed:ce9d94ca-172f-4f87-bf85-67f2a01d8e72 for instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa on n-h1-858384-13 Oct 18 13:46:16.047942 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-cb275bc3-be20-4b85-9787-c7d82600a2d6 req-6a9cd33b-11ef-4c65-8d51-c82ad03d4fc6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073216 Oct 18 13:46:16.049049 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2916/5621] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:46:16.917823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6b8b1fef-1ebd-48f1-9a99-a5e17fbfe1e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:16.918771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6b8b1fef-1ebd-48f1-9a99-a5e17fbfe1e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:16.928229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b8b1fef-1ebd-48f1-9a99-a5e17fbfe1e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:16.934177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b8b1fef-1ebd-48f1-9a99-a5e17fbfe1e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:16.934975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b8b1fef-1ebd-48f1-9a99-a5e17fbfe1e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:16.937409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b8b1fef-1ebd-48f1-9a99-a5e17fbfe1e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:16.939042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b8b1fef-1ebd-48f1-9a99-a5e17fbfe1e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:16.942297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b8b1fef-1ebd-48f1-9a99-a5e17fbfe1e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:16.974069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0357f5b5-c37c-482c-8a7a-4086d34d34da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:16.974069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0357f5b5-c37c-482c-8a7a-4086d34d34da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:16.990496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0357f5b5-c37c-482c-8a7a-4086d34d34da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:16.995041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0357f5b5-c37c-482c-8a7a-4086d34d34da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:16.995842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0357f5b5-c37c-482c-8a7a-4086d34d34da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:16.997007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0357f5b5-c37c-482c-8a7a-4086d34d34da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:17.005892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0357f5b5-c37c-482c-8a7a-4086d34d34da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:17.006701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0357f5b5-c37c-482c-8a7a-4086d34d34da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:17.146899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:17.370720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=38 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:17.662116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6b8b1fef-1ebd-48f1-9a99-a5e17fbfe1e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:17.673498 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6b8b1fef-1ebd-48f1-9a99-a5e17fbfe1e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1368 microversion: 2.1 time: 0.759565 Oct 18 13:46:17.685987 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2706/5622] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:16 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1368 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:17.754497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0357f5b5-c37c-482c-8a7a-4086d34d34da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:17.774231 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0357f5b5-c37c-482c-8a7a-4086d34d34da tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1503 microversion: 2.1 time: 0.810433 Oct 18 13:46:17.774834 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2917/5623] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:16 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1503 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:18.694097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-2cb47bee-737b-494f-9b62-f73d37f96c9b req-745829c4-3e74-4a55-ba8e-969b312a4c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d0a52d-d8cb-486d-9c25-21ef57e40113", "name": "network-vif-deleted", "tag": "c6f4ffc8-e834-4fcf-a14d-2b92aaf40b81"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:18.715906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e41fe2ae-4078-4cdc-8987-5efaf2702aa7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:18.717616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e41fe2ae-4078-4cdc-8987-5efaf2702aa7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:18.750251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41fe2ae-4078-4cdc-8987-5efaf2702aa7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:18.750769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41fe2ae-4078-4cdc-8987-5efaf2702aa7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:18.751200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41fe2ae-4078-4cdc-8987-5efaf2702aa7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:18.751915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41fe2ae-4078-4cdc-8987-5efaf2702aa7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:18.757229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2cb47bee-737b-494f-9b62-f73d37f96c9b req-745829c4-3e74-4a55-ba8e-969b312a4c23 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:18.761892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41fe2ae-4078-4cdc-8987-5efaf2702aa7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:18.762421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41fe2ae-4078-4cdc-8987-5efaf2702aa7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:18.770867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2cb47bee-737b-494f-9b62-f73d37f96c9b req-745829c4-3e74-4a55-ba8e-969b312a4c23 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:18.771317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2cb47bee-737b-494f-9b62-f73d37f96c9b req-745829c4-3e74-4a55-ba8e-969b312a4c23 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:18.808633 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-2cb47bee-737b-494f-9b62-f73d37f96c9b req-745829c4-3e74-4a55-ba8e-969b312a4c23 service nova] Creating event network-vif-deleted:c6f4ffc8-e834-4fcf-a14d-2b92aaf40b81 for instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 on n-h2-858384-13 Oct 18 13:46:18.826931 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-2cb47bee-737b-494f-9b62-f73d37f96c9b req-745829c4-3e74-4a55-ba8e-969b312a4c23 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137126 Oct 18 13:46:18.827893 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2707/5624] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:46:18.833868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:18.834582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:18.860210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:18.861021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:18.861976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:18.863931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:18.864716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:18.865395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:18.911620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:18.912409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:18.913011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:18.913655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lazy-loading 'fault' on Instance uuid c1d0a52d-d8cb-486d-9c25-21ef57e40113 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:46:19.069777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c51264420cfa4ac8a0d36eb28ef964bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55a201743844504ae6ca3556a1b5a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:19.074637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e41fe2ae-4078-4cdc-8987-5efaf2702aa7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:19.104897 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-19809fad-de7a-47b2-8d7a-6304d258dfee tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 200 len: 1302 microversion: 2.1 time: 0.275673 Oct 18 13:46:19.105531 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2708/5625] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:18 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 1302 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:19.107773 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e41fe2ae-4078-4cdc-8987-5efaf2702aa7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1368 microversion: 2.1 time: 0.398988 Oct 18 13:46:19.108643 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2918/5626] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:18 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1368 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:20.128160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-816d5cb7-af23-485d-8218-92d7369f6c26 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:20.128779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-816d5cb7-af23-485d-8218-92d7369f6c26 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:20.136648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-816b614f-b660-4801-bd75-e48ecb19adb3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:20.137860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-816b614f-b660-4801-bd75-e48ecb19adb3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:20.162075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-816d5cb7-af23-485d-8218-92d7369f6c26 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:20.164157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-816d5cb7-af23-485d-8218-92d7369f6c26 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:20.164912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-816d5cb7-af23-485d-8218-92d7369f6c26 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:20.165715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-816b614f-b660-4801-bd75-e48ecb19adb3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:20.166470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-816d5cb7-af23-485d-8218-92d7369f6c26 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:20.167207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-816b614f-b660-4801-bd75-e48ecb19adb3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:20.167909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-816d5cb7-af23-485d-8218-92d7369f6c26 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:20.168584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-816b614f-b660-4801-bd75-e48ecb19adb3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:20.169265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-816d5cb7-af23-485d-8218-92d7369f6c26 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:20.175030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-816b614f-b660-4801-bd75-e48ecb19adb3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:20.175929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-816b614f-b660-4801-bd75-e48ecb19adb3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:20.177465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-816b614f-b660-4801-bd75-e48ecb19adb3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:20.219104 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-816d5cb7-af23-485d-8218-92d7369f6c26 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] HTTP exception thrown: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-816d5cb7-af23-485d-8218-92d7369f6c26 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Request method failure captured: Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 HTTP/1.1 Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq4OCO8GiUJ3sn56enbETCU-9aAWo1J09YxincCvv0HSZoE5stMq9U5SoKLY06aaX2MJAjy0M0sTuRp9BXEoJjcLEivmnyWAcEAnw9MqUY5N-m_gIfNw4yev6s0FsL6g-WeFZg_eIPSR5s8OMsKpMvx7w0MGDy5I71ZqaiD-NvQGkdY Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c55a201743844504ae6ca3556a1b5a1e"}]}] Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c51264420cfa4ac8a0d36eb28ef964bb Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c1d0a52d-d8cb-486d-9c25-21ef57e40113'} Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.224562 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.232239 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.232239 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.232239 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.232239 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:46:20.232239 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:46:20.232239 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.232239 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.232239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-816d5cb7-af23-485d-8218-92d7369f6c26 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Returning 404 to user: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:46:20.232239 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-816d5cb7-af23-485d-8218-92d7369f6c26 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 404 len: 111 microversion: 2.1 time: 0.101818 Oct 18 13:46:20.232239 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2709/5627] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:20 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:46:20.242218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e261c2b2-c15f-4f49-b1a7-05987eca02f8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:20.293743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.compute.server_groups [None req-e261c2b2-c15f-4f49-b1a7-05987eca02f8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Querying cell a8e216eb-ce73-4101-a62e-f9159a9c2bcf(cell1) for 1 instances {{(pid=120612) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 13:46:20.294619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e261c2b2-c15f-4f49-b1a7-05987eca02f8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:20.295200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e261c2b2-c15f-4f49-b1a7-05987eca02f8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:20.295738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e261c2b2-c15f-4f49-b1a7-05987eca02f8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:20.301565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:20.327655 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e261c2b2-c15f-4f49-b1a7-05987eca02f8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.092063 Oct 18 13:46:20.335874 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2710/5628] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:46:20 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:46:20.341204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4fe737a8-6779-4580-b55d-b11b83d3b692 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:20.375067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.compute.server_groups [None req-4fe737a8-6779-4580-b55d-b11b83d3b692 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Querying cell a8e216eb-ce73-4101-a62e-f9159a9c2bcf(cell1) for 1 instances {{(pid=120612) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 18 13:46:20.375907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe737a8-6779-4580-b55d-b11b83d3b692 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:20.376313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe737a8-6779-4580-b55d-b11b83d3b692 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:20.376746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe737a8-6779-4580-b55d-b11b83d3b692 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:20.419081 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4fe737a8-6779-4580-b55d-b11b83d3b692 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/d3b04da3-39ce-4766-a4a7-fe4c1d83cf51" status: 200 len: 183 microversion: 2.1 time: 0.081601 Oct 18 13:46:20.420447 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2711/5629] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 13:46:20 2022] GET /compute/v2.1/os-server-groups/d3b04da3-39ce-4766-a4a7-fe4c1d83cf51 => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:46:20.449870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-75c2d2c0-5676-45a4-a46a-59ed83f1af00 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:20.450499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-75c2d2c0-5676-45a4-a46a-59ed83f1af00 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:20.464532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75c2d2c0-5676-45a4-a46a-59ed83f1af00 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:20.467647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75c2d2c0-5676-45a4-a46a-59ed83f1af00 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:20.470545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75c2d2c0-5676-45a4-a46a-59ed83f1af00 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:20.471671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75c2d2c0-5676-45a4-a46a-59ed83f1af00 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:20.472140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75c2d2c0-5676-45a4-a46a-59ed83f1af00 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:20.472599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75c2d2c0-5676-45a4-a46a-59ed83f1af00 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:20.516779 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-75c2d2c0-5676-45a4-a46a-59ed83f1af00 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] HTTP exception thrown: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-75c2d2c0-5676-45a4-a46a-59ed83f1af00 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Request method failure captured: Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 HTTP/1.1 Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq4OCO8GiUJ3sn56enbETCU-9aAWo1J09YxincCvv0HSZoE5stMq9U5SoKLY06aaX2MJAjy0M0sTuRp9BXEoJjcLEivmnyWAcEAnw9MqUY5N-m_gIfNw4yev6s0FsL6g-WeFZg_eIPSR5s8OMsKpMvx7w0MGDy5I71ZqaiD-NvQGkdY Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c55a201743844504ae6ca3556a1b5a1e"}]}] Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c51264420cfa4ac8a0d36eb28ef964bb Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c1d0a52d-d8cb-486d-9c25-21ef57e40113'} Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:46:20.523577 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:46:20.528074 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.528074 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.528074 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.528074 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.528074 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.528074 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.528074 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.528074 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:46:20.528074 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:46:20.528074 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.528074 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.528074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-75c2d2c0-5676-45a4-a46a-59ed83f1af00 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Returning 404 to user: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:46:20.528074 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-75c2d2c0-5676-45a4-a46a-59ed83f1af00 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 404 len: 111 microversion: 2.1 time: 0.090067 Oct 18 13:46:20.531003 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2712/5630] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:46:20 2022] DELETE /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:46:20.546152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96614cfd-b8e3-43bc-a02f-4277c6364dc2 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:20.547460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-96614cfd-b8e3-43bc-a02f-4277c6364dc2 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] [instance: c1d0a52d-d8cb-486d-9c25-21ef57e40113] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:20.560638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96614cfd-b8e3-43bc-a02f-4277c6364dc2 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:20.561137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96614cfd-b8e3-43bc-a02f-4277c6364dc2 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:20.561607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96614cfd-b8e3-43bc-a02f-4277c6364dc2 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:20.562733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96614cfd-b8e3-43bc-a02f-4277c6364dc2 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:20.563024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96614cfd-b8e3-43bc-a02f-4277c6364dc2 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:20.563441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96614cfd-b8e3-43bc-a02f-4277c6364dc2 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:20.612804 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-96614cfd-b8e3-43bc-a02f-4277c6364dc2 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] HTTP exception thrown: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96614cfd-b8e3-43bc-a02f-4277c6364dc2 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Request method failure captured: Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 HTTP/1.1 Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq4OCO8GiUJ3sn56enbETCU-9aAWo1J09YxincCvv0HSZoE5stMq9U5SoKLY06aaX2MJAjy0M0sTuRp9BXEoJjcLEivmnyWAcEAnw9MqUY5N-m_gIfNw4yev6s0FsL6g-WeFZg_eIPSR5s8OMsKpMvx7w0MGDy5I71ZqaiD-NvQGkdY Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c55a201743844504ae6ca3556a1b5a1e"}]}] Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c51264420cfa4ac8a0d36eb28ef964bb Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c1d0a52d-d8cb-486d-9c25-21ef57e40113'} Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.615005 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.619460 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.619460 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.619460 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.619460 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:46:20.619460 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:46:20.619460 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. Oct 18 13:46:20.619460 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.619460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96614cfd-b8e3-43bc-a02f-4277c6364dc2 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Returning 404 to user: Instance c1d0a52d-d8cb-486d-9c25-21ef57e40113 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:46:20.619460 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-96614cfd-b8e3-43bc-a02f-4277c6364dc2 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113" status: 404 len: 111 microversion: 2.1 time: 0.083257 Oct 18 13:46:20.619460 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2713/5631] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:20 2022] GET /compute/v2.1/servers/c1d0a52d-d8cb-486d-9c25-21ef57e40113 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:46:20.628390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-041d1525-c3b2-4588-b00c-1394f86f94ab tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:20.637511 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-041d1525-c3b2-4588-b00c-1394f86f94ab tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] HTTP exception thrown: Instance group 2c48e440-0b96-4168-8d19-a612891e0ae6 could not be found. Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-041d1525-c3b2-4588-b00c-1394f86f94ab tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Request method failure captured: Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-server-groups/2c48e440-0b96-4168-8d19-a612891e0ae6 HTTP/1.1 Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq4OCO8GiUJ3sn56enbETCU-9aAWo1J09YxincCvv0HSZoE5stMq9U5SoKLY06aaX2MJAjy0M0sTuRp9BXEoJjcLEivmnyWAcEAnw9MqUY5N-m_gIfNw4yev6s0FsL6g-WeFZg_eIPSR5s8OMsKpMvx7w0MGDy5I71ZqaiD-NvQGkdY Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c55a201743844504ae6ca3556a1b5a1e"}]}] Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c51264420cfa4ac8a0d36eb28ef964bb Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance group 2c48e440-0b96-4168-8d19-a612891e0ae6 could not be found. Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '2c48e440-0b96-4168-8d19-a612891e0ae6'} Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2c48e440-0b96-4168-8d19-a612891e0ae6 could not be found. Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2c48e440-0b96-4168-8d19-a612891e0ae6 could not be found. Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.642362 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.646964 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.646964 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.646964 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:46:20.646964 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:46:20.646964 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2c48e440-0b96-4168-8d19-a612891e0ae6 could not be found. Oct 18 13:46:20.646964 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.646964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-041d1525-c3b2-4588-b00c-1394f86f94ab tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Returning 404 to user: Instance group 2c48e440-0b96-4168-8d19-a612891e0ae6 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:46:20.646964 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-041d1525-c3b2-4588-b00c-1394f86f94ab tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/2c48e440-0b96-4168-8d19-a612891e0ae6" status: 404 len: 117 microversion: 2.1 time: 0.019279 Oct 18 13:46:20.650281 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2714/5632] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 18 13:46:20 2022] DELETE /compute/v2.1/os-server-groups/2c48e440-0b96-4168-8d19-a612891e0ae6 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:46:20.664855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dfe730e2-48bd-4afc-a1eb-1b6fe24f6683 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:20.682539 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-dfe730e2-48bd-4afc-a1eb-1b6fe24f6683 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] HTTP exception thrown: Instance group a5683e34-8e1a-40a1-a146-4f25dcfd18e3 could not be found. Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dfe730e2-48bd-4afc-a1eb-1b6fe24f6683 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Request method failure captured: Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-server-groups/a5683e34-8e1a-40a1-a146-4f25dcfd18e3 HTTP/1.1 Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq4OCO8GiUJ3sn56enbETCU-9aAWo1J09YxincCvv0HSZoE5stMq9U5SoKLY06aaX2MJAjy0M0sTuRp9BXEoJjcLEivmnyWAcEAnw9MqUY5N-m_gIfNw4yev6s0FsL6g-WeFZg_eIPSR5s8OMsKpMvx7w0MGDy5I71ZqaiD-NvQGkdY Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c55a201743844504ae6ca3556a1b5a1e"}]}] Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c51264420cfa4ac8a0d36eb28ef964bb Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance group a5683e34-8e1a-40a1-a146-4f25dcfd18e3 could not be found. Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'a5683e34-8e1a-40a1-a146-4f25dcfd18e3'} Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a5683e34-8e1a-40a1-a146-4f25dcfd18e3 could not be found. Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a5683e34-8e1a-40a1-a146-4f25dcfd18e3 could not be found. Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.692680 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.696600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.696600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.696600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:46:20.696600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:46:20.696600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a5683e34-8e1a-40a1-a146-4f25dcfd18e3 could not be found. Oct 18 13:46:20.696600 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.696600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dfe730e2-48bd-4afc-a1eb-1b6fe24f6683 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Returning 404 to user: Instance group a5683e34-8e1a-40a1-a146-4f25dcfd18e3 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:46:20.696600 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dfe730e2-48bd-4afc-a1eb-1b6fe24f6683 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/a5683e34-8e1a-40a1-a146-4f25dcfd18e3" status: 404 len: 117 microversion: 2.1 time: 0.043040 Oct 18 13:46:20.696600 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2715/5633] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 18 13:46:20 2022] DELETE /compute/v2.1/os-server-groups/a5683e34-8e1a-40a1-a146-4f25dcfd18e3 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:46:20.708710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f0d1dea-890c-489c-a1b0-d2821b983c1c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:20.715611 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-7f0d1dea-890c-489c-a1b0-d2821b983c1c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] HTTP exception thrown: Instance group 083187b0-c956-4548-892b-81c4d8c6032c could not be found. Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f0d1dea-890c-489c-a1b0-d2821b983c1c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Request method failure captured: Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-server-groups/083187b0-c956-4548-892b-81c4d8c6032c HTTP/1.1 Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq4OCO8GiUJ3sn56enbETCU-9aAWo1J09YxincCvv0HSZoE5stMq9U5SoKLY06aaX2MJAjy0M0sTuRp9BXEoJjcLEivmnyWAcEAnw9MqUY5N-m_gIfNw4yev6s0FsL6g-WeFZg_eIPSR5s8OMsKpMvx7w0MGDy5I71ZqaiD-NvQGkdY Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c55a201743844504ae6ca3556a1b5a1e"}]}] Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c51264420cfa4ac8a0d36eb28ef964bb Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance group 083187b0-c956-4548-892b-81c4d8c6032c could not be found. Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '083187b0-c956-4548-892b-81c4d8c6032c'} Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 083187b0-c956-4548-892b-81c4d8c6032c could not be found. Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 083187b0-c956-4548-892b-81c4d8c6032c could not be found. Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.717459 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.721223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.721223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.721223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:46:20.721223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:46:20.721223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 083187b0-c956-4548-892b-81c4d8c6032c could not be found. Oct 18 13:46:20.721223 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.721223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f0d1dea-890c-489c-a1b0-d2821b983c1c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Returning 404 to user: Instance group 083187b0-c956-4548-892b-81c4d8c6032c could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:46:20.721223 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7f0d1dea-890c-489c-a1b0-d2821b983c1c tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/083187b0-c956-4548-892b-81c4d8c6032c" status: 404 len: 117 microversion: 2.1 time: 0.017531 Oct 18 13:46:20.721223 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2716/5634] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 18 13:46:20 2022] DELETE /compute/v2.1/os-server-groups/083187b0-c956-4548-892b-81c4d8c6032c => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:46:20.734623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42a440e3-fcf0-49ed-b107-ebc9e2a4b12a tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:20.742776 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-42a440e3-fcf0-49ed-b107-ebc9e2a4b12a tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] HTTP exception thrown: Instance group c88a2a03-36d2-4ce3-93a3-0ede0cd19bca could not be found. Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42a440e3-fcf0-49ed-b107-ebc9e2a4b12a tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Request method failure captured: Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/os-server-groups/c88a2a03-36d2-4ce3-93a3-0ede0cd19bca HTTP/1.1 Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq4OCO8GiUJ3sn56enbETCU-9aAWo1J09YxincCvv0HSZoE5stMq9U5SoKLY06aaX2MJAjy0M0sTuRp9BXEoJjcLEivmnyWAcEAnw9MqUY5N-m_gIfNw4yev6s0FsL6g-WeFZg_eIPSR5s8OMsKpMvx7w0MGDy5I71ZqaiD-NvQGkdY Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55a201743844504ae6ca3556a1b5a1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c55a201743844504ae6ca3556a1b5a1e"}]}] Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: c55a201743844504ae6ca3556a1b5a1e Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerGroupTestJSON-734410471 Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c51264420cfa4ac8a0d36eb28ef964bb Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerGroupTestJSON-734410471-project Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance group c88a2a03-36d2-4ce3-93a3-0ede0cd19bca could not be found. Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c88a2a03-36d2-4ce3-93a3-0ede0cd19bca'} Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c88a2a03-36d2-4ce3-93a3-0ede0cd19bca could not be found. Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c88a2a03-36d2-4ce3-93a3-0ede0cd19bca could not be found. Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.744394 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:46:20.749750 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:46:20.749750 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:46:20.749750 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:46:20.749750 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:46:20.749750 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c88a2a03-36d2-4ce3-93a3-0ede0cd19bca could not be found. Oct 18 13:46:20.749750 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:46:20.749750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42a440e3-fcf0-49ed-b107-ebc9e2a4b12a tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Returning 404 to user: Instance group c88a2a03-36d2-4ce3-93a3-0ede0cd19bca could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:46:20.751209 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-42a440e3-fcf0-49ed-b107-ebc9e2a4b12a tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/c88a2a03-36d2-4ce3-93a3-0ede0cd19bca" status: 404 len: 117 microversion: 2.1 time: 0.022338 Oct 18 13:46:20.752503 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2717/5635] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 18 13:46:20 2022] DELETE /compute/v2.1/os-server-groups/c88a2a03-36d2-4ce3-93a3-0ede0cd19bca => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:46:20.764031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e974e95-5d2b-45cd-ba9f-7d54dbaa1cb8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:20.793087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:20.802659 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1e974e95-5d2b-45cd-ba9f-7d54dbaa1cb8 tempest-ServerGroupTestJSON-734410471 tempest-ServerGroupTestJSON-734410471-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/d3b04da3-39ce-4766-a4a7-fe4c1d83cf51" status: 204 len: 0 microversion: 2.1 time: 0.043356 Oct 18 13:46:20.806535 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2718/5636] 10.222.0.40 () {58 vars in 1266 bytes} [Tue Oct 18 13:46:20 2022] DELETE /compute/v2.1/os-server-groups/d3b04da3-39ce-4766-a4a7-fe4c1d83cf51 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:46:20.922061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-816b614f-b660-4801-bd75-e48ecb19adb3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:20.934034 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-816b614f-b660-4801-bd75-e48ecb19adb3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1368 microversion: 2.1 time: 0.802682 Oct 18 13:46:20.935129 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2919/5637] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:20 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1368 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:21.961257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4de8b6e6-0e0a-454c-b335-74d3b2fe93e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:21.961994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4de8b6e6-0e0a-454c-b335-74d3b2fe93e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:21.983889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4de8b6e6-0e0a-454c-b335-74d3b2fe93e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:21.984635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4de8b6e6-0e0a-454c-b335-74d3b2fe93e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:21.985152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4de8b6e6-0e0a-454c-b335-74d3b2fe93e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:21.992852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4de8b6e6-0e0a-454c-b335-74d3b2fe93e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:21.993661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4de8b6e6-0e0a-454c-b335-74d3b2fe93e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:21.994013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4de8b6e6-0e0a-454c-b335-74d3b2fe93e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:22.481896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4de8b6e6-0e0a-454c-b335-74d3b2fe93e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:22.491906 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4de8b6e6-0e0a-454c-b335-74d3b2fe93e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1368 microversion: 2.1 time: 0.537003 Oct 18 13:46:22.499840 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2719/5638] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:21 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1368 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:23.518856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68effd9e-fe4c-4820-81d3-7ccc6e8b5017 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:23.521379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-68effd9e-fe4c-4820-81d3-7ccc6e8b5017 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:23.547929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68effd9e-fe4c-4820-81d3-7ccc6e8b5017 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:23.550148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68effd9e-fe4c-4820-81d3-7ccc6e8b5017 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:23.551517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68effd9e-fe4c-4820-81d3-7ccc6e8b5017 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:23.553000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68effd9e-fe4c-4820-81d3-7ccc6e8b5017 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:23.555827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68effd9e-fe4c-4820-81d3-7ccc6e8b5017 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:23.560392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68effd9e-fe4c-4820-81d3-7ccc6e8b5017 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:23.580986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=83 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:24.287422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68effd9e-fe4c-4820-81d3-7ccc6e8b5017 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:24.301907 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68effd9e-fe4c-4820-81d3-7ccc6e8b5017 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1368 microversion: 2.1 time: 0.789147 Oct 18 13:46:24.304220 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2920/5639] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:23 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1368 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:25.345117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a41ae825-b4a1-4d63-911d-b7b031690b7d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:25.349422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a41ae825-b4a1-4d63-911d-b7b031690b7d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:25.360757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a41ae825-b4a1-4d63-911d-b7b031690b7d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:25.361718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a41ae825-b4a1-4d63-911d-b7b031690b7d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:25.369341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a41ae825-b4a1-4d63-911d-b7b031690b7d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:25.371445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a41ae825-b4a1-4d63-911d-b7b031690b7d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:25.372190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a41ae825-b4a1-4d63-911d-b7b031690b7d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:25.372878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a41ae825-b4a1-4d63-911d-b7b031690b7d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:25.988039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a41ae825-b4a1-4d63-911d-b7b031690b7d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:25.996763 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a41ae825-b4a1-4d63-911d-b7b031690b7d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1368 microversion: 2.1 time: 0.670847 Oct 18 13:46:26.005575 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2720/5640] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:25 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1368 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:27.031478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-92d6cf8d-57ea-40fe-ae42-425642793f76 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:27.032157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-92d6cf8d-57ea-40fe-ae42-425642793f76 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:27.053909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=53 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:27.068796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92d6cf8d-57ea-40fe-ae42-425642793f76 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:27.069758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92d6cf8d-57ea-40fe-ae42-425642793f76 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:27.073334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92d6cf8d-57ea-40fe-ae42-425642793f76 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:27.075610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92d6cf8d-57ea-40fe-ae42-425642793f76 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:27.077612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92d6cf8d-57ea-40fe-ae42-425642793f76 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:27.081104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92d6cf8d-57ea-40fe-ae42-425642793f76 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:27.550178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-4b8ad6fa-19ec-4d5c-9590-2ba40fcfdbf4 req-31f14777-ebe1-499a-bda5-0d6fcb17a957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71970dc-22e3-42e6-bb9f-bf0c8699bbfa", "name": "network-vif-plugged", "status": "completed", "tag": "ce9d94ca-172f-4f87-bf85-67f2a01d8e72"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:27.570007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4b8ad6fa-19ec-4d5c-9590-2ba40fcfdbf4 req-31f14777-ebe1-499a-bda5-0d6fcb17a957 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:27.573280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4b8ad6fa-19ec-4d5c-9590-2ba40fcfdbf4 req-31f14777-ebe1-499a-bda5-0d6fcb17a957 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:27.573954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4b8ad6fa-19ec-4d5c-9590-2ba40fcfdbf4 req-31f14777-ebe1-499a-bda5-0d6fcb17a957 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:27.608866 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4b8ad6fa-19ec-4d5c-9590-2ba40fcfdbf4 req-31f14777-ebe1-499a-bda5-0d6fcb17a957 service nova] Creating event network-vif-plugged:ce9d94ca-172f-4f87-bf85-67f2a01d8e72 for instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa on n-h1-858384-13 Oct 18 13:46:27.624574 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-4b8ad6fa-19ec-4d5c-9590-2ba40fcfdbf4 req-31f14777-ebe1-499a-bda5-0d6fcb17a957 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079406 Oct 18 13:46:27.627591 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2721/5641] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:46:27.710972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-92d6cf8d-57ea-40fe-ae42-425642793f76 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:27.723293 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-92d6cf8d-57ea-40fe-ae42-425642793f76 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1368 microversion: 2.1 time: 0.696117 Oct 18 13:46:27.725989 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2921/5642] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:27 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1368 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:28.755838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3c015e35-9005-46ce-88ba-bc46d9dc989e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:28.756681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3c015e35-9005-46ce-88ba-bc46d9dc989e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:28.770275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c015e35-9005-46ce-88ba-bc46d9dc989e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:28.773448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c015e35-9005-46ce-88ba-bc46d9dc989e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:28.775407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c015e35-9005-46ce-88ba-bc46d9dc989e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:28.776392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c015e35-9005-46ce-88ba-bc46d9dc989e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:28.778362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c015e35-9005-46ce-88ba-bc46d9dc989e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:28.779964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c015e35-9005-46ce-88ba-bc46d9dc989e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:29.366001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3c015e35-9005-46ce-88ba-bc46d9dc989e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:29.375785 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3c015e35-9005-46ce-88ba-bc46d9dc989e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1368 microversion: 2.1 time: 0.629164 Oct 18 13:46:29.381534 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2722/5643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:28 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1368 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:30.409646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a77fc112-a658-4efe-8204-1cd15d180b08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:30.418972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a77fc112-a658-4efe-8204-1cd15d180b08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:30.436408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a77fc112-a658-4efe-8204-1cd15d180b08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:30.439525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a77fc112-a658-4efe-8204-1cd15d180b08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:30.440422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a77fc112-a658-4efe-8204-1cd15d180b08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:30.441574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a77fc112-a658-4efe-8204-1cd15d180b08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:30.442200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a77fc112-a658-4efe-8204-1cd15d180b08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:30.442862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a77fc112-a658-4efe-8204-1cd15d180b08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:30.446520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1284535800", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:30.522972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:46:30.919069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a77fc112-a658-4efe-8204-1cd15d180b08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:30.935472 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a77fc112-a658-4efe-8204-1cd15d180b08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1557 microversion: 2.1 time: 0.529511 Oct 18 13:46:30.937522 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2922/5644] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:30 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1557 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:30.960164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d8f667e6-1237-4351-95c9-dec4c0899f72 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:30.960965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d8f667e6-1237-4351-95c9-dec4c0899f72 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:30.967443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8f667e6-1237-4351-95c9-dec4c0899f72 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:30.974961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8f667e6-1237-4351-95c9-dec4c0899f72 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:30.975690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8f667e6-1237-4351-95c9-dec4c0899f72 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:30.976631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8f667e6-1237-4351-95c9-dec4c0899f72 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:30.977289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8f667e6-1237-4351-95c9-dec4c0899f72 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:30.977904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8f667e6-1237-4351-95c9-dec4c0899f72 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:31.205555 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d8f667e6-1237-4351-95c9-dec4c0899f72 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.250372 Oct 18 13:46:31.207595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:46:31.208378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:46:31.209119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:46:31.210630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:46:31.211300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:46:31.213947 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2923/5645] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:46:30 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:46:31.251408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:31.255001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:31.255477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:31.256243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:31.256702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:31.257127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:31.324226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Getting quotas for project 85efe02f52ab4c3d8703ce6eb9aef38a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:46:31.330616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Getting quotas for user 48c916447d9e4a3cac14b14143455689 and project 85efe02f52ab4c3d8703ce6eb9aef38a. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:46:31.352095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:46:31.355786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:46:31.423423 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a2c3529b-a548-4cbf-9116-2d6a1552f109 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982189 Oct 18 13:46:31.424280 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2723/5646] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:46:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:46:31.446941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8d952cb6-e735-4564-ba21-d70bade9a6aa tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:31.447634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8d952cb6-e735-4564-ba21-d70bade9a6aa tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:31.606250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8d952cb6-e735-4564-ba21-d70bade9a6aa tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:31.633920 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8d952cb6-e735-4564-ba21-d70bade9a6aa tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1214 microversion: 2.1 time: 0.202177 Oct 18 13:46:31.637027 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2924/5647] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:31 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:32.666077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-de2fdd58-fc82-493c-a1c7-0ad2ab92163c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:32.667501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-de2fdd58-fc82-493c-a1c7-0ad2ab92163c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:32.676748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de2fdd58-fc82-493c-a1c7-0ad2ab92163c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:32.678258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de2fdd58-fc82-493c-a1c7-0ad2ab92163c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:32.679097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de2fdd58-fc82-493c-a1c7-0ad2ab92163c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:32.681127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de2fdd58-fc82-493c-a1c7-0ad2ab92163c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:32.682826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de2fdd58-fc82-493c-a1c7-0ad2ab92163c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:32.683586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de2fdd58-fc82-493c-a1c7-0ad2ab92163c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:32.776506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-de2fdd58-fc82-493c-a1c7-0ad2ab92163c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:32.789228 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-de2fdd58-fc82-493c-a1c7-0ad2ab92163c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1266 microversion: 2.1 time: 0.130755 Oct 18 13:46:32.790730 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2724/5648] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:32 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:33.815899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4672b242-3cee-412c-a107-74a34cab63c5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:33.816570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4672b242-3cee-412c-a107-74a34cab63c5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:33.828592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4672b242-3cee-412c-a107-74a34cab63c5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:33.835116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4672b242-3cee-412c-a107-74a34cab63c5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:33.835835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4672b242-3cee-412c-a107-74a34cab63c5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:33.836773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4672b242-3cee-412c-a107-74a34cab63c5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:33.837435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4672b242-3cee-412c-a107-74a34cab63c5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:33.845213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4672b242-3cee-412c-a107-74a34cab63c5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:34.288534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4672b242-3cee-412c-a107-74a34cab63c5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:34.304330 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4672b242-3cee-412c-a107-74a34cab63c5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1272 microversion: 2.1 time: 0.492445 Oct 18 13:46:34.307766 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2925/5649] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:33 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1272 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:35.330346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c2fb872-599a-406c-ba30-78f053faad84 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:35.330974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2c2fb872-599a-406c-ba30-78f053faad84 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:35.341431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c2fb872-599a-406c-ba30-78f053faad84 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:35.342250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c2fb872-599a-406c-ba30-78f053faad84 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:35.342871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c2fb872-599a-406c-ba30-78f053faad84 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:35.343771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c2fb872-599a-406c-ba30-78f053faad84 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:35.344407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c2fb872-599a-406c-ba30-78f053faad84 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:35.345012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c2fb872-599a-406c-ba30-78f053faad84 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:35.474003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2c2fb872-599a-406c-ba30-78f053faad84 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:35.484103 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2c2fb872-599a-406c-ba30-78f053faad84 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1272 microversion: 2.1 time: 0.158165 Oct 18 13:46:35.486146 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2725/5650] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:35 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:35.772521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-0619083b-0c5d-40d7-9fa2-e039b7b2d8cb req-72d639c8-c06f-476a-b218-4814c1d8259c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71970dc-22e3-42e6-bb9f-bf0c8699bbfa", "tag": "ce9d94ca-172f-4f87-bf85-67f2a01d8e72"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:35.791539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0619083b-0c5d-40d7-9fa2-e039b7b2d8cb req-72d639c8-c06f-476a-b218-4814c1d8259c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:35.792698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0619083b-0c5d-40d7-9fa2-e039b7b2d8cb req-72d639c8-c06f-476a-b218-4814c1d8259c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:35.793270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0619083b-0c5d-40d7-9fa2-e039b7b2d8cb req-72d639c8-c06f-476a-b218-4814c1d8259c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:35.809803 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-0619083b-0c5d-40d7-9fa2-e039b7b2d8cb req-72d639c8-c06f-476a-b218-4814c1d8259c service nova] Creating event network-changed:ce9d94ca-172f-4f87-bf85-67f2a01d8e72 for instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa on n-h1-858384-13 Oct 18 13:46:35.817358 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-0619083b-0c5d-40d7-9fa2-e039b7b2d8cb req-72d639c8-c06f-476a-b218-4814c1d8259c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050636 Oct 18 13:46:35.818634 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2926/5651] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:46:36.510591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8e16ce54-d8a4-4e9e-ad29-00aaf50e9b44 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:36.512254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8e16ce54-d8a4-4e9e-ad29-00aaf50e9b44 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:36.534683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e16ce54-d8a4-4e9e-ad29-00aaf50e9b44 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:36.535186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e16ce54-d8a4-4e9e-ad29-00aaf50e9b44 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:36.535358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e16ce54-d8a4-4e9e-ad29-00aaf50e9b44 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:36.536065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e16ce54-d8a4-4e9e-ad29-00aaf50e9b44 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:36.537159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e16ce54-d8a4-4e9e-ad29-00aaf50e9b44 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:36.537599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e16ce54-d8a4-4e9e-ad29-00aaf50e9b44 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:37.177882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8e16ce54-d8a4-4e9e-ad29-00aaf50e9b44 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:37.192397 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8e16ce54-d8a4-4e9e-ad29-00aaf50e9b44 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.688349 Oct 18 13:46:37.193000 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2726/5652] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:36 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:37.875470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d723b9b4-a7d2-4459-9dc8-465cdbfb626f req-aa6c1dd1-73d8-475a-87e1-b6b19d3a2c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb", "tag": "b8b587a2-280d-40a7-b142-ce5b26994211"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:37.892867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d723b9b4-a7d2-4459-9dc8-465cdbfb626f req-aa6c1dd1-73d8-475a-87e1-b6b19d3a2c00 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:37.897400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d723b9b4-a7d2-4459-9dc8-465cdbfb626f req-aa6c1dd1-73d8-475a-87e1-b6b19d3a2c00 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:37.898283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d723b9b4-a7d2-4459-9dc8-465cdbfb626f req-aa6c1dd1-73d8-475a-87e1-b6b19d3a2c00 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:37.919250 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d723b9b4-a7d2-4459-9dc8-465cdbfb626f req-aa6c1dd1-73d8-475a-87e1-b6b19d3a2c00 service nova] Creating event network-changed:b8b587a2-280d-40a7-b142-ce5b26994211 for instance f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb on n-h2-858384-13 Oct 18 13:46:37.932965 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d723b9b4-a7d2-4459-9dc8-465cdbfb626f req-aa6c1dd1-73d8-475a-87e1-b6b19d3a2c00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062434 Oct 18 13:46:37.934464 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2927/5653] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:46:38.217213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9a79c83b-62e7-4d31-a108-3dbe296a90d6 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:38.218404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9a79c83b-62e7-4d31-a108-3dbe296a90d6 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:38.236697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a79c83b-62e7-4d31-a108-3dbe296a90d6 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:38.237410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a79c83b-62e7-4d31-a108-3dbe296a90d6 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:38.238238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a79c83b-62e7-4d31-a108-3dbe296a90d6 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:38.239768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a79c83b-62e7-4d31-a108-3dbe296a90d6 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:38.240231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a79c83b-62e7-4d31-a108-3dbe296a90d6 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:38.240684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a79c83b-62e7-4d31-a108-3dbe296a90d6 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:38.582301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9a79c83b-62e7-4d31-a108-3dbe296a90d6 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:38.607886 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9a79c83b-62e7-4d31-a108-3dbe296a90d6 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.394705 Oct 18 13:46:38.640118 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2727/5654] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:38 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:39.640611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c5eb127a-7b83-44a4-b8f0-7153a86c65b7 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:39.642145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c5eb127a-7b83-44a4-b8f0-7153a86c65b7 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:39.650008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5eb127a-7b83-44a4-b8f0-7153a86c65b7 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:39.650944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5eb127a-7b83-44a4-b8f0-7153a86c65b7 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:39.651613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5eb127a-7b83-44a4-b8f0-7153a86c65b7 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:39.652578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5eb127a-7b83-44a4-b8f0-7153a86c65b7 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:39.653309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5eb127a-7b83-44a4-b8f0-7153a86c65b7 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:39.654021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5eb127a-7b83-44a4-b8f0-7153a86c65b7 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:40.003796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c5eb127a-7b83-44a4-b8f0-7153a86c65b7 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:40.021252 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c5eb127a-7b83-44a4-b8f0-7153a86c65b7 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.385551 Oct 18 13:46:40.022716 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2928/5655] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:39 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:41.053129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-64851eb3-f4c4-4a7f-8249-9e818209c06c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:41.053565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-64851eb3-f4c4-4a7f-8249-9e818209c06c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:41.065351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64851eb3-f4c4-4a7f-8249-9e818209c06c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:41.067007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64851eb3-f4c4-4a7f-8249-9e818209c06c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:41.067678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64851eb3-f4c4-4a7f-8249-9e818209c06c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:41.068842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64851eb3-f4c4-4a7f-8249-9e818209c06c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:41.069559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64851eb3-f4c4-4a7f-8249-9e818209c06c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:41.070250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-64851eb3-f4c4-4a7f-8249-9e818209c06c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:41.296655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:41.346803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:41.618325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-64851eb3-f4c4-4a7f-8249-9e818209c06c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:41.628220 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-64851eb3-f4c4-4a7f-8249-9e818209c06c tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.586995 Oct 18 13:46:41.632047 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2728/5656] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:41 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:42.658354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c63d98cc-5836-4045-ae4e-48c1bd15c61e tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:42.659677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c63d98cc-5836-4045-ae4e-48c1bd15c61e tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:42.666561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:42.668556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c63d98cc-5836-4045-ae4e-48c1bd15c61e tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:42.669742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c63d98cc-5836-4045-ae4e-48c1bd15c61e tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:42.670433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c63d98cc-5836-4045-ae4e-48c1bd15c61e tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:42.671316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c63d98cc-5836-4045-ae4e-48c1bd15c61e tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:42.671939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c63d98cc-5836-4045-ae4e-48c1bd15c61e tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:42.672532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c63d98cc-5836-4045-ae4e-48c1bd15c61e tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:43.182366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c63d98cc-5836-4045-ae4e-48c1bd15c61e tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:43.196560 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c63d98cc-5836-4045-ae4e-48c1bd15c61e tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.542236 Oct 18 13:46:43.200559 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2929/5657] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:42 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:44.226017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6b71fd77-1249-4d2b-8393-484c6a02b392 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:44.229088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6b71fd77-1249-4d2b-8393-484c6a02b392 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:44.248519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b71fd77-1249-4d2b-8393-484c6a02b392 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:44.250870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b71fd77-1249-4d2b-8393-484c6a02b392 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:44.251807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b71fd77-1249-4d2b-8393-484c6a02b392 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:44.253702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b71fd77-1249-4d2b-8393-484c6a02b392 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:44.254411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b71fd77-1249-4d2b-8393-484c6a02b392 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:44.255402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b71fd77-1249-4d2b-8393-484c6a02b392 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:44.640121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6b71fd77-1249-4d2b-8393-484c6a02b392 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:44.691691 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6b71fd77-1249-4d2b-8393-484c6a02b392 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.469014 Oct 18 13:46:44.693328 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2729/5658] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:44 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:45.270867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-07b75b4d-a101-4d51-82eb-67e8723845de req-c7e28c23-c35a-43ef-b88c-5948d4f09bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb", "name": "network-vif-plugged", "status": "completed", "tag": "b8b587a2-280d-40a7-b142-ce5b26994211"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:45.282240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-07b75b4d-a101-4d51-82eb-67e8723845de req-c7e28c23-c35a-43ef-b88c-5948d4f09bd5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:45.283206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-07b75b4d-a101-4d51-82eb-67e8723845de req-c7e28c23-c35a-43ef-b88c-5948d4f09bd5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:45.284013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-07b75b4d-a101-4d51-82eb-67e8723845de req-c7e28c23-c35a-43ef-b88c-5948d4f09bd5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:45.298267 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-07b75b4d-a101-4d51-82eb-67e8723845de req-c7e28c23-c35a-43ef-b88c-5948d4f09bd5 service nova] Creating event network-vif-plugged:b8b587a2-280d-40a7-b142-ce5b26994211 for instance f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb on n-h2-858384-13 Oct 18 13:46:45.304667 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-07b75b4d-a101-4d51-82eb-67e8723845de req-c7e28c23-c35a-43ef-b88c-5948d4f09bd5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037375 Oct 18 13:46:45.306404 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2930/5659] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:46:45.716103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3f1aa63b-37e9-48d8-b668-55bcfdac1d37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:45.717566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3f1aa63b-37e9-48d8-b668-55bcfdac1d37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:45.725499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f1aa63b-37e9-48d8-b668-55bcfdac1d37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:45.726219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f1aa63b-37e9-48d8-b668-55bcfdac1d37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:45.726800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f1aa63b-37e9-48d8-b668-55bcfdac1d37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:45.727830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f1aa63b-37e9-48d8-b668-55bcfdac1d37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:45.728434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f1aa63b-37e9-48d8-b668-55bcfdac1d37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:45.729006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f1aa63b-37e9-48d8-b668-55bcfdac1d37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:46.560968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3f1aa63b-37e9-48d8-b668-55bcfdac1d37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:46.591001 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3f1aa63b-37e9-48d8-b668-55bcfdac1d37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1314 microversion: 2.1 time: 0.876102 Oct 18 13:46:46.598745 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2730/5660] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:45 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1314 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:47.629318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0b77a4e7-3a06-41a9-9810-567923c3cc37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:47.630370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0b77a4e7-3a06-41a9-9810-567923c3cc37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:47.661225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b77a4e7-3a06-41a9-9810-567923c3cc37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:47.662149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b77a4e7-3a06-41a9-9810-567923c3cc37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:47.667481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b77a4e7-3a06-41a9-9810-567923c3cc37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:47.668809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b77a4e7-3a06-41a9-9810-567923c3cc37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:47.669605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b77a4e7-3a06-41a9-9810-567923c3cc37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:47.670872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b77a4e7-3a06-41a9-9810-567923c3cc37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:48.288384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2042597693", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:48.357564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] validate_networks() for [('0f53d850-1ca9-4c54-bb4c-a387201cf186', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:46:48.360696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0b77a4e7-3a06-41a9-9810-567923c3cc37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:48.383842 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0b77a4e7-3a06-41a9-9810-567923c3cc37 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1463 microversion: 2.1 time: 0.762408 Oct 18 13:46:48.398167 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2931/5661] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:47 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1463 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:48.412334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-447390bc-c48f-42c4-be38-a9749044c5de tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd27ba06-2ec0-4497-a185-5c2c39dbbe55", "device": "/dev/sdb"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:48.424700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-447390bc-c48f-42c4-be38-a9749044c5de tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:48.437023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-447390bc-c48f-42c4-be38-a9749044c5de tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:48.437858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-447390bc-c48f-42c4-be38-a9749044c5de tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:48.438499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-447390bc-c48f-42c4-be38-a9749044c5de tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:48.439434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-447390bc-c48f-42c4-be38-a9749044c5de tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:48.440110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-447390bc-c48f-42c4-be38-a9749044c5de tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:48.441655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-447390bc-c48f-42c4-be38-a9749044c5de tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:48.798003 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-447390bc-c48f-42c4-be38-a9749044c5de tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "POST /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390174 Oct 18 13:46:48.814468 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2932/5662] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:46:48 2022] POST /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:46:49.410851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:46:49.411795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:46:49.412464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:46:49.413026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:46:49.413634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:46:49.435785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:49.444615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:49.445278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:49.447884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:49.448473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:49.450067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:49.506537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Getting quotas for project 6fe7cd2619ed479b92db50d810bbe7e1. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:46:49.520435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Getting quotas for user 84a7c8fc8b2146eca34ce17ff4ea3015 and project 6fe7cd2619ed479b92db50d810bbe7e1. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:46:49.572601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:46:49.581678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:46:49.715416 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4701fe80-23fe-4e74-912a-901447121071 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.671488 Oct 18 13:46:49.725557 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2731/5663] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:46:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:46:49.729996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-095212af-4c8e-42c1-b62a-e8c3a067a377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:49.730885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-095212af-4c8e-42c1-b62a-e8c3a067a377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:49.851938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-095212af-4c8e-42c1-b62a-e8c3a067a377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:49.864146 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-095212af-4c8e-42c1-b62a-e8c3a067a377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1214 microversion: 2.1 time: 0.139791 Oct 18 13:46:49.871868 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2933/5664] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:49 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:50.893390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d3261d3-b180-46a2-bdfc-12b8ac5bc483 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:50.894340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4d3261d3-b180-46a2-bdfc-12b8ac5bc483 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:50.908370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d3261d3-b180-46a2-bdfc-12b8ac5bc483 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:50.911530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d3261d3-b180-46a2-bdfc-12b8ac5bc483 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:50.912320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d3261d3-b180-46a2-bdfc-12b8ac5bc483 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:50.914016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d3261d3-b180-46a2-bdfc-12b8ac5bc483 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:50.917826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d3261d3-b180-46a2-bdfc-12b8ac5bc483 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:50.918453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d3261d3-b180-46a2-bdfc-12b8ac5bc483 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:50.990799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=73 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:51.553424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4d3261d3-b180-46a2-bdfc-12b8ac5bc483 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:51.598587 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d3261d3-b180-46a2-bdfc-12b8ac5bc483 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1210 microversion: 2.1 time: 0.712496 Oct 18 13:46:51.599689 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2732/5665] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:50 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1210 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:52.626748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-09775808-b5cf-41c9-9048-398777096c0c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:52.628266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-09775808-b5cf-41c9-9048-398777096c0c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:52.660077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09775808-b5cf-41c9-9048-398777096c0c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:52.660710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09775808-b5cf-41c9-9048-398777096c0c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:52.661194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09775808-b5cf-41c9-9048-398777096c0c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:52.662006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09775808-b5cf-41c9-9048-398777096c0c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:52.662498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09775808-b5cf-41c9-9048-398777096c0c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:52.669962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09775808-b5cf-41c9-9048-398777096c0c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:53.379897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09775808-b5cf-41c9-9048-398777096c0c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:53.388498 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-09775808-b5cf-41c9-9048-398777096c0c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1272 microversion: 2.1 time: 0.766393 Oct 18 13:46:53.389123 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2934/5666] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:52 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1272 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:54.416935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0520922d-f144-46aa-891c-270a9a8a1aa5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:54.417568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0520922d-f144-46aa-891c-270a9a8a1aa5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:54.420283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:54.441840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0520922d-f144-46aa-891c-270a9a8a1aa5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:54.444904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0520922d-f144-46aa-891c-270a9a8a1aa5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:54.445589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0520922d-f144-46aa-891c-270a9a8a1aa5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:54.448751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0520922d-f144-46aa-891c-270a9a8a1aa5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:54.449424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0520922d-f144-46aa-891c-270a9a8a1aa5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:54.451368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0520922d-f144-46aa-891c-270a9a8a1aa5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:54.968271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0520922d-f144-46aa-891c-270a9a8a1aa5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:54.982841 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0520922d-f144-46aa-891c-270a9a8a1aa5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1314 microversion: 2.1 time: 0.569336 Oct 18 13:46:54.983834 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2733/5667] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:54 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:56.010718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cc0640fb-fe76-4d27-b39d-84cf2ca72b47 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:56.012022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cc0640fb-fe76-4d27-b39d-84cf2ca72b47 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:56.022043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc0640fb-fe76-4d27-b39d-84cf2ca72b47 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:56.022802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc0640fb-fe76-4d27-b39d-84cf2ca72b47 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:56.023451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc0640fb-fe76-4d27-b39d-84cf2ca72b47 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:56.024349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc0640fb-fe76-4d27-b39d-84cf2ca72b47 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:56.024981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc0640fb-fe76-4d27-b39d-84cf2ca72b47 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:56.025618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc0640fb-fe76-4d27-b39d-84cf2ca72b47 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:56.082643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:56.621975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cc0640fb-fe76-4d27-b39d-84cf2ca72b47 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:56.641908 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cc0640fb-fe76-4d27-b39d-84cf2ca72b47 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1314 microversion: 2.1 time: 0.635026 Oct 18 13:46:56.643043 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2935/5668] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:56 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:57.669328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-224c027e-fb1a-4dae-8fe4-d1b924322b8c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:57.670051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-224c027e-fb1a-4dae-8fe4-d1b924322b8c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:57.681470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-224c027e-fb1a-4dae-8fe4-d1b924322b8c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:57.681989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-224c027e-fb1a-4dae-8fe4-d1b924322b8c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:57.682429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-224c027e-fb1a-4dae-8fe4-d1b924322b8c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:57.684911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-224c027e-fb1a-4dae-8fe4-d1b924322b8c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:57.685700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-224c027e-fb1a-4dae-8fe4-d1b924322b8c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:57.686520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-224c027e-fb1a-4dae-8fe4-d1b924322b8c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:57.929761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-38b2b3ce-e7d1-4b0a-919e-41bb7f871db9 req-a698407b-8430-44a5-b42e-edc3f3846170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1153b9b7-ba42-423a-8194-716869043254", "tag": "6c11202b-17f6-4e7c-ae70-edbb3e8ecbee"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:46:57.943662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=34 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:46:57.995197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-38b2b3ce-e7d1-4b0a-919e-41bb7f871db9 req-a698407b-8430-44a5-b42e-edc3f3846170 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:57.995704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-38b2b3ce-e7d1-4b0a-919e-41bb7f871db9 req-a698407b-8430-44a5-b42e-edc3f3846170 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:57.996149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-38b2b3ce-e7d1-4b0a-919e-41bb7f871db9 req-a698407b-8430-44a5-b42e-edc3f3846170 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:58.013335 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-38b2b3ce-e7d1-4b0a-919e-41bb7f871db9 req-a698407b-8430-44a5-b42e-edc3f3846170 service nova] Creating event network-changed:6c11202b-17f6-4e7c-ae70-edbb3e8ecbee for instance 1153b9b7-ba42-423a-8194-716869043254 on n-h2-858384-13 Oct 18 13:46:58.031055 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-38b2b3ce-e7d1-4b0a-919e-41bb7f871db9 req-a698407b-8430-44a5-b42e-edc3f3846170 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101228 Oct 18 13:46:58.031801 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2936/5669] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:46:58.234427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-224c027e-fb1a-4dae-8fe4-d1b924322b8c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:58.243784 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-224c027e-fb1a-4dae-8fe4-d1b924322b8c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1314 microversion: 2.1 time: 0.578316 Oct 18 13:46:58.244712 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2734/5670] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:57 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:46:59.267650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-33f14cd0-609f-44b9-91ca-3b4237272db8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:46:59.269168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-33f14cd0-609f-44b9-91ca-3b4237272db8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:46:59.276984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33f14cd0-609f-44b9-91ca-3b4237272db8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:59.277854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33f14cd0-609f-44b9-91ca-3b4237272db8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:59.278469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33f14cd0-609f-44b9-91ca-3b4237272db8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:59.279359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33f14cd0-609f-44b9-91ca-3b4237272db8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:46:59.279992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33f14cd0-609f-44b9-91ca-3b4237272db8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:46:59.280593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33f14cd0-609f-44b9-91ca-3b4237272db8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:46:59.624678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-33f14cd0-609f-44b9-91ca-3b4237272db8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:46:59.646629 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-33f14cd0-609f-44b9-91ca-3b4237272db8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1314 microversion: 2.1 time: 0.381871 Oct 18 13:46:59.647901 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2937/5671] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:46:59 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:00.674046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-60294953-82ef-4bac-b217-ec79ac4fc068 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:00.675984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-60294953-82ef-4bac-b217-ec79ac4fc068 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:00.687936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:00.708662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:00.712288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60294953-82ef-4bac-b217-ec79ac4fc068 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:00.714286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60294953-82ef-4bac-b217-ec79ac4fc068 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:00.715895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60294953-82ef-4bac-b217-ec79ac4fc068 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:00.717116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60294953-82ef-4bac-b217-ec79ac4fc068 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:00.717953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60294953-82ef-4bac-b217-ec79ac4fc068 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:00.719063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60294953-82ef-4bac-b217-ec79ac4fc068 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:01.047627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-60294953-82ef-4bac-b217-ec79ac4fc068 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:01.057364 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-60294953-82ef-4bac-b217-ec79ac4fc068 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1314 microversion: 2.1 time: 0.387403 Oct 18 13:47:01.058615 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2735/5672] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:00 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:02.082452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a630d579-7f34-4fe9-840d-a8c108136d09 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:02.083001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a630d579-7f34-4fe9-840d-a8c108136d09 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:02.098503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:02.101026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a630d579-7f34-4fe9-840d-a8c108136d09 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:02.101571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a630d579-7f34-4fe9-840d-a8c108136d09 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:02.102005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a630d579-7f34-4fe9-840d-a8c108136d09 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:02.102724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a630d579-7f34-4fe9-840d-a8c108136d09 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:02.103183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a630d579-7f34-4fe9-840d-a8c108136d09 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:02.103608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a630d579-7f34-4fe9-840d-a8c108136d09 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:02.353087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a630d579-7f34-4fe9-840d-a8c108136d09 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:02.371780 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a630d579-7f34-4fe9-840d-a8c108136d09 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1314 microversion: 2.1 time: 0.292816 Oct 18 13:47:02.372787 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2938/5673] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:02 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:02.742664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-555bea51-fcb8-47cc-b04a-b688b4cb1d88 req-00c6be52-423a-4470-a729-9bdecb5facd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1153b9b7-ba42-423a-8194-716869043254", "name": "network-vif-plugged", "status": "completed", "tag": "6c11202b-17f6-4e7c-ae70-edbb3e8ecbee"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:02.761687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-555bea51-fcb8-47cc-b04a-b688b4cb1d88 req-00c6be52-423a-4470-a729-9bdecb5facd8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:02.765938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-555bea51-fcb8-47cc-b04a-b688b4cb1d88 req-00c6be52-423a-4470-a729-9bdecb5facd8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:02.766945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-555bea51-fcb8-47cc-b04a-b688b4cb1d88 req-00c6be52-423a-4470-a729-9bdecb5facd8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:02.784845 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-555bea51-fcb8-47cc-b04a-b688b4cb1d88 req-00c6be52-423a-4470-a729-9bdecb5facd8 service nova] Creating event network-vif-plugged:6c11202b-17f6-4e7c-ae70-edbb3e8ecbee for instance 1153b9b7-ba42-423a-8194-716869043254 on n-h2-858384-13 Oct 18 13:47:02.807268 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-555bea51-fcb8-47cc-b04a-b688b4cb1d88 req-00c6be52-423a-4470-a729-9bdecb5facd8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087437 Oct 18 13:47:02.807884 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2736/5674] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:03.398107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b86abe2b-ab49-442e-ab0a-e6bbf6975ad8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:03.398726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b86abe2b-ab49-442e-ab0a-e6bbf6975ad8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:03.405681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b86abe2b-ab49-442e-ab0a-e6bbf6975ad8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:03.406646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b86abe2b-ab49-442e-ab0a-e6bbf6975ad8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:03.407264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b86abe2b-ab49-442e-ab0a-e6bbf6975ad8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:03.407974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b86abe2b-ab49-442e-ab0a-e6bbf6975ad8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:03.409124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b86abe2b-ab49-442e-ab0a-e6bbf6975ad8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:03.409600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b86abe2b-ab49-442e-ab0a-e6bbf6975ad8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:03.598553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b86abe2b-ab49-442e-ab0a-e6bbf6975ad8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:03.608675 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b86abe2b-ab49-442e-ab0a-e6bbf6975ad8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1314 microversion: 2.1 time: 0.214370 Oct 18 13:47:03.613922 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2939/5675] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:03 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:04.640604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8a8651d7-5f9a-42fb-9d5f-7819ec705c39 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:04.641346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8a8651d7-5f9a-42fb-9d5f-7819ec705c39 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:04.657840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a8651d7-5f9a-42fb-9d5f-7819ec705c39 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:04.658334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a8651d7-5f9a-42fb-9d5f-7819ec705c39 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:04.660000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a8651d7-5f9a-42fb-9d5f-7819ec705c39 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:04.663339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a8651d7-5f9a-42fb-9d5f-7819ec705c39 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:04.664021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a8651d7-5f9a-42fb-9d5f-7819ec705c39 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:04.667762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a8651d7-5f9a-42fb-9d5f-7819ec705c39 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:06.210458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8a8651d7-5f9a-42fb-9d5f-7819ec705c39 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:06.220375 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8a8651d7-5f9a-42fb-9d5f-7819ec705c39 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1314 microversion: 2.1 time: 1.587368 Oct 18 13:47:06.233155 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2737/5676] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:04 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1314 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:07.256417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-17460519-46f6-4c34-8e81-19ce0698f589 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:07.257642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-17460519-46f6-4c34-8e81-19ce0698f589 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:07.276986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17460519-46f6-4c34-8e81-19ce0698f589 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:07.277762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17460519-46f6-4c34-8e81-19ce0698f589 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:07.278364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17460519-46f6-4c34-8e81-19ce0698f589 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:07.279452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17460519-46f6-4c34-8e81-19ce0698f589 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:07.280097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17460519-46f6-4c34-8e81-19ce0698f589 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:07.280816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-17460519-46f6-4c34-8e81-19ce0698f589 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:07.851248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-17460519-46f6-4c34-8e81-19ce0698f589 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:07.870563 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-17460519-46f6-4c34-8e81-19ce0698f589 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1500 microversion: 2.1 time: 0.618998 Oct 18 13:47:07.871420 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2940/5677] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:07 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1500 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:07.898351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b2cc6540-2dc9-48bd-a222-c8e131d32c9e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:07.905316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b2cc6540-2dc9-48bd-a222-c8e131d32c9e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:07.919375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2cc6540-2dc9-48bd-a222-c8e131d32c9e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:07.920067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2cc6540-2dc9-48bd-a222-c8e131d32c9e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:07.920693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2cc6540-2dc9-48bd-a222-c8e131d32c9e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:07.921600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2cc6540-2dc9-48bd-a222-c8e131d32c9e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:07.922215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2cc6540-2dc9-48bd-a222-c8e131d32c9e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:07.922859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2cc6540-2dc9-48bd-a222-c8e131d32c9e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:08.003958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-b2cc6540-2dc9-48bd-a222-c8e131d32c9e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lazy-loading 'flavor' on Instance uuid 1153b9b7-ba42-423a-8194-716869043254 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:47:08.114894 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b2cc6540-2dc9-48bd-a222-c8e131d32c9e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "POST /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254/action" status: 200 len: 32 microversion: 2.1 time: 0.224621 Oct 18 13:47:08.115519 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2738/5678] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:47:07 2022] POST /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:47:08.125888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-40fa18bc-6adb-4fd8-a7ad-cab5d0778521 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:08.126763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-40fa18bc-6adb-4fd8-a7ad-cab5d0778521 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:08.136653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40fa18bc-6adb-4fd8-a7ad-cab5d0778521 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:08.137516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40fa18bc-6adb-4fd8-a7ad-cab5d0778521 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:08.139128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40fa18bc-6adb-4fd8-a7ad-cab5d0778521 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:08.140942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40fa18bc-6adb-4fd8-a7ad-cab5d0778521 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:08.142565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40fa18bc-6adb-4fd8-a7ad-cab5d0778521 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:08.145348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-40fa18bc-6adb-4fd8-a7ad-cab5d0778521 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:08.513454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-40fa18bc-6adb-4fd8-a7ad-cab5d0778521 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:08.524077 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-40fa18bc-6adb-4fd8-a7ad-cab5d0778521 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.402826 Oct 18 13:47:08.528089 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2941/5679] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:08 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:09.548705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-43956661-500a-49c6-88f8-d413b6f595b8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:09.550143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-43956661-500a-49c6-88f8-d413b6f595b8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:09.568984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43956661-500a-49c6-88f8-d413b6f595b8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:09.569846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43956661-500a-49c6-88f8-d413b6f595b8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:09.570312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43956661-500a-49c6-88f8-d413b6f595b8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:09.571067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43956661-500a-49c6-88f8-d413b6f595b8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:09.577962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43956661-500a-49c6-88f8-d413b6f595b8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:09.578671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43956661-500a-49c6-88f8-d413b6f595b8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:10.022842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-43956661-500a-49c6-88f8-d413b6f595b8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:10.034292 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-43956661-500a-49c6-88f8-d413b6f595b8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.489469 Oct 18 13:47:10.052492 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2739/5680] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:09 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:11.070186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5b9a3241-52e8-4f66-8ccd-c17b65a6e7cc tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:11.071157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5b9a3241-52e8-4f66-8ccd-c17b65a6e7cc tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:11.100395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b9a3241-52e8-4f66-8ccd-c17b65a6e7cc tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:11.100912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b9a3241-52e8-4f66-8ccd-c17b65a6e7cc tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:11.103539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b9a3241-52e8-4f66-8ccd-c17b65a6e7cc tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:11.104308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b9a3241-52e8-4f66-8ccd-c17b65a6e7cc tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:11.104787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b9a3241-52e8-4f66-8ccd-c17b65a6e7cc tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:11.105279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b9a3241-52e8-4f66-8ccd-c17b65a6e7cc tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:11.404978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5b9a3241-52e8-4f66-8ccd-c17b65a6e7cc tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:11.422061 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5b9a3241-52e8-4f66-8ccd-c17b65a6e7cc tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.366306 Oct 18 13:47:11.423067 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2942/5681] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:11 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:12.453407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-59126901-122b-45ed-af56-e14d855042ea tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:12.454407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-59126901-122b-45ed-af56-e14d855042ea tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:12.471277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59126901-122b-45ed-af56-e14d855042ea tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:12.476090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59126901-122b-45ed-af56-e14d855042ea tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:12.490709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59126901-122b-45ed-af56-e14d855042ea tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:12.496802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59126901-122b-45ed-af56-e14d855042ea tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:12.497351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59126901-122b-45ed-af56-e14d855042ea tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:12.502248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59126901-122b-45ed-af56-e14d855042ea tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:12.983371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-59126901-122b-45ed-af56-e14d855042ea tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:13.012013 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-59126901-122b-45ed-af56-e14d855042ea tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.555907 Oct 18 13:47:13.017544 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2740/5682] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:12 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:14.050232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5c3e6613-73ef-438e-b84a-bbd5da67d603 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:14.050775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5c3e6613-73ef-438e-b84a-bbd5da67d603 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:14.063885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c3e6613-73ef-438e-b84a-bbd5da67d603 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:14.071713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c3e6613-73ef-438e-b84a-bbd5da67d603 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:14.072445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c3e6613-73ef-438e-b84a-bbd5da67d603 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:14.073403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c3e6613-73ef-438e-b84a-bbd5da67d603 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:14.074033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c3e6613-73ef-438e-b84a-bbd5da67d603 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:14.074656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c3e6613-73ef-438e-b84a-bbd5da67d603 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:14.938492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5c3e6613-73ef-438e-b84a-bbd5da67d603 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:14.953650 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5c3e6613-73ef-438e-b84a-bbd5da67d603 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.909253 Oct 18 13:47:14.957369 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2943/5683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:14 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:15.983869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-85af1180-30d1-4139-9340-3f2e4dfc2a35 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:15.985329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-85af1180-30d1-4139-9340-3f2e4dfc2a35 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:15.994136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85af1180-30d1-4139-9340-3f2e4dfc2a35 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:15.994975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85af1180-30d1-4139-9340-3f2e4dfc2a35 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:15.995804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85af1180-30d1-4139-9340-3f2e4dfc2a35 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:15.996768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85af1180-30d1-4139-9340-3f2e4dfc2a35 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:16.000525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85af1180-30d1-4139-9340-3f2e4dfc2a35 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:16.001210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85af1180-30d1-4139-9340-3f2e4dfc2a35 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:16.719970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-85af1180-30d1-4139-9340-3f2e4dfc2a35 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:16.742487 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-85af1180-30d1-4139-9340-3f2e4dfc2a35 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.757443 Oct 18 13:47:16.743611 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2741/5684] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:15 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:17.772114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1e153e4c-5d2a-4c1d-b308-2b16531ca129 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:17.772934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1e153e4c-5d2a-4c1d-b308-2b16531ca129 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:17.802694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e153e4c-5d2a-4c1d-b308-2b16531ca129 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:17.803207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e153e4c-5d2a-4c1d-b308-2b16531ca129 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:17.805498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e153e4c-5d2a-4c1d-b308-2b16531ca129 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:17.808125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e153e4c-5d2a-4c1d-b308-2b16531ca129 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:17.808613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e153e4c-5d2a-4c1d-b308-2b16531ca129 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:17.809054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e153e4c-5d2a-4c1d-b308-2b16531ca129 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:18.120992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1e153e4c-5d2a-4c1d-b308-2b16531ca129 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:18.130320 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1e153e4c-5d2a-4c1d-b308-2b16531ca129 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.366069 Oct 18 13:47:18.136376 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2944/5685] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:17 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:19.167649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68263479-3f97-4acc-9e43-34ce492a8d6a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:19.168902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-68263479-3f97-4acc-9e43-34ce492a8d6a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:19.179936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68263479-3f97-4acc-9e43-34ce492a8d6a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:19.184107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68263479-3f97-4acc-9e43-34ce492a8d6a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:19.184764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68263479-3f97-4acc-9e43-34ce492a8d6a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:19.186949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68263479-3f97-4acc-9e43-34ce492a8d6a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:19.187715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68263479-3f97-4acc-9e43-34ce492a8d6a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:19.190573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68263479-3f97-4acc-9e43-34ce492a8d6a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:19.694103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-68263479-3f97-4acc-9e43-34ce492a8d6a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:19.708622 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-68263479-3f97-4acc-9e43-34ce492a8d6a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.548338 Oct 18 13:47:19.709239 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2742/5686] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:19 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:20.733738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c407c226-93bf-4222-8b20-3e25b34f2abd tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:20.734358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c407c226-93bf-4222-8b20-3e25b34f2abd tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:20.747511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c407c226-93bf-4222-8b20-3e25b34f2abd tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:20.748501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c407c226-93bf-4222-8b20-3e25b34f2abd tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:20.749165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c407c226-93bf-4222-8b20-3e25b34f2abd tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:20.750226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c407c226-93bf-4222-8b20-3e25b34f2abd tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:20.751017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c407c226-93bf-4222-8b20-3e25b34f2abd tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:20.752970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c407c226-93bf-4222-8b20-3e25b34f2abd tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:20.927377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c407c226-93bf-4222-8b20-3e25b34f2abd tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:20.937219 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c407c226-93bf-4222-8b20-3e25b34f2abd tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.206647 Oct 18 13:47:20.938470 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2945/5687] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:20 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:21.962879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d260dd58-3972-4bc9-a6f4-0938676a9a06 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:21.964345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d260dd58-3972-4bc9-a6f4-0938676a9a06 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:21.978937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d260dd58-3972-4bc9-a6f4-0938676a9a06 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:21.981712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d260dd58-3972-4bc9-a6f4-0938676a9a06 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:21.981924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d260dd58-3972-4bc9-a6f4-0938676a9a06 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:21.982572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d260dd58-3972-4bc9-a6f4-0938676a9a06 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:21.983031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d260dd58-3972-4bc9-a6f4-0938676a9a06 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:21.983453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d260dd58-3972-4bc9-a6f4-0938676a9a06 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:21.987998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:22.453680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d260dd58-3972-4bc9-a6f4-0938676a9a06 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:22.465222 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d260dd58-3972-4bc9-a6f4-0938676a9a06 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.505764 Oct 18 13:47:22.466580 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2743/5688] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:21 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:23.493260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-28c131e3-235c-47d7-b963-69c9346c1349 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:23.495242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-28c131e3-235c-47d7-b963-69c9346c1349 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:23.506236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28c131e3-235c-47d7-b963-69c9346c1349 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:23.511060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28c131e3-235c-47d7-b963-69c9346c1349 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:23.511694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28c131e3-235c-47d7-b963-69c9346c1349 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:23.512624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28c131e3-235c-47d7-b963-69c9346c1349 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:23.515024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28c131e3-235c-47d7-b963-69c9346c1349 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:23.516182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28c131e3-235c-47d7-b963-69c9346c1349 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:23.975785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-28c131e3-235c-47d7-b963-69c9346c1349 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:23.990421 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-28c131e3-235c-47d7-b963-69c9346c1349 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.501486 Oct 18 13:47:23.991021 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2946/5689] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:23 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:25.018191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dba907ec-9d6f-4db5-ac16-4b58c643c4f8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:25.018798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dba907ec-9d6f-4db5-ac16-4b58c643c4f8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:25.026256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=22 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:25.028428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dba907ec-9d6f-4db5-ac16-4b58c643c4f8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:25.029396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dba907ec-9d6f-4db5-ac16-4b58c643c4f8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:25.030146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dba907ec-9d6f-4db5-ac16-4b58c643c4f8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:25.031481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dba907ec-9d6f-4db5-ac16-4b58c643c4f8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:25.032109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dba907ec-9d6f-4db5-ac16-4b58c643c4f8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:25.032705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dba907ec-9d6f-4db5-ac16-4b58c643c4f8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:25.319434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dba907ec-9d6f-4db5-ac16-4b58c643c4f8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:25.328701 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dba907ec-9d6f-4db5-ac16-4b58c643c4f8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.314423 Oct 18 13:47:25.331403 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2744/5690] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:25 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:26.353534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e37b883c-34fc-4c3f-9e40-5a6bc464e377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:26.355311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e37b883c-34fc-4c3f-9e40-5a6bc464e377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:26.366083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e37b883c-34fc-4c3f-9e40-5a6bc464e377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:26.369804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e37b883c-34fc-4c3f-9e40-5a6bc464e377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:26.370505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e37b883c-34fc-4c3f-9e40-5a6bc464e377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:26.371428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e37b883c-34fc-4c3f-9e40-5a6bc464e377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:26.373480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e37b883c-34fc-4c3f-9e40-5a6bc464e377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:26.374327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e37b883c-34fc-4c3f-9e40-5a6bc464e377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:26.385017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=68 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:27.242488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e37b883c-34fc-4c3f-9e40-5a6bc464e377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:27.259545 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e37b883c-34fc-4c3f-9e40-5a6bc464e377 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.909763 Oct 18 13:47:27.261309 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2947/5691] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:26 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:28.287448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-850ec7c9-4681-464a-9c5a-50def17bd549 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:28.289849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-850ec7c9-4681-464a-9c5a-50def17bd549 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:28.308324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-850ec7c9-4681-464a-9c5a-50def17bd549 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:28.311906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-850ec7c9-4681-464a-9c5a-50def17bd549 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:28.312667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-850ec7c9-4681-464a-9c5a-50def17bd549 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:28.315337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-850ec7c9-4681-464a-9c5a-50def17bd549 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:28.318993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-850ec7c9-4681-464a-9c5a-50def17bd549 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:28.319711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-850ec7c9-4681-464a-9c5a-50def17bd549 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:29.083168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-850ec7c9-4681-464a-9c5a-50def17bd549 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:29.105520 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-850ec7c9-4681-464a-9c5a-50def17bd549 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.813293 Oct 18 13:47:29.123283 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2745/5692] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:28 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:30.130758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c31e6a7f-b456-45f9-8469-bb8e74227c74 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:30.131393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c31e6a7f-b456-45f9-8469-bb8e74227c74 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:30.170285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=24 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:30.173540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c31e6a7f-b456-45f9-8469-bb8e74227c74 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:30.175012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c31e6a7f-b456-45f9-8469-bb8e74227c74 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:30.175783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c31e6a7f-b456-45f9-8469-bb8e74227c74 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:30.178022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c31e6a7f-b456-45f9-8469-bb8e74227c74 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:30.178676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c31e6a7f-b456-45f9-8469-bb8e74227c74 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:30.191529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c31e6a7f-b456-45f9-8469-bb8e74227c74 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:31.055505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c31e6a7f-b456-45f9-8469-bb8e74227c74 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:31.064851 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c31e6a7f-b456-45f9-8469-bb8e74227c74 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.938526 Oct 18 13:47:31.069005 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2948/5693] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:30 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:32.105981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4ddf80f5-f3a9-4663-bf86-77ed33b588f4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:32.107406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4ddf80f5-f3a9-4663-bf86-77ed33b588f4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:32.116693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ddf80f5-f3a9-4663-bf86-77ed33b588f4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:32.117668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ddf80f5-f3a9-4663-bf86-77ed33b588f4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:32.118287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ddf80f5-f3a9-4663-bf86-77ed33b588f4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:32.119297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ddf80f5-f3a9-4663-bf86-77ed33b588f4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:32.119929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ddf80f5-f3a9-4663-bf86-77ed33b588f4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:32.120578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ddf80f5-f3a9-4663-bf86-77ed33b588f4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:32.793750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4ddf80f5-f3a9-4663-bf86-77ed33b588f4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:32.823028 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4ddf80f5-f3a9-4663-bf86-77ed33b588f4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.720457 Oct 18 13:47:32.825709 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2746/5694] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:32 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:33.857329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8f5be6dc-2916-4dc4-ba46-da2152bd12f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:33.857990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8f5be6dc-2916-4dc4-ba46-da2152bd12f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:33.877571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f5be6dc-2916-4dc4-ba46-da2152bd12f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:33.878086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f5be6dc-2916-4dc4-ba46-da2152bd12f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:33.878535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f5be6dc-2916-4dc4-ba46-da2152bd12f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:33.881167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f5be6dc-2916-4dc4-ba46-da2152bd12f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:33.881670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f5be6dc-2916-4dc4-ba46-da2152bd12f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:33.882107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8f5be6dc-2916-4dc4-ba46-da2152bd12f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:34.643431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8f5be6dc-2916-4dc4-ba46-da2152bd12f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:34.653942 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8f5be6dc-2916-4dc4-ba46-da2152bd12f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.805318 Oct 18 13:47:34.670933 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2949/5695] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:33 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:35.682231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a60fe6c-66cd-4af7-a9b1-ab76cfccd19b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:35.682891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4a60fe6c-66cd-4af7-a9b1-ab76cfccd19b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:35.701283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a60fe6c-66cd-4af7-a9b1-ab76cfccd19b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:35.701786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a60fe6c-66cd-4af7-a9b1-ab76cfccd19b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:35.702220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a60fe6c-66cd-4af7-a9b1-ab76cfccd19b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:35.703209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a60fe6c-66cd-4af7-a9b1-ab76cfccd19b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:35.703831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a60fe6c-66cd-4af7-a9b1-ab76cfccd19b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:35.704458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a60fe6c-66cd-4af7-a9b1-ab76cfccd19b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:36.453864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a60fe6c-66cd-4af7-a9b1-ab76cfccd19b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:36.467709 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4a60fe6c-66cd-4af7-a9b1-ab76cfccd19b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.789641 Oct 18 13:47:36.468325 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2747/5696] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:35 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:37.494818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93a12252-0e52-43e3-b538-5f46754882e4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:37.496205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-93a12252-0e52-43e3-b538-5f46754882e4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:37.513006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93a12252-0e52-43e3-b538-5f46754882e4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.513763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93a12252-0e52-43e3-b538-5f46754882e4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.514386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93a12252-0e52-43e3-b538-5f46754882e4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.530234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93a12252-0e52-43e3-b538-5f46754882e4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.531011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93a12252-0e52-43e3-b538-5f46754882e4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.531665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93a12252-0e52-43e3-b538-5f46754882e4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.835714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68197607-e493-4b25-95f3-efeb38ae3b5f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:37.836378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-68197607-e493-4b25-95f3-efeb38ae3b5f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:37.851056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68197607-e493-4b25-95f3-efeb38ae3b5f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.855669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68197607-e493-4b25-95f3-efeb38ae3b5f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.856348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68197607-e493-4b25-95f3-efeb38ae3b5f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.857498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68197607-e493-4b25-95f3-efeb38ae3b5f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:37.862973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68197607-e493-4b25-95f3-efeb38ae3b5f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:37.864999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68197607-e493-4b25-95f3-efeb38ae3b5f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:37.957303 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-68197607-e493-4b25-95f3-efeb38ae3b5f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa/ips" status: 200 len: 149 microversion: 2.1 time: 0.120713 Oct 18 13:47:37.960920 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2748/5697] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:47:37 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa/ips => generated 149 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:37.976539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2decc41-4d8b-4089-ae39-2f7f40a9c5ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "159a34e6-06bc-4bd7-9f8a-11a565262b0b"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:37.993723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-93a12252-0e52-43e3-b538-5f46754882e4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:37.993989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d2decc41-4d8b-4089-ae39-2f7f40a9c5ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:38.007665 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-93a12252-0e52-43e3-b538-5f46754882e4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1506 microversion: 2.1 time: 0.516582 Oct 18 13:47:38.020123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2decc41-4d8b-4089-ae39-2f7f40a9c5ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:38.022393 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2950/5698] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:37 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:38.022641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2decc41-4d8b-4089-ae39-2f7f40a9c5ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:38.023268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2decc41-4d8b-4089-ae39-2f7f40a9c5ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:38.024829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2decc41-4d8b-4089-ae39-2f7f40a9c5ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:38.027111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2decc41-4d8b-4089-ae39-2f7f40a9c5ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:38.027719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2decc41-4d8b-4089-ae39-2f7f40a9c5ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:38.231303 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-d2decc41-4d8b-4089-ae39-2f7f40a9c5ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Invalid volume: volume 159a34e6-06bc-4bd7-9f8a-11a565262b0b is already attached to instances: ee304341-74a8-4ded-a4a4-0ddb13f16002 Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2decc41-4d8b-4089-ae39-2f7f40a9c5ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa/os-volume_attachments HTTP/1.1 Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 74 Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: {"volumeAttachment": {"volumeId": "159a34e6-06bc-4bd7-9f8a-11a565262b0b"}} Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid volume: volume 159a34e6-06bc-4bd7-9f8a-11a565262b0b is already attached to instances: ee304341-74a8-4ded-a4a4-0ddb13f16002 Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'server_id': 'b71970dc-22e3-42e6-bb9f-bf0c8699bbfa', 'body': {'volumeAttachment': {'volumeId': '159a34e6-06bc-4bd7-9f8a-11a565262b0b'}}} Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 159a34e6-06bc-4bd7-9f8a-11a565262b0b is already attached to instances: ee304341-74a8-4ded-a4a4-0ddb13f16002 Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:38.233787 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 159a34e6-06bc-4bd7-9f8a-11a565262b0b is already attached to instances: ee304341-74a8-4ded-a4a4-0ddb13f16002 Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 159a34e6-06bc-4bd7-9f8a-11a565262b0b is already attached to instances: ee304341-74a8-4ded-a4a4-0ddb13f16002 Oct 18 13:47:38.238906 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:47:38.243501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2decc41-4d8b-4089-ae39-2f7f40a9c5ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 400 to user: Invalid volume: volume 159a34e6-06bc-4bd7-9f8a-11a565262b0b is already attached to instances: ee304341-74a8-4ded-a4a4-0ddb13f16002 {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:38.246000 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d2decc41-4d8b-4089-ae39-2f7f40a9c5ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "POST /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.278887 Oct 18 13:47:38.252937 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2749/5699] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:47:37 2022] POST /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa/os-volume_attachments => generated 174 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:47:38.256469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-537a5b86-3d37-4e66-b627-2fa77b9fff29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:38.256987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-537a5b86-3d37-4e66-b627-2fa77b9fff29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:38.270196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-537a5b86-3d37-4e66-b627-2fa77b9fff29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:38.270724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-537a5b86-3d37-4e66-b627-2fa77b9fff29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:38.271197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-537a5b86-3d37-4e66-b627-2fa77b9fff29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:38.271924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-537a5b86-3d37-4e66-b627-2fa77b9fff29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:38.272414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-537a5b86-3d37-4e66-b627-2fa77b9fff29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:38.272902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-537a5b86-3d37-4e66-b627-2fa77b9fff29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:38.435267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-537a5b86-3d37-4e66-b627-2fa77b9fff29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:47:38.727542 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-537a5b86-3d37-4e66-b627-2fa77b9fff29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 204 len: 0 microversion: 2.1 time: 0.462347 Oct 18 13:47:38.731419 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2951/5700] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:47:38 2022] DELETE /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:47:38.740468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6f40aa17-7765-4007-89a9-2c04bb8b80eb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:38.741082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6f40aa17-7765-4007-89a9-2c04bb8b80eb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:38.757912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f40aa17-7765-4007-89a9-2c04bb8b80eb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:38.758408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f40aa17-7765-4007-89a9-2c04bb8b80eb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:38.758840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f40aa17-7765-4007-89a9-2c04bb8b80eb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:38.762957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f40aa17-7765-4007-89a9-2c04bb8b80eb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:38.768650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f40aa17-7765-4007-89a9-2c04bb8b80eb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:38.769628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6f40aa17-7765-4007-89a9-2c04bb8b80eb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:39.041650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a085408b-8011-41a7-9156-e1ff6abd4030 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:39.044452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a085408b-8011-41a7-9156-e1ff6abd4030 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:39.070368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a085408b-8011-41a7-9156-e1ff6abd4030 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:39.072735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a085408b-8011-41a7-9156-e1ff6abd4030 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:39.073794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a085408b-8011-41a7-9156-e1ff6abd4030 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:39.081536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a085408b-8011-41a7-9156-e1ff6abd4030 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:39.082310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a085408b-8011-41a7-9156-e1ff6abd4030 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:39.084934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a085408b-8011-41a7-9156-e1ff6abd4030 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:39.499792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a085408b-8011-41a7-9156-e1ff6abd4030 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:39.513068 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a085408b-8011-41a7-9156-e1ff6abd4030 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1486 microversion: 2.1 time: 0.480504 Oct 18 13:47:39.519073 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2952/5701] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:39 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1486 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:39.836382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6f40aa17-7765-4007-89a9-2c04bb8b80eb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:39.846018 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6f40aa17-7765-4007-89a9-2c04bb8b80eb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1682 microversion: 2.1 time: 1.110810 Oct 18 13:47:39.852554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1442816931", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:39.862186 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2750/5702] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:38 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1682 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:39.950816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] validate_networks() for [('0f53d850-1ca9-4c54-bb4c-a387201cf186', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:47:40.888108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5e4a7b07-cc6e-4287-a4a4-be1d135852b7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:40.889004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5e4a7b07-cc6e-4287-a4a4-be1d135852b7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:40.897929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e4a7b07-cc6e-4287-a4a4-be1d135852b7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:40.899103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e4a7b07-cc6e-4287-a4a4-be1d135852b7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:40.899727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e4a7b07-cc6e-4287-a4a4-be1d135852b7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:40.900596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e4a7b07-cc6e-4287-a4a4-be1d135852b7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:40.901257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e4a7b07-cc6e-4287-a4a4-be1d135852b7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:40.902441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e4a7b07-cc6e-4287-a4a4-be1d135852b7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:41.143582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:47:41.144688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:47:41.145513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:47:41.146166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:47:41.146894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:47:41.170807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:41.171693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:41.172773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:41.174766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:41.177466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:41.178224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:41.234871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Getting quotas for project 6fe7cd2619ed479b92db50d810bbe7e1. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:47:41.253810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Getting quotas for user 84a7c8fc8b2146eca34ce17ff4ea3015 and project 6fe7cd2619ed479b92db50d810bbe7e1. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:47:41.272131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:47:41.276932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:47:41.397266 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a1403a07-616b-4f66-b889-b2b0c72bb0b9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.549308 Oct 18 13:47:41.398018 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2953/5703] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:47:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 13:47:41.415399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6b49f8ca-5d50-42ae-b2a7-c3cab8df8b42 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:41.416045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6b49f8ca-5d50-42ae-b2a7-c3cab8df8b42 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:41.630695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6b49f8ca-5d50-42ae-b2a7-c3cab8df8b42 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:41.648019 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6b49f8ca-5d50-42ae-b2a7-c3cab8df8b42 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1214 microversion: 2.1 time: 0.240058 Oct 18 13:47:41.650161 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2954/5704] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:41 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:41.941507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5e4a7b07-cc6e-4287-a4a4-be1d135852b7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:41.958663 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5e4a7b07-cc6e-4287-a4a4-be1d135852b7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1682 microversion: 2.1 time: 1.073062 Oct 18 13:47:41.973247 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2751/5705] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:40 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1682 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:42.677153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3b373c58-9c4b-4e63-a04a-1f292eecd289 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:42.677870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3b373c58-9c4b-4e63-a04a-1f292eecd289 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:42.697057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b373c58-9c4b-4e63-a04a-1f292eecd289 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:42.697586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b373c58-9c4b-4e63-a04a-1f292eecd289 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:42.698032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b373c58-9c4b-4e63-a04a-1f292eecd289 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:42.703444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b373c58-9c4b-4e63-a04a-1f292eecd289 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:42.704385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b373c58-9c4b-4e63-a04a-1f292eecd289 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:42.707453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b373c58-9c4b-4e63-a04a-1f292eecd289 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:42.992452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a9f79e03-a515-4c89-91e1-fed1bd302636 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:42.993746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a9f79e03-a515-4c89-91e1-fed1bd302636 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:43.001909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9f79e03-a515-4c89-91e1-fed1bd302636 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:43.002365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9f79e03-a515-4c89-91e1-fed1bd302636 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:43.002820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9f79e03-a515-4c89-91e1-fed1bd302636 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:43.003607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9f79e03-a515-4c89-91e1-fed1bd302636 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:43.004095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9f79e03-a515-4c89-91e1-fed1bd302636 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:43.004515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9f79e03-a515-4c89-91e1-fed1bd302636 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:43.180853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3b373c58-9c4b-4e63-a04a-1f292eecd289 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:43.192029 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3b373c58-9c4b-4e63-a04a-1f292eecd289 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1210 microversion: 2.1 time: 0.519529 Oct 18 13:47:43.199235 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2955/5706] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:42 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1210 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:43.368452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a9f79e03-a515-4c89-91e1-fed1bd302636 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:43.376752 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a9f79e03-a515-4c89-91e1-fed1bd302636 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1614 microversion: 2.1 time: 0.392367 Oct 18 13:47:43.384663 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2752/5707] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:42 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1614 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:44.120346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f34b783f-21ad-42f0-80bb-1d7a732830ff req-edb218a1-54ef-4bcf-bbe9-a5fed1d647bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71970dc-22e3-42e6-bb9f-bf0c8699bbfa", "name": "network-vif-deleted", "tag": "ce9d94ca-172f-4f87-bf85-67f2a01d8e72"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:44.141170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f34b783f-21ad-42f0-80bb-1d7a732830ff req-edb218a1-54ef-4bcf-bbe9-a5fed1d647bb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.145137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f34b783f-21ad-42f0-80bb-1d7a732830ff req-edb218a1-54ef-4bcf-bbe9-a5fed1d647bb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.145858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f34b783f-21ad-42f0-80bb-1d7a732830ff req-edb218a1-54ef-4bcf-bbe9-a5fed1d647bb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:44.174857 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f34b783f-21ad-42f0-80bb-1d7a732830ff req-edb218a1-54ef-4bcf-bbe9-a5fed1d647bb service nova] Creating event network-vif-deleted:ce9d94ca-172f-4f87-bf85-67f2a01d8e72 for instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa on n-h1-858384-13 Oct 18 13:47:44.186359 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f34b783f-21ad-42f0-80bb-1d7a732830ff req-edb218a1-54ef-4bcf-bbe9-a5fed1d647bb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070064 Oct 18 13:47:44.199359 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2956/5708] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:47:44.225511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a9006c1e-7683-4859-a4ab-4e2f354e81f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:44.226900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a9006c1e-7683-4859-a4ab-4e2f354e81f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:44.243895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9006c1e-7683-4859-a4ab-4e2f354e81f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.244712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9006c1e-7683-4859-a4ab-4e2f354e81f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.245393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9006c1e-7683-4859-a4ab-4e2f354e81f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:44.246357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9006c1e-7683-4859-a4ab-4e2f354e81f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.247695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9006c1e-7683-4859-a4ab-4e2f354e81f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.248368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9006c1e-7683-4859-a4ab-4e2f354e81f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:44.414254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:44.415361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:44.429576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.431220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.432167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:44.440206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.441498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.442203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:44.461130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a9006c1e-7683-4859-a4ab-4e2f354e81f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:44.475529 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a9006c1e-7683-4859-a4ab-4e2f354e81f3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1272 microversion: 2.1 time: 0.256244 Oct 18 13:47:44.476880 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2753/5709] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:44 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:44.527482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:44.527710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:44.528111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:44.557212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lazy-loading 'fault' on Instance uuid b71970dc-22e3-42e6-bb9f-bf0c8699bbfa {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:47:44.632050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:44.643067 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-15a98e82-003e-454b-81c3-5f948f76a392 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 200 len: 1332 microversion: 2.1 time: 0.236855 Oct 18 13:47:44.644239 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2957/5710] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:44 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 1332 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:45.499980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-91591837-f983-4d59-b84c-7618dc2aa932 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:45.500586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-91591837-f983-4d59-b84c-7618dc2aa932 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:45.517628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91591837-f983-4d59-b84c-7618dc2aa932 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:45.520255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91591837-f983-4d59-b84c-7618dc2aa932 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:45.520873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91591837-f983-4d59-b84c-7618dc2aa932 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:45.522221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91591837-f983-4d59-b84c-7618dc2aa932 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:45.522847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91591837-f983-4d59-b84c-7618dc2aa932 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:45.523557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91591837-f983-4d59-b84c-7618dc2aa932 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:45.668088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c37cac8-4b7d-4939-aae0-a4bf7765cb84 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:45.668934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4c37cac8-4b7d-4939-aae0-a4bf7765cb84 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:45.686186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c37cac8-4b7d-4939-aae0-a4bf7765cb84 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:45.687177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c37cac8-4b7d-4939-aae0-a4bf7765cb84 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:45.687698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c37cac8-4b7d-4939-aae0-a4bf7765cb84 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:45.689148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c37cac8-4b7d-4939-aae0-a4bf7765cb84 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:45.689713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c37cac8-4b7d-4939-aae0-a4bf7765cb84 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:45.690216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c37cac8-4b7d-4939-aae0-a4bf7765cb84 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:45.724186 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-4c37cac8-4b7d-4939-aae0-a4bf7765cb84 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c37cac8-4b7d-4939-aae0-a4bf7765cb84 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa HTTP/1.1 Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'b71970dc-22e3-42e6-bb9f-bf0c8699bbfa'} Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:47:45.730800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.734778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:47:45.734778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:47:45.734778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:47:45.734778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:47:45.734778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:47:45.734778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:47:45.734778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:47:45.734778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c37cac8-4b7d-4939-aae0-a4bf7765cb84 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 404 to user: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:47:45.734778 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4c37cac8-4b7d-4939-aae0-a4bf7765cb84 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 404 len: 111 microversion: 2.1 time: 0.069587 Oct 18 13:47:45.738264 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2958/5711] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:45 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:47:45.755293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bafde765-6120-46a3-bf7b-b28e585ebd7d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '.version_select at 0x7ff60ec379d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:45.805475 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bafde765-6120-46a3-bf7b-b28e585ebd7d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516185963" status: 202 len: 0 microversion: 2.1 time: 0.061803 Oct 18 13:47:45.806692 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2959/5712] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:47:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516185963 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:47:45.871510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-91591837-f983-4d59-b84c-7618dc2aa932 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:45.884939 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-91591837-f983-4d59-b84c-7618dc2aa932 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1272 microversion: 2.1 time: 0.388591 Oct 18 13:47:45.885842 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2754/5713] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:45 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1272 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:46.911749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-14bc5cc5-61e5-4ed0-926b-3b15b24bda7a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:46.912561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-14bc5cc5-61e5-4ed0-926b-3b15b24bda7a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:46.937098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14bc5cc5-61e5-4ed0-926b-3b15b24bda7a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:46.937619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14bc5cc5-61e5-4ed0-926b-3b15b24bda7a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:46.938567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14bc5cc5-61e5-4ed0-926b-3b15b24bda7a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:46.939522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14bc5cc5-61e5-4ed0-926b-3b15b24bda7a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:46.939983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14bc5cc5-61e5-4ed0-926b-3b15b24bda7a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:46.945629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14bc5cc5-61e5-4ed0-926b-3b15b24bda7a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:47.618606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-14bc5cc5-61e5-4ed0-926b-3b15b24bda7a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:47.627313 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-14bc5cc5-61e5-4ed0-926b-3b15b24bda7a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1314 microversion: 2.1 time: 0.719458 Oct 18 13:47:47.637838 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2960/5714] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:46 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:48.671777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ffe62114-9d4c-454c-b5d8-6e762dab52f9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:48.673618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ffe62114-9d4c-454c-b5d8-6e762dab52f9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:48.682525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffe62114-9d4c-454c-b5d8-6e762dab52f9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:48.689865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffe62114-9d4c-454c-b5d8-6e762dab52f9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:48.690718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffe62114-9d4c-454c-b5d8-6e762dab52f9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:48.691815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffe62114-9d4c-454c-b5d8-6e762dab52f9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:48.692785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffe62114-9d4c-454c-b5d8-6e762dab52f9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:48.693419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffe62114-9d4c-454c-b5d8-6e762dab52f9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:49.537118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ffe62114-9d4c-454c-b5d8-6e762dab52f9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:49.554638 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ffe62114-9d4c-454c-b5d8-6e762dab52f9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1314 microversion: 2.1 time: 0.887254 Oct 18 13:47:49.556926 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2755/5715] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:48 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1314 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:50.388532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-61d34a52-5faf-4a50-ab96-6d3a6639fa81 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:50.390368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-61d34a52-5faf-4a50-ab96-6d3a6639fa81 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:50.402216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61d34a52-5faf-4a50-ab96-6d3a6639fa81 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:50.403711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61d34a52-5faf-4a50-ab96-6d3a6639fa81 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:50.406623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61d34a52-5faf-4a50-ab96-6d3a6639fa81 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:50.407907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61d34a52-5faf-4a50-ab96-6d3a6639fa81 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:50.410270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61d34a52-5faf-4a50-ab96-6d3a6639fa81 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:50.413053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61d34a52-5faf-4a50-ab96-6d3a6639fa81 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:50.530426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-61d34a52-5faf-4a50-ab96-6d3a6639fa81 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lazy-loading 'services' on Instance uuid ee304341-74a8-4ded-a4a4-0ddb13f16002 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:47:50.587878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b2948fb1-7cf2-41f9-b64f-885a08dbedbe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:50.588677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b2948fb1-7cf2-41f9-b64f-885a08dbedbe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:50.614463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2948fb1-7cf2-41f9-b64f-885a08dbedbe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:50.615229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2948fb1-7cf2-41f9-b64f-885a08dbedbe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:50.615927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2948fb1-7cf2-41f9-b64f-885a08dbedbe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:50.617340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2948fb1-7cf2-41f9-b64f-885a08dbedbe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:50.623496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2948fb1-7cf2-41f9-b64f-885a08dbedbe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:50.627860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2948fb1-7cf2-41f9-b64f-885a08dbedbe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:50.790146 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-61d34a52-5faf-4a50-ab96-6d3a6639fa81 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments/159a34e6-06bc-4bd7-9f8a-11a565262b0b" status: 202 len: 0 microversion: 2.1 time: 0.405217 Oct 18 13:47:50.791526 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2961/5716] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:47:50 2022] DELETE /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments/159a34e6-06bc-4bd7-9f8a-11a565262b0b => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:47:50.816132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c66bc05-ba2c-461f-9c87-8f25bf8b1243 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:50.829733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7c66bc05-ba2c-461f-9c87-8f25bf8b1243 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:50.847370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c66bc05-ba2c-461f-9c87-8f25bf8b1243 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:50.848833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c66bc05-ba2c-461f-9c87-8f25bf8b1243 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:50.849516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c66bc05-ba2c-461f-9c87-8f25bf8b1243 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:50.850437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c66bc05-ba2c-461f-9c87-8f25bf8b1243 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:50.851093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c66bc05-ba2c-461f-9c87-8f25bf8b1243 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:50.851714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c66bc05-ba2c-461f-9c87-8f25bf8b1243 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:50.911968 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7c66bc05-ba2c-461f-9c87-8f25bf8b1243 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115948 Oct 18 13:47:50.913408 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2962/5717] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:47:50 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:51.310390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:51.328021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b2948fb1-7cf2-41f9-b64f-885a08dbedbe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:51.345820 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b2948fb1-7cf2-41f9-b64f-885a08dbedbe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1314 microversion: 2.1 time: 0.765044 Oct 18 13:47:51.353678 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2756/5718] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:50 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1314 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:51.620868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ea22cbf5-f42c-4df9-9e0a-90ee9e662a07 req-5aca988d-4307-41f7-9619-387890bc9675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9f55222-3d85-4193-96c2-d523abf1b713", "tag": "4fb17d86-f56c-432e-9e71-b9586073ec1b"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:51.639219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=8 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:51.643483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ea22cbf5-f42c-4df9-9e0a-90ee9e662a07 req-5aca988d-4307-41f7-9619-387890bc9675 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:51.649493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ea22cbf5-f42c-4df9-9e0a-90ee9e662a07 req-5aca988d-4307-41f7-9619-387890bc9675 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:51.649980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ea22cbf5-f42c-4df9-9e0a-90ee9e662a07 req-5aca988d-4307-41f7-9619-387890bc9675 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:51.682622 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ea22cbf5-f42c-4df9-9e0a-90ee9e662a07 req-5aca988d-4307-41f7-9619-387890bc9675 service nova] Creating event network-changed:4fb17d86-f56c-432e-9e71-b9586073ec1b for instance b9f55222-3d85-4193-96c2-d523abf1b713 on n-h1-858384-13 Oct 18 13:47:51.696312 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ea22cbf5-f42c-4df9-9e0a-90ee9e662a07 req-5aca988d-4307-41f7-9619-387890bc9675 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.396412 Oct 18 13:47:51.697676 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2963/5719] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:51.925586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9c3d0da6-a485-4e11-a652-d6cb05bc7182 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:51.930116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9c3d0da6-a485-4e11-a652-d6cb05bc7182 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:51.945006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c3d0da6-a485-4e11-a652-d6cb05bc7182 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:51.947053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c3d0da6-a485-4e11-a652-d6cb05bc7182 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:51.949145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c3d0da6-a485-4e11-a652-d6cb05bc7182 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:51.951395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c3d0da6-a485-4e11-a652-d6cb05bc7182 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:51.952114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c3d0da6-a485-4e11-a652-d6cb05bc7182 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:51.959106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c3d0da6-a485-4e11-a652-d6cb05bc7182 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:52.044738 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9c3d0da6-a485-4e11-a652-d6cb05bc7182 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123544 Oct 18 13:47:52.047798 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2757/5720] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:47:51 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:52.380123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-90607465-c467-4372-83a0-2bdd1621c7f0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:52.381309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-90607465-c467-4372-83a0-2bdd1621c7f0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:52.433488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90607465-c467-4372-83a0-2bdd1621c7f0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:52.436993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90607465-c467-4372-83a0-2bdd1621c7f0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:52.439852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90607465-c467-4372-83a0-2bdd1621c7f0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:52.460908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90607465-c467-4372-83a0-2bdd1621c7f0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:52.461713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90607465-c467-4372-83a0-2bdd1621c7f0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:52.462971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90607465-c467-4372-83a0-2bdd1621c7f0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:53.061720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-26e1c18a-d823-4384-9877-b524588b045f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:53.066103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-26e1c18a-d823-4384-9877-b524588b045f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:53.108553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26e1c18a-d823-4384-9877-b524588b045f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:53.110081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26e1c18a-d823-4384-9877-b524588b045f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:53.111941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26e1c18a-d823-4384-9877-b524588b045f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:53.112711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26e1c18a-d823-4384-9877-b524588b045f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:53.113207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26e1c18a-d823-4384-9877-b524588b045f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:53.115955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26e1c18a-d823-4384-9877-b524588b045f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:53.128698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=88 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:53.210237 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-26e1c18a-d823-4384-9877-b524588b045f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149620 Oct 18 13:47:53.212746 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2758/5721] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:47:53 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:53.234730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-90607465-c467-4372-83a0-2bdd1621c7f0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:53.252908 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-90607465-c467-4372-83a0-2bdd1621c7f0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1314 microversion: 2.1 time: 0.877815 Oct 18 13:47:53.256470 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2964/5722] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:52 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:54.224302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0f3c588-3248-4c21-b71b-05c6180132bb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:54.226514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e0f3c588-3248-4c21-b71b-05c6180132bb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:54.252081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f3c588-3248-4c21-b71b-05c6180132bb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:54.252855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f3c588-3248-4c21-b71b-05c6180132bb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:54.253482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f3c588-3248-4c21-b71b-05c6180132bb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:54.254371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f3c588-3248-4c21-b71b-05c6180132bb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:54.255004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f3c588-3248-4c21-b71b-05c6180132bb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:54.255592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f3c588-3248-4c21-b71b-05c6180132bb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:54.279844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-94291d36-ca8b-495f-833d-e47e494192d1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:54.281066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-94291d36-ca8b-495f-833d-e47e494192d1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:54.294172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94291d36-ca8b-495f-833d-e47e494192d1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:54.295349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94291d36-ca8b-495f-833d-e47e494192d1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:54.296030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94291d36-ca8b-495f-833d-e47e494192d1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:54.296970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94291d36-ca8b-495f-833d-e47e494192d1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:54.301752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94291d36-ca8b-495f-833d-e47e494192d1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:54.302513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94291d36-ca8b-495f-833d-e47e494192d1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:54.346141 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e0f3c588-3248-4c21-b71b-05c6180132bb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126686 Oct 18 13:47:54.355828 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2759/5723] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:47:54 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:55.067101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-94291d36-ca8b-495f-833d-e47e494192d1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:55.070394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:55.083258 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-94291d36-ca8b-495f-833d-e47e494192d1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1314 microversion: 2.1 time: 0.807119 Oct 18 13:47:55.101219 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2965/5724] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:54 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:55.369955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2969b9f6-eb14-429b-bdf7-67f9662af335 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:55.372438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2969b9f6-eb14-429b-bdf7-67f9662af335 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:55.387765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=32 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:47:55.393289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2969b9f6-eb14-429b-bdf7-67f9662af335 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:55.394036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2969b9f6-eb14-429b-bdf7-67f9662af335 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:55.396611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2969b9f6-eb14-429b-bdf7-67f9662af335 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:55.400527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2969b9f6-eb14-429b-bdf7-67f9662af335 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:55.401591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2969b9f6-eb14-429b-bdf7-67f9662af335 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:55.402285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2969b9f6-eb14-429b-bdf7-67f9662af335 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:55.508893 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2969b9f6-eb14-429b-bdf7-67f9662af335 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143862 Oct 18 13:47:55.511712 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2760/5725] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:47:55 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:56.116692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ecfa52c6-59b5-4536-9ac5-1e8be32da21a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:56.117423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ecfa52c6-59b5-4536-9ac5-1e8be32da21a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:56.138478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecfa52c6-59b5-4536-9ac5-1e8be32da21a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:56.139184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecfa52c6-59b5-4536-9ac5-1e8be32da21a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:56.139724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecfa52c6-59b5-4536-9ac5-1e8be32da21a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:56.144066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecfa52c6-59b5-4536-9ac5-1e8be32da21a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:56.146212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecfa52c6-59b5-4536-9ac5-1e8be32da21a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:56.153155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecfa52c6-59b5-4536-9ac5-1e8be32da21a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:56.524282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dc9f8bf8-7bac-4b8a-a684-311febdfd843 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:56.526482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dc9f8bf8-7bac-4b8a-a684-311febdfd843 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:56.547763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc9f8bf8-7bac-4b8a-a684-311febdfd843 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:56.548706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc9f8bf8-7bac-4b8a-a684-311febdfd843 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:56.550548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc9f8bf8-7bac-4b8a-a684-311febdfd843 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:56.552340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc9f8bf8-7bac-4b8a-a684-311febdfd843 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:56.554691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc9f8bf8-7bac-4b8a-a684-311febdfd843 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:56.556409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc9f8bf8-7bac-4b8a-a684-311febdfd843 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:56.641646 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dc9f8bf8-7bac-4b8a-a684-311febdfd843 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122518 Oct 18 13:47:56.656391 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2761/5726] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:47:56 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:47:56.832455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ecfa52c6-59b5-4536-9ac5-1e8be32da21a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:56.842581 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ecfa52c6-59b5-4536-9ac5-1e8be32da21a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1314 microversion: 2.1 time: 0.729231 Oct 18 13:47:56.843226 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2966/5727] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:56 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:47:57.668516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31388baa-834a-44f3-aea1-2d9289c00285 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:57.670775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-31388baa-834a-44f3-aea1-2d9289c00285 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:57.696111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31388baa-834a-44f3-aea1-2d9289c00285 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:57.696111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31388baa-834a-44f3-aea1-2d9289c00285 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:57.696111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31388baa-834a-44f3-aea1-2d9289c00285 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:57.696111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31388baa-834a-44f3-aea1-2d9289c00285 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:57.696111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31388baa-834a-44f3-aea1-2d9289c00285 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:57.696111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31388baa-834a-44f3-aea1-2d9289c00285 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:57.792800 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31388baa-834a-44f3-aea1-2d9289c00285 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128092 Oct 18 13:47:57.794055 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2762/5728] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:47:57 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:57.867540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db795bc0-0cfc-40d9-96a4-20dcd3fa921b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:57.868917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db795bc0-0cfc-40d9-96a4-20dcd3fa921b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:57.885760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db795bc0-0cfc-40d9-96a4-20dcd3fa921b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:57.895340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db795bc0-0cfc-40d9-96a4-20dcd3fa921b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:57.897656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db795bc0-0cfc-40d9-96a4-20dcd3fa921b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:57.898890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db795bc0-0cfc-40d9-96a4-20dcd3fa921b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:57.899480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db795bc0-0cfc-40d9-96a4-20dcd3fa921b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:57.906567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db795bc0-0cfc-40d9-96a4-20dcd3fa921b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:58.310942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db795bc0-0cfc-40d9-96a4-20dcd3fa921b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:58.322194 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db795bc0-0cfc-40d9-96a4-20dcd3fa921b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1314 microversion: 2.1 time: 0.459465 Oct 18 13:47:58.323788 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2967/5729] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:57 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:58.806899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a234f33d-a04f-4c26-8e09-b59cfd18f896 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:58.809614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a234f33d-a04f-4c26-8e09-b59cfd18f896 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:58.829068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a234f33d-a04f-4c26-8e09-b59cfd18f896 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:58.829871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a234f33d-a04f-4c26-8e09-b59cfd18f896 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:58.830472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a234f33d-a04f-4c26-8e09-b59cfd18f896 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:58.831332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a234f33d-a04f-4c26-8e09-b59cfd18f896 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:58.831935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a234f33d-a04f-4c26-8e09-b59cfd18f896 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:58.832507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a234f33d-a04f-4c26-8e09-b59cfd18f896 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:58.900765 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a234f33d-a04f-4c26-8e09-b59cfd18f896 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097994 Oct 18 13:47:58.904411 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2763/5730] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:47:58 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:59.163266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9517ee51-54ac-4136-8e9c-41095a12847f req-4a0ed99d-d80d-4813-b1cd-97fbec2f219f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f55222-3d85-4193-96c2-d523abf1b713", "name": "network-vif-plugged", "status": "completed", "tag": "4fb17d86-f56c-432e-9e71-b9586073ec1b"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:47:59.177749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9517ee51-54ac-4136-8e9c-41095a12847f req-4a0ed99d-d80d-4813-b1cd-97fbec2f219f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:59.178599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9517ee51-54ac-4136-8e9c-41095a12847f req-4a0ed99d-d80d-4813-b1cd-97fbec2f219f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:59.179316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9517ee51-54ac-4136-8e9c-41095a12847f req-4a0ed99d-d80d-4813-b1cd-97fbec2f219f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:59.195858 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9517ee51-54ac-4136-8e9c-41095a12847f req-4a0ed99d-d80d-4813-b1cd-97fbec2f219f service nova] Creating event network-vif-plugged:4fb17d86-f56c-432e-9e71-b9586073ec1b for instance b9f55222-3d85-4193-96c2-d523abf1b713 on n-h1-858384-13 Oct 18 13:47:59.203143 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9517ee51-54ac-4136-8e9c-41095a12847f req-4a0ed99d-d80d-4813-b1cd-97fbec2f219f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046587 Oct 18 13:47:59.205286 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2968/5731] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:47:59.347359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aa51487e-c5e2-48f7-97da-d695d1851ee1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:59.348317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aa51487e-c5e2-48f7-97da-d695d1851ee1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:59.357390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa51487e-c5e2-48f7-97da-d695d1851ee1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:59.363251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa51487e-c5e2-48f7-97da-d695d1851ee1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:59.367093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa51487e-c5e2-48f7-97da-d695d1851ee1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:59.368118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa51487e-c5e2-48f7-97da-d695d1851ee1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:59.368804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa51487e-c5e2-48f7-97da-d695d1851ee1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:59.370862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aa51487e-c5e2-48f7-97da-d695d1851ee1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:47:59.833485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aa51487e-c5e2-48f7-97da-d695d1851ee1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:47:59.852437 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aa51487e-c5e2-48f7-97da-d695d1851ee1 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1314 microversion: 2.1 time: 0.509494 Oct 18 13:47:59.853519 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2764/5732] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:47:59 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:47:59.917877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93d48c25-4ff5-422e-bbbe-ff5614d13503 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:47:59.920916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-93d48c25-4ff5-422e-bbbe-ff5614d13503 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:47:59.955548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93d48c25-4ff5-422e-bbbe-ff5614d13503 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:47:59.957060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93d48c25-4ff5-422e-bbbe-ff5614d13503 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:47:59.973366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93d48c25-4ff5-422e-bbbe-ff5614d13503 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:00.000862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93d48c25-4ff5-422e-bbbe-ff5614d13503 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:00.002072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93d48c25-4ff5-422e-bbbe-ff5614d13503 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:00.003577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93d48c25-4ff5-422e-bbbe-ff5614d13503 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:00.121664 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-93d48c25-4ff5-422e-bbbe-ff5614d13503 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.209660 Oct 18 13:48:00.122709 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2969/5733] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:47:59 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002/os-volume_attachments => generated 25 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:48:00.255253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c6151550-c238-4c69-875c-22d0124efa82 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:00.256316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c6151550-c238-4c69-875c-22d0124efa82 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:00.265455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6151550-c238-4c69-875c-22d0124efa82 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:00.269576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6151550-c238-4c69-875c-22d0124efa82 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:00.270203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6151550-c238-4c69-875c-22d0124efa82 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:00.271049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6151550-c238-4c69-875c-22d0124efa82 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:00.273281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6151550-c238-4c69-875c-22d0124efa82 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:00.274054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6151550-c238-4c69-875c-22d0124efa82 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:00.321630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c6151550-c238-4c69-875c-22d0124efa82 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:48:00.466053 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c6151550-c238-4c69-875c-22d0124efa82 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 204 len: 0 microversion: 2.1 time: 0.214324 Oct 18 13:48:00.467404 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2765/5734] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:48:00 2022] DELETE /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:48:00.477169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e20dec5b-5840-4271-b822-e28ea43fbc45 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:00.477815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e20dec5b-5840-4271-b822-e28ea43fbc45 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:00.481647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:00.489492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e20dec5b-5840-4271-b822-e28ea43fbc45 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:00.490474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e20dec5b-5840-4271-b822-e28ea43fbc45 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:00.491546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e20dec5b-5840-4271-b822-e28ea43fbc45 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:00.493000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e20dec5b-5840-4271-b822-e28ea43fbc45 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:00.493721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e20dec5b-5840-4271-b822-e28ea43fbc45 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:00.494393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e20dec5b-5840-4271-b822-e28ea43fbc45 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:00.833834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e20dec5b-5840-4271-b822-e28ea43fbc45 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:00.843348 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e20dec5b-5840-4271-b822-e28ea43fbc45 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1679 microversion: 2.1 time: 0.371037 Oct 18 13:48:00.847690 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2970/5735] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:00 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1679 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:00.880467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c3605053-f9e7-49d2-a579-c91331802d9a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:00.882060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c3605053-f9e7-49d2-a579-c91331802d9a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:00.889314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3605053-f9e7-49d2-a579-c91331802d9a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:00.890088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3605053-f9e7-49d2-a579-c91331802d9a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:00.892466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3605053-f9e7-49d2-a579-c91331802d9a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:00.893335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3605053-f9e7-49d2-a579-c91331802d9a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:00.893972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3605053-f9e7-49d2-a579-c91331802d9a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:00.894764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3605053-f9e7-49d2-a579-c91331802d9a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:01.275847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3605053-f9e7-49d2-a579-c91331802d9a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:01.284158 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c3605053-f9e7-49d2-a579-c91331802d9a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1314 microversion: 2.1 time: 0.411439 Oct 18 13:48:01.288381 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2766/5736] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:00 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:01.879360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8dd627c-6d67-4c73-9f90-7be81df0f39c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:01.880586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8dd627c-6d67-4c73-9f90-7be81df0f39c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:01.889169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8dd627c-6d67-4c73-9f90-7be81df0f39c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:01.890715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8dd627c-6d67-4c73-9f90-7be81df0f39c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:01.891992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8dd627c-6d67-4c73-9f90-7be81df0f39c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:01.893076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8dd627c-6d67-4c73-9f90-7be81df0f39c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:01.893735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8dd627c-6d67-4c73-9f90-7be81df0f39c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:01.894357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8dd627c-6d67-4c73-9f90-7be81df0f39c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:02.146884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b8dd627c-6d67-4c73-9f90-7be81df0f39c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:02.160546 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8dd627c-6d67-4c73-9f90-7be81df0f39c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1679 microversion: 2.1 time: 0.287244 Oct 18 13:48:02.163934 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2971/5737] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:01 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1679 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:02.311317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-17664e57-92f1-42f4-8147-c2115b8cc614 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:02.312304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-17664e57-92f1-42f4-8147-c2115b8cc614 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:02.331864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-17664e57-92f1-42f4-8147-c2115b8cc614 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:02.332360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-17664e57-92f1-42f4-8147-c2115b8cc614 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:02.332802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-17664e57-92f1-42f4-8147-c2115b8cc614 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:02.333692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-17664e57-92f1-42f4-8147-c2115b8cc614 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:02.334143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-17664e57-92f1-42f4-8147-c2115b8cc614 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:02.334568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-17664e57-92f1-42f4-8147-c2115b8cc614 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:03.195201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dfd6fa69-a3c2-42c8-b92e-53caf1a10082 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:03.195993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dfd6fa69-a3c2-42c8-b92e-53caf1a10082 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:03.199589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-17664e57-92f1-42f4-8147-c2115b8cc614 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:03.211481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfd6fa69-a3c2-42c8-b92e-53caf1a10082 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:03.211744 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-17664e57-92f1-42f4-8147-c2115b8cc614 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1501 microversion: 2.1 time: 0.904256 Oct 18 13:48:03.212259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfd6fa69-a3c2-42c8-b92e-53caf1a10082 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:03.212806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfd6fa69-a3c2-42c8-b92e-53caf1a10082 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:03.216992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfd6fa69-a3c2-42c8-b92e-53caf1a10082 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:03.217701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfd6fa69-a3c2-42c8-b92e-53caf1a10082 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:03.218441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfd6fa69-a3c2-42c8-b92e-53caf1a10082 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:03.225569 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2767/5738] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:02 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1501 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:03.248407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35c5ea91-c1ee-4957-98f8-69eb4e6fe482 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:03.250860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-35c5ea91-c1ee-4957-98f8-69eb4e6fe482 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:03.266021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35c5ea91-c1ee-4957-98f8-69eb4e6fe482 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:03.266811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35c5ea91-c1ee-4957-98f8-69eb4e6fe482 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:03.267408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35c5ea91-c1ee-4957-98f8-69eb4e6fe482 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:03.268289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35c5ea91-c1ee-4957-98f8-69eb4e6fe482 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:03.268892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35c5ea91-c1ee-4957-98f8-69eb4e6fe482 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:03.269486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35c5ea91-c1ee-4957-98f8-69eb4e6fe482 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:03.323781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-35c5ea91-c1ee-4957-98f8-69eb4e6fe482 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lazy-loading 'flavor' on Instance uuid b9f55222-3d85-4193-96c2-d523abf1b713 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:48:03.487349 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-35c5ea91-c1ee-4957-98f8-69eb4e6fe482 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "POST /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713/action" status: 200 len: 32 microversion: 2.1 time: 0.243891 Oct 18 13:48:03.492613 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2768/5739] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:48:03 2022] POST /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:48:03.498076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42a8a85e-b8c2-4185-b07e-7b9a416564d5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:03.510249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-42a8a85e-b8c2-4185-b07e-7b9a416564d5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:03.517563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42a8a85e-b8c2-4185-b07e-7b9a416564d5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:03.518381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42a8a85e-b8c2-4185-b07e-7b9a416564d5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:03.522323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42a8a85e-b8c2-4185-b07e-7b9a416564d5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:03.523294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42a8a85e-b8c2-4185-b07e-7b9a416564d5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:03.523825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42a8a85e-b8c2-4185-b07e-7b9a416564d5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:03.524341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42a8a85e-b8c2-4185-b07e-7b9a416564d5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:03.872544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-42a8a85e-b8c2-4185-b07e-7b9a416564d5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:03.882176 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-42a8a85e-b8c2-4185-b07e-7b9a416564d5 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.388138 Oct 18 13:48:03.883494 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2769/5740] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:03 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:03.899293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dfd6fa69-a3c2-42c8-b92e-53caf1a10082 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:03.913777 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dfd6fa69-a3c2-42c8-b92e-53caf1a10082 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1679 microversion: 2.1 time: 0.725936 Oct 18 13:48:03.918377 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2972/5741] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:03 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1679 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:04.657138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d97f16d1-e25b-4976-b3fb-558a0ca14658 req-6bf6e6fa-642a-43c7-afcb-4cbad07ca346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee304341-74a8-4ded-a4a4-0ddb13f16002", "name": "network-vif-deleted", "tag": "7a31afc9-ee4a-4c22-97a1-875b9e65a1b3"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:04.731427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d97f16d1-e25b-4976-b3fb-558a0ca14658 req-6bf6e6fa-642a-43c7-afcb-4cbad07ca346 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:04.732660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d97f16d1-e25b-4976-b3fb-558a0ca14658 req-6bf6e6fa-642a-43c7-afcb-4cbad07ca346 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:04.733102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d97f16d1-e25b-4976-b3fb-558a0ca14658 req-6bf6e6fa-642a-43c7-afcb-4cbad07ca346 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:04.767989 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d97f16d1-e25b-4976-b3fb-558a0ca14658 req-6bf6e6fa-642a-43c7-afcb-4cbad07ca346 service nova] Creating event network-vif-deleted:7a31afc9-ee4a-4c22-97a1-875b9e65a1b3 for instance ee304341-74a8-4ded-a4a4-0ddb13f16002 on n-h1-858384-13 Oct 18 13:48:04.787137 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d97f16d1-e25b-4976-b3fb-558a0ca14658 req-6bf6e6fa-642a-43c7-afcb-4cbad07ca346 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128659 Oct 18 13:48:04.790825 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2770/5742] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:04.911037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cea2e703-d578-4a81-b2bf-3ce3bcf9091a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:04.911675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cea2e703-d578-4a81-b2bf-3ce3bcf9091a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:04.932764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cea2e703-d578-4a81-b2bf-3ce3bcf9091a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:04.934167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cea2e703-d578-4a81-b2bf-3ce3bcf9091a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:04.934671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cea2e703-d578-4a81-b2bf-3ce3bcf9091a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:04.935483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cea2e703-d578-4a81-b2bf-3ce3bcf9091a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:04.935951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cea2e703-d578-4a81-b2bf-3ce3bcf9091a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:04.936378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cea2e703-d578-4a81-b2bf-3ce3bcf9091a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:04.945158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:04.954757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:04.977909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:04.979387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:04.980749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:04.982314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:04.985737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:04.987754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:05.057392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:05.058279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:05.058969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:05.059775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lazy-loading 'fault' on Instance uuid ee304341-74a8-4ded-a4a4-0ddb13f16002 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:48:05.062457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:05.136101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:05.145135 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b12fa8a9-88da-4662-921d-926d8bb1835f tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 200 len: 1331 microversion: 2.1 time: 0.204123 Oct 18 13:48:05.152290 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2771/5743] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:04 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 1331 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:06.005159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cea2e703-d578-4a81-b2bf-3ce3bcf9091a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:06.017970 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cea2e703-d578-4a81-b2bf-3ce3bcf9091a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 1.109054 Oct 18 13:48:06.018625 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2973/5744] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:04 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:06.179553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5f151406-fb4e-403b-9d60-4049406803fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:06.180159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5f151406-fb4e-403b-9d60-4049406803fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:06.210974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f151406-fb4e-403b-9d60-4049406803fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:06.211692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f151406-fb4e-403b-9d60-4049406803fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:06.212153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f151406-fb4e-403b-9d60-4049406803fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:06.215998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f151406-fb4e-403b-9d60-4049406803fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:06.217816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f151406-fb4e-403b-9d60-4049406803fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:06.218314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5f151406-fb4e-403b-9d60-4049406803fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:06.262738 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-5f151406-fb4e-403b-9d60-4049406803fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5f151406-fb4e-403b-9d60-4049406803fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 HTTP/1.1 Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'ee304341-74a8-4ded-a4a4-0ddb13f16002'} Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:06.268894 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:06.274628 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:06.274628 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:06.274628 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:06.274628 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:48:06.274628 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:48:06.274628 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:48:06.274628 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:06.274628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5f151406-fb4e-403b-9d60-4049406803fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 404 to user: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:48:06.274628 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5f151406-fb4e-403b-9d60-4049406803fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 404 len: 111 microversion: 2.1 time: 0.097522 Oct 18 13:48:06.275757 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2772/5745] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:06 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:48:06.285200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c8299b84-3c1f-4fdb-80cd-4c8d1bb8d102 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '.version_select at 0x7ff60effb9d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:06.337552 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c8299b84-3c1f-4fdb-80cd-4c8d1bb8d102 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479360903" status: 202 len: 0 microversion: 2.1 time: 0.057222 Oct 18 13:48:06.345656 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2974/5746] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:48:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479360903 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:48:07.043082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e38b4338-a00d-4113-bbb6-5a8556363149 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:07.043691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e38b4338-a00d-4113-bbb6-5a8556363149 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:07.067331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e38b4338-a00d-4113-bbb6-5a8556363149 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:07.068091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e38b4338-a00d-4113-bbb6-5a8556363149 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:07.068543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e38b4338-a00d-4113-bbb6-5a8556363149 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:07.069369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e38b4338-a00d-4113-bbb6-5a8556363149 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:07.070871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e38b4338-a00d-4113-bbb6-5a8556363149 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:07.073296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e38b4338-a00d-4113-bbb6-5a8556363149 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:07.492221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e38b4338-a00d-4113-bbb6-5a8556363149 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:07.507567 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e38b4338-a00d-4113-bbb6-5a8556363149 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.465064 Oct 18 13:48:07.512225 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2773/5747] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:07 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:08.535565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1842883-c774-4105-8067-3c398b940ae4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:08.536338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1842883-c774-4105-8067-3c398b940ae4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:08.550252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1842883-c774-4105-8067-3c398b940ae4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:08.550752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1842883-c774-4105-8067-3c398b940ae4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:08.551190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1842883-c774-4105-8067-3c398b940ae4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:08.551895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1842883-c774-4105-8067-3c398b940ae4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:08.559517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1842883-c774-4105-8067-3c398b940ae4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:08.563156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1842883-c774-4105-8067-3c398b940ae4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:09.040574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-28256815-4d99-45f5-8f58-d14212d63d37 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Action: 'create', calling method: .version_select at 0x7ff60e647670>, body: {"keypair": {"name": "tempest-keypair-1881708035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKd0q/5O6NrJjWbXE3ZhaxqKMQMQk7J2jU2lxjpe1y7l9ZFdaZ+h+A3qMeHi0PhXR08UJCyb+hWuM1oL0UAGgWyGShgA6VREg3GZi/TM7xEq12SmmBtBhQLoMYUe2A/+zA=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:09.079783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-28256815-4d99-45f5-8f58-d14212d63d37 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for project b134786f443e4760b57d3cb5842daa89. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:48:09.093536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-28256815-4d99-45f5-8f58-d14212d63d37 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for user e1fdfb4e43ca40eabb58abe0e9bd4ea3 and project b134786f443e4760b57d3cb5842daa89. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:48:09.170627 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-28256815-4d99-45f5-8f58-d14212d63d37 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134094 Oct 18 13:48:09.172205 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2774/5748] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:48:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:48:09.288498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d1842883-c774-4105-8067-3c398b940ae4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:09.298613 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d1842883-c774-4105-8067-3c398b940ae4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.767572 Oct 18 13:48:09.315165 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2975/5749] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:08 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:10.324692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84522000-aab9-4d12-a00b-2432e108ebc3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:10.325457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-84522000-aab9-4d12-a00b-2432e108ebc3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:10.338650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84522000-aab9-4d12-a00b-2432e108ebc3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:10.339145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84522000-aab9-4d12-a00b-2432e108ebc3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:10.339578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84522000-aab9-4d12-a00b-2432e108ebc3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:10.340279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84522000-aab9-4d12-a00b-2432e108ebc3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:10.340727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84522000-aab9-4d12-a00b-2432e108ebc3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:10.341149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84522000-aab9-4d12-a00b-2432e108ebc3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:10.751510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-84522000-aab9-4d12-a00b-2432e108ebc3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:10.772009 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-84522000-aab9-4d12-a00b-2432e108ebc3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.451952 Oct 18 13:48:10.772606 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2775/5750] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:10 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:11.799722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f77feac8-bc5f-4088-ab83-308c9bf1eed8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:11.800955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f77feac8-bc5f-4088-ab83-308c9bf1eed8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:11.818489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f77feac8-bc5f-4088-ab83-308c9bf1eed8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:11.821811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f77feac8-bc5f-4088-ab83-308c9bf1eed8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:11.822973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f77feac8-bc5f-4088-ab83-308c9bf1eed8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:11.823887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f77feac8-bc5f-4088-ab83-308c9bf1eed8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:11.824504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f77feac8-bc5f-4088-ab83-308c9bf1eed8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:11.826723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f77feac8-bc5f-4088-ab83-308c9bf1eed8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:12.380537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f77feac8-bc5f-4088-ab83-308c9bf1eed8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:12.416182 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f77feac8-bc5f-4088-ab83-308c9bf1eed8 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.620474 Oct 18 13:48:12.416833 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2976/5751] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:11 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:13.450427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ab570f25-8580-45a9-a260-5e03e1a5769c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:13.451044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ab570f25-8580-45a9-a260-5e03e1a5769c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:13.458400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab570f25-8580-45a9-a260-5e03e1a5769c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:13.458881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab570f25-8580-45a9-a260-5e03e1a5769c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:13.459311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab570f25-8580-45a9-a260-5e03e1a5769c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:13.460006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab570f25-8580-45a9-a260-5e03e1a5769c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:13.460451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab570f25-8580-45a9-a260-5e03e1a5769c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:13.460875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab570f25-8580-45a9-a260-5e03e1a5769c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:14.560709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ab570f25-8580-45a9-a260-5e03e1a5769c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:14.574765 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ab570f25-8580-45a9-a260-5e03e1a5769c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 1.127884 Oct 18 13:48:14.575195 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2776/5752] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:13 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:15.602385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a2a503f5-22be-44ee-9eef-df273f6fe36e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:15.603096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a2a503f5-22be-44ee-9eef-df273f6fe36e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:15.614964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2a503f5-22be-44ee-9eef-df273f6fe36e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:15.624609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2a503f5-22be-44ee-9eef-df273f6fe36e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:15.625066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2a503f5-22be-44ee-9eef-df273f6fe36e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:15.625883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2a503f5-22be-44ee-9eef-df273f6fe36e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:15.626354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2a503f5-22be-44ee-9eef-df273f6fe36e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:15.626792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a2a503f5-22be-44ee-9eef-df273f6fe36e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:16.426394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a2a503f5-22be-44ee-9eef-df273f6fe36e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:16.434771 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a2a503f5-22be-44ee-9eef-df273f6fe36e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.836426 Oct 18 13:48:16.440726 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2977/5753] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:15 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:16.589747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-747760894", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e79f1988-366e-4b47-8001-6022e690ef28"}], "security_groups": [{"name": "tempest-securitygroup--2050096946"}], "key_name": "tempest-keypair-1881708035", "user_data": "}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:16.834935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] validate_networks() for [('e79f1988-366e-4b47-8001-6022e690ef28', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:48:17.464830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-170e01a1-8b92-4577-b12d-9f0f57084da9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:17.466058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-170e01a1-8b92-4577-b12d-9f0f57084da9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:17.481970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-170e01a1-8b92-4577-b12d-9f0f57084da9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:17.482802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-170e01a1-8b92-4577-b12d-9f0f57084da9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:17.483246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-170e01a1-8b92-4577-b12d-9f0f57084da9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:17.487751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-170e01a1-8b92-4577-b12d-9f0f57084da9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:17.488514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-170e01a1-8b92-4577-b12d-9f0f57084da9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:17.488972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-170e01a1-8b92-4577-b12d-9f0f57084da9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:17.777256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-170e01a1-8b92-4577-b12d-9f0f57084da9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:17.790044 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-170e01a1-8b92-4577-b12d-9f0f57084da9 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.329858 Oct 18 13:48:17.790857 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2978/5754] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:17 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:18.102248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:48:18.104045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:48:18.104938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:48:18.105647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:48:18.106286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:48:18.128262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:18.129675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:18.131425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:18.133644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:18.134371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:18.135166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:18.159058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for project b134786f443e4760b57d3cb5842daa89. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:48:18.165431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for user e1fdfb4e43ca40eabb58abe0e9bd4ea3 and project b134786f443e4760b57d3cb5842daa89. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:48:18.182910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:48:18.187686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:48:18.276512 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1a1cce6d-702c-4178-9b6f-e70cb90e9b16 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.691607 Oct 18 13:48:18.288889 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2777/5755] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:48:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:48:18.293954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-74a85e29-ab55-4d21-8320-789faf94fdfc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:18.294591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-74a85e29-ab55-4d21-8320-789faf94fdfc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:18.822913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-db2813db-e6c2-4975-a61d-dabc61bfe292 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:18.826051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-db2813db-e6c2-4975-a61d-dabc61bfe292 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:18.848722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db2813db-e6c2-4975-a61d-dabc61bfe292 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:18.850461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db2813db-e6c2-4975-a61d-dabc61bfe292 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:18.852269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db2813db-e6c2-4975-a61d-dabc61bfe292 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:18.854428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db2813db-e6c2-4975-a61d-dabc61bfe292 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:18.857083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-74a85e29-ab55-4d21-8320-789faf94fdfc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:18.857805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db2813db-e6c2-4975-a61d-dabc61bfe292 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:18.858410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db2813db-e6c2-4975-a61d-dabc61bfe292 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:18.872751 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-74a85e29-ab55-4d21-8320-789faf94fdfc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1241 microversion: 2.1 time: 0.582717 Oct 18 13:48:18.893332 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2979/5756] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:18 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1241 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:19.208433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-db2813db-e6c2-4975-a61d-dabc61bfe292 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:19.221981 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-db2813db-e6c2-4975-a61d-dabc61bfe292 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.409043 Oct 18 13:48:19.240035 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2778/5757] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:18 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:19.900881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0203be7a-72fe-49fd-9872-68c62b0056f0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:19.901715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0203be7a-72fe-49fd-9872-68c62b0056f0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:19.919109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0203be7a-72fe-49fd-9872-68c62b0056f0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:19.919603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0203be7a-72fe-49fd-9872-68c62b0056f0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:19.920227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0203be7a-72fe-49fd-9872-68c62b0056f0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:19.921150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0203be7a-72fe-49fd-9872-68c62b0056f0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:19.921802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0203be7a-72fe-49fd-9872-68c62b0056f0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:19.922418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0203be7a-72fe-49fd-9872-68c62b0056f0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:20.043536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0203be7a-72fe-49fd-9872-68c62b0056f0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:20.055236 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0203be7a-72fe-49fd-9872-68c62b0056f0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1293 microversion: 2.1 time: 0.158717 Oct 18 13:48:20.060051 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2980/5758] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:19 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1293 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:20.248222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3dfdd302-617a-4e09-8f8b-5deace842feb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:20.249157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3dfdd302-617a-4e09-8f8b-5deace842feb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:20.268824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dfdd302-617a-4e09-8f8b-5deace842feb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:20.271590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dfdd302-617a-4e09-8f8b-5deace842feb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:20.272136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dfdd302-617a-4e09-8f8b-5deace842feb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:20.272965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dfdd302-617a-4e09-8f8b-5deace842feb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:20.273479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dfdd302-617a-4e09-8f8b-5deace842feb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:20.274006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dfdd302-617a-4e09-8f8b-5deace842feb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:20.487138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3dfdd302-617a-4e09-8f8b-5deace842feb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:20.497957 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3dfdd302-617a-4e09-8f8b-5deace842feb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.254268 Oct 18 13:48:20.498918 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2779/5759] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:20 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:21.087517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b5bfc014-08cf-43e0-ad97-36418d5503bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:21.088750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b5bfc014-08cf-43e0-ad97-36418d5503bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:21.103202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5bfc014-08cf-43e0-ad97-36418d5503bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:21.103916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5bfc014-08cf-43e0-ad97-36418d5503bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:21.104547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5bfc014-08cf-43e0-ad97-36418d5503bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:21.105461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5bfc014-08cf-43e0-ad97-36418d5503bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:21.107778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5bfc014-08cf-43e0-ad97-36418d5503bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:21.108413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b5bfc014-08cf-43e0-ad97-36418d5503bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:21.315652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b5bfc014-08cf-43e0-ad97-36418d5503bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:21.325531 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b5bfc014-08cf-43e0-ad97-36418d5503bd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1299 microversion: 2.1 time: 0.242577 Oct 18 13:48:21.326995 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2981/5760] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:21 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1299 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:21.520171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f9ea3c0c-268b-4d48-92de-b3d9520405ab tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:21.520777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f9ea3c0c-268b-4d48-92de-b3d9520405ab tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:21.534426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9ea3c0c-268b-4d48-92de-b3d9520405ab tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:21.536879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9ea3c0c-268b-4d48-92de-b3d9520405ab tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:21.537482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9ea3c0c-268b-4d48-92de-b3d9520405ab tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:21.539708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9ea3c0c-268b-4d48-92de-b3d9520405ab tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:21.540286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9ea3c0c-268b-4d48-92de-b3d9520405ab tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:21.547285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f9ea3c0c-268b-4d48-92de-b3d9520405ab tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:21.974188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f9ea3c0c-268b-4d48-92de-b3d9520405ab tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:21.985637 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f9ea3c0c-268b-4d48-92de-b3d9520405ab tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.469179 Oct 18 13:48:21.986242 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2780/5761] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:21 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:22.355210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5abffefa-97b9-46db-8b3f-e4bcb107a052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:22.356544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5abffefa-97b9-46db-8b3f-e4bcb107a052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:22.366471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5abffefa-97b9-46db-8b3f-e4bcb107a052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:22.367200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5abffefa-97b9-46db-8b3f-e4bcb107a052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:22.367847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5abffefa-97b9-46db-8b3f-e4bcb107a052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:22.368759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5abffefa-97b9-46db-8b3f-e4bcb107a052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:22.370281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5abffefa-97b9-46db-8b3f-e4bcb107a052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:22.370919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5abffefa-97b9-46db-8b3f-e4bcb107a052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:23.013487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9dce87e8-5c68-4b00-90f1-3f2eb1e0bb60 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:23.020239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9dce87e8-5c68-4b00-90f1-3f2eb1e0bb60 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:23.043157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dce87e8-5c68-4b00-90f1-3f2eb1e0bb60 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:23.044128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dce87e8-5c68-4b00-90f1-3f2eb1e0bb60 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:23.045422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dce87e8-5c68-4b00-90f1-3f2eb1e0bb60 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:23.048225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dce87e8-5c68-4b00-90f1-3f2eb1e0bb60 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:23.050553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dce87e8-5c68-4b00-90f1-3f2eb1e0bb60 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:23.051168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dce87e8-5c68-4b00-90f1-3f2eb1e0bb60 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:23.555595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5abffefa-97b9-46db-8b3f-e4bcb107a052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:23.571715 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5abffefa-97b9-46db-8b3f-e4bcb107a052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1367 microversion: 2.1 time: 1.220581 Oct 18 13:48:23.589482 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2982/5762] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:22 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1367 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:23.678763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9dce87e8-5c68-4b00-90f1-3f2eb1e0bb60 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:23.694185 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9dce87e8-5c68-4b00-90f1-3f2eb1e0bb60 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.684444 Oct 18 13:48:23.695279 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2781/5763] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:23 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:24.611866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-59858c6f-ac5b-4bd7-a3f7-78b3928b8121 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:24.612496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-59858c6f-ac5b-4bd7-a3f7-78b3928b8121 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:24.625626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59858c6f-ac5b-4bd7-a3f7-78b3928b8121 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:24.626139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59858c6f-ac5b-4bd7-a3f7-78b3928b8121 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:24.626583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59858c6f-ac5b-4bd7-a3f7-78b3928b8121 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:24.634802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59858c6f-ac5b-4bd7-a3f7-78b3928b8121 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:24.635524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59858c6f-ac5b-4bd7-a3f7-78b3928b8121 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:24.636132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59858c6f-ac5b-4bd7-a3f7-78b3928b8121 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:24.765730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8385b327-6987-4912-93a6-e14bd3e1c203 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:24.772412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8385b327-6987-4912-93a6-e14bd3e1c203 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:24.786416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8385b327-6987-4912-93a6-e14bd3e1c203 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:24.803110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8385b327-6987-4912-93a6-e14bd3e1c203 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:24.803694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8385b327-6987-4912-93a6-e14bd3e1c203 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:24.809557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8385b327-6987-4912-93a6-e14bd3e1c203 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:24.815733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8385b327-6987-4912-93a6-e14bd3e1c203 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:24.816279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8385b327-6987-4912-93a6-e14bd3e1c203 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:25.338904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8385b327-6987-4912-93a6-e14bd3e1c203 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:25.351057 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8385b327-6987-4912-93a6-e14bd3e1c203 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.607100 Oct 18 13:48:25.365206 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2782/5764] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:24 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:25.637597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-59858c6f-ac5b-4bd7-a3f7-78b3928b8121 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:25.655069 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-59858c6f-ac5b-4bd7-a3f7-78b3928b8121 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1367 microversion: 2.1 time: 1.040152 Oct 18 13:48:25.670679 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2983/5765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:24 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1367 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:26.414305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6ada9d56-cfea-4faa-b28f-61e21b43ecd4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:26.415855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6ada9d56-cfea-4faa-b28f-61e21b43ecd4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:26.427135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:26.446670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ada9d56-cfea-4faa-b28f-61e21b43ecd4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:26.447204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ada9d56-cfea-4faa-b28f-61e21b43ecd4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:26.449047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ada9d56-cfea-4faa-b28f-61e21b43ecd4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:26.454929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ada9d56-cfea-4faa-b28f-61e21b43ecd4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:26.461740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ada9d56-cfea-4faa-b28f-61e21b43ecd4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:26.462298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ada9d56-cfea-4faa-b28f-61e21b43ecd4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:26.683919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-532e0003-6a51-456c-8164-c3c9c61ead9e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:26.685004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-532e0003-6a51-456c-8164-c3c9c61ead9e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:26.722261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-532e0003-6a51-456c-8164-c3c9c61ead9e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:26.722785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-532e0003-6a51-456c-8164-c3c9c61ead9e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:26.723236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-532e0003-6a51-456c-8164-c3c9c61ead9e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:26.725741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-532e0003-6a51-456c-8164-c3c9c61ead9e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:26.726299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-532e0003-6a51-456c-8164-c3c9c61ead9e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:26.726762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-532e0003-6a51-456c-8164-c3c9c61ead9e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:26.751079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=94 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:26.956821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6ada9d56-cfea-4faa-b28f-61e21b43ecd4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:26.969568 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6ada9d56-cfea-4faa-b28f-61e21b43ecd4 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.575436 Oct 18 13:48:26.985867 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2783/5766] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:26 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:27.948673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-532e0003-6a51-456c-8164-c3c9c61ead9e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:27.972080 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-532e0003-6a51-456c-8164-c3c9c61ead9e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1367 microversion: 2.1 time: 1.293076 Oct 18 13:48:27.972705 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2984/5767] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:26 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1367 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:28.006190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a8eb58d8-564a-48d9-bea1-9d3f896cd20b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:28.006902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a8eb58d8-564a-48d9-bea1-9d3f896cd20b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:28.021415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8eb58d8-564a-48d9-bea1-9d3f896cd20b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:28.022258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8eb58d8-564a-48d9-bea1-9d3f896cd20b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:28.023229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8eb58d8-564a-48d9-bea1-9d3f896cd20b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:28.026163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8eb58d8-564a-48d9-bea1-9d3f896cd20b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:28.026851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8eb58d8-564a-48d9-bea1-9d3f896cd20b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:28.027482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8eb58d8-564a-48d9-bea1-9d3f896cd20b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:28.148100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:28.164948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-802af520-02fc-425c-a89a-663f88a0a0d4 req-c155e0c8-168b-485d-86a1-6e5f336dd047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5730123c-98f2-4753-9451-5bd415013688", "tag": "7d3d200d-0336-44fe-84b4-2ace88e86904"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:28.182248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=10 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:28.200332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-802af520-02fc-425c-a89a-663f88a0a0d4 req-c155e0c8-168b-485d-86a1-6e5f336dd047 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:28.200461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-802af520-02fc-425c-a89a-663f88a0a0d4 req-c155e0c8-168b-485d-86a1-6e5f336dd047 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:28.211754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-802af520-02fc-425c-a89a-663f88a0a0d4 req-c155e0c8-168b-485d-86a1-6e5f336dd047 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:28.243914 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-802af520-02fc-425c-a89a-663f88a0a0d4 req-c155e0c8-168b-485d-86a1-6e5f336dd047 service nova] Creating event network-changed:7d3d200d-0336-44fe-84b4-2ace88e86904 for instance 5730123c-98f2-4753-9451-5bd415013688 on n-h1-858384-13 Oct 18 13:48:28.258369 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-802af520-02fc-425c-a89a-663f88a0a0d4 req-c155e0c8-168b-485d-86a1-6e5f336dd047 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.451881 Oct 18 13:48:28.259017 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2784/5768] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:48:28.309126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-368b5de3-a13c-4913-82eb-79686b426c68 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:28.310814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-368b5de3-a13c-4913-82eb-79686b426c68 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:28.318284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-368b5de3-a13c-4913-82eb-79686b426c68 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:28.318872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-368b5de3-a13c-4913-82eb-79686b426c68 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:28.319310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-368b5de3-a13c-4913-82eb-79686b426c68 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:28.320059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-368b5de3-a13c-4913-82eb-79686b426c68 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:28.320515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-368b5de3-a13c-4913-82eb-79686b426c68 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:28.320941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-368b5de3-a13c-4913-82eb-79686b426c68 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:28.440708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-368b5de3-a13c-4913-82eb-79686b426c68 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lazy-loading 'services' on Instance uuid f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:48:28.467654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a8eb58d8-564a-48d9-bea1-9d3f896cd20b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:28.480816 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a8eb58d8-564a-48d9-bea1-9d3f896cd20b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.482739 Oct 18 13:48:28.481480 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2985/5769] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:27 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:28.580911 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-368b5de3-a13c-4913-82eb-79686b426c68 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb/os-volume_attachments/dd27ba06-2ec0-4497-a185-5c2c39dbbe55" status: 202 len: 0 microversion: 2.1 time: 0.270728 Oct 18 13:48:28.582026 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2785/5770] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:48:28 2022] DELETE /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb/os-volume_attachments/dd27ba06-2ec0-4497-a185-5c2c39dbbe55 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:48:28.995614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7d2c1613-a8ed-4c39-b07b-c60ddb83dfdc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:29.000378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7d2c1613-a8ed-4c39-b07b-c60ddb83dfdc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:29.003312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:29.010220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d2c1613-a8ed-4c39-b07b-c60ddb83dfdc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:29.010797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d2c1613-a8ed-4c39-b07b-c60ddb83dfdc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:29.011301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d2c1613-a8ed-4c39-b07b-c60ddb83dfdc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:29.012081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d2c1613-a8ed-4c39-b07b-c60ddb83dfdc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:29.013083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d2c1613-a8ed-4c39-b07b-c60ddb83dfdc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:29.013620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7d2c1613-a8ed-4c39-b07b-c60ddb83dfdc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:29.238153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7d2c1613-a8ed-4c39-b07b-c60ddb83dfdc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:29.251353 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7d2c1613-a8ed-4c39-b07b-c60ddb83dfdc tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1367 microversion: 2.1 time: 0.259413 Oct 18 13:48:29.251980 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2986/5771] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:28 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:29.509682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a325f480-9add-4481-8aae-d9539227a2db tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:29.510962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a325f480-9add-4481-8aae-d9539227a2db tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:29.518857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a325f480-9add-4481-8aae-d9539227a2db tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:29.519616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a325f480-9add-4481-8aae-d9539227a2db tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:29.520376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a325f480-9add-4481-8aae-d9539227a2db tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:29.521427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a325f480-9add-4481-8aae-d9539227a2db tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:29.522196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a325f480-9add-4481-8aae-d9539227a2db tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:29.522958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a325f480-9add-4481-8aae-d9539227a2db tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:29.854380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a325f480-9add-4481-8aae-d9539227a2db tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:29.872148 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a325f480-9add-4481-8aae-d9539227a2db tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.367281 Oct 18 13:48:29.874511 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2786/5772] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:29 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:30.278056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b193069e-7269-4098-9573-43be0fd209f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:30.278830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b193069e-7269-4098-9573-43be0fd209f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:30.299999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b193069e-7269-4098-9573-43be0fd209f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:30.300813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b193069e-7269-4098-9573-43be0fd209f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:30.301516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b193069e-7269-4098-9573-43be0fd209f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:30.302443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b193069e-7269-4098-9573-43be0fd209f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:30.303129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b193069e-7269-4098-9573-43be0fd209f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:30.303788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b193069e-7269-4098-9573-43be0fd209f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:30.558800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b193069e-7269-4098-9573-43be0fd209f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:30.570079 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b193069e-7269-4098-9573-43be0fd209f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1367 microversion: 2.1 time: 0.297585 Oct 18 13:48:30.570694 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2987/5773] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:30 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:30.904906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-09c115a5-d7ae-4808-92b4-1823a101882f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:30.906289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-09c115a5-d7ae-4808-92b4-1823a101882f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:30.914208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09c115a5-d7ae-4808-92b4-1823a101882f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:30.914695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09c115a5-d7ae-4808-92b4-1823a101882f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:30.915120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09c115a5-d7ae-4808-92b4-1823a101882f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:30.915999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09c115a5-d7ae-4808-92b4-1823a101882f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:30.916608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09c115a5-d7ae-4808-92b4-1823a101882f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:30.917285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09c115a5-d7ae-4808-92b4-1823a101882f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:31.468979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-09c115a5-d7ae-4808-92b4-1823a101882f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:31.477756 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-09c115a5-d7ae-4808-92b4-1823a101882f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.577005 Oct 18 13:48:31.493633 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2787/5774] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:30 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:31.596564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-10d3335d-600d-467a-9595-b396253ae4c0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:31.597693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-10d3335d-600d-467a-9595-b396253ae4c0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:31.600809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:31.609071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10d3335d-600d-467a-9595-b396253ae4c0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:31.610009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10d3335d-600d-467a-9595-b396253ae4c0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:31.610701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10d3335d-600d-467a-9595-b396253ae4c0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:31.611763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10d3335d-600d-467a-9595-b396253ae4c0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:31.612447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10d3335d-600d-467a-9595-b396253ae4c0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:31.613108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10d3335d-600d-467a-9595-b396253ae4c0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:32.079191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-10d3335d-600d-467a-9595-b396253ae4c0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:32.091515 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-10d3335d-600d-467a-9595-b396253ae4c0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1367 microversion: 2.1 time: 0.499289 Oct 18 13:48:32.092819 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2988/5775] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:31 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1367 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:32.511700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-54ac6104-676e-4a9e-93dc-19b018e1521c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:32.512374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-54ac6104-676e-4a9e-93dc-19b018e1521c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:32.523284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54ac6104-676e-4a9e-93dc-19b018e1521c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:32.523776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54ac6104-676e-4a9e-93dc-19b018e1521c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:32.524211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54ac6104-676e-4a9e-93dc-19b018e1521c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:32.524913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54ac6104-676e-4a9e-93dc-19b018e1521c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:32.525398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54ac6104-676e-4a9e-93dc-19b018e1521c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:32.525822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-54ac6104-676e-4a9e-93dc-19b018e1521c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:32.804118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-54ac6104-676e-4a9e-93dc-19b018e1521c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:32.816373 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-54ac6104-676e-4a9e-93dc-19b018e1521c tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.308900 Oct 18 13:48:32.818179 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2788/5776] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:32 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:33.119465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-492fce38-2090-4eff-8a05-c8898914ad34 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:33.124553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-492fce38-2090-4eff-8a05-c8898914ad34 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:33.142002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-492fce38-2090-4eff-8a05-c8898914ad34 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:33.142507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-492fce38-2090-4eff-8a05-c8898914ad34 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:33.142950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-492fce38-2090-4eff-8a05-c8898914ad34 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:33.143674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-492fce38-2090-4eff-8a05-c8898914ad34 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:33.144139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-492fce38-2090-4eff-8a05-c8898914ad34 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:33.144575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-492fce38-2090-4eff-8a05-c8898914ad34 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:33.843002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-67858edd-c8bb-4475-9a08-c491e47bd6fe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:33.843676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-67858edd-c8bb-4475-9a08-c491e47bd6fe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:33.856100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67858edd-c8bb-4475-9a08-c491e47bd6fe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:33.861555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67858edd-c8bb-4475-9a08-c491e47bd6fe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:33.862095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67858edd-c8bb-4475-9a08-c491e47bd6fe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:33.862932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67858edd-c8bb-4475-9a08-c491e47bd6fe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:33.863410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67858edd-c8bb-4475-9a08-c491e47bd6fe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:33.863841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67858edd-c8bb-4475-9a08-c491e47bd6fe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:34.180971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-492fce38-2090-4eff-8a05-c8898914ad34 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:34.193214 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-492fce38-2090-4eff-8a05-c8898914ad34 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1367 microversion: 2.1 time: 1.078782 Oct 18 13:48:34.196100 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2989/5777] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:33 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1367 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:34.473979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-67858edd-c8bb-4475-9a08-c491e47bd6fe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:34.482683 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-67858edd-c8bb-4475-9a08-c491e47bd6fe tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.643642 Oct 18 13:48:34.489799 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2789/5778] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:33 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:35.226773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e336cf0-5964-4370-836d-9c5aeae9fac7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:35.231551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7e336cf0-5964-4370-836d-9c5aeae9fac7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:35.254958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e336cf0-5964-4370-836d-9c5aeae9fac7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:35.255633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e336cf0-5964-4370-836d-9c5aeae9fac7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:35.256385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e336cf0-5964-4370-836d-9c5aeae9fac7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:35.257285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e336cf0-5964-4370-836d-9c5aeae9fac7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:35.260724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e336cf0-5964-4370-836d-9c5aeae9fac7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:35.261948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e336cf0-5964-4370-836d-9c5aeae9fac7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:35.522686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8711badd-acee-4463-ac77-6757ac05d6e2 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:35.523885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8711badd-acee-4463-ac77-6757ac05d6e2 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:35.531879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8711badd-acee-4463-ac77-6757ac05d6e2 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:35.533069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8711badd-acee-4463-ac77-6757ac05d6e2 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:35.533781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8711badd-acee-4463-ac77-6757ac05d6e2 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:35.534687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8711badd-acee-4463-ac77-6757ac05d6e2 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:35.535443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8711badd-acee-4463-ac77-6757ac05d6e2 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:35.536263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8711badd-acee-4463-ac77-6757ac05d6e2 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:35.541518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:35.832867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7e336cf0-5964-4370-836d-9c5aeae9fac7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:35.847549 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7e336cf0-5964-4370-836d-9c5aeae9fac7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1367 microversion: 2.1 time: 0.628932 Oct 18 13:48:35.863011 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2990/5779] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:35 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1367 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:36.110598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8711badd-acee-4463-ac77-6757ac05d6e2 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:36.131486 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8711badd-acee-4463-ac77-6757ac05d6e2 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.612903 Oct 18 13:48:36.135025 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2790/5780] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:35 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:36.150724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8e742464-8667-48cf-881b-a9b51e0d0b3f req-4236b93c-48ec-41b8-93a6-d783ba7714ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5730123c-98f2-4753-9451-5bd415013688", "name": "network-vif-plugged", "status": "completed", "tag": "7d3d200d-0336-44fe-84b4-2ace88e86904"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:36.160484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8e742464-8667-48cf-881b-a9b51e0d0b3f req-4236b93c-48ec-41b8-93a6-d783ba7714ee service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:36.161281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8e742464-8667-48cf-881b-a9b51e0d0b3f req-4236b93c-48ec-41b8-93a6-d783ba7714ee service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:36.161891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8e742464-8667-48cf-881b-a9b51e0d0b3f req-4236b93c-48ec-41b8-93a6-d783ba7714ee service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:36.174866 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8e742464-8667-48cf-881b-a9b51e0d0b3f req-4236b93c-48ec-41b8-93a6-d783ba7714ee service nova] Creating event network-vif-plugged:7d3d200d-0336-44fe-84b4-2ace88e86904 for instance 5730123c-98f2-4753-9451-5bd415013688 on n-h1-858384-13 Oct 18 13:48:36.183739 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8e742464-8667-48cf-881b-a9b51e0d0b3f req-4236b93c-48ec-41b8-93a6-d783ba7714ee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207876 Oct 18 13:48:36.184383 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2991/5781] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:48:36.426087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ddbd36ab-ec38-4416-acd3-3f507be12c29 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:36.426891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ddbd36ab-ec38-4416-acd3-3f507be12c29 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:36.441209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddbd36ab-ec38-4416-acd3-3f507be12c29 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:36.441829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddbd36ab-ec38-4416-acd3-3f507be12c29 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:36.442500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddbd36ab-ec38-4416-acd3-3f507be12c29 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:36.443278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddbd36ab-ec38-4416-acd3-3f507be12c29 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:36.443801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddbd36ab-ec38-4416-acd3-3f507be12c29 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:36.445818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddbd36ab-ec38-4416-acd3-3f507be12c29 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:36.479226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ddbd36ab-ec38-4416-acd3-3f507be12c29 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:48:36.597530 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ddbd36ab-ec38-4416-acd3-3f507be12c29 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 204 len: 0 microversion: 2.1 time: 0.174471 Oct 18 13:48:36.601894 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2791/5782] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:48:36 2022] DELETE /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:48:36.608592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-268e00ec-9b6e-44ff-af85-f7a3a9b23b67 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:36.610262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-268e00ec-9b6e-44ff-af85-f7a3a9b23b67 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:36.617419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-268e00ec-9b6e-44ff-af85-f7a3a9b23b67 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:36.618287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-268e00ec-9b6e-44ff-af85-f7a3a9b23b67 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:36.618936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-268e00ec-9b6e-44ff-af85-f7a3a9b23b67 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:36.619854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-268e00ec-9b6e-44ff-af85-f7a3a9b23b67 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:36.620768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-268e00ec-9b6e-44ff-af85-f7a3a9b23b67 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:36.621460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-268e00ec-9b6e-44ff-af85-f7a3a9b23b67 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:36.875694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d716d41b-88af-493f-b8ee-9105e145731c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:36.876427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d716d41b-88af-493f-b8ee-9105e145731c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:36.882679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d716d41b-88af-493f-b8ee-9105e145731c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:36.883437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d716d41b-88af-493f-b8ee-9105e145731c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:36.884052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d716d41b-88af-493f-b8ee-9105e145731c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:36.884942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d716d41b-88af-493f-b8ee-9105e145731c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:36.885624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d716d41b-88af-493f-b8ee-9105e145731c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:36.886249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d716d41b-88af-493f-b8ee-9105e145731c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:36.976617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-268e00ec-9b6e-44ff-af85-f7a3a9b23b67 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:36.998200 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-268e00ec-9b6e-44ff-af85-f7a3a9b23b67 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1469 microversion: 2.1 time: 0.394945 Oct 18 13:48:37.003536 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2992/5783] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:36 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1469 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:37.162966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1e768234-83e7-46f4-8a09-7a9c961bed3b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:37.162966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1e768234-83e7-46f4-8a09-7a9c961bed3b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:37.175312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e768234-83e7-46f4-8a09-7a9c961bed3b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:37.175905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e768234-83e7-46f4-8a09-7a9c961bed3b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:37.176486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e768234-83e7-46f4-8a09-7a9c961bed3b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:37.177325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e768234-83e7-46f4-8a09-7a9c961bed3b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:37.177858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e768234-83e7-46f4-8a09-7a9c961bed3b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:37.178425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1e768234-83e7-46f4-8a09-7a9c961bed3b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:37.210151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d716d41b-88af-493f-b8ee-9105e145731c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:37.225507 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d716d41b-88af-493f-b8ee-9105e145731c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1367 microversion: 2.1 time: 0.354209 Oct 18 13:48:37.226389 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2792/5784] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:36 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:37.539138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1e768234-83e7-46f4-8a09-7a9c961bed3b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:37.549746 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1e768234-83e7-46f4-8a09-7a9c961bed3b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1487 microversion: 2.1 time: 0.395077 Oct 18 13:48:37.550611 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2993/5785] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:37 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1487 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:37.574467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-99b91d85-fa20-4d86-8309-050dd8e701eb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:37.574994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-99b91d85-fa20-4d86-8309-050dd8e701eb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:37.582660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99b91d85-fa20-4d86-8309-050dd8e701eb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:37.583154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99b91d85-fa20-4d86-8309-050dd8e701eb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:37.583586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99b91d85-fa20-4d86-8309-050dd8e701eb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:37.584285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99b91d85-fa20-4d86-8309-050dd8e701eb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:37.584733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99b91d85-fa20-4d86-8309-050dd8e701eb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:37.585155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-99b91d85-fa20-4d86-8309-050dd8e701eb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:37.678284 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-99b91d85-fa20-4d86-8309-050dd8e701eb tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "POST /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713/action" status: 202 len: 0 microversion: 2.1 time: 0.107387 Oct 18 13:48:37.678940 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2793/5786] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:48:37 2022] POST /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:48:37.690847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d95eb6b-f5f7-44a1-a598-60a947d17796 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:37.691472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3d95eb6b-f5f7-44a1-a598-60a947d17796 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:37.703559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d95eb6b-f5f7-44a1-a598-60a947d17796 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:37.704098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d95eb6b-f5f7-44a1-a598-60a947d17796 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:37.704541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d95eb6b-f5f7-44a1-a598-60a947d17796 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:37.706137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d95eb6b-f5f7-44a1-a598-60a947d17796 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:37.706607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d95eb6b-f5f7-44a1-a598-60a947d17796 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:37.707067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d95eb6b-f5f7-44a1-a598-60a947d17796 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:38.034100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3d95eb6b-f5f7-44a1-a598-60a947d17796 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:38.039036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d79c5208-4c0c-4a76-8e05-a069f6c815a5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:38.042070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d79c5208-4c0c-4a76-8e05-a069f6c815a5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:38.052761 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3d95eb6b-f5f7-44a1-a598-60a947d17796 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1495 microversion: 2.1 time: 0.368717 Oct 18 13:48:38.055246 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2994/5787] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:37 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1495 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:38.057756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d79c5208-4c0c-4a76-8e05-a069f6c815a5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:38.058407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d79c5208-4c0c-4a76-8e05-a069f6c815a5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:38.059202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d79c5208-4c0c-4a76-8e05-a069f6c815a5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:38.060511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d79c5208-4c0c-4a76-8e05-a069f6c815a5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:38.062355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d79c5208-4c0c-4a76-8e05-a069f6c815a5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:38.073415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d79c5208-4c0c-4a76-8e05-a069f6c815a5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:38.253133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c492c2f2-4ac6-44aa-be69-001cad54c4e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:38.253779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c492c2f2-4ac6-44aa-be69-001cad54c4e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:38.274452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c492c2f2-4ac6-44aa-be69-001cad54c4e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:38.275458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c492c2f2-4ac6-44aa-be69-001cad54c4e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:38.275911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c492c2f2-4ac6-44aa-be69-001cad54c4e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:38.276791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c492c2f2-4ac6-44aa-be69-001cad54c4e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:38.277272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c492c2f2-4ac6-44aa-be69-001cad54c4e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:38.277702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c492c2f2-4ac6-44aa-be69-001cad54c4e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:38.662683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c492c2f2-4ac6-44aa-be69-001cad54c4e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:38.674262 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c492c2f2-4ac6-44aa-be69-001cad54c4e3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1556 microversion: 2.1 time: 0.424906 Oct 18 13:48:38.674863 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2995/5788] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:38 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1556 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:38.690688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d79c5208-4c0c-4a76-8e05-a069f6c815a5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:38.698085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d2e6e2ac-daaf-402e-9b18-da05f47420a9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:38.698585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d2e6e2ac-daaf-402e-9b18-da05f47420a9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:38.712726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2e6e2ac-daaf-402e-9b18-da05f47420a9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:38.713258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2e6e2ac-daaf-402e-9b18-da05f47420a9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:38.713710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2e6e2ac-daaf-402e-9b18-da05f47420a9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:38.714426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2e6e2ac-daaf-402e-9b18-da05f47420a9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:38.721366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2e6e2ac-daaf-402e-9b18-da05f47420a9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:38.721846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2e6e2ac-daaf-402e-9b18-da05f47420a9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:38.725825 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d79c5208-4c0c-4a76-8e05-a069f6c815a5 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1469 microversion: 2.1 time: 0.705394 Oct 18 13:48:38.740287 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2794/5789] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:38 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1469 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:38.834208 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d2e6e2ac-daaf-402e-9b18-da05f47420a9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132580 Oct 18 13:48:38.835871 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2996/5790] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:48:38 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:48:39.084066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f946e969-d9c6-474c-8a19-b33e3715bb18 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:39.084686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f946e969-d9c6-474c-8a19-b33e3715bb18 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:39.091288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f946e969-d9c6-474c-8a19-b33e3715bb18 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:39.092054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f946e969-d9c6-474c-8a19-b33e3715bb18 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:39.093560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f946e969-d9c6-474c-8a19-b33e3715bb18 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:39.094491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f946e969-d9c6-474c-8a19-b33e3715bb18 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:39.095128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f946e969-d9c6-474c-8a19-b33e3715bb18 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:39.095718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f946e969-d9c6-474c-8a19-b33e3715bb18 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:39.265887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-33caeffb-ddc4-4a80-bf62-330481e3b690 req-41e9280b-5b00-47b5-ba1b-b3009208a7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb", "name": "network-vif-deleted", "tag": "b8b587a2-280d-40a7-b142-ce5b26994211"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:39.290145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-33caeffb-ddc4-4a80-bf62-330481e3b690 req-41e9280b-5b00-47b5-ba1b-b3009208a7a2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:39.293360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-33caeffb-ddc4-4a80-bf62-330481e3b690 req-41e9280b-5b00-47b5-ba1b-b3009208a7a2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:39.293873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-33caeffb-ddc4-4a80-bf62-330481e3b690 req-41e9280b-5b00-47b5-ba1b-b3009208a7a2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:39.318713 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-33caeffb-ddc4-4a80-bf62-330481e3b690 req-41e9280b-5b00-47b5-ba1b-b3009208a7a2 service nova] Creating event network-vif-deleted:b8b587a2-280d-40a7-b142-ce5b26994211 for instance f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb on n-h2-858384-13 Oct 18 13:48:39.328922 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-33caeffb-ddc4-4a80-bf62-330481e3b690 req-41e9280b-5b00-47b5-ba1b-b3009208a7a2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072494 Oct 18 13:48:39.330173 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2997/5791] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:48:39.377211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f946e969-d9c6-474c-8a19-b33e3715bb18 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:39.388777 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f946e969-d9c6-474c-8a19-b33e3715bb18 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1495 microversion: 2.1 time: 0.308395 Oct 18 13:48:39.403631 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2795/5792] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:39 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1495 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:39.757339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:39.765267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:39.775121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:39.775903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:39.776896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:39.777856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:39.778547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:39.779567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:39.820137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:39.820923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:39.821562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:39.823441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lazy-loading 'fault' on Instance uuid f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:48:39.969780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c916447d9e4a3cac14b14143455689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85efe02f52ab4c3d8703ce6eb9aef38a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:39.984814 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fa1bb3a7-b6c9-4674-bbea-5db1d648cb5b tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 200 len: 1304 microversion: 2.1 time: 0.235805 Oct 18 13:48:39.984953 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2998/5793] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:39 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 1304 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:40.415291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-90b2039a-4d39-412a-82c3-fde71a16fb8e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:40.416075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-90b2039a-4d39-412a-82c3-fde71a16fb8e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:40.428880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b2039a-4d39-412a-82c3-fde71a16fb8e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:40.430803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b2039a-4d39-412a-82c3-fde71a16fb8e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:40.431530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b2039a-4d39-412a-82c3-fde71a16fb8e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:40.433003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b2039a-4d39-412a-82c3-fde71a16fb8e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:40.433749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b2039a-4d39-412a-82c3-fde71a16fb8e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:40.435775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b2039a-4d39-412a-82c3-fde71a16fb8e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:40.776981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-90b2039a-4d39-412a-82c3-fde71a16fb8e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:40.791785 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-90b2039a-4d39-412a-82c3-fde71a16fb8e tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1495 microversion: 2.1 time: 0.379822 Oct 18 13:48:40.792894 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2796/5794] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:40 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1495 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:41.009264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-56abaa80-410a-4a4f-bf22-4cd20fd8e545 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:41.011067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-56abaa80-410a-4a4f-bf22-4cd20fd8e545 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] [instance: f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:41.025528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56abaa80-410a-4a4f-bf22-4cd20fd8e545 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:41.026732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56abaa80-410a-4a4f-bf22-4cd20fd8e545 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:41.028376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56abaa80-410a-4a4f-bf22-4cd20fd8e545 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:41.030047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56abaa80-410a-4a4f-bf22-4cd20fd8e545 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:41.031027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56abaa80-410a-4a4f-bf22-4cd20fd8e545 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:41.031677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56abaa80-410a-4a4f-bf22-4cd20fd8e545 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:41.059650 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-56abaa80-410a-4a4f-bf22-4cd20fd8e545 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] HTTP exception thrown: Instance f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb could not be found. Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-56abaa80-410a-4a4f-bf22-4cd20fd8e545 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Request method failure captured: Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb HTTP/1.1 Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq4zov6c9sULlC-NAUFeUasw8431DReLpeT-HqmIhU_ycr6ZVn63FIJ70zN8ASi9ZzfTJWx2qWXipwkey3wUc2-pl2pYD_68jGYmMO-IKsfO665zPiHL5juVYC4l2Nc-pDV7KTusBsXgXE4OyMGBbAhIc1MyFa1_i5aXmwTGyUsIa9I Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 85efe02f52ab4c3d8703ce6eb9aef38a Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-VolumesBackupsTest-623774887 Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/85efe02f52ab4c3d8703ce6eb9aef38a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/85efe02f52ab4c3d8703ce6eb9aef38a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/85efe02f52ab4c3d8703ce6eb9aef38a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_85efe02f52ab4c3d8703ce6eb9aef38a"}]}] Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-VolumesBackupsTest-623774887 Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 85efe02f52ab4c3d8703ce6eb9aef38a Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-VolumesBackupsTest-623774887 Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-VolumesBackupsTest-623774887-project Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 48c916447d9e4a3cac14b14143455689 Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-VolumesBackupsTest-623774887-project Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb could not be found. Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb'} Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb could not be found. Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb could not be found. Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:41.063025 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:48:41.068148 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:41.068148 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:41.068148 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:41.068148 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:48:41.068148 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:48:41.068148 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb could not be found. Oct 18 13:48:41.068148 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:48:41.070672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-56abaa80-410a-4a4f-bf22-4cd20fd8e545 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] Returning 404 to user: Instance f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:48:41.071780 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-56abaa80-410a-4a4f-bf22-4cd20fd8e545 tempest-VolumesBackupsTest-623774887 tempest-VolumesBackupsTest-623774887-project] 10.222.0.40 "GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb" status: 404 len: 111 microversion: 2.1 time: 0.068156 Oct 18 13:48:41.073016 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 2999/5795] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:41 2022] GET /compute/v2.1/servers/f7fb589b-04d0-4c7e-b08c-fcf9f351bbeb => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:48:41.138035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-faf164bd-365d-4936-807d-47d468cfe404 req-e8c7452e-ba2c-4ae3-a913-6e70ff51ed18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5730123c-98f2-4753-9451-5bd415013688", "tag": "7d3d200d-0336-44fe-84b4-2ace88e86904"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:41.162091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-faf164bd-365d-4936-807d-47d468cfe404 req-e8c7452e-ba2c-4ae3-a913-6e70ff51ed18 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:41.162950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-faf164bd-365d-4936-807d-47d468cfe404 req-e8c7452e-ba2c-4ae3-a913-6e70ff51ed18 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:41.163630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-faf164bd-365d-4936-807d-47d468cfe404 req-e8c7452e-ba2c-4ae3-a913-6e70ff51ed18 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:41.266797 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-faf164bd-365d-4936-807d-47d468cfe404 req-e8c7452e-ba2c-4ae3-a913-6e70ff51ed18 service nova] Creating event network-changed:7d3d200d-0336-44fe-84b4-2ace88e86904 for instance 5730123c-98f2-4753-9451-5bd415013688 on n-h1-858384-13 Oct 18 13:48:41.305435 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-faf164bd-365d-4936-807d-47d468cfe404 req-e8c7452e-ba2c-4ae3-a913-6e70ff51ed18 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172232 Oct 18 13:48:41.309552 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2797/5796] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:41.816065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f949c196-9087-4e4f-a36f-5056cdf18672 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:41.816686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f949c196-9087-4e4f-a36f-5056cdf18672 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:41.829814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f949c196-9087-4e4f-a36f-5056cdf18672 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:41.830317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f949c196-9087-4e4f-a36f-5056cdf18672 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:41.830754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f949c196-9087-4e4f-a36f-5056cdf18672 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:41.831677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f949c196-9087-4e4f-a36f-5056cdf18672 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:41.832312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f949c196-9087-4e4f-a36f-5056cdf18672 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:41.832955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f949c196-9087-4e4f-a36f-5056cdf18672 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:42.238508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f949c196-9087-4e4f-a36f-5056cdf18672 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:42.249270 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f949c196-9087-4e4f-a36f-5056cdf18672 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1495 microversion: 2.1 time: 0.436382 Oct 18 13:48:42.250385 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3000/5797] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:41 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1495 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:43.278601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-36095589-771f-4583-aaf4-e245e0d1cb63 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:43.281420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-36095589-771f-4583-aaf4-e245e0d1cb63 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:43.293280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36095589-771f-4583-aaf4-e245e0d1cb63 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:43.293786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36095589-771f-4583-aaf4-e245e0d1cb63 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:43.295095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36095589-771f-4583-aaf4-e245e0d1cb63 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:43.297173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36095589-771f-4583-aaf4-e245e0d1cb63 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:43.299336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36095589-771f-4583-aaf4-e245e0d1cb63 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:43.299946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36095589-771f-4583-aaf4-e245e0d1cb63 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:43.562890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36095589-771f-4583-aaf4-e245e0d1cb63 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:43.572430 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-36095589-771f-4583-aaf4-e245e0d1cb63 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1501 microversion: 2.1 time: 0.302005 Oct 18 13:48:43.572994 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2798/5798] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:43 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1501 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:43.620321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3a725b52-c259-4e50-863a-185911ff16fa tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:43.621624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3a725b52-c259-4e50-863a-185911ff16fa tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:43.630170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a725b52-c259-4e50-863a-185911ff16fa tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:43.630875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a725b52-c259-4e50-863a-185911ff16fa tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:43.631656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a725b52-c259-4e50-863a-185911ff16fa tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:43.632537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a725b52-c259-4e50-863a-185911ff16fa tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:43.633156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a725b52-c259-4e50-863a-185911ff16fa tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:43.633764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a725b52-c259-4e50-863a-185911ff16fa tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:43.689194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3a725b52-c259-4e50-863a-185911ff16fa tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:48:43.758536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:48:43.851598 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3a725b52-c259-4e50-863a-185911ff16fa tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 204 len: 0 microversion: 2.1 time: 0.236398 Oct 18 13:48:43.852665 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3001/5799] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:48:43 2022] DELETE /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:48:43.862291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1bbd2907-d41c-466e-8019-0152ef8bfaad tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:43.863312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1bbd2907-d41c-466e-8019-0152ef8bfaad tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:43.891556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1bbd2907-d41c-466e-8019-0152ef8bfaad tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:43.892158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1bbd2907-d41c-466e-8019-0152ef8bfaad tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:43.892617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1bbd2907-d41c-466e-8019-0152ef8bfaad tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:43.894191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1bbd2907-d41c-466e-8019-0152ef8bfaad tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:43.894670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1bbd2907-d41c-466e-8019-0152ef8bfaad tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:43.895551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1bbd2907-d41c-466e-8019-0152ef8bfaad tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:44.131461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1bbd2907-d41c-466e-8019-0152ef8bfaad tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:44.142064 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1bbd2907-d41c-466e-8019-0152ef8bfaad tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.284992 Oct 18 13:48:44.142653 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2799/5800] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:43 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:45.178068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3e4c144f-448b-4a45-bbde-10a74d931b43 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:45.178950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3e4c144f-448b-4a45-bbde-10a74d931b43 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:45.200524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e4c144f-448b-4a45-bbde-10a74d931b43 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:45.201218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e4c144f-448b-4a45-bbde-10a74d931b43 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:45.206614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e4c144f-448b-4a45-bbde-10a74d931b43 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:45.208439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e4c144f-448b-4a45-bbde-10a74d931b43 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:45.210471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e4c144f-448b-4a45-bbde-10a74d931b43 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:45.224081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e4c144f-448b-4a45-bbde-10a74d931b43 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:45.466719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3e4c144f-448b-4a45-bbde-10a74d931b43 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:45.477731 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3e4c144f-448b-4a45-bbde-10a74d931b43 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.312219 Oct 18 13:48:45.482257 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3002/5801] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:45 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:46.512188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1cef8d77-e57b-4f1a-a137-5a14b3c90ed3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:46.512953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1cef8d77-e57b-4f1a-a137-5a14b3c90ed3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:46.539153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cef8d77-e57b-4f1a-a137-5a14b3c90ed3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:46.540021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cef8d77-e57b-4f1a-a137-5a14b3c90ed3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:46.540626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cef8d77-e57b-4f1a-a137-5a14b3c90ed3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:46.541559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cef8d77-e57b-4f1a-a137-5a14b3c90ed3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:46.543654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cef8d77-e57b-4f1a-a137-5a14b3c90ed3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:46.544334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1cef8d77-e57b-4f1a-a137-5a14b3c90ed3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:47.151762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1cef8d77-e57b-4f1a-a137-5a14b3c90ed3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:47.174235 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1cef8d77-e57b-4f1a-a137-5a14b3c90ed3 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 0.666585 Oct 18 13:48:47.186969 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2800/5802] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:46 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:48.203579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-060e72c7-9556-4d1f-8ab6-adcbe2b43c4a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:48.204353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-060e72c7-9556-4d1f-8ab6-adcbe2b43c4a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:48.222405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-060e72c7-9556-4d1f-8ab6-adcbe2b43c4a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:48.224086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-060e72c7-9556-4d1f-8ab6-adcbe2b43c4a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:48.225885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-060e72c7-9556-4d1f-8ab6-adcbe2b43c4a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:48.227563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-060e72c7-9556-4d1f-8ab6-adcbe2b43c4a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:48.228197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-060e72c7-9556-4d1f-8ab6-adcbe2b43c4a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:48.230689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-060e72c7-9556-4d1f-8ab6-adcbe2b43c4a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:49.532760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-060e72c7-9556-4d1f-8ab6-adcbe2b43c4a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:49.547566 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-060e72c7-9556-4d1f-8ab6-adcbe2b43c4a tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1507 microversion: 2.1 time: 1.349976 Oct 18 13:48:49.549876 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3003/5803] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:48 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1507 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:49.848335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-4387f23d-67f1-4029-b9a4-25bd6456e002 req-eeeca51f-3282-4a74-a422-57af434bd187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f55222-3d85-4193-96c2-d523abf1b713", "name": "network-vif-deleted", "tag": "4fb17d86-f56c-432e-9e71-b9586073ec1b"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:49.862373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4387f23d-67f1-4029-b9a4-25bd6456e002 req-eeeca51f-3282-4a74-a422-57af434bd187 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:49.864769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4387f23d-67f1-4029-b9a4-25bd6456e002 req-eeeca51f-3282-4a74-a422-57af434bd187 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:49.865233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4387f23d-67f1-4029-b9a4-25bd6456e002 req-eeeca51f-3282-4a74-a422-57af434bd187 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:49.917221 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4387f23d-67f1-4029-b9a4-25bd6456e002 req-eeeca51f-3282-4a74-a422-57af434bd187 service nova] Creating event network-vif-deleted:4fb17d86-f56c-432e-9e71-b9586073ec1b for instance b9f55222-3d85-4193-96c2-d523abf1b713 on n-h1-858384-13 Oct 18 13:48:49.927495 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-4387f23d-67f1-4029-b9a4-25bd6456e002 req-eeeca51f-3282-4a74-a422-57af434bd187 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083014 Oct 18 13:48:49.931673 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2801/5804] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:50.572376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:50.573821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:50.586986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:50.600654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:50.602201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:50.604345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:50.604823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:50.613397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:50.679403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:50.679889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:50.686766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:50.687470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lazy-loading 'fault' on Instance uuid b9f55222-3d85-4193-96c2-d523abf1b713 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:48:50.837535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:50.845988 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fb40db1b-ba84-4b75-83d5-54572664144f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 200 len: 1304 microversion: 2.1 time: 0.277709 Oct 18 13:48:50.846668 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3004/5805] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:50 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 1304 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:51.875101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d8452ea3-b4ae-41db-9b5f-9b9d4f17b57f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:51.876398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d8452ea3-b4ae-41db-9b5f-9b9d4f17b57f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: b9f55222-3d85-4193-96c2-d523abf1b713] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:51.890273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8452ea3-b4ae-41db-9b5f-9b9d4f17b57f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:51.892733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8452ea3-b4ae-41db-9b5f-9b9d4f17b57f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:51.893381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8452ea3-b4ae-41db-9b5f-9b9d4f17b57f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:51.895194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8452ea3-b4ae-41db-9b5f-9b9d4f17b57f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:51.900832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8452ea3-b4ae-41db-9b5f-9b9d4f17b57f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:51.901369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8452ea3-b4ae-41db-9b5f-9b9d4f17b57f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:51.957499 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-d8452ea3-b4ae-41db-9b5f-9b9d4f17b57f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] HTTP exception thrown: Instance b9f55222-3d85-4193-96c2-d523abf1b713 could not be found. Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d8452ea3-b4ae-41db-9b5f-9b9d4f17b57f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Request method failure captured: Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 HTTP/1.1 Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq5HuOBeQlj5oehUEXny3m5ASE54zxWkEPgejMsVxYTMYkrlHg55qtZ3e501sAgLRDhjN3m_wLaJUvDLgw8X51I8w9TsbmaAFp3GTnabhLElmfezGQX-oJbWwFAZv9JlDewPcEzq9VmMijhhJ5mfZ--Bm4kakFxJ8bOwRPT6b1vAA48 Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 6fe7cd2619ed479b92db50d810bbe7e1 Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerRescueTestJSON-1813234130 Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fe7cd2619ed479b92db50d810bbe7e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6fe7cd2619ed479b92db50d810bbe7e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fe7cd2619ed479b92db50d810bbe7e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6fe7cd2619ed479b92db50d810bbe7e1"}]}] Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerRescueTestJSON-1813234130 Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 6fe7cd2619ed479b92db50d810bbe7e1 Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerRescueTestJSON-1813234130 Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerRescueTestJSON-1813234130-project Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 84a7c8fc8b2146eca34ce17ff4ea3015 Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerRescueTestJSON-1813234130-project Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance b9f55222-3d85-4193-96c2-d523abf1b713 could not be found. Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'b9f55222-3d85-4193-96c2-d523abf1b713'} Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9f55222-3d85-4193-96c2-d523abf1b713 could not be found. Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9f55222-3d85-4193-96c2-d523abf1b713 could not be found. Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:51.959436 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:51.964156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:51.964156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:51.964156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:51.964156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:48:51.964156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:48:51.964156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9f55222-3d85-4193-96c2-d523abf1b713 could not be found. Oct 18 13:48:51.964156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:51.964156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d8452ea3-b4ae-41db-9b5f-9b9d4f17b57f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Returning 404 to user: Instance b9f55222-3d85-4193-96c2-d523abf1b713 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:48:51.967828 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d8452ea3-b4ae-41db-9b5f-9b9d4f17b57f tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713" status: 404 len: 111 microversion: 2.1 time: 0.096507 Oct 18 13:48:51.968428 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2802/5806] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:51 2022] GET /compute/v2.1/servers/b9f55222-3d85-4193-96c2-d523abf1b713 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:48:51.976856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b3133f0a-0f93-4e40-8a33-6d95fa8965b0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:51.977407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b3133f0a-0f93-4e40-8a33-6d95fa8965b0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:51.995464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3133f0a-0f93-4e40-8a33-6d95fa8965b0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:51.996019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3133f0a-0f93-4e40-8a33-6d95fa8965b0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:51.996474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3133f0a-0f93-4e40-8a33-6d95fa8965b0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:51.999574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3133f0a-0f93-4e40-8a33-6d95fa8965b0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:52.000351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3133f0a-0f93-4e40-8a33-6d95fa8965b0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:52.000937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3133f0a-0f93-4e40-8a33-6d95fa8965b0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:52.057063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b3133f0a-0f93-4e40-8a33-6d95fa8965b0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:48:52.177109 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b3133f0a-0f93-4e40-8a33-6d95fa8965b0 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 204 len: 0 microversion: 2.1 time: 0.203907 Oct 18 13:48:52.180772 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3005/5807] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:48:51 2022] DELETE /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:48:52.189971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-77fab42c-53d0-4109-8de5-fee87ebece78 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:52.190733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-77fab42c-53d0-4109-8de5-fee87ebece78 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:52.198569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77fab42c-53d0-4109-8de5-fee87ebece78 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:52.200461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77fab42c-53d0-4109-8de5-fee87ebece78 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:52.201057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77fab42c-53d0-4109-8de5-fee87ebece78 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:52.202473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77fab42c-53d0-4109-8de5-fee87ebece78 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:52.203312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77fab42c-53d0-4109-8de5-fee87ebece78 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:52.203827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-77fab42c-53d0-4109-8de5-fee87ebece78 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:52.485258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-77fab42c-53d0-4109-8de5-fee87ebece78 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:52.495316 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-77fab42c-53d0-4109-8de5-fee87ebece78 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1492 microversion: 2.1 time: 0.309884 Oct 18 13:48:52.495912 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2803/5808] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:52 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1492 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:48:53.522990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1ec5f1fa-e98d-421a-82a4-13b6fa95ff4b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:53.524791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1ec5f1fa-e98d-421a-82a4-13b6fa95ff4b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:53.546558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ec5f1fa-e98d-421a-82a4-13b6fa95ff4b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:53.547291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ec5f1fa-e98d-421a-82a4-13b6fa95ff4b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:53.548092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ec5f1fa-e98d-421a-82a4-13b6fa95ff4b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:53.548586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ec5f1fa-e98d-421a-82a4-13b6fa95ff4b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:53.549533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ec5f1fa-e98d-421a-82a4-13b6fa95ff4b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:53.550975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ec5f1fa-e98d-421a-82a4-13b6fa95ff4b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:53.870759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1ec5f1fa-e98d-421a-82a4-13b6fa95ff4b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:53.883718 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1ec5f1fa-e98d-421a-82a4-13b6fa95ff4b tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1492 microversion: 2.1 time: 0.365382 Oct 18 13:48:53.884719 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3006/5809] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:53 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1492 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:54.912141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9678c375-23ed-4939-a998-d92509b1a636 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:54.912986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9678c375-23ed-4939-a998-d92509b1a636 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:54.922263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9678c375-23ed-4939-a998-d92509b1a636 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:54.922749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9678c375-23ed-4939-a998-d92509b1a636 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:54.924166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9678c375-23ed-4939-a998-d92509b1a636 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:54.924923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9678c375-23ed-4939-a998-d92509b1a636 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:54.926099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9678c375-23ed-4939-a998-d92509b1a636 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:54.926768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9678c375-23ed-4939-a998-d92509b1a636 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:55.256556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9678c375-23ed-4939-a998-d92509b1a636 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a7c8fc8b2146eca34ce17ff4ea3015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe7cd2619ed479b92db50d810bbe7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:48:55.273788 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9678c375-23ed-4939-a998-d92509b1a636 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 200 len: 1492 microversion: 2.1 time: 0.365311 Oct 18 13:48:55.274792 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2804/5810] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:54 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 1492 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:48:55.337363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-49b7f9ff-4e37-4a88-9523-969f43ec4f2c req-ba2971e0-d508-4d8b-92fa-1362a3790233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1153b9b7-ba42-423a-8194-716869043254", "name": "network-vif-deleted", "tag": "6c11202b-17f6-4e7c-ae70-edbb3e8ecbee"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:48:55.370693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-49b7f9ff-4e37-4a88-9523-969f43ec4f2c req-ba2971e0-d508-4d8b-92fa-1362a3790233 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:55.375705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-49b7f9ff-4e37-4a88-9523-969f43ec4f2c req-ba2971e0-d508-4d8b-92fa-1362a3790233 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:55.377445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-49b7f9ff-4e37-4a88-9523-969f43ec4f2c req-ba2971e0-d508-4d8b-92fa-1362a3790233 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:55.435797 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-49b7f9ff-4e37-4a88-9523-969f43ec4f2c req-ba2971e0-d508-4d8b-92fa-1362a3790233 service nova] Creating event network-vif-deleted:6c11202b-17f6-4e7c-ae70-edbb3e8ecbee for instance 1153b9b7-ba42-423a-8194-716869043254 on n-h2-858384-13 Oct 18 13:48:55.445809 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-49b7f9ff-4e37-4a88-9523-969f43ec4f2c req-ba2971e0-d508-4d8b-92fa-1362a3790233 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111491 Oct 18 13:48:55.449433 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3007/5811] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:48:56.299938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e43c5ea6-6646-4dfc-98e9-0dcd33606969 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:48:56.300545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e43c5ea6-6646-4dfc-98e9-0dcd33606969 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] [instance: 1153b9b7-ba42-423a-8194-716869043254] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:48:56.320517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e43c5ea6-6646-4dfc-98e9-0dcd33606969 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:56.321007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e43c5ea6-6646-4dfc-98e9-0dcd33606969 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:56.321471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e43c5ea6-6646-4dfc-98e9-0dcd33606969 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:56.322171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e43c5ea6-6646-4dfc-98e9-0dcd33606969 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:48:56.330626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e43c5ea6-6646-4dfc-98e9-0dcd33606969 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:48:56.331915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e43c5ea6-6646-4dfc-98e9-0dcd33606969 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:48:56.375681 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e43c5ea6-6646-4dfc-98e9-0dcd33606969 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] HTTP exception thrown: Instance 1153b9b7-ba42-423a-8194-716869043254 could not be found. Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e43c5ea6-6646-4dfc-98e9-0dcd33606969 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Request method failure captured: Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 HTTP/1.1 Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq5HuOBeQlj5oehUEXny3m5ASE54zxWkEPgejMsVxYTMYkrlHg55qtZ3e501sAgLRDhjN3m_wLaJUvDLgw8X51I8w9TsbmaAFp3GTnabhLElmfezGQX-oJbWwFAZv9JlDewPcEzq9VmMijhhJ5mfZ--Bm4kakFxJ8bOwRPT6b1vAA48 Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 6fe7cd2619ed479b92db50d810bbe7e1 Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerRescueTestJSON-1813234130 Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fe7cd2619ed479b92db50d810bbe7e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6fe7cd2619ed479b92db50d810bbe7e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6fe7cd2619ed479b92db50d810bbe7e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6fe7cd2619ed479b92db50d810bbe7e1"}]}] Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerRescueTestJSON-1813234130 Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 6fe7cd2619ed479b92db50d810bbe7e1 Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerRescueTestJSON-1813234130 Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerRescueTestJSON-1813234130-project Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 84a7c8fc8b2146eca34ce17ff4ea3015 Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerRescueTestJSON-1813234130-project Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 1153b9b7-ba42-423a-8194-716869043254 could not be found. Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '1153b9b7-ba42-423a-8194-716869043254'} Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1153b9b7-ba42-423a-8194-716869043254 could not be found. Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1153b9b7-ba42-423a-8194-716869043254 could not be found. Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:48:56.377380 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:56.381442 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:48:56.381442 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:48:56.381442 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:48:56.381442 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:48:56.381442 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:48:56.381442 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1153b9b7-ba42-423a-8194-716869043254 could not be found. Oct 18 13:48:56.381442 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:48:56.381442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e43c5ea6-6646-4dfc-98e9-0dcd33606969 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] Returning 404 to user: Instance 1153b9b7-ba42-423a-8194-716869043254 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:48:56.381442 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e43c5ea6-6646-4dfc-98e9-0dcd33606969 tempest-ServerRescueTestJSON-1813234130 tempest-ServerRescueTestJSON-1813234130-project] 10.222.0.40 "GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254" status: 404 len: 111 microversion: 2.1 time: 0.083982 Oct 18 13:48:56.390727 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2805/5812] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:48:56 2022] GET /compute/v2.1/servers/1153b9b7-ba42-423a-8194-716869043254 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:49:44.504993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:44.505768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:44.507391 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 18 13:49:45.147023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cbcd0a85-2d6a-4e86-bfa2-e8c8498da752 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:49:45.147886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cbcd0a85-2d6a-4e86-bfa2-e8c8498da752 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:45.165498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbcd0a85-2d6a-4e86-bfa2-e8c8498da752 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:45.165911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbcd0a85-2d6a-4e86-bfa2-e8c8498da752 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:45.166367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbcd0a85-2d6a-4e86-bfa2-e8c8498da752 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:45.167074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbcd0a85-2d6a-4e86-bfa2-e8c8498da752 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:45.167540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbcd0a85-2d6a-4e86-bfa2-e8c8498da752 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:45.168572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbcd0a85-2d6a-4e86-bfa2-e8c8498da752 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:45.239597 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cbcd0a85-2d6a-4e86-bfa2-e8c8498da752 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/ips" status: 200 len: 149 microversion: 2.1 time: 0.741121 Oct 18 13:49:45.240179 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3008/5813] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:49:44 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/ips => generated 149 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:49:48.096311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-44066ce9-0949-43e3-b8f2-1a34451cde08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06682491-2882-46c5-b1a8-b1f9a89600d5"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:49:48.100877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-44066ce9-0949-43e3-b8f2-1a34451cde08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:49:48.125582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:48.128234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:49:48.133806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44066ce9-0949-43e3-b8f2-1a34451cde08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:48.135764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44066ce9-0949-43e3-b8f2-1a34451cde08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:48.139048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44066ce9-0949-43e3-b8f2-1a34451cde08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:48.140004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44066ce9-0949-43e3-b8f2-1a34451cde08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:49:48.140681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44066ce9-0949-43e3-b8f2-1a34451cde08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:49:48.141302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-44066ce9-0949-43e3-b8f2-1a34451cde08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:49:48.605496 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-44066ce9-0949-43e3-b8f2-1a34451cde08 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "POST /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515326 Oct 18 13:49:48.606814 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2806/5814] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:49:48 2022] POST /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:05.431876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-67ea3019-d101-4956-8603-e15cf20aafca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06682491-2882-46c5-b1a8-b1f9a89600d5"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:05.435943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-67ea3019-d101-4956-8603-e15cf20aafca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:05.442384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:05.443247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:05.446137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67ea3019-d101-4956-8603-e15cf20aafca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:05.446991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67ea3019-d101-4956-8603-e15cf20aafca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:05.447639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67ea3019-d101-4956-8603-e15cf20aafca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:05.448966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67ea3019-d101-4956-8603-e15cf20aafca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:05.449684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67ea3019-d101-4956-8603-e15cf20aafca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:05.450316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67ea3019-d101-4956-8603-e15cf20aafca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:05.690353 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-67ea3019-d101-4956-8603-e15cf20aafca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Invalid volume: volume 06682491-2882-46c5-b1a8-b1f9a89600d5 is already attached to instances: 5730123c-98f2-4753-9451-5bd415013688 Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-67ea3019-d101-4956-8603-e15cf20aafca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments HTTP/1.1 Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 74 Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: {"volumeAttachment": {"volumeId": "06682491-2882-46c5-b1a8-b1f9a89600d5"}} Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: exception: Invalid volume: volume 06682491-2882-46c5-b1a8-b1f9a89600d5 is already attached to instances: 5730123c-98f2-4753-9451-5bd415013688 Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'server_id': '5730123c-98f2-4753-9451-5bd415013688', 'body': {'volumeAttachment': {'volumeId': '06682491-2882-46c5-b1a8-b1f9a89600d5'}}} Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 06682491-2882-46c5-b1a8-b1f9a89600d5 is already attached to instances: 5730123c-98f2-4753-9451-5bd415013688 Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:50:05.695947 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 06682491-2882-46c5-b1a8-b1f9a89600d5 is already attached to instances: 5730123c-98f2-4753-9451-5bd415013688 Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 06682491-2882-46c5-b1a8-b1f9a89600d5 is already attached to instances: 5730123c-98f2-4753-9451-5bd415013688 Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-67ea3019-d101-4956-8603-e15cf20aafca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 400 to user: Invalid volume: volume 06682491-2882-46c5-b1a8-b1f9a89600d5 is already attached to instances: 5730123c-98f2-4753-9451-5bd415013688 {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-67ea3019-d101-4956-8603-e15cf20aafca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "POST /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.270624 Oct 18 13:50:05.702844 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3009/5815] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:50:05 2022] POST /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments => generated 174 bytes in 272 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 13:50:05.828729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:05.829811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:05.834848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aefbae84-3d41-4f6b-b62a-5ea3a0d4aa83 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:05.844884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aefbae84-3d41-4f6b-b62a-5ea3a0d4aa83 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:05.851660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefbae84-3d41-4f6b-b62a-5ea3a0d4aa83 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:05.852270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefbae84-3d41-4f6b-b62a-5ea3a0d4aa83 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:05.852809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefbae84-3d41-4f6b-b62a-5ea3a0d4aa83 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:05.853671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefbae84-3d41-4f6b-b62a-5ea3a0d4aa83 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:05.854810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefbae84-3d41-4f6b-b62a-5ea3a0d4aa83 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:05.855454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aefbae84-3d41-4f6b-b62a-5ea3a0d4aa83 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:05.976036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-aefbae84-3d41-4f6b-b62a-5ea3a0d4aa83 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lazy-loading 'services' on Instance uuid 5730123c-98f2-4753-9451-5bd415013688 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:50:06.090757 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aefbae84-3d41-4f6b-b62a-5ea3a0d4aa83 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments/06682491-2882-46c5-b1a8-b1f9a89600d5" status: 202 len: 0 microversion: 2.1 time: 0.263716 Oct 18 13:50:06.092297 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2807/5816] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:50:05 2022] DELETE /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments/06682491-2882-46c5-b1a8-b1f9a89600d5 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:50:06.101415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-595875bb-5c9c-40bd-a4be-a5baa28947e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:06.104641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-595875bb-5c9c-40bd-a4be-a5baa28947e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:06.121425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-595875bb-5c9c-40bd-a4be-a5baa28947e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:06.122498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-595875bb-5c9c-40bd-a4be-a5baa28947e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:06.123474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-595875bb-5c9c-40bd-a4be-a5baa28947e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:06.124462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-595875bb-5c9c-40bd-a4be-a5baa28947e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:06.127331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-595875bb-5c9c-40bd-a4be-a5baa28947e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:06.127952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-595875bb-5c9c-40bd-a4be-a5baa28947e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:06.203870 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-595875bb-5c9c-40bd-a4be-a5baa28947e5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106539 Oct 18 13:50:06.209338 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3010/5817] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:50:06 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:07.218616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-309bc74e-5813-4617-a159-ac4303f12a6a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:07.223970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-309bc74e-5813-4617-a159-ac4303f12a6a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:07.235732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-309bc74e-5813-4617-a159-ac4303f12a6a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:07.236559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-309bc74e-5813-4617-a159-ac4303f12a6a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:07.237261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-309bc74e-5813-4617-a159-ac4303f12a6a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:07.238847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-309bc74e-5813-4617-a159-ac4303f12a6a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:07.239541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-309bc74e-5813-4617-a159-ac4303f12a6a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:07.241156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-309bc74e-5813-4617-a159-ac4303f12a6a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:07.315153 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-309bc74e-5813-4617-a159-ac4303f12a6a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102740 Oct 18 13:50:07.316529 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2808/5818] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:50:07 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:08.327995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6250fb1b-313b-48a6-a9c6-4d6bd96cb4a3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:08.330337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6250fb1b-313b-48a6-a9c6-4d6bd96cb4a3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:08.369436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6250fb1b-313b-48a6-a9c6-4d6bd96cb4a3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:08.370195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6250fb1b-313b-48a6-a9c6-4d6bd96cb4a3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:08.377928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6250fb1b-313b-48a6-a9c6-4d6bd96cb4a3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:08.379121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6250fb1b-313b-48a6-a9c6-4d6bd96cb4a3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:08.379801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6250fb1b-313b-48a6-a9c6-4d6bd96cb4a3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:08.380429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6250fb1b-313b-48a6-a9c6-4d6bd96cb4a3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:08.480127 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6250fb1b-313b-48a6-a9c6-4d6bd96cb4a3 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148902 Oct 18 13:50:08.481082 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3011/5819] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:50:08 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:09.492059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-479f39ce-825f-4813-8ea5-e77f52c4b940 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:09.494297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-479f39ce-825f-4813-8ea5-e77f52c4b940 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:09.507575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-479f39ce-825f-4813-8ea5-e77f52c4b940 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:09.508069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-479f39ce-825f-4813-8ea5-e77f52c4b940 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:09.508505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-479f39ce-825f-4813-8ea5-e77f52c4b940 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:09.509223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-479f39ce-825f-4813-8ea5-e77f52c4b940 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:09.509682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-479f39ce-825f-4813-8ea5-e77f52c4b940 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:09.510106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-479f39ce-825f-4813-8ea5-e77f52c4b940 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:09.588058 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-479f39ce-825f-4813-8ea5-e77f52c4b940 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099844 Oct 18 13:50:09.593216 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2809/5820] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:50:09 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:10.600588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c4d5f934-5223-439a-b68f-cc1f212b7664 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:10.603123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c4d5f934-5223-439a-b68f-cc1f212b7664 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:10.618049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4d5f934-5223-439a-b68f-cc1f212b7664 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:10.618821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4d5f934-5223-439a-b68f-cc1f212b7664 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:10.622103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4d5f934-5223-439a-b68f-cc1f212b7664 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:10.623140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4d5f934-5223-439a-b68f-cc1f212b7664 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:10.623841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4d5f934-5223-439a-b68f-cc1f212b7664 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:10.624507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c4d5f934-5223-439a-b68f-cc1f212b7664 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:10.733954 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c4d5f934-5223-439a-b68f-cc1f212b7664 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137317 Oct 18 13:50:10.735016 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3012/5821] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:50:10 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:11.756129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b0436fea-2364-4fa6-b8e6-842d5725da17 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:11.759087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b0436fea-2364-4fa6-b8e6-842d5725da17 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:11.771741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0436fea-2364-4fa6-b8e6-842d5725da17 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:11.781929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0436fea-2364-4fa6-b8e6-842d5725da17 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:11.782635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0436fea-2364-4fa6-b8e6-842d5725da17 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:11.783554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0436fea-2364-4fa6-b8e6-842d5725da17 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:11.784174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0436fea-2364-4fa6-b8e6-842d5725da17 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:11.784772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0436fea-2364-4fa6-b8e6-842d5725da17 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:11.847227 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b0436fea-2364-4fa6-b8e6-842d5725da17 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088346 Oct 18 13:50:11.847863 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2810/5822] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:50:11 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:12.862445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3b7bb070-4bfb-44a0-b6c0-8900c002d53a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:12.865458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3b7bb070-4bfb-44a0-b6c0-8900c002d53a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:12.880886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b7bb070-4bfb-44a0-b6c0-8900c002d53a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:12.888168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b7bb070-4bfb-44a0-b6c0-8900c002d53a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:12.895977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b7bb070-4bfb-44a0-b6c0-8900c002d53a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:12.897222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b7bb070-4bfb-44a0-b6c0-8900c002d53a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:12.897454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b7bb070-4bfb-44a0-b6c0-8900c002d53a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:12.898473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b7bb070-4bfb-44a0-b6c0-8900c002d53a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:13.061657 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3b7bb070-4bfb-44a0-b6c0-8900c002d53a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199433 Oct 18 13:50:13.067761 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3013/5823] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:50:12 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:14.082916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5d270612-8114-4509-baf4-58d22efcafc4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:14.090275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5d270612-8114-4509-baf4-58d22efcafc4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:14.107833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d270612-8114-4509-baf4-58d22efcafc4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:14.110245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d270612-8114-4509-baf4-58d22efcafc4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:14.110795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d270612-8114-4509-baf4-58d22efcafc4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:14.114488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d270612-8114-4509-baf4-58d22efcafc4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:14.115058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d270612-8114-4509-baf4-58d22efcafc4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:14.116308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d270612-8114-4509-baf4-58d22efcafc4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:14.203769 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5d270612-8114-4509-baf4-58d22efcafc4 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132749 Oct 18 13:50:14.209227 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2811/5824] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:50:14 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:15.221221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e8a65ec0-3927-46f5-a322-86447bd3c589 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:15.223685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e8a65ec0-3927-46f5-a322-86447bd3c589 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:15.249907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8a65ec0-3927-46f5-a322-86447bd3c589 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:15.251044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8a65ec0-3927-46f5-a322-86447bd3c589 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:15.253090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8a65ec0-3927-46f5-a322-86447bd3c589 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:15.254410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8a65ec0-3927-46f5-a322-86447bd3c589 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:15.256086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8a65ec0-3927-46f5-a322-86447bd3c589 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:15.258536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8a65ec0-3927-46f5-a322-86447bd3c589 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:15.339438 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e8a65ec0-3927-46f5-a322-86447bd3c589 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121875 Oct 18 13:50:15.345450 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3014/5825] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:50:15 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:50:15.481247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3b3ba1f9-2638-4c60-938a-69737fb0904b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:15.481247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3b3ba1f9-2638-4c60-938a-69737fb0904b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:15.499715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b3ba1f9-2638-4c60-938a-69737fb0904b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:15.504180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b3ba1f9-2638-4c60-938a-69737fb0904b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:15.505833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b3ba1f9-2638-4c60-938a-69737fb0904b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:15.510465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b3ba1f9-2638-4c60-938a-69737fb0904b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:15.516100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b3ba1f9-2638-4c60-938a-69737fb0904b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:15.516850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b3ba1f9-2638-4c60-938a-69737fb0904b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:15.600172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3b3ba1f9-2638-4c60-938a-69737fb0904b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:50:15.748380 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3b3ba1f9-2638-4c60-938a-69737fb0904b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 204 len: 0 microversion: 2.1 time: 0.279115 Oct 18 13:50:15.750525 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2812/5826] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:50:15 2022] DELETE /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:50:15.759807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0ad04fd8-c1ea-4691-9c59-4212c57dad89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:15.761202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0ad04fd8-c1ea-4691-9c59-4212c57dad89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:15.775473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ad04fd8-c1ea-4691-9c59-4212c57dad89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:15.777360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ad04fd8-c1ea-4691-9c59-4212c57dad89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:15.778163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ad04fd8-c1ea-4691-9c59-4212c57dad89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:15.780850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ad04fd8-c1ea-4691-9c59-4212c57dad89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:15.781690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ad04fd8-c1ea-4691-9c59-4212c57dad89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:15.782925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ad04fd8-c1ea-4691-9c59-4212c57dad89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:16.238219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0ad04fd8-c1ea-4691-9c59-4212c57dad89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:16.250673 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0ad04fd8-c1ea-4691-9c59-4212c57dad89 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1681 microversion: 2.1 time: 0.495546 Oct 18 13:50:16.252326 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3015/5827] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:15 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1681 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:17.281742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-52467df1-42d4-422a-96ee-01dbd1dec307 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:17.284306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-52467df1-42d4-422a-96ee-01dbd1dec307 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:17.321524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52467df1-42d4-422a-96ee-01dbd1dec307 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:17.323420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52467df1-42d4-422a-96ee-01dbd1dec307 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:17.326099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52467df1-42d4-422a-96ee-01dbd1dec307 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:17.328083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52467df1-42d4-422a-96ee-01dbd1dec307 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:17.333637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52467df1-42d4-422a-96ee-01dbd1dec307 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:17.334406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52467df1-42d4-422a-96ee-01dbd1dec307 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:18.110696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-52467df1-42d4-422a-96ee-01dbd1dec307 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:18.143614 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-52467df1-42d4-422a-96ee-01dbd1dec307 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1681 microversion: 2.1 time: 0.865079 Oct 18 13:50:18.167686 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2813/5828] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:17 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1681 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:19.167924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9a70fed2-b8b8-47ec-817f-2c416852b0fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:19.168751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9a70fed2-b8b8-47ec-817f-2c416852b0fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:19.186849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a70fed2-b8b8-47ec-817f-2c416852b0fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:19.193233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a70fed2-b8b8-47ec-817f-2c416852b0fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:19.193804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a70fed2-b8b8-47ec-817f-2c416852b0fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:19.194669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a70fed2-b8b8-47ec-817f-2c416852b0fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:19.195947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a70fed2-b8b8-47ec-817f-2c416852b0fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:19.196657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a70fed2-b8b8-47ec-817f-2c416852b0fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:19.635736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9a70fed2-b8b8-47ec-817f-2c416852b0fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:19.644762 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9a70fed2-b8b8-47ec-817f-2c416852b0fb tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1613 microversion: 2.1 time: 0.481757 Oct 18 13:50:19.647546 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3016/5829] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:19 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1613 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:19.989875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-be0197d9-a7c2-493a-a28b-5fb49cdd88b2 req-0ccb8d66-dde7-4ea9-97dc-862dd5801231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5730123c-98f2-4753-9451-5bd415013688", "name": "network-vif-deleted", "tag": "7d3d200d-0336-44fe-84b4-2ace88e86904"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:20.023116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-be0197d9-a7c2-493a-a28b-5fb49cdd88b2 req-0ccb8d66-dde7-4ea9-97dc-862dd5801231 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:20.023547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-be0197d9-a7c2-493a-a28b-5fb49cdd88b2 req-0ccb8d66-dde7-4ea9-97dc-862dd5801231 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:20.023989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-be0197d9-a7c2-493a-a28b-5fb49cdd88b2 req-0ccb8d66-dde7-4ea9-97dc-862dd5801231 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:20.074265 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-be0197d9-a7c2-493a-a28b-5fb49cdd88b2 req-0ccb8d66-dde7-4ea9-97dc-862dd5801231 service nova] Creating event network-vif-deleted:7d3d200d-0336-44fe-84b4-2ace88e86904 for instance 5730123c-98f2-4753-9451-5bd415013688 on n-h1-858384-13 Oct 18 13:50:20.097585 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-be0197d9-a7c2-493a-a28b-5fb49cdd88b2 req-0ccb8d66-dde7-4ea9-97dc-862dd5801231 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112417 Oct 18 13:50:20.098197 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2814/5830] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:20.676273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:20.676914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:20.700956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:20.706567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:20.708464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:20.715299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:20.715904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:20.716357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:20.847720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:20.849989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:20.852091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:20.855094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lazy-loading 'fault' on Instance uuid 5730123c-98f2-4753-9451-5bd415013688 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:50:21.069866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:21.093158 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bd6d5974-69ed-4041-bbe7-2b71552be052 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 200 len: 1331 microversion: 2.1 time: 0.421919 Oct 18 13:50:21.095771 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3017/5831] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:20 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 1331 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:22.121716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-13051b27-0fe9-4f0c-876d-249170641aec tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:22.123162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-13051b27-0fe9-4f0c-876d-249170641aec tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:22.139626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13051b27-0fe9-4f0c-876d-249170641aec tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:22.141127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13051b27-0fe9-4f0c-876d-249170641aec tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:22.141898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13051b27-0fe9-4f0c-876d-249170641aec tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:22.142796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13051b27-0fe9-4f0c-876d-249170641aec tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:22.143619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13051b27-0fe9-4f0c-876d-249170641aec tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:22.144153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13051b27-0fe9-4f0c-876d-249170641aec tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:22.161692 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-13051b27-0fe9-4f0c-876d-249170641aec tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-13051b27-0fe9-4f0c-876d-249170641aec tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 HTTP/1.1 Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '5730123c-98f2-4753-9451-5bd415013688'} Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:50:22.169823 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:50:22.175396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:50:22.175396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:50:22.175396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:50:22.175396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:50:22.175396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:50:22.175396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:50:22.175396 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:50:22.176910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-13051b27-0fe9-4f0c-876d-249170641aec tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 404 to user: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:50:22.177732 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-13051b27-0fe9-4f0c-876d-249170641aec tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 404 len: 111 microversion: 2.1 time: 0.063378 Oct 18 13:50:22.183050 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2815/5832] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:22 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:50:22.193393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5ee8ee4e-b9fd-4254-8e17-a687423025ca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '.version_select at 0x7ff617ac4160>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:22.275962 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5ee8ee4e-b9fd-4254-8e17-a687423025ca tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881708035" status: 202 len: 0 microversion: 2.1 time: 0.090649 Oct 18 13:50:22.279316 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3018/5833] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:50:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881708035 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:50:23.749241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-85bdb23f-1e08-4d95-b1e8-75a30200fce1 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Action: 'create', calling method: .version_select at 0x7ff60e638e50>, body: {"keypair": {"name": "tempest-keypair-1767517408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZqli/33Jq3cNdb53LoiG7luS9rkBhCuHN/fx8l+BAOFOflF8mXVOSHKgX/KQGV6rWfDk5Ls8mMPY4s7pga5upH7l4rzK8gQ+H/adv6S7xbSgTspXQSnQt50QN5vx5KEg=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:23.796371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-85bdb23f-1e08-4d95-b1e8-75a30200fce1 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for project b134786f443e4760b57d3cb5842daa89. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:50:23.808735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-85bdb23f-1e08-4d95-b1e8-75a30200fce1 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for user e1fdfb4e43ca40eabb58abe0e9bd4ea3 and project b134786f443e4760b57d3cb5842daa89. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:50:23.831240 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-85bdb23f-1e08-4d95-b1e8-75a30200fce1 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 13:50:24.839507 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [None req-85bdb23f-1e08-4d95-b1e8-75a30200fce1 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 48402. Oct 18 13:50:24.863428 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-85bdb23f-1e08-4d95-b1e8-75a30200fce1 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.118470 Oct 18 13:50:24.864632 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2816/5834] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:50:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:28.110714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1023853212", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e79f1988-366e-4b47-8001-6022e690ef28"}], "security_groups": [{"name": "tempest-securitygroup--1641948553"}], "key_name": "tempest-keypair-1767517408", "user_data": "}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:28.345221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] validate_networks() for [('e79f1988-366e-4b47-8001-6022e690ef28', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:50:29.449906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:50:29.451162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:50:29.451674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:50:29.452094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:50:29.452515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:50:29.477913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:29.478448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:29.478896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:29.479622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:29.480076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:29.483812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:29.563898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for project b134786f443e4760b57d3cb5842daa89. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:50:29.578539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Getting quotas for user e1fdfb4e43ca40eabb58abe0e9bd4ea3 and project b134786f443e4760b57d3cb5842daa89. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:50:29.612734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:50:29.615932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:50:29.722897 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d7d01e63-bd89-4452-a1a4-8909cbaedf64 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.616713 Oct 18 13:50:29.725045 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3019/5835] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:50:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:50:29.741731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2d7d4f95-5369-48b8-816e-cdfb16352306 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:29.743494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2d7d4f95-5369-48b8-816e-cdfb16352306 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:29.851308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2d7d4f95-5369-48b8-816e-cdfb16352306 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:29.884266 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2d7d4f95-5369-48b8-816e-cdfb16352306 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1242 microversion: 2.1 time: 0.147623 Oct 18 13:50:29.887127 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2817/5836] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:29 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1242 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:30.910292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-80eddfe4-8a1b-415d-826b-76ccd37581f9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:30.911607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-80eddfe4-8a1b-415d-826b-76ccd37581f9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:30.922791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80eddfe4-8a1b-415d-826b-76ccd37581f9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:30.931984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80eddfe4-8a1b-415d-826b-76ccd37581f9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:30.932880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80eddfe4-8a1b-415d-826b-76ccd37581f9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:30.933833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80eddfe4-8a1b-415d-826b-76ccd37581f9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:30.946093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80eddfe4-8a1b-415d-826b-76ccd37581f9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:30.947508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80eddfe4-8a1b-415d-826b-76ccd37581f9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:31.133405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-80eddfe4-8a1b-415d-826b-76ccd37581f9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:31.142810 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-80eddfe4-8a1b-415d-826b-76ccd37581f9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1246 microversion: 2.1 time: 0.237825 Oct 18 13:50:31.151292 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3020/5837] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:30 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1246 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:32.178447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ae782c26-9e66-4b3d-b639-0570cc0722f7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:32.183719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ae782c26-9e66-4b3d-b639-0570cc0722f7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:32.187480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:32.213361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae782c26-9e66-4b3d-b639-0570cc0722f7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:32.214385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae782c26-9e66-4b3d-b639-0570cc0722f7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:32.217045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae782c26-9e66-4b3d-b639-0570cc0722f7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:32.218091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae782c26-9e66-4b3d-b639-0570cc0722f7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:32.225748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae782c26-9e66-4b3d-b639-0570cc0722f7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:32.226447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ae782c26-9e66-4b3d-b639-0570cc0722f7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:32.354705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ae782c26-9e66-4b3d-b639-0570cc0722f7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:32.367183 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ae782c26-9e66-4b3d-b639-0570cc0722f7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1300 microversion: 2.1 time: 0.198529 Oct 18 13:50:32.377572 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2818/5838] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:32 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:33.393029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3a831507-4d60-4401-8876-aaa5e77b87f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:33.394914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3a831507-4d60-4401-8876-aaa5e77b87f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:33.429136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a831507-4d60-4401-8876-aaa5e77b87f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:33.432645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a831507-4d60-4401-8876-aaa5e77b87f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:33.433644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a831507-4d60-4401-8876-aaa5e77b87f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:33.435554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a831507-4d60-4401-8876-aaa5e77b87f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:33.437320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a831507-4d60-4401-8876-aaa5e77b87f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:33.437774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3a831507-4d60-4401-8876-aaa5e77b87f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:33.583113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3a831507-4d60-4401-8876-aaa5e77b87f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:33.600456 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3a831507-4d60-4401-8876-aaa5e77b87f8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1300 microversion: 2.1 time: 0.213134 Oct 18 13:50:33.606465 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3021/5839] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:33 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1300 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:34.630440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cefb8573-c4e2-468f-8137-91cbaebe5019 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:34.631832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cefb8573-c4e2-468f-8137-91cbaebe5019 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:34.645426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cefb8573-c4e2-468f-8137-91cbaebe5019 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:34.646226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cefb8573-c4e2-468f-8137-91cbaebe5019 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:34.646852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cefb8573-c4e2-468f-8137-91cbaebe5019 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:34.649881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cefb8573-c4e2-468f-8137-91cbaebe5019 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:34.650687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cefb8573-c4e2-468f-8137-91cbaebe5019 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:34.651306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cefb8573-c4e2-468f-8137-91cbaebe5019 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:35.680950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cefb8573-c4e2-468f-8137-91cbaebe5019 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:35.705759 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cefb8573-c4e2-468f-8137-91cbaebe5019 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1368 microversion: 2.1 time: 1.066536 Oct 18 13:50:35.706525 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2819/5840] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:34 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1368 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:36.758010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1fb51c8-e024-4912-861d-ed4caebc19c8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:36.760294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1fb51c8-e024-4912-861d-ed4caebc19c8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:36.786499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:36.796836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1fb51c8-e024-4912-861d-ed4caebc19c8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:36.797662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1fb51c8-e024-4912-861d-ed4caebc19c8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:36.798445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1fb51c8-e024-4912-861d-ed4caebc19c8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:36.799570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1fb51c8-e024-4912-861d-ed4caebc19c8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:36.801870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1fb51c8-e024-4912-861d-ed4caebc19c8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:36.802639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1fb51c8-e024-4912-861d-ed4caebc19c8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:36.815602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=71 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:37.198653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d1fb51c8-e024-4912-861d-ed4caebc19c8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:37.235724 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d1fb51c8-e024-4912-861d-ed4caebc19c8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1368 microversion: 2.1 time: 0.508752 Oct 18 13:50:37.247753 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3022/5841] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:36 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1368 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:37.704443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e19e45ad-0056-47ff-8c2e-88097e5285df req-d4c776fa-2e7e-4740-af56-c7097c120563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb", "tag": "a2f62c2b-76f7-413f-a593-8fdae2e2e9dd"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:37.723283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:37.726473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e19e45ad-0056-47ff-8c2e-88097e5285df req-d4c776fa-2e7e-4740-af56-c7097c120563 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:37.731001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e19e45ad-0056-47ff-8c2e-88097e5285df req-d4c776fa-2e7e-4740-af56-c7097c120563 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:37.731987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e19e45ad-0056-47ff-8c2e-88097e5285df req-d4c776fa-2e7e-4740-af56-c7097c120563 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:37.750613 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e19e45ad-0056-47ff-8c2e-88097e5285df req-d4c776fa-2e7e-4740-af56-c7097c120563 service nova] Creating event network-changed:a2f62c2b-76f7-413f-a593-8fdae2e2e9dd for instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb on n-h1-858384-13 Oct 18 13:50:37.759207 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e19e45ad-0056-47ff-8c2e-88097e5285df req-d4c776fa-2e7e-4740-af56-c7097c120563 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059911 Oct 18 13:50:37.760876 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2820/5842] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:38.298084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e2c073f2-91bf-4201-8d98-318b991dea59 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:38.298997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e2c073f2-91bf-4201-8d98-318b991dea59 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:38.309139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2c073f2-91bf-4201-8d98-318b991dea59 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:38.312858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2c073f2-91bf-4201-8d98-318b991dea59 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:38.313628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2c073f2-91bf-4201-8d98-318b991dea59 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:38.316474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2c073f2-91bf-4201-8d98-318b991dea59 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:38.317872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2c073f2-91bf-4201-8d98-318b991dea59 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:38.318499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2c073f2-91bf-4201-8d98-318b991dea59 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:38.504677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1136298245", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "903966e4-1dee-4808-914f-e04cdd5ee670"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:38.605672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] validate_networks() for [('903966e4-1dee-4808-914f-e04cdd5ee670', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:50:38.667899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e2c073f2-91bf-4201-8d98-318b991dea59 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:38.676876 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e2c073f2-91bf-4201-8d98-318b991dea59 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1368 microversion: 2.1 time: 0.383315 Oct 18 13:50:38.683075 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2821/5843] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:38 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1368 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:39.170425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:50:39.170871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:50:39.171427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:50:39.171865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:50:39.172286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:50:39.193276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:39.194431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:39.194885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:39.195634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:39.196100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:39.196537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:39.218281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Getting quotas for project 9ab1919232bc40d69fc3da077eda541c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:50:39.224309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Getting quotas for user d9f91a6353d4422e87067372dbd4d8a7 and project 9ab1919232bc40d69fc3da077eda541c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:50:39.240044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:50:39.245061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:50:39.335010 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dca31abe-1025-4061-890f-365370740df2 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.124563 Oct 18 13:50:39.336837 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3023/5844] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:50:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:50:39.349166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af4b3cbd-1f72-41b3-bf3f-40b795df8e22 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:39.351391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-af4b3cbd-1f72-41b3-bf3f-40b795df8e22 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:39.498668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-af4b3cbd-1f72-41b3-bf3f-40b795df8e22 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f91a6353d4422e87067372dbd4d8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab1919232bc40d69fc3da077eda541c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:39.508170 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-af4b3cbd-1f72-41b3-bf3f-40b795df8e22 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 200 len: 1214 microversion: 2.1 time: 0.161495 Oct 18 13:50:39.533164 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2822/5845] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:39 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:39.709691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-54234950-3094-4387-8476-63336c76f591 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:39.711111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-54234950-3094-4387-8476-63336c76f591 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:39.736086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54234950-3094-4387-8476-63336c76f591 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:39.736881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54234950-3094-4387-8476-63336c76f591 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:39.737550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54234950-3094-4387-8476-63336c76f591 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:39.738437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54234950-3094-4387-8476-63336c76f591 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:39.739064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54234950-3094-4387-8476-63336c76f591 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:39.739660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54234950-3094-4387-8476-63336c76f591 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:39.962727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-54234950-3094-4387-8476-63336c76f591 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:39.972431 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-54234950-3094-4387-8476-63336c76f591 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1368 microversion: 2.1 time: 0.266587 Oct 18 13:50:39.974327 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3024/5846] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:39 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:40.545800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d85429a3-ce42-4738-abe2-66c5e1f1c4bc tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:40.547052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d85429a3-ce42-4738-abe2-66c5e1f1c4bc tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:40.554864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d85429a3-ce42-4738-abe2-66c5e1f1c4bc tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:40.580709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d85429a3-ce42-4738-abe2-66c5e1f1c4bc tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:40.581271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d85429a3-ce42-4738-abe2-66c5e1f1c4bc tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:40.590042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d85429a3-ce42-4738-abe2-66c5e1f1c4bc tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:40.590535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d85429a3-ce42-4738-abe2-66c5e1f1c4bc tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:40.590972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d85429a3-ce42-4738-abe2-66c5e1f1c4bc tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:40.942783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d85429a3-ce42-4738-abe2-66c5e1f1c4bc tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f91a6353d4422e87067372dbd4d8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab1919232bc40d69fc3da077eda541c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:40.954715 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d85429a3-ce42-4738-abe2-66c5e1f1c4bc tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 200 len: 1266 microversion: 2.1 time: 0.414110 Oct 18 13:50:40.955308 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2823/5847] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:40 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 1266 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:40.997974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2682929c-48a9-41e1-a852-026dfbd3ee8b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:40.998670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2682929c-48a9-41e1-a852-026dfbd3ee8b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:41.013891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2682929c-48a9-41e1-a852-026dfbd3ee8b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:41.014387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2682929c-48a9-41e1-a852-026dfbd3ee8b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:41.015032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2682929c-48a9-41e1-a852-026dfbd3ee8b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:41.015966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2682929c-48a9-41e1-a852-026dfbd3ee8b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:41.017810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2682929c-48a9-41e1-a852-026dfbd3ee8b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:41.018506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2682929c-48a9-41e1-a852-026dfbd3ee8b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:41.455067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2682929c-48a9-41e1-a852-026dfbd3ee8b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:41.467891 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2682929c-48a9-41e1-a852-026dfbd3ee8b tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1368 microversion: 2.1 time: 0.475736 Oct 18 13:50:41.468521 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3025/5848] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:40 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1368 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:41.982246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cc4d62ae-cfbe-437f-a72a-96b4e5dd98d7 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:41.983542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cc4d62ae-cfbe-437f-a72a-96b4e5dd98d7 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:42.007180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4d62ae-cfbe-437f-a72a-96b4e5dd98d7 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:42.008009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4d62ae-cfbe-437f-a72a-96b4e5dd98d7 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:42.011161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4d62ae-cfbe-437f-a72a-96b4e5dd98d7 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:42.011931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4d62ae-cfbe-437f-a72a-96b4e5dd98d7 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:42.012403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4d62ae-cfbe-437f-a72a-96b4e5dd98d7 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:42.012849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4d62ae-cfbe-437f-a72a-96b4e5dd98d7 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:42.216594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cc4d62ae-cfbe-437f-a72a-96b4e5dd98d7 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f91a6353d4422e87067372dbd4d8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab1919232bc40d69fc3da077eda541c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:42.232902 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cc4d62ae-cfbe-437f-a72a-96b4e5dd98d7 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 200 len: 1272 microversion: 2.1 time: 0.254934 Oct 18 13:50:42.233659 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2824/5849] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:41 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:42.492567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f48b93e2-a0f5-4e65-af4b-703577095dd7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:42.493000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f48b93e2-a0f5-4e65-af4b-703577095dd7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:42.503960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f48b93e2-a0f5-4e65-af4b-703577095dd7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:42.507270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f48b93e2-a0f5-4e65-af4b-703577095dd7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:42.507789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f48b93e2-a0f5-4e65-af4b-703577095dd7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:42.508549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f48b93e2-a0f5-4e65-af4b-703577095dd7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:42.512581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f48b93e2-a0f5-4e65-af4b-703577095dd7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:42.513105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f48b93e2-a0f5-4e65-af4b-703577095dd7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:42.738243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f48b93e2-a0f5-4e65-af4b-703577095dd7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:42.747548 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f48b93e2-a0f5-4e65-af4b-703577095dd7 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1368 microversion: 2.1 time: 0.259373 Oct 18 13:50:42.748356 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3026/5850] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:42 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:43.260857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-24ecd05c-ef4d-4611-a586-2e3c24d34112 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:43.262478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-24ecd05c-ef4d-4611-a586-2e3c24d34112 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:43.283030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24ecd05c-ef4d-4611-a586-2e3c24d34112 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:43.286451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24ecd05c-ef4d-4611-a586-2e3c24d34112 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:43.288714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24ecd05c-ef4d-4611-a586-2e3c24d34112 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:43.289809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24ecd05c-ef4d-4611-a586-2e3c24d34112 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:43.292742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24ecd05c-ef4d-4611-a586-2e3c24d34112 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:43.296758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-24ecd05c-ef4d-4611-a586-2e3c24d34112 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:43.763861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-24ecd05c-ef4d-4611-a586-2e3c24d34112 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f91a6353d4422e87067372dbd4d8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab1919232bc40d69fc3da077eda541c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:43.773654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9b94c99f-14f9-413c-aaec-1df513e67354 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:43.774425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9b94c99f-14f9-413c-aaec-1df513e67354 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:43.798325 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-24ecd05c-ef4d-4611-a586-2e3c24d34112 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 200 len: 1314 microversion: 2.1 time: 0.536647 Oct 18 13:50:43.801770 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2825/5851] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:43 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:43.803458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b94c99f-14f9-413c-aaec-1df513e67354 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:43.829753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b94c99f-14f9-413c-aaec-1df513e67354 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:43.830425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b94c99f-14f9-413c-aaec-1df513e67354 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:43.831345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b94c99f-14f9-413c-aaec-1df513e67354 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:43.832269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b94c99f-14f9-413c-aaec-1df513e67354 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:43.832709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b94c99f-14f9-413c-aaec-1df513e67354 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:44.247032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b94c99f-14f9-413c-aaec-1df513e67354 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:44.261816 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9b94c99f-14f9-413c-aaec-1df513e67354 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1368 microversion: 2.1 time: 0.492174 Oct 18 13:50:44.267377 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3027/5852] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:43 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1368 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:44.464329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-fd57f5cf-9144-4db2-979b-1e0d7e4adaeb req-5923802b-50c9-4dda-b309-1587058387e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb", "name": "network-vif-plugged", "status": "completed", "tag": "a2f62c2b-76f7-413f-a593-8fdae2e2e9dd"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:44.486936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fd57f5cf-9144-4db2-979b-1e0d7e4adaeb req-5923802b-50c9-4dda-b309-1587058387e0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:44.487863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fd57f5cf-9144-4db2-979b-1e0d7e4adaeb req-5923802b-50c9-4dda-b309-1587058387e0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:44.488070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fd57f5cf-9144-4db2-979b-1e0d7e4adaeb req-5923802b-50c9-4dda-b309-1587058387e0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:44.526722 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-fd57f5cf-9144-4db2-979b-1e0d7e4adaeb req-5923802b-50c9-4dda-b309-1587058387e0 service nova] Creating event network-vif-plugged:a2f62c2b-76f7-413f-a593-8fdae2e2e9dd for instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb on n-h1-858384-13 Oct 18 13:50:44.536093 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-fd57f5cf-9144-4db2-979b-1e0d7e4adaeb req-5923802b-50c9-4dda-b309-1587058387e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077340 Oct 18 13:50:44.538987 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2826/5853] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:44.793851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-fe19c566-274d-4184-8da3-e871ee2628aa req-4bd462db-cad0-4248-8d59-1cb00169fa12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c799f14a-bd10-4d3f-a37d-183d613b44a1", "tag": "ed3ca940-625f-4288-9289-152f0d72f83e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:44.815314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fe19c566-274d-4184-8da3-e871ee2628aa req-4bd462db-cad0-4248-8d59-1cb00169fa12 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:44.825131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fe19c566-274d-4184-8da3-e871ee2628aa req-4bd462db-cad0-4248-8d59-1cb00169fa12 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:44.825838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fe19c566-274d-4184-8da3-e871ee2628aa req-4bd462db-cad0-4248-8d59-1cb00169fa12 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:44.832885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e8bed17a-333b-4e43-bfc7-05f43de9e372 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:44.833864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e8bed17a-333b-4e43-bfc7-05f43de9e372 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:44.841779 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-fe19c566-274d-4184-8da3-e871ee2628aa req-4bd462db-cad0-4248-8d59-1cb00169fa12 service nova] Creating event network-changed:ed3ca940-625f-4288-9289-152f0d72f83e for instance c799f14a-bd10-4d3f-a37d-183d613b44a1 on n-h2-858384-13 Oct 18 13:50:44.855916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8bed17a-333b-4e43-bfc7-05f43de9e372 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:44.856591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8bed17a-333b-4e43-bfc7-05f43de9e372 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:44.857192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8bed17a-333b-4e43-bfc7-05f43de9e372 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:44.858799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8bed17a-333b-4e43-bfc7-05f43de9e372 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:44.860586 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-fe19c566-274d-4184-8da3-e871ee2628aa req-4bd462db-cad0-4248-8d59-1cb00169fa12 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072195 Oct 18 13:50:44.860750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8bed17a-333b-4e43-bfc7-05f43de9e372 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:44.861894 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3028/5854] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:44.863003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8bed17a-333b-4e43-bfc7-05f43de9e372 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:45.291590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2f2951ea-1188-4d46-892a-2df60c9df963 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:45.292832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2f2951ea-1188-4d46-892a-2df60c9df963 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:45.300390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f2951ea-1188-4d46-892a-2df60c9df963 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:45.301412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f2951ea-1188-4d46-892a-2df60c9df963 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:45.302106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f2951ea-1188-4d46-892a-2df60c9df963 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:45.303135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f2951ea-1188-4d46-892a-2df60c9df963 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:45.303828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f2951ea-1188-4d46-892a-2df60c9df963 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:45.304571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f2951ea-1188-4d46-892a-2df60c9df963 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:45.396436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e8bed17a-333b-4e43-bfc7-05f43de9e372 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f91a6353d4422e87067372dbd4d8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab1919232bc40d69fc3da077eda541c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:45.412187 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e8bed17a-333b-4e43-bfc7-05f43de9e372 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 200 len: 1314 microversion: 2.1 time: 0.586134 Oct 18 13:50:45.413220 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2827/5855] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:44 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:45.583217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2f2951ea-1188-4d46-892a-2df60c9df963 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:45.593334 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2f2951ea-1188-4d46-892a-2df60c9df963 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1368 microversion: 2.1 time: 0.306906 Oct 18 13:50:45.604856 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3029/5856] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:45 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1368 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:46.437161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7cd07252-fe2a-43b0-8777-0ad3da27e1d8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:46.437967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7cd07252-fe2a-43b0-8777-0ad3da27e1d8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:46.444635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cd07252-fe2a-43b0-8777-0ad3da27e1d8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:46.449868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cd07252-fe2a-43b0-8777-0ad3da27e1d8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:46.452211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cd07252-fe2a-43b0-8777-0ad3da27e1d8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:46.453092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cd07252-fe2a-43b0-8777-0ad3da27e1d8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:46.458259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cd07252-fe2a-43b0-8777-0ad3da27e1d8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:46.458815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7cd07252-fe2a-43b0-8777-0ad3da27e1d8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:46.619386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f725cf62-c01a-4dbb-8c8a-1aafeafeeb58 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:46.620116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f725cf62-c01a-4dbb-8c8a-1aafeafeeb58 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:46.631379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f725cf62-c01a-4dbb-8c8a-1aafeafeeb58 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:46.636332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f725cf62-c01a-4dbb-8c8a-1aafeafeeb58 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:46.637470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f725cf62-c01a-4dbb-8c8a-1aafeafeeb58 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:46.638417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f725cf62-c01a-4dbb-8c8a-1aafeafeeb58 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:46.641290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f725cf62-c01a-4dbb-8c8a-1aafeafeeb58 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:46.641903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f725cf62-c01a-4dbb-8c8a-1aafeafeeb58 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:46.720249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7cd07252-fe2a-43b0-8777-0ad3da27e1d8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f91a6353d4422e87067372dbd4d8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab1919232bc40d69fc3da077eda541c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:46.730074 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7cd07252-fe2a-43b0-8777-0ad3da27e1d8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 200 len: 1314 microversion: 2.1 time: 0.297053 Oct 18 13:50:46.747357 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2828/5857] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:46 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:46.958021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f725cf62-c01a-4dbb-8c8a-1aafeafeeb58 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:46.980949 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f725cf62-c01a-4dbb-8c8a-1aafeafeeb58 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1558 microversion: 2.1 time: 0.366668 Oct 18 13:50:46.982645 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3030/5858] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:46 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1558 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:47.005225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6b81fdf9-42c3-4a5a-bf4f-e8ce0de1d08d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:47.006129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6b81fdf9-42c3-4a5a-bf4f-e8ce0de1d08d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:47.019173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b81fdf9-42c3-4a5a-bf4f-e8ce0de1d08d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:47.020032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b81fdf9-42c3-4a5a-bf4f-e8ce0de1d08d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:47.020660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b81fdf9-42c3-4a5a-bf4f-e8ce0de1d08d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:47.021622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b81fdf9-42c3-4a5a-bf4f-e8ce0de1d08d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:47.022076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b81fdf9-42c3-4a5a-bf4f-e8ce0de1d08d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:47.022503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b81fdf9-42c3-4a5a-bf4f-e8ce0de1d08d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:47.273380 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6b81fdf9-42c3-4a5a-bf4f-e8ce0de1d08d tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.271970 Oct 18 13:50:47.274370 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2829/5859] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 13:50:47 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-interface => generated 285 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:47.754486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-95cfc28e-1044-4b20-b1c6-ad99a6e862c1 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:47.755676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-95cfc28e-1044-4b20-b1c6-ad99a6e862c1 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:47.785470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95cfc28e-1044-4b20-b1c6-ad99a6e862c1 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:47.786019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95cfc28e-1044-4b20-b1c6-ad99a6e862c1 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:47.786561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95cfc28e-1044-4b20-b1c6-ad99a6e862c1 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:47.787143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95cfc28e-1044-4b20-b1c6-ad99a6e862c1 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:47.787598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95cfc28e-1044-4b20-b1c6-ad99a6e862c1 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:47.788024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-95cfc28e-1044-4b20-b1c6-ad99a6e862c1 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:48.232106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-95cfc28e-1044-4b20-b1c6-ad99a6e862c1 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f91a6353d4422e87067372dbd4d8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab1919232bc40d69fc3da077eda541c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:48.247530 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-95cfc28e-1044-4b20-b1c6-ad99a6e862c1 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 200 len: 1314 microversion: 2.1 time: 0.496998 Oct 18 13:50:48.253558 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3031/5860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:47 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:49.288613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2455df1c-63e9-4c24-a05f-393c0ab421cb tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:49.291138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2455df1c-63e9-4c24-a05f-393c0ab421cb tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:49.300633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2455df1c-63e9-4c24-a05f-393c0ab421cb tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:49.300937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2455df1c-63e9-4c24-a05f-393c0ab421cb tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:49.301618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2455df1c-63e9-4c24-a05f-393c0ab421cb tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:49.335485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2455df1c-63e9-4c24-a05f-393c0ab421cb tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:49.336365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2455df1c-63e9-4c24-a05f-393c0ab421cb tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:49.344176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2455df1c-63e9-4c24-a05f-393c0ab421cb tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:49.506671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=8 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:50.001305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2455df1c-63e9-4c24-a05f-393c0ab421cb tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f91a6353d4422e87067372dbd4d8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab1919232bc40d69fc3da077eda541c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:50.019603 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2455df1c-63e9-4c24-a05f-393c0ab421cb tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 200 len: 1314 microversion: 2.1 time: 0.745587 Oct 18 13:50:50.023211 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2830/5861] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:49 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:50.030777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:50.031548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=12 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:50.043187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-2540f155-a074-4c51-8f8f-994a98936327 req-293937dc-d6fd-4730-bb8c-8d6b356f9899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb", "tag": "a2f62c2b-76f7-413f-a593-8fdae2e2e9dd"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:50.063921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2540f155-a074-4c51-8f8f-994a98936327 req-293937dc-d6fd-4730-bb8c-8d6b356f9899 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:50.065840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2540f155-a074-4c51-8f8f-994a98936327 req-293937dc-d6fd-4730-bb8c-8d6b356f9899 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:50.067456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2540f155-a074-4c51-8f8f-994a98936327 req-293937dc-d6fd-4730-bb8c-8d6b356f9899 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:50.089220 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-2540f155-a074-4c51-8f8f-994a98936327 req-293937dc-d6fd-4730-bb8c-8d6b356f9899 service nova] Creating event network-changed:a2f62c2b-76f7-413f-a593-8fdae2e2e9dd for instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb on n-h1-858384-13 Oct 18 13:50:50.109674 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-2540f155-a074-4c51-8f8f-994a98936327 req-293937dc-d6fd-4730-bb8c-8d6b356f9899 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079374 Oct 18 13:50:50.113551 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3032/5862] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:50.748027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2141622129", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "22ef14ff-15bc-4e28-b052-f40435e8752f"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:50.858824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] validate_networks() for [('22ef14ff-15bc-4e28-b052-f40435e8752f', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:50:51.045829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f04ee22-dc5a-4f62-ba4a-5895480f6dc8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:51.047384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7f04ee22-dc5a-4f62-ba4a-5895480f6dc8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:51.062333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f04ee22-dc5a-4f62-ba4a-5895480f6dc8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:51.063131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f04ee22-dc5a-4f62-ba4a-5895480f6dc8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:51.063746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f04ee22-dc5a-4f62-ba4a-5895480f6dc8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:51.064677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f04ee22-dc5a-4f62-ba4a-5895480f6dc8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:51.067194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f04ee22-dc5a-4f62-ba4a-5895480f6dc8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:51.067891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f04ee22-dc5a-4f62-ba4a-5895480f6dc8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:51.851411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7f04ee22-dc5a-4f62-ba4a-5895480f6dc8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f91a6353d4422e87067372dbd4d8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab1919232bc40d69fc3da077eda541c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:51.861360 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7f04ee22-dc5a-4f62-ba4a-5895480f6dc8 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 200 len: 1314 microversion: 2.1 time: 0.819758 Oct 18 13:50:51.867223 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3033/5863] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:51 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:51.883191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-bdd1b5e3-0f48-48f6-b3e8-fb7b07f817fb req-aea67e45-72c4-4f15-b72b-01567033609c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c799f14a-bd10-4d3f-a37d-183d613b44a1", "name": "network-vif-plugged", "status": "completed", "tag": "ed3ca940-625f-4288-9289-152f0d72f83e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:51.908859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bdd1b5e3-0f48-48f6-b3e8-fb7b07f817fb req-aea67e45-72c4-4f15-b72b-01567033609c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:51.912003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bdd1b5e3-0f48-48f6-b3e8-fb7b07f817fb req-aea67e45-72c4-4f15-b72b-01567033609c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:51.912448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bdd1b5e3-0f48-48f6-b3e8-fb7b07f817fb req-aea67e45-72c4-4f15-b72b-01567033609c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:51.937051 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-bdd1b5e3-0f48-48f6-b3e8-fb7b07f817fb req-aea67e45-72c4-4f15-b72b-01567033609c service nova] Creating event network-vif-plugged:ed3ca940-625f-4288-9289-152f0d72f83e for instance c799f14a-bd10-4d3f-a37d-183d613b44a1 on n-h2-858384-13 Oct 18 13:50:51.991778 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-bdd1b5e3-0f48-48f6-b3e8-fb7b07f817fb req-aea67e45-72c4-4f15-b72b-01567033609c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110997 Oct 18 13:50:51.995875 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3034/5864] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:52.434680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:50:52.436159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:50:52.437058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:50:52.437897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:50:52.438648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:50:52.450930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:52.452055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:52.452823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:52.454191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:52.454936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:52.455588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:52.475310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Getting quotas for project 4c27d36c3dad44ab995cd79e4b65159e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:50:52.482010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Getting quotas for user c75ac8b8eb0f459598982c40cf5d0fe7 and project 4c27d36c3dad44ab995cd79e4b65159e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:50:52.495923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:50:52.498280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:50:52.545676 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-56ebfe3a-fa70-42db-9532-e37370c235f2 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.803974 Oct 18 13:50:52.546976 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2831/5865] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:50:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:50:52.558885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d6ca716-8a82-45cc-aa6b-445522d6fcc5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:52.561988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3d6ca716-8a82-45cc-aa6b-445522d6fcc5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:52.649168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3d6ca716-8a82-45cc-aa6b-445522d6fcc5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:52.660268 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3d6ca716-8a82-45cc-aa6b-445522d6fcc5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1214 microversion: 2.1 time: 0.106117 Oct 18 13:50:52.661405 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3035/5866] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:52 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:52.891897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c3c0c778-c45a-4261-ab60-26f1bf880b4a tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:52.892983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c3c0c778-c45a-4261-ab60-26f1bf880b4a tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:52.908021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3c0c778-c45a-4261-ab60-26f1bf880b4a tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:52.908596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3c0c778-c45a-4261-ab60-26f1bf880b4a tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:52.909259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3c0c778-c45a-4261-ab60-26f1bf880b4a tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:52.911667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3c0c778-c45a-4261-ab60-26f1bf880b4a tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:52.912338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3c0c778-c45a-4261-ab60-26f1bf880b4a tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:52.912966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c3c0c778-c45a-4261-ab60-26f1bf880b4a tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:53.124636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c3c0c778-c45a-4261-ab60-26f1bf880b4a tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f91a6353d4422e87067372dbd4d8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab1919232bc40d69fc3da077eda541c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:53.132879 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c3c0c778-c45a-4261-ab60-26f1bf880b4a tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 200 len: 1314 microversion: 2.1 time: 0.246273 Oct 18 13:50:53.134953 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2832/5867] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:52 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:53.683779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3566285c-b124-462e-a68d-60a3953d6572 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:53.684437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3566285c-b124-462e-a68d-60a3953d6572 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:53.692728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3566285c-b124-462e-a68d-60a3953d6572 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:53.693229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3566285c-b124-462e-a68d-60a3953d6572 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:53.693684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3566285c-b124-462e-a68d-60a3953d6572 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:53.694393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3566285c-b124-462e-a68d-60a3953d6572 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:53.694856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3566285c-b124-462e-a68d-60a3953d6572 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:53.695288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3566285c-b124-462e-a68d-60a3953d6572 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:53.798930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3566285c-b124-462e-a68d-60a3953d6572 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:53.810020 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3566285c-b124-462e-a68d-60a3953d6572 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1266 microversion: 2.1 time: 0.129360 Oct 18 13:50:53.811592 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3036/5868] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:53 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:54.159391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-554b6ab0-ed97-414c-9ca7-8ee535a906e4 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:54.160172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-554b6ab0-ed97-414c-9ca7-8ee535a906e4 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:54.168800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-554b6ab0-ed97-414c-9ca7-8ee535a906e4 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:54.170081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-554b6ab0-ed97-414c-9ca7-8ee535a906e4 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:54.170752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-554b6ab0-ed97-414c-9ca7-8ee535a906e4 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:54.171821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-554b6ab0-ed97-414c-9ca7-8ee535a906e4 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:54.172517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-554b6ab0-ed97-414c-9ca7-8ee535a906e4 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:54.173052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-554b6ab0-ed97-414c-9ca7-8ee535a906e4 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:54.333724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-554b6ab0-ed97-414c-9ca7-8ee535a906e4 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f91a6353d4422e87067372dbd4d8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab1919232bc40d69fc3da077eda541c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:54.341737 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-554b6ab0-ed97-414c-9ca7-8ee535a906e4 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 200 len: 1498 microversion: 2.1 time: 0.186424 Oct 18 13:50:54.342593 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2833/5869] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:54 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 1498 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:54.834110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cd5bd81d-3958-45fa-9a4e-3dad30aa0993 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:54.835734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cd5bd81d-3958-45fa-9a4e-3dad30aa0993 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:54.849369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd5bd81d-3958-45fa-9a4e-3dad30aa0993 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:54.850447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd5bd81d-3958-45fa-9a4e-3dad30aa0993 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:54.857639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd5bd81d-3958-45fa-9a4e-3dad30aa0993 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:54.858591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd5bd81d-3958-45fa-9a4e-3dad30aa0993 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:54.859067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd5bd81d-3958-45fa-9a4e-3dad30aa0993 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:54.859508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd5bd81d-3958-45fa-9a4e-3dad30aa0993 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:54.998554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cd5bd81d-3958-45fa-9a4e-3dad30aa0993 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:55.011955 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cd5bd81d-3958-45fa-9a4e-3dad30aa0993 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1272 microversion: 2.1 time: 0.181962 Oct 18 13:50:55.013250 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3037/5870] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:54 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:56.034613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0b194a16-5171-4831-86db-34566a0545f0 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:56.035403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0b194a16-5171-4831-86db-34566a0545f0 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:56.047360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b194a16-5171-4831-86db-34566a0545f0 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:56.047938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b194a16-5171-4831-86db-34566a0545f0 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:56.049864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b194a16-5171-4831-86db-34566a0545f0 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:56.050822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b194a16-5171-4831-86db-34566a0545f0 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:56.051298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b194a16-5171-4831-86db-34566a0545f0 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:56.051785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b194a16-5171-4831-86db-34566a0545f0 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:56.234173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0b194a16-5171-4831-86db-34566a0545f0 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:56.242130 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0b194a16-5171-4831-86db-34566a0545f0 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1314 microversion: 2.1 time: 0.211372 Oct 18 13:50:56.245249 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2834/5871] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:56 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:57.271125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d4f60c22-581f-407a-b95b-be36ef0eba8e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:57.271796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d4f60c22-581f-407a-b95b-be36ef0eba8e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:57.279341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4f60c22-581f-407a-b95b-be36ef0eba8e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:57.280244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4f60c22-581f-407a-b95b-be36ef0eba8e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:57.281100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4f60c22-581f-407a-b95b-be36ef0eba8e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:57.282063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4f60c22-581f-407a-b95b-be36ef0eba8e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:57.282523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4f60c22-581f-407a-b95b-be36ef0eba8e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:57.283203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4f60c22-581f-407a-b95b-be36ef0eba8e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:57.652273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d4f60c22-581f-407a-b95b-be36ef0eba8e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:57.670839 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d4f60c22-581f-407a-b95b-be36ef0eba8e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1314 microversion: 2.1 time: 0.403752 Oct 18 13:50:57.671777 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3038/5872] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:57 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:57.903477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-5c677a48-eb1c-4526-95d1-dd783000d53f req-38004659-bfff-477a-b139-8897b6675fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "057154f3-919e-4384-8678-07b8e393f896", "tag": "ddfb3cc6-163c-4c6d-8e65-3494a2d8fec4"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:50:57.924163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5c677a48-eb1c-4526-95d1-dd783000d53f req-38004659-bfff-477a-b139-8897b6675fc5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:57.924637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5c677a48-eb1c-4526-95d1-dd783000d53f req-38004659-bfff-477a-b139-8897b6675fc5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:57.926891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-5c677a48-eb1c-4526-95d1-dd783000d53f req-38004659-bfff-477a-b139-8897b6675fc5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:57.951542 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-5c677a48-eb1c-4526-95d1-dd783000d53f req-38004659-bfff-477a-b139-8897b6675fc5 service nova] Creating event network-changed:ddfb3cc6-163c-4c6d-8e65-3494a2d8fec4 for instance 057154f3-919e-4384-8678-07b8e393f896 on n-h1-858384-13 Oct 18 13:50:57.970096 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-5c677a48-eb1c-4526-95d1-dd783000d53f req-38004659-bfff-477a-b139-8897b6675fc5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070898 Oct 18 13:50:57.971663 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2835/5873] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:50:58.575662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-33fa228f-09a1-4a9e-a7f1-fdd3e74b37df tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:58.578180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-33fa228f-09a1-4a9e-a7f1-fdd3e74b37df tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:58.590791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33fa228f-09a1-4a9e-a7f1-fdd3e74b37df tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:58.591542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33fa228f-09a1-4a9e-a7f1-fdd3e74b37df tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:58.592204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33fa228f-09a1-4a9e-a7f1-fdd3e74b37df tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:58.593160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33fa228f-09a1-4a9e-a7f1-fdd3e74b37df tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:58.593872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33fa228f-09a1-4a9e-a7f1-fdd3e74b37df tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:58.599723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33fa228f-09a1-4a9e-a7f1-fdd3e74b37df tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:58.636713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-33fa228f-09a1-4a9e-a7f1-fdd3e74b37df tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:50:58.697379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d1e921d4-f7b0-4621-9004-64752b82cd69 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:58.699304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d1e921d4-f7b0-4621-9004-64752b82cd69 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:58.707901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1e921d4-f7b0-4621-9004-64752b82cd69 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:58.708970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1e921d4-f7b0-4621-9004-64752b82cd69 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:58.709714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1e921d4-f7b0-4621-9004-64752b82cd69 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:58.710792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1e921d4-f7b0-4621-9004-64752b82cd69 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:58.712188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1e921d4-f7b0-4621-9004-64752b82cd69 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:58.712991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1e921d4-f7b0-4621-9004-64752b82cd69 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:58.780176 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-33fa228f-09a1-4a9e-a7f1-fdd3e74b37df tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 204 len: 0 microversion: 2.1 time: 0.208836 Oct 18 13:50:58.784350 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3039/5874] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:50:58 2022] DELETE /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:50:58.793014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5403f2f1-7f0d-490f-899b-9f46b2a103bf tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:58.794043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5403f2f1-7f0d-490f-899b-9f46b2a103bf tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:58.801943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5403f2f1-7f0d-490f-899b-9f46b2a103bf tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:58.802752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5403f2f1-7f0d-490f-899b-9f46b2a103bf tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:58.803442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5403f2f1-7f0d-490f-899b-9f46b2a103bf tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:58.804428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5403f2f1-7f0d-490f-899b-9f46b2a103bf tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:58.805315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5403f2f1-7f0d-490f-899b-9f46b2a103bf tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:58.805952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5403f2f1-7f0d-490f-899b-9f46b2a103bf tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:58.927667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d1e921d4-f7b0-4621-9004-64752b82cd69 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:58.941892 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d1e921d4-f7b0-4621-9004-64752b82cd69 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1314 microversion: 2.1 time: 0.251575 Oct 18 13:50:58.942482 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2836/5875] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:58 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:50:59.023612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5403f2f1-7f0d-490f-899b-9f46b2a103bf tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f91a6353d4422e87067372dbd4d8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab1919232bc40d69fc3da077eda541c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:50:59.026808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:50:59.036568 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5403f2f1-7f0d-490f-899b-9f46b2a103bf tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 200 len: 1504 microversion: 2.1 time: 0.250464 Oct 18 13:50:59.037905 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3040/5876] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:58 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:50:59.968119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-155a5ca4-fbdd-43eb-8b65-d7b0dd7fb917 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:50:59.968723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-155a5ca4-fbdd-43eb-8b65-d7b0dd7fb917 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:50:59.975854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-155a5ca4-fbdd-43eb-8b65-d7b0dd7fb917 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:59.976419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-155a5ca4-fbdd-43eb-8b65-d7b0dd7fb917 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:59.976864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-155a5ca4-fbdd-43eb-8b65-d7b0dd7fb917 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:50:59.977778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-155a5ca4-fbdd-43eb-8b65-d7b0dd7fb917 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:50:59.978457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-155a5ca4-fbdd-43eb-8b65-d7b0dd7fb917 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:50:59.979083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-155a5ca4-fbdd-43eb-8b65-d7b0dd7fb917 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:00.062012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3dccd971-c8ac-4771-a820-5a846f5c092f tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:00.062783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3dccd971-c8ac-4771-a820-5a846f5c092f tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:00.083190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dccd971-c8ac-4771-a820-5a846f5c092f tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:00.083699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dccd971-c8ac-4771-a820-5a846f5c092f tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:00.084145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dccd971-c8ac-4771-a820-5a846f5c092f tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:00.084897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dccd971-c8ac-4771-a820-5a846f5c092f tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:00.085382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dccd971-c8ac-4771-a820-5a846f5c092f tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:00.092853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3dccd971-c8ac-4771-a820-5a846f5c092f tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:00.332425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3dccd971-c8ac-4771-a820-5a846f5c092f tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f91a6353d4422e87067372dbd4d8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab1919232bc40d69fc3da077eda541c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:00.341508 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3dccd971-c8ac-4771-a820-5a846f5c092f tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 200 len: 1504 microversion: 2.1 time: 0.283844 Oct 18 13:51:00.342120 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3041/5877] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:00 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:00.362650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-155a5ca4-fbdd-43eb-8b65-d7b0dd7fb917 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:00.374599 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-155a5ca4-fbdd-43eb-8b65-d7b0dd7fb917 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1314 microversion: 2.1 time: 0.410350 Oct 18 13:51:00.390557 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2837/5878] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:50:59 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:00.818110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d52d3392-8c07-4a48-8bf8-121d34fdc602 req-13528b2b-736d-45e7-92ba-670bb998522d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c799f14a-bd10-4d3f-a37d-183d613b44a1", "name": "network-vif-deleted", "tag": "ed3ca940-625f-4288-9289-152f0d72f83e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:00.832772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d52d3392-8c07-4a48-8bf8-121d34fdc602 req-13528b2b-736d-45e7-92ba-670bb998522d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:00.833645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d52d3392-8c07-4a48-8bf8-121d34fdc602 req-13528b2b-736d-45e7-92ba-670bb998522d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:00.834319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d52d3392-8c07-4a48-8bf8-121d34fdc602 req-13528b2b-736d-45e7-92ba-670bb998522d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:00.846988 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d52d3392-8c07-4a48-8bf8-121d34fdc602 req-13528b2b-736d-45e7-92ba-670bb998522d service nova] Creating event network-vif-deleted:ed3ca940-625f-4288-9289-152f0d72f83e for instance c799f14a-bd10-4d3f-a37d-183d613b44a1 on n-h2-858384-13 Oct 18 13:51:00.853258 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d52d3392-8c07-4a48-8bf8-121d34fdc602 req-13528b2b-736d-45e7-92ba-670bb998522d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037987 Oct 18 13:51:00.854610 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3042/5879] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:01.377501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c08df567-904a-4b3f-a15d-6fd512c11288 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:01.379594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c08df567-904a-4b3f-a15d-6fd512c11288 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] [instance: c799f14a-bd10-4d3f-a37d-183d613b44a1] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:01.401410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-98dfc5e8-bfe3-487e-9cb6-f29ad349b1ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:01.402119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-98dfc5e8-bfe3-487e-9cb6-f29ad349b1ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:01.402876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c08df567-904a-4b3f-a15d-6fd512c11288 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:01.403437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c08df567-904a-4b3f-a15d-6fd512c11288 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:01.403880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c08df567-904a-4b3f-a15d-6fd512c11288 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:01.404590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c08df567-904a-4b3f-a15d-6fd512c11288 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:01.406060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c08df567-904a-4b3f-a15d-6fd512c11288 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:01.407557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c08df567-904a-4b3f-a15d-6fd512c11288 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:01.420039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98dfc5e8-bfe3-487e-9cb6-f29ad349b1ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:01.423723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98dfc5e8-bfe3-487e-9cb6-f29ad349b1ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:01.424404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98dfc5e8-bfe3-487e-9cb6-f29ad349b1ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:01.425657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98dfc5e8-bfe3-487e-9cb6-f29ad349b1ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:01.426126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98dfc5e8-bfe3-487e-9cb6-f29ad349b1ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:01.426558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98dfc5e8-bfe3-487e-9cb6-f29ad349b1ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:01.435129 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-c08df567-904a-4b3f-a15d-6fd512c11288 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] HTTP exception thrown: Instance c799f14a-bd10-4d3f-a37d-183d613b44a1 could not be found. Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c08df567-904a-4b3f-a15d-6fd512c11288 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Request method failure captured: Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 HTTP/1.1 Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq8qWFLteVTfWCi8p-6qTB1KCF2Ms04B34ZIH3gT_dVFVGpsMInRHfbe1fj-0PfRUkJ_4GGbuOiMVq5ZZtpwIVci2HBFVax2aWThMmL7Q9x_UKzsvIxo4Qgi2uSyV-7vXCDrUtaFfbdp1UhTjTDOJE5P1fU0DT22wjepK1hQmpxj--k Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 9ab1919232bc40d69fc3da077eda541c Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-VolumesActionsTest-2113241014 Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ab1919232bc40d69fc3da077eda541c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9ab1919232bc40d69fc3da077eda541c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9ab1919232bc40d69fc3da077eda541c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9ab1919232bc40d69fc3da077eda541c"}]}] Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-VolumesActionsTest-2113241014 Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 9ab1919232bc40d69fc3da077eda541c Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-VolumesActionsTest-2113241014 Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-VolumesActionsTest-2113241014-project Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: d9f91a6353d4422e87067372dbd4d8a7 Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-VolumesActionsTest-2113241014-project Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c799f14a-bd10-4d3f-a37d-183d613b44a1 could not be found. Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c799f14a-bd10-4d3f-a37d-183d613b44a1'} Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c799f14a-bd10-4d3f-a37d-183d613b44a1 could not be found. Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c799f14a-bd10-4d3f-a37d-183d613b44a1 could not be found. Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:01.441044 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:51:01.447895 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:01.447895 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:01.447895 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:01.447895 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:51:01.447895 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:51:01.447895 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c799f14a-bd10-4d3f-a37d-183d613b44a1 could not be found. Oct 18 13:51:01.447895 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:51:01.447895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c08df567-904a-4b3f-a15d-6fd512c11288 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] Returning 404 to user: Instance c799f14a-bd10-4d3f-a37d-183d613b44a1 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:51:01.447895 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c08df567-904a-4b3f-a15d-6fd512c11288 tempest-VolumesActionsTest-2113241014 tempest-VolumesActionsTest-2113241014-project] 10.222.0.40 "GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1" status: 404 len: 111 microversion: 2.1 time: 0.086505 Oct 18 13:51:01.450492 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2838/5880] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:01 2022] GET /compute/v2.1/servers/c799f14a-bd10-4d3f-a37d-183d613b44a1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:51:01.938982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-98dfc5e8-bfe3-487e-9cb6-f29ad349b1ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:01.954764 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-98dfc5e8-bfe3-487e-9cb6-f29ad349b1ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1314 microversion: 2.1 time: 0.557582 Oct 18 13:51:01.955804 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3043/5881] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:01 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:02.979294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:02.980632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:02.995869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-de3727b5-7991-449d-96b3-6464206004ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:02.999940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-de3727b5-7991-449d-96b3-6464206004ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:03.016361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de3727b5-7991-449d-96b3-6464206004ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:03.017449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de3727b5-7991-449d-96b3-6464206004ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:03.018588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de3727b5-7991-449d-96b3-6464206004ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:03.019675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de3727b5-7991-449d-96b3-6464206004ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:03.020351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de3727b5-7991-449d-96b3-6464206004ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:03.020995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de3727b5-7991-449d-96b3-6464206004ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:03.029572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=99 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:03.235072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-de3727b5-7991-449d-96b3-6464206004ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:03.247880 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-de3727b5-7991-449d-96b3-6464206004ba tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1314 microversion: 2.1 time: 0.271649 Oct 18 13:51:03.261134 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2839/5882] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:02 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:04.273428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-132913d3-bb15-4331-8481-9a4376cbdc96 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:04.275561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-132913d3-bb15-4331-8481-9a4376cbdc96 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:04.296626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:04.303802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-132913d3-bb15-4331-8481-9a4376cbdc96 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:04.304413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-132913d3-bb15-4331-8481-9a4376cbdc96 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:04.305050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-132913d3-bb15-4331-8481-9a4376cbdc96 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:04.311120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-132913d3-bb15-4331-8481-9a4376cbdc96 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:04.311729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-132913d3-bb15-4331-8481-9a4376cbdc96 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:04.313365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-132913d3-bb15-4331-8481-9a4376cbdc96 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:04.481462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-6fdf842f-0a2f-41ca-a45e-1746aeb1804f req-450caa13-e7e0-4d3f-ae5e-a516c1184f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057154f3-919e-4384-8678-07b8e393f896", "name": "network-vif-plugged", "status": "completed", "tag": "ddfb3cc6-163c-4c6d-8e65-3494a2d8fec4"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:04.510927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6fdf842f-0a2f-41ca-a45e-1746aeb1804f req-450caa13-e7e0-4d3f-ae5e-a516c1184f71 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:04.511741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6fdf842f-0a2f-41ca-a45e-1746aeb1804f req-450caa13-e7e0-4d3f-ae5e-a516c1184f71 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:04.513135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6fdf842f-0a2f-41ca-a45e-1746aeb1804f req-450caa13-e7e0-4d3f-ae5e-a516c1184f71 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:04.540584 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-6fdf842f-0a2f-41ca-a45e-1746aeb1804f req-450caa13-e7e0-4d3f-ae5e-a516c1184f71 service nova] Creating event network-vif-plugged:ddfb3cc6-163c-4c6d-8e65-3494a2d8fec4 for instance 057154f3-919e-4384-8678-07b8e393f896 on n-h1-858384-13 Oct 18 13:51:04.562030 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-6fdf842f-0a2f-41ca-a45e-1746aeb1804f req-450caa13-e7e0-4d3f-ae5e-a516c1184f71 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072742 Oct 18 13:51:04.563034 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2840/5883] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:04.661876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-132913d3-bb15-4331-8481-9a4376cbdc96 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:04.673272 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-132913d3-bb15-4331-8481-9a4376cbdc96 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1314 microversion: 2.1 time: 0.402972 Oct 18 13:51:04.678072 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3044/5884] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:04 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:05.703161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2f0937bb-abb9-46fe-8ef0-c0203f5bf94f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:05.708724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2f0937bb-abb9-46fe-8ef0-c0203f5bf94f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:05.728456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f0937bb-abb9-46fe-8ef0-c0203f5bf94f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:05.729325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f0937bb-abb9-46fe-8ef0-c0203f5bf94f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:05.729996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f0937bb-abb9-46fe-8ef0-c0203f5bf94f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:05.731593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f0937bb-abb9-46fe-8ef0-c0203f5bf94f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:05.732308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f0937bb-abb9-46fe-8ef0-c0203f5bf94f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:05.733677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f0937bb-abb9-46fe-8ef0-c0203f5bf94f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:06.234955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2f0937bb-abb9-46fe-8ef0-c0203f5bf94f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:06.271808 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2f0937bb-abb9-46fe-8ef0-c0203f5bf94f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1314 microversion: 2.1 time: 0.578311 Oct 18 13:51:06.274806 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2841/5885] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:05 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:07.303171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1baa928-7b35-4d36-85df-cc1b55cd3bbe tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:07.305017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1baa928-7b35-4d36-85df-cc1b55cd3bbe tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:07.313505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:07.315158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1baa928-7b35-4d36-85df-cc1b55cd3bbe tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:07.315770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1baa928-7b35-4d36-85df-cc1b55cd3bbe tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:07.316219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1baa928-7b35-4d36-85df-cc1b55cd3bbe tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:07.316933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1baa928-7b35-4d36-85df-cc1b55cd3bbe tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:07.317430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1baa928-7b35-4d36-85df-cc1b55cd3bbe tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:07.318077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1baa928-7b35-4d36-85df-cc1b55cd3bbe tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:07.491321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d1baa928-7b35-4d36-85df-cc1b55cd3bbe tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:07.507451 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d1baa928-7b35-4d36-85df-cc1b55cd3bbe tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1497 microversion: 2.1 time: 0.209122 Oct 18 13:51:07.525749 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3045/5886] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:07 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1497 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:08.999585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96f2c805-7292-4997-af6c-d40f204a9f39 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:09.000768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-96f2c805-7292-4997-af6c-d40f204a9f39 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:09.008001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:09.009509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96f2c805-7292-4997-af6c-d40f204a9f39 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:09.010238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96f2c805-7292-4997-af6c-d40f204a9f39 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:09.010858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96f2c805-7292-4997-af6c-d40f204a9f39 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:09.011773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96f2c805-7292-4997-af6c-d40f204a9f39 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:09.012419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96f2c805-7292-4997-af6c-d40f204a9f39 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:09.013019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96f2c805-7292-4997-af6c-d40f204a9f39 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:09.041296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-96f2c805-7292-4997-af6c-d40f204a9f39 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:51:09.140875 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-96f2c805-7292-4997-af6c-d40f204a9f39 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "DELETE /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 204 len: 0 microversion: 2.1 time: 0.144657 Oct 18 13:51:09.142425 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2842/5887] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:51:08 2022] DELETE /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:51:09.153517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8edad551-a61a-4827-8855-b1ccff1b4451 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:09.153517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8edad551-a61a-4827-8855-b1ccff1b4451 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:09.161976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8edad551-a61a-4827-8855-b1ccff1b4451 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:09.162579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8edad551-a61a-4827-8855-b1ccff1b4451 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:09.163505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8edad551-a61a-4827-8855-b1ccff1b4451 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:09.165578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8edad551-a61a-4827-8855-b1ccff1b4451 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:09.166518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8edad551-a61a-4827-8855-b1ccff1b4451 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:09.167170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8edad551-a61a-4827-8855-b1ccff1b4451 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:09.516715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8edad551-a61a-4827-8855-b1ccff1b4451 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:09.527949 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8edad551-a61a-4827-8855-b1ccff1b4451 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1503 microversion: 2.1 time: 0.379102 Oct 18 13:51:09.529435 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3046/5888] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:09 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1503 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:10.556269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d0f105c6-5a47-48b5-9f92-b4525d4c4c50 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:10.557321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d0f105c6-5a47-48b5-9f92-b4525d4c4c50 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:10.570099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0f105c6-5a47-48b5-9f92-b4525d4c4c50 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:10.574420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0f105c6-5a47-48b5-9f92-b4525d4c4c50 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:10.575828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0f105c6-5a47-48b5-9f92-b4525d4c4c50 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:10.577145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0f105c6-5a47-48b5-9f92-b4525d4c4c50 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:10.577677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0f105c6-5a47-48b5-9f92-b4525d4c4c50 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:10.578109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d0f105c6-5a47-48b5-9f92-b4525d4c4c50 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:10.904405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d0f105c6-5a47-48b5-9f92-b4525d4c4c50 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:10.912619 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d0f105c6-5a47-48b5-9f92-b4525d4c4c50 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1503 microversion: 2.1 time: 0.361052 Oct 18 13:51:10.913239 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2843/5889] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:10 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1503 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:11.425374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-b2bad9e3-ce01-401a-9df8-35ea94bacc1d req-d26dd31e-3330-4193-adb3-e281def74477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057154f3-919e-4384-8678-07b8e393f896", "name": "network-vif-deleted", "tag": "ddfb3cc6-163c-4c6d-8e65-3494a2d8fec4"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:11.444430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b2bad9e3-ce01-401a-9df8-35ea94bacc1d req-d26dd31e-3330-4193-adb3-e281def74477 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:11.445101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b2bad9e3-ce01-401a-9df8-35ea94bacc1d req-d26dd31e-3330-4193-adb3-e281def74477 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:11.462816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b2bad9e3-ce01-401a-9df8-35ea94bacc1d req-d26dd31e-3330-4193-adb3-e281def74477 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:11.488751 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-b2bad9e3-ce01-401a-9df8-35ea94bacc1d req-d26dd31e-3330-4193-adb3-e281def74477 service nova] Creating event network-vif-deleted:ddfb3cc6-163c-4c6d-8e65-3494a2d8fec4 for instance 057154f3-919e-4384-8678-07b8e393f896 on n-h1-858384-13 Oct 18 13:51:11.494933 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-b2bad9e3-ce01-401a-9df8-35ea94bacc1d req-d26dd31e-3330-4193-adb3-e281def74477 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075245 Oct 18 13:51:11.500626 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3047/5890] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:11.936077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:11.937332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:11.944189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:11.953730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:11.954389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:11.955320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:11.955950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:11.957770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:12.018785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:12.019546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:12.020153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:12.020897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lazy-loading 'fault' on Instance uuid 057154f3-919e-4384-8678-07b8e393f896 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:51:12.086779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:12.095316 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d7de02d-455d-4097-a336-4a2e1cf7839e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 200 len: 1304 microversion: 2.1 time: 0.163430 Oct 18 13:51:12.099155 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2844/5891] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:11 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:13.124688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-33289015-01fc-478a-ba8b-31d9c7b4601a tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:13.126210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-33289015-01fc-478a-ba8b-31d9c7b4601a tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: 057154f3-919e-4384-8678-07b8e393f896] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:13.145845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33289015-01fc-478a-ba8b-31d9c7b4601a tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:13.146737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33289015-01fc-478a-ba8b-31d9c7b4601a tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:13.146871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33289015-01fc-478a-ba8b-31d9c7b4601a tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:13.147491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33289015-01fc-478a-ba8b-31d9c7b4601a tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:13.147956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33289015-01fc-478a-ba8b-31d9c7b4601a tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:13.148418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33289015-01fc-478a-ba8b-31d9c7b4601a tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:13.191743 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-33289015-01fc-478a-ba8b-31d9c7b4601a tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] HTTP exception thrown: Instance 057154f3-919e-4384-8678-07b8e393f896 could not be found. Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-33289015-01fc-478a-ba8b-31d9c7b4601a tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Request method failure captured: Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 HTTP/1.1 Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq83Q8pjCzB0uvNTqSwy3LPtvTFPADwpv137ydMOKw-ljhavnDsbzP1bMaGlNBVd19xxzgR-mTWAnVd0v2dazj_Jn03-wwVN0uQcU5v-Su1LGj243BLp0YX0q4XnIeZnyR-gmDbmBaezq7o2Nny6SarPNSqfI1_e-sroeJvH66NUoXY Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 4c27d36c3dad44ab995cd79e4b65159e Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-VolumesActionsTest-998677188 Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c27d36c3dad44ab995cd79e4b65159e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4c27d36c3dad44ab995cd79e4b65159e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c27d36c3dad44ab995cd79e4b65159e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4c27d36c3dad44ab995cd79e4b65159e"}]}] Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-VolumesActionsTest-998677188 Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 4c27d36c3dad44ab995cd79e4b65159e Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-VolumesActionsTest-998677188 Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-VolumesActionsTest-998677188-project Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c75ac8b8eb0f459598982c40cf5d0fe7 Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-VolumesActionsTest-998677188-project Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 057154f3-919e-4384-8678-07b8e393f896 could not be found. Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '057154f3-919e-4384-8678-07b8e393f896'} Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057154f3-919e-4384-8678-07b8e393f896 could not be found. Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057154f3-919e-4384-8678-07b8e393f896 could not be found. Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:13.202073 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:51:13.209359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:13.209359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:13.209359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:13.209359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:51:13.209359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:51:13.209359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057154f3-919e-4384-8678-07b8e393f896 could not be found. Oct 18 13:51:13.209359 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:51:13.209359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-33289015-01fc-478a-ba8b-31d9c7b4601a tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Returning 404 to user: Instance 057154f3-919e-4384-8678-07b8e393f896 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:51:13.210611 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-33289015-01fc-478a-ba8b-31d9c7b4601a tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896" status: 404 len: 111 microversion: 2.1 time: 0.084939 Oct 18 13:51:13.211432 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3048/5892] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:13 2022] GET /compute/v2.1/servers/057154f3-919e-4384-8678-07b8e393f896 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:51:13.438308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-452990569", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "22ef14ff-15bc-4e28-b052-f40435e8752f"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:13.563714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] validate_networks() for [('22ef14ff-15bc-4e28-b052-f40435e8752f', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:51:14.299780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:51:14.300300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:51:14.301054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:51:14.302259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:51:14.303055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:51:14.325205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:14.325967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:14.326600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:14.328359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:14.332412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:14.333158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:14.376883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Getting quotas for project 4c27d36c3dad44ab995cd79e4b65159e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:51:14.393663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Getting quotas for user c75ac8b8eb0f459598982c40cf5d0fe7 and project 4c27d36c3dad44ab995cd79e4b65159e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:51:14.425294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:51:14.427937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:51:14.578191 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1f1dd8bd-6c37-4cc4-8b5c-79437bedef5e tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.144292 Oct 18 13:51:14.578892 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2845/5893] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:51:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:51:14.590112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a78fe571-bcb7-4783-8c61-4f04596d3d0f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:14.591284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a78fe571-bcb7-4783-8c61-4f04596d3d0f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:15.098147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a78fe571-bcb7-4783-8c61-4f04596d3d0f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:15.109089 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a78fe571-bcb7-4783-8c61-4f04596d3d0f tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 200 len: 1213 microversion: 2.1 time: 0.523076 Oct 18 13:51:15.114549 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3049/5894] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:14 2022] GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 1213 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:16.159138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-26c11b1c-0dba-444c-811e-870150b7b444 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:16.160476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-26c11b1c-0dba-444c-811e-870150b7b444 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:16.177911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26c11b1c-0dba-444c-811e-870150b7b444 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:16.183983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26c11b1c-0dba-444c-811e-870150b7b444 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:16.184641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26c11b1c-0dba-444c-811e-870150b7b444 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:16.191526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26c11b1c-0dba-444c-811e-870150b7b444 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:16.191526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26c11b1c-0dba-444c-811e-870150b7b444 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:16.191526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26c11b1c-0dba-444c-811e-870150b7b444 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:16.400923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-26c11b1c-0dba-444c-811e-870150b7b444 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:16.410004 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-26c11b1c-0dba-444c-811e-870150b7b444 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 200 len: 1283 microversion: 2.1 time: 0.278964 Oct 18 13:51:16.411949 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2846/5895] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:16 2022] GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 1283 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:17.437746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a3902be4-4d2b-40be-b344-39fc6f206cf5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:17.439731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a3902be4-4d2b-40be-b344-39fc6f206cf5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:17.455386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3902be4-4d2b-40be-b344-39fc6f206cf5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:17.455909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3902be4-4d2b-40be-b344-39fc6f206cf5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:17.456560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3902be4-4d2b-40be-b344-39fc6f206cf5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:17.460075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3902be4-4d2b-40be-b344-39fc6f206cf5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:17.461568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3902be4-4d2b-40be-b344-39fc6f206cf5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:17.463150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a3902be4-4d2b-40be-b344-39fc6f206cf5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:18.284706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a3902be4-4d2b-40be-b344-39fc6f206cf5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:18.296639 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a3902be4-4d2b-40be-b344-39fc6f206cf5 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 200 len: 1313 microversion: 2.1 time: 0.861525 Oct 18 13:51:18.310206 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3050/5896] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:17 2022] GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 1313 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:18.722214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-2f20ae55-9585-4b4e-b9e5-5db71a6a8df8 req-e40b63a5-370f-432e-afe1-c180a5d6a12f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6564acd-3a96-4971-b317-dd1500cf4e45", "tag": "67785619-86da-46d2-8613-f8d345b5a076"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:18.748650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2f20ae55-9585-4b4e-b9e5-5db71a6a8df8 req-e40b63a5-370f-432e-afe1-c180a5d6a12f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:18.761124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2f20ae55-9585-4b4e-b9e5-5db71a6a8df8 req-e40b63a5-370f-432e-afe1-c180a5d6a12f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:18.761708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2f20ae55-9585-4b4e-b9e5-5db71a6a8df8 req-e40b63a5-370f-432e-afe1-c180a5d6a12f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:18.799693 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-2f20ae55-9585-4b4e-b9e5-5db71a6a8df8 req-e40b63a5-370f-432e-afe1-c180a5d6a12f service nova] Creating event network-changed:67785619-86da-46d2-8613-f8d345b5a076 for instance a6564acd-3a96-4971-b317-dd1500cf4e45 on n-h2-858384-13 Oct 18 13:51:18.813079 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-2f20ae55-9585-4b4e-b9e5-5db71a6a8df8 req-e40b63a5-370f-432e-afe1-c180a5d6a12f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095648 Oct 18 13:51:18.817032 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2847/5897] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:19.327796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-065aa3ba-8ec0-48dc-993d-af681ec7f741 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:19.328530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-065aa3ba-8ec0-48dc-993d-af681ec7f741 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:19.353655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-065aa3ba-8ec0-48dc-993d-af681ec7f741 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:19.358017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-065aa3ba-8ec0-48dc-993d-af681ec7f741 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:19.358669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-065aa3ba-8ec0-48dc-993d-af681ec7f741 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:19.366107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-065aa3ba-8ec0-48dc-993d-af681ec7f741 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:19.367502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-065aa3ba-8ec0-48dc-993d-af681ec7f741 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:19.374207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-065aa3ba-8ec0-48dc-993d-af681ec7f741 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:20.000008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-065aa3ba-8ec0-48dc-993d-af681ec7f741 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:20.063743 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-065aa3ba-8ec0-48dc-993d-af681ec7f741 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 200 len: 1313 microversion: 2.1 time: 0.740097 Oct 18 13:51:20.078708 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3051/5898] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:19 2022] GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 1313 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:21.099015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b35a8c22-ec28-491a-af54-01f54f495f08 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:21.100511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b35a8c22-ec28-491a-af54-01f54f495f08 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:21.155455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b35a8c22-ec28-491a-af54-01f54f495f08 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:21.159915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b35a8c22-ec28-491a-af54-01f54f495f08 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:21.166203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b35a8c22-ec28-491a-af54-01f54f495f08 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:21.167277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b35a8c22-ec28-491a-af54-01f54f495f08 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:21.169953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b35a8c22-ec28-491a-af54-01f54f495f08 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:21.170609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b35a8c22-ec28-491a-af54-01f54f495f08 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:21.781214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b35a8c22-ec28-491a-af54-01f54f495f08 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:21.796219 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b35a8c22-ec28-491a-af54-01f54f495f08 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 200 len: 1313 microversion: 2.1 time: 0.708241 Oct 18 13:51:21.822042 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2848/5899] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:21 2022] GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 1313 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:22.831799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-238ecf9d-a3c2-4b77-b7d9-de73e6aaae49 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:22.833034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-238ecf9d-a3c2-4b77-b7d9-de73e6aaae49 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:22.841025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-238ecf9d-a3c2-4b77-b7d9-de73e6aaae49 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:22.841785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-238ecf9d-a3c2-4b77-b7d9-de73e6aaae49 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:22.842415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-238ecf9d-a3c2-4b77-b7d9-de73e6aaae49 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:22.843356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-238ecf9d-a3c2-4b77-b7d9-de73e6aaae49 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:22.844695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-238ecf9d-a3c2-4b77-b7d9-de73e6aaae49 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:22.845329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-238ecf9d-a3c2-4b77-b7d9-de73e6aaae49 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:23.119645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-238ecf9d-a3c2-4b77-b7d9-de73e6aaae49 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:23.128424 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-238ecf9d-a3c2-4b77-b7d9-de73e6aaae49 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 200 len: 1313 microversion: 2.1 time: 0.300661 Oct 18 13:51:23.129021 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3052/5900] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:22 2022] GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:24.155263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-28c96132-946d-42ef-9293-c42c1c82dfca tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:24.156028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-28c96132-946d-42ef-9293-c42c1c82dfca tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:24.170680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28c96132-946d-42ef-9293-c42c1c82dfca tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:24.171182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28c96132-946d-42ef-9293-c42c1c82dfca tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:24.171628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28c96132-946d-42ef-9293-c42c1c82dfca tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:24.172347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28c96132-946d-42ef-9293-c42c1c82dfca tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:24.172808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28c96132-946d-42ef-9293-c42c1c82dfca tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:24.190914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-28c96132-946d-42ef-9293-c42c1c82dfca tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:24.344800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:24.413091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:24.485618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-28c96132-946d-42ef-9293-c42c1c82dfca tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:24.497459 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-28c96132-946d-42ef-9293-c42c1c82dfca tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 200 len: 1313 microversion: 2.1 time: 0.346181 Oct 18 13:51:24.498553 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2849/5901] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:24 2022] GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:25.467846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-744fad2b-8b11-43d8-81e5-f30750469acd req-a05d397f-3079-40c6-80e9-bc18e9eb85bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6564acd-3a96-4971-b317-dd1500cf4e45", "name": "network-vif-plugged", "status": "completed", "tag": "67785619-86da-46d2-8613-f8d345b5a076"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:25.486422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:25.498853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-744fad2b-8b11-43d8-81e5-f30750469acd req-a05d397f-3079-40c6-80e9-bc18e9eb85bf service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:25.501007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-744fad2b-8b11-43d8-81e5-f30750469acd req-a05d397f-3079-40c6-80e9-bc18e9eb85bf service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:25.501655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-744fad2b-8b11-43d8-81e5-f30750469acd req-a05d397f-3079-40c6-80e9-bc18e9eb85bf service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:25.525278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-80160436-19b7-4a6c-ab4b-b6f859fbb09c tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:25.526798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-80160436-19b7-4a6c-ab4b-b6f859fbb09c tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:25.548065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80160436-19b7-4a6c-ab4b-b6f859fbb09c tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:25.550891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80160436-19b7-4a6c-ab4b-b6f859fbb09c tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:25.551379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80160436-19b7-4a6c-ab4b-b6f859fbb09c tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:25.552641 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-744fad2b-8b11-43d8-81e5-f30750469acd req-a05d397f-3079-40c6-80e9-bc18e9eb85bf service nova] Creating event network-vif-plugged:67785619-86da-46d2-8613-f8d345b5a076 for instance a6564acd-3a96-4971-b317-dd1500cf4e45 on n-h2-858384-13 Oct 18 13:51:25.553227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80160436-19b7-4a6c-ab4b-b6f859fbb09c tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:25.553699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80160436-19b7-4a6c-ab4b-b6f859fbb09c tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:25.555755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80160436-19b7-4a6c-ab4b-b6f859fbb09c tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:25.572481 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-744fad2b-8b11-43d8-81e5-f30750469acd req-a05d397f-3079-40c6-80e9-bc18e9eb85bf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109642 Oct 18 13:51:25.575236 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3053/5902] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:25.900597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-80160436-19b7-4a6c-ab4b-b6f859fbb09c tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:25.908565 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-80160436-19b7-4a6c-ab4b-b6f859fbb09c tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 200 len: 1313 microversion: 2.1 time: 0.388919 Oct 18 13:51:25.909160 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2850/5903] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:25 2022] GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:51:26.939421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f0a5a237-2b02-4577-8668-a96b089139bc tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:26.941074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f0a5a237-2b02-4577-8668-a96b089139bc tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:26.986011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0a5a237-2b02-4577-8668-a96b089139bc tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:26.990390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0a5a237-2b02-4577-8668-a96b089139bc tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:26.993664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0a5a237-2b02-4577-8668-a96b089139bc tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:26.994359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0a5a237-2b02-4577-8668-a96b089139bc tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:27.000750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0a5a237-2b02-4577-8668-a96b089139bc tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:27.001233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0a5a237-2b02-4577-8668-a96b089139bc tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:27.305030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f0a5a237-2b02-4577-8668-a96b089139bc tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:27.322233 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f0a5a237-2b02-4577-8668-a96b089139bc tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 200 len: 1313 microversion: 2.1 time: 0.383559 Oct 18 13:51:27.322867 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3054/5904] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:26 2022] GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:28.350631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-866f46c9-3954-48c1-a1be-e309ccd5862d tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:28.352949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-866f46c9-3954-48c1-a1be-e309ccd5862d tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:28.370790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-866f46c9-3954-48c1-a1be-e309ccd5862d tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:28.372946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-866f46c9-3954-48c1-a1be-e309ccd5862d tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:28.375323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-866f46c9-3954-48c1-a1be-e309ccd5862d tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:28.376497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-866f46c9-3954-48c1-a1be-e309ccd5862d tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:28.378951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-866f46c9-3954-48c1-a1be-e309ccd5862d tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:28.379670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-866f46c9-3954-48c1-a1be-e309ccd5862d tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:28.733612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-866f46c9-3954-48c1-a1be-e309ccd5862d tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:28.755253 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-866f46c9-3954-48c1-a1be-e309ccd5862d tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 200 len: 1495 microversion: 2.1 time: 0.409382 Oct 18 13:51:28.756431 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2851/5905] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:28 2022] GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 1495 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:29.978171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9ed0a8d3-0730-4b0c-9f84-1b4867eabd20 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:29.979648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9ed0a8d3-0730-4b0c-9f84-1b4867eabd20 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:30.011331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ed0a8d3-0730-4b0c-9f84-1b4867eabd20 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:30.015834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ed0a8d3-0730-4b0c-9f84-1b4867eabd20 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:30.016616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ed0a8d3-0730-4b0c-9f84-1b4867eabd20 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:30.017602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ed0a8d3-0730-4b0c-9f84-1b4867eabd20 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:30.018253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ed0a8d3-0730-4b0c-9f84-1b4867eabd20 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:30.018933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9ed0a8d3-0730-4b0c-9f84-1b4867eabd20 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:30.099771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=64 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:30.107886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9ed0a8d3-0730-4b0c-9f84-1b4867eabd20 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:51:30.338895 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9ed0a8d3-0730-4b0c-9f84-1b4867eabd20 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 204 len: 0 microversion: 2.1 time: 0.366662 Oct 18 13:51:30.348680 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3055/5906] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:51:29 2022] DELETE /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:51:30.366949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ff91b44b-1844-438f-907b-9573e5e63660 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:30.367651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ff91b44b-1844-438f-907b-9573e5e63660 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:30.397216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff91b44b-1844-438f-907b-9573e5e63660 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:30.405582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff91b44b-1844-438f-907b-9573e5e63660 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:30.406368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff91b44b-1844-438f-907b-9573e5e63660 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:30.407359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff91b44b-1844-438f-907b-9573e5e63660 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:30.408005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff91b44b-1844-438f-907b-9573e5e63660 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:30.408603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff91b44b-1844-438f-907b-9573e5e63660 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:30.775483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ff91b44b-1844-438f-907b-9573e5e63660 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:30.786093 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ff91b44b-1844-438f-907b-9573e5e63660 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 200 len: 1501 microversion: 2.1 time: 0.423247 Oct 18 13:51:30.786784 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2852/5907] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:30 2022] GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 1501 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:31.814108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-efc757a6-87f0-4beb-9ac1-bc5a14e6510b tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:31.815734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-efc757a6-87f0-4beb-9ac1-bc5a14e6510b tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:31.837499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efc757a6-87f0-4beb-9ac1-bc5a14e6510b tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:31.838532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efc757a6-87f0-4beb-9ac1-bc5a14e6510b tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:31.839161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efc757a6-87f0-4beb-9ac1-bc5a14e6510b tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:31.841264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efc757a6-87f0-4beb-9ac1-bc5a14e6510b tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:31.841918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efc757a6-87f0-4beb-9ac1-bc5a14e6510b tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:31.842704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-efc757a6-87f0-4beb-9ac1-bc5a14e6510b tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:32.586419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-603987e2-933b-407e-af46-bffd8081ab2d req-ecc57fe9-9299-430e-b3ba-c5ea29bd7501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6564acd-3a96-4971-b317-dd1500cf4e45", "name": "network-vif-deleted", "tag": "67785619-86da-46d2-8613-f8d345b5a076"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:32.609223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-603987e2-933b-407e-af46-bffd8081ab2d req-ecc57fe9-9299-430e-b3ba-c5ea29bd7501 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:32.609743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-603987e2-933b-407e-af46-bffd8081ab2d req-ecc57fe9-9299-430e-b3ba-c5ea29bd7501 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:32.612162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-603987e2-933b-407e-af46-bffd8081ab2d req-ecc57fe9-9299-430e-b3ba-c5ea29bd7501 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:32.625561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-efc757a6-87f0-4beb-9ac1-bc5a14e6510b tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75ac8b8eb0f459598982c40cf5d0fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c27d36c3dad44ab995cd79e4b65159e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:51:32.657811 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-efc757a6-87f0-4beb-9ac1-bc5a14e6510b tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 200 len: 1501 microversion: 2.1 time: 0.837152 Oct 18 13:51:32.660294 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3056/5908] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:31 2022] GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 1501 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:51:32.676459 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-603987e2-933b-407e-af46-bffd8081ab2d req-ecc57fe9-9299-430e-b3ba-c5ea29bd7501 service nova] Creating event network-vif-deleted:67785619-86da-46d2-8613-f8d345b5a076 for instance a6564acd-3a96-4971-b317-dd1500cf4e45 on n-h2-858384-13 Oct 18 13:51:32.691196 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-603987e2-933b-407e-af46-bffd8081ab2d req-ecc57fe9-9299-430e-b3ba-c5ea29bd7501 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109278 Oct 18 13:51:32.692193 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2853/5909] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:33.691287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a63d6c26-6e6b-4a96-bb90-a49dc5443733 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:33.692096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a63d6c26-6e6b-4a96-bb90-a49dc5443733 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] [instance: a6564acd-3a96-4971-b317-dd1500cf4e45] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:33.708422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a63d6c26-6e6b-4a96-bb90-a49dc5443733 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:33.711194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a63d6c26-6e6b-4a96-bb90-a49dc5443733 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:33.713251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a63d6c26-6e6b-4a96-bb90-a49dc5443733 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:33.715414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a63d6c26-6e6b-4a96-bb90-a49dc5443733 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:33.716094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a63d6c26-6e6b-4a96-bb90-a49dc5443733 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:33.718138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a63d6c26-6e6b-4a96-bb90-a49dc5443733 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:33.751814 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-a63d6c26-6e6b-4a96-bb90-a49dc5443733 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] HTTP exception thrown: Instance a6564acd-3a96-4971-b317-dd1500cf4e45 could not be found. Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a63d6c26-6e6b-4a96-bb90-a49dc5443733 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Request method failure captured: Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 HTTP/1.1 Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq83Q8pjCzB0uvNTqSwy3LPtvTFPADwpv137ydMOKw-ljhavnDsbzP1bMaGlNBVd19xxzgR-mTWAnVd0v2dazj_Jn03-wwVN0uQcU5v-Su1LGj243BLp0YX0q4XnIeZnyR-gmDbmBaezq7o2Nny6SarPNSqfI1_e-sroeJvH66NUoXY Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 4c27d36c3dad44ab995cd79e4b65159e Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-VolumesActionsTest-998677188 Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c27d36c3dad44ab995cd79e4b65159e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4c27d36c3dad44ab995cd79e4b65159e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4c27d36c3dad44ab995cd79e4b65159e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4c27d36c3dad44ab995cd79e4b65159e"}]}] Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-VolumesActionsTest-998677188 Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 4c27d36c3dad44ab995cd79e4b65159e Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-VolumesActionsTest-998677188 Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-VolumesActionsTest-998677188-project Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c75ac8b8eb0f459598982c40cf5d0fe7 Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-VolumesActionsTest-998677188-project Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance a6564acd-3a96-4971-b317-dd1500cf4e45 could not be found. Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'a6564acd-3a96-4971-b317-dd1500cf4e45'} Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6564acd-3a96-4971-b317-dd1500cf4e45 could not be found. Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6564acd-3a96-4971-b317-dd1500cf4e45 could not be found. Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:51:33.755749 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:51:33.761786 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:51:33.761786 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:51:33.761786 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:51:33.761786 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:51:33.761786 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:51:33.761786 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6564acd-3a96-4971-b317-dd1500cf4e45 could not be found. Oct 18 13:51:33.761786 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:51:33.761786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a63d6c26-6e6b-4a96-bb90-a49dc5443733 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] Returning 404 to user: Instance a6564acd-3a96-4971-b317-dd1500cf4e45 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:51:33.761786 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a63d6c26-6e6b-4a96-bb90-a49dc5443733 tempest-VolumesActionsTest-998677188 tempest-VolumesActionsTest-998677188-project] 10.222.0.40 "GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45" status: 404 len: 111 microversion: 2.1 time: 0.072979 Oct 18 13:51:33.762452 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3057/5910] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:51:33 2022] GET /compute/v2.1/servers/a6564acd-3a96-4971-b317-dd1500cf4e45 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:51:53.379063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f223a5b8-2f39-4f7c-b96c-24d22b70f52a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:51:53.383407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f223a5b8-2f39-4f7c-b96c-24d22b70f52a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:53.396004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:53.414107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:53.436431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f223a5b8-2f39-4f7c-b96c-24d22b70f52a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:53.438715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f223a5b8-2f39-4f7c-b96c-24d22b70f52a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:53.439840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f223a5b8-2f39-4f7c-b96c-24d22b70f52a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:53.447419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f223a5b8-2f39-4f7c-b96c-24d22b70f52a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:53.448795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f223a5b8-2f39-4f7c-b96c-24d22b70f52a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:53.450174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f223a5b8-2f39-4f7c-b96c-24d22b70f52a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:53.608750 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f223a5b8-2f39-4f7c-b96c-24d22b70f52a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/ips" status: 200 len: 150 microversion: 2.1 time: 0.242722 Oct 18 13:51:53.624196 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2854/5911] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:51:53 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/ips => generated 150 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:51:56.854373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1b5a4c26-35a8-4b6a-b681-989d40c2f7c5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81fbf640-39f4-4a58-89e2-3e0765652de3"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:51:56.858608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1b5a4c26-35a8-4b6a-b681-989d40c2f7c5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:51:56.862810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:56.863789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:51:56.896166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b5a4c26-35a8-4b6a-b681-989d40c2f7c5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:56.897603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b5a4c26-35a8-4b6a-b681-989d40c2f7c5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:56.898733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b5a4c26-35a8-4b6a-b681-989d40c2f7c5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:56.903309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b5a4c26-35a8-4b6a-b681-989d40c2f7c5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:51:56.904125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b5a4c26-35a8-4b6a-b681-989d40c2f7c5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:51:56.906028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b5a4c26-35a8-4b6a-b681-989d40c2f7c5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:51:57.634235 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1b5a4c26-35a8-4b6a-b681-989d40c2f7c5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "POST /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.778219 Oct 18 13:51:57.637224 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3058/5912] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:51:56 2022] POST /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments => generated 194 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:17.641163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-52f9216f-958d-4cb7-9288-52d5abc7c382 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:17.641869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-52f9216f-958d-4cb7-9288-52d5abc7c382 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:17.655496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:17.656213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:17.658796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52f9216f-958d-4cb7-9288-52d5abc7c382 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:17.659306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52f9216f-958d-4cb7-9288-52d5abc7c382 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:17.659772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52f9216f-958d-4cb7-9288-52d5abc7c382 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:17.663058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52f9216f-958d-4cb7-9288-52d5abc7c382 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:17.663549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52f9216f-958d-4cb7-9288-52d5abc7c382 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:17.663995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52f9216f-958d-4cb7-9288-52d5abc7c382 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:17.993806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-52f9216f-958d-4cb7-9288-52d5abc7c382 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lazy-loading 'services' on Instance uuid f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:52:18.144495 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-52f9216f-958d-4cb7-9288-52d5abc7c382 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments/81fbf640-39f4-4a58-89e2-3e0765652de3" status: 202 len: 0 microversion: 2.1 time: 0.507730 Oct 18 13:52:18.146630 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2855/5913] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:52:17 2022] DELETE /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments/81fbf640-39f4-4a58-89e2-3e0765652de3 => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:52:18.164396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-247b8e36-618a-49fa-bc0f-ffa49d88f987 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:18.169984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-247b8e36-618a-49fa-bc0f-ffa49d88f987 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:18.192057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:18.196014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:18.200898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-247b8e36-618a-49fa-bc0f-ffa49d88f987 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:18.203689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-247b8e36-618a-49fa-bc0f-ffa49d88f987 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:18.206070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-247b8e36-618a-49fa-bc0f-ffa49d88f987 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:18.208979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-247b8e36-618a-49fa-bc0f-ffa49d88f987 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:18.211310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-247b8e36-618a-49fa-bc0f-ffa49d88f987 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:18.212001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-247b8e36-618a-49fa-bc0f-ffa49d88f987 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:18.395426 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-247b8e36-618a-49fa-bc0f-ffa49d88f987 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.241583 Oct 18 13:52:18.399242 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3059/5914] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:52:18 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments => generated 197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:19.415676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c4b9241-cff3-42e4-95ed-b255b2e69408 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:19.421817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7c4b9241-cff3-42e4-95ed-b255b2e69408 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:19.446249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c4b9241-cff3-42e4-95ed-b255b2e69408 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:19.447389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c4b9241-cff3-42e4-95ed-b255b2e69408 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:19.449355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c4b9241-cff3-42e4-95ed-b255b2e69408 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:19.450419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c4b9241-cff3-42e4-95ed-b255b2e69408 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:19.452560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c4b9241-cff3-42e4-95ed-b255b2e69408 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:19.453254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c4b9241-cff3-42e4-95ed-b255b2e69408 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:19.566473 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7c4b9241-cff3-42e4-95ed-b255b2e69408 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160204 Oct 18 13:52:19.575728 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2856/5915] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:52:19 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:20.590622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f37a9263-b08d-4447-b037-83fbc632fa12 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:20.593914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f37a9263-b08d-4447-b037-83fbc632fa12 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:20.617983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f37a9263-b08d-4447-b037-83fbc632fa12 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:20.619370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f37a9263-b08d-4447-b037-83fbc632fa12 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:20.620004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f37a9263-b08d-4447-b037-83fbc632fa12 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:20.620924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f37a9263-b08d-4447-b037-83fbc632fa12 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:20.622130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f37a9263-b08d-4447-b037-83fbc632fa12 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:20.622785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f37a9263-b08d-4447-b037-83fbc632fa12 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:20.677887 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f37a9263-b08d-4447-b037-83fbc632fa12 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093199 Oct 18 13:52:20.692339 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3060/5916] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:52:20 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:21.702888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a5bf5389-01af-4562-b7c2-ab470e87e957 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:21.707085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a5bf5389-01af-4562-b7c2-ab470e87e957 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:21.733383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5bf5389-01af-4562-b7c2-ab470e87e957 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:21.734172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5bf5389-01af-4562-b7c2-ab470e87e957 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:21.735007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5bf5389-01af-4562-b7c2-ab470e87e957 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:21.737005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5bf5389-01af-4562-b7c2-ab470e87e957 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:21.737838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5bf5389-01af-4562-b7c2-ab470e87e957 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:21.741725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5bf5389-01af-4562-b7c2-ab470e87e957 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:21.793384 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a5bf5389-01af-4562-b7c2-ab470e87e957 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097308 Oct 18 13:52:21.798444 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2857/5917] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:52:21 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:22.806410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-47745f92-cef8-4497-a07b-ce6682e8f612 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:22.808724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-47745f92-cef8-4497-a07b-ce6682e8f612 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:22.823021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47745f92-cef8-4497-a07b-ce6682e8f612 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:22.825504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47745f92-cef8-4497-a07b-ce6682e8f612 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:22.827414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47745f92-cef8-4497-a07b-ce6682e8f612 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:22.828490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47745f92-cef8-4497-a07b-ce6682e8f612 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:22.831577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47745f92-cef8-4497-a07b-ce6682e8f612 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:22.832205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-47745f92-cef8-4497-a07b-ce6682e8f612 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:22.925379 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-47745f92-cef8-4497-a07b-ce6682e8f612 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104430 Oct 18 13:52:22.931626 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3061/5918] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:52:22 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:23.939855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-46757627-8880-4f67-b353-2964fb053be8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:23.942509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-46757627-8880-4f67-b353-2964fb053be8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:23.973343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46757627-8880-4f67-b353-2964fb053be8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:23.974954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46757627-8880-4f67-b353-2964fb053be8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:23.975598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46757627-8880-4f67-b353-2964fb053be8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:23.976560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46757627-8880-4f67-b353-2964fb053be8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:23.977847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46757627-8880-4f67-b353-2964fb053be8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:23.980863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46757627-8880-4f67-b353-2964fb053be8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:24.102394 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-46757627-8880-4f67-b353-2964fb053be8 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168000 Oct 18 13:52:24.109337 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2858/5919] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:52:23 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:25.116202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-347d5f6e-b83b-4dc3-b9ac-3bd32951cc3a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:25.118610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-347d5f6e-b83b-4dc3-b9ac-3bd32951cc3a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:25.139292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-347d5f6e-b83b-4dc3-b9ac-3bd32951cc3a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:25.144946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-347d5f6e-b83b-4dc3-b9ac-3bd32951cc3a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:25.146497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-347d5f6e-b83b-4dc3-b9ac-3bd32951cc3a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:25.150878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-347d5f6e-b83b-4dc3-b9ac-3bd32951cc3a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:25.151620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-347d5f6e-b83b-4dc3-b9ac-3bd32951cc3a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:25.152203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-347d5f6e-b83b-4dc3-b9ac-3bd32951cc3a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:25.274519 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-347d5f6e-b83b-4dc3-b9ac-3bd32951cc3a tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162858 Oct 18 13:52:25.281990 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3062/5920] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:52:25 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:26.298969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-912c1187-08de-467e-a01a-051b9e6e3574 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:26.301511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-912c1187-08de-467e-a01a-051b9e6e3574 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:26.326059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912c1187-08de-467e-a01a-051b9e6e3574 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:26.326546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912c1187-08de-467e-a01a-051b9e6e3574 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:26.326993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912c1187-08de-467e-a01a-051b9e6e3574 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:26.327705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912c1187-08de-467e-a01a-051b9e6e3574 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:26.328164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912c1187-08de-467e-a01a-051b9e6e3574 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:26.328594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912c1187-08de-467e-a01a-051b9e6e3574 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:26.398317 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-912c1187-08de-467e-a01a-051b9e6e3574 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110511 Oct 18 13:52:26.399142 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2859/5921] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 13:52:26 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 13:52:26.489169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c26302bb-210c-45f8-a5a5-39d084aed3cd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:26.489712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c26302bb-210c-45f8-a5a5-39d084aed3cd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:26.504299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c26302bb-210c-45f8-a5a5-39d084aed3cd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:26.504854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c26302bb-210c-45f8-a5a5-39d084aed3cd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:26.505329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c26302bb-210c-45f8-a5a5-39d084aed3cd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:26.506154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c26302bb-210c-45f8-a5a5-39d084aed3cd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:26.509072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c26302bb-210c-45f8-a5a5-39d084aed3cd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:26.511392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c26302bb-210c-45f8-a5a5-39d084aed3cd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:26.584726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c26302bb-210c-45f8-a5a5-39d084aed3cd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:52:26.737683 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c26302bb-210c-45f8-a5a5-39d084aed3cd tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 204 len: 0 microversion: 2.1 time: 0.252831 Oct 18 13:52:26.739725 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3063/5922] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:52:26 2022] DELETE /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:52:26.750400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-52fd9d64-e568-4138-ad7e-4d1d07f186ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:26.751340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-52fd9d64-e568-4138-ad7e-4d1d07f186ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:26.780399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52fd9d64-e568-4138-ad7e-4d1d07f186ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:26.781194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52fd9d64-e568-4138-ad7e-4d1d07f186ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:26.782010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52fd9d64-e568-4138-ad7e-4d1d07f186ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:26.782957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52fd9d64-e568-4138-ad7e-4d1d07f186ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:26.783608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52fd9d64-e568-4138-ad7e-4d1d07f186ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:26.784228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52fd9d64-e568-4138-ad7e-4d1d07f186ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:27.264772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-52fd9d64-e568-4138-ad7e-4d1d07f186ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:27.300445 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-52fd9d64-e568-4138-ad7e-4d1d07f186ce tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1683 microversion: 2.1 time: 0.555813 Oct 18 13:52:27.313822 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2860/5923] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:26 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1683 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:28.338266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4ff458db-032a-446c-89dc-76e5e6869d29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:28.339000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4ff458db-032a-446c-89dc-76e5e6869d29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:28.403155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ff458db-032a-446c-89dc-76e5e6869d29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:28.403663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ff458db-032a-446c-89dc-76e5e6869d29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:28.404112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ff458db-032a-446c-89dc-76e5e6869d29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:28.404841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ff458db-032a-446c-89dc-76e5e6869d29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:28.421978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ff458db-032a-446c-89dc-76e5e6869d29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:28.428584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ff458db-032a-446c-89dc-76e5e6869d29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:28.883533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4ff458db-032a-446c-89dc-76e5e6869d29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:28.895370 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4ff458db-032a-446c-89dc-76e5e6869d29 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1683 microversion: 2.1 time: 0.569458 Oct 18 13:52:28.896559 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3064/5924] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:28 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1683 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:29.922228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-da4c515a-19bf-48a8-b848-56d8a20f9c88 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:29.922975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-da4c515a-19bf-48a8-b848-56d8a20f9c88 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:29.944820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da4c515a-19bf-48a8-b848-56d8a20f9c88 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:29.946770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da4c515a-19bf-48a8-b848-56d8a20f9c88 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:29.949522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da4c515a-19bf-48a8-b848-56d8a20f9c88 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:29.953336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da4c515a-19bf-48a8-b848-56d8a20f9c88 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:29.954194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da4c515a-19bf-48a8-b848-56d8a20f9c88 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:29.958287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da4c515a-19bf-48a8-b848-56d8a20f9c88 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:30.403894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-da4c515a-19bf-48a8-b848-56d8a20f9c88 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:30.420471 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-da4c515a-19bf-48a8-b848-56d8a20f9c88 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1683 microversion: 2.1 time: 0.502270 Oct 18 13:52:30.425269 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2861/5925] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:29 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1683 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:30.903464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8006c647-d35e-4c68-b06b-4d112fcf19cc req-0c76ad84-05d0-4cb4-af63-7867f58fc012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb", "name": "network-vif-deleted", "tag": "a2f62c2b-76f7-413f-a593-8fdae2e2e9dd"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:30.938650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8006c647-d35e-4c68-b06b-4d112fcf19cc req-0c76ad84-05d0-4cb4-af63-7867f58fc012 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:30.945731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8006c647-d35e-4c68-b06b-4d112fcf19cc req-0c76ad84-05d0-4cb4-af63-7867f58fc012 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:30.948422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8006c647-d35e-4c68-b06b-4d112fcf19cc req-0c76ad84-05d0-4cb4-af63-7867f58fc012 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:31.009406 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8006c647-d35e-4c68-b06b-4d112fcf19cc req-0c76ad84-05d0-4cb4-af63-7867f58fc012 service nova] Creating event network-vif-deleted:a2f62c2b-76f7-413f-a593-8fdae2e2e9dd for instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb on n-h1-858384-13 Oct 18 13:52:31.031284 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8006c647-d35e-4c68-b06b-4d112fcf19cc req-0c76ad84-05d0-4cb4-af63-7867f58fc012 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124262 Oct 18 13:52:31.036380 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3065/5926] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:31.448626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:31.449327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:31.469640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:31.470056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:31.473035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:31.474667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:31.475248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:31.479108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:31.578165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:31.579225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:31.580963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:31.581478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lazy-loading 'fault' on Instance uuid f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:52:31.788662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fdfb4e43ca40eabb58abe0e9bd4ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b134786f443e4760b57d3cb5842daa89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:52:31.805249 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a7501e13-0249-4866-b218-93a115f8146c tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 200 len: 1332 microversion: 2.1 time: 0.361855 Oct 18 13:52:31.812998 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2862/5927] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:31 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 1332 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:52:32.839845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1635a6b1-d95f-4d13-beaf-385b5428903e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:32.840600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1635a6b1-d95f-4d13-beaf-385b5428903e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:32.873601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1635a6b1-d95f-4d13-beaf-385b5428903e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:32.880177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1635a6b1-d95f-4d13-beaf-385b5428903e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:32.882256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1635a6b1-d95f-4d13-beaf-385b5428903e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:32.882945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1635a6b1-d95f-4d13-beaf-385b5428903e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:32.883434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1635a6b1-d95f-4d13-beaf-385b5428903e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:32.883874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1635a6b1-d95f-4d13-beaf-385b5428903e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:32.956437 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-1635a6b1-d95f-4d13-beaf-385b5428903e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1635a6b1-d95f-4d13-beaf-385b5428903e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb HTTP/1.1 Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb'} Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:32.967502 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:52:32.970920 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:32.970920 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:32.970920 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:32.970920 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:52:32.970920 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:52:32.970920 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:32.970920 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:52:32.970920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1635a6b1-d95f-4d13-beaf-385b5428903e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 404 to user: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:52:32.970920 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1635a6b1-d95f-4d13-beaf-385b5428903e tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 404 len: 111 microversion: 2.1 time: 0.135275 Oct 18 13:52:32.974035 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3066/5928] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:32 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:52:32.982873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0eae9a86-fc73-40ff-acd0-e65a45da1951 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '.version_select at 0x7ff60f888820>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:33.059114 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0eae9a86-fc73-40ff-acd0-e65a45da1951 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767517408" status: 202 len: 0 microversion: 2.1 time: 0.083871 Oct 18 13:52:33.063572 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2863/5929] 10.222.0.40 () {58 vars in 1221 bytes} [Tue Oct 18 13:52:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767517408 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 13:52:44.083377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1bb4e81e-03a7-4e27-9851-281c01abcbf9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:44.084477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1bb4e81e-03a7-4e27-9851-281c01abcbf9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:44.099389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:44.113965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:44.116101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bb4e81e-03a7-4e27-9851-281c01abcbf9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:44.117823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bb4e81e-03a7-4e27-9851-281c01abcbf9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:44.118682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bb4e81e-03a7-4e27-9851-281c01abcbf9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:44.129894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bb4e81e-03a7-4e27-9851-281c01abcbf9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:44.130715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bb4e81e-03a7-4e27-9851-281c01abcbf9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:44.135675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bb4e81e-03a7-4e27-9851-281c01abcbf9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:44.212075 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-1bb4e81e-03a7-4e27-9851-281c01abcbf9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1bb4e81e-03a7-4e27-9851-281c01abcbf9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb HTTP/1.1 Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb'} Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:52:44.267367 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:52:44.271228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:44.271228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:52:44.271228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:44.271228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:52:44.271228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:44.271228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:44.271228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:44.271228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:52:44.271228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:52:44.271228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:44.271228 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:52:44.275270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1bb4e81e-03a7-4e27-9851-281c01abcbf9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 404 to user: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:52:44.283384 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1bb4e81e-03a7-4e27-9851-281c01abcbf9 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 404 len: 111 microversion: 2.1 time: 0.204200 Oct 18 13:52:44.294052 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3067/5930] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:52:44 2022] DELETE /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:52:44.297011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d6c082b6-102c-4f96-a913-af72bd993a39 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:44.297700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d6c082b6-102c-4f96-a913-af72bd993a39 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:44.327928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:44.338218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:52:44.359043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6c082b6-102c-4f96-a913-af72bd993a39 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:44.359902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6c082b6-102c-4f96-a913-af72bd993a39 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:44.360565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6c082b6-102c-4f96-a913-af72bd993a39 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:44.361607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6c082b6-102c-4f96-a913-af72bd993a39 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:44.362499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6c082b6-102c-4f96-a913-af72bd993a39 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:44.364396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d6c082b6-102c-4f96-a913-af72bd993a39 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:44.406877 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-d6c082b6-102c-4f96-a913-af72bd993a39 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d6c082b6-102c-4f96-a913-af72bd993a39 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb HTTP/1.1 Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb'} Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:44.418584 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:44.421990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:44.421990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:44.421990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:44.421990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:52:44.421990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:52:44.421990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. Oct 18 13:52:44.421990 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:44.426328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d6c082b6-102c-4f96-a913-af72bd993a39 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 404 to user: Instance f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:52:44.429140 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d6c082b6-102c-4f96-a913-af72bd993a39 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb" status: 404 len: 111 microversion: 2.1 time: 0.136444 Oct 18 13:52:44.438688 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2864/5931] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:44 2022] GET /compute/v2.1/servers/f0a76562-cba1-4fc3-9d6d-25ec7ba3c9fb => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:52:50.843732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e816aa1-ca9e-4895-bd1f-6999719309d5 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2004596737", "availability_zone": "foo_zone"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:50.850172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.aggregate [None req-4e816aa1-ca9e-4895-bd1f-6999719309d5 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Generated uuid 69057fd6-fe3c-446f-8135-c3f49964da61 for aggregate {{(pid=120611) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 18 13:52:50.852240 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4e816aa1-ca9e-4895-bd1f-6999719309d5 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] [0135da17-52a6-4f3f-bf9a-8d65ee41392a] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 13:52:51.868866 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [None req-4e816aa1-ca9e-4895-bd1f-6999719309d5 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] [0135da17-52a6-4f3f-bf9a-8d65ee41392a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 52638. Oct 18 13:52:51.927343 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4e816aa1-ca9e-4895-bd1f-6999719309d5 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 1.674913 Oct 18 13:52:51.927980 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3068/5932] 10.222.0.40 () {60 vars in 1164 bytes} [Tue Oct 18 13:52:50 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:51.939991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b41b3615-de76-4586-a610-6731e3c14498 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:52.001794 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b41b3615-de76-4586-a610-6731e3c14498 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.065770 Oct 18 13:52:52.002425 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2865/5933] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 18 13:52:51 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:52.014429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-55bdf8e6-cf9e-4ad2-8770-7a5668898997 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:52.018239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55bdf8e6-cf9e-4ad2-8770-7a5668898997 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:52.018726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55bdf8e6-cf9e-4ad2-8770-7a5668898997 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:52.025870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55bdf8e6-cf9e-4ad2-8770-7a5668898997 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:52.026790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55bdf8e6-cf9e-4ad2-8770-7a5668898997 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:52.028068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55bdf8e6-cf9e-4ad2-8770-7a5668898997 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:52.028526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55bdf8e6-cf9e-4ad2-8770-7a5668898997 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:52.119121 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-55bdf8e6-cf9e-4ad2-8770-7a5668898997 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.108641 Oct 18 13:52:52.120131 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3069/5934] 10.222.0.40 () {58 vars in 1176 bytes} [Tue Oct 18 13:52:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:52.131851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-82d8483f-08e6-4fb7-bbd4-58af414d085c tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:52.150887 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-82d8483f-08e6-4fb7-bbd4-58af414d085c tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.022953 Oct 18 13:52:52.151776 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2866/5935] 10.222.0.40 () {58 vars in 1143 bytes} [Tue Oct 18 13:52:52 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:52.165683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9357df2f-d5ab-4736-9f68-7077b235491e tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-13"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:52.194279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9357df2f-d5ab-4736-9f68-7077b235491e tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:52.196448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9357df2f-d5ab-4736-9f68-7077b235491e tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:52.197100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9357df2f-d5ab-4736-9f68-7077b235491e tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:52.786379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-715ddac2-461e-4f09-ba3c-855baa16ffc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:52.787293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-715ddac2-461e-4f09-ba3c-855baa16ffc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:52.801389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-715ddac2-461e-4f09-ba3c-855baa16ffc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:52.805887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-715ddac2-461e-4f09-ba3c-855baa16ffc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:52.806336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-715ddac2-461e-4f09-ba3c-855baa16ffc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:52.807083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-715ddac2-461e-4f09-ba3c-855baa16ffc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:52.807533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-715ddac2-461e-4f09-ba3c-855baa16ffc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:52.808124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-715ddac2-461e-4f09-ba3c-855baa16ffc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:52.842226 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9357df2f-d5ab-4736-9f68-7077b235491e tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.679559 Oct 18 13:52:52.844045 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3070/5936] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 18 13:52:52 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:52.856428 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-715ddac2-461e-4f09-ba3c-855baa16ffc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:52:52.859343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8b09ce78-6721-47e3-8a6d-9de7f689226e tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-715ddac2-461e-4f09-ba3c-855baa16ffc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 HTTP/1.1 Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '5730123c-98f2-4753-9451-5bd415013688'} Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:52:52.869621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:52:52.873969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:52:52.873969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:52.873969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:52.873969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:52.873969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:52.873969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:52.873969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:52.873969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:52:52.873969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:52:52.873969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:52:52.873969 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:52.873969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-715ddac2-461e-4f09-ba3c-855baa16ffc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 404 to user: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:52:52.873969 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-715ddac2-461e-4f09-ba3c-855baa16ffc0 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 404 len: 111 microversion: 2.1 time: 0.091788 Oct 18 13:52:52.874848 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2867/5937] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:52:52 2022] DELETE /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:52:52.884376 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8b09ce78-6721-47e3-8a6d-9de7f689226e tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.032327 Oct 18 13:52:52.884976 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3071/5938] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:52:52 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:52:52.891582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8440a3c0-0e56-4cff-9798-864dbfb68be6 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:52.891582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8440a3c0-0e56-4cff-9798-864dbfb68be6 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: 5730123c-98f2-4753-9451-5bd415013688] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:52.905325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-98e22857-c665-41a9-8556-3ecef977dd24 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-672589988", "availability_zone": "foo_zone"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:52.914332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8440a3c0-0e56-4cff-9798-864dbfb68be6 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:52.914332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8440a3c0-0e56-4cff-9798-864dbfb68be6 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:52.914745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8440a3c0-0e56-4cff-9798-864dbfb68be6 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:52.915442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8440a3c0-0e56-4cff-9798-864dbfb68be6 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:52.915889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8440a3c0-0e56-4cff-9798-864dbfb68be6 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:52.916310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8440a3c0-0e56-4cff-9798-864dbfb68be6 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:52.968180 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-8440a3c0-0e56-4cff-9798-864dbfb68be6 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8440a3c0-0e56-4cff-9798-864dbfb68be6 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 HTTP/1.1 Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '5730123c-98f2-4753-9451-5bd415013688'} Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:52.970011 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:52.976128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:52.976128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:52.976128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:52.976128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:52:52.976128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:52:52.976128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. Oct 18 13:52:52.976128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:52.976128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8440a3c0-0e56-4cff-9798-864dbfb68be6 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 404 to user: Instance 5730123c-98f2-4753-9451-5bd415013688 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:52:52.976128 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8440a3c0-0e56-4cff-9798-864dbfb68be6 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688" status: 404 len: 111 microversion: 2.1 time: 0.095800 Oct 18 13:52:52.976128 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2868/5939] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:52 2022] GET /compute/v2.1/servers/5730123c-98f2-4753-9451-5bd415013688 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:52:52.998202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-10777fab-ac09-4288-9163-8e742f498869 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:52.999316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-10777fab-ac09-4288-9163-8e742f498869 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:53.030532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10777fab-ac09-4288-9163-8e742f498869 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:53.031097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10777fab-ac09-4288-9163-8e742f498869 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:53.031575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10777fab-ac09-4288-9163-8e742f498869 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:53.032350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10777fab-ac09-4288-9163-8e742f498869 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:53.032860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10777fab-ac09-4288-9163-8e742f498869 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:53.033331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10777fab-ac09-4288-9163-8e742f498869 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:53.055773 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-98e22857-c665-41a9-8556-3ecef977dd24 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.162775 Oct 18 13:52:53.056951 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3072/5940] 10.222.0.40 () {60 vars in 1173 bytes} [Tue Oct 18 13:52:52 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:53.074393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-15195acb-c997-4207-a860-f5812f7178de tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:53.084056 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-10777fab-ac09-4288-9163-8e742f498869 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-10777fab-ac09-4288-9163-8e742f498869 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa HTTP/1.1 Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'b71970dc-22e3-42e6-bb9f-bf0c8699bbfa'} Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:52:53.087741 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:52:53.093114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:52:53.093114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:53.093114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:53.093114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:53.093114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:53.093114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:53.093114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:53.093114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:52:53.093114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:52:53.093114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:52:53.093114 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:53.093114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-10777fab-ac09-4288-9163-8e742f498869 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 404 to user: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:52:53.093114 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-10777fab-ac09-4288-9163-8e742f498869 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 404 len: 111 microversion: 2.1 time: 0.094978 Oct 18 13:52:53.095417 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2869/5941] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:52:52 2022] DELETE /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:52:53.108662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2234642c-fb52-4fd3-a1bc-238a95bf3cf5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:53.109313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2234642c-fb52-4fd3-a1bc-238a95bf3cf5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: b71970dc-22e3-42e6-bb9f-bf0c8699bbfa] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:52:53.133237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2234642c-fb52-4fd3-a1bc-238a95bf3cf5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:53.134534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2234642c-fb52-4fd3-a1bc-238a95bf3cf5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:53.135145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2234642c-fb52-4fd3-a1bc-238a95bf3cf5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:53.140793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2234642c-fb52-4fd3-a1bc-238a95bf3cf5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:53.141791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2234642c-fb52-4fd3-a1bc-238a95bf3cf5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:53.142377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2234642c-fb52-4fd3-a1bc-238a95bf3cf5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:53.171226 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-15195acb-c997-4207-a860-f5812f7178de tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.106530 Oct 18 13:52:53.172555 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3073/5942] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 18 13:52:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:53.185823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-785d8239-f50f-4483-9142-382afd5842bf tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:53.201978 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-2234642c-fb52-4fd3-a1bc-238a95bf3cf5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2234642c-fb52-4fd3-a1bc-238a95bf3cf5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa HTTP/1.1 Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'b71970dc-22e3-42e6-bb9f-bf0c8699bbfa'} Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:52:53.204492 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:53.209139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:52:53.209139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:52:53.209139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:52:53.209139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:52:53.209139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:52:53.209139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. Oct 18 13:52:53.209139 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:52:53.211665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2234642c-fb52-4fd3-a1bc-238a95bf3cf5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 404 to user: Instance b71970dc-22e3-42e6-bb9f-bf0c8699bbfa could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:52:53.212764 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2234642c-fb52-4fd3-a1bc-238a95bf3cf5 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa" status: 404 len: 111 microversion: 2.1 time: 0.116162 Oct 18 13:52:53.213567 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2870/5943] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:52:53 2022] GET /compute/v2.1/servers/b71970dc-22e3-42e6-bb9f-bf0c8699bbfa => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:52:53.219244 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-785d8239-f50f-4483-9142-382afd5842bf tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.037611 Oct 18 13:52:53.225629 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3074/5944] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Oct 18 13:52:53 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:52:53.268237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-657b1847-0391-4983-8dc3-e3effe3f900a tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-13"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:52:53.307225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-657b1847-0391-4983-8dc3-e3effe3f900a tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:52:53.308524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-657b1847-0391-4983-8dc3-e3effe3f900a tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:52:53.310864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-657b1847-0391-4983-8dc3-e3effe3f900a tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:52:53.936997 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-657b1847-0391-4983-8dc3-e3effe3f900a tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.702968 Oct 18 13:52:53.949121 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2871/5945] 10.222.0.40 () {60 vars in 1194 bytes} [Tue Oct 18 13:52:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:52:53.953318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-72286ad9-d9d7-49d9-b24d-0ee4e0393721 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:52:54.011523 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-72286ad9-d9d7-49d9-b24d-0ee4e0393721 tempest-TestAggregatesBasicOps-235295428 tempest-TestAggregatesBasicOps-235295428-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.064717 Oct 18 13:52:54.013109 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3075/5946] 10.222.0.40 () {58 vars in 1155 bytes} [Tue Oct 18 13:52:53 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 18 13:53:02.009858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f61a1ca0-becd-4f0b-a947-0ecaaa94da19 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:02.010434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f61a1ca0-becd-4f0b-a947-0ecaaa94da19 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:02.025437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f61a1ca0-becd-4f0b-a947-0ecaaa94da19 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:02.025938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f61a1ca0-becd-4f0b-a947-0ecaaa94da19 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:02.026382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f61a1ca0-becd-4f0b-a947-0ecaaa94da19 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:02.034574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f61a1ca0-becd-4f0b-a947-0ecaaa94da19 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:02.035198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f61a1ca0-becd-4f0b-a947-0ecaaa94da19 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:02.035740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f61a1ca0-becd-4f0b-a947-0ecaaa94da19 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:02.095082 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-f61a1ca0-becd-4f0b-a947-0ecaaa94da19 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f61a1ca0-becd-4f0b-a947-0ecaaa94da19 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 HTTP/1.1 Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'ee304341-74a8-4ded-a4a4-0ddb13f16002'} Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:53:02.099387 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:53:02.102857 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:53:02.102857 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:53:02.102857 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:53:02.102857 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:53:02.102857 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:53:02.102857 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:53:02.102857 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:53:02.102857 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:53:02.102857 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:53:02.102857 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:53:02.102857 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:53:02.108844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f61a1ca0-becd-4f0b-a947-0ecaaa94da19 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 404 to user: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:53:02.110053 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f61a1ca0-becd-4f0b-a947-0ecaaa94da19 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 404 len: 111 microversion: 2.1 time: 0.106655 Oct 18 13:53:02.122318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:02.126711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-540c0356-7a33-4037-942f-399993afa364 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:02.127600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-540c0356-7a33-4037-942f-399993afa364 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] [instance: ee304341-74a8-4ded-a4a4-0ddb13f16002] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:02.137586 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2872/5947] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:53:02 2022] DELETE /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:53:02.152188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-540c0356-7a33-4037-942f-399993afa364 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:02.152689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-540c0356-7a33-4037-942f-399993afa364 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:02.153130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-540c0356-7a33-4037-942f-399993afa364 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:02.163556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-540c0356-7a33-4037-942f-399993afa364 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:02.164150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-540c0356-7a33-4037-942f-399993afa364 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:02.164602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-540c0356-7a33-4037-942f-399993afa364 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:02.226384 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-540c0356-7a33-4037-942f-399993afa364 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] HTTP exception thrown: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-540c0356-7a33-4037-942f-399993afa364 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Request method failure captured: Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 HTTP/1.1 Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq2XnQG_fmR5W5to_Ituq6FUBryjL2I1fKXMDoJqA40lQ8g59kb1duCdMoJpkR2vNCv4qnfo6P0TMB_x4hx8cUastd52nR-bmKW_x_KixQjPwzYYxVpsnQWtp_m8ZZw2lS2z5qFRKl7iZxe-oYPS5g2bhn-LnJilIEEzwriVQj7lqGE Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b134786f443e4760b57d3cb5842daa89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b134786f443e4760b57d3cb5842daa89"}]}] Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: b134786f443e4760b57d3cb5842daa89 Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545051538 Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e1fdfb4e43ca40eabb58abe0e9bd4ea3 Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-AttachVolumeNegativeTest-1545051538-project Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'ee304341-74a8-4ded-a4a4-0ddb13f16002'} Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:53:02.227987 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:53:02.231776 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:53:02.231776 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:53:02.231776 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:53:02.231776 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:53:02.231776 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:53:02.231776 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. Oct 18 13:53:02.231776 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:53:02.231776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-540c0356-7a33-4037-942f-399993afa364 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] Returning 404 to user: Instance ee304341-74a8-4ded-a4a4-0ddb13f16002 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:53:02.231776 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-540c0356-7a33-4037-942f-399993afa364 tempest-AttachVolumeNegativeTest-1545051538 tempest-AttachVolumeNegativeTest-1545051538-project] 10.222.0.40 "GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002" status: 404 len: 111 microversion: 2.1 time: 0.108925 Oct 18 13:53:02.247172 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3076/5948] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:02 2022] GET /compute/v2.1/servers/ee304341-74a8-4ded-a4a4-0ddb13f16002 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:53:30.633526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-47ce5962-0099-4ed4-9cc4-43c879a5ca53 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Action: 'create', calling method: .version_select at 0x7ff60e7229d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-5454164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZijhJmn0xC/nba1FZq8RHfk5vhxQBw8mtqoscOTqPuw5fS5UMmNxCP0Y2ns1VqmnNf6JVdbPweZxK96RUUP60yf9Te7ZlIzEYXBzfCsyB/QiqVEJ+u+V1LFYQEHSBrxw=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:30.661129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:30.662989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=16 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:30.696353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-47ce5962-0099-4ed4-9cc4-43c879a5ca53 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Getting quotas for project 5000aa07e2f5417c9b0441ecc463cba9. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:53:30.711315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-47ce5962-0099-4ed4-9cc4-43c879a5ca53 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Getting quotas for user e1578cd25f24465d941f03800e4bac54 and project 5000aa07e2f5417c9b0441ecc463cba9. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:53:30.793483 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-47ce5962-0099-4ed4-9cc4-43c879a5ca53 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.165004 Oct 18 13:53:30.794116 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2873/5949] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:53:30 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:33.334057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1757789912", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "dfc37021-13c8-46d4-9329-edf936a8377e"}], "key_name": "tempest-TestNetworkBasicOps-5454164", "security_groups": [{"name": "tempest-secgroup-smoke-1102450883"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:33.368911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:33.370170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=10 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:33.632309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] validate_networks() for [('dfc37021-13c8-46d4-9329-edf936a8377e', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:53:34.525317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:53:34.525952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:53:34.526220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:53:34.526798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:53:34.527377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:53:34.543979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:34.544664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:34.545305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:34.551601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:34.561930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:34.562605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:34.605045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Getting quotas for project 5000aa07e2f5417c9b0441ecc463cba9. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:53:34.629780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Getting quotas for user e1578cd25f24465d941f03800e4bac54 and project 5000aa07e2f5417c9b0441ecc463cba9. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:53:34.685641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:53:34.692338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:53:34.823461 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8a3000f-90c6-49e2-9df5-bff6a8a8be47 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.494569 Oct 18 13:53:34.824657 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3077/5950] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:53:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:53:34.839127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-868fc50b-dcff-4037-9d03-8ae9f06865f3 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:34.839759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-868fc50b-dcff-4037-9d03-8ae9f06865f3 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:35.052128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-868fc50b-dcff-4037-9d03-8ae9f06865f3 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:35.062587 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-868fc50b-dcff-4037-9d03-8ae9f06865f3 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1246 microversion: 2.1 time: 0.230189 Oct 18 13:53:35.063181 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2874/5951] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:34 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1246 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:36.091806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-11efaa77-76d1-4e73-b12e-8b8c55b8d412 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:36.093497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-11efaa77-76d1-4e73-b12e-8b8c55b8d412 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:36.109799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11efaa77-76d1-4e73-b12e-8b8c55b8d412 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:36.110630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11efaa77-76d1-4e73-b12e-8b8c55b8d412 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:36.111881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11efaa77-76d1-4e73-b12e-8b8c55b8d412 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:36.112874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11efaa77-76d1-4e73-b12e-8b8c55b8d412 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:36.114306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11efaa77-76d1-4e73-b12e-8b8c55b8d412 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:36.114973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11efaa77-76d1-4e73-b12e-8b8c55b8d412 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:36.232512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-11efaa77-76d1-4e73-b12e-8b8c55b8d412 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:36.244195 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-11efaa77-76d1-4e73-b12e-8b8c55b8d412 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1250 microversion: 2.1 time: 0.157995 Oct 18 13:53:36.260894 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3078/5952] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:36 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1250 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:37.267961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb61204a-9610-4ca6-88a4-c20f0aa9500a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:37.272328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb61204a-9610-4ca6-88a4-c20f0aa9500a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:37.294971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb61204a-9610-4ca6-88a4-c20f0aa9500a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:37.300106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb61204a-9610-4ca6-88a4-c20f0aa9500a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:37.300572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb61204a-9610-4ca6-88a4-c20f0aa9500a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:37.301347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb61204a-9610-4ca6-88a4-c20f0aa9500a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:37.301815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb61204a-9610-4ca6-88a4-c20f0aa9500a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:37.302427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb61204a-9610-4ca6-88a4-c20f0aa9500a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:37.401440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fb61204a-9610-4ca6-88a4-c20f0aa9500a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:37.413775 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb61204a-9610-4ca6-88a4-c20f0aa9500a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1304 microversion: 2.1 time: 0.149217 Oct 18 13:53:37.424511 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2875/5953] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:37 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:38.439731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-909a716b-9a68-44fe-90b1-6aca115c7c78 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:38.440547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-909a716b-9a68-44fe-90b1-6aca115c7c78 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:38.466446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-909a716b-9a68-44fe-90b1-6aca115c7c78 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:38.466951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-909a716b-9a68-44fe-90b1-6aca115c7c78 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:38.467396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-909a716b-9a68-44fe-90b1-6aca115c7c78 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:38.468114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-909a716b-9a68-44fe-90b1-6aca115c7c78 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:38.468583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-909a716b-9a68-44fe-90b1-6aca115c7c78 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:38.469014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-909a716b-9a68-44fe-90b1-6aca115c7c78 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:38.961221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-909a716b-9a68-44fe-90b1-6aca115c7c78 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:38.972545 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-909a716b-9a68-44fe-90b1-6aca115c7c78 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1372 microversion: 2.1 time: 0.537560 Oct 18 13:53:38.977521 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3079/5954] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:38 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1372 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:39.785395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a4bd45d2-02de-4222-8efb-60f5cdd38b36 req-acfcc902-7ca7-44f3-a7fb-e3c9427cd962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb1d00b-c865-462a-919c-dd989a50751b", "tag": "2baa912d-f01c-474d-a3cf-39d7e8768f0f"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:39.805780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a4bd45d2-02de-4222-8efb-60f5cdd38b36 req-acfcc902-7ca7-44f3-a7fb-e3c9427cd962 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:39.824603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a4bd45d2-02de-4222-8efb-60f5cdd38b36 req-acfcc902-7ca7-44f3-a7fb-e3c9427cd962 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:39.825144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a4bd45d2-02de-4222-8efb-60f5cdd38b36 req-acfcc902-7ca7-44f3-a7fb-e3c9427cd962 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:39.849382 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a4bd45d2-02de-4222-8efb-60f5cdd38b36 req-acfcc902-7ca7-44f3-a7fb-e3c9427cd962 service nova] Creating event network-changed:2baa912d-f01c-474d-a3cf-39d7e8768f0f for instance 5eb1d00b-c865-462a-919c-dd989a50751b on n-h1-858384-13 Oct 18 13:53:39.857123 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a4bd45d2-02de-4222-8efb-60f5cdd38b36 req-acfcc902-7ca7-44f3-a7fb-e3c9427cd962 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.330458 Oct 18 13:53:39.865383 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2876/5955] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:40.002856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2a17c772-5385-4c64-9bbe-4a4e570bd1fa tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:40.004496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2a17c772-5385-4c64-9bbe-4a4e570bd1fa tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:40.012140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a17c772-5385-4c64-9bbe-4a4e570bd1fa tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:40.012835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a17c772-5385-4c64-9bbe-4a4e570bd1fa tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:40.013516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a17c772-5385-4c64-9bbe-4a4e570bd1fa tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:40.021053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a17c772-5385-4c64-9bbe-4a4e570bd1fa tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:40.023665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a17c772-5385-4c64-9bbe-4a4e570bd1fa tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:40.024669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a17c772-5385-4c64-9bbe-4a4e570bd1fa tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:40.396110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a17c772-5385-4c64-9bbe-4a4e570bd1fa tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:40.406081 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2a17c772-5385-4c64-9bbe-4a4e570bd1fa tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1372 microversion: 2.1 time: 0.408404 Oct 18 13:53:40.406902 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3080/5956] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:39 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1372 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:41.431635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4dd92422-801a-4b94-b2ae-46cc7329ce33 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:41.432484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4dd92422-801a-4b94-b2ae-46cc7329ce33 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:41.441128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dd92422-801a-4b94-b2ae-46cc7329ce33 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:41.441676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dd92422-801a-4b94-b2ae-46cc7329ce33 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:41.442297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dd92422-801a-4b94-b2ae-46cc7329ce33 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:41.443090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dd92422-801a-4b94-b2ae-46cc7329ce33 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:41.450147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dd92422-801a-4b94-b2ae-46cc7329ce33 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:41.450862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dd92422-801a-4b94-b2ae-46cc7329ce33 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:41.705656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4dd92422-801a-4b94-b2ae-46cc7329ce33 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:41.715095 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4dd92422-801a-4b94-b2ae-46cc7329ce33 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1372 microversion: 2.1 time: 0.288024 Oct 18 13:53:41.715830 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2877/5957] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:41 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1372 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:42.743076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9be9641a-2d4d-4770-a09e-ef6f5ab8a3b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:42.743703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9be9641a-2d4d-4770-a09e-ef6f5ab8a3b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:42.752579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9be9641a-2d4d-4770-a09e-ef6f5ab8a3b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:42.753087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9be9641a-2d4d-4770-a09e-ef6f5ab8a3b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:42.760480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9be9641a-2d4d-4770-a09e-ef6f5ab8a3b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:42.762355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9be9641a-2d4d-4770-a09e-ef6f5ab8a3b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:42.763470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9be9641a-2d4d-4770-a09e-ef6f5ab8a3b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:42.764136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9be9641a-2d4d-4770-a09e-ef6f5ab8a3b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:43.165454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9be9641a-2d4d-4770-a09e-ef6f5ab8a3b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:43.218197 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9be9641a-2d4d-4770-a09e-ef6f5ab8a3b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1372 microversion: 2.1 time: 0.442100 Oct 18 13:53:43.219123 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3081/5958] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:42 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1372 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:44.252943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bec7cd05-0c33-4f10-b0af-f207bbb5c6a0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:44.254246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bec7cd05-0c33-4f10-b0af-f207bbb5c6a0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:44.274603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bec7cd05-0c33-4f10-b0af-f207bbb5c6a0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:44.275484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bec7cd05-0c33-4f10-b0af-f207bbb5c6a0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:44.276588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bec7cd05-0c33-4f10-b0af-f207bbb5c6a0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:44.278106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bec7cd05-0c33-4f10-b0af-f207bbb5c6a0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:44.278699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bec7cd05-0c33-4f10-b0af-f207bbb5c6a0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:44.279227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bec7cd05-0c33-4f10-b0af-f207bbb5c6a0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:44.486354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bec7cd05-0c33-4f10-b0af-f207bbb5c6a0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:44.500938 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bec7cd05-0c33-4f10-b0af-f207bbb5c6a0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1372 microversion: 2.1 time: 0.256854 Oct 18 13:53:44.504644 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2878/5959] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:44 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1372 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:45.330396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:45.331172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:45.534948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22203196-0b9c-4a1f-9c91-c39f786327ac tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:45.537378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-22203196-0b9c-4a1f-9c91-c39f786327ac tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:45.564754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:53:45.576393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22203196-0b9c-4a1f-9c91-c39f786327ac tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:45.578406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22203196-0b9c-4a1f-9c91-c39f786327ac tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:45.578947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22203196-0b9c-4a1f-9c91-c39f786327ac tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:45.584316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22203196-0b9c-4a1f-9c91-c39f786327ac tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:45.584893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22203196-0b9c-4a1f-9c91-c39f786327ac tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:45.588305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22203196-0b9c-4a1f-9c91-c39f786327ac tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:45.756845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ca5b08a1-2874-4b18-9f8a-eeff39883568 req-a1eab0bc-f09d-4b11-99fe-4fdbb547741c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb1d00b-c865-462a-919c-dd989a50751b", "name": "network-vif-plugged", "status": "completed", "tag": "2baa912d-f01c-474d-a3cf-39d7e8768f0f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:45.778496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ca5b08a1-2874-4b18-9f8a-eeff39883568 req-a1eab0bc-f09d-4b11-99fe-4fdbb547741c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:45.779025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ca5b08a1-2874-4b18-9f8a-eeff39883568 req-a1eab0bc-f09d-4b11-99fe-4fdbb547741c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:45.779455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ca5b08a1-2874-4b18-9f8a-eeff39883568 req-a1eab0bc-f09d-4b11-99fe-4fdbb547741c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:45.807017 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ca5b08a1-2874-4b18-9f8a-eeff39883568 req-a1eab0bc-f09d-4b11-99fe-4fdbb547741c service nova] Creating event network-vif-plugged:2baa912d-f01c-474d-a3cf-39d7e8768f0f for instance 5eb1d00b-c865-462a-919c-dd989a50751b on n-h1-858384-13 Oct 18 13:53:45.820351 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ca5b08a1-2874-4b18-9f8a-eeff39883568 req-a1eab0bc-f09d-4b11-99fe-4fdbb547741c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.496732 Oct 18 13:53:45.820982 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3082/5960] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:53:45.822394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-22203196-0b9c-4a1f-9c91-c39f786327ac tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:45.832982 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-22203196-0b9c-4a1f-9c91-c39f786327ac tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1372 microversion: 2.1 time: 0.306560 Oct 18 13:53:45.835273 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2879/5961] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:45 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1372 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:46.859442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3766b607-dbe5-4d2c-93fc-e2fb005558e9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:46.861879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3766b607-dbe5-4d2c-93fc-e2fb005558e9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:46.870909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3766b607-dbe5-4d2c-93fc-e2fb005558e9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:46.871809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3766b607-dbe5-4d2c-93fc-e2fb005558e9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:46.872560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3766b607-dbe5-4d2c-93fc-e2fb005558e9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:46.874875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3766b607-dbe5-4d2c-93fc-e2fb005558e9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:46.875543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3766b607-dbe5-4d2c-93fc-e2fb005558e9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:46.880018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3766b607-dbe5-4d2c-93fc-e2fb005558e9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:47.119682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3766b607-dbe5-4d2c-93fc-e2fb005558e9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:47.135195 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3766b607-dbe5-4d2c-93fc-e2fb005558e9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1372 microversion: 2.1 time: 0.281257 Oct 18 13:53:47.136159 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3083/5962] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:46 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1372 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:48.167516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e5f67f3a-f9f2-45a4-beab-4a29c75c826d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:48.167516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e5f67f3a-f9f2-45a4-beab-4a29c75c826d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:48.172742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5f67f3a-f9f2-45a4-beab-4a29c75c826d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:48.188115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5f67f3a-f9f2-45a4-beab-4a29c75c826d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:48.188799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5f67f3a-f9f2-45a4-beab-4a29c75c826d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:48.189681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5f67f3a-f9f2-45a4-beab-4a29c75c826d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:48.190163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5f67f3a-f9f2-45a4-beab-4a29c75c826d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:48.190914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5f67f3a-f9f2-45a4-beab-4a29c75c826d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:48.398055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e5f67f3a-f9f2-45a4-beab-4a29c75c826d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:48.407979 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e5f67f3a-f9f2-45a4-beab-4a29c75c826d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1544 microversion: 2.1 time: 0.251375 Oct 18 13:53:48.411735 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2880/5963] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:48 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1544 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:48.435635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a326382e-5108-43a5-90ff-b1822c089ed9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:53:48.436279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a326382e-5108-43a5-90ff-b1822c089ed9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:53:48.452412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a326382e-5108-43a5-90ff-b1822c089ed9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:48.452986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a326382e-5108-43a5-90ff-b1822c089ed9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:48.453456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a326382e-5108-43a5-90ff-b1822c089ed9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:48.454715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a326382e-5108-43a5-90ff-b1822c089ed9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:48.458426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a326382e-5108-43a5-90ff-b1822c089ed9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:48.458911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a326382e-5108-43a5-90ff-b1822c089ed9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:48.645137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a326382e-5108-43a5-90ff-b1822c089ed9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:53:48.663127 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a326382e-5108-43a5-90ff-b1822c089ed9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1544 microversion: 2.1 time: 0.224487 Oct 18 13:53:48.664228 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3084/5964] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:53:48 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1544 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:53:51.692844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-3fcc6650-9a77-4f10-9db1-d465414a6b08 req-9b4a2626-d6e6-4ff0-aebe-c70019fca722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb1d00b-c865-462a-919c-dd989a50751b", "tag": "2baa912d-f01c-474d-a3cf-39d7e8768f0f"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:53:51.734174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3fcc6650-9a77-4f10-9db1-d465414a6b08 req-9b4a2626-d6e6-4ff0-aebe-c70019fca722 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:53:51.737559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3fcc6650-9a77-4f10-9db1-d465414a6b08 req-9b4a2626-d6e6-4ff0-aebe-c70019fca722 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:53:51.739684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3fcc6650-9a77-4f10-9db1-d465414a6b08 req-9b4a2626-d6e6-4ff0-aebe-c70019fca722 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:53:51.772130 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-3fcc6650-9a77-4f10-9db1-d465414a6b08 req-9b4a2626-d6e6-4ff0-aebe-c70019fca722 service nova] Creating event network-changed:2baa912d-f01c-474d-a3cf-39d7e8768f0f for instance 5eb1d00b-c865-462a-919c-dd989a50751b on n-h1-858384-13 Oct 18 13:53:51.784736 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-3fcc6650-9a77-4f10-9db1-d465414a6b08 req-9b4a2626-d6e6-4ff0-aebe-c70019fca722 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099414 Oct 18 13:53:51.793917 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2881/5965] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:54:24.260651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f39125ff-bda2-4772-8665-fbbe0bfa34f6 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:54:24.268787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f39125ff-bda2-4772-8665-fbbe0bfa34f6 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:24.278040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:24.279070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=40 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:24.286297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f39125ff-bda2-4772-8665-fbbe0bfa34f6 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:24.287131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f39125ff-bda2-4772-8665-fbbe0bfa34f6 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:24.287744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f39125ff-bda2-4772-8665-fbbe0bfa34f6 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:24.288667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f39125ff-bda2-4772-8665-fbbe0bfa34f6 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:24.289383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f39125ff-bda2-4772-8665-fbbe0bfa34f6 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:24.289980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f39125ff-bda2-4772-8665-fbbe0bfa34f6 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:24.376397 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f39125ff-bda2-4772-8665-fbbe0bfa34f6 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "POST /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b/action" status: 200 len: 24572 microversion: 2.1 time: 0.130600 Oct 18 13:54:24.382598 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3085/5966] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:54:24 2022] POST /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b/action => generated 24572 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 13:54:32.369446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:32.371289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=34 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:32.377964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-270732645", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "8e8e032e-dae9-4be7-9ac4-279c1a87433e"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:54:32.446892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] validate_networks() for [('8e8e032e-dae9-4be7-9ac4-279c1a87433e', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:54:33.017202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:54:33.018408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:54:33.019888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:54:33.020684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:54:33.021462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:54:33.054088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:33.054955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:33.056523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:33.057494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:33.058398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:33.059320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:33.110948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Getting quotas for project 265512d8e20c440aa47d65744b7c5e77. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:54:33.117646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Getting quotas for user 113b44ece3a640f0bafbcac853e1a994 and project 265512d8e20c440aa47d65744b7c5e77. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:54:33.134701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:54:33.137688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:54:33.226498 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7be9d58d-6257-41c0-9373-8adadc2f6e5e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869747 Oct 18 13:54:33.228049 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2882/5967] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:54:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:54:33.243656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-18d0f6aa-ba29-4079-b98b-24fdd59ddf4b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:33.244389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-18d0f6aa-ba29-4079-b98b-24fdd59ddf4b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:33.857894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-18d0f6aa-ba29-4079-b98b-24fdd59ddf4b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:33.871070 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-18d0f6aa-ba29-4079-b98b-24fdd59ddf4b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 200 len: 1218 microversion: 2.1 time: 0.631686 Oct 18 13:54:33.885897 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3086/5968] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:33 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 1218 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:34.915968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-74739e3a-c28e-4cfd-9cee-59206feb2dc4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:34.917193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-74739e3a-c28e-4cfd-9cee-59206feb2dc4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:34.934052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74739e3a-c28e-4cfd-9cee-59206feb2dc4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:34.934549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74739e3a-c28e-4cfd-9cee-59206feb2dc4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:34.939013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74739e3a-c28e-4cfd-9cee-59206feb2dc4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:34.941852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74739e3a-c28e-4cfd-9cee-59206feb2dc4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:34.942798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74739e3a-c28e-4cfd-9cee-59206feb2dc4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:34.944668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74739e3a-c28e-4cfd-9cee-59206feb2dc4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:35.049149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-74739e3a-c28e-4cfd-9cee-59206feb2dc4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:35.058195 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-74739e3a-c28e-4cfd-9cee-59206feb2dc4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 200 len: 1270 microversion: 2.1 time: 0.158934 Oct 18 13:54:35.059654 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2883/5969] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:34 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:36.090804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0096dc05-f0bd-445b-a46c-4ecb6746cd62 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:36.091529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0096dc05-f0bd-445b-a46c-4ecb6746cd62 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:36.099168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:36.121282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0096dc05-f0bd-445b-a46c-4ecb6746cd62 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:36.121884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0096dc05-f0bd-445b-a46c-4ecb6746cd62 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:36.122612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0096dc05-f0bd-445b-a46c-4ecb6746cd62 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:36.123387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0096dc05-f0bd-445b-a46c-4ecb6746cd62 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:36.125568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0096dc05-f0bd-445b-a46c-4ecb6746cd62 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:36.126301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0096dc05-f0bd-445b-a46c-4ecb6746cd62 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:36.329839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0096dc05-f0bd-445b-a46c-4ecb6746cd62 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:36.372076 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0096dc05-f0bd-445b-a46c-4ecb6746cd62 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 200 len: 1276 microversion: 2.1 time: 0.288917 Oct 18 13:54:36.380931 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3087/5970] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:36 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 1276 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:54:37.416612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4bf02616-9a49-4907-b0f2-f0551c8eb82e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:37.417408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4bf02616-9a49-4907-b0f2-f0551c8eb82e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:37.427709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4bf02616-9a49-4907-b0f2-f0551c8eb82e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:37.428183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4bf02616-9a49-4907-b0f2-f0551c8eb82e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:37.429656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4bf02616-9a49-4907-b0f2-f0551c8eb82e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:37.431959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4bf02616-9a49-4907-b0f2-f0551c8eb82e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:37.432426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4bf02616-9a49-4907-b0f2-f0551c8eb82e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:37.432861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4bf02616-9a49-4907-b0f2-f0551c8eb82e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:37.963625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4bf02616-9a49-4907-b0f2-f0551c8eb82e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:38.001471 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4bf02616-9a49-4907-b0f2-f0551c8eb82e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 200 len: 1318 microversion: 2.1 time: 0.586134 Oct 18 13:54:38.002347 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2884/5971] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:37 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:54:39.028107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-862f606b-5dfe-425b-a68b-0ec99e9f097b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:39.030902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-862f606b-5dfe-425b-a68b-0ec99e9f097b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:39.044308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-862f606b-5dfe-425b-a68b-0ec99e9f097b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:39.045140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-862f606b-5dfe-425b-a68b-0ec99e9f097b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:39.047848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-862f606b-5dfe-425b-a68b-0ec99e9f097b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:39.048946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-862f606b-5dfe-425b-a68b-0ec99e9f097b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:39.049660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-862f606b-5dfe-425b-a68b-0ec99e9f097b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:39.050738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-862f606b-5dfe-425b-a68b-0ec99e9f097b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:39.207040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-a82522dd-baba-496b-b590-75d68c3e5eef req-eec5434e-ba20-401b-88b7-e19093a5d160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c951f769-6c31-4af5-b2ed-6b23ab13fe04", "tag": "eb65d8ff-e0ab-46fe-82e0-47102319f1b9"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:54:39.228810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a82522dd-baba-496b-b590-75d68c3e5eef req-eec5434e-ba20-401b-88b7-e19093a5d160 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:39.231947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a82522dd-baba-496b-b590-75d68c3e5eef req-eec5434e-ba20-401b-88b7-e19093a5d160 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:39.234369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a82522dd-baba-496b-b590-75d68c3e5eef req-eec5434e-ba20-401b-88b7-e19093a5d160 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:39.266461 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-a82522dd-baba-496b-b590-75d68c3e5eef req-eec5434e-ba20-401b-88b7-e19093a5d160 service nova] Creating event network-changed:eb65d8ff-e0ab-46fe-82e0-47102319f1b9 for instance c951f769-6c31-4af5-b2ed-6b23ab13fe04 on n-h2-858384-13 Oct 18 13:54:39.274259 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-a82522dd-baba-496b-b590-75d68c3e5eef req-eec5434e-ba20-401b-88b7-e19093a5d160 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.692405 Oct 18 13:54:39.276876 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3088/5972] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:54:39.488733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-862f606b-5dfe-425b-a68b-0ec99e9f097b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:39.508607 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-862f606b-5dfe-425b-a68b-0ec99e9f097b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 200 len: 1318 microversion: 2.1 time: 0.484285 Oct 18 13:54:39.509230 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2885/5973] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:39 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:40.567244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2a7553ee-27d3-4e3e-9d08-9b18e57e5f27 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:40.568514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2a7553ee-27d3-4e3e-9d08-9b18e57e5f27 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:40.601122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a7553ee-27d3-4e3e-9d08-9b18e57e5f27 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:40.602285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a7553ee-27d3-4e3e-9d08-9b18e57e5f27 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:40.603324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a7553ee-27d3-4e3e-9d08-9b18e57e5f27 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:40.605066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a7553ee-27d3-4e3e-9d08-9b18e57e5f27 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:40.606231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a7553ee-27d3-4e3e-9d08-9b18e57e5f27 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:40.607253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a7553ee-27d3-4e3e-9d08-9b18e57e5f27 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:41.036720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2a7553ee-27d3-4e3e-9d08-9b18e57e5f27 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:41.046691 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2a7553ee-27d3-4e3e-9d08-9b18e57e5f27 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 200 len: 1318 microversion: 2.1 time: 0.497209 Oct 18 13:54:41.047854 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3089/5974] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:40 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:42.089830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3f22d000-d41d-4324-9d54-364e4b6a5a15 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:42.091138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3f22d000-d41d-4324-9d54-364e4b6a5a15 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:42.104005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f22d000-d41d-4324-9d54-364e4b6a5a15 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:42.104687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f22d000-d41d-4324-9d54-364e4b6a5a15 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:42.105335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f22d000-d41d-4324-9d54-364e4b6a5a15 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:42.106237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f22d000-d41d-4324-9d54-364e4b6a5a15 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:42.107790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f22d000-d41d-4324-9d54-364e4b6a5a15 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:42.110945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f22d000-d41d-4324-9d54-364e4b6a5a15 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:42.484171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3f22d000-d41d-4324-9d54-364e4b6a5a15 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:42.525488 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3f22d000-d41d-4324-9d54-364e4b6a5a15 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 200 len: 1318 microversion: 2.1 time: 0.441845 Oct 18 13:54:42.526708 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2886/5975] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:42 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:43.552809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0a91393f-e9e0-46b9-b57b-bdbaec29b305 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:43.554125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0a91393f-e9e0-46b9-b57b-bdbaec29b305 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:43.565580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a91393f-e9e0-46b9-b57b-bdbaec29b305 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:43.566163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a91393f-e9e0-46b9-b57b-bdbaec29b305 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:43.566499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a91393f-e9e0-46b9-b57b-bdbaec29b305 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:43.567298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a91393f-e9e0-46b9-b57b-bdbaec29b305 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:43.567631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a91393f-e9e0-46b9-b57b-bdbaec29b305 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:43.568054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0a91393f-e9e0-46b9-b57b-bdbaec29b305 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:43.866800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:44.132137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0a91393f-e9e0-46b9-b57b-bdbaec29b305 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:44.177502 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0a91393f-e9e0-46b9-b57b-bdbaec29b305 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 200 len: 1318 microversion: 2.1 time: 0.630103 Oct 18 13:54:44.184328 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3090/5976] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:43 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 1318 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:45.205313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c595cdf-b142-429e-8e5b-a652c5d2b8ce tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:45.206585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2c595cdf-b142-429e-8e5b-a652c5d2b8ce tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:45.211878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:45.213624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:45.215611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c595cdf-b142-429e-8e5b-a652c5d2b8ce tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:45.216168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c595cdf-b142-429e-8e5b-a652c5d2b8ce tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:45.216604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c595cdf-b142-429e-8e5b-a652c5d2b8ce tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:45.217814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c595cdf-b142-429e-8e5b-a652c5d2b8ce tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:45.218259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c595cdf-b142-429e-8e5b-a652c5d2b8ce tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:45.218689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c595cdf-b142-429e-8e5b-a652c5d2b8ce tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:45.390702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2c595cdf-b142-429e-8e5b-a652c5d2b8ce tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:45.407216 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2c595cdf-b142-429e-8e5b-a652c5d2b8ce tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 200 len: 1318 microversion: 2.1 time: 0.206502 Oct 18 13:54:45.418150 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2887/5977] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:45 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:46.356306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-4e5239cd-013b-4974-bfc4-aa4d5e731996 req-857842d7-d771-4af9-9db6-fc99b957eb41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c951f769-6c31-4af5-b2ed-6b23ab13fe04", "name": "network-vif-plugged", "status": "completed", "tag": "eb65d8ff-e0ab-46fe-82e0-47102319f1b9"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:54:46.380730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4e5239cd-013b-4974-bfc4-aa4d5e731996 req-857842d7-d771-4af9-9db6-fc99b957eb41 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:46.382329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4e5239cd-013b-4974-bfc4-aa4d5e731996 req-857842d7-d771-4af9-9db6-fc99b957eb41 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:46.383458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4e5239cd-013b-4974-bfc4-aa4d5e731996 req-857842d7-d771-4af9-9db6-fc99b957eb41 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:46.415157 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-4e5239cd-013b-4974-bfc4-aa4d5e731996 req-857842d7-d771-4af9-9db6-fc99b957eb41 service nova] Creating event network-vif-plugged:eb65d8ff-e0ab-46fe-82e0-47102319f1b9 for instance c951f769-6c31-4af5-b2ed-6b23ab13fe04 on n-h2-858384-13 Oct 18 13:54:46.426730 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-4e5239cd-013b-4974-bfc4-aa4d5e731996 req-857842d7-d771-4af9-9db6-fc99b957eb41 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078477 Oct 18 13:54:46.428582 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3091/5978] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:54:46.443357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-76ba4311-0bb8-40b4-ada9-9aafcb419066 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:46.444654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-76ba4311-0bb8-40b4-ada9-9aafcb419066 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:46.468706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76ba4311-0bb8-40b4-ada9-9aafcb419066 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:46.470951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76ba4311-0bb8-40b4-ada9-9aafcb419066 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:46.472878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76ba4311-0bb8-40b4-ada9-9aafcb419066 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:46.474481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76ba4311-0bb8-40b4-ada9-9aafcb419066 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:46.475174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76ba4311-0bb8-40b4-ada9-9aafcb419066 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:46.479047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76ba4311-0bb8-40b4-ada9-9aafcb419066 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:46.890356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-76ba4311-0bb8-40b4-ada9-9aafcb419066 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:46.911499 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-76ba4311-0bb8-40b4-ada9-9aafcb419066 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 200 len: 1318 microversion: 2.1 time: 0.471311 Oct 18 13:54:46.925054 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2888/5979] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:46 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:54:47.947706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-945e67ca-315a-4349-9ec3-92f48fafa72e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:54:47.950450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-945e67ca-315a-4349-9ec3-92f48fafa72e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:54:47.974314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-945e67ca-315a-4349-9ec3-92f48fafa72e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:47.975059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-945e67ca-315a-4349-9ec3-92f48fafa72e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:47.978973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-945e67ca-315a-4349-9ec3-92f48fafa72e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:47.984479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-945e67ca-315a-4349-9ec3-92f48fafa72e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:54:47.986379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-945e67ca-315a-4349-9ec3-92f48fafa72e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:54:47.987428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-945e67ca-315a-4349-9ec3-92f48fafa72e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:54:48.285381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-945e67ca-315a-4349-9ec3-92f48fafa72e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:54:48.302208 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-945e67ca-315a-4349-9ec3-92f48fafa72e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 200 len: 1507 microversion: 2.1 time: 0.361430 Oct 18 13:54:48.317947 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3092/5980] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:54:47 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:54:59.913039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5ee38b00-5397-4305-8d81-46cd0466bd45 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Action: 'create', calling method: .version_select at 0x7ff60e5e15e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1915458947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh+eRKF3u114mbcNntIBtmnY3W00R9GuBeWUuKfZ6df2V/mmPzbpfpJcBxA7pb/f/NrM23vrpuSbWAUQuRGiCkliCJupUl0sUNvO88odry1N9jxUNnxjN2flYN9uzVwTA=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:54:59.927157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:59.933480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=38 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:54:59.948260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5ee38b00-5397-4305-8d81-46cd0466bd45 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Getting quotas for project 5000aa07e2f5417c9b0441ecc463cba9. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:54:59.954948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5ee38b00-5397-4305-8d81-46cd0466bd45 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Getting quotas for user e1578cd25f24465d941f03800e4bac54 and project 5000aa07e2f5417c9b0441ecc463cba9. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:54:59.987921 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5ee38b00-5397-4305-8d81-46cd0466bd45 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.078823 Oct 18 13:54:59.988987 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2889/5981] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:54:59 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:55:02.584686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1499619170", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "795b218a-f017-4991-a44b-f23a9df60b79"}], "key_name": "tempest-TestNetworkBasicOps-1915458947", "security_groups": [{"name": "tempest-secgroup-smoke-1651244727"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:02.636573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=18 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:02.643402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=28 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:08.584211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] validate_networks() for [('795b218a-f017-4991-a44b-f23a9df60b79', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:55:09.394539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:55:09.395560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:55:09.396555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:55:09.397499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:55:09.398479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:55:09.451566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:09.453146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:09.454201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:09.462919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:09.464074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:09.465104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:09.533486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Getting quotas for project 5000aa07e2f5417c9b0441ecc463cba9. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:55:09.556331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Getting quotas for user e1578cd25f24465d941f03800e4bac54 and project 5000aa07e2f5417c9b0441ecc463cba9. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:55:09.609228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:55:09.618641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:55:09.733552 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc2e78f2-f913-4666-bd8d-493f6eb35866 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 7.152984 Oct 18 13:55:09.736565 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3093/5982] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:55:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 7158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:55:09.749813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5fdcc418-a356-489d-bb30-8043ad48a0ff tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:09.752861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5fdcc418-a356-489d-bb30-8043ad48a0ff tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:09.929313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5fdcc418-a356-489d-bb30-8043ad48a0ff tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:09.971382 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5fdcc418-a356-489d-bb30-8043ad48a0ff tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1249 microversion: 2.1 time: 0.228226 Oct 18 13:55:09.976829 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2890/5983] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:09 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1249 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:11.004847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-594ec535-27f0-42b5-ba91-9be4d430c1cb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:11.005880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-594ec535-27f0-42b5-ba91-9be4d430c1cb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:11.024120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-594ec535-27f0-42b5-ba91-9be4d430c1cb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:11.031901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-594ec535-27f0-42b5-ba91-9be4d430c1cb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:11.032737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-594ec535-27f0-42b5-ba91-9be4d430c1cb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:11.033862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-594ec535-27f0-42b5-ba91-9be4d430c1cb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:11.039104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-594ec535-27f0-42b5-ba91-9be4d430c1cb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:11.040174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-594ec535-27f0-42b5-ba91-9be4d430c1cb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:11.227186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-594ec535-27f0-42b5-ba91-9be4d430c1cb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:11.247247 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-594ec535-27f0-42b5-ba91-9be4d430c1cb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1301 microversion: 2.1 time: 0.244929 Oct 18 13:55:11.250364 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3094/5984] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:10 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1301 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:12.287428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-704c4618-5af9-4329-8696-b491893da060 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:12.288578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-704c4618-5af9-4329-8696-b491893da060 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:12.314905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-704c4618-5af9-4329-8696-b491893da060 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:12.318158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-704c4618-5af9-4329-8696-b491893da060 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:12.321127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-704c4618-5af9-4329-8696-b491893da060 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:12.323389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-704c4618-5af9-4329-8696-b491893da060 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:12.325338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-704c4618-5af9-4329-8696-b491893da060 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:12.327136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-704c4618-5af9-4329-8696-b491893da060 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:12.425966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-704c4618-5af9-4329-8696-b491893da060 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:12.444152 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-704c4618-5af9-4329-8696-b491893da060 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1307 microversion: 2.1 time: 0.159716 Oct 18 13:55:12.465497 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2891/5985] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:12 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1307 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:13.482697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bd843f3e-8571-4c17-9011-a84bdce6fec1 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:13.489285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bd843f3e-8571-4c17-9011-a84bdce6fec1 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:13.539456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd843f3e-8571-4c17-9011-a84bdce6fec1 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:13.546116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd843f3e-8571-4c17-9011-a84bdce6fec1 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:13.547139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd843f3e-8571-4c17-9011-a84bdce6fec1 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:13.549541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd843f3e-8571-4c17-9011-a84bdce6fec1 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:13.550287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd843f3e-8571-4c17-9011-a84bdce6fec1 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:13.554230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd843f3e-8571-4c17-9011-a84bdce6fec1 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:14.191462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bd843f3e-8571-4c17-9011-a84bdce6fec1 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:14.213859 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bd843f3e-8571-4c17-9011-a84bdce6fec1 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1375 microversion: 2.1 time: 0.744613 Oct 18 13:55:14.217653 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3095/5986] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:13 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1375 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:15.240042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68bebf4d-c6fc-48bb-b84a-5fc21a814f09 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:15.242259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-68bebf4d-c6fc-48bb-b84a-5fc21a814f09 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:15.260289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68bebf4d-c6fc-48bb-b84a-5fc21a814f09 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:15.261706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68bebf4d-c6fc-48bb-b84a-5fc21a814f09 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:15.264718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68bebf4d-c6fc-48bb-b84a-5fc21a814f09 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:15.268130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68bebf4d-c6fc-48bb-b84a-5fc21a814f09 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:15.270099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68bebf4d-c6fc-48bb-b84a-5fc21a814f09 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:15.272143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68bebf4d-c6fc-48bb-b84a-5fc21a814f09 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:15.691774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-68bebf4d-c6fc-48bb-b84a-5fc21a814f09 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:15.715917 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-68bebf4d-c6fc-48bb-b84a-5fc21a814f09 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1375 microversion: 2.1 time: 0.479951 Oct 18 13:55:15.717443 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2892/5987] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:15 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1375 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:15.787652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ba0185bd-c549-4684-b569-5a91a38e0b4d req-209f4de7-3b37-4d1a-95c4-d1550098358c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6288b0-8e06-40ad-b164-fdb7baa380cd", "tag": "40d53359-8501-41c5-b6e4-4ab40cf2bd25"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:15.824329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ba0185bd-c549-4684-b569-5a91a38e0b4d req-209f4de7-3b37-4d1a-95c4-d1550098358c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:15.824885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ba0185bd-c549-4684-b569-5a91a38e0b4d req-209f4de7-3b37-4d1a-95c4-d1550098358c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:15.825366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ba0185bd-c549-4684-b569-5a91a38e0b4d req-209f4de7-3b37-4d1a-95c4-d1550098358c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:15.862350 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ba0185bd-c549-4684-b569-5a91a38e0b4d req-209f4de7-3b37-4d1a-95c4-d1550098358c service nova] Creating event network-changed:40d53359-8501-41c5-b6e4-4ab40cf2bd25 for instance ed6288b0-8e06-40ad-b164-fdb7baa380cd on n-h1-858384-13 Oct 18 13:55:15.880302 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ba0185bd-c549-4684-b569-5a91a38e0b4d req-209f4de7-3b37-4d1a-95c4-d1550098358c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100300 Oct 18 13:55:15.880960 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3096/5988] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:16.750935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aae13bb1-ac4d-444b-83dc-506ad2f2569a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:16.752257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aae13bb1-ac4d-444b-83dc-506ad2f2569a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:16.763612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aae13bb1-ac4d-444b-83dc-506ad2f2569a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:16.764259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aae13bb1-ac4d-444b-83dc-506ad2f2569a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:16.764887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aae13bb1-ac4d-444b-83dc-506ad2f2569a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:16.777327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aae13bb1-ac4d-444b-83dc-506ad2f2569a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:16.779521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aae13bb1-ac4d-444b-83dc-506ad2f2569a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:16.780543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aae13bb1-ac4d-444b-83dc-506ad2f2569a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:17.056153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aae13bb1-ac4d-444b-83dc-506ad2f2569a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:17.081061 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aae13bb1-ac4d-444b-83dc-506ad2f2569a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1375 microversion: 2.1 time: 0.336876 Oct 18 13:55:17.102569 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2893/5989] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:16 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1375 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:18.142050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4cb1de17-9312-44ce-941d-afb2a6c98dcc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:18.143671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4cb1de17-9312-44ce-941d-afb2a6c98dcc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:18.166560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4cb1de17-9312-44ce-941d-afb2a6c98dcc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:18.167070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4cb1de17-9312-44ce-941d-afb2a6c98dcc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:18.167520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4cb1de17-9312-44ce-941d-afb2a6c98dcc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:18.168238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4cb1de17-9312-44ce-941d-afb2a6c98dcc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:18.168701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4cb1de17-9312-44ce-941d-afb2a6c98dcc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:18.169204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4cb1de17-9312-44ce-941d-afb2a6c98dcc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:18.499795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4cb1de17-9312-44ce-941d-afb2a6c98dcc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:18.519038 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4cb1de17-9312-44ce-941d-afb2a6c98dcc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1375 microversion: 2.1 time: 0.385405 Oct 18 13:55:18.520941 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3097/5990] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:18 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1375 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:19.556821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9cea9a9f-5900-41ae-8689-3ae0bd7d6e51 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:19.558498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9cea9a9f-5900-41ae-8689-3ae0bd7d6e51 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:19.573095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cea9a9f-5900-41ae-8689-3ae0bd7d6e51 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:19.574786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cea9a9f-5900-41ae-8689-3ae0bd7d6e51 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:19.575913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cea9a9f-5900-41ae-8689-3ae0bd7d6e51 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:19.577889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cea9a9f-5900-41ae-8689-3ae0bd7d6e51 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:19.579405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cea9a9f-5900-41ae-8689-3ae0bd7d6e51 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:19.584580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9cea9a9f-5900-41ae-8689-3ae0bd7d6e51 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:19.971512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:20.132104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9cea9a9f-5900-41ae-8689-3ae0bd7d6e51 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:20.172289 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9cea9a9f-5900-41ae-8689-3ae0bd7d6e51 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1375 microversion: 2.1 time: 0.622843 Oct 18 13:55:20.173615 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2894/5991] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:19 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1375 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:21.202368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cfb23d48-e858-44d5-80cf-5e2b70f25c4f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:21.203645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cfb23d48-e858-44d5-80cf-5e2b70f25c4f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:21.221300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:21.222860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:55:21.225110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfb23d48-e858-44d5-80cf-5e2b70f25c4f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:21.225801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfb23d48-e858-44d5-80cf-5e2b70f25c4f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:21.226406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfb23d48-e858-44d5-80cf-5e2b70f25c4f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:21.227309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfb23d48-e858-44d5-80cf-5e2b70f25c4f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:21.227927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfb23d48-e858-44d5-80cf-5e2b70f25c4f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:21.228520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfb23d48-e858-44d5-80cf-5e2b70f25c4f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:21.509129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cfb23d48-e858-44d5-80cf-5e2b70f25c4f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:21.522978 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cfb23d48-e858-44d5-80cf-5e2b70f25c4f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1375 microversion: 2.1 time: 0.327619 Oct 18 13:55:21.534886 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3098/5992] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:21 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1375 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:22.239891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ac8c0ba0-00c1-42f7-9d64-ca9a1a01e192 req-9abd15c4-040a-4901-a0ec-e03fc549a68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6288b0-8e06-40ad-b164-fdb7baa380cd", "name": "network-vif-plugged", "status": "completed", "tag": "40d53359-8501-41c5-b6e4-4ab40cf2bd25"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:22.271864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ac8c0ba0-00c1-42f7-9d64-ca9a1a01e192 req-9abd15c4-040a-4901-a0ec-e03fc549a68b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:22.277711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ac8c0ba0-00c1-42f7-9d64-ca9a1a01e192 req-9abd15c4-040a-4901-a0ec-e03fc549a68b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:22.279876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ac8c0ba0-00c1-42f7-9d64-ca9a1a01e192 req-9abd15c4-040a-4901-a0ec-e03fc549a68b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:22.324684 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ac8c0ba0-00c1-42f7-9d64-ca9a1a01e192 req-9abd15c4-040a-4901-a0ec-e03fc549a68b service nova] Creating event network-vif-plugged:40d53359-8501-41c5-b6e4-4ab40cf2bd25 for instance ed6288b0-8e06-40ad-b164-fdb7baa380cd on n-h1-858384-13 Oct 18 13:55:22.342504 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ac8c0ba0-00c1-42f7-9d64-ca9a1a01e192 req-9abd15c4-040a-4901-a0ec-e03fc549a68b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123241 Oct 18 13:55:22.344771 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2895/5993] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:55:22.558305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9597a131-ac76-4afb-b307-63c35c6adabc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:22.560415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9597a131-ac76-4afb-b307-63c35c6adabc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:22.583858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9597a131-ac76-4afb-b307-63c35c6adabc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:22.588451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9597a131-ac76-4afb-b307-63c35c6adabc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:22.594336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9597a131-ac76-4afb-b307-63c35c6adabc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:22.594336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9597a131-ac76-4afb-b307-63c35c6adabc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:22.601757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9597a131-ac76-4afb-b307-63c35c6adabc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:22.603008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9597a131-ac76-4afb-b307-63c35c6adabc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:23.015041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9597a131-ac76-4afb-b307-63c35c6adabc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:23.030491 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9597a131-ac76-4afb-b307-63c35c6adabc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1375 microversion: 2.1 time: 0.476677 Oct 18 13:55:23.031651 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3099/5994] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:22 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1375 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:24.075028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-596fe312-6296-4d17-82d3-e342186ce375 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:24.079258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-596fe312-6296-4d17-82d3-e342186ce375 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:24.124349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-596fe312-6296-4d17-82d3-e342186ce375 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:24.124868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-596fe312-6296-4d17-82d3-e342186ce375 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:24.131828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-596fe312-6296-4d17-82d3-e342186ce375 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:24.132761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-596fe312-6296-4d17-82d3-e342186ce375 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:24.133286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-596fe312-6296-4d17-82d3-e342186ce375 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:24.133759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-596fe312-6296-4d17-82d3-e342186ce375 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:24.411000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-596fe312-6296-4d17-82d3-e342186ce375 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:24.427334 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-596fe312-6296-4d17-82d3-e342186ce375 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1375 microversion: 2.1 time: 0.372261 Oct 18 13:55:24.428599 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2896/5995] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:24 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1375 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:25.452556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-52238f1e-aa3c-4cd5-88a6-21293a05375a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:25.453279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-52238f1e-aa3c-4cd5-88a6-21293a05375a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:25.475534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52238f1e-aa3c-4cd5-88a6-21293a05375a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:25.477068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52238f1e-aa3c-4cd5-88a6-21293a05375a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:25.479143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52238f1e-aa3c-4cd5-88a6-21293a05375a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:25.480601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52238f1e-aa3c-4cd5-88a6-21293a05375a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:25.481820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52238f1e-aa3c-4cd5-88a6-21293a05375a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:25.482871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-52238f1e-aa3c-4cd5-88a6-21293a05375a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:25.699685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-52238f1e-aa3c-4cd5-88a6-21293a05375a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:25.725248 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-52238f1e-aa3c-4cd5-88a6-21293a05375a tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1547 microversion: 2.1 time: 0.276838 Oct 18 13:55:25.726753 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3100/5996] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:25 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1547 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:55:25.760665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-52ba4288-ee21-44bd-897a-bd94e9452f69 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:55:25.763146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-52ba4288-ee21-44bd-897a-bd94e9452f69 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:25.775547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52ba4288-ee21-44bd-897a-bd94e9452f69 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:25.776826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52ba4288-ee21-44bd-897a-bd94e9452f69 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:25.777975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52ba4288-ee21-44bd-897a-bd94e9452f69 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:25.781284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52ba4288-ee21-44bd-897a-bd94e9452f69 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:25.782425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52ba4288-ee21-44bd-897a-bd94e9452f69 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:25.783106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52ba4288-ee21-44bd-897a-bd94e9452f69 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:25.994208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-52ba4288-ee21-44bd-897a-bd94e9452f69 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:55:26.019517 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-52ba4288-ee21-44bd-897a-bd94e9452f69 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1547 microversion: 2.1 time: 0.265087 Oct 18 13:55:26.020593 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2897/5997] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:55:25 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1547 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:55:26.207143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8bb2b4ec-a590-44bf-a324-1f63e9e150e3 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "054bcc28-060d-450e-86e7-477be5f1f982", "device": "/dev/sdb"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:55:26.210485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8bb2b4ec-a590-44bf-a324-1f63e9e150e3 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:55:26.219338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bb2b4ec-a590-44bf-a324-1f63e9e150e3 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:26.234991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bb2b4ec-a590-44bf-a324-1f63e9e150e3 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:26.235791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bb2b4ec-a590-44bf-a324-1f63e9e150e3 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:26.236559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bb2b4ec-a590-44bf-a324-1f63e9e150e3 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:55:26.237021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bb2b4ec-a590-44bf-a324-1f63e9e150e3 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:55:26.237642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bb2b4ec-a590-44bf-a324-1f63e9e150e3 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:55:26.675787 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8bb2b4ec-a590-44bf-a324-1f63e9e150e3 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "POST /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.472663 Oct 18 13:55:26.706419 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3101/5998] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:55:26 2022] POST /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:01.502241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-208248d9-1aae-457e-b5e4-24853aa87e33 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:01.503433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-208248d9-1aae-457e-b5e4-24853aa87e33 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:01.510291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:01.511139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=38 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:01.512706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-208248d9-1aae-457e-b5e4-24853aa87e33 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:01.513498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-208248d9-1aae-457e-b5e4-24853aa87e33 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:01.513997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-208248d9-1aae-457e-b5e4-24853aa87e33 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:01.514861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-208248d9-1aae-457e-b5e4-24853aa87e33 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:01.515377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-208248d9-1aae-457e-b5e4-24853aa87e33 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:01.515869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-208248d9-1aae-457e-b5e4-24853aa87e33 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:01.626492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-208248d9-1aae-457e-b5e4-24853aa87e33 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lazy-loading 'services' on Instance uuid c951f769-6c31-4af5-b2ed-6b23ab13fe04 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:56:01.715084 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-208248d9-1aae-457e-b5e4-24853aa87e33 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04/os-volume_attachments/054bcc28-060d-450e-86e7-477be5f1f982" status: 202 len: 0 microversion: 2.1 time: 0.216421 Oct 18 13:56:01.719769 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2898/5999] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:56:01 2022] DELETE /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04/os-volume_attachments/054bcc28-060d-450e-86e7-477be5f1f982 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:56:05.237031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8b5e38b0-422f-4e4d-a78a-73b031d09969 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:05.237674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8b5e38b0-422f-4e4d-a78a-73b031d09969 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:05.243546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:05.244408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:05.260171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b5e38b0-422f-4e4d-a78a-73b031d09969 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:05.260687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b5e38b0-422f-4e4d-a78a-73b031d09969 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:05.262663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b5e38b0-422f-4e4d-a78a-73b031d09969 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:05.264787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b5e38b0-422f-4e4d-a78a-73b031d09969 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:05.266441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b5e38b0-422f-4e4d-a78a-73b031d09969 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:05.266922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b5e38b0-422f-4e4d-a78a-73b031d09969 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:05.334967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8b5e38b0-422f-4e4d-a78a-73b031d09969 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:56:05.606703 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8b5e38b0-422f-4e4d-a78a-73b031d09969 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 204 len: 0 microversion: 2.1 time: 0.372634 Oct 18 13:56:05.611970 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3102/6000] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:56:05 2022] DELETE /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:56:05.624825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f84338a9-71ac-43ad-a3cf-7447ef1d7226 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:05.625665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f84338a9-71ac-43ad-a3cf-7447ef1d7226 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:05.642412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f84338a9-71ac-43ad-a3cf-7447ef1d7226 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:05.643395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f84338a9-71ac-43ad-a3cf-7447ef1d7226 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:05.644070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f84338a9-71ac-43ad-a3cf-7447ef1d7226 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:05.645833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f84338a9-71ac-43ad-a3cf-7447ef1d7226 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:05.649827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f84338a9-71ac-43ad-a3cf-7447ef1d7226 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:05.650617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f84338a9-71ac-43ad-a3cf-7447ef1d7226 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:06.020304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f84338a9-71ac-43ad-a3cf-7447ef1d7226 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:06.040264 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f84338a9-71ac-43ad-a3cf-7447ef1d7226 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1553 microversion: 2.1 time: 0.423321 Oct 18 13:56:06.061367 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2899/6001] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:05 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1553 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:07.067443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c5014282-56c3-4846-9263-1cc2b9214d12 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:07.068892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c5014282-56c3-4846-9263-1cc2b9214d12 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:07.090833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5014282-56c3-4846-9263-1cc2b9214d12 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:07.091369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5014282-56c3-4846-9263-1cc2b9214d12 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:07.091817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5014282-56c3-4846-9263-1cc2b9214d12 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:07.096897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5014282-56c3-4846-9263-1cc2b9214d12 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:07.097519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5014282-56c3-4846-9263-1cc2b9214d12 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:07.098287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5014282-56c3-4846-9263-1cc2b9214d12 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:07.647823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c5014282-56c3-4846-9263-1cc2b9214d12 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:07.661807 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c5014282-56c3-4846-9263-1cc2b9214d12 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1553 microversion: 2.1 time: 0.598864 Oct 18 13:56:07.690935 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3103/6002] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:07 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1553 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:08.693597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a88ebb4-de23-4a88-93ee-06b4ae407b11 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:08.694314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4a88ebb4-de23-4a88-93ee-06b4ae407b11 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:08.702260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a88ebb4-de23-4a88-93ee-06b4ae407b11 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:08.703058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a88ebb4-de23-4a88-93ee-06b4ae407b11 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:08.703702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a88ebb4-de23-4a88-93ee-06b4ae407b11 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:08.707282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a88ebb4-de23-4a88-93ee-06b4ae407b11 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:08.718238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a88ebb4-de23-4a88-93ee-06b4ae407b11 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:08.719464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a88ebb4-de23-4a88-93ee-06b4ae407b11 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:08.920085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d7127d0f-1a0b-4a1c-9ce5-d88938b1e0a3 req-48aef0d2-ebbd-4d45-96ea-c24a5dabc25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6288b0-8e06-40ad-b164-fdb7baa380cd", "name": "network-vif-deleted", "tag": "40d53359-8501-41c5-b6e4-4ab40cf2bd25"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:08.966782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d7127d0f-1a0b-4a1c-9ce5-d88938b1e0a3 req-48aef0d2-ebbd-4d45-96ea-c24a5dabc25b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:08.972987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d7127d0f-1a0b-4a1c-9ce5-d88938b1e0a3 req-48aef0d2-ebbd-4d45-96ea-c24a5dabc25b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:08.973766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d7127d0f-1a0b-4a1c-9ce5-d88938b1e0a3 req-48aef0d2-ebbd-4d45-96ea-c24a5dabc25b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:09.006694 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d7127d0f-1a0b-4a1c-9ce5-d88938b1e0a3 req-48aef0d2-ebbd-4d45-96ea-c24a5dabc25b service nova] Creating event network-vif-deleted:40d53359-8501-41c5-b6e4-4ab40cf2bd25 for instance ed6288b0-8e06-40ad-b164-fdb7baa380cd on n-h1-858384-13 Oct 18 13:56:09.039487 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d7127d0f-1a0b-4a1c-9ce5-d88938b1e0a3 req-48aef0d2-ebbd-4d45-96ea-c24a5dabc25b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137604 Oct 18 13:56:09.040121 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3104/6003] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:09.373813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a88ebb4-de23-4a88-93ee-06b4ae407b11 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:09.398754 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4a88ebb4-de23-4a88-93ee-06b4ae407b11 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 200 len: 1485 microversion: 2.1 time: 0.708967 Oct 18 13:56:09.399376 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2900/6004] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:08 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 1485 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:10.429045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-472bf5ed-fdff-4603-8aa8-9b8e2ea6316b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:10.430081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-472bf5ed-fdff-4603-8aa8-9b8e2ea6316b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: ed6288b0-8e06-40ad-b164-fdb7baa380cd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:10.447632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-472bf5ed-fdff-4603-8aa8-9b8e2ea6316b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:10.449313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-472bf5ed-fdff-4603-8aa8-9b8e2ea6316b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:10.449685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-472bf5ed-fdff-4603-8aa8-9b8e2ea6316b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:10.451124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-472bf5ed-fdff-4603-8aa8-9b8e2ea6316b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:10.452534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-472bf5ed-fdff-4603-8aa8-9b8e2ea6316b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:10.456274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-472bf5ed-fdff-4603-8aa8-9b8e2ea6316b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:10.493559 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-472bf5ed-fdff-4603-8aa8-9b8e2ea6316b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] HTTP exception thrown: Instance ed6288b0-8e06-40ad-b164-fdb7baa380cd could not be found. Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-472bf5ed-fdff-4603-8aa8-9b8e2ea6316b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Request method failure captured: Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd HTTP/1.1 Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq_OU17etjgstOSNB5QP9PziKjMCPdMMj8rW-vMKYqMNHfc_30LNb5q1zrOc19FYuRKW-CvKyE1cJc64kgaaj850F224XBxmzq_uYVbiwaJhdyXAs0xaYAMNV0IxRbkR_I_RYNKJeFkinUSMLb5ajxsWEAaZ-au_ajLuE-Um86MskVE Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 5000aa07e2f5417c9b0441ecc463cba9 Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestNetworkBasicOps-1206184800 Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5000aa07e2f5417c9b0441ecc463cba9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5000aa07e2f5417c9b0441ecc463cba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5000aa07e2f5417c9b0441ecc463cba9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5000aa07e2f5417c9b0441ecc463cba9"}]}] Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestNetworkBasicOps-1206184800 Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 5000aa07e2f5417c9b0441ecc463cba9 Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestNetworkBasicOps-1206184800 Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestNetworkBasicOps-1206184800-project Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e1578cd25f24465d941f03800e4bac54 Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestNetworkBasicOps-1206184800-project Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance ed6288b0-8e06-40ad-b164-fdb7baa380cd could not be found. Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'ed6288b0-8e06-40ad-b164-fdb7baa380cd'} Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed6288b0-8e06-40ad-b164-fdb7baa380cd could not be found. Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed6288b0-8e06-40ad-b164-fdb7baa380cd could not be found. Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:56:10.498179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:56:10.502255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:56:10.502255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:56:10.502255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:56:10.502255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:56:10.502255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:56:10.502255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed6288b0-8e06-40ad-b164-fdb7baa380cd could not be found. Oct 18 13:56:10.502255 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:56:10.509779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-472bf5ed-fdff-4603-8aa8-9b8e2ea6316b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Returning 404 to user: Instance ed6288b0-8e06-40ad-b164-fdb7baa380cd could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:56:10.513019 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-472bf5ed-fdff-4603-8aa8-9b8e2ea6316b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd" status: 404 len: 111 microversion: 2.1 time: 0.088767 Oct 18 13:56:10.514841 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3105/6005] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:10 2022] GET /compute/v2.1/servers/ed6288b0-8e06-40ad-b164-fdb7baa380cd => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:56:10.897367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8ec5ffa5-94ca-4804-9312-65811e1b5fdc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '.version_select at 0x7ff60f6e3160>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:10.952912 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8ec5ffa5-94ca-4804-9312-65811e1b5fdc tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1915458947" status: 202 len: 0 microversion: 2.1 time: 0.059976 Oct 18 13:56:10.954162 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2901/6006] 10.222.0.40 () {58 vars in 1257 bytes} [Tue Oct 18 13:56:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1915458947 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:56:12.553967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9afa25d1-9ed7-409d-ab35-81bb98722941 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:12.555044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9afa25d1-9ed7-409d-ab35-81bb98722941 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:12.575376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9afa25d1-9ed7-409d-ab35-81bb98722941 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:12.576173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9afa25d1-9ed7-409d-ab35-81bb98722941 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:12.577496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9afa25d1-9ed7-409d-ab35-81bb98722941 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:12.578506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9afa25d1-9ed7-409d-ab35-81bb98722941 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:12.582481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9afa25d1-9ed7-409d-ab35-81bb98722941 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:12.583707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9afa25d1-9ed7-409d-ab35-81bb98722941 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:12.720222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9afa25d1-9ed7-409d-ab35-81bb98722941 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:56:12.909234 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9afa25d1-9ed7-409d-ab35-81bb98722941 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 204 len: 0 microversion: 2.1 time: 0.357952 Oct 18 13:56:12.911624 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3106/6007] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:56:12 2022] DELETE /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:56:12.920489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-57505d4f-c267-4b4e-b162-984dc34e5394 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:12.921720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-57505d4f-c267-4b4e-b162-984dc34e5394 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:12.946244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57505d4f-c267-4b4e-b162-984dc34e5394 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:12.951256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57505d4f-c267-4b4e-b162-984dc34e5394 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:12.952217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57505d4f-c267-4b4e-b162-984dc34e5394 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:12.953001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57505d4f-c267-4b4e-b162-984dc34e5394 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:12.953509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57505d4f-c267-4b4e-b162-984dc34e5394 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:12.953946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-57505d4f-c267-4b4e-b162-984dc34e5394 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:13.537496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-57505d4f-c267-4b4e-b162-984dc34e5394 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:13.549936 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-57505d4f-c267-4b4e-b162-984dc34e5394 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 200 len: 1513 microversion: 2.1 time: 0.633850 Oct 18 13:56:13.567746 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2902/6008] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:12 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 1513 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:14.584753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b2481275-00a4-4ef3-8744-5992885b9beb tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:14.586171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b2481275-00a4-4ef3-8744-5992885b9beb tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:14.615788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2481275-00a4-4ef3-8744-5992885b9beb tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:14.616664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2481275-00a4-4ef3-8744-5992885b9beb tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:14.617934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2481275-00a4-4ef3-8744-5992885b9beb tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:14.623927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2481275-00a4-4ef3-8744-5992885b9beb tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:14.626391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2481275-00a4-4ef3-8744-5992885b9beb tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:14.627057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2481275-00a4-4ef3-8744-5992885b9beb tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:15.363724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-f405f9d3-899e-43fe-b647-c99fd50226fa req-8a98e2dd-21e0-43f1-aa10-c20badc22d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c951f769-6c31-4af5-b2ed-6b23ab13fe04", "name": "network-vif-deleted", "tag": "eb65d8ff-e0ab-46fe-82e0-47102319f1b9"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:15.439464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f405f9d3-899e-43fe-b647-c99fd50226fa req-8a98e2dd-21e0-43f1-aa10-c20badc22d10 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:15.440762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f405f9d3-899e-43fe-b647-c99fd50226fa req-8a98e2dd-21e0-43f1-aa10-c20badc22d10 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:15.443655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f405f9d3-899e-43fe-b647-c99fd50226fa req-8a98e2dd-21e0-43f1-aa10-c20badc22d10 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:15.485921 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f405f9d3-899e-43fe-b647-c99fd50226fa req-8a98e2dd-21e0-43f1-aa10-c20badc22d10 service nova] Creating event network-vif-deleted:eb65d8ff-e0ab-46fe-82e0-47102319f1b9 for instance c951f769-6c31-4af5-b2ed-6b23ab13fe04 on n-h2-858384-13 Oct 18 13:56:15.513745 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-f405f9d3-899e-43fe-b647-c99fd50226fa req-8a98e2dd-21e0-43f1-aa10-c20badc22d10 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163291 Oct 18 13:56:15.517861 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2903/6009] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:15.793368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b2481275-00a4-4ef3-8744-5992885b9beb tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:15.811594 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b2481275-00a4-4ef3-8744-5992885b9beb tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 200 len: 1513 microversion: 2.1 time: 1.231699 Oct 18 13:56:15.827257 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3107/6010] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:14 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 1513 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:15.904379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4db0b182-b29a-431d-bebf-61b9fd77d804 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:15.904734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-618ca8a7-7d41-4944-add5-66571f049bea req-2fa50dbe-758b-47f5-ad6b-d5114d5abade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb1d00b-c865-462a-919c-dd989a50751b", "tag": "2baa912d-f01c-474d-a3cf-39d7e8768f0f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:15.905836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4db0b182-b29a-431d-bebf-61b9fd77d804 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:15.933418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4db0b182-b29a-431d-bebf-61b9fd77d804 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:15.937281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4db0b182-b29a-431d-bebf-61b9fd77d804 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:15.940099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4db0b182-b29a-431d-bebf-61b9fd77d804 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:15.940099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4db0b182-b29a-431d-bebf-61b9fd77d804 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:15.940099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4db0b182-b29a-431d-bebf-61b9fd77d804 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:15.940099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4db0b182-b29a-431d-bebf-61b9fd77d804 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:15.940724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-618ca8a7-7d41-4944-add5-66571f049bea req-2fa50dbe-758b-47f5-ad6b-d5114d5abade service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:15.940904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-618ca8a7-7d41-4944-add5-66571f049bea req-2fa50dbe-758b-47f5-ad6b-d5114d5abade service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:15.941356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-618ca8a7-7d41-4944-add5-66571f049bea req-2fa50dbe-758b-47f5-ad6b-d5114d5abade service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:15.996829 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-618ca8a7-7d41-4944-add5-66571f049bea req-2fa50dbe-758b-47f5-ad6b-d5114d5abade service nova] Creating event network-changed:2baa912d-f01c-474d-a3cf-39d7e8768f0f for instance 5eb1d00b-c865-462a-919c-dd989a50751b on n-h1-858384-13 Oct 18 13:56:16.019410 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-618ca8a7-7d41-4944-add5-66571f049bea req-2fa50dbe-758b-47f5-ad6b-d5114d5abade service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122792 Oct 18 13:56:16.028945 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3108/6011] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:16.050117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4db0b182-b29a-431d-bebf-61b9fd77d804 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:56:16.245858 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4db0b182-b29a-431d-bebf-61b9fd77d804 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 204 len: 0 microversion: 2.1 time: 0.353987 Oct 18 13:56:16.247345 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2904/6012] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:56:15 2022] DELETE /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:56:16.256492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f45360dc-b66a-4e48-b019-8c537d99b490 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:16.257671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f45360dc-b66a-4e48-b019-8c537d99b490 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:16.278827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f45360dc-b66a-4e48-b019-8c537d99b490 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:16.290451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f45360dc-b66a-4e48-b019-8c537d99b490 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:16.291286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f45360dc-b66a-4e48-b019-8c537d99b490 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:16.293486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f45360dc-b66a-4e48-b019-8c537d99b490 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:16.294213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f45360dc-b66a-4e48-b019-8c537d99b490 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:16.294871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f45360dc-b66a-4e48-b019-8c537d99b490 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:16.596300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f45360dc-b66a-4e48-b019-8c537d99b490 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:16.615508 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f45360dc-b66a-4e48-b019-8c537d99b490 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1669 microversion: 2.1 time: 0.361249 Oct 18 13:56:16.616544 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3109/6013] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:16 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1669 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:16.841931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-da300899-8168-48ef-9109-91ae1a74865b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:16.842775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-da300899-8168-48ef-9109-91ae1a74865b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: c951f769-6c31-4af5-b2ed-6b23ab13fe04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:16.863625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da300899-8168-48ef-9109-91ae1a74865b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:16.864771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da300899-8168-48ef-9109-91ae1a74865b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:16.865999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da300899-8168-48ef-9109-91ae1a74865b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:16.871915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da300899-8168-48ef-9109-91ae1a74865b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:16.877876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da300899-8168-48ef-9109-91ae1a74865b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:16.882506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-da300899-8168-48ef-9109-91ae1a74865b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:16.927124 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-da300899-8168-48ef-9109-91ae1a74865b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] HTTP exception thrown: Instance c951f769-6c31-4af5-b2ed-6b23ab13fe04 could not be found. Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-da300899-8168-48ef-9109-91ae1a74865b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Request method failure captured: Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 HTTP/1.1 Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq-2Ah8lpND7MyP_QfhmXqsE5BSFcu5z1EeBQyXk09iCLlYASowo6h35JAoHQMvSsGOc8_2G5-1DQmFNrAp40DEGJ5w9H_rMYEQIrnBdoqjs8-gkZNOqqIDAaPhq-9f6BNJUnKuAwK3E0pFk_ONtoMI55OO6IIVuaWoQ7MHE10cj2PE Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 265512d8e20c440aa47d65744b7c5e77 Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1274206424 Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/265512d8e20c440aa47d65744b7c5e77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/265512d8e20c440aa47d65744b7c5e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/265512d8e20c440aa47d65744b7c5e77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_265512d8e20c440aa47d65744b7c5e77"}]}] Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-VolumesSnapshotTestJSON-1274206424 Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 265512d8e20c440aa47d65744b7c5e77 Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1274206424 Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-VolumesSnapshotTestJSON-1274206424-project Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 113b44ece3a640f0bafbcac853e1a994 Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-VolumesSnapshotTestJSON-1274206424-project Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance c951f769-6c31-4af5-b2ed-6b23ab13fe04 could not be found. Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'c951f769-6c31-4af5-b2ed-6b23ab13fe04'} Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c951f769-6c31-4af5-b2ed-6b23ab13fe04 could not be found. Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c951f769-6c31-4af5-b2ed-6b23ab13fe04 could not be found. Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:56:16.930173 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:56:16.935153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:56:16.935153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:56:16.935153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:56:16.935153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:56:16.935153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:56:16.935153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c951f769-6c31-4af5-b2ed-6b23ab13fe04 could not be found. Oct 18 13:56:16.935153 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:56:16.942033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-da300899-8168-48ef-9109-91ae1a74865b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Returning 404 to user: Instance c951f769-6c31-4af5-b2ed-6b23ab13fe04 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:56:16.943090 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-da300899-8168-48ef-9109-91ae1a74865b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04" status: 404 len: 111 microversion: 2.1 time: 0.106813 Oct 18 13:56:16.945076 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2905/6014] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:16 2022] GET /compute/v2.1/servers/c951f769-6c31-4af5-b2ed-6b23ab13fe04 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:56:17.651945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e893b2d0-69f0-4b9b-80b3-dffa74dcd6b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:17.652884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e893b2d0-69f0-4b9b-80b3-dffa74dcd6b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:17.670716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e893b2d0-69f0-4b9b-80b3-dffa74dcd6b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:17.671256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e893b2d0-69f0-4b9b-80b3-dffa74dcd6b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:17.671697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e893b2d0-69f0-4b9b-80b3-dffa74dcd6b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:17.672432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e893b2d0-69f0-4b9b-80b3-dffa74dcd6b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:17.674024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e893b2d0-69f0-4b9b-80b3-dffa74dcd6b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:17.674467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e893b2d0-69f0-4b9b-80b3-dffa74dcd6b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:18.130007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e893b2d0-69f0-4b9b-80b3-dffa74dcd6b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:18.152293 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e893b2d0-69f0-4b9b-80b3-dffa74dcd6b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1669 microversion: 2.1 time: 0.510342 Oct 18 13:56:18.185264 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3110/6015] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:17 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1669 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:19.185422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-20b8b254-361b-4f8d-a57a-5a13c862815e tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:19.186809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-20b8b254-361b-4f8d-a57a-5a13c862815e tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:19.206468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20b8b254-361b-4f8d-a57a-5a13c862815e tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:19.207368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20b8b254-361b-4f8d-a57a-5a13c862815e tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:19.208058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20b8b254-361b-4f8d-a57a-5a13c862815e tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:19.209107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20b8b254-361b-4f8d-a57a-5a13c862815e tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:19.209940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20b8b254-361b-4f8d-a57a-5a13c862815e tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:19.211976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20b8b254-361b-4f8d-a57a-5a13c862815e tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:19.836967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-20b8b254-361b-4f8d-a57a-5a13c862815e tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:19.858193 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-20b8b254-361b-4f8d-a57a-5a13c862815e tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1550 microversion: 2.1 time: 0.685665 Oct 18 13:56:19.858817 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2906/6016] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:19 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1550 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:20.259541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-90501664-7409-478c-8aa5-61b882184a95 req-fa52e265-6777-4e40-84a6-b7f23f1f7d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb1d00b-c865-462a-919c-dd989a50751b", "name": "network-vif-deleted", "tag": "2baa912d-f01c-474d-a3cf-39d7e8768f0f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:20.306009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-90501664-7409-478c-8aa5-61b882184a95 req-fa52e265-6777-4e40-84a6-b7f23f1f7d60 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:20.306978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-90501664-7409-478c-8aa5-61b882184a95 req-fa52e265-6777-4e40-84a6-b7f23f1f7d60 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:20.308035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-90501664-7409-478c-8aa5-61b882184a95 req-fa52e265-6777-4e40-84a6-b7f23f1f7d60 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:20.345591 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-90501664-7409-478c-8aa5-61b882184a95 req-fa52e265-6777-4e40-84a6-b7f23f1f7d60 service nova] Creating event network-vif-deleted:2baa912d-f01c-474d-a3cf-39d7e8768f0f for instance 5eb1d00b-c865-462a-919c-dd989a50751b on n-h1-858384-13 Oct 18 13:56:20.389312 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-90501664-7409-478c-8aa5-61b882184a95 req-fa52e265-6777-4e40-84a6-b7f23f1f7d60 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138496 Oct 18 13:56:20.390393 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3111/6017] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:20.883200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:20.884012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:20.899634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:20.900135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:20.900572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:20.906610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:20.907673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:20.911335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:20.984873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:20.985674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:20.986309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:20.986933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lazy-loading 'fault' on Instance uuid 5eb1d00b-c865-462a-919c-dd989a50751b {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:56:21.465455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:21.473033 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5c3f91f6-5913-45fd-8467-17b217078990 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 200 len: 1336 microversion: 2.1 time: 0.594102 Oct 18 13:56:21.473925 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2907/6018] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:20 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 1336 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:22.500848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-584a852d-855b-4f55-9969-360c9383c31d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:22.502289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-584a852d-855b-4f55-9969-360c9383c31d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: 5eb1d00b-c865-462a-919c-dd989a50751b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:22.523380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-584a852d-855b-4f55-9969-360c9383c31d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:22.524218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-584a852d-855b-4f55-9969-360c9383c31d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:22.524886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-584a852d-855b-4f55-9969-360c9383c31d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:22.526433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-584a852d-855b-4f55-9969-360c9383c31d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:22.532174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-584a852d-855b-4f55-9969-360c9383c31d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:22.534958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-584a852d-855b-4f55-9969-360c9383c31d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:22.577414 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-584a852d-855b-4f55-9969-360c9383c31d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] HTTP exception thrown: Instance 5eb1d00b-c865-462a-919c-dd989a50751b could not be found. Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-584a852d-855b-4f55-9969-360c9383c31d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Request method failure captured: Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b HTTP/1.1 Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq_OU17etjgstOSNB5QP9PziKjMCPdMMj8rW-vMKYqMNHfc_30LNb5q1zrOc19FYuRKW-CvKyE1cJc64kgaaj850F224XBxmzq_uYVbiwaJhdyXAs0xaYAMNV0IxRbkR_I_RYNKJeFkinUSMLb5ajxsWEAaZ-au_ajLuE-Um86MskVE Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 5000aa07e2f5417c9b0441ecc463cba9 Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestNetworkBasicOps-1206184800 Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5000aa07e2f5417c9b0441ecc463cba9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5000aa07e2f5417c9b0441ecc463cba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5000aa07e2f5417c9b0441ecc463cba9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5000aa07e2f5417c9b0441ecc463cba9"}]}] Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestNetworkBasicOps-1206184800 Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 5000aa07e2f5417c9b0441ecc463cba9 Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestNetworkBasicOps-1206184800 Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestNetworkBasicOps-1206184800-project Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: e1578cd25f24465d941f03800e4bac54 Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestNetworkBasicOps-1206184800-project Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 5eb1d00b-c865-462a-919c-dd989a50751b could not be found. Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '5eb1d00b-c865-462a-919c-dd989a50751b'} Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb1d00b-c865-462a-919c-dd989a50751b could not be found. Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb1d00b-c865-462a-919c-dd989a50751b could not be found. Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:56:22.586677 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:56:22.591157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:56:22.591157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:56:22.591157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:56:22.591157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:56:22.591157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:56:22.591157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb1d00b-c865-462a-919c-dd989a50751b could not be found. Oct 18 13:56:22.591157 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:56:22.595940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-584a852d-855b-4f55-9969-360c9383c31d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Returning 404 to user: Instance 5eb1d00b-c865-462a-919c-dd989a50751b could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:56:22.599246 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-584a852d-855b-4f55-9969-360c9383c31d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b" status: 404 len: 111 microversion: 2.1 time: 0.104067 Oct 18 13:56:22.600362 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3112/6019] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:22 2022] GET /compute/v2.1/servers/5eb1d00b-c865-462a-919c-dd989a50751b => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:56:22.960400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9673b31e-4266-40db-b304-784c1e0a67a9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '.version_select at 0x7ff60ea414c0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:23.027287 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9673b31e-4266-40db-b304-784c1e0a67a9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-5454164" status: 202 len: 0 microversion: 2.1 time: 0.074060 Oct 18 13:56:23.053965 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2908/6020] 10.222.0.40 () {58 vars in 1248 bytes} [Tue Oct 18 13:56:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-5454164 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:56:29.214302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-900057029", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "8e8e032e-dae9-4be7-9ac4-279c1a87433e"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:29.319526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] validate_networks() for [('8e8e032e-dae9-4be7-9ac4-279c1a87433e', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:56:30.954097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:56:30.955219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:56:30.955852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:56:30.956442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:56:30.957024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:56:30.967301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:30.967679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:30.968120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:30.968949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:30.969422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:30.970010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:30.994891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Getting quotas for project 265512d8e20c440aa47d65744b7c5e77. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:56:31.001721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Getting quotas for user 113b44ece3a640f0bafbcac853e1a994 and project 265512d8e20c440aa47d65744b7c5e77. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:56:31.027937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:56:31.030299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:56:31.093845 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9a568c66-45a1-4ac0-8cc6-96af0c0dfcf5 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.884621 Oct 18 13:56:31.094858 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3113/6021] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:56:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:56:31.108007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c2833fc6-9abf-4b25-b069-bd86e4170514 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:31.108633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c2833fc6-9abf-4b25-b069-bd86e4170514 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:31.210930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c2833fc6-9abf-4b25-b069-bd86e4170514 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:31.220750 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c2833fc6-9abf-4b25-b069-bd86e4170514 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1218 microversion: 2.1 time: 0.118386 Oct 18 13:56:31.224324 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2909/6022] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:31 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:32.258158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-05842d67-f4e0-4da5-a96e-e1aaa9dde820 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:32.259578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-05842d67-f4e0-4da5-a96e-e1aaa9dde820 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:32.271433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05842d67-f4e0-4da5-a96e-e1aaa9dde820 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:32.272404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05842d67-f4e0-4da5-a96e-e1aaa9dde820 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:32.273647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05842d67-f4e0-4da5-a96e-e1aaa9dde820 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:32.274824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05842d67-f4e0-4da5-a96e-e1aaa9dde820 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:32.276056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05842d67-f4e0-4da5-a96e-e1aaa9dde820 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:32.277443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05842d67-f4e0-4da5-a96e-e1aaa9dde820 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:32.389774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-05842d67-f4e0-4da5-a96e-e1aaa9dde820 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:32.407401 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-05842d67-f4e0-4da5-a96e-e1aaa9dde820 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1270 microversion: 2.1 time: 0.155136 Oct 18 13:56:32.422430 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3114/6023] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:32 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:33.437397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4351b5a2-1ba4-4503-af04-d7498adfc57c tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:33.438022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4351b5a2-1ba4-4503-af04-d7498adfc57c tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:33.452110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:33.454039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:33.455495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4351b5a2-1ba4-4503-af04-d7498adfc57c tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:33.455987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4351b5a2-1ba4-4503-af04-d7498adfc57c tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:33.456429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4351b5a2-1ba4-4503-af04-d7498adfc57c tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:33.457149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4351b5a2-1ba4-4503-af04-d7498adfc57c tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:33.471908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4351b5a2-1ba4-4503-af04-d7498adfc57c tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:33.472372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4351b5a2-1ba4-4503-af04-d7498adfc57c tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:33.685069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4351b5a2-1ba4-4503-af04-d7498adfc57c tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:33.693836 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4351b5a2-1ba4-4503-af04-d7498adfc57c tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1276 microversion: 2.1 time: 0.260598 Oct 18 13:56:33.701769 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2910/6024] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:33 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1276 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:34.728239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-73478acd-0490-4326-ace1-e68a72ad00fc tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:34.729046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-73478acd-0490-4326-ace1-e68a72ad00fc tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:34.744350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73478acd-0490-4326-ace1-e68a72ad00fc tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:34.756619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73478acd-0490-4326-ace1-e68a72ad00fc tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:34.757071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73478acd-0490-4326-ace1-e68a72ad00fc tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:34.761959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73478acd-0490-4326-ace1-e68a72ad00fc tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:34.766972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73478acd-0490-4326-ace1-e68a72ad00fc tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:34.771641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73478acd-0490-4326-ace1-e68a72ad00fc tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:35.205355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-73478acd-0490-4326-ace1-e68a72ad00fc tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:35.216647 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-73478acd-0490-4326-ace1-e68a72ad00fc tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1318 microversion: 2.1 time: 0.492522 Oct 18 13:56:35.218160 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3115/6025] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:34 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:36.249696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b38514ce-ac43-4a02-982b-3e3eab951f12 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:36.250630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b38514ce-ac43-4a02-982b-3e3eab951f12 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:36.284014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38514ce-ac43-4a02-982b-3e3eab951f12 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:36.284527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38514ce-ac43-4a02-982b-3e3eab951f12 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:36.284974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38514ce-ac43-4a02-982b-3e3eab951f12 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:36.285738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38514ce-ac43-4a02-982b-3e3eab951f12 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:36.286196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38514ce-ac43-4a02-982b-3e3eab951f12 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:36.286633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b38514ce-ac43-4a02-982b-3e3eab951f12 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:36.748386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b38514ce-ac43-4a02-982b-3e3eab951f12 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:36.760390 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b38514ce-ac43-4a02-982b-3e3eab951f12 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1318 microversion: 2.1 time: 0.515935 Oct 18 13:56:36.765945 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2911/6026] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:36 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:56:37.795674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c38b3a70-e3ee-4b9b-9397-e1ef243037bd tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:37.796909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c38b3a70-e3ee-4b9b-9397-e1ef243037bd tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:37.800072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:37.821859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c38b3a70-e3ee-4b9b-9397-e1ef243037bd tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:37.823237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c38b3a70-e3ee-4b9b-9397-e1ef243037bd tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:37.823863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c38b3a70-e3ee-4b9b-9397-e1ef243037bd tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:37.824794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c38b3a70-e3ee-4b9b-9397-e1ef243037bd tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:37.825444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c38b3a70-e3ee-4b9b-9397-e1ef243037bd tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:37.826060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c38b3a70-e3ee-4b9b-9397-e1ef243037bd tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:37.875132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:38.326961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c38b3a70-e3ee-4b9b-9397-e1ef243037bd tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:38.335277 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c38b3a70-e3ee-4b9b-9397-e1ef243037bd tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1318 microversion: 2.1 time: 0.545660 Oct 18 13:56:38.354040 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3116/6027] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:37 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1318 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:38.604947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-2a184e2b-10f6-42cd-b154-6118f50b7702 req-a3c443cf-cd8a-464c-9683-d5660cc36b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81affc5-2a71-4f8c-9625-408b39b28018", "tag": "d8f07298-f4b7-436d-8ccb-3496e477e475"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:38.643299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2a184e2b-10f6-42cd-b154-6118f50b7702 req-a3c443cf-cd8a-464c-9683-d5660cc36b36 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:38.646344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2a184e2b-10f6-42cd-b154-6118f50b7702 req-a3c443cf-cd8a-464c-9683-d5660cc36b36 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:38.650679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2a184e2b-10f6-42cd-b154-6118f50b7702 req-a3c443cf-cd8a-464c-9683-d5660cc36b36 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:38.686138 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-2a184e2b-10f6-42cd-b154-6118f50b7702 req-a3c443cf-cd8a-464c-9683-d5660cc36b36 service nova] Creating event network-changed:d8f07298-f4b7-436d-8ccb-3496e477e475 for instance b81affc5-2a71-4f8c-9625-408b39b28018 on n-h1-858384-13 Oct 18 13:56:38.698258 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-2a184e2b-10f6-42cd-b154-6118f50b7702 req-a3c443cf-cd8a-464c-9683-d5660cc36b36 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098636 Oct 18 13:56:38.699713 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2912/6028] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:39.365424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-614fe968-3ab3-4cf3-9355-b8feb1c9a7e9 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:39.369976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-614fe968-3ab3-4cf3-9355-b8feb1c9a7e9 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:39.381938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-614fe968-3ab3-4cf3-9355-b8feb1c9a7e9 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:39.382637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-614fe968-3ab3-4cf3-9355-b8feb1c9a7e9 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:39.383465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-614fe968-3ab3-4cf3-9355-b8feb1c9a7e9 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:39.385449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-614fe968-3ab3-4cf3-9355-b8feb1c9a7e9 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:39.386110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-614fe968-3ab3-4cf3-9355-b8feb1c9a7e9 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:39.386804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-614fe968-3ab3-4cf3-9355-b8feb1c9a7e9 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:39.859013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-614fe968-3ab3-4cf3-9355-b8feb1c9a7e9 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:39.872454 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-614fe968-3ab3-4cf3-9355-b8feb1c9a7e9 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1318 microversion: 2.1 time: 0.515181 Oct 18 13:56:39.891148 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3117/6029] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:39 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:40.900593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5a6191af-95bc-4c1c-8567-ad82fc4ca50f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:40.902096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5a6191af-95bc-4c1c-8567-ad82fc4ca50f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:40.913912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a6191af-95bc-4c1c-8567-ad82fc4ca50f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:40.914665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a6191af-95bc-4c1c-8567-ad82fc4ca50f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:40.916064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a6191af-95bc-4c1c-8567-ad82fc4ca50f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:40.920388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a6191af-95bc-4c1c-8567-ad82fc4ca50f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:40.921040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a6191af-95bc-4c1c-8567-ad82fc4ca50f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:40.921623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5a6191af-95bc-4c1c-8567-ad82fc4ca50f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:41.220835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:41.308610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5a6191af-95bc-4c1c-8567-ad82fc4ca50f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:41.335134 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5a6191af-95bc-4c1c-8567-ad82fc4ca50f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1318 microversion: 2.1 time: 0.434838 Oct 18 13:56:41.356475 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2913/6030] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:40 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:42.076731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5691a751-bb3a-44d2-8da9-34cd25b1e27d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Action: 'create', calling method: .version_select at 0x7ff617b2f160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-890502699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTrKlpWM6vK7F0ir/SuT/Jd5GpNhG3rYP/19SyWVMDnYtb9LCXcz9B1KEzeMjlItGSH7B1XTu+GR6/C2Ws1CP5kRxLy3UPsyXep+wPQQzTx0yQSM5UU0R7SB8zCBd83RQ=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:42.106968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:42.109262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:42.189426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-5691a751-bb3a-44d2-8da9-34cd25b1e27d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Getting quotas for project 5000aa07e2f5417c9b0441ecc463cba9. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:56:42.206189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-5691a751-bb3a-44d2-8da9-34cd25b1e27d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Getting quotas for user e1578cd25f24465d941f03800e4bac54 and project 5000aa07e2f5417c9b0441ecc463cba9. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:56:42.263240 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5691a751-bb3a-44d2-8da9-34cd25b1e27d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.195674 Oct 18 13:56:42.264558 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3118/6031] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:56:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:42.363085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-735dc86a-2ded-4056-9a11-b8ebe662f537 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:42.363846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-735dc86a-2ded-4056-9a11-b8ebe662f537 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:42.386922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-735dc86a-2ded-4056-9a11-b8ebe662f537 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:42.387769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-735dc86a-2ded-4056-9a11-b8ebe662f537 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:42.391260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-735dc86a-2ded-4056-9a11-b8ebe662f537 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:42.392287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-735dc86a-2ded-4056-9a11-b8ebe662f537 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:42.397941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-735dc86a-2ded-4056-9a11-b8ebe662f537 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:42.401415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-735dc86a-2ded-4056-9a11-b8ebe662f537 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:42.928942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-735dc86a-2ded-4056-9a11-b8ebe662f537 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:42.940843 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-735dc86a-2ded-4056-9a11-b8ebe662f537 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1318 microversion: 2.1 time: 0.581945 Oct 18 13:56:42.941889 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2914/6032] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:42 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:43.970769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-34b6553b-8906-43b8-985d-7cb773f8b717 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:43.971509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-34b6553b-8906-43b8-985d-7cb773f8b717 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:43.991631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34b6553b-8906-43b8-985d-7cb773f8b717 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:43.993618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34b6553b-8906-43b8-985d-7cb773f8b717 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:43.995741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34b6553b-8906-43b8-985d-7cb773f8b717 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:43.997493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34b6553b-8906-43b8-985d-7cb773f8b717 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:44.002604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34b6553b-8906-43b8-985d-7cb773f8b717 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:44.003330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34b6553b-8906-43b8-985d-7cb773f8b717 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:44.522095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-34b6553b-8906-43b8-985d-7cb773f8b717 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:44.549952 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-34b6553b-8906-43b8-985d-7cb773f8b717 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1318 microversion: 2.1 time: 0.580171 Oct 18 13:56:44.549952 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3119/6033] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:43 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:44.663546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1859946629", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "2e547e25-19cf-4e20-9753-f11ef8131742"}], "key_name": "tempest-TestNetworkBasicOps-890502699", "security_groups": [{"name": "tempest-secgroup-smoke-1626709771"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:44.928398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] validate_networks() for [('2e547e25-19cf-4e20-9753-f11ef8131742', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:56:45.571593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a1371d0c-d27a-4308-b279-064fc47a11d1 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:45.573243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a1371d0c-d27a-4308-b279-064fc47a11d1 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:45.594946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1371d0c-d27a-4308-b279-064fc47a11d1 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:45.598061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1371d0c-d27a-4308-b279-064fc47a11d1 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:45.598970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1371d0c-d27a-4308-b279-064fc47a11d1 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:45.605610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1371d0c-d27a-4308-b279-064fc47a11d1 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:45.606042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1371d0c-d27a-4308-b279-064fc47a11d1 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:45.606484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1371d0c-d27a-4308-b279-064fc47a11d1 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:45.922230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a1371d0c-d27a-4308-b279-064fc47a11d1 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:45.938367 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a1371d0c-d27a-4308-b279-064fc47a11d1 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1318 microversion: 2.1 time: 0.371634 Oct 18 13:56:45.949468 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3120/6034] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:45 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:56:46.384082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:56:46.385607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:56:46.386432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:56:46.387481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:56:46.388277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:56:46.402064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:46.403228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:46.403913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:46.405081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:46.406019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:46.406743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:46.476737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Getting quotas for project 5000aa07e2f5417c9b0441ecc463cba9. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:56:46.506833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Getting quotas for user e1578cd25f24465d941f03800e4bac54 and project 5000aa07e2f5417c9b0441ecc463cba9. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:56:46.547478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d277c2f8-2da0-47e8-bee8-c94efc2e595d req-88869ba3-66ad-4008-9d57-9bfdfccc32b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81affc5-2a71-4f8c-9625-408b39b28018", "name": "network-vif-plugged", "status": "completed", "tag": "d8f07298-f4b7-436d-8ccb-3496e477e475"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:46.591111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d277c2f8-2da0-47e8-bee8-c94efc2e595d req-88869ba3-66ad-4008-9d57-9bfdfccc32b6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:46.596053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:56:46.597584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d277c2f8-2da0-47e8-bee8-c94efc2e595d req-88869ba3-66ad-4008-9d57-9bfdfccc32b6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:46.598185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d277c2f8-2da0-47e8-bee8-c94efc2e595d req-88869ba3-66ad-4008-9d57-9bfdfccc32b6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:46.598762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:56:46.632070 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d277c2f8-2da0-47e8-bee8-c94efc2e595d req-88869ba3-66ad-4008-9d57-9bfdfccc32b6 service nova] Creating event network-vif-plugged:d8f07298-f4b7-436d-8ccb-3496e477e475 for instance b81affc5-2a71-4f8c-9625-408b39b28018 on n-h1-858384-13 Oct 18 13:56:46.644602 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d277c2f8-2da0-47e8-bee8-c94efc2e595d req-88869ba3-66ad-4008-9d57-9bfdfccc32b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102996 Oct 18 13:56:46.646167 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3121/6035] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:46.728895 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-70944a24-da07-4a13-949d-99eeafd43598 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.068010 Oct 18 13:56:46.731297 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2915/6036] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:56:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:56:46.746264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7d6c925a-bd38-4911-9b13-55e0165625c9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:46.747659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7d6c925a-bd38-4911-9b13-55e0165625c9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:46.957523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7d6c925a-bd38-4911-9b13-55e0165625c9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:46.966918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d234d70a-df05-4071-aba7-a8fb51f2e90a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:46.967554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d234d70a-df05-4071-aba7-a8fb51f2e90a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:46.972412 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7d6c925a-bd38-4911-9b13-55e0165625c9 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1248 microversion: 2.1 time: 0.232168 Oct 18 13:56:46.975903 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3122/6037] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:46 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1248 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:47.005382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d234d70a-df05-4071-aba7-a8fb51f2e90a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:47.006047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d234d70a-df05-4071-aba7-a8fb51f2e90a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:47.006501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d234d70a-df05-4071-aba7-a8fb51f2e90a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:47.007255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d234d70a-df05-4071-aba7-a8fb51f2e90a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:47.007714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d234d70a-df05-4071-aba7-a8fb51f2e90a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:47.008141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d234d70a-df05-4071-aba7-a8fb51f2e90a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:47.415136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d234d70a-df05-4071-aba7-a8fb51f2e90a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:47.438079 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d234d70a-df05-4071-aba7-a8fb51f2e90a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1318 microversion: 2.1 time: 0.476391 Oct 18 13:56:47.450761 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2916/6038] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:46 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:56:47.999887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-54b4d8f3-5f08-46b0-a17e-b196c8926413 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:48.001941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-54b4d8f3-5f08-46b0-a17e-b196c8926413 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:48.042846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54b4d8f3-5f08-46b0-a17e-b196c8926413 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:48.048513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54b4d8f3-5f08-46b0-a17e-b196c8926413 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:48.048973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54b4d8f3-5f08-46b0-a17e-b196c8926413 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:48.050754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54b4d8f3-5f08-46b0-a17e-b196c8926413 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:48.051226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54b4d8f3-5f08-46b0-a17e-b196c8926413 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:48.051662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54b4d8f3-5f08-46b0-a17e-b196c8926413 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:48.217478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-54b4d8f3-5f08-46b0-a17e-b196c8926413 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:48.230709 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-54b4d8f3-5f08-46b0-a17e-b196c8926413 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1300 microversion: 2.1 time: 0.236509 Oct 18 13:56:48.241369 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3123/6039] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:47 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1300 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:48.466605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c49100d5-1972-4bd8-bedc-60739977a93a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:48.467864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c49100d5-1972-4bd8-bedc-60739977a93a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:48.488367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c49100d5-1972-4bd8-bedc-60739977a93a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:48.489133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c49100d5-1972-4bd8-bedc-60739977a93a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:48.489614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c49100d5-1972-4bd8-bedc-60739977a93a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:48.490458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c49100d5-1972-4bd8-bedc-60739977a93a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:48.490921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c49100d5-1972-4bd8-bedc-60739977a93a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:48.491338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c49100d5-1972-4bd8-bedc-60739977a93a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:48.911187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c49100d5-1972-4bd8-bedc-60739977a93a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:48.933481 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c49100d5-1972-4bd8-bedc-60739977a93a tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1318 microversion: 2.1 time: 0.470564 Oct 18 13:56:48.936050 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2917/6040] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:48 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:49.257967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a9350cbc-30c2-47b0-9bd9-c69525b98d4d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:49.259651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a9350cbc-30c2-47b0-9bd9-c69525b98d4d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:49.271288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9350cbc-30c2-47b0-9bd9-c69525b98d4d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:49.277240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9350cbc-30c2-47b0-9bd9-c69525b98d4d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:49.278163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9350cbc-30c2-47b0-9bd9-c69525b98d4d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:49.280559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9350cbc-30c2-47b0-9bd9-c69525b98d4d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:49.281740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9350cbc-30c2-47b0-9bd9-c69525b98d4d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:49.289072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9350cbc-30c2-47b0-9bd9-c69525b98d4d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:49.459169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a9350cbc-30c2-47b0-9bd9-c69525b98d4d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:49.476628 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a9350cbc-30c2-47b0-9bd9-c69525b98d4d tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1306 microversion: 2.1 time: 0.217928 Oct 18 13:56:49.479165 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3124/6041] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:49 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1306 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:49.967088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-49dfe3ec-b3f4-4f4b-9c35-77dfea02a921 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:49.967694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-49dfe3ec-b3f4-4f4b-9c35-77dfea02a921 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:49.980200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49dfe3ec-b3f4-4f4b-9c35-77dfea02a921 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:49.981746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49dfe3ec-b3f4-4f4b-9c35-77dfea02a921 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:49.985351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49dfe3ec-b3f4-4f4b-9c35-77dfea02a921 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:49.985351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49dfe3ec-b3f4-4f4b-9c35-77dfea02a921 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:49.989767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49dfe3ec-b3f4-4f4b-9c35-77dfea02a921 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:49.990255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49dfe3ec-b3f4-4f4b-9c35-77dfea02a921 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:50.326251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-49dfe3ec-b3f4-4f4b-9c35-77dfea02a921 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:50.340193 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-49dfe3ec-b3f4-4f4b-9c35-77dfea02a921 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1507 microversion: 2.1 time: 0.377145 Oct 18 13:56:50.340787 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2918/6042] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:49 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:50.372646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6bfe6ed7-7817-4923-8a94-4165fbdb9fe4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45efb11d-1452-4d43-a4fa-f11b51202e7f", "device": "/dev/sdb"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:50.377146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6bfe6ed7-7817-4923-8a94-4165fbdb9fe4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:50.386312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bfe6ed7-7817-4923-8a94-4165fbdb9fe4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:50.387435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bfe6ed7-7817-4923-8a94-4165fbdb9fe4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:50.388127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bfe6ed7-7817-4923-8a94-4165fbdb9fe4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:50.390357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bfe6ed7-7817-4923-8a94-4165fbdb9fe4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:50.391082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bfe6ed7-7817-4923-8a94-4165fbdb9fe4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:50.391945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bfe6ed7-7817-4923-8a94-4165fbdb9fe4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:50.508020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f16f16ea-edd7-4d40-ab2a-8788e93b0c14 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:50.509114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f16f16ea-edd7-4d40-ab2a-8788e93b0c14 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:50.522833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f16f16ea-edd7-4d40-ab2a-8788e93b0c14 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:50.523328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f16f16ea-edd7-4d40-ab2a-8788e93b0c14 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:50.523775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f16f16ea-edd7-4d40-ab2a-8788e93b0c14 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:50.539955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f16f16ea-edd7-4d40-ab2a-8788e93b0c14 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:50.542345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f16f16ea-edd7-4d40-ab2a-8788e93b0c14 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:50.543006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f16f16ea-edd7-4d40-ab2a-8788e93b0c14 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:50.815757 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6bfe6ed7-7817-4923-8a94-4165fbdb9fe4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "POST /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448714 Oct 18 13:56:50.817739 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3125/6043] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 13:56:50 2022] POST /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018/os-volume_attachments => generated 194 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:50.908699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f16f16ea-edd7-4d40-ab2a-8788e93b0c14 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:50.925276 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f16f16ea-edd7-4d40-ab2a-8788e93b0c14 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1374 microversion: 2.1 time: 0.422822 Oct 18 13:56:50.927710 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2919/6044] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:50 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1374 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:56:51.295235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1948354825", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:51.416636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] validate_networks() for None {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:56:51.799243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-54ddd619-db37-4312-b859-023c24b3f243 req-5cd47e29-d11c-4136-9412-5f56a896eae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d960a1-1167-462d-8356-a21647334acb", "tag": "0b89975f-0369-4018-99c0-935061f3d33c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:51.831886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-54ddd619-db37-4312-b859-023c24b3f243 req-5cd47e29-d11c-4136-9412-5f56a896eae9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:51.833403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-54ddd619-db37-4312-b859-023c24b3f243 req-5cd47e29-d11c-4136-9412-5f56a896eae9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:51.834150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-54ddd619-db37-4312-b859-023c24b3f243 req-5cd47e29-d11c-4136-9412-5f56a896eae9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:51.850920 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-54ddd619-db37-4312-b859-023c24b3f243 req-5cd47e29-d11c-4136-9412-5f56a896eae9 service nova] Creating event network-changed:0b89975f-0369-4018-99c0-935061f3d33c for instance a6d960a1-1167-462d-8356-a21647334acb on n-h2-858384-13 Oct 18 13:56:51.858253 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-54ddd619-db37-4312-b859-023c24b3f243 req-5cd47e29-d11c-4136-9412-5f56a896eae9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065016 Oct 18 13:56:51.859826 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2920/6045] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:51.964353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a207569f-6d94-44f1-aaae-7e18d80e5578 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:51.966359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a207569f-6d94-44f1-aaae-7e18d80e5578 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:51.984361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a207569f-6d94-44f1-aaae-7e18d80e5578 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:51.996322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a207569f-6d94-44f1-aaae-7e18d80e5578 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:51.998455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a207569f-6d94-44f1-aaae-7e18d80e5578 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:52.003855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a207569f-6d94-44f1-aaae-7e18d80e5578 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:52.004749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a207569f-6d94-44f1-aaae-7e18d80e5578 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:52.008217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a207569f-6d94-44f1-aaae-7e18d80e5578 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:52.035959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:56:52.037574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:56:52.038269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:56:52.039021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:56:52.039635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:56:52.052641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:52.053465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:52.054247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:52.055208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:52.056828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:52.057719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:52.102487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Getting quotas for project 30a24f74124e442dad213f0190c878cf. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:56:52.117018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Getting quotas for user 7e82b610511c42949550f0c5847c0716 and project 30a24f74124e442dad213f0190c878cf. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:56:52.137275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:56:52.139896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:56:52.201229 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d74fb109-4b83-4dfe-b69a-804ddd8adda3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912956 Oct 18 13:56:52.202973 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3126/6046] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:56:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:56:52.226003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8b02bfdf-b6ce-444d-8b3f-4d2162547576 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:52.226665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8b02bfdf-b6ce-444d-8b3f-4d2162547576 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:52.330016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8b02bfdf-b6ce-444d-8b3f-4d2162547576 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:52.338881 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8b02bfdf-b6ce-444d-8b3f-4d2162547576 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1215 microversion: 2.1 time: 0.128717 Oct 18 13:56:52.354624 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3127/6047] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:52 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:52.470364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a207569f-6d94-44f1-aaae-7e18d80e5578 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:52.479897 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a207569f-6d94-44f1-aaae-7e18d80e5578 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1374 microversion: 2.1 time: 0.528913 Oct 18 13:56:52.480495 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2921/6048] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:51 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1374 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:53.367550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-06fbcd37-2a66-4fac-8fe3-b2653d4c8b1b tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:53.368205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-06fbcd37-2a66-4fac-8fe3-b2653d4c8b1b tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:53.384358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06fbcd37-2a66-4fac-8fe3-b2653d4c8b1b tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:53.384899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06fbcd37-2a66-4fac-8fe3-b2653d4c8b1b tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:53.385313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06fbcd37-2a66-4fac-8fe3-b2653d4c8b1b tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:53.386038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06fbcd37-2a66-4fac-8fe3-b2653d4c8b1b tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:53.387217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06fbcd37-2a66-4fac-8fe3-b2653d4c8b1b tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:53.387217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06fbcd37-2a66-4fac-8fe3-b2653d4c8b1b tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:53.495710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-06fbcd37-2a66-4fac-8fe3-b2653d4c8b1b tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:53.509502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42c8a365-95db-40ec-a014-cd0748a914d5 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:53.510686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-42c8a365-95db-40ec-a014-cd0748a914d5 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:53.517125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42c8a365-95db-40ec-a014-cd0748a914d5 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:53.517873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42c8a365-95db-40ec-a014-cd0748a914d5 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:53.518465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42c8a365-95db-40ec-a014-cd0748a914d5 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:53.519358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42c8a365-95db-40ec-a014-cd0748a914d5 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:53.519996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42c8a365-95db-40ec-a014-cd0748a914d5 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:53.520766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42c8a365-95db-40ec-a014-cd0748a914d5 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:53.521133 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-06fbcd37-2a66-4fac-8fe3-b2653d4c8b1b tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1267 microversion: 2.1 time: 0.157369 Oct 18 13:56:53.525701 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3128/6049] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:53 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:53.995526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-42c8a365-95db-40ec-a014-cd0748a914d5 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:54.008619 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-42c8a365-95db-40ec-a014-cd0748a914d5 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1374 microversion: 2.1 time: 0.502722 Oct 18 13:56:54.014048 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2922/6050] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:53 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1374 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:56:54.546702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9222970c-c4e1-4b41-91b0-b36d095d72e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:54.547440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9222970c-c4e1-4b41-91b0-b36d095d72e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:54.572696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9222970c-c4e1-4b41-91b0-b36d095d72e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:54.574203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9222970c-c4e1-4b41-91b0-b36d095d72e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:54.575191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9222970c-c4e1-4b41-91b0-b36d095d72e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:54.577672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9222970c-c4e1-4b41-91b0-b36d095d72e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:54.578386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9222970c-c4e1-4b41-91b0-b36d095d72e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:54.578994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9222970c-c4e1-4b41-91b0-b36d095d72e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:54.709795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9222970c-c4e1-4b41-91b0-b36d095d72e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:54.723501 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9222970c-c4e1-4b41-91b0-b36d095d72e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1273 microversion: 2.1 time: 0.178791 Oct 18 13:56:54.724457 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3129/6051] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:54 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:55.032720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dfd6aa72-75bc-485b-9081-67eda92209fd tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:55.034450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dfd6aa72-75bc-485b-9081-67eda92209fd tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:55.051821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfd6aa72-75bc-485b-9081-67eda92209fd tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:55.054638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfd6aa72-75bc-485b-9081-67eda92209fd tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:55.057318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfd6aa72-75bc-485b-9081-67eda92209fd tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:55.060466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfd6aa72-75bc-485b-9081-67eda92209fd tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:55.063431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfd6aa72-75bc-485b-9081-67eda92209fd tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:55.064733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dfd6aa72-75bc-485b-9081-67eda92209fd tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:55.482561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dfd6aa72-75bc-485b-9081-67eda92209fd tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:55.495596 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dfd6aa72-75bc-485b-9081-67eda92209fd tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1374 microversion: 2.1 time: 0.467460 Oct 18 13:56:55.499735 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2923/6052] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:55 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1374 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:55.750771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dc9625d3-4676-4c4e-bfa1-efb551cca8b3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:55.752191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dc9625d3-4676-4c4e-bfa1-efb551cca8b3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:55.770593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc9625d3-4676-4c4e-bfa1-efb551cca8b3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:55.773302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc9625d3-4676-4c4e-bfa1-efb551cca8b3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:55.776098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc9625d3-4676-4c4e-bfa1-efb551cca8b3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:55.777067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc9625d3-4676-4c4e-bfa1-efb551cca8b3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:55.777741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc9625d3-4676-4c4e-bfa1-efb551cca8b3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:55.778369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc9625d3-4676-4c4e-bfa1-efb551cca8b3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:56.098085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc9625d3-4676-4c4e-bfa1-efb551cca8b3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:56.108001 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dc9625d3-4676-4c4e-bfa1-efb551cca8b3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1315 microversion: 2.1 time: 0.363750 Oct 18 13:56:56.108596 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3130/6053] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:55 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:56.519985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2f115882-8a20-4b38-81e0-a90a6214a915 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:56.521287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2f115882-8a20-4b38-81e0-a90a6214a915 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:56.525240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:56.539732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:56:56.547695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f115882-8a20-4b38-81e0-a90a6214a915 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:56.548421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f115882-8a20-4b38-81e0-a90a6214a915 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:56.549028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f115882-8a20-4b38-81e0-a90a6214a915 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:56.549960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f115882-8a20-4b38-81e0-a90a6214a915 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:56.550592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f115882-8a20-4b38-81e0-a90a6214a915 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:56.551199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f115882-8a20-4b38-81e0-a90a6214a915 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:57.105025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2f115882-8a20-4b38-81e0-a90a6214a915 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:57.132672 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2f115882-8a20-4b38-81e0-a90a6214a915 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1374 microversion: 2.1 time: 0.615024 Oct 18 13:56:57.139554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6560bc98-afbb-48bf-a8d1-4acb32324fbc tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:57.139554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6560bc98-afbb-48bf-a8d1-4acb32324fbc tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:57.154244 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2924/6054] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:56 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1374 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:57.166924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6560bc98-afbb-48bf-a8d1-4acb32324fbc tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:57.167892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6560bc98-afbb-48bf-a8d1-4acb32324fbc tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:57.168594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6560bc98-afbb-48bf-a8d1-4acb32324fbc tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:57.170314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6560bc98-afbb-48bf-a8d1-4acb32324fbc tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:57.171881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6560bc98-afbb-48bf-a8d1-4acb32324fbc tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:57.173531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6560bc98-afbb-48bf-a8d1-4acb32324fbc tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:57.281886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e40690b4-b7ed-4af9-8485-e036d89ff168 req-3b9fd202-b611-4932-957f-4897c37d28e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb2b4ec5-0795-4c72-835e-f46378ac66e5", "tag": "e04fdb69-b242-400a-88e4-58b706eac3ce"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:57.332953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e40690b4-b7ed-4af9-8485-e036d89ff168 req-3b9fd202-b611-4932-957f-4897c37d28e1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:57.335018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e40690b4-b7ed-4af9-8485-e036d89ff168 req-3b9fd202-b611-4932-957f-4897c37d28e1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:57.337567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e40690b4-b7ed-4af9-8485-e036d89ff168 req-3b9fd202-b611-4932-957f-4897c37d28e1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:57.391321 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e40690b4-b7ed-4af9-8485-e036d89ff168 req-3b9fd202-b611-4932-957f-4897c37d28e1 service nova] Creating event network-changed:e04fdb69-b242-400a-88e4-58b706eac3ce for instance bb2b4ec5-0795-4c72-835e-f46378ac66e5 on n-h1-858384-13 Oct 18 13:56:57.401355 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e40690b4-b7ed-4af9-8485-e036d89ff168 req-3b9fd202-b611-4932-957f-4897c37d28e1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123472 Oct 18 13:56:57.403296 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2925/6055] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:56:57.473138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6560bc98-afbb-48bf-a8d1-4acb32324fbc tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:57.495900 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6560bc98-afbb-48bf-a8d1-4acb32324fbc tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1315 microversion: 2.1 time: 0.365856 Oct 18 13:56:57.497490 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3131/6056] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:57 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:58.178633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2ddbb7d2-d550-43b7-af1f-169669bb589f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:58.179375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2ddbb7d2-d550-43b7-af1f-169669bb589f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:58.190585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ddbb7d2-d550-43b7-af1f-169669bb589f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:58.191335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ddbb7d2-d550-43b7-af1f-169669bb589f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:58.191766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ddbb7d2-d550-43b7-af1f-169669bb589f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:58.192635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ddbb7d2-d550-43b7-af1f-169669bb589f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:58.193270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ddbb7d2-d550-43b7-af1f-169669bb589f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:58.193879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ddbb7d2-d550-43b7-af1f-169669bb589f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:58.386821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2ddbb7d2-d550-43b7-af1f-169669bb589f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:58.397102 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2ddbb7d2-d550-43b7-af1f-169669bb589f tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1374 microversion: 2.1 time: 0.222785 Oct 18 13:56:58.405322 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2926/6057] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:58 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1374 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:58.522920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bb604b9d-d0b3-4db0-9e9b-aa2e580b7063 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:58.523662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bb604b9d-d0b3-4db0-9e9b-aa2e580b7063 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:58.535439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb604b9d-d0b3-4db0-9e9b-aa2e580b7063 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:58.536205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb604b9d-d0b3-4db0-9e9b-aa2e580b7063 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:58.536866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb604b9d-d0b3-4db0-9e9b-aa2e580b7063 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:58.537846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb604b9d-d0b3-4db0-9e9b-aa2e580b7063 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:58.538311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb604b9d-d0b3-4db0-9e9b-aa2e580b7063 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:58.538974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bb604b9d-d0b3-4db0-9e9b-aa2e580b7063 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:58.782404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bb604b9d-d0b3-4db0-9e9b-aa2e580b7063 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:58.791493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-9c525543-d57b-49b3-9c49-2dd62780a36f req-4f7d4f0b-4b77-402d-aa37-d8240e5d86c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d960a1-1167-462d-8356-a21647334acb", "name": "network-vif-plugged", "status": "completed", "tag": "0b89975f-0369-4018-99c0-935061f3d33c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:56:58.795315 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bb604b9d-d0b3-4db0-9e9b-aa2e580b7063 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1315 microversion: 2.1 time: 0.277073 Oct 18 13:56:58.812164 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3132/6058] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:58 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:58.812264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9c525543-d57b-49b3-9c49-2dd62780a36f req-4f7d4f0b-4b77-402d-aa37-d8240e5d86c8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:58.812264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9c525543-d57b-49b3-9c49-2dd62780a36f req-4f7d4f0b-4b77-402d-aa37-d8240e5d86c8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:58.812264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9c525543-d57b-49b3-9c49-2dd62780a36f req-4f7d4f0b-4b77-402d-aa37-d8240e5d86c8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:58.820271 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-9c525543-d57b-49b3-9c49-2dd62780a36f req-4f7d4f0b-4b77-402d-aa37-d8240e5d86c8 service nova] Creating event network-vif-plugged:0b89975f-0369-4018-99c0-935061f3d33c for instance a6d960a1-1167-462d-8356-a21647334acb on n-h2-858384-13 Oct 18 13:56:58.828347 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-9c525543-d57b-49b3-9c49-2dd62780a36f req-4f7d4f0b-4b77-402d-aa37-d8240e5d86c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040508 Oct 18 13:56:58.829707 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2927/6059] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:56:59.424179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f0c62f9b-ca07-43ed-bcd9-6721f64073b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:59.424836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f0c62f9b-ca07-43ed-bcd9-6721f64073b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:59.431615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0c62f9b-ca07-43ed-bcd9-6721f64073b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:59.432074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0c62f9b-ca07-43ed-bcd9-6721f64073b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:59.432505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0c62f9b-ca07-43ed-bcd9-6721f64073b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:59.433223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0c62f9b-ca07-43ed-bcd9-6721f64073b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:59.433675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0c62f9b-ca07-43ed-bcd9-6721f64073b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:59.434902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f0c62f9b-ca07-43ed-bcd9-6721f64073b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:59.591343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f0c62f9b-ca07-43ed-bcd9-6721f64073b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:56:59.602957 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f0c62f9b-ca07-43ed-bcd9-6721f64073b0 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1374 microversion: 2.1 time: 0.182274 Oct 18 13:56:59.603732 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3133/6060] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:59 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:56:59.820456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a39f05a-cafa-48fe-a13d-fa6a19bf4a62 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:56:59.822017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4a39f05a-cafa-48fe-a13d-fa6a19bf4a62 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:56:59.829950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a39f05a-cafa-48fe-a13d-fa6a19bf4a62 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:59.830436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a39f05a-cafa-48fe-a13d-fa6a19bf4a62 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:59.830868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a39f05a-cafa-48fe-a13d-fa6a19bf4a62 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:56:59.831759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a39f05a-cafa-48fe-a13d-fa6a19bf4a62 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:56:59.832450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a39f05a-cafa-48fe-a13d-fa6a19bf4a62 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:56:59.833260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a39f05a-cafa-48fe-a13d-fa6a19bf4a62 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:00.001702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a39f05a-cafa-48fe-a13d-fa6a19bf4a62 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:00.010083 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4a39f05a-cafa-48fe-a13d-fa6a19bf4a62 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1315 microversion: 2.1 time: 0.193979 Oct 18 13:57:00.010667 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2928/6061] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:56:59 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:57:00.628045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a33b8a2d-40e1-4cce-b478-6bf8b997ce90 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:00.628691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a33b8a2d-40e1-4cce-b478-6bf8b997ce90 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:00.637247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a33b8a2d-40e1-4cce-b478-6bf8b997ce90 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:00.637856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a33b8a2d-40e1-4cce-b478-6bf8b997ce90 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:00.638297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a33b8a2d-40e1-4cce-b478-6bf8b997ce90 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:00.639011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a33b8a2d-40e1-4cce-b478-6bf8b997ce90 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:00.639475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a33b8a2d-40e1-4cce-b478-6bf8b997ce90 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:00.639898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a33b8a2d-40e1-4cce-b478-6bf8b997ce90 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:00.785718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a33b8a2d-40e1-4cce-b478-6bf8b997ce90 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:00.794533 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a33b8a2d-40e1-4cce-b478-6bf8b997ce90 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1546 microversion: 2.1 time: 0.170545 Oct 18 13:57:00.795444 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3134/6062] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:00 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:00.820842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e37188e6-f5c4-42d8-9d21-e59080555ac2 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:00.822398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e37188e6-f5c4-42d8-9d21-e59080555ac2 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:00.830885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e37188e6-f5c4-42d8-9d21-e59080555ac2 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:00.832253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e37188e6-f5c4-42d8-9d21-e59080555ac2 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:00.832595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e37188e6-f5c4-42d8-9d21-e59080555ac2 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:00.833481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e37188e6-f5c4-42d8-9d21-e59080555ac2 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:00.834045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e37188e6-f5c4-42d8-9d21-e59080555ac2 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:00.834922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e37188e6-f5c4-42d8-9d21-e59080555ac2 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:01.034524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-98c06f7f-662e-4fea-84e8-4a79a2bd7c99 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:01.035449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-98c06f7f-662e-4fea-84e8-4a79a2bd7c99 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:01.043414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98c06f7f-662e-4fea-84e8-4a79a2bd7c99 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:01.044233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98c06f7f-662e-4fea-84e8-4a79a2bd7c99 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:01.044887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98c06f7f-662e-4fea-84e8-4a79a2bd7c99 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:01.045884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98c06f7f-662e-4fea-84e8-4a79a2bd7c99 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:01.046533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98c06f7f-662e-4fea-84e8-4a79a2bd7c99 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:01.046964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98c06f7f-662e-4fea-84e8-4a79a2bd7c99 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:01.104210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e37188e6-f5c4-42d8-9d21-e59080555ac2 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:01.110559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:01.114398 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e37188e6-f5c4-42d8-9d21-e59080555ac2 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1546 microversion: 2.1 time: 0.299014 Oct 18 13:57:01.121895 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2929/6063] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:00 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1546 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:01.333374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-98c06f7f-662e-4fea-84e8-4a79a2bd7c99 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:01.336145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:01.347545 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-98c06f7f-662e-4fea-84e8-4a79a2bd7c99 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1315 microversion: 2.1 time: 0.317027 Oct 18 13:57:01.348690 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3135/6064] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:01 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:02.380873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-43499e41-5711-402c-9573-c001d13c601e tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:02.390101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-43499e41-5711-402c-9573-c001d13c601e tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:02.415782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43499e41-5711-402c-9573-c001d13c601e tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:02.416591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43499e41-5711-402c-9573-c001d13c601e tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:02.417252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43499e41-5711-402c-9573-c001d13c601e tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:02.420628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43499e41-5711-402c-9573-c001d13c601e tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:02.421937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43499e41-5711-402c-9573-c001d13c601e tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:02.424007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-43499e41-5711-402c-9573-c001d13c601e tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:02.826246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-43499e41-5711-402c-9573-c001d13c601e tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:02.846431 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-43499e41-5711-402c-9573-c001d13c601e tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1315 microversion: 2.1 time: 0.474772 Oct 18 13:57:02.858003 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2930/6065] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:02 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:03.648974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:03.650192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=14 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:03.714656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-6ac439b4-1c93-4ab2-8244-03b27fec2fd9 req-eec37faf-0e1f-4337-b006-8a1e39d07d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d960a1-1167-462d-8356-a21647334acb", "tag": "0b89975f-0369-4018-99c0-935061f3d33c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:03.749762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:03.754463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6ac439b4-1c93-4ab2-8244-03b27fec2fd9 req-eec37faf-0e1f-4337-b006-8a1e39d07d8d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:03.756495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6ac439b4-1c93-4ab2-8244-03b27fec2fd9 req-eec37faf-0e1f-4337-b006-8a1e39d07d8d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:03.759649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6ac439b4-1c93-4ab2-8244-03b27fec2fd9 req-eec37faf-0e1f-4337-b006-8a1e39d07d8d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:03.807337 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-6ac439b4-1c93-4ab2-8244-03b27fec2fd9 req-eec37faf-0e1f-4337-b006-8a1e39d07d8d service nova] Creating event network-changed:0b89975f-0369-4018-99c0-935061f3d33c for instance a6d960a1-1167-462d-8356-a21647334acb on n-h2-858384-13 Oct 18 13:57:03.831471 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-6ac439b4-1c93-4ab2-8244-03b27fec2fd9 req-eec37faf-0e1f-4337-b006-8a1e39d07d8d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128076 Oct 18 13:57:03.833141 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2931/6066] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:57:03.843370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-460020106", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "3e96ce48-fb24-449f-8825-70171d87c3dc"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:03.876789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4c4281e0-499a-4033-996f-8c384503cac3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:03.881570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4c4281e0-499a-4033-996f-8c384503cac3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:03.890474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c4281e0-499a-4033-996f-8c384503cac3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:03.890976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c4281e0-499a-4033-996f-8c384503cac3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:03.891630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c4281e0-499a-4033-996f-8c384503cac3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:03.892484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c4281e0-499a-4033-996f-8c384503cac3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:03.894340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c4281e0-499a-4033-996f-8c384503cac3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:03.894804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c4281e0-499a-4033-996f-8c384503cac3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:03.923784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] validate_networks() for [('3e96ce48-fb24-449f-8825-70171d87c3dc', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:57:04.213584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4c4281e0-499a-4033-996f-8c384503cac3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:04.218330 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4c4281e0-499a-4033-996f-8c384503cac3 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1315 microversion: 2.1 time: 0.348782 Oct 18 13:57:04.218935 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2932/6067] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:03 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:04.478922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:57:04.479682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:57:04.480419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:57:04.481044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:57:04.481921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:57:04.500539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:04.501069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:04.505624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:04.506594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:04.507357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:04.513536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:04.524684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-6ef8d328-6e82-433c-95ea-42f7ac36a307 req-fb0f99c8-dd69-42b5-a53e-75ed7f70c521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2b4ec5-0795-4c72-835e-f46378ac66e5", "name": "network-vif-plugged", "status": "completed", "tag": "e04fdb69-b242-400a-88e4-58b706eac3ce"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:04.539675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6ef8d328-6e82-433c-95ea-42f7ac36a307 req-fb0f99c8-dd69-42b5-a53e-75ed7f70c521 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:04.540132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6ef8d328-6e82-433c-95ea-42f7ac36a307 req-fb0f99c8-dd69-42b5-a53e-75ed7f70c521 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:04.540568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-6ef8d328-6e82-433c-95ea-42f7ac36a307 req-fb0f99c8-dd69-42b5-a53e-75ed7f70c521 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:04.559405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Getting quotas for project ee3e4ba0f6be428da396d93ddc71756e. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:57:04.568291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Getting quotas for user 599bcafa4eef46248f732ecf2f1b3809 and project ee3e4ba0f6be428da396d93ddc71756e. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:57:04.579725 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-6ef8d328-6e82-433c-95ea-42f7ac36a307 req-fb0f99c8-dd69-42b5-a53e-75ed7f70c521 service nova] Creating event network-vif-plugged:e04fdb69-b242-400a-88e4-58b706eac3ce for instance bb2b4ec5-0795-4c72-835e-f46378ac66e5 on n-h1-858384-13 Oct 18 13:57:04.588206 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-6ef8d328-6e82-433c-95ea-42f7ac36a307 req-fb0f99c8-dd69-42b5-a53e-75ed7f70c521 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067650 Oct 18 13:57:04.590629 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2933/6068] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:57:04.592082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:57:04.594377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:57:04.661002 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-38ab583a-837b-42c0-b590-97b415af76d8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018307 Oct 18 13:57:04.668419 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3136/6069] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:57:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:57:04.675685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4cc4278c-d51c-45e1-9ebf-1d258d8b2752 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:04.677774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4cc4278c-d51c-45e1-9ebf-1d258d8b2752 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:05.010863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4cc4278c-d51c-45e1-9ebf-1d258d8b2752 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:05.019802 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4cc4278c-d51c-45e1-9ebf-1d258d8b2752 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1214 microversion: 2.1 time: 0.350033 Oct 18 13:57:05.020389 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2934/6070] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:04 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1214 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:57:05.247097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-051dc984-d5b1-4f21-8d86-96bc23e6526c tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:05.248587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-051dc984-d5b1-4f21-8d86-96bc23e6526c tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:05.281622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-051dc984-d5b1-4f21-8d86-96bc23e6526c tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:05.282050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-051dc984-d5b1-4f21-8d86-96bc23e6526c tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:05.282489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-051dc984-d5b1-4f21-8d86-96bc23e6526c tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:05.286782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-051dc984-d5b1-4f21-8d86-96bc23e6526c tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:05.287578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-051dc984-d5b1-4f21-8d86-96bc23e6526c tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:05.288062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-051dc984-d5b1-4f21-8d86-96bc23e6526c tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:05.507541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-051dc984-d5b1-4f21-8d86-96bc23e6526c tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:05.528263 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-051dc984-d5b1-4f21-8d86-96bc23e6526c tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1315 microversion: 2.1 time: 0.288620 Oct 18 13:57:05.529203 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3137/6071] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:05 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:06.048321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c106632e-4fa0-44c0-adf6-101b372a37e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:06.049771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c106632e-4fa0-44c0-adf6-101b372a37e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:06.074851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c106632e-4fa0-44c0-adf6-101b372a37e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:06.077581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c106632e-4fa0-44c0-adf6-101b372a37e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:06.078417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c106632e-4fa0-44c0-adf6-101b372a37e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:06.079700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c106632e-4fa0-44c0-adf6-101b372a37e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:06.080000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c106632e-4fa0-44c0-adf6-101b372a37e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:06.080442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c106632e-4fa0-44c0-adf6-101b372a37e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:06.214910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c106632e-4fa0-44c0-adf6-101b372a37e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:06.226108 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c106632e-4fa0-44c0-adf6-101b372a37e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1274 microversion: 2.1 time: 0.182623 Oct 18 13:57:06.226752 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2935/6072] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:06 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:06.564416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-38187c99-449d-47e6-a69f-32dc96edad1f tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:06.565679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-38187c99-449d-47e6-a69f-32dc96edad1f tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:06.585108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38187c99-449d-47e6-a69f-32dc96edad1f tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:06.585663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38187c99-449d-47e6-a69f-32dc96edad1f tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:06.586090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38187c99-449d-47e6-a69f-32dc96edad1f tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:06.587892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38187c99-449d-47e6-a69f-32dc96edad1f tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:06.588578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38187c99-449d-47e6-a69f-32dc96edad1f tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:06.589402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38187c99-449d-47e6-a69f-32dc96edad1f tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:06.835782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-38187c99-449d-47e6-a69f-32dc96edad1f tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:06.850398 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-38187c99-449d-47e6-a69f-32dc96edad1f tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1315 microversion: 2.1 time: 0.292928 Oct 18 13:57:06.851232 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3138/6073] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:06 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:07.254836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d1b9649b-0c78-452c-993c-ed7420280417 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:07.256202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d1b9649b-0c78-452c-993c-ed7420280417 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:07.266268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1b9649b-0c78-452c-993c-ed7420280417 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:07.267109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1b9649b-0c78-452c-993c-ed7420280417 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:07.267792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1b9649b-0c78-452c-993c-ed7420280417 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:07.268976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1b9649b-0c78-452c-993c-ed7420280417 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:07.269847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1b9649b-0c78-452c-993c-ed7420280417 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:07.270503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1b9649b-0c78-452c-993c-ed7420280417 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:07.576868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d1b9649b-0c78-452c-993c-ed7420280417 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:07.591366 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d1b9649b-0c78-452c-993c-ed7420280417 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1314 microversion: 2.1 time: 0.340370 Oct 18 13:57:07.592340 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2936/6074] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:07 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:07.877632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ebf076ed-7b9e-4b4d-b207-8647ff958a6a tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:07.878485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ebf076ed-7b9e-4b4d-b207-8647ff958a6a tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:07.894325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebf076ed-7b9e-4b4d-b207-8647ff958a6a tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:07.895099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebf076ed-7b9e-4b4d-b207-8647ff958a6a tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:07.898700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebf076ed-7b9e-4b4d-b207-8647ff958a6a tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:07.900278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebf076ed-7b9e-4b4d-b207-8647ff958a6a tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:07.900942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebf076ed-7b9e-4b4d-b207-8647ff958a6a tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:07.901713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebf076ed-7b9e-4b4d-b207-8647ff958a6a tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:08.128774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ebf076ed-7b9e-4b4d-b207-8647ff958a6a tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:08.139684 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ebf076ed-7b9e-4b4d-b207-8647ff958a6a tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1465 microversion: 2.1 time: 0.267208 Oct 18 13:57:08.140337 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3139/6075] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:07 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1465 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:08.190869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5034b6d9-12a6-4247-9a18-cde10c3bbbdf tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:08.191375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5034b6d9-12a6-4247-9a18-cde10c3bbbdf tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:08.198697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5034b6d9-12a6-4247-9a18-cde10c3bbbdf tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:08.199193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5034b6d9-12a6-4247-9a18-cde10c3bbbdf tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:08.199639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5034b6d9-12a6-4247-9a18-cde10c3bbbdf tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:08.200365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5034b6d9-12a6-4247-9a18-cde10c3bbbdf tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:08.200825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5034b6d9-12a6-4247-9a18-cde10c3bbbdf tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:08.201280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5034b6d9-12a6-4247-9a18-cde10c3bbbdf tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:08.235084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5034b6d9-12a6-4247-9a18-cde10c3bbbdf tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:57:08.381025 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5034b6d9-12a6-4247-9a18-cde10c3bbbdf tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 204 len: 0 microversion: 2.1 time: 0.193049 Oct 18 13:57:08.386383 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2937/6076] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:57:08 2022] DELETE /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:57:08.392647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a5a1e4a6-c4d7-4579-b816-ab0a708bc2d6 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:08.393549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a5a1e4a6-c4d7-4579-b816-ab0a708bc2d6 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:08.396311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:08.403430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5a1e4a6-c4d7-4579-b816-ab0a708bc2d6 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:08.404171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5a1e4a6-c4d7-4579-b816-ab0a708bc2d6 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:08.404793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5a1e4a6-c4d7-4579-b816-ab0a708bc2d6 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:08.405716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5a1e4a6-c4d7-4579-b816-ab0a708bc2d6 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:08.406536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5a1e4a6-c4d7-4579-b816-ab0a708bc2d6 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:08.407330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5a1e4a6-c4d7-4579-b816-ab0a708bc2d6 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:08.589441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a5d0af73-cd18-4c32-a884-c34fb282aee0 req-bd67d282-fd9f-422a-9808-b8d74220cb64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f2fcb9-314f-4a73-a123-b078a943fe30", "tag": "0b6ae991-ba8c-41cd-9469-0c2929fc8bd9"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:08.612586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a5d0af73-cd18-4c32-a884-c34fb282aee0 req-bd67d282-fd9f-422a-9808-b8d74220cb64 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:08.615091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a5d0af73-cd18-4c32-a884-c34fb282aee0 req-bd67d282-fd9f-422a-9808-b8d74220cb64 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:08.615805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a5d0af73-cd18-4c32-a884-c34fb282aee0 req-bd67d282-fd9f-422a-9808-b8d74220cb64 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:08.629125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a5a1e4a6-c4d7-4579-b816-ab0a708bc2d6 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:08.649558 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a5a1e4a6-c4d7-4579-b816-ab0a708bc2d6 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1471 microversion: 2.1 time: 0.257933 Oct 18 13:57:08.654819 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3140/6077] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:08 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1471 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:08.665486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5b438f82-bd19-45e2-a0d9-5131430cb345 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:08.668791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5b438f82-bd19-45e2-a0d9-5131430cb345 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:08.677359 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a5d0af73-cd18-4c32-a884-c34fb282aee0 req-bd67d282-fd9f-422a-9808-b8d74220cb64 service nova] Creating event network-changed:0b6ae991-ba8c-41cd-9469-0c2929fc8bd9 for instance 87f2fcb9-314f-4a73-a123-b078a943fe30 on n-h2-858384-13 Oct 18 13:57:08.677858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b438f82-bd19-45e2-a0d9-5131430cb345 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:08.678555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b438f82-bd19-45e2-a0d9-5131430cb345 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:08.679336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b438f82-bd19-45e2-a0d9-5131430cb345 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:08.680644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b438f82-bd19-45e2-a0d9-5131430cb345 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:08.681547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b438f82-bd19-45e2-a0d9-5131430cb345 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:08.682371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5b438f82-bd19-45e2-a0d9-5131430cb345 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:08.689150 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a5d0af73-cd18-4c32-a884-c34fb282aee0 req-bd67d282-fd9f-422a-9808-b8d74220cb64 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106386 Oct 18 13:57:08.693252 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2938/6078] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:57:08.980946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5b438f82-bd19-45e2-a0d9-5131430cb345 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:09.001635 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5b438f82-bd19-45e2-a0d9-5131430cb345 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1314 microversion: 2.1 time: 0.344248 Oct 18 13:57:09.002789 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3141/6079] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:08 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:09.682646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-675d8d8e-773a-429e-a5be-ac80b39974e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:09.683420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-675d8d8e-773a-429e-a5be-ac80b39974e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:09.700929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-675d8d8e-773a-429e-a5be-ac80b39974e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:09.701452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-675d8d8e-773a-429e-a5be-ac80b39974e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:09.702113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-675d8d8e-773a-429e-a5be-ac80b39974e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:09.703045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-675d8d8e-773a-429e-a5be-ac80b39974e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:09.703510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-675d8d8e-773a-429e-a5be-ac80b39974e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:09.703959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-675d8d8e-773a-429e-a5be-ac80b39974e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:09.853884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-675d8d8e-773a-429e-a5be-ac80b39974e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:09.861623 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-675d8d8e-773a-429e-a5be-ac80b39974e4 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1471 microversion: 2.1 time: 0.183516 Oct 18 13:57:09.862202 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2939/6080] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:09 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:10.035325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ecc9488a-81cd-450a-ad3b-b7594057e07c tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:10.036049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ecc9488a-81cd-450a-ad3b-b7594057e07c tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:10.044381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecc9488a-81cd-450a-ad3b-b7594057e07c tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:10.044883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecc9488a-81cd-450a-ad3b-b7594057e07c tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:10.045350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecc9488a-81cd-450a-ad3b-b7594057e07c tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:10.046068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecc9488a-81cd-450a-ad3b-b7594057e07c tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:10.046528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecc9488a-81cd-450a-ad3b-b7594057e07c tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:10.046953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecc9488a-81cd-450a-ad3b-b7594057e07c tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:10.260068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ecc9488a-81cd-450a-ad3b-b7594057e07c tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:10.268734 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ecc9488a-81cd-450a-ad3b-b7594057e07c tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1314 microversion: 2.1 time: 0.244720 Oct 18 13:57:10.270028 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3142/6081] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:10 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:10.888326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c32f5b15-12eb-4066-be16-9b8fb7b98ff5 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:10.889172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c32f5b15-12eb-4066-be16-9b8fb7b98ff5 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:10.903597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c32f5b15-12eb-4066-be16-9b8fb7b98ff5 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:10.904098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c32f5b15-12eb-4066-be16-9b8fb7b98ff5 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:10.904538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c32f5b15-12eb-4066-be16-9b8fb7b98ff5 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:10.905320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c32f5b15-12eb-4066-be16-9b8fb7b98ff5 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:10.905775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c32f5b15-12eb-4066-be16-9b8fb7b98ff5 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:10.906203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c32f5b15-12eb-4066-be16-9b8fb7b98ff5 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:11.016640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c32f5b15-12eb-4066-be16-9b8fb7b98ff5 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e82b610511c42949550f0c5847c0716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30a24f74124e442dad213f0190c878cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:11.034551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-e28ca00e-6182-47df-a51c-c58d24283537 req-0490f82f-2282-481e-ac4a-6f523807fa5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2b4ec5-0795-4c72-835e-f46378ac66e5", "name": "network-vif-deleted", "tag": "e04fdb69-b242-400a-88e4-58b706eac3ce"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:11.035232 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c32f5b15-12eb-4066-be16-9b8fb7b98ff5 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 200 len: 1429 microversion: 2.1 time: 0.152477 Oct 18 13:57:11.035850 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2940/6082] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:10 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 1429 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:57:11.049408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e28ca00e-6182-47df-a51c-c58d24283537 req-0490f82f-2282-481e-ac4a-6f523807fa5a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:11.056113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e28ca00e-6182-47df-a51c-c58d24283537 req-0490f82f-2282-481e-ac4a-6f523807fa5a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:11.056927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e28ca00e-6182-47df-a51c-c58d24283537 req-0490f82f-2282-481e-ac4a-6f523807fa5a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:11.093497 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-e28ca00e-6182-47df-a51c-c58d24283537 req-0490f82f-2282-481e-ac4a-6f523807fa5a service nova] Creating event network-vif-deleted:e04fdb69-b242-400a-88e4-58b706eac3ce for instance bb2b4ec5-0795-4c72-835e-f46378ac66e5 on n-h1-858384-13 Oct 18 13:57:11.106007 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-e28ca00e-6182-47df-a51c-c58d24283537 req-0490f82f-2282-481e-ac4a-6f523807fa5a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075126 Oct 18 13:57:11.107199 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3143/6083] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:57:11.295750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-81aad773-3d27-4c17-81c8-749420ac9ea8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:11.306337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-81aad773-3d27-4c17-81c8-749420ac9ea8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:11.327754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81aad773-3d27-4c17-81c8-749420ac9ea8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:11.331193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81aad773-3d27-4c17-81c8-749420ac9ea8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:11.331976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81aad773-3d27-4c17-81c8-749420ac9ea8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:11.337162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81aad773-3d27-4c17-81c8-749420ac9ea8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:11.339220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81aad773-3d27-4c17-81c8-749420ac9ea8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:11.342857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81aad773-3d27-4c17-81c8-749420ac9ea8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:11.579211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-81aad773-3d27-4c17-81c8-749420ac9ea8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:11.603007 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-81aad773-3d27-4c17-81c8-749420ac9ea8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1314 microversion: 2.1 time: 0.309724 Oct 18 13:57:11.621765 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2941/6084] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:11 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:12.067604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d5db2749-27bb-424c-91c3-1bdef2b06653 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:12.068309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d5db2749-27bb-424c-91c3-1bdef2b06653 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] [instance: bb2b4ec5-0795-4c72-835e-f46378ac66e5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:12.078453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5db2749-27bb-424c-91c3-1bdef2b06653 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:12.078944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5db2749-27bb-424c-91c3-1bdef2b06653 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:12.079384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5db2749-27bb-424c-91c3-1bdef2b06653 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:12.080092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5db2749-27bb-424c-91c3-1bdef2b06653 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:12.080551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5db2749-27bb-424c-91c3-1bdef2b06653 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:12.080985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5db2749-27bb-424c-91c3-1bdef2b06653 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:12.097508 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-d5db2749-27bb-424c-91c3-1bdef2b06653 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] HTTP exception thrown: Instance bb2b4ec5-0795-4c72-835e-f46378ac66e5 could not be found. Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d5db2749-27bb-424c-91c3-1bdef2b06653 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Request method failure captured: Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 HTTP/1.1 Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrCgYilWC80Yse229-9L70OB7UgPT4yuB6rLc9oZ_yCtZffe_QOYfrVsvvWdg-gKk_FatHB7vU4GZSys5bgaGwuOjRlLg0YokMOvluq4QX3GAwhOICtvIPvIasyc5tvFWc9Ixz6I6CDjaOjPhEQK3twgeMqGRIWIYB1q_bw6Mh7_Zpc Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 30a24f74124e442dad213f0190c878cf Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-VolumesNegativeTest-1192717446 Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30a24f74124e442dad213f0190c878cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30a24f74124e442dad213f0190c878cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30a24f74124e442dad213f0190c878cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30a24f74124e442dad213f0190c878cf"}]}] Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-VolumesNegativeTest-1192717446 Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 30a24f74124e442dad213f0190c878cf Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-VolumesNegativeTest-1192717446 Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-VolumesNegativeTest-1192717446-project Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7e82b610511c42949550f0c5847c0716 Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-VolumesNegativeTest-1192717446-project Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance bb2b4ec5-0795-4c72-835e-f46378ac66e5 could not be found. Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'bb2b4ec5-0795-4c72-835e-f46378ac66e5'} Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb2b4ec5-0795-4c72-835e-f46378ac66e5 could not be found. Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb2b4ec5-0795-4c72-835e-f46378ac66e5 could not be found. Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:57:12.099418 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:57:12.106291 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:57:12.106291 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:57:12.106291 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:57:12.106291 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:57:12.106291 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:57:12.106291 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb2b4ec5-0795-4c72-835e-f46378ac66e5 could not be found. Oct 18 13:57:12.106291 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:57:12.106291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d5db2749-27bb-424c-91c3-1bdef2b06653 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] Returning 404 to user: Instance bb2b4ec5-0795-4c72-835e-f46378ac66e5 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:57:12.106291 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d5db2749-27bb-424c-91c3-1bdef2b06653 tempest-VolumesNegativeTest-1192717446 tempest-VolumesNegativeTest-1192717446-project] 10.222.0.40 "GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5" status: 404 len: 111 microversion: 2.1 time: 0.038340 Oct 18 13:57:12.106291 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3144/6085] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:12 2022] GET /compute/v2.1/servers/bb2b4ec5-0795-4c72-835e-f46378ac66e5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:57:12.627710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c8abd255-c2ae-4e70-800a-c152640f1d52 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:12.628382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c8abd255-c2ae-4e70-800a-c152640f1d52 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:12.636226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8abd255-c2ae-4e70-800a-c152640f1d52 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:12.636717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8abd255-c2ae-4e70-800a-c152640f1d52 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:12.637154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8abd255-c2ae-4e70-800a-c152640f1d52 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:12.637953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8abd255-c2ae-4e70-800a-c152640f1d52 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:12.638414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8abd255-c2ae-4e70-800a-c152640f1d52 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:12.638842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8abd255-c2ae-4e70-800a-c152640f1d52 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:12.813636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c8abd255-c2ae-4e70-800a-c152640f1d52 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:12.825532 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c8abd255-c2ae-4e70-800a-c152640f1d52 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1314 microversion: 2.1 time: 0.201442 Oct 18 13:57:12.826852 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2942/6086] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:12 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:13.851585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5261f51f-f417-425b-adfe-417f84ce8191 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:13.852681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5261f51f-f417-425b-adfe-417f84ce8191 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:13.866101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5261f51f-f417-425b-adfe-417f84ce8191 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:13.867181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5261f51f-f417-425b-adfe-417f84ce8191 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:13.868714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5261f51f-f417-425b-adfe-417f84ce8191 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:13.869939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5261f51f-f417-425b-adfe-417f84ce8191 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:13.870816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5261f51f-f417-425b-adfe-417f84ce8191 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:13.871805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5261f51f-f417-425b-adfe-417f84ce8191 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:14.129867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5261f51f-f417-425b-adfe-417f84ce8191 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:14.141592 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5261f51f-f417-425b-adfe-417f84ce8191 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1314 microversion: 2.1 time: 0.293737 Oct 18 13:57:14.143386 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3145/6087] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:13 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:14.906596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-40133316-7680-4aa8-a287-04ddc2bb08a7 req-84b81d34-2ce3-4af6-b59b-da6e2d206ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f2fcb9-314f-4a73-a123-b078a943fe30", "name": "network-vif-plugged", "status": "completed", "tag": "0b6ae991-ba8c-41cd-9469-0c2929fc8bd9"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:14.922599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-40133316-7680-4aa8-a287-04ddc2bb08a7 req-84b81d34-2ce3-4af6-b59b-da6e2d206ae8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:14.923091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-40133316-7680-4aa8-a287-04ddc2bb08a7 req-84b81d34-2ce3-4af6-b59b-da6e2d206ae8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:14.923683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-40133316-7680-4aa8-a287-04ddc2bb08a7 req-84b81d34-2ce3-4af6-b59b-da6e2d206ae8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:14.938048 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-40133316-7680-4aa8-a287-04ddc2bb08a7 req-84b81d34-2ce3-4af6-b59b-da6e2d206ae8 service nova] Creating event network-vif-plugged:0b6ae991-ba8c-41cd-9469-0c2929fc8bd9 for instance 87f2fcb9-314f-4a73-a123-b078a943fe30 on n-h2-858384-13 Oct 18 13:57:14.944540 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-40133316-7680-4aa8-a287-04ddc2bb08a7 req-84b81d34-2ce3-4af6-b59b-da6e2d206ae8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046154 Oct 18 13:57:14.945425 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2943/6088] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:57:15.171843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-48a14fa1-3e8e-4707-ac38-00533ebf2898 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:15.172466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-48a14fa1-3e8e-4707-ac38-00533ebf2898 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:15.174846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:15.175734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:15.183400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a14fa1-3e8e-4707-ac38-00533ebf2898 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:15.184261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a14fa1-3e8e-4707-ac38-00533ebf2898 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:15.184889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a14fa1-3e8e-4707-ac38-00533ebf2898 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:15.185618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a14fa1-3e8e-4707-ac38-00533ebf2898 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:15.186074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a14fa1-3e8e-4707-ac38-00533ebf2898 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:15.186497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48a14fa1-3e8e-4707-ac38-00533ebf2898 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:15.361084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-48a14fa1-3e8e-4707-ac38-00533ebf2898 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:15.371021 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-48a14fa1-3e8e-4707-ac38-00533ebf2898 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1314 microversion: 2.1 time: 0.204161 Oct 18 13:57:15.377216 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3146/6089] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:15 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:16.395282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4674f7bf-1ad6-4966-8f49-0f95e61efdca tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:16.396338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4674f7bf-1ad6-4966-8f49-0f95e61efdca tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:16.398844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:16.406157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4674f7bf-1ad6-4966-8f49-0f95e61efdca tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:16.407023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4674f7bf-1ad6-4966-8f49-0f95e61efdca tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:16.407703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4674f7bf-1ad6-4966-8f49-0f95e61efdca tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:16.408672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4674f7bf-1ad6-4966-8f49-0f95e61efdca tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:16.409276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4674f7bf-1ad6-4966-8f49-0f95e61efdca tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:16.409808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4674f7bf-1ad6-4966-8f49-0f95e61efdca tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:16.566581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4674f7bf-1ad6-4966-8f49-0f95e61efdca tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:16.575616 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4674f7bf-1ad6-4966-8f49-0f95e61efdca tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1501 microversion: 2.1 time: 0.184649 Oct 18 13:57:16.576464 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2944/6090] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:16 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:16.603976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e6bcd6f-bc74-4c56-ba62-9c03f62d42c2 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:16.605685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7e6bcd6f-bc74-4c56-ba62-9c03f62d42c2 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:16.626167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e6bcd6f-bc74-4c56-ba62-9c03f62d42c2 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:16.626675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e6bcd6f-bc74-4c56-ba62-9c03f62d42c2 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:16.627399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e6bcd6f-bc74-4c56-ba62-9c03f62d42c2 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:16.628509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e6bcd6f-bc74-4c56-ba62-9c03f62d42c2 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:16.629195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e6bcd6f-bc74-4c56-ba62-9c03f62d42c2 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:16.629801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e6bcd6f-bc74-4c56-ba62-9c03f62d42c2 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:16.904135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7e6bcd6f-bc74-4c56-ba62-9c03f62d42c2 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:16.923845 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7e6bcd6f-bc74-4c56-ba62-9c03f62d42c2 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1501 microversion: 2.1 time: 0.328604 Oct 18 13:57:16.925167 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3147/6091] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:16 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1501 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:16.961626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a87278ae-5a40-45e7-8c4d-8eefd2c000e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:16.962792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a87278ae-5a40-45e7-8c4d-8eefd2c000e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:16.970175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a87278ae-5a40-45e7-8c4d-8eefd2c000e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:16.979464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a87278ae-5a40-45e7-8c4d-8eefd2c000e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:16.979464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a87278ae-5a40-45e7-8c4d-8eefd2c000e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:16.979464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a87278ae-5a40-45e7-8c4d-8eefd2c000e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:16.979464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a87278ae-5a40-45e7-8c4d-8eefd2c000e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:16.979464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a87278ae-5a40-45e7-8c4d-8eefd2c000e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:17.017605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-a87278ae-5a40-45e7-8c4d-8eefd2c000e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lazy-loading 'flavor' on Instance uuid 87f2fcb9-314f-4a73-a123-b078a943fe30 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:57:17.118410 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a87278ae-5a40-45e7-8c4d-8eefd2c000e1 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "POST /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30/action" status: 202 len: 0 microversion: 2.1 time: 0.172137 Oct 18 13:57:17.119726 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2945/6092] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:57:16 2022] POST /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:57:17.146816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b6404c88-c07e-463a-9c4a-62bface18e15 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:17.147877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b6404c88-c07e-463a-9c4a-62bface18e15 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:17.170499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6404c88-c07e-463a-9c4a-62bface18e15 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:17.171009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6404c88-c07e-463a-9c4a-62bface18e15 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:17.171687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6404c88-c07e-463a-9c4a-62bface18e15 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:17.172419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6404c88-c07e-463a-9c4a-62bface18e15 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:17.172892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6404c88-c07e-463a-9c4a-62bface18e15 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:17.173518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6404c88-c07e-463a-9c4a-62bface18e15 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:17.364003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b6404c88-c07e-463a-9c4a-62bface18e15 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:17.373286 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b6404c88-c07e-463a-9c4a-62bface18e15 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1509 microversion: 2.1 time: 0.249138 Oct 18 13:57:17.385575 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3148/6093] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:17 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1509 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:18.401462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0ad669c1-d8b7-41e7-8822-51708d826ae8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:18.403006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0ad669c1-d8b7-41e7-8822-51708d826ae8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:18.413134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ad669c1-d8b7-41e7-8822-51708d826ae8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:18.413678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ad669c1-d8b7-41e7-8822-51708d826ae8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:18.414165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ad669c1-d8b7-41e7-8822-51708d826ae8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:18.414901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ad669c1-d8b7-41e7-8822-51708d826ae8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:18.415342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ad669c1-d8b7-41e7-8822-51708d826ae8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:18.415976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ad669c1-d8b7-41e7-8822-51708d826ae8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:18.613468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0ad669c1-d8b7-41e7-8822-51708d826ae8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:18.618305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:18.642529 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0ad669c1-d8b7-41e7-8822-51708d826ae8 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1492 microversion: 2.1 time: 0.248436 Oct 18 13:57:18.643728 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2946/6094] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:18 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1492 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:18.667219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-396a048b-d027-4ebb-99eb-3d472b1fd739 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:18.667791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-396a048b-d027-4ebb-99eb-3d472b1fd739 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:18.677040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-396a048b-d027-4ebb-99eb-3d472b1fd739 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:18.677573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-396a048b-d027-4ebb-99eb-3d472b1fd739 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:18.678139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-396a048b-d027-4ebb-99eb-3d472b1fd739 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:18.678877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-396a048b-d027-4ebb-99eb-3d472b1fd739 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:18.679345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-396a048b-d027-4ebb-99eb-3d472b1fd739 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:18.680310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-396a048b-d027-4ebb-99eb-3d472b1fd739 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:18.787699 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-396a048b-d027-4ebb-99eb-3d472b1fd739 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "POST /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30/action" status: 202 len: 0 microversion: 2.1 time: 0.124357 Oct 18 13:57:18.801926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-62e6260a-c46f-4bda-a90d-6e38117ef8c4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:18.802809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-62e6260a-c46f-4bda-a90d-6e38117ef8c4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:18.808468 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3149/6095] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:57:18 2022] POST /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:57:18.818928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62e6260a-c46f-4bda-a90d-6e38117ef8c4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:18.819435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62e6260a-c46f-4bda-a90d-6e38117ef8c4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:18.819871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62e6260a-c46f-4bda-a90d-6e38117ef8c4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:18.820643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62e6260a-c46f-4bda-a90d-6e38117ef8c4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:18.821091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62e6260a-c46f-4bda-a90d-6e38117ef8c4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:18.826130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62e6260a-c46f-4bda-a90d-6e38117ef8c4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:19.338673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-62e6260a-c46f-4bda-a90d-6e38117ef8c4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:19.372750 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-62e6260a-c46f-4bda-a90d-6e38117ef8c4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1498 microversion: 2.1 time: 0.578271 Oct 18 13:57:19.378766 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2947/6096] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:18 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1498 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:19.951080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f0d1261-8c41-44bc-8982-c3a033bac99b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:19.951989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7f0d1261-8c41-44bc-8982-c3a033bac99b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:19.962442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f0d1261-8c41-44bc-8982-c3a033bac99b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:19.963438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f0d1261-8c41-44bc-8982-c3a033bac99b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:19.963919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f0d1261-8c41-44bc-8982-c3a033bac99b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:19.964780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f0d1261-8c41-44bc-8982-c3a033bac99b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:19.965769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f0d1261-8c41-44bc-8982-c3a033bac99b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:19.966307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f0d1261-8c41-44bc-8982-c3a033bac99b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:20.125592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-7f0d1261-8c41-44bc-8982-c3a033bac99b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lazy-loading 'services' on Instance uuid b81affc5-2a71-4f8c-9625-408b39b28018 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:57:20.235536 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7f0d1261-8c41-44bc-8982-c3a033bac99b tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018/os-volume_attachments/45efb11d-1452-4d43-a4fa-f11b51202e7f" status: 202 len: 0 microversion: 2.1 time: 0.291564 Oct 18 13:57:20.240233 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3150/6097] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 13:57:19 2022] DELETE /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018/os-volume_attachments/45efb11d-1452-4d43-a4fa-f11b51202e7f => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:57:20.406064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c151ee21-a29f-49ed-b546-5f496a02004d tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:20.407103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c151ee21-a29f-49ed-b546-5f496a02004d tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:20.418089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c151ee21-a29f-49ed-b546-5f496a02004d tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:20.419295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c151ee21-a29f-49ed-b546-5f496a02004d tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:20.420581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c151ee21-a29f-49ed-b546-5f496a02004d tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:20.422066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c151ee21-a29f-49ed-b546-5f496a02004d tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:20.422891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c151ee21-a29f-49ed-b546-5f496a02004d tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:20.423570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c151ee21-a29f-49ed-b546-5f496a02004d tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:20.606354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c151ee21-a29f-49ed-b546-5f496a02004d tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:20.616189 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c151ee21-a29f-49ed-b546-5f496a02004d tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1498 microversion: 2.1 time: 0.215432 Oct 18 13:57:20.617584 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2948/6098] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:20 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1498 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:21.641613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e23fa48-140d-475c-b457-de426ec48ab0 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:21.642737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4e23fa48-140d-475c-b457-de426ec48ab0 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:21.653307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e23fa48-140d-475c-b457-de426ec48ab0 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:21.654061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e23fa48-140d-475c-b457-de426ec48ab0 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:21.654692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e23fa48-140d-475c-b457-de426ec48ab0 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:21.655770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e23fa48-140d-475c-b457-de426ec48ab0 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:21.656242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e23fa48-140d-475c-b457-de426ec48ab0 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:21.657216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e23fa48-140d-475c-b457-de426ec48ab0 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:21.821465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4e23fa48-140d-475c-b457-de426ec48ab0 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:21.830230 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4e23fa48-140d-475c-b457-de426ec48ab0 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1501 microversion: 2.1 time: 0.193938 Oct 18 13:57:21.830830 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3151/6099] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:21 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1501 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:21.860302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c1017e98-d6e5-4a37-82bc-0ae63cd930b4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:21.861554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c1017e98-d6e5-4a37-82bc-0ae63cd930b4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:21.883491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1017e98-d6e5-4a37-82bc-0ae63cd930b4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:21.893437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1017e98-d6e5-4a37-82bc-0ae63cd930b4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:21.894586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1017e98-d6e5-4a37-82bc-0ae63cd930b4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:21.896066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1017e98-d6e5-4a37-82bc-0ae63cd930b4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:21.897101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1017e98-d6e5-4a37-82bc-0ae63cd930b4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:21.898952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1017e98-d6e5-4a37-82bc-0ae63cd930b4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:21.958782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-c1017e98-d6e5-4a37-82bc-0ae63cd930b4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lazy-loading 'flavor' on Instance uuid 87f2fcb9-314f-4a73-a123-b078a943fe30 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:57:22.115844 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c1017e98-d6e5-4a37-82bc-0ae63cd930b4 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "POST /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30/action" status: 202 len: 0 microversion: 2.1 time: 0.265358 Oct 18 13:57:22.118840 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2949/6100] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:57:21 2022] POST /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:57:22.141388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-da1876e2-5b7f-4807-8abf-af18ae94dc2b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:22.144473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-da1876e2-5b7f-4807-8abf-af18ae94dc2b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:22.167041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da1876e2-5b7f-4807-8abf-af18ae94dc2b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:22.169116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da1876e2-5b7f-4807-8abf-af18ae94dc2b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:22.170250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da1876e2-5b7f-4807-8abf-af18ae94dc2b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:22.171847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da1876e2-5b7f-4807-8abf-af18ae94dc2b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:22.173030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da1876e2-5b7f-4807-8abf-af18ae94dc2b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:22.174165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da1876e2-5b7f-4807-8abf-af18ae94dc2b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:22.458558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-da1876e2-5b7f-4807-8abf-af18ae94dc2b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:22.472892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:22.478435 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-da1876e2-5b7f-4807-8abf-af18ae94dc2b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1509 microversion: 2.1 time: 0.354884 Oct 18 13:57:22.493832 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3152/6101] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:22 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1509 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:22.722884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e9424e8-7168-41a4-8ef9-7d9209efbe02 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Action: 'create', calling method: .version_select at 0x7ff6148bd3a0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1137305977", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRqoktvHyeWVkyjOd0DBQCXnoKJDjY6iaSzSh5Gn/d5fT8HqOkH/a5YdJXcRrzJsY8mPw3GVaz7BIvRwOpLSIx9bA9POF+vs8VvwZBiuQiaztRdDLJakisl80TYks170g=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:22.754421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-1e9424e8-7168-41a4-8ef9-7d9209efbe02 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Getting quotas for project 40ce6582de794908a180829b55ff74bc. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:57:22.760290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-1e9424e8-7168-41a4-8ef9-7d9209efbe02 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Getting quotas for user b12baa4d649044179dc337f8a0f65a27 and project 40ce6582de794908a180829b55ff74bc. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:57:22.785016 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1e9424e8-7168-41a4-8ef9-7d9209efbe02 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.264372 Oct 18 13:57:22.785694 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2950/6102] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:57:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:57:23.524782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-15dc0116-3d3e-4808-99be-f34723a5dc77 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:23.526597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-15dc0116-3d3e-4808-99be-f34723a5dc77 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:23.541226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15dc0116-3d3e-4808-99be-f34723a5dc77 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:23.542001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15dc0116-3d3e-4808-99be-f34723a5dc77 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:23.542647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15dc0116-3d3e-4808-99be-f34723a5dc77 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:23.544121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15dc0116-3d3e-4808-99be-f34723a5dc77 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:23.544597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15dc0116-3d3e-4808-99be-f34723a5dc77 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:23.545020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15dc0116-3d3e-4808-99be-f34723a5dc77 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:23.832239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-15dc0116-3d3e-4808-99be-f34723a5dc77 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:23.850555 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-15dc0116-3d3e-4808-99be-f34723a5dc77 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1492 microversion: 2.1 time: 0.336757 Oct 18 13:57:23.852109 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3153/6103] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:23 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1492 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:23.876954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d9e97492-5db8-4a77-9827-45b7c53a5ce5 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:23.879626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d9e97492-5db8-4a77-9827-45b7c53a5ce5 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:23.898258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9e97492-5db8-4a77-9827-45b7c53a5ce5 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:23.899108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9e97492-5db8-4a77-9827-45b7c53a5ce5 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:23.900285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9e97492-5db8-4a77-9827-45b7c53a5ce5 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:23.901950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9e97492-5db8-4a77-9827-45b7c53a5ce5 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:23.903117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9e97492-5db8-4a77-9827-45b7c53a5ce5 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:23.903900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d9e97492-5db8-4a77-9827-45b7c53a5ce5 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:24.015718 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d9e97492-5db8-4a77-9827-45b7c53a5ce5 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "POST /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30/action" status: 202 len: 0 microversion: 2.1 time: 0.144337 Oct 18 13:57:24.017150 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2951/6104] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:57:23 2022] POST /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:57:24.026402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-baf66d67-2d4c-44be-8dcf-70c733764e42 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:24.027375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-baf66d67-2d4c-44be-8dcf-70c733764e42 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:24.034312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baf66d67-2d4c-44be-8dcf-70c733764e42 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:24.035290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baf66d67-2d4c-44be-8dcf-70c733764e42 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:24.036110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baf66d67-2d4c-44be-8dcf-70c733764e42 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:24.037792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baf66d67-2d4c-44be-8dcf-70c733764e42 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:24.039219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baf66d67-2d4c-44be-8dcf-70c733764e42 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:24.040385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baf66d67-2d4c-44be-8dcf-70c733764e42 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:24.262838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-baf66d67-2d4c-44be-8dcf-70c733764e42 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:24.271310 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-baf66d67-2d4c-44be-8dcf-70c733764e42 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1498 microversion: 2.1 time: 0.249525 Oct 18 13:57:24.272570 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3154/6105] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:24 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1498 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:25.323564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b8fa3fd3-8ae4-4383-a2ac-bb53cfe4e197 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:25.328245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b8fa3fd3-8ae4-4383-a2ac-bb53cfe4e197 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:25.348839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8fa3fd3-8ae4-4383-a2ac-bb53cfe4e197 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:25.349768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8fa3fd3-8ae4-4383-a2ac-bb53cfe4e197 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:25.352933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8fa3fd3-8ae4-4383-a2ac-bb53cfe4e197 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:25.354992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8fa3fd3-8ae4-4383-a2ac-bb53cfe4e197 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:25.355671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8fa3fd3-8ae4-4383-a2ac-bb53cfe4e197 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:25.356566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b8fa3fd3-8ae4-4383-a2ac-bb53cfe4e197 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:25.752109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b8fa3fd3-8ae4-4383-a2ac-bb53cfe4e197 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:25.762908 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b8fa3fd3-8ae4-4383-a2ac-bb53cfe4e197 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1498 microversion: 2.1 time: 0.456593 Oct 18 13:57:25.763522 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2952/6106] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:25 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1498 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:26.135060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8cd18b17-dc86-4902-bca5-e92d6ffaf821 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:26.139434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8cd18b17-dc86-4902-bca5-e92d6ffaf821 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:26.149900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cd18b17-dc86-4902-bca5-e92d6ffaf821 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:26.151399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cd18b17-dc86-4902-bca5-e92d6ffaf821 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:26.152226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cd18b17-dc86-4902-bca5-e92d6ffaf821 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:26.153333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cd18b17-dc86-4902-bca5-e92d6ffaf821 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:26.154133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cd18b17-dc86-4902-bca5-e92d6ffaf821 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:26.154770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8cd18b17-dc86-4902-bca5-e92d6ffaf821 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:26.238685 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8cd18b17-dc86-4902-bca5-e92d6ffaf821 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "POST /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb/action" status: 200 len: 24571 microversion: 2.1 time: 0.108131 Oct 18 13:57:26.246503 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3155/6107] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:57:26 2022] POST /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb/action => generated 24571 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:57:26.792601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-08c20a29-58b0-443d-b221-c8fd2c693150 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:26.793575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-08c20a29-58b0-443d-b221-c8fd2c693150 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:26.802652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08c20a29-58b0-443d-b221-c8fd2c693150 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:26.803406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08c20a29-58b0-443d-b221-c8fd2c693150 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:26.804731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08c20a29-58b0-443d-b221-c8fd2c693150 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:26.805667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08c20a29-58b0-443d-b221-c8fd2c693150 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:26.806529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08c20a29-58b0-443d-b221-c8fd2c693150 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:26.807137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08c20a29-58b0-443d-b221-c8fd2c693150 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:26.965666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-48b52ee6-3454-42a4-8a27-1e7c7a2f688e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:26.967342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-48b52ee6-3454-42a4-8a27-1e7c7a2f688e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:26.977404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48b52ee6-3454-42a4-8a27-1e7c7a2f688e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:26.978400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48b52ee6-3454-42a4-8a27-1e7c7a2f688e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:26.979314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48b52ee6-3454-42a4-8a27-1e7c7a2f688e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:26.981503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48b52ee6-3454-42a4-8a27-1e7c7a2f688e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:26.982539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48b52ee6-3454-42a4-8a27-1e7c7a2f688e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:26.983490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48b52ee6-3454-42a4-8a27-1e7c7a2f688e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:27.026093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-48b52ee6-3454-42a4-8a27-1e7c7a2f688e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:57:27.080186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-08c20a29-58b0-443d-b221-c8fd2c693150 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:27.099194 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-08c20a29-58b0-443d-b221-c8fd2c693150 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1501 microversion: 2.1 time: 0.311743 Oct 18 13:57:27.100940 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2953/6108] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:26 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1501 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:57:27.127999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2ca95520-6591-46f3-8931-702a1bb71288 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:27.128949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2ca95520-6591-46f3-8931-702a1bb71288 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:27.139032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ca95520-6591-46f3-8931-702a1bb71288 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:27.139579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ca95520-6591-46f3-8931-702a1bb71288 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:27.143601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ca95520-6591-46f3-8931-702a1bb71288 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:27.144408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ca95520-6591-46f3-8931-702a1bb71288 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:27.146571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ca95520-6591-46f3-8931-702a1bb71288 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:27.147233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2ca95520-6591-46f3-8931-702a1bb71288 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:27.154574 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-48b52ee6-3454-42a4-8a27-1e7c7a2f688e tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 204 len: 0 microversion: 2.1 time: 0.193224 Oct 18 13:57:27.161837 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3156/6109] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:57:26 2022] DELETE /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:57:27.168831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-186a38c3-9e02-423f-aa46-dfd7283ae34f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:27.169912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-186a38c3-9e02-423f-aa46-dfd7283ae34f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:27.178224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-186a38c3-9e02-423f-aa46-dfd7283ae34f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:27.179010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-186a38c3-9e02-423f-aa46-dfd7283ae34f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:27.180189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-186a38c3-9e02-423f-aa46-dfd7283ae34f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:27.181250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-186a38c3-9e02-423f-aa46-dfd7283ae34f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:27.181886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-186a38c3-9e02-423f-aa46-dfd7283ae34f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:27.182746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-186a38c3-9e02-423f-aa46-dfd7283ae34f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:27.215053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2ca95520-6591-46f3-8931-702a1bb71288 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:57:27.333866 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2ca95520-6591-46f3-8931-702a1bb71288 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "DELETE /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 204 len: 0 microversion: 2.1 time: 0.209419 Oct 18 13:57:27.334981 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2954/6110] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:57:27 2022] DELETE /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:57:27.346603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ca07573d-1ca7-49e8-b75e-7f548935564b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:27.347990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ca07573d-1ca7-49e8-b75e-7f548935564b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:27.357888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca07573d-1ca7-49e8-b75e-7f548935564b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:27.358952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca07573d-1ca7-49e8-b75e-7f548935564b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:27.359575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca07573d-1ca7-49e8-b75e-7f548935564b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:27.360492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca07573d-1ca7-49e8-b75e-7f548935564b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:27.361312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca07573d-1ca7-49e8-b75e-7f548935564b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:27.361906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca07573d-1ca7-49e8-b75e-7f548935564b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:27.548566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-186a38c3-9e02-423f-aa46-dfd7283ae34f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:27.590075 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-186a38c3-9e02-423f-aa46-dfd7283ae34f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1513 microversion: 2.1 time: 0.426423 Oct 18 13:57:27.594645 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3157/6111] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:27 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1513 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:27.762847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ca07573d-1ca7-49e8-b75e-7f548935564b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:27.776760 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ca07573d-1ca7-49e8-b75e-7f548935564b tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1507 microversion: 2.1 time: 0.435846 Oct 18 13:57:27.789209 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2955/6112] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:27 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1507 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:28.635261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ad8ca278-190c-466c-8766-304fe996d36f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:28.635999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ad8ca278-190c-466c-8766-304fe996d36f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:28.649034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad8ca278-190c-466c-8766-304fe996d36f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:28.651943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad8ca278-190c-466c-8766-304fe996d36f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:28.652608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad8ca278-190c-466c-8766-304fe996d36f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:28.653654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad8ca278-190c-466c-8766-304fe996d36f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:28.656194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad8ca278-190c-466c-8766-304fe996d36f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:28.656844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad8ca278-190c-466c-8766-304fe996d36f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:28.806101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-912cdccb-2896-4f2c-a2e2-cefe82c6113f tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:28.808022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-912cdccb-2896-4f2c-a2e2-cefe82c6113f tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:28.823738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912cdccb-2896-4f2c-a2e2-cefe82c6113f tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:28.825964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912cdccb-2896-4f2c-a2e2-cefe82c6113f tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:28.826407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912cdccb-2896-4f2c-a2e2-cefe82c6113f tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:28.827146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912cdccb-2896-4f2c-a2e2-cefe82c6113f tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:28.827607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912cdccb-2896-4f2c-a2e2-cefe82c6113f tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:28.828037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912cdccb-2896-4f2c-a2e2-cefe82c6113f tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:28.898942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ad8ca278-190c-466c-8766-304fe996d36f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:28.920976 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ad8ca278-190c-466c-8766-304fe996d36f tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1513 microversion: 2.1 time: 0.290206 Oct 18 13:57:28.944221 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3158/6113] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:28 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1513 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:29.286472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-912cdccb-2896-4f2c-a2e2-cefe82c6113f tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:29.305641 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-912cdccb-2896-4f2c-a2e2-cefe82c6113f tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1507 microversion: 2.1 time: 0.504098 Oct 18 13:57:29.306851 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2956/6114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:28 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1507 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:29.951902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d6d9494b-ba6d-4a1b-8031-980b51c7c5f4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:29.952563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d6d9494b-ba6d-4a1b-8031-980b51c7c5f4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:29.970797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6d9494b-ba6d-4a1b-8031-980b51c7c5f4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:29.971185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6d9494b-ba6d-4a1b-8031-980b51c7c5f4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:29.971669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6d9494b-ba6d-4a1b-8031-980b51c7c5f4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:29.972405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6d9494b-ba6d-4a1b-8031-980b51c7c5f4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:29.972901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6d9494b-ba6d-4a1b-8031-980b51c7c5f4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:29.973362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6d9494b-ba6d-4a1b-8031-980b51c7c5f4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:30.221204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d6d9494b-ba6d-4a1b-8031-980b51c7c5f4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:30.235295 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d6d9494b-ba6d-4a1b-8031-980b51c7c5f4 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1513 microversion: 2.1 time: 0.287398 Oct 18 13:57:30.236361 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3159/6115] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:29 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1513 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:30.346250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af2d6d81-c480-4bf6-87e9-aecd1212e1a9 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:30.347803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-af2d6d81-c480-4bf6-87e9-aecd1212e1a9 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:30.363622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af2d6d81-c480-4bf6-87e9-aecd1212e1a9 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:30.364179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af2d6d81-c480-4bf6-87e9-aecd1212e1a9 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:30.364687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af2d6d81-c480-4bf6-87e9-aecd1212e1a9 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:30.365524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af2d6d81-c480-4bf6-87e9-aecd1212e1a9 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:30.366124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af2d6d81-c480-4bf6-87e9-aecd1212e1a9 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:30.366652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af2d6d81-c480-4bf6-87e9-aecd1212e1a9 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:30.704566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1c0e2edd-8bc6-4185-8e92-d6f6c29763de req-5b2e5f7f-b2f6-4460-b538-0e646ccb706c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81affc5-2a71-4f8c-9625-408b39b28018", "name": "network-vif-deleted", "tag": "d8f07298-f4b7-436d-8ccb-3496e477e475"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:30.742647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1c0e2edd-8bc6-4185-8e92-d6f6c29763de req-5b2e5f7f-b2f6-4460-b538-0e646ccb706c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:30.743586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1c0e2edd-8bc6-4185-8e92-d6f6c29763de req-5b2e5f7f-b2f6-4460-b538-0e646ccb706c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:30.744295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1c0e2edd-8bc6-4185-8e92-d6f6c29763de req-5b2e5f7f-b2f6-4460-b538-0e646ccb706c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:30.762787 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1c0e2edd-8bc6-4185-8e92-d6f6c29763de req-5b2e5f7f-b2f6-4460-b538-0e646ccb706c service nova] Creating event network-vif-deleted:d8f07298-f4b7-436d-8ccb-3496e477e475 for instance b81affc5-2a71-4f8c-9625-408b39b28018 on n-h1-858384-13 Oct 18 13:57:30.769435 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1c0e2edd-8bc6-4185-8e92-d6f6c29763de req-5b2e5f7f-b2f6-4460-b538-0e646ccb706c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069098 Oct 18 13:57:30.770942 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3160/6116] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:57:30.870027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-af2d6d81-c480-4bf6-87e9-aecd1212e1a9 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599bcafa4eef46248f732ecf2f1b3809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3e4ba0f6be428da396d93ddc71756e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:30.879982 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-af2d6d81-c480-4bf6-87e9-aecd1212e1a9 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 200 len: 1507 microversion: 2.1 time: 0.540303 Oct 18 13:57:30.894364 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2957/6117] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:30 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 1507 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:31.268915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:31.269750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:31.307578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:31.307845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:31.308305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:31.312213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:31.314442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:31.315342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:31.420508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:31.421008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:31.426214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:31.427392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lazy-loading 'fault' on Instance uuid b81affc5-2a71-4f8c-9625-408b39b28018 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:57:31.478416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '113b44ece3a640f0bafbcac853e1a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265512d8e20c440aa47d65744b7c5e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:31.489824 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c048ec7c-bc26-4125-8564-9b2e91072b94 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 200 len: 1308 microversion: 2.1 time: 0.231302 Oct 18 13:57:31.491028 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3161/6118] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:31 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 1308 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:31.906568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-622403e9-28eb-4e1b-b69a-36d727d1d2f3 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:31.907301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-622403e9-28eb-4e1b-b69a-36d727d1d2f3 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] [instance: 87f2fcb9-314f-4a73-a123-b078a943fe30] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:31.917632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-622403e9-28eb-4e1b-b69a-36d727d1d2f3 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:31.918175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-622403e9-28eb-4e1b-b69a-36d727d1d2f3 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:31.918700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-622403e9-28eb-4e1b-b69a-36d727d1d2f3 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:31.919583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-622403e9-28eb-4e1b-b69a-36d727d1d2f3 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:31.920119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-622403e9-28eb-4e1b-b69a-36d727d1d2f3 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:31.920576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-622403e9-28eb-4e1b-b69a-36d727d1d2f3 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:31.950673 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-622403e9-28eb-4e1b-b69a-36d727d1d2f3 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] HTTP exception thrown: Instance 87f2fcb9-314f-4a73-a123-b078a943fe30 could not be found. Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-622403e9-28eb-4e1b-b69a-36d727d1d2f3 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Request method failure captured: Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 HTTP/1.1 Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrCt9qNItpCz0YEe6h3fNZjwpgrjRJPOcJGkvREK3uAC3b5ZvgUcd0Dir8OAMwmrFRgmBkN8bGRM9X4JFPeWgs7Prl7VRrpMcoFLVbkGcFL59wkXvPpW8zyn6MFDeL6IxKRAsEaG2y9NSdeIp4A9bvly7mnCOfiKulnoxq72PgD3DOA Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: ee3e4ba0f6be428da396d93ddc71756e Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestServerAdvancedOps-2087207043 Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ee3e4ba0f6be428da396d93ddc71756e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ee3e4ba0f6be428da396d93ddc71756e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ee3e4ba0f6be428da396d93ddc71756e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ee3e4ba0f6be428da396d93ddc71756e"}]}] Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestServerAdvancedOps-2087207043 Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: ee3e4ba0f6be428da396d93ddc71756e Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestServerAdvancedOps-2087207043 Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestServerAdvancedOps-2087207043-project Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 599bcafa4eef46248f732ecf2f1b3809 Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestServerAdvancedOps-2087207043-project Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 87f2fcb9-314f-4a73-a123-b078a943fe30 could not be found. Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '87f2fcb9-314f-4a73-a123-b078a943fe30'} Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f2fcb9-314f-4a73-a123-b078a943fe30 could not be found. Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f2fcb9-314f-4a73-a123-b078a943fe30 could not be found. Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:57:31.954510 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:57:31.963343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:57:31.963343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:57:31.963343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:57:31.963343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:57:31.963343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:57:31.963343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f2fcb9-314f-4a73-a123-b078a943fe30 could not be found. Oct 18 13:57:31.963343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:57:31.963343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-622403e9-28eb-4e1b-b69a-36d727d1d2f3 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] Returning 404 to user: Instance 87f2fcb9-314f-4a73-a123-b078a943fe30 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:57:31.963343 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-622403e9-28eb-4e1b-b69a-36d727d1d2f3 tempest-TestServerAdvancedOps-2087207043 tempest-TestServerAdvancedOps-2087207043-project] 10.222.0.40 "GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30" status: 404 len: 111 microversion: 2.1 time: 0.055324 Oct 18 13:57:31.963343 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2958/6119] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:31 2022] GET /compute/v2.1/servers/87f2fcb9-314f-4a73-a123-b078a943fe30 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:57:32.524264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bd3877fe-d54b-4199-a822-2ff3b4223733 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:32.527852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bd3877fe-d54b-4199-a822-2ff3b4223733 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] [instance: b81affc5-2a71-4f8c-9625-408b39b28018] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:32.560869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd3877fe-d54b-4199-a822-2ff3b4223733 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:32.563223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd3877fe-d54b-4199-a822-2ff3b4223733 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:32.563954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd3877fe-d54b-4199-a822-2ff3b4223733 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:32.564928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd3877fe-d54b-4199-a822-2ff3b4223733 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:32.566116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd3877fe-d54b-4199-a822-2ff3b4223733 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:32.566905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bd3877fe-d54b-4199-a822-2ff3b4223733 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:32.595822 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-bd3877fe-d54b-4199-a822-2ff3b4223733 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] HTTP exception thrown: Instance b81affc5-2a71-4f8c-9625-408b39b28018 could not be found. Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bd3877fe-d54b-4199-a822-2ff3b4223733 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Request method failure captured: Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 HTTP/1.1 Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTq-2Ah8lpND7MyP_QfhmXqsE5BSFcu5z1EeBQyXk09iCLlYASowo6h35JAoHQMvSsGOc8_2G5-1DQmFNrAp40DEGJ5w9H_rMYEQIrnBdoqjs8-gkZNOqqIDAaPhq-9f6BNJUnKuAwK3E0pFk_ONtoMI55OO6IIVuaWoQ7MHE10cj2PE Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 265512d8e20c440aa47d65744b7c5e77 Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1274206424 Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/265512d8e20c440aa47d65744b7c5e77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/265512d8e20c440aa47d65744b7c5e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/265512d8e20c440aa47d65744b7c5e77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_265512d8e20c440aa47d65744b7c5e77"}]}] Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-VolumesSnapshotTestJSON-1274206424 Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 265512d8e20c440aa47d65744b7c5e77 Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1274206424 Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-VolumesSnapshotTestJSON-1274206424-project Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 113b44ece3a640f0bafbcac853e1a994 Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-VolumesSnapshotTestJSON-1274206424-project Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance b81affc5-2a71-4f8c-9625-408b39b28018 could not be found. Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'b81affc5-2a71-4f8c-9625-408b39b28018'} Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b81affc5-2a71-4f8c-9625-408b39b28018 could not be found. Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b81affc5-2a71-4f8c-9625-408b39b28018 could not be found. Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:57:32.599827 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:57:32.605829 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:57:32.605829 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:57:32.605829 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:57:32.605829 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:57:32.605829 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:57:32.605829 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b81affc5-2a71-4f8c-9625-408b39b28018 could not be found. Oct 18 13:57:32.605829 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:57:32.605829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bd3877fe-d54b-4199-a822-2ff3b4223733 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] Returning 404 to user: Instance b81affc5-2a71-4f8c-9625-408b39b28018 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:57:32.605829 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bd3877fe-d54b-4199-a822-2ff3b4223733 tempest-VolumesSnapshotTestJSON-1274206424 tempest-VolumesSnapshotTestJSON-1274206424-project] 10.222.0.40 "GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018" status: 404 len: 111 microversion: 2.1 time: 0.092136 Oct 18 13:57:32.605829 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3162/6120] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:32 2022] GET /compute/v2.1/servers/b81affc5-2a71-4f8c-9625-408b39b28018 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:57:32.816018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b7c08a12-34db-454b-8b16-80ed146b0108 req-04dba95a-1fdf-4671-8d7a-675bb042081a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f2fcb9-314f-4a73-a123-b078a943fe30", "name": "network-vif-deleted", "tag": "0b6ae991-ba8c-41cd-9469-0c2929fc8bd9"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:32.833960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:32.841490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b7c08a12-34db-454b-8b16-80ed146b0108 req-04dba95a-1fdf-4671-8d7a-675bb042081a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:32.845981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b7c08a12-34db-454b-8b16-80ed146b0108 req-04dba95a-1fdf-4671-8d7a-675bb042081a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:32.846730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b7c08a12-34db-454b-8b16-80ed146b0108 req-04dba95a-1fdf-4671-8d7a-675bb042081a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:32.879972 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b7c08a12-34db-454b-8b16-80ed146b0108 req-04dba95a-1fdf-4671-8d7a-675bb042081a service nova] Creating event network-vif-deleted:0b6ae991-ba8c-41cd-9469-0c2929fc8bd9 for instance 87f2fcb9-314f-4a73-a123-b078a943fe30 on n-h2-858384-13 Oct 18 13:57:32.905702 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b7c08a12-34db-454b-8b16-80ed146b0108 req-04dba95a-1fdf-4671-8d7a-675bb042081a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092172 Oct 18 13:57:32.906372 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2959/6121] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:57:33.526648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-179478921-access_point-362908110", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "de163bea-9d48-429c-9477-be144afd5f6d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1137305977", "security_groups": [{"name": "tempest-secgroup_access--1144102292"}, {"name": "tempest-secgroup_general--55037434"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:33.896118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] validate_networks() for [('de163bea-9d48-429c-9477-be144afd5f6d', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:57:35.128870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:57:35.133018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:57:35.137007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:57:35.139543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:57:35.141907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:57:35.181567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:35.182264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:35.183024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:35.184185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:35.184799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:35.185503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:35.207359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Getting quotas for project 40ce6582de794908a180829b55ff74bc. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:57:35.214871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Getting quotas for user b12baa4d649044179dc337f8a0f65a27 and project 40ce6582de794908a180829b55ff74bc. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:57:35.231034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:57:35.233666 n-d-858384-13 devstack@n-api.service[120611]: WARNING nova.utils [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-179478921-access_point-362908110 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-179478921-acc Oct 18 13:57:35.234623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:57:35.310995 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc0b87b8-0503-435c-bc36-f2217ecc5e2d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.788248 Oct 18 13:57:35.321814 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3163/6122] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:57:33 2022] POST /compute/v2.1/servers => generated 456 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:57:35.331560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e8494722-1fc2-4375-8928-f7990037de4b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:35.341085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e8494722-1fc2-4375-8928-f7990037de4b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:35.380575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:35.633424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e8494722-1fc2-4375-8928-f7990037de4b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:35.662958 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e8494722-1fc2-4375-8928-f7990037de4b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1293 microversion: 2.1 time: 0.337105 Oct 18 13:57:35.666831 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2960/6123] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:35 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1293 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:36.693351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-da707a65-e79b-4a45-aaec-8188463c30c9 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:36.695395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-da707a65-e79b-4a45-aaec-8188463c30c9 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:36.712136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da707a65-e79b-4a45-aaec-8188463c30c9 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:36.713044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da707a65-e79b-4a45-aaec-8188463c30c9 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:36.717897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da707a65-e79b-4a45-aaec-8188463c30c9 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:36.719061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da707a65-e79b-4a45-aaec-8188463c30c9 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:36.719630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da707a65-e79b-4a45-aaec-8188463c30c9 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:36.720153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da707a65-e79b-4a45-aaec-8188463c30c9 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:36.823646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-da707a65-e79b-4a45-aaec-8188463c30c9 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:36.836676 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-da707a65-e79b-4a45-aaec-8188463c30c9 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1289 microversion: 2.1 time: 0.148398 Oct 18 13:57:36.841611 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3164/6124] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:36 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1289 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:57:37.353564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3c07fd42-f759-40e8-8ef8-aedff12c3bee tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:37.364314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3c07fd42-f759-40e8-8ef8-aedff12c3bee tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:37.410810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c07fd42-f759-40e8-8ef8-aedff12c3bee tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:37.411590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c07fd42-f759-40e8-8ef8-aedff12c3bee tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:37.412204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c07fd42-f759-40e8-8ef8-aedff12c3bee tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:37.414953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c07fd42-f759-40e8-8ef8-aedff12c3bee tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:37.419165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c07fd42-f759-40e8-8ef8-aedff12c3bee tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:37.420582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c07fd42-f759-40e8-8ef8-aedff12c3bee tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:37.551610 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3c07fd42-f759-40e8-8ef8-aedff12c3bee tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "POST /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb/action" status: 200 len: 32643 microversion: 2.1 time: 0.197680 Oct 18 13:57:37.560619 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2961/6125] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:57:37 2022] POST /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb/action => generated 32643 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:57:37.861005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d5566b8-4faf-4051-be36-b67f40915bc0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:37.862581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d5566b8-4faf-4051-be36-b67f40915bc0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:37.892960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d5566b8-4faf-4051-be36-b67f40915bc0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:37.894167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d5566b8-4faf-4051-be36-b67f40915bc0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:37.895244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d5566b8-4faf-4051-be36-b67f40915bc0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:37.896483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d5566b8-4faf-4051-be36-b67f40915bc0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:37.897243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d5566b8-4faf-4051-be36-b67f40915bc0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:37.898590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d5566b8-4faf-4051-be36-b67f40915bc0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:38.080453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9d5566b8-4faf-4051-be36-b67f40915bc0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:38.134892 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d5566b8-4faf-4051-be36-b67f40915bc0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1351 microversion: 2.1 time: 0.272632 Oct 18 13:57:38.152140 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3165/6126] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:37 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1351 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:39.173116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7441055c-244e-48d3-a6e8-db39053e481d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:39.174238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7441055c-244e-48d3-a6e8-db39053e481d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:39.204177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7441055c-244e-48d3-a6e8-db39053e481d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:39.204934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7441055c-244e-48d3-a6e8-db39053e481d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:39.207733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7441055c-244e-48d3-a6e8-db39053e481d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:39.208666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7441055c-244e-48d3-a6e8-db39053e481d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:39.209320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7441055c-244e-48d3-a6e8-db39053e481d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:39.211681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7441055c-244e-48d3-a6e8-db39053e481d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:39.926522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fb4255e0-63ef-4dec-8c42-4e3201b2e34c tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:39.927013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb4255e0-63ef-4dec-8c42-4e3201b2e34c tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:39.929872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:39.950707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb4255e0-63ef-4dec-8c42-4e3201b2e34c tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:39.951200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb4255e0-63ef-4dec-8c42-4e3201b2e34c tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:39.951833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb4255e0-63ef-4dec-8c42-4e3201b2e34c tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:39.952732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb4255e0-63ef-4dec-8c42-4e3201b2e34c tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:39.953245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb4255e0-63ef-4dec-8c42-4e3201b2e34c tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:39.953633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fb4255e0-63ef-4dec-8c42-4e3201b2e34c tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:39.988122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7441055c-244e-48d3-a6e8-db39053e481d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:40.001812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:40.013996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fb4255e0-63ef-4dec-8c42-4e3201b2e34c tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:57:40.018397 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7441055c-244e-48d3-a6e8-db39053e481d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1469 microversion: 2.1 time: 0.849469 Oct 18 13:57:40.025129 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2962/6127] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:39 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1469 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:40.054917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d84d2799-ecc6-428d-b40f-7406cbcef4fa req-cb050461-f468-4491-96e7-d94c97184120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d960a1-1167-462d-8356-a21647334acb", "tag": "0b89975f-0369-4018-99c0-935061f3d33c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:40.088874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d84d2799-ecc6-428d-b40f-7406cbcef4fa req-cb050461-f468-4491-96e7-d94c97184120 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:40.089521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d84d2799-ecc6-428d-b40f-7406cbcef4fa req-cb050461-f468-4491-96e7-d94c97184120 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:40.090531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d84d2799-ecc6-428d-b40f-7406cbcef4fa req-cb050461-f468-4491-96e7-d94c97184120 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:40.114280 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d84d2799-ecc6-428d-b40f-7406cbcef4fa req-cb050461-f468-4491-96e7-d94c97184120 service nova] Creating event network-changed:0b89975f-0369-4018-99c0-935061f3d33c for instance a6d960a1-1167-462d-8356-a21647334acb on n-h2-858384-13 Oct 18 13:57:40.140821 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d84d2799-ecc6-428d-b40f-7406cbcef4fa req-cb050461-f468-4491-96e7-d94c97184120 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110589 Oct 18 13:57:40.142466 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2963/6128] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:57:40.159543 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fb4255e0-63ef-4dec-8c42-4e3201b2e34c tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 204 len: 0 microversion: 2.1 time: 0.236290 Oct 18 13:57:40.173302 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3166/6129] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:57:39 2022] DELETE /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 13:57:40.181328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb3aabd2-2dcb-4a72-912f-8720cf066f80 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:40.182683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb3aabd2-2dcb-4a72-912f-8720cf066f80 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:40.196634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb3aabd2-2dcb-4a72-912f-8720cf066f80 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:40.197643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb3aabd2-2dcb-4a72-912f-8720cf066f80 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:40.198400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb3aabd2-2dcb-4a72-912f-8720cf066f80 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:40.199380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb3aabd2-2dcb-4a72-912f-8720cf066f80 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:40.200083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb3aabd2-2dcb-4a72-912f-8720cf066f80 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:40.200732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb3aabd2-2dcb-4a72-912f-8720cf066f80 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:41.063191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a590ab35-040d-4801-b057-797d5c2cfc51 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:41.068491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fb3aabd2-2dcb-4a72-912f-8720cf066f80 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:41.069877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a590ab35-040d-4801-b057-797d5c2cfc51 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:41.078076 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb3aabd2-2dcb-4a72-912f-8720cf066f80 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1670 microversion: 2.1 time: 0.910209 Oct 18 13:57:41.095049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a590ab35-040d-4801-b057-797d5c2cfc51 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:41.095725 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2964/6130] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:40 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1670 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:41.096550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a590ab35-040d-4801-b057-797d5c2cfc51 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:41.097278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a590ab35-040d-4801-b057-797d5c2cfc51 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:41.098837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a590ab35-040d-4801-b057-797d5c2cfc51 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:41.099576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a590ab35-040d-4801-b057-797d5c2cfc51 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:41.101514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a590ab35-040d-4801-b057-797d5c2cfc51 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:41.984168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a590ab35-040d-4801-b057-797d5c2cfc51 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:41.994041 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a590ab35-040d-4801-b057-797d5c2cfc51 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1469 microversion: 2.1 time: 0.944239 Oct 18 13:57:41.999529 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3167/6131] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:41 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1469 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:42.106051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-74a59f9d-82bb-47cd-9839-1c9aa0a894e7 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:42.106680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-74a59f9d-82bb-47cd-9839-1c9aa0a894e7 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:42.118951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74a59f9d-82bb-47cd-9839-1c9aa0a894e7 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:42.119462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74a59f9d-82bb-47cd-9839-1c9aa0a894e7 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:42.119867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74a59f9d-82bb-47cd-9839-1c9aa0a894e7 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:42.120581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74a59f9d-82bb-47cd-9839-1c9aa0a894e7 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:42.121253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74a59f9d-82bb-47cd-9839-1c9aa0a894e7 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:42.121853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-74a59f9d-82bb-47cd-9839-1c9aa0a894e7 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:43.023744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d0b1880e-39aa-4fe5-a2ee-064921c8aa31 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:43.025108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d0b1880e-39aa-4fe5-a2ee-064921c8aa31 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:43.032769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0b1880e-39aa-4fe5-a2ee-064921c8aa31 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:43.033567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0b1880e-39aa-4fe5-a2ee-064921c8aa31 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:43.034211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0b1880e-39aa-4fe5-a2ee-064921c8aa31 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:43.035122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0b1880e-39aa-4fe5-a2ee-064921c8aa31 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:43.035827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0b1880e-39aa-4fe5-a2ee-064921c8aa31 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:43.036526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0b1880e-39aa-4fe5-a2ee-064921c8aa31 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:43.066975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:43.231056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-74a59f9d-82bb-47cd-9839-1c9aa0a894e7 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:43.246536 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-74a59f9d-82bb-47cd-9839-1c9aa0a894e7 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1670 microversion: 2.1 time: 1.140895 Oct 18 13:57:43.247367 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2965/6132] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:42 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1670 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:43.280711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d0b1880e-39aa-4fe5-a2ee-064921c8aa31 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:43.297778 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d0b1880e-39aa-4fe5-a2ee-064921c8aa31 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1469 microversion: 2.1 time: 0.279057 Oct 18 13:57:43.298390 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3168/6133] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:43 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:43.384753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-27318575-0f75-4ba0-8fa9-63908a724cc0 req-dec4fdfa-6cc6-41e3-8f92-eb2baa9cb9fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bfd8fdb-c939-4f85-837f-0de9341480f3", "tag": "e960394b-2e00-4357-8cd4-493ff3e4184c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:43.396640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-27318575-0f75-4ba0-8fa9-63908a724cc0 req-dec4fdfa-6cc6-41e3-8f92-eb2baa9cb9fb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:43.397505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-27318575-0f75-4ba0-8fa9-63908a724cc0 req-dec4fdfa-6cc6-41e3-8f92-eb2baa9cb9fb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:43.398123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-27318575-0f75-4ba0-8fa9-63908a724cc0 req-dec4fdfa-6cc6-41e3-8f92-eb2baa9cb9fb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:43.413934 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-27318575-0f75-4ba0-8fa9-63908a724cc0 req-dec4fdfa-6cc6-41e3-8f92-eb2baa9cb9fb service nova] Creating event network-changed:e960394b-2e00-4357-8cd4-493ff3e4184c for instance 4bfd8fdb-c939-4f85-837f-0de9341480f3 on n-h1-858384-13 Oct 18 13:57:43.421845 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-27318575-0f75-4ba0-8fa9-63908a724cc0 req-dec4fdfa-6cc6-41e3-8f92-eb2baa9cb9fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042365 Oct 18 13:57:43.423538 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2966/6134] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:57:44.275752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-84cdf126-70d2-4dbc-942c-84cc668a8feb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:44.276363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-84cdf126-70d2-4dbc-942c-84cc668a8feb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:44.300850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84cdf126-70d2-4dbc-942c-84cc668a8feb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:44.301378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84cdf126-70d2-4dbc-942c-84cc668a8feb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:44.301839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84cdf126-70d2-4dbc-942c-84cc668a8feb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:44.302531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84cdf126-70d2-4dbc-942c-84cc668a8feb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:44.302986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84cdf126-70d2-4dbc-942c-84cc668a8feb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:44.303444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-84cdf126-70d2-4dbc-942c-84cc668a8feb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:44.327349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7b2fe44b-6b60-4b7e-9424-009fffa3c378 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:44.328993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7b2fe44b-6b60-4b7e-9424-009fffa3c378 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:44.352237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b2fe44b-6b60-4b7e-9424-009fffa3c378 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:44.353687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b2fe44b-6b60-4b7e-9424-009fffa3c378 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:44.354683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b2fe44b-6b60-4b7e-9424-009fffa3c378 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:44.355706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b2fe44b-6b60-4b7e-9424-009fffa3c378 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:44.356491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b2fe44b-6b60-4b7e-9424-009fffa3c378 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:44.357142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b2fe44b-6b60-4b7e-9424-009fffa3c378 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:44.497244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-84cdf126-70d2-4dbc-942c-84cc668a8feb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1578cd25f24465d941f03800e4bac54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5000aa07e2f5417c9b0441ecc463cba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:44.507886 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-84cdf126-70d2-4dbc-942c-84cc668a8feb tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 200 len: 1333 microversion: 2.1 time: 0.236325 Oct 18 13:57:44.510476 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3169/6135] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:44 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 1333 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:44.910465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7b2fe44b-6b60-4b7e-9424-009fffa3c378 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:44.933644 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7b2fe44b-6b60-4b7e-9424-009fffa3c378 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1469 microversion: 2.1 time: 0.607414 Oct 18 13:57:44.935871 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2967/6136] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:44 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1469 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:57:45.455386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3761aa55-f20c-47c7-81aa-07e7a430297b req-8b7d29f7-c683-4b7e-839e-add8c0c7f182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d960a1-1167-462d-8356-a21647334acb", "name": "network-vif-deleted", "tag": "0b89975f-0369-4018-99c0-935061f3d33c"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:45.461436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:45.462756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:45.493314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3761aa55-f20c-47c7-81aa-07e7a430297b req-8b7d29f7-c683-4b7e-839e-add8c0c7f182 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:45.494119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3761aa55-f20c-47c7-81aa-07e7a430297b req-8b7d29f7-c683-4b7e-839e-add8c0c7f182 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:45.496295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3761aa55-f20c-47c7-81aa-07e7a430297b req-8b7d29f7-c683-4b7e-839e-add8c0c7f182 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:45.527427 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3761aa55-f20c-47c7-81aa-07e7a430297b req-8b7d29f7-c683-4b7e-839e-add8c0c7f182 service nova] Creating event network-vif-deleted:0b89975f-0369-4018-99c0-935061f3d33c for instance a6d960a1-1167-462d-8356-a21647334acb on n-h2-858384-13 Oct 18 13:57:45.536359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ce44c0b3-a5f4-4b64-a937-f5737057c84b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:45.537107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ce44c0b3-a5f4-4b64-a937-f5737057c84b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] [instance: a6d960a1-1167-462d-8356-a21647334acb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:45.542884 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3761aa55-f20c-47c7-81aa-07e7a430297b req-8b7d29f7-c683-4b7e-839e-add8c0c7f182 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092177 Oct 18 13:57:45.543505 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3170/6137] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:57:45.545581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce44c0b3-a5f4-4b64-a937-f5737057c84b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:45.546084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce44c0b3-a5f4-4b64-a937-f5737057c84b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:45.546530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce44c0b3-a5f4-4b64-a937-f5737057c84b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:45.547242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce44c0b3-a5f4-4b64-a937-f5737057c84b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:45.547979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce44c0b3-a5f4-4b64-a937-f5737057c84b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:45.548130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce44c0b3-a5f4-4b64-a937-f5737057c84b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:45.568011 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-ce44c0b3-a5f4-4b64-a937-f5737057c84b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] HTTP exception thrown: Instance a6d960a1-1167-462d-8356-a21647334acb could not be found. Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ce44c0b3-a5f4-4b64-a937-f5737057c84b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Request method failure captured: Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb HTTP/1.1 Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTq_OU17etjgstOSNB5QP9PziKjMCPdMMj8rW-vMKYqMNHfc_30LNb5q1zrOc19FYuRKW-CvKyE1cJc64kgaaj850F224XBxmzq_uYVbiwaJhdyXAs0xaYAMNV0IxRbkR_I_RYNKJeFkinUSMLb5ajxsWEAaZ-au_ajLuE-Um86MskVE Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 5000aa07e2f5417c9b0441ecc463cba9 Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestNetworkBasicOps-1206184800 Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5000aa07e2f5417c9b0441ecc463cba9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5000aa07e2f5417c9b0441ecc463cba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5000aa07e2f5417c9b0441ecc463cba9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5000aa07e2f5417c9b0441ecc463cba9"}]}] Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestNetworkBasicOps-1206184800 Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 5000aa07e2f5417c9b0441ecc463cba9 Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestNetworkBasicOps-1206184800 Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestNetworkBasicOps-1206184800-project Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: e1578cd25f24465d941f03800e4bac54 Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestNetworkBasicOps-1206184800-project Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance a6d960a1-1167-462d-8356-a21647334acb could not be found. Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'a6d960a1-1167-462d-8356-a21647334acb'} Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d960a1-1167-462d-8356-a21647334acb could not be found. Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d960a1-1167-462d-8356-a21647334acb could not be found. Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:57:45.570493 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:57:45.575418 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:57:45.575418 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:57:45.575418 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:57:45.575418 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:57:45.575418 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:57:45.575418 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d960a1-1167-462d-8356-a21647334acb could not be found. Oct 18 13:57:45.575418 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:57:45.575418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ce44c0b3-a5f4-4b64-a937-f5737057c84b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Returning 404 to user: Instance a6d960a1-1167-462d-8356-a21647334acb could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:57:45.575418 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ce44c0b3-a5f4-4b64-a937-f5737057c84b tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb" status: 404 len: 111 microversion: 2.1 time: 0.040099 Oct 18 13:57:45.575418 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2968/6138] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:45 2022] GET /compute/v2.1/servers/a6d960a1-1167-462d-8356-a21647334acb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:57:45.803831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-58369e57-9647-4a58-9bde-6f8efded8f38 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] Calling method '.version_select at 0x7ff60ee24f70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:45.843699 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-58369e57-9647-4a58-9bde-6f8efded8f38 tempest-TestNetworkBasicOps-1206184800 tempest-TestNetworkBasicOps-1206184800-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-890502699" status: 202 len: 0 microversion: 2.1 time: 0.044172 Oct 18 13:57:45.845646 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3171/6139] 10.222.0.40 () {58 vars in 1254 bytes} [Tue Oct 18 13:57:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-890502699 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:57:45.961442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3082dab9-f4e4-4640-8475-74cd3c3884dd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:45.962307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3082dab9-f4e4-4640-8475-74cd3c3884dd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:45.971420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:57:45.977889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3082dab9-f4e4-4640-8475-74cd3c3884dd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:45.978800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3082dab9-f4e4-4640-8475-74cd3c3884dd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:45.983877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3082dab9-f4e4-4640-8475-74cd3c3884dd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:45.984805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3082dab9-f4e4-4640-8475-74cd3c3884dd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:45.988872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3082dab9-f4e4-4640-8475-74cd3c3884dd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:45.989378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3082dab9-f4e4-4640-8475-74cd3c3884dd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:46.228042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3082dab9-f4e4-4640-8475-74cd3c3884dd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:46.243770 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3082dab9-f4e4-4640-8475-74cd3c3884dd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1469 microversion: 2.1 time: 0.287806 Oct 18 13:57:46.260688 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2969/6140] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:45 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1469 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:47.274403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-610c5201-005c-49d3-a92a-e482ef988b32 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:47.278942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-610c5201-005c-49d3-a92a-e482ef988b32 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:47.295155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610c5201-005c-49d3-a92a-e482ef988b32 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:47.297563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610c5201-005c-49d3-a92a-e482ef988b32 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:47.298481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610c5201-005c-49d3-a92a-e482ef988b32 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:47.306214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610c5201-005c-49d3-a92a-e482ef988b32 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:47.307066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610c5201-005c-49d3-a92a-e482ef988b32 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:47.307767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-610c5201-005c-49d3-a92a-e482ef988b32 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:47.825873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-610c5201-005c-49d3-a92a-e482ef988b32 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:47.834788 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-610c5201-005c-49d3-a92a-e482ef988b32 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1469 microversion: 2.1 time: 0.570718 Oct 18 13:57:47.835380 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3172/6141] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:47 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1469 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:48.874930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-007e93e2-63ee-4785-9720-2d3d11e13a9e tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:48.876087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-007e93e2-63ee-4785-9720-2d3d11e13a9e tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:48.929928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-007e93e2-63ee-4785-9720-2d3d11e13a9e tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:48.930424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-007e93e2-63ee-4785-9720-2d3d11e13a9e tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:48.938026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-007e93e2-63ee-4785-9720-2d3d11e13a9e tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:48.942529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-007e93e2-63ee-4785-9720-2d3d11e13a9e tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:48.943028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-007e93e2-63ee-4785-9720-2d3d11e13a9e tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:48.950502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-007e93e2-63ee-4785-9720-2d3d11e13a9e tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:49.346516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-007e93e2-63ee-4785-9720-2d3d11e13a9e tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:49.363643 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-007e93e2-63ee-4785-9720-2d3d11e13a9e tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1469 microversion: 2.1 time: 0.497586 Oct 18 13:57:49.367781 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2970/6142] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:48 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1469 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:50.411648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c83b376e-5bd9-475f-9a27-d7cf703b218a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:50.412353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c83b376e-5bd9-475f-9a27-d7cf703b218a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:50.437287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c83b376e-5bd9-475f-9a27-d7cf703b218a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:50.437786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c83b376e-5bd9-475f-9a27-d7cf703b218a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:50.440939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c83b376e-5bd9-475f-9a27-d7cf703b218a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:50.441945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c83b376e-5bd9-475f-9a27-d7cf703b218a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:50.444668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c83b376e-5bd9-475f-9a27-d7cf703b218a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:50.445118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c83b376e-5bd9-475f-9a27-d7cf703b218a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:50.972287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c83b376e-5bd9-475f-9a27-d7cf703b218a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:50.991402 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c83b376e-5bd9-475f-9a27-d7cf703b218a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1469 microversion: 2.1 time: 0.574795 Oct 18 13:57:50.997808 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3173/6143] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:50 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1469 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:52.061962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2a0449c6-2ac0-4132-bcbd-381aa1262c08 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:52.062657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2a0449c6-2ac0-4132-bcbd-381aa1262c08 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:52.116714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0449c6-2ac0-4132-bcbd-381aa1262c08 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:52.124764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0449c6-2ac0-4132-bcbd-381aa1262c08 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:52.127813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0449c6-2ac0-4132-bcbd-381aa1262c08 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:52.129782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0449c6-2ac0-4132-bcbd-381aa1262c08 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:52.134572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0449c6-2ac0-4132-bcbd-381aa1262c08 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:52.138769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0449c6-2ac0-4132-bcbd-381aa1262c08 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:52.745457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2a0449c6-2ac0-4132-bcbd-381aa1262c08 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:52.754654 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2a0449c6-2ac0-4132-bcbd-381aa1262c08 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1469 microversion: 2.1 time: 0.734816 Oct 18 13:57:52.755904 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2971/6144] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:52 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1469 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:52.867809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-71b94305-308c-45a2-be5f-7cf9cef5f603 req-7032f9b5-e457-4268-be2f-b4501b735a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bfd8fdb-c939-4f85-837f-0de9341480f3", "name": "network-vif-plugged", "status": "completed", "tag": "e960394b-2e00-4357-8cd4-493ff3e4184c"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:57:52.890084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-71b94305-308c-45a2-be5f-7cf9cef5f603 req-7032f9b5-e457-4268-be2f-b4501b735a64 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:52.893895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-71b94305-308c-45a2-be5f-7cf9cef5f603 req-7032f9b5-e457-4268-be2f-b4501b735a64 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:52.894687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-71b94305-308c-45a2-be5f-7cf9cef5f603 req-7032f9b5-e457-4268-be2f-b4501b735a64 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:52.947636 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-71b94305-308c-45a2-be5f-7cf9cef5f603 req-7032f9b5-e457-4268-be2f-b4501b735a64 service nova] Creating event network-vif-plugged:e960394b-2e00-4357-8cd4-493ff3e4184c for instance 4bfd8fdb-c939-4f85-837f-0de9341480f3 on n-h1-858384-13 Oct 18 13:57:52.969051 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-71b94305-308c-45a2-be5f-7cf9cef5f603 req-7032f9b5-e457-4268-be2f-b4501b735a64 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105113 Oct 18 13:57:52.970132 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3174/6145] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:57:53.789692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1a01a043-1ebd-487d-b5cd-1f3a5a8b0b09 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:53.791185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1a01a043-1ebd-487d-b5cd-1f3a5a8b0b09 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:53.817573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a01a043-1ebd-487d-b5cd-1f3a5a8b0b09 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:53.820359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a01a043-1ebd-487d-b5cd-1f3a5a8b0b09 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:53.821663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a01a043-1ebd-487d-b5cd-1f3a5a8b0b09 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:53.822434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a01a043-1ebd-487d-b5cd-1f3a5a8b0b09 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:53.825973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a01a043-1ebd-487d-b5cd-1f3a5a8b0b09 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:53.826444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a01a043-1ebd-487d-b5cd-1f3a5a8b0b09 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:54.115519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1a01a043-1ebd-487d-b5cd-1f3a5a8b0b09 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:54.126088 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1a01a043-1ebd-487d-b5cd-1f3a5a8b0b09 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1469 microversion: 2.1 time: 0.348022 Oct 18 13:57:54.126696 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2972/6146] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:53 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1469 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:55.154212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7894e5e0-b02a-4ec6-af58-5d5cf54e5b7f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:55.156717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7894e5e0-b02a-4ec6-af58-5d5cf54e5b7f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:55.165819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7894e5e0-b02a-4ec6-af58-5d5cf54e5b7f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:55.166778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7894e5e0-b02a-4ec6-af58-5d5cf54e5b7f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:55.167448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7894e5e0-b02a-4ec6-af58-5d5cf54e5b7f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:55.168433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7894e5e0-b02a-4ec6-af58-5d5cf54e5b7f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:55.169721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7894e5e0-b02a-4ec6-af58-5d5cf54e5b7f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:55.170373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7894e5e0-b02a-4ec6-af58-5d5cf54e5b7f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:55.707666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7894e5e0-b02a-4ec6-af58-5d5cf54e5b7f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:55.720283 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7894e5e0-b02a-4ec6-af58-5d5cf54e5b7f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1641 microversion: 2.1 time: 0.571546 Oct 18 13:57:55.720903 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3175/6147] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:55 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1641 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:55.745132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9e20fd06-6278-4be8-a514-5d65e951adff tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:55.745848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9e20fd06-6278-4be8-a514-5d65e951adff tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:55.753399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e20fd06-6278-4be8-a514-5d65e951adff tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:55.754060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e20fd06-6278-4be8-a514-5d65e951adff tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:55.754517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e20fd06-6278-4be8-a514-5d65e951adff tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:55.755237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e20fd06-6278-4be8-a514-5d65e951adff tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:55.755846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e20fd06-6278-4be8-a514-5d65e951adff tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:55.756920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e20fd06-6278-4be8-a514-5d65e951adff tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:56.049532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9e20fd06-6278-4be8-a514-5d65e951adff tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:57:56.058261 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9e20fd06-6278-4be8-a514-5d65e951adff tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1641 microversion: 2.1 time: 0.317748 Oct 18 13:57:56.086493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-815fe6fe-47b0-44ce-b1ee-e486d2caaa09 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:57:56.087369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-815fe6fe-47b0-44ce-b1ee-e486d2caaa09 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:57:56.089321 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2973/6148] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:55 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1641 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:57:56.099600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-815fe6fe-47b0-44ce-b1ee-e486d2caaa09 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:56.108181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-815fe6fe-47b0-44ce-b1ee-e486d2caaa09 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:56.109091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-815fe6fe-47b0-44ce-b1ee-e486d2caaa09 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:56.110099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-815fe6fe-47b0-44ce-b1ee-e486d2caaa09 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:57:56.113875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-815fe6fe-47b0-44ce-b1ee-e486d2caaa09 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:57:56.118572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-815fe6fe-47b0-44ce-b1ee-e486d2caaa09 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:57:56.754610 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-815fe6fe-47b0-44ce-b1ee-e486d2caaa09 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1794 microversion: 2.1 time: 0.672765 Oct 18 13:57:56.770529 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3176/6149] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:57:56 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1794 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:01.327382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-3717f0ef-8a08-47bb-bad2-faf0158b3f60 req-35389796-718b-4d8a-bc18-520aabdb319f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bfd8fdb-c939-4f85-837f-0de9341480f3", "tag": "e960394b-2e00-4357-8cd4-493ff3e4184c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:58:01.349534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3717f0ef-8a08-47bb-bad2-faf0158b3f60 req-35389796-718b-4d8a-bc18-520aabdb319f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:01.351532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3717f0ef-8a08-47bb-bad2-faf0158b3f60 req-35389796-718b-4d8a-bc18-520aabdb319f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:01.352693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3717f0ef-8a08-47bb-bad2-faf0158b3f60 req-35389796-718b-4d8a-bc18-520aabdb319f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:01.390548 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-3717f0ef-8a08-47bb-bad2-faf0158b3f60 req-35389796-718b-4d8a-bc18-520aabdb319f service nova] Creating event network-changed:e960394b-2e00-4357-8cd4-493ff3e4184c for instance 4bfd8fdb-c939-4f85-837f-0de9341480f3 on n-h1-858384-13 Oct 18 13:58:01.401226 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-3717f0ef-8a08-47bb-bad2-faf0158b3f60 req-35389796-718b-4d8a-bc18-520aabdb319f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078855 Oct 18 13:58:01.401593 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2974/6150] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:58:42.298005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:42.298768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=39 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:42.528564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4117ea4c-3e25-4a29-9365-f94daae48d34 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'create', calling method: .version_select at 0x7ff60f001940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-158561403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx4qnwNK6GyBGso97f7VUgu/PNkhAPjmI/cM/PnzTXTEgRyOxhN06sAsZs8C3s5v3IYm+7kOeTfBw/SCu2nvF32ONgtcVPnsd5cJTKMpJKPInKep149OkX9ZwZLuFScLg=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:58:42.546563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-4117ea4c-3e25-4a29-9365-f94daae48d34 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for project c5b27cd003004ada9e45c087db637da3. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:58:42.554376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-4117ea4c-3e25-4a29-9365-f94daae48d34 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for user 21e90c2f331f46f497b568dbc0e0c100 and project c5b27cd003004ada9e45c087db637da3. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:58:42.584439 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4117ea4c-3e25-4a29-9365-f94daae48d34 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.292396 Oct 18 13:58:42.586161 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3177/6151] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 13:58:42 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:58:50.712874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=31 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:50.714600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=56 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:58:50.721711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-297567367", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "bff45d17-e8bc-4150-8a68-4dbd7afb680e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-158561403", "security_groups": [{"name": "tempest-secgroup-smoke-402914329"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:58:50.882693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] validate_networks() for [('bff45d17-e8bc-4150-8a68-4dbd7afb680e', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:58:51.484997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:58:51.485450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:58:51.486745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:58:51.487348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:58:51.487942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:58:51.499738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:51.500500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:51.500940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:51.501881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:51.502538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:51.503144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:51.528504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for project c5b27cd003004ada9e45c087db637da3. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:58:51.538377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for user 21e90c2f331f46f497b568dbc0e0c100 and project c5b27cd003004ada9e45c087db637da3. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:58:51.554470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:58:51.558448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:58:51.626283 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4b87fe58-2357-4542-9b1e-44e0d5bbace3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.916693 Oct 18 13:58:51.627477 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2975/6152] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:58:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:58:51.641736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13a9f2b2-2ff2-49fd-a8f4-6a3ad829beaf tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:51.642394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-13a9f2b2-2ff2-49fd-a8f4-6a3ad829beaf tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:51.738375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-13a9f2b2-2ff2-49fd-a8f4-6a3ad829beaf tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:51.746633 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13a9f2b2-2ff2-49fd-a8f4-6a3ad829beaf tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1265 microversion: 2.1 time: 0.111190 Oct 18 13:58:51.747156 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3178/6153] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:51 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:52.788664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ca0b5ae3-fa2f-4780-a792-4ed232bb8de9 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:52.794167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ca0b5ae3-fa2f-4780-a792-4ed232bb8de9 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:52.801386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca0b5ae3-fa2f-4780-a792-4ed232bb8de9 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:52.802172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca0b5ae3-fa2f-4780-a792-4ed232bb8de9 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:52.802798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca0b5ae3-fa2f-4780-a792-4ed232bb8de9 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:52.804024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca0b5ae3-fa2f-4780-a792-4ed232bb8de9 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:52.804853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca0b5ae3-fa2f-4780-a792-4ed232bb8de9 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:52.805517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ca0b5ae3-fa2f-4780-a792-4ed232bb8de9 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:52.879128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ca0b5ae3-fa2f-4780-a792-4ed232bb8de9 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:52.889120 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ca0b5ae3-fa2f-4780-a792-4ed232bb8de9 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1317 microversion: 2.1 time: 0.121211 Oct 18 13:58:52.893234 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2976/6154] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:52 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1317 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:53.916180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4514a9a3-43bc-4b98-951b-103ead3e2c81 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:53.917769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4514a9a3-43bc-4b98-951b-103ead3e2c81 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:53.925308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4514a9a3-43bc-4b98-951b-103ead3e2c81 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:53.926070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4514a9a3-43bc-4b98-951b-103ead3e2c81 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:53.926512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4514a9a3-43bc-4b98-951b-103ead3e2c81 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:53.927227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4514a9a3-43bc-4b98-951b-103ead3e2c81 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:53.927886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4514a9a3-43bc-4b98-951b-103ead3e2c81 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:53.928519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4514a9a3-43bc-4b98-951b-103ead3e2c81 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:54.094971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4514a9a3-43bc-4b98-951b-103ead3e2c81 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:54.106741 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4514a9a3-43bc-4b98-951b-103ead3e2c81 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1323 microversion: 2.1 time: 0.195337 Oct 18 13:58:54.108151 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3179/6155] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:53 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1323 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:55.133935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8dcb2741-9a4b-4b49-9fe7-e88c28de329e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:55.134421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8dcb2741-9a4b-4b49-9fe7-e88c28de329e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:55.150153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8dcb2741-9a4b-4b49-9fe7-e88c28de329e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:55.150773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8dcb2741-9a4b-4b49-9fe7-e88c28de329e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:55.155462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8dcb2741-9a4b-4b49-9fe7-e88c28de329e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:55.158389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8dcb2741-9a4b-4b49-9fe7-e88c28de329e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:55.158913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8dcb2741-9a4b-4b49-9fe7-e88c28de329e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:55.159366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8dcb2741-9a4b-4b49-9fe7-e88c28de329e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:55.469494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8dcb2741-9a4b-4b49-9fe7-e88c28de329e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:55.488935 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8dcb2741-9a4b-4b49-9fe7-e88c28de329e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1390 microversion: 2.1 time: 0.359757 Oct 18 13:58:55.490614 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2977/6156] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:55 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1390 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:55.932417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-db089d49-7ffe-4cb4-a7f5-2dab9a10e3fe req-2a5fde98-3c05-4db5-b5f7-024f47518980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959c7403-84b5-4f11-9117-a86a2d452a44", "tag": "d7dcac03-eee5-498f-bdf2-9f546cfb50bc"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:58:55.969381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-db089d49-7ffe-4cb4-a7f5-2dab9a10e3fe req-2a5fde98-3c05-4db5-b5f7-024f47518980 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:55.974235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-db089d49-7ffe-4cb4-a7f5-2dab9a10e3fe req-2a5fde98-3c05-4db5-b5f7-024f47518980 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:55.976390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-db089d49-7ffe-4cb4-a7f5-2dab9a10e3fe req-2a5fde98-3c05-4db5-b5f7-024f47518980 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:56.008378 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-db089d49-7ffe-4cb4-a7f5-2dab9a10e3fe req-2a5fde98-3c05-4db5-b5f7-024f47518980 service nova] Creating event network-changed:d7dcac03-eee5-498f-bdf2-9f546cfb50bc for instance 959c7403-84b5-4f11-9117-a86a2d452a44 on n-h2-858384-13 Oct 18 13:58:56.020881 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-db089d49-7ffe-4cb4-a7f5-2dab9a10e3fe req-2a5fde98-3c05-4db5-b5f7-024f47518980 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098888 Oct 18 13:58:56.023873 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3180/6157] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:58:56.515255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a97ee969-4411-4578-9265-ce2c88302610 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:56.516158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a97ee969-4411-4578-9265-ce2c88302610 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:56.529671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a97ee969-4411-4578-9265-ce2c88302610 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:56.530175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a97ee969-4411-4578-9265-ce2c88302610 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:56.531064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a97ee969-4411-4578-9265-ce2c88302610 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:56.532358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a97ee969-4411-4578-9265-ce2c88302610 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:56.535037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a97ee969-4411-4578-9265-ce2c88302610 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:56.536027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a97ee969-4411-4578-9265-ce2c88302610 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:56.765146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a97ee969-4411-4578-9265-ce2c88302610 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:56.777851 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a97ee969-4411-4578-9265-ce2c88302610 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1390 microversion: 2.1 time: 0.267440 Oct 18 13:58:56.778926 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2978/6158] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:56 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1390 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:57.802913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b62ca468-3e26-4fef-8c71-dba3d203b1f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:57.804941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b62ca468-3e26-4fef-8c71-dba3d203b1f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:57.812822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b62ca468-3e26-4fef-8c71-dba3d203b1f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:57.813341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b62ca468-3e26-4fef-8c71-dba3d203b1f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:57.814015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b62ca468-3e26-4fef-8c71-dba3d203b1f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:57.814932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b62ca468-3e26-4fef-8c71-dba3d203b1f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:57.815410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b62ca468-3e26-4fef-8c71-dba3d203b1f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:57.815847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b62ca468-3e26-4fef-8c71-dba3d203b1f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:57.964444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b62ca468-3e26-4fef-8c71-dba3d203b1f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:57.973374 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b62ca468-3e26-4fef-8c71-dba3d203b1f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1390 microversion: 2.1 time: 0.175638 Oct 18 13:58:57.973962 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3181/6159] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:57 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:58:58.997614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fadc1e0a-5bb1-4e51-8f64-54f3b79590ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:58:58.997614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fadc1e0a-5bb1-4e51-8f64-54f3b79590ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:58:59.007293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fadc1e0a-5bb1-4e51-8f64-54f3b79590ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:59.007293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fadc1e0a-5bb1-4e51-8f64-54f3b79590ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:59.007293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fadc1e0a-5bb1-4e51-8f64-54f3b79590ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:59.007293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fadc1e0a-5bb1-4e51-8f64-54f3b79590ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:58:59.009231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fadc1e0a-5bb1-4e51-8f64-54f3b79590ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:58:59.009231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fadc1e0a-5bb1-4e51-8f64-54f3b79590ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:58:59.186158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fadc1e0a-5bb1-4e51-8f64-54f3b79590ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:58:59.195874 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fadc1e0a-5bb1-4e51-8f64-54f3b79590ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1390 microversion: 2.1 time: 0.203632 Oct 18 13:58:59.196488 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2979/6160] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:58:58 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1390 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:00.221770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a7b29d95-1623-4e55-8bf6-5304286bc455 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:00.223408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a7b29d95-1623-4e55-8bf6-5304286bc455 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:00.231365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7b29d95-1623-4e55-8bf6-5304286bc455 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:00.231965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7b29d95-1623-4e55-8bf6-5304286bc455 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:00.232523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7b29d95-1623-4e55-8bf6-5304286bc455 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:00.233355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7b29d95-1623-4e55-8bf6-5304286bc455 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:00.233908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7b29d95-1623-4e55-8bf6-5304286bc455 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:00.234469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a7b29d95-1623-4e55-8bf6-5304286bc455 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:00.379824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a7b29d95-1623-4e55-8bf6-5304286bc455 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:00.388021 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a7b29d95-1623-4e55-8bf6-5304286bc455 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1390 microversion: 2.1 time: 0.170163 Oct 18 13:59:00.388610 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3182/6161] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:00 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:01.364180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-15e7ec92-fd43-4424-8009-25c44a6337d2 req-cb06a972-ef7a-4a75-900d-686d77c3b86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959c7403-84b5-4f11-9117-a86a2d452a44", "name": "network-vif-plugged", "status": "completed", "tag": "d7dcac03-eee5-498f-bdf2-9f546cfb50bc"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:01.377914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-15e7ec92-fd43-4424-8009-25c44a6337d2 req-cb06a972-ef7a-4a75-900d-686d77c3b86d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:01.378476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-15e7ec92-fd43-4424-8009-25c44a6337d2 req-cb06a972-ef7a-4a75-900d-686d77c3b86d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:01.378914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-15e7ec92-fd43-4424-8009-25c44a6337d2 req-cb06a972-ef7a-4a75-900d-686d77c3b86d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:01.390756 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-15e7ec92-fd43-4424-8009-25c44a6337d2 req-cb06a972-ef7a-4a75-900d-686d77c3b86d service nova] Creating event network-vif-plugged:d7dcac03-eee5-498f-bdf2-9f546cfb50bc for instance 959c7403-84b5-4f11-9117-a86a2d452a44 on n-h2-858384-13 Oct 18 13:59:01.395720 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-15e7ec92-fd43-4424-8009-25c44a6337d2 req-cb06a972-ef7a-4a75-900d-686d77c3b86d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241331 Oct 18 13:59:01.396306 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2980/6162] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:01.411585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4aacc3f3-e618-4cc5-8c5f-1d13dfa5d4f4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:01.412296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4aacc3f3-e618-4cc5-8c5f-1d13dfa5d4f4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:01.420875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aacc3f3-e618-4cc5-8c5f-1d13dfa5d4f4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:01.421495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aacc3f3-e618-4cc5-8c5f-1d13dfa5d4f4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:01.422001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aacc3f3-e618-4cc5-8c5f-1d13dfa5d4f4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:01.422766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aacc3f3-e618-4cc5-8c5f-1d13dfa5d4f4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:01.423455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aacc3f3-e618-4cc5-8c5f-1d13dfa5d4f4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:01.423951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aacc3f3-e618-4cc5-8c5f-1d13dfa5d4f4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:01.566891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4aacc3f3-e618-4cc5-8c5f-1d13dfa5d4f4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:01.576600 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4aacc3f3-e618-4cc5-8c5f-1d13dfa5d4f4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1390 microversion: 2.1 time: 0.168912 Oct 18 13:59:01.577550 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3183/6163] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:01 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:02.597377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:02.598775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:02.604409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-193249ed-66b0-4914-88b9-3e51750ad406 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:02.605110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-193249ed-66b0-4914-88b9-3e51750ad406 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:02.612495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-193249ed-66b0-4914-88b9-3e51750ad406 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:02.612978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-193249ed-66b0-4914-88b9-3e51750ad406 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:02.613869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-193249ed-66b0-4914-88b9-3e51750ad406 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:02.614564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-193249ed-66b0-4914-88b9-3e51750ad406 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:02.615233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-193249ed-66b0-4914-88b9-3e51750ad406 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:02.615783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-193249ed-66b0-4914-88b9-3e51750ad406 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:02.753200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-193249ed-66b0-4914-88b9-3e51750ad406 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:02.762923 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-193249ed-66b0-4914-88b9-3e51750ad406 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1390 microversion: 2.1 time: 0.166593 Oct 18 13:59:02.763545 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2981/6164] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:02 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:03.786153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7294ef62-cece-4418-9c5e-c867ed770649 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:03.786889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7294ef62-cece-4418-9c5e-c867ed770649 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:03.789516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:03.796471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7294ef62-cece-4418-9c5e-c867ed770649 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:03.796973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7294ef62-cece-4418-9c5e-c867ed770649 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:03.797441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7294ef62-cece-4418-9c5e-c867ed770649 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:03.798143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7294ef62-cece-4418-9c5e-c867ed770649 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:03.798794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7294ef62-cece-4418-9c5e-c867ed770649 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:03.799231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7294ef62-cece-4418-9c5e-c867ed770649 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:03.955628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7294ef62-cece-4418-9c5e-c867ed770649 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:03.964781 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7294ef62-cece-4418-9c5e-c867ed770649 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1561 microversion: 2.1 time: 0.182606 Oct 18 13:59:03.965507 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3184/6165] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:03 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:03.989191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e739d901-2d85-47af-9ff3-4a05a1bb53ce tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:03.989919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e739d901-2d85-47af-9ff3-4a05a1bb53ce tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:03.997548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e739d901-2d85-47af-9ff3-4a05a1bb53ce tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:03.998048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e739d901-2d85-47af-9ff3-4a05a1bb53ce tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:03.998482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e739d901-2d85-47af-9ff3-4a05a1bb53ce tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:03.999170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e739d901-2d85-47af-9ff3-4a05a1bb53ce tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:03.999615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e739d901-2d85-47af-9ff3-4a05a1bb53ce tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:04.000039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e739d901-2d85-47af-9ff3-4a05a1bb53ce tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:04.141656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e739d901-2d85-47af-9ff3-4a05a1bb53ce tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:04.150104 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e739d901-2d85-47af-9ff3-4a05a1bb53ce tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1561 microversion: 2.1 time: 0.164791 Oct 18 13:59:04.151200 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2982/6166] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:03 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:06.795835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8ccc13bc-230c-4da6-9c4e-562f5c58b9fe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:06.796454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b4112ace-3074-4d73-811f-004bd6a30b3b req-9955d005-2942-492c-84ae-2fb01bfa585f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959c7403-84b5-4f11-9117-a86a2d452a44", "tag": "d7dcac03-eee5-498f-bdf2-9f546cfb50bc"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:06.798214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8ccc13bc-230c-4da6-9c4e-562f5c58b9fe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:06.806864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b4112ace-3074-4d73-811f-004bd6a30b3b req-9955d005-2942-492c-84ae-2fb01bfa585f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:06.807620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b4112ace-3074-4d73-811f-004bd6a30b3b req-9955d005-2942-492c-84ae-2fb01bfa585f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:06.808249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b4112ace-3074-4d73-811f-004bd6a30b3b req-9955d005-2942-492c-84ae-2fb01bfa585f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:06.809747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ccc13bc-230c-4da6-9c4e-562f5c58b9fe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:06.810244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ccc13bc-230c-4da6-9c4e-562f5c58b9fe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:06.810983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ccc13bc-230c-4da6-9c4e-562f5c58b9fe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:06.811883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ccc13bc-230c-4da6-9c4e-562f5c58b9fe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:06.812803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ccc13bc-230c-4da6-9c4e-562f5c58b9fe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:06.813253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ccc13bc-230c-4da6-9c4e-562f5c58b9fe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:06.824601 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b4112ace-3074-4d73-811f-004bd6a30b3b req-9955d005-2942-492c-84ae-2fb01bfa585f service nova] Creating event network-changed:d7dcac03-eee5-498f-bdf2-9f546cfb50bc for instance 959c7403-84b5-4f11-9117-a86a2d452a44 on n-h2-858384-13 Oct 18 13:59:06.834318 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b4112ace-3074-4d73-811f-004bd6a30b3b req-9955d005-2942-492c-84ae-2fb01bfa585f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042063 Oct 18 13:59:06.834983 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2983/6167] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:59:07.014377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8ccc13bc-230c-4da6-9c4e-562f5c58b9fe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:07.027799 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8ccc13bc-230c-4da6-9c4e-562f5c58b9fe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1561 microversion: 2.1 time: 0.240449 Oct 18 13:59:07.032557 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3185/6168] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:06 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1561 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:11.767759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-70889669", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "db568a41-534e-4079-be82-a8e1d219042c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1137305977", "security_groups": []}, "os:scheduler_hints": {"different_host": ["4bfd8fdb-c939-4f85-837f-0de9341480f3"]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:11.847945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] validate_networks() for [('db568a41-534e-4079-be82-a8e1d219042c', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:59:12.428993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:59:12.429564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:59:12.430131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:59:12.430548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:59:12.430969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:59:12.441879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:12.442371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:12.442813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:12.443548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:12.444006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:12.445001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:12.471763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Getting quotas for project 40ce6582de794908a180829b55ff74bc. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:59:12.478179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Getting quotas for user b12baa4d649044179dc337f8a0f65a27 and project 40ce6582de794908a180829b55ff74bc. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:59:12.493482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:59:12.496030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:59:12.582301 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-13bce099-8ab8-4aaf-ac6d-6ac46fddbd19 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.819572 Oct 18 13:59:12.592891 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2984/6169] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:59:11 2022] POST /compute/v2.1/servers => generated 361 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:59:12.600797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3560804f-5eb2-4354-8874-e3a58ee81383 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:12.601523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3560804f-5eb2-4354-8874-e3a58ee81383 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:12.608226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:12.766928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3560804f-5eb2-4354-8874-e3a58ee81383 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:12.784172 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3560804f-5eb2-4354-8874-e3a58ee81383 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1240 microversion: 2.1 time: 0.189937 Oct 18 13:59:12.785921 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3186/6170] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:12 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1240 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:13.810654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3343f3bd-7eb4-4f3a-94f4-24b4f4e609f7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:13.811895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3343f3bd-7eb4-4f3a-94f4-24b4f4e609f7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:13.819993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3343f3bd-7eb4-4f3a-94f4-24b4f4e609f7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:13.820689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3343f3bd-7eb4-4f3a-94f4-24b4f4e609f7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:13.821128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3343f3bd-7eb4-4f3a-94f4-24b4f4e609f7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:13.822044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3343f3bd-7eb4-4f3a-94f4-24b4f4e609f7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:13.822505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3343f3bd-7eb4-4f3a-94f4-24b4f4e609f7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:13.822937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3343f3bd-7eb4-4f3a-94f4-24b4f4e609f7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:13.897572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3343f3bd-7eb4-4f3a-94f4-24b4f4e609f7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:13.909776 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3343f3bd-7eb4-4f3a-94f4-24b4f4e609f7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1292 microversion: 2.1 time: 0.104136 Oct 18 13:59:13.910382 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2985/6171] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:13 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:14.943677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f3b4002d-f916-4679-b64b-56cf984a0edd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:14.946023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f3b4002d-f916-4679-b64b-56cf984a0edd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:14.955575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3b4002d-f916-4679-b64b-56cf984a0edd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:14.956297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3b4002d-f916-4679-b64b-56cf984a0edd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:14.956948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3b4002d-f916-4679-b64b-56cf984a0edd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:14.958764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3b4002d-f916-4679-b64b-56cf984a0edd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:14.961317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3b4002d-f916-4679-b64b-56cf984a0edd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:14.961774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3b4002d-f916-4679-b64b-56cf984a0edd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:15.079899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f3b4002d-f916-4679-b64b-56cf984a0edd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:15.104899 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f3b4002d-f916-4679-b64b-56cf984a0edd tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1298 microversion: 2.1 time: 0.170430 Oct 18 13:59:15.117448 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3187/6172] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:14 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1298 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:15.719883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-299b2814-fb62-44dd-b6c0-d842b542aca7 req-23740562-ea06-4278-9d07-18f19e5abcf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6", "tag": "03b84e7f-80d6-4f2c-b430-7ef1ef4d7280"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:15.747084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-299b2814-fb62-44dd-b6c0-d842b542aca7 req-23740562-ea06-4278-9d07-18f19e5abcf5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:15.747967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-299b2814-fb62-44dd-b6c0-d842b542aca7 req-23740562-ea06-4278-9d07-18f19e5abcf5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:15.748640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-299b2814-fb62-44dd-b6c0-d842b542aca7 req-23740562-ea06-4278-9d07-18f19e5abcf5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:15.767807 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-299b2814-fb62-44dd-b6c0-d842b542aca7 req-23740562-ea06-4278-9d07-18f19e5abcf5 service nova] Creating event network-changed:03b84e7f-80d6-4f2c-b430-7ef1ef4d7280 for instance ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 on n-h2-858384-13 Oct 18 13:59:15.773973 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-299b2814-fb62-44dd-b6c0-d842b542aca7 req-23740562-ea06-4278-9d07-18f19e5abcf5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059255 Oct 18 13:59:15.775369 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2986/6173] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:16.129540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-795a12ad-0fb1-4e7f-bf01-e9268e50fb0a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:16.130501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-795a12ad-0fb1-4e7f-bf01-e9268e50fb0a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:16.137953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-795a12ad-0fb1-4e7f-bf01-e9268e50fb0a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:16.138575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-795a12ad-0fb1-4e7f-bf01-e9268e50fb0a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:16.139113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-795a12ad-0fb1-4e7f-bf01-e9268e50fb0a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:16.139906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-795a12ad-0fb1-4e7f-bf01-e9268e50fb0a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:16.140709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-795a12ad-0fb1-4e7f-bf01-e9268e50fb0a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:16.141151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-795a12ad-0fb1-4e7f-bf01-e9268e50fb0a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:16.230705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-795a12ad-0fb1-4e7f-bf01-e9268e50fb0a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:16.238668 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-795a12ad-0fb1-4e7f-bf01-e9268e50fb0a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1298 microversion: 2.1 time: 0.113251 Oct 18 13:59:16.239254 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3188/6174] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:16 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:17.264752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-34203cf8-e202-41c7-bb67-14cce119eb4f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:17.265477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-34203cf8-e202-41c7-bb67-14cce119eb4f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:17.272261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34203cf8-e202-41c7-bb67-14cce119eb4f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:17.272735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34203cf8-e202-41c7-bb67-14cce119eb4f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:17.273277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34203cf8-e202-41c7-bb67-14cce119eb4f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:17.273979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34203cf8-e202-41c7-bb67-14cce119eb4f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:17.274425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34203cf8-e202-41c7-bb67-14cce119eb4f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:17.274847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34203cf8-e202-41c7-bb67-14cce119eb4f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:17.787120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-34203cf8-e202-41c7-bb67-14cce119eb4f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:17.803200 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-34203cf8-e202-41c7-bb67-14cce119eb4f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1298 microversion: 2.1 time: 0.537471 Oct 18 13:59:17.819483 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2987/6175] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:17 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1298 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:18.827015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ffe21289-65bd-4edf-bae3-751e1d3f8c69 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:18.827624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ffe21289-65bd-4edf-bae3-751e1d3f8c69 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:18.834515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffe21289-65bd-4edf-bae3-751e1d3f8c69 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:18.834991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffe21289-65bd-4edf-bae3-751e1d3f8c69 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:18.835423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffe21289-65bd-4edf-bae3-751e1d3f8c69 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:18.836102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffe21289-65bd-4edf-bae3-751e1d3f8c69 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:18.836551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffe21289-65bd-4edf-bae3-751e1d3f8c69 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:18.836970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ffe21289-65bd-4edf-bae3-751e1d3f8c69 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:18.918956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ffe21289-65bd-4edf-bae3-751e1d3f8c69 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:18.926984 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ffe21289-65bd-4edf-bae3-751e1d3f8c69 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1298 microversion: 2.1 time: 0.103840 Oct 18 13:59:18.927649 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3189/6176] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:18 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:19.952231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aef2ac8e-d340-4863-b4de-8be3f97fa841 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:19.952970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aef2ac8e-d340-4863-b4de-8be3f97fa841 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:19.960767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aef2ac8e-d340-4863-b4de-8be3f97fa841 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:19.961648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aef2ac8e-d340-4863-b4de-8be3f97fa841 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:19.962349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aef2ac8e-d340-4863-b4de-8be3f97fa841 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:19.963276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aef2ac8e-d340-4863-b4de-8be3f97fa841 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:19.963945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aef2ac8e-d340-4863-b4de-8be3f97fa841 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:19.964582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aef2ac8e-d340-4863-b4de-8be3f97fa841 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:20.055707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aef2ac8e-d340-4863-b4de-8be3f97fa841 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:20.066119 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aef2ac8e-d340-4863-b4de-8be3f97fa841 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1298 microversion: 2.1 time: 0.118378 Oct 18 13:59:20.066935 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2988/6177] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:19 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:21.089262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d16c5ef5-249c-4be3-a77e-2d3d59ff3ddb tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:21.089886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d16c5ef5-249c-4be3-a77e-2d3d59ff3ddb tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:21.097021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d16c5ef5-249c-4be3-a77e-2d3d59ff3ddb tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:21.097702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d16c5ef5-249c-4be3-a77e-2d3d59ff3ddb tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:21.098147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d16c5ef5-249c-4be3-a77e-2d3d59ff3ddb tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:21.099249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d16c5ef5-249c-4be3-a77e-2d3d59ff3ddb tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:21.099360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d16c5ef5-249c-4be3-a77e-2d3d59ff3ddb tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:21.099700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d16c5ef5-249c-4be3-a77e-2d3d59ff3ddb tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:21.195252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d16c5ef5-249c-4be3-a77e-2d3d59ff3ddb tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:21.204612 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d16c5ef5-249c-4be3-a77e-2d3d59ff3ddb tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1298 microversion: 2.1 time: 0.119277 Oct 18 13:59:21.216803 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3190/6178] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:21 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:21.302822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-894fb305-8162-4db6-81f3-98445f715397 req-f2be6348-d140-45b5-bab6-cf0d544853d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6", "name": "network-vif-plugged", "status": "completed", "tag": "03b84e7f-80d6-4f2c-b430-7ef1ef4d7280"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:21.309714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:21.317216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-894fb305-8162-4db6-81f3-98445f715397 req-f2be6348-d140-45b5-bab6-cf0d544853d4 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:21.317773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-894fb305-8162-4db6-81f3-98445f715397 req-f2be6348-d140-45b5-bab6-cf0d544853d4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:21.318264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-894fb305-8162-4db6-81f3-98445f715397 req-f2be6348-d140-45b5-bab6-cf0d544853d4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:21.326085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=65 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:21.336986 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-894fb305-8162-4db6-81f3-98445f715397 req-f2be6348-d140-45b5-bab6-cf0d544853d4 service nova] Creating event network-vif-plugged:03b84e7f-80d6-4f2c-b430-7ef1ef4d7280 for instance ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 on n-h2-858384-13 Oct 18 13:59:21.342558 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-894fb305-8162-4db6-81f3-98445f715397 req-f2be6348-d140-45b5-bab6-cf0d544853d4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044723 Oct 18 13:59:21.343348 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2989/6179] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:22.228792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2bb7118c-ad9d-4556-a29d-810116a49e89 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:22.229371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2bb7118c-ad9d-4556-a29d-810116a49e89 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:22.236486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bb7118c-ad9d-4556-a29d-810116a49e89 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:22.236973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bb7118c-ad9d-4556-a29d-810116a49e89 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:22.237422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bb7118c-ad9d-4556-a29d-810116a49e89 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:22.238111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bb7118c-ad9d-4556-a29d-810116a49e89 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:22.238559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bb7118c-ad9d-4556-a29d-810116a49e89 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:22.238979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bb7118c-ad9d-4556-a29d-810116a49e89 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:22.326063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2bb7118c-ad9d-4556-a29d-810116a49e89 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:22.337711 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2bb7118c-ad9d-4556-a29d-810116a49e89 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1298 microversion: 2.1 time: 0.113470 Oct 18 13:59:22.338324 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3191/6180] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:22 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:23.359150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:23.360002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:23.364890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-034fecf2-ef15-4b84-80c1-96c04da13d81 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:23.365604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-034fecf2-ef15-4b84-80c1-96c04da13d81 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:23.373330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-034fecf2-ef15-4b84-80c1-96c04da13d81 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:23.373808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-034fecf2-ef15-4b84-80c1-96c04da13d81 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:23.374243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-034fecf2-ef15-4b84-80c1-96c04da13d81 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:23.374923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-034fecf2-ef15-4b84-80c1-96c04da13d81 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:23.375372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-034fecf2-ef15-4b84-80c1-96c04da13d81 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:23.375793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-034fecf2-ef15-4b84-80c1-96c04da13d81 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:23.465807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-034fecf2-ef15-4b84-80c1-96c04da13d81 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:23.473931 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-034fecf2-ef15-4b84-80c1-96c04da13d81 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1471 microversion: 2.1 time: 0.116544 Oct 18 13:59:23.474530 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2990/6181] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:23 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1471 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:23.497425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-96c1e804-9638-4596-bc85-5d99484d235d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:23.498030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-96c1e804-9638-4596-bc85-5d99484d235d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:23.499928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:23.506240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96c1e804-9638-4596-bc85-5d99484d235d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:23.507055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96c1e804-9638-4596-bc85-5d99484d235d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:23.507647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96c1e804-9638-4596-bc85-5d99484d235d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:23.508343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96c1e804-9638-4596-bc85-5d99484d235d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:23.508797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96c1e804-9638-4596-bc85-5d99484d235d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:23.509239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-96c1e804-9638-4596-bc85-5d99484d235d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:23.604917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-96c1e804-9638-4596-bc85-5d99484d235d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:23.612811 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-96c1e804-9638-4596-bc85-5d99484d235d tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1471 microversion: 2.1 time: 0.119429 Oct 18 13:59:23.613458 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3192/6182] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:23 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1471 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:59:23.635292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3c8991ab-78cd-4f85-8d7e-bb1b2ad0de99 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:23.635925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3c8991ab-78cd-4f85-8d7e-bb1b2ad0de99 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:23.642202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c8991ab-78cd-4f85-8d7e-bb1b2ad0de99 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:23.642759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c8991ab-78cd-4f85-8d7e-bb1b2ad0de99 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:23.643367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c8991ab-78cd-4f85-8d7e-bb1b2ad0de99 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:23.644125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c8991ab-78cd-4f85-8d7e-bb1b2ad0de99 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:23.644679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c8991ab-78cd-4f85-8d7e-bb1b2ad0de99 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:23.645191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c8991ab-78cd-4f85-8d7e-bb1b2ad0de99 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:23.733381 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3c8991ab-78cd-4f85-8d7e-bb1b2ad0de99 tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1624 microversion: 2.1 time: 0.101906 Oct 18 13:59:23.734071 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2991/6183] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:23 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1624 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:23.756172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4f6a9513-2c7a-4806-8653-3e3e1b28ca3a tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:23.756983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4f6a9513-2c7a-4806-8653-3e3e1b28ca3a tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:23.763360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f6a9513-2c7a-4806-8653-3e3e1b28ca3a tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:23.763832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f6a9513-2c7a-4806-8653-3e3e1b28ca3a tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:23.764270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f6a9513-2c7a-4806-8653-3e3e1b28ca3a tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:23.764972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f6a9513-2c7a-4806-8653-3e3e1b28ca3a tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:23.765453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f6a9513-2c7a-4806-8653-3e3e1b28ca3a tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:23.765883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f6a9513-2c7a-4806-8653-3e3e1b28ca3a tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:23.906339 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4f6a9513-2c7a-4806-8653-3e3e1b28ca3a tempest-TestSecurityGroupsBasicOps-2059127637 tempest-TestSecurityGroupsBasicOps-2059127637-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1913 microversion: 2.1 time: 0.153787 Oct 18 13:59:23.906934 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3193/6184] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:23 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1913 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:23.978281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7f186dd0-9ae0-44e1-a186-59eb980cd8d7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:23.978776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7f186dd0-9ae0-44e1-a186-59eb980cd8d7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:23.984900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f186dd0-9ae0-44e1-a186-59eb980cd8d7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:23.985412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f186dd0-9ae0-44e1-a186-59eb980cd8d7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:23.985841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f186dd0-9ae0-44e1-a186-59eb980cd8d7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:23.986517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f186dd0-9ae0-44e1-a186-59eb980cd8d7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:23.986964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f186dd0-9ae0-44e1-a186-59eb980cd8d7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:23.987384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7f186dd0-9ae0-44e1-a186-59eb980cd8d7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:24.014169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7f186dd0-9ae0-44e1-a186-59eb980cd8d7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:59:24.093310 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7f186dd0-9ae0-44e1-a186-59eb980cd8d7 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 204 len: 0 microversion: 2.1 time: 0.118794 Oct 18 13:59:24.097170 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2992/6185] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:59:23 2022] DELETE /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:59:24.106570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3e4fcbf5-cb28-4146-9822-c012b9e6c749 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:24.107191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3e4fcbf5-cb28-4146-9822-c012b9e6c749 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:24.114113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e4fcbf5-cb28-4146-9822-c012b9e6c749 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:24.114606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e4fcbf5-cb28-4146-9822-c012b9e6c749 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:24.115074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e4fcbf5-cb28-4146-9822-c012b9e6c749 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:24.115773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e4fcbf5-cb28-4146-9822-c012b9e6c749 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:24.116745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e4fcbf5-cb28-4146-9822-c012b9e6c749 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:24.117167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3e4fcbf5-cb28-4146-9822-c012b9e6c749 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:24.119904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=81 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:24.202886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3e4fcbf5-cb28-4146-9822-c012b9e6c749 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:24.211338 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3e4fcbf5-cb28-4146-9822-c012b9e6c749 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1477 microversion: 2.1 time: 0.109064 Oct 18 13:59:24.211942 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3194/6186] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:24 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1477 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:25.236039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-659e4bd1-5d6b-4698-85cf-0f981987b4f8 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:25.236748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-659e4bd1-5d6b-4698-85cf-0f981987b4f8 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:25.244191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-659e4bd1-5d6b-4698-85cf-0f981987b4f8 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:25.244691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-659e4bd1-5d6b-4698-85cf-0f981987b4f8 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:25.245133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-659e4bd1-5d6b-4698-85cf-0f981987b4f8 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:25.245865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-659e4bd1-5d6b-4698-85cf-0f981987b4f8 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:25.246324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-659e4bd1-5d6b-4698-85cf-0f981987b4f8 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:25.246870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-659e4bd1-5d6b-4698-85cf-0f981987b4f8 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:25.342698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-659e4bd1-5d6b-4698-85cf-0f981987b4f8 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:25.350820 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-659e4bd1-5d6b-4698-85cf-0f981987b4f8 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1477 microversion: 2.1 time: 0.119093 Oct 18 13:59:25.351414 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2993/6187] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:25 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1477 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:25.971009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3fd1ab98-389e-4d86-9b7d-e6d6e621e1b3 req-4135dbf6-ac43-4b5e-a05e-130ccc139a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6", "name": "network-vif-deleted", "tag": "03b84e7f-80d6-4f2c-b430-7ef1ef4d7280"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:25.988124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3fd1ab98-389e-4d86-9b7d-e6d6e621e1b3 req-4135dbf6-ac43-4b5e-a05e-130ccc139a22 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:25.989068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3fd1ab98-389e-4d86-9b7d-e6d6e621e1b3 req-4135dbf6-ac43-4b5e-a05e-130ccc139a22 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:25.989551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3fd1ab98-389e-4d86-9b7d-e6d6e621e1b3 req-4135dbf6-ac43-4b5e-a05e-130ccc139a22 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:26.004706 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3fd1ab98-389e-4d86-9b7d-e6d6e621e1b3 req-4135dbf6-ac43-4b5e-a05e-130ccc139a22 service nova] Creating event network-vif-deleted:03b84e7f-80d6-4f2c-b430-7ef1ef4d7280 for instance ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 on n-h2-858384-13 Oct 18 13:59:26.010913 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3fd1ab98-389e-4d86-9b7d-e6d6e621e1b3 req-4135dbf6-ac43-4b5e-a05e-130ccc139a22 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043566 Oct 18 13:59:26.011630 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3195/6188] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:26.375031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:26.375698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:26.383058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:26.383603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:26.384056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:26.384850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:26.385204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:26.385625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:26.422643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:26.423122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:26.423561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:26.424005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lazy-loading 'fault' on Instance uuid ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:59:26.473328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:26.481636 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-abf790c1-e1fd-4f67-9ffd-d8e8dabdc5c0 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 200 len: 1330 microversion: 2.1 time: 0.110452 Oct 18 13:59:26.482147 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2994/6189] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:26 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:27.505863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0368bb49-6dc5-4523-a5b9-8638e4b75f13 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:27.506686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0368bb49-6dc5-4523-a5b9-8638e4b75f13 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:27.515009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0368bb49-6dc5-4523-a5b9-8638e4b75f13 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:27.515559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0368bb49-6dc5-4523-a5b9-8638e4b75f13 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:27.516036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0368bb49-6dc5-4523-a5b9-8638e4b75f13 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:27.516799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0368bb49-6dc5-4523-a5b9-8638e4b75f13 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:27.517323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0368bb49-6dc5-4523-a5b9-8638e4b75f13 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:27.518105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0368bb49-6dc5-4523-a5b9-8638e4b75f13 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:27.534873 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-0368bb49-6dc5-4523-a5b9-8638e4b75f13 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] HTTP exception thrown: Instance ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 could not be found. Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0368bb49-6dc5-4523-a5b9-8638e4b75f13 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Request method failure captured: Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 HTTP/1.1 Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrDAaWxaA-p8jNVabkGZYRH6FiumWKtxlU0lq9OsmVU3n3R4ZilVAN0p950SFtToiZykqUsXkxyIvmCJVaoaz8Z_nJP0wZRwTuNtt-htctnMPak_s56e8tiGgoApeZ2pKPYb3rlgPz14pMzDmHmEBIN2hWlBEKSAOCBKbH7c6jRed4k Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 40ce6582de794908a180829b55ff74bc Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-179478921 Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40ce6582de794908a180829b55ff74bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40ce6582de794908a180829b55ff74bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40ce6582de794908a180829b55ff74bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40ce6582de794908a180829b55ff74bc"}]}] Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestSecurityGroupsBasicOps-179478921 Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 40ce6582de794908a180829b55ff74bc Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-179478921 Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestSecurityGroupsBasicOps-179478921-project Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: b12baa4d649044179dc337f8a0f65a27 Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestSecurityGroupsBasicOps-179478921-project Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 could not be found. Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6'} Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 could not be found. Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 could not be found. Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:59:27.536441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:59:27.546917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:59:27.546917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:59:27.546917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:59:27.546917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:59:27.546917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:59:27.546917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 could not be found. Oct 18 13:59:27.546917 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 13:59:27.546917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0368bb49-6dc5-4523-a5b9-8638e4b75f13 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Returning 404 to user: Instance ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:59:27.546917 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0368bb49-6dc5-4523-a5b9-8638e4b75f13 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6" status: 404 len: 111 microversion: 2.1 time: 0.037728 Oct 18 13:59:27.551067 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3196/6190] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:27 2022] GET /compute/v2.1/servers/ccf0c16e-0cc3-43af-a451-2d6c7e2b59a6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 13:59:28.369978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-63420dcc-0a5e-45c9-8d4e-61f6f2cfa872 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:28.372026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-63420dcc-0a5e-45c9-8d4e-61f6f2cfa872 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:28.379251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63420dcc-0a5e-45c9-8d4e-61f6f2cfa872 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:28.379932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63420dcc-0a5e-45c9-8d4e-61f6f2cfa872 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:28.380377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63420dcc-0a5e-45c9-8d4e-61f6f2cfa872 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:28.381086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63420dcc-0a5e-45c9-8d4e-61f6f2cfa872 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:28.381587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63420dcc-0a5e-45c9-8d4e-61f6f2cfa872 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:28.382621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-63420dcc-0a5e-45c9-8d4e-61f6f2cfa872 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:28.440093 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-63420dcc-0a5e-45c9-8d4e-61f6f2cfa872 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44/action" status: 200 len: 24570 microversion: 2.1 time: 0.074545 Oct 18 13:59:28.447934 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2995/6191] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:59:28 2022] POST /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44/action => generated 24570 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:59:31.994168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b00fea70-015e-40b0-ae1b-1564acc1446f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:31.994696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b00fea70-015e-40b0-ae1b-1564acc1446f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:31.997663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7fabd2d3-6b81-424e-95fc-03d545e70746 req-100eebc1-d321-4516-8f9c-8d9eac6135ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bfd8fdb-c939-4f85-837f-0de9341480f3", "tag": "e960394b-2e00-4357-8cd4-493ff3e4184c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:32.009478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7fabd2d3-6b81-424e-95fc-03d545e70746 req-100eebc1-d321-4516-8f9c-8d9eac6135ec service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:32.010248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7fabd2d3-6b81-424e-95fc-03d545e70746 req-100eebc1-d321-4516-8f9c-8d9eac6135ec service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:32.010817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7fabd2d3-6b81-424e-95fc-03d545e70746 req-100eebc1-d321-4516-8f9c-8d9eac6135ec service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:32.012660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b00fea70-015e-40b0-ae1b-1564acc1446f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:32.013154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b00fea70-015e-40b0-ae1b-1564acc1446f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:32.013618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b00fea70-015e-40b0-ae1b-1564acc1446f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:32.014518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b00fea70-015e-40b0-ae1b-1564acc1446f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:32.014975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b00fea70-015e-40b0-ae1b-1564acc1446f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:32.015562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b00fea70-015e-40b0-ae1b-1564acc1446f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:32.023642 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7fabd2d3-6b81-424e-95fc-03d545e70746 req-100eebc1-d321-4516-8f9c-8d9eac6135ec service nova] Creating event network-changed:e960394b-2e00-4357-8cd4-493ff3e4184c for instance 4bfd8fdb-c939-4f85-837f-0de9341480f3 on n-h1-858384-13 Oct 18 13:59:32.029823 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7fabd2d3-6b81-424e-95fc-03d545e70746 req-100eebc1-d321-4516-8f9c-8d9eac6135ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036139 Oct 18 13:59:32.031209 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2996/6192] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:32.052431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b00fea70-015e-40b0-ae1b-1564acc1446f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 13:59:32.168220 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b00fea70-015e-40b0-ae1b-1564acc1446f tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 204 len: 0 microversion: 2.1 time: 0.177696 Oct 18 13:59:32.170480 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3197/6193] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 13:59:31 2022] DELETE /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:59:32.179293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-819f5763-cbc8-49f4-bf6d-951150d22587 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:32.180039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-819f5763-cbc8-49f4-bf6d-951150d22587 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:32.190706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-819f5763-cbc8-49f4-bf6d-951150d22587 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:32.191239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-819f5763-cbc8-49f4-bf6d-951150d22587 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:32.195310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-819f5763-cbc8-49f4-bf6d-951150d22587 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:32.196510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-819f5763-cbc8-49f4-bf6d-951150d22587 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:32.196980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-819f5763-cbc8-49f4-bf6d-951150d22587 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:32.197686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-819f5763-cbc8-49f4-bf6d-951150d22587 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:32.405946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-819f5763-cbc8-49f4-bf6d-951150d22587 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:32.414740 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-819f5763-cbc8-49f4-bf6d-951150d22587 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1766 microversion: 2.1 time: 0.240524 Oct 18 13:59:32.415344 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2997/6194] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:32 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1766 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:59:33.440246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5e0dcb3b-3659-42fa-b22e-e025858dc581 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:33.441118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e0dcb3b-3659-42fa-b22e-e025858dc581 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:33.456520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e0dcb3b-3659-42fa-b22e-e025858dc581 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:33.457013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e0dcb3b-3659-42fa-b22e-e025858dc581 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:33.460177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e0dcb3b-3659-42fa-b22e-e025858dc581 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:33.461599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e0dcb3b-3659-42fa-b22e-e025858dc581 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:33.462081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e0dcb3b-3659-42fa-b22e-e025858dc581 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:33.463389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e0dcb3b-3659-42fa-b22e-e025858dc581 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:33.680036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5e0dcb3b-3659-42fa-b22e-e025858dc581 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:33.689234 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5e0dcb3b-3659-42fa-b22e-e025858dc581 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1766 microversion: 2.1 time: 0.253692 Oct 18 13:59:33.689816 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3198/6195] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:33 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1766 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:34.553021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e3c232f4-9c1c-4d4f-8007-e77d53ff5380 req-006a4812-c09d-4dce-b6c9-57b0f383396f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bfd8fdb-c939-4f85-837f-0de9341480f3", "name": "network-vif-deleted", "tag": "e960394b-2e00-4357-8cd4-493ff3e4184c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:34.564654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e3c232f4-9c1c-4d4f-8007-e77d53ff5380 req-006a4812-c09d-4dce-b6c9-57b0f383396f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:34.565133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e3c232f4-9c1c-4d4f-8007-e77d53ff5380 req-006a4812-c09d-4dce-b6c9-57b0f383396f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:34.565607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e3c232f4-9c1c-4d4f-8007-e77d53ff5380 req-006a4812-c09d-4dce-b6c9-57b0f383396f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:34.582211 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e3c232f4-9c1c-4d4f-8007-e77d53ff5380 req-006a4812-c09d-4dce-b6c9-57b0f383396f service nova] Creating event network-vif-deleted:e960394b-2e00-4357-8cd4-493ff3e4184c for instance 4bfd8fdb-c939-4f85-837f-0de9341480f3 on n-h1-858384-13 Oct 18 13:59:34.592373 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e3c232f4-9c1c-4d4f-8007-e77d53ff5380 req-006a4812-c09d-4dce-b6c9-57b0f383396f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043322 Oct 18 13:59:34.592993 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2998/6196] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:34.716155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:34.716854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:34.724531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:34.725027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:34.726027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:34.726957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:34.727591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:34.728441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:34.765081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:34.765529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:34.765968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:34.766426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lazy-loading 'fault' on Instance uuid 4bfd8fdb-c939-4f85-837f-0de9341480f3 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 13:59:34.813675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12baa4d649044179dc337f8a0f65a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce6582de794908a180829b55ff74bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:34.821982 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-789d5bb8-58ff-4a05-8e54-4d712d291f7b tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 200 len: 1383 microversion: 2.1 time: 0.111233 Oct 18 13:59:34.822843 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3199/6197] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:34 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 1383 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:34.862589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1ac5222c-ebfe-4e54-8376-d9f53ae30ff1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:34.863404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1ac5222c-ebfe-4e54-8376-d9f53ae30ff1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:34.870752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ac5222c-ebfe-4e54-8376-d9f53ae30ff1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:34.871245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ac5222c-ebfe-4e54-8376-d9f53ae30ff1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:34.871679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ac5222c-ebfe-4e54-8376-d9f53ae30ff1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:34.872379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ac5222c-ebfe-4e54-8376-d9f53ae30ff1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:34.872834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ac5222c-ebfe-4e54-8376-d9f53ae30ff1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:34.873279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1ac5222c-ebfe-4e54-8376-d9f53ae30ff1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:35.145542 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1ac5222c-ebfe-4e54-8376-d9f53ae30ff1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1832 microversion: 2.1 time: 0.287193 Oct 18 13:59:35.146586 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 2999/6198] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:34 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1832 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:35.173455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53a9897f-4799-444a-927c-ee6f862deac4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:35.174574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53a9897f-4799-444a-927c-ee6f862deac4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:35.183820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a9897f-4799-444a-927c-ee6f862deac4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:35.184757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a9897f-4799-444a-927c-ee6f862deac4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:35.185604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a9897f-4799-444a-927c-ee6f862deac4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:35.187302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a9897f-4799-444a-927c-ee6f862deac4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:35.187953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a9897f-4799-444a-927c-ee6f862deac4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:35.189095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53a9897f-4799-444a-927c-ee6f862deac4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:35.340467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-53a9897f-4799-444a-927c-ee6f862deac4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:35.349557 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53a9897f-4799-444a-927c-ee6f862deac4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1679 microversion: 2.1 time: 0.183138 Oct 18 13:59:35.350163 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3200/6199] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:35 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:35.452242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5dae5361-e7e9-4425-8e74-5bb542304cfe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:35.454492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5dae5361-e7e9-4425-8e74-5bb542304cfe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:35.461934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5dae5361-e7e9-4425-8e74-5bb542304cfe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:35.462426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5dae5361-e7e9-4425-8e74-5bb542304cfe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:35.462860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5dae5361-e7e9-4425-8e74-5bb542304cfe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:35.463554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5dae5361-e7e9-4425-8e74-5bb542304cfe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:35.464003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5dae5361-e7e9-4425-8e74-5bb542304cfe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:35.464425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5dae5361-e7e9-4425-8e74-5bb542304cfe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:35.516980 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5dae5361-e7e9-4425-8e74-5bb542304cfe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44/action" status: 200 len: 32638 microversion: 2.1 time: 0.068429 Oct 18 13:59:35.524279 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3000/6200] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:59:35 2022] POST /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44/action => generated 32638 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 13:59:35.773369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-81806b1b-862e-480f-aab0-dc03a6604bce tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:35.773937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-81806b1b-862e-480f-aab0-dc03a6604bce tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:35.781140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81806b1b-862e-480f-aab0-dc03a6604bce tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:35.781670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81806b1b-862e-480f-aab0-dc03a6604bce tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:35.782109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81806b1b-862e-480f-aab0-dc03a6604bce tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:35.782814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81806b1b-862e-480f-aab0-dc03a6604bce tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:35.783269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81806b1b-862e-480f-aab0-dc03a6604bce tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:35.783697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81806b1b-862e-480f-aab0-dc03a6604bce tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:35.825497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-81806b1b-862e-480f-aab0-dc03a6604bce tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1ea14938d7494314bfd22a720de0cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d89ffa02aee43ba868ecb377bd4977e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:35.826120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-81806b1b-862e-480f-aab0-dc03a6604bce tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] flavor_id is None. Assuming migration. {{(pid=120611) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 18 13:59:35.826627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-81806b1b-862e-480f-aab0-dc03a6604bce tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120611) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 13:59:35.848976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2242607-f5bf-4fd0-a575-06379b23978a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:35.849823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d2242607-f5bf-4fd0-a575-06379b23978a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [instance: 4bfd8fdb-c939-4f85-837f-0de9341480f3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:35.860890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2242607-f5bf-4fd0-a575-06379b23978a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:35.862174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2242607-f5bf-4fd0-a575-06379b23978a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:35.862959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2242607-f5bf-4fd0-a575-06379b23978a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:35.863736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2242607-f5bf-4fd0-a575-06379b23978a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:35.864258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2242607-f5bf-4fd0-a575-06379b23978a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:35.864746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d2242607-f5bf-4fd0-a575-06379b23978a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:35.880828 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-d2242607-f5bf-4fd0-a575-06379b23978a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] HTTP exception thrown: Instance 4bfd8fdb-c939-4f85-837f-0de9341480f3 could not be found. Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2242607-f5bf-4fd0-a575-06379b23978a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Request method failure captured: Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 HTTP/1.1 Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrDAaWxaA-p8jNVabkGZYRH6FiumWKtxlU0lq9OsmVU3n3R4ZilVAN0p950SFtToiZykqUsXkxyIvmCJVaoaz8Z_nJP0wZRwTuNtt-htctnMPak_s56e8tiGgoApeZ2pKPYb3rlgPz14pMzDmHmEBIN2hWlBEKSAOCBKbH7c6jRed4k Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 40ce6582de794908a180829b55ff74bc Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-179478921 Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40ce6582de794908a180829b55ff74bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40ce6582de794908a180829b55ff74bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40ce6582de794908a180829b55ff74bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40ce6582de794908a180829b55ff74bc"}]}] Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestSecurityGroupsBasicOps-179478921 Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 40ce6582de794908a180829b55ff74bc Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-179478921 Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestSecurityGroupsBasicOps-179478921-project Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: b12baa4d649044179dc337f8a0f65a27 Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestSecurityGroupsBasicOps-179478921-project Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4bfd8fdb-c939-4f85-837f-0de9341480f3 could not be found. Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '4bfd8fdb-c939-4f85-837f-0de9341480f3'} Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bfd8fdb-c939-4f85-837f-0de9341480f3 could not be found. Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bfd8fdb-c939-4f85-837f-0de9341480f3 could not be found. Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 13:59:35.883085 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:59:35.889158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 13:59:35.889158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 13:59:35.889158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 13:59:35.889158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 13:59:35.889158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 13:59:35.889158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bfd8fdb-c939-4f85-837f-0de9341480f3 could not be found. Oct 18 13:59:35.889158 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 13:59:35.889158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d2242607-f5bf-4fd0-a575-06379b23978a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Returning 404 to user: Instance 4bfd8fdb-c939-4f85-837f-0de9341480f3 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 13:59:35.889158 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d2242607-f5bf-4fd0-a575-06379b23978a tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3" status: 404 len: 111 microversion: 2.1 time: 0.042325 Oct 18 13:59:35.889158 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3001/6201] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:35 2022] GET /compute/v2.1/servers/4bfd8fdb-c939-4f85-837f-0de9341480f3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 13:59:36.020078 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-81806b1b-862e-480f-aab0-dc03a6604bce tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44/action" status: 202 len: 0 microversion: 2.1 time: 0.250452 Oct 18 13:59:36.021091 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3201/6202] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:59:35 2022] POST /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:59:36.029743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2d8be1c9-67fa-4780-a608-918865615059 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:36.030842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2d8be1c9-67fa-4780-a608-918865615059 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:36.060614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d8be1c9-67fa-4780-a608-918865615059 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:36.062853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d8be1c9-67fa-4780-a608-918865615059 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:36.064189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d8be1c9-67fa-4780-a608-918865615059 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:36.066521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d8be1c9-67fa-4780-a608-918865615059 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:36.067003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d8be1c9-67fa-4780-a608-918865615059 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:36.067855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2d8be1c9-67fa-4780-a608-918865615059 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:36.412118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2d8be1c9-67fa-4780-a608-918865615059 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:36.425233 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2d8be1c9-67fa-4780-a608-918865615059 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1688 microversion: 2.1 time: 0.399166 Oct 18 13:59:36.426658 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3002/6203] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:36 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1688 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:37.450627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b0df37c9-6f37-4b4f-9c61-5c5499bd2149 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:37.452073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b0df37c9-6f37-4b4f-9c61-5c5499bd2149 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:37.459391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0df37c9-6f37-4b4f-9c61-5c5499bd2149 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:37.461210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0df37c9-6f37-4b4f-9c61-5c5499bd2149 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:37.462040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0df37c9-6f37-4b4f-9c61-5c5499bd2149 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:37.463055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0df37c9-6f37-4b4f-9c61-5c5499bd2149 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:37.463721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0df37c9-6f37-4b4f-9c61-5c5499bd2149 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:37.464324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0df37c9-6f37-4b4f-9c61-5c5499bd2149 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:37.650578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b0df37c9-6f37-4b4f-9c61-5c5499bd2149 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:37.670587 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b0df37c9-6f37-4b4f-9c61-5c5499bd2149 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1688 microversion: 2.1 time: 0.223825 Oct 18 13:59:37.671546 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3202/6204] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:37 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1688 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:38.696913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-49a9e8d8-f98d-46b8-8a59-a68fd8c6ed0a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:38.698358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-49a9e8d8-f98d-46b8-8a59-a68fd8c6ed0a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:38.705625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49a9e8d8-f98d-46b8-8a59-a68fd8c6ed0a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:38.706370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49a9e8d8-f98d-46b8-8a59-a68fd8c6ed0a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:38.707022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49a9e8d8-f98d-46b8-8a59-a68fd8c6ed0a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:38.707933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49a9e8d8-f98d-46b8-8a59-a68fd8c6ed0a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:38.708613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49a9e8d8-f98d-46b8-8a59-a68fd8c6ed0a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:38.710428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49a9e8d8-f98d-46b8-8a59-a68fd8c6ed0a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:39.032257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-49a9e8d8-f98d-46b8-8a59-a68fd8c6ed0a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:39.045889 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-49a9e8d8-f98d-46b8-8a59-a68fd8c6ed0a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1688 microversion: 2.1 time: 0.353596 Oct 18 13:59:39.047300 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3003/6205] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:38 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1688 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:40.076948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a20dd28-ac8a-488e-bb4e-85aeab444ce7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:40.078311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1a20dd28-ac8a-488e-bb4e-85aeab444ce7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:40.115124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a20dd28-ac8a-488e-bb4e-85aeab444ce7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:40.115938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a20dd28-ac8a-488e-bb4e-85aeab444ce7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:40.117066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a20dd28-ac8a-488e-bb4e-85aeab444ce7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:40.118276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a20dd28-ac8a-488e-bb4e-85aeab444ce7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:40.119973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a20dd28-ac8a-488e-bb4e-85aeab444ce7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:40.120584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a20dd28-ac8a-488e-bb4e-85aeab444ce7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:40.286464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1a20dd28-ac8a-488e-bb4e-85aeab444ce7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:40.295590 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1a20dd28-ac8a-488e-bb4e-85aeab444ce7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1693 microversion: 2.1 time: 0.226009 Oct 18 13:59:40.313207 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3203/6206] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:40 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1693 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:40.534663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e499ed3a-6165-40d8-adcc-b010e2963900 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] Calling method '.version_select at 0x7ff60f89a790>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:40.540577 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e499ed3a-6165-40d8-adcc-b010e2963900 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 13:59:41.323912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0d04e844-034f-45ae-8080-310c859e8192 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:41.324535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0d04e844-034f-45ae-8080-310c859e8192 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:41.331536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d04e844-034f-45ae-8080-310c859e8192 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:41.332025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d04e844-034f-45ae-8080-310c859e8192 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:41.332515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d04e844-034f-45ae-8080-310c859e8192 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:41.333163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d04e844-034f-45ae-8080-310c859e8192 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:41.333817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d04e844-034f-45ae-8080-310c859e8192 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:41.334116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d04e844-034f-45ae-8080-310c859e8192 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:41.473735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0d04e844-034f-45ae-8080-310c859e8192 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:41.481586 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0d04e844-034f-45ae-8080-310c859e8192 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1693 microversion: 2.1 time: 0.162462 Oct 18 13:59:41.482162 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3204/6207] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:41 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:59:41.549682 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [None req-e499ed3a-6165-40d8-adcc-b010e2963900 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 35564. Oct 18 13:59:41.571324 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e499ed3a-6165-40d8-adcc-b010e2963900 tempest-TestSecurityGroupsBasicOps-179478921 tempest-TestSecurityGroupsBasicOps-179478921-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1137305977" status: 202 len: 0 microversion: 2.1 time: 1.040949 Oct 18 13:59:41.571910 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3004/6208] 10.222.0.40 () {58 vars in 1278 bytes} [Tue Oct 18 13:59:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1137305977 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 13:59:42.505782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4010972a-0e69-4e76-8e22-e321e51ca41d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:42.506408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4010972a-0e69-4e76-8e22-e321e51ca41d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:42.514078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4010972a-0e69-4e76-8e22-e321e51ca41d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:42.514577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4010972a-0e69-4e76-8e22-e321e51ca41d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:42.515408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4010972a-0e69-4e76-8e22-e321e51ca41d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:42.516029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4010972a-0e69-4e76-8e22-e321e51ca41d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:42.516494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4010972a-0e69-4e76-8e22-e321e51ca41d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:42.516924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4010972a-0e69-4e76-8e22-e321e51ca41d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:42.689606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4010972a-0e69-4e76-8e22-e321e51ca41d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:42.697654 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4010972a-0e69-4e76-8e22-e321e51ca41d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1693 microversion: 2.1 time: 0.196357 Oct 18 13:59:42.698475 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3205/6209] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:42 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1693 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:59:43.723547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cc7d33f9-9ef8-4492-b7ed-ec700f74a154 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:43.724979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cc7d33f9-9ef8-4492-b7ed-ec700f74a154 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:43.732998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc7d33f9-9ef8-4492-b7ed-ec700f74a154 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:43.733509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc7d33f9-9ef8-4492-b7ed-ec700f74a154 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:43.734132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc7d33f9-9ef8-4492-b7ed-ec700f74a154 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:43.735019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc7d33f9-9ef8-4492-b7ed-ec700f74a154 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:43.735625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc7d33f9-9ef8-4492-b7ed-ec700f74a154 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:43.736224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc7d33f9-9ef8-4492-b7ed-ec700f74a154 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:43.918770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cc7d33f9-9ef8-4492-b7ed-ec700f74a154 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:43.927493 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cc7d33f9-9ef8-4492-b7ed-ec700f74a154 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1693 microversion: 2.1 time: 0.208973 Oct 18 13:59:43.928689 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3005/6210] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:43 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1693 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:44.955708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b0bc3090-018b-4e1b-9eb1-9be73b7638a8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:44.957301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b0bc3090-018b-4e1b-9eb1-9be73b7638a8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:44.960650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:44.967240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0bc3090-018b-4e1b-9eb1-9be73b7638a8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:44.968521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0bc3090-018b-4e1b-9eb1-9be73b7638a8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:44.969265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0bc3090-018b-4e1b-9eb1-9be73b7638a8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:44.970736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0bc3090-018b-4e1b-9eb1-9be73b7638a8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:44.971837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0bc3090-018b-4e1b-9eb1-9be73b7638a8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:44.972488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0bc3090-018b-4e1b-9eb1-9be73b7638a8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:45.202988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b0bc3090-018b-4e1b-9eb1-9be73b7638a8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:45.211695 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b0bc3090-018b-4e1b-9eb1-9be73b7638a8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1693 microversion: 2.1 time: 0.261287 Oct 18 13:59:45.226657 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3206/6211] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:44 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1693 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:46.236681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-672fd637-3c9a-42d8-8b26-872cc3b61f76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:46.237471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-672fd637-3c9a-42d8-8b26-872cc3b61f76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:46.246326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-672fd637-3c9a-42d8-8b26-872cc3b61f76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:46.246957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-672fd637-3c9a-42d8-8b26-872cc3b61f76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:46.247682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-672fd637-3c9a-42d8-8b26-872cc3b61f76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:46.248597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-672fd637-3c9a-42d8-8b26-872cc3b61f76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:46.249402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-672fd637-3c9a-42d8-8b26-872cc3b61f76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:46.253392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-672fd637-3c9a-42d8-8b26-872cc3b61f76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:46.439197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-672fd637-3c9a-42d8-8b26-872cc3b61f76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:46.448536 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-672fd637-3c9a-42d8-8b26-872cc3b61f76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1693 microversion: 2.1 time: 0.215755 Oct 18 13:59:46.449329 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3006/6212] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:46 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1693 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:47.473066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-61c4847b-21e4-4037-a869-23968bb417a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:47.473733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-61c4847b-21e4-4037-a869-23968bb417a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:47.485265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61c4847b-21e4-4037-a869-23968bb417a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:47.486826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61c4847b-21e4-4037-a869-23968bb417a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:47.487429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61c4847b-21e4-4037-a869-23968bb417a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:47.488621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61c4847b-21e4-4037-a869-23968bb417a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:47.489361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61c4847b-21e4-4037-a869-23968bb417a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:47.494512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61c4847b-21e4-4037-a869-23968bb417a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:47.676879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-61c4847b-21e4-4037-a869-23968bb417a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:47.687225 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-61c4847b-21e4-4037-a869-23968bb417a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1693 microversion: 2.1 time: 0.217864 Oct 18 13:59:47.690939 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3207/6213] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:47 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1693 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:48.713203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0f6f63fe-152e-4e60-a709-03d274b20d16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:48.714652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0f6f63fe-152e-4e60-a709-03d274b20d16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:48.723418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f6f63fe-152e-4e60-a709-03d274b20d16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:48.724388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f6f63fe-152e-4e60-a709-03d274b20d16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:48.725130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f6f63fe-152e-4e60-a709-03d274b20d16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:48.726300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f6f63fe-152e-4e60-a709-03d274b20d16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:48.726930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f6f63fe-152e-4e60-a709-03d274b20d16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:48.727531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0f6f63fe-152e-4e60-a709-03d274b20d16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:48.917804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0f6f63fe-152e-4e60-a709-03d274b20d16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:48.929406 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0f6f63fe-152e-4e60-a709-03d274b20d16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1693 microversion: 2.1 time: 0.220849 Oct 18 13:59:48.930096 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3007/6214] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:48 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1693 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:49.956871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eed2f10a-a4df-4b47-b8a4-07583bd966f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:49.958214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eed2f10a-a4df-4b47-b8a4-07583bd966f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:49.968519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed2f10a-a4df-4b47-b8a4-07583bd966f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:49.969027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed2f10a-a4df-4b47-b8a4-07583bd966f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:49.969793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed2f10a-a4df-4b47-b8a4-07583bd966f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:49.970725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed2f10a-a4df-4b47-b8a4-07583bd966f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:49.971384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed2f10a-a4df-4b47-b8a4-07583bd966f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:49.972210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eed2f10a-a4df-4b47-b8a4-07583bd966f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:49.991857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:50.170773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eed2f10a-a4df-4b47-b8a4-07583bd966f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:50.180672 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eed2f10a-a4df-4b47-b8a4-07583bd966f8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1693 microversion: 2.1 time: 0.228256 Oct 18 13:59:50.181731 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3208/6215] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:49 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1693 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:51.206399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4340540-8bd4-49c9-80a4-72b1c5708f6f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:51.207755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e4340540-8bd4-49c9-80a4-72b1c5708f6f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:51.217797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4340540-8bd4-49c9-80a4-72b1c5708f6f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:51.218717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4340540-8bd4-49c9-80a4-72b1c5708f6f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:51.219433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4340540-8bd4-49c9-80a4-72b1c5708f6f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:51.220439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4340540-8bd4-49c9-80a4-72b1c5708f6f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:51.221408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4340540-8bd4-49c9-80a4-72b1c5708f6f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:51.222536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4340540-8bd4-49c9-80a4-72b1c5708f6f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:51.255108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:51.640689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e4340540-8bd4-49c9-80a4-72b1c5708f6f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:51.660702 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e4340540-8bd4-49c9-80a4-72b1c5708f6f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1692 microversion: 2.1 time: 0.459394 Oct 18 13:59:51.680886 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3008/6216] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:51 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1692 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:52.700977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2157e4c7-ddf0-43c0-a150-51fb256643d2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:52.707243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2157e4c7-ddf0-43c0-a150-51fb256643d2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:52.726888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 13:59:52.732935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2157e4c7-ddf0-43c0-a150-51fb256643d2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:52.734849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2157e4c7-ddf0-43c0-a150-51fb256643d2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:52.735810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2157e4c7-ddf0-43c0-a150-51fb256643d2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:52.739118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2157e4c7-ddf0-43c0-a150-51fb256643d2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:52.740446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2157e4c7-ddf0-43c0-a150-51fb256643d2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:52.741190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2157e4c7-ddf0-43c0-a150-51fb256643d2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:52.868547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-6fffab4d-86f3-4563-962d-4d1e24f20d8f req-a421c139-ecb2-42a6-83a7-45590f1a9062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959c7403-84b5-4f11-9117-a86a2d452a44", "name": "network-vif-unplugged", "status": "completed", "tag": "d7dcac03-eee5-498f-bdf2-9f546cfb50bc"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:52.882743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6fffab4d-86f3-4563-962d-4d1e24f20d8f req-a421c139-ecb2-42a6-83a7-45590f1a9062 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:52.884422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6fffab4d-86f3-4563-962d-4d1e24f20d8f req-a421c139-ecb2-42a6-83a7-45590f1a9062 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:52.885449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6fffab4d-86f3-4563-962d-4d1e24f20d8f req-a421c139-ecb2-42a6-83a7-45590f1a9062 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:52.899374 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-6fffab4d-86f3-4563-962d-4d1e24f20d8f req-a421c139-ecb2-42a6-83a7-45590f1a9062 service nova] Creating event network-vif-unplugged:d7dcac03-eee5-498f-bdf2-9f546cfb50bc for instance 959c7403-84b5-4f11-9117-a86a2d452a44 on n-h1-858384-13 Oct 18 13:59:52.908212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [req-6fffab4d-86f3-4563-962d-4d1e24f20d8f req-a421c139-ecb2-42a6-83a7-45590f1a9062 service nova] Instance 959c7403-84b5-4f11-9117-a86a2d452a44 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:59:52.922133 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-6fffab4d-86f3-4563-962d-4d1e24f20d8f req-a421c139-ecb2-42a6-83a7-45590f1a9062 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.419406 Oct 18 13:59:52.923246 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3209/6217] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:53.250706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2157e4c7-ddf0-43c0-a150-51fb256643d2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:53.264903 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2157e4c7-ddf0-43c0-a150-51fb256643d2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1692 microversion: 2.1 time: 0.577356 Oct 18 13:59:53.265584 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3009/6218] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:52 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1692 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:54.299390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d03a2c3b-8867-4e48-b95b-9030ecefc441 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:54.300107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d03a2c3b-8867-4e48-b95b-9030ecefc441 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:54.321492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03a2c3b-8867-4e48-b95b-9030ecefc441 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:54.324772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03a2c3b-8867-4e48-b95b-9030ecefc441 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:54.327335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03a2c3b-8867-4e48-b95b-9030ecefc441 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:54.328324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03a2c3b-8867-4e48-b95b-9030ecefc441 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:54.328810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03a2c3b-8867-4e48-b95b-9030ecefc441 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:54.329288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d03a2c3b-8867-4e48-b95b-9030ecefc441 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:54.966206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7b7a34ce-3bf6-4bf1-8dc6-b8d0ae9a40f9 req-0e713396-ba9a-4dfc-89ff-99a86e3d0a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959c7403-84b5-4f11-9117-a86a2d452a44", "tag": "d7dcac03-eee5-498f-bdf2-9f546cfb50bc"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:54.986910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7b7a34ce-3bf6-4bf1-8dc6-b8d0ae9a40f9 req-0e713396-ba9a-4dfc-89ff-99a86e3d0a7e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:54.987034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7b7a34ce-3bf6-4bf1-8dc6-b8d0ae9a40f9 req-0e713396-ba9a-4dfc-89ff-99a86e3d0a7e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:54.987456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7b7a34ce-3bf6-4bf1-8dc6-b8d0ae9a40f9 req-0e713396-ba9a-4dfc-89ff-99a86e3d0a7e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:55.042402 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7b7a34ce-3bf6-4bf1-8dc6-b8d0ae9a40f9 req-0e713396-ba9a-4dfc-89ff-99a86e3d0a7e service nova] Creating event network-changed:d7dcac03-eee5-498f-bdf2-9f546cfb50bc for instance 959c7403-84b5-4f11-9117-a86a2d452a44 on n-h1-858384-13 Oct 18 13:59:55.051647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-7b7a34ce-3bf6-4bf1-8dc6-b8d0ae9a40f9 req-0e713396-ba9a-4dfc-89ff-99a86e3d0a7e service nova] Instance 959c7403-84b5-4f11-9117-a86a2d452a44 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 13:59:55.077585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d03a2c3b-8867-4e48-b95b-9030ecefc441 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:55.082168 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7b7a34ce-3bf6-4bf1-8dc6-b8d0ae9a40f9 req-0e713396-ba9a-4dfc-89ff-99a86e3d0a7e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119132 Oct 18 13:59:55.083023 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3010/6219] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 13:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 13:59:55.093024 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d03a2c3b-8867-4e48-b95b-9030ecefc441 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1692 microversion: 2.1 time: 0.805716 Oct 18 13:59:55.093675 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3210/6220] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:54 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1692 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:56.124568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-85932609-6bd0-40a1-8b99-66dae4466c64 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:56.125515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-85932609-6bd0-40a1-8b99-66dae4466c64 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:56.149658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85932609-6bd0-40a1-8b99-66dae4466c64 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:56.150492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85932609-6bd0-40a1-8b99-66dae4466c64 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:56.151660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85932609-6bd0-40a1-8b99-66dae4466c64 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:56.152592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85932609-6bd0-40a1-8b99-66dae4466c64 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:56.153236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85932609-6bd0-40a1-8b99-66dae4466c64 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:56.154320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85932609-6bd0-40a1-8b99-66dae4466c64 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:56.496014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-85932609-6bd0-40a1-8b99-66dae4466c64 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:56.518163 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-85932609-6bd0-40a1-8b99-66dae4466c64 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1690 microversion: 2.1 time: 0.399398 Oct 18 13:59:56.533213 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3011/6221] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:56 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1690 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:57.110307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-24f2f467-6f05-46cb-a8da-6df1f228429a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:57.112022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24f2f467-6f05-46cb-a8da-6df1f228429a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:57.112759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24f2f467-6f05-46cb-a8da-6df1f228429a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:57.112979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24f2f467-6f05-46cb-a8da-6df1f228429a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:57.114146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24f2f467-6f05-46cb-a8da-6df1f228429a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:57.114804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24f2f467-6f05-46cb-a8da-6df1f228429a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:57.115285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-24f2f467-6f05-46cb-a8da-6df1f228429a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:57.147368 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-24f2f467-6f05-46cb-a8da-6df1f228429a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.112600 Oct 18 13:59:57.149307 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3211/6222] 10.222.0.40 () {58 vars in 1185 bytes} [Tue Oct 18 13:59:57 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 13:59:57.261625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1210895931", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "availability_zone": "nova:n-h2-858384-13", "networks": [{"uuid": "a6211fb4-71c0-4c04-9798-3413de8c747f"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:57.332970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] validate_networks() for [('a6211fb4-71c0-4c04-9798-3413de8c747f', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 13:59:57.545877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a117dd2d-a3bb-4071-83b2-186a942693e6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:57.546670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a117dd2d-a3bb-4071-83b2-186a942693e6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:57.553007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a117dd2d-a3bb-4071-83b2-186a942693e6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:57.556037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a117dd2d-a3bb-4071-83b2-186a942693e6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:57.556897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a117dd2d-a3bb-4071-83b2-186a942693e6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:57.562591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a117dd2d-a3bb-4071-83b2-186a942693e6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:57.563517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a117dd2d-a3bb-4071-83b2-186a942693e6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:57.564417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a117dd2d-a3bb-4071-83b2-186a942693e6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:57.744544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a117dd2d-a3bb-4071-83b2-186a942693e6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:57.753569 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a117dd2d-a3bb-4071-83b2-186a942693e6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1690 microversion: 2.1 time: 0.211899 Oct 18 13:59:57.754238 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3212/6223] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:57 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1690 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 13:59:57.883880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 13:59:57.884299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 13:59:57.884773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 13:59:57.885206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 13:59:57.885639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 13:59:57.894716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:57.895187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:57.900142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:57.901363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:57.902048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:57.902501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:57.923542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Getting quotas for project a2a154e27fba4da2bb3ba7faedc752ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 13:59:57.929140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Getting quotas for user 31ada4f780954d87b6e6cb16639a3ffb and project a2a154e27fba4da2bb3ba7faedc752ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 13:59:57.943043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 13:59:57.946348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 13:59:57.995478 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e29f5eb3-c4a3-4c9d-bca0-a9c11ea438d6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740128 Oct 18 13:59:57.996312 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3012/6224] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 13:59:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 13:59:58.009882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aecac96f-7bae-474b-aca8-aae5e22fbb4b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:58.010495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aecac96f-7bae-474b-aca8-aae5e22fbb4b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:58.083102 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aecac96f-7bae-474b-aca8-aae5e22fbb4b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1329 microversion: 2.1 time: 0.079723 Oct 18 13:59:58.087307 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3213/6225] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:58 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1329 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:58.783783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-61593ac3-2e48-4f4f-8343-869e4b9fba5f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:58.785590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-61593ac3-2e48-4f4f-8343-869e4b9fba5f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:58.799269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61593ac3-2e48-4f4f-8343-869e4b9fba5f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:58.800689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61593ac3-2e48-4f4f-8343-869e4b9fba5f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:58.801389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61593ac3-2e48-4f4f-8343-869e4b9fba5f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:58.802943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61593ac3-2e48-4f4f-8343-869e4b9fba5f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:58.803546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61593ac3-2e48-4f4f-8343-869e4b9fba5f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:58.804099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61593ac3-2e48-4f4f-8343-869e4b9fba5f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:58.976506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-61593ac3-2e48-4f4f-8343-869e4b9fba5f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:58.986379 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-61593ac3-2e48-4f4f-8343-869e4b9fba5f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1687 microversion: 2.1 time: 0.210104 Oct 18 13:59:58.993290 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3013/6226] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:58 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1687 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:59.022425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a1733a46-48b5-484d-a69c-73b9c6272f41 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 13:59:59.029275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a1733a46-48b5-484d-a69c-73b9c6272f41 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:59.068849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1733a46-48b5-484d-a69c-73b9c6272f41 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:59.070823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1733a46-48b5-484d-a69c-73b9c6272f41 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:59.072003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1733a46-48b5-484d-a69c-73b9c6272f41 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:59.073854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1733a46-48b5-484d-a69c-73b9c6272f41 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:59.075311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1733a46-48b5-484d-a69c-73b9c6272f41 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:59.076460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1733a46-48b5-484d-a69c-73b9c6272f41 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:59.109593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1d9656ce-ab61-4c39-84d2-643eb3905d9f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:59.110214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1d9656ce-ab61-4c39-84d2-643eb3905d9f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:59.119980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9656ce-ab61-4c39-84d2-643eb3905d9f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:59.120486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9656ce-ab61-4c39-84d2-643eb3905d9f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:59.120934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9656ce-ab61-4c39-84d2-643eb3905d9f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:59.124097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9656ce-ab61-4c39-84d2-643eb3905d9f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:59.124575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9656ce-ab61-4c39-84d2-643eb3905d9f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:59.125015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d9656ce-ab61-4c39-84d2-643eb3905d9f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:59.190787 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a1733a46-48b5-484d-a69c-73b9c6272f41 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44/action" status: 204 len: 0 microversion: 2.1 time: 0.183574 Oct 18 13:59:59.191669 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3214/6227] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 13:59:59 2022] POST /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44/action => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 13:59:59.217474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-33229674-7ace-4e49-91cf-b1871cc7570e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 13:59:59.219104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-33229674-7ace-4e49-91cf-b1871cc7570e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 13:59:59.232264 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1d9656ce-ab61-4c39-84d2-643eb3905d9f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1418 microversion: 2.1 time: 0.126837 Oct 18 13:59:59.233496 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3014/6228] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:59 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1418 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 13:59:59.238766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33229674-7ace-4e49-91cf-b1871cc7570e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:59.239444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33229674-7ace-4e49-91cf-b1871cc7570e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:59.239909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33229674-7ace-4e49-91cf-b1871cc7570e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:59.240660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33229674-7ace-4e49-91cf-b1871cc7570e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 13:59:59.245470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33229674-7ace-4e49-91cf-b1871cc7570e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 13:59:59.249461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33229674-7ace-4e49-91cf-b1871cc7570e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 13:59:59.424058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-33229674-7ace-4e49-91cf-b1871cc7570e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 13:59:59.450491 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-33229674-7ace-4e49-91cf-b1871cc7570e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1687 microversion: 2.1 time: 0.253090 Oct 18 13:59:59.455281 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3215/6229] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 13:59:59 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1687 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:00.287440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-370fbf72-dd76-4097-9920-0db47a117e9d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:00.290700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-370fbf72-dd76-4097-9920-0db47a117e9d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:00.318924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-370fbf72-dd76-4097-9920-0db47a117e9d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:00.320453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-370fbf72-dd76-4097-9920-0db47a117e9d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:00.322638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-370fbf72-dd76-4097-9920-0db47a117e9d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:00.324263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-370fbf72-dd76-4097-9920-0db47a117e9d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:00.325898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-370fbf72-dd76-4097-9920-0db47a117e9d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:00.326616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-370fbf72-dd76-4097-9920-0db47a117e9d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:00.480207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0db4a2cc-f998-4924-9749-8f4c03c70df5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:00.481656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0db4a2cc-f998-4924-9749-8f4c03c70df5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:00.489626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0db4a2cc-f998-4924-9749-8f4c03c70df5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:00.490666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0db4a2cc-f998-4924-9749-8f4c03c70df5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:00.491916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0db4a2cc-f998-4924-9749-8f4c03c70df5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:00.492920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0db4a2cc-f998-4924-9749-8f4c03c70df5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:00.493634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0db4a2cc-f998-4924-9749-8f4c03c70df5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:00.494072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0db4a2cc-f998-4924-9749-8f4c03c70df5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:00.521471 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-370fbf72-dd76-4097-9920-0db47a117e9d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1424 microversion: 2.1 time: 0.268115 Oct 18 14:00:00.524436 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3015/6230] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:00 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1424 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:00.722974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0db4a2cc-f998-4924-9749-8f4c03c70df5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:00.733648 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0db4a2cc-f998-4924-9749-8f4c03c70df5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1687 microversion: 2.1 time: 0.258349 Oct 18 14:00:00.735007 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3216/6231] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:00 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1687 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:01.550695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-12cc7e7f-3cf4-4409-a3d4-96207748af4f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:01.551320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-12cc7e7f-3cf4-4409-a3d4-96207748af4f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:01.565395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12cc7e7f-3cf4-4409-a3d4-96207748af4f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:01.567399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12cc7e7f-3cf4-4409-a3d4-96207748af4f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:01.568299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12cc7e7f-3cf4-4409-a3d4-96207748af4f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:01.572834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12cc7e7f-3cf4-4409-a3d4-96207748af4f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:01.579503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12cc7e7f-3cf4-4409-a3d4-96207748af4f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:01.582626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12cc7e7f-3cf4-4409-a3d4-96207748af4f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:01.614679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9f791d80-2a7c-4f21-b502-aeaa0137359b req-a015cdd0-0bec-48b1-a4b2-aae9d15febd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959c7403-84b5-4f11-9117-a86a2d452a44", "name": "network-vif-plugged", "status": "completed", "tag": "d7dcac03-eee5-498f-bdf2-9f546cfb50bc"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:01.650136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9f791d80-2a7c-4f21-b502-aeaa0137359b req-a015cdd0-0bec-48b1-a4b2-aae9d15febd5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:01.653352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9f791d80-2a7c-4f21-b502-aeaa0137359b req-a015cdd0-0bec-48b1-a4b2-aae9d15febd5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:01.654049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9f791d80-2a7c-4f21-b502-aeaa0137359b req-a015cdd0-0bec-48b1-a4b2-aae9d15febd5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:01.682232 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9f791d80-2a7c-4f21-b502-aeaa0137359b req-a015cdd0-0bec-48b1-a4b2-aae9d15febd5 service nova] Creating event network-vif-plugged:d7dcac03-eee5-498f-bdf2-9f546cfb50bc for instance 959c7403-84b5-4f11-9117-a86a2d452a44 on n-h1-858384-13 Oct 18 14:00:01.688201 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9f791d80-2a7c-4f21-b502-aeaa0137359b req-a015cdd0-0bec-48b1-a4b2-aae9d15febd5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077569 Oct 18 14:00:01.689073 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3217/6232] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:01.763088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc4fea4c-ed80-4351-8084-6a1a08df0a36 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:01.764131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bc4fea4c-ed80-4351-8084-6a1a08df0a36 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:01.773336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc4fea4c-ed80-4351-8084-6a1a08df0a36 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:01.774101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc4fea4c-ed80-4351-8084-6a1a08df0a36 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:01.774622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc4fea4c-ed80-4351-8084-6a1a08df0a36 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:01.775790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc4fea4c-ed80-4351-8084-6a1a08df0a36 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:01.777437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc4fea4c-ed80-4351-8084-6a1a08df0a36 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:01.777978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc4fea4c-ed80-4351-8084-6a1a08df0a36 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:01.923775 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-12cc7e7f-3cf4-4409-a3d4-96207748af4f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1466 microversion: 2.1 time: 0.377125 Oct 18 14:00:01.937665 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3016/6233] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:01 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1466 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:01.968321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bc4fea4c-ed80-4351-8084-6a1a08df0a36 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:01.978556 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bc4fea4c-ed80-4351-8084-6a1a08df0a36 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1679 microversion: 2.1 time: 0.221101 Oct 18 14:00:01.979376 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3218/6234] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:01 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:02.081069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b01b6e10-53d6-43ed-aa27-7ce38603f403 req-aaa57703-5276-4d88-8506-16dbd125e511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4676ec9e-9509-4dee-ad75-0598d10a1c72", "tag": "d00e34b3-0d9f-4cae-9d45-1231cb8c3bf1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:02.110993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b01b6e10-53d6-43ed-aa27-7ce38603f403 req-aaa57703-5276-4d88-8506-16dbd125e511 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:02.118231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b01b6e10-53d6-43ed-aa27-7ce38603f403 req-aaa57703-5276-4d88-8506-16dbd125e511 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:02.118762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b01b6e10-53d6-43ed-aa27-7ce38603f403 req-aaa57703-5276-4d88-8506-16dbd125e511 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:02.132050 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b01b6e10-53d6-43ed-aa27-7ce38603f403 req-aaa57703-5276-4d88-8506-16dbd125e511 service nova] Creating event network-changed:d00e34b3-0d9f-4cae-9d45-1231cb8c3bf1 for instance 4676ec9e-9509-4dee-ad75-0598d10a1c72 on n-h2-858384-13 Oct 18 14:00:02.137841 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b01b6e10-53d6-43ed-aa27-7ce38603f403 req-aaa57703-5276-4d88-8506-16dbd125e511 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060243 Oct 18 14:00:02.138371 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3017/6235] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:02.952214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-67f80519-c727-40e2-9b3f-11687c2fe359 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:02.953110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-67f80519-c727-40e2-9b3f-11687c2fe359 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:02.961078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67f80519-c727-40e2-9b3f-11687c2fe359 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:02.961789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67f80519-c727-40e2-9b3f-11687c2fe359 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:02.962292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67f80519-c727-40e2-9b3f-11687c2fe359 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:02.963059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67f80519-c727-40e2-9b3f-11687c2fe359 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:02.963583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67f80519-c727-40e2-9b3f-11687c2fe359 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:02.964073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67f80519-c727-40e2-9b3f-11687c2fe359 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:03.122554 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-67f80519-c727-40e2-9b3f-11687c2fe359 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1466 microversion: 2.1 time: 0.174366 Oct 18 14:00:03.123139 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3219/6236] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:02 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1466 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:04.147227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9c21c997-ecbb-4fe0-be90-44239b8e522f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:04.148814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9c21c997-ecbb-4fe0-be90-44239b8e522f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:04.155422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c21c997-ecbb-4fe0-be90-44239b8e522f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:04.155974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c21c997-ecbb-4fe0-be90-44239b8e522f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:04.156478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c21c997-ecbb-4fe0-be90-44239b8e522f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:04.157273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c21c997-ecbb-4fe0-be90-44239b8e522f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:04.157792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c21c997-ecbb-4fe0-be90-44239b8e522f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:04.158860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c21c997-ecbb-4fe0-be90-44239b8e522f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:04.293950 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9c21c997-ecbb-4fe0-be90-44239b8e522f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1466 microversion: 2.1 time: 0.151600 Oct 18 14:00:04.294554 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3018/6237] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:04 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1466 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:05.317996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e41c8e55-2f0d-4510-a230-62bea704ea05 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:05.319098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e41c8e55-2f0d-4510-a230-62bea704ea05 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:05.326084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41c8e55-2f0d-4510-a230-62bea704ea05 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:05.326714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41c8e55-2f0d-4510-a230-62bea704ea05 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:05.327263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41c8e55-2f0d-4510-a230-62bea704ea05 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:05.328066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41c8e55-2f0d-4510-a230-62bea704ea05 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:05.328628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41c8e55-2f0d-4510-a230-62bea704ea05 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:05.329156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e41c8e55-2f0d-4510-a230-62bea704ea05 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:05.476768 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e41c8e55-2f0d-4510-a230-62bea704ea05 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1466 microversion: 2.1 time: 0.162445 Oct 18 14:00:05.477571 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3220/6238] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:05 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1466 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:06.500450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0b0e6abe-095f-4af6-a727-3687f84e109f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:06.501022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0b0e6abe-095f-4af6-a727-3687f84e109f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:06.508378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b0e6abe-095f-4af6-a727-3687f84e109f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:06.508866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b0e6abe-095f-4af6-a727-3687f84e109f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:06.509341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b0e6abe-095f-4af6-a727-3687f84e109f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:06.510052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b0e6abe-095f-4af6-a727-3687f84e109f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:06.510501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b0e6abe-095f-4af6-a727-3687f84e109f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:06.510922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b0e6abe-095f-4af6-a727-3687f84e109f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:06.664550 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0b0e6abe-095f-4af6-a727-3687f84e109f tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1466 microversion: 2.1 time: 0.168266 Oct 18 14:00:06.665321 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3019/6239] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:06 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1466 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:07.462655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-a18bc8ba-0b2e-4f69-821f-1b83c7fa80bb req-3cf40ab3-cb71-45b3-910b-552ab5c38f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4676ec9e-9509-4dee-ad75-0598d10a1c72", "name": "network-vif-plugged", "status": "completed", "tag": "d00e34b3-0d9f-4cae-9d45-1231cb8c3bf1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:07.468863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:07.475502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a18bc8ba-0b2e-4f69-821f-1b83c7fa80bb req-3cf40ab3-cb71-45b3-910b-552ab5c38f11 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:07.476318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a18bc8ba-0b2e-4f69-821f-1b83c7fa80bb req-3cf40ab3-cb71-45b3-910b-552ab5c38f11 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:07.476877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a18bc8ba-0b2e-4f69-821f-1b83c7fa80bb req-3cf40ab3-cb71-45b3-910b-552ab5c38f11 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:07.492407 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-a18bc8ba-0b2e-4f69-821f-1b83c7fa80bb req-3cf40ab3-cb71-45b3-910b-552ab5c38f11 service nova] Creating event network-vif-plugged:d00e34b3-0d9f-4cae-9d45-1231cb8c3bf1 for instance 4676ec9e-9509-4dee-ad75-0598d10a1c72 on n-h2-858384-13 Oct 18 14:00:07.498085 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-a18bc8ba-0b2e-4f69-821f-1b83c7fa80bb req-3cf40ab3-cb71-45b3-910b-552ab5c38f11 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039419 Oct 18 14:00:07.498640 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3221/6240] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:07.687894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9c2d3e5c-9653-4526-9e07-96c4a208889e tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:07.688636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9c2d3e5c-9653-4526-9e07-96c4a208889e tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:07.697164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c2d3e5c-9653-4526-9e07-96c4a208889e tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:07.697776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c2d3e5c-9653-4526-9e07-96c4a208889e tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:07.698290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c2d3e5c-9653-4526-9e07-96c4a208889e tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:07.699069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c2d3e5c-9653-4526-9e07-96c4a208889e tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:07.699618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c2d3e5c-9653-4526-9e07-96c4a208889e tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:07.700136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c2d3e5c-9653-4526-9e07-96c4a208889e tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:07.847284 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9c2d3e5c-9653-4526-9e07-96c4a208889e tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1466 microversion: 2.1 time: 0.163178 Oct 18 14:00:07.847890 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3020/6241] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:07 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1466 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:08.872465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:08.877163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3cf609c7-2c23-4277-8c4e-1ca1b91978b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:08.877897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3cf609c7-2c23-4277-8c4e-1ca1b91978b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:08.884369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cf609c7-2c23-4277-8c4e-1ca1b91978b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:08.884847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cf609c7-2c23-4277-8c4e-1ca1b91978b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:08.885310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cf609c7-2c23-4277-8c4e-1ca1b91978b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:08.885996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cf609c7-2c23-4277-8c4e-1ca1b91978b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:08.886446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cf609c7-2c23-4277-8c4e-1ca1b91978b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:08.886868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3cf609c7-2c23-4277-8c4e-1ca1b91978b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:09.021701 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3cf609c7-2c23-4277-8c4e-1ca1b91978b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1652 microversion: 2.1 time: 0.149998 Oct 18 14:00:09.023786 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3222/6242] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:08 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1652 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:09.046972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9c134299-9a1e-4da5-a359-753b0aacf0f0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:09.047586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9c134299-9a1e-4da5-a359-753b0aacf0f0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:09.049691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:09.050571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:09.057279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c134299-9a1e-4da5-a359-753b0aacf0f0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:09.057773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c134299-9a1e-4da5-a359-753b0aacf0f0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:09.058206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c134299-9a1e-4da5-a359-753b0aacf0f0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:09.058913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c134299-9a1e-4da5-a359-753b0aacf0f0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:09.059368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c134299-9a1e-4da5-a359-753b0aacf0f0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:09.059783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9c134299-9a1e-4da5-a359-753b0aacf0f0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:09.201570 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9c134299-9a1e-4da5-a359-753b0aacf0f0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1652 microversion: 2.1 time: 0.158122 Oct 18 14:00:09.202248 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3021/6243] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:09 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1652 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:09.223919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb47b6ab-0c60-47d4-a5fe-cc935a81b0e9 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:09.224540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eb47b6ab-0c60-47d4-a5fe-cc935a81b0e9 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:09.230869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb47b6ab-0c60-47d4-a5fe-cc935a81b0e9 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:09.231367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb47b6ab-0c60-47d4-a5fe-cc935a81b0e9 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:09.231804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb47b6ab-0c60-47d4-a5fe-cc935a81b0e9 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:09.232508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb47b6ab-0c60-47d4-a5fe-cc935a81b0e9 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:09.232966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb47b6ab-0c60-47d4-a5fe-cc935a81b0e9 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:09.233455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb47b6ab-0c60-47d4-a5fe-cc935a81b0e9 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:09.366029 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eb47b6ab-0c60-47d4-a5fe-cc935a81b0e9 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1652 microversion: 2.1 time: 0.145806 Oct 18 14:00:09.366847 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3223/6244] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:09 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1652 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:09.431804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1642746746", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "availability_zone": "nova:n-h1-858384-13", "networks": [{"uuid": "a6211fb4-71c0-4c04-9798-3413de8c747f"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:09.632871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] validate_networks() for [('a6211fb4-71c0-4c04-9798-3413de8c747f', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:00:09.893969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:00:09.894459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:00:09.894973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:00:09.895560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:00:09.895904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:00:09.905498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:09.905979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:09.906409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:09.907126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:09.907573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:09.907995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:09.925844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Getting quotas for project a2a154e27fba4da2bb3ba7faedc752ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:00:09.932320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Getting quotas for user 31ada4f780954d87b6e6cb16639a3ffb and project a2a154e27fba4da2bb3ba7faedc752ac. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:00:09.947236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:00:09.949796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:00:09.997587 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f8fd5db6-43d4-45c3-a7ff-89f44d7796b1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569782 Oct 18 14:00:09.998419 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3022/6245] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:00:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:00:10.009524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4eecbb3f-c903-4468-b60b-bbe6fc824ee0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:10.010259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4eecbb3f-c903-4468-b60b-bbe6fc824ee0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:10.091098 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4eecbb3f-c903-4468-b60b-bbe6fc824ee0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1329 microversion: 2.1 time: 0.085650 Oct 18 14:00:10.091836 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3224/6246] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:10 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1329 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:11.118974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-18ed2891-4774-4402-b640-6f8c40cdc68b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:11.120960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-18ed2891-4774-4402-b640-6f8c40cdc68b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:11.128795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18ed2891-4774-4402-b640-6f8c40cdc68b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:11.129319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18ed2891-4774-4402-b640-6f8c40cdc68b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:11.129753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18ed2891-4774-4402-b640-6f8c40cdc68b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:11.130668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18ed2891-4774-4402-b640-6f8c40cdc68b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:11.131126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18ed2891-4774-4402-b640-6f8c40cdc68b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:11.131558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-18ed2891-4774-4402-b640-6f8c40cdc68b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:11.231198 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-18ed2891-4774-4402-b640-6f8c40cdc68b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1418 microversion: 2.1 time: 0.116553 Oct 18 14:00:11.245376 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3023/6247] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:11 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1418 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:12.258402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e90bc01b-97d5-41b4-8950-f26b76220a7d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:12.259023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e90bc01b-97d5-41b4-8950-f26b76220a7d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:12.267494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e90bc01b-97d5-41b4-8950-f26b76220a7d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:12.268367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e90bc01b-97d5-41b4-8950-f26b76220a7d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:12.269013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e90bc01b-97d5-41b4-8950-f26b76220a7d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:12.270419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e90bc01b-97d5-41b4-8950-f26b76220a7d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:12.271249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e90bc01b-97d5-41b4-8950-f26b76220a7d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:12.272182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e90bc01b-97d5-41b4-8950-f26b76220a7d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:12.440294 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e90bc01b-97d5-41b4-8950-f26b76220a7d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1466 microversion: 2.1 time: 0.185770 Oct 18 14:00:12.441302 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3225/6248] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:12 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1466 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:12.703988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-cc8d6263-2522-49aa-accd-08eb3985a9b2 req-734927f2-593d-4d73-a55c-cd206d460296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c90ce83-d228-45dc-94eb-b19bbeb2ae44", "tag": "e8ea39c6-183c-4224-956c-afb5e121fd72"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:12.737072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cc8d6263-2522-49aa-accd-08eb3985a9b2 req-734927f2-593d-4d73-a55c-cd206d460296 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:12.755722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cc8d6263-2522-49aa-accd-08eb3985a9b2 req-734927f2-593d-4d73-a55c-cd206d460296 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:12.756256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cc8d6263-2522-49aa-accd-08eb3985a9b2 req-734927f2-593d-4d73-a55c-cd206d460296 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:12.770587 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-cc8d6263-2522-49aa-accd-08eb3985a9b2 req-734927f2-593d-4d73-a55c-cd206d460296 service nova] Creating event network-changed:e8ea39c6-183c-4224-956c-afb5e121fd72 for instance 8c90ce83-d228-45dc-94eb-b19bbeb2ae44 on n-h1-858384-13 Oct 18 14:00:12.776786 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-cc8d6263-2522-49aa-accd-08eb3985a9b2 req-734927f2-593d-4d73-a55c-cd206d460296 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076788 Oct 18 14:00:12.777447 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3024/6249] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:13.464421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ec29e198-2add-43f0-933f-a92720d299ef tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:13.465053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ec29e198-2add-43f0-933f-a92720d299ef tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:13.473591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec29e198-2add-43f0-933f-a92720d299ef tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:13.474090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec29e198-2add-43f0-933f-a92720d299ef tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:13.474529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec29e198-2add-43f0-933f-a92720d299ef tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:13.475250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec29e198-2add-43f0-933f-a92720d299ef tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:13.476391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec29e198-2add-43f0-933f-a92720d299ef tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:13.476823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec29e198-2add-43f0-933f-a92720d299ef tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:13.612372 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ec29e198-2add-43f0-933f-a92720d299ef tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1466 microversion: 2.1 time: 0.152222 Oct 18 14:00:13.612955 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3226/6250] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:13 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1466 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:14.636383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7f3c3b5-a314-46b3-a9c5-29261fd2d0c1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:14.637781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f7f3c3b5-a314-46b3-a9c5-29261fd2d0c1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:14.645116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7f3c3b5-a314-46b3-a9c5-29261fd2d0c1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:14.645639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7f3c3b5-a314-46b3-a9c5-29261fd2d0c1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:14.646071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7f3c3b5-a314-46b3-a9c5-29261fd2d0c1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:14.646769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7f3c3b5-a314-46b3-a9c5-29261fd2d0c1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:14.647219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7f3c3b5-a314-46b3-a9c5-29261fd2d0c1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:14.647810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7f3c3b5-a314-46b3-a9c5-29261fd2d0c1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:14.784340 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f7f3c3b5-a314-46b3-a9c5-29261fd2d0c1 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1466 microversion: 2.1 time: 0.152445 Oct 18 14:00:14.784924 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3025/6251] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:14 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1466 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:15.808898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8ef46acc-f588-45a3-94f8-7d48472ce2c8 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:15.809566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8ef46acc-f588-45a3-94f8-7d48472ce2c8 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:15.812315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=48 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:15.817746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ef46acc-f588-45a3-94f8-7d48472ce2c8 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:15.818537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ef46acc-f588-45a3-94f8-7d48472ce2c8 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:15.819154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ef46acc-f588-45a3-94f8-7d48472ce2c8 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:15.820239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ef46acc-f588-45a3-94f8-7d48472ce2c8 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:15.820862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ef46acc-f588-45a3-94f8-7d48472ce2c8 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:15.821451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ef46acc-f588-45a3-94f8-7d48472ce2c8 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:15.971985 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8ef46acc-f588-45a3-94f8-7d48472ce2c8 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1466 microversion: 2.1 time: 0.168505 Oct 18 14:00:15.972594 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3227/6252] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:15 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1466 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:16.995906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-029641b3-0b63-4ad5-9136-901b8a7c4871 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:16.996723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-029641b3-0b63-4ad5-9136-901b8a7c4871 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:17.005800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-029641b3-0b63-4ad5-9136-901b8a7c4871 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:17.006635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-029641b3-0b63-4ad5-9136-901b8a7c4871 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:17.007092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-029641b3-0b63-4ad5-9136-901b8a7c4871 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:17.008152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-029641b3-0b63-4ad5-9136-901b8a7c4871 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:17.008628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-029641b3-0b63-4ad5-9136-901b8a7c4871 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:17.009070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-029641b3-0b63-4ad5-9136-901b8a7c4871 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:17.148758 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-029641b3-0b63-4ad5-9136-901b8a7c4871 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1466 microversion: 2.1 time: 0.157029 Oct 18 14:00:17.149467 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3026/6253] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:16 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1466 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:18.172149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2a3c51c2-07cd-4218-8755-7ee57a8ea75b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:18.172886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2a3c51c2-07cd-4218-8755-7ee57a8ea75b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:18.180383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a3c51c2-07cd-4218-8755-7ee57a8ea75b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:18.180864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a3c51c2-07cd-4218-8755-7ee57a8ea75b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:18.181333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a3c51c2-07cd-4218-8755-7ee57a8ea75b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:18.182201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a3c51c2-07cd-4218-8755-7ee57a8ea75b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:18.182659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a3c51c2-07cd-4218-8755-7ee57a8ea75b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:18.183082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a3c51c2-07cd-4218-8755-7ee57a8ea75b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:18.187254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:18.324717 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2a3c51c2-07cd-4218-8755-7ee57a8ea75b tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1466 microversion: 2.1 time: 0.156266 Oct 18 14:00:18.325317 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3228/6254] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:18 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1466 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:19.350292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-677218ac-0e3f-43a0-89a2-08253ad9e3c0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:19.351027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-677218ac-0e3f-43a0-89a2-08253ad9e3c0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:19.358971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-677218ac-0e3f-43a0-89a2-08253ad9e3c0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:19.359450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-677218ac-0e3f-43a0-89a2-08253ad9e3c0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:19.360349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-677218ac-0e3f-43a0-89a2-08253ad9e3c0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:19.360907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-677218ac-0e3f-43a0-89a2-08253ad9e3c0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:19.361386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-677218ac-0e3f-43a0-89a2-08253ad9e3c0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:19.361810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-677218ac-0e3f-43a0-89a2-08253ad9e3c0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:19.450221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f69c22f0-b7d1-4f95-a8cf-3025088d8e41 req-f73258b8-43f7-44fd-aac6-9d5c7c2f38d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c90ce83-d228-45dc-94eb-b19bbeb2ae44", "name": "network-vif-plugged", "status": "completed", "tag": "e8ea39c6-183c-4224-956c-afb5e121fd72"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:19.466673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f69c22f0-b7d1-4f95-a8cf-3025088d8e41 req-f73258b8-43f7-44fd-aac6-9d5c7c2f38d4 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:19.467154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f69c22f0-b7d1-4f95-a8cf-3025088d8e41 req-f73258b8-43f7-44fd-aac6-9d5c7c2f38d4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:19.468141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f69c22f0-b7d1-4f95-a8cf-3025088d8e41 req-f73258b8-43f7-44fd-aac6-9d5c7c2f38d4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:19.520542 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f69c22f0-b7d1-4f95-a8cf-3025088d8e41 req-f73258b8-43f7-44fd-aac6-9d5c7c2f38d4 service nova] Creating event network-vif-plugged:e8ea39c6-183c-4224-956c-afb5e121fd72 for instance 8c90ce83-d228-45dc-94eb-b19bbeb2ae44 on n-h1-858384-13 Oct 18 14:00:19.529009 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f69c22f0-b7d1-4f95-a8cf-3025088d8e41 req-f73258b8-43f7-44fd-aac6-9d5c7c2f38d4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082603 Oct 18 14:00:19.530049 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3229/6255] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:00:19.561409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:19.569404 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-677218ac-0e3f-43a0-89a2-08253ad9e3c0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1466 microversion: 2.1 time: 0.223668 Oct 18 14:00:19.570356 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3027/6256] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:19 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1466 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:20.590597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:20.595800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-778a92e2-25de-4242-b913-ccb4c84b896d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:20.596552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-778a92e2-25de-4242-b913-ccb4c84b896d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:20.604951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-778a92e2-25de-4242-b913-ccb4c84b896d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:20.604951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-778a92e2-25de-4242-b913-ccb4c84b896d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:20.605359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-778a92e2-25de-4242-b913-ccb4c84b896d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:20.606052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-778a92e2-25de-4242-b913-ccb4c84b896d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:20.606518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-778a92e2-25de-4242-b913-ccb4c84b896d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:20.606990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-778a92e2-25de-4242-b913-ccb4c84b896d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:20.758642 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-778a92e2-25de-4242-b913-ccb4c84b896d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1466 microversion: 2.1 time: 0.168926 Oct 18 14:00:20.759248 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3230/6257] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:20 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1466 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:21.782438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-81376b34-7a2b-4190-8363-37f01199ce5a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:21.783288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-81376b34-7a2b-4190-8363-37f01199ce5a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:21.785254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:21.786187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:21.794731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81376b34-7a2b-4190-8363-37f01199ce5a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:21.795325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81376b34-7a2b-4190-8363-37f01199ce5a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:21.795843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81376b34-7a2b-4190-8363-37f01199ce5a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:21.796641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81376b34-7a2b-4190-8363-37f01199ce5a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:21.797375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81376b34-7a2b-4190-8363-37f01199ce5a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:21.797886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81376b34-7a2b-4190-8363-37f01199ce5a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:21.960345 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-81376b34-7a2b-4190-8363-37f01199ce5a tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1652 microversion: 2.1 time: 0.182096 Oct 18 14:00:21.961252 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3028/6258] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:21 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1652 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:21.983323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d2cab8d1-e948-4d33-86f4-425d9b45b94d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:21.984039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d2cab8d1-e948-4d33-86f4-425d9b45b94d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:21.992503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2cab8d1-e948-4d33-86f4-425d9b45b94d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:21.993163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2cab8d1-e948-4d33-86f4-425d9b45b94d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:21.993693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2cab8d1-e948-4d33-86f4-425d9b45b94d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:21.994481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2cab8d1-e948-4d33-86f4-425d9b45b94d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:21.995197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2cab8d1-e948-4d33-86f4-425d9b45b94d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:21.995853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2cab8d1-e948-4d33-86f4-425d9b45b94d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:22.145710 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d2cab8d1-e948-4d33-86f4-425d9b45b94d tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1652 microversion: 2.1 time: 0.166116 Oct 18 14:00:22.146304 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3231/6259] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:21 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1652 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:22.168483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1eadac20-8c81-4f89-bd35-880b842b4e53 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:22.169144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1eadac20-8c81-4f89-bd35-880b842b4e53 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:22.175597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1eadac20-8c81-4f89-bd35-880b842b4e53 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:22.176076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1eadac20-8c81-4f89-bd35-880b842b4e53 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:22.176508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1eadac20-8c81-4f89-bd35-880b842b4e53 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:22.177422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1eadac20-8c81-4f89-bd35-880b842b4e53 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:22.177877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1eadac20-8c81-4f89-bd35-880b842b4e53 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:22.178299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1eadac20-8c81-4f89-bd35-880b842b4e53 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:22.324824 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1eadac20-8c81-4f89-bd35-880b842b4e53 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1652 microversion: 2.1 time: 0.160154 Oct 18 14:00:22.325463 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3029/6260] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:22 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1652 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:22.349095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-03c492e4-a3fd-410d-9649-14eb42372005 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:22.349674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-03c492e4-a3fd-410d-9649-14eb42372005 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:22.357360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03c492e4-a3fd-410d-9649-14eb42372005 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:22.357849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03c492e4-a3fd-410d-9649-14eb42372005 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:22.358293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03c492e4-a3fd-410d-9649-14eb42372005 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:22.359012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03c492e4-a3fd-410d-9649-14eb42372005 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:22.359471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03c492e4-a3fd-410d-9649-14eb42372005 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:22.359929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03c492e4-a3fd-410d-9649-14eb42372005 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:22.388125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-03c492e4-a3fd-410d-9649-14eb42372005 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:00:22.471319 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-03c492e4-a3fd-410d-9649-14eb42372005 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 204 len: 0 microversion: 2.1 time: 0.126154 Oct 18 14:00:22.475080 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3232/6261] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:00:22 2022] DELETE /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:00:22.481433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd388aa7-a043-4e57-9f07-c5a701bce849 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:22.482051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fd388aa7-a043-4e57-9f07-c5a701bce849 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:22.488318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd388aa7-a043-4e57-9f07-c5a701bce849 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:22.488800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd388aa7-a043-4e57-9f07-c5a701bce849 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:22.489275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd388aa7-a043-4e57-9f07-c5a701bce849 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:22.489954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd388aa7-a043-4e57-9f07-c5a701bce849 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:22.490405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd388aa7-a043-4e57-9f07-c5a701bce849 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:22.490831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd388aa7-a043-4e57-9f07-c5a701bce849 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:22.644470 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fd388aa7-a043-4e57-9f07-c5a701bce849 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1658 microversion: 2.1 time: 0.166780 Oct 18 14:00:22.645553 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3030/6262] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:22 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1658 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:23.669247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ef305cd6-8893-411c-9aa2-6208347cf9c6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:23.670071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ef305cd6-8893-411c-9aa2-6208347cf9c6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:23.677264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef305cd6-8893-411c-9aa2-6208347cf9c6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:23.677679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef305cd6-8893-411c-9aa2-6208347cf9c6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:23.678113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef305cd6-8893-411c-9aa2-6208347cf9c6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:23.679575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef305cd6-8893-411c-9aa2-6208347cf9c6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:23.680032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef305cd6-8893-411c-9aa2-6208347cf9c6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:23.680604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ef305cd6-8893-411c-9aa2-6208347cf9c6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:23.817351 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ef305cd6-8893-411c-9aa2-6208347cf9c6 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1658 microversion: 2.1 time: 0.152312 Oct 18 14:00:23.818264 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3233/6263] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:23 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1658 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:24.747416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-f95dde3f-eecf-4e77-9a04-2b42500821ab req-9228fc83-f17e-4913-ac0f-e3e7964d3ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c90ce83-d228-45dc-94eb-b19bbeb2ae44", "name": "network-vif-deleted", "tag": "e8ea39c6-183c-4224-956c-afb5e121fd72"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:24.756086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:24.780994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f95dde3f-eecf-4e77-9a04-2b42500821ab req-9228fc83-f17e-4913-ac0f-e3e7964d3ef5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:24.781767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f95dde3f-eecf-4e77-9a04-2b42500821ab req-9228fc83-f17e-4913-ac0f-e3e7964d3ef5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:24.783828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f95dde3f-eecf-4e77-9a04-2b42500821ab req-9228fc83-f17e-4913-ac0f-e3e7964d3ef5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:24.814793 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f95dde3f-eecf-4e77-9a04-2b42500821ab req-9228fc83-f17e-4913-ac0f-e3e7964d3ef5 service nova] Creating event network-vif-deleted:e8ea39c6-183c-4224-956c-afb5e121fd72 for instance 8c90ce83-d228-45dc-94eb-b19bbeb2ae44 on n-h1-858384-13 Oct 18 14:00:24.824201 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-f95dde3f-eecf-4e77-9a04-2b42500821ab req-9228fc83-f17e-4913-ac0f-e3e7964d3ef5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081050 Oct 18 14:00:24.824880 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3031/6264] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:24.840697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-16d28446-2048-4f8b-af61-062adc8913a0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:24.842053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-16d28446-2048-4f8b-af61-062adc8913a0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:24.851189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16d28446-2048-4f8b-af61-062adc8913a0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:24.852088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16d28446-2048-4f8b-af61-062adc8913a0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:24.852935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16d28446-2048-4f8b-af61-062adc8913a0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:24.854227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16d28446-2048-4f8b-af61-062adc8913a0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:24.854964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16d28446-2048-4f8b-af61-062adc8913a0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:24.855822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16d28446-2048-4f8b-af61-062adc8913a0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:24.943028 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-16d28446-2048-4f8b-af61-062adc8913a0 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 200 len: 1451 microversion: 2.1 time: 0.106735 Oct 18 14:00:24.945113 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3234/6265] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:24 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 1451 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:25.969152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c578305a-0d99-4901-9d4a-a69040755a39 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:25.969843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c578305a-0d99-4901-9d4a-a69040755a39 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 8c90ce83-d228-45dc-94eb-b19bbeb2ae44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:25.976337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c578305a-0d99-4901-9d4a-a69040755a39 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:25.976824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c578305a-0d99-4901-9d4a-a69040755a39 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:25.977291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c578305a-0d99-4901-9d4a-a69040755a39 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:25.977994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c578305a-0d99-4901-9d4a-a69040755a39 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:25.978452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c578305a-0d99-4901-9d4a-a69040755a39 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:25.978881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c578305a-0d99-4901-9d4a-a69040755a39 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:25.993328 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-c578305a-0d99-4901-9d4a-a69040755a39 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] HTTP exception thrown: Instance 8c90ce83-d228-45dc-94eb-b19bbeb2ae44 could not be found. Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c578305a-0d99-4901-9d4a-a69040755a39 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Request method failure captured: Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 HTTP/1.1 Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrFcx7354arQxo3pCcjVa-11b7C_L39VfkusePCOciCoizX8kvaN0dLS5YWlpw4SAsaxldFCwq0Bm4CTSZxk27N2HPeehzIHQCK72HxX8KAC1aCWhgQKtcN7fnEGUO8g-0XcOe3MKesTtKeVfR3DUP-k4KAvAR9lF2PAeyukjZ2jcqI Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a2a154e27fba4da2bb3ba7faedc752ac Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestServerMultinode-2034961747 Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2a154e27fba4da2bb3ba7faedc752ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2a154e27fba4da2bb3ba7faedc752ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2a154e27fba4da2bb3ba7faedc752ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2a154e27fba4da2bb3ba7faedc752ac"}]}] Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestServerMultinode-2034961747 Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a2a154e27fba4da2bb3ba7faedc752ac Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestServerMultinode-2034961747 Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestServerMultinode-2034961747-project-admin Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 31ada4f780954d87b6e6cb16639a3ffb Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestServerMultinode-2034961747-project-admin Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 8c90ce83-d228-45dc-94eb-b19bbeb2ae44 could not be found. Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '8c90ce83-d228-45dc-94eb-b19bbeb2ae44'} Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c90ce83-d228-45dc-94eb-b19bbeb2ae44 could not be found. Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c90ce83-d228-45dc-94eb-b19bbeb2ae44 could not be found. Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:00:25.994998 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:00:26.000761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:00:26.000761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:00:26.000761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:00:26.000761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:00:26.000761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:00:26.000761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c90ce83-d228-45dc-94eb-b19bbeb2ae44 could not be found. Oct 18 14:00:26.000761 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:00:26.000761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c578305a-0d99-4901-9d4a-a69040755a39 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Returning 404 to user: Instance 8c90ce83-d228-45dc-94eb-b19bbeb2ae44 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:00:26.000761 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c578305a-0d99-4901-9d4a-a69040755a39 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44" status: 404 len: 111 microversion: 2.1 time: 0.032390 Oct 18 14:00:26.000761 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3032/6266] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:25 2022] GET /compute/v2.1/servers/8c90ce83-d228-45dc-94eb-b19bbeb2ae44 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:00:26.005218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e99985f-82ea-40c5-b4e4-609043385c25 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:26.005727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7e99985f-82ea-40c5-b4e4-609043385c25 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:26.013089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e99985f-82ea-40c5-b4e4-609043385c25 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:26.013613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e99985f-82ea-40c5-b4e4-609043385c25 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:26.014056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e99985f-82ea-40c5-b4e4-609043385c25 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:26.014761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e99985f-82ea-40c5-b4e4-609043385c25 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:26.015223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e99985f-82ea-40c5-b4e4-609043385c25 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:26.015650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e99985f-82ea-40c5-b4e4-609043385c25 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:26.044861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7e99985f-82ea-40c5-b4e4-609043385c25 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:00:26.138435 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7e99985f-82ea-40c5-b4e4-609043385c25 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 204 len: 0 microversion: 2.1 time: 0.136616 Oct 18 14:00:26.141270 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3235/6267] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:00:26 2022] DELETE /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:00:26.148406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-465bd78c-d6dc-444a-b3a2-fbb820348ff5 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:26.149360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-465bd78c-d6dc-444a-b3a2-fbb820348ff5 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:26.155703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-465bd78c-d6dc-444a-b3a2-fbb820348ff5 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:26.156185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-465bd78c-d6dc-444a-b3a2-fbb820348ff5 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:26.156853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-465bd78c-d6dc-444a-b3a2-fbb820348ff5 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:26.157713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-465bd78c-d6dc-444a-b3a2-fbb820348ff5 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:26.158251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-465bd78c-d6dc-444a-b3a2-fbb820348ff5 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:26.158742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-465bd78c-d6dc-444a-b3a2-fbb820348ff5 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:26.302147 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-465bd78c-d6dc-444a-b3a2-fbb820348ff5 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1658 microversion: 2.1 time: 0.157706 Oct 18 14:00:26.302746 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3033/6268] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:26 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1658 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:27.327041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4725282a-0b29-4e43-9d3c-01bf8e51dc03 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:27.327753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4725282a-0b29-4e43-9d3c-01bf8e51dc03 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:27.334826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4725282a-0b29-4e43-9d3c-01bf8e51dc03 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:27.336436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4725282a-0b29-4e43-9d3c-01bf8e51dc03 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:27.336883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4725282a-0b29-4e43-9d3c-01bf8e51dc03 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:27.337618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4725282a-0b29-4e43-9d3c-01bf8e51dc03 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:27.338080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4725282a-0b29-4e43-9d3c-01bf8e51dc03 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:27.338505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4725282a-0b29-4e43-9d3c-01bf8e51dc03 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:27.491879 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4725282a-0b29-4e43-9d3c-01bf8e51dc03 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1658 microversion: 2.1 time: 0.168835 Oct 18 14:00:27.492794 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3236/6269] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:27 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1658 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:27.901740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f08b210c-c6c3-4c85-9a39-e5512833ef7f tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Action: 'create', calling method: .version_select at 0x7ff60f727c10>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2058565145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+ZsERYOs83iUUKbodq84buNFVZlVnmjzZhnQSlSbwM8aHq23vX3VgLfRbGNM/Rp/gjYEyXkd7ltPLwJRXVdDKu3NN3BNEYfJXxG2w8X6ekyPDh0C3vQKHND+XpQXqyUg=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:27.921620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-f08b210c-c6c3-4c85-9a39-e5512833ef7f tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Getting quotas for project 0c17a79a36964518b5004272fc84fa57. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:00:27.931105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-f08b210c-c6c3-4c85-9a39-e5512833ef7f tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Getting quotas for user c4667690f67b4436b32931d9fd3b59c5 and project 0c17a79a36964518b5004272fc84fa57. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:00:27.958047 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f08b210c-c6c3-4c85-9a39-e5512833ef7f tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062684 Oct 18 14:00:27.958671 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3034/6270] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:00:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:28.359055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-fdb91fa7-d011-4566-ad21-c4fa185c4f70 req-a464100e-788b-4d9e-857d-bb8d15bf0c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4676ec9e-9509-4dee-ad75-0598d10a1c72", "name": "network-vif-deleted", "tag": "d00e34b3-0d9f-4cae-9d45-1231cb8c3bf1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:28.375698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fdb91fa7-d011-4566-ad21-c4fa185c4f70 req-a464100e-788b-4d9e-857d-bb8d15bf0c60 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:28.376321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fdb91fa7-d011-4566-ad21-c4fa185c4f70 req-a464100e-788b-4d9e-857d-bb8d15bf0c60 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:28.376877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fdb91fa7-d011-4566-ad21-c4fa185c4f70 req-a464100e-788b-4d9e-857d-bb8d15bf0c60 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:28.390973 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-fdb91fa7-d011-4566-ad21-c4fa185c4f70 req-a464100e-788b-4d9e-857d-bb8d15bf0c60 service nova] Creating event network-vif-deleted:d00e34b3-0d9f-4cae-9d45-1231cb8c3bf1 for instance 4676ec9e-9509-4dee-ad75-0598d10a1c72 on n-h2-858384-13 Oct 18 14:00:28.397005 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-fdb91fa7-d011-4566-ad21-c4fa185c4f70 req-a464100e-788b-4d9e-857d-bb8d15bf0c60 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044028 Oct 18 14:00:28.399195 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3237/6271] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:00:28.518764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1279aa2d-c529-41d6-bb80-4531ccea44e3 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:28.519398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1279aa2d-c529-41d6-bb80-4531ccea44e3 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:28.529809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1279aa2d-c529-41d6-bb80-4531ccea44e3 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:28.530673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1279aa2d-c529-41d6-bb80-4531ccea44e3 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:28.531348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1279aa2d-c529-41d6-bb80-4531ccea44e3 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:28.533093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1279aa2d-c529-41d6-bb80-4531ccea44e3 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:28.533794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1279aa2d-c529-41d6-bb80-4531ccea44e3 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:28.535591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1279aa2d-c529-41d6-bb80-4531ccea44e3 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:28.585945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1279aa2d-c529-41d6-bb80-4531ccea44e3 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:28.586748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1279aa2d-c529-41d6-bb80-4531ccea44e3 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:28.587259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1279aa2d-c529-41d6-bb80-4531ccea44e3 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:28.587836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-1279aa2d-c529-41d6-bb80-4531ccea44e3 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lazy-loading 'fault' on Instance uuid 4676ec9e-9509-4dee-ad75-0598d10a1c72 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:00:28.664338 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1279aa2d-c529-41d6-bb80-4531ccea44e3 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 200 len: 1456 microversion: 2.1 time: 0.149645 Oct 18 14:00:28.664958 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3035/6272] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:28 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 1456 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:29.341362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-97214362", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a776c593-a5d3-4710-b0a8-c3252cf8f72c", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2058565145", "security_groups": [{"name": "tempest-secgroup-smoke-1586230929"}], "networks": [{"uuid": "b8fe646d-873f-49f4-bc5f-b36919da14af"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:29.459420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] validate_networks() for [('b8fe646d-873f-49f4-bc5f-b36919da14af', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:00:29.687963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b91a13fe-5462-4473-a2b6-96dfb7414165 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:29.688583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b91a13fe-5462-4473-a2b6-96dfb7414165 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] [instance: 4676ec9e-9509-4dee-ad75-0598d10a1c72] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:29.695930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b91a13fe-5462-4473-a2b6-96dfb7414165 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:29.696420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b91a13fe-5462-4473-a2b6-96dfb7414165 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:29.696858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b91a13fe-5462-4473-a2b6-96dfb7414165 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:29.697661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b91a13fe-5462-4473-a2b6-96dfb7414165 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:29.698120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b91a13fe-5462-4473-a2b6-96dfb7414165 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:29.698554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b91a13fe-5462-4473-a2b6-96dfb7414165 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:29.713354 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-b91a13fe-5462-4473-a2b6-96dfb7414165 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] HTTP exception thrown: Instance 4676ec9e-9509-4dee-ad75-0598d10a1c72 could not be found. Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b91a13fe-5462-4473-a2b6-96dfb7414165 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Request method failure captured: Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 HTTP/1.1 Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrFcx7354arQxo3pCcjVa-11b7C_L39VfkusePCOciCoizX8kvaN0dLS5YWlpw4SAsaxldFCwq0Bm4CTSZxk27N2HPeehzIHQCK72HxX8KAC1aCWhgQKtcN7fnEGUO8g-0XcOe3MKesTtKeVfR3DUP-k4KAvAR9lF2PAeyukjZ2jcqI Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a2a154e27fba4da2bb3ba7faedc752ac Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestServerMultinode-2034961747 Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2a154e27fba4da2bb3ba7faedc752ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a2a154e27fba4da2bb3ba7faedc752ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a2a154e27fba4da2bb3ba7faedc752ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a2a154e27fba4da2bb3ba7faedc752ac"}]}] Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestServerMultinode-2034961747 Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a2a154e27fba4da2bb3ba7faedc752ac Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestServerMultinode-2034961747 Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestServerMultinode-2034961747-project-admin Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 31ada4f780954d87b6e6cb16639a3ffb Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestServerMultinode-2034961747-project-admin Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4676ec9e-9509-4dee-ad75-0598d10a1c72 could not be found. Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '4676ec9e-9509-4dee-ad75-0598d10a1c72'} Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4676ec9e-9509-4dee-ad75-0598d10a1c72 could not be found. Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4676ec9e-9509-4dee-ad75-0598d10a1c72 could not be found. Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:00:29.714934 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:00:29.721301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:00:29.721301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:00:29.721301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:00:29.721301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:00:29.721301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:00:29.721301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4676ec9e-9509-4dee-ad75-0598d10a1c72 could not be found. Oct 18 14:00:29.721301 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:00:29.721301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b91a13fe-5462-4473-a2b6-96dfb7414165 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] Returning 404 to user: Instance 4676ec9e-9509-4dee-ad75-0598d10a1c72 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:00:29.721301 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b91a13fe-5462-4473-a2b6-96dfb7414165 tempest-TestServerMultinode-2034961747 tempest-TestServerMultinode-2034961747-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72" status: 404 len: 111 microversion: 2.1 time: 0.032318 Oct 18 14:00:29.721301 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3036/6273] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:29 2022] GET /compute/v2.1/servers/4676ec9e-9509-4dee-ad75-0598d10a1c72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:00:29.861489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:00:29.862043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:00:29.862592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:00:29.863074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:00:29.863555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:00:29.873776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:29.874342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:29.874865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:29.875658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:29.876177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:29.876601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:29.894246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Getting quotas for project 0c17a79a36964518b5004272fc84fa57. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:00:29.900394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Getting quotas for user c4667690f67b4436b32931d9fd3b59c5 and project 0c17a79a36964518b5004272fc84fa57. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:00:29.963627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:00:29.966321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a776c593-a5d3-4710-b0a8-c3252cf8f72c',volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:00:30.130613 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fa2b50bc-93c7-41a8-a6f4-187d493af6fb tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.793534 Oct 18 14:00:30.139457 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3238/6274] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:00:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:00:30.144257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-18db50e7-3034-4120-8471-a7760ff3d9da tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:30.144908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-18db50e7-3034-4120-8471-a7760ff3d9da tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:30.220106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-18db50e7-3034-4120-8471-a7760ff3d9da tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:30.229955 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-18db50e7-3034-4120-8471-a7760ff3d9da tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1097 microversion: 2.1 time: 0.089825 Oct 18 14:00:30.230867 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3037/6275] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:30 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1097 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:31.255577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-78ca532c-6a5e-48fe-9cfc-caf8be03e427 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:31.256502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-78ca532c-6a5e-48fe-9cfc-caf8be03e427 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:31.266571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78ca532c-6a5e-48fe-9cfc-caf8be03e427 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:31.267341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78ca532c-6a5e-48fe-9cfc-caf8be03e427 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:31.268097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78ca532c-6a5e-48fe-9cfc-caf8be03e427 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:31.269094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78ca532c-6a5e-48fe-9cfc-caf8be03e427 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:31.269773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78ca532c-6a5e-48fe-9cfc-caf8be03e427 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:31.270366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78ca532c-6a5e-48fe-9cfc-caf8be03e427 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:31.378199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-78ca532c-6a5e-48fe-9cfc-caf8be03e427 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:31.388969 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-78ca532c-6a5e-48fe-9cfc-caf8be03e427 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1203 microversion: 2.1 time: 0.137865 Oct 18 14:00:31.390769 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3239/6276] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:31 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1203 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:32.284268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bd675336-26c4-4bbc-a679-6fa9be5ce04b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:32.287678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bd675336-26c4-4bbc-a679-6fa9be5ce04b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:32.302406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd675336-26c4-4bbc-a679-6fa9be5ce04b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:32.303315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd675336-26c4-4bbc-a679-6fa9be5ce04b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:32.304601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd675336-26c4-4bbc-a679-6fa9be5ce04b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:32.305656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd675336-26c4-4bbc-a679-6fa9be5ce04b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:32.306846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd675336-26c4-4bbc-a679-6fa9be5ce04b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:32.309336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd675336-26c4-4bbc-a679-6fa9be5ce04b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:32.400852 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bd675336-26c4-4bbc-a679-6fa9be5ce04b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44/action" status: 200 len: 24571 microversion: 2.1 time: 0.120335 Oct 18 14:00:32.402209 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3038/6277] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:00:32 2022] POST /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44/action => generated 24571 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:00:32.416381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cd1ead33-2d18-4ad5-b352-d12a8ddaf2db tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:32.417047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cd1ead33-2d18-4ad5-b352-d12a8ddaf2db tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:32.430827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd1ead33-2d18-4ad5-b352-d12a8ddaf2db tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:32.432503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd1ead33-2d18-4ad5-b352-d12a8ddaf2db tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:32.433047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd1ead33-2d18-4ad5-b352-d12a8ddaf2db tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:32.434636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd1ead33-2d18-4ad5-b352-d12a8ddaf2db tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:32.435330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd1ead33-2d18-4ad5-b352-d12a8ddaf2db tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:32.436445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd1ead33-2d18-4ad5-b352-d12a8ddaf2db tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:32.511861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cd1ead33-2d18-4ad5-b352-d12a8ddaf2db tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:32.521708 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cd1ead33-2d18-4ad5-b352-d12a8ddaf2db tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1213 microversion: 2.1 time: 0.108807 Oct 18 14:00:32.522802 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3240/6278] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:32 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:33.547383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a9f7815-e09d-4804-9c13-275bfbeafa38 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:33.549100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4a9f7815-e09d-4804-9c13-275bfbeafa38 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:33.557951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a9f7815-e09d-4804-9c13-275bfbeafa38 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:33.558956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a9f7815-e09d-4804-9c13-275bfbeafa38 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:33.559568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a9f7815-e09d-4804-9c13-275bfbeafa38 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:33.561115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a9f7815-e09d-4804-9c13-275bfbeafa38 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:33.561984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a9f7815-e09d-4804-9c13-275bfbeafa38 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:33.562588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a9f7815-e09d-4804-9c13-275bfbeafa38 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:33.874604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a9f7815-e09d-4804-9c13-275bfbeafa38 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:33.894108 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4a9f7815-e09d-4804-9c13-275bfbeafa38 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1281 microversion: 2.1 time: 0.351713 Oct 18 14:00:33.895495 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3039/6279] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:33 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1281 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:34.364166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-52883425-2cc1-44e8-a50a-3eccc49a66ff req-ceb3fb59-a1a6-4c0f-9b69-f4d23931b07e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2feae907-8cb2-4716-81b6-05797d06a420", "tag": "5c895f73-52cc-4d6d-a316-ac5041ceedac"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:34.391953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-52883425-2cc1-44e8-a50a-3eccc49a66ff req-ceb3fb59-a1a6-4c0f-9b69-f4d23931b07e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:34.392659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-52883425-2cc1-44e8-a50a-3eccc49a66ff req-ceb3fb59-a1a6-4c0f-9b69-f4d23931b07e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:34.398255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-52883425-2cc1-44e8-a50a-3eccc49a66ff req-ceb3fb59-a1a6-4c0f-9b69-f4d23931b07e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:34.419552 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-52883425-2cc1-44e8-a50a-3eccc49a66ff req-ceb3fb59-a1a6-4c0f-9b69-f4d23931b07e service nova] Creating event network-changed:5c895f73-52cc-4d6d-a316-ac5041ceedac for instance 2feae907-8cb2-4716-81b6-05797d06a420 on n-h2-858384-13 Oct 18 14:00:34.427287 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-52883425-2cc1-44e8-a50a-3eccc49a66ff req-ceb3fb59-a1a6-4c0f-9b69-f4d23931b07e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067306 Oct 18 14:00:34.428486 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3241/6280] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:34.921926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7d61c159-e942-4c21-b6eb-ba915aa90011 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:34.922905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7d61c159-e942-4c21-b6eb-ba915aa90011 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:34.932856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d61c159-e942-4c21-b6eb-ba915aa90011 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:34.934720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d61c159-e942-4c21-b6eb-ba915aa90011 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:34.935440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d61c159-e942-4c21-b6eb-ba915aa90011 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:34.936601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d61c159-e942-4c21-b6eb-ba915aa90011 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:34.941547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d61c159-e942-4c21-b6eb-ba915aa90011 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:34.942354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d61c159-e942-4c21-b6eb-ba915aa90011 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:35.277639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7d61c159-e942-4c21-b6eb-ba915aa90011 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:35.294106 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7d61c159-e942-4c21-b6eb-ba915aa90011 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1281 microversion: 2.1 time: 0.375930 Oct 18 14:00:35.294973 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3040/6281] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:34 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1281 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:36.325274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04c85d55-2b46-4a7f-aeb8-120e9102112b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:36.326821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04c85d55-2b46-4a7f-aeb8-120e9102112b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:36.338434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04c85d55-2b46-4a7f-aeb8-120e9102112b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:36.339269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04c85d55-2b46-4a7f-aeb8-120e9102112b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:36.339913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04c85d55-2b46-4a7f-aeb8-120e9102112b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:36.340918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04c85d55-2b46-4a7f-aeb8-120e9102112b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:36.341715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04c85d55-2b46-4a7f-aeb8-120e9102112b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:36.342351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04c85d55-2b46-4a7f-aeb8-120e9102112b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:36.861588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04c85d55-2b46-4a7f-aeb8-120e9102112b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:36.872102 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04c85d55-2b46-4a7f-aeb8-120e9102112b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1281 microversion: 2.1 time: 0.555212 Oct 18 14:00:36.875238 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3242/6282] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:36 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1281 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:37.901433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3449bd51-398d-4563-949e-3bc7b813baff tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:37.902057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3449bd51-398d-4563-949e-3bc7b813baff tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:37.910078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3449bd51-398d-4563-949e-3bc7b813baff tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:37.910576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3449bd51-398d-4563-949e-3bc7b813baff tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:37.911008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3449bd51-398d-4563-949e-3bc7b813baff tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:37.911718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3449bd51-398d-4563-949e-3bc7b813baff tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:37.912177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3449bd51-398d-4563-949e-3bc7b813baff tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:37.912603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3449bd51-398d-4563-949e-3bc7b813baff tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:38.126448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3449bd51-398d-4563-949e-3bc7b813baff tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:38.144807 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3449bd51-398d-4563-949e-3bc7b813baff tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1269 microversion: 2.1 time: 0.247577 Oct 18 14:00:38.157202 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3041/6283] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:37 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1269 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:39.178137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5e7f0b8c-3580-4e1e-aafe-6fe3f3062e90 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:39.180258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e7f0b8c-3580-4e1e-aafe-6fe3f3062e90 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:39.190041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e7f0b8c-3580-4e1e-aafe-6fe3f3062e90 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:39.191095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e7f0b8c-3580-4e1e-aafe-6fe3f3062e90 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:39.192019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e7f0b8c-3580-4e1e-aafe-6fe3f3062e90 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:39.193055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e7f0b8c-3580-4e1e-aafe-6fe3f3062e90 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:39.193735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e7f0b8c-3580-4e1e-aafe-6fe3f3062e90 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:39.194951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e7f0b8c-3580-4e1e-aafe-6fe3f3062e90 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:39.376228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5e7f0b8c-3580-4e1e-aafe-6fe3f3062e90 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:39.385698 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5e7f0b8c-3580-4e1e-aafe-6fe3f3062e90 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1269 microversion: 2.1 time: 0.217686 Oct 18 14:00:39.386484 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3243/6284] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:39 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1269 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:40.409505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-53603870-e140-478a-aa0c-7c7228fe8da2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:40.410155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-53603870-e140-478a-aa0c-7c7228fe8da2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:40.413694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:40.422345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53603870-e140-478a-aa0c-7c7228fe8da2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:40.423639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53603870-e140-478a-aa0c-7c7228fe8da2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:40.424513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53603870-e140-478a-aa0c-7c7228fe8da2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:40.425439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53603870-e140-478a-aa0c-7c7228fe8da2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:40.426068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53603870-e140-478a-aa0c-7c7228fe8da2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:40.426488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-53603870-e140-478a-aa0c-7c7228fe8da2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:40.584113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-53603870-e140-478a-aa0c-7c7228fe8da2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:40.594152 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-53603870-e140-478a-aa0c-7c7228fe8da2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1269 microversion: 2.1 time: 0.189396 Oct 18 14:00:40.594755 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3042/6285] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:40 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:41.617217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-959702cc-be59-4fbc-9fc9-4cb834676b7c tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:41.618241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-959702cc-be59-4fbc-9fc9-4cb834676b7c tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:41.621341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:41.622853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:41.630718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-959702cc-be59-4fbc-9fc9-4cb834676b7c tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:41.631206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-959702cc-be59-4fbc-9fc9-4cb834676b7c tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:41.632365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-959702cc-be59-4fbc-9fc9-4cb834676b7c tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:41.633072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-959702cc-be59-4fbc-9fc9-4cb834676b7c tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:41.633548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-959702cc-be59-4fbc-9fc9-4cb834676b7c tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:41.633974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-959702cc-be59-4fbc-9fc9-4cb834676b7c tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:41.638632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:41.797294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-959702cc-be59-4fbc-9fc9-4cb834676b7c tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:41.807286 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-959702cc-be59-4fbc-9fc9-4cb834676b7c tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1269 microversion: 2.1 time: 0.193625 Oct 18 14:00:41.807665 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3244/6286] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:41 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1269 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:42.831696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-47c9fc24-186e-46c1-8a7e-677aa33d5985 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:42.832427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-47c9fc24-186e-46c1-8a7e-677aa33d5985 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:42.842052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47c9fc24-186e-46c1-8a7e-677aa33d5985 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:42.843074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47c9fc24-186e-46c1-8a7e-677aa33d5985 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:42.843798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47c9fc24-186e-46c1-8a7e-677aa33d5985 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:42.844449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47c9fc24-186e-46c1-8a7e-677aa33d5985 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:42.844798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47c9fc24-186e-46c1-8a7e-677aa33d5985 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:42.845459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47c9fc24-186e-46c1-8a7e-677aa33d5985 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:43.010652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-47c9fc24-186e-46c1-8a7e-677aa33d5985 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:43.019449 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-47c9fc24-186e-46c1-8a7e-677aa33d5985 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1269 microversion: 2.1 time: 0.191621 Oct 18 14:00:43.020116 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3043/6287] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:42 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1269 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:44.044429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8ff2119a-923c-412b-a8fc-c52de7fd462e tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:44.045649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8ff2119a-923c-412b-a8fc-c52de7fd462e tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:44.056279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff2119a-923c-412b-a8fc-c52de7fd462e tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:44.058597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff2119a-923c-412b-a8fc-c52de7fd462e tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:44.060222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff2119a-923c-412b-a8fc-c52de7fd462e tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:44.061857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff2119a-923c-412b-a8fc-c52de7fd462e tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:44.062931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff2119a-923c-412b-a8fc-c52de7fd462e tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:44.063957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ff2119a-923c-412b-a8fc-c52de7fd462e tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:44.345140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8ff2119a-923c-412b-a8fc-c52de7fd462e tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:44.355036 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8ff2119a-923c-412b-a8fc-c52de7fd462e tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1269 microversion: 2.1 time: 0.314583 Oct 18 14:00:44.356465 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3245/6288] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:44 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1269 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:45.379262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f14b9b3e-b577-48c0-b3ae-869656d282b5 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:45.382308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f14b9b3e-b577-48c0-b3ae-869656d282b5 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:45.390323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f14b9b3e-b577-48c0-b3ae-869656d282b5 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:45.393681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f14b9b3e-b577-48c0-b3ae-869656d282b5 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:45.394501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f14b9b3e-b577-48c0-b3ae-869656d282b5 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:45.395431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f14b9b3e-b577-48c0-b3ae-869656d282b5 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:45.396080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f14b9b3e-b577-48c0-b3ae-869656d282b5 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:45.396879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f14b9b3e-b577-48c0-b3ae-869656d282b5 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:45.595588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f14b9b3e-b577-48c0-b3ae-869656d282b5 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:45.604884 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f14b9b3e-b577-48c0-b3ae-869656d282b5 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1269 microversion: 2.1 time: 0.229610 Oct 18 14:00:45.605587 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3044/6289] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:45 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1269 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:46.629274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6a0f2da9-52f4-4ab5-b561-8963f17d5867 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:46.631031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6a0f2da9-52f4-4ab5-b561-8963f17d5867 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:46.636984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:46.644714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a0f2da9-52f4-4ab5-b561-8963f17d5867 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:46.645343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a0f2da9-52f4-4ab5-b561-8963f17d5867 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:46.645865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a0f2da9-52f4-4ab5-b561-8963f17d5867 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:46.646630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a0f2da9-52f4-4ab5-b561-8963f17d5867 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:46.647181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a0f2da9-52f4-4ab5-b561-8963f17d5867 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:46.648251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a0f2da9-52f4-4ab5-b561-8963f17d5867 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:46.813740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6a0f2da9-52f4-4ab5-b561-8963f17d5867 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:46.822629 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6a0f2da9-52f4-4ab5-b561-8963f17d5867 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1269 microversion: 2.1 time: 0.198249 Oct 18 14:00:46.837402 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3246/6290] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:46 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1269 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:47.849116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d4fa39ae-b817-480f-ae92-779641d4a4ac tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:47.850101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d4fa39ae-b817-480f-ae92-779641d4a4ac tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:47.867263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4fa39ae-b817-480f-ae92-779641d4a4ac tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:47.867892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4fa39ae-b817-480f-ae92-779641d4a4ac tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:47.868465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4fa39ae-b817-480f-ae92-779641d4a4ac tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:47.869793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4fa39ae-b817-480f-ae92-779641d4a4ac tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:47.870482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4fa39ae-b817-480f-ae92-779641d4a4ac tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:47.870931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d4fa39ae-b817-480f-ae92-779641d4a4ac tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:48.096922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d4fa39ae-b817-480f-ae92-779641d4a4ac tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:48.109309 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d4fa39ae-b817-480f-ae92-779641d4a4ac tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1269 microversion: 2.1 time: 0.265128 Oct 18 14:00:48.110643 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3045/6291] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:47 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1269 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:48.271933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-a9d72921-78df-431a-9eb4-0fe48c4db86b req-bb7a33a6-7ad9-43ed-8e65-d61918afda44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2feae907-8cb2-4716-81b6-05797d06a420", "name": "network-vif-plugged", "status": "completed", "tag": "5c895f73-52cc-4d6d-a316-ac5041ceedac"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:48.289347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a9d72921-78df-431a-9eb4-0fe48c4db86b req-bb7a33a6-7ad9-43ed-8e65-d61918afda44 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:48.289908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a9d72921-78df-431a-9eb4-0fe48c4db86b req-bb7a33a6-7ad9-43ed-8e65-d61918afda44 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:48.299339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a9d72921-78df-431a-9eb4-0fe48c4db86b req-bb7a33a6-7ad9-43ed-8e65-d61918afda44 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:48.315102 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-a9d72921-78df-431a-9eb4-0fe48c4db86b req-bb7a33a6-7ad9-43ed-8e65-d61918afda44 service nova] Creating event network-vif-plugged:5c895f73-52cc-4d6d-a316-ac5041ceedac for instance 2feae907-8cb2-4716-81b6-05797d06a420 on n-h2-858384-13 Oct 18 14:00:48.326902 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-a9d72921-78df-431a-9eb4-0fe48c4db86b req-bb7a33a6-7ad9-43ed-8e65-d61918afda44 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058788 Oct 18 14:00:48.328290 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3247/6292] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:49.134014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b04bedca-313a-4a30-9455-4acbfbc70c3d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:49.135247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b04bedca-313a-4a30-9455-4acbfbc70c3d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:49.148309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b04bedca-313a-4a30-9455-4acbfbc70c3d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:49.149032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b04bedca-313a-4a30-9455-4acbfbc70c3d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:49.149846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b04bedca-313a-4a30-9455-4acbfbc70c3d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:49.151193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b04bedca-313a-4a30-9455-4acbfbc70c3d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:49.152578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b04bedca-313a-4a30-9455-4acbfbc70c3d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:49.155615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b04bedca-313a-4a30-9455-4acbfbc70c3d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:49.373350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b04bedca-313a-4a30-9455-4acbfbc70c3d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:49.384146 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b04bedca-313a-4a30-9455-4acbfbc70c3d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1269 microversion: 2.1 time: 0.255885 Oct 18 14:00:49.408149 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3046/6293] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:49 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1269 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:50.414195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6f951be3-fe93-406b-9cd0-f86ac6fef44d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:50.415637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6f951be3-fe93-406b-9cd0-f86ac6fef44d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:50.443937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f951be3-fe93-406b-9cd0-f86ac6fef44d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:50.445226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f951be3-fe93-406b-9cd0-f86ac6fef44d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:50.445988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f951be3-fe93-406b-9cd0-f86ac6fef44d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:50.446722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f951be3-fe93-406b-9cd0-f86ac6fef44d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:50.447384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f951be3-fe93-406b-9cd0-f86ac6fef44d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:50.447816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6f951be3-fe93-406b-9cd0-f86ac6fef44d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:50.738231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6f951be3-fe93-406b-9cd0-f86ac6fef44d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:50.758436 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6f951be3-fe93-406b-9cd0-f86ac6fef44d tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1458 microversion: 2.1 time: 0.350008 Oct 18 14:00:50.760025 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3248/6294] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:50 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1458 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:50.787755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ead2a1cc-cc11-447d-a648-77ed6b90a7a6 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:50.789004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ead2a1cc-cc11-447d-a648-77ed6b90a7a6 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:50.801631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ead2a1cc-cc11-447d-a648-77ed6b90a7a6 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:50.802134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ead2a1cc-cc11-447d-a648-77ed6b90a7a6 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:50.802581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ead2a1cc-cc11-447d-a648-77ed6b90a7a6 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:50.803308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ead2a1cc-cc11-447d-a648-77ed6b90a7a6 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:50.804314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ead2a1cc-cc11-447d-a648-77ed6b90a7a6 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:50.804765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ead2a1cc-cc11-447d-a648-77ed6b90a7a6 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:51.013359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ead2a1cc-cc11-447d-a648-77ed6b90a7a6 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:51.021985 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ead2a1cc-cc11-447d-a648-77ed6b90a7a6 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1458 microversion: 2.1 time: 0.238127 Oct 18 14:00:51.022752 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3047/6295] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:50 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1458 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:53.055278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-587140517", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "24b4c343-261b-4f7a-9bd3-34380b1c71e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d0463e74-962e-46fb-9c76-86e27a0887d2"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:53.149593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] validate_networks() for [('d0463e74-962e-46fb-9c76-86e27a0887d2', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:00:53.856125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:00:53.856622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:00:53.857232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:00:53.857682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:00:53.858538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:00:53.869789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:53.870445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:53.870890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:53.873193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:53.874594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:53.875210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:53.907173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:00:53.919015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for user 1d29125d80d146749096e754db7d84d4 and project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:00:53.990276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:00:53.993161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24b4c343-261b-4f7a-9bd3-34380b1c71e5',volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:00:54.132645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-eb6a01d3-8344-443e-a3d4-9e734de03291 req-d4bb05be-dfb8-426e-ba21-f8671970bc5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2feae907-8cb2-4716-81b6-05797d06a420", "tag": "5c895f73-52cc-4d6d-a316-ac5041ceedac"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:54.151090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-eb6a01d3-8344-443e-a3d4-9e734de03291 req-d4bb05be-dfb8-426e-ba21-f8671970bc5a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:54.151877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-eb6a01d3-8344-443e-a3d4-9e734de03291 req-d4bb05be-dfb8-426e-ba21-f8671970bc5a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:54.152506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-eb6a01d3-8344-443e-a3d4-9e734de03291 req-d4bb05be-dfb8-426e-ba21-f8671970bc5a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:54.157678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:54.168952 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-eb6a01d3-8344-443e-a3d4-9e734de03291 req-d4bb05be-dfb8-426e-ba21-f8671970bc5a service nova] Creating event network-changed:5c895f73-52cc-4d6d-a316-ac5041ceedac for instance 2feae907-8cb2-4716-81b6-05797d06a420 on n-h2-858384-13 Oct 18 14:00:54.177598 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-eb6a01d3-8344-443e-a3d4-9e734de03291 req-d4bb05be-dfb8-426e-ba21-f8671970bc5a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.322029 Oct 18 14:00:54.179275 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3048/6296] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:54.214674 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c79bf998-4b2e-409d-a205-e6f12e3e3a7d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166806 Oct 18 14:00:54.215855 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3249/6297] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:00:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:00:54.245277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-06faae7c-ba93-4d61-bd1f-d95537c57b04 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:54.251068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-06faae7c-ba93-4d61-bd1f-d95537c57b04 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:54.477125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-06faae7c-ba93-4d61-bd1f-d95537c57b04 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:54.487612 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-06faae7c-ba93-4d61-bd1f-d95537c57b04 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1056 microversion: 2.1 time: 0.260305 Oct 18 14:00:54.488222 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3049/6298] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:54 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1056 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:55.440201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5df16c27-0a72-4612-8804-5d09cefb6796 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:55.440831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5df16c27-0a72-4612-8804-5d09cefb6796 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:55.450751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5df16c27-0a72-4612-8804-5d09cefb6796 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:55.451499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5df16c27-0a72-4612-8804-5d09cefb6796 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:55.452095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5df16c27-0a72-4612-8804-5d09cefb6796 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:55.452815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5df16c27-0a72-4612-8804-5d09cefb6796 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:55.453384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5df16c27-0a72-4612-8804-5d09cefb6796 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:55.453839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5df16c27-0a72-4612-8804-5d09cefb6796 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:55.511313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0ebf2be7-f441-4c01-957b-2c7b4fb70b07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:55.511928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0ebf2be7-f441-4c01-957b-2c7b4fb70b07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:55.514500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:00:55.525501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ebf2be7-f441-4c01-957b-2c7b4fb70b07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:55.526024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ebf2be7-f441-4c01-957b-2c7b4fb70b07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:55.526467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ebf2be7-f441-4c01-957b-2c7b4fb70b07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:55.527179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ebf2be7-f441-4c01-957b-2c7b4fb70b07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:55.527635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ebf2be7-f441-4c01-957b-2c7b4fb70b07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:55.528065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ebf2be7-f441-4c01-957b-2c7b4fb70b07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:55.588462 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5df16c27-0a72-4612-8804-5d09cefb6796 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1832 microversion: 2.1 time: 0.153333 Oct 18 14:00:55.589052 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3250/6299] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:55 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1832 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:55.592239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0ebf2be7-f441-4c01-957b-2c7b4fb70b07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:55.599983 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0ebf2be7-f441-4c01-957b-2c7b4fb70b07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1154 microversion: 2.1 time: 0.093089 Oct 18 14:00:55.601132 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3050/6300] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:55 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1154 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:00:56.234149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-be368f56-621f-477d-ab3e-55bf93d7e88c req-5d94db23-c903-4f47-9338-d6d4935ec6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2feae907-8cb2-4716-81b6-05797d06a420", "tag": "5c895f73-52cc-4d6d-a316-ac5041ceedac"}, {"name": "network-changed", "server_uuid": "2feae907-8cb2-4716-81b6-05797d06a420", "tag": "5c895f73-52cc-4d6d-a316-ac5041ceedac"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:56.252865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-be368f56-621f-477d-ab3e-55bf93d7e88c req-5d94db23-c903-4f47-9338-d6d4935ec6b3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:56.253605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-be368f56-621f-477d-ab3e-55bf93d7e88c req-5d94db23-c903-4f47-9338-d6d4935ec6b3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:56.254240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-be368f56-621f-477d-ab3e-55bf93d7e88c req-5d94db23-c903-4f47-9338-d6d4935ec6b3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:56.277304 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-be368f56-621f-477d-ab3e-55bf93d7e88c req-5d94db23-c903-4f47-9338-d6d4935ec6b3 service nova] Creating event network-changed:5c895f73-52cc-4d6d-a316-ac5041ceedac for instance 2feae907-8cb2-4716-81b6-05797d06a420 on n-h2-858384-13 Oct 18 14:00:56.278131 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-be368f56-621f-477d-ab3e-55bf93d7e88c req-5d94db23-c903-4f47-9338-d6d4935ec6b3 service nova] Creating event network-changed:5c895f73-52cc-4d6d-a316-ac5041ceedac for instance 2feae907-8cb2-4716-81b6-05797d06a420 on n-h2-858384-13 Oct 18 14:00:56.284903 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-be368f56-621f-477d-ab3e-55bf93d7e88c req-5d94db23-c903-4f47-9338-d6d4935ec6b3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054442 Oct 18 14:00:56.286134 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3251/6301] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:56.623905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-90ba8dae-4b27-4aac-97d2-76dd1f6bfbed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:56.624534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-90ba8dae-4b27-4aac-97d2-76dd1f6bfbed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:56.639886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90ba8dae-4b27-4aac-97d2-76dd1f6bfbed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:56.640383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90ba8dae-4b27-4aac-97d2-76dd1f6bfbed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:56.640827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90ba8dae-4b27-4aac-97d2-76dd1f6bfbed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:56.641567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90ba8dae-4b27-4aac-97d2-76dd1f6bfbed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:56.649562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90ba8dae-4b27-4aac-97d2-76dd1f6bfbed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:56.650167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90ba8dae-4b27-4aac-97d2-76dd1f6bfbed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:57.269365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-75eb2f5f-5653-4497-84ed-c52ade26f744 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:57.270537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-75eb2f5f-5653-4497-84ed-c52ade26f744 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:57.282843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75eb2f5f-5653-4497-84ed-c52ade26f744 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:57.283343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75eb2f5f-5653-4497-84ed-c52ade26f744 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:57.283790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75eb2f5f-5653-4497-84ed-c52ade26f744 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:57.284505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75eb2f5f-5653-4497-84ed-c52ade26f744 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:57.287556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75eb2f5f-5653-4497-84ed-c52ade26f744 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:57.290125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-75eb2f5f-5653-4497-84ed-c52ade26f744 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:57.350307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-75eb2f5f-5653-4497-84ed-c52ade26f744 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:00:57.447110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-90ba8dae-4b27-4aac-97d2-76dd1f6bfbed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:57.469455 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-90ba8dae-4b27-4aac-97d2-76dd1f6bfbed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1214 microversion: 2.1 time: 0.849343 Oct 18 14:00:57.485358 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3051/6302] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:56 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1214 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:57.551043 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-75eb2f5f-5653-4497-84ed-c52ade26f744 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "DELETE /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 204 len: 0 microversion: 2.1 time: 0.288455 Oct 18 14:00:57.552420 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3252/6303] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:00:57 2022] DELETE /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 14:00:57.562069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-71f9c36e-c501-4452-9ca0-851873ee6c26 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:57.562998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-71f9c36e-c501-4452-9ca0-851873ee6c26 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:57.574266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71f9c36e-c501-4452-9ca0-851873ee6c26 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:57.574769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71f9c36e-c501-4452-9ca0-851873ee6c26 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:57.577793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71f9c36e-c501-4452-9ca0-851873ee6c26 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:57.578568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71f9c36e-c501-4452-9ca0-851873ee6c26 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:57.581163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71f9c36e-c501-4452-9ca0-851873ee6c26 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:57.581734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71f9c36e-c501-4452-9ca0-851873ee6c26 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:58.220061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-71f9c36e-c501-4452-9ca0-851873ee6c26 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:58.230523 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-71f9c36e-c501-4452-9ca0-851873ee6c26 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1685 microversion: 2.1 time: 0.672413 Oct 18 14:00:58.237125 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3052/6304] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:57 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1685 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:58.347560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-279d6fad-f079-4d89-923f-e5a3d6d86afd req-dcfe93c9-5d62-4424-8daf-1941dd36e21c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959c7403-84b5-4f11-9117-a86a2d452a44", "tag": "d7dcac03-eee5-498f-bdf2-9f546cfb50bc"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:58.363779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-279d6fad-f079-4d89-923f-e5a3d6d86afd req-dcfe93c9-5d62-4424-8daf-1941dd36e21c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:58.364267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-279d6fad-f079-4d89-923f-e5a3d6d86afd req-dcfe93c9-5d62-4424-8daf-1941dd36e21c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:58.364703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-279d6fad-f079-4d89-923f-e5a3d6d86afd req-dcfe93c9-5d62-4424-8daf-1941dd36e21c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:58.389238 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-279d6fad-f079-4d89-923f-e5a3d6d86afd req-dcfe93c9-5d62-4424-8daf-1941dd36e21c service nova] Creating event network-changed:d7dcac03-eee5-498f-bdf2-9f546cfb50bc for instance 959c7403-84b5-4f11-9117-a86a2d452a44 on n-h1-858384-13 Oct 18 14:00:58.395276 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-279d6fad-f079-4d89-923f-e5a3d6d86afd req-dcfe93c9-5d62-4424-8daf-1941dd36e21c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052249 Oct 18 14:00:58.399291 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3253/6305] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:58.511115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c2e3a3d9-1ed9-455b-8f48-d6b5ffdc1d27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:58.511333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c2e3a3d9-1ed9-455b-8f48-d6b5ffdc1d27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:58.522365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2e3a3d9-1ed9-455b-8f48-d6b5ffdc1d27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:58.523153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2e3a3d9-1ed9-455b-8f48-d6b5ffdc1d27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:58.523816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2e3a3d9-1ed9-455b-8f48-d6b5ffdc1d27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:58.524702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2e3a3d9-1ed9-455b-8f48-d6b5ffdc1d27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:58.531672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2e3a3d9-1ed9-455b-8f48-d6b5ffdc1d27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:58.532151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2e3a3d9-1ed9-455b-8f48-d6b5ffdc1d27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:58.903102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c2e3a3d9-1ed9-455b-8f48-d6b5ffdc1d27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:58.911047 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c2e3a3d9-1ed9-455b-8f48-d6b5ffdc1d27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1214 microversion: 2.1 time: 0.407488 Oct 18 14:00:58.912464 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3053/6306] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:58 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1214 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:59.143247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7e9a1ead-d551-48cb-9b45-490137c77c56 req-e16781e0-f5f7-4e69-9a4c-4e65db4310e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3995e94d-4d39-4326-aa9b-e99f642dfee6", "tag": "c5693bba-56fa-4a28-8dcd-eb7711fec77b"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:00:59.153871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7e9a1ead-d551-48cb-9b45-490137c77c56 req-e16781e0-f5f7-4e69-9a4c-4e65db4310e6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:59.154408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7e9a1ead-d551-48cb-9b45-490137c77c56 req-e16781e0-f5f7-4e69-9a4c-4e65db4310e6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:59.154857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7e9a1ead-d551-48cb-9b45-490137c77c56 req-e16781e0-f5f7-4e69-9a4c-4e65db4310e6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:59.167696 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7e9a1ead-d551-48cb-9b45-490137c77c56 req-e16781e0-f5f7-4e69-9a4c-4e65db4310e6 service nova] Creating event network-changed:c5693bba-56fa-4a28-8dcd-eb7711fec77b for instance 3995e94d-4d39-4326-aa9b-e99f642dfee6 on n-h1-858384-13 Oct 18 14:00:59.173904 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7e9a1ead-d551-48cb-9b45-490137c77c56 req-e16781e0-f5f7-4e69-9a4c-4e65db4310e6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033964 Oct 18 14:00:59.175213 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3254/6307] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:00:59.260335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-23b02478-5f02-4642-92d2-6f93641024b7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:59.260879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-23b02478-5f02-4642-92d2-6f93641024b7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:59.270870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23b02478-5f02-4642-92d2-6f93641024b7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:59.273465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23b02478-5f02-4642-92d2-6f93641024b7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:59.276147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23b02478-5f02-4642-92d2-6f93641024b7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:59.277030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23b02478-5f02-4642-92d2-6f93641024b7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:59.282942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23b02478-5f02-4642-92d2-6f93641024b7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:59.285673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-23b02478-5f02-4642-92d2-6f93641024b7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:59.807776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-23b02478-5f02-4642-92d2-6f93641024b7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:00:59.817514 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-23b02478-5f02-4642-92d2-6f93641024b7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1685 microversion: 2.1 time: 0.561309 Oct 18 14:00:59.818258 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3054/6308] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:59 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1685 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:00:59.939149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dff11eb1-afa3-4045-936a-90d330eef653 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:00:59.940496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dff11eb1-afa3-4045-936a-90d330eef653 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:00:59.947940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dff11eb1-afa3-4045-936a-90d330eef653 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:59.949135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dff11eb1-afa3-4045-936a-90d330eef653 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:59.949135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dff11eb1-afa3-4045-936a-90d330eef653 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:00:59.950059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dff11eb1-afa3-4045-936a-90d330eef653 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:00:59.950601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dff11eb1-afa3-4045-936a-90d330eef653 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:00:59.951009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dff11eb1-afa3-4045-936a-90d330eef653 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:00.162236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dff11eb1-afa3-4045-936a-90d330eef653 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:00.173523 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dff11eb1-afa3-4045-936a-90d330eef653 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1214 microversion: 2.1 time: 0.240864 Oct 18 14:01:00.174500 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3255/6309] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:00:59 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:00.843096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:00.844331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:00.862645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:00.865263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:00.866882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:00.868500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:00.870670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:00.871221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:00.912363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:00.912880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:00.914030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:00.914753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lazy-loading 'fault' on Instance uuid 959c7403-84b5-4f11-9117-a86a2d452a44 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:01:00.990060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:00.999940 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7a2a41ec-2dab-44f3-87e8-0671af3d8d6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 200 len: 1355 microversion: 2.1 time: 0.161236 Oct 18 14:01:01.024917 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3055/6310] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:00 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 1355 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:01.197867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c963b2b9-3380-4639-b4d4-2abe852d9264 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:01.199933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c963b2b9-3380-4639-b4d4-2abe852d9264 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:01.207241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c963b2b9-3380-4639-b4d4-2abe852d9264 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:01.207795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c963b2b9-3380-4639-b4d4-2abe852d9264 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:01.208224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c963b2b9-3380-4639-b4d4-2abe852d9264 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:01.208967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c963b2b9-3380-4639-b4d4-2abe852d9264 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:01.209456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c963b2b9-3380-4639-b4d4-2abe852d9264 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:01.210582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c963b2b9-3380-4639-b4d4-2abe852d9264 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:01.376499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c963b2b9-3380-4639-b4d4-2abe852d9264 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:01.387029 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c963b2b9-3380-4639-b4d4-2abe852d9264 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1214 microversion: 2.1 time: 0.194466 Oct 18 14:01:01.388004 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3256/6311] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:01 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1214 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:01.391042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d77b1fd4-05c4-43d3-b4e6-0a226c67d190 req-6d13b90b-ec53-4e48-9c2e-d4e9a5fac024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959c7403-84b5-4f11-9117-a86a2d452a44", "name": "network-vif-deleted", "tag": "d7dcac03-eee5-498f-bdf2-9f546cfb50bc"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:01.406524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d77b1fd4-05c4-43d3-b4e6-0a226c67d190 req-6d13b90b-ec53-4e48-9c2e-d4e9a5fac024 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:01.407018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d77b1fd4-05c4-43d3-b4e6-0a226c67d190 req-6d13b90b-ec53-4e48-9c2e-d4e9a5fac024 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:01.407534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d77b1fd4-05c4-43d3-b4e6-0a226c67d190 req-6d13b90b-ec53-4e48-9c2e-d4e9a5fac024 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:01.419968 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d77b1fd4-05c4-43d3-b4e6-0a226c67d190 req-6d13b90b-ec53-4e48-9c2e-d4e9a5fac024 service nova] Creating event network-vif-deleted:d7dcac03-eee5-498f-bdf2-9f546cfb50bc for instance 959c7403-84b5-4f11-9117-a86a2d452a44 on n-h1-858384-13 Oct 18 14:01:01.425655 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d77b1fd4-05c4-43d3-b4e6-0a226c67d190 req-6d13b90b-ec53-4e48-9c2e-d4e9a5fac024 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049266 Oct 18 14:01:01.426923 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3056/6312] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:01:02.029318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f9fbef21-455d-447c-a61a-62ce5518b93a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:02.029958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f9fbef21-455d-447c-a61a-62ce5518b93a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 959c7403-84b5-4f11-9117-a86a2d452a44] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:02.035917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9fbef21-455d-447c-a61a-62ce5518b93a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:02.036391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9fbef21-455d-447c-a61a-62ce5518b93a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:02.036819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9fbef21-455d-447c-a61a-62ce5518b93a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:02.037524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9fbef21-455d-447c-a61a-62ce5518b93a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:02.038529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9fbef21-455d-447c-a61a-62ce5518b93a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:02.038983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9fbef21-455d-447c-a61a-62ce5518b93a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:02.052129 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-f9fbef21-455d-447c-a61a-62ce5518b93a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] HTTP exception thrown: Instance 959c7403-84b5-4f11-9117-a86a2d452a44 could not be found. Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f9fbef21-455d-447c-a61a-62ce5518b93a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Request method failure captured: Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 HTTP/1.1 Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrERveMSbr98lDbhVRpVCZtMpZCqRzllFV9Zp-9Paa2aeI2L6Uu3YKC5mtfy6YqZYTDL35tBdZ2S8DBV9NMKTb2UJzxCOY2UD_h7FbwqxTtZxtG-8cn42k_jl_VvaBbCHWnwHwkU0ksMnyQKE0VuTZblyb548PMnFxhTFzNpMLJL5y0 Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: c5b27cd003004ada9e45c087db637da3 Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1155266913 Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5b27cd003004ada9e45c087db637da3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5b27cd003004ada9e45c087db637da3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5b27cd003004ada9e45c087db637da3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5b27cd003004ada9e45c087db637da3"}]}] Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1155266913 Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: c5b27cd003004ada9e45c087db637da3 Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1155266913 Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestNetworkAdvancedServerOps-1155266913-project Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 21e90c2f331f46f497b568dbc0e0c100 Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1155266913-project Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 959c7403-84b5-4f11-9117-a86a2d452a44 could not be found. Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '959c7403-84b5-4f11-9117-a86a2d452a44'} Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959c7403-84b5-4f11-9117-a86a2d452a44 could not be found. Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959c7403-84b5-4f11-9117-a86a2d452a44 could not be found. Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:01:02.054442 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:01:02.060572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:01:02.060572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:02.060572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:01:02.060572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:01:02.060572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:01:02.060572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:01:02.060572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959c7403-84b5-4f11-9117-a86a2d452a44 could not be found. Oct 18 14:01:02.060572 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:01:02.060572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f9fbef21-455d-447c-a61a-62ce5518b93a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Returning 404 to user: Instance 959c7403-84b5-4f11-9117-a86a2d452a44 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:01:02.060572 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f9fbef21-455d-447c-a61a-62ce5518b93a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44" status: 404 len: 111 microversion: 2.1 time: 0.030477 Oct 18 14:01:02.060572 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3257/6313] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:02 2022] GET /compute/v2.1/servers/959c7403-84b5-4f11-9117-a86a2d452a44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:01:02.411843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5371fa44-ae50-4bb8-819d-41562943b6c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:02.412545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5371fa44-ae50-4bb8-819d-41562943b6c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:02.419945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5371fa44-ae50-4bb8-819d-41562943b6c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:02.420425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5371fa44-ae50-4bb8-819d-41562943b6c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:02.420858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5371fa44-ae50-4bb8-819d-41562943b6c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:02.421576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5371fa44-ae50-4bb8-819d-41562943b6c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:02.422029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5371fa44-ae50-4bb8-819d-41562943b6c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:02.422456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5371fa44-ae50-4bb8-819d-41562943b6c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:02.637963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5371fa44-ae50-4bb8-819d-41562943b6c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:02.645911 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5371fa44-ae50-4bb8-819d-41562943b6c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1202 microversion: 2.1 time: 0.238297 Oct 18 14:01:02.646501 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3057/6314] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:02 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1202 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:03.671343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1d20153a-6d62-4320-9a2c-58b0ed78e967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:03.672110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1d20153a-6d62-4320-9a2c-58b0ed78e967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:03.680286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d20153a-6d62-4320-9a2c-58b0ed78e967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:03.681359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d20153a-6d62-4320-9a2c-58b0ed78e967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:03.682072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d20153a-6d62-4320-9a2c-58b0ed78e967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:03.684507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d20153a-6d62-4320-9a2c-58b0ed78e967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:03.685377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d20153a-6d62-4320-9a2c-58b0ed78e967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:03.686199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d20153a-6d62-4320-9a2c-58b0ed78e967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:03.865892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1d20153a-6d62-4320-9a2c-58b0ed78e967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:03.875106 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1d20153a-6d62-4320-9a2c-58b0ed78e967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1202 microversion: 2.1 time: 0.207637 Oct 18 14:01:03.876542 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3258/6315] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:03 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1202 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:04.899425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4da1d5a8-479d-4cc3-a44f-df1c64c95086 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:04.900694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4da1d5a8-479d-4cc3-a44f-df1c64c95086 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:04.905299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:04.909784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4da1d5a8-479d-4cc3-a44f-df1c64c95086 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:04.910274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4da1d5a8-479d-4cc3-a44f-df1c64c95086 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:04.910704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4da1d5a8-479d-4cc3-a44f-df1c64c95086 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:04.911744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4da1d5a8-479d-4cc3-a44f-df1c64c95086 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:04.912199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4da1d5a8-479d-4cc3-a44f-df1c64c95086 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:04.912640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4da1d5a8-479d-4cc3-a44f-df1c64c95086 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:05.075952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4da1d5a8-479d-4cc3-a44f-df1c64c95086 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:05.104116 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4da1d5a8-479d-4cc3-a44f-df1c64c95086 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1202 microversion: 2.1 time: 0.209534 Oct 18 14:01:05.105725 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3058/6316] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:04 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1202 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:05.312764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-35d36406-2a68-4358-bd2e-4583b75cbf89 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '.version_select at 0x7ff60e5b49d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:05.320549 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [None req-35d36406-2a68-4358-bd2e-4583b75cbf89 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [0135da17-52a6-4f3f-bf9a-8d65ee41392a] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:01:05.321009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:05.322061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:06.130652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-edcebb3b-708e-49a4-ac64-42c6942fee9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:06.131263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-edcebb3b-708e-49a4-ac64-42c6942fee9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:06.138967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edcebb3b-708e-49a4-ac64-42c6942fee9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:06.139450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edcebb3b-708e-49a4-ac64-42c6942fee9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:06.139887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edcebb3b-708e-49a4-ac64-42c6942fee9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:06.140579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edcebb3b-708e-49a4-ac64-42c6942fee9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:06.141032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edcebb3b-708e-49a4-ac64-42c6942fee9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:06.141487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edcebb3b-708e-49a4-ac64-42c6942fee9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:06.281978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-edcebb3b-708e-49a4-ac64-42c6942fee9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:06.290742 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-edcebb3b-708e-49a4-ac64-42c6942fee9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1202 microversion: 2.1 time: 0.164153 Oct 18 14:01:06.291351 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3059/6317] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:06 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:06.327791 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [None req-35d36406-2a68-4358-bd2e-4583b75cbf89 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [0135da17-52a6-4f3f-bf9a-8d65ee41392a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 36612. Oct 18 14:01:06.348494 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-35d36406-2a68-4358-bd2e-4583b75cbf89 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-158561403" status: 202 len: 0 microversion: 2.1 time: 1.040024 Oct 18 14:01:06.349075 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3259/6318] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 18 14:01:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-158561403 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:01:06.382946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c0b5279-32fa-4e85-ba1a-c15e7ab54aca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'create', calling method: .version_select at 0x7ff60f7a2310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-587303360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrYe9gJxvtYv24+nxK1zn7Ma7Nrm69DFYuzembLghszEm/Qm9nPP9x54PSNfuN8NXOqBRsBfrnqqjeiKDDJ1u41JRqgCKTd6SGF+mDgGQf50BgS2igcg2e/IEjzbgcNwQ=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:06.398767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-2c0b5279-32fa-4e85-ba1a-c15e7ab54aca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for project c5b27cd003004ada9e45c087db637da3. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:01:06.403928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-2c0b5279-32fa-4e85-ba1a-c15e7ab54aca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for user 21e90c2f331f46f497b568dbc0e0c100 and project c5b27cd003004ada9e45c087db637da3. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:01:06.429474 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2c0b5279-32fa-4e85-ba1a-c15e7ab54aca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050108 Oct 18 14:01:06.430086 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3060/6319] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:01:06 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:01:07.314086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c61fb4bf-babe-4f74-aabe-e5006be92dac tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:07.314743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c61fb4bf-babe-4f74-aabe-e5006be92dac tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:07.322207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c61fb4bf-babe-4f74-aabe-e5006be92dac tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:07.322698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c61fb4bf-babe-4f74-aabe-e5006be92dac tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:07.323138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c61fb4bf-babe-4f74-aabe-e5006be92dac tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:07.323840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c61fb4bf-babe-4f74-aabe-e5006be92dac tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:07.324360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c61fb4bf-babe-4f74-aabe-e5006be92dac tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:07.324786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c61fb4bf-babe-4f74-aabe-e5006be92dac tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:07.469287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c61fb4bf-babe-4f74-aabe-e5006be92dac tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:07.477378 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c61fb4bf-babe-4f74-aabe-e5006be92dac tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1202 microversion: 2.1 time: 0.167218 Oct 18 14:01:07.478032 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3260/6320] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:07 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1202 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:08.502808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-116f9437-238d-4ba7-934a-215facb6c41c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:08.503483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-116f9437-238d-4ba7-934a-215facb6c41c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:08.511221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-116f9437-238d-4ba7-934a-215facb6c41c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:08.511714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-116f9437-238d-4ba7-934a-215facb6c41c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:08.512158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-116f9437-238d-4ba7-934a-215facb6c41c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:08.512850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-116f9437-238d-4ba7-934a-215facb6c41c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:08.513327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-116f9437-238d-4ba7-934a-215facb6c41c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:08.513758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-116f9437-238d-4ba7-934a-215facb6c41c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:08.656374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-116f9437-238d-4ba7-934a-215facb6c41c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:08.664333 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-116f9437-238d-4ba7-934a-215facb6c41c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1202 microversion: 2.1 time: 0.166585 Oct 18 14:01:08.664943 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3061/6321] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:08 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:09.688521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f8e056c1-dc3c-4518-90b0-873ea02a4518 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:09.690484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f8e056c1-dc3c-4518-90b0-873ea02a4518 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:09.699798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8e056c1-dc3c-4518-90b0-873ea02a4518 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:09.700766 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8e056c1-dc3c-4518-90b0-873ea02a4518 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:09.701526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8e056c1-dc3c-4518-90b0-873ea02a4518 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:09.702582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8e056c1-dc3c-4518-90b0-873ea02a4518 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:09.703556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8e056c1-dc3c-4518-90b0-873ea02a4518 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:09.704213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8e056c1-dc3c-4518-90b0-873ea02a4518 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:09.977107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f8e056c1-dc3c-4518-90b0-873ea02a4518 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:09.985548 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f8e056c1-dc3c-4518-90b0-873ea02a4518 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1202 microversion: 2.1 time: 0.301733 Oct 18 14:01:10.001712 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3261/6322] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:09 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1202 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:11.012670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9fbfdbc2-480a-418f-8d43-6e4d536857ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:11.013396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9fbfdbc2-480a-418f-8d43-6e4d536857ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:11.027226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fbfdbc2-480a-418f-8d43-6e4d536857ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:11.028747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fbfdbc2-480a-418f-8d43-6e4d536857ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:11.029949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fbfdbc2-480a-418f-8d43-6e4d536857ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:11.030890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fbfdbc2-480a-418f-8d43-6e4d536857ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:11.032594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fbfdbc2-480a-418f-8d43-6e4d536857ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:11.033048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fbfdbc2-480a-418f-8d43-6e4d536857ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:11.536343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9fbfdbc2-480a-418f-8d43-6e4d536857ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:11.554497 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9fbfdbc2-480a-418f-8d43-6e4d536857ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1202 microversion: 2.1 time: 0.545732 Oct 18 14:01:11.555114 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3062/6323] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:11 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1202 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:11.892052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-513a4db8-a1e3-4c75-8905-3b7008318ece req-2a6003c8-0243-41b0-b76c-5e3809df5b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3995e94d-4d39-4326-aa9b-e99f642dfee6", "name": "network-vif-plugged", "status": "completed", "tag": "c5693bba-56fa-4a28-8dcd-eb7711fec77b"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:11.905477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-513a4db8-a1e3-4c75-8905-3b7008318ece req-2a6003c8-0243-41b0-b76c-5e3809df5b79 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:11.906237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-513a4db8-a1e3-4c75-8905-3b7008318ece req-2a6003c8-0243-41b0-b76c-5e3809df5b79 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:11.907138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-513a4db8-a1e3-4c75-8905-3b7008318ece req-2a6003c8-0243-41b0-b76c-5e3809df5b79 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:11.911748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:11.922622 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-513a4db8-a1e3-4c75-8905-3b7008318ece req-2a6003c8-0243-41b0-b76c-5e3809df5b79 service nova] Creating event network-vif-plugged:c5693bba-56fa-4a28-8dcd-eb7711fec77b for instance 3995e94d-4d39-4326-aa9b-e99f642dfee6 on n-h1-858384-13 Oct 18 14:01:11.928149 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-513a4db8-a1e3-4c75-8905-3b7008318ece req-2a6003c8-0243-41b0-b76c-5e3809df5b79 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039907 Oct 18 14:01:11.928921 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3262/6324] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:01:12.579988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fc3af1a7-f0f2-4520-8765-f7202fc796d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:12.580776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fc3af1a7-f0f2-4520-8765-f7202fc796d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:12.589659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc3af1a7-f0f2-4520-8765-f7202fc796d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:12.590094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc3af1a7-f0f2-4520-8765-f7202fc796d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:12.591140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc3af1a7-f0f2-4520-8765-f7202fc796d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:12.592023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc3af1a7-f0f2-4520-8765-f7202fc796d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:12.592705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc3af1a7-f0f2-4520-8765-f7202fc796d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:12.593432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc3af1a7-f0f2-4520-8765-f7202fc796d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:12.667877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-64142287", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "e5fb8bed-1c03-4fd3-b431-d7b9a5fa16d0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-587303360", "security_groups": [{"name": "tempest-secgroup-smoke-1311043528"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:12.758343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fc3af1a7-f0f2-4520-8765-f7202fc796d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:12.767382 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fc3af1a7-f0f2-4520-8765-f7202fc796d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1202 microversion: 2.1 time: 0.191346 Oct 18 14:01:12.768094 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3063/6325] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:12 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1202 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:12.810855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] validate_networks() for [('e5fb8bed-1c03-4fd3-b431-d7b9a5fa16d0', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:01:13.292809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:01:13.293510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:01:13.293797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:01:13.294208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:01:13.294625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:01:13.309956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:13.310518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:13.311030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:13.312762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:13.313031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:13.313624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:13.332999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for project c5b27cd003004ada9e45c087db637da3. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:01:13.339432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for user 21e90c2f331f46f497b568dbc0e0c100 and project c5b27cd003004ada9e45c087db637da3. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:01:13.354884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:01:13.357344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:01:13.407311 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-93b7cb51-6118-4aa2-aea2-bd0e41793114 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.746042 Oct 18 14:01:13.408536 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3263/6326] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:01:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:01:13.426239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d0e8dd61-c24e-4efd-b03d-9223a02a151c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:13.427590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d0e8dd61-c24e-4efd-b03d-9223a02a151c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:13.518985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d0e8dd61-c24e-4efd-b03d-9223a02a151c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:13.529296 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d0e8dd61-c24e-4efd-b03d-9223a02a151c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1264 microversion: 2.1 time: 0.112822 Oct 18 14:01:13.530053 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3064/6327] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:13 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1264 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:13.795264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-115cb40d-4fcc-4cfc-9943-26b63085da4b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:13.796436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-115cb40d-4fcc-4cfc-9943-26b63085da4b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:13.823899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-115cb40d-4fcc-4cfc-9943-26b63085da4b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:13.825727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-115cb40d-4fcc-4cfc-9943-26b63085da4b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:13.829941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-115cb40d-4fcc-4cfc-9943-26b63085da4b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:13.833136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-115cb40d-4fcc-4cfc-9943-26b63085da4b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:13.833863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-115cb40d-4fcc-4cfc-9943-26b63085da4b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:13.834381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-115cb40d-4fcc-4cfc-9943-26b63085da4b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:14.059248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-115cb40d-4fcc-4cfc-9943-26b63085da4b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:14.070680 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-115cb40d-4fcc-4cfc-9943-26b63085da4b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1388 microversion: 2.1 time: 0.282936 Oct 18 14:01:14.082663 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3264/6328] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:13 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1388 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:14.103311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-03d983b2-66c4-412e-86e3-6790985c742f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:14.103932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-03d983b2-66c4-412e-86e3-6790985c742f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:14.115808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03d983b2-66c4-412e-86e3-6790985c742f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:14.116943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03d983b2-66c4-412e-86e3-6790985c742f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:14.117837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03d983b2-66c4-412e-86e3-6790985c742f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:14.118811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03d983b2-66c4-412e-86e3-6790985c742f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:14.119500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03d983b2-66c4-412e-86e3-6790985c742f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:14.120158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03d983b2-66c4-412e-86e3-6790985c742f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:14.332935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-03d983b2-66c4-412e-86e3-6790985c742f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:14.343699 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-03d983b2-66c4-412e-86e3-6790985c742f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1388 microversion: 2.1 time: 0.244360 Oct 18 14:01:14.344138 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3065/6329] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:14 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1388 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:14.367366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac06f726-d687-4ecb-8dae-489e3d0c819f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:14.367992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ac06f726-d687-4ecb-8dae-489e3d0c819f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:14.375994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac06f726-d687-4ecb-8dae-489e3d0c819f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:14.376939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac06f726-d687-4ecb-8dae-489e3d0c819f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:14.377867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac06f726-d687-4ecb-8dae-489e3d0c819f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:14.379063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac06f726-d687-4ecb-8dae-489e3d0c819f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:14.379168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac06f726-d687-4ecb-8dae-489e3d0c819f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:14.379541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac06f726-d687-4ecb-8dae-489e3d0c819f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:14.566413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0df46053-be97-4e90-8189-c61fdbafc56c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:14.567359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0df46053-be97-4e90-8189-c61fdbafc56c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:14.570032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ac06f726-d687-4ecb-8dae-489e3d0c819f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:14.580350 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ac06f726-d687-4ecb-8dae-489e3d0c819f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1388 microversion: 2.1 time: 0.216849 Oct 18 14:01:14.581637 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3265/6330] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:14 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1388 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:14.592467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0df46053-be97-4e90-8189-c61fdbafc56c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:14.592467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0df46053-be97-4e90-8189-c61fdbafc56c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:14.593234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0df46053-be97-4e90-8189-c61fdbafc56c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:14.593462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0df46053-be97-4e90-8189-c61fdbafc56c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:14.594141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0df46053-be97-4e90-8189-c61fdbafc56c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:14.594766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0df46053-be97-4e90-8189-c61fdbafc56c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:14.610555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2bb738bf-4349-4677-a866-09326d6a6c13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:14.611062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2bb738bf-4349-4677-a866-09326d6a6c13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:14.618599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bb738bf-4349-4677-a866-09326d6a6c13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:14.619106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bb738bf-4349-4677-a866-09326d6a6c13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:14.619612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bb738bf-4349-4677-a866-09326d6a6c13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:14.620328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bb738bf-4349-4677-a866-09326d6a6c13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:14.620790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bb738bf-4349-4677-a866-09326d6a6c13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:14.621236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2bb738bf-4349-4677-a866-09326d6a6c13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:14.666334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2bb738bf-4349-4677-a866-09326d6a6c13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:01:14.685083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0df46053-be97-4e90-8189-c61fdbafc56c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:14.693046 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0df46053-be97-4e90-8189-c61fdbafc56c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1316 microversion: 2.1 time: 0.138388 Oct 18 14:01:14.693672 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3066/6331] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:14 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1316 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:14.757549 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2bb738bf-4349-4677-a866-09326d6a6c13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 204 len: 0 microversion: 2.1 time: 0.151128 Oct 18 14:01:14.758155 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3266/6332] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:01:14 2022] DELETE /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:01:14.766444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0de2e9c3-1488-4ffe-bcac-2cb3a1cde8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:14.767042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0de2e9c3-1488-4ffe-bcac-2cb3a1cde8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:14.774961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0de2e9c3-1488-4ffe-bcac-2cb3a1cde8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:14.775378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0de2e9c3-1488-4ffe-bcac-2cb3a1cde8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:14.775818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0de2e9c3-1488-4ffe-bcac-2cb3a1cde8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:14.776567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0de2e9c3-1488-4ffe-bcac-2cb3a1cde8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:14.777024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0de2e9c3-1488-4ffe-bcac-2cb3a1cde8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:14.777484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0de2e9c3-1488-4ffe-bcac-2cb3a1cde8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:14.917049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0de2e9c3-1488-4ffe-bcac-2cb3a1cde8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:14.927159 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0de2e9c3-1488-4ffe-bcac-2cb3a1cde8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1394 microversion: 2.1 time: 0.164620 Oct 18 14:01:14.927751 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3067/6333] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:14 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1394 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:15.718350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db964603-32e7-4c22-b0a2-5f7380fa6f45 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:15.719199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db964603-32e7-4c22-b0a2-5f7380fa6f45 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:15.726395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db964603-32e7-4c22-b0a2-5f7380fa6f45 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:15.726880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db964603-32e7-4c22-b0a2-5f7380fa6f45 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:15.727309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db964603-32e7-4c22-b0a2-5f7380fa6f45 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:15.728008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db964603-32e7-4c22-b0a2-5f7380fa6f45 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:15.728486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db964603-32e7-4c22-b0a2-5f7380fa6f45 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:15.728913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db964603-32e7-4c22-b0a2-5f7380fa6f45 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:15.860953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db964603-32e7-4c22-b0a2-5f7380fa6f45 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:15.869987 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db964603-32e7-4c22-b0a2-5f7380fa6f45 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1324 microversion: 2.1 time: 0.156132 Oct 18 14:01:15.870589 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3267/6334] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:15 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1324 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:15.954545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-62239963-e077-4e36-bde3-1c2e187ed094 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:15.955252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-62239963-e077-4e36-bde3-1c2e187ed094 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:15.963470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62239963-e077-4e36-bde3-1c2e187ed094 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:15.964621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62239963-e077-4e36-bde3-1c2e187ed094 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:15.964621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62239963-e077-4e36-bde3-1c2e187ed094 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:15.965067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62239963-e077-4e36-bde3-1c2e187ed094 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:15.966624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62239963-e077-4e36-bde3-1c2e187ed094 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:15.966624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62239963-e077-4e36-bde3-1c2e187ed094 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:16.199527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-62239963-e077-4e36-bde3-1c2e187ed094 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:16.201988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:16.209748 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-62239963-e077-4e36-bde3-1c2e187ed094 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1394 microversion: 2.1 time: 0.260281 Oct 18 14:01:16.210449 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3068/6335] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:15 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1394 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:16.894285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-12c57cce-24f4-4a8a-ad60-9ef2f35fdd55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:16.895029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-12c57cce-24f4-4a8a-ad60-9ef2f35fdd55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:16.897572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:16.903632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c57cce-24f4-4a8a-ad60-9ef2f35fdd55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:16.904188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c57cce-24f4-4a8a-ad60-9ef2f35fdd55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:16.904627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c57cce-24f4-4a8a-ad60-9ef2f35fdd55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:16.905372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c57cce-24f4-4a8a-ad60-9ef2f35fdd55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:16.905841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c57cce-24f4-4a8a-ad60-9ef2f35fdd55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:16.906275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-12c57cce-24f4-4a8a-ad60-9ef2f35fdd55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:16.978619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-12c57cce-24f4-4a8a-ad60-9ef2f35fdd55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:16.987749 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-12c57cce-24f4-4a8a-ad60-9ef2f35fdd55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1322 microversion: 2.1 time: 0.097306 Oct 18 14:01:16.988096 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3268/6336] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:16 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1322 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:17.234786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-357cdb6f-6d21-4100-9faf-18004d2cf018 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:17.235716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-357cdb6f-6d21-4100-9faf-18004d2cf018 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:17.244418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-357cdb6f-6d21-4100-9faf-18004d2cf018 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:17.245083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-357cdb6f-6d21-4100-9faf-18004d2cf018 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:17.245835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-357cdb6f-6d21-4100-9faf-18004d2cf018 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:17.246747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-357cdb6f-6d21-4100-9faf-18004d2cf018 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:17.247425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-357cdb6f-6d21-4100-9faf-18004d2cf018 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:17.247875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-357cdb6f-6d21-4100-9faf-18004d2cf018 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:17.637104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-357cdb6f-6d21-4100-9faf-18004d2cf018 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:17.647265 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-357cdb6f-6d21-4100-9faf-18004d2cf018 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1394 microversion: 2.1 time: 0.416723 Oct 18 14:01:17.647783 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3069/6337] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:17 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1394 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:17.934843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-4966bde7-8351-4d84-ba4e-c881a8ca9ecd req-0438be17-4741-4cc4-b767-4cd9c29f665c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3995e94d-4d39-4326-aa9b-e99f642dfee6", "name": "network-vif-deleted", "tag": "c5693bba-56fa-4a28-8dcd-eb7711fec77b"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:17.948128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4966bde7-8351-4d84-ba4e-c881a8ca9ecd req-0438be17-4741-4cc4-b767-4cd9c29f665c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:17.948720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4966bde7-8351-4d84-ba4e-c881a8ca9ecd req-0438be17-4741-4cc4-b767-4cd9c29f665c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:17.949254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4966bde7-8351-4d84-ba4e-c881a8ca9ecd req-0438be17-4741-4cc4-b767-4cd9c29f665c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:17.962915 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-4966bde7-8351-4d84-ba4e-c881a8ca9ecd req-0438be17-4741-4cc4-b767-4cd9c29f665c service nova] Creating event network-vif-deleted:c5693bba-56fa-4a28-8dcd-eb7711fec77b for instance 3995e94d-4d39-4326-aa9b-e99f642dfee6 on n-h1-858384-13 Oct 18 14:01:17.969504 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-4966bde7-8351-4d84-ba4e-c881a8ca9ecd req-0438be17-4741-4cc4-b767-4cd9c29f665c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038827 Oct 18 14:01:17.970266 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3269/6338] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:01:18.012753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ba00becc-9a00-468c-9cde-02e07c228b46 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:18.013876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ba00becc-9a00-468c-9cde-02e07c228b46 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:18.021748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba00becc-9a00-468c-9cde-02e07c228b46 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:18.022519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba00becc-9a00-468c-9cde-02e07c228b46 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:18.023139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba00becc-9a00-468c-9cde-02e07c228b46 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:18.024071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba00becc-9a00-468c-9cde-02e07c228b46 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:18.024699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba00becc-9a00-468c-9cde-02e07c228b46 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:18.025325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba00becc-9a00-468c-9cde-02e07c228b46 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:18.316087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ba00becc-9a00-468c-9cde-02e07c228b46 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:18.326105 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ba00becc-9a00-468c-9cde-02e07c228b46 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1390 microversion: 2.1 time: 0.317185 Oct 18 14:01:18.326885 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3070/6339] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:18 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1390 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:18.673779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a5304874-479e-44f0-abcc-a06f9ad614f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:18.674506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a5304874-479e-44f0-abcc-a06f9ad614f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:18.682488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5304874-479e-44f0-abcc-a06f9ad614f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:18.683288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5304874-479e-44f0-abcc-a06f9ad614f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:18.683859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5304874-479e-44f0-abcc-a06f9ad614f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:18.684478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5304874-479e-44f0-abcc-a06f9ad614f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:18.684976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5304874-479e-44f0-abcc-a06f9ad614f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:18.685843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5304874-479e-44f0-abcc-a06f9ad614f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:18.774298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a5304874-479e-44f0-abcc-a06f9ad614f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:18.783694 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a5304874-479e-44f0-abcc-a06f9ad614f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1187 microversion: 2.1 time: 0.114619 Oct 18 14:01:18.784392 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3270/6340] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:18 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1187 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:19.351255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6c39210a-72da-4397-b0ac-e33b329f1dba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:19.352051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6c39210a-72da-4397-b0ac-e33b329f1dba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:19.359994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c39210a-72da-4397-b0ac-e33b329f1dba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:19.360597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c39210a-72da-4397-b0ac-e33b329f1dba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:19.361426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c39210a-72da-4397-b0ac-e33b329f1dba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:19.362381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c39210a-72da-4397-b0ac-e33b329f1dba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:19.362914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c39210a-72da-4397-b0ac-e33b329f1dba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:19.363460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c39210a-72da-4397-b0ac-e33b329f1dba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:19.511702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6c39210a-72da-4397-b0ac-e33b329f1dba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:19.519966 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6c39210a-72da-4397-b0ac-e33b329f1dba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1390 microversion: 2.1 time: 0.173407 Oct 18 14:01:19.520571 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3071/6341] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:19 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:19.808633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0142f993-e09e-42c7-81cf-453572b4728e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:19.810173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0142f993-e09e-42c7-81cf-453572b4728e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:19.817810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0142f993-e09e-42c7-81cf-453572b4728e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:19.818309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0142f993-e09e-42c7-81cf-453572b4728e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:19.818747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0142f993-e09e-42c7-81cf-453572b4728e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:19.819768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0142f993-e09e-42c7-81cf-453572b4728e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:19.820231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0142f993-e09e-42c7-81cf-453572b4728e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:19.820891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0142f993-e09e-42c7-81cf-453572b4728e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:19.892003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0142f993-e09e-42c7-81cf-453572b4728e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:19.900761 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0142f993-e09e-42c7-81cf-453572b4728e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1187 microversion: 2.1 time: 0.096090 Oct 18 14:01:19.901372 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3271/6342] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:19 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:20.007247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-510f8aea-74b9-419e-b4a2-701508b45ed3 req-a10e5e1e-4fd7-48f8-bafa-54807160b361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff024001-4ca4-43af-ab54-318484d5dd12", "tag": "905cbe40-b1dc-4027-9472-7b1125b88497"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:20.026401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-510f8aea-74b9-419e-b4a2-701508b45ed3 req-a10e5e1e-4fd7-48f8-bafa-54807160b361 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:20.027399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-510f8aea-74b9-419e-b4a2-701508b45ed3 req-a10e5e1e-4fd7-48f8-bafa-54807160b361 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:20.028277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-510f8aea-74b9-419e-b4a2-701508b45ed3 req-a10e5e1e-4fd7-48f8-bafa-54807160b361 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:20.052282 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-510f8aea-74b9-419e-b4a2-701508b45ed3 req-a10e5e1e-4fd7-48f8-bafa-54807160b361 service nova] Creating event network-changed:905cbe40-b1dc-4027-9472-7b1125b88497 for instance ff024001-4ca4-43af-ab54-318484d5dd12 on n-h1-858384-13 Oct 18 14:01:20.059347 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-510f8aea-74b9-419e-b4a2-701508b45ed3 req-a10e5e1e-4fd7-48f8-bafa-54807160b361 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056303 Oct 18 14:01:20.059980 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3072/6343] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:01:20.544951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d9e0e45-e035-42cb-9759-35fde095dbf5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:20.545608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3d9e0e45-e035-42cb-9759-35fde095dbf5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:20.552765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d9e0e45-e035-42cb-9759-35fde095dbf5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:20.553290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d9e0e45-e035-42cb-9759-35fde095dbf5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:20.554262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d9e0e45-e035-42cb-9759-35fde095dbf5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:20.555002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d9e0e45-e035-42cb-9759-35fde095dbf5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:20.555468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d9e0e45-e035-42cb-9759-35fde095dbf5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:20.555903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d9e0e45-e035-42cb-9759-35fde095dbf5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:20.704131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3d9e0e45-e035-42cb-9759-35fde095dbf5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:20.714333 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3d9e0e45-e035-42cb-9759-35fde095dbf5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1390 microversion: 2.1 time: 0.172376 Oct 18 14:01:20.717567 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3272/6344] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:20 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:20.925526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dbfb9119-ae9a-4007-89db-f7c162295b3f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:20.926326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dbfb9119-ae9a-4007-89db-f7c162295b3f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:20.933264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbfb9119-ae9a-4007-89db-f7c162295b3f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:20.933760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbfb9119-ae9a-4007-89db-f7c162295b3f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:20.934198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbfb9119-ae9a-4007-89db-f7c162295b3f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:20.934912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbfb9119-ae9a-4007-89db-f7c162295b3f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:20.935397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbfb9119-ae9a-4007-89db-f7c162295b3f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:20.935804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbfb9119-ae9a-4007-89db-f7c162295b3f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:21.018423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dbfb9119-ae9a-4007-89db-f7c162295b3f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:21.028218 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dbfb9119-ae9a-4007-89db-f7c162295b3f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1187 microversion: 2.1 time: 0.107890 Oct 18 14:01:21.029113 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3073/6345] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:20 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:21.737011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-da28df00-c23c-47c3-9b10-139868c035f6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:21.738490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-da28df00-c23c-47c3-9b10-139868c035f6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:21.746905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da28df00-c23c-47c3-9b10-139868c035f6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:21.747737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da28df00-c23c-47c3-9b10-139868c035f6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:21.748642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da28df00-c23c-47c3-9b10-139868c035f6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:21.750036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da28df00-c23c-47c3-9b10-139868c035f6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:21.750974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da28df00-c23c-47c3-9b10-139868c035f6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:21.751629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-da28df00-c23c-47c3-9b10-139868c035f6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:21.926603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-da28df00-c23c-47c3-9b10-139868c035f6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:21.934829 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-da28df00-c23c-47c3-9b10-139868c035f6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1390 microversion: 2.1 time: 0.202730 Oct 18 14:01:21.935430 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3273/6346] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:21 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1390 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:22.051025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a2ed8360-08dc-42a1-9249-cf26392252f2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:22.051763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a2ed8360-08dc-42a1-9249-cf26392252f2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:22.059428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2ed8360-08dc-42a1-9249-cf26392252f2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:22.059965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2ed8360-08dc-42a1-9249-cf26392252f2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:22.060449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2ed8360-08dc-42a1-9249-cf26392252f2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:22.061323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2ed8360-08dc-42a1-9249-cf26392252f2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:22.061961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2ed8360-08dc-42a1-9249-cf26392252f2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:22.062646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2ed8360-08dc-42a1-9249-cf26392252f2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:22.132635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a2ed8360-08dc-42a1-9249-cf26392252f2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:22.141029 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a2ed8360-08dc-42a1-9249-cf26392252f2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 200 len: 1187 microversion: 2.1 time: 0.094148 Oct 18 14:01:22.141694 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3074/6347] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:22 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:22.959204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-88430f0e-08f4-4b7c-b80f-c6dd3127a2dd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:22.959843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-88430f0e-08f4-4b7c-b80f-c6dd3127a2dd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:22.967257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88430f0e-08f4-4b7c-b80f-c6dd3127a2dd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:22.967782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88430f0e-08f4-4b7c-b80f-c6dd3127a2dd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:22.968431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88430f0e-08f4-4b7c-b80f-c6dd3127a2dd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:22.969248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88430f0e-08f4-4b7c-b80f-c6dd3127a2dd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:22.969713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88430f0e-08f4-4b7c-b80f-c6dd3127a2dd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:22.970142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-88430f0e-08f4-4b7c-b80f-c6dd3127a2dd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:23.108736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-88430f0e-08f4-4b7c-b80f-c6dd3127a2dd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:23.116623 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-88430f0e-08f4-4b7c-b80f-c6dd3127a2dd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1390 microversion: 2.1 time: 0.161417 Oct 18 14:01:23.117217 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3274/6348] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:22 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:23.165648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-08a2f23c-fa18-4322-84a0-819a731bf31d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:23.166260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-08a2f23c-fa18-4322-84a0-819a731bf31d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 3995e94d-4d39-4326-aa9b-e99f642dfee6] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:23.173162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08a2f23c-fa18-4322-84a0-819a731bf31d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:23.173671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08a2f23c-fa18-4322-84a0-819a731bf31d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:23.174104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08a2f23c-fa18-4322-84a0-819a731bf31d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:23.174792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08a2f23c-fa18-4322-84a0-819a731bf31d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:23.175244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08a2f23c-fa18-4322-84a0-819a731bf31d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:23.175672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-08a2f23c-fa18-4322-84a0-819a731bf31d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:23.189464 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-08a2f23c-fa18-4322-84a0-819a731bf31d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 3995e94d-4d39-4326-aa9b-e99f642dfee6 could not be found. Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-08a2f23c-fa18-4322-84a0-819a731bf31d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 HTTP/1.1 Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 3995e94d-4d39-4326-aa9b-e99f642dfee6 could not be found. Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '3995e94d-4d39-4326-aa9b-e99f642dfee6'} Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3995e94d-4d39-4326-aa9b-e99f642dfee6 could not be found. Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3995e94d-4d39-4326-aa9b-e99f642dfee6 could not be found. Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:01:23.191113 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:01:23.197228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:23.197228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:01:23.197228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:01:23.197228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:01:23.197228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:01:23.197228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3995e94d-4d39-4326-aa9b-e99f642dfee6 could not be found. Oct 18 14:01:23.197228 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:01:23.197228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-08a2f23c-fa18-4322-84a0-819a731bf31d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 3995e94d-4d39-4326-aa9b-e99f642dfee6 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:01:23.197228 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-08a2f23c-fa18-4322-84a0-819a731bf31d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6" status: 404 len: 111 microversion: 2.1 time: 0.032063 Oct 18 14:01:23.197228 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3075/6349] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:23 2022] GET /compute/v2.1/servers/3995e94d-4d39-4326-aa9b-e99f642dfee6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:01:23.817492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7f74ff07-4914-40e2-8a80-573df6164fac req-8dec9144-66db-48f4-a270-3ddc0e15cf01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff024001-4ca4-43af-ab54-318484d5dd12", "name": "network-vif-plugged", "status": "completed", "tag": "905cbe40-b1dc-4027-9472-7b1125b88497"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:23.825656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:23.826580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:23.833461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7f74ff07-4914-40e2-8a80-573df6164fac req-8dec9144-66db-48f4-a270-3ddc0e15cf01 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:23.834125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7f74ff07-4914-40e2-8a80-573df6164fac req-8dec9144-66db-48f4-a270-3ddc0e15cf01 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:23.834561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7f74ff07-4914-40e2-8a80-573df6164fac req-8dec9144-66db-48f4-a270-3ddc0e15cf01 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:23.848304 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7f74ff07-4914-40e2-8a80-573df6164fac req-8dec9144-66db-48f4-a270-3ddc0e15cf01 service nova] Creating event network-vif-plugged:905cbe40-b1dc-4027-9472-7b1125b88497 for instance ff024001-4ca4-43af-ab54-318484d5dd12 on n-h1-858384-13 Oct 18 14:01:23.855095 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7f74ff07-4914-40e2-8a80-573df6164fac req-8dec9144-66db-48f4-a270-3ddc0e15cf01 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042468 Oct 18 14:01:23.855954 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3275/6350] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:01:24.139764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e56b5b77-f233-4f74-bc25-96209d36b7e0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:24.140407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e56b5b77-f233-4f74-bc25-96209d36b7e0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:24.142567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:24.148770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e56b5b77-f233-4f74-bc25-96209d36b7e0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:24.149200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e56b5b77-f233-4f74-bc25-96209d36b7e0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:24.149645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e56b5b77-f233-4f74-bc25-96209d36b7e0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:24.150354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e56b5b77-f233-4f74-bc25-96209d36b7e0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:24.150842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e56b5b77-f233-4f74-bc25-96209d36b7e0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:24.151269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e56b5b77-f233-4f74-bc25-96209d36b7e0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:24.289377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e56b5b77-f233-4f74-bc25-96209d36b7e0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:24.297381 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e56b5b77-f233-4f74-bc25-96209d36b7e0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1390 microversion: 2.1 time: 0.161544 Oct 18 14:01:24.299581 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3076/6351] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:24 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:25.326297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db9198a7-28fc-47fb-90fc-b46468e6c03d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:25.326727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db9198a7-28fc-47fb-90fc-b46468e6c03d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:25.332918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db9198a7-28fc-47fb-90fc-b46468e6c03d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:25.333450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db9198a7-28fc-47fb-90fc-b46468e6c03d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:25.333892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db9198a7-28fc-47fb-90fc-b46468e6c03d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:25.334586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db9198a7-28fc-47fb-90fc-b46468e6c03d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:25.335136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db9198a7-28fc-47fb-90fc-b46468e6c03d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:25.335922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db9198a7-28fc-47fb-90fc-b46468e6c03d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:25.517439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db9198a7-28fc-47fb-90fc-b46468e6c03d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:25.526222 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db9198a7-28fc-47fb-90fc-b46468e6c03d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1390 microversion: 2.1 time: 0.205917 Oct 18 14:01:25.527143 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3276/6352] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:25 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1390 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:26.550469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1a42b9ab-1ac5-4282-b8d0-e45d4c31894d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:26.551180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1a42b9ab-1ac5-4282-b8d0-e45d4c31894d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:26.555065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:26.561767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a42b9ab-1ac5-4282-b8d0-e45d4c31894d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:26.562304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a42b9ab-1ac5-4282-b8d0-e45d4c31894d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:26.562740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a42b9ab-1ac5-4282-b8d0-e45d4c31894d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:26.563558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a42b9ab-1ac5-4282-b8d0-e45d4c31894d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:26.564092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a42b9ab-1ac5-4282-b8d0-e45d4c31894d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:26.564757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a42b9ab-1ac5-4282-b8d0-e45d4c31894d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:26.761723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1a42b9ab-1ac5-4282-b8d0-e45d4c31894d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:26.773435 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1a42b9ab-1ac5-4282-b8d0-e45d4c31894d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1562 microversion: 2.1 time: 0.227109 Oct 18 14:01:26.777225 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3077/6353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:26 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:26.799780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c80ebad0-d62a-4201-a814-4ba1fb93c6ca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:26.800616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c80ebad0-d62a-4201-a814-4ba1fb93c6ca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:26.808648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c80ebad0-d62a-4201-a814-4ba1fb93c6ca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:26.809157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c80ebad0-d62a-4201-a814-4ba1fb93c6ca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:26.809654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c80ebad0-d62a-4201-a814-4ba1fb93c6ca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:26.810380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c80ebad0-d62a-4201-a814-4ba1fb93c6ca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:26.810977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c80ebad0-d62a-4201-a814-4ba1fb93c6ca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:26.811441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c80ebad0-d62a-4201-a814-4ba1fb93c6ca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:27.373747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c80ebad0-d62a-4201-a814-4ba1fb93c6ca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:27.389858 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c80ebad0-d62a-4201-a814-4ba1fb93c6ca tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1562 microversion: 2.1 time: 0.593813 Oct 18 14:01:27.390909 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3277/6354] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:26 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1562 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:28.434881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-990351879", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c38c3964-f1c4-4c71-adfa-b5866691ae5e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d0463e74-962e-46fb-9c76-86e27a0887d2"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:28.507690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] validate_networks() for [('d0463e74-962e-46fb-9c76-86e27a0887d2', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:01:29.112261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-072fac04-e38d-4798-9e99-87282c7c41ba tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:29.113703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-072fac04-e38d-4798-9e99-87282c7c41ba tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:29.125461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-072fac04-e38d-4798-9e99-87282c7c41ba tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:29.126346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-072fac04-e38d-4798-9e99-87282c7c41ba tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:29.127191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-072fac04-e38d-4798-9e99-87282c7c41ba tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:29.128452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-072fac04-e38d-4798-9e99-87282c7c41ba tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:29.129205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-072fac04-e38d-4798-9e99-87282c7c41ba tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:29.130059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-072fac04-e38d-4798-9e99-87282c7c41ba tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:29.169826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-072fac04-e38d-4798-9e99-87282c7c41ba tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:01:29.227076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:29.296704 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-072fac04-e38d-4798-9e99-87282c7c41ba tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 204 len: 0 microversion: 2.1 time: 0.189127 Oct 18 14:01:29.298083 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3278/6355] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:01:29 2022] DELETE /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:01:29.306488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-41c3944c-e4a9-4058-a5ca-144884accc3c req-1f9059ed-8862-44d8-8dc9-1b0f1282add9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2feae907-8cb2-4716-81b6-05797d06a420", "tag": "5c895f73-52cc-4d6d-a316-ac5041ceedac"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:29.324242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-41c3944c-e4a9-4058-a5ca-144884accc3c req-1f9059ed-8862-44d8-8dc9-1b0f1282add9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:29.325017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-41c3944c-e4a9-4058-a5ca-144884accc3c req-1f9059ed-8862-44d8-8dc9-1b0f1282add9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:29.326144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-41c3944c-e4a9-4058-a5ca-144884accc3c req-1f9059ed-8862-44d8-8dc9-1b0f1282add9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:29.345969 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-41c3944c-e4a9-4058-a5ca-144884accc3c req-1f9059ed-8862-44d8-8dc9-1b0f1282add9 service nova] Creating event network-changed:5c895f73-52cc-4d6d-a316-ac5041ceedac for instance 2feae907-8cb2-4716-81b6-05797d06a420 on n-h2-858384-13 Oct 18 14:01:29.352259 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-41c3944c-e4a9-4058-a5ca-144884accc3c req-1f9059ed-8862-44d8-8dc9-1b0f1282add9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052500 Oct 18 14:01:29.353416 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3279/6356] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:01:29.365458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c1a064b9-43aa-4150-b18e-d04891390647 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:29.367892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c1a064b9-43aa-4150-b18e-d04891390647 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:29.376762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1a064b9-43aa-4150-b18e-d04891390647 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:29.378232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1a064b9-43aa-4150-b18e-d04891390647 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:29.379078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1a064b9-43aa-4150-b18e-d04891390647 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:29.380328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1a064b9-43aa-4150-b18e-d04891390647 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:29.381239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1a064b9-43aa-4150-b18e-d04891390647 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:29.386844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c1a064b9-43aa-4150-b18e-d04891390647 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:29.455733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:01:29.456560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:01:29.457423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:01:29.457849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:01:29.458398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:01:29.474085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:29.474460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:29.475110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:29.476821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:29.477515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:29.478197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:29.504185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:01:29.511320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for user 1d29125d80d146749096e754db7d84d4 and project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:01:29.597459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c1a064b9-43aa-4150-b18e-d04891390647 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:29.597809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:01:29.600730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c38c3964-f1c4-4c71-adfa-b5866691ae5e',volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:01:29.614504 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c1a064b9-43aa-4150-b18e-d04891390647 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1582 microversion: 2.1 time: 0.259005 Oct 18 14:01:29.617967 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3280/6357] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:29 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1582 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:29.623959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4419b6c-b275-4fef-99e6-5c81b46f41cb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:29.624984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e4419b6c-b275-4fef-99e6-5c81b46f41cb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:29.632237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4419b6c-b275-4fef-99e6-5c81b46f41cb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:29.632638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4419b6c-b275-4fef-99e6-5c81b46f41cb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:29.633760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4419b6c-b275-4fef-99e6-5c81b46f41cb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:29.634052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4419b6c-b275-4fef-99e6-5c81b46f41cb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:29.635189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4419b6c-b275-4fef-99e6-5c81b46f41cb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:29.635717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4419b6c-b275-4fef-99e6-5c81b46f41cb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:29.812081 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-62b9034a-8466-490e-85e4-2711dd36d1f9 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.381240 Oct 18 14:01:29.813113 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3078/6358] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:01:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:01:29.820355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-3d1edd70-2a0c-402c-83b6-e6bc7b6df758 req-471ad769-0bc7-4bf4-a908-47b01136bcb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff024001-4ca4-43af-ab54-318484d5dd12", "tag": "905cbe40-b1dc-4027-9472-7b1125b88497"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:29.821227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e4419b6c-b275-4fef-99e6-5c81b46f41cb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:29.830558 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e4419b6c-b275-4fef-99e6-5c81b46f41cb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1562 microversion: 2.1 time: 0.210883 Oct 18 14:01:29.831356 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3281/6359] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:29 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1562 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:29.841971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3d1edd70-2a0c-402c-83b6-e6bc7b6df758 req-471ad769-0bc7-4bf4-a908-47b01136bcb3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:29.842725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3d1edd70-2a0c-402c-83b6-e6bc7b6df758 req-471ad769-0bc7-4bf4-a908-47b01136bcb3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:29.844354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3d1edd70-2a0c-402c-83b6-e6bc7b6df758 req-471ad769-0bc7-4bf4-a908-47b01136bcb3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:29.863114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4b0c2618-750e-427a-b81a-1f5a2354f202 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:29.865355 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-3d1edd70-2a0c-402c-83b6-e6bc7b6df758 req-471ad769-0bc7-4bf4-a908-47b01136bcb3 service nova] Creating event network-changed:905cbe40-b1dc-4027-9472-7b1125b88497 for instance ff024001-4ca4-43af-ab54-318484d5dd12 on n-h1-858384-13 Oct 18 14:01:29.867764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4b0c2618-750e-427a-b81a-1f5a2354f202 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:29.874842 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-3d1edd70-2a0c-402c-83b6-e6bc7b6df758 req-471ad769-0bc7-4bf4-a908-47b01136bcb3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060283 Oct 18 14:01:29.876956 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3079/6360] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:01:29.962532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b0c2618-750e-427a-b81a-1f5a2354f202 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:29.972296 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4b0c2618-750e-427a-b81a-1f5a2354f202 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1056 microversion: 2.1 time: 0.118871 Oct 18 14:01:29.992167 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3282/6361] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:29 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1056 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:30.645626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1a379e19-177f-4ab0-a3e2-ee1bad5dbfa2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:30.646521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1a379e19-177f-4ab0-a3e2-ee1bad5dbfa2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:30.655666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a379e19-177f-4ab0-a3e2-ee1bad5dbfa2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:30.656275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a379e19-177f-4ab0-a3e2-ee1bad5dbfa2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:30.657422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a379e19-177f-4ab0-a3e2-ee1bad5dbfa2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:30.658214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a379e19-177f-4ab0-a3e2-ee1bad5dbfa2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:30.658810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a379e19-177f-4ab0-a3e2-ee1bad5dbfa2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:30.659472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a379e19-177f-4ab0-a3e2-ee1bad5dbfa2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:31.002218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac4ede63-e9aa-4108-9d37-92de83633340 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:31.003574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ac4ede63-e9aa-4108-9d37-92de83633340 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:31.012500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac4ede63-e9aa-4108-9d37-92de83633340 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:31.013385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac4ede63-e9aa-4108-9d37-92de83633340 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:31.014060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac4ede63-e9aa-4108-9d37-92de83633340 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:31.015022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac4ede63-e9aa-4108-9d37-92de83633340 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:31.015708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac4ede63-e9aa-4108-9d37-92de83633340 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:31.016365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac4ede63-e9aa-4108-9d37-92de83633340 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:31.029015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1a379e19-177f-4ab0-a3e2-ee1bad5dbfa2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:31.041860 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1a379e19-177f-4ab0-a3e2-ee1bad5dbfa2 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1582 microversion: 2.1 time: 0.399184 Oct 18 14:01:31.041860 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3080/6362] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:30 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1582 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:31.117913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ac4ede63-e9aa-4108-9d37-92de83633340 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:31.126475 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ac4ede63-e9aa-4108-9d37-92de83633340 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1154 microversion: 2.1 time: 0.128861 Oct 18 14:01:31.127669 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3283/6363] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:30 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1154 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:31.735857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-75247459-4f7a-454a-b821-9ac0c54772de req-092b448f-d5b9-4fcd-a426-934051a7b0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2feae907-8cb2-4716-81b6-05797d06a420", "name": "network-vif-deleted", "tag": "5c895f73-52cc-4d6d-a316-ac5041ceedac"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:31.751045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-75247459-4f7a-454a-b821-9ac0c54772de req-092b448f-d5b9-4fcd-a426-934051a7b0f3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:31.751948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-75247459-4f7a-454a-b821-9ac0c54772de req-092b448f-d5b9-4fcd-a426-934051a7b0f3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:31.752722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-75247459-4f7a-454a-b821-9ac0c54772de req-092b448f-d5b9-4fcd-a426-934051a7b0f3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:31.769954 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-75247459-4f7a-454a-b821-9ac0c54772de req-092b448f-d5b9-4fcd-a426-934051a7b0f3 service nova] Creating event network-vif-deleted:5c895f73-52cc-4d6d-a316-ac5041ceedac for instance 2feae907-8cb2-4716-81b6-05797d06a420 on n-h2-858384-13 Oct 18 14:01:31.778600 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-75247459-4f7a-454a-b821-9ac0c54772de req-092b448f-d5b9-4fcd-a426-934051a7b0f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048147 Oct 18 14:01:31.779581 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3081/6364] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:01:32.088436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3095007a-38e9-4a63-9ffa-d1762b46a65b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:32.092033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3095007a-38e9-4a63-9ffa-d1762b46a65b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:32.117605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3095007a-38e9-4a63-9ffa-d1762b46a65b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:32.118122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3095007a-38e9-4a63-9ffa-d1762b46a65b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:32.118572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3095007a-38e9-4a63-9ffa-d1762b46a65b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:32.121342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3095007a-38e9-4a63-9ffa-d1762b46a65b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:32.122264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3095007a-38e9-4a63-9ffa-d1762b46a65b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:32.122390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3095007a-38e9-4a63-9ffa-d1762b46a65b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:32.162440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-517a382b-f24e-47da-9ff6-18231922c7c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:32.163515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-517a382b-f24e-47da-9ff6-18231922c7c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:32.181492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-517a382b-f24e-47da-9ff6-18231922c7c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:32.183175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-517a382b-f24e-47da-9ff6-18231922c7c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:32.183849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-517a382b-f24e-47da-9ff6-18231922c7c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:32.184800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-517a382b-f24e-47da-9ff6-18231922c7c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:32.188087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-517a382b-f24e-47da-9ff6-18231922c7c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:32.188801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-517a382b-f24e-47da-9ff6-18231922c7c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:32.386814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3095007a-38e9-4a63-9ffa-d1762b46a65b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:32.400099 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3095007a-38e9-4a63-9ffa-d1762b46a65b tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1228 microversion: 2.1 time: 0.331648 Oct 18 14:01:32.401327 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3284/6365] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:32 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1228 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:32.484312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-517a382b-f24e-47da-9ff6-18231922c7c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:32.493325 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-517a382b-f24e-47da-9ff6-18231922c7c4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1214 microversion: 2.1 time: 0.339836 Oct 18 14:01:32.494130 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3082/6366] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:32 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1214 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:33.025027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3c686d8e-86e3-4724-8888-c854d5548e75 req-1abafb9a-4712-4c85-8ddb-ed48a62b975e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09913496-f71f-4103-8108-7aeeffabac0a", "tag": "7d300c1c-3412-460c-b312-ecd79da63982"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:33.035301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3c686d8e-86e3-4724-8888-c854d5548e75 req-1abafb9a-4712-4c85-8ddb-ed48a62b975e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:33.036039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3c686d8e-86e3-4724-8888-c854d5548e75 req-1abafb9a-4712-4c85-8ddb-ed48a62b975e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:33.036772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3c686d8e-86e3-4724-8888-c854d5548e75 req-1abafb9a-4712-4c85-8ddb-ed48a62b975e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:33.051179 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3c686d8e-86e3-4724-8888-c854d5548e75 req-1abafb9a-4712-4c85-8ddb-ed48a62b975e service nova] Creating event network-changed:7d300c1c-3412-460c-b312-ecd79da63982 for instance 09913496-f71f-4103-8108-7aeeffabac0a on n-h2-858384-13 Oct 18 14:01:33.058240 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3c686d8e-86e3-4724-8888-c854d5548e75 req-1abafb9a-4712-4c85-8ddb-ed48a62b975e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036942 Oct 18 14:01:33.059603 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3285/6367] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:01:33.426809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dd76c9ad-a49d-432e-98d3-250cdbf17e72 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:33.428201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dd76c9ad-a49d-432e-98d3-250cdbf17e72 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:33.438337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd76c9ad-a49d-432e-98d3-250cdbf17e72 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:33.440168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd76c9ad-a49d-432e-98d3-250cdbf17e72 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:33.440791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd76c9ad-a49d-432e-98d3-250cdbf17e72 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:33.442185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd76c9ad-a49d-432e-98d3-250cdbf17e72 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:33.443068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd76c9ad-a49d-432e-98d3-250cdbf17e72 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:33.444705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd76c9ad-a49d-432e-98d3-250cdbf17e72 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:33.517789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc07456b-e9a6-4faf-bab6-591886832955 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:33.519211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bc07456b-e9a6-4faf-bab6-591886832955 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:33.531459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dd76c9ad-a49d-432e-98d3-250cdbf17e72 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:33.540337 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dd76c9ad-a49d-432e-98d3-250cdbf17e72 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1228 microversion: 2.1 time: 0.118192 Oct 18 14:01:33.541218 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3083/6368] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:33 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1228 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:33.541869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc07456b-e9a6-4faf-bab6-591886832955 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:33.542861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc07456b-e9a6-4faf-bab6-591886832955 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:33.543660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc07456b-e9a6-4faf-bab6-591886832955 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:33.544724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc07456b-e9a6-4faf-bab6-591886832955 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:33.545237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc07456b-e9a6-4faf-bab6-591886832955 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:33.558051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc07456b-e9a6-4faf-bab6-591886832955 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:33.837809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bc07456b-e9a6-4faf-bab6-591886832955 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:33.846767 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bc07456b-e9a6-4faf-bab6-591886832955 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1214 microversion: 2.1 time: 0.333457 Oct 18 14:01:33.847631 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3286/6369] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:33 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1214 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:34.568590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-01a27863-954c-4b3d-b0c7-0fbe502c57bf tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:34.570097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-01a27863-954c-4b3d-b0c7-0fbe502c57bf tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:34.577746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01a27863-954c-4b3d-b0c7-0fbe502c57bf tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:34.578238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01a27863-954c-4b3d-b0c7-0fbe502c57bf tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:34.578679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01a27863-954c-4b3d-b0c7-0fbe502c57bf tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:34.579418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01a27863-954c-4b3d-b0c7-0fbe502c57bf tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:34.579873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01a27863-954c-4b3d-b0c7-0fbe502c57bf tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:34.580305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01a27863-954c-4b3d-b0c7-0fbe502c57bf tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:34.665924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-01a27863-954c-4b3d-b0c7-0fbe502c57bf tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:34.675610 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-01a27863-954c-4b3d-b0c7-0fbe502c57bf tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1228 microversion: 2.1 time: 0.111269 Oct 18 14:01:34.676656 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3084/6370] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:34 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1228 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:34.871241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8ef7bdd-6297-425c-8f39-72ed6040865e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:34.871832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8ef7bdd-6297-425c-8f39-72ed6040865e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:34.879028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8ef7bdd-6297-425c-8f39-72ed6040865e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:34.879513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8ef7bdd-6297-425c-8f39-72ed6040865e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:34.879944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8ef7bdd-6297-425c-8f39-72ed6040865e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:34.880636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8ef7bdd-6297-425c-8f39-72ed6040865e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:34.881093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8ef7bdd-6297-425c-8f39-72ed6040865e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:34.881571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8ef7bdd-6297-425c-8f39-72ed6040865e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:35.022495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b8ef7bdd-6297-425c-8f39-72ed6040865e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:35.035169 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8ef7bdd-6297-425c-8f39-72ed6040865e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1214 microversion: 2.1 time: 0.167983 Oct 18 14:01:35.035769 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3287/6371] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:34 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:35.702184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7c6101e-c322-4aaa-8059-149937703830 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:35.703016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f7c6101e-c322-4aaa-8059-149937703830 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:35.709368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7c6101e-c322-4aaa-8059-149937703830 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:35.710413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7c6101e-c322-4aaa-8059-149937703830 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:35.710842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7c6101e-c322-4aaa-8059-149937703830 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:35.711527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7c6101e-c322-4aaa-8059-149937703830 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:35.711972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7c6101e-c322-4aaa-8059-149937703830 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:35.712390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7c6101e-c322-4aaa-8059-149937703830 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:35.775452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f7c6101e-c322-4aaa-8059-149937703830 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4667690f67b4436b32931d9fd3b59c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c17a79a36964518b5004272fc84fa57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:35.783514 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f7c6101e-c322-4aaa-8059-149937703830 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 200 len: 1228 microversion: 2.1 time: 0.085580 Oct 18 14:01:35.784095 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3085/6372] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:35 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 1228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:36.059560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9118c406-f5ef-42c2-9b2c-5056d15838e6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:36.060214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9118c406-f5ef-42c2-9b2c-5056d15838e6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:36.067862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9118c406-f5ef-42c2-9b2c-5056d15838e6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:36.068349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9118c406-f5ef-42c2-9b2c-5056d15838e6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:36.068780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9118c406-f5ef-42c2-9b2c-5056d15838e6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:36.070189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9118c406-f5ef-42c2-9b2c-5056d15838e6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:36.070653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9118c406-f5ef-42c2-9b2c-5056d15838e6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:36.071080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9118c406-f5ef-42c2-9b2c-5056d15838e6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:36.222128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9118c406-f5ef-42c2-9b2c-5056d15838e6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:36.231156 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9118c406-f5ef-42c2-9b2c-5056d15838e6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1214 microversion: 2.1 time: 0.175651 Oct 18 14:01:36.231930 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3288/6373] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:36 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:36.808032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0fbb068-2a3e-4b44-9c6a-cc6d23b82094 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:36.808645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c0fbb068-2a3e-4b44-9c6a-cc6d23b82094 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] [instance: 2feae907-8cb2-4716-81b6-05797d06a420] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:36.816079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fbb068-2a3e-4b44-9c6a-cc6d23b82094 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:36.816563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fbb068-2a3e-4b44-9c6a-cc6d23b82094 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:36.816991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fbb068-2a3e-4b44-9c6a-cc6d23b82094 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:36.817995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fbb068-2a3e-4b44-9c6a-cc6d23b82094 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:36.818442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fbb068-2a3e-4b44-9c6a-cc6d23b82094 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:36.818862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fbb068-2a3e-4b44-9c6a-cc6d23b82094 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:36.833857 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-c0fbb068-2a3e-4b44-9c6a-cc6d23b82094 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] HTTP exception thrown: Instance 2feae907-8cb2-4716-81b6-05797d06a420 could not be found. Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0fbb068-2a3e-4b44-9c6a-cc6d23b82094 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Request method failure captured: Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 HTTP/1.1 Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrDvDabMfRdDXqecc9YZD3L3QzNHzGaJUZe_dcqsDSJUAoWzsG9Xk5zMg6-kslJ3GTM-C3iE_8miGTXTSiSqDZAEHCacM8BBF19afsKZ0gU0OXknTl0_OwI-TidDx7MErDBwr8-cEed4Ko1cPAXoDeUvSAyXVMoaR9-7F3WFPS-pZIA Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 0c17a79a36964518b5004272fc84fa57 Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestVolumeBackupRestore-900983596 Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0c17a79a36964518b5004272fc84fa57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0c17a79a36964518b5004272fc84fa57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0c17a79a36964518b5004272fc84fa57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0c17a79a36964518b5004272fc84fa57"}]}] Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestVolumeBackupRestore-900983596 Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 0c17a79a36964518b5004272fc84fa57 Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestVolumeBackupRestore-900983596 Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestVolumeBackupRestore-900983596-project Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c4667690f67b4436b32931d9fd3b59c5 Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestVolumeBackupRestore-900983596-project Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 2feae907-8cb2-4716-81b6-05797d06a420 could not be found. Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '2feae907-8cb2-4716-81b6-05797d06a420'} Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2feae907-8cb2-4716-81b6-05797d06a420 could not be found. Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2feae907-8cb2-4716-81b6-05797d06a420 could not be found. Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:01:36.836325 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:01:36.841863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:01:36.841863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:01:36.841863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:01:36.841863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:01:36.841863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:01:36.841863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2feae907-8cb2-4716-81b6-05797d06a420 could not be found. Oct 18 14:01:36.841863 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:01:36.841863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0fbb068-2a3e-4b44-9c6a-cc6d23b82094 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Returning 404 to user: Instance 2feae907-8cb2-4716-81b6-05797d06a420 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:01:36.841863 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c0fbb068-2a3e-4b44-9c6a-cc6d23b82094 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420" status: 404 len: 111 microversion: 2.1 time: 0.033818 Oct 18 14:01:36.841863 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3086/6374] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:36 2022] GET /compute/v2.1/servers/2feae907-8cb2-4716-81b6-05797d06a420 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:01:37.033534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5d2035b4-7cab-4df8-ac6b-836d431e0907 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] Calling method '.version_select at 0x7ff60f823430>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:37.063287 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5d2035b4-7cab-4df8-ac6b-836d431e0907 tempest-TestVolumeBackupRestore-900983596 tempest-TestVolumeBackupRestore-900983596-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2058565145" status: 202 len: 0 microversion: 2.1 time: 0.033479 Oct 18 14:01:37.067166 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3289/6375] 10.222.0.40 () {58 vars in 1269 bytes} [Tue Oct 18 14:01:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2058565145 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:01:37.257598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-62ce6db0-7eb0-42ef-9947-02cdd33850f5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:37.258339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-62ce6db0-7eb0-42ef-9947-02cdd33850f5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:37.265095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62ce6db0-7eb0-42ef-9947-02cdd33850f5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:37.265806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62ce6db0-7eb0-42ef-9947-02cdd33850f5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:37.266361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62ce6db0-7eb0-42ef-9947-02cdd33850f5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:37.267161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62ce6db0-7eb0-42ef-9947-02cdd33850f5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:37.267676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62ce6db0-7eb0-42ef-9947-02cdd33850f5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:37.268115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62ce6db0-7eb0-42ef-9947-02cdd33850f5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:37.474741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-62ce6db0-7eb0-42ef-9947-02cdd33850f5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:37.484214 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-62ce6db0-7eb0-42ef-9947-02cdd33850f5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1214 microversion: 2.1 time: 0.232774 Oct 18 14:01:37.484785 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3087/6376] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:37 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1214 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:38.508003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb8cf0a2-4ee0-48e4-9dfc-9875067c9948 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:38.508849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cb8cf0a2-4ee0-48e4-9dfc-9875067c9948 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:38.517081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb8cf0a2-4ee0-48e4-9dfc-9875067c9948 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:38.517667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb8cf0a2-4ee0-48e4-9dfc-9875067c9948 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:38.521405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb8cf0a2-4ee0-48e4-9dfc-9875067c9948 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:38.522955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb8cf0a2-4ee0-48e4-9dfc-9875067c9948 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:38.523732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb8cf0a2-4ee0-48e4-9dfc-9875067c9948 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:38.524265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb8cf0a2-4ee0-48e4-9dfc-9875067c9948 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:38.682360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cb8cf0a2-4ee0-48e4-9dfc-9875067c9948 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:38.691493 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cb8cf0a2-4ee0-48e4-9dfc-9875067c9948 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1214 microversion: 2.1 time: 0.188293 Oct 18 14:01:38.692305 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3290/6377] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:38 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:39.716573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9f84ae86-84cd-4e50-b1b3-411e51a25479 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:39.716573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9f84ae86-84cd-4e50-b1b3-411e51a25479 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:39.719032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:39.719704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:39.725828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f84ae86-84cd-4e50-b1b3-411e51a25479 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:39.726191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f84ae86-84cd-4e50-b1b3-411e51a25479 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:39.728300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f84ae86-84cd-4e50-b1b3-411e51a25479 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:39.728300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f84ae86-84cd-4e50-b1b3-411e51a25479 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:39.728300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f84ae86-84cd-4e50-b1b3-411e51a25479 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:39.728300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f84ae86-84cd-4e50-b1b3-411e51a25479 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:39.919164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9f84ae86-84cd-4e50-b1b3-411e51a25479 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:39.934246 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9f84ae86-84cd-4e50-b1b3-411e51a25479 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1214 microversion: 2.1 time: 0.222571 Oct 18 14:01:39.949139 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3088/6378] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:39 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1214 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:40.958763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-09c1bddb-0f81-48d6-8891-f577a8697f7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:40.960668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-09c1bddb-0f81-48d6-8891-f577a8697f7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:40.968097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:40.970582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09c1bddb-0f81-48d6-8891-f577a8697f7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:40.971251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09c1bddb-0f81-48d6-8891-f577a8697f7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:40.971907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09c1bddb-0f81-48d6-8891-f577a8697f7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:40.972984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09c1bddb-0f81-48d6-8891-f577a8697f7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:40.973649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09c1bddb-0f81-48d6-8891-f577a8697f7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:40.974225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-09c1bddb-0f81-48d6-8891-f577a8697f7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:41.191811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-09c1bddb-0f81-48d6-8891-f577a8697f7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:41.207588 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-09c1bddb-0f81-48d6-8891-f577a8697f7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1214 microversion: 2.1 time: 0.252734 Oct 18 14:01:41.208594 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3291/6379] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:40 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1214 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:42.237430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d5fe8cc9-b35f-4240-a6e2-8d200154443f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:42.238433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d5fe8cc9-b35f-4240-a6e2-8d200154443f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:42.246869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5fe8cc9-b35f-4240-a6e2-8d200154443f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:42.247678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5fe8cc9-b35f-4240-a6e2-8d200154443f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:42.248335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5fe8cc9-b35f-4240-a6e2-8d200154443f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:42.249295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5fe8cc9-b35f-4240-a6e2-8d200154443f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:42.249941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5fe8cc9-b35f-4240-a6e2-8d200154443f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:42.250588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d5fe8cc9-b35f-4240-a6e2-8d200154443f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:42.268897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:42.444498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d5fe8cc9-b35f-4240-a6e2-8d200154443f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:42.454145 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d5fe8cc9-b35f-4240-a6e2-8d200154443f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1214 microversion: 2.1 time: 0.221029 Oct 18 14:01:42.470345 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3089/6380] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:42 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1214 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:43.480847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-01ec4dd0-5f31-4722-8130-e663d3e91219 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:43.481496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-01ec4dd0-5f31-4722-8130-e663d3e91219 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:43.488762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01ec4dd0-5f31-4722-8130-e663d3e91219 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:43.489293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01ec4dd0-5f31-4722-8130-e663d3e91219 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:43.489737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01ec4dd0-5f31-4722-8130-e663d3e91219 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:43.490450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01ec4dd0-5f31-4722-8130-e663d3e91219 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:43.490969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01ec4dd0-5f31-4722-8130-e663d3e91219 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:43.491695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-01ec4dd0-5f31-4722-8130-e663d3e91219 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:43.729091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-01ec4dd0-5f31-4722-8130-e663d3e91219 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:43.737329 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-01ec4dd0-5f31-4722-8130-e663d3e91219 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1202 microversion: 2.1 time: 0.260340 Oct 18 14:01:43.738110 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3292/6381] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:43 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1202 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:44.763515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-041bef33-238f-4368-9b5d-db1ab801b92f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:44.764758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-041bef33-238f-4368-9b5d-db1ab801b92f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:44.774452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-041bef33-238f-4368-9b5d-db1ab801b92f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:44.775194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-041bef33-238f-4368-9b5d-db1ab801b92f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:44.776056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-041bef33-238f-4368-9b5d-db1ab801b92f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:44.776979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-041bef33-238f-4368-9b5d-db1ab801b92f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:44.777633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-041bef33-238f-4368-9b5d-db1ab801b92f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:44.778211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-041bef33-238f-4368-9b5d-db1ab801b92f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:45.280461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-041bef33-238f-4368-9b5d-db1ab801b92f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:45.289271 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-041bef33-238f-4368-9b5d-db1ab801b92f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1202 microversion: 2.1 time: 0.530463 Oct 18 14:01:45.290165 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3090/6382] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:44 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1202 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:46.312378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dcf9b0d8-2ab4-43cd-8c57-b02481d70eb4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:46.312922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dcf9b0d8-2ab4-43cd-8c57-b02481d70eb4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:46.320374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcf9b0d8-2ab4-43cd-8c57-b02481d70eb4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:46.321015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcf9b0d8-2ab4-43cd-8c57-b02481d70eb4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:46.321499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcf9b0d8-2ab4-43cd-8c57-b02481d70eb4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:46.322238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcf9b0d8-2ab4-43cd-8c57-b02481d70eb4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:46.322704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcf9b0d8-2ab4-43cd-8c57-b02481d70eb4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:46.323135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dcf9b0d8-2ab4-43cd-8c57-b02481d70eb4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:46.481046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dcf9b0d8-2ab4-43cd-8c57-b02481d70eb4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:46.495840 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dcf9b0d8-2ab4-43cd-8c57-b02481d70eb4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1202 microversion: 2.1 time: 0.187448 Oct 18 14:01:46.496496 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3293/6383] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:46 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1202 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:47.520107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3183e8de-3297-483e-9e6c-7c225c7b9713 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:47.520727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3183e8de-3297-483e-9e6c-7c225c7b9713 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:47.528371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3183e8de-3297-483e-9e6c-7c225c7b9713 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:47.528859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3183e8de-3297-483e-9e6c-7c225c7b9713 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:47.529321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3183e8de-3297-483e-9e6c-7c225c7b9713 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:47.530084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3183e8de-3297-483e-9e6c-7c225c7b9713 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:47.530537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3183e8de-3297-483e-9e6c-7c225c7b9713 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:47.530964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3183e8de-3297-483e-9e6c-7c225c7b9713 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:47.685403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3183e8de-3297-483e-9e6c-7c225c7b9713 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:47.701860 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3183e8de-3297-483e-9e6c-7c225c7b9713 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1202 microversion: 2.1 time: 0.185565 Oct 18 14:01:47.702707 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3091/6384] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:47 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1202 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:48.728882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-161d3e27-10e4-41dc-a937-9a4789280848 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:48.729650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-161d3e27-10e4-41dc-a937-9a4789280848 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:48.739392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:48.742703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-161d3e27-10e4-41dc-a937-9a4789280848 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:48.743826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-161d3e27-10e4-41dc-a937-9a4789280848 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:48.744790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-161d3e27-10e4-41dc-a937-9a4789280848 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:48.745761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-161d3e27-10e4-41dc-a937-9a4789280848 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:48.746253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-161d3e27-10e4-41dc-a937-9a4789280848 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:48.746822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-161d3e27-10e4-41dc-a937-9a4789280848 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:48.896187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-161d3e27-10e4-41dc-a937-9a4789280848 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:48.904671 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-161d3e27-10e4-41dc-a937-9a4789280848 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1202 microversion: 2.1 time: 0.180391 Oct 18 14:01:48.905282 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3294/6385] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:48 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1202 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:49.929614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bc5976e7-c5c5-43de-b488-60910e3ceca0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:49.930900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bc5976e7-c5c5-43de-b488-60910e3ceca0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:49.939106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc5976e7-c5c5-43de-b488-60910e3ceca0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:49.939900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc5976e7-c5c5-43de-b488-60910e3ceca0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:49.940415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc5976e7-c5c5-43de-b488-60910e3ceca0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:49.941359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc5976e7-c5c5-43de-b488-60910e3ceca0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:49.942054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc5976e7-c5c5-43de-b488-60910e3ceca0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:49.942617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc5976e7-c5c5-43de-b488-60910e3ceca0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:50.111654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bc5976e7-c5c5-43de-b488-60910e3ceca0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:50.131327 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bc5976e7-c5c5-43de-b488-60910e3ceca0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1202 microversion: 2.1 time: 0.205773 Oct 18 14:01:50.132485 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3092/6386] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:49 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1202 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:51.156231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-77f16a23-993c-4c0f-8627-93cc106470c2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:51.157534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-77f16a23-993c-4c0f-8627-93cc106470c2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:51.167064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77f16a23-993c-4c0f-8627-93cc106470c2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:51.167849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77f16a23-993c-4c0f-8627-93cc106470c2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:51.168657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77f16a23-993c-4c0f-8627-93cc106470c2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:51.169607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77f16a23-993c-4c0f-8627-93cc106470c2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:51.170496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77f16a23-993c-4c0f-8627-93cc106470c2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:51.170935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77f16a23-993c-4c0f-8627-93cc106470c2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:51.337072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-77f16a23-993c-4c0f-8627-93cc106470c2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:51.346960 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-77f16a23-993c-4c0f-8627-93cc106470c2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1202 microversion: 2.1 time: 0.194466 Oct 18 14:01:51.347636 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3295/6387] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:51 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1202 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:51.919402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-777f388c-56ee-41c6-8544-1be2412f128b req-3b4b18c6-ef0a-4064-b657-86b9976f1409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09913496-f71f-4103-8108-7aeeffabac0a", "name": "network-vif-plugged", "status": "completed", "tag": "7d300c1c-3412-460c-b312-ecd79da63982"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:51.932227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-777f388c-56ee-41c6-8544-1be2412f128b req-3b4b18c6-ef0a-4064-b657-86b9976f1409 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:51.932797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-777f388c-56ee-41c6-8544-1be2412f128b req-3b4b18c6-ef0a-4064-b657-86b9976f1409 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:51.933257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-777f388c-56ee-41c6-8544-1be2412f128b req-3b4b18c6-ef0a-4064-b657-86b9976f1409 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:51.945433 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-777f388c-56ee-41c6-8544-1be2412f128b req-3b4b18c6-ef0a-4064-b657-86b9976f1409 service nova] Creating event network-vif-plugged:7d300c1c-3412-460c-b312-ecd79da63982 for instance 09913496-f71f-4103-8108-7aeeffabac0a on n-h2-858384-13 Oct 18 14:01:51.950950 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-777f388c-56ee-41c6-8544-1be2412f128b req-3b4b18c6-ef0a-4064-b657-86b9976f1409 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036000 Oct 18 14:01:51.951576 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3093/6388] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:01:52.374614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-705705fe-3473-4dc9-839d-c64d54cefc3b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:52.375231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-705705fe-3473-4dc9-839d-c64d54cefc3b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:52.382303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-705705fe-3473-4dc9-839d-c64d54cefc3b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:52.382796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-705705fe-3473-4dc9-839d-c64d54cefc3b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:52.383229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-705705fe-3473-4dc9-839d-c64d54cefc3b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:52.383925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-705705fe-3473-4dc9-839d-c64d54cefc3b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:52.384379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-705705fe-3473-4dc9-839d-c64d54cefc3b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:52.384809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-705705fe-3473-4dc9-839d-c64d54cefc3b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:52.526482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-705705fe-3473-4dc9-839d-c64d54cefc3b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:52.534317 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-705705fe-3473-4dc9-839d-c64d54cefc3b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1202 microversion: 2.1 time: 0.163701 Oct 18 14:01:52.534906 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3296/6389] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:52 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:53.559074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ba863e22-beda-459e-9124-0a4b71f69d39 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:53.559802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ba863e22-beda-459e-9124-0a4b71f69d39 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:53.567148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba863e22-beda-459e-9124-0a4b71f69d39 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:53.567627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba863e22-beda-459e-9124-0a4b71f69d39 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:53.568321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba863e22-beda-459e-9124-0a4b71f69d39 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:53.569199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba863e22-beda-459e-9124-0a4b71f69d39 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:53.569731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba863e22-beda-459e-9124-0a4b71f69d39 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:53.570221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ba863e22-beda-459e-9124-0a4b71f69d39 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:53.703264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ba863e22-beda-459e-9124-0a4b71f69d39 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:53.711513 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ba863e22-beda-459e-9124-0a4b71f69d39 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1389 microversion: 2.1 time: 0.156845 Oct 18 14:01:53.712307 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3094/6390] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:53 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:53.737492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7430bffb-55e8-4e19-8bb2-faf4747a5e44 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:53.738220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7430bffb-55e8-4e19-8bb2-faf4747a5e44 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:53.745850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7430bffb-55e8-4e19-8bb2-faf4747a5e44 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:53.746369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7430bffb-55e8-4e19-8bb2-faf4747a5e44 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:53.747038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7430bffb-55e8-4e19-8bb2-faf4747a5e44 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:53.748344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7430bffb-55e8-4e19-8bb2-faf4747a5e44 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:53.748801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7430bffb-55e8-4e19-8bb2-faf4747a5e44 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:53.749581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7430bffb-55e8-4e19-8bb2-faf4747a5e44 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:53.887975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7430bffb-55e8-4e19-8bb2-faf4747a5e44 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:53.896193 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7430bffb-55e8-4e19-8bb2-faf4747a5e44 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1389 microversion: 2.1 time: 0.164515 Oct 18 14:01:53.896780 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3297/6391] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:53 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:53.918431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2fc99007-dfcb-41f0-9b3f-ede229785147 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:53.919084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2fc99007-dfcb-41f0-9b3f-ede229785147 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:53.925244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fc99007-dfcb-41f0-9b3f-ede229785147 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:53.925736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fc99007-dfcb-41f0-9b3f-ede229785147 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:53.926176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fc99007-dfcb-41f0-9b3f-ede229785147 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:53.926875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fc99007-dfcb-41f0-9b3f-ede229785147 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:53.927333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fc99007-dfcb-41f0-9b3f-ede229785147 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:53.927760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fc99007-dfcb-41f0-9b3f-ede229785147 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:54.067757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2fc99007-dfcb-41f0-9b3f-ede229785147 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:54.076901 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2fc99007-dfcb-41f0-9b3f-ede229785147 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1389 microversion: 2.1 time: 0.162437 Oct 18 14:01:54.077545 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3095/6392] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:53 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:54.101137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d06ef436-6231-4098-a112-fca603fc7469 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:54.101715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d06ef436-6231-4098-a112-fca603fc7469 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:54.107938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d06ef436-6231-4098-a112-fca603fc7469 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:54.108476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d06ef436-6231-4098-a112-fca603fc7469 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:54.108869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d06ef436-6231-4098-a112-fca603fc7469 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:54.109613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d06ef436-6231-4098-a112-fca603fc7469 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:54.110072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d06ef436-6231-4098-a112-fca603fc7469 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:54.110499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d06ef436-6231-4098-a112-fca603fc7469 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:54.113309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:54.137534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d06ef436-6231-4098-a112-fca603fc7469 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:01:54.214591 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d06ef436-6231-4098-a112-fca603fc7469 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "DELETE /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 204 len: 0 microversion: 2.1 time: 0.118009 Oct 18 14:01:54.215650 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3298/6393] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:01:54 2022] DELETE /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:01:54.223821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-56b918e0-ba28-489f-bbdf-27a0a0472996 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:54.224459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-56b918e0-ba28-489f-bbdf-27a0a0472996 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:54.231398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56b918e0-ba28-489f-bbdf-27a0a0472996 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:54.231887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56b918e0-ba28-489f-bbdf-27a0a0472996 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:54.232319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56b918e0-ba28-489f-bbdf-27a0a0472996 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:54.233004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56b918e0-ba28-489f-bbdf-27a0a0472996 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:54.233506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56b918e0-ba28-489f-bbdf-27a0a0472996 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:54.233928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56b918e0-ba28-489f-bbdf-27a0a0472996 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:54.369615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-56b918e0-ba28-489f-bbdf-27a0a0472996 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:54.377820 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-56b918e0-ba28-489f-bbdf-27a0a0472996 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1395 microversion: 2.1 time: 0.157894 Oct 18 14:01:54.378408 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3096/6394] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:54 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1395 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:55.401110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-047a7ecd-c402-4379-b051-eb620d393679 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:55.401749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-047a7ecd-c402-4379-b051-eb620d393679 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:55.409552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-047a7ecd-c402-4379-b051-eb620d393679 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:55.410030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-047a7ecd-c402-4379-b051-eb620d393679 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:55.410470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-047a7ecd-c402-4379-b051-eb620d393679 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:55.411179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-047a7ecd-c402-4379-b051-eb620d393679 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:55.411616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-047a7ecd-c402-4379-b051-eb620d393679 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:55.412040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-047a7ecd-c402-4379-b051-eb620d393679 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:55.553057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-047a7ecd-c402-4379-b051-eb620d393679 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:55.562052 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-047a7ecd-c402-4379-b051-eb620d393679 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1395 microversion: 2.1 time: 0.165312 Oct 18 14:01:55.562641 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3299/6395] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:55 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1395 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:56.117592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-df2d00cd-644a-4dda-8dbd-87742e9dd0bc req-3948cdd8-49f3-46c9-9f4f-fba9e5932895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09913496-f71f-4103-8108-7aeeffabac0a", "name": "network-vif-deleted", "tag": "7d300c1c-3412-460c-b312-ecd79da63982"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:01:56.128994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-df2d00cd-644a-4dda-8dbd-87742e9dd0bc req-3948cdd8-49f3-46c9-9f4f-fba9e5932895 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:56.129371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-df2d00cd-644a-4dda-8dbd-87742e9dd0bc req-3948cdd8-49f3-46c9-9f4f-fba9e5932895 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:56.129985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-df2d00cd-644a-4dda-8dbd-87742e9dd0bc req-3948cdd8-49f3-46c9-9f4f-fba9e5932895 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:56.143576 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-df2d00cd-644a-4dda-8dbd-87742e9dd0bc req-3948cdd8-49f3-46c9-9f4f-fba9e5932895 service nova] Creating event network-vif-deleted:7d300c1c-3412-460c-b312-ecd79da63982 for instance 09913496-f71f-4103-8108-7aeeffabac0a on n-h2-858384-13 Oct 18 14:01:56.150861 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-df2d00cd-644a-4dda-8dbd-87742e9dd0bc req-3948cdd8-49f3-46c9-9f4f-fba9e5932895 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037083 Oct 18 14:01:56.151709 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3097/6396] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:01:56.587147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2fe4b251-cac4-42b5-bcd3-fc7651bbcd7e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:56.587778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2fe4b251-cac4-42b5-bcd3-fc7651bbcd7e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:56.595415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fe4b251-cac4-42b5-bcd3-fc7651bbcd7e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:56.595904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fe4b251-cac4-42b5-bcd3-fc7651bbcd7e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:56.596365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fe4b251-cac4-42b5-bcd3-fc7651bbcd7e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:56.597090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fe4b251-cac4-42b5-bcd3-fc7651bbcd7e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:56.597573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fe4b251-cac4-42b5-bcd3-fc7651bbcd7e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:56.597997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2fe4b251-cac4-42b5-bcd3-fc7651bbcd7e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:56.665367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2fe4b251-cac4-42b5-bcd3-fc7651bbcd7e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:56.673347 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2fe4b251-cac4-42b5-bcd3-fc7651bbcd7e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1187 microversion: 2.1 time: 0.090833 Oct 18 14:01:56.673906 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3300/6397] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:56 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:01:57.698196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-58eb5046-2a2c-4dca-8670-04bef6d09fd6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:57.698893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-58eb5046-2a2c-4dca-8670-04bef6d09fd6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:57.701483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:01:57.706608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58eb5046-2a2c-4dca-8670-04bef6d09fd6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:57.707135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58eb5046-2a2c-4dca-8670-04bef6d09fd6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:57.707750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58eb5046-2a2c-4dca-8670-04bef6d09fd6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:57.708476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58eb5046-2a2c-4dca-8670-04bef6d09fd6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:57.708927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58eb5046-2a2c-4dca-8670-04bef6d09fd6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:57.710237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58eb5046-2a2c-4dca-8670-04bef6d09fd6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:57.786073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-58eb5046-2a2c-4dca-8670-04bef6d09fd6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:57.795574 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-58eb5046-2a2c-4dca-8670-04bef6d09fd6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1187 microversion: 2.1 time: 0.102852 Oct 18 14:01:57.796184 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3098/6398] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:57 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1187 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:58.820918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ecdd9d2b-4075-4de0-9a22-4affaf094d16 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:58.821584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ecdd9d2b-4075-4de0-9a22-4affaf094d16 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:58.829032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecdd9d2b-4075-4de0-9a22-4affaf094d16 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:58.829680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecdd9d2b-4075-4de0-9a22-4affaf094d16 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:58.830056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecdd9d2b-4075-4de0-9a22-4affaf094d16 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:58.830789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecdd9d2b-4075-4de0-9a22-4affaf094d16 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:58.831203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecdd9d2b-4075-4de0-9a22-4affaf094d16 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:58.831625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecdd9d2b-4075-4de0-9a22-4affaf094d16 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:58.901720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ecdd9d2b-4075-4de0-9a22-4affaf094d16 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:01:58.911221 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ecdd9d2b-4075-4de0-9a22-4affaf094d16 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1187 microversion: 2.1 time: 0.095409 Oct 18 14:01:58.912044 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3301/6399] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:58 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:01:59.936645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9d8c906b-e438-45e1-8e5f-e4ffd224a0e3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:01:59.937233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9d8c906b-e438-45e1-8e5f-e4ffd224a0e3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:01:59.945791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d8c906b-e438-45e1-8e5f-e4ffd224a0e3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:59.946292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d8c906b-e438-45e1-8e5f-e4ffd224a0e3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:59.946736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d8c906b-e438-45e1-8e5f-e4ffd224a0e3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:01:59.947447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d8c906b-e438-45e1-8e5f-e4ffd224a0e3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:01:59.947906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d8c906b-e438-45e1-8e5f-e4ffd224a0e3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:01:59.948337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d8c906b-e438-45e1-8e5f-e4ffd224a0e3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:00.021701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9d8c906b-e438-45e1-8e5f-e4ffd224a0e3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:00.031739 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9d8c906b-e438-45e1-8e5f-e4ffd224a0e3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 200 len: 1187 microversion: 2.1 time: 0.099165 Oct 18 14:02:00.032336 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3099/6400] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:01:59 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 1187 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:00.600814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-20e0ac6b-21e5-4fe0-8c3e-f1b90b53cbad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:00.603683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-20e0ac6b-21e5-4fe0-8c3e-f1b90b53cbad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:00.610998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20e0ac6b-21e5-4fe0-8c3e-f1b90b53cbad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:00.611478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20e0ac6b-21e5-4fe0-8c3e-f1b90b53cbad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:00.611906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20e0ac6b-21e5-4fe0-8c3e-f1b90b53cbad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:00.612604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20e0ac6b-21e5-4fe0-8c3e-f1b90b53cbad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:00.613058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20e0ac6b-21e5-4fe0-8c3e-f1b90b53cbad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:00.613502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20e0ac6b-21e5-4fe0-8c3e-f1b90b53cbad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:00.687806 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-20e0ac6b-21e5-4fe0-8c3e-f1b90b53cbad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12/action" status: 200 len: 24570 microversion: 2.1 time: 0.090998 Oct 18 14:02:00.692134 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3302/6401] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:02:00 2022] POST /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12/action => generated 24570 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:02:01.055916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-779e0111-6ee2-4f63-90b0-55bd34490b3a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:01.056584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-779e0111-6ee2-4f63-90b0-55bd34490b3a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 09913496-f71f-4103-8108-7aeeffabac0a] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:01.063837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-779e0111-6ee2-4f63-90b0-55bd34490b3a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:01.064313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-779e0111-6ee2-4f63-90b0-55bd34490b3a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:01.064743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-779e0111-6ee2-4f63-90b0-55bd34490b3a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:01.065461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-779e0111-6ee2-4f63-90b0-55bd34490b3a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:01.065910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-779e0111-6ee2-4f63-90b0-55bd34490b3a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:01.066333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-779e0111-6ee2-4f63-90b0-55bd34490b3a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:01.080631 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-779e0111-6ee2-4f63-90b0-55bd34490b3a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 09913496-f71f-4103-8108-7aeeffabac0a could not be found. Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-779e0111-6ee2-4f63-90b0-55bd34490b3a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a HTTP/1.1 Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 09913496-f71f-4103-8108-7aeeffabac0a could not be found. Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '09913496-f71f-4103-8108-7aeeffabac0a'} Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09913496-f71f-4103-8108-7aeeffabac0a could not be found. Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09913496-f71f-4103-8108-7aeeffabac0a could not be found. Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:02:01.082310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:02:01.085738 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:02:01.085738 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:02:01.085738 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:02:01.085738 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:02:01.085738 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:02:01.085738 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09913496-f71f-4103-8108-7aeeffabac0a could not be found. Oct 18 14:02:01.085738 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:02:01.085738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-779e0111-6ee2-4f63-90b0-55bd34490b3a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 09913496-f71f-4103-8108-7aeeffabac0a could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:02:01.085738 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-779e0111-6ee2-4f63-90b0-55bd34490b3a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a" status: 404 len: 111 microversion: 2.1 time: 0.032400 Oct 18 14:02:01.085738 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3100/6402] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:01 2022] GET /compute/v2.1/servers/09913496-f71f-4103-8108-7aeeffabac0a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:02:22.211359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-789389798", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6aa38ebc-8d0d-43b2-8a77-6c54c9e82ac5", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d0463e74-962e-46fb-9c76-86e27a0887d2"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:22.222399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:22.223061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:22.312435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] validate_networks() for [('d0463e74-962e-46fb-9c76-86e27a0887d2', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:02:22.813586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:02:22.814022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:02:22.814934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:02:22.814934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:02:22.815970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:02:22.825282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:22.825869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:22.826501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:22.826942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:22.827400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:22.827830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:22.845620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:02:22.852171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for user 1d29125d80d146749096e754db7d84d4 and project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:02:22.864945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:02:22.867470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='6aa38ebc-8d0d-43b2-8a77-6c54c9e82ac5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:02:22.949359 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b7688629-591d-4a32-968d-00f9ab0029b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742197 Oct 18 14:02:22.950494 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3303/6403] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:02:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:02:22.967187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-47d4a27d-4d75-4439-94c7-e2c19d8c47e5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:22.968016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-47d4a27d-4d75-4439-94c7-e2c19d8c47e5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:22.970427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=5 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:22.971102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=57 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:23.031602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-47d4a27d-4d75-4439-94c7-e2c19d8c47e5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:23.041311 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-47d4a27d-4d75-4439-94c7-e2c19d8c47e5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1056 microversion: 2.1 time: 0.078181 Oct 18 14:02:23.041895 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3101/6404] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:22 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1056 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:24.068356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c167f09-f6b0-4451-849e-522361a750a8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:24.069626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c167f09-f6b0-4451-849e-522361a750a8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:24.078079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c167f09-f6b0-4451-849e-522361a750a8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:24.078674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c167f09-f6b0-4451-849e-522361a750a8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:24.079319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c167f09-f6b0-4451-849e-522361a750a8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:24.080109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c167f09-f6b0-4451-849e-522361a750a8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:24.080631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c167f09-f6b0-4451-849e-522361a750a8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:24.081321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c167f09-f6b0-4451-849e-522361a750a8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:24.175048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3c167f09-f6b0-4451-849e-522361a750a8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:24.184071 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c167f09-f6b0-4451-849e-522361a750a8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1126 microversion: 2.1 time: 0.122195 Oct 18 14:02:24.184754 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3304/6405] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:24 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1126 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:25.212879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-69cbba52-243e-4c8c-9251-6767d15ac59a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:25.214108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-69cbba52-243e-4c8c-9251-6767d15ac59a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:25.223932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69cbba52-243e-4c8c-9251-6767d15ac59a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:25.224880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69cbba52-243e-4c8c-9251-6767d15ac59a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:25.225789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69cbba52-243e-4c8c-9251-6767d15ac59a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:25.226687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69cbba52-243e-4c8c-9251-6767d15ac59a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:25.227150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69cbba52-243e-4c8c-9251-6767d15ac59a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:25.227867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69cbba52-243e-4c8c-9251-6767d15ac59a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:25.410787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-69cbba52-243e-4c8c-9251-6767d15ac59a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:25.421843 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-69cbba52-243e-4c8c-9251-6767d15ac59a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1168 microversion: 2.1 time: 0.216205 Oct 18 14:02:25.423496 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3102/6406] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:25 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1168 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:25.846999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-2ee48be0-553d-4abb-982b-f9605541b6ae req-6f0265ca-78a8-45e1-84b0-9f481d6174dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49054fa3-bf1b-4375-9d5f-eaf5bb707e4f", "tag": "af2265fb-99e3-4ce2-a415-eaad03b990ff"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:25.863607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2ee48be0-553d-4abb-982b-f9605541b6ae req-6f0265ca-78a8-45e1-84b0-9f481d6174dd service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:25.864339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2ee48be0-553d-4abb-982b-f9605541b6ae req-6f0265ca-78a8-45e1-84b0-9f481d6174dd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:25.864991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2ee48be0-553d-4abb-982b-f9605541b6ae req-6f0265ca-78a8-45e1-84b0-9f481d6174dd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:25.879816 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-2ee48be0-553d-4abb-982b-f9605541b6ae req-6f0265ca-78a8-45e1-84b0-9f481d6174dd service nova] Creating event network-changed:af2265fb-99e3-4ce2-a415-eaad03b990ff for instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f on n-h2-858384-13 Oct 18 14:02:25.886336 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-2ee48be0-553d-4abb-982b-f9605541b6ae req-6f0265ca-78a8-45e1-84b0-9f481d6174dd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047507 Oct 18 14:02:25.887122 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3305/6407] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:02:26.447416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e0d46a1-0967-47d1-9adc-0d2df87728a6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:26.448025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1e0d46a1-0967-47d1-9adc-0d2df87728a6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:26.455897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e0d46a1-0967-47d1-9adc-0d2df87728a6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:26.456272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e0d46a1-0967-47d1-9adc-0d2df87728a6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:26.456705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e0d46a1-0967-47d1-9adc-0d2df87728a6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:26.457448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e0d46a1-0967-47d1-9adc-0d2df87728a6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:26.457899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e0d46a1-0967-47d1-9adc-0d2df87728a6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:26.458335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e0d46a1-0967-47d1-9adc-0d2df87728a6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:26.648551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1e0d46a1-0967-47d1-9adc-0d2df87728a6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:26.656888 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1e0d46a1-0967-47d1-9adc-0d2df87728a6 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1168 microversion: 2.1 time: 0.214639 Oct 18 14:02:26.657513 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3103/6408] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:26 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1168 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:27.681811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9daf0d53-a3f1-43e9-8bd2-2b9eae6b756b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:27.683129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9daf0d53-a3f1-43e9-8bd2-2b9eae6b756b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:27.691686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9daf0d53-a3f1-43e9-8bd2-2b9eae6b756b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:27.692403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9daf0d53-a3f1-43e9-8bd2-2b9eae6b756b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:27.692993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9daf0d53-a3f1-43e9-8bd2-2b9eae6b756b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:27.694588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9daf0d53-a3f1-43e9-8bd2-2b9eae6b756b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:27.695411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9daf0d53-a3f1-43e9-8bd2-2b9eae6b756b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:27.695846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9daf0d53-a3f1-43e9-8bd2-2b9eae6b756b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:27.877706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9daf0d53-a3f1-43e9-8bd2-2b9eae6b756b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:27.885949 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9daf0d53-a3f1-43e9-8bd2-2b9eae6b756b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1168 microversion: 2.1 time: 0.209222 Oct 18 14:02:27.886762 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3306/6409] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:27 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1168 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:28.911751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4031778a-bb4f-4589-860c-39d842740d05 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:28.913644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4031778a-bb4f-4589-860c-39d842740d05 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:28.931954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4031778a-bb4f-4589-860c-39d842740d05 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:28.933076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4031778a-bb4f-4589-860c-39d842740d05 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:28.933853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4031778a-bb4f-4589-860c-39d842740d05 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:28.934588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4031778a-bb4f-4589-860c-39d842740d05 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:28.935281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4031778a-bb4f-4589-860c-39d842740d05 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:28.935908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4031778a-bb4f-4589-860c-39d842740d05 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:29.142779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4031778a-bb4f-4589-860c-39d842740d05 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:29.155905 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4031778a-bb4f-4589-860c-39d842740d05 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1168 microversion: 2.1 time: 0.248122 Oct 18 14:02:29.156526 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3104/6410] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:28 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1168 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:30.183899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e85f0bef-51fd-4edd-a47f-b7706a49154c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:30.184870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e85f0bef-51fd-4edd-a47f-b7706a49154c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:30.191809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85f0bef-51fd-4edd-a47f-b7706a49154c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:30.192426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85f0bef-51fd-4edd-a47f-b7706a49154c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:30.192877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85f0bef-51fd-4edd-a47f-b7706a49154c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:30.193748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85f0bef-51fd-4edd-a47f-b7706a49154c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:30.195154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85f0bef-51fd-4edd-a47f-b7706a49154c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:30.195569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85f0bef-51fd-4edd-a47f-b7706a49154c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:30.353534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e85f0bef-51fd-4edd-a47f-b7706a49154c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:30.372261 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e85f0bef-51fd-4edd-a47f-b7706a49154c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1168 microversion: 2.1 time: 0.192130 Oct 18 14:02:30.373456 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3307/6411] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:30 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1168 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:31.078752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5ad9afab-3144-45c5-a8c0-4987b482cdc9 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:31.080392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5ad9afab-3144-45c5-a8c0-4987b482cdc9 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:31.089871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ad9afab-3144-45c5-a8c0-4987b482cdc9 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:31.090290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ad9afab-3144-45c5-a8c0-4987b482cdc9 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:31.090949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ad9afab-3144-45c5-a8c0-4987b482cdc9 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:31.091369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ad9afab-3144-45c5-a8c0-4987b482cdc9 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:31.091811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ad9afab-3144-45c5-a8c0-4987b482cdc9 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:31.092226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ad9afab-3144-45c5-a8c0-4987b482cdc9 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:31.283124 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5ad9afab-3144-45c5-a8c0-4987b482cdc9 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1833 microversion: 2.1 time: 0.210387 Oct 18 14:02:31.283800 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3105/6412] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:31 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1833 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:31.329998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3ca08c22-5f37-41f4-9188-931007183c93 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:31.331263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3ca08c22-5f37-41f4-9188-931007183c93 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:31.340623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ca08c22-5f37-41f4-9188-931007183c93 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:31.341160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ca08c22-5f37-41f4-9188-931007183c93 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:31.341628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ca08c22-5f37-41f4-9188-931007183c93 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:31.342345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ca08c22-5f37-41f4-9188-931007183c93 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:31.342804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ca08c22-5f37-41f4-9188-931007183c93 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:31.343239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ca08c22-5f37-41f4-9188-931007183c93 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:31.400903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-20388d50-ac72-42c6-8bd4-005ac727a7f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:31.401553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-20388d50-ac72-42c6-8bd4-005ac727a7f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:31.414049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20388d50-ac72-42c6-8bd4-005ac727a7f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:31.414683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20388d50-ac72-42c6-8bd4-005ac727a7f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:31.415113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20388d50-ac72-42c6-8bd4-005ac727a7f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:31.415845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20388d50-ac72-42c6-8bd4-005ac727a7f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:31.416289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20388d50-ac72-42c6-8bd4-005ac727a7f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:31.416718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20388d50-ac72-42c6-8bd4-005ac727a7f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:31.541218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ca08c22-5f37-41f4-9188-931007183c93 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:31.558771 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3ca08c22-5f37-41f4-9188-931007183c93 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1680 microversion: 2.1 time: 0.235193 Oct 18 14:02:31.565364 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3308/6413] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:31 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1680 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:31.633486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-20388d50-ac72-42c6-8bd4-005ac727a7f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:31.646155 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-20388d50-ac72-42c6-8bd4-005ac727a7f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1168 microversion: 2.1 time: 0.254542 Oct 18 14:02:31.647587 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3106/6414] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:31 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1168 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:31.708627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d4ef9526-84a5-4485-83ce-a621af7e5804 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:31.712451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d4ef9526-84a5-4485-83ce-a621af7e5804 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:31.719789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ef9526-84a5-4485-83ce-a621af7e5804 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:31.720521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ef9526-84a5-4485-83ce-a621af7e5804 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:31.721278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ef9526-84a5-4485-83ce-a621af7e5804 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:31.725529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ef9526-84a5-4485-83ce-a621af7e5804 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:31.727901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ef9526-84a5-4485-83ce-a621af7e5804 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:31.728801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4ef9526-84a5-4485-83ce-a621af7e5804 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:31.811292 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d4ef9526-84a5-4485-83ce-a621af7e5804 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12/action" status: 200 len: 32636 microversion: 2.1 time: 0.107656 Oct 18 14:02:31.821172 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3309/6415] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:02:31 2022] POST /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12/action => generated 32636 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:02:32.038252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5ee675f3-f24e-4cf5-a9c1-764f7f3ed812 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:32.038916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5ee675f3-f24e-4cf5-a9c1-764f7f3ed812 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:32.049656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ee675f3-f24e-4cf5-a9c1-764f7f3ed812 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:32.054857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ee675f3-f24e-4cf5-a9c1-764f7f3ed812 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:32.054857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ee675f3-f24e-4cf5-a9c1-764f7f3ed812 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:32.054857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ee675f3-f24e-4cf5-a9c1-764f7f3ed812 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:32.054857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ee675f3-f24e-4cf5-a9c1-764f7f3ed812 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:32.054857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ee675f3-f24e-4cf5-a9c1-764f7f3ed812 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:32.173002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5ee675f3-f24e-4cf5-a9c1-764f7f3ed812 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1ea14938d7494314bfd22a720de0cdfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d89ffa02aee43ba868ecb377bd4977e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:32.173968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5ee675f3-f24e-4cf5-a9c1-764f7f3ed812 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] flavor_id is None. Assuming migration. {{(pid=120612) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 18 14:02:32.174076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5ee675f3-f24e-4cf5-a9c1-764f7f3ed812 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120612) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:02:32.466338 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5ee675f3-f24e-4cf5-a9c1-764f7f3ed812 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12/action" status: 202 len: 0 microversion: 2.1 time: 0.435248 Oct 18 14:02:32.470631 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3107/6416] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:02:32 2022] POST /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:02:32.477857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f29bbfb2-8b62-470b-85e1-2b2aaf98c522 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:32.478570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f29bbfb2-8b62-470b-85e1-2b2aaf98c522 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:32.486927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f29bbfb2-8b62-470b-85e1-2b2aaf98c522 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:32.487451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f29bbfb2-8b62-470b-85e1-2b2aaf98c522 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:32.488270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f29bbfb2-8b62-470b-85e1-2b2aaf98c522 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:32.489192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f29bbfb2-8b62-470b-85e1-2b2aaf98c522 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:32.489801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f29bbfb2-8b62-470b-85e1-2b2aaf98c522 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:32.491123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f29bbfb2-8b62-470b-85e1-2b2aaf98c522 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:32.679579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96e93568-eee2-4b4d-9452-4d4e27430912 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:32.681986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-96e93568-eee2-4b4d-9452-4d4e27430912 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:32.690534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f29bbfb2-8b62-470b-85e1-2b2aaf98c522 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:32.691002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96e93568-eee2-4b4d-9452-4d4e27430912 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:32.691002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96e93568-eee2-4b4d-9452-4d4e27430912 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:32.691439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96e93568-eee2-4b4d-9452-4d4e27430912 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:32.692134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96e93568-eee2-4b4d-9452-4d4e27430912 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:32.692578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96e93568-eee2-4b4d-9452-4d4e27430912 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:32.693047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96e93568-eee2-4b4d-9452-4d4e27430912 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:32.702655 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f29bbfb2-8b62-470b-85e1-2b2aaf98c522 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1689 microversion: 2.1 time: 0.229604 Oct 18 14:02:32.728972 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3310/6417] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:32 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1689 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:32.868783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-96e93568-eee2-4b4d-9452-4d4e27430912 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:32.886149 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-96e93568-eee2-4b4d-9452-4d4e27430912 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1168 microversion: 2.1 time: 0.213754 Oct 18 14:02:32.904623 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3108/6418] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:32 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1168 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:33.735306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0546f352-ad93-4ea2-937a-543bf8759cf0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:33.737856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0546f352-ad93-4ea2-937a-543bf8759cf0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:33.739695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:33.740425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:33.746156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0546f352-ad93-4ea2-937a-543bf8759cf0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:33.746643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0546f352-ad93-4ea2-937a-543bf8759cf0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:33.747082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0546f352-ad93-4ea2-937a-543bf8759cf0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:33.747786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0546f352-ad93-4ea2-937a-543bf8759cf0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:33.748235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0546f352-ad93-4ea2-937a-543bf8759cf0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:33.748655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0546f352-ad93-4ea2-937a-543bf8759cf0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:33.905756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0546f352-ad93-4ea2-937a-543bf8759cf0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:33.914827 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0546f352-ad93-4ea2-937a-543bf8759cf0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1689 microversion: 2.1 time: 0.183533 Oct 18 14:02:33.916614 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3311/6419] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:33 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:33.921855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d165af8-f640-41f7-a401-81a86a592006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:33.923009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4d165af8-f640-41f7-a401-81a86a592006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:33.931251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:33.933817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d165af8-f640-41f7-a401-81a86a592006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:33.934313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d165af8-f640-41f7-a401-81a86a592006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:33.934758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d165af8-f640-41f7-a401-81a86a592006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:33.935494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d165af8-f640-41f7-a401-81a86a592006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:33.936157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d165af8-f640-41f7-a401-81a86a592006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:33.936588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d165af8-f640-41f7-a401-81a86a592006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:34.248662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4d165af8-f640-41f7-a401-81a86a592006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:34.265820 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d165af8-f640-41f7-a401-81a86a592006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1168 microversion: 2.1 time: 0.348873 Oct 18 14:02:34.281267 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3109/6420] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:33 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1168 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:34.946799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d0b7556-6c35-412c-9db6-dd372e4fb28b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:34.947425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d0b7556-6c35-412c-9db6-dd372e4fb28b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:34.956890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d0b7556-6c35-412c-9db6-dd372e4fb28b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:34.957430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d0b7556-6c35-412c-9db6-dd372e4fb28b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:34.957888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d0b7556-6c35-412c-9db6-dd372e4fb28b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:34.958635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d0b7556-6c35-412c-9db6-dd372e4fb28b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:34.959089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d0b7556-6c35-412c-9db6-dd372e4fb28b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:34.959654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d0b7556-6c35-412c-9db6-dd372e4fb28b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:35.108133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d0b7556-6c35-412c-9db6-dd372e4fb28b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:35.116658 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d0b7556-6c35-412c-9db6-dd372e4fb28b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1694 microversion: 2.1 time: 0.174494 Oct 18 14:02:35.122519 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3312/6421] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:34 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1694 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:35.291974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-52798052-1cf6-463c-ac27-b673e3823981 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:35.292828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-52798052-1cf6-463c-ac27-b673e3823981 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:35.300855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52798052-1cf6-463c-ac27-b673e3823981 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:35.301286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52798052-1cf6-463c-ac27-b673e3823981 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:35.301727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52798052-1cf6-463c-ac27-b673e3823981 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:35.302429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52798052-1cf6-463c-ac27-b673e3823981 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:35.303098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52798052-1cf6-463c-ac27-b673e3823981 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:35.303527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-52798052-1cf6-463c-ac27-b673e3823981 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:35.465627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-52798052-1cf6-463c-ac27-b673e3823981 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:35.473436 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-52798052-1cf6-463c-ac27-b673e3823981 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1168 microversion: 2.1 time: 0.185930 Oct 18 14:02:35.474013 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3110/6422] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:35 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1168 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:36.152948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f4186e1-ab6c-4bf2-af0d-247177035f6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:36.152948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9f4186e1-ab6c-4bf2-af0d-247177035f6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:36.157472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f4186e1-ab6c-4bf2-af0d-247177035f6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:36.158060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f4186e1-ab6c-4bf2-af0d-247177035f6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:36.158707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f4186e1-ab6c-4bf2-af0d-247177035f6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:36.159463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f4186e1-ab6c-4bf2-af0d-247177035f6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:36.159978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f4186e1-ab6c-4bf2-af0d-247177035f6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:36.160453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f4186e1-ab6c-4bf2-af0d-247177035f6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:36.320859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9f4186e1-ab6c-4bf2-af0d-247177035f6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:36.328939 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9f4186e1-ab6c-4bf2-af0d-247177035f6b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1694 microversion: 2.1 time: 0.184962 Oct 18 14:02:36.329599 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3313/6423] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:36 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1694 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:36.497570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f669494b-7415-470c-b088-edde23ff46e1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:36.498144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f669494b-7415-470c-b088-edde23ff46e1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:36.505619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f669494b-7415-470c-b088-edde23ff46e1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:36.506933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f669494b-7415-470c-b088-edde23ff46e1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:36.507380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f669494b-7415-470c-b088-edde23ff46e1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:36.508091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f669494b-7415-470c-b088-edde23ff46e1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:36.508571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f669494b-7415-470c-b088-edde23ff46e1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:36.508995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f669494b-7415-470c-b088-edde23ff46e1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:36.661368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f669494b-7415-470c-b088-edde23ff46e1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:36.670225 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f669494b-7415-470c-b088-edde23ff46e1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1168 microversion: 2.1 time: 0.176956 Oct 18 14:02:36.670866 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3111/6424] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:36 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1168 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:37.355889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68c7ea97-31b3-419c-80db-56aa2d3a3495 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:37.356442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-68c7ea97-31b3-419c-80db-56aa2d3a3495 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:37.364523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68c7ea97-31b3-419c-80db-56aa2d3a3495 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:37.365021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68c7ea97-31b3-419c-80db-56aa2d3a3495 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:37.365625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68c7ea97-31b3-419c-80db-56aa2d3a3495 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:37.366244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68c7ea97-31b3-419c-80db-56aa2d3a3495 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:37.366900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68c7ea97-31b3-419c-80db-56aa2d3a3495 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:37.367455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68c7ea97-31b3-419c-80db-56aa2d3a3495 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:37.538199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68c7ea97-31b3-419c-80db-56aa2d3a3495 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:37.546442 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68c7ea97-31b3-419c-80db-56aa2d3a3495 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1694 microversion: 2.1 time: 0.195139 Oct 18 14:02:37.547125 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3314/6425] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:37 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:37.696348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-522fb03c-df62-4d0a-8d1e-4e054160be9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:37.696889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-522fb03c-df62-4d0a-8d1e-4e054160be9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:37.704001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-522fb03c-df62-4d0a-8d1e-4e054160be9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:37.704486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-522fb03c-df62-4d0a-8d1e-4e054160be9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:37.704926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-522fb03c-df62-4d0a-8d1e-4e054160be9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:37.705656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-522fb03c-df62-4d0a-8d1e-4e054160be9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:37.706177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-522fb03c-df62-4d0a-8d1e-4e054160be9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:37.706610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-522fb03c-df62-4d0a-8d1e-4e054160be9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:37.848513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-522fb03c-df62-4d0a-8d1e-4e054160be9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:37.858662 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-522fb03c-df62-4d0a-8d1e-4e054160be9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1168 microversion: 2.1 time: 0.167731 Oct 18 14:02:37.859487 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3112/6426] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:37 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1168 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:38.569980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ba5bb886-6b7f-4185-b66d-a71f53ab8f59 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:38.570611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ba5bb886-6b7f-4185-b66d-a71f53ab8f59 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:38.577873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba5bb886-6b7f-4185-b66d-a71f53ab8f59 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:38.578370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba5bb886-6b7f-4185-b66d-a71f53ab8f59 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:38.578815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba5bb886-6b7f-4185-b66d-a71f53ab8f59 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:38.579541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba5bb886-6b7f-4185-b66d-a71f53ab8f59 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:38.580001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba5bb886-6b7f-4185-b66d-a71f53ab8f59 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:38.580430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ba5bb886-6b7f-4185-b66d-a71f53ab8f59 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:38.726350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ba5bb886-6b7f-4185-b66d-a71f53ab8f59 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:38.734860 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ba5bb886-6b7f-4185-b66d-a71f53ab8f59 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1694 microversion: 2.1 time: 0.169220 Oct 18 14:02:38.735453 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3315/6427] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:38 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:38.889979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7ea668d7-0e91-4dff-a2fd-04600bcb9ae8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:38.890609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7ea668d7-0e91-4dff-a2fd-04600bcb9ae8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:38.898453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ea668d7-0e91-4dff-a2fd-04600bcb9ae8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:38.898946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ea668d7-0e91-4dff-a2fd-04600bcb9ae8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:38.899471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ea668d7-0e91-4dff-a2fd-04600bcb9ae8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:38.899471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ea668d7-0e91-4dff-a2fd-04600bcb9ae8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:38.899471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ea668d7-0e91-4dff-a2fd-04600bcb9ae8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:38.899471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ea668d7-0e91-4dff-a2fd-04600bcb9ae8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:39.045701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ea668d7-0e91-4dff-a2fd-04600bcb9ae8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:39.055287 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7ea668d7-0e91-4dff-a2fd-04600bcb9ae8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1168 microversion: 2.1 time: 0.169204 Oct 18 14:02:39.056396 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3113/6428] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:38 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1168 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:39.760249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93700686-f046-49fa-8843-efaf63c43088 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:39.760893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-93700686-f046-49fa-8843-efaf63c43088 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:39.767842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93700686-f046-49fa-8843-efaf63c43088 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:39.768323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93700686-f046-49fa-8843-efaf63c43088 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:39.768755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93700686-f046-49fa-8843-efaf63c43088 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:39.769474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93700686-f046-49fa-8843-efaf63c43088 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:39.769925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93700686-f046-49fa-8843-efaf63c43088 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:39.770347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93700686-f046-49fa-8843-efaf63c43088 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:39.920711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-93700686-f046-49fa-8843-efaf63c43088 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:39.929732 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-93700686-f046-49fa-8843-efaf63c43088 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1694 microversion: 2.1 time: 0.173856 Oct 18 14:02:39.930502 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3316/6429] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:39 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:40.081452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-76b3ea74-bc6d-4816-8972-43549cdb3a22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:40.082151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-76b3ea74-bc6d-4816-8972-43549cdb3a22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:40.090733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76b3ea74-bc6d-4816-8972-43549cdb3a22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:40.091232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76b3ea74-bc6d-4816-8972-43549cdb3a22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:40.091673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76b3ea74-bc6d-4816-8972-43549cdb3a22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:40.092398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76b3ea74-bc6d-4816-8972-43549cdb3a22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:40.092836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76b3ea74-bc6d-4816-8972-43549cdb3a22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:40.093318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-76b3ea74-bc6d-4816-8972-43549cdb3a22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:40.233201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-76b3ea74-bc6d-4816-8972-43549cdb3a22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:40.241949 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-76b3ea74-bc6d-4816-8972-43549cdb3a22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1202 microversion: 2.1 time: 0.164442 Oct 18 14:02:40.242556 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3114/6430] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:40 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:40.953962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-10422cb2-a579-4080-9aba-2f6b640a195b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:40.954576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-10422cb2-a579-4080-9aba-2f6b640a195b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:40.961578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10422cb2-a579-4080-9aba-2f6b640a195b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:40.962065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10422cb2-a579-4080-9aba-2f6b640a195b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:40.962555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10422cb2-a579-4080-9aba-2f6b640a195b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:40.963273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10422cb2-a579-4080-9aba-2f6b640a195b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:40.963728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10422cb2-a579-4080-9aba-2f6b640a195b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:40.964151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-10422cb2-a579-4080-9aba-2f6b640a195b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:41.113158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-10422cb2-a579-4080-9aba-2f6b640a195b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:41.121796 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-10422cb2-a579-4080-9aba-2f6b640a195b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1694 microversion: 2.1 time: 0.171371 Oct 18 14:02:41.122404 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3317/6431] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:40 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:41.266314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d285351c-c53c-4863-a363-6717aec1a17e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:41.266873 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d285351c-c53c-4863-a363-6717aec1a17e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:41.275098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d285351c-c53c-4863-a363-6717aec1a17e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:41.275587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d285351c-c53c-4863-a363-6717aec1a17e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:41.276031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d285351c-c53c-4863-a363-6717aec1a17e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:41.276781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d285351c-c53c-4863-a363-6717aec1a17e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:41.277264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d285351c-c53c-4863-a363-6717aec1a17e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:41.277700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d285351c-c53c-4863-a363-6717aec1a17e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:41.435289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d285351c-c53c-4863-a363-6717aec1a17e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:41.445387 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d285351c-c53c-4863-a363-6717aec1a17e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1202 microversion: 2.1 time: 0.183208 Oct 18 14:02:41.446001 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3115/6432] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:41 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1202 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:42.147067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c195d36f-44e4-4534-a0a0-2fcd17256239 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:42.147917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c195d36f-44e4-4534-a0a0-2fcd17256239 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:42.156133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c195d36f-44e4-4534-a0a0-2fcd17256239 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:42.156634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c195d36f-44e4-4534-a0a0-2fcd17256239 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:42.157203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c195d36f-44e4-4534-a0a0-2fcd17256239 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:42.158125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c195d36f-44e4-4534-a0a0-2fcd17256239 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:42.158576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c195d36f-44e4-4534-a0a0-2fcd17256239 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:42.159054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c195d36f-44e4-4534-a0a0-2fcd17256239 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:42.331725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c195d36f-44e4-4534-a0a0-2fcd17256239 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:42.340636 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c195d36f-44e4-4534-a0a0-2fcd17256239 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1694 microversion: 2.1 time: 0.197896 Oct 18 14:02:42.341260 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3318/6433] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:42 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:42.471064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dd771a27-652b-43dc-ae01-0dfe6403bfda tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:42.471651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dd771a27-652b-43dc-ae01-0dfe6403bfda tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:42.480238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd771a27-652b-43dc-ae01-0dfe6403bfda tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:42.480769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd771a27-652b-43dc-ae01-0dfe6403bfda tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:42.481226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd771a27-652b-43dc-ae01-0dfe6403bfda tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:42.482026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd771a27-652b-43dc-ae01-0dfe6403bfda tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:42.482481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd771a27-652b-43dc-ae01-0dfe6403bfda tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:42.482959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dd771a27-652b-43dc-ae01-0dfe6403bfda tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:42.777878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dd771a27-652b-43dc-ae01-0dfe6403bfda tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:42.781468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:42.787711 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dd771a27-652b-43dc-ae01-0dfe6403bfda tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1202 microversion: 2.1 time: 0.320433 Oct 18 14:02:42.800724 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3116/6434] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:42 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1202 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:43.365546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-590f4408-6926-4bf5-960f-e588f5164ae7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:43.366707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-590f4408-6926-4bf5-960f-e588f5164ae7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:43.373886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-590f4408-6926-4bf5-960f-e588f5164ae7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:43.374377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-590f4408-6926-4bf5-960f-e588f5164ae7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:43.374812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-590f4408-6926-4bf5-960f-e588f5164ae7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:43.375511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-590f4408-6926-4bf5-960f-e588f5164ae7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:43.375968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-590f4408-6926-4bf5-960f-e588f5164ae7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:43.376394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-590f4408-6926-4bf5-960f-e588f5164ae7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:43.536963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-590f4408-6926-4bf5-960f-e588f5164ae7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:43.545260 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-590f4408-6926-4bf5-960f-e588f5164ae7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1694 microversion: 2.1 time: 0.183589 Oct 18 14:02:43.545857 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3319/6435] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:43 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:43.811386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c663e68e-2944-406c-90f2-c59e7c9e8629 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:43.812258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c663e68e-2944-406c-90f2-c59e7c9e8629 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:43.820888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c663e68e-2944-406c-90f2-c59e7c9e8629 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:43.821468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c663e68e-2944-406c-90f2-c59e7c9e8629 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:43.821951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c663e68e-2944-406c-90f2-c59e7c9e8629 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:43.822662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c663e68e-2944-406c-90f2-c59e7c9e8629 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:43.823135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c663e68e-2944-406c-90f2-c59e7c9e8629 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:43.823598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c663e68e-2944-406c-90f2-c59e7c9e8629 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:43.979443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c663e68e-2944-406c-90f2-c59e7c9e8629 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:43.987796 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c663e68e-2944-406c-90f2-c59e7c9e8629 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1202 microversion: 2.1 time: 0.180400 Oct 18 14:02:43.988401 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3117/6436] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:43 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1202 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:44.573472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6cb55eec-f2a5-49cb-bbad-e8f6992d501e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:44.573472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6cb55eec-f2a5-49cb-bbad-e8f6992d501e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:44.577504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cb55eec-f2a5-49cb-bbad-e8f6992d501e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:44.577996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cb55eec-f2a5-49cb-bbad-e8f6992d501e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:44.578436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cb55eec-f2a5-49cb-bbad-e8f6992d501e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:44.579136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cb55eec-f2a5-49cb-bbad-e8f6992d501e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:44.579592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cb55eec-f2a5-49cb-bbad-e8f6992d501e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:44.580022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6cb55eec-f2a5-49cb-bbad-e8f6992d501e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:44.721291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6cb55eec-f2a5-49cb-bbad-e8f6992d501e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:44.730848 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6cb55eec-f2a5-49cb-bbad-e8f6992d501e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1694 microversion: 2.1 time: 0.165407 Oct 18 14:02:44.731431 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3320/6437] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:44 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:45.013732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe2b74a3-2ab0-436a-abed-7e710dac614a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:45.014386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe2b74a3-2ab0-436a-abed-7e710dac614a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:45.021626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe2b74a3-2ab0-436a-abed-7e710dac614a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:45.022597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe2b74a3-2ab0-436a-abed-7e710dac614a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:45.023042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe2b74a3-2ab0-436a-abed-7e710dac614a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:45.023841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe2b74a3-2ab0-436a-abed-7e710dac614a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:45.024310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe2b74a3-2ab0-436a-abed-7e710dac614a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:45.024740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe2b74a3-2ab0-436a-abed-7e710dac614a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:45.162804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe2b74a3-2ab0-436a-abed-7e710dac614a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:45.171513 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fe2b74a3-2ab0-436a-abed-7e710dac614a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1202 microversion: 2.1 time: 0.161783 Oct 18 14:02:45.172122 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3118/6438] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:45 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:45.754842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7acf0b7f-1bcd-466d-9b83-3d99ae9ab551 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:45.755590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7acf0b7f-1bcd-466d-9b83-3d99ae9ab551 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:45.763712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7acf0b7f-1bcd-466d-9b83-3d99ae9ab551 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:45.764275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7acf0b7f-1bcd-466d-9b83-3d99ae9ab551 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:45.764717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7acf0b7f-1bcd-466d-9b83-3d99ae9ab551 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:45.765555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7acf0b7f-1bcd-466d-9b83-3d99ae9ab551 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:45.766022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7acf0b7f-1bcd-466d-9b83-3d99ae9ab551 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:45.766445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7acf0b7f-1bcd-466d-9b83-3d99ae9ab551 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:45.770857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:45.915627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7acf0b7f-1bcd-466d-9b83-3d99ae9ab551 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:45.923948 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7acf0b7f-1bcd-466d-9b83-3d99ae9ab551 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1694 microversion: 2.1 time: 0.173361 Oct 18 14:02:45.924685 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3321/6439] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:45 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:46.195778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eeb2abed-ccff-480f-b792-e6beb1bba14e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:46.196409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eeb2abed-ccff-480f-b792-e6beb1bba14e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:46.203928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eeb2abed-ccff-480f-b792-e6beb1bba14e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:46.204420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eeb2abed-ccff-480f-b792-e6beb1bba14e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:46.204854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eeb2abed-ccff-480f-b792-e6beb1bba14e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:46.205611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eeb2abed-ccff-480f-b792-e6beb1bba14e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:46.206065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eeb2abed-ccff-480f-b792-e6beb1bba14e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:46.206495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eeb2abed-ccff-480f-b792-e6beb1bba14e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:46.362078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eeb2abed-ccff-480f-b792-e6beb1bba14e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:46.370785 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eeb2abed-ccff-480f-b792-e6beb1bba14e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1202 microversion: 2.1 time: 0.179237 Oct 18 14:02:46.371376 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3119/6440] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:46 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1202 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:46.951877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e9f3e989-1a2f-4d70-8587-ded475aef752 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:46.952638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e9f3e989-1a2f-4d70-8587-ded475aef752 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:46.961276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9f3e989-1a2f-4d70-8587-ded475aef752 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:46.961789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9f3e989-1a2f-4d70-8587-ded475aef752 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:46.962328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9f3e989-1a2f-4d70-8587-ded475aef752 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:46.963187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9f3e989-1a2f-4d70-8587-ded475aef752 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:46.963551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9f3e989-1a2f-4d70-8587-ded475aef752 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:46.964207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e9f3e989-1a2f-4d70-8587-ded475aef752 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:47.215327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e9f3e989-1a2f-4d70-8587-ded475aef752 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:47.223744 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e9f3e989-1a2f-4d70-8587-ded475aef752 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1693 microversion: 2.1 time: 0.277098 Oct 18 14:02:47.224342 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3322/6441] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:46 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1693 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:47.395385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-14a311fe-6e8f-42fb-b303-5f0c3e5ff49e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:47.395904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-14a311fe-6e8f-42fb-b303-5f0c3e5ff49e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:47.403279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14a311fe-6e8f-42fb-b303-5f0c3e5ff49e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:47.403758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14a311fe-6e8f-42fb-b303-5f0c3e5ff49e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:47.404389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14a311fe-6e8f-42fb-b303-5f0c3e5ff49e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:47.405100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14a311fe-6e8f-42fb-b303-5f0c3e5ff49e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:47.405593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14a311fe-6e8f-42fb-b303-5f0c3e5ff49e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:47.406024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14a311fe-6e8f-42fb-b303-5f0c3e5ff49e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:47.537460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-5f9ed2f9-549f-4816-9c00-1db50fa5d0e2 req-e826f139-4322-4b03-a090-c9c233231b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff024001-4ca4-43af-ab54-318484d5dd12", "name": "network-vif-unplugged", "status": "completed", "tag": "905cbe40-b1dc-4027-9472-7b1125b88497"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:47.549342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5f9ed2f9-549f-4816-9c00-1db50fa5d0e2 req-e826f139-4322-4b03-a090-c9c233231b59 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:47.550085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5f9ed2f9-549f-4816-9c00-1db50fa5d0e2 req-e826f139-4322-4b03-a090-c9c233231b59 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:47.550558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5f9ed2f9-549f-4816-9c00-1db50fa5d0e2 req-e826f139-4322-4b03-a090-c9c233231b59 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:47.563270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-14a311fe-6e8f-42fb-b303-5f0c3e5ff49e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:47.566384 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-5f9ed2f9-549f-4816-9c00-1db50fa5d0e2 req-e826f139-4322-4b03-a090-c9c233231b59 service nova] Creating event network-vif-unplugged:905cbe40-b1dc-4027-9472-7b1125b88497 for instance ff024001-4ca4-43af-ab54-318484d5dd12 on n-h2-858384-13 Oct 18 14:02:47.573619 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-14a311fe-6e8f-42fb-b303-5f0c3e5ff49e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1202 microversion: 2.1 time: 0.182197 Oct 18 14:02:47.574318 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3120/6442] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:47 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1202 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:47.574486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [req-5f9ed2f9-549f-4816-9c00-1db50fa5d0e2 req-e826f139-4322-4b03-a090-c9c233231b59 service nova] Instance ff024001-4ca4-43af-ab54-318484d5dd12 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:02:47.595640 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-5f9ed2f9-549f-4816-9c00-1db50fa5d0e2 req-e826f139-4322-4b03-a090-c9c233231b59 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062204 Oct 18 14:02:47.596255 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3323/6443] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:02:48.213129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a4166f8c-d710-475c-acf1-ed44f061d548 req-4599697a-1dc9-4024-8a0c-e1f360653914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49054fa3-bf1b-4375-9d5f-eaf5bb707e4f", "name": "network-vif-plugged", "status": "completed", "tag": "af2265fb-99e3-4ce2-a415-eaad03b990ff"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:48.223965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a4166f8c-d710-475c-acf1-ed44f061d548 req-4599697a-1dc9-4024-8a0c-e1f360653914 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:48.224443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a4166f8c-d710-475c-acf1-ed44f061d548 req-4599697a-1dc9-4024-8a0c-e1f360653914 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:48.224868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a4166f8c-d710-475c-acf1-ed44f061d548 req-4599697a-1dc9-4024-8a0c-e1f360653914 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:48.237752 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a4166f8c-d710-475c-acf1-ed44f061d548 req-4599697a-1dc9-4024-8a0c-e1f360653914 service nova] Creating event network-vif-plugged:af2265fb-99e3-4ce2-a415-eaad03b990ff for instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f on n-h2-858384-13 Oct 18 14:02:48.248815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a7faf6a-b110-44c3-8a61-ebc631e682ad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:48.249546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1a7faf6a-b110-44c3-8a61-ebc631e682ad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:48.256703 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a4166f8c-d710-475c-acf1-ed44f061d548 req-4599697a-1dc9-4024-8a0c-e1f360653914 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047578 Oct 18 14:02:48.257342 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3121/6444] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:02:48.261336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a7faf6a-b110-44c3-8a61-ebc631e682ad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:48.262061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a7faf6a-b110-44c3-8a61-ebc631e682ad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:48.262877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a7faf6a-b110-44c3-8a61-ebc631e682ad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:48.263848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a7faf6a-b110-44c3-8a61-ebc631e682ad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:48.264627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a7faf6a-b110-44c3-8a61-ebc631e682ad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:48.265683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a7faf6a-b110-44c3-8a61-ebc631e682ad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:48.492965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1a7faf6a-b110-44c3-8a61-ebc631e682ad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:48.501591 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1a7faf6a-b110-44c3-8a61-ebc631e682ad tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1693 microversion: 2.1 time: 0.257082 Oct 18 14:02:48.502183 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3324/6445] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:48 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1693 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:48.600099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-30bad425-f322-4191-9937-a1229acaca0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:48.601808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-30bad425-f322-4191-9937-a1229acaca0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:48.608100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30bad425-f322-4191-9937-a1229acaca0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:48.608587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30bad425-f322-4191-9937-a1229acaca0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:48.609024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30bad425-f322-4191-9937-a1229acaca0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:48.609751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30bad425-f322-4191-9937-a1229acaca0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:48.610208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30bad425-f322-4191-9937-a1229acaca0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:48.610636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30bad425-f322-4191-9937-a1229acaca0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:48.761477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-30bad425-f322-4191-9937-a1229acaca0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:48.771283 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-30bad425-f322-4191-9937-a1229acaca0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1202 microversion: 2.1 time: 0.176234 Oct 18 14:02:48.771867 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3122/6446] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:48 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1202 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:49.525538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb97a28b-147f-4e1d-9ee5-ab8e88d43782 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:49.526163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cb97a28b-147f-4e1d-9ee5-ab8e88d43782 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:49.533733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb97a28b-147f-4e1d-9ee5-ab8e88d43782 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:49.534228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb97a28b-147f-4e1d-9ee5-ab8e88d43782 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:49.534694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb97a28b-147f-4e1d-9ee5-ab8e88d43782 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:49.535400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb97a28b-147f-4e1d-9ee5-ab8e88d43782 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:49.535867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb97a28b-147f-4e1d-9ee5-ab8e88d43782 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:49.536292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb97a28b-147f-4e1d-9ee5-ab8e88d43782 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:49.634529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-0fd1234a-fd1b-41dd-9413-7decafa466e2 req-b2a6bac0-68c6-425a-a20c-2ff9c1fe3560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff024001-4ca4-43af-ab54-318484d5dd12", "tag": "905cbe40-b1dc-4027-9472-7b1125b88497"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:49.645363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0fd1234a-fd1b-41dd-9413-7decafa466e2 req-b2a6bac0-68c6-425a-a20c-2ff9c1fe3560 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:49.645845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0fd1234a-fd1b-41dd-9413-7decafa466e2 req-b2a6bac0-68c6-425a-a20c-2ff9c1fe3560 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:49.646273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0fd1234a-fd1b-41dd-9413-7decafa466e2 req-b2a6bac0-68c6-425a-a20c-2ff9c1fe3560 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:49.660153 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0fd1234a-fd1b-41dd-9413-7decafa466e2 req-b2a6bac0-68c6-425a-a20c-2ff9c1fe3560 service nova] Creating event network-changed:905cbe40-b1dc-4027-9472-7b1125b88497 for instance ff024001-4ca4-43af-ab54-318484d5dd12 on n-h2-858384-13 Oct 18 14:02:49.666840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-0fd1234a-fd1b-41dd-9413-7decafa466e2 req-b2a6bac0-68c6-425a-a20c-2ff9c1fe3560 service nova] Instance ff024001-4ca4-43af-ab54-318484d5dd12 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:02:49.678006 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-0fd1234a-fd1b-41dd-9413-7decafa466e2 req-b2a6bac0-68c6-425a-a20c-2ff9c1fe3560 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048013 Oct 18 14:02:49.678929 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3123/6447] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:02:49.717125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cb97a28b-147f-4e1d-9ee5-ab8e88d43782 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:49.729876 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cb97a28b-147f-4e1d-9ee5-ab8e88d43782 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1691 microversion: 2.1 time: 0.208580 Oct 18 14:02:49.730478 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3325/6448] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:49 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1691 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:49.797654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-724c00b4-7e25-4b2f-a5a0-77b864871151 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:49.798373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-724c00b4-7e25-4b2f-a5a0-77b864871151 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:49.805134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-724c00b4-7e25-4b2f-a5a0-77b864871151 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:49.806312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-724c00b4-7e25-4b2f-a5a0-77b864871151 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:49.806809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-724c00b4-7e25-4b2f-a5a0-77b864871151 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:49.807579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-724c00b4-7e25-4b2f-a5a0-77b864871151 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:49.808037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-724c00b4-7e25-4b2f-a5a0-77b864871151 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:49.808473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-724c00b4-7e25-4b2f-a5a0-77b864871151 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:50.030581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-724c00b4-7e25-4b2f-a5a0-77b864871151 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:50.038908 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-724c00b4-7e25-4b2f-a5a0-77b864871151 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1202 microversion: 2.1 time: 0.245798 Oct 18 14:02:50.039487 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3124/6449] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:49 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1202 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:50.755189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e3942eea-9ce4-428f-b808-3236af24830f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:50.755900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e3942eea-9ce4-428f-b808-3236af24830f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:50.765119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3942eea-9ce4-428f-b808-3236af24830f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:50.765730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3942eea-9ce4-428f-b808-3236af24830f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:50.766166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3942eea-9ce4-428f-b808-3236af24830f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:50.766987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3942eea-9ce4-428f-b808-3236af24830f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:50.767442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3942eea-9ce4-428f-b808-3236af24830f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:50.767864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3942eea-9ce4-428f-b808-3236af24830f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:50.995550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e3942eea-9ce4-428f-b808-3236af24830f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:51.004981 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e3942eea-9ce4-428f-b808-3236af24830f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1688 microversion: 2.1 time: 0.253597 Oct 18 14:02:51.006058 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3326/6450] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:50 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1688 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:51.037619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b291c490-2b36-4712-9e3f-aff4c91f2d3c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:51.038325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b291c490-2b36-4712-9e3f-aff4c91f2d3c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:51.046772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b291c490-2b36-4712-9e3f-aff4c91f2d3c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.047458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b291c490-2b36-4712-9e3f-aff4c91f2d3c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.048069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b291c490-2b36-4712-9e3f-aff4c91f2d3c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:51.049034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b291c490-2b36-4712-9e3f-aff4c91f2d3c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.049685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b291c490-2b36-4712-9e3f-aff4c91f2d3c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.050175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b291c490-2b36-4712-9e3f-aff4c91f2d3c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:51.064777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cd03aa8e-6a04-42bf-8e96-419435469006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:51.065721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cd03aa8e-6a04-42bf-8e96-419435469006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:51.073344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd03aa8e-6a04-42bf-8e96-419435469006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.073929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd03aa8e-6a04-42bf-8e96-419435469006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.075510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd03aa8e-6a04-42bf-8e96-419435469006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:51.079798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd03aa8e-6a04-42bf-8e96-419435469006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.079798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd03aa8e-6a04-42bf-8e96-419435469006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.079798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cd03aa8e-6a04-42bf-8e96-419435469006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:51.196277 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b291c490-2b36-4712-9e3f-aff4c91f2d3c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12/action" status: 202 len: 0 microversion: 2.1 time: 0.164585 Oct 18 14:02:51.197125 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3125/6451] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:02:51 2022] POST /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:02:51.207608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bb617c43-6b09-439a-8236-b0067f4ec210 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:51.208471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bb617c43-6b09-439a-8236-b0067f4ec210 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:51.219381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb617c43-6b09-439a-8236-b0067f4ec210 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.220349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb617c43-6b09-439a-8236-b0067f4ec210 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.221402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb617c43-6b09-439a-8236-b0067f4ec210 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:51.222673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb617c43-6b09-439a-8236-b0067f4ec210 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.223225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb617c43-6b09-439a-8236-b0067f4ec210 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.223678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bb617c43-6b09-439a-8236-b0067f4ec210 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:51.457297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bb617c43-6b09-439a-8236-b0067f4ec210 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:51.467764 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bb617c43-6b09-439a-8236-b0067f4ec210 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1687 microversion: 2.1 time: 0.265668 Oct 18 14:02:51.468469 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3126/6452] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:51 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1687 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:51.673594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cd03aa8e-6a04-42bf-8e96-419435469006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:51.684513 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cd03aa8e-6a04-42bf-8e96-419435469006 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1388 microversion: 2.1 time: 0.623800 Oct 18 14:02:51.685616 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3327/6453] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:51 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1388 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:51.708875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-619514a8-10ed-457f-937f-6bca2eef8c27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:51.709633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-619514a8-10ed-457f-937f-6bca2eef8c27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:51.716469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-619514a8-10ed-457f-937f-6bca2eef8c27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.716919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-619514a8-10ed-457f-937f-6bca2eef8c27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.717381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-619514a8-10ed-457f-937f-6bca2eef8c27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:51.718076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-619514a8-10ed-457f-937f-6bca2eef8c27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.718523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-619514a8-10ed-457f-937f-6bca2eef8c27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.718943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-619514a8-10ed-457f-937f-6bca2eef8c27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:51.862172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-619514a8-10ed-457f-937f-6bca2eef8c27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:51.871074 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-619514a8-10ed-457f-937f-6bca2eef8c27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1388 microversion: 2.1 time: 0.166179 Oct 18 14:02:51.871668 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3127/6454] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:51 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1388 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:51.893609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a531efd0-34bf-4714-aef3-c3723e25332e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:51.894801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a531efd0-34bf-4714-aef3-c3723e25332e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:51.902818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a531efd0-34bf-4714-aef3-c3723e25332e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.903673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a531efd0-34bf-4714-aef3-c3723e25332e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.904290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a531efd0-34bf-4714-aef3-c3723e25332e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:51.905297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a531efd0-34bf-4714-aef3-c3723e25332e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:51.905762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a531efd0-34bf-4714-aef3-c3723e25332e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:51.906186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a531efd0-34bf-4714-aef3-c3723e25332e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:52.202597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a531efd0-34bf-4714-aef3-c3723e25332e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:52.211446 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a531efd0-34bf-4714-aef3-c3723e25332e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1388 microversion: 2.1 time: 0.321762 Oct 18 14:02:52.212082 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3328/6455] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:51 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1388 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:52.315260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ec549d16-5458-4b0e-941d-8dba76b5adec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:52.316406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ec549d16-5458-4b0e-941d-8dba76b5adec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:52.325313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec549d16-5458-4b0e-941d-8dba76b5adec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:52.326058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec549d16-5458-4b0e-941d-8dba76b5adec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:52.326642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec549d16-5458-4b0e-941d-8dba76b5adec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:52.327504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec549d16-5458-4b0e-941d-8dba76b5adec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:52.328098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec549d16-5458-4b0e-941d-8dba76b5adec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:52.328665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ec549d16-5458-4b0e-941d-8dba76b5adec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:52.360879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ec549d16-5458-4b0e-941d-8dba76b5adec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:02:52.473370 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ec549d16-5458-4b0e-941d-8dba76b5adec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "DELETE /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 204 len: 0 microversion: 2.1 time: 0.159451 Oct 18 14:02:52.477613 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3128/6456] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:02:52 2022] DELETE /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:02:52.486002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8d51f3ad-861d-4d27-bf35-b77bbbb1ac43 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:52.486914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8d51f3ad-861d-4d27-bf35-b77bbbb1ac43 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:52.490024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:52.493788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e83703d1-3cda-4f8f-bd05-b201ddbad1e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:52.494523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e83703d1-3cda-4f8f-bd05-b201ddbad1e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:52.497575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d51f3ad-861d-4d27-bf35-b77bbbb1ac43 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:52.498282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d51f3ad-861d-4d27-bf35-b77bbbb1ac43 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:52.498730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d51f3ad-861d-4d27-bf35-b77bbbb1ac43 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:52.499434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d51f3ad-861d-4d27-bf35-b77bbbb1ac43 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:52.500145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d51f3ad-861d-4d27-bf35-b77bbbb1ac43 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:52.500739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d51f3ad-861d-4d27-bf35-b77bbbb1ac43 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:52.501723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e83703d1-3cda-4f8f-bd05-b201ddbad1e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:52.502214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e83703d1-3cda-4f8f-bd05-b201ddbad1e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:52.502652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e83703d1-3cda-4f8f-bd05-b201ddbad1e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:52.503365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e83703d1-3cda-4f8f-bd05-b201ddbad1e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:52.503881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e83703d1-3cda-4f8f-bd05-b201ddbad1e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:52.504232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e83703d1-3cda-4f8f-bd05-b201ddbad1e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:52.663952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e83703d1-3cda-4f8f-bd05-b201ddbad1e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:52.671418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8d51f3ad-861d-4d27-bf35-b77bbbb1ac43 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:52.676616 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e83703d1-3cda-4f8f-bd05-b201ddbad1e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1687 microversion: 2.1 time: 0.187964 Oct 18 14:02:52.677679 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3129/6457] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:52 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:52.681937 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8d51f3ad-861d-4d27-bf35-b77bbbb1ac43 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1394 microversion: 2.1 time: 0.199070 Oct 18 14:02:52.689487 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3329/6458] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:52 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1394 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:53.700874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cb07407a-a1c8-417e-8cfb-920fdf82deae tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:53.701520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cb07407a-a1c8-417e-8cfb-920fdf82deae tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:53.704374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:53.706356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7cd961c7-7e5e-4866-9753-fc715b78e927 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:53.706972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7cd961c7-7e5e-4866-9753-fc715b78e927 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:53.710817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb07407a-a1c8-417e-8cfb-920fdf82deae tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:53.711315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb07407a-a1c8-417e-8cfb-920fdf82deae tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:53.711761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb07407a-a1c8-417e-8cfb-920fdf82deae tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:53.712466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb07407a-a1c8-417e-8cfb-920fdf82deae tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:53.712927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb07407a-a1c8-417e-8cfb-920fdf82deae tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:53.713396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb07407a-a1c8-417e-8cfb-920fdf82deae tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:53.716085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7cd961c7-7e5e-4866-9753-fc715b78e927 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:53.716587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7cd961c7-7e5e-4866-9753-fc715b78e927 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:53.717029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7cd961c7-7e5e-4866-9753-fc715b78e927 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:53.717752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7cd961c7-7e5e-4866-9753-fc715b78e927 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:53.718208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7cd961c7-7e5e-4866-9753-fc715b78e927 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:53.718639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7cd961c7-7e5e-4866-9753-fc715b78e927 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:53.871797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cb07407a-a1c8-417e-8cfb-920fdf82deae tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:53.879877 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cb07407a-a1c8-417e-8cfb-920fdf82deae tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1687 microversion: 2.1 time: 0.182968 Oct 18 14:02:53.883528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7cd961c7-7e5e-4866-9753-fc715b78e927 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:53.887109 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3130/6459] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:53 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1687 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:53.891975 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7cd961c7-7e5e-4866-9753-fc715b78e927 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1394 microversion: 2.1 time: 0.189870 Oct 18 14:02:53.892812 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3330/6460] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:53 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1394 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:54.235284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-3b11ff03-168b-486c-9653-7bda3aa3429e req-56b90fdc-3bf0-4ce7-aafd-54e38b97ee32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff024001-4ca4-43af-ab54-318484d5dd12", "name": "network-vif-plugged", "status": "completed", "tag": "905cbe40-b1dc-4027-9472-7b1125b88497"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:54.245972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3b11ff03-168b-486c-9653-7bda3aa3429e req-56b90fdc-3bf0-4ce7-aafd-54e38b97ee32 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:54.246700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3b11ff03-168b-486c-9653-7bda3aa3429e req-56b90fdc-3bf0-4ce7-aafd-54e38b97ee32 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:54.247079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3b11ff03-168b-486c-9653-7bda3aa3429e req-56b90fdc-3bf0-4ce7-aafd-54e38b97ee32 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:54.250291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:02:54.263222 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-3b11ff03-168b-486c-9653-7bda3aa3429e req-56b90fdc-3bf0-4ce7-aafd-54e38b97ee32 service nova] Creating event network-vif-plugged:905cbe40-b1dc-4027-9472-7b1125b88497 for instance ff024001-4ca4-43af-ab54-318484d5dd12 on n-h2-858384-13 Oct 18 14:02:54.269843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-3b11ff03-168b-486c-9653-7bda3aa3429e req-56b90fdc-3bf0-4ce7-aafd-54e38b97ee32 service nova] Instance ff024001-4ca4-43af-ab54-318484d5dd12 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:02:54.281891 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-3b11ff03-168b-486c-9653-7bda3aa3429e req-56b90fdc-3bf0-4ce7-aafd-54e38b97ee32 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050234 Oct 18 14:02:54.282522 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3131/6461] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:02:54.906394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c616761e-968c-487b-84c9-f319854a5f3e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:54.906957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c616761e-968c-487b-84c9-f319854a5f3e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:54.914379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c616761e-968c-487b-84c9-f319854a5f3e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:54.915944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c616761e-968c-487b-84c9-f319854a5f3e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:54.916412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c616761e-968c-487b-84c9-f319854a5f3e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:54.917157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c616761e-968c-487b-84c9-f319854a5f3e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:54.917644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c616761e-968c-487b-84c9-f319854a5f3e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:54.918077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c616761e-968c-487b-84c9-f319854a5f3e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:54.918969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8e46a950-7231-4536-86e1-49818a7a3d21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:54.919677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8e46a950-7231-4536-86e1-49818a7a3d21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:54.927496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e46a950-7231-4536-86e1-49818a7a3d21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:54.927993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e46a950-7231-4536-86e1-49818a7a3d21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:54.928524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e46a950-7231-4536-86e1-49818a7a3d21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:54.929637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e46a950-7231-4536-86e1-49818a7a3d21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:54.931160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e46a950-7231-4536-86e1-49818a7a3d21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:54.931370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e46a950-7231-4536-86e1-49818a7a3d21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:55.075851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c616761e-968c-487b-84c9-f319854a5f3e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:55.091016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8e46a950-7231-4536-86e1-49818a7a3d21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:55.096439 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c616761e-968c-487b-84c9-f319854a5f3e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1687 microversion: 2.1 time: 0.185604 Oct 18 14:02:55.103670 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8e46a950-7231-4536-86e1-49818a7a3d21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1394 microversion: 2.1 time: 0.189624 Oct 18 14:02:55.104233 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3132/6462] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:54 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1394 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:55.105878 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3331/6463] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:54 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1687 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:55.619840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-1eafbf43-fe9b-46e3-88db-c6f1a220ee21 req-d6097087-beb1-4e51-bf1f-1aed2d34f45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49054fa3-bf1b-4375-9d5f-eaf5bb707e4f", "name": "network-vif-deleted", "tag": "af2265fb-99e3-4ce2-a415-eaad03b990ff"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:55.644510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1eafbf43-fe9b-46e3-88db-c6f1a220ee21 req-d6097087-beb1-4e51-bf1f-1aed2d34f45c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:55.647889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1eafbf43-fe9b-46e3-88db-c6f1a220ee21 req-d6097087-beb1-4e51-bf1f-1aed2d34f45c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:55.648588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1eafbf43-fe9b-46e3-88db-c6f1a220ee21 req-d6097087-beb1-4e51-bf1f-1aed2d34f45c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:55.667035 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-1eafbf43-fe9b-46e3-88db-c6f1a220ee21 req-d6097087-beb1-4e51-bf1f-1aed2d34f45c service nova] Creating event network-vif-deleted:af2265fb-99e3-4ce2-a415-eaad03b990ff for instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f on n-h2-858384-13 Oct 18 14:02:55.674408 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-1eafbf43-fe9b-46e3-88db-c6f1a220ee21 req-d6097087-beb1-4e51-bf1f-1aed2d34f45c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058711 Oct 18 14:02:55.675400 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3133/6464] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:02:56.068837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-abb7732e-3329-45e6-810c-052d29e4e4e9 req-c040cd5d-af2b-4f11-a523-973a2673eb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff024001-4ca4-43af-ab54-318484d5dd12", "name": "network-vif-unplugged", "status": "completed", "tag": "905cbe40-b1dc-4027-9472-7b1125b88497"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:56.083373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-abb7732e-3329-45e6-810c-052d29e4e4e9 req-c040cd5d-af2b-4f11-a523-973a2673eb2e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:56.084266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-abb7732e-3329-45e6-810c-052d29e4e4e9 req-c040cd5d-af2b-4f11-a523-973a2673eb2e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:56.084921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-abb7732e-3329-45e6-810c-052d29e4e4e9 req-c040cd5d-af2b-4f11-a523-973a2673eb2e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:56.107574 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-abb7732e-3329-45e6-810c-052d29e4e4e9 req-c040cd5d-af2b-4f11-a523-973a2673eb2e service nova] Creating event network-vif-unplugged:905cbe40-b1dc-4027-9472-7b1125b88497 for instance ff024001-4ca4-43af-ab54-318484d5dd12 on n-h1-858384-13 Oct 18 14:02:56.116343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [req-abb7732e-3329-45e6-810c-052d29e4e4e9 req-c040cd5d-af2b-4f11-a523-973a2673eb2e service nova] Instance ff024001-4ca4-43af-ab54-318484d5dd12 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:02:56.128374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aac2fd7a-310e-4845-ba41-2cae5294765c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:56.129885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aac2fd7a-310e-4845-ba41-2cae5294765c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:56.138025 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-abb7732e-3329-45e6-810c-052d29e4e4e9 req-c040cd5d-af2b-4f11-a523-973a2673eb2e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073124 Oct 18 14:02:56.139151 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3332/6465] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:02:56.149556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aac2fd7a-310e-4845-ba41-2cae5294765c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:56.150183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-43f096c5-e421-4684-963f-5ad0203f6d97 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:56.150460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aac2fd7a-310e-4845-ba41-2cae5294765c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:56.150911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-43f096c5-e421-4684-963f-5ad0203f6d97 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:56.151224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aac2fd7a-310e-4845-ba41-2cae5294765c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:56.152123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aac2fd7a-310e-4845-ba41-2cae5294765c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:56.152940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aac2fd7a-310e-4845-ba41-2cae5294765c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:56.153780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aac2fd7a-310e-4845-ba41-2cae5294765c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:56.158272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43f096c5-e421-4684-963f-5ad0203f6d97 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:56.158769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43f096c5-e421-4684-963f-5ad0203f6d97 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:56.159292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43f096c5-e421-4684-963f-5ad0203f6d97 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:56.160514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43f096c5-e421-4684-963f-5ad0203f6d97 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:56.166323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43f096c5-e421-4684-963f-5ad0203f6d97 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:56.166965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43f096c5-e421-4684-963f-5ad0203f6d97 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:56.276141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-43f096c5-e421-4684-963f-5ad0203f6d97 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:56.288935 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-43f096c5-e421-4684-963f-5ad0203f6d97 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1187 microversion: 2.1 time: 0.147507 Oct 18 14:02:56.290399 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3333/6466] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:56 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1187 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:56.431972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aac2fd7a-310e-4845-ba41-2cae5294765c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:56.440606 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aac2fd7a-310e-4845-ba41-2cae5294765c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1687 microversion: 2.1 time: 0.318308 Oct 18 14:02:56.441467 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3134/6467] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:56 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1687 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:57.314323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-035a9b52-2f4c-498e-a16e-966a5723e6d5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:57.315107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-035a9b52-2f4c-498e-a16e-966a5723e6d5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:57.323317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-035a9b52-2f4c-498e-a16e-966a5723e6d5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:57.324072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-035a9b52-2f4c-498e-a16e-966a5723e6d5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:57.324576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-035a9b52-2f4c-498e-a16e-966a5723e6d5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:57.325464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-035a9b52-2f4c-498e-a16e-966a5723e6d5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:57.326262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-035a9b52-2f4c-498e-a16e-966a5723e6d5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:57.326928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-035a9b52-2f4c-498e-a16e-966a5723e6d5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:57.394530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-035a9b52-2f4c-498e-a16e-966a5723e6d5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:57.403603 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-035a9b52-2f4c-498e-a16e-966a5723e6d5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1187 microversion: 2.1 time: 0.093129 Oct 18 14:02:57.404245 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3334/6468] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:57 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:02:57.467518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-90b6860d-34fe-4d78-81af-4cc31555b252 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:57.468153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-90b6860d-34fe-4d78-81af-4cc31555b252 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:57.475744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b6860d-34fe-4d78-81af-4cc31555b252 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:57.476262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b6860d-34fe-4d78-81af-4cc31555b252 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:57.476649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b6860d-34fe-4d78-81af-4cc31555b252 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:57.477432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b6860d-34fe-4d78-81af-4cc31555b252 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:57.478001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b6860d-34fe-4d78-81af-4cc31555b252 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:57.478428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b6860d-34fe-4d78-81af-4cc31555b252 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:57.632375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-90b6860d-34fe-4d78-81af-4cc31555b252 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:57.641400 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-90b6860d-34fe-4d78-81af-4cc31555b252 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1687 microversion: 2.1 time: 0.178101 Oct 18 14:02:57.642100 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3135/6469] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:57 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:58.176805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-0d176388-2d2b-45e6-9cfa-f8044d6803e5 req-eb37bc47-a969-49bd-ab5e-cf441a8d86c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff024001-4ca4-43af-ab54-318484d5dd12", "tag": "905cbe40-b1dc-4027-9472-7b1125b88497"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:02:58.187397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0d176388-2d2b-45e6-9cfa-f8044d6803e5 req-eb37bc47-a969-49bd-ab5e-cf441a8d86c0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:58.187971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0d176388-2d2b-45e6-9cfa-f8044d6803e5 req-eb37bc47-a969-49bd-ab5e-cf441a8d86c0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:58.188494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0d176388-2d2b-45e6-9cfa-f8044d6803e5 req-eb37bc47-a969-49bd-ab5e-cf441a8d86c0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:58.201803 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-0d176388-2d2b-45e6-9cfa-f8044d6803e5 req-eb37bc47-a969-49bd-ab5e-cf441a8d86c0 service nova] Creating event network-changed:905cbe40-b1dc-4027-9472-7b1125b88497 for instance ff024001-4ca4-43af-ab54-318484d5dd12 on n-h1-858384-13 Oct 18 14:02:58.208351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [req-0d176388-2d2b-45e6-9cfa-f8044d6803e5 req-eb37bc47-a969-49bd-ab5e-cf441a8d86c0 service nova] Instance ff024001-4ca4-43af-ab54-318484d5dd12 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:02:58.220441 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-0d176388-2d2b-45e6-9cfa-f8044d6803e5 req-eb37bc47-a969-49bd-ab5e-cf441a8d86c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047513 Oct 18 14:02:58.221082 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3335/6470] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:02:58.427397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb624e32-33a6-44f9-9848-771a1e63e04f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:58.428243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb624e32-33a6-44f9-9848-771a1e63e04f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:58.435366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb624e32-33a6-44f9-9848-771a1e63e04f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:58.436097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb624e32-33a6-44f9-9848-771a1e63e04f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:58.436594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb624e32-33a6-44f9-9848-771a1e63e04f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:58.437297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb624e32-33a6-44f9-9848-771a1e63e04f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:58.437937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb624e32-33a6-44f9-9848-771a1e63e04f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:58.438434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb624e32-33a6-44f9-9848-771a1e63e04f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:58.516018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fb624e32-33a6-44f9-9848-771a1e63e04f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:58.525480 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb624e32-33a6-44f9-9848-771a1e63e04f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1187 microversion: 2.1 time: 0.102023 Oct 18 14:02:58.526341 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3136/6471] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:58 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1187 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:58.667316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2eb20f5a-b532-4fea-b5a9-40811029b5ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:58.668230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2eb20f5a-b532-4fea-b5a9-40811029b5ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:58.675780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2eb20f5a-b532-4fea-b5a9-40811029b5ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:58.676519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2eb20f5a-b532-4fea-b5a9-40811029b5ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:58.676962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2eb20f5a-b532-4fea-b5a9-40811029b5ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:58.677733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2eb20f5a-b532-4fea-b5a9-40811029b5ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:58.678194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2eb20f5a-b532-4fea-b5a9-40811029b5ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:58.678622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2eb20f5a-b532-4fea-b5a9-40811029b5ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:58.891184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2eb20f5a-b532-4fea-b5a9-40811029b5ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:58.905384 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2eb20f5a-b532-4fea-b5a9-40811029b5ba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1687 microversion: 2.1 time: 0.242805 Oct 18 14:02:58.919000 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3336/6472] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:58 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1687 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:59.553559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b2740523-86c5-40bb-a761-31522844793e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:59.554278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b2740523-86c5-40bb-a761-31522844793e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:59.562924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2740523-86c5-40bb-a761-31522844793e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:59.563424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2740523-86c5-40bb-a761-31522844793e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:59.563864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2740523-86c5-40bb-a761-31522844793e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:59.564580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2740523-86c5-40bb-a761-31522844793e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:59.565033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2740523-86c5-40bb-a761-31522844793e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:59.565558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2740523-86c5-40bb-a761-31522844793e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:59.638427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b2740523-86c5-40bb-a761-31522844793e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:02:59.647527 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b2740523-86c5-40bb-a761-31522844793e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1187 microversion: 2.1 time: 0.098008 Oct 18 14:02:59.648208 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3137/6473] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:59 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:02:59.932086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2145c3c2-48f2-48ea-9c5b-9fd9b171e332 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:02:59.933675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2145c3c2-48f2-48ea-9c5b-9fd9b171e332 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:02:59.941720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2145c3c2-48f2-48ea-9c5b-9fd9b171e332 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:59.942626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2145c3c2-48f2-48ea-9c5b-9fd9b171e332 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:59.945342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2145c3c2-48f2-48ea-9c5b-9fd9b171e332 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:02:59.948039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2145c3c2-48f2-48ea-9c5b-9fd9b171e332 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:02:59.948681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2145c3c2-48f2-48ea-9c5b-9fd9b171e332 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:02:59.949300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2145c3c2-48f2-48ea-9c5b-9fd9b171e332 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:00.185973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2145c3c2-48f2-48ea-9c5b-9fd9b171e332 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:00.194028 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2145c3c2-48f2-48ea-9c5b-9fd9b171e332 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1687 microversion: 2.1 time: 0.267404 Oct 18 14:03:00.194701 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3337/6474] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:02:59 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1687 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:00.677747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:00.678463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:00.692235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:00.693056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:00.693554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:00.694385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:00.694838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:00.695636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:00.741142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:00.741962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:00.742515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:00.743609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lazy-loading 'fault' on Instance uuid 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:03:00.811239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:00.820448 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c54907ab-2135-4fb4-94f9-3d021ab586e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 200 len: 1146 microversion: 2.1 time: 0.150770 Oct 18 14:03:00.821694 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3138/6475] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:00 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 1146 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:01.220451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-afc9a26e-f18d-45c4-9b5d-5b52133d5ffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:01.221173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-afc9a26e-f18d-45c4-9b5d-5b52133d5ffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:01.230011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afc9a26e-f18d-45c4-9b5d-5b52133d5ffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:01.230512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afc9a26e-f18d-45c4-9b5d-5b52133d5ffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:01.230953 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afc9a26e-f18d-45c4-9b5d-5b52133d5ffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:01.231681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afc9a26e-f18d-45c4-9b5d-5b52133d5ffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:01.232142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afc9a26e-f18d-45c4-9b5d-5b52133d5ffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:01.232592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afc9a26e-f18d-45c4-9b5d-5b52133d5ffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:01.415848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-afc9a26e-f18d-45c4-9b5d-5b52133d5ffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:01.419856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:01.426150 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-afc9a26e-f18d-45c4-9b5d-5b52133d5ffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1680 microversion: 2.1 time: 0.209851 Oct 18 14:03:01.426833 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3338/6476] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:01 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:01.851254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dbb852e5-1556-42db-8b89-65a108ceb2bd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:01.851922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dbb852e5-1556-42db-8b89-65a108ceb2bd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:01.860237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbb852e5-1556-42db-8b89-65a108ceb2bd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:01.860768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbb852e5-1556-42db-8b89-65a108ceb2bd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:01.861290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbb852e5-1556-42db-8b89-65a108ceb2bd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:01.862115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbb852e5-1556-42db-8b89-65a108ceb2bd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:01.862669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbb852e5-1556-42db-8b89-65a108ceb2bd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:01.863213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbb852e5-1556-42db-8b89-65a108ceb2bd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:01.880629 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-dbb852e5-1556-42db-8b89-65a108ceb2bd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dbb852e5-1556-42db-8b89-65a108ceb2bd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f HTTP/1.1 Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '49054fa3-bf1b-4375-9d5f-eaf5bb707e4f'} Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:01.882517 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:03:01.887069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:01.887069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:01.887069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:01.887069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:03:01.887069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:03:01.887069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:01.887069 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:03:01.887069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dbb852e5-1556-42db-8b89-65a108ceb2bd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:03:01.887069 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dbb852e5-1556-42db-8b89-65a108ceb2bd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 404 len: 111 microversion: 2.1 time: 0.037898 Oct 18 14:03:01.887069 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3139/6477] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:01 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:03:02.324838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-0bf4e38e-2014-49b1-815b-6f73f684ffa8 req-53b9a6d0-5faf-4632-be9b-91fc31d4a2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff024001-4ca4-43af-ab54-318484d5dd12", "name": "network-vif-plugged", "status": "completed", "tag": "905cbe40-b1dc-4027-9472-7b1125b88497"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:02.338946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0bf4e38e-2014-49b1-815b-6f73f684ffa8 req-53b9a6d0-5faf-4632-be9b-91fc31d4a2f8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:02.339141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0bf4e38e-2014-49b1-815b-6f73f684ffa8 req-53b9a6d0-5faf-4632-be9b-91fc31d4a2f8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:02.339481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0bf4e38e-2014-49b1-815b-6f73f684ffa8 req-53b9a6d0-5faf-4632-be9b-91fc31d4a2f8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:02.352951 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-0bf4e38e-2014-49b1-815b-6f73f684ffa8 req-53b9a6d0-5faf-4632-be9b-91fc31d4a2f8 service nova] Creating event network-vif-plugged:905cbe40-b1dc-4027-9472-7b1125b88497 for instance ff024001-4ca4-43af-ab54-318484d5dd12 on n-h1-858384-13 Oct 18 14:03:02.358624 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-0bf4e38e-2014-49b1-815b-6f73f684ffa8 req-53b9a6d0-5faf-4632-be9b-91fc31d4a2f8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037556 Oct 18 14:03:02.359534 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3339/6478] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:03:04.046994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-397ce366-4b61-4ca1-b294-89bbf86c3b1c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:04.048079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-397ce366-4b61-4ca1-b294-89bbf86c3b1c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:04.056995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-397ce366-4b61-4ca1-b294-89bbf86c3b1c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:04.057611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-397ce366-4b61-4ca1-b294-89bbf86c3b1c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:04.058058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-397ce366-4b61-4ca1-b294-89bbf86c3b1c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:04.058770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-397ce366-4b61-4ca1-b294-89bbf86c3b1c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:04.059224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-397ce366-4b61-4ca1-b294-89bbf86c3b1c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:04.059651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-397ce366-4b61-4ca1-b294-89bbf86c3b1c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:04.075483 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-397ce366-4b61-4ca1-b294-89bbf86c3b1c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-397ce366-4b61-4ca1-b294-89bbf86c3b1c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f HTTP/1.1 Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '49054fa3-bf1b-4375-9d5f-eaf5bb707e4f'} Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:03:04.077062 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-397ce366-4b61-4ca1-b294-89bbf86c3b1c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-397ce366-4b61-4ca1-b294-89bbf86c3b1c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "DELETE /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 404 len: 111 microversion: 2.1 time: 0.035594 Oct 18 14:03:04.080558 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3140/6479] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:03:04 2022] DELETE /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:03:04.089514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6365913b-973a-4f05-9cea-6f6edf8de0db tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:04.090834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6365913b-973a-4f05-9cea-6f6edf8de0db tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:04.097513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6365913b-973a-4f05-9cea-6f6edf8de0db tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:04.098006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6365913b-973a-4f05-9cea-6f6edf8de0db tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:04.098565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6365913b-973a-4f05-9cea-6f6edf8de0db tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:04.099142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6365913b-973a-4f05-9cea-6f6edf8de0db tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:04.099592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6365913b-973a-4f05-9cea-6f6edf8de0db tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:04.100023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6365913b-973a-4f05-9cea-6f6edf8de0db tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:04.114417 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-6365913b-973a-4f05-9cea-6f6edf8de0db tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6365913b-973a-4f05-9cea-6f6edf8de0db tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f HTTP/1.1 Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '49054fa3-bf1b-4375-9d5f-eaf5bb707e4f'} Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:04.116174 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:03:04.124362 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:04.124362 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:04.124362 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:04.124362 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:03:04.124362 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:03:04.124362 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. Oct 18 14:03:04.124362 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:03:04.124362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6365913b-973a-4f05-9cea-6f6edf8de0db tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 49054fa3-bf1b-4375-9d5f-eaf5bb707e4f could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:03:04.124362 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6365913b-973a-4f05-9cea-6f6edf8de0db tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f" status: 404 len: 111 microversion: 2.1 time: 0.034039 Oct 18 14:03:04.124362 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3340/6480] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:04 2022] GET /compute/v2.1/servers/49054fa3-bf1b-4375-9d5f-eaf5bb707e4f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:03:23.859726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-648153567", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e778a676-c00d-4ef5-8a9e-31ad303ade97", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d0463e74-962e-46fb-9c76-86e27a0887d2"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:23.871099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=23 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:23.871762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=47 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:23.927306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] validate_networks() for [('d0463e74-962e-46fb-9c76-86e27a0887d2', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:03:24.568494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:03:24.568918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:03:24.569435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:03:24.569846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:03:24.570286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:03:24.580417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:24.580889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:24.581412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:24.582133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:24.582583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:24.583007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:24.600975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:03:24.607618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for user 1d29125d80d146749096e754db7d84d4 and project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:03:24.670618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:03:24.672704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e778a676-c00d-4ef5-8a9e-31ad303ade97',volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:03:24.810220 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-af463992-157d-447a-8c07-6691b0abbbfe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954067 Oct 18 14:03:24.810806 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3141/6481] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:03:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:03:24.823013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-90a542e0-ece3-4e2b-bfbb-1b6068bc4101 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:24.823632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-90a542e0-ece3-4e2b-bfbb-1b6068bc4101 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:24.827211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=23 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:24.828049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:24.892167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-90a542e0-ece3-4e2b-bfbb-1b6068bc4101 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:24.899824 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-90a542e0-ece3-4e2b-bfbb-1b6068bc4101 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1070 microversion: 2.1 time: 0.081820 Oct 18 14:03:24.900557 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3341/6482] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:24 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1070 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:25.923946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-984f8c13-ac11-49d1-a000-dbbd3cc2d669 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:25.924585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-984f8c13-ac11-49d1-a000-dbbd3cc2d669 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:25.931304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-984f8c13-ac11-49d1-a000-dbbd3cc2d669 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:25.931847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-984f8c13-ac11-49d1-a000-dbbd3cc2d669 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:25.932288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-984f8c13-ac11-49d1-a000-dbbd3cc2d669 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:25.932998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-984f8c13-ac11-49d1-a000-dbbd3cc2d669 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:25.933538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-984f8c13-ac11-49d1-a000-dbbd3cc2d669 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:25.933972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-984f8c13-ac11-49d1-a000-dbbd3cc2d669 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:26.007602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-984f8c13-ac11-49d1-a000-dbbd3cc2d669 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:26.019159 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-984f8c13-ac11-49d1-a000-dbbd3cc2d669 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1186 microversion: 2.1 time: 0.098916 Oct 18 14:03:26.019790 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3142/6483] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:25 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1186 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:27.045572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4b34ccfa-190d-4117-a983-972af6a61e27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:27.047025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4b34ccfa-190d-4117-a983-972af6a61e27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:27.059949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b34ccfa-190d-4117-a983-972af6a61e27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:27.060449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b34ccfa-190d-4117-a983-972af6a61e27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:27.060889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b34ccfa-190d-4117-a983-972af6a61e27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:27.061812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b34ccfa-190d-4117-a983-972af6a61e27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:27.062292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b34ccfa-190d-4117-a983-972af6a61e27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:27.062707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4b34ccfa-190d-4117-a983-972af6a61e27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:27.268322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4b34ccfa-190d-4117-a983-972af6a61e27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:27.277568 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4b34ccfa-190d-4117-a983-972af6a61e27 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1228 microversion: 2.1 time: 0.237302 Oct 18 14:03:27.286540 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3342/6484] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:27 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1228 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:27.376880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-11c5c615-7059-41c2-989f-233eafbd2642 req-0bcd2b76-fdbe-4184-b10b-18ba4eb1810e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07c7e580-e9c9-4b7f-b3a0-c00742fea035", "tag": "8deb68a0-939d-4ce9-b2c1-db0f3a52da0f"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:27.395620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-11c5c615-7059-41c2-989f-233eafbd2642 req-0bcd2b76-fdbe-4184-b10b-18ba4eb1810e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:27.396342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-11c5c615-7059-41c2-989f-233eafbd2642 req-0bcd2b76-fdbe-4184-b10b-18ba4eb1810e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:27.403536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-11c5c615-7059-41c2-989f-233eafbd2642 req-0bcd2b76-fdbe-4184-b10b-18ba4eb1810e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:27.421808 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-11c5c615-7059-41c2-989f-233eafbd2642 req-0bcd2b76-fdbe-4184-b10b-18ba4eb1810e service nova] Creating event network-changed:8deb68a0-939d-4ce9-b2c1-db0f3a52da0f for instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 on n-h2-858384-13 Oct 18 14:03:27.427473 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-11c5c615-7059-41c2-989f-233eafbd2642 req-0bcd2b76-fdbe-4184-b10b-18ba4eb1810e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058397 Oct 18 14:03:27.428115 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3143/6485] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:03:28.300365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d5f23a03-ede6-4db0-b059-2846fbc10962 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:28.300968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d5f23a03-ede6-4db0-b059-2846fbc10962 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:28.309258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5f23a03-ede6-4db0-b059-2846fbc10962 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:28.310102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5f23a03-ede6-4db0-b059-2846fbc10962 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:28.310549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5f23a03-ede6-4db0-b059-2846fbc10962 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:28.311273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5f23a03-ede6-4db0-b059-2846fbc10962 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:28.311737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5f23a03-ede6-4db0-b059-2846fbc10962 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:28.312163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5f23a03-ede6-4db0-b059-2846fbc10962 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:28.501312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d5f23a03-ede6-4db0-b059-2846fbc10962 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:28.510201 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d5f23a03-ede6-4db0-b059-2846fbc10962 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1228 microversion: 2.1 time: 0.213783 Oct 18 14:03:28.510995 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3343/6486] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:28 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1228 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:29.535519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3679cfc0-aa18-45c9-9a1d-9774ecefcd35 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:29.536218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3679cfc0-aa18-45c9-9a1d-9774ecefcd35 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:29.542637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3679cfc0-aa18-45c9-9a1d-9774ecefcd35 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:29.543123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3679cfc0-aa18-45c9-9a1d-9774ecefcd35 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:29.543557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3679cfc0-aa18-45c9-9a1d-9774ecefcd35 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:29.544308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3679cfc0-aa18-45c9-9a1d-9774ecefcd35 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:29.544735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3679cfc0-aa18-45c9-9a1d-9774ecefcd35 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:29.545153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3679cfc0-aa18-45c9-9a1d-9774ecefcd35 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:29.683463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3679cfc0-aa18-45c9-9a1d-9774ecefcd35 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:29.691530 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3679cfc0-aa18-45c9-9a1d-9774ecefcd35 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1228 microversion: 2.1 time: 0.161262 Oct 18 14:03:29.692190 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3144/6487] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:29 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1228 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:30.716306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-78252063-9692-491e-8e9d-2556f0adaddc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:30.717406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-78252063-9692-491e-8e9d-2556f0adaddc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:30.728224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78252063-9692-491e-8e9d-2556f0adaddc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:30.728840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78252063-9692-491e-8e9d-2556f0adaddc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:30.729424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78252063-9692-491e-8e9d-2556f0adaddc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:30.730181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78252063-9692-491e-8e9d-2556f0adaddc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:30.730973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78252063-9692-491e-8e9d-2556f0adaddc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:30.731770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78252063-9692-491e-8e9d-2556f0adaddc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:30.894189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-78252063-9692-491e-8e9d-2556f0adaddc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:30.910010 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-78252063-9692-491e-8e9d-2556f0adaddc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1228 microversion: 2.1 time: 0.198871 Oct 18 14:03:30.910857 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3344/6488] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:30 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1228 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:31.934450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-60398bc6-77aa-447e-9a35-7e71c7fc9164 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:31.935007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-60398bc6-77aa-447e-9a35-7e71c7fc9164 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:31.942056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60398bc6-77aa-447e-9a35-7e71c7fc9164 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:31.942543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60398bc6-77aa-447e-9a35-7e71c7fc9164 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:31.942980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60398bc6-77aa-447e-9a35-7e71c7fc9164 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:31.943669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60398bc6-77aa-447e-9a35-7e71c7fc9164 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:31.944121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60398bc6-77aa-447e-9a35-7e71c7fc9164 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:31.944547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60398bc6-77aa-447e-9a35-7e71c7fc9164 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:32.102003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-60398bc6-77aa-447e-9a35-7e71c7fc9164 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:32.119617 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-60398bc6-77aa-447e-9a35-7e71c7fc9164 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1216 microversion: 2.1 time: 0.189036 Oct 18 14:03:32.120546 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3145/6489] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:31 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:33.147310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-18e7ef22-8c8b-461e-84f0-dab3913e31ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:33.147929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-18e7ef22-8c8b-461e-84f0-dab3913e31ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:33.156025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18e7ef22-8c8b-461e-84f0-dab3913e31ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:33.156514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18e7ef22-8c8b-461e-84f0-dab3913e31ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:33.156975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18e7ef22-8c8b-461e-84f0-dab3913e31ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:33.157706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18e7ef22-8c8b-461e-84f0-dab3913e31ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:33.158162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18e7ef22-8c8b-461e-84f0-dab3913e31ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:33.158584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18e7ef22-8c8b-461e-84f0-dab3913e31ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:33.298421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-18e7ef22-8c8b-461e-84f0-dab3913e31ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:33.306206 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-18e7ef22-8c8b-461e-84f0-dab3913e31ed tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1216 microversion: 2.1 time: 0.162846 Oct 18 14:03:33.306832 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3345/6490] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:33 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1216 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:33.694814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-51a21882-3f16-43f2-b220-4dc5e088f698 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:33.697839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-51a21882-3f16-43f2-b220-4dc5e088f698 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:33.705024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51a21882-3f16-43f2-b220-4dc5e088f698 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:33.705549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51a21882-3f16-43f2-b220-4dc5e088f698 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:33.705963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51a21882-3f16-43f2-b220-4dc5e088f698 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:33.706661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51a21882-3f16-43f2-b220-4dc5e088f698 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:33.707115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51a21882-3f16-43f2-b220-4dc5e088f698 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:33.707534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51a21882-3f16-43f2-b220-4dc5e088f698 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:33.782646 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-51a21882-3f16-43f2-b220-4dc5e088f698 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12/action" status: 200 len: 63031 microversion: 2.1 time: 0.091740 Oct 18 14:03:33.783362 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3146/6491] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:03:33 2022] POST /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12/action => generated 63031 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 14:03:34.328801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ce20b18b-2798-4acb-81d5-43f9b902a414 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:34.329336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ce20b18b-2798-4acb-81d5-43f9b902a414 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:34.336530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce20b18b-2798-4acb-81d5-43f9b902a414 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:34.337058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce20b18b-2798-4acb-81d5-43f9b902a414 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:34.337511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce20b18b-2798-4acb-81d5-43f9b902a414 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:34.338246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce20b18b-2798-4acb-81d5-43f9b902a414 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:34.338756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce20b18b-2798-4acb-81d5-43f9b902a414 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:34.339181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ce20b18b-2798-4acb-81d5-43f9b902a414 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:34.486737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ce20b18b-2798-4acb-81d5-43f9b902a414 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:34.495708 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ce20b18b-2798-4acb-81d5-43f9b902a414 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1216 microversion: 2.1 time: 0.170257 Oct 18 14:03:34.496269 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3346/6492] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:34 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:35.520833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b18b0412-be53-466e-8b39-808ed1eb2095 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:35.521478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b18b0412-be53-466e-8b39-808ed1eb2095 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:35.524075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:35.524775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:35.532108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b18b0412-be53-466e-8b39-808ed1eb2095 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:35.532593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b18b0412-be53-466e-8b39-808ed1eb2095 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:35.533028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b18b0412-be53-466e-8b39-808ed1eb2095 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:35.533830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b18b0412-be53-466e-8b39-808ed1eb2095 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:35.534276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b18b0412-be53-466e-8b39-808ed1eb2095 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:35.534745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b18b0412-be53-466e-8b39-808ed1eb2095 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:35.683714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b18b0412-be53-466e-8b39-808ed1eb2095 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:35.692333 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b18b0412-be53-466e-8b39-808ed1eb2095 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1216 microversion: 2.1 time: 0.176190 Oct 18 14:03:35.692917 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3147/6493] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:35 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1216 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:36.716980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0e302a8a-e290-4235-9bc0-9a15f8c8ce07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:36.717661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0e302a8a-e290-4235-9bc0-9a15f8c8ce07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:36.719623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:36.726761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0e302a8a-e290-4235-9bc0-9a15f8c8ce07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:36.727251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0e302a8a-e290-4235-9bc0-9a15f8c8ce07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:36.727692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0e302a8a-e290-4235-9bc0-9a15f8c8ce07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:36.728396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0e302a8a-e290-4235-9bc0-9a15f8c8ce07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:36.728856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0e302a8a-e290-4235-9bc0-9a15f8c8ce07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:36.729314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0e302a8a-e290-4235-9bc0-9a15f8c8ce07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:36.877495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0e302a8a-e290-4235-9bc0-9a15f8c8ce07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:36.885237 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0e302a8a-e290-4235-9bc0-9a15f8c8ce07 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1216 microversion: 2.1 time: 0.173292 Oct 18 14:03:36.885803 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3347/6494] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:36 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:37.909692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fda94486-24f8-48d5-8b3f-c04696680a5d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:37.910454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fda94486-24f8-48d5-8b3f-c04696680a5d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:37.917381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fda94486-24f8-48d5-8b3f-c04696680a5d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:37.917860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fda94486-24f8-48d5-8b3f-c04696680a5d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:37.919052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fda94486-24f8-48d5-8b3f-c04696680a5d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:37.919758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fda94486-24f8-48d5-8b3f-c04696680a5d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:37.920213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fda94486-24f8-48d5-8b3f-c04696680a5d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:37.920636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fda94486-24f8-48d5-8b3f-c04696680a5d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:38.059008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fda94486-24f8-48d5-8b3f-c04696680a5d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:38.067179 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fda94486-24f8-48d5-8b3f-c04696680a5d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1216 microversion: 2.1 time: 0.161375 Oct 18 14:03:38.067755 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3148/6495] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:37 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:39.092184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cbc381ed-d201-451f-86eb-c33cfaa7e20e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:39.092807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cbc381ed-d201-451f-86eb-c33cfaa7e20e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:39.100184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbc381ed-d201-451f-86eb-c33cfaa7e20e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:39.100677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbc381ed-d201-451f-86eb-c33cfaa7e20e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:39.101116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbc381ed-d201-451f-86eb-c33cfaa7e20e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:39.101843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbc381ed-d201-451f-86eb-c33cfaa7e20e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:39.102294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbc381ed-d201-451f-86eb-c33cfaa7e20e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:39.102725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbc381ed-d201-451f-86eb-c33cfaa7e20e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:39.254894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cbc381ed-d201-451f-86eb-c33cfaa7e20e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:39.263224 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cbc381ed-d201-451f-86eb-c33cfaa7e20e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1216 microversion: 2.1 time: 0.175989 Oct 18 14:03:39.263820 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3348/6496] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:39 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1216 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:40.286568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8d236f68-e76d-40bd-8913-c9de33e32f0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:40.287180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8d236f68-e76d-40bd-8913-c9de33e32f0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:40.295524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d236f68-e76d-40bd-8913-c9de33e32f0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:40.296065 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d236f68-e76d-40bd-8913-c9de33e32f0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:40.296500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d236f68-e76d-40bd-8913-c9de33e32f0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:40.297219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d236f68-e76d-40bd-8913-c9de33e32f0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:40.297672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d236f68-e76d-40bd-8913-c9de33e32f0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:40.298096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d236f68-e76d-40bd-8913-c9de33e32f0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:40.442894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8d236f68-e76d-40bd-8913-c9de33e32f0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:40.451951 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8d236f68-e76d-40bd-8913-c9de33e32f0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1216 microversion: 2.1 time: 0.169328 Oct 18 14:03:40.452564 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3149/6497] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:40 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:40.585482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-665969ec-f076-4964-a383-25236bfb6540 req-093e1182-c83b-429a-b0d3-4106c881b0ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c7e580-e9c9-4b7f-b3a0-c00742fea035", "name": "network-vif-plugged", "status": "completed", "tag": "8deb68a0-939d-4ce9-b2c1-db0f3a52da0f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:40.601498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-665969ec-f076-4964-a383-25236bfb6540 req-093e1182-c83b-429a-b0d3-4106c881b0ee service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:40.602162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-665969ec-f076-4964-a383-25236bfb6540 req-093e1182-c83b-429a-b0d3-4106c881b0ee service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:40.602728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-665969ec-f076-4964-a383-25236bfb6540 req-093e1182-c83b-429a-b0d3-4106c881b0ee service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:40.620489 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-665969ec-f076-4964-a383-25236bfb6540 req-093e1182-c83b-429a-b0d3-4106c881b0ee service nova] Creating event network-vif-plugged:8deb68a0-939d-4ce9-b2c1-db0f3a52da0f for instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 on n-h2-858384-13 Oct 18 14:03:40.628289 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-665969ec-f076-4964-a383-25236bfb6540 req-093e1182-c83b-429a-b0d3-4106c881b0ee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049367 Oct 18 14:03:40.628899 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3349/6498] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:03:41.476671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c8c534a8-6ca2-4ef7-b5d8-8c05f3bbbbf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:41.477305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c8c534a8-6ca2-4ef7-b5d8-8c05f3bbbbf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:41.485056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8c534a8-6ca2-4ef7-b5d8-8c05f3bbbbf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:41.485577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8c534a8-6ca2-4ef7-b5d8-8c05f3bbbbf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:41.486019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8c534a8-6ca2-4ef7-b5d8-8c05f3bbbbf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:41.489268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8c534a8-6ca2-4ef7-b5d8-8c05f3bbbbf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:41.489268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8c534a8-6ca2-4ef7-b5d8-8c05f3bbbbf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:41.489268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8c534a8-6ca2-4ef7-b5d8-8c05f3bbbbf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:41.622076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c8c534a8-6ca2-4ef7-b5d8-8c05f3bbbbf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:41.629853 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c8c534a8-6ca2-4ef7-b5d8-8c05f3bbbbf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1216 microversion: 2.1 time: 0.157141 Oct 18 14:03:41.630453 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3150/6499] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:41 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:42.654324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db068645-0512-4992-ae6c-c8106e6764c5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:42.655088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db068645-0512-4992-ae6c-c8106e6764c5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:42.661749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db068645-0512-4992-ae6c-c8106e6764c5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:42.662231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db068645-0512-4992-ae6c-c8106e6764c5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:42.662668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db068645-0512-4992-ae6c-c8106e6764c5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:42.663356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db068645-0512-4992-ae6c-c8106e6764c5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:42.663811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db068645-0512-4992-ae6c-c8106e6764c5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:42.664234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db068645-0512-4992-ae6c-c8106e6764c5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:42.796660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db068645-0512-4992-ae6c-c8106e6764c5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:42.804507 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db068645-0512-4992-ae6c-c8106e6764c5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1402 microversion: 2.1 time: 0.156221 Oct 18 14:03:42.805117 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3350/6500] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:42 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1402 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:42.829787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9e5ebf7f-a914-49d7-aaa5-c58e44df9196 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:42.830448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9e5ebf7f-a914-49d7-aaa5-c58e44df9196 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:42.836646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e5ebf7f-a914-49d7-aaa5-c58e44df9196 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:42.837127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e5ebf7f-a914-49d7-aaa5-c58e44df9196 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:42.838000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e5ebf7f-a914-49d7-aaa5-c58e44df9196 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:42.839280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e5ebf7f-a914-49d7-aaa5-c58e44df9196 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:42.839781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e5ebf7f-a914-49d7-aaa5-c58e44df9196 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:42.840333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e5ebf7f-a914-49d7-aaa5-c58e44df9196 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:42.981470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9e5ebf7f-a914-49d7-aaa5-c58e44df9196 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:42.989423 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9e5ebf7f-a914-49d7-aaa5-c58e44df9196 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1402 microversion: 2.1 time: 0.165086 Oct 18 14:03:42.990009 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3151/6501] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:42 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1402 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:43.014613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c3c71ad-e27c-4cd8-89a7-74fe09ad37ae tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1388984897"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:43.017000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4c3c71ad-e27c-4cd8-89a7-74fe09ad37ae tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:43.023159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c3c71ad-e27c-4cd8-89a7-74fe09ad37ae tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:43.023642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c3c71ad-e27c-4cd8-89a7-74fe09ad37ae tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:43.024079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c3c71ad-e27c-4cd8-89a7-74fe09ad37ae tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:43.024772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c3c71ad-e27c-4cd8-89a7-74fe09ad37ae tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:43.025248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c3c71ad-e27c-4cd8-89a7-74fe09ad37ae tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:43.025678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4c3c71ad-e27c-4cd8-89a7-74fe09ad37ae tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:43.122804 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.compute.api [None req-4c3c71ad-e27c-4cd8-89a7-74fe09ad37ae tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Attempting to quiesce instance before volume snapshot. Oct 18 14:03:43.195580 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.compute.api [None req-4c3c71ad-e27c-4cd8-89a7-74fe09ad37ae tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 18 14:03:43.271851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4c3c71ad-e27c-4cd8-89a7-74fe09ad37ae tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Creating snapshot from volume e778a676-c00d-4ef5-8a9e-31ad303ade97. {{(pid=120611) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 18 14:03:44.240495 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4c3c71ad-e27c-4cd8-89a7-74fe09ad37ae tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "POST /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035/action" status: 202 len: 0 microversion: 2.1 time: 1.230501 Oct 18 14:03:44.241459 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3351/6502] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:03:43 2022] POST /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035/action => generated 0 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 18 14:03:45.416043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-2101514289", "imageRef": "53a24bb3-5e71-4172-b94f-d9632bd2fd04", "flavorRef": "452", "networks": [{"uuid": "d0463e74-962e-46fb-9c76-86e27a0887d2"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:45.478765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] validate_networks() for [('d0463e74-962e-46fb-9c76-86e27a0887d2', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:03:45.878440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:03:45.878860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:03:45.879331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:03:45.879774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:03:45.880187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:03:45.891056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:45.891532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:45.891961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:45.892678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:45.893127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:45.893592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:45.910402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:03:45.915687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for user 1d29125d80d146749096e754db7d84d4 and project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:03:45.928116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:03:45.930710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='17428fe5-ddf1-4651-8b27-590f69ab5e2f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:03:46.008042 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-91268461-282d-4adb-a206-08cc8fed49a4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595820 Oct 18 14:03:46.008713 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3152/6503] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:03:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:03:46.022122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-41da6786-df53-4905-a13e-876d36861844 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:46.022872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-41da6786-df53-4905-a13e-876d36861844 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:46.087672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-41da6786-df53-4905-a13e-876d36861844 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:46.096595 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-41da6786-df53-4905-a13e-876d36861844 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1230 microversion: 2.1 time: 0.079624 Oct 18 14:03:46.097239 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3352/6504] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:46 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1230 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:47.123389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5cea9ec0-409c-48d7-a427-afd48041622d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:47.124517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5cea9ec0-409c-48d7-a427-afd48041622d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:47.132742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cea9ec0-409c-48d7-a427-afd48041622d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:47.133293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cea9ec0-409c-48d7-a427-afd48041622d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:47.133735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cea9ec0-409c-48d7-a427-afd48041622d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:47.134517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cea9ec0-409c-48d7-a427-afd48041622d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:47.135020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cea9ec0-409c-48d7-a427-afd48041622d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:47.135517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5cea9ec0-409c-48d7-a427-afd48041622d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:47.267289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5cea9ec0-409c-48d7-a427-afd48041622d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:47.275905 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5cea9ec0-409c-48d7-a427-afd48041622d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1290 microversion: 2.1 time: 0.159261 Oct 18 14:03:47.276521 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3153/6505] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:47 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1290 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:48.300784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a4f8b877-711f-4936-8ab1-064364bbb630 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:48.301622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a4f8b877-711f-4936-8ab1-064364bbb630 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:48.309313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f8b877-711f-4936-8ab1-064364bbb630 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:48.310501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f8b877-711f-4936-8ab1-064364bbb630 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:48.311194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f8b877-711f-4936-8ab1-064364bbb630 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:48.312148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f8b877-711f-4936-8ab1-064364bbb630 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:48.312726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f8b877-711f-4936-8ab1-064364bbb630 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:48.313311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f8b877-711f-4936-8ab1-064364bbb630 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:48.461444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a4f8b877-711f-4936-8ab1-064364bbb630 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:48.469982 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a4f8b877-711f-4936-8ab1-064364bbb630 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1342 microversion: 2.1 time: 0.173345 Oct 18 14:03:48.470574 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3353/6506] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:48 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:48.743254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-4b7ec17d-712f-4666-97ff-63cf5dd473d6 req-89084a46-368d-45c6-98bb-f5f1ac6b0331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c4de7d4-9638-4e5c-96d6-09c381ea51a2", "tag": "50fd0a95-6a48-47b3-8c7e-fb103677f330"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:48.756261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4b7ec17d-712f-4666-97ff-63cf5dd473d6 req-89084a46-368d-45c6-98bb-f5f1ac6b0331 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:48.757090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4b7ec17d-712f-4666-97ff-63cf5dd473d6 req-89084a46-368d-45c6-98bb-f5f1ac6b0331 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:48.757752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-4b7ec17d-712f-4666-97ff-63cf5dd473d6 req-89084a46-368d-45c6-98bb-f5f1ac6b0331 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:48.772313 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-4b7ec17d-712f-4666-97ff-63cf5dd473d6 req-89084a46-368d-45c6-98bb-f5f1ac6b0331 service nova] Creating event network-changed:50fd0a95-6a48-47b3-8c7e-fb103677f330 for instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 on n-h1-858384-13 Oct 18 14:03:48.778237 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-4b7ec17d-712f-4666-97ff-63cf5dd473d6 req-89084a46-368d-45c6-98bb-f5f1ac6b0331 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038756 Oct 18 14:03:48.779977 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3154/6507] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:03:49.494095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7317a177-d654-4a59-8e24-2d53c5819d0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:49.494664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7317a177-d654-4a59-8e24-2d53c5819d0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:49.502771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7317a177-d654-4a59-8e24-2d53c5819d0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:49.503282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7317a177-d654-4a59-8e24-2d53c5819d0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:49.503738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7317a177-d654-4a59-8e24-2d53c5819d0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:49.504490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7317a177-d654-4a59-8e24-2d53c5819d0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:49.504960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7317a177-d654-4a59-8e24-2d53c5819d0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:49.505565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7317a177-d654-4a59-8e24-2d53c5819d0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:49.652841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7317a177-d654-4a59-8e24-2d53c5819d0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:49.661391 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7317a177-d654-4a59-8e24-2d53c5819d0d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1342 microversion: 2.1 time: 0.171362 Oct 18 14:03:49.662122 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3354/6508] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:49 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:50.378833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c518f6e-ceeb-4d78-8c13-f4ed7940dcaa tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:50.379569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7c518f6e-ceeb-4d78-8c13-f4ed7940dcaa tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:50.386432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c518f6e-ceeb-4d78-8c13-f4ed7940dcaa tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:50.386972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c518f6e-ceeb-4d78-8c13-f4ed7940dcaa tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:50.387346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c518f6e-ceeb-4d78-8c13-f4ed7940dcaa tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:50.388042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c518f6e-ceeb-4d78-8c13-f4ed7940dcaa tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:50.388485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c518f6e-ceeb-4d78-8c13-f4ed7940dcaa tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:50.388936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c518f6e-ceeb-4d78-8c13-f4ed7940dcaa tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:50.538641 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7c518f6e-ceeb-4d78-8c13-f4ed7940dcaa tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1833 microversion: 2.1 time: 0.359296 Oct 18 14:03:50.539244 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3155/6509] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:50 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1833 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:50.684657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-28e3bb36-db0f-421d-8975-208c545ca491 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:50.686427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-28e3bb36-db0f-421d-8975-208c545ca491 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:50.693507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28e3bb36-db0f-421d-8975-208c545ca491 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:50.694016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28e3bb36-db0f-421d-8975-208c545ca491 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:50.694471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28e3bb36-db0f-421d-8975-208c545ca491 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:50.695365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28e3bb36-db0f-421d-8975-208c545ca491 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:50.695845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28e3bb36-db0f-421d-8975-208c545ca491 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:50.697229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28e3bb36-db0f-421d-8975-208c545ca491 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:50.927832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-28e3bb36-db0f-421d-8975-208c545ca491 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:50.938470 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-28e3bb36-db0f-421d-8975-208c545ca491 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1342 microversion: 2.1 time: 0.258402 Oct 18 14:03:50.939552 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3355/6510] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:50 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1342 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:51.980321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b87093dc-d303-44b3-be95-55a8a42244a3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:51.983427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b87093dc-d303-44b3-be95-55a8a42244a3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:51.991539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b87093dc-d303-44b3-be95-55a8a42244a3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:51.995026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b87093dc-d303-44b3-be95-55a8a42244a3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:51.995474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b87093dc-d303-44b3-be95-55a8a42244a3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:51.996369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b87093dc-d303-44b3-be95-55a8a42244a3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:51.996828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b87093dc-d303-44b3-be95-55a8a42244a3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:51.997445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b87093dc-d303-44b3-be95-55a8a42244a3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:52.178631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b87093dc-d303-44b3-be95-55a8a42244a3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:52.190935 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b87093dc-d303-44b3-be95-55a8a42244a3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1342 microversion: 2.1 time: 0.216108 Oct 18 14:03:52.198684 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3156/6511] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:51 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:52.361516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-77e462c5-96f2-4425-8cf7-099703ef086a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:52.362164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-0b611aa1-5e61-4275-b653-e4f429da5afa req-b80dfbc0-8823-4faa-b620-eb017deb7169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff024001-4ca4-43af-ab54-318484d5dd12", "tag": "905cbe40-b1dc-4027-9472-7b1125b88497"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:52.363068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-77e462c5-96f2-4425-8cf7-099703ef086a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:52.371434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77e462c5-96f2-4425-8cf7-099703ef086a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:52.372028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77e462c5-96f2-4425-8cf7-099703ef086a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:52.373978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77e462c5-96f2-4425-8cf7-099703ef086a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:52.375160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77e462c5-96f2-4425-8cf7-099703ef086a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:52.376039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77e462c5-96f2-4425-8cf7-099703ef086a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:52.376657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77e462c5-96f2-4425-8cf7-099703ef086a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:52.382930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0b611aa1-5e61-4275-b653-e4f429da5afa req-b80dfbc0-8823-4faa-b620-eb017deb7169 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:52.383600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0b611aa1-5e61-4275-b653-e4f429da5afa req-b80dfbc0-8823-4faa-b620-eb017deb7169 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:52.385700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0b611aa1-5e61-4275-b653-e4f429da5afa req-b80dfbc0-8823-4faa-b620-eb017deb7169 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:52.413091 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0b611aa1-5e61-4275-b653-e4f429da5afa req-b80dfbc0-8823-4faa-b620-eb017deb7169 service nova] Creating event network-changed:905cbe40-b1dc-4027-9472-7b1125b88497 for instance ff024001-4ca4-43af-ab54-318484d5dd12 on n-h1-858384-13 Oct 18 14:03:52.420391 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-0b611aa1-5e61-4275-b653-e4f429da5afa req-b80dfbc0-8823-4faa-b620-eb017deb7169 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061313 Oct 18 14:03:52.421258 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3157/6512] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:03:52.424548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-77e462c5-96f2-4425-8cf7-099703ef086a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:03:52.508786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:52.584376 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-77e462c5-96f2-4425-8cf7-099703ef086a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 204 len: 0 microversion: 2.1 time: 0.227395 Oct 18 14:03:52.585807 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3356/6513] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:03:52 2022] DELETE /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:03:52.598629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1633f9f3-5082-4454-9286-27d876678afb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:52.600145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1633f9f3-5082-4454-9286-27d876678afb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:52.610249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1633f9f3-5082-4454-9286-27d876678afb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:52.610995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1633f9f3-5082-4454-9286-27d876678afb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:52.611582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1633f9f3-5082-4454-9286-27d876678afb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:52.612941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1633f9f3-5082-4454-9286-27d876678afb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:52.614161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1633f9f3-5082-4454-9286-27d876678afb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:52.615759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1633f9f3-5082-4454-9286-27d876678afb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:52.943215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1633f9f3-5082-4454-9286-27d876678afb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:52.956401 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1633f9f3-5082-4454-9286-27d876678afb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1686 microversion: 2.1 time: 0.365158 Oct 18 14:03:52.957373 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3158/6514] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:52 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1686 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:53.232776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-302a79dc-5c30-4e9e-835b-c6515b6bd812 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:53.233636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-302a79dc-5c30-4e9e-835b-c6515b6bd812 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:53.242927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302a79dc-5c30-4e9e-835b-c6515b6bd812 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:53.243641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302a79dc-5c30-4e9e-835b-c6515b6bd812 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:53.244418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302a79dc-5c30-4e9e-835b-c6515b6bd812 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:53.245207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302a79dc-5c30-4e9e-835b-c6515b6bd812 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:53.245863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302a79dc-5c30-4e9e-835b-c6515b6bd812 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:53.246703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-302a79dc-5c30-4e9e-835b-c6515b6bd812 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:53.521802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-302a79dc-5c30-4e9e-835b-c6515b6bd812 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:53.536944 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-302a79dc-5c30-4e9e-835b-c6515b6bd812 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1342 microversion: 2.1 time: 0.309087 Oct 18 14:03:53.541517 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3357/6515] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:53 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1342 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:53.982503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f817623b-5f8a-455a-ae9d-0b798be2ed38 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:53.983237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f817623b-5f8a-455a-ae9d-0b798be2ed38 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:53.986079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:53.992337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f817623b-5f8a-455a-ae9d-0b798be2ed38 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:53.993037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f817623b-5f8a-455a-ae9d-0b798be2ed38 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:53.993798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f817623b-5f8a-455a-ae9d-0b798be2ed38 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:53.994515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f817623b-5f8a-455a-ae9d-0b798be2ed38 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:53.995130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f817623b-5f8a-455a-ae9d-0b798be2ed38 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:53.995705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f817623b-5f8a-455a-ae9d-0b798be2ed38 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:54.000059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=87 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:54.246514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f817623b-5f8a-455a-ae9d-0b798be2ed38 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:54.256188 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f817623b-5f8a-455a-ae9d-0b798be2ed38 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1686 microversion: 2.1 time: 0.278289 Oct 18 14:03:54.257398 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3159/6516] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:53 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1686 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:54.564652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-028b5d40-02ba-4065-af2e-6d58dbf2b99f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:54.566318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-028b5d40-02ba-4065-af2e-6d58dbf2b99f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:54.573540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-028b5d40-02ba-4065-af2e-6d58dbf2b99f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:54.574282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-028b5d40-02ba-4065-af2e-6d58dbf2b99f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:54.574792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-028b5d40-02ba-4065-af2e-6d58dbf2b99f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:54.575764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-028b5d40-02ba-4065-af2e-6d58dbf2b99f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:54.576213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-028b5d40-02ba-4065-af2e-6d58dbf2b99f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:54.576652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-028b5d40-02ba-4065-af2e-6d58dbf2b99f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:54.749981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-028b5d40-02ba-4065-af2e-6d58dbf2b99f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:54.759372 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-028b5d40-02ba-4065-af2e-6d58dbf2b99f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1342 microversion: 2.1 time: 0.200013 Oct 18 14:03:54.760292 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3358/6517] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:54 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:54.884408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e5ff03ab-eee0-453b-9cd9-a1dc69bce958 req-9722a2a1-0fe3-49be-b562-51196bd4bee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff024001-4ca4-43af-ab54-318484d5dd12", "name": "network-vif-deleted", "tag": "905cbe40-b1dc-4027-9472-7b1125b88497"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:03:54.896849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e5ff03ab-eee0-453b-9cd9-a1dc69bce958 req-9722a2a1-0fe3-49be-b562-51196bd4bee7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:54.898465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e5ff03ab-eee0-453b-9cd9-a1dc69bce958 req-9722a2a1-0fe3-49be-b562-51196bd4bee7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:54.898918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e5ff03ab-eee0-453b-9cd9-a1dc69bce958 req-9722a2a1-0fe3-49be-b562-51196bd4bee7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:54.915746 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e5ff03ab-eee0-453b-9cd9-a1dc69bce958 req-9722a2a1-0fe3-49be-b562-51196bd4bee7 service nova] Creating event network-vif-deleted:905cbe40-b1dc-4027-9472-7b1125b88497 for instance ff024001-4ca4-43af-ab54-318484d5dd12 on n-h1-858384-13 Oct 18 14:03:54.922247 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e5ff03ab-eee0-453b-9cd9-a1dc69bce958 req-9722a2a1-0fe3-49be-b562-51196bd4bee7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041960 Oct 18 14:03:54.923033 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3160/6518] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:03:55.281289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:55.282185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:55.285762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:55.289760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:55.290461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:55.291077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:55.291818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:55.292437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:55.293041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:55.338614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:55.339159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:55.339421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:55.340332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lazy-loading 'fault' on Instance uuid ff024001-4ca4-43af-ab54-318484d5dd12 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:03:55.400820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:55.410580 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e319218c-0ef8-4b64-9fb2-14f5358a78d7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 200 len: 1354 microversion: 2.1 time: 0.134060 Oct 18 14:03:55.411290 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3359/6519] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:55 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 1354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:55.785504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ffc25d55-b0b4-41c6-9bcd-d64ed26dfaab tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:55.786204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ffc25d55-b0b4-41c6-9bcd-d64ed26dfaab tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:55.793072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffc25d55-b0b4-41c6-9bcd-d64ed26dfaab tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:55.793825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffc25d55-b0b4-41c6-9bcd-d64ed26dfaab tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:55.794929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffc25d55-b0b4-41c6-9bcd-d64ed26dfaab tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:55.795704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffc25d55-b0b4-41c6-9bcd-d64ed26dfaab tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:55.796159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffc25d55-b0b4-41c6-9bcd-d64ed26dfaab tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:55.796768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ffc25d55-b0b4-41c6-9bcd-d64ed26dfaab tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:55.902700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:55.922710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:56.232917 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ffc25d55-b0b4-41c6-9bcd-d64ed26dfaab tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:56.243094 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ffc25d55-b0b4-41c6-9bcd-d64ed26dfaab tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1342 microversion: 2.1 time: 0.462361 Oct 18 14:03:56.258311 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3161/6520] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:55 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1342 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:56.434392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4b1423b-9928-4cc4-8d0d-f7bcba116094 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:56.435426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e4b1423b-9928-4cc4-8d0d-f7bcba116094 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: ff024001-4ca4-43af-ab54-318484d5dd12] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:56.437757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:03:56.443605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b1423b-9928-4cc4-8d0d-f7bcba116094 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:56.444153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b1423b-9928-4cc4-8d0d-f7bcba116094 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:56.447422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b1423b-9928-4cc4-8d0d-f7bcba116094 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:56.448736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b1423b-9928-4cc4-8d0d-f7bcba116094 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:56.449239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b1423b-9928-4cc4-8d0d-f7bcba116094 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:56.449708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b1423b-9928-4cc4-8d0d-f7bcba116094 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:56.465294 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-e4b1423b-9928-4cc4-8d0d-f7bcba116094 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] HTTP exception thrown: Instance ff024001-4ca4-43af-ab54-318484d5dd12 could not be found. Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4b1423b-9928-4cc4-8d0d-f7bcba116094 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Request method failure captured: Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 HTTP/1.1 Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrERveMSbr98lDbhVRpVCZtMpZCqRzllFV9Zp-9Paa2aeI2L6Uu3YKC5mtfy6YqZYTDL35tBdZ2S8DBV9NMKTb2UJzxCOY2UD_h7FbwqxTtZxtG-8cn42k_jl_VvaBbCHWnwHwkU0ksMnyQKE0VuTZblyb548PMnFxhTFzNpMLJL5y0 Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: c5b27cd003004ada9e45c087db637da3 Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1155266913 Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5b27cd003004ada9e45c087db637da3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5b27cd003004ada9e45c087db637da3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5b27cd003004ada9e45c087db637da3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5b27cd003004ada9e45c087db637da3"}]}] Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1155266913 Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: c5b27cd003004ada9e45c087db637da3 Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1155266913 Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestNetworkAdvancedServerOps-1155266913-project Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 21e90c2f331f46f497b568dbc0e0c100 Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1155266913-project Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance ff024001-4ca4-43af-ab54-318484d5dd12 could not be found. Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'ff024001-4ca4-43af-ab54-318484d5dd12'} Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff024001-4ca4-43af-ab54-318484d5dd12 could not be found. Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff024001-4ca4-43af-ab54-318484d5dd12 could not be found. Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:03:56.468051 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:03:56.472281 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:03:56.472281 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:03:56.472281 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:03:56.472281 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:03:56.472281 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:03:56.472281 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:03:56.472281 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff024001-4ca4-43af-ab54-318484d5dd12 could not be found. Oct 18 14:03:56.472281 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:03:56.472281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4b1423b-9928-4cc4-8d0d-f7bcba116094 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Returning 404 to user: Instance ff024001-4ca4-43af-ab54-318484d5dd12 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:03:56.472281 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e4b1423b-9928-4cc4-8d0d-f7bcba116094 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12" status: 404 len: 111 microversion: 2.1 time: 0.039064 Oct 18 14:03:56.472281 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3360/6521] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:56 2022] GET /compute/v2.1/servers/ff024001-4ca4-43af-ab54-318484d5dd12 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:03:57.269098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-46f9eb71-3cec-4e3e-8226-62c799bee9f1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:57.269749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-46f9eb71-3cec-4e3e-8226-62c799bee9f1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:57.276893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46f9eb71-3cec-4e3e-8226-62c799bee9f1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:57.277441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46f9eb71-3cec-4e3e-8226-62c799bee9f1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:57.277883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46f9eb71-3cec-4e3e-8226-62c799bee9f1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:57.278634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46f9eb71-3cec-4e3e-8226-62c799bee9f1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:57.279282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46f9eb71-3cec-4e3e-8226-62c799bee9f1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:57.279742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46f9eb71-3cec-4e3e-8226-62c799bee9f1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:57.432410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-46f9eb71-3cec-4e3e-8226-62c799bee9f1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:57.441903 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-46f9eb71-3cec-4e3e-8226-62c799bee9f1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1342 microversion: 2.1 time: 0.177050 Oct 18 14:03:57.442786 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3162/6522] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:57 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1342 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:03:58.466689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5abd539c-2cef-466d-be3b-c391e8bd4cdc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:58.467960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5abd539c-2cef-466d-be3b-c391e8bd4cdc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:58.475606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5abd539c-2cef-466d-be3b-c391e8bd4cdc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:58.476127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5abd539c-2cef-466d-be3b-c391e8bd4cdc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:58.476726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5abd539c-2cef-466d-be3b-c391e8bd4cdc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:58.490253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5abd539c-2cef-466d-be3b-c391e8bd4cdc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:58.491032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5abd539c-2cef-466d-be3b-c391e8bd4cdc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:58.491650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5abd539c-2cef-466d-be3b-c391e8bd4cdc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:58.906289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5abd539c-2cef-466d-be3b-c391e8bd4cdc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:03:58.930280 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5abd539c-2cef-466d-be3b-c391e8bd4cdc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1342 microversion: 2.1 time: 0.467944 Oct 18 14:03:58.943502 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3361/6523] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:58 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1342 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:03:59.961431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6fd5fe41-21d0-44e1-b0a2-b4ef2207a6fb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:03:59.962233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6fd5fe41-21d0-44e1-b0a2-b4ef2207a6fb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:03:59.972639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fd5fe41-21d0-44e1-b0a2-b4ef2207a6fb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:59.973361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fd5fe41-21d0-44e1-b0a2-b4ef2207a6fb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:59.973894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fd5fe41-21d0-44e1-b0a2-b4ef2207a6fb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:03:59.975028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fd5fe41-21d0-44e1-b0a2-b4ef2207a6fb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:03:59.975807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fd5fe41-21d0-44e1-b0a2-b4ef2207a6fb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:03:59.976370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fd5fe41-21d0-44e1-b0a2-b4ef2207a6fb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:00.167855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6fd5fe41-21d0-44e1-b0a2-b4ef2207a6fb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:00.178167 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6fd5fe41-21d0-44e1-b0a2-b4ef2207a6fb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1342 microversion: 2.1 time: 0.226176 Oct 18 14:04:00.178772 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3163/6524] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:03:59 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1342 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:00.428326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-43fd4c9c-c1d4-4d06-b6cd-071ddc5cbd08 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '.version_select at 0x7ff60e549ca0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:00.452468 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-43fd4c9c-c1d4-4d06-b6cd-071ddc5cbd08 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-587303360" status: 202 len: 0 microversion: 2.1 time: 0.027789 Oct 18 14:04:00.453493 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3362/6525] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 18 14:04:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-587303360 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:04:00.496880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-04b01717-13ea-4649-a769-93aedaf02137 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'create', calling method: .version_select at 0x7ff60ecc1940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-344078349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxQZOWMxvOBoPSHakfH/Sub/N17gluvg+N7d5aparwjI9KC5aA42In97b949OlLmeaiD+wFRqLFUMmxqkl4XaQIQE/Zb5iwMPhGAIngAH8G//94cYDxKQX2zTNJ/EshXg=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:00.514522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-04b01717-13ea-4649-a769-93aedaf02137 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for project c5b27cd003004ada9e45c087db637da3. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:04:00.520573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-04b01717-13ea-4649-a769-93aedaf02137 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for user 21e90c2f331f46f497b568dbc0e0c100 and project c5b27cd003004ada9e45c087db637da3. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:04:00.536085 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-04b01717-13ea-4649-a769-93aedaf02137 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:04:01.201707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3ed0c5f0-89c6-4149-9718-9097b49f6e00 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:01.202336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3ed0c5f0-89c6-4149-9718-9097b49f6e00 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:01.209291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ed0c5f0-89c6-4149-9718-9097b49f6e00 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:01.209789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ed0c5f0-89c6-4149-9718-9097b49f6e00 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:01.210238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ed0c5f0-89c6-4149-9718-9097b49f6e00 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:01.210946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ed0c5f0-89c6-4149-9718-9097b49f6e00 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:01.211408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ed0c5f0-89c6-4149-9718-9097b49f6e00 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:01.211843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ed0c5f0-89c6-4149-9718-9097b49f6e00 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:01.353986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ed0c5f0-89c6-4149-9718-9097b49f6e00 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:01.363217 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3ed0c5f0-89c6-4149-9718-9097b49f6e00 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1342 microversion: 2.1 time: 0.165468 Oct 18 14:04:01.363893 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3363/6526] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:01 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:04:01.543504 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [None req-04b01717-13ea-4649-a769-93aedaf02137 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38146. Oct 18 14:04:01.560221 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-04b01717-13ea-4649-a769-93aedaf02137 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.067426 Oct 18 14:04:01.561170 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3164/6527] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:04:00 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:02.390175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dd6f8190-d31f-44e9-9554-3916c7b7cd83 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:02.391730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dd6f8190-d31f-44e9-9554-3916c7b7cd83 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:02.401750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd6f8190-d31f-44e9-9554-3916c7b7cd83 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:02.402666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd6f8190-d31f-44e9-9554-3916c7b7cd83 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:02.403978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd6f8190-d31f-44e9-9554-3916c7b7cd83 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:02.405016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd6f8190-d31f-44e9-9554-3916c7b7cd83 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:02.406039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd6f8190-d31f-44e9-9554-3916c7b7cd83 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:02.406913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd6f8190-d31f-44e9-9554-3916c7b7cd83 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:02.565510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dd6f8190-d31f-44e9-9554-3916c7b7cd83 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:02.578255 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dd6f8190-d31f-44e9-9554-3916c7b7cd83 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1342 microversion: 2.1 time: 0.193764 Oct 18 14:04:02.579135 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3364/6528] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:02 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1342 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:03.606079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe98f103-1d48-474b-9f7e-fee2282dd04d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:03.607440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe98f103-1d48-474b-9f7e-fee2282dd04d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:03.614251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe98f103-1d48-474b-9f7e-fee2282dd04d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:03.614736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe98f103-1d48-474b-9f7e-fee2282dd04d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:03.615169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe98f103-1d48-474b-9f7e-fee2282dd04d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:03.615874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe98f103-1d48-474b-9f7e-fee2282dd04d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:03.616353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe98f103-1d48-474b-9f7e-fee2282dd04d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:03.616773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe98f103-1d48-474b-9f7e-fee2282dd04d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:03.885714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fe98f103-1d48-474b-9f7e-fee2282dd04d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:03.894694 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fe98f103-1d48-474b-9f7e-fee2282dd04d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1376 microversion: 2.1 time: 0.295307 Oct 18 14:04:03.895288 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3165/6529] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:03 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1376 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:04.918532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed7c00c0-36eb-45fe-b9ae-e94b1b96f06c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:04.919674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ed7c00c0-36eb-45fe-b9ae-e94b1b96f06c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:04.926855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed7c00c0-36eb-45fe-b9ae-e94b1b96f06c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:04.927585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed7c00c0-36eb-45fe-b9ae-e94b1b96f06c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:04.928309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed7c00c0-36eb-45fe-b9ae-e94b1b96f06c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:04.929095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed7c00c0-36eb-45fe-b9ae-e94b1b96f06c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:04.929763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed7c00c0-36eb-45fe-b9ae-e94b1b96f06c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:04.930470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed7c00c0-36eb-45fe-b9ae-e94b1b96f06c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:05.105592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ed7c00c0-36eb-45fe-b9ae-e94b1b96f06c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:05.114147 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ed7c00c0-36eb-45fe-b9ae-e94b1b96f06c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1376 microversion: 2.1 time: 0.200188 Oct 18 14:04:05.114767 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3365/6530] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:04 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1376 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:06.138074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-be81f581-1722-427b-8af1-e35ea21b5c08 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:06.138715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-be81f581-1722-427b-8af1-e35ea21b5c08 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:06.146035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be81f581-1722-427b-8af1-e35ea21b5c08 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:06.146516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be81f581-1722-427b-8af1-e35ea21b5c08 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:06.146946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be81f581-1722-427b-8af1-e35ea21b5c08 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:06.147634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be81f581-1722-427b-8af1-e35ea21b5c08 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:06.148086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be81f581-1722-427b-8af1-e35ea21b5c08 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:06.148507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be81f581-1722-427b-8af1-e35ea21b5c08 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:06.384191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-be81f581-1722-427b-8af1-e35ea21b5c08 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:06.397689 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-be81f581-1722-427b-8af1-e35ea21b5c08 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1376 microversion: 2.1 time: 0.263542 Oct 18 14:04:06.412170 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3166/6531] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:06 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1376 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:07.431919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8b312b33-f8c7-42a2-87e2-acf8c0d1cf29 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:07.432817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8b312b33-f8c7-42a2-87e2-acf8c0d1cf29 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:07.452814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b312b33-f8c7-42a2-87e2-acf8c0d1cf29 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:07.453859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b312b33-f8c7-42a2-87e2-acf8c0d1cf29 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:07.455379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b312b33-f8c7-42a2-87e2-acf8c0d1cf29 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:07.457536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b312b33-f8c7-42a2-87e2-acf8c0d1cf29 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:07.459524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b312b33-f8c7-42a2-87e2-acf8c0d1cf29 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:07.460437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8b312b33-f8c7-42a2-87e2-acf8c0d1cf29 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:07.712097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8b312b33-f8c7-42a2-87e2-acf8c0d1cf29 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:07.724673 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8b312b33-f8c7-42a2-87e2-acf8c0d1cf29 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1376 microversion: 2.1 time: 0.301106 Oct 18 14:04:07.726019 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3366/6532] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:07 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1376 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:07.949962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-372996484", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "cb41e4d9-d4f0-45a3-820f-97ab71fb2eaa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-344078349", "security_groups": [{"name": "tempest-secgroup-smoke-1805191347"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:08.071013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] validate_networks() for [('cb41e4d9-d4f0-45a3-820f-97ab71fb2eaa', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:04:08.517622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:04:08.518247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:04:08.518872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:04:08.519452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:04:08.520022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:04:08.531912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:08.533392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:08.534050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:08.535143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:08.535770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:08.537465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:08.558351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for project c5b27cd003004ada9e45c087db637da3. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:04:08.565488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for user 21e90c2f331f46f497b568dbc0e0c100 and project c5b27cd003004ada9e45c087db637da3. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:04:08.579851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:04:08.582878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:04:08.636086 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5fe2e07d-6bb0-4509-b4cc-6d6f3cc44f1e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.690068 Oct 18 14:04:08.644046 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3167/6533] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:04:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:04:08.649580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-923d08ee-3435-4ea2-9290-7ef0cfe1c777 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:08.650972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-923d08ee-3435-4ea2-9290-7ef0cfe1c777 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:08.742325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-923d08ee-3435-4ea2-9290-7ef0cfe1c777 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:08.752096 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-923d08ee-3435-4ea2-9290-7ef0cfe1c777 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1265 microversion: 2.1 time: 0.106359 Oct 18 14:04:08.752699 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3367/6534] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:08 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:08.765318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4ba75452-c5f2-4529-b5ec-ff50bb912a76 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:08.765318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4ba75452-c5f2-4529-b5ec-ff50bb912a76 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:08.769192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ba75452-c5f2-4529-b5ec-ff50bb912a76 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:08.769192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ba75452-c5f2-4529-b5ec-ff50bb912a76 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:08.769454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ba75452-c5f2-4529-b5ec-ff50bb912a76 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:08.770061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ba75452-c5f2-4529-b5ec-ff50bb912a76 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:08.771529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ba75452-c5f2-4529-b5ec-ff50bb912a76 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:08.772238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ba75452-c5f2-4529-b5ec-ff50bb912a76 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:08.976305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4ba75452-c5f2-4529-b5ec-ff50bb912a76 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:08.988881 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4ba75452-c5f2-4529-b5ec-ff50bb912a76 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1376 microversion: 2.1 time: 0.240907 Oct 18 14:04:08.989857 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3168/6535] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:08 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1376 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:09.776135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fee1a103-9ca9-4209-acd1-9fedc9ba4fbe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:09.776764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fee1a103-9ca9-4209-acd1-9fedc9ba4fbe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:09.787948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fee1a103-9ca9-4209-acd1-9fedc9ba4fbe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:09.788509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fee1a103-9ca9-4209-acd1-9fedc9ba4fbe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:09.788923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fee1a103-9ca9-4209-acd1-9fedc9ba4fbe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:09.789664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fee1a103-9ca9-4209-acd1-9fedc9ba4fbe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:09.790125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fee1a103-9ca9-4209-acd1-9fedc9ba4fbe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:09.790560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fee1a103-9ca9-4209-acd1-9fedc9ba4fbe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:09.863145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fee1a103-9ca9-4209-acd1-9fedc9ba4fbe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:09.874115 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fee1a103-9ca9-4209-acd1-9fedc9ba4fbe tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1269 microversion: 2.1 time: 0.101162 Oct 18 14:04:09.877379 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3368/6536] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:09 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:10.012104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-47e8f910-8888-412c-b950-1139caebfac0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:10.013613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-47e8f910-8888-412c-b950-1139caebfac0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:10.021021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47e8f910-8888-412c-b950-1139caebfac0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:10.021588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47e8f910-8888-412c-b950-1139caebfac0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:10.021983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47e8f910-8888-412c-b950-1139caebfac0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:10.022980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47e8f910-8888-412c-b950-1139caebfac0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:10.023433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47e8f910-8888-412c-b950-1139caebfac0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:10.024031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47e8f910-8888-412c-b950-1139caebfac0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:10.223762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-47e8f910-8888-412c-b950-1139caebfac0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:10.233229 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-47e8f910-8888-412c-b950-1139caebfac0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1376 microversion: 2.1 time: 0.224844 Oct 18 14:04:10.245816 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3169/6537] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:10 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1376 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:10.904742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-512e57c6-50df-40d2-bb04-44d58ec1164d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:10.906229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-512e57c6-50df-40d2-bb04-44d58ec1164d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:10.916100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-512e57c6-50df-40d2-bb04-44d58ec1164d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:10.917344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-512e57c6-50df-40d2-bb04-44d58ec1164d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:10.918181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-512e57c6-50df-40d2-bb04-44d58ec1164d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:10.919162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-512e57c6-50df-40d2-bb04-44d58ec1164d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:10.919897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-512e57c6-50df-40d2-bb04-44d58ec1164d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:10.920599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-512e57c6-50df-40d2-bb04-44d58ec1164d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:11.008440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-512e57c6-50df-40d2-bb04-44d58ec1164d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:11.018055 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-512e57c6-50df-40d2-bb04-44d58ec1164d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1323 microversion: 2.1 time: 0.121273 Oct 18 14:04:11.019284 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3369/6538] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:10 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1323 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:11.259157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6fd27648-48d0-4ae1-bba6-26e3a44beaf1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:11.260572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6fd27648-48d0-4ae1-bba6-26e3a44beaf1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:11.273985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fd27648-48d0-4ae1-bba6-26e3a44beaf1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:11.277560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fd27648-48d0-4ae1-bba6-26e3a44beaf1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:11.278216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fd27648-48d0-4ae1-bba6-26e3a44beaf1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:11.279740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fd27648-48d0-4ae1-bba6-26e3a44beaf1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:11.286407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fd27648-48d0-4ae1-bba6-26e3a44beaf1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:11.287481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fd27648-48d0-4ae1-bba6-26e3a44beaf1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:11.568906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6fd27648-48d0-4ae1-bba6-26e3a44beaf1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:11.586332 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6fd27648-48d0-4ae1-bba6-26e3a44beaf1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1376 microversion: 2.1 time: 0.331924 Oct 18 14:04:11.598449 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3170/6539] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:11 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1376 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:04:12.049461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-79d8d28a-ec84-4514-94e7-3ef7ecb1264b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:12.050113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-79d8d28a-ec84-4514-94e7-3ef7ecb1264b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:12.060520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79d8d28a-ec84-4514-94e7-3ef7ecb1264b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:12.060995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79d8d28a-ec84-4514-94e7-3ef7ecb1264b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:12.061514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79d8d28a-ec84-4514-94e7-3ef7ecb1264b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:12.062787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79d8d28a-ec84-4514-94e7-3ef7ecb1264b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:12.063522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79d8d28a-ec84-4514-94e7-3ef7ecb1264b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:12.064244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79d8d28a-ec84-4514-94e7-3ef7ecb1264b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:12.255947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79d8d28a-ec84-4514-94e7-3ef7ecb1264b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:12.265600 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-79d8d28a-ec84-4514-94e7-3ef7ecb1264b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1391 microversion: 2.1 time: 0.222499 Oct 18 14:04:12.266290 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3370/6540] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:12 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1391 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:12.612854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bd81214d-65c4-4f2c-a01e-3c23918a737c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:12.621666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bd81214d-65c4-4f2c-a01e-3c23918a737c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:12.635276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7c541d92-e7c7-40fd-bcaf-1f98990a58ac req-595e771e-82eb-43c8-83a1-1e32013aef2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feffb0ae-c79e-45ca-857e-95371f190abc", "tag": "1fe58928-5578-443e-bbea-1093d7288e81"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:12.639781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd81214d-65c4-4f2c-a01e-3c23918a737c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:12.640618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd81214d-65c4-4f2c-a01e-3c23918a737c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:12.641317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd81214d-65c4-4f2c-a01e-3c23918a737c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:12.642240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd81214d-65c4-4f2c-a01e-3c23918a737c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:12.643059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd81214d-65c4-4f2c-a01e-3c23918a737c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:12.643703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd81214d-65c4-4f2c-a01e-3c23918a737c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:12.653280 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7c541d92-e7c7-40fd-bcaf-1f98990a58ac req-595e771e-82eb-43c8-83a1-1e32013aef2b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:12.654224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7c541d92-e7c7-40fd-bcaf-1f98990a58ac req-595e771e-82eb-43c8-83a1-1e32013aef2b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:12.655489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7c541d92-e7c7-40fd-bcaf-1f98990a58ac req-595e771e-82eb-43c8-83a1-1e32013aef2b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:12.671612 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7c541d92-e7c7-40fd-bcaf-1f98990a58ac req-595e771e-82eb-43c8-83a1-1e32013aef2b service nova] Creating event network-changed:1fe58928-5578-443e-bbea-1093d7288e81 for instance feffb0ae-c79e-45ca-857e-95371f190abc on n-h1-858384-13 Oct 18 14:04:12.678653 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7c541d92-e7c7-40fd-bcaf-1f98990a58ac req-595e771e-82eb-43c8-83a1-1e32013aef2b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062197 Oct 18 14:04:12.679619 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3371/6541] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:12.793165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-86084a4b-49d6-446b-a01f-4caee14dee08 req-06831526-4c55-47c6-978e-6765d73f0835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4de7d4-9638-4e5c-96d6-09c381ea51a2", "name": "network-vif-plugged", "status": "completed", "tag": "50fd0a95-6a48-47b3-8c7e-fb103677f330"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:12.807935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-86084a4b-49d6-446b-a01f-4caee14dee08 req-06831526-4c55-47c6-978e-6765d73f0835 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:12.808675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-86084a4b-49d6-446b-a01f-4caee14dee08 req-06831526-4c55-47c6-978e-6765d73f0835 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:12.809915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-86084a4b-49d6-446b-a01f-4caee14dee08 req-06831526-4c55-47c6-978e-6765d73f0835 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:12.827313 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-86084a4b-49d6-446b-a01f-4caee14dee08 req-06831526-4c55-47c6-978e-6765d73f0835 service nova] Creating event network-vif-plugged:50fd0a95-6a48-47b3-8c7e-fb103677f330 for instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 on n-h1-858384-13 Oct 18 14:04:12.834997 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-86084a4b-49d6-446b-a01f-4caee14dee08 req-06831526-4c55-47c6-978e-6765d73f0835 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137521 Oct 18 14:04:12.836137 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3372/6542] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:04:12.888202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bd81214d-65c4-4f2c-a01e-3c23918a737c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:12.897918 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bd81214d-65c4-4f2c-a01e-3c23918a737c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1376 microversion: 2.1 time: 0.288909 Oct 18 14:04:12.898665 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3171/6543] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:12 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1376 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:04:13.293659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-587303da-d999-482b-a4e0-1694076511d6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:13.295472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-587303da-d999-482b-a4e0-1694076511d6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:13.307150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587303da-d999-482b-a4e0-1694076511d6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:13.307816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587303da-d999-482b-a4e0-1694076511d6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:13.308605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587303da-d999-482b-a4e0-1694076511d6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:13.310480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587303da-d999-482b-a4e0-1694076511d6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:13.311373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587303da-d999-482b-a4e0-1694076511d6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:13.312011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-587303da-d999-482b-a4e0-1694076511d6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:13.492240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-587303da-d999-482b-a4e0-1694076511d6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:13.505741 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-587303da-d999-482b-a4e0-1694076511d6 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1391 microversion: 2.1 time: 0.218740 Oct 18 14:04:13.506552 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3373/6544] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:13 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1391 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:13.923923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-293420eb-8156-4f27-8cf5-0b81b4d50665 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:13.924600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-293420eb-8156-4f27-8cf5-0b81b4d50665 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:13.931573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-293420eb-8156-4f27-8cf5-0b81b4d50665 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:13.932053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-293420eb-8156-4f27-8cf5-0b81b4d50665 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:13.932521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-293420eb-8156-4f27-8cf5-0b81b4d50665 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:13.933244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-293420eb-8156-4f27-8cf5-0b81b4d50665 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:13.933697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-293420eb-8156-4f27-8cf5-0b81b4d50665 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:13.934106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-293420eb-8156-4f27-8cf5-0b81b4d50665 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:14.094777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-293420eb-8156-4f27-8cf5-0b81b4d50665 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:14.107811 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-293420eb-8156-4f27-8cf5-0b81b4d50665 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1376 microversion: 2.1 time: 0.187838 Oct 18 14:04:14.109297 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3172/6545] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:13 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1376 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:14.531834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e395314e-6252-4668-b13d-385aae35b722 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:14.532788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e395314e-6252-4668-b13d-385aae35b722 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:14.541631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e395314e-6252-4668-b13d-385aae35b722 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:14.542491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e395314e-6252-4668-b13d-385aae35b722 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:14.543126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e395314e-6252-4668-b13d-385aae35b722 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:14.544750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e395314e-6252-4668-b13d-385aae35b722 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:14.545497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e395314e-6252-4668-b13d-385aae35b722 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:14.546099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e395314e-6252-4668-b13d-385aae35b722 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:14.711002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e395314e-6252-4668-b13d-385aae35b722 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:14.719844 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e395314e-6252-4668-b13d-385aae35b722 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1391 microversion: 2.1 time: 0.193414 Oct 18 14:04:14.720438 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3374/6546] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:14 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1391 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:15.133513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-383560b7-1043-4ce0-b2e5-3981e0b6a8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:15.134116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-383560b7-1043-4ce0-b2e5-3981e0b6a8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:15.142183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-383560b7-1043-4ce0-b2e5-3981e0b6a8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:15.142710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-383560b7-1043-4ce0-b2e5-3981e0b6a8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:15.143407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-383560b7-1043-4ce0-b2e5-3981e0b6a8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:15.144112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-383560b7-1043-4ce0-b2e5-3981e0b6a8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:15.144569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-383560b7-1043-4ce0-b2e5-3981e0b6a8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:15.144998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-383560b7-1043-4ce0-b2e5-3981e0b6a8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:15.303482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-383560b7-1043-4ce0-b2e5-3981e0b6a8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:15.313549 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-383560b7-1043-4ce0-b2e5-3981e0b6a8b7 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1376 microversion: 2.1 time: 0.183789 Oct 18 14:04:15.314167 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3173/6547] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:15 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1376 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:15.743928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87047b75-7cc1-465d-bab5-a2850ddf3506 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:15.744593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-87047b75-7cc1-465d-bab5-a2850ddf3506 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:15.753788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87047b75-7cc1-465d-bab5-a2850ddf3506 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:15.754291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87047b75-7cc1-465d-bab5-a2850ddf3506 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:15.754927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87047b75-7cc1-465d-bab5-a2850ddf3506 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:15.755638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87047b75-7cc1-465d-bab5-a2850ddf3506 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:15.756132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87047b75-7cc1-465d-bab5-a2850ddf3506 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:15.756572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87047b75-7cc1-465d-bab5-a2850ddf3506 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:15.894916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-87047b75-7cc1-465d-bab5-a2850ddf3506 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:15.902778 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-87047b75-7cc1-465d-bab5-a2850ddf3506 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1391 microversion: 2.1 time: 0.162901 Oct 18 14:04:15.903399 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3375/6548] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:15 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:16.338230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-86221b1d-c4de-41c6-bf85-9853c86117fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:16.338843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-86221b1d-c4de-41c6-bf85-9853c86117fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:16.347563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86221b1d-c4de-41c6-bf85-9853c86117fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:16.348068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86221b1d-c4de-41c6-bf85-9853c86117fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:16.348547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86221b1d-c4de-41c6-bf85-9853c86117fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:16.349224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86221b1d-c4de-41c6-bf85-9853c86117fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:16.349711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86221b1d-c4de-41c6-bf85-9853c86117fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:16.350303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86221b1d-c4de-41c6-bf85-9853c86117fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:16.574479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-86221b1d-c4de-41c6-bf85-9853c86117fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:16.585528 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-86221b1d-c4de-41c6-bf85-9853c86117fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1562 microversion: 2.1 time: 0.251410 Oct 18 14:04:16.585878 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3174/6549] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:16 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1562 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:16.610729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0b672288-8b93-4541-add6-47358f7003ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:16.611362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0b672288-8b93-4541-add6-47358f7003ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:16.620845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b672288-8b93-4541-add6-47358f7003ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:16.621218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b672288-8b93-4541-add6-47358f7003ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:16.622545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b672288-8b93-4541-add6-47358f7003ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:16.624297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b672288-8b93-4541-add6-47358f7003ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:16.624297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b672288-8b93-4541-add6-47358f7003ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:16.624297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b672288-8b93-4541-add6-47358f7003ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:16.813618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0b672288-8b93-4541-add6-47358f7003ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:16.816070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:16.824725 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0b672288-8b93-4541-add6-47358f7003ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1562 microversion: 2.1 time: 0.218096 Oct 18 14:04:16.825998 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3376/6550] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:16 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1562 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:16.937245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4dac4eb1-0f15-4c0c-aa5f-b6dc088c8156 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:16.939398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4dac4eb1-0f15-4c0c-aa5f-b6dc088c8156 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:16.950558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-86c01c2b-91c6-4f29-8eb5-78ceb67f1002 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:16.953162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-86c01c2b-91c6-4f29-8eb5-78ceb67f1002 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:16.953535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dac4eb1-0f15-4c0c-aa5f-b6dc088c8156 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:16.954921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dac4eb1-0f15-4c0c-aa5f-b6dc088c8156 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:16.956024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dac4eb1-0f15-4c0c-aa5f-b6dc088c8156 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:16.957670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dac4eb1-0f15-4c0c-aa5f-b6dc088c8156 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:16.959399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dac4eb1-0f15-4c0c-aa5f-b6dc088c8156 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:16.960989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dac4eb1-0f15-4c0c-aa5f-b6dc088c8156 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:16.967385 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86c01c2b-91c6-4f29-8eb5-78ceb67f1002 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:16.968800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86c01c2b-91c6-4f29-8eb5-78ceb67f1002 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:16.969796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86c01c2b-91c6-4f29-8eb5-78ceb67f1002 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:16.972740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86c01c2b-91c6-4f29-8eb5-78ceb67f1002 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:16.974571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86c01c2b-91c6-4f29-8eb5-78ceb67f1002 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:16.975608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-86c01c2b-91c6-4f29-8eb5-78ceb67f1002 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:17.015467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-86c01c2b-91c6-4f29-8eb5-78ceb67f1002 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:04:17.108054 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-86c01c2b-91c6-4f29-8eb5-78ceb67f1002 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 204 len: 0 microversion: 2.1 time: 0.165911 Oct 18 14:04:17.108880 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3377/6551] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:04:16 2022] DELETE /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:04:17.117483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fda69995-e483-46f2-9cc8-e00fe789b05b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:17.118290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fda69995-e483-46f2-9cc8-e00fe789b05b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:17.126220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fda69995-e483-46f2-9cc8-e00fe789b05b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:17.126743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fda69995-e483-46f2-9cc8-e00fe789b05b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:17.127197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fda69995-e483-46f2-9cc8-e00fe789b05b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:17.128341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fda69995-e483-46f2-9cc8-e00fe789b05b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:17.129589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fda69995-e483-46f2-9cc8-e00fe789b05b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:17.130052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fda69995-e483-46f2-9cc8-e00fe789b05b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:17.202960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4dac4eb1-0f15-4c0c-aa5f-b6dc088c8156 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:17.210887 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4dac4eb1-0f15-4c0c-aa5f-b6dc088c8156 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1391 microversion: 2.1 time: 0.283481 Oct 18 14:04:17.213274 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3175/6552] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:16 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:17.297165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fda69995-e483-46f2-9cc8-e00fe789b05b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:17.305842 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fda69995-e483-46f2-9cc8-e00fe789b05b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1568 microversion: 2.1 time: 0.192638 Oct 18 14:04:17.306445 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3378/6553] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:17 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:04:18.237877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c2c99886-ef0f-45f3-89d7-7a6f4abe5a5b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:18.238539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c2c99886-ef0f-45f3-89d7-7a6f4abe5a5b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:18.245681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2c99886-ef0f-45f3-89d7-7a6f4abe5a5b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:18.246164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2c99886-ef0f-45f3-89d7-7a6f4abe5a5b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:18.246600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2c99886-ef0f-45f3-89d7-7a6f4abe5a5b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:18.247937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2c99886-ef0f-45f3-89d7-7a6f4abe5a5b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:18.248441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2c99886-ef0f-45f3-89d7-7a6f4abe5a5b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:18.248916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2c99886-ef0f-45f3-89d7-7a6f4abe5a5b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:18.330752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac62f6ea-2419-4b3e-8071-bcc3732d5fa8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:18.331390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ac62f6ea-2419-4b3e-8071-bcc3732d5fa8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:18.338846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac62f6ea-2419-4b3e-8071-bcc3732d5fa8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:18.339359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac62f6ea-2419-4b3e-8071-bcc3732d5fa8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:18.339815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac62f6ea-2419-4b3e-8071-bcc3732d5fa8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:18.340540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac62f6ea-2419-4b3e-8071-bcc3732d5fa8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:18.341046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac62f6ea-2419-4b3e-8071-bcc3732d5fa8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:18.341629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac62f6ea-2419-4b3e-8071-bcc3732d5fa8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:18.395820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c2c99886-ef0f-45f3-89d7-7a6f4abe5a5b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:18.403662 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c2c99886-ef0f-45f3-89d7-7a6f4abe5a5b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1391 microversion: 2.1 time: 0.169777 Oct 18 14:04:18.405207 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3176/6554] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:18 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:18.486574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ac62f6ea-2419-4b3e-8071-bcc3732d5fa8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:18.494523 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ac62f6ea-2419-4b3e-8071-bcc3732d5fa8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1568 microversion: 2.1 time: 0.167837 Oct 18 14:04:18.495108 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3379/6555] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:18 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:04:18.672657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e0946b3a-60d7-427a-bffa-6cb0536b237c req-0bcc9d68-a115-443e-8031-7e356b4ce33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feffb0ae-c79e-45ca-857e-95371f190abc", "name": "network-vif-plugged", "status": "completed", "tag": "1fe58928-5578-443e-bbea-1093d7288e81"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:18.678530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:18.679273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=10 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:18.687280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e0946b3a-60d7-427a-bffa-6cb0536b237c req-0bcc9d68-a115-443e-8031-7e356b4ce33a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:18.687779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e0946b3a-60d7-427a-bffa-6cb0536b237c req-0bcc9d68-a115-443e-8031-7e356b4ce33a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:18.688199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e0946b3a-60d7-427a-bffa-6cb0536b237c req-0bcc9d68-a115-443e-8031-7e356b4ce33a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:18.700317 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e0946b3a-60d7-427a-bffa-6cb0536b237c req-0bcc9d68-a115-443e-8031-7e356b4ce33a service nova] Creating event network-vif-plugged:1fe58928-5578-443e-bbea-1093d7288e81 for instance feffb0ae-c79e-45ca-857e-95371f190abc on n-h1-858384-13 Oct 18 14:04:18.705640 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e0946b3a-60d7-427a-bffa-6cb0536b237c req-0bcc9d68-a115-443e-8031-7e356b4ce33a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037271 Oct 18 14:04:18.706423 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3177/6556] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:19.428266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dc734940-c6f3-4ee4-8e3b-68e694a7702f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:19.428902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dc734940-c6f3-4ee4-8e3b-68e694a7702f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:19.431987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:19.438165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc734940-c6f3-4ee4-8e3b-68e694a7702f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:19.438679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc734940-c6f3-4ee4-8e3b-68e694a7702f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:19.439136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc734940-c6f3-4ee4-8e3b-68e694a7702f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:19.439879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc734940-c6f3-4ee4-8e3b-68e694a7702f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:19.440337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc734940-c6f3-4ee4-8e3b-68e694a7702f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:19.440845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc734940-c6f3-4ee4-8e3b-68e694a7702f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:19.521355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e7f5bb3f-4146-4d22-9f4d-8dab196dc163 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:19.522227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e7f5bb3f-4146-4d22-9f4d-8dab196dc163 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:19.545632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7f5bb3f-4146-4d22-9f4d-8dab196dc163 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:19.546327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7f5bb3f-4146-4d22-9f4d-8dab196dc163 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:19.546983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7f5bb3f-4146-4d22-9f4d-8dab196dc163 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:19.547946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7f5bb3f-4146-4d22-9f4d-8dab196dc163 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:19.548563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7f5bb3f-4146-4d22-9f4d-8dab196dc163 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:19.549158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e7f5bb3f-4146-4d22-9f4d-8dab196dc163 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:19.630847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc734940-c6f3-4ee4-8e3b-68e694a7702f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:19.641037 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dc734940-c6f3-4ee4-8e3b-68e694a7702f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1391 microversion: 2.1 time: 0.216619 Oct 18 14:04:19.642446 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3380/6557] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:19 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1391 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:19.648296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-20199ad6-30ae-446c-8963-8228df6b7568 req-bf5303cb-a92c-4740-894c-5525e86f6194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4de7d4-9638-4e5c-96d6-09c381ea51a2", "name": "network-vif-deleted", "tag": "50fd0a95-6a48-47b3-8c7e-fb103677f330"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:19.659802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-20199ad6-30ae-446c-8963-8228df6b7568 req-bf5303cb-a92c-4740-894c-5525e86f6194 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:19.660730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-20199ad6-30ae-446c-8963-8228df6b7568 req-bf5303cb-a92c-4740-894c-5525e86f6194 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:19.661278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-20199ad6-30ae-446c-8963-8228df6b7568 req-bf5303cb-a92c-4740-894c-5525e86f6194 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:19.669527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e7f5bb3f-4146-4d22-9f4d-8dab196dc163 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:19.672147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:19.680739 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e7f5bb3f-4146-4d22-9f4d-8dab196dc163 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1526 microversion: 2.1 time: 0.163431 Oct 18 14:04:19.681247 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-20199ad6-30ae-446c-8963-8228df6b7568 req-bf5303cb-a92c-4740-894c-5525e86f6194 service nova] Creating event network-vif-deleted:50fd0a95-6a48-47b3-8c7e-fb103677f330 for instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 on n-h1-858384-13 Oct 18 14:04:19.694391 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3178/6558] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:19 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1526 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:19.695895 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-20199ad6-30ae-446c-8963-8228df6b7568 req-bf5303cb-a92c-4740-894c-5525e86f6194 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051864 Oct 18 14:04:19.701436 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3381/6559] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:20.664179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-26d1e22a-30c2-4d47-91b7-d71f0012fbc1 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:20.664729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-26d1e22a-30c2-4d47-91b7-d71f0012fbc1 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:20.673059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26d1e22a-30c2-4d47-91b7-d71f0012fbc1 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:20.673573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26d1e22a-30c2-4d47-91b7-d71f0012fbc1 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:20.674007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26d1e22a-30c2-4d47-91b7-d71f0012fbc1 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:20.674699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26d1e22a-30c2-4d47-91b7-d71f0012fbc1 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:20.675158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26d1e22a-30c2-4d47-91b7-d71f0012fbc1 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:20.675564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26d1e22a-30c2-4d47-91b7-d71f0012fbc1 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:20.708961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1d34e854-c047-44aa-b5a6-4df8c5366b28 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:20.710442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1d34e854-c047-44aa-b5a6-4df8c5366b28 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:20.717462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d34e854-c047-44aa-b5a6-4df8c5366b28 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:20.718296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d34e854-c047-44aa-b5a6-4df8c5366b28 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:20.718801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d34e854-c047-44aa-b5a6-4df8c5366b28 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:20.719560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d34e854-c047-44aa-b5a6-4df8c5366b28 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:20.720054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d34e854-c047-44aa-b5a6-4df8c5366b28 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:20.720580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d34e854-c047-44aa-b5a6-4df8c5366b28 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:20.796689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1d34e854-c047-44aa-b5a6-4df8c5366b28 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:20.804997 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1d34e854-c047-44aa-b5a6-4df8c5366b28 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1361 microversion: 2.1 time: 0.101362 Oct 18 14:04:20.805972 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3382/6560] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:20 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1361 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:04:20.836460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-26d1e22a-30c2-4d47-91b7-d71f0012fbc1 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:20.845550 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-26d1e22a-30c2-4d47-91b7-d71f0012fbc1 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1563 microversion: 2.1 time: 0.185196 Oct 18 14:04:20.846479 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3179/6561] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:20 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:20.868984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bbe4701a-a8bc-4da7-a679-cadd3f5bbbdb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:20.869690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bbe4701a-a8bc-4da7-a679-cadd3f5bbbdb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:20.876717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe4701a-a8bc-4da7-a679-cadd3f5bbbdb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:20.877259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe4701a-a8bc-4da7-a679-cadd3f5bbbdb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:20.877718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe4701a-a8bc-4da7-a679-cadd3f5bbbdb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:20.878443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe4701a-a8bc-4da7-a679-cadd3f5bbbdb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:20.878918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe4701a-a8bc-4da7-a679-cadd3f5bbbdb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:20.879356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bbe4701a-a8bc-4da7-a679-cadd3f5bbbdb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:21.027212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bbe4701a-a8bc-4da7-a679-cadd3f5bbbdb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:21.036793 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bbe4701a-a8bc-4da7-a679-cadd3f5bbbdb tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1563 microversion: 2.1 time: 0.171659 Oct 18 14:04:21.037402 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3383/6562] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:20 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:21.828956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aac5811f-c2c3-47bb-9e30-44ce8758a2ef tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:21.829630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aac5811f-c2c3-47bb-9e30-44ce8758a2ef tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:21.837585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aac5811f-c2c3-47bb-9e30-44ce8758a2ef tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:21.838072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aac5811f-c2c3-47bb-9e30-44ce8758a2ef tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:21.838507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aac5811f-c2c3-47bb-9e30-44ce8758a2ef tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:21.839220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aac5811f-c2c3-47bb-9e30-44ce8758a2ef tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:21.839679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aac5811f-c2c3-47bb-9e30-44ce8758a2ef tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:21.840272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aac5811f-c2c3-47bb-9e30-44ce8758a2ef tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:21.922649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aac5811f-c2c3-47bb-9e30-44ce8758a2ef tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:21.931497 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aac5811f-c2c3-47bb-9e30-44ce8758a2ef tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1361 microversion: 2.1 time: 0.107216 Oct 18 14:04:21.932120 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3180/6563] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:21 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1361 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:22.959056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e8feb014-6826-4233-a0e8-120ec23eb44e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:22.959056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e8feb014-6826-4233-a0e8-120ec23eb44e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:22.967033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8feb014-6826-4233-a0e8-120ec23eb44e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:22.967729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8feb014-6826-4233-a0e8-120ec23eb44e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:22.968228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8feb014-6826-4233-a0e8-120ec23eb44e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:22.968983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8feb014-6826-4233-a0e8-120ec23eb44e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:22.969548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8feb014-6826-4233-a0e8-120ec23eb44e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:22.970079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8feb014-6826-4233-a0e8-120ec23eb44e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:23.060018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e8feb014-6826-4233-a0e8-120ec23eb44e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:23.072938 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e8feb014-6826-4233-a0e8-120ec23eb44e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1361 microversion: 2.1 time: 0.118800 Oct 18 14:04:23.073904 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3384/6564] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:22 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1361 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:23.479469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3d57dbe1-d7d5-4760-bd8a-018c38270c5c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:23.480116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-b3a20d10-dca9-42fa-acda-e2800de14b59 req-f9244f9b-2501-4609-8e5b-8be6ed1d8219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feffb0ae-c79e-45ca-857e-95371f190abc", "tag": "1fe58928-5578-443e-bbea-1093d7288e81"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:23.480238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3d57dbe1-d7d5-4760-bd8a-018c38270c5c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:23.490646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b3a20d10-dca9-42fa-acda-e2800de14b59 req-f9244f9b-2501-4609-8e5b-8be6ed1d8219 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:23.491551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b3a20d10-dca9-42fa-acda-e2800de14b59 req-f9244f9b-2501-4609-8e5b-8be6ed1d8219 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:23.492071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b3a20d10-dca9-42fa-acda-e2800de14b59 req-f9244f9b-2501-4609-8e5b-8be6ed1d8219 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:23.497630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d57dbe1-d7d5-4760-bd8a-018c38270c5c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:23.499129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d57dbe1-d7d5-4760-bd8a-018c38270c5c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:23.499887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d57dbe1-d7d5-4760-bd8a-018c38270c5c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:23.501073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d57dbe1-d7d5-4760-bd8a-018c38270c5c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:23.501976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d57dbe1-d7d5-4760-bd8a-018c38270c5c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:23.502775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3d57dbe1-d7d5-4760-bd8a-018c38270c5c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:23.507286 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-b3a20d10-dca9-42fa-acda-e2800de14b59 req-f9244f9b-2501-4609-8e5b-8be6ed1d8219 service nova] Creating event network-changed:1fe58928-5578-443e-bbea-1093d7288e81 for instance feffb0ae-c79e-45ca-857e-95371f190abc on n-h1-858384-13 Oct 18 14:04:23.514308 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-b3a20d10-dca9-42fa-acda-e2800de14b59 req-f9244f9b-2501-4609-8e5b-8be6ed1d8219 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037710 Oct 18 14:04:23.515157 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3385/6565] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:23.762036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3d57dbe1-d7d5-4760-bd8a-018c38270c5c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:23.784737 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3d57dbe1-d7d5-4760-bd8a-018c38270c5c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1563 microversion: 2.1 time: 0.310024 Oct 18 14:04:23.787089 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3181/6566] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:23 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1563 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:24.114805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc9dce62-1f68-4270-8c37-5361a35f617c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:24.120222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc9dce62-1f68-4270-8c37-5361a35f617c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:24.130836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc9dce62-1f68-4270-8c37-5361a35f617c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:24.132076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc9dce62-1f68-4270-8c37-5361a35f617c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:24.132783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc9dce62-1f68-4270-8c37-5361a35f617c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:24.133864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc9dce62-1f68-4270-8c37-5361a35f617c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:24.134596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc9dce62-1f68-4270-8c37-5361a35f617c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:24.135241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc9dce62-1f68-4270-8c37-5361a35f617c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:24.240210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc9dce62-1f68-4270-8c37-5361a35f617c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:24.250615 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc9dce62-1f68-4270-8c37-5361a35f617c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1361 microversion: 2.1 time: 0.145454 Oct 18 14:04:24.252116 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3386/6567] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:24 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:25.279908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:25.280594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:25.283590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:25.290207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:25.290693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:25.291200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:25.291916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:25.292422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:25.293045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:25.334662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:25.335060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:25.335508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:25.335973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lazy-loading 'fault' on Instance uuid 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:04:25.401950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:25.413531 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9fe282f3-538e-410b-8843-eed28be2eb5f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 200 len: 1366 microversion: 2.1 time: 0.141104 Oct 18 14:04:25.414846 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3182/6568] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:25 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:26.439394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-075e3f11-a1e4-4f78-98fd-7a793e1733b2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:26.439950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-075e3f11-a1e4-4f78-98fd-7a793e1733b2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:26.442907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:26.449114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-075e3f11-a1e4-4f78-98fd-7a793e1733b2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:26.449664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-075e3f11-a1e4-4f78-98fd-7a793e1733b2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:26.450611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-075e3f11-a1e4-4f78-98fd-7a793e1733b2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:26.451357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-075e3f11-a1e4-4f78-98fd-7a793e1733b2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:26.451837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-075e3f11-a1e4-4f78-98fd-7a793e1733b2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:26.452284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-075e3f11-a1e4-4f78-98fd-7a793e1733b2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:26.474804 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-075e3f11-a1e4-4f78-98fd-7a793e1733b2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-075e3f11-a1e4-4f78-98fd-7a793e1733b2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 HTTP/1.1 Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '0c4de7d4-9638-4e5c-96d6-09c381ea51a2'} Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:26.476364 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:26.484238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:26.484238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:26.484238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:26.484238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:04:26.484238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:04:26.484238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:26.484238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:26.484238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-075e3f11-a1e4-4f78-98fd-7a793e1733b2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:04:26.484238 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-075e3f11-a1e4-4f78-98fd-7a793e1733b2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 404 len: 111 microversion: 2.1 time: 0.042646 Oct 18 14:04:26.484238 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3387/6569] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:26 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:04:30.781924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9ea4c549-93cf-456e-8b4d-65b47ad355e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:30.782441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9ea4c549-93cf-456e-8b4d-65b47ad355e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:30.789372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ea4c549-93cf-456e-8b4d-65b47ad355e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:30.789849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ea4c549-93cf-456e-8b4d-65b47ad355e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:30.790282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ea4c549-93cf-456e-8b4d-65b47ad355e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:30.790965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ea4c549-93cf-456e-8b4d-65b47ad355e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:30.791409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ea4c549-93cf-456e-8b4d-65b47ad355e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:30.791829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ea4c549-93cf-456e-8b4d-65b47ad355e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:30.817556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9ea4c549-93cf-456e-8b4d-65b47ad355e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:04:30.895841 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9ea4c549-93cf-456e-8b4d-65b47ad355e8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "DELETE /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 204 len: 0 microversion: 2.1 time: 0.118086 Oct 18 14:04:30.896436 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3183/6570] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:04:30 2022] DELETE /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 14:04:30.906116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-60cc7d23-e6d0-4ce5-a390-7c756a77ef9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:30.906992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-60cc7d23-e6d0-4ce5-a390-7c756a77ef9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:30.914059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60cc7d23-e6d0-4ce5-a390-7c756a77ef9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:30.914632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60cc7d23-e6d0-4ce5-a390-7c756a77ef9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:30.915159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60cc7d23-e6d0-4ce5-a390-7c756a77ef9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:30.915882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60cc7d23-e6d0-4ce5-a390-7c756a77ef9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:30.916354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60cc7d23-e6d0-4ce5-a390-7c756a77ef9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:30.917097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60cc7d23-e6d0-4ce5-a390-7c756a77ef9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:31.052991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-60cc7d23-e6d0-4ce5-a390-7c756a77ef9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:31.060846 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-60cc7d23-e6d0-4ce5-a390-7c756a77ef9a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1408 microversion: 2.1 time: 0.159784 Oct 18 14:04:31.061445 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3388/6571] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:30 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:32.084585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fc0f1119-20c8-4626-b31f-121f3990e7fd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:32.085937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fc0f1119-20c8-4626-b31f-121f3990e7fd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:32.093759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc0f1119-20c8-4626-b31f-121f3990e7fd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:32.094314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc0f1119-20c8-4626-b31f-121f3990e7fd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:32.094762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc0f1119-20c8-4626-b31f-121f3990e7fd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:32.095475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc0f1119-20c8-4626-b31f-121f3990e7fd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:32.095933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc0f1119-20c8-4626-b31f-121f3990e7fd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:32.096360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc0f1119-20c8-4626-b31f-121f3990e7fd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:32.235578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fc0f1119-20c8-4626-b31f-121f3990e7fd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:32.243473 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fc0f1119-20c8-4626-b31f-121f3990e7fd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1408 microversion: 2.1 time: 0.163293 Oct 18 14:04:32.244056 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3184/6572] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:32 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:32.979594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-2dded778-708a-4855-9181-d50c4f43bc61 req-1818decd-3ff1-4a78-b550-a1db78848cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c7e580-e9c9-4b7f-b3a0-c00742fea035", "name": "network-vif-deleted", "tag": "8deb68a0-939d-4ce9-b2c1-db0f3a52da0f"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:32.992825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2dded778-708a-4855-9181-d50c4f43bc61 req-1818decd-3ff1-4a78-b550-a1db78848cfb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:32.993427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2dded778-708a-4855-9181-d50c4f43bc61 req-1818decd-3ff1-4a78-b550-a1db78848cfb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:32.994068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2dded778-708a-4855-9181-d50c4f43bc61 req-1818decd-3ff1-4a78-b550-a1db78848cfb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:33.009947 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-2dded778-708a-4855-9181-d50c4f43bc61 req-1818decd-3ff1-4a78-b550-a1db78848cfb service nova] Creating event network-vif-deleted:8deb68a0-939d-4ce9-b2c1-db0f3a52da0f for instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 on n-h2-858384-13 Oct 18 14:04:33.015402 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-2dded778-708a-4855-9181-d50c4f43bc61 req-1818decd-3ff1-4a78-b550-a1db78848cfb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039552 Oct 18 14:04:33.016010 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3389/6573] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:33.267842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-200d66bc-2e28-4ba6-a862-5b7930269c4e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:33.268638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-200d66bc-2e28-4ba6-a862-5b7930269c4e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:33.275976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-200d66bc-2e28-4ba6-a862-5b7930269c4e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:33.276804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-200d66bc-2e28-4ba6-a862-5b7930269c4e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:33.277378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-200d66bc-2e28-4ba6-a862-5b7930269c4e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:33.278730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-200d66bc-2e28-4ba6-a862-5b7930269c4e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:33.279848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-200d66bc-2e28-4ba6-a862-5b7930269c4e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:33.280626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-200d66bc-2e28-4ba6-a862-5b7930269c4e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:33.348088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-200d66bc-2e28-4ba6-a862-5b7930269c4e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:33.356253 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-200d66bc-2e28-4ba6-a862-5b7930269c4e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1201 microversion: 2.1 time: 0.092281 Oct 18 14:04:33.361263 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3185/6574] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:33 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:34.382492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c26328f-f8c2-477f-9816-45f343cd6090 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:34.383520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c26328f-f8c2-477f-9816-45f343cd6090 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:34.391633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c26328f-f8c2-477f-9816-45f343cd6090 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:34.392145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c26328f-f8c2-477f-9816-45f343cd6090 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:34.392599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c26328f-f8c2-477f-9816-45f343cd6090 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:34.393367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c26328f-f8c2-477f-9816-45f343cd6090 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:34.393845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c26328f-f8c2-477f-9816-45f343cd6090 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:34.394290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c26328f-f8c2-477f-9816-45f343cd6090 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:34.481795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3c26328f-f8c2-477f-9816-45f343cd6090 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:34.492223 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c26328f-f8c2-477f-9816-45f343cd6090 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1201 microversion: 2.1 time: 0.116434 Oct 18 14:04:34.492851 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3390/6575] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:34 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1201 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:35.520586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ce604939-ad1e-4771-81e2-665d055051f4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:35.521256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ce604939-ad1e-4771-81e2-665d055051f4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:35.529020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce604939-ad1e-4771-81e2-665d055051f4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:35.529275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce604939-ad1e-4771-81e2-665d055051f4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:35.529712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce604939-ad1e-4771-81e2-665d055051f4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:35.530402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce604939-ad1e-4771-81e2-665d055051f4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:35.530848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce604939-ad1e-4771-81e2-665d055051f4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:35.531265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce604939-ad1e-4771-81e2-665d055051f4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:35.598684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ce604939-ad1e-4771-81e2-665d055051f4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:35.606989 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ce604939-ad1e-4771-81e2-665d055051f4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1201 microversion: 2.1 time: 0.090136 Oct 18 14:04:35.607464 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3186/6576] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:35 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:36.629571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-511223b2-37c3-4a9d-8d72-94a80e0009d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:36.630194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-511223b2-37c3-4a9d-8d72-94a80e0009d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:36.637322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-511223b2-37c3-4a9d-8d72-94a80e0009d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:36.637908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-511223b2-37c3-4a9d-8d72-94a80e0009d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:36.638359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-511223b2-37c3-4a9d-8d72-94a80e0009d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:36.639154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-511223b2-37c3-4a9d-8d72-94a80e0009d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:36.639627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-511223b2-37c3-4a9d-8d72-94a80e0009d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:36.640064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-511223b2-37c3-4a9d-8d72-94a80e0009d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:36.711613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-511223b2-37c3-4a9d-8d72-94a80e0009d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:36.722988 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-511223b2-37c3-4a9d-8d72-94a80e0009d2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 200 len: 1201 microversion: 2.1 time: 0.097431 Oct 18 14:04:36.723801 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3391/6577] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:36 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 1201 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:04:37.747908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-69883612-cf7a-4307-af0b-8034181b8fe8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:37.748690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-69883612-cf7a-4307-af0b-8034181b8fe8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:37.756184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69883612-cf7a-4307-af0b-8034181b8fe8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:37.756704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69883612-cf7a-4307-af0b-8034181b8fe8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:37.757190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69883612-cf7a-4307-af0b-8034181b8fe8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:37.758101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69883612-cf7a-4307-af0b-8034181b8fe8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:37.758569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69883612-cf7a-4307-af0b-8034181b8fe8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:37.758996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69883612-cf7a-4307-af0b-8034181b8fe8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:37.774106 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-69883612-cf7a-4307-af0b-8034181b8fe8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-69883612-cf7a-4307-af0b-8034181b8fe8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 HTTP/1.1 Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '07c7e580-e9c9-4b7f-b3a0-c00742fea035'} Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:37.775767 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:37.781401 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:37.781401 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:37.781401 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:37.781401 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:04:37.781401 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:04:37.781401 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:37.781401 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:37.781401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-69883612-cf7a-4307-af0b-8034181b8fe8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:04:37.781401 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-69883612-cf7a-4307-af0b-8034181b8fe8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 404 len: 111 microversion: 2.1 time: 0.033664 Oct 18 14:04:37.781401 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3187/6578] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:37 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:04:40.989510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dd925795-87c3-4ef8-bda4-8b85efc9ef8a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:40.990050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dd925795-87c3-4ef8-bda4-8b85efc9ef8a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:40.997542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd925795-87c3-4ef8-bda4-8b85efc9ef8a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:40.998043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd925795-87c3-4ef8-bda4-8b85efc9ef8a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:40.998487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd925795-87c3-4ef8-bda4-8b85efc9ef8a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:40.999188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd925795-87c3-4ef8-bda4-8b85efc9ef8a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:40.999651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd925795-87c3-4ef8-bda4-8b85efc9ef8a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:41.000084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd925795-87c3-4ef8-bda4-8b85efc9ef8a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:41.015041 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-dd925795-87c3-4ef8-bda4-8b85efc9ef8a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dd925795-87c3-4ef8-bda4-8b85efc9ef8a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 HTTP/1.1 Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '0c4de7d4-9638-4e5c-96d6-09c381ea51a2'} Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:04:41.016736 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dd925795-87c3-4ef8-bda4-8b85efc9ef8a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dd925795-87c3-4ef8-bda4-8b85efc9ef8a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 404 len: 111 microversion: 2.1 time: 0.032626 Oct 18 14:04:41.023944 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3392/6579] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:04:40 2022] DELETE /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:04:41.031445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2889a858-22a9-4e74-a3cd-12082ea35d0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:41.032070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2889a858-22a9-4e74-a3cd-12082ea35d0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 0c4de7d4-9638-4e5c-96d6-09c381ea51a2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:41.039265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2889a858-22a9-4e74-a3cd-12082ea35d0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:41.039746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2889a858-22a9-4e74-a3cd-12082ea35d0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:41.040187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2889a858-22a9-4e74-a3cd-12082ea35d0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:41.040982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2889a858-22a9-4e74-a3cd-12082ea35d0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:41.041461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2889a858-22a9-4e74-a3cd-12082ea35d0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:41.041883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2889a858-22a9-4e74-a3cd-12082ea35d0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:41.060444 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-2889a858-22a9-4e74-a3cd-12082ea35d0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2889a858-22a9-4e74-a3cd-12082ea35d0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 HTTP/1.1 Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '0c4de7d4-9638-4e5c-96d6-09c381ea51a2'} Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:41.062154 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.066731 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:41.066731 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:41.066731 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:41.066731 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:04:41.066731 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:04:41.066731 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. Oct 18 14:04:41.066731 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.066731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2889a858-22a9-4e74-a3cd-12082ea35d0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 0c4de7d4-9638-4e5c-96d6-09c381ea51a2 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:04:41.066731 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2889a858-22a9-4e74-a3cd-12082ea35d0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2" status: 404 len: 111 microversion: 2.1 time: 0.036819 Oct 18 14:04:41.066731 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3188/6580] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:41 2022] GET /compute/v2.1/servers/0c4de7d4-9638-4e5c-96d6-09c381ea51a2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:04:41.472641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-51827fb5-5452-4e0f-a74f-16e3d586b2d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:41.473073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-51827fb5-5452-4e0f-a74f-16e3d586b2d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:41.479354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51827fb5-5452-4e0f-a74f-16e3d586b2d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:41.479887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51827fb5-5452-4e0f-a74f-16e3d586b2d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:41.480347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51827fb5-5452-4e0f-a74f-16e3d586b2d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:41.481088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51827fb5-5452-4e0f-a74f-16e3d586b2d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:41.481591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51827fb5-5452-4e0f-a74f-16e3d586b2d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:41.482027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51827fb5-5452-4e0f-a74f-16e3d586b2d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:41.502986 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-51827fb5-5452-4e0f-a74f-16e3d586b2d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-51827fb5-5452-4e0f-a74f-16e3d586b2d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 HTTP/1.1 Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '07c7e580-e9c9-4b7f-b3a0-c00742fea035'} Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:04:41.504558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-51827fb5-5452-4e0f-a74f-16e3d586b2d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-51827fb5-5452-4e0f-a74f-16e3d586b2d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "DELETE /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 404 len: 111 microversion: 2.1 time: 0.037624 Oct 18 14:04:41.509028 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3393/6581] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:04:41 2022] DELETE /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:04:41.515928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1a9db2fd-d242-4276-a3a6-621f4b2a8907 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:41.516569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1a9db2fd-d242-4276-a3a6-621f4b2a8907 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 07c7e580-e9c9-4b7f-b3a0-c00742fea035] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:41.522788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a9db2fd-d242-4276-a3a6-621f4b2a8907 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:41.523280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a9db2fd-d242-4276-a3a6-621f4b2a8907 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:41.523722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a9db2fd-d242-4276-a3a6-621f4b2a8907 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:41.524420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a9db2fd-d242-4276-a3a6-621f4b2a8907 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:41.524874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a9db2fd-d242-4276-a3a6-621f4b2a8907 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:41.525341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a9db2fd-d242-4276-a3a6-621f4b2a8907 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:41.539773 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-1a9db2fd-d242-4276-a3a6-621f4b2a8907 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1a9db2fd-d242-4276-a3a6-621f4b2a8907 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 HTTP/1.1 Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '07c7e580-e9c9-4b7f-b3a0-c00742fea035'} Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:04:41.541351 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.545667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:04:41.545667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:04:41.545667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:04:41.545667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:04:41.545667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:04:41.545667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. Oct 18 14:04:41.545667 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:04:41.545667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1a9db2fd-d242-4276-a3a6-621f4b2a8907 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 07c7e580-e9c9-4b7f-b3a0-c00742fea035 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:04:41.545667 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1a9db2fd-d242-4276-a3a6-621f4b2a8907 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035" status: 404 len: 111 microversion: 2.1 time: 0.031502 Oct 18 14:04:41.545667 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3189/6582] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:41 2022] GET /compute/v2.1/servers/07c7e580-e9c9-4b7f-b3a0-c00742fea035 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:04:41.618413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-26af3798-22a6-40bc-bdcd-0aa45ee7aad3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Action: 'create', calling method: .version_select at 0x7ff60e5495e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1682685967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGarswuuC9YMC+QhgppJVT/diBxoS3TrEN3jK2vrfv2/xb/ETDLeAzGqJA7PY/ORaEURx9ule9R7NnAxAWZa4uo3f+amHCUgpbvZCCFPVNkasnVj/jChKwYhprvojpQz2A=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:41.636224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-26af3798-22a6-40bc-bdcd-0aa45ee7aad3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:04:41.643679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-26af3798-22a6-40bc-bdcd-0aa45ee7aad3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for user 1d29125d80d146749096e754db7d84d4 and project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:04:41.670207 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-26af3798-22a6-40bc-bdcd-0aa45ee7aad3 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.055776 Oct 18 14:04:41.670853 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3394/6583] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:04:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:04:57.221115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-97b0c017-1ad3-4807-a5f1-d92b74eb7a50 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:57.224662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-97b0c017-1ad3-4807-a5f1-d92b74eb7a50 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:57.228603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:57.229437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:57.237808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97b0c017-1ad3-4807-a5f1-d92b74eb7a50 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:57.238859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97b0c017-1ad3-4807-a5f1-d92b74eb7a50 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:57.239357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97b0c017-1ad3-4807-a5f1-d92b74eb7a50 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:57.240160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97b0c017-1ad3-4807-a5f1-d92b74eb7a50 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:57.240687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97b0c017-1ad3-4807-a5f1-d92b74eb7a50 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:57.241162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97b0c017-1ad3-4807-a5f1-d92b74eb7a50 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:57.323358 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-97b0c017-1ad3-4807-a5f1-d92b74eb7a50 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc/action" status: 200 len: 24533 microversion: 2.1 time: 0.108168 Oct 18 14:04:57.324271 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3190/6584] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:04:57 2022] POST /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc/action => generated 24533 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 14:04:59.100413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:59.101228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:59.102073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:04:59.106490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1115096679", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1682685967", "security_groups": [{"name": "tempest-secgroup-smoke-918686956"}], "block_device_mapping_v2": [{"uuid": "3784091e-77fb-40f3-8f4f-cf64a102030c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d0463e74-962e-46fb-9c76-86e27a0887d2"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:04:59.232230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] validate_networks() for [('d0463e74-962e-46fb-9c76-86e27a0887d2', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:04:59.605709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:04:59.606154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:04:59.606649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:04:59.607074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:04:59.608208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:04:59.617659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:59.618160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:59.618611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:59.619356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:04:59.619825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:04:59.620268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:04:59.640815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:04:59.646216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for user 1d29125d80d146749096e754db7d84d4 and project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:04:59.707765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:04:59.709810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3784091e-77fb-40f3-8f4f-cf64a102030c',volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:04:59.851415 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-03ff9404-e6bd-41db-9b4f-5ba4be6ffe7c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.753100 Oct 18 14:04:59.856414 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3395/6585] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:04:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:04:59.864778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e539b63-41db-4fdb-b9c0-4890656b67af tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:04:59.865587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0e539b63-41db-4fdb-b9c0-4890656b67af tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:04:59.934146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e539b63-41db-4fdb-b9c0-4890656b67af tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:04:59.942646 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e539b63-41db-4fdb-b9c0-4890656b67af tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1095 microversion: 2.1 time: 0.082639 Oct 18 14:04:59.943498 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3191/6586] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:04:59 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:00.969928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-56bfe83c-c06b-4e02-919d-1bff3dc5fad8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:00.970812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-56bfe83c-c06b-4e02-919d-1bff3dc5fad8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:00.979282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56bfe83c-c06b-4e02-919d-1bff3dc5fad8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:00.979798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56bfe83c-c06b-4e02-919d-1bff3dc5fad8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:00.980262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56bfe83c-c06b-4e02-919d-1bff3dc5fad8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:00.981010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56bfe83c-c06b-4e02-919d-1bff3dc5fad8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:00.981506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56bfe83c-c06b-4e02-919d-1bff3dc5fad8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:00.981973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-56bfe83c-c06b-4e02-919d-1bff3dc5fad8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:01.081484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-56bfe83c-c06b-4e02-919d-1bff3dc5fad8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:01.100715 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-56bfe83c-c06b-4e02-919d-1bff3dc5fad8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1201 microversion: 2.1 time: 0.137221 Oct 18 14:05:01.101653 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3396/6587] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:00 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1201 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:02.125114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7431f903-503c-4ff1-84fc-ddaf9ddfb258 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:02.125953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7431f903-503c-4ff1-84fc-ddaf9ddfb258 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:02.133564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7431f903-503c-4ff1-84fc-ddaf9ddfb258 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:02.134207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7431f903-503c-4ff1-84fc-ddaf9ddfb258 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:02.134750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7431f903-503c-4ff1-84fc-ddaf9ddfb258 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:02.135565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7431f903-503c-4ff1-84fc-ddaf9ddfb258 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:02.136179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7431f903-503c-4ff1-84fc-ddaf9ddfb258 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:02.136691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7431f903-503c-4ff1-84fc-ddaf9ddfb258 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:02.295444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7431f903-503c-4ff1-84fc-ddaf9ddfb258 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:02.305750 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7431f903-503c-4ff1-84fc-ddaf9ddfb258 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1278 microversion: 2.1 time: 0.184460 Oct 18 14:05:02.306394 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3192/6588] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:02 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:02.625232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-dfab6346-7880-4487-92f5-4aa0ef875029 req-fac1940b-1ffc-4c0b-bf20-94109bcaed57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e72811-100d-46d0-b8af-bcfc77d3cc91", "tag": "eb4fe447-6c05-4bd3-82b8-9126e0742cfd"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:02.652248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dfab6346-7880-4487-92f5-4aa0ef875029 req-fac1940b-1ffc-4c0b-bf20-94109bcaed57 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:02.652741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dfab6346-7880-4487-92f5-4aa0ef875029 req-fac1940b-1ffc-4c0b-bf20-94109bcaed57 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:02.653199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-dfab6346-7880-4487-92f5-4aa0ef875029 req-fac1940b-1ffc-4c0b-bf20-94109bcaed57 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:02.671117 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-dfab6346-7880-4487-92f5-4aa0ef875029 req-fac1940b-1ffc-4c0b-bf20-94109bcaed57 service nova] Creating event network-changed:eb4fe447-6c05-4bd3-82b8-9126e0742cfd for instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 on n-h2-858384-13 Oct 18 14:05:02.676583 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-dfab6346-7880-4487-92f5-4aa0ef875029 req-fac1940b-1ffc-4c0b-bf20-94109bcaed57 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057353 Oct 18 14:05:02.677233 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3397/6589] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:03.329791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e5815c24-33b9-4e35-ae00-fedaa5657fc8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:03.330672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e5815c24-33b9-4e35-ae00-fedaa5657fc8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:03.338259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5815c24-33b9-4e35-ae00-fedaa5657fc8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:03.338804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5815c24-33b9-4e35-ae00-fedaa5657fc8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:03.339195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5815c24-33b9-4e35-ae00-fedaa5657fc8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:03.340838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5815c24-33b9-4e35-ae00-fedaa5657fc8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:03.341413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5815c24-33b9-4e35-ae00-fedaa5657fc8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:03.342196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e5815c24-33b9-4e35-ae00-fedaa5657fc8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:03.494968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e5815c24-33b9-4e35-ae00-fedaa5657fc8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:03.504037 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e5815c24-33b9-4e35-ae00-fedaa5657fc8 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1278 microversion: 2.1 time: 0.178092 Oct 18 14:05:03.505232 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3193/6590] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:03 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:04.528138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f5f0497e-6b89-4ae3-98f6-d03f7495e04c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:04.528851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f5f0497e-6b89-4ae3-98f6-d03f7495e04c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:04.535430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5f0497e-6b89-4ae3-98f6-d03f7495e04c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:04.535926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5f0497e-6b89-4ae3-98f6-d03f7495e04c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:04.536382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5f0497e-6b89-4ae3-98f6-d03f7495e04c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:04.537081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5f0497e-6b89-4ae3-98f6-d03f7495e04c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:04.537567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5f0497e-6b89-4ae3-98f6-d03f7495e04c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:04.538003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5f0497e-6b89-4ae3-98f6-d03f7495e04c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:04.695152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f5f0497e-6b89-4ae3-98f6-d03f7495e04c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:04.703964 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f5f0497e-6b89-4ae3-98f6-d03f7495e04c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1278 microversion: 2.1 time: 0.181077 Oct 18 14:05:04.704801 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3398/6591] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:04 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:05.727115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-012d5f39-ae10-494d-ac62-efab06620d4f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:05.727884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-012d5f39-ae10-494d-ac62-efab06620d4f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:05.735545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-012d5f39-ae10-494d-ac62-efab06620d4f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:05.736037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-012d5f39-ae10-494d-ac62-efab06620d4f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:05.736479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-012d5f39-ae10-494d-ac62-efab06620d4f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:05.737237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-012d5f39-ae10-494d-ac62-efab06620d4f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:05.737692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-012d5f39-ae10-494d-ac62-efab06620d4f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:05.738152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-012d5f39-ae10-494d-ac62-efab06620d4f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:05.876869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-012d5f39-ae10-494d-ac62-efab06620d4f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:05.885439 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-012d5f39-ae10-494d-ac62-efab06620d4f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1278 microversion: 2.1 time: 0.162230 Oct 18 14:05:05.886055 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3194/6592] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:05 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:06.910055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2b65ce4f-3b87-490a-9ecf-23b60a7e6292 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:06.910677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2b65ce4f-3b87-490a-9ecf-23b60a7e6292 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:06.918111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b65ce4f-3b87-490a-9ecf-23b60a7e6292 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:06.918607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b65ce4f-3b87-490a-9ecf-23b60a7e6292 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:06.919053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b65ce4f-3b87-490a-9ecf-23b60a7e6292 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:06.919883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b65ce4f-3b87-490a-9ecf-23b60a7e6292 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:06.920370 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b65ce4f-3b87-490a-9ecf-23b60a7e6292 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:06.920806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b65ce4f-3b87-490a-9ecf-23b60a7e6292 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:07.062406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2b65ce4f-3b87-490a-9ecf-23b60a7e6292 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:07.070317 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2b65ce4f-3b87-490a-9ecf-23b60a7e6292 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1266 microversion: 2.1 time: 0.164201 Oct 18 14:05:07.070895 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3399/6593] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:06 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:08.093799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3fb03094-a40b-48ad-9d04-4148dffc1505 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:08.094408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3fb03094-a40b-48ad-9d04-4148dffc1505 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:08.101921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb03094-a40b-48ad-9d04-4148dffc1505 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:08.102407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb03094-a40b-48ad-9d04-4148dffc1505 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:08.102846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb03094-a40b-48ad-9d04-4148dffc1505 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:08.103536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb03094-a40b-48ad-9d04-4148dffc1505 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:08.103979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb03094-a40b-48ad-9d04-4148dffc1505 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:08.104401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb03094-a40b-48ad-9d04-4148dffc1505 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:08.251218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3fb03094-a40b-48ad-9d04-4148dffc1505 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:08.259134 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3fb03094-a40b-48ad-9d04-4148dffc1505 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1266 microversion: 2.1 time: 0.169345 Oct 18 14:05:08.259714 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3195/6594] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:08 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:09.282687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-096c4cee-bb67-4008-a21b-7f1ce095c8f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:09.283311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-096c4cee-bb67-4008-a21b-7f1ce095c8f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:09.290228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-096c4cee-bb67-4008-a21b-7f1ce095c8f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:09.290711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-096c4cee-bb67-4008-a21b-7f1ce095c8f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:09.291154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-096c4cee-bb67-4008-a21b-7f1ce095c8f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:09.291853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-096c4cee-bb67-4008-a21b-7f1ce095c8f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:09.292315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-096c4cee-bb67-4008-a21b-7f1ce095c8f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:09.292748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-096c4cee-bb67-4008-a21b-7f1ce095c8f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:09.427624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-096c4cee-bb67-4008-a21b-7f1ce095c8f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:09.435744 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-096c4cee-bb67-4008-a21b-7f1ce095c8f0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1266 microversion: 2.1 time: 0.157612 Oct 18 14:05:09.436863 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3400/6595] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:09 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:10.459958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0bf02b9b-7407-4f2e-9dee-d033597ae2e2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:10.460564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0bf02b9b-7407-4f2e-9dee-d033597ae2e2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:10.463382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:10.469719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0bf02b9b-7407-4f2e-9dee-d033597ae2e2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:10.470203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0bf02b9b-7407-4f2e-9dee-d033597ae2e2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:10.470639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0bf02b9b-7407-4f2e-9dee-d033597ae2e2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:10.471328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0bf02b9b-7407-4f2e-9dee-d033597ae2e2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:10.471780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0bf02b9b-7407-4f2e-9dee-d033597ae2e2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:10.472203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0bf02b9b-7407-4f2e-9dee-d033597ae2e2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:10.612454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0bf02b9b-7407-4f2e-9dee-d033597ae2e2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:10.620509 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0bf02b9b-7407-4f2e-9dee-d033597ae2e2 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1266 microversion: 2.1 time: 0.164507 Oct 18 14:05:10.621123 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3196/6596] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:10 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:11.644738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c9e034c7-256d-414a-8214-e4eadc5a6415 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:11.645394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c9e034c7-256d-414a-8214-e4eadc5a6415 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:11.647369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:11.648243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:11.654895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9e034c7-256d-414a-8214-e4eadc5a6415 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:11.655390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9e034c7-256d-414a-8214-e4eadc5a6415 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:11.655836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9e034c7-256d-414a-8214-e4eadc5a6415 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:11.656672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9e034c7-256d-414a-8214-e4eadc5a6415 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:11.657134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9e034c7-256d-414a-8214-e4eadc5a6415 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:11.657595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9e034c7-256d-414a-8214-e4eadc5a6415 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:11.794708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c9e034c7-256d-414a-8214-e4eadc5a6415 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:11.803110 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c9e034c7-256d-414a-8214-e4eadc5a6415 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1266 microversion: 2.1 time: 0.163011 Oct 18 14:05:11.803683 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3401/6597] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:11 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:12.826779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c6cd6c68-7589-421c-bdbe-4c204aeea347 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:12.827413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c6cd6c68-7589-421c-bdbe-4c204aeea347 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:12.834295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6cd6c68-7589-421c-bdbe-4c204aeea347 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:12.834770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6cd6c68-7589-421c-bdbe-4c204aeea347 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:12.835200 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6cd6c68-7589-421c-bdbe-4c204aeea347 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:12.835889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6cd6c68-7589-421c-bdbe-4c204aeea347 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:12.836336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6cd6c68-7589-421c-bdbe-4c204aeea347 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:12.836757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6cd6c68-7589-421c-bdbe-4c204aeea347 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:12.973364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c6cd6c68-7589-421c-bdbe-4c204aeea347 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:12.981634 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c6cd6c68-7589-421c-bdbe-4c204aeea347 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1266 microversion: 2.1 time: 0.159044 Oct 18 14:05:12.982223 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3197/6598] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:12 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:14.004469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a4af4e7-2ee7-4067-843f-92d42f21d116 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:14.005090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1a4af4e7-2ee7-4067-843f-92d42f21d116 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:14.011931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a4af4e7-2ee7-4067-843f-92d42f21d116 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:14.012417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a4af4e7-2ee7-4067-843f-92d42f21d116 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:14.012865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a4af4e7-2ee7-4067-843f-92d42f21d116 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:14.013587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a4af4e7-2ee7-4067-843f-92d42f21d116 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:14.014056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a4af4e7-2ee7-4067-843f-92d42f21d116 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:14.014490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a4af4e7-2ee7-4067-843f-92d42f21d116 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:14.148917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1a4af4e7-2ee7-4067-843f-92d42f21d116 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:14.157370 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1a4af4e7-2ee7-4067-843f-92d42f21d116 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1266 microversion: 2.1 time: 0.157295 Oct 18 14:05:14.157951 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3402/6599] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:13 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:15.001339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-2c356dea-8cfa-4ff3-85ea-4d07adc39b1a req-b55692e1-b266-412d-bf5c-118f0fad7005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e72811-100d-46d0-b8af-bcfc77d3cc91", "name": "network-vif-plugged", "status": "completed", "tag": "eb4fe447-6c05-4bd3-82b8-9126e0742cfd"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:15.013738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2c356dea-8cfa-4ff3-85ea-4d07adc39b1a req-b55692e1-b266-412d-bf5c-118f0fad7005 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:15.014172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2c356dea-8cfa-4ff3-85ea-4d07adc39b1a req-b55692e1-b266-412d-bf5c-118f0fad7005 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:15.014602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2c356dea-8cfa-4ff3-85ea-4d07adc39b1a req-b55692e1-b266-412d-bf5c-118f0fad7005 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:15.026728 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-2c356dea-8cfa-4ff3-85ea-4d07adc39b1a req-b55692e1-b266-412d-bf5c-118f0fad7005 service nova] Creating event network-vif-plugged:eb4fe447-6c05-4bd3-82b8-9126e0742cfd for instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 on n-h2-858384-13 Oct 18 14:05:15.032161 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-2c356dea-8cfa-4ff3-85ea-4d07adc39b1a req-b55692e1-b266-412d-bf5c-118f0fad7005 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035161 Oct 18 14:05:15.032784 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3198/6600] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:15.179935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-83d4d7cf-490f-4f1f-8c7f-4608a4eb36ff tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:15.180555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-83d4d7cf-490f-4f1f-8c7f-4608a4eb36ff tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:15.188026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83d4d7cf-490f-4f1f-8c7f-4608a4eb36ff tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:15.188699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83d4d7cf-490f-4f1f-8c7f-4608a4eb36ff tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:15.189208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83d4d7cf-490f-4f1f-8c7f-4608a4eb36ff tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:15.190123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83d4d7cf-490f-4f1f-8c7f-4608a4eb36ff tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:15.190597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83d4d7cf-490f-4f1f-8c7f-4608a4eb36ff tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:15.191033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-83d4d7cf-490f-4f1f-8c7f-4608a4eb36ff tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:15.336291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-83d4d7cf-490f-4f1f-8c7f-4608a4eb36ff tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:15.345824 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-83d4d7cf-490f-4f1f-8c7f-4608a4eb36ff tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1266 microversion: 2.1 time: 0.169292 Oct 18 14:05:15.346290 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3403/6601] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:15 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:16.369353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-226dbd40-041a-4c08-957c-9e2bf6e55e36 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:16.369960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-226dbd40-041a-4c08-957c-9e2bf6e55e36 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:16.376980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-226dbd40-041a-4c08-957c-9e2bf6e55e36 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:16.377476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-226dbd40-041a-4c08-957c-9e2bf6e55e36 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:16.377906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-226dbd40-041a-4c08-957c-9e2bf6e55e36 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:16.378617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-226dbd40-041a-4c08-957c-9e2bf6e55e36 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:16.379064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-226dbd40-041a-4c08-957c-9e2bf6e55e36 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:16.379489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-226dbd40-041a-4c08-957c-9e2bf6e55e36 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:16.517346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-226dbd40-041a-4c08-957c-9e2bf6e55e36 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:16.525217 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-226dbd40-041a-4c08-957c-9e2bf6e55e36 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1452 microversion: 2.1 time: 0.161063 Oct 18 14:05:16.525788 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3199/6602] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:16 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:16.547712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a294a7c1-e2ef-4ccc-a74e-db478005b4c0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:16.548433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a294a7c1-e2ef-4ccc-a74e-db478005b4c0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:16.555118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a294a7c1-e2ef-4ccc-a74e-db478005b4c0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:16.555615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a294a7c1-e2ef-4ccc-a74e-db478005b4c0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:16.556068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a294a7c1-e2ef-4ccc-a74e-db478005b4c0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:16.556780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a294a7c1-e2ef-4ccc-a74e-db478005b4c0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:16.557373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a294a7c1-e2ef-4ccc-a74e-db478005b4c0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:16.557834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a294a7c1-e2ef-4ccc-a74e-db478005b4c0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:16.695936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a294a7c1-e2ef-4ccc-a74e-db478005b4c0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:16.704121 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a294a7c1-e2ef-4ccc-a74e-db478005b4c0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1452 microversion: 2.1 time: 0.160788 Oct 18 14:05:16.704702 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3404/6603] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:16 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:18.373076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-06cda104-4e17-4b8d-a8cf-7c05c549bc46 req-05e762fd-66e8-4137-9572-3e6858d31793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e72811-100d-46d0-b8af-bcfc77d3cc91", "tag": "eb4fe447-6c05-4bd3-82b8-9126e0742cfd"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:18.385287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-06cda104-4e17-4b8d-a8cf-7c05c549bc46 req-05e762fd-66e8-4137-9572-3e6858d31793 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:18.385767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-06cda104-4e17-4b8d-a8cf-7c05c549bc46 req-05e762fd-66e8-4137-9572-3e6858d31793 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:18.386199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-06cda104-4e17-4b8d-a8cf-7c05c549bc46 req-05e762fd-66e8-4137-9572-3e6858d31793 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:18.398932 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-06cda104-4e17-4b8d-a8cf-7c05c549bc46 req-05e762fd-66e8-4137-9572-3e6858d31793 service nova] Creating event network-changed:eb4fe447-6c05-4bd3-82b8-9126e0742cfd for instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 on n-h2-858384-13 Oct 18 14:05:18.404879 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-06cda104-4e17-4b8d-a8cf-7c05c549bc46 req-05e762fd-66e8-4137-9572-3e6858d31793 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035579 Oct 18 14:05:18.405651 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3200/6604] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:27.729866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b850d0e2-9440-43be-b608-4e1bee3f5a7c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:27.730427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b850d0e2-9440-43be-b608-4e1bee3f5a7c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:27.732905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:27.733613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=52 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:27.739533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b850d0e2-9440-43be-b608-4e1bee3f5a7c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:27.740028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b850d0e2-9440-43be-b608-4e1bee3f5a7c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:27.740479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b850d0e2-9440-43be-b608-4e1bee3f5a7c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:27.741200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b850d0e2-9440-43be-b608-4e1bee3f5a7c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:27.741668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b850d0e2-9440-43be-b608-4e1bee3f5a7c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:27.742103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b850d0e2-9440-43be-b608-4e1bee3f5a7c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:27.884288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b850d0e2-9440-43be-b608-4e1bee3f5a7c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:27.893791 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b850d0e2-9440-43be-b608-4e1bee3f5a7c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1682 microversion: 2.1 time: 0.168035 Oct 18 14:05:27.894493 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3405/6605] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:27 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:27.997577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a3e237b1-9e52-44ef-be5f-1c196fc8c9bf tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:27.999813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a3e237b1-9e52-44ef-be5f-1c196fc8c9bf tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:28.001924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=25 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:28.007203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3e237b1-9e52-44ef-be5f-1c196fc8c9bf tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:28.007689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3e237b1-9e52-44ef-be5f-1c196fc8c9bf tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:28.008129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3e237b1-9e52-44ef-be5f-1c196fc8c9bf tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:28.008826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3e237b1-9e52-44ef-be5f-1c196fc8c9bf tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:28.009349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3e237b1-9e52-44ef-be5f-1c196fc8c9bf tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:28.009730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3e237b1-9e52-44ef-be5f-1c196fc8c9bf tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:28.012767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=51 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:28.084433 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a3e237b1-9e52-44ef-be5f-1c196fc8c9bf tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc/action" status: 200 len: 32608 microversion: 2.1 time: 0.092129 Oct 18 14:05:28.086056 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3201/6606] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:05:27 2022] POST /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc/action => generated 32608 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:05:28.291831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-21bcf634-15fa-4561-83da-fd2e9ab9d5d1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:28.292450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-21bcf634-15fa-4561-83da-fd2e9ab9d5d1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:28.298588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21bcf634-15fa-4561-83da-fd2e9ab9d5d1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:28.299081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21bcf634-15fa-4561-83da-fd2e9ab9d5d1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:28.299531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21bcf634-15fa-4561-83da-fd2e9ab9d5d1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:28.300230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21bcf634-15fa-4561-83da-fd2e9ab9d5d1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:28.300690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21bcf634-15fa-4561-83da-fd2e9ab9d5d1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:28.301313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21bcf634-15fa-4561-83da-fd2e9ab9d5d1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:28.433611 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-21bcf634-15fa-4561-83da-fd2e9ab9d5d1 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1835 microversion: 2.1 time: 0.145447 Oct 18 14:05:28.434190 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3406/6607] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:28 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1835 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:28.464803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-98891247-c875-4ca6-9cbe-5e52c68c327a tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:28.467431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-98891247-c875-4ca6-9cbe-5e52c68c327a tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:28.474795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98891247-c875-4ca6-9cbe-5e52c68c327a tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:28.475281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98891247-c875-4ca6-9cbe-5e52c68c327a tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:28.475721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98891247-c875-4ca6-9cbe-5e52c68c327a tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:28.476418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98891247-c875-4ca6-9cbe-5e52c68c327a tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:28.476867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98891247-c875-4ca6-9cbe-5e52c68c327a tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:28.477337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-98891247-c875-4ca6-9cbe-5e52c68c327a tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:28.504431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-98891247-c875-4ca6-9cbe-5e52c68c327a tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lazy-loading 'flavor' on Instance uuid feffb0ae-c79e-45ca-857e-95371f190abc {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:05:28.517103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-98891247-c875-4ca6-9cbe-5e52c68c327a tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Going to try to live migrate instance to another host {{(pid=120612) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 18 14:05:30.149399 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-98891247-c875-4ca6-9cbe-5e52c68c327a tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc/action" status: 202 len: 0 microversion: 2.1 time: 1.688726 Oct 18 14:05:30.150079 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3202/6608] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:05:28 2022] POST /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc/action => generated 0 bytes in 1690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:05:30.161588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-270569a0-ac1d-45d5-8922-f13c7fe9b8a0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:30.162354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-270569a0-ac1d-45d5-8922-f13c7fe9b8a0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:30.172063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-270569a0-ac1d-45d5-8922-f13c7fe9b8a0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:30.173150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-270569a0-ac1d-45d5-8922-f13c7fe9b8a0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:30.174451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-270569a0-ac1d-45d5-8922-f13c7fe9b8a0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:30.176499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-270569a0-ac1d-45d5-8922-f13c7fe9b8a0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:30.177523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-270569a0-ac1d-45d5-8922-f13c7fe9b8a0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:30.178045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-270569a0-ac1d-45d5-8922-f13c7fe9b8a0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:30.375455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-270569a0-ac1d-45d5-8922-f13c7fe9b8a0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:30.383876 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-270569a0-ac1d-45d5-8922-f13c7fe9b8a0 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1692 microversion: 2.1 time: 0.228410 Oct 18 14:05:30.384495 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3407/6609] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:30 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1692 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:31.324902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-2bed9f2a-3160-4ae1-a0c6-5d0c76d952b8 req-857c4ad1-d9ba-4478-8f3e-edbaea76a393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feffb0ae-c79e-45ca-857e-95371f190abc", "name": "network-vif-unplugged", "status": "completed", "tag": "1fe58928-5578-443e-bbea-1093d7288e81"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:31.336567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2bed9f2a-3160-4ae1-a0c6-5d0c76d952b8 req-857c4ad1-d9ba-4478-8f3e-edbaea76a393 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:31.337049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2bed9f2a-3160-4ae1-a0c6-5d0c76d952b8 req-857c4ad1-d9ba-4478-8f3e-edbaea76a393 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:31.337524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2bed9f2a-3160-4ae1-a0c6-5d0c76d952b8 req-857c4ad1-d9ba-4478-8f3e-edbaea76a393 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:31.351672 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-2bed9f2a-3160-4ae1-a0c6-5d0c76d952b8 req-857c4ad1-d9ba-4478-8f3e-edbaea76a393 service nova] Creating event network-vif-unplugged:1fe58928-5578-443e-bbea-1093d7288e81 for instance feffb0ae-c79e-45ca-857e-95371f190abc on n-h1-858384-13 Oct 18 14:05:31.357219 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-2bed9f2a-3160-4ae1-a0c6-5d0c76d952b8 req-857c4ad1-d9ba-4478-8f3e-edbaea76a393 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037612 Oct 18 14:05:31.357850 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3203/6610] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:31.408841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cf6e51a6-1c97-4785-94a9-cacc550e8625 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:31.410496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cf6e51a6-1c97-4785-94a9-cacc550e8625 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:31.421089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf6e51a6-1c97-4785-94a9-cacc550e8625 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:31.421816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf6e51a6-1c97-4785-94a9-cacc550e8625 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:31.423114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf6e51a6-1c97-4785-94a9-cacc550e8625 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:31.424076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf6e51a6-1c97-4785-94a9-cacc550e8625 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:31.424580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf6e51a6-1c97-4785-94a9-cacc550e8625 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:31.425295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cf6e51a6-1c97-4785-94a9-cacc550e8625 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:31.647782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cf6e51a6-1c97-4785-94a9-cacc550e8625 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:31.656604 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cf6e51a6-1c97-4785-94a9-cacc550e8625 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1692 microversion: 2.1 time: 0.252341 Oct 18 14:05:31.657405 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3408/6611] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:31 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1692 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:32.682496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d97b6a4d-1b12-45dd-bad0-07fc0e9fdc35 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:32.683364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d97b6a4d-1b12-45dd-bad0-07fc0e9fdc35 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:32.691720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d97b6a4d-1b12-45dd-bad0-07fc0e9fdc35 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:32.692215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d97b6a4d-1b12-45dd-bad0-07fc0e9fdc35 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:32.692660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d97b6a4d-1b12-45dd-bad0-07fc0e9fdc35 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:32.693413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d97b6a4d-1b12-45dd-bad0-07fc0e9fdc35 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:32.693870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d97b6a4d-1b12-45dd-bad0-07fc0e9fdc35 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:32.694305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d97b6a4d-1b12-45dd-bad0-07fc0e9fdc35 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:32.848342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d97b6a4d-1b12-45dd-bad0-07fc0e9fdc35 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:32.856768 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d97b6a4d-1b12-45dd-bad0-07fc0e9fdc35 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1692 microversion: 2.1 time: 0.178711 Oct 18 14:05:32.857392 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3204/6612] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:32 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:33.394651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7c4485b0-644d-4acb-91f4-51d10b1991c0 req-0083fd5b-9930-401c-84ee-1f06b7f269bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feffb0ae-c79e-45ca-857e-95371f190abc", "tag": "1fe58928-5578-443e-bbea-1093d7288e81"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:33.406007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7c4485b0-644d-4acb-91f4-51d10b1991c0 req-0083fd5b-9930-401c-84ee-1f06b7f269bb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:33.406597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7c4485b0-644d-4acb-91f4-51d10b1991c0 req-0083fd5b-9930-401c-84ee-1f06b7f269bb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:33.407201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7c4485b0-644d-4acb-91f4-51d10b1991c0 req-0083fd5b-9930-401c-84ee-1f06b7f269bb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:33.419932 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7c4485b0-644d-4acb-91f4-51d10b1991c0 req-0083fd5b-9930-401c-84ee-1f06b7f269bb service nova] Creating event network-changed:1fe58928-5578-443e-bbea-1093d7288e81 for instance feffb0ae-c79e-45ca-857e-95371f190abc on n-h1-858384-13 Oct 18 14:05:33.426007 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7c4485b0-644d-4acb-91f4-51d10b1991c0 req-0083fd5b-9930-401c-84ee-1f06b7f269bb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035896 Oct 18 14:05:33.426639 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3409/6613] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:33.881713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9ed9298f-2a36-4b12-8cf4-894265b6cf19 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:33.882401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9ed9298f-2a36-4b12-8cf4-894265b6cf19 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:33.889521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ed9298f-2a36-4b12-8cf4-894265b6cf19 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:33.889933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ed9298f-2a36-4b12-8cf4-894265b6cf19 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:33.890368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ed9298f-2a36-4b12-8cf4-894265b6cf19 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:33.892127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ed9298f-2a36-4b12-8cf4-894265b6cf19 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:33.892943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ed9298f-2a36-4b12-8cf4-894265b6cf19 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:33.893807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ed9298f-2a36-4b12-8cf4-894265b6cf19 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:34.115054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9ed9298f-2a36-4b12-8cf4-894265b6cf19 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:34.123765 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9ed9298f-2a36-4b12-8cf4-894265b6cf19 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1692 microversion: 2.1 time: 0.246137 Oct 18 14:05:34.124612 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3205/6614] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:33 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1692 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:35.149405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-34999bc4-eaab-49f4-9f56-d56a2fc7e257 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:35.150125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-34999bc4-eaab-49f4-9f56-d56a2fc7e257 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:35.157051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34999bc4-eaab-49f4-9f56-d56a2fc7e257 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:35.157688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34999bc4-eaab-49f4-9f56-d56a2fc7e257 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:35.158144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34999bc4-eaab-49f4-9f56-d56a2fc7e257 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:35.158856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34999bc4-eaab-49f4-9f56-d56a2fc7e257 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:35.159330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34999bc4-eaab-49f4-9f56-d56a2fc7e257 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:35.159767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34999bc4-eaab-49f4-9f56-d56a2fc7e257 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:35.303302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-34999bc4-eaab-49f4-9f56-d56a2fc7e257 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:35.311077 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-34999bc4-eaab-49f4-9f56-d56a2fc7e257 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1692 microversion: 2.1 time: 0.166826 Oct 18 14:05:35.311711 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3410/6615] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:35 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:36.335985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8754c333-ae15-4392-b3c6-d271bcf39f90 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:36.336635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8754c333-ae15-4392-b3c6-d271bcf39f90 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:36.344966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8754c333-ae15-4392-b3c6-d271bcf39f90 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:36.345520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8754c333-ae15-4392-b3c6-d271bcf39f90 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:36.345961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8754c333-ae15-4392-b3c6-d271bcf39f90 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:36.347141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8754c333-ae15-4392-b3c6-d271bcf39f90 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:36.347611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8754c333-ae15-4392-b3c6-d271bcf39f90 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:36.348063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8754c333-ae15-4392-b3c6-d271bcf39f90 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:36.532892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8754c333-ae15-4392-b3c6-d271bcf39f90 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:36.545139 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8754c333-ae15-4392-b3c6-d271bcf39f90 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1692 microversion: 2.1 time: 0.213293 Oct 18 14:05:36.545805 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3206/6616] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:36 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1692 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:37.570661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b89103c8-9009-491f-9b9a-eb5414e2dffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:37.571328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b89103c8-9009-491f-9b9a-eb5414e2dffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:37.579200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b89103c8-9009-491f-9b9a-eb5414e2dffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:37.580130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b89103c8-9009-491f-9b9a-eb5414e2dffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:37.580593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b89103c8-9009-491f-9b9a-eb5414e2dffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:37.581341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b89103c8-9009-491f-9b9a-eb5414e2dffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:37.581819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b89103c8-9009-491f-9b9a-eb5414e2dffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:37.582263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b89103c8-9009-491f-9b9a-eb5414e2dffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:37.727667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b89103c8-9009-491f-9b9a-eb5414e2dffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:37.736403 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b89103c8-9009-491f-9b9a-eb5414e2dffc tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1692 microversion: 2.1 time: 0.168942 Oct 18 14:05:37.737003 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3411/6617] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:37 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:38.760477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-080d837a-1945-41ff-8555-a0f6402a0f65 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:38.761160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-080d837a-1945-41ff-8555-a0f6402a0f65 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:38.770233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-080d837a-1945-41ff-8555-a0f6402a0f65 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:38.770734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-080d837a-1945-41ff-8555-a0f6402a0f65 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:38.771176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-080d837a-1945-41ff-8555-a0f6402a0f65 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:38.771890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-080d837a-1945-41ff-8555-a0f6402a0f65 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:38.772347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-080d837a-1945-41ff-8555-a0f6402a0f65 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:38.772777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-080d837a-1945-41ff-8555-a0f6402a0f65 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:38.942531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-080d837a-1945-41ff-8555-a0f6402a0f65 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:38.952453 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-080d837a-1945-41ff-8555-a0f6402a0f65 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1692 microversion: 2.1 time: 0.196084 Oct 18 14:05:38.953160 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3207/6618] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:38 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1692 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:39.980401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0f306722-93e5-4511-95d5-4ca94468288f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:39.981102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0f306722-93e5-4511-95d5-4ca94468288f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:39.990715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f306722-93e5-4511-95d5-4ca94468288f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:39.991227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f306722-93e5-4511-95d5-4ca94468288f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:39.991898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f306722-93e5-4511-95d5-4ca94468288f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:39.992811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f306722-93e5-4511-95d5-4ca94468288f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:39.993459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f306722-93e5-4511-95d5-4ca94468288f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:39.994052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0f306722-93e5-4511-95d5-4ca94468288f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:40.171653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0f306722-93e5-4511-95d5-4ca94468288f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:40.181391 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0f306722-93e5-4511-95d5-4ca94468288f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1682 microversion: 2.1 time: 0.205247 Oct 18 14:05:40.182366 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3412/6619] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:39 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:40.208249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b5628d49-954f-4893-9db4-1b2eb47f44c5 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:40.208867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b5628d49-954f-4893-9db4-1b2eb47f44c5 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:40.216944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5628d49-954f-4893-9db4-1b2eb47f44c5 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:40.217688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5628d49-954f-4893-9db4-1b2eb47f44c5 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:40.218619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5628d49-954f-4893-9db4-1b2eb47f44c5 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:40.220501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5628d49-954f-4893-9db4-1b2eb47f44c5 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:40.221325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5628d49-954f-4893-9db4-1b2eb47f44c5 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:40.222034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b5628d49-954f-4893-9db4-1b2eb47f44c5 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:40.377980 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b5628d49-954f-4893-9db4-1b2eb47f44c5 tempest-TestNetworkAdvancedServerOps-487432083 tempest-TestNetworkAdvancedServerOps-487432083-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1835 microversion: 2.1 time: 0.174292 Oct 18 14:05:40.378578 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3208/6620] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:40 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1835 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:05:40.402636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6bef4c0d-0b81-4362-ab2c-8641e4b17357 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:40.403269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6bef4c0d-0b81-4362-ab2c-8641e4b17357 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:40.410315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bef4c0d-0b81-4362-ab2c-8641e4b17357 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:40.410817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bef4c0d-0b81-4362-ab2c-8641e4b17357 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:40.411270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bef4c0d-0b81-4362-ab2c-8641e4b17357 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:40.411989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bef4c0d-0b81-4362-ab2c-8641e4b17357 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:40.412461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bef4c0d-0b81-4362-ab2c-8641e4b17357 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:40.412903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6bef4c0d-0b81-4362-ab2c-8641e4b17357 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:40.552047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6bef4c0d-0b81-4362-ab2c-8641e4b17357 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:40.560489 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6bef4c0d-0b81-4362-ab2c-8641e4b17357 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1682 microversion: 2.1 time: 0.161715 Oct 18 14:05:40.561200 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3413/6621] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:40 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:40.670990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-87ea4f24-258b-4e53-8588-d9f31905bb20 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:40.673645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-87ea4f24-258b-4e53-8588-d9f31905bb20 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:40.683440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87ea4f24-258b-4e53-8588-d9f31905bb20 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:40.684209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87ea4f24-258b-4e53-8588-d9f31905bb20 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:40.684738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87ea4f24-258b-4e53-8588-d9f31905bb20 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:40.685448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87ea4f24-258b-4e53-8588-d9f31905bb20 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:40.685909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87ea4f24-258b-4e53-8588-d9f31905bb20 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:40.686336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87ea4f24-258b-4e53-8588-d9f31905bb20 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:40.742633 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-87ea4f24-258b-4e53-8588-d9f31905bb20 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc/action" status: 200 len: 38484 microversion: 2.1 time: 0.079663 Oct 18 14:05:40.743572 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3209/6622] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:05:40 2022] POST /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc/action => generated 38484 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 14:05:42.037623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e56809fe-fe08-4ce8-95aa-0c3a9554992f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:42.038145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e56809fe-fe08-4ce8-95aa-0c3a9554992f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:42.046846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e56809fe-fe08-4ce8-95aa-0c3a9554992f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:42.047357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e56809fe-fe08-4ce8-95aa-0c3a9554992f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:42.048869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e56809fe-fe08-4ce8-95aa-0c3a9554992f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:42.050195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e56809fe-fe08-4ce8-95aa-0c3a9554992f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:42.050893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e56809fe-fe08-4ce8-95aa-0c3a9554992f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:42.051556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e56809fe-fe08-4ce8-95aa-0c3a9554992f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:42.082714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e56809fe-fe08-4ce8-95aa-0c3a9554992f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:05:42.117700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ba866c8b-1664-46c5-b4e0-ff1f45c0056d req-7ae80943-5e8a-41a1-911b-988a1c2dbed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feffb0ae-c79e-45ca-857e-95371f190abc", "tag": "1fe58928-5578-443e-bbea-1093d7288e81"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:42.130620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ba866c8b-1664-46c5-b4e0-ff1f45c0056d req-7ae80943-5e8a-41a1-911b-988a1c2dbed6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:42.131323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ba866c8b-1664-46c5-b4e0-ff1f45c0056d req-7ae80943-5e8a-41a1-911b-988a1c2dbed6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:42.131961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ba866c8b-1664-46c5-b4e0-ff1f45c0056d req-7ae80943-5e8a-41a1-911b-988a1c2dbed6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:42.144490 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ba866c8b-1664-46c5-b4e0-ff1f45c0056d req-7ae80943-5e8a-41a1-911b-988a1c2dbed6 service nova] Creating event network-changed:1fe58928-5578-443e-bbea-1093d7288e81 for instance feffb0ae-c79e-45ca-857e-95371f190abc on n-h2-858384-13 Oct 18 14:05:42.151835 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ba866c8b-1664-46c5-b4e0-ff1f45c0056d req-7ae80943-5e8a-41a1-911b-988a1c2dbed6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120910 Oct 18 14:05:42.153375 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3210/6623] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:42.175228 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e56809fe-fe08-4ce8-95aa-0c3a9554992f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "DELETE /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 204 len: 0 microversion: 2.1 time: 0.148377 Oct 18 14:05:42.179495 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3414/6624] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:05:42 2022] DELETE /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:05:42.197588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7970742b-571d-4dbf-a184-604cce5c935d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:42.198614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7970742b-571d-4dbf-a184-604cce5c935d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:42.206523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7970742b-571d-4dbf-a184-604cce5c935d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:42.207019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7970742b-571d-4dbf-a184-604cce5c935d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:42.207628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7970742b-571d-4dbf-a184-604cce5c935d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:42.208335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7970742b-571d-4dbf-a184-604cce5c935d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:42.209617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7970742b-571d-4dbf-a184-604cce5c935d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:42.210214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7970742b-571d-4dbf-a184-604cce5c935d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:42.360137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7970742b-571d-4dbf-a184-604cce5c935d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:42.372734 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7970742b-571d-4dbf-a184-604cce5c935d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1688 microversion: 2.1 time: 0.184941 Oct 18 14:05:42.385204 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3211/6625] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:42 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:43.399815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:43.400736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:43.409617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:43.410120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:43.410622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:43.411356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:43.411847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:43.412376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:43.449306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:43.449807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:43.450265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:43.450743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lazy-loading 'fault' on Instance uuid feffb0ae-c79e-45ca-857e-95371f190abc {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:05:43.504529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:43.513110 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-863ca5b5-7df8-4034-9456-10fc0e37deb4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 200 len: 1355 microversion: 2.1 time: 0.118433 Oct 18 14:05:43.514049 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3415/6626] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:43 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 1355 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:44.168255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-87fcbbe0-69d1-4e38-83d3-9260b236cd47 req-8fc68ea9-d930-4f96-8ad4-16f4a804a49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feffb0ae-c79e-45ca-857e-95371f190abc", "name": "network-vif-deleted", "tag": "1fe58928-5578-443e-bbea-1093d7288e81"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:44.180959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-87fcbbe0-69d1-4e38-83d3-9260b236cd47 req-8fc68ea9-d930-4f96-8ad4-16f4a804a49f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:44.181571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-87fcbbe0-69d1-4e38-83d3-9260b236cd47 req-8fc68ea9-d930-4f96-8ad4-16f4a804a49f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:44.182137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-87fcbbe0-69d1-4e38-83d3-9260b236cd47 req-8fc68ea9-d930-4f96-8ad4-16f4a804a49f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:44.194501 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-87fcbbe0-69d1-4e38-83d3-9260b236cd47 req-8fc68ea9-d930-4f96-8ad4-16f4a804a49f service nova] Creating event network-vif-deleted:1fe58928-5578-443e-bbea-1093d7288e81 for instance feffb0ae-c79e-45ca-857e-95371f190abc on n-h2-858384-13 Oct 18 14:05:44.200016 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-87fcbbe0-69d1-4e38-83d3-9260b236cd47 req-8fc68ea9-d930-4f96-8ad4-16f4a804a49f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035721 Oct 18 14:05:44.200616 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3212/6627] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:44.539134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-200e84ec-3202-455a-938f-c7fe3e3ae42c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:44.539796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-200e84ec-3202-455a-938f-c7fe3e3ae42c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: feffb0ae-c79e-45ca-857e-95371f190abc] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:44.547874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-200e84ec-3202-455a-938f-c7fe3e3ae42c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:44.548467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-200e84ec-3202-455a-938f-c7fe3e3ae42c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:44.548921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-200e84ec-3202-455a-938f-c7fe3e3ae42c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:44.549657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-200e84ec-3202-455a-938f-c7fe3e3ae42c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:44.550131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-200e84ec-3202-455a-938f-c7fe3e3ae42c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:44.550635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-200e84ec-3202-455a-938f-c7fe3e3ae42c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:44.566180 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-200e84ec-3202-455a-938f-c7fe3e3ae42c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] HTTP exception thrown: Instance feffb0ae-c79e-45ca-857e-95371f190abc could not be found. Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-200e84ec-3202-455a-938f-c7fe3e3ae42c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Request method failure captured: Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc HTTP/1.1 Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrERveMSbr98lDbhVRpVCZtMpZCqRzllFV9Zp-9Paa2aeI2L6Uu3YKC5mtfy6YqZYTDL35tBdZ2S8DBV9NMKTb2UJzxCOY2UD_h7FbwqxTtZxtG-8cn42k_jl_VvaBbCHWnwHwkU0ksMnyQKE0VuTZblyb548PMnFxhTFzNpMLJL5y0 Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: c5b27cd003004ada9e45c087db637da3 Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1155266913 Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5b27cd003004ada9e45c087db637da3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5b27cd003004ada9e45c087db637da3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5b27cd003004ada9e45c087db637da3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5b27cd003004ada9e45c087db637da3"}]}] Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1155266913 Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: c5b27cd003004ada9e45c087db637da3 Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1155266913 Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestNetworkAdvancedServerOps-1155266913-project Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 21e90c2f331f46f497b568dbc0e0c100 Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1155266913-project Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance feffb0ae-c79e-45ca-857e-95371f190abc could not be found. Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'feffb0ae-c79e-45ca-857e-95371f190abc'} Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feffb0ae-c79e-45ca-857e-95371f190abc could not be found. Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feffb0ae-c79e-45ca-857e-95371f190abc could not be found. Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:05:44.567837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:05:44.572501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:05:44.572501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:05:44.572501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:05:44.572501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:05:44.572501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:05:44.572501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:05:44.572501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feffb0ae-c79e-45ca-857e-95371f190abc could not be found. Oct 18 14:05:44.572501 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:05:44.572501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-200e84ec-3202-455a-938f-c7fe3e3ae42c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Returning 404 to user: Instance feffb0ae-c79e-45ca-857e-95371f190abc could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:05:44.572501 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-200e84ec-3202-455a-938f-c7fe3e3ae42c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc" status: 404 len: 111 microversion: 2.1 time: 0.034698 Oct 18 14:05:44.572501 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3416/6628] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:44 2022] GET /compute/v2.1/servers/feffb0ae-c79e-45ca-857e-95371f190abc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:05:47.884217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1b11523c-81a5-498c-8fbb-e9b59bb12467 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '.version_select at 0x7ff60e827280>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:47.917943 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1b11523c-81a5-498c-8fbb-e9b59bb12467 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-344078349" status: 202 len: 0 microversion: 2.1 time: 0.037999 Oct 18 14:05:47.918948 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3213/6629] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 18 14:05:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-344078349 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:05:47.960311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f3c7f52-339a-44aa-b9c1-0e460c594504 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'create', calling method: .version_select at 0x7ff60e2f3280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-390969125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuMnaF+5I4NdR5sgcfeHkBDF16LJC7noTXukqL8Bq+Mce63LrMNG7ZmVqq4vdKmZHfgRbe95UXPnidABvXDv1QyNA3Lol7k/5fxKAo8ypr3tW9XTR5f2yWlNitXbdtnNA=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:47.982492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-7f3c7f52-339a-44aa-b9c1-0e460c594504 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for project c5b27cd003004ada9e45c087db637da3. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:05:47.988952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-7f3c7f52-339a-44aa-b9c1-0e460c594504 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for user 21e90c2f331f46f497b568dbc0e0c100 and project c5b27cd003004ada9e45c087db637da3. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:05:48.017862 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7f3c7f52-339a-44aa-b9c1-0e460c594504 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.063938 Oct 18 14:05:48.018824 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3417/6630] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:05:47 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:54.583284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1228017290", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "0926ad2c-4691-4a92-a720-5fda345b5356"}], "key_name": "tempest-TestNetworkAdvancedServerOps-390969125", "security_groups": [{"name": "tempest-secgroup-smoke-1296434701"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:54.599478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:54.723617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] validate_networks() for [('0926ad2c-4691-4a92-a720-5fda345b5356', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:05:55.268461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:05:55.268900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:05:55.269441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:05:55.269881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:05:55.270377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:05:55.281698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:55.283028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:55.283586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:55.284611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:55.285208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:55.285710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:55.310932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for project c5b27cd003004ada9e45c087db637da3. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:05:55.319365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Getting quotas for user 21e90c2f331f46f497b568dbc0e0c100 and project c5b27cd003004ada9e45c087db637da3. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:05:55.334651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:05:55.336920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:05:55.396145 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4545cc20-de72-4057-a6ab-d9f5584f5d9c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.818250 Oct 18 14:05:55.399580 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3214/6631] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:05:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 14:05:55.416880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b7185322-e0fe-42c7-b6be-639836b9b651 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:55.417689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7185322-e0fe-42c7-b6be-639836b9b651 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:55.421672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:55.489930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7185322-e0fe-42c7-b6be-639836b9b651 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:55.497434 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b7185322-e0fe-42c7-b6be-639836b9b651 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1266 microversion: 2.1 time: 0.086549 Oct 18 14:05:55.498448 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3418/6632] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:55 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:56.523265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-216e183e-00d9-416e-8005-1a27046aab76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:56.525449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-216e183e-00d9-416e-8005-1a27046aab76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:56.535102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-216e183e-00d9-416e-8005-1a27046aab76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:56.535844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-216e183e-00d9-416e-8005-1a27046aab76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:56.536450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-216e183e-00d9-416e-8005-1a27046aab76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:56.538008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-216e183e-00d9-416e-8005-1a27046aab76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:56.538620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-216e183e-00d9-416e-8005-1a27046aab76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:56.539206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-216e183e-00d9-416e-8005-1a27046aab76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:56.624182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-216e183e-00d9-416e-8005-1a27046aab76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:56.632484 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-216e183e-00d9-416e-8005-1a27046aab76 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1318 microversion: 2.1 time: 0.115355 Oct 18 14:05:56.633763 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3215/6633] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:56 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1318 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:57.664053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-82b2d49a-8661-4f80-9216-66a15f9ed41c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:57.666133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-82b2d49a-8661-4f80-9216-66a15f9ed41c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:57.675782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82b2d49a-8661-4f80-9216-66a15f9ed41c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:57.676622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82b2d49a-8661-4f80-9216-66a15f9ed41c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:57.679226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82b2d49a-8661-4f80-9216-66a15f9ed41c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:57.680023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82b2d49a-8661-4f80-9216-66a15f9ed41c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:57.680506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82b2d49a-8661-4f80-9216-66a15f9ed41c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:57.680950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82b2d49a-8661-4f80-9216-66a15f9ed41c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:57.864936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-82b2d49a-8661-4f80-9216-66a15f9ed41c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:57.878775 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-82b2d49a-8661-4f80-9216-66a15f9ed41c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1392 microversion: 2.1 time: 0.222181 Oct 18 14:05:57.879774 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3419/6634] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:57 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1392 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:05:58.351770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-50060ec5-41ed-442b-9346-2ab794acb49f req-0e94f8d9-25e1-4517-8cc8-853fe5f1315f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6442f6-cf23-40c4-b0a5-2da762186138", "tag": "d00cbe5f-c74d-496c-a878-bc05aaf50b87"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:05:58.358881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:58.363334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-50060ec5-41ed-442b-9346-2ab794acb49f req-0e94f8d9-25e1-4517-8cc8-853fe5f1315f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:58.363829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-50060ec5-41ed-442b-9346-2ab794acb49f req-0e94f8d9-25e1-4517-8cc8-853fe5f1315f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:58.364868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-50060ec5-41ed-442b-9346-2ab794acb49f req-0e94f8d9-25e1-4517-8cc8-853fe5f1315f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:58.385405 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-50060ec5-41ed-442b-9346-2ab794acb49f req-0e94f8d9-25e1-4517-8cc8-853fe5f1315f service nova] Creating event network-changed:d00cbe5f-c74d-496c-a878-bc05aaf50b87 for instance 0d6442f6-cf23-40c4-b0a5-2da762186138 on n-h1-858384-13 Oct 18 14:05:58.390159 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-50060ec5-41ed-442b-9346-2ab794acb49f req-0e94f8d9-25e1-4517-8cc8-853fe5f1315f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042177 Oct 18 14:05:58.390770 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3216/6635] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:05:58.905218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2d1b7cf2-5446-4c7a-9644-d02abcf9957a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:05:58.906141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2d1b7cf2-5446-4c7a-9644-d02abcf9957a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:05:58.909339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:05:58.915006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d1b7cf2-5446-4c7a-9644-d02abcf9957a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:58.915504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d1b7cf2-5446-4c7a-9644-d02abcf9957a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:58.916041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d1b7cf2-5446-4c7a-9644-d02abcf9957a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:58.916756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d1b7cf2-5446-4c7a-9644-d02abcf9957a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:05:58.917286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d1b7cf2-5446-4c7a-9644-d02abcf9957a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:05:58.917726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d1b7cf2-5446-4c7a-9644-d02abcf9957a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:05:59.062553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2d1b7cf2-5446-4c7a-9644-d02abcf9957a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:05:59.071933 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2d1b7cf2-5446-4c7a-9644-d02abcf9957a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1392 microversion: 2.1 time: 0.170724 Oct 18 14:05:59.072517 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3420/6636] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:05:58 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:00.097309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-33da861f-8c09-482e-9946-f4956dc380f7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:00.098713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-33da861f-8c09-482e-9946-f4956dc380f7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:00.106220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33da861f-8c09-482e-9946-f4956dc380f7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:00.106707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33da861f-8c09-482e-9946-f4956dc380f7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:00.107153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33da861f-8c09-482e-9946-f4956dc380f7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:00.107862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33da861f-8c09-482e-9946-f4956dc380f7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:00.108312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33da861f-8c09-482e-9946-f4956dc380f7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:00.108775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33da861f-8c09-482e-9946-f4956dc380f7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:00.256836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-33da861f-8c09-482e-9946-f4956dc380f7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:00.265854 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-33da861f-8c09-482e-9946-f4956dc380f7 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1392 microversion: 2.1 time: 0.174500 Oct 18 14:06:00.266961 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3217/6637] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:00 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:01.289870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0dc49d3e-d610-4dcf-be31-5af9c7f74e8a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:01.290580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0dc49d3e-d610-4dcf-be31-5af9c7f74e8a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:01.298912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dc49d3e-d610-4dcf-be31-5af9c7f74e8a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:01.299405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dc49d3e-d610-4dcf-be31-5af9c7f74e8a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:01.299859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dc49d3e-d610-4dcf-be31-5af9c7f74e8a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:01.300566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dc49d3e-d610-4dcf-be31-5af9c7f74e8a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:01.301023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dc49d3e-d610-4dcf-be31-5af9c7f74e8a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:01.301505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0dc49d3e-d610-4dcf-be31-5af9c7f74e8a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:01.452480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0dc49d3e-d610-4dcf-be31-5af9c7f74e8a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:01.461596 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0dc49d3e-d610-4dcf-be31-5af9c7f74e8a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1392 microversion: 2.1 time: 0.175627 Oct 18 14:06:01.462171 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3421/6638] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:01 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:02.488733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b65ce782-a7f9-4a27-bb74-e0b04f6af73d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:02.489482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b65ce782-a7f9-4a27-bb74-e0b04f6af73d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:02.497047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b65ce782-a7f9-4a27-bb74-e0b04f6af73d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:02.497560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b65ce782-a7f9-4a27-bb74-e0b04f6af73d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:02.498000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b65ce782-a7f9-4a27-bb74-e0b04f6af73d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:02.498700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b65ce782-a7f9-4a27-bb74-e0b04f6af73d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:02.499183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b65ce782-a7f9-4a27-bb74-e0b04f6af73d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:02.499610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b65ce782-a7f9-4a27-bb74-e0b04f6af73d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:02.640291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b65ce782-a7f9-4a27-bb74-e0b04f6af73d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:02.652400 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b65ce782-a7f9-4a27-bb74-e0b04f6af73d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1392 microversion: 2.1 time: 0.171173 Oct 18 14:06:02.652988 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3218/6639] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:02 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:03.686122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-180f417d-1deb-49c4-954d-aa4e0f5f8001 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:03.687800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-180f417d-1deb-49c4-954d-aa4e0f5f8001 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:03.693485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-180f417d-1deb-49c4-954d-aa4e0f5f8001 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:03.693983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-180f417d-1deb-49c4-954d-aa4e0f5f8001 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:03.694435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-180f417d-1deb-49c4-954d-aa4e0f5f8001 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:03.695141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-180f417d-1deb-49c4-954d-aa4e0f5f8001 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:03.695626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-180f417d-1deb-49c4-954d-aa4e0f5f8001 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:03.696276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-180f417d-1deb-49c4-954d-aa4e0f5f8001 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:03.839886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-180f417d-1deb-49c4-954d-aa4e0f5f8001 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:03.849429 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-180f417d-1deb-49c4-954d-aa4e0f5f8001 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1392 microversion: 2.1 time: 0.167220 Oct 18 14:06:03.850017 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3422/6640] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:03 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:04.872838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bbfaa00a-df7c-4b6b-a240-2a18536715d3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:04.873406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bbfaa00a-df7c-4b6b-a240-2a18536715d3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:04.880702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbfaa00a-df7c-4b6b-a240-2a18536715d3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:04.881195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbfaa00a-df7c-4b6b-a240-2a18536715d3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:04.881637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbfaa00a-df7c-4b6b-a240-2a18536715d3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:04.882330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbfaa00a-df7c-4b6b-a240-2a18536715d3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:04.882776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbfaa00a-df7c-4b6b-a240-2a18536715d3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:04.883194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bbfaa00a-df7c-4b6b-a240-2a18536715d3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:05.035440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bbfaa00a-df7c-4b6b-a240-2a18536715d3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:05.043783 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bbfaa00a-df7c-4b6b-a240-2a18536715d3 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1392 microversion: 2.1 time: 0.174843 Oct 18 14:06:05.044388 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3219/6641] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:04 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:06:05.116277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-14e7d55f-a9f0-42d9-bb31-6810fc9dd32f req-c84fcf4c-a105-46cd-ab68-9a6db55d7fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6442f6-cf23-40c4-b0a5-2da762186138", "name": "network-vif-plugged", "status": "completed", "tag": "d00cbe5f-c74d-496c-a878-bc05aaf50b87"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:05.128936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-14e7d55f-a9f0-42d9-bb31-6810fc9dd32f req-c84fcf4c-a105-46cd-ab68-9a6db55d7fc7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:05.129383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-14e7d55f-a9f0-42d9-bb31-6810fc9dd32f req-c84fcf4c-a105-46cd-ab68-9a6db55d7fc7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:05.129844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-14e7d55f-a9f0-42d9-bb31-6810fc9dd32f req-c84fcf4c-a105-46cd-ab68-9a6db55d7fc7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:05.144124 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-14e7d55f-a9f0-42d9-bb31-6810fc9dd32f req-c84fcf4c-a105-46cd-ab68-9a6db55d7fc7 service nova] Creating event network-vif-plugged:d00cbe5f-c74d-496c-a878-bc05aaf50b87 for instance 0d6442f6-cf23-40c4-b0a5-2da762186138 on n-h1-858384-13 Oct 18 14:06:05.149662 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-14e7d55f-a9f0-42d9-bb31-6810fc9dd32f req-c84fcf4c-a105-46cd-ab68-9a6db55d7fc7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040529 Oct 18 14:06:05.150282 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3423/6642] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:06:06.068662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ce6dc110-eab6-423f-aea2-8fa436c21247 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:06.069306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ce6dc110-eab6-423f-aea2-8fa436c21247 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:06.071284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:06.072088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:06.079011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce6dc110-eab6-423f-aea2-8fa436c21247 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:06.079491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce6dc110-eab6-423f-aea2-8fa436c21247 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:06.080073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce6dc110-eab6-423f-aea2-8fa436c21247 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:06.080848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce6dc110-eab6-423f-aea2-8fa436c21247 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:06.081348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce6dc110-eab6-423f-aea2-8fa436c21247 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:06.081771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce6dc110-eab6-423f-aea2-8fa436c21247 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:06.220547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ce6dc110-eab6-423f-aea2-8fa436c21247 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:06.229536 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ce6dc110-eab6-423f-aea2-8fa436c21247 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1392 microversion: 2.1 time: 0.165156 Oct 18 14:06:06.230594 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3220/6643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:06 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:07.255916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-678120d0-df8e-4c68-8e38-7a80357ee428 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:07.256629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-678120d0-df8e-4c68-8e38-7a80357ee428 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:07.258644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:07.265276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-678120d0-df8e-4c68-8e38-7a80357ee428 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:07.265780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-678120d0-df8e-4c68-8e38-7a80357ee428 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:07.266235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-678120d0-df8e-4c68-8e38-7a80357ee428 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:07.266950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-678120d0-df8e-4c68-8e38-7a80357ee428 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:07.268196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-678120d0-df8e-4c68-8e38-7a80357ee428 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:07.268649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-678120d0-df8e-4c68-8e38-7a80357ee428 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:07.411653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-678120d0-df8e-4c68-8e38-7a80357ee428 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:07.419712 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-678120d0-df8e-4c68-8e38-7a80357ee428 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1564 microversion: 2.1 time: 0.169351 Oct 18 14:06:07.420296 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3424/6644] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:07 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:07.443565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-199ab1a7-8d8d-46c7-866b-51f6d32cd6ec tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:07.444199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-199ab1a7-8d8d-46c7-866b-51f6d32cd6ec tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:07.451559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-199ab1a7-8d8d-46c7-866b-51f6d32cd6ec tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:07.452047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-199ab1a7-8d8d-46c7-866b-51f6d32cd6ec tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:07.452486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-199ab1a7-8d8d-46c7-866b-51f6d32cd6ec tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:07.453194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-199ab1a7-8d8d-46c7-866b-51f6d32cd6ec tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:07.453657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-199ab1a7-8d8d-46c7-866b-51f6d32cd6ec tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:07.454083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-199ab1a7-8d8d-46c7-866b-51f6d32cd6ec tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:07.596209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-199ab1a7-8d8d-46c7-866b-51f6d32cd6ec tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:07.604326 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-199ab1a7-8d8d-46c7-866b-51f6d32cd6ec tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1564 microversion: 2.1 time: 0.165663 Oct 18 14:06:07.604828 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3221/6645] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:07 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:09.567839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8939a158-5682-4bef-b1e7-a8dc5f74697f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:06:09.568475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8939a158-5682-4bef-b1e7-a8dc5f74697f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:09.570693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-fab1c163-d532-4be0-a1bb-a1b645ab6337 req-598352c1-2b7c-4529-9bd5-59e9e96a2946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6442f6-cf23-40c4-b0a5-2da762186138", "tag": "d00cbe5f-c74d-496c-a878-bc05aaf50b87"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:09.576143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8939a158-5682-4bef-b1e7-a8dc5f74697f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:09.576884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8939a158-5682-4bef-b1e7-a8dc5f74697f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:09.577597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8939a158-5682-4bef-b1e7-a8dc5f74697f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:09.578540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8939a158-5682-4bef-b1e7-a8dc5f74697f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:09.579243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8939a158-5682-4bef-b1e7-a8dc5f74697f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:09.579764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8939a158-5682-4bef-b1e7-a8dc5f74697f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:09.583677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fab1c163-d532-4be0-a1bb-a1b645ab6337 req-598352c1-2b7c-4529-9bd5-59e9e96a2946 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:09.584139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fab1c163-d532-4be0-a1bb-a1b645ab6337 req-598352c1-2b7c-4529-9bd5-59e9e96a2946 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:09.584645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fab1c163-d532-4be0-a1bb-a1b645ab6337 req-598352c1-2b7c-4529-9bd5-59e9e96a2946 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:09.597107 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-fab1c163-d532-4be0-a1bb-a1b645ab6337 req-598352c1-2b7c-4529-9bd5-59e9e96a2946 service nova] Creating event network-changed:d00cbe5f-c74d-496c-a878-bc05aaf50b87 for instance 0d6442f6-cf23-40c4-b0a5-2da762186138 on n-h1-858384-13 Oct 18 14:06:09.603561 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-fab1c163-d532-4be0-a1bb-a1b645ab6337 req-598352c1-2b7c-4529-9bd5-59e9e96a2946 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036412 Oct 18 14:06:09.604198 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3222/6646] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:06:09.743244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8939a158-5682-4bef-b1e7-a8dc5f74697f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:06:09.751591 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8939a158-5682-4bef-b1e7-a8dc5f74697f tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1564 microversion: 2.1 time: 0.187778 Oct 18 14:06:09.752183 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3425/6647] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:06:09 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1564 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:06:43.083134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=13 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:43.083911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=42 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:06:43.089325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6c88c517-a33b-46d8-b55f-545c0c7dbdba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:06:43.091626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6c88c517-a33b-46d8-b55f-545c0c7dbdba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:06:43.099063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c88c517-a33b-46d8-b55f-545c0c7dbdba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:43.099546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c88c517-a33b-46d8-b55f-545c0c7dbdba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:43.099985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c88c517-a33b-46d8-b55f-545c0c7dbdba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:43.101432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c88c517-a33b-46d8-b55f-545c0c7dbdba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:06:43.101894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c88c517-a33b-46d8-b55f-545c0c7dbdba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:06:43.102323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c88c517-a33b-46d8-b55f-545c0c7dbdba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:06:43.170968 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6c88c517-a33b-46d8-b55f-545c0c7dbdba tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138/action" status: 200 len: 24567 microversion: 2.1 time: 0.089365 Oct 18 14:06:43.172109 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3223/6648] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:06:43 2022] POST /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138/action => generated 24567 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:07:13.601476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=11 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:13.602259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=38 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:13.607070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:13.609781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:13.616540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:13.617029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:13.617504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:13.618201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:13.618662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:13.619095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:13.904437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:07:13.904973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:07:13.905503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:07:13.905934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:07:13.906376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:07:13.967942 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [1585c77b-6861-4342-a4a8-67f84b39fbd1] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:07:14.975602 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [1585c77b-6861-4342-a4a8-67f84b39fbd1] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38900. Oct 18 14:07:14.978629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:14.985518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:14.986029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:14.986484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:14.987201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:14.987678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:14.988118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:15.016798 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d10649b8-e6ec-4efe-a076-62f2ec4a2638 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138/action" status: 202 len: 1138 microversion: 2.1 time: 1.417140 Oct 18 14:07:15.017485 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3426/6649] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:07:13 2022] POST /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138/action => generated 1138 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 18 14:07:15.039646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7aad0536-dc25-46de-88c4-d6b322631dfd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:15.041343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7aad0536-dc25-46de-88c4-d6b322631dfd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:15.047225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:15.047965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:15.053954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7aad0536-dc25-46de-88c4-d6b322631dfd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:15.054610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7aad0536-dc25-46de-88c4-d6b322631dfd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:15.055721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7aad0536-dc25-46de-88c4-d6b322631dfd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:15.056428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7aad0536-dc25-46de-88c4-d6b322631dfd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:15.056879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7aad0536-dc25-46de-88c4-d6b322631dfd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:15.057530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7aad0536-dc25-46de-88c4-d6b322631dfd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:15.256264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7aad0536-dc25-46de-88c4-d6b322631dfd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:15.268925 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7aad0536-dc25-46de-88c4-d6b322631dfd tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1692 microversion: 2.1 time: 0.234135 Oct 18 14:07:15.269559 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3224/6650] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:15 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1692 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:15.715979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d5175025-557b-4f94-8970-cfddb1a7bf7f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:15.716488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d5175025-557b-4f94-8970-cfddb1a7bf7f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:15.722458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5175025-557b-4f94-8970-cfddb1a7bf7f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:15.722950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5175025-557b-4f94-8970-cfddb1a7bf7f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:15.723395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5175025-557b-4f94-8970-cfddb1a7bf7f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:15.724090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5175025-557b-4f94-8970-cfddb1a7bf7f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:15.724555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5175025-557b-4f94-8970-cfddb1a7bf7f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:15.724990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d5175025-557b-4f94-8970-cfddb1a7bf7f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:15.751141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d5175025-557b-4f94-8970-cfddb1a7bf7f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:07:15.827755 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d5175025-557b-4f94-8970-cfddb1a7bf7f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "DELETE /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 204 len: 0 microversion: 2.1 time: 0.169113 Oct 18 14:07:15.828454 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3427/6651] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:07:15 2022] DELETE /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:07:15.836728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f52d4da8-f7a0-461e-9899-4d90a8a35352 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:15.837372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f52d4da8-f7a0-461e-9899-4d90a8a35352 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:15.844467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f52d4da8-f7a0-461e-9899-4d90a8a35352 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:15.844944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f52d4da8-f7a0-461e-9899-4d90a8a35352 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:15.845416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f52d4da8-f7a0-461e-9899-4d90a8a35352 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:15.846126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f52d4da8-f7a0-461e-9899-4d90a8a35352 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:15.846576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f52d4da8-f7a0-461e-9899-4d90a8a35352 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:15.846996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f52d4da8-f7a0-461e-9899-4d90a8a35352 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:15.985925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f52d4da8-f7a0-461e-9899-4d90a8a35352 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:15.994046 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f52d4da8-f7a0-461e-9899-4d90a8a35352 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1577 microversion: 2.1 time: 0.161241 Oct 18 14:07:15.994630 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3225/6652] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:15 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:16.298428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-071937ca-c5c3-4da1-8b83-d903cc2206e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:16.299153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-071937ca-c5c3-4da1-8b83-d903cc2206e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:16.305442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-071937ca-c5c3-4da1-8b83-d903cc2206e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:16.305944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-071937ca-c5c3-4da1-8b83-d903cc2206e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:16.306402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-071937ca-c5c3-4da1-8b83-d903cc2206e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:16.307112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-071937ca-c5c3-4da1-8b83-d903cc2206e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:16.307591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-071937ca-c5c3-4da1-8b83-d903cc2206e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:16.308690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-071937ca-c5c3-4da1-8b83-d903cc2206e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:16.443686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-071937ca-c5c3-4da1-8b83-d903cc2206e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:16.452825 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-071937ca-c5c3-4da1-8b83-d903cc2206e4 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1692 microversion: 2.1 time: 0.158741 Oct 18 14:07:16.453440 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3428/6653] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:16 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:17.017006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-061c97b3-8f48-4a9f-8200-27b2b4e89fea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:17.017633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-061c97b3-8f48-4a9f-8200-27b2b4e89fea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:17.024602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-061c97b3-8f48-4a9f-8200-27b2b4e89fea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:17.025137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-061c97b3-8f48-4a9f-8200-27b2b4e89fea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:17.025586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-061c97b3-8f48-4a9f-8200-27b2b4e89fea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:17.026270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-061c97b3-8f48-4a9f-8200-27b2b4e89fea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:17.027248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-061c97b3-8f48-4a9f-8200-27b2b4e89fea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:17.027699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-061c97b3-8f48-4a9f-8200-27b2b4e89fea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:17.165392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-061c97b3-8f48-4a9f-8200-27b2b4e89fea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:17.174829 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-061c97b3-8f48-4a9f-8200-27b2b4e89fea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1577 microversion: 2.1 time: 0.161725 Oct 18 14:07:17.175519 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3226/6654] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:17 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:17.475836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-989ca471-202c-4ede-99c2-2e183c06a110 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:17.477131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-989ca471-202c-4ede-99c2-2e183c06a110 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:17.484834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-989ca471-202c-4ede-99c2-2e183c06a110 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:17.485384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-989ca471-202c-4ede-99c2-2e183c06a110 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:17.485838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-989ca471-202c-4ede-99c2-2e183c06a110 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:17.486551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-989ca471-202c-4ede-99c2-2e183c06a110 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:17.487021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-989ca471-202c-4ede-99c2-2e183c06a110 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:17.487461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-989ca471-202c-4ede-99c2-2e183c06a110 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:17.627164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-989ca471-202c-4ede-99c2-2e183c06a110 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:17.635655 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-989ca471-202c-4ede-99c2-2e183c06a110 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1692 microversion: 2.1 time: 0.163718 Oct 18 14:07:17.637135 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3429/6655] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:17 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:18.198380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4972cdf6-f37f-4519-b6ba-68a0016fe591 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:18.199703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4972cdf6-f37f-4519-b6ba-68a0016fe591 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:18.207760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4972cdf6-f37f-4519-b6ba-68a0016fe591 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:18.208357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4972cdf6-f37f-4519-b6ba-68a0016fe591 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:18.208892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4972cdf6-f37f-4519-b6ba-68a0016fe591 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:18.209806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4972cdf6-f37f-4519-b6ba-68a0016fe591 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:18.210408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4972cdf6-f37f-4519-b6ba-68a0016fe591 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:18.210947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4972cdf6-f37f-4519-b6ba-68a0016fe591 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:18.223284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9fbb2be4-1012-4dd0-a46c-65f223cc03bf req-60af0073-14fd-4d12-b183-8f17a532ade9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e72811-100d-46d0-b8af-bcfc77d3cc91", "name": "network-vif-deleted", "tag": "eb4fe447-6c05-4bd3-82b8-9126e0742cfd"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:18.234194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9fbb2be4-1012-4dd0-a46c-65f223cc03bf req-60af0073-14fd-4d12-b183-8f17a532ade9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:18.234831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9fbb2be4-1012-4dd0-a46c-65f223cc03bf req-60af0073-14fd-4d12-b183-8f17a532ade9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:18.236107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9fbb2be4-1012-4dd0-a46c-65f223cc03bf req-60af0073-14fd-4d12-b183-8f17a532ade9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:18.251559 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9fbb2be4-1012-4dd0-a46c-65f223cc03bf req-60af0073-14fd-4d12-b183-8f17a532ade9 service nova] Creating event network-vif-deleted:eb4fe447-6c05-4bd3-82b8-9126e0742cfd for instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 on n-h2-858384-13 Oct 18 14:07:18.259656 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9fbb2be4-1012-4dd0-a46c-65f223cc03bf req-60af0073-14fd-4d12-b183-8f17a532ade9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040072 Oct 18 14:07:18.262169 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3430/6656] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:07:18.596573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4972cdf6-f37f-4519-b6ba-68a0016fe591 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:18.605984 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4972cdf6-f37f-4519-b6ba-68a0016fe591 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1510 microversion: 2.1 time: 0.411596 Oct 18 14:07:18.607029 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3227/6657] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:18 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1510 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:18.661439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3f1dcff8-2e5e-4d40-bcfc-873fbccb84b5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:18.662146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3f1dcff8-2e5e-4d40-bcfc-873fbccb84b5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:18.669080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f1dcff8-2e5e-4d40-bcfc-873fbccb84b5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:18.669609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f1dcff8-2e5e-4d40-bcfc-873fbccb84b5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:18.670077 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f1dcff8-2e5e-4d40-bcfc-873fbccb84b5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:18.670788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f1dcff8-2e5e-4d40-bcfc-873fbccb84b5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:18.671260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f1dcff8-2e5e-4d40-bcfc-873fbccb84b5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:18.671703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3f1dcff8-2e5e-4d40-bcfc-873fbccb84b5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:18.812865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3f1dcff8-2e5e-4d40-bcfc-873fbccb84b5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:18.821665 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3f1dcff8-2e5e-4d40-bcfc-873fbccb84b5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1692 microversion: 2.1 time: 0.165413 Oct 18 14:07:18.822843 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3431/6658] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:18 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:19.629141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c1e1135e-138e-4b46-89c8-c8a63bd84967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:19.629775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c1e1135e-138e-4b46-89c8-c8a63bd84967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:19.637252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1e1135e-138e-4b46-89c8-c8a63bd84967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:19.637737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1e1135e-138e-4b46-89c8-c8a63bd84967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:19.638169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1e1135e-138e-4b46-89c8-c8a63bd84967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:19.638882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1e1135e-138e-4b46-89c8-c8a63bd84967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:19.639337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1e1135e-138e-4b46-89c8-c8a63bd84967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:19.639756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c1e1135e-138e-4b46-89c8-c8a63bd84967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:19.703700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c1e1135e-138e-4b46-89c8-c8a63bd84967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:19.711849 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c1e1135e-138e-4b46-89c8-c8a63bd84967 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1226 microversion: 2.1 time: 0.086532 Oct 18 14:07:19.712433 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3228/6659] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:19 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:19.846187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d5f3f46-77a0-4c6d-92d8-be11ab1b5bee tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:19.846979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d5f3f46-77a0-4c6d-92d8-be11ab1b5bee tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:19.854083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d5f3f46-77a0-4c6d-92d8-be11ab1b5bee tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:19.854581 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d5f3f46-77a0-4c6d-92d8-be11ab1b5bee tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:19.855022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d5f3f46-77a0-4c6d-92d8-be11ab1b5bee tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:19.855725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d5f3f46-77a0-4c6d-92d8-be11ab1b5bee tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:19.856189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d5f3f46-77a0-4c6d-92d8-be11ab1b5bee tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:19.856621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d5f3f46-77a0-4c6d-92d8-be11ab1b5bee tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:19.996355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d5f3f46-77a0-4c6d-92d8-be11ab1b5bee tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:20.004444 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d5f3f46-77a0-4c6d-92d8-be11ab1b5bee tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1692 microversion: 2.1 time: 0.162053 Oct 18 14:07:20.005255 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3432/6660] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:19 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:20.734923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dad253da-836a-4b0f-a981-6cd249854d56 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:20.735559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dad253da-836a-4b0f-a981-6cd249854d56 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:20.743461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dad253da-836a-4b0f-a981-6cd249854d56 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:20.743944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dad253da-836a-4b0f-a981-6cd249854d56 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:20.744374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dad253da-836a-4b0f-a981-6cd249854d56 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:20.745075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dad253da-836a-4b0f-a981-6cd249854d56 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:20.745555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dad253da-836a-4b0f-a981-6cd249854d56 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:20.746007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dad253da-836a-4b0f-a981-6cd249854d56 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:20.811328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dad253da-836a-4b0f-a981-6cd249854d56 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:20.819288 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dad253da-836a-4b0f-a981-6cd249854d56 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1226 microversion: 2.1 time: 0.088472 Oct 18 14:07:20.819866 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3229/6661] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:20 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:07:21.028861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-628098c8-9a8b-45e9-a13a-fc4e0fd1c6b2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:21.029636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-628098c8-9a8b-45e9-a13a-fc4e0fd1c6b2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:21.036492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-628098c8-9a8b-45e9-a13a-fc4e0fd1c6b2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:21.036994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-628098c8-9a8b-45e9-a13a-fc4e0fd1c6b2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:21.037474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-628098c8-9a8b-45e9-a13a-fc4e0fd1c6b2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:21.038185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-628098c8-9a8b-45e9-a13a-fc4e0fd1c6b2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:21.038655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-628098c8-9a8b-45e9-a13a-fc4e0fd1c6b2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:21.039099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-628098c8-9a8b-45e9-a13a-fc4e0fd1c6b2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:21.182745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-628098c8-9a8b-45e9-a13a-fc4e0fd1c6b2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:21.190716 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-628098c8-9a8b-45e9-a13a-fc4e0fd1c6b2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1692 microversion: 2.1 time: 0.166660 Oct 18 14:07:21.191313 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3433/6662] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:21 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:21.842601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4b08320-10a0-45bc-9910-efd38ee2df5c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:21.843882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e4b08320-10a0-45bc-9910-efd38ee2df5c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:21.850891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4b08320-10a0-45bc-9910-efd38ee2df5c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:21.851292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4b08320-10a0-45bc-9910-efd38ee2df5c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:21.851739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4b08320-10a0-45bc-9910-efd38ee2df5c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:21.852435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4b08320-10a0-45bc-9910-efd38ee2df5c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:21.852893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4b08320-10a0-45bc-9910-efd38ee2df5c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:21.853359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4b08320-10a0-45bc-9910-efd38ee2df5c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:21.919646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e4b08320-10a0-45bc-9910-efd38ee2df5c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:21.927738 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e4b08320-10a0-45bc-9910-efd38ee2df5c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 200 len: 1226 microversion: 2.1 time: 0.089847 Oct 18 14:07:21.928334 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3230/6663] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:21 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:22.215638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6aff7f4b-b343-4ef2-b822-e3a421a43c55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:22.216180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6aff7f4b-b343-4ef2-b822-e3a421a43c55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:22.223681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6aff7f4b-b343-4ef2-b822-e3a421a43c55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:22.224182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6aff7f4b-b343-4ef2-b822-e3a421a43c55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:22.224624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6aff7f4b-b343-4ef2-b822-e3a421a43c55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:22.225355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6aff7f4b-b343-4ef2-b822-e3a421a43c55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:22.225820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6aff7f4b-b343-4ef2-b822-e3a421a43c55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:22.226256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6aff7f4b-b343-4ef2-b822-e3a421a43c55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:22.368589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6aff7f4b-b343-4ef2-b822-e3a421a43c55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:22.377963 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6aff7f4b-b343-4ef2-b822-e3a421a43c55 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1692 microversion: 2.1 time: 0.166857 Oct 18 14:07:22.378568 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3434/6664] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:22 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:22.951307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1522770a-2be0-44d7-a129-1c646f7fda2b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:22.951920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1522770a-2be0-44d7-a129-1c646f7fda2b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:22.958875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1522770a-2be0-44d7-a129-1c646f7fda2b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:22.959360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1522770a-2be0-44d7-a129-1c646f7fda2b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:22.959795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1522770a-2be0-44d7-a129-1c646f7fda2b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:22.960486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1522770a-2be0-44d7-a129-1c646f7fda2b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:22.960937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1522770a-2be0-44d7-a129-1c646f7fda2b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:22.961401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1522770a-2be0-44d7-a129-1c646f7fda2b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:22.976012 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-1522770a-2be0-44d7-a129-1c646f7fda2b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1522770a-2be0-44d7-a129-1c646f7fda2b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 HTTP/1.1 Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '45e72811-100d-46d0-b8af-bcfc77d3cc91'} Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:07:22.977684 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:07:22.982571 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:07:22.982571 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:07:22.982571 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:07:22.982571 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:07:22.982571 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:07:22.982571 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:07:22.982571 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:07:22.982571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1522770a-2be0-44d7-a129-1c646f7fda2b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:07:22.982571 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1522770a-2be0-44d7-a129-1c646f7fda2b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 404 len: 111 microversion: 2.1 time: 0.032522 Oct 18 14:07:22.982571 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3231/6665] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:22 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:07:23.029275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-849714954", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1682685967", "security_groups": [{"name": "tempest-secgroup-smoke-918686956"}], "block_device_mapping_v2": [{"uuid": "3784091e-77fb-40f3-8f4f-cf64a102030c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d0463e74-962e-46fb-9c76-86e27a0887d2"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:23.144034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] validate_networks() for [('d0463e74-962e-46fb-9c76-86e27a0887d2', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:07:23.402742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8a08d957-0159-4cde-872c-27ca17d36d7e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:23.403365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8a08d957-0159-4cde-872c-27ca17d36d7e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:23.409494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a08d957-0159-4cde-872c-27ca17d36d7e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:23.409970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a08d957-0159-4cde-872c-27ca17d36d7e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:23.410403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a08d957-0159-4cde-872c-27ca17d36d7e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:23.411089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a08d957-0159-4cde-872c-27ca17d36d7e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:23.411533 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a08d957-0159-4cde-872c-27ca17d36d7e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:23.411954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8a08d957-0159-4cde-872c-27ca17d36d7e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:23.552207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8a08d957-0159-4cde-872c-27ca17d36d7e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:23.560563 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8a08d957-0159-4cde-872c-27ca17d36d7e tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1692 microversion: 2.1 time: 0.162341 Oct 18 14:07:23.561295 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3232/6666] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:23 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:07:23.568719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:07:23.569227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:07:23.569797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:07:23.570295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:07:23.570796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:07:23.581458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:23.581896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:23.582348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:23.583138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:23.583616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:23.584062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:23.601903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:07:23.608227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for user 1d29125d80d146749096e754db7d84d4 and project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:07:23.669084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:07:23.671244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3784091e-77fb-40f3-8f4f-cf64a102030c',volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:07:23.799630 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d2f179b8-7ae4-4ab3-9171-5f8dec7e9f22 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.774856 Oct 18 14:07:23.800271 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3435/6667] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:07:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:07:23.811394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0c44a31b-263f-4e30-b974-3376a5b9d64d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:23.811998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0c44a31b-263f-4e30-b974-3376a5b9d64d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:23.866910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0c44a31b-263f-4e30-b974-3376a5b9d64d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:23.874210 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0c44a31b-263f-4e30-b974-3376a5b9d64d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1094 microversion: 2.1 time: 0.066810 Oct 18 14:07:23.874802 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3233/6668] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:23 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:24.586812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6b4b2cae-02dd-4bd9-af1a-f75f388836a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:24.587463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6b4b2cae-02dd-4bd9-af1a-f75f388836a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:24.594334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b4b2cae-02dd-4bd9-af1a-f75f388836a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:24.594826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b4b2cae-02dd-4bd9-af1a-f75f388836a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:24.595281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b4b2cae-02dd-4bd9-af1a-f75f388836a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:24.595976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b4b2cae-02dd-4bd9-af1a-f75f388836a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:24.596441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b4b2cae-02dd-4bd9-af1a-f75f388836a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:24.596874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b4b2cae-02dd-4bd9-af1a-f75f388836a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:24.737612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6b4b2cae-02dd-4bd9-af1a-f75f388836a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:24.746461 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6b4b2cae-02dd-4bd9-af1a-f75f388836a5 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1692 microversion: 2.1 time: 0.164431 Oct 18 14:07:24.747090 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3436/6669] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:24 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:24.896930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-65958b34-a3e1-4a70-a3d0-6cfdb5771a0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:24.897665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-65958b34-a3e1-4a70-a3d0-6cfdb5771a0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:24.907203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65958b34-a3e1-4a70-a3d0-6cfdb5771a0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:24.907703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65958b34-a3e1-4a70-a3d0-6cfdb5771a0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:24.908211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65958b34-a3e1-4a70-a3d0-6cfdb5771a0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:24.908919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65958b34-a3e1-4a70-a3d0-6cfdb5771a0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:24.909402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65958b34-a3e1-4a70-a3d0-6cfdb5771a0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:24.909826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65958b34-a3e1-4a70-a3d0-6cfdb5771a0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:25.018336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-65958b34-a3e1-4a70-a3d0-6cfdb5771a0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:25.028015 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-65958b34-a3e1-4a70-a3d0-6cfdb5771a0b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1210 microversion: 2.1 time: 0.133910 Oct 18 14:07:25.028853 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3234/6670] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:24 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1210 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:25.774338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-38fb65d6-0358-4454-9706-14fcf3db227d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:25.775530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-38fb65d6-0358-4454-9706-14fcf3db227d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:25.786397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38fb65d6-0358-4454-9706-14fcf3db227d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:25.787169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38fb65d6-0358-4454-9706-14fcf3db227d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:25.787809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38fb65d6-0358-4454-9706-14fcf3db227d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:25.788923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38fb65d6-0358-4454-9706-14fcf3db227d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:25.789588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38fb65d6-0358-4454-9706-14fcf3db227d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:25.790444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38fb65d6-0358-4454-9706-14fcf3db227d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:25.946124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-38fb65d6-0358-4454-9706-14fcf3db227d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:25.960395 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-38fb65d6-0358-4454-9706-14fcf3db227d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1692 microversion: 2.1 time: 0.192935 Oct 18 14:07:25.961393 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3437/6671] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:25 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1692 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:26.059631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cebf749d-a1c1-4a5c-b0e5-c54733b69f88 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:26.060287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cebf749d-a1c1-4a5c-b0e5-c54733b69f88 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:26.068469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cebf749d-a1c1-4a5c-b0e5-c54733b69f88 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:26.069221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cebf749d-a1c1-4a5c-b0e5-c54733b69f88 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:26.069731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cebf749d-a1c1-4a5c-b0e5-c54733b69f88 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:26.070439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cebf749d-a1c1-4a5c-b0e5-c54733b69f88 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:26.070882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cebf749d-a1c1-4a5c-b0e5-c54733b69f88 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:26.071476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cebf749d-a1c1-4a5c-b0e5-c54733b69f88 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:26.275234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cebf749d-a1c1-4a5c-b0e5-c54733b69f88 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:26.284351 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cebf749d-a1c1-4a5c-b0e5-c54733b69f88 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1277 microversion: 2.1 time: 0.235111 Oct 18 14:07:26.284952 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3235/6672] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:26 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1277 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:26.366292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d07e99b5-a3d0-4021-87ba-6a1f7eea2ef7 req-c27375ec-a937-40e7-a5a9-5294daabf493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e45e7766-950f-423e-a0a0-a2add3c835e2", "tag": "1d97c0c3-aa7f-4940-ae78-d368c7b276e8"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:26.381727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d07e99b5-a3d0-4021-87ba-6a1f7eea2ef7 req-c27375ec-a937-40e7-a5a9-5294daabf493 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:26.382233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d07e99b5-a3d0-4021-87ba-6a1f7eea2ef7 req-c27375ec-a937-40e7-a5a9-5294daabf493 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:26.382684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d07e99b5-a3d0-4021-87ba-6a1f7eea2ef7 req-c27375ec-a937-40e7-a5a9-5294daabf493 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:26.403580 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d07e99b5-a3d0-4021-87ba-6a1f7eea2ef7 req-c27375ec-a937-40e7-a5a9-5294daabf493 service nova] Creating event network-changed:1d97c0c3-aa7f-4940-ae78-d368c7b276e8 for instance e45e7766-950f-423e-a0a0-a2add3c835e2 on n-h2-858384-13 Oct 18 14:07:26.409013 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d07e99b5-a3d0-4021-87ba-6a1f7eea2ef7 req-c27375ec-a937-40e7-a5a9-5294daabf493 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050203 Oct 18 14:07:26.410008 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3438/6673] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:07:26.987121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1dedc1a9-08ae-46bc-bf90-5b8291469a16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:26.987879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1dedc1a9-08ae-46bc-bf90-5b8291469a16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:26.994473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1dedc1a9-08ae-46bc-bf90-5b8291469a16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:26.995122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1dedc1a9-08ae-46bc-bf90-5b8291469a16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:26.995831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1dedc1a9-08ae-46bc-bf90-5b8291469a16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:26.996861 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1dedc1a9-08ae-46bc-bf90-5b8291469a16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:26.997597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1dedc1a9-08ae-46bc-bf90-5b8291469a16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:26.998247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1dedc1a9-08ae-46bc-bf90-5b8291469a16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:27.252965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1dedc1a9-08ae-46bc-bf90-5b8291469a16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:27.263479 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1dedc1a9-08ae-46bc-bf90-5b8291469a16 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1698 microversion: 2.1 time: 0.282037 Oct 18 14:07:27.264383 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3236/6674] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:26 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1698 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:27.310279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bf64f862-4d49-43fd-9517-b9697cff376b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:27.311126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bf64f862-4d49-43fd-9517-b9697cff376b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:27.318859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf64f862-4d49-43fd-9517-b9697cff376b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:27.319362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf64f862-4d49-43fd-9517-b9697cff376b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:27.319817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf64f862-4d49-43fd-9517-b9697cff376b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:27.320888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf64f862-4d49-43fd-9517-b9697cff376b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:27.321419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf64f862-4d49-43fd-9517-b9697cff376b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:27.321860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bf64f862-4d49-43fd-9517-b9697cff376b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:27.476560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bf64f862-4d49-43fd-9517-b9697cff376b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:27.488096 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bf64f862-4d49-43fd-9517-b9697cff376b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1277 microversion: 2.1 time: 0.183099 Oct 18 14:07:27.489000 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3439/6675] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:27 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:28.289281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-80c7cae4-b3ac-4d49-96c6-3ee31db0fc82 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:28.289886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-80c7cae4-b3ac-4d49-96c6-3ee31db0fc82 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:28.297781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80c7cae4-b3ac-4d49-96c6-3ee31db0fc82 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:28.298275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80c7cae4-b3ac-4d49-96c6-3ee31db0fc82 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:28.298746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80c7cae4-b3ac-4d49-96c6-3ee31db0fc82 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:28.299491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80c7cae4-b3ac-4d49-96c6-3ee31db0fc82 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:28.299947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80c7cae4-b3ac-4d49-96c6-3ee31db0fc82 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:28.300375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80c7cae4-b3ac-4d49-96c6-3ee31db0fc82 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:28.454374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-80c7cae4-b3ac-4d49-96c6-3ee31db0fc82 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:28.462791 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-80c7cae4-b3ac-4d49-96c6-3ee31db0fc82 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1698 microversion: 2.1 time: 0.177559 Oct 18 14:07:28.463469 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3237/6676] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:28 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:28.513091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4b9a0ee-a09f-463f-90af-affe87d59b33 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:28.513854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e4b9a0ee-a09f-463f-90af-affe87d59b33 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:28.522065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0ee-a09f-463f-90af-affe87d59b33 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:28.522656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0ee-a09f-463f-90af-affe87d59b33 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:28.523179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0ee-a09f-463f-90af-affe87d59b33 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:28.523973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0ee-a09f-463f-90af-affe87d59b33 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:28.524512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0ee-a09f-463f-90af-affe87d59b33 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:28.525027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0ee-a09f-463f-90af-affe87d59b33 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:28.672704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e4b9a0ee-a09f-463f-90af-affe87d59b33 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:28.676262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:28.681430 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e4b9a0ee-a09f-463f-90af-affe87d59b33 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1277 microversion: 2.1 time: 0.173084 Oct 18 14:07:28.682011 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3440/6677] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:28 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:29.488005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a0060c79-a832-47b4-a8da-2b68a2ed3eb2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:29.488543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a0060c79-a832-47b4-a8da-2b68a2ed3eb2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:29.496945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0060c79-a832-47b4-a8da-2b68a2ed3eb2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:29.497631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0060c79-a832-47b4-a8da-2b68a2ed3eb2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:29.498085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0060c79-a832-47b4-a8da-2b68a2ed3eb2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:29.498793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0060c79-a832-47b4-a8da-2b68a2ed3eb2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:29.499276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0060c79-a832-47b4-a8da-2b68a2ed3eb2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:29.499701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0060c79-a832-47b4-a8da-2b68a2ed3eb2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:29.705034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3fa95467-9485-41cb-bea3-1504fb026614 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:29.706108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3fa95467-9485-41cb-bea3-1504fb026614 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:29.719010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa95467-9485-41cb-bea3-1504fb026614 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:29.719915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa95467-9485-41cb-bea3-1504fb026614 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:29.720517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa95467-9485-41cb-bea3-1504fb026614 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:29.721537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa95467-9485-41cb-bea3-1504fb026614 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:29.722192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa95467-9485-41cb-bea3-1504fb026614 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:29.722827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3fa95467-9485-41cb-bea3-1504fb026614 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:29.732104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a0060c79-a832-47b4-a8da-2b68a2ed3eb2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:29.741798 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a0060c79-a832-47b4-a8da-2b68a2ed3eb2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1698 microversion: 2.1 time: 0.258557 Oct 18 14:07:29.742655 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3238/6678] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:29 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1698 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:29.890218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3fa95467-9485-41cb-bea3-1504fb026614 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:29.901150 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3fa95467-9485-41cb-bea3-1504fb026614 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1277 microversion: 2.1 time: 0.200588 Oct 18 14:07:29.902525 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3441/6679] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:29 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:07:30.767743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-06addcbc-f77e-4fa9-b38f-f66bdbfd1e97 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:30.768334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-06addcbc-f77e-4fa9-b38f-f66bdbfd1e97 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:30.775124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06addcbc-f77e-4fa9-b38f-f66bdbfd1e97 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:30.775598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06addcbc-f77e-4fa9-b38f-f66bdbfd1e97 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:30.776029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06addcbc-f77e-4fa9-b38f-f66bdbfd1e97 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:30.777222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06addcbc-f77e-4fa9-b38f-f66bdbfd1e97 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:30.777670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06addcbc-f77e-4fa9-b38f-f66bdbfd1e97 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:30.778087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06addcbc-f77e-4fa9-b38f-f66bdbfd1e97 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:30.912964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-06addcbc-f77e-4fa9-b38f-f66bdbfd1e97 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:30.921071 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-06addcbc-f77e-4fa9-b38f-f66bdbfd1e97 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1698 microversion: 2.1 time: 0.157246 Oct 18 14:07:30.921675 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3239/6680] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:30 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:30.925597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f03d3e28-489f-439c-b370-60f90ea2b1fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:30.926261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f03d3e28-489f-439c-b370-60f90ea2b1fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:30.933622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f03d3e28-489f-439c-b370-60f90ea2b1fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:30.934125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f03d3e28-489f-439c-b370-60f90ea2b1fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:30.934571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f03d3e28-489f-439c-b370-60f90ea2b1fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:30.935278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f03d3e28-489f-439c-b370-60f90ea2b1fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:30.935749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f03d3e28-489f-439c-b370-60f90ea2b1fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:30.936188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f03d3e28-489f-439c-b370-60f90ea2b1fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:31.069358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f03d3e28-489f-439c-b370-60f90ea2b1fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:31.078399 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f03d3e28-489f-439c-b370-60f90ea2b1fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1265 microversion: 2.1 time: 0.156830 Oct 18 14:07:31.078981 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3442/6681] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:30 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:07:31.711153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-f28a7e6b-3a47-4eb3-a002-34886d2c18a5 req-61d84aea-b260-431e-a4ab-b3eec6c019ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6442f6-cf23-40c4-b0a5-2da762186138", "name": "network-vif-unplugged", "status": "completed", "tag": "d00cbe5f-c74d-496c-a878-bc05aaf50b87"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:31.721585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f28a7e6b-3a47-4eb3-a002-34886d2c18a5 req-61d84aea-b260-431e-a4ab-b3eec6c019ad service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:31.722059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f28a7e6b-3a47-4eb3-a002-34886d2c18a5 req-61d84aea-b260-431e-a4ab-b3eec6c019ad service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:31.722489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f28a7e6b-3a47-4eb3-a002-34886d2c18a5 req-61d84aea-b260-431e-a4ab-b3eec6c019ad service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:31.734162 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f28a7e6b-3a47-4eb3-a002-34886d2c18a5 req-61d84aea-b260-431e-a4ab-b3eec6c019ad service nova] Creating event network-vif-unplugged:d00cbe5f-c74d-496c-a878-bc05aaf50b87 for instance 0d6442f6-cf23-40c4-b0a5-2da762186138 on n-h1-858384-13 Oct 18 14:07:31.739860 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-f28a7e6b-3a47-4eb3-a002-34886d2c18a5 req-61d84aea-b260-431e-a4ab-b3eec6c019ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032290 Oct 18 14:07:31.740798 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3240/6682] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:07:31.944356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3d071ee9-99be-4524-84d2-db26b9bb833a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:31.944979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3d071ee9-99be-4524-84d2-db26b9bb833a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:31.952651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d071ee9-99be-4524-84d2-db26b9bb833a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:31.953147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d071ee9-99be-4524-84d2-db26b9bb833a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:31.953620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d071ee9-99be-4524-84d2-db26b9bb833a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:31.954315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d071ee9-99be-4524-84d2-db26b9bb833a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:31.954778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d071ee9-99be-4524-84d2-db26b9bb833a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:31.955211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3d071ee9-99be-4524-84d2-db26b9bb833a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:32.090855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3d071ee9-99be-4524-84d2-db26b9bb833a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:32.098894 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3d071ee9-99be-4524-84d2-db26b9bb833a tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1683 microversion: 2.1 time: 0.158460 Oct 18 14:07:32.099479 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3443/6683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:31 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:32.103976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a5ee380f-0b1f-4f83-9780-cbfaee97fdf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:32.105111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a5ee380f-0b1f-4f83-9780-cbfaee97fdf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:32.111154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5ee380f-0b1f-4f83-9780-cbfaee97fdf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:32.111628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5ee380f-0b1f-4f83-9780-cbfaee97fdf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:32.112061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5ee380f-0b1f-4f83-9780-cbfaee97fdf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:32.112741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5ee380f-0b1f-4f83-9780-cbfaee97fdf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:32.113202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5ee380f-0b1f-4f83-9780-cbfaee97fdf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:32.113638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a5ee380f-0b1f-4f83-9780-cbfaee97fdf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:32.275655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a5ee380f-0b1f-4f83-9780-cbfaee97fdf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:32.283774 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a5ee380f-0b1f-4f83-9780-cbfaee97fdf5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1265 microversion: 2.1 time: 0.184997 Oct 18 14:07:32.284354 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3241/6684] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:32 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:07:33.306747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-66954dac-cd9c-4225-9277-0c3d6392ae90 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:33.307388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-66954dac-cd9c-4225-9277-0c3d6392ae90 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:33.314285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66954dac-cd9c-4225-9277-0c3d6392ae90 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:33.314778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66954dac-cd9c-4225-9277-0c3d6392ae90 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:33.315223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66954dac-cd9c-4225-9277-0c3d6392ae90 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:33.315922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66954dac-cd9c-4225-9277-0c3d6392ae90 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:33.316384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66954dac-cd9c-4225-9277-0c3d6392ae90 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:33.316820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66954dac-cd9c-4225-9277-0c3d6392ae90 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:33.460840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-66954dac-cd9c-4225-9277-0c3d6392ae90 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:33.469634 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-66954dac-cd9c-4225-9277-0c3d6392ae90 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1265 microversion: 2.1 time: 0.166681 Oct 18 14:07:33.470240 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3444/6685] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:33 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:33.820030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-9a46c6ed-81e7-431a-be7d-c2d5e2934e4e req-f5067554-352d-4550-86f9-917342f14d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6442f6-cf23-40c4-b0a5-2da762186138", "name": "network-vif-plugged", "status": "completed", "tag": "d00cbe5f-c74d-496c-a878-bc05aaf50b87"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:33.834521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9a46c6ed-81e7-431a-be7d-c2d5e2934e4e req-f5067554-352d-4550-86f9-917342f14d03 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:33.835413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9a46c6ed-81e7-431a-be7d-c2d5e2934e4e req-f5067554-352d-4550-86f9-917342f14d03 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:33.836076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9a46c6ed-81e7-431a-be7d-c2d5e2934e4e req-f5067554-352d-4550-86f9-917342f14d03 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:33.850079 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-9a46c6ed-81e7-431a-be7d-c2d5e2934e4e req-f5067554-352d-4550-86f9-917342f14d03 service nova] Creating event network-vif-plugged:d00cbe5f-c74d-496c-a878-bc05aaf50b87 for instance 0d6442f6-cf23-40c4-b0a5-2da762186138 on n-h1-858384-13 Oct 18 14:07:33.857789 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-9a46c6ed-81e7-431a-be7d-c2d5e2934e4e req-f5067554-352d-4550-86f9-917342f14d03 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042892 Oct 18 14:07:33.859104 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3242/6686] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:07:34.492548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0c30bb92-1ca0-48e5-9f76-ed0d15dc32bc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:34.493078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0c30bb92-1ca0-48e5-9f76-ed0d15dc32bc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:34.495513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:34.496272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:34.503773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c30bb92-1ca0-48e5-9f76-ed0d15dc32bc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:34.504279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c30bb92-1ca0-48e5-9f76-ed0d15dc32bc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:34.504721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c30bb92-1ca0-48e5-9f76-ed0d15dc32bc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:34.505527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c30bb92-1ca0-48e5-9f76-ed0d15dc32bc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:34.505918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c30bb92-1ca0-48e5-9f76-ed0d15dc32bc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:34.506349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c30bb92-1ca0-48e5-9f76-ed0d15dc32bc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:34.647911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0c30bb92-1ca0-48e5-9f76-ed0d15dc32bc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:34.656650 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0c30bb92-1ca0-48e5-9f76-ed0d15dc32bc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1265 microversion: 2.1 time: 0.168433 Oct 18 14:07:34.657339 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3445/6687] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:34 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:35.677482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:35.683372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d196b4d7-b460-419d-8f5f-ed2e06673e21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:35.684078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d196b4d7-b460-419d-8f5f-ed2e06673e21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:35.690569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d196b4d7-b460-419d-8f5f-ed2e06673e21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:35.691046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d196b4d7-b460-419d-8f5f-ed2e06673e21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:35.691485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d196b4d7-b460-419d-8f5f-ed2e06673e21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:35.692165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d196b4d7-b460-419d-8f5f-ed2e06673e21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:35.692610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d196b4d7-b460-419d-8f5f-ed2e06673e21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:35.693044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d196b4d7-b460-419d-8f5f-ed2e06673e21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:35.711385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=100 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:07:35.830557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d196b4d7-b460-419d-8f5f-ed2e06673e21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:35.838284 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d196b4d7-b460-419d-8f5f-ed2e06673e21 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1265 microversion: 2.1 time: 0.161761 Oct 18 14:07:35.839391 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3243/6688] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:35 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:36.861440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ad5801f9-5b8a-4ce3-9b90-62e85006dbeb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:36.862071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ad5801f9-5b8a-4ce3-9b90-62e85006dbeb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:36.868991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad5801f9-5b8a-4ce3-9b90-62e85006dbeb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:36.869518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad5801f9-5b8a-4ce3-9b90-62e85006dbeb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:36.869973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad5801f9-5b8a-4ce3-9b90-62e85006dbeb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:36.870681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad5801f9-5b8a-4ce3-9b90-62e85006dbeb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:36.871147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad5801f9-5b8a-4ce3-9b90-62e85006dbeb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:36.871588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad5801f9-5b8a-4ce3-9b90-62e85006dbeb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:37.006609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ad5801f9-5b8a-4ce3-9b90-62e85006dbeb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:37.015870 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ad5801f9-5b8a-4ce3-9b90-62e85006dbeb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1265 microversion: 2.1 time: 0.158345 Oct 18 14:07:37.016480 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3446/6689] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:36 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:38.039581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-111a7451-bd72-4bf8-be6e-f885be1c075f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:38.040243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-111a7451-bd72-4bf8-be6e-f885be1c075f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:38.048413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-111a7451-bd72-4bf8-be6e-f885be1c075f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:38.048919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-111a7451-bd72-4bf8-be6e-f885be1c075f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:38.049375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-111a7451-bd72-4bf8-be6e-f885be1c075f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:38.050080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-111a7451-bd72-4bf8-be6e-f885be1c075f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:38.050538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-111a7451-bd72-4bf8-be6e-f885be1c075f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:38.050966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-111a7451-bd72-4bf8-be6e-f885be1c075f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:38.190658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-111a7451-bd72-4bf8-be6e-f885be1c075f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:38.202762 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-111a7451-bd72-4bf8-be6e-f885be1c075f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1265 microversion: 2.1 time: 0.166903 Oct 18 14:07:38.203373 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3244/6690] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:38 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:39.228990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c6e77da8-dbea-4009-8eea-fc6881122a47 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:39.230217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c6e77da8-dbea-4009-8eea-fc6881122a47 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:39.237126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6e77da8-dbea-4009-8eea-fc6881122a47 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:39.237661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6e77da8-dbea-4009-8eea-fc6881122a47 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:39.238109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6e77da8-dbea-4009-8eea-fc6881122a47 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:39.238920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6e77da8-dbea-4009-8eea-fc6881122a47 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:39.239393 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6e77da8-dbea-4009-8eea-fc6881122a47 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:39.239838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6e77da8-dbea-4009-8eea-fc6881122a47 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:39.373208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c6e77da8-dbea-4009-8eea-fc6881122a47 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:39.382243 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c6e77da8-dbea-4009-8eea-fc6881122a47 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1265 microversion: 2.1 time: 0.157198 Oct 18 14:07:39.382846 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3447/6691] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:39 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:39.693279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-8f9678d3-38b8-4591-a3d7-73d3f39202d3 req-8fae425e-04f0-41d5-a690-ca9fb966d30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e45e7766-950f-423e-a0a0-a2add3c835e2", "name": "network-vif-plugged", "status": "completed", "tag": "1d97c0c3-aa7f-4940-ae78-d368c7b276e8"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:39.703916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8f9678d3-38b8-4591-a3d7-73d3f39202d3 req-8fae425e-04f0-41d5-a690-ca9fb966d30e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:39.704524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8f9678d3-38b8-4591-a3d7-73d3f39202d3 req-8fae425e-04f0-41d5-a690-ca9fb966d30e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:39.704952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8f9678d3-38b8-4591-a3d7-73d3f39202d3 req-8fae425e-04f0-41d5-a690-ca9fb966d30e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:39.719554 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-8f9678d3-38b8-4591-a3d7-73d3f39202d3 req-8fae425e-04f0-41d5-a690-ca9fb966d30e service nova] Creating event network-vif-plugged:1d97c0c3-aa7f-4940-ae78-d368c7b276e8 for instance e45e7766-950f-423e-a0a0-a2add3c835e2 on n-h2-858384-13 Oct 18 14:07:39.724854 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-8f9678d3-38b8-4591-a3d7-73d3f39202d3 req-8fae425e-04f0-41d5-a690-ca9fb966d30e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035550 Oct 18 14:07:39.725508 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3245/6692] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:07:40.405538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a8972f0e-3a6d-4cc7-ba15-27e117937182 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:40.406164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a8972f0e-3a6d-4cc7-ba15-27e117937182 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:40.413049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8972f0e-3a6d-4cc7-ba15-27e117937182 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:40.413578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8972f0e-3a6d-4cc7-ba15-27e117937182 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:40.414023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8972f0e-3a6d-4cc7-ba15-27e117937182 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:40.414717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8972f0e-3a6d-4cc7-ba15-27e117937182 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:40.415180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8972f0e-3a6d-4cc7-ba15-27e117937182 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:40.415616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8972f0e-3a6d-4cc7-ba15-27e117937182 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:40.552933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a8972f0e-3a6d-4cc7-ba15-27e117937182 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:40.561309 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a8972f0e-3a6d-4cc7-ba15-27e117937182 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1265 microversion: 2.1 time: 0.159745 Oct 18 14:07:40.561882 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3448/6693] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:40 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:41.586678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-10407d58-20c4-49e0-b543-e076cf08ecd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:41.587376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-10407d58-20c4-49e0-b543-e076cf08ecd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:41.594296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10407d58-20c4-49e0-b543-e076cf08ecd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:41.594776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10407d58-20c4-49e0-b543-e076cf08ecd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:41.595211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10407d58-20c4-49e0-b543-e076cf08ecd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:41.595894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10407d58-20c4-49e0-b543-e076cf08ecd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:41.596343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10407d58-20c4-49e0-b543-e076cf08ecd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:41.596767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-10407d58-20c4-49e0-b543-e076cf08ecd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:41.728302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-10407d58-20c4-49e0-b543-e076cf08ecd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:41.736379 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-10407d58-20c4-49e0-b543-e076cf08ecd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1451 microversion: 2.1 time: 0.154938 Oct 18 14:07:41.736957 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3246/6694] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:41 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:41.758693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bdd26299-f7f5-417a-be79-543d96a0baba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:07:41.759314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bdd26299-f7f5-417a-be79-543d96a0baba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:07:41.766806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdd26299-f7f5-417a-be79-543d96a0baba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:41.767303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdd26299-f7f5-417a-be79-543d96a0baba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:41.767746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdd26299-f7f5-417a-be79-543d96a0baba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:41.768443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdd26299-f7f5-417a-be79-543d96a0baba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:41.768905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdd26299-f7f5-417a-be79-543d96a0baba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:41.769364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdd26299-f7f5-417a-be79-543d96a0baba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:41.907416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bdd26299-f7f5-417a-be79-543d96a0baba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:07:41.915471 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bdd26299-f7f5-417a-be79-543d96a0baba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1451 microversion: 2.1 time: 0.160732 Oct 18 14:07:41.916040 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3449/6695] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:07:41 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:07:44.020858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-dcc852ba-0f37-4d7e-897c-c1cce31c1bd2 req-86dbea6e-d454-40e0-9284-f14052136ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e45e7766-950f-423e-a0a0-a2add3c835e2", "tag": "1d97c0c3-aa7f-4940-ae78-d368c7b276e8"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:07:44.031770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-dcc852ba-0f37-4d7e-897c-c1cce31c1bd2 req-86dbea6e-d454-40e0-9284-f14052136ee8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:07:44.032522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-dcc852ba-0f37-4d7e-897c-c1cce31c1bd2 req-86dbea6e-d454-40e0-9284-f14052136ee8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:07:44.033036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-dcc852ba-0f37-4d7e-897c-c1cce31c1bd2 req-86dbea6e-d454-40e0-9284-f14052136ee8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:07:44.046623 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-dcc852ba-0f37-4d7e-897c-c1cce31c1bd2 req-86dbea6e-d454-40e0-9284-f14052136ee8 service nova] Creating event network-changed:1d97c0c3-aa7f-4940-ae78-d368c7b276e8 for instance e45e7766-950f-423e-a0a0-a2add3c835e2 on n-h2-858384-13 Oct 18 14:07:44.052027 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-dcc852ba-0f37-4d7e-897c-c1cce31c1bd2 req-86dbea6e-d454-40e0-9284-f14052136ee8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103950 Oct 18 14:07:44.052730 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3247/6696] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:08:06.379237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f372adc2-c498-4d10-b327-49a6de81b008 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:08:06.381316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f372adc2-c498-4d10-b327-49a6de81b008 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:06.383479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:06.384198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=54 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:06.391142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f372adc2-c498-4d10-b327-49a6de81b008 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:06.391702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f372adc2-c498-4d10-b327-49a6de81b008 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:06.392241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f372adc2-c498-4d10-b327-49a6de81b008 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:06.393069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f372adc2-c498-4d10-b327-49a6de81b008 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:06.393621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f372adc2-c498-4d10-b327-49a6de81b008 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:06.394120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f372adc2-c498-4d10-b327-49a6de81b008 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:06.465199 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f372adc2-c498-4d10-b327-49a6de81b008 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "POST /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138/action" status: 200 len: 24571 microversion: 2.1 time: 0.090204 Oct 18 14:08:06.465914 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3450/6697] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:08:06 2022] POST /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138/action => generated 24571 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:08:38.050237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=50 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:38.051063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=18 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:38.056887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ebafbd7c-7ef6-4549-8595-32afd2a21790 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:38.057518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ebafbd7c-7ef6-4549-8595-32afd2a21790 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:38.058509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3b037c2a-37da-49a0-bf0d-42641fcd0f62 req-0ff69b1a-6c40-481b-992f-4c7db7804273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6442f6-cf23-40c4-b0a5-2da762186138", "tag": "d00cbe5f-c74d-496c-a878-bc05aaf50b87"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:08:38.065003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebafbd7c-7ef6-4549-8595-32afd2a21790 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:38.065781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebafbd7c-7ef6-4549-8595-32afd2a21790 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:38.066223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebafbd7c-7ef6-4549-8595-32afd2a21790 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:38.066343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:38.066928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebafbd7c-7ef6-4549-8595-32afd2a21790 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:38.067048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:08:38.067846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebafbd7c-7ef6-4549-8595-32afd2a21790 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:38.068457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ebafbd7c-7ef6-4549-8595-32afd2a21790 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:38.072715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3b037c2a-37da-49a0-bf0d-42641fcd0f62 req-0ff69b1a-6c40-481b-992f-4c7db7804273 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:38.073241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3b037c2a-37da-49a0-bf0d-42641fcd0f62 req-0ff69b1a-6c40-481b-992f-4c7db7804273 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:38.073902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3b037c2a-37da-49a0-bf0d-42641fcd0f62 req-0ff69b1a-6c40-481b-992f-4c7db7804273 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:38.098660 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3b037c2a-37da-49a0-bf0d-42641fcd0f62 req-0ff69b1a-6c40-481b-992f-4c7db7804273 service nova] Creating event network-changed:d00cbe5f-c74d-496c-a878-bc05aaf50b87 for instance 0d6442f6-cf23-40c4-b0a5-2da762186138 on n-h1-858384-13 Oct 18 14:08:38.101031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ebafbd7c-7ef6-4549-8595-32afd2a21790 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:08:38.104582 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3b037c2a-37da-49a0-bf0d-42641fcd0f62 req-0ff69b1a-6c40-481b-992f-4c7db7804273 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050234 Oct 18 14:08:38.105613 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3451/6698] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:08:38.203299 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ebafbd7c-7ef6-4549-8595-32afd2a21790 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 204 len: 0 microversion: 2.1 time: 0.154325 Oct 18 14:08:38.204423 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3248/6699] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:08:38 2022] DELETE /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:08:38.216359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5aa90fe6-c274-4472-b6a7-6475240bcf2c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:38.217561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5aa90fe6-c274-4472-b6a7-6475240bcf2c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:38.225225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5aa90fe6-c274-4472-b6a7-6475240bcf2c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:38.226039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5aa90fe6-c274-4472-b6a7-6475240bcf2c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:38.226519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5aa90fe6-c274-4472-b6a7-6475240bcf2c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:38.227268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5aa90fe6-c274-4472-b6a7-6475240bcf2c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:38.227740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5aa90fe6-c274-4472-b6a7-6475240bcf2c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:38.228359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5aa90fe6-c274-4472-b6a7-6475240bcf2c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:38.674007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5aa90fe6-c274-4472-b6a7-6475240bcf2c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:38.684386 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5aa90fe6-c274-4472-b6a7-6475240bcf2c tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1689 microversion: 2.1 time: 0.474399 Oct 18 14:08:38.685019 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3452/6700] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:38 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1689 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:39.709859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e863c56b-a4b0-4e35-b62b-a96eac995d8d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:39.710556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e863c56b-a4b0-4e35-b62b-a96eac995d8d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:39.717504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e863c56b-a4b0-4e35-b62b-a96eac995d8d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:39.717979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e863c56b-a4b0-4e35-b62b-a96eac995d8d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:39.718407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e863c56b-a4b0-4e35-b62b-a96eac995d8d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:39.719084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e863c56b-a4b0-4e35-b62b-a96eac995d8d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:39.719529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e863c56b-a4b0-4e35-b62b-a96eac995d8d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:39.719948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e863c56b-a4b0-4e35-b62b-a96eac995d8d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:39.933654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e863c56b-a4b0-4e35-b62b-a96eac995d8d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:39.942357 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e863c56b-a4b0-4e35-b62b-a96eac995d8d tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1689 microversion: 2.1 time: 0.237012 Oct 18 14:08:39.943581 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3249/6701] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:39 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1689 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:40.505056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-71f0bbe0-c678-4adf-ad15-641c813b8d5a req-27f454d3-cd61-4203-8ed1-f48985fd0924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6442f6-cf23-40c4-b0a5-2da762186138", "name": "network-vif-deleted", "tag": "d00cbe5f-c74d-496c-a878-bc05aaf50b87"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:08:40.525044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-71f0bbe0-c678-4adf-ad15-641c813b8d5a req-27f454d3-cd61-4203-8ed1-f48985fd0924 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:40.525934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-71f0bbe0-c678-4adf-ad15-641c813b8d5a req-27f454d3-cd61-4203-8ed1-f48985fd0924 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:40.526719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-71f0bbe0-c678-4adf-ad15-641c813b8d5a req-27f454d3-cd61-4203-8ed1-f48985fd0924 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:40.549508 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-71f0bbe0-c678-4adf-ad15-641c813b8d5a req-27f454d3-cd61-4203-8ed1-f48985fd0924 service nova] Creating event network-vif-deleted:d00cbe5f-c74d-496c-a878-bc05aaf50b87 for instance 0d6442f6-cf23-40c4-b0a5-2da762186138 on n-h1-858384-13 Oct 18 14:08:40.558904 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-71f0bbe0-c678-4adf-ad15-641c813b8d5a req-27f454d3-cd61-4203-8ed1-f48985fd0924 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062243 Oct 18 14:08:40.560094 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3453/6702] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:08:40.972652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:40.973473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:40.981598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:40.982082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:40.982517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:40.983212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:40.983665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:40.984108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:41.021897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:41.022653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:41.023121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:41.023701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lazy-loading 'fault' on Instance uuid 0d6442f6-cf23-40c4-b0a5-2da762186138 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:08:41.067670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e90c2f331f46f497b568dbc0e0c100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b27cd003004ada9e45c087db637da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:08:41.080230 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a2f02942-5bd6-4086-a77c-7fe903e9fae8 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 200 len: 1356 microversion: 2.1 time: 0.111949 Oct 18 14:08:41.093232 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3250/6703] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:40 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 1356 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:08:42.107759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-34940f81-24a4-496c-b983-3efbd109f99b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:42.108484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-34940f81-24a4-496c-b983-3efbd109f99b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [instance: 0d6442f6-cf23-40c4-b0a5-2da762186138] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:08:42.115602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34940f81-24a4-496c-b983-3efbd109f99b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:42.116148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34940f81-24a4-496c-b983-3efbd109f99b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:42.116552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34940f81-24a4-496c-b983-3efbd109f99b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:42.117290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34940f81-24a4-496c-b983-3efbd109f99b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:08:42.117763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34940f81-24a4-496c-b983-3efbd109f99b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:08:42.118205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-34940f81-24a4-496c-b983-3efbd109f99b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:08:42.131760 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-34940f81-24a4-496c-b983-3efbd109f99b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] HTTP exception thrown: Instance 0d6442f6-cf23-40c4-b0a5-2da762186138 could not be found. Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-34940f81-24a4-496c-b983-3efbd109f99b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Request method failure captured: Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 HTTP/1.1 Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrERveMSbr98lDbhVRpVCZtMpZCqRzllFV9Zp-9Paa2aeI2L6Uu3YKC5mtfy6YqZYTDL35tBdZ2S8DBV9NMKTb2UJzxCOY2UD_h7FbwqxTtZxtG-8cn42k_jl_VvaBbCHWnwHwkU0ksMnyQKE0VuTZblyb548PMnFxhTFzNpMLJL5y0 Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: c5b27cd003004ada9e45c087db637da3 Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1155266913 Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5b27cd003004ada9e45c087db637da3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5b27cd003004ada9e45c087db637da3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5b27cd003004ada9e45c087db637da3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5b27cd003004ada9e45c087db637da3"}]}] Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1155266913 Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: c5b27cd003004ada9e45c087db637da3 Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1155266913 Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestNetworkAdvancedServerOps-1155266913-project Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 21e90c2f331f46f497b568dbc0e0c100 Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1155266913-project Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 0d6442f6-cf23-40c4-b0a5-2da762186138 could not be found. Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '0d6442f6-cf23-40c4-b0a5-2da762186138'} Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6442f6-cf23-40c4-b0a5-2da762186138 could not be found. Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6442f6-cf23-40c4-b0a5-2da762186138 could not be found. Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:08:42.133440 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:08:42.137867 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:08:42.137867 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:08:42.137867 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:08:42.137867 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:08:42.137867 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:08:42.137867 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:08:42.137867 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6442f6-cf23-40c4-b0a5-2da762186138 could not be found. Oct 18 14:08:42.137867 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:08:42.137867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-34940f81-24a4-496c-b983-3efbd109f99b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Returning 404 to user: Instance 0d6442f6-cf23-40c4-b0a5-2da762186138 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:08:42.137867 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-34940f81-24a4-496c-b983-3efbd109f99b tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138" status: 404 len: 111 microversion: 2.1 time: 0.032218 Oct 18 14:08:42.137867 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3454/6704] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:08:42 2022] GET /compute/v2.1/servers/0d6442f6-cf23-40c4-b0a5-2da762186138 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:08:45.283175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4b18aafc-aeea-4bc6-8de3-9a75f13123a2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] Calling method '.version_select at 0x7ff614047a60>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:08:45.289495 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4b18aafc-aeea-4bc6-8de3-9a75f13123a2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:08:46.299645 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [None req-4b18aafc-aeea-4bc6-8de3-9a75f13123a2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39106. Oct 18 14:08:46.320580 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4b18aafc-aeea-4bc6-8de3-9a75f13123a2 tempest-TestNetworkAdvancedServerOps-1155266913 tempest-TestNetworkAdvancedServerOps-1155266913-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-390969125" status: 202 len: 0 microversion: 2.1 time: 1.041231 Oct 18 14:08:46.321543 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3251/6705] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 18 14:08:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-390969125 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:09:22.715764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-517142954", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1682685967", "security_groups": [{"name": "tempest-secgroup-smoke-918686956"}], "block_device_mapping_v2": [{"uuid": "f59ecf38-b989-4e7d-b2c3-ebe768765aa0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d0463e74-962e-46fb-9c76-86e27a0887d2"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:22.726689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=8 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:22.727213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=12 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:22.729362 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:09:22.729535 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:09:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Oct 18 14:09:22.848732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] validate_networks() for [('d0463e74-962e-46fb-9c76-86e27a0887d2', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:09:23.267144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:09:23.267591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:09:23.268095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:09:23.268533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:09:23.268966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:09:23.278587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:23.279093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:23.279554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:23.280593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:23.281404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:23.282117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:23.304487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:09:23.310652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Getting quotas for user 1d29125d80d146749096e754db7d84d4 and project 59688d82c8a54ebdbdbd360983b5e13c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:09:23.372588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:09:23.374828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f59ecf38-b989-4e7d-b2c3-ebe768765aa0',volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:09:23.536133 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-59381cd4-f030-43f0-8cc7-fac647c0670e tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.824641 Oct 18 14:09:23.536785 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3455/6706] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:09:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:09:23.550292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bba0953f-d43b-4cea-b592-6d6817212230 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:23.551136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bba0953f-d43b-4cea-b592-6d6817212230 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:23.555280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:23.555865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:23.558312 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:09:23.558312 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:09:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 (ip 10.222.0.40) !!! Oct 18 14:09:23.624507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bba0953f-d43b-4cea-b592-6d6817212230 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:23.637281 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bba0953f-d43b-4cea-b592-6d6817212230 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1094 microversion: 2.1 time: 0.091540 Oct 18 14:09:23.637991 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3252/6707] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:23 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1094 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:24.660942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-33ad2492-c26e-431f-b534-49d82dbfc908 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:24.662078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-33ad2492-c26e-431f-b534-49d82dbfc908 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:24.669902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33ad2492-c26e-431f-b534-49d82dbfc908 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:24.670407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33ad2492-c26e-431f-b534-49d82dbfc908 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:24.670855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33ad2492-c26e-431f-b534-49d82dbfc908 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:24.671638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33ad2492-c26e-431f-b534-49d82dbfc908 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:24.672164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33ad2492-c26e-431f-b534-49d82dbfc908 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:24.672609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-33ad2492-c26e-431f-b534-49d82dbfc908 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:24.739941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-33ad2492-c26e-431f-b534-49d82dbfc908 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:24.751712 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-33ad2492-c26e-431f-b534-49d82dbfc908 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1200 microversion: 2.1 time: 0.095372 Oct 18 14:09:24.752458 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3456/6708] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:24 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1200 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:25.777221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e99d716-0361-42e6-87b6-9b34193e62ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:25.777954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4e99d716-0361-42e6-87b6-9b34193e62ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:25.788324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e99d716-0361-42e6-87b6-9b34193e62ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:25.789108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e99d716-0361-42e6-87b6-9b34193e62ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:25.789759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e99d716-0361-42e6-87b6-9b34193e62ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:25.791208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e99d716-0361-42e6-87b6-9b34193e62ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:25.792201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e99d716-0361-42e6-87b6-9b34193e62ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:25.792798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e99d716-0361-42e6-87b6-9b34193e62ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:26.246421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4e99d716-0361-42e6-87b6-9b34193e62ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:26.257503 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4e99d716-0361-42e6-87b6-9b34193e62ba tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1277 microversion: 2.1 time: 0.484949 Oct 18 14:09:26.258451 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3253/6709] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:25 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1277 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:26.684164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-54142726-4b7c-4ace-bbfe-dcd627161d3e req-1413058e-0778-41ed-9e5d-3f72e156307e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88dd0811-9a13-45cf-9f56-30d0ef545da3", "tag": "33f0bfc6-178a-46fc-8847-e0eba4780c8d"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:26.711562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-54142726-4b7c-4ace-bbfe-dcd627161d3e req-1413058e-0778-41ed-9e5d-3f72e156307e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:26.713532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-54142726-4b7c-4ace-bbfe-dcd627161d3e req-1413058e-0778-41ed-9e5d-3f72e156307e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:26.714177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-54142726-4b7c-4ace-bbfe-dcd627161d3e req-1413058e-0778-41ed-9e5d-3f72e156307e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:26.727082 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-54142726-4b7c-4ace-bbfe-dcd627161d3e req-1413058e-0778-41ed-9e5d-3f72e156307e service nova] Creating event network-changed:33f0bfc6-178a-46fc-8847-e0eba4780c8d for instance 88dd0811-9a13-45cf-9f56-30d0ef545da3 on n-h1-858384-13 Oct 18 14:09:26.732911 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-54142726-4b7c-4ace-bbfe-dcd627161d3e req-1413058e-0778-41ed-9e5d-3f72e156307e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055360 Oct 18 14:09:26.733910 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3457/6710] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:09:27.292023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4cdc6080-2753-4499-afa8-7994601122fe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:27.293544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4cdc6080-2753-4499-afa8-7994601122fe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:27.300940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cdc6080-2753-4499-afa8-7994601122fe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:27.301591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cdc6080-2753-4499-afa8-7994601122fe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:27.302026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cdc6080-2753-4499-afa8-7994601122fe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:27.302852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cdc6080-2753-4499-afa8-7994601122fe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:27.303307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cdc6080-2753-4499-afa8-7994601122fe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:27.303781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cdc6080-2753-4499-afa8-7994601122fe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:27.567759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4cdc6080-2753-4499-afa8-7994601122fe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:27.577804 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4cdc6080-2753-4499-afa8-7994601122fe tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1277 microversion: 2.1 time: 0.291799 Oct 18 14:09:27.578652 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3254/6711] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:27 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1277 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:28.603589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-71cf0817-1514-4fe1-af43-34b76bfe5c77 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:28.604656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-71cf0817-1514-4fe1-af43-34b76bfe5c77 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:28.611226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71cf0817-1514-4fe1-af43-34b76bfe5c77 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:28.611744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71cf0817-1514-4fe1-af43-34b76bfe5c77 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:28.612335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71cf0817-1514-4fe1-af43-34b76bfe5c77 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:28.612949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71cf0817-1514-4fe1-af43-34b76bfe5c77 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:28.613639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71cf0817-1514-4fe1-af43-34b76bfe5c77 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:28.614262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71cf0817-1514-4fe1-af43-34b76bfe5c77 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:28.757895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-71cf0817-1514-4fe1-af43-34b76bfe5c77 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:28.767206 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-71cf0817-1514-4fe1-af43-34b76bfe5c77 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1277 microversion: 2.1 time: 0.169130 Oct 18 14:09:28.767790 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3458/6712] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:28 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:29.795433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c69e0807-497d-41ee-91ac-48c212fce20c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:29.796474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c69e0807-497d-41ee-91ac-48c212fce20c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:29.805620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c69e0807-497d-41ee-91ac-48c212fce20c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:29.806553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c69e0807-497d-41ee-91ac-48c212fce20c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:29.807198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c69e0807-497d-41ee-91ac-48c212fce20c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:29.808046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c69e0807-497d-41ee-91ac-48c212fce20c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:29.808503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c69e0807-497d-41ee-91ac-48c212fce20c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:29.808934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c69e0807-497d-41ee-91ac-48c212fce20c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:29.996746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c69e0807-497d-41ee-91ac-48c212fce20c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:30.009553 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c69e0807-497d-41ee-91ac-48c212fce20c tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1277 microversion: 2.1 time: 0.220414 Oct 18 14:09:30.010859 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3255/6713] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:29 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:31.047455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4aa69aea-bcff-40b5-adef-eb4f6dcc29b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:31.048096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4aa69aea-bcff-40b5-adef-eb4f6dcc29b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:31.055661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aa69aea-bcff-40b5-adef-eb4f6dcc29b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:31.056680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aa69aea-bcff-40b5-adef-eb4f6dcc29b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:31.057129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aa69aea-bcff-40b5-adef-eb4f6dcc29b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:31.057895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aa69aea-bcff-40b5-adef-eb4f6dcc29b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:31.058384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aa69aea-bcff-40b5-adef-eb4f6dcc29b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:31.058874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4aa69aea-bcff-40b5-adef-eb4f6dcc29b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:31.238188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4aa69aea-bcff-40b5-adef-eb4f6dcc29b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:31.247245 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4aa69aea-bcff-40b5-adef-eb4f6dcc29b0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1265 microversion: 2.1 time: 0.205266 Oct 18 14:09:31.248087 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3459/6714] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:31 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:32.272248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8ea9f9c4-a37a-48b5-9ca9-5c1a0d69ed61 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:32.273010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8ea9f9c4-a37a-48b5-9ca9-5c1a0d69ed61 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:32.280338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ea9f9c4-a37a-48b5-9ca9-5c1a0d69ed61 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:32.280826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ea9f9c4-a37a-48b5-9ca9-5c1a0d69ed61 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:32.281369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ea9f9c4-a37a-48b5-9ca9-5c1a0d69ed61 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:32.282005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ea9f9c4-a37a-48b5-9ca9-5c1a0d69ed61 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:32.282449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ea9f9c4-a37a-48b5-9ca9-5c1a0d69ed61 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:32.282881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ea9f9c4-a37a-48b5-9ca9-5c1a0d69ed61 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:32.442307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8ea9f9c4-a37a-48b5-9ca9-5c1a0d69ed61 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:32.453073 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8ea9f9c4-a37a-48b5-9ca9-5c1a0d69ed61 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1265 microversion: 2.1 time: 0.184780 Oct 18 14:09:32.453855 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3256/6715] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:32 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:33.480314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5fe9a158-b548-4010-bd66-c107efbf9029 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:33.481123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5fe9a158-b548-4010-bd66-c107efbf9029 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:33.483986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:33.484682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:33.491408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe9a158-b548-4010-bd66-c107efbf9029 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:33.492084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe9a158-b548-4010-bd66-c107efbf9029 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:33.492677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe9a158-b548-4010-bd66-c107efbf9029 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:33.494290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe9a158-b548-4010-bd66-c107efbf9029 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:33.495209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe9a158-b548-4010-bd66-c107efbf9029 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:33.497228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5fe9a158-b548-4010-bd66-c107efbf9029 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:33.663293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5fe9a158-b548-4010-bd66-c107efbf9029 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:33.672804 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5fe9a158-b548-4010-bd66-c107efbf9029 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1265 microversion: 2.1 time: 0.197355 Oct 18 14:09:33.673328 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3460/6716] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:33 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:34.706933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fd7b7406-a83c-41e5-bfba-805c33afabc4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:34.707539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fd7b7406-a83c-41e5-bfba-805c33afabc4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:34.710579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:09:34.719824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd7b7406-a83c-41e5-bfba-805c33afabc4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:34.720669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd7b7406-a83c-41e5-bfba-805c33afabc4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:34.721366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd7b7406-a83c-41e5-bfba-805c33afabc4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:34.722412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd7b7406-a83c-41e5-bfba-805c33afabc4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:34.723030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd7b7406-a83c-41e5-bfba-805c33afabc4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:34.723595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fd7b7406-a83c-41e5-bfba-805c33afabc4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:34.874807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fd7b7406-a83c-41e5-bfba-805c33afabc4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:34.883509 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fd7b7406-a83c-41e5-bfba-805c33afabc4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1265 microversion: 2.1 time: 0.180742 Oct 18 14:09:34.884092 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3257/6717] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:34 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:09:35.918474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-72246e21-c046-455c-97ea-e4185652e8d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:35.919135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-72246e21-c046-455c-97ea-e4185652e8d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:35.926331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72246e21-c046-455c-97ea-e4185652e8d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:35.926835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72246e21-c046-455c-97ea-e4185652e8d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:35.927291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72246e21-c046-455c-97ea-e4185652e8d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:35.928005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72246e21-c046-455c-97ea-e4185652e8d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:35.928478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72246e21-c046-455c-97ea-e4185652e8d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:35.928925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72246e21-c046-455c-97ea-e4185652e8d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:36.083571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-72246e21-c046-455c-97ea-e4185652e8d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:36.092356 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-72246e21-c046-455c-97ea-e4185652e8d1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1265 microversion: 2.1 time: 0.178035 Oct 18 14:09:36.093444 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3461/6718] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:35 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:37.115489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e84bbc70-c357-457e-a115-618c736328eb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:37.116214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e84bbc70-c357-457e-a115-618c736328eb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:37.124742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e84bbc70-c357-457e-a115-618c736328eb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:37.125264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e84bbc70-c357-457e-a115-618c736328eb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:37.125728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e84bbc70-c357-457e-a115-618c736328eb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:37.126460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e84bbc70-c357-457e-a115-618c736328eb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:37.126883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e84bbc70-c357-457e-a115-618c736328eb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:37.127313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e84bbc70-c357-457e-a115-618c736328eb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:37.285190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e84bbc70-c357-457e-a115-618c736328eb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:37.293364 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e84bbc70-c357-457e-a115-618c736328eb tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1265 microversion: 2.1 time: 0.181900 Oct 18 14:09:37.293963 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3258/6719] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:37 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:09:38.316328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-707cfec8-3a3a-4297-b1dd-4b45ff2cbee4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:38.316955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-707cfec8-3a3a-4297-b1dd-4b45ff2cbee4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:38.324765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-707cfec8-3a3a-4297-b1dd-4b45ff2cbee4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:38.325302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-707cfec8-3a3a-4297-b1dd-4b45ff2cbee4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:38.325748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-707cfec8-3a3a-4297-b1dd-4b45ff2cbee4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:38.326468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-707cfec8-3a3a-4297-b1dd-4b45ff2cbee4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:38.326934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-707cfec8-3a3a-4297-b1dd-4b45ff2cbee4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:38.327372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-707cfec8-3a3a-4297-b1dd-4b45ff2cbee4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:38.469471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-707cfec8-3a3a-4297-b1dd-4b45ff2cbee4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:38.478007 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-707cfec8-3a3a-4297-b1dd-4b45ff2cbee4 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1265 microversion: 2.1 time: 0.165554 Oct 18 14:09:38.478813 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3462/6720] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:38 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:09:39.503886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7dcc394c-ae1f-4833-8375-8c47d3cc56dd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:39.504877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7dcc394c-ae1f-4833-8375-8c47d3cc56dd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:39.515413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7dcc394c-ae1f-4833-8375-8c47d3cc56dd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:39.516242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7dcc394c-ae1f-4833-8375-8c47d3cc56dd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:39.516975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7dcc394c-ae1f-4833-8375-8c47d3cc56dd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:39.517870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7dcc394c-ae1f-4833-8375-8c47d3cc56dd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:39.518327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7dcc394c-ae1f-4833-8375-8c47d3cc56dd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:39.518752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7dcc394c-ae1f-4833-8375-8c47d3cc56dd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:39.656387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7dcc394c-ae1f-4833-8375-8c47d3cc56dd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:39.664236 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7dcc394c-ae1f-4833-8375-8c47d3cc56dd tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1265 microversion: 2.1 time: 0.166697 Oct 18 14:09:39.664823 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3259/6721] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:39 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:40.687775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-06c06f33-b1f1-4108-b103-11c059080354 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:40.688481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-06c06f33-b1f1-4108-b103-11c059080354 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:40.695588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06c06f33-b1f1-4108-b103-11c059080354 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:40.696087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06c06f33-b1f1-4108-b103-11c059080354 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:40.696535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06c06f33-b1f1-4108-b103-11c059080354 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:40.697290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06c06f33-b1f1-4108-b103-11c059080354 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:40.697764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06c06f33-b1f1-4108-b103-11c059080354 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:40.698202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06c06f33-b1f1-4108-b103-11c059080354 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:40.841484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-06c06f33-b1f1-4108-b103-11c059080354 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:40.849319 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-06c06f33-b1f1-4108-b103-11c059080354 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1265 microversion: 2.1 time: 0.165696 Oct 18 14:09:40.849905 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3463/6722] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:40 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:41.873413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ef56ade2-769d-434e-8265-4e7e2024c4ec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:41.874043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ef56ade2-769d-434e-8265-4e7e2024c4ec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:41.881355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ef56ade2-769d-434e-8265-4e7e2024c4ec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:41.881846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ef56ade2-769d-434e-8265-4e7e2024c4ec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:41.882283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ef56ade2-769d-434e-8265-4e7e2024c4ec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:41.882993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ef56ade2-769d-434e-8265-4e7e2024c4ec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:41.883448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ef56ade2-769d-434e-8265-4e7e2024c4ec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:41.883877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ef56ade2-769d-434e-8265-4e7e2024c4ec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:42.032685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ef56ade2-769d-434e-8265-4e7e2024c4ec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:42.044452 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ef56ade2-769d-434e-8265-4e7e2024c4ec tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1265 microversion: 2.1 time: 0.175663 Oct 18 14:09:42.045327 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3260/6723] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:41 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:09:42.658931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1fee605c-407b-4ff5-98c0-373be5d5f4c6 req-0b025c03-751a-4529-8e40-764c92475cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88dd0811-9a13-45cf-9f56-30d0ef545da3", "name": "network-vif-plugged", "status": "completed", "tag": "33f0bfc6-178a-46fc-8847-e0eba4780c8d"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:42.668866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1fee605c-407b-4ff5-98c0-373be5d5f4c6 req-0b025c03-751a-4529-8e40-764c92475cf9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:42.669392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1fee605c-407b-4ff5-98c0-373be5d5f4c6 req-0b025c03-751a-4529-8e40-764c92475cf9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:42.669842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1fee605c-407b-4ff5-98c0-373be5d5f4c6 req-0b025c03-751a-4529-8e40-764c92475cf9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:42.681155 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1fee605c-407b-4ff5-98c0-373be5d5f4c6 req-0b025c03-751a-4529-8e40-764c92475cf9 service nova] Creating event network-vif-plugged:33f0bfc6-178a-46fc-8847-e0eba4780c8d for instance 88dd0811-9a13-45cf-9f56-30d0ef545da3 on n-h1-858384-13 Oct 18 14:09:42.686457 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1fee605c-407b-4ff5-98c0-373be5d5f4c6 req-0b025c03-751a-4529-8e40-764c92475cf9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183458 Oct 18 14:09:42.687064 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3464/6724] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:09:43.067887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-69a10087-e332-4920-9771-44c842772770 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:43.070424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-69a10087-e332-4920-9771-44c842772770 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:43.079622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69a10087-e332-4920-9771-44c842772770 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:43.080102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69a10087-e332-4920-9771-44c842772770 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:43.080531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69a10087-e332-4920-9771-44c842772770 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:43.081287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69a10087-e332-4920-9771-44c842772770 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:43.081922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69a10087-e332-4920-9771-44c842772770 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:43.082351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-69a10087-e332-4920-9771-44c842772770 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:43.254938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-69a10087-e332-4920-9771-44c842772770 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:43.264574 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-69a10087-e332-4920-9771-44c842772770 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1265 microversion: 2.1 time: 0.200628 Oct 18 14:09:43.265215 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3261/6725] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:43 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:44.296083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-446cb3a6-34d1-4d77-a1f5-46269f9c9c8d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:44.297067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-446cb3a6-34d1-4d77-a1f5-46269f9c9c8d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:44.305218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-446cb3a6-34d1-4d77-a1f5-46269f9c9c8d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:44.305874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-446cb3a6-34d1-4d77-a1f5-46269f9c9c8d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:44.306338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-446cb3a6-34d1-4d77-a1f5-46269f9c9c8d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:44.307091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-446cb3a6-34d1-4d77-a1f5-46269f9c9c8d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:44.307585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-446cb3a6-34d1-4d77-a1f5-46269f9c9c8d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:44.308036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-446cb3a6-34d1-4d77-a1f5-46269f9c9c8d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:44.472095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-446cb3a6-34d1-4d77-a1f5-46269f9c9c8d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:44.483377 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-446cb3a6-34d1-4d77-a1f5-46269f9c9c8d tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1451 microversion: 2.1 time: 0.194471 Oct 18 14:09:44.483965 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3465/6726] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:44 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1451 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:44.506266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad8f8fa1-09bb-40b4-adb2-66bad250b417 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:09:44.506887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ad8f8fa1-09bb-40b4-adb2-66bad250b417 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:09:44.514193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad8f8fa1-09bb-40b4-adb2-66bad250b417 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:44.514686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad8f8fa1-09bb-40b4-adb2-66bad250b417 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:44.515126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad8f8fa1-09bb-40b4-adb2-66bad250b417 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:44.515827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad8f8fa1-09bb-40b4-adb2-66bad250b417 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:44.516294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad8f8fa1-09bb-40b4-adb2-66bad250b417 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:44.516726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad8f8fa1-09bb-40b4-adb2-66bad250b417 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:44.656547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad8f8fa1-09bb-40b4-adb2-66bad250b417 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:09:44.664408 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad8f8fa1-09bb-40b4-adb2-66bad250b417 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1451 microversion: 2.1 time: 0.162127 Oct 18 14:09:44.664983 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3262/6727] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:09:44 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:09:46.670376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c250d536-d9ce-4c11-bb00-0ce8eeca690c req-e68fd690-13b9-480c-a721-025f2219a058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88dd0811-9a13-45cf-9f56-30d0ef545da3", "tag": "33f0bfc6-178a-46fc-8847-e0eba4780c8d"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:09:46.680292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c250d536-d9ce-4c11-bb00-0ce8eeca690c req-e68fd690-13b9-480c-a721-025f2219a058 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:09:46.680797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c250d536-d9ce-4c11-bb00-0ce8eeca690c req-e68fd690-13b9-480c-a721-025f2219a058 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:09:46.681481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c250d536-d9ce-4c11-bb00-0ce8eeca690c req-e68fd690-13b9-480c-a721-025f2219a058 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:09:46.704642 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c250d536-d9ce-4c11-bb00-0ce8eeca690c req-e68fd690-13b9-480c-a721-025f2219a058 service nova] Creating event network-changed:33f0bfc6-178a-46fc-8847-e0eba4780c8d for instance 88dd0811-9a13-45cf-9f56-30d0ef545da3 on n-h1-858384-13 Oct 18 14:09:46.710109 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c250d536-d9ce-4c11-bb00-0ce8eeca690c req-e68fd690-13b9-480c-a721-025f2219a058 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044999 Oct 18 14:09:46.710743 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3466/6728] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:11:18.407990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-83ba3095-3c27-4a64-b605-fe6d30caa9fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:18.409757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-83ba3095-3c27-4a64-b605-fe6d30caa9fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:18.411774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=24 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:18.413022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=60 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:18.413155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:18.415506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=56 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:11:18.422785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83ba3095-3c27-4a64-b605-fe6d30caa9fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:18.423265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83ba3095-3c27-4a64-b605-fe6d30caa9fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:18.423970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83ba3095-3c27-4a64-b605-fe6d30caa9fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:18.424738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83ba3095-3c27-4a64-b605-fe6d30caa9fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:18.425436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83ba3095-3c27-4a64-b605-fe6d30caa9fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:18.426073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-83ba3095-3c27-4a64-b605-fe6d30caa9fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:18.474484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-83ba3095-3c27-4a64-b605-fe6d30caa9fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:11:18.525402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-5e053397-55ce-43c8-8019-dd344cfa194a req-f80df4cb-cee9-4a4e-9c69-4e9e1404f67e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88dd0811-9a13-45cf-9f56-30d0ef545da3", "tag": "33f0bfc6-178a-46fc-8847-e0eba4780c8d"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:11:18.544723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5e053397-55ce-43c8-8019-dd344cfa194a req-f80df4cb-cee9-4a4e-9c69-4e9e1404f67e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:18.546004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5e053397-55ce-43c8-8019-dd344cfa194a req-f80df4cb-cee9-4a4e-9c69-4e9e1404f67e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:18.547072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5e053397-55ce-43c8-8019-dd344cfa194a req-f80df4cb-cee9-4a4e-9c69-4e9e1404f67e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:18.564307 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-5e053397-55ce-43c8-8019-dd344cfa194a req-f80df4cb-cee9-4a4e-9c69-4e9e1404f67e service nova] Creating event network-changed:33f0bfc6-178a-46fc-8847-e0eba4780c8d for instance 88dd0811-9a13-45cf-9f56-30d0ef545da3 on n-h1-858384-13 Oct 18 14:11:18.570759 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-5e053397-55ce-43c8-8019-dd344cfa194a req-f80df4cb-cee9-4a4e-9c69-4e9e1404f67e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166927 Oct 18 14:11:18.571756 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3467/6729] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:11:18.579232 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-83ba3095-3c27-4a64-b605-fe6d30caa9fa tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "DELETE /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 204 len: 0 microversion: 2.1 time: 0.177813 Oct 18 14:11:18.579871 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3263/6730] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:11:18 2022] DELETE /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:11:18.591174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bdcc19f6-7cd8-4f0c-a283-41ea688fd7fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:18.592034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bdcc19f6-7cd8-4f0c-a283-41ea688fd7fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:18.598710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdcc19f6-7cd8-4f0c-a283-41ea688fd7fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:18.599217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdcc19f6-7cd8-4f0c-a283-41ea688fd7fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:18.599669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdcc19f6-7cd8-4f0c-a283-41ea688fd7fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:18.600669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdcc19f6-7cd8-4f0c-a283-41ea688fd7fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:18.601155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdcc19f6-7cd8-4f0c-a283-41ea688fd7fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:18.601634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bdcc19f6-7cd8-4f0c-a283-41ea688fd7fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:18.750391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bdcc19f6-7cd8-4f0c-a283-41ea688fd7fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:18.764772 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bdcc19f6-7cd8-4f0c-a283-41ea688fd7fc tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1576 microversion: 2.1 time: 0.179150 Oct 18 14:11:18.765402 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3468/6731] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:18 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:19.793898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-565fcb6d-c286-4ebe-bda4-1e5131bec701 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:19.794613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-565fcb6d-c286-4ebe-bda4-1e5131bec701 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:19.802423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-565fcb6d-c286-4ebe-bda4-1e5131bec701 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:19.802920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-565fcb6d-c286-4ebe-bda4-1e5131bec701 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:19.803358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-565fcb6d-c286-4ebe-bda4-1e5131bec701 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:19.804577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-565fcb6d-c286-4ebe-bda4-1e5131bec701 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:19.805381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-565fcb6d-c286-4ebe-bda4-1e5131bec701 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:19.805381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-565fcb6d-c286-4ebe-bda4-1e5131bec701 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:20.004905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-565fcb6d-c286-4ebe-bda4-1e5131bec701 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:20.014200 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-565fcb6d-c286-4ebe-bda4-1e5131bec701 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1576 microversion: 2.1 time: 0.228224 Oct 18 14:11:20.014808 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3264/6732] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:19 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1576 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:21.040061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-20afbd30-a461-4aba-9cfe-f89d2daa2bd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:21.040828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-20afbd30-a461-4aba-9cfe-f89d2daa2bd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:21.049804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20afbd30-a461-4aba-9cfe-f89d2daa2bd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:21.050485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20afbd30-a461-4aba-9cfe-f89d2daa2bd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:21.051054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20afbd30-a461-4aba-9cfe-f89d2daa2bd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:21.051961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20afbd30-a461-4aba-9cfe-f89d2daa2bd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:21.052541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20afbd30-a461-4aba-9cfe-f89d2daa2bd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:21.053744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20afbd30-a461-4aba-9cfe-f89d2daa2bd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:21.210632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-20afbd30-a461-4aba-9cfe-f89d2daa2bd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:21.220306 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-20afbd30-a461-4aba-9cfe-f89d2daa2bd5 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1457 microversion: 2.1 time: 0.184867 Oct 18 14:11:21.222373 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3469/6733] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:21 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1457 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:21.315845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-aabe9792-31fe-4e6d-81ce-d8914e14a110 req-d443ba2a-d9a9-49d1-a0d3-1ab86b18fde2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88dd0811-9a13-45cf-9f56-30d0ef545da3", "name": "network-vif-deleted", "tag": "33f0bfc6-178a-46fc-8847-e0eba4780c8d"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:11:21.329726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-aabe9792-31fe-4e6d-81ce-d8914e14a110 req-d443ba2a-d9a9-49d1-a0d3-1ab86b18fde2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:21.330209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-aabe9792-31fe-4e6d-81ce-d8914e14a110 req-d443ba2a-d9a9-49d1-a0d3-1ab86b18fde2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:21.330643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-aabe9792-31fe-4e6d-81ce-d8914e14a110 req-d443ba2a-d9a9-49d1-a0d3-1ab86b18fde2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:21.346076 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-aabe9792-31fe-4e6d-81ce-d8914e14a110 req-d443ba2a-d9a9-49d1-a0d3-1ab86b18fde2 service nova] Creating event network-vif-deleted:33f0bfc6-178a-46fc-8847-e0eba4780c8d for instance 88dd0811-9a13-45cf-9f56-30d0ef545da3 on n-h1-858384-13 Oct 18 14:11:21.352832 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-aabe9792-31fe-4e6d-81ce-d8914e14a110 req-d443ba2a-d9a9-49d1-a0d3-1ab86b18fde2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040988 Oct 18 14:11:21.353560 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3265/6734] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:11:22.247781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-829ae7ac-ed39-4950-a917-eefab8b90aea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:22.248399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-829ae7ac-ed39-4950-a917-eefab8b90aea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:22.255092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-829ae7ac-ed39-4950-a917-eefab8b90aea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:22.255589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-829ae7ac-ed39-4950-a917-eefab8b90aea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:22.256558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-829ae7ac-ed39-4950-a917-eefab8b90aea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:22.257384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-829ae7ac-ed39-4950-a917-eefab8b90aea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:22.257769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-829ae7ac-ed39-4950-a917-eefab8b90aea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:22.258209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-829ae7ac-ed39-4950-a917-eefab8b90aea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:22.325459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-829ae7ac-ed39-4950-a917-eefab8b90aea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:22.335286 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-829ae7ac-ed39-4950-a917-eefab8b90aea tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1225 microversion: 2.1 time: 0.092191 Oct 18 14:11:22.335908 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3470/6735] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:22 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:23.359601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2a0561d1-a4d6-4bca-86d4-0d889a614c06 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:23.360317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2a0561d1-a4d6-4bca-86d4-0d889a614c06 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:23.368158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0561d1-a4d6-4bca-86d4-0d889a614c06 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:23.368652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0561d1-a4d6-4bca-86d4-0d889a614c06 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:23.369092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0561d1-a4d6-4bca-86d4-0d889a614c06 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:23.369847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0561d1-a4d6-4bca-86d4-0d889a614c06 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:23.370303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0561d1-a4d6-4bca-86d4-0d889a614c06 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:23.370730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2a0561d1-a4d6-4bca-86d4-0d889a614c06 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:23.439114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2a0561d1-a4d6-4bca-86d4-0d889a614c06 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:23.447473 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2a0561d1-a4d6-4bca-86d4-0d889a614c06 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1225 microversion: 2.1 time: 0.092283 Oct 18 14:11:23.448074 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3266/6736] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:23 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:24.472908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ad2335cf-a58e-4934-b5a3-095c8dc07252 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:24.473571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ad2335cf-a58e-4934-b5a3-095c8dc07252 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:24.481362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad2335cf-a58e-4934-b5a3-095c8dc07252 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:24.481873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad2335cf-a58e-4934-b5a3-095c8dc07252 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:24.482332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad2335cf-a58e-4934-b5a3-095c8dc07252 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:24.483055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad2335cf-a58e-4934-b5a3-095c8dc07252 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:24.483648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad2335cf-a58e-4934-b5a3-095c8dc07252 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:24.484130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad2335cf-a58e-4934-b5a3-095c8dc07252 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:24.551957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ad2335cf-a58e-4934-b5a3-095c8dc07252 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:24.561072 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ad2335cf-a58e-4934-b5a3-095c8dc07252 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1225 microversion: 2.1 time: 0.092142 Oct 18 14:11:24.561868 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3471/6737] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:24 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:25.587180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-00fea95a-400e-4a45-aa68-064061c66b66 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:25.588304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-00fea95a-400e-4a45-aa68-064061c66b66 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:25.597246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00fea95a-400e-4a45-aa68-064061c66b66 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:25.597981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00fea95a-400e-4a45-aa68-064061c66b66 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:25.598532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00fea95a-400e-4a45-aa68-064061c66b66 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:25.599390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00fea95a-400e-4a45-aa68-064061c66b66 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:25.600083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00fea95a-400e-4a45-aa68-064061c66b66 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:25.600603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00fea95a-400e-4a45-aa68-064061c66b66 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:25.675054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-00fea95a-400e-4a45-aa68-064061c66b66 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:25.684520 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-00fea95a-400e-4a45-aa68-064061c66b66 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 200 len: 1225 microversion: 2.1 time: 0.103717 Oct 18 14:11:25.685240 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3267/6738] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:25 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:26.715095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cdeaf519-2d95-4092-a600-d671915d130b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:26.715979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cdeaf519-2d95-4092-a600-d671915d130b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 88dd0811-9a13-45cf-9f56-30d0ef545da3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:26.723117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdeaf519-2d95-4092-a600-d671915d130b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:26.723622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdeaf519-2d95-4092-a600-d671915d130b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:26.724081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdeaf519-2d95-4092-a600-d671915d130b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:26.725417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdeaf519-2d95-4092-a600-d671915d130b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:26.725929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdeaf519-2d95-4092-a600-d671915d130b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:26.726369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdeaf519-2d95-4092-a600-d671915d130b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:26.740322 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-cdeaf519-2d95-4092-a600-d671915d130b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 88dd0811-9a13-45cf-9f56-30d0ef545da3 could not be found. Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cdeaf519-2d95-4092-a600-d671915d130b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 HTTP/1.1 Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 88dd0811-9a13-45cf-9f56-30d0ef545da3 could not be found. Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '88dd0811-9a13-45cf-9f56-30d0ef545da3'} Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88dd0811-9a13-45cf-9f56-30d0ef545da3 could not be found. Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88dd0811-9a13-45cf-9f56-30d0ef545da3 could not be found. Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:11:26.742179 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:11:26.746152 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:26.746152 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:11:26.746152 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:11:26.746152 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:11:26.746152 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:11:26.746152 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88dd0811-9a13-45cf-9f56-30d0ef545da3 could not be found. Oct 18 14:11:26.746152 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:11:26.746152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cdeaf519-2d95-4092-a600-d671915d130b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 88dd0811-9a13-45cf-9f56-30d0ef545da3 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:11:26.746152 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cdeaf519-2d95-4092-a600-d671915d130b tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3" status: 404 len: 111 microversion: 2.1 time: 0.032970 Oct 18 14:11:26.746152 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3472/6739] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:26 2022] GET /compute/v2.1/servers/88dd0811-9a13-45cf-9f56-30d0ef545da3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:11:33.070254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5123e2a0-3bc6-4076-91d6-86cce9b8b331 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:33.070807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5123e2a0-3bc6-4076-91d6-86cce9b8b331 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:33.072989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-27805cc8-ba30-4393-89a6-04a1e0367a66 req-2a8d97a1-b26d-4fe5-bd4f-6c99c38ad471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e45e7766-950f-423e-a0a0-a2add3c835e2", "tag": "1d97c0c3-aa7f-4940-ae78-d368c7b276e8"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:11:33.078828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5123e2a0-3bc6-4076-91d6-86cce9b8b331 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:33.079707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5123e2a0-3bc6-4076-91d6-86cce9b8b331 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:33.080148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5123e2a0-3bc6-4076-91d6-86cce9b8b331 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:33.081058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5123e2a0-3bc6-4076-91d6-86cce9b8b331 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:33.081684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5123e2a0-3bc6-4076-91d6-86cce9b8b331 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:33.082305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5123e2a0-3bc6-4076-91d6-86cce9b8b331 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:33.097663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-27805cc8-ba30-4393-89a6-04a1e0367a66 req-2a8d97a1-b26d-4fe5-bd4f-6c99c38ad471 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:33.098523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-27805cc8-ba30-4393-89a6-04a1e0367a66 req-2a8d97a1-b26d-4fe5-bd4f-6c99c38ad471 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:33.099298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-27805cc8-ba30-4393-89a6-04a1e0367a66 req-2a8d97a1-b26d-4fe5-bd4f-6c99c38ad471 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:33.111269 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-27805cc8-ba30-4393-89a6-04a1e0367a66 req-2a8d97a1-b26d-4fe5-bd4f-6c99c38ad471 service nova] Creating event network-changed:1d97c0c3-aa7f-4940-ae78-d368c7b276e8 for instance e45e7766-950f-423e-a0a0-a2add3c835e2 on n-h2-858384-13 Oct 18 14:11:33.112163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5123e2a0-3bc6-4076-91d6-86cce9b8b331 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:11:33.116999 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-27805cc8-ba30-4393-89a6-04a1e0367a66 req-2a8d97a1-b26d-4fe5-bd4f-6c99c38ad471 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048802 Oct 18 14:11:33.117970 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3473/6740] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:11:33.204576 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5123e2a0-3bc6-4076-91d6-86cce9b8b331 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 204 len: 0 microversion: 2.1 time: 0.138316 Oct 18 14:11:33.205273 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3268/6741] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:11:33 2022] DELETE /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:11:33.215699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a9985262-6904-4ab6-9efe-07e7d5948eb0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:33.216728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a9985262-6904-4ab6-9efe-07e7d5948eb0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:33.223377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9985262-6904-4ab6-9efe-07e7d5948eb0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:33.224130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9985262-6904-4ab6-9efe-07e7d5948eb0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:33.226579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9985262-6904-4ab6-9efe-07e7d5948eb0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:33.226579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9985262-6904-4ab6-9efe-07e7d5948eb0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:33.227109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9985262-6904-4ab6-9efe-07e7d5948eb0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:33.227765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9985262-6904-4ab6-9efe-07e7d5948eb0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:33.371083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a9985262-6904-4ab6-9efe-07e7d5948eb0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:33.379412 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a9985262-6904-4ab6-9efe-07e7d5948eb0 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1576 microversion: 2.1 time: 0.168155 Oct 18 14:11:33.384328 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3474/6742] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:33 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:34.404587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-713f31a8-75bb-456b-8466-6b006156e884 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:34.405315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-713f31a8-75bb-456b-8466-6b006156e884 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:34.413865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-713f31a8-75bb-456b-8466-6b006156e884 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:34.413865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-713f31a8-75bb-456b-8466-6b006156e884 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:34.414289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-713f31a8-75bb-456b-8466-6b006156e884 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:34.414968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-713f31a8-75bb-456b-8466-6b006156e884 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:34.415425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-713f31a8-75bb-456b-8466-6b006156e884 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:34.415858 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-713f31a8-75bb-456b-8466-6b006156e884 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:34.562550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-713f31a8-75bb-456b-8466-6b006156e884 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:34.572495 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-713f31a8-75bb-456b-8466-6b006156e884 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1576 microversion: 2.1 time: 0.171899 Oct 18 14:11:34.589442 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3269/6743] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:34 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:11:35.163836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8718c652-9f85-4c4d-9205-b09deab3c77a req-35e8f67d-f892-48f9-9f3e-67d1c07b4753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e45e7766-950f-423e-a0a0-a2add3c835e2", "name": "network-vif-deleted", "tag": "1d97c0c3-aa7f-4940-ae78-d368c7b276e8"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:11:35.174202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8718c652-9f85-4c4d-9205-b09deab3c77a req-35e8f67d-f892-48f9-9f3e-67d1c07b4753 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:35.174700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8718c652-9f85-4c4d-9205-b09deab3c77a req-35e8f67d-f892-48f9-9f3e-67d1c07b4753 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:35.175145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8718c652-9f85-4c4d-9205-b09deab3c77a req-35e8f67d-f892-48f9-9f3e-67d1c07b4753 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:35.188082 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8718c652-9f85-4c4d-9205-b09deab3c77a req-35e8f67d-f892-48f9-9f3e-67d1c07b4753 service nova] Creating event network-vif-deleted:1d97c0c3-aa7f-4940-ae78-d368c7b276e8 for instance e45e7766-950f-423e-a0a0-a2add3c835e2 on n-h2-858384-13 Oct 18 14:11:35.193488 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8718c652-9f85-4c4d-9205-b09deab3c77a req-35e8f67d-f892-48f9-9f3e-67d1c07b4753 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033939 Oct 18 14:11:35.194137 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3475/6744] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:11:35.598783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4b528d17-4ecc-460e-9f22-37e37ecef8a1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:35.600067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4b528d17-4ecc-460e-9f22-37e37ecef8a1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:35.606960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b528d17-4ecc-460e-9f22-37e37ecef8a1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:35.607445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b528d17-4ecc-460e-9f22-37e37ecef8a1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:35.607884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b528d17-4ecc-460e-9f22-37e37ecef8a1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:35.608580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b528d17-4ecc-460e-9f22-37e37ecef8a1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:35.609036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b528d17-4ecc-460e-9f22-37e37ecef8a1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:35.609496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b528d17-4ecc-460e-9f22-37e37ecef8a1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:35.682844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4b528d17-4ecc-460e-9f22-37e37ecef8a1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:35.691276 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4b528d17-4ecc-460e-9f22-37e37ecef8a1 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1225 microversion: 2.1 time: 0.096628 Oct 18 14:11:35.691930 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3270/6745] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:35 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:11:36.716938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-958084f8-e173-497a-9b98-f11a48d87b13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:36.718690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-958084f8-e173-497a-9b98-f11a48d87b13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:36.726221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-958084f8-e173-497a-9b98-f11a48d87b13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:36.726733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-958084f8-e173-497a-9b98-f11a48d87b13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:36.727194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-958084f8-e173-497a-9b98-f11a48d87b13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:36.727961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-958084f8-e173-497a-9b98-f11a48d87b13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:36.728439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-958084f8-e173-497a-9b98-f11a48d87b13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:36.728885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-958084f8-e173-497a-9b98-f11a48d87b13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:36.800049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-958084f8-e173-497a-9b98-f11a48d87b13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:36.809010 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-958084f8-e173-497a-9b98-f11a48d87b13 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1225 microversion: 2.1 time: 0.097127 Oct 18 14:11:36.809630 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3476/6746] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:36 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:37.832915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4397ba4b-f96a-4e7b-8717-47efa5262524 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:37.833552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4397ba4b-f96a-4e7b-8717-47efa5262524 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:37.840529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4397ba4b-f96a-4e7b-8717-47efa5262524 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:37.841005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4397ba4b-f96a-4e7b-8717-47efa5262524 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:37.841465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4397ba4b-f96a-4e7b-8717-47efa5262524 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:37.842148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4397ba4b-f96a-4e7b-8717-47efa5262524 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:37.842687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4397ba4b-f96a-4e7b-8717-47efa5262524 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:37.843192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4397ba4b-f96a-4e7b-8717-47efa5262524 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:37.908940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4397ba4b-f96a-4e7b-8717-47efa5262524 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:37.917571 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4397ba4b-f96a-4e7b-8717-47efa5262524 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1225 microversion: 2.1 time: 0.088711 Oct 18 14:11:37.918175 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3271/6747] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:37 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:38.940203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-183f84cb-9a30-47c1-9b07-daa9ac4f119f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:38.940818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-183f84cb-9a30-47c1-9b07-daa9ac4f119f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:38.953285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-183f84cb-9a30-47c1-9b07-daa9ac4f119f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:38.954421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-183f84cb-9a30-47c1-9b07-daa9ac4f119f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:38.954878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-183f84cb-9a30-47c1-9b07-daa9ac4f119f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:38.955802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-183f84cb-9a30-47c1-9b07-daa9ac4f119f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:38.956429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-183f84cb-9a30-47c1-9b07-daa9ac4f119f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:38.957034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-183f84cb-9a30-47c1-9b07-daa9ac4f119f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:39.023782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-183f84cb-9a30-47c1-9b07-daa9ac4f119f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d29125d80d146749096e754db7d84d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59688d82c8a54ebdbdbd360983b5e13c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:11:39.037520 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-183f84cb-9a30-47c1-9b07-daa9ac4f119f tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 200 len: 1225 microversion: 2.1 time: 0.101265 Oct 18 14:11:39.038608 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3477/6748] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:38 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:11:40.063261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea17062f-1440-429e-9a46-92de6e0eda01 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:40.063864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ea17062f-1440-429e-9a46-92de6e0eda01 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: e45e7766-950f-423e-a0a0-a2add3c835e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:40.070964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea17062f-1440-429e-9a46-92de6e0eda01 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:40.071564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea17062f-1440-429e-9a46-92de6e0eda01 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:40.072007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea17062f-1440-429e-9a46-92de6e0eda01 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:40.072759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea17062f-1440-429e-9a46-92de6e0eda01 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:40.073248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea17062f-1440-429e-9a46-92de6e0eda01 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:40.073680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea17062f-1440-429e-9a46-92de6e0eda01 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:40.088695 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-ea17062f-1440-429e-9a46-92de6e0eda01 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance e45e7766-950f-423e-a0a0-a2add3c835e2 could not be found. Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea17062f-1440-429e-9a46-92de6e0eda01 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 HTTP/1.1 Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance e45e7766-950f-423e-a0a0-a2add3c835e2 could not be found. Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'e45e7766-950f-423e-a0a0-a2add3c835e2'} Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e45e7766-950f-423e-a0a0-a2add3c835e2 could not be found. Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e45e7766-950f-423e-a0a0-a2add3c835e2 could not be found. Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:11:40.090511 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.095468 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:40.095468 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:11:40.095468 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:11:40.095468 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:11:40.095468 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:11:40.095468 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e45e7766-950f-423e-a0a0-a2add3c835e2 could not be found. Oct 18 14:11:40.095468 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.095468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea17062f-1440-429e-9a46-92de6e0eda01 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance e45e7766-950f-423e-a0a0-a2add3c835e2 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:11:40.095468 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ea17062f-1440-429e-9a46-92de6e0eda01 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2" status: 404 len: 111 microversion: 2.1 time: 0.032753 Oct 18 14:11:40.095468 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3272/6749] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:40 2022] GET /compute/v2.1/servers/e45e7766-950f-423e-a0a0-a2add3c835e2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:11:40.540812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e3ea93e-a624-4ab3-80ad-a0fb1312c76a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:40.541410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4e3ea93e-a624-4ab3-80ad-a0fb1312c76a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:40.548229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e3ea93e-a624-4ab3-80ad-a0fb1312c76a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:40.548731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e3ea93e-a624-4ab3-80ad-a0fb1312c76a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:40.549216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e3ea93e-a624-4ab3-80ad-a0fb1312c76a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:40.549917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e3ea93e-a624-4ab3-80ad-a0fb1312c76a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:40.550391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e3ea93e-a624-4ab3-80ad-a0fb1312c76a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:40.550832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e3ea93e-a624-4ab3-80ad-a0fb1312c76a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:40.564601 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-4e3ea93e-a624-4ab3-80ad-a0fb1312c76a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e3ea93e-a624-4ab3-80ad-a0fb1312c76a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 HTTP/1.1 Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '45e72811-100d-46d0-b8af-bcfc77d3cc91'} Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:11:40.566318 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e3ea93e-a624-4ab3-80ad-a0fb1312c76a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4e3ea93e-a624-4ab3-80ad-a0fb1312c76a tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "DELETE /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 404 len: 111 microversion: 2.1 time: 0.031479 Oct 18 14:11:40.570733 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3478/6750] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:11:40 2022] DELETE /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:11:40.577497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6e7104f5-0d2d-434a-b557-4562190862bf tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:40.578150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6e7104f5-0d2d-434a-b557-4562190862bf tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] [instance: 45e72811-100d-46d0-b8af-bcfc77d3cc91] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:11:40.585163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e7104f5-0d2d-434a-b557-4562190862bf tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:40.585679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e7104f5-0d2d-434a-b557-4562190862bf tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:40.586127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e7104f5-0d2d-434a-b557-4562190862bf tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:40.586852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e7104f5-0d2d-434a-b557-4562190862bf tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:11:40.587392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e7104f5-0d2d-434a-b557-4562190862bf tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:11:40.587825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6e7104f5-0d2d-434a-b557-4562190862bf tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:11:40.602440 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-6e7104f5-0d2d-434a-b557-4562190862bf tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] HTTP exception thrown: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6e7104f5-0d2d-434a-b557-4562190862bf tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Request method failure captured: Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 HTTP/1.1 Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrGMAo1Bcf21R6cy5yhWNahiL207spDpNQsnBMjoh1jbeSdsBCeoHh828hpPu2u6o-gNQwk7DWuWi6fdEgASzhdBewzrEcP6RBHbkih7oGNyBGzk_GmHBpJAZ5LfZw-4FR_mEmmCdSgenyMqKHZQ9OCtbLp-fDOX82ypl2Q-kkc0n1k Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/59688d82c8a54ebdbdbd360983b5e13c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_59688d82c8a54ebdbdbd360983b5e13c"}]}] Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestVolumeBootPattern-108448651 Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 59688d82c8a54ebdbdbd360983b5e13c Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestVolumeBootPattern-108448651 Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 1d29125d80d146749096e754db7d84d4 Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestVolumeBootPattern-108448651-project Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '45e72811-100d-46d0-b8af-bcfc77d3cc91'} Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:11:40.604087 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.608494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:11:40.608494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:11:40.608494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:11:40.608494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:11:40.608494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:11:40.608494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. Oct 18 14:11:40.608494 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:11:40.608494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6e7104f5-0d2d-434a-b557-4562190862bf tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Returning 404 to user: Instance 45e72811-100d-46d0-b8af-bcfc77d3cc91 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:11:40.608494 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6e7104f5-0d2d-434a-b557-4562190862bf tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91" status: 404 len: 111 microversion: 2.1 time: 0.032075 Oct 18 14:11:40.608494 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3273/6751] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:11:40 2022] GET /compute/v2.1/servers/45e72811-100d-46d0-b8af-bcfc77d3cc91 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:11:44.030613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bbe6d21c-5b14-4bda-928f-80cc3d9f0144 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] Calling method '.version_select at 0x7ff617ba3f70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:11:44.070055 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bbe6d21c-5b14-4bda-928f-80cc3d9f0144 tempest-TestVolumeBootPattern-108448651 tempest-TestVolumeBootPattern-108448651-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1682685967" status: 202 len: 0 microversion: 2.1 time: 0.044000 Oct 18 14:11:44.070676 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3479/6752] 10.222.0.40 () {58 vars in 1263 bytes} [Tue Oct 18 14:11:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1682685967 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:12:03.083019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:03.083777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:03.200121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-694789016", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:03.253238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] validate_networks() for None {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:12:03.809169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:12:03.809624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:12:03.810102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:12:03.810509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:12:03.810924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:12:03.820984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:03.821564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:03.822001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:03.822722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:03.823178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:03.823602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:03.840605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Getting quotas for project 62430d3fe1c74063b5608f6cb382442e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:12:03.845880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Getting quotas for user 607097f134b349acb31017bc03e52e16 and project 62430d3fe1c74063b5608f6cb382442e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:12:03.858622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:12:03.860942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:12:03.906953 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ddc5ecbc-40bb-4e40-a629-1ff679629975 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829622 Oct 18 14:12:03.907610 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3274/6753] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:12:03.920553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4958b026-ac5d-4907-9c22-4b9cb6dcfba4 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:03.921203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4958b026-ac5d-4907-9c22-4b9cb6dcfba4 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:03.924255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=52 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:03.925158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:03.980810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4958b026-ac5d-4907-9c22-4b9cb6dcfba4 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:03.987932 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4958b026-ac5d-4907-9c22-4b9cb6dcfba4 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1221 microversion: 2.1 time: 0.071447 Oct 18 14:12:03.988512 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3480/6754] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:03 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1221 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:05.012623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ff0360eb-4e3b-42e4-a9cf-d8bd1d2809c5 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:05.013152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ff0360eb-4e3b-42e4-a9cf-d8bd1d2809c5 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:05.020252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff0360eb-4e3b-42e4-a9cf-d8bd1d2809c5 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:05.020921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff0360eb-4e3b-42e4-a9cf-d8bd1d2809c5 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:05.021407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff0360eb-4e3b-42e4-a9cf-d8bd1d2809c5 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:05.022386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff0360eb-4e3b-42e4-a9cf-d8bd1d2809c5 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:05.022916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff0360eb-4e3b-42e4-a9cf-d8bd1d2809c5 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:05.023345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff0360eb-4e3b-42e4-a9cf-d8bd1d2809c5 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:05.094449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ff0360eb-4e3b-42e4-a9cf-d8bd1d2809c5 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:05.105369 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ff0360eb-4e3b-42e4-a9cf-d8bd1d2809c5 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1273 microversion: 2.1 time: 0.097514 Oct 18 14:12:05.113246 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3275/6755] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:05 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:06.129645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5e840798-62cc-4f7b-a244-1514f4286552 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:06.130517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e840798-62cc-4f7b-a244-1514f4286552 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:06.137881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e840798-62cc-4f7b-a244-1514f4286552 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:06.138496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e840798-62cc-4f7b-a244-1514f4286552 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:06.139023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e840798-62cc-4f7b-a244-1514f4286552 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:06.140029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e840798-62cc-4f7b-a244-1514f4286552 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:06.140702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e840798-62cc-4f7b-a244-1514f4286552 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:06.141244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e840798-62cc-4f7b-a244-1514f4286552 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:06.275055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5e840798-62cc-4f7b-a244-1514f4286552 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:06.282996 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5e840798-62cc-4f7b-a244-1514f4286552 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1321 microversion: 2.1 time: 0.157271 Oct 18 14:12:06.283890 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3481/6756] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:06 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:06.689796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b71b639b-614c-4226-b405-e9c348896873 req-f9f52996-e02a-402e-8085-750a8246e824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a51d88d9-d28a-4e6f-a90f-bab038567251", "tag": "3ca83760-2614-4619-9e25-c2bb20d87fe9"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:06.711526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b71b639b-614c-4226-b405-e9c348896873 req-f9f52996-e02a-402e-8085-750a8246e824 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:06.712014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b71b639b-614c-4226-b405-e9c348896873 req-f9f52996-e02a-402e-8085-750a8246e824 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:06.712455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b71b639b-614c-4226-b405-e9c348896873 req-f9f52996-e02a-402e-8085-750a8246e824 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:06.725372 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b71b639b-614c-4226-b405-e9c348896873 req-f9f52996-e02a-402e-8085-750a8246e824 service nova] Creating event network-changed:3ca83760-2614-4619-9e25-c2bb20d87fe9 for instance a51d88d9-d28a-4e6f-a90f-bab038567251 on n-h1-858384-13 Oct 18 14:12:06.731683 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b71b639b-614c-4226-b405-e9c348896873 req-f9f52996-e02a-402e-8085-750a8246e824 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045482 Oct 18 14:12:06.732650 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3276/6757] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:12:07.308007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2732a9b5-35f1-4ade-80c2-858af0f3ffef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:07.308643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2732a9b5-35f1-4ade-80c2-858af0f3ffef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:07.315692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2732a9b5-35f1-4ade-80c2-858af0f3ffef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:07.316197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2732a9b5-35f1-4ade-80c2-858af0f3ffef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:07.316657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2732a9b5-35f1-4ade-80c2-858af0f3ffef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:07.317416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2732a9b5-35f1-4ade-80c2-858af0f3ffef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:07.317896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2732a9b5-35f1-4ade-80c2-858af0f3ffef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:07.318342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2732a9b5-35f1-4ade-80c2-858af0f3ffef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:07.453845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2732a9b5-35f1-4ade-80c2-858af0f3ffef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:07.462070 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2732a9b5-35f1-4ade-80c2-858af0f3ffef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1321 microversion: 2.1 time: 0.158954 Oct 18 14:12:07.462881 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3482/6758] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:07 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:08.487249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-60b1957e-73b3-414c-b812-7d54a62db9ef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:08.487837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-60b1957e-73b3-414c-b812-7d54a62db9ef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:08.494746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60b1957e-73b3-414c-b812-7d54a62db9ef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:08.495219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60b1957e-73b3-414c-b812-7d54a62db9ef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:08.495653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60b1957e-73b3-414c-b812-7d54a62db9ef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:08.496334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60b1957e-73b3-414c-b812-7d54a62db9ef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:08.496782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60b1957e-73b3-414c-b812-7d54a62db9ef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:08.497223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-60b1957e-73b3-414c-b812-7d54a62db9ef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:08.634755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-60b1957e-73b3-414c-b812-7d54a62db9ef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:08.642513 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-60b1957e-73b3-414c-b812-7d54a62db9ef tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1321 microversion: 2.1 time: 0.160529 Oct 18 14:12:08.643085 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3277/6759] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:08 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:09.665858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-82f2d06e-f055-4223-9ca9-225f25751ea0 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:09.666505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-82f2d06e-f055-4223-9ca9-225f25751ea0 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:09.673448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82f2d06e-f055-4223-9ca9-225f25751ea0 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:09.673956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82f2d06e-f055-4223-9ca9-225f25751ea0 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:09.674416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82f2d06e-f055-4223-9ca9-225f25751ea0 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:09.675136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82f2d06e-f055-4223-9ca9-225f25751ea0 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:09.675618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82f2d06e-f055-4223-9ca9-225f25751ea0 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:09.676069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82f2d06e-f055-4223-9ca9-225f25751ea0 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:09.812723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-82f2d06e-f055-4223-9ca9-225f25751ea0 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:09.821413 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-82f2d06e-f055-4223-9ca9-225f25751ea0 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1321 microversion: 2.1 time: 0.159693 Oct 18 14:12:09.822004 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3483/6760] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:09 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:10.844958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8d64d0c7-1a63-419b-9a8b-b3e22a74a9dd tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:10.845607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8d64d0c7-1a63-419b-9a8b-b3e22a74a9dd tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:10.853538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d64d0c7-1a63-419b-9a8b-b3e22a74a9dd tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:10.854020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d64d0c7-1a63-419b-9a8b-b3e22a74a9dd tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:10.854458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d64d0c7-1a63-419b-9a8b-b3e22a74a9dd tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:10.855151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d64d0c7-1a63-419b-9a8b-b3e22a74a9dd tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:10.855611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d64d0c7-1a63-419b-9a8b-b3e22a74a9dd tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:10.856032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d64d0c7-1a63-419b-9a8b-b3e22a74a9dd tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:10.987810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8d64d0c7-1a63-419b-9a8b-b3e22a74a9dd tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:10.995823 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8d64d0c7-1a63-419b-9a8b-b3e22a74a9dd tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1321 microversion: 2.1 time: 0.155466 Oct 18 14:12:10.996401 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3278/6761] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:10 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:12.019996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6ca35c2c-995a-4cbb-b64d-24a464426339 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:12.020632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6ca35c2c-995a-4cbb-b64d-24a464426339 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:12.028346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ca35c2c-995a-4cbb-b64d-24a464426339 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:12.028856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ca35c2c-995a-4cbb-b64d-24a464426339 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:12.029356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ca35c2c-995a-4cbb-b64d-24a464426339 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:12.030079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ca35c2c-995a-4cbb-b64d-24a464426339 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:12.030558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ca35c2c-995a-4cbb-b64d-24a464426339 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:12.031006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ca35c2c-995a-4cbb-b64d-24a464426339 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:12.164913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ca35c2c-995a-4cbb-b64d-24a464426339 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:12.172815 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6ca35c2c-995a-4cbb-b64d-24a464426339 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1321 microversion: 2.1 time: 0.156737 Oct 18 14:12:12.173452 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3484/6762] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:12 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:13.195708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a3c8bac3-2119-4f5a-bbc3-188163560e14 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:13.196334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a3c8bac3-2119-4f5a-bbc3-188163560e14 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:13.203193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3c8bac3-2119-4f5a-bbc3-188163560e14 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:13.203666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3c8bac3-2119-4f5a-bbc3-188163560e14 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:13.204095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3c8bac3-2119-4f5a-bbc3-188163560e14 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:13.205026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3c8bac3-2119-4f5a-bbc3-188163560e14 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:13.205491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3c8bac3-2119-4f5a-bbc3-188163560e14 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:13.205911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a3c8bac3-2119-4f5a-bbc3-188163560e14 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:13.347129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a3c8bac3-2119-4f5a-bbc3-188163560e14 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:13.355918 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a3c8bac3-2119-4f5a-bbc3-188163560e14 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1321 microversion: 2.1 time: 0.164071 Oct 18 14:12:13.356451 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3279/6763] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:13 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:13.406470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8a8db3be-2a3b-4f3a-a7eb-cc592baeabf7 req-2cccaa30-6945-4a8f-9dab-7873d721e984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51d88d9-d28a-4e6f-a90f-bab038567251", "name": "network-vif-plugged", "status": "completed", "tag": "3ca83760-2614-4619-9e25-c2bb20d87fe9"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:13.419232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8a8db3be-2a3b-4f3a-a7eb-cc592baeabf7 req-2cccaa30-6945-4a8f-9dab-7873d721e984 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:13.419734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8a8db3be-2a3b-4f3a-a7eb-cc592baeabf7 req-2cccaa30-6945-4a8f-9dab-7873d721e984 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:13.420189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8a8db3be-2a3b-4f3a-a7eb-cc592baeabf7 req-2cccaa30-6945-4a8f-9dab-7873d721e984 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:13.432494 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8a8db3be-2a3b-4f3a-a7eb-cc592baeabf7 req-2cccaa30-6945-4a8f-9dab-7873d721e984 service nova] Creating event network-vif-plugged:3ca83760-2614-4619-9e25-c2bb20d87fe9 for instance a51d88d9-d28a-4e6f-a90f-bab038567251 on n-h1-858384-13 Oct 18 14:12:13.437635 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8a8db3be-2a3b-4f3a-a7eb-cc592baeabf7 req-2cccaa30-6945-4a8f-9dab-7873d721e984 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034976 Oct 18 14:12:13.438421 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3485/6764] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:12:14.380231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-14896cfe-5258-41bc-b416-f68e23595420 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:14.380770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-14896cfe-5258-41bc-b416-f68e23595420 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:14.384008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:14.384777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:14.391800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14896cfe-5258-41bc-b416-f68e23595420 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:14.392274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14896cfe-5258-41bc-b416-f68e23595420 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:14.392704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14896cfe-5258-41bc-b416-f68e23595420 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:14.393417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14896cfe-5258-41bc-b416-f68e23595420 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:14.393866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14896cfe-5258-41bc-b416-f68e23595420 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:14.394280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14896cfe-5258-41bc-b416-f68e23595420 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:14.528105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-14896cfe-5258-41bc-b416-f68e23595420 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:14.535882 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-14896cfe-5258-41bc-b416-f68e23595420 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1321 microversion: 2.1 time: 0.160209 Oct 18 14:12:14.536465 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3280/6765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:14 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:15.556137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:15.561288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3b93e21f-5aae-40ba-8e17-07b2f5023515 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:15.562034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3b93e21f-5aae-40ba-8e17-07b2f5023515 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:15.568576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b93e21f-5aae-40ba-8e17-07b2f5023515 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:15.569073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b93e21f-5aae-40ba-8e17-07b2f5023515 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:15.570539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b93e21f-5aae-40ba-8e17-07b2f5023515 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:15.571118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b93e21f-5aae-40ba-8e17-07b2f5023515 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:15.571650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b93e21f-5aae-40ba-8e17-07b2f5023515 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:15.572043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3b93e21f-5aae-40ba-8e17-07b2f5023515 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:15.766713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3b93e21f-5aae-40ba-8e17-07b2f5023515 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:15.775277 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3b93e21f-5aae-40ba-8e17-07b2f5023515 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1470 microversion: 2.1 time: 0.220172 Oct 18 14:12:15.775858 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3486/6766] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:15 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1470 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:15.853994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a81d766f-a78f-412b-bd24-ce70cb0fe2ae tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Calling method '.version_select at 0x7ff60e6f8670>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:15.919574 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a81d766f-a78f-412b-bd24-ce70cb0fe2ae tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/a4e14decae884285bb6e68cee9524ebe" status: 200 len: 371 microversion: 2.1 time: 0.123646 Oct 18 14:12:15.920164 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3281/6767] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 18 14:12:15 2022] GET /compute/v2.1/os-quota-sets/a4e14decae884285bb6e68cee9524ebe => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:12:15.932859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2938d16a-2a63-4b9c-92d1-36f88d556fe8 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1492737035", "id": 916194827, "os-flavor-access:is_public": "True"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:15.951516 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2938d16a-2a63-4b9c-92d1-36f88d556fe8 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022992 Oct 18 14:12:15.952097 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3487/6768] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:12:15 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:12:15.965379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "916194827"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:15.967635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:15.973616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:15.974099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:15.974526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:15.975207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:15.975676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:15.976187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:16.112049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f5fbade8460a4b51abcd3cb186f69f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e14decae884285bb6e68cee9524ebe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:16.119181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1492737035 {{(pid=120612) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:12:16.126034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:16.126508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:16.126936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:16.127684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:16.128132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:16.128556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:16.150926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Getting quotas for project 62430d3fe1c74063b5608f6cb382442e. Resources: {'ram', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:12:16.155967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Getting quotas for user 607097f134b349acb31017bc03e52e16 and project 62430d3fe1c74063b5608f6cb382442e. Resources: {'ram', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:12:16.168715 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.compute.api [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] ram quota exceeded for a4e14decae884285bb6e68cee9524ebe, tried to resize instance. Oct 18 14:12:16.169279 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Request method failure captured: Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251/action HTTP/1.1 Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 38 Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrQyTXJ5hUQuHJpkvFDbNGaYmqjP-Q5ys-rXe4j7uTR9QT1UuCKkXGKjpvwevzoSAp-DpVOps7V8x0x6hZaBwzem_hFAUTnFy_L2BQro2mRyu4JW_DYZ7C7gm2r4E9aKYOSpGZoGAaM1pJH8i6Mh6NIasAYSHJUzLmCw5Pc7t370Rrw Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a4e14decae884285bb6e68cee9524ebe Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1310556618 Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Role: admin,member,reader Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: admin,member,reader Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4e14decae884285bb6e68cee9524ebe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a4e14decae884285bb6e68cee9524ebe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4e14decae884285bb6e68cee9524ebe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a4e14decae884285bb6e68cee9524ebe"}]}] Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1310556618 Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a4e14decae884285bb6e68cee9524ebe Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1310556618 Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersAdminNegativeTestJSON-1310556618-project-admin Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: f5fbade8460a4b51abcd3cb186f69f8a Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1310556618-project-admin Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: {"resize": {"flavorRef": "916194827"}} Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'a51d88d9-d28a-4e6f-a90f-bab038567251', 'body': {'resize': {'flavorRef': '916194827'}}} Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:12:16.171310 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-38283e4d-4e10-47e7-9afa-13a2997a65c3 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251/action" status: 403 len: 118 microversion: 2.1 time: 0.211489 Oct 18 14:12:16.176033 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3282/6769] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:12:15 2022] POST /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251/action => generated 118 bytes in 213 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:12:16.182387 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cbfb3248-6695-420f-8b8f-4c776b66e3ad tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:16.199578 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cbfb3248-6695-420f-8b8f-4c776b66e3ad tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/916194827" status: 202 len: 0 microversion: 2.1 time: 0.021585 Oct 18 14:12:16.200150 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3488/6770] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 14:12:16 2022] DELETE /compute/v2.1/flavors/916194827 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:12:16.208258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-523d868a-45cc-4701-a299-3240620f9fd4 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:16.228698 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-523d868a-45cc-4701-a299-3240620f9fd4 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024302 Oct 18 14:12:16.229452 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3283/6771] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 14:12:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:12:16.250367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-35fd8169-414c-4dd8-a5ee-a47a4553d57c tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Calling method '.version_select at 0x7ff60c2923a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:16.325672 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-35fd8169-414c-4dd8-a5ee-a47a4553d57c tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/a4e14decae884285bb6e68cee9524ebe" status: 200 len: 371 microversion: 2.1 time: 0.078987 Oct 18 14:12:16.326258 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3489/6772] 10.222.0.40 () {58 vars in 1242 bytes} [Tue Oct 18 14:12:16 2022] GET /compute/v2.1/os-quota-sets/a4e14decae884285bb6e68cee9524ebe => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:12:16.338853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-603e5b64-5842-4837-8e81-584ec3a49d0b tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1182292166", "id": 412891563, "os-flavor-access:is_public": "True"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:16.357022 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-603e5b64-5842-4837-8e81-584ec3a49d0b tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.022092 Oct 18 14:12:16.357649 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3284/6773] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:12:16 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:12:16.370173 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "412891563"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:16.372504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:16.378520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:16.379015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:16.379464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:16.380175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:16.380638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:16.381079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:16.471355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f5fbade8460a4b51abcd3cb186f69f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e14decae884285bb6e68cee9524ebe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:16.477910 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1182292166 {{(pid=120611) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:12:16.484609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:16.485021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:16.485493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:16.486228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:16.486688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:16.487122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:16.507629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Getting quotas for project 62430d3fe1c74063b5608f6cb382442e. Resources: {'ram', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:12:16.512647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Getting quotas for user 607097f134b349acb31017bc03e52e16 and project 62430d3fe1c74063b5608f6cb382442e. Resources: {'ram', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:12:16.525382 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.compute.api [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] cores quota exceeded for a4e14decae884285bb6e68cee9524ebe, tried to resize instance. Oct 18 14:12:16.525936 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Request method failure captured: Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251/action HTTP/1.1 Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 38 Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrQyTXJ5hUQuHJpkvFDbNGaYmqjP-Q5ys-rXe4j7uTR9QT1UuCKkXGKjpvwevzoSAp-DpVOps7V8x0x6hZaBwzem_hFAUTnFy_L2BQro2mRyu4JW_DYZ7C7gm2r4E9aKYOSpGZoGAaM1pJH8i6Mh6NIasAYSHJUzLmCw5Pc7t370Rrw Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: a4e14decae884285bb6e68cee9524ebe Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1310556618 Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Role: admin,member,reader Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: admin,member,reader Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4e14decae884285bb6e68cee9524ebe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a4e14decae884285bb6e68cee9524ebe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4e14decae884285bb6e68cee9524ebe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a4e14decae884285bb6e68cee9524ebe"}]}] Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1310556618 Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: a4e14decae884285bb6e68cee9524ebe Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1310556618 Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersAdminNegativeTestJSON-1310556618-project-admin Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: f5fbade8460a4b51abcd3cb186f69f8a Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1310556618-project-admin Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: {"resize": {"flavorRef": "412891563"}} Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'a51d88d9-d28a-4e6f-a90f-bab038567251', 'body': {'resize': {'flavorRef': '412891563'}}} Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:12:16.528018 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f09a7f12-bfd6-43a2-9b14-7a1b771d6713 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251/action" status: 403 len: 113 microversion: 2.1 time: 0.163666 Oct 18 14:12:16.532275 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3490/6774] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:12:16 2022] POST /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251/action => generated 113 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:12:16.539082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9f3f8087-f815-45a3-a0d8-0b1d1a42daf0 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:16.559912 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9f3f8087-f815-45a3-a0d8-0b1d1a42daf0 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/412891563" status: 202 len: 0 microversion: 2.1 time: 0.025194 Oct 18 14:12:16.560980 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3285/6775] 10.222.0.40 () {58 vars in 1158 bytes} [Tue Oct 18 14:12:16 2022] DELETE /compute/v2.1/flavors/412891563 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:12:16.570035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3b68b686-6928-4eb2-a493-c29427edac45 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:16.591548 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3b68b686-6928-4eb2-a493-c29427edac45 tempest-ServersAdminNegativeTestJSON-1310556618 tempest-ServersAdminNegativeTestJSON-1310556618-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026337 Oct 18 14:12:16.592136 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3491/6776] 10.222.0.40 () {58 vars in 1146 bytes} [Tue Oct 18 14:12:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:16.614002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2db269bb-8e40-419b-9db1-2fa9089f5eb1 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:16.614614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2db269bb-8e40-419b-9db1-2fa9089f5eb1 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:16.621681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2db269bb-8e40-419b-9db1-2fa9089f5eb1 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:16.622254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2db269bb-8e40-419b-9db1-2fa9089f5eb1 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:16.622765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2db269bb-8e40-419b-9db1-2fa9089f5eb1 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:16.623559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2db269bb-8e40-419b-9db1-2fa9089f5eb1 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:16.624086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2db269bb-8e40-419b-9db1-2fa9089f5eb1 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:16.624516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2db269bb-8e40-419b-9db1-2fa9089f5eb1 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:16.655507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2db269bb-8e40-419b-9db1-2fa9089f5eb1 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:12:16.744055 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2db269bb-8e40-419b-9db1-2fa9089f5eb1 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 204 len: 0 microversion: 2.1 time: 0.133899 Oct 18 14:12:16.747868 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3286/6777] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:12:16 2022] DELETE /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:12:16.754065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a274b323-18af-4bac-8ac1-3070ef2e71e2 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:16.754778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a274b323-18af-4bac-8ac1-3070ef2e71e2 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:16.762124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a274b323-18af-4bac-8ac1-3070ef2e71e2 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:16.762747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a274b323-18af-4bac-8ac1-3070ef2e71e2 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:16.763311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a274b323-18af-4bac-8ac1-3070ef2e71e2 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:16.764403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a274b323-18af-4bac-8ac1-3070ef2e71e2 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:16.764983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a274b323-18af-4bac-8ac1-3070ef2e71e2 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:16.765524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a274b323-18af-4bac-8ac1-3070ef2e71e2 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:16.899948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a274b323-18af-4bac-8ac1-3070ef2e71e2 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:16.907821 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a274b323-18af-4bac-8ac1-3070ef2e71e2 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1476 microversion: 2.1 time: 0.158292 Oct 18 14:12:16.908403 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3492/6778] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:16 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1476 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:17.932428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dcdea41f-00ea-44ec-a5b4-cd93efad9191 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:17.933805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dcdea41f-00ea-44ec-a5b4-cd93efad9191 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:17.940832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcdea41f-00ea-44ec-a5b4-cd93efad9191 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:17.941347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcdea41f-00ea-44ec-a5b4-cd93efad9191 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:17.941780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcdea41f-00ea-44ec-a5b4-cd93efad9191 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:17.942461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcdea41f-00ea-44ec-a5b4-cd93efad9191 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:17.942906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcdea41f-00ea-44ec-a5b4-cd93efad9191 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:17.943332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dcdea41f-00ea-44ec-a5b4-cd93efad9191 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:18.134415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dcdea41f-00ea-44ec-a5b4-cd93efad9191 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:18.142692 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dcdea41f-00ea-44ec-a5b4-cd93efad9191 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1476 microversion: 2.1 time: 0.214452 Oct 18 14:12:18.143285 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3287/6779] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:17 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1476 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:18.777715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-47f25505-8267-4fa9-9301-b59eac3c264e req-1d26fa3e-807a-4a32-ba79-9b066a373e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51d88d9-d28a-4e6f-a90f-bab038567251", "name": "network-vif-deleted", "tag": "3ca83760-2614-4619-9e25-c2bb20d87fe9"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:18.790421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-47f25505-8267-4fa9-9301-b59eac3c264e req-1d26fa3e-807a-4a32-ba79-9b066a373e31 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:18.791050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-47f25505-8267-4fa9-9301-b59eac3c264e req-1d26fa3e-807a-4a32-ba79-9b066a373e31 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:18.791568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-47f25505-8267-4fa9-9301-b59eac3c264e req-1d26fa3e-807a-4a32-ba79-9b066a373e31 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:18.808229 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-47f25505-8267-4fa9-9301-b59eac3c264e req-1d26fa3e-807a-4a32-ba79-9b066a373e31 service nova] Creating event network-vif-deleted:3ca83760-2614-4619-9e25-c2bb20d87fe9 for instance a51d88d9-d28a-4e6f-a90f-bab038567251 on n-h1-858384-13 Oct 18 14:12:18.814063 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-47f25505-8267-4fa9-9301-b59eac3c264e req-1d26fa3e-807a-4a32-ba79-9b066a373e31 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040986 Oct 18 14:12:18.814868 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3493/6780] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:12:19.166892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:19.167964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:19.175651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:19.176137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:19.176593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:19.177433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:19.177896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:19.178325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:19.220978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:19.221404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:19.221838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:19.222291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lazy-loading 'fault' on Instance uuid a51d88d9-d28a-4e6f-a90f-bab038567251 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:12:19.269551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607097f134b349acb31017bc03e52e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62430d3fe1c74063b5608f6cb382442e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:19.279108 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b7af4f35-9664-48c9-b424-d8e35a1e1d51 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 200 len: 1311 microversion: 2.1 time: 0.117012 Oct 18 14:12:19.279707 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3288/6781] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:19 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 1311 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:20.304288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-37df17db-f38b-495f-a838-c84d22c12d82 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:20.305000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-37df17db-f38b-495f-a838-c84d22c12d82 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] [instance: a51d88d9-d28a-4e6f-a90f-bab038567251] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:20.311250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37df17db-f38b-495f-a838-c84d22c12d82 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:20.311772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37df17db-f38b-495f-a838-c84d22c12d82 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:20.312224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37df17db-f38b-495f-a838-c84d22c12d82 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:20.312923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37df17db-f38b-495f-a838-c84d22c12d82 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:20.313418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37df17db-f38b-495f-a838-c84d22c12d82 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:20.313855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37df17db-f38b-495f-a838-c84d22c12d82 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:20.327868 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-37df17db-f38b-495f-a838-c84d22c12d82 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] HTTP exception thrown: Instance a51d88d9-d28a-4e6f-a90f-bab038567251 could not be found. Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-37df17db-f38b-495f-a838-c84d22c12d82 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Request method failure captured: Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 HTTP/1.1 Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrQy6pMbKK3m9WzLpUoxhlR-lrUUpq3kHK90PhGkLiyO7Tuf7PngphMw3WpoujK_HrzuJZAqrt_b0gqZd3R-CTEzr4cC1fyaw3iYGm2KWL6nebMiKAIimo973sAy3tGTKZBD4M8e6On-mQ-m4eON9BrW3zQ44QH3uE0B1Dr9Pcl2NGQ Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 62430d3fe1c74063b5608f6cb382442e Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1672843567 Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62430d3fe1c74063b5608f6cb382442e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/62430d3fe1c74063b5608f6cb382442e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/62430d3fe1c74063b5608f6cb382442e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_62430d3fe1c74063b5608f6cb382442e"}]}] Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1672843567 Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 62430d3fe1c74063b5608f6cb382442e Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1672843567 Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersAdminNegativeTestJSON-1672843567-project Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 607097f134b349acb31017bc03e52e16 Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1672843567-project Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance a51d88d9-d28a-4e6f-a90f-bab038567251 could not be found. Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'a51d88d9-d28a-4e6f-a90f-bab038567251'} Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a51d88d9-d28a-4e6f-a90f-bab038567251 could not be found. Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a51d88d9-d28a-4e6f-a90f-bab038567251 could not be found. Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:12:20.329521 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:12:20.334489 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:12:20.334489 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:12:20.334489 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:12:20.334489 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:12:20.334489 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:12:20.334489 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:12:20.334489 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a51d88d9-d28a-4e6f-a90f-bab038567251 could not be found. Oct 18 14:12:20.334489 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:12:20.334489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-37df17db-f38b-495f-a838-c84d22c12d82 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] Returning 404 to user: Instance a51d88d9-d28a-4e6f-a90f-bab038567251 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:12:20.334489 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-37df17db-f38b-495f-a838-c84d22c12d82 tempest-ServersAdminNegativeTestJSON-1672843567 tempest-ServersAdminNegativeTestJSON-1672843567-project] 10.222.0.40 "GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251" status: 404 len: 111 microversion: 2.1 time: 0.032667 Oct 18 14:12:20.334489 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3494/6782] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:20 2022] GET /compute/v2.1/servers/a51d88d9-d28a-4e6f-a90f-bab038567251 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:12:26.395753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:26.396528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:26.516034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1344165907", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "e50ce4f8-1df5-4083-b28c-e6be5cde54ff"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:26.591791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] validate_networks() for [('e50ce4f8-1df5-4083-b28c-e6be5cde54ff', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:12:27.018205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:12:27.018814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:12:27.019703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:12:27.020288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:12:27.020859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:12:27.032489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:27.032978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:27.033522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:27.034197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:27.034654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:27.035080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:27.052901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Getting quotas for project de1d9bd9e8b54aa2844f093a2ef1d05e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:12:27.058538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Getting quotas for user 4a54b58871fb4504bdafa0a43292bc54 and project de1d9bd9e8b54aa2844f093a2ef1d05e. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:12:27.073251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:12:27.075569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:12:27.133052 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c357d3bf-35cc-46f6-8fe7-b5a8004288e8 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742504 Oct 18 14:12:27.139830 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3289/6783] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:12:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:12:27.145414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d06253d1-ac98-4401-8ca1-75bf647dcce1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:27.148425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d06253d1-ac98-4401-8ca1-75bf647dcce1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:27.151315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:27.152140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:27.215493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d06253d1-ac98-4401-8ca1-75bf647dcce1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:27.223352 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d06253d1-ac98-4401-8ca1-75bf647dcce1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1215 microversion: 2.1 time: 0.082152 Oct 18 14:12:27.223943 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3495/6784] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:27 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:28.249320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fcffd06d-12ef-4e91-850c-dd0f14f9002d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:28.249962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fcffd06d-12ef-4e91-850c-dd0f14f9002d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:28.256848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcffd06d-12ef-4e91-850c-dd0f14f9002d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:28.257580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcffd06d-12ef-4e91-850c-dd0f14f9002d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:28.258024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcffd06d-12ef-4e91-850c-dd0f14f9002d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:28.258716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcffd06d-12ef-4e91-850c-dd0f14f9002d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:28.259166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcffd06d-12ef-4e91-850c-dd0f14f9002d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:28.259592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcffd06d-12ef-4e91-850c-dd0f14f9002d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:28.323788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fcffd06d-12ef-4e91-850c-dd0f14f9002d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:28.332636 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fcffd06d-12ef-4e91-850c-dd0f14f9002d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1267 microversion: 2.1 time: 0.088089 Oct 18 14:12:28.333344 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3290/6785] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:28 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:29.357017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-06ef7dd9-c9b0-475d-92a2-087ebfe7f18b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:29.358298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-06ef7dd9-c9b0-475d-92a2-087ebfe7f18b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:29.367763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06ef7dd9-c9b0-475d-92a2-087ebfe7f18b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:29.368344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06ef7dd9-c9b0-475d-92a2-087ebfe7f18b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:29.368735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06ef7dd9-c9b0-475d-92a2-087ebfe7f18b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:29.369549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06ef7dd9-c9b0-475d-92a2-087ebfe7f18b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:29.369979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06ef7dd9-c9b0-475d-92a2-087ebfe7f18b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:29.370429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-06ef7dd9-c9b0-475d-92a2-087ebfe7f18b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:29.536534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-06ef7dd9-c9b0-475d-92a2-087ebfe7f18b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:29.545384 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-06ef7dd9-c9b0-475d-92a2-087ebfe7f18b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1315 microversion: 2.1 time: 0.192467 Oct 18 14:12:29.546343 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3496/6786] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:29 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:29.992914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-1efc1de3-1e04-4eda-96aa-b185b4c5f446 req-5af01997-5f17-4cf4-80ed-d60b6636d698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7136de3-7677-415d-ab2d-4cd5bf89ecf2", "tag": "dca2dbaa-08d5-4585-a1c0-f23ebcf46661"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:30.008278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1efc1de3-1e04-4eda-96aa-b185b4c5f446 req-5af01997-5f17-4cf4-80ed-d60b6636d698 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:30.008776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1efc1de3-1e04-4eda-96aa-b185b4c5f446 req-5af01997-5f17-4cf4-80ed-d60b6636d698 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:30.009855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-1efc1de3-1e04-4eda-96aa-b185b4c5f446 req-5af01997-5f17-4cf4-80ed-d60b6636d698 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:30.028303 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-1efc1de3-1e04-4eda-96aa-b185b4c5f446 req-5af01997-5f17-4cf4-80ed-d60b6636d698 service nova] Creating event network-changed:dca2dbaa-08d5-4585-a1c0-f23ebcf46661 for instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 on n-h1-858384-13 Oct 18 14:12:30.034515 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-1efc1de3-1e04-4eda-96aa-b185b4c5f446 req-5af01997-5f17-4cf4-80ed-d60b6636d698 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056558 Oct 18 14:12:30.035688 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3291/6787] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:12:30.570134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-055491b4-1f08-4e69-840a-7e2f1851f924 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:30.570764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-055491b4-1f08-4e69-840a-7e2f1851f924 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:30.578117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-055491b4-1f08-4e69-840a-7e2f1851f924 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:30.578622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-055491b4-1f08-4e69-840a-7e2f1851f924 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:30.579070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-055491b4-1f08-4e69-840a-7e2f1851f924 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:30.580048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-055491b4-1f08-4e69-840a-7e2f1851f924 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:30.580517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-055491b4-1f08-4e69-840a-7e2f1851f924 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:30.580959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-055491b4-1f08-4e69-840a-7e2f1851f924 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:30.715902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-055491b4-1f08-4e69-840a-7e2f1851f924 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:30.723658 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-055491b4-1f08-4e69-840a-7e2f1851f924 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1315 microversion: 2.1 time: 0.158276 Oct 18 14:12:30.724229 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3497/6788] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:30 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:31.749578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1b052679-df3d-4137-bf62-4d50250f9f6b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:31.750275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1b052679-df3d-4137-bf62-4d50250f9f6b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:31.757231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b052679-df3d-4137-bf62-4d50250f9f6b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:31.758002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b052679-df3d-4137-bf62-4d50250f9f6b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:31.758440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b052679-df3d-4137-bf62-4d50250f9f6b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:31.759132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b052679-df3d-4137-bf62-4d50250f9f6b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:31.759584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b052679-df3d-4137-bf62-4d50250f9f6b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:31.760008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b052679-df3d-4137-bf62-4d50250f9f6b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:31.896346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1b052679-df3d-4137-bf62-4d50250f9f6b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:31.904412 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1b052679-df3d-4137-bf62-4d50250f9f6b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1315 microversion: 2.1 time: 0.160999 Oct 18 14:12:31.904993 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3292/6789] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:31 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:12:32.928291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7716be0e-7411-438f-bac9-5ffe6d11a922 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:32.929492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7716be0e-7411-438f-bac9-5ffe6d11a922 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:32.936753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7716be0e-7411-438f-bac9-5ffe6d11a922 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:32.937303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7716be0e-7411-438f-bac9-5ffe6d11a922 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:32.937787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7716be0e-7411-438f-bac9-5ffe6d11a922 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:32.938523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7716be0e-7411-438f-bac9-5ffe6d11a922 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:32.939002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7716be0e-7411-438f-bac9-5ffe6d11a922 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:32.939452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7716be0e-7411-438f-bac9-5ffe6d11a922 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:33.080701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7716be0e-7411-438f-bac9-5ffe6d11a922 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:33.089588 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7716be0e-7411-438f-bac9-5ffe6d11a922 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1315 microversion: 2.1 time: 0.165156 Oct 18 14:12:33.090287 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3498/6790] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:32 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:34.112624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d268f2d-fa72-4a0c-9f85-44c870a417f4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:34.113268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4d268f2d-fa72-4a0c-9f85-44c870a417f4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:34.116041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:34.122319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d268f2d-fa72-4a0c-9f85-44c870a417f4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:34.122814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d268f2d-fa72-4a0c-9f85-44c870a417f4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:34.123253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d268f2d-fa72-4a0c-9f85-44c870a417f4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:34.123954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d268f2d-fa72-4a0c-9f85-44c870a417f4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:34.124443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d268f2d-fa72-4a0c-9f85-44c870a417f4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:34.124874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d268f2d-fa72-4a0c-9f85-44c870a417f4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:34.128155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:34.267524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4d268f2d-fa72-4a0c-9f85-44c870a417f4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:34.275930 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d268f2d-fa72-4a0c-9f85-44c870a417f4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1315 microversion: 2.1 time: 0.167255 Oct 18 14:12:34.276511 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3293/6791] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:34 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:35.299251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c11fef01-ae21-4a05-a6cc-3e0072670d1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:35.299892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c11fef01-ae21-4a05-a6cc-3e0072670d1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:35.302614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:35.308248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c11fef01-ae21-4a05-a6cc-3e0072670d1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:35.308757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c11fef01-ae21-4a05-a6cc-3e0072670d1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:35.309242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c11fef01-ae21-4a05-a6cc-3e0072670d1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:35.309967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c11fef01-ae21-4a05-a6cc-3e0072670d1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:35.310452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c11fef01-ae21-4a05-a6cc-3e0072670d1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:35.310901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c11fef01-ae21-4a05-a6cc-3e0072670d1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:35.315868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=74 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:35.458514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c11fef01-ae21-4a05-a6cc-3e0072670d1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:35.467134 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c11fef01-ae21-4a05-a6cc-3e0072670d1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1315 microversion: 2.1 time: 0.171820 Oct 18 14:12:35.467754 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3499/6792] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:35 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:36.490816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-15d162c9-66a2-4de8-81f0-cceb49daacce tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:36.491729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-15d162c9-66a2-4de8-81f0-cceb49daacce tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:36.498169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15d162c9-66a2-4de8-81f0-cceb49daacce tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:36.498645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15d162c9-66a2-4de8-81f0-cceb49daacce tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:36.499081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15d162c9-66a2-4de8-81f0-cceb49daacce tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:36.499761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15d162c9-66a2-4de8-81f0-cceb49daacce tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:36.500211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15d162c9-66a2-4de8-81f0-cceb49daacce tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:36.500638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15d162c9-66a2-4de8-81f0-cceb49daacce tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:36.639153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-15d162c9-66a2-4de8-81f0-cceb49daacce tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:36.646840 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-15d162c9-66a2-4de8-81f0-cceb49daacce tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1315 microversion: 2.1 time: 0.160110 Oct 18 14:12:36.648196 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3294/6793] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:36 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:37.501101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-27d6c516-1640-44c0-a540-fdd3eea02046 req-7fcc7b38-5754-431f-b300-70b88c13bb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136de3-7677-415d-ab2d-4cd5bf89ecf2", "name": "network-vif-plugged", "status": "completed", "tag": "dca2dbaa-08d5-4585-a1c0-f23ebcf46661"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:37.506748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:37.515973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-27d6c516-1640-44c0-a540-fdd3eea02046 req-7fcc7b38-5754-431f-b300-70b88c13bb8e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:37.516478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-27d6c516-1640-44c0-a540-fdd3eea02046 req-7fcc7b38-5754-431f-b300-70b88c13bb8e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:37.516926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-27d6c516-1640-44c0-a540-fdd3eea02046 req-7fcc7b38-5754-431f-b300-70b88c13bb8e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:37.528864 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-27d6c516-1640-44c0-a540-fdd3eea02046 req-7fcc7b38-5754-431f-b300-70b88c13bb8e service nova] Creating event network-vif-plugged:dca2dbaa-08d5-4585-a1c0-f23ebcf46661 for instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 on n-h1-858384-13 Oct 18 14:12:37.534981 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-27d6c516-1640-44c0-a540-fdd3eea02046 req-7fcc7b38-5754-431f-b300-70b88c13bb8e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037292 Oct 18 14:12:37.535585 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3500/6794] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:12:37.670459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-221bfa78-7d9b-45b3-9db9-22248043e48b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:37.671063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-221bfa78-7d9b-45b3-9db9-22248043e48b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:37.672954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:37.673833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:12:37.681324 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-221bfa78-7d9b-45b3-9db9-22248043e48b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:37.681810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-221bfa78-7d9b-45b3-9db9-22248043e48b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:37.682246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-221bfa78-7d9b-45b3-9db9-22248043e48b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:37.682936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-221bfa78-7d9b-45b3-9db9-22248043e48b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:37.683381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-221bfa78-7d9b-45b3-9db9-22248043e48b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:37.683860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-221bfa78-7d9b-45b3-9db9-22248043e48b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:37.823104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-221bfa78-7d9b-45b3-9db9-22248043e48b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:37.831096 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-221bfa78-7d9b-45b3-9db9-22248043e48b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1315 microversion: 2.1 time: 0.164478 Oct 18 14:12:37.831681 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3295/6795] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:37 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:38.855127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f12e6308-3708-4de6-a469-87cc131d9421 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:38.855843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f12e6308-3708-4de6-a469-87cc131d9421 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:38.863065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f12e6308-3708-4de6-a469-87cc131d9421 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:38.863566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f12e6308-3708-4de6-a469-87cc131d9421 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:38.864020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f12e6308-3708-4de6-a469-87cc131d9421 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:38.864739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f12e6308-3708-4de6-a469-87cc131d9421 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:38.865224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f12e6308-3708-4de6-a469-87cc131d9421 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:38.865666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f12e6308-3708-4de6-a469-87cc131d9421 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:39.007608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f12e6308-3708-4de6-a469-87cc131d9421 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:39.015557 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f12e6308-3708-4de6-a469-87cc131d9421 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1315 microversion: 2.1 time: 0.165254 Oct 18 14:12:39.016822 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3501/6796] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:38 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:40.039259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e2af0df5-4888-4117-a296-81900ce89f1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:40.039872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e2af0df5-4888-4117-a296-81900ce89f1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:40.046706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2af0df5-4888-4117-a296-81900ce89f1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:40.047179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2af0df5-4888-4117-a296-81900ce89f1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:40.047617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2af0df5-4888-4117-a296-81900ce89f1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:40.048297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2af0df5-4888-4117-a296-81900ce89f1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:40.048746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2af0df5-4888-4117-a296-81900ce89f1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:40.049162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2af0df5-4888-4117-a296-81900ce89f1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:40.179020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e2af0df5-4888-4117-a296-81900ce89f1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:40.187570 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e2af0df5-4888-4117-a296-81900ce89f1c tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1502 microversion: 2.1 time: 0.152482 Oct 18 14:12:40.188149 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3296/6797] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:40 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:40.211607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:12:40.214034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:40.220312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:40.220814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:40.221293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:40.222015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:40.222490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:40.222934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:40.252485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:40.258022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Old instance type m1.heat2, new instance type m1.heat {{(pid=120611) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:12:40.264877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:12:40.265362 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:12:40.265857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:12:40.266288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:12:40.266722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:12:40.328632 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [1585c77b-6861-4342-a4a8-67f84b39fbd1] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:12:41.336540 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [1585c77b-6861-4342-a4a8-67f84b39fbd1] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39656. Oct 18 14:12:41.340487 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5f29bc9c-6f02-4d22-8bfd-d428c23c05d0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "POST /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2/action" status: 202 len: 0 microversion: 2.1 time: 1.134314 Oct 18 14:12:41.341250 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3502/6798] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:12:40 2022] POST /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:12:41.349965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed26cccd-5570-4e37-b467-f67289f8313a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:41.350509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ed26cccd-5570-4e37-b467-f67289f8313a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:41.357562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed26cccd-5570-4e37-b467-f67289f8313a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:41.358051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed26cccd-5570-4e37-b467-f67289f8313a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:41.358495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed26cccd-5570-4e37-b467-f67289f8313a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:41.359230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed26cccd-5570-4e37-b467-f67289f8313a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:41.359679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed26cccd-5570-4e37-b467-f67289f8313a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:41.360111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed26cccd-5570-4e37-b467-f67289f8313a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:41.540730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ed26cccd-5570-4e37-b467-f67289f8313a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:41.549351 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ed26cccd-5570-4e37-b467-f67289f8313a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1511 microversion: 2.1 time: 0.203361 Oct 18 14:12:41.550008 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3297/6799] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:41 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:42.575412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2287d0d1-fc38-49eb-8109-a43195675295 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:42.576056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2287d0d1-fc38-49eb-8109-a43195675295 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:42.582561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2287d0d1-fc38-49eb-8109-a43195675295 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:42.583061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2287d0d1-fc38-49eb-8109-a43195675295 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:42.583524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2287d0d1-fc38-49eb-8109-a43195675295 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:42.584279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2287d0d1-fc38-49eb-8109-a43195675295 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:42.584756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2287d0d1-fc38-49eb-8109-a43195675295 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:42.585220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2287d0d1-fc38-49eb-8109-a43195675295 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:42.724825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2287d0d1-fc38-49eb-8109-a43195675295 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:42.733881 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2287d0d1-fc38-49eb-8109-a43195675295 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1511 microversion: 2.1 time: 0.164287 Oct 18 14:12:42.734481 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3503/6800] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:42 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:43.758161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f36e4ce6-dfe3-43e1-affe-7203fdd79c72 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:43.758825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f36e4ce6-dfe3-43e1-affe-7203fdd79c72 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:43.765891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f36e4ce6-dfe3-43e1-affe-7203fdd79c72 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:43.766367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f36e4ce6-dfe3-43e1-affe-7203fdd79c72 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:43.766799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f36e4ce6-dfe3-43e1-affe-7203fdd79c72 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:43.767484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f36e4ce6-dfe3-43e1-affe-7203fdd79c72 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:43.767928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f36e4ce6-dfe3-43e1-affe-7203fdd79c72 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:43.768349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f36e4ce6-dfe3-43e1-affe-7203fdd79c72 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:43.930025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f36e4ce6-dfe3-43e1-affe-7203fdd79c72 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:43.940339 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f36e4ce6-dfe3-43e1-affe-7203fdd79c72 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.186245 Oct 18 14:12:43.940930 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3298/6801] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:43 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:44.964709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-627d7cb1-b011-4f6d-8498-541a8cc8f2ea tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:44.965386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-627d7cb1-b011-4f6d-8498-541a8cc8f2ea tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:44.972319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-627d7cb1-b011-4f6d-8498-541a8cc8f2ea tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:44.972820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-627d7cb1-b011-4f6d-8498-541a8cc8f2ea tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:44.973303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-627d7cb1-b011-4f6d-8498-541a8cc8f2ea tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:44.974028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-627d7cb1-b011-4f6d-8498-541a8cc8f2ea tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:44.974502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-627d7cb1-b011-4f6d-8498-541a8cc8f2ea tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:44.974948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-627d7cb1-b011-4f6d-8498-541a8cc8f2ea tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:45.117965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-627d7cb1-b011-4f6d-8498-541a8cc8f2ea tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:45.127143 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-627d7cb1-b011-4f6d-8498-541a8cc8f2ea tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.167035 Oct 18 14:12:45.127732 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3504/6802] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:44 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:46.154412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-92070c3f-0073-4d63-a359-d845d9233298 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:46.155018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-92070c3f-0073-4d63-a359-d845d9233298 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:46.161896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92070c3f-0073-4d63-a359-d845d9233298 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:46.162374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92070c3f-0073-4d63-a359-d845d9233298 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:46.162806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92070c3f-0073-4d63-a359-d845d9233298 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:46.163491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92070c3f-0073-4d63-a359-d845d9233298 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:46.163939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92070c3f-0073-4d63-a359-d845d9233298 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:46.164361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92070c3f-0073-4d63-a359-d845d9233298 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:46.307272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-92070c3f-0073-4d63-a359-d845d9233298 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:46.315383 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-92070c3f-0073-4d63-a359-d845d9233298 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.165028 Oct 18 14:12:46.315970 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3299/6803] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:46 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:47.339262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-38994194-5fed-4a5a-8490-c09c103cf249 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:47.339918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-38994194-5fed-4a5a-8490-c09c103cf249 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:47.346582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38994194-5fed-4a5a-8490-c09c103cf249 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:47.347078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38994194-5fed-4a5a-8490-c09c103cf249 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:47.347526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38994194-5fed-4a5a-8490-c09c103cf249 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:47.348232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38994194-5fed-4a5a-8490-c09c103cf249 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:47.348699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38994194-5fed-4a5a-8490-c09c103cf249 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:47.349212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38994194-5fed-4a5a-8490-c09c103cf249 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:47.488886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-38994194-5fed-4a5a-8490-c09c103cf249 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:47.497371 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-38994194-5fed-4a5a-8490-c09c103cf249 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.162145 Oct 18 14:12:47.497963 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3505/6804] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:47 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:48.521610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e6060f4-110b-42ac-9168-3f8cf663daf0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:48.522166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1e6060f4-110b-42ac-9168-3f8cf663daf0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:48.529767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e6060f4-110b-42ac-9168-3f8cf663daf0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:48.530242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e6060f4-110b-42ac-9168-3f8cf663daf0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:48.530968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e6060f4-110b-42ac-9168-3f8cf663daf0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:48.531667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e6060f4-110b-42ac-9168-3f8cf663daf0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:48.532112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e6060f4-110b-42ac-9168-3f8cf663daf0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:48.532535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e6060f4-110b-42ac-9168-3f8cf663daf0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:48.670125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1e6060f4-110b-42ac-9168-3f8cf663daf0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:48.677982 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1e6060f4-110b-42ac-9168-3f8cf663daf0 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.160390 Oct 18 14:12:48.678568 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3300/6805] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:48 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:49.701436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-20a9ab62-3c65-4852-87fc-236d33ec2547 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:49.701986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-20a9ab62-3c65-4852-87fc-236d33ec2547 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:49.709651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20a9ab62-3c65-4852-87fc-236d33ec2547 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:49.710153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20a9ab62-3c65-4852-87fc-236d33ec2547 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:49.710600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20a9ab62-3c65-4852-87fc-236d33ec2547 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:49.711306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20a9ab62-3c65-4852-87fc-236d33ec2547 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:49.711802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20a9ab62-3c65-4852-87fc-236d33ec2547 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:49.712759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-20a9ab62-3c65-4852-87fc-236d33ec2547 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:49.845736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-20a9ab62-3c65-4852-87fc-236d33ec2547 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:49.854263 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-20a9ab62-3c65-4852-87fc-236d33ec2547 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.156828 Oct 18 14:12:49.855367 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3506/6806] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:49 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:50.877867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1c942cda-7b75-47b5-85c9-c891c54eed98 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:50.878448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1c942cda-7b75-47b5-85c9-c891c54eed98 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:50.885654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c942cda-7b75-47b5-85c9-c891c54eed98 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:50.886129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c942cda-7b75-47b5-85c9-c891c54eed98 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:50.886560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c942cda-7b75-47b5-85c9-c891c54eed98 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:50.887595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c942cda-7b75-47b5-85c9-c891c54eed98 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:50.888073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c942cda-7b75-47b5-85c9-c891c54eed98 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:50.888492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1c942cda-7b75-47b5-85c9-c891c54eed98 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:51.020241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1c942cda-7b75-47b5-85c9-c891c54eed98 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:51.028631 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1c942cda-7b75-47b5-85c9-c891c54eed98 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.154649 Oct 18 14:12:51.029236 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3301/6807] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:50 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:52.051972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b294bc0a-f8e5-4e2c-9b91-f0eeef31cbc9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:52.052628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b294bc0a-f8e5-4e2c-9b91-f0eeef31cbc9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:52.060827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b294bc0a-f8e5-4e2c-9b91-f0eeef31cbc9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:52.061371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b294bc0a-f8e5-4e2c-9b91-f0eeef31cbc9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:52.061829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b294bc0a-f8e5-4e2c-9b91-f0eeef31cbc9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:52.062588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b294bc0a-f8e5-4e2c-9b91-f0eeef31cbc9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:52.063017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b294bc0a-f8e5-4e2c-9b91-f0eeef31cbc9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:52.063462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b294bc0a-f8e5-4e2c-9b91-f0eeef31cbc9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:52.200043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b294bc0a-f8e5-4e2c-9b91-f0eeef31cbc9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:52.208168 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b294bc0a-f8e5-4e2c-9b91-f0eeef31cbc9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.160111 Oct 18 14:12:52.208751 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3507/6808] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:52 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:53.232096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8bd6a672-9505-4468-9f16-2f7176e263a9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:53.232706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8bd6a672-9505-4468-9f16-2f7176e263a9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:53.239662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8bd6a672-9505-4468-9f16-2f7176e263a9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:53.240150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8bd6a672-9505-4468-9f16-2f7176e263a9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:53.240585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8bd6a672-9505-4468-9f16-2f7176e263a9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:53.241297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8bd6a672-9505-4468-9f16-2f7176e263a9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:53.241750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8bd6a672-9505-4468-9f16-2f7176e263a9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:53.242177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8bd6a672-9505-4468-9f16-2f7176e263a9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:53.379057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8bd6a672-9505-4468-9f16-2f7176e263a9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:53.388580 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8bd6a672-9505-4468-9f16-2f7176e263a9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.160882 Oct 18 14:12:53.389314 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3302/6809] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:53 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:54.411664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-82d6ba3e-1b61-48dd-88b8-d265100b5fe5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:54.412322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-82d6ba3e-1b61-48dd-88b8-d265100b5fe5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:54.421124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82d6ba3e-1b61-48dd-88b8-d265100b5fe5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:54.421658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82d6ba3e-1b61-48dd-88b8-d265100b5fe5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:54.422112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82d6ba3e-1b61-48dd-88b8-d265100b5fe5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:54.422830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82d6ba3e-1b61-48dd-88b8-d265100b5fe5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:54.423304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82d6ba3e-1b61-48dd-88b8-d265100b5fe5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:54.423746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82d6ba3e-1b61-48dd-88b8-d265100b5fe5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:54.554772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-82d6ba3e-1b61-48dd-88b8-d265100b5fe5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:54.563342 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-82d6ba3e-1b61-48dd-88b8-d265100b5fe5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.155731 Oct 18 14:12:54.563925 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3508/6810] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:54 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:55.586793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9006937f-e0ad-4b92-9599-ef2c47a6ec15 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:55.587528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9006937f-e0ad-4b92-9599-ef2c47a6ec15 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:55.594625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9006937f-e0ad-4b92-9599-ef2c47a6ec15 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:55.595111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9006937f-e0ad-4b92-9599-ef2c47a6ec15 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:55.595555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9006937f-e0ad-4b92-9599-ef2c47a6ec15 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:55.596246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9006937f-e0ad-4b92-9599-ef2c47a6ec15 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:55.596700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9006937f-e0ad-4b92-9599-ef2c47a6ec15 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:55.597127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9006937f-e0ad-4b92-9599-ef2c47a6ec15 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:55.743153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9006937f-e0ad-4b92-9599-ef2c47a6ec15 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:55.751774 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9006937f-e0ad-4b92-9599-ef2c47a6ec15 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.168935 Oct 18 14:12:55.752368 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3303/6811] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:55 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:56.775259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f3dc2340-7119-442d-a96e-ba30df8e3247 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:56.775920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f3dc2340-7119-442d-a96e-ba30df8e3247 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:56.782500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3dc2340-7119-442d-a96e-ba30df8e3247 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:56.783004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3dc2340-7119-442d-a96e-ba30df8e3247 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:56.783455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3dc2340-7119-442d-a96e-ba30df8e3247 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:56.784162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3dc2340-7119-442d-a96e-ba30df8e3247 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:56.784635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3dc2340-7119-442d-a96e-ba30df8e3247 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:56.785075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f3dc2340-7119-442d-a96e-ba30df8e3247 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:56.915258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f3dc2340-7119-442d-a96e-ba30df8e3247 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:56.923300 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f3dc2340-7119-442d-a96e-ba30df8e3247 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.152139 Oct 18 14:12:56.923892 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3509/6812] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:56 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:57.947952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a77b3e98-e244-4c41-8dca-f22262759a27 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:57.948921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a77b3e98-e244-4c41-8dca-f22262759a27 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:57.957030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a77b3e98-e244-4c41-8dca-f22262759a27 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:57.957545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a77b3e98-e244-4c41-8dca-f22262759a27 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:57.957976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a77b3e98-e244-4c41-8dca-f22262759a27 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:57.958665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a77b3e98-e244-4c41-8dca-f22262759a27 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:57.959111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a77b3e98-e244-4c41-8dca-f22262759a27 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:57.959530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a77b3e98-e244-4c41-8dca-f22262759a27 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:58.093928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a77b3e98-e244-4c41-8dca-f22262759a27 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:58.101806 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a77b3e98-e244-4c41-8dca-f22262759a27 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.159312 Oct 18 14:12:58.102386 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3304/6813] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:57 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:12:59.125432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5dbcb6d0-1453-43eb-b41e-8c8870155651 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:12:59.126052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5dbcb6d0-1453-43eb-b41e-8c8870155651 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:12:59.133534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5dbcb6d0-1453-43eb-b41e-8c8870155651 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:59.134030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5dbcb6d0-1453-43eb-b41e-8c8870155651 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:59.134479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5dbcb6d0-1453-43eb-b41e-8c8870155651 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:59.135179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5dbcb6d0-1453-43eb-b41e-8c8870155651 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:12:59.135646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5dbcb6d0-1453-43eb-b41e-8c8870155651 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:12:59.136079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5dbcb6d0-1453-43eb-b41e-8c8870155651 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:12:59.270994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5dbcb6d0-1453-43eb-b41e-8c8870155651 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:12:59.279092 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5dbcb6d0-1453-43eb-b41e-8c8870155651 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.157897 Oct 18 14:12:59.279667 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3510/6814] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:12:59 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:00.303125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f543f0d7-140a-48fb-a9bf-6e18a3cc8be4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:00.303742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f543f0d7-140a-48fb-a9bf-6e18a3cc8be4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:00.311308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f543f0d7-140a-48fb-a9bf-6e18a3cc8be4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:00.311801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f543f0d7-140a-48fb-a9bf-6e18a3cc8be4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:00.312240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f543f0d7-140a-48fb-a9bf-6e18a3cc8be4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:00.312933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f543f0d7-140a-48fb-a9bf-6e18a3cc8be4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:00.313420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f543f0d7-140a-48fb-a9bf-6e18a3cc8be4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:00.313847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f543f0d7-140a-48fb-a9bf-6e18a3cc8be4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:00.454773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f543f0d7-140a-48fb-a9bf-6e18a3cc8be4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:00.462841 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f543f0d7-140a-48fb-a9bf-6e18a3cc8be4 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.163615 Oct 18 14:13:00.463408 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3305/6815] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:00 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:01.486749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-faf4ff54-a702-47b1-b875-1875419a66b5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:01.487379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-faf4ff54-a702-47b1-b875-1875419a66b5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:01.494353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faf4ff54-a702-47b1-b875-1875419a66b5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:01.494849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faf4ff54-a702-47b1-b875-1875419a66b5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:01.495296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faf4ff54-a702-47b1-b875-1875419a66b5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:01.496018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faf4ff54-a702-47b1-b875-1875419a66b5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:01.496468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faf4ff54-a702-47b1-b875-1875419a66b5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:01.496908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-faf4ff54-a702-47b1-b875-1875419a66b5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:01.629569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-faf4ff54-a702-47b1-b875-1875419a66b5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:01.637496 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-faf4ff54-a702-47b1-b875-1875419a66b5 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.154701 Oct 18 14:13:01.638083 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3511/6816] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:01 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:02.661385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6d2d98da-c048-4192-891a-5c99a7b9d824 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:02.661994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6d2d98da-c048-4192-891a-5c99a7b9d824 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:02.669664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d2d98da-c048-4192-891a-5c99a7b9d824 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:02.670156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d2d98da-c048-4192-891a-5c99a7b9d824 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:02.670598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d2d98da-c048-4192-891a-5c99a7b9d824 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:02.671293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d2d98da-c048-4192-891a-5c99a7b9d824 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:02.671746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d2d98da-c048-4192-891a-5c99a7b9d824 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:02.672174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6d2d98da-c048-4192-891a-5c99a7b9d824 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:02.805763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6d2d98da-c048-4192-891a-5c99a7b9d824 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:02.814492 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6d2d98da-c048-4192-891a-5c99a7b9d824 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.157109 Oct 18 14:13:02.815067 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3306/6817] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:02 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:03.837904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7dba09a7-5266-4bb9-9482-bbf4087257b3 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:03.838559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7dba09a7-5266-4bb9-9482-bbf4087257b3 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:03.845940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dba09a7-5266-4bb9-9482-bbf4087257b3 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:03.846438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dba09a7-5266-4bb9-9482-bbf4087257b3 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:03.846884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dba09a7-5266-4bb9-9482-bbf4087257b3 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:03.847584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dba09a7-5266-4bb9-9482-bbf4087257b3 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:03.848053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dba09a7-5266-4bb9-9482-bbf4087257b3 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:03.848518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7dba09a7-5266-4bb9-9482-bbf4087257b3 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:03.987058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7dba09a7-5266-4bb9-9482-bbf4087257b3 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:03.994902 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7dba09a7-5266-4bb9-9482-bbf4087257b3 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.160925 Oct 18 14:13:03.995482 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3512/6818] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:03 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:05.018371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-30c11620-deb2-493f-8666-1ab35ff667b1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:05.018992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-30c11620-deb2-493f-8666-1ab35ff667b1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:05.021688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=28 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:05.026967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30c11620-deb2-493f-8666-1ab35ff667b1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:05.027653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30c11620-deb2-493f-8666-1ab35ff667b1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:05.028198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30c11620-deb2-493f-8666-1ab35ff667b1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:05.028923 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30c11620-deb2-493f-8666-1ab35ff667b1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:05.029389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30c11620-deb2-493f-8666-1ab35ff667b1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:05.029821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-30c11620-deb2-493f-8666-1ab35ff667b1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:05.032694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=84 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:05.168306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-30c11620-deb2-493f-8666-1ab35ff667b1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:05.176610 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-30c11620-deb2-493f-8666-1ab35ff667b1 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.162144 Oct 18 14:13:05.177203 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3307/6819] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:05 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:06.200371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9e5ab525-aacb-48b0-bcde-4d432c9fd7bf tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:06.201003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9e5ab525-aacb-48b0-bcde-4d432c9fd7bf tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:06.203884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=32 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:06.209606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e5ab525-aacb-48b0-bcde-4d432c9fd7bf tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:06.210116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e5ab525-aacb-48b0-bcde-4d432c9fd7bf tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:06.210575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e5ab525-aacb-48b0-bcde-4d432c9fd7bf tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:06.211291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e5ab525-aacb-48b0-bcde-4d432c9fd7bf tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:06.211764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e5ab525-aacb-48b0-bcde-4d432c9fd7bf tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:06.212212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9e5ab525-aacb-48b0-bcde-4d432c9fd7bf tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:06.215008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:06.349613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9e5ab525-aacb-48b0-bcde-4d432c9fd7bf tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:06.358323 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9e5ab525-aacb-48b0-bcde-4d432c9fd7bf tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.162497 Oct 18 14:13:06.358913 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3513/6820] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:06 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:07.381925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1faf2654-9b62-4153-8439-200db12ac081 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:07.382524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1faf2654-9b62-4153-8439-200db12ac081 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:07.390031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1faf2654-9b62-4153-8439-200db12ac081 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:07.390521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1faf2654-9b62-4153-8439-200db12ac081 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:07.390966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1faf2654-9b62-4153-8439-200db12ac081 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:07.391661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1faf2654-9b62-4153-8439-200db12ac081 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:07.392118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1faf2654-9b62-4153-8439-200db12ac081 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:07.392547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1faf2654-9b62-4153-8439-200db12ac081 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:07.524000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1faf2654-9b62-4153-8439-200db12ac081 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:07.531896 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1faf2654-9b62-4153-8439-200db12ac081 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.154145 Oct 18 14:13:07.532467 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3308/6821] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:07 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:08.554625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6c40aedf-1fea-404d-b5f4-bbe2383be803 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:08.555259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6c40aedf-1fea-404d-b5f4-bbe2383be803 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:08.562765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c40aedf-1fea-404d-b5f4-bbe2383be803 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:08.563267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c40aedf-1fea-404d-b5f4-bbe2383be803 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:08.563720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c40aedf-1fea-404d-b5f4-bbe2383be803 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:08.564430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c40aedf-1fea-404d-b5f4-bbe2383be803 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:08.564906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c40aedf-1fea-404d-b5f4-bbe2383be803 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:08.565398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6c40aedf-1fea-404d-b5f4-bbe2383be803 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:08.697887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6c40aedf-1fea-404d-b5f4-bbe2383be803 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:08.706630 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6c40aedf-1fea-404d-b5f4-bbe2383be803 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.156010 Oct 18 14:13:08.707209 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3514/6822] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:08 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:09.731002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b7980aac-ace4-4017-8cb4-f2d73bbdd10b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:09.731859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b7980aac-ace4-4017-8cb4-f2d73bbdd10b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:09.738698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7980aac-ace4-4017-8cb4-f2d73bbdd10b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:09.739173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7980aac-ace4-4017-8cb4-f2d73bbdd10b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:09.739604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7980aac-ace4-4017-8cb4-f2d73bbdd10b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:09.740284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7980aac-ace4-4017-8cb4-f2d73bbdd10b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:09.740730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7980aac-ace4-4017-8cb4-f2d73bbdd10b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:09.741149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7980aac-ace4-4017-8cb4-f2d73bbdd10b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:09.874365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b7980aac-ace4-4017-8cb4-f2d73bbdd10b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:09.882039 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b7980aac-ace4-4017-8cb4-f2d73bbdd10b tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1516 microversion: 2.1 time: 0.155662 Oct 18 14:13:09.882609 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3309/6823] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:09 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:13:10.906237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3027cf56-6bd0-4e1a-8d89-bc8ac1879ab7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:10.906886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3027cf56-6bd0-4e1a-8d89-bc8ac1879ab7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:10.914157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3027cf56-6bd0-4e1a-8d89-bc8ac1879ab7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:10.914661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3027cf56-6bd0-4e1a-8d89-bc8ac1879ab7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:10.915111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3027cf56-6bd0-4e1a-8d89-bc8ac1879ab7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:10.915830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3027cf56-6bd0-4e1a-8d89-bc8ac1879ab7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:10.916294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3027cf56-6bd0-4e1a-8d89-bc8ac1879ab7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:10.916763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3027cf56-6bd0-4e1a-8d89-bc8ac1879ab7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:11.125554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3027cf56-6bd0-4e1a-8d89-bc8ac1879ab7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:11.133503 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3027cf56-6bd0-4e1a-8d89-bc8ac1879ab7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1515 microversion: 2.1 time: 0.231318 Oct 18 14:13:11.134113 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3515/6824] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:10 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:11.274061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d25a97df-c117-440e-b408-f10a84edac36 req-fb094c2a-4423-41e2-b87d-693e49aaa1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136de3-7677-415d-ab2d-4cd5bf89ecf2", "name": "network-vif-unplugged", "status": "completed", "tag": "dca2dbaa-08d5-4585-a1c0-f23ebcf46661"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:11.284617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d25a97df-c117-440e-b408-f10a84edac36 req-fb094c2a-4423-41e2-b87d-693e49aaa1bb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:11.285101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d25a97df-c117-440e-b408-f10a84edac36 req-fb094c2a-4423-41e2-b87d-693e49aaa1bb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:11.285558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d25a97df-c117-440e-b408-f10a84edac36 req-fb094c2a-4423-41e2-b87d-693e49aaa1bb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:11.298372 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d25a97df-c117-440e-b408-f10a84edac36 req-fb094c2a-4423-41e2-b87d-693e49aaa1bb service nova] Creating event network-vif-unplugged:dca2dbaa-08d5-4585-a1c0-f23ebcf46661 for instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 on n-h2-858384-13 Oct 18 14:13:11.303789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-d25a97df-c117-440e-b408-f10a84edac36 req-fb094c2a-4423-41e2-b87d-693e49aaa1bb service nova] Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:13:11.315347 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d25a97df-c117-440e-b408-f10a84edac36 req-fb094c2a-4423-41e2-b87d-693e49aaa1bb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110655 Oct 18 14:13:11.315977 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3310/6825] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:13:12.157125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a469153f-1483-4682-92d4-3a47cf1501a7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:12.157779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a469153f-1483-4682-92d4-3a47cf1501a7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:12.164679 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a469153f-1483-4682-92d4-3a47cf1501a7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:12.165197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a469153f-1483-4682-92d4-3a47cf1501a7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:12.165667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a469153f-1483-4682-92d4-3a47cf1501a7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:12.166381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a469153f-1483-4682-92d4-3a47cf1501a7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:12.166854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a469153f-1483-4682-92d4-3a47cf1501a7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:12.167298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a469153f-1483-4682-92d4-3a47cf1501a7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:12.297663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a469153f-1483-4682-92d4-3a47cf1501a7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:12.305435 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a469153f-1483-4682-92d4-3a47cf1501a7 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1513 microversion: 2.1 time: 0.152281 Oct 18 14:13:12.306016 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3516/6826] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:12 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:13.333934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e21aa0e1-c6de-4821-a0b7-167488680023 req-b2e9b834-2588-4d73-863c-4e918f4dec75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7136de3-7677-415d-ab2d-4cd5bf89ecf2", "tag": "dca2dbaa-08d5-4585-a1c0-f23ebcf46661"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:13.334511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1c1c3061-7f08-4016-a4be-0f237771057e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:13.334984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1c1c3061-7f08-4016-a4be-0f237771057e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:13.342961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c1c3061-7f08-4016-a4be-0f237771057e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:13.343467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c1c3061-7f08-4016-a4be-0f237771057e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:13.343919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c1c3061-7f08-4016-a4be-0f237771057e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:13.344635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c1c3061-7f08-4016-a4be-0f237771057e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:13.345343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c1c3061-7f08-4016-a4be-0f237771057e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:13.346003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c1c3061-7f08-4016-a4be-0f237771057e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:13.346888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e21aa0e1-c6de-4821-a0b7-167488680023 req-b2e9b834-2588-4d73-863c-4e918f4dec75 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:13.347357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e21aa0e1-c6de-4821-a0b7-167488680023 req-b2e9b834-2588-4d73-863c-4e918f4dec75 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:13.347984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e21aa0e1-c6de-4821-a0b7-167488680023 req-b2e9b834-2588-4d73-863c-4e918f4dec75 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:13.366734 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e21aa0e1-c6de-4821-a0b7-167488680023 req-b2e9b834-2588-4d73-863c-4e918f4dec75 service nova] Creating event network-changed:dca2dbaa-08d5-4585-a1c0-f23ebcf46661 for instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 on n-h2-858384-13 Oct 18 14:13:13.373467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-e21aa0e1-c6de-4821-a0b7-167488680023 req-b2e9b834-2588-4d73-863c-4e918f4dec75 service nova] Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:13:13.387025 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e21aa0e1-c6de-4821-a0b7-167488680023 req-b2e9b834-2588-4d73-863c-4e918f4dec75 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057646 Oct 18 14:13:13.387976 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3311/6827] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:13:13.535641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1c1c3061-7f08-4016-a4be-0f237771057e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:13.548410 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1c1c3061-7f08-4016-a4be-0f237771057e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1513 microversion: 2.1 time: 0.217391 Oct 18 14:13:13.550123 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3517/6828] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:13 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:13:14.575778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e77e4d2b-73d9-4e71-91c8-c1e7e96dda3a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:14.576500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e77e4d2b-73d9-4e71-91c8-c1e7e96dda3a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:14.582941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e77e4d2b-73d9-4e71-91c8-c1e7e96dda3a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:14.583444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e77e4d2b-73d9-4e71-91c8-c1e7e96dda3a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:14.583875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e77e4d2b-73d9-4e71-91c8-c1e7e96dda3a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:14.584558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e77e4d2b-73d9-4e71-91c8-c1e7e96dda3a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:14.585007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e77e4d2b-73d9-4e71-91c8-c1e7e96dda3a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:14.585455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e77e4d2b-73d9-4e71-91c8-c1e7e96dda3a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:14.722233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e77e4d2b-73d9-4e71-91c8-c1e7e96dda3a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:14.730153 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e77e4d2b-73d9-4e71-91c8-c1e7e96dda3a tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1510 microversion: 2.1 time: 0.159947 Oct 18 14:13:14.730843 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3312/6829] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:14 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:14.752338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d7560d3-fc0e-42f8-99d0-5746503f9b78 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:14.752838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d7560d3-fc0e-42f8-99d0-5746503f9b78 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:14.759820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d7560d3-fc0e-42f8-99d0-5746503f9b78 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:14.760323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d7560d3-fc0e-42f8-99d0-5746503f9b78 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:14.760783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d7560d3-fc0e-42f8-99d0-5746503f9b78 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:14.762058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d7560d3-fc0e-42f8-99d0-5746503f9b78 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:14.762619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d7560d3-fc0e-42f8-99d0-5746503f9b78 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:14.763068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d7560d3-fc0e-42f8-99d0-5746503f9b78 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:14.790524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d7560d3-fc0e-42f8-99d0-5746503f9b78 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:13:14.842522 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.compute.api [None req-9d7560d3-fc0e-42f8-99d0-5746503f9b78 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Found an unconfirmed migration during delete, id: 16, status: finished Oct 18 14:13:15.298141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-bb31c4d0-9259-4ab0-b65d-b32b4cd992a4 req-6cf1602d-877c-4320-b142-1257f3ce9ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136de3-7677-415d-ab2d-4cd5bf89ecf2", "name": "network-vif-plugged", "status": "completed", "tag": "dca2dbaa-08d5-4585-a1c0-f23ebcf46661"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:15.308190 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bb31c4d0-9259-4ab0-b65d-b32b4cd992a4 req-6cf1602d-877c-4320-b142-1257f3ce9ae9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:15.308721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bb31c4d0-9259-4ab0-b65d-b32b4cd992a4 req-6cf1602d-877c-4320-b142-1257f3ce9ae9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:15.309189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bb31c4d0-9259-4ab0-b65d-b32b4cd992a4 req-6cf1602d-877c-4320-b142-1257f3ce9ae9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:15.321867 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-bb31c4d0-9259-4ab0-b65d-b32b4cd992a4 req-6cf1602d-877c-4320-b142-1257f3ce9ae9 service nova] Creating event network-vif-plugged:dca2dbaa-08d5-4585-a1c0-f23ebcf46661 for instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 on n-h2-858384-13 Oct 18 14:13:15.327544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-bb31c4d0-9259-4ab0-b65d-b32b4cd992a4 req-6cf1602d-877c-4320-b142-1257f3ce9ae9 service nova] Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:13:15.341140 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-bb31c4d0-9259-4ab0-b65d-b32b4cd992a4 req-6cf1602d-877c-4320-b142-1257f3ce9ae9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047431 Oct 18 14:13:15.341962 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3313/6830] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:13:16.313414 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d7560d3-fc0e-42f8-99d0-5746503f9b78 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 204 len: 0 microversion: 2.1 time: 1.564653 Oct 18 14:13:16.314464 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3518/6831] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:13:14 2022] DELETE /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 0 bytes in 1566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:13:16.323716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-32d21971-9018-4f4c-9246-1356051db43d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:16.325139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-32d21971-9018-4f4c-9246-1356051db43d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:16.331745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32d21971-9018-4f4c-9246-1356051db43d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:16.332226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32d21971-9018-4f4c-9246-1356051db43d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:16.332661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32d21971-9018-4f4c-9246-1356051db43d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:16.333378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32d21971-9018-4f4c-9246-1356051db43d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:16.333830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32d21971-9018-4f4c-9246-1356051db43d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:16.334255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-32d21971-9018-4f4c-9246-1356051db43d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:16.468056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-32d21971-9018-4f4c-9246-1356051db43d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:16.475813 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-32d21971-9018-4f4c-9246-1356051db43d tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1502 microversion: 2.1 time: 0.157132 Oct 18 14:13:16.476389 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3314/6832] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:16 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:17.500600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b6fde58f-06f9-48b7-88dd-2d72c042a7b9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:17.501382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b6fde58f-06f9-48b7-88dd-2d72c042a7b9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:17.507911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6fde58f-06f9-48b7-88dd-2d72c042a7b9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:17.508430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6fde58f-06f9-48b7-88dd-2d72c042a7b9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:17.508869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6fde58f-06f9-48b7-88dd-2d72c042a7b9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:17.509613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6fde58f-06f9-48b7-88dd-2d72c042a7b9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:17.510092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6fde58f-06f9-48b7-88dd-2d72c042a7b9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:17.510570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b6fde58f-06f9-48b7-88dd-2d72c042a7b9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:17.714989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b6fde58f-06f9-48b7-88dd-2d72c042a7b9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a54b58871fb4504bdafa0a43292bc54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de1d9bd9e8b54aa2844f093a2ef1d05e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:17.722848 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b6fde58f-06f9-48b7-88dd-2d72c042a7b9 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 200 len: 1502 microversion: 2.1 time: 0.227305 Oct 18 14:13:17.737332 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3519/6833] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:17 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:13:18.094933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-fa5f99d3-0a66-4268-a074-b651d98407c6 req-73c5be2b-b3a2-4c52-96a2-1a854c3b44a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7136de3-7677-415d-ab2d-4cd5bf89ecf2", "name": "network-vif-deleted", "tag": "dca2dbaa-08d5-4585-a1c0-f23ebcf46661"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:18.108920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fa5f99d3-0a66-4268-a074-b651d98407c6 req-73c5be2b-b3a2-4c52-96a2-1a854c3b44a5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:18.109442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fa5f99d3-0a66-4268-a074-b651d98407c6 req-73c5be2b-b3a2-4c52-96a2-1a854c3b44a5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:18.109876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fa5f99d3-0a66-4268-a074-b651d98407c6 req-73c5be2b-b3a2-4c52-96a2-1a854c3b44a5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:18.122056 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-fa5f99d3-0a66-4268-a074-b651d98407c6 req-73c5be2b-b3a2-4c52-96a2-1a854c3b44a5 service nova] Creating event network-vif-deleted:dca2dbaa-08d5-4585-a1c0-f23ebcf46661 for instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 on n-h2-858384-13 Oct 18 14:13:18.127302 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-fa5f99d3-0a66-4268-a074-b651d98407c6 req-73c5be2b-b3a2-4c52-96a2-1a854c3b44a5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037537 Oct 18 14:13:18.127923 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3315/6834] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:13:18.746900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-630040fc-4043-4e71-b911-334f034e168e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:18.747540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-630040fc-4043-4e71-b911-334f034e168e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:18.754495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-630040fc-4043-4e71-b911-334f034e168e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:18.754996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-630040fc-4043-4e71-b911-334f034e168e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:18.755453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-630040fc-4043-4e71-b911-334f034e168e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:18.756157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-630040fc-4043-4e71-b911-334f034e168e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:18.756630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-630040fc-4043-4e71-b911-334f034e168e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:18.757072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-630040fc-4043-4e71-b911-334f034e168e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:18.770806 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-630040fc-4043-4e71-b911-334f034e168e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] HTTP exception thrown: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-630040fc-4043-4e71-b911-334f034e168e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Request method failure captured: Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 HTTP/1.1 Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrRKMnHeQnfcvC1o7LHMHC857jOajg39znNIrC_fMSYNUScsRfpf5Wbx8q0NaH-s_tyQbXtkTbfXVERrR9DBgrFwOcLF6ppRMAE86YAR0BiOMnJ5IWKoQNj8sa7BpfEqfALPtxQ_4Al19jTkdUCHhtVkvJCABWlmjo0s8VmDGRcXqa8 Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: de1d9bd9e8b54aa2844f093a2ef1d05e Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-472887218 Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de1d9bd9e8b54aa2844f093a2ef1d05e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/de1d9bd9e8b54aa2844f093a2ef1d05e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de1d9bd9e8b54aa2844f093a2ef1d05e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_de1d9bd9e8b54aa2844f093a2ef1d05e"}]}] Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-472887218 Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: de1d9bd9e8b54aa2844f093a2ef1d05e Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-472887218 Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-472887218-project Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 4a54b58871fb4504bdafa0a43292bc54 Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-472887218-project Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'b7136de3-7677-415d-ab2d-4cd5bf89ecf2'} Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:13:18.772460 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.777725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:18.777725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:13:18.777725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:13:18.777725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:13:18.777725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:13:18.777725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.777725 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.777725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-630040fc-4043-4e71-b911-334f034e168e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Returning 404 to user: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:13:18.777725 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-630040fc-4043-4e71-b911-334f034e168e tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 404 len: 111 microversion: 2.1 time: 0.031263 Oct 18 14:13:18.777725 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3520/6835] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:18 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:13:18.789904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22a88799-d479-499e-ab83-f5de6db992fd tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:18.790489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-22a88799-d479-499e-ab83-f5de6db992fd tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:18.797732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22a88799-d479-499e-ab83-f5de6db992fd tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:18.798215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22a88799-d479-499e-ab83-f5de6db992fd tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:18.798651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22a88799-d479-499e-ab83-f5de6db992fd tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:18.799344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22a88799-d479-499e-ab83-f5de6db992fd tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:18.799794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22a88799-d479-499e-ab83-f5de6db992fd tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:18.800220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22a88799-d479-499e-ab83-f5de6db992fd tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:18.813727 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-22a88799-d479-499e-ab83-f5de6db992fd tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] HTTP exception thrown: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22a88799-d479-499e-ab83-f5de6db992fd tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Request method failure captured: Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 HTTP/1.1 Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrRKMnHeQnfcvC1o7LHMHC857jOajg39znNIrC_fMSYNUScsRfpf5Wbx8q0NaH-s_tyQbXtkTbfXVERrR9DBgrFwOcLF6ppRMAE86YAR0BiOMnJ5IWKoQNj8sa7BpfEqfALPtxQ_4Al19jTkdUCHhtVkvJCABWlmjo0s8VmDGRcXqa8 Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: de1d9bd9e8b54aa2844f093a2ef1d05e Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-DeleteServersTestJSON-472887218 Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de1d9bd9e8b54aa2844f093a2ef1d05e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/de1d9bd9e8b54aa2844f093a2ef1d05e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de1d9bd9e8b54aa2844f093a2ef1d05e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_de1d9bd9e8b54aa2844f093a2ef1d05e"}]}] Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-DeleteServersTestJSON-472887218 Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: de1d9bd9e8b54aa2844f093a2ef1d05e Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-DeleteServersTestJSON-472887218 Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-DeleteServersTestJSON-472887218-project Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 4a54b58871fb4504bdafa0a43292bc54 Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-DeleteServersTestJSON-472887218-project Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'b7136de3-7677-415d-ab2d-4cd5bf89ecf2'} Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:13:18.815343 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22a88799-d479-499e-ab83-f5de6db992fd tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Returning 404 to user: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-22a88799-d479-499e-ab83-f5de6db992fd tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 404 len: 111 microversion: 2.1 time: 0.031132 Oct 18 14:13:18.820573 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3316/6836] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:13:18 2022] DELETE /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:13:18.825543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa2fa527-5dff-494b-b322-f5bb211c9801 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:18.826184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fa2fa527-5dff-494b-b322-f5bb211c9801 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] [instance: b7136de3-7677-415d-ab2d-4cd5bf89ecf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:18.832819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa2fa527-5dff-494b-b322-f5bb211c9801 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:18.833356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa2fa527-5dff-494b-b322-f5bb211c9801 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:18.833825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa2fa527-5dff-494b-b322-f5bb211c9801 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:18.834533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa2fa527-5dff-494b-b322-f5bb211c9801 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:18.835006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa2fa527-5dff-494b-b322-f5bb211c9801 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:18.835447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa2fa527-5dff-494b-b322-f5bb211c9801 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:18.849689 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-fa2fa527-5dff-494b-b322-f5bb211c9801 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] HTTP exception thrown: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa2fa527-5dff-494b-b322-f5bb211c9801 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Request method failure captured: Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 HTTP/1.1 Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrRKMnHeQnfcvC1o7LHMHC857jOajg39znNIrC_fMSYNUScsRfpf5Wbx8q0NaH-s_tyQbXtkTbfXVERrR9DBgrFwOcLF6ppRMAE86YAR0BiOMnJ5IWKoQNj8sa7BpfEqfALPtxQ_4Al19jTkdUCHhtVkvJCABWlmjo0s8VmDGRcXqa8 Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: de1d9bd9e8b54aa2844f093a2ef1d05e Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-DeleteServersTestJSON-472887218 Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de1d9bd9e8b54aa2844f093a2ef1d05e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/de1d9bd9e8b54aa2844f093a2ef1d05e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/de1d9bd9e8b54aa2844f093a2ef1d05e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_de1d9bd9e8b54aa2844f093a2ef1d05e"}]}] Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-DeleteServersTestJSON-472887218 Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: de1d9bd9e8b54aa2844f093a2ef1d05e Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-DeleteServersTestJSON-472887218 Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-DeleteServersTestJSON-472887218-project Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 4a54b58871fb4504bdafa0a43292bc54 Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-DeleteServersTestJSON-472887218-project Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'b7136de3-7677-415d-ab2d-4cd5bf89ecf2'} Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:13:18.851238 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.856524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:13:18.856524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:13:18.856524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:13:18.856524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:13:18.856524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:13:18.856524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. Oct 18 14:13:18.856524 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:13:18.856524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa2fa527-5dff-494b-b322-f5bb211c9801 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] Returning 404 to user: Instance b7136de3-7677-415d-ab2d-4cd5bf89ecf2 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:13:18.856524 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fa2fa527-5dff-494b-b322-f5bb211c9801 tempest-DeleteServersTestJSON-472887218 tempest-DeleteServersTestJSON-472887218-project] 10.222.0.40 "GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2" status: 404 len: 111 microversion: 2.1 time: 0.031350 Oct 18 14:13:18.856524 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3521/6837] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:18 2022] GET /compute/v2.1/servers/b7136de3-7677-415d-ab2d-4cd5bf89ecf2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:13:27.388899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1695863440", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "281f7550-0f04-4d45-b670-d698744d9174"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:27.445420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] validate_networks() for [('281f7550-0f04-4d45-b670-d698744d9174', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:13:28.131532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:13:28.132036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:13:28.132522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:13:28.132934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:13:28.133386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:13:28.143353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:28.143834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:28.144269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:28.145002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:28.145482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:28.145913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:28.164071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Getting quotas for project cf6006fcbd1c4874b9996dde9da39e14. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:13:28.169830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Getting quotas for user 9f8a9c9ba575492cbf67914c5f4bbabb and project cf6006fcbd1c4874b9996dde9da39e14. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:13:28.182387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:13:28.184743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:13:28.233221 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-90b4d4f4-2959-4738-a001-d4835f92539f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961956 Oct 18 14:13:28.240352 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3317/6838] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:13:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:13:28.249571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32bf0950-eb83-4c4c-8086-84d427987ebe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:28.250884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-32bf0950-eb83-4c4c-8086-84d427987ebe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:28.316278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-32bf0950-eb83-4c4c-8086-84d427987ebe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:28.325676 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-32bf0950-eb83-4c4c-8086-84d427987ebe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1218 microversion: 2.1 time: 0.083150 Oct 18 14:13:28.326656 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3522/6839] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:28 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:29.353029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a25cb812-cb9f-4f09-b2fd-0ecc5b8778c4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:29.355632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a25cb812-cb9f-4f09-b2fd-0ecc5b8778c4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:29.372440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25cb812-cb9f-4f09-b2fd-0ecc5b8778c4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:29.373478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25cb812-cb9f-4f09-b2fd-0ecc5b8778c4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:29.373998 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25cb812-cb9f-4f09-b2fd-0ecc5b8778c4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:29.374728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25cb812-cb9f-4f09-b2fd-0ecc5b8778c4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:29.375301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25cb812-cb9f-4f09-b2fd-0ecc5b8778c4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:29.375689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a25cb812-cb9f-4f09-b2fd-0ecc5b8778c4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:29.450732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a25cb812-cb9f-4f09-b2fd-0ecc5b8778c4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:29.459847 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a25cb812-cb9f-4f09-b2fd-0ecc5b8778c4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1288 microversion: 2.1 time: 0.114213 Oct 18 14:13:29.460994 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3318/6840] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:29 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1288 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:30.488061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-18aef4d7-698b-4a89-ab39-28bdda6cff5e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:30.488988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-18aef4d7-698b-4a89-ab39-28bdda6cff5e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:30.491686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:30.499960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18aef4d7-698b-4a89-ab39-28bdda6cff5e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:30.500518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18aef4d7-698b-4a89-ab39-28bdda6cff5e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:30.500969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18aef4d7-698b-4a89-ab39-28bdda6cff5e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:30.501706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18aef4d7-698b-4a89-ab39-28bdda6cff5e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:30.502176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18aef4d7-698b-4a89-ab39-28bdda6cff5e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:30.502616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18aef4d7-698b-4a89-ab39-28bdda6cff5e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:30.739942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-18aef4d7-698b-4a89-ab39-28bdda6cff5e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:30.748566 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-18aef4d7-698b-4a89-ab39-28bdda6cff5e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1318 microversion: 2.1 time: 0.264439 Oct 18 14:13:30.749159 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3523/6841] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:30 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:30.934341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-88e86962-3385-427c-976e-3964d05b58ad req-4684fd94-7cf4-4e57-8cf3-c95861c531d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d9a3dc-2f99-4575-9c49-3a99c775fe64", "tag": "1be59c69-5493-44b4-b0fe-587e287906c1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:30.945119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-88e86962-3385-427c-976e-3964d05b58ad req-4684fd94-7cf4-4e57-8cf3-c95861c531d9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:30.945871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-88e86962-3385-427c-976e-3964d05b58ad req-4684fd94-7cf4-4e57-8cf3-c95861c531d9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:30.946387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-88e86962-3385-427c-976e-3964d05b58ad req-4684fd94-7cf4-4e57-8cf3-c95861c531d9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:30.960163 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-88e86962-3385-427c-976e-3964d05b58ad req-4684fd94-7cf4-4e57-8cf3-c95861c531d9 service nova] Creating event network-changed:1be59c69-5493-44b4-b0fe-587e287906c1 for instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 on n-h2-858384-13 Oct 18 14:13:30.965606 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-88e86962-3385-427c-976e-3964d05b58ad req-4684fd94-7cf4-4e57-8cf3-c95861c531d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035480 Oct 18 14:13:30.966402 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3319/6842] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:13:31.772557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ec31df57-dce0-4001-9b78-97800957b294 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:31.773102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ec31df57-dce0-4001-9b78-97800957b294 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:31.780360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec31df57-dce0-4001-9b78-97800957b294 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:31.780863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec31df57-dce0-4001-9b78-97800957b294 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:31.781359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec31df57-dce0-4001-9b78-97800957b294 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:31.782069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec31df57-dce0-4001-9b78-97800957b294 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:31.782543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec31df57-dce0-4001-9b78-97800957b294 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:31.782985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec31df57-dce0-4001-9b78-97800957b294 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:31.919629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ec31df57-dce0-4001-9b78-97800957b294 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:31.927482 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ec31df57-dce0-4001-9b78-97800957b294 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1318 microversion: 2.1 time: 0.158951 Oct 18 14:13:31.928089 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3524/6843] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:31 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:32.952645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2b88b179-f9c2-41d7-ba56-7cbb5bd5a772 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:32.953316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2b88b179-f9c2-41d7-ba56-7cbb5bd5a772 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:32.959791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b88b179-f9c2-41d7-ba56-7cbb5bd5a772 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:32.960270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b88b179-f9c2-41d7-ba56-7cbb5bd5a772 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:32.960709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b88b179-f9c2-41d7-ba56-7cbb5bd5a772 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:32.961434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b88b179-f9c2-41d7-ba56-7cbb5bd5a772 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:32.961885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b88b179-f9c2-41d7-ba56-7cbb5bd5a772 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:32.962312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2b88b179-f9c2-41d7-ba56-7cbb5bd5a772 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:33.357473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2b88b179-f9c2-41d7-ba56-7cbb5bd5a772 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:33.365454 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2b88b179-f9c2-41d7-ba56-7cbb5bd5a772 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1318 microversion: 2.1 time: 0.418616 Oct 18 14:13:33.366026 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3320/6844] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:32 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:34.388764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d7d2ad1-7384-4a92-b9c7-eb1fa07218f4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:34.389469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d7d2ad1-7384-4a92-b9c7-eb1fa07218f4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:34.396834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d7d2ad1-7384-4a92-b9c7-eb1fa07218f4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:34.397439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d7d2ad1-7384-4a92-b9c7-eb1fa07218f4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:34.397846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d7d2ad1-7384-4a92-b9c7-eb1fa07218f4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:34.398783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d7d2ad1-7384-4a92-b9c7-eb1fa07218f4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:34.399050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d7d2ad1-7384-4a92-b9c7-eb1fa07218f4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:34.399585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d7d2ad1-7384-4a92-b9c7-eb1fa07218f4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:34.535371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d7d2ad1-7384-4a92-b9c7-eb1fa07218f4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:34.543461 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d7d2ad1-7384-4a92-b9c7-eb1fa07218f4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1318 microversion: 2.1 time: 0.159390 Oct 18 14:13:34.544039 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3525/6845] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:34 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:35.352147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-db06c1bf-870c-4a99-8a5b-6760191353c1 req-30832177-455a-46aa-9b8d-be0527c1e59d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d9a3dc-2f99-4575-9c49-3a99c775fe64", "name": "network-vif-plugged", "status": "completed", "tag": "1be59c69-5493-44b4-b0fe-587e287906c1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:35.358585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:35.364839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-db06c1bf-870c-4a99-8a5b-6760191353c1 req-30832177-455a-46aa-9b8d-be0527c1e59d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:35.365372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-db06c1bf-870c-4a99-8a5b-6760191353c1 req-30832177-455a-46aa-9b8d-be0527c1e59d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:35.365791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-db06c1bf-870c-4a99-8a5b-6760191353c1 req-30832177-455a-46aa-9b8d-be0527c1e59d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:35.370425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=62 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:35.378893 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-db06c1bf-870c-4a99-8a5b-6760191353c1 req-30832177-455a-46aa-9b8d-be0527c1e59d service nova] Creating event network-vif-plugged:1be59c69-5493-44b4-b0fe-587e287906c1 for instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 on n-h2-858384-13 Oct 18 14:13:35.383988 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-db06c1bf-870c-4a99-8a5b-6760191353c1 req-30832177-455a-46aa-9b8d-be0527c1e59d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035721 Oct 18 14:13:35.384606 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3321/6846] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:13:35.566959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-00661a64-8970-4ab4-80d9-c2fa74a893f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:35.567593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-00661a64-8970-4ab4-80d9-c2fa74a893f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:35.575294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00661a64-8970-4ab4-80d9-c2fa74a893f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:35.575791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00661a64-8970-4ab4-80d9-c2fa74a893f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:35.576239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00661a64-8970-4ab4-80d9-c2fa74a893f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:35.576943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00661a64-8970-4ab4-80d9-c2fa74a893f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:35.577434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00661a64-8970-4ab4-80d9-c2fa74a893f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:35.577878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00661a64-8970-4ab4-80d9-c2fa74a893f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:35.710898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-00661a64-8970-4ab4-80d9-c2fa74a893f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:35.720361 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-00661a64-8970-4ab4-80d9-c2fa74a893f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1318 microversion: 2.1 time: 0.157264 Oct 18 14:13:35.720951 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3526/6847] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:35 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:36.749618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6cfce76f-e4f7-4554-97ea-9ea5857e35b7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:36.749618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6cfce76f-e4f7-4554-97ea-9ea5857e35b7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:36.753927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cfce76f-e4f7-4554-97ea-9ea5857e35b7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:36.754935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cfce76f-e4f7-4554-97ea-9ea5857e35b7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:36.755076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cfce76f-e4f7-4554-97ea-9ea5857e35b7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:36.755745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cfce76f-e4f7-4554-97ea-9ea5857e35b7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:36.756193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cfce76f-e4f7-4554-97ea-9ea5857e35b7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:36.756616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cfce76f-e4f7-4554-97ea-9ea5857e35b7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:36.893106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6cfce76f-e4f7-4554-97ea-9ea5857e35b7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:36.902833 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6cfce76f-e4f7-4554-97ea-9ea5857e35b7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1508 microversion: 2.1 time: 0.162524 Oct 18 14:13:36.903441 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3322/6848] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:36 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:36.926525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b2551968-57b9-4e20-b5ad-65db46a51d13 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:36.927188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b2551968-57b9-4e20-b5ad-65db46a51d13 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:36.928792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:36.935375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2551968-57b9-4e20-b5ad-65db46a51d13 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:36.935809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2551968-57b9-4e20-b5ad-65db46a51d13 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:36.936265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2551968-57b9-4e20-b5ad-65db46a51d13 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:36.936991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2551968-57b9-4e20-b5ad-65db46a51d13 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:36.937496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2551968-57b9-4e20-b5ad-65db46a51d13 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:36.937945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2551968-57b9-4e20-b5ad-65db46a51d13 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:37.087556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b2551968-57b9-4e20-b5ad-65db46a51d13 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:37.096407 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b2551968-57b9-4e20-b5ad-65db46a51d13 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1508 microversion: 2.1 time: 0.174948 Oct 18 14:13:37.097063 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3527/6849] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:36 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:37.119157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b15850ab-1ff3-48f3-b4b6-d953980a823f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:37.122186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b15850ab-1ff3-48f3-b4b6-d953980a823f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:37.128531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b15850ab-1ff3-48f3-b4b6-d953980a823f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:37.129012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b15850ab-1ff3-48f3-b4b6-d953980a823f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:37.129470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b15850ab-1ff3-48f3-b4b6-d953980a823f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:37.130168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b15850ab-1ff3-48f3-b4b6-d953980a823f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:37.130614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b15850ab-1ff3-48f3-b4b6-d953980a823f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:37.131032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b15850ab-1ff3-48f3-b4b6-d953980a823f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:37.201845 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b15850ab-1ff3-48f3-b4b6-d953980a823f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "PUT /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1080 microversion: 2.1 time: 0.086461 Oct 18 14:13:37.202385 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3323/6850] 10.222.0.40 () {60 vars in 1256 bytes} [Tue Oct 18 14:13:37 2022] PUT /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1080 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:37.225607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b7acd885-396e-49af-a101-8dac31b6e1c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:37.226499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7acd885-396e-49af-a101-8dac31b6e1c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:37.234807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7acd885-396e-49af-a101-8dac31b6e1c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:37.235317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7acd885-396e-49af-a101-8dac31b6e1c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:37.235777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7acd885-396e-49af-a101-8dac31b6e1c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:37.236511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7acd885-396e-49af-a101-8dac31b6e1c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:37.236996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7acd885-396e-49af-a101-8dac31b6e1c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:37.237499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7acd885-396e-49af-a101-8dac31b6e1c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:37.396476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7acd885-396e-49af-a101-8dac31b6e1c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:37.405143 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b7acd885-396e-49af-a101-8dac31b6e1c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1506 microversion: 2.1 time: 0.185362 Oct 18 14:13:37.405762 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3528/6851] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:37 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:37.428989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7d5afa5-2515-4a13-af86-08e2cff14f32 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:37.429668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f7d5afa5-2515-4a13-af86-08e2cff14f32 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:37.435984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7d5afa5-2515-4a13-af86-08e2cff14f32 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:37.436466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7d5afa5-2515-4a13-af86-08e2cff14f32 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:37.436906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7d5afa5-2515-4a13-af86-08e2cff14f32 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:37.437647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7d5afa5-2515-4a13-af86-08e2cff14f32 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:37.438106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7d5afa5-2515-4a13-af86-08e2cff14f32 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:37.438536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7d5afa5-2515-4a13-af86-08e2cff14f32 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:37.580110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f7d5afa5-2515-4a13-af86-08e2cff14f32 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:37.588200 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f7d5afa5-2515-4a13-af86-08e2cff14f32 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1506 microversion: 2.1 time: 0.163550 Oct 18 14:13:37.589299 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3324/6852] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:37 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:37.611433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:13:37.613842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:37.620136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:37.620739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:37.621204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:37.621922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:37.622386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:37.622824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:37.653032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:37.659049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Old instance type m1.heat2, new instance type m1.heat {{(pid=120611) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:13:37.668544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:13:37.669544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:13:37.670039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:13:37.670462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:13:37.670891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:13:37.740894 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c5579766-72b2-48c7-b719-c3b9376cf0a3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "POST /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64/action" status: 202 len: 0 microversion: 2.1 time: 0.133360 Oct 18 14:13:37.741571 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3529/6853] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:13:37 2022] POST /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:13:37.751052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a4297d50-8901-4a70-ae09-46509179cf8b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:37.751749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a4297d50-8901-4a70-ae09-46509179cf8b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:37.759166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4297d50-8901-4a70-ae09-46509179cf8b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:37.759718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4297d50-8901-4a70-ae09-46509179cf8b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:37.761061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4297d50-8901-4a70-ae09-46509179cf8b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:37.761684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4297d50-8901-4a70-ae09-46509179cf8b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:37.762326 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4297d50-8901-4a70-ae09-46509179cf8b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:37.762762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4297d50-8901-4a70-ae09-46509179cf8b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:37.921356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a4297d50-8901-4a70-ae09-46509179cf8b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:37.929253 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a4297d50-8901-4a70-ae09-46509179cf8b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1517 microversion: 2.1 time: 0.182611 Oct 18 14:13:37.929820 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3325/6854] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:37 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:13:38.950085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:38.954243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dfa8977e-37a4-4c7d-9d97-3c42967ffbf3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:38.954887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dfa8977e-37a4-4c7d-9d97-3c42967ffbf3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:38.965960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfa8977e-37a4-4c7d-9d97-3c42967ffbf3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:38.966464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfa8977e-37a4-4c7d-9d97-3c42967ffbf3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:38.966923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfa8977e-37a4-4c7d-9d97-3c42967ffbf3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:38.967637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfa8977e-37a4-4c7d-9d97-3c42967ffbf3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:38.968112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfa8977e-37a4-4c7d-9d97-3c42967ffbf3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:38.968553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dfa8977e-37a4-4c7d-9d97-3c42967ffbf3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:39.190271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dfa8977e-37a4-4c7d-9d97-3c42967ffbf3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:39.199840 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dfa8977e-37a4-4c7d-9d97-3c42967ffbf3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1517 microversion: 2.1 time: 0.251500 Oct 18 14:13:39.201082 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3530/6855] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:38 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1517 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:40.224103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-182373f4-d5d0-42f6-904b-1640e349c452 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:40.224719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-182373f4-d5d0-42f6-904b-1640e349c452 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:40.227335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:40.228263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:40.236132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-182373f4-d5d0-42f6-904b-1640e349c452 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:40.236664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-182373f4-d5d0-42f6-904b-1640e349c452 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:40.237050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-182373f4-d5d0-42f6-904b-1640e349c452 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:40.237937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-182373f4-d5d0-42f6-904b-1640e349c452 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:40.238387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-182373f4-d5d0-42f6-904b-1640e349c452 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:40.238809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-182373f4-d5d0-42f6-904b-1640e349c452 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:40.374841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-182373f4-d5d0-42f6-904b-1640e349c452 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:40.382679 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-182373f4-d5d0-42f6-904b-1640e349c452 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.162413 Oct 18 14:13:40.383261 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3326/6856] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:40 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:41.405497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3216b6d6-fda5-43fc-831f-1dbf86aa547e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:41.406072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3216b6d6-fda5-43fc-831f-1dbf86aa547e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:41.412919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3216b6d6-fda5-43fc-831f-1dbf86aa547e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:41.413450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3216b6d6-fda5-43fc-831f-1dbf86aa547e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:41.413905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3216b6d6-fda5-43fc-831f-1dbf86aa547e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:41.414618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3216b6d6-fda5-43fc-831f-1dbf86aa547e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:41.415088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3216b6d6-fda5-43fc-831f-1dbf86aa547e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:41.415528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3216b6d6-fda5-43fc-831f-1dbf86aa547e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:41.556007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3216b6d6-fda5-43fc-831f-1dbf86aa547e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:41.564683 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3216b6d6-fda5-43fc-831f-1dbf86aa547e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.163216 Oct 18 14:13:41.565289 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3531/6857] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:41 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:42.587780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b7d45636-4e77-494f-95dd-58fa32acaa9d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:42.588381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b7d45636-4e77-494f-95dd-58fa32acaa9d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:42.595860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7d45636-4e77-494f-95dd-58fa32acaa9d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:42.596331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7d45636-4e77-494f-95dd-58fa32acaa9d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:42.596758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7d45636-4e77-494f-95dd-58fa32acaa9d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:42.597474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7d45636-4e77-494f-95dd-58fa32acaa9d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:42.597922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7d45636-4e77-494f-95dd-58fa32acaa9d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:42.598341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7d45636-4e77-494f-95dd-58fa32acaa9d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:42.729727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b7d45636-4e77-494f-95dd-58fa32acaa9d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:42.737632 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b7d45636-4e77-494f-95dd-58fa32acaa9d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.153739 Oct 18 14:13:42.738211 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3327/6858] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:42 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:43.760843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e8170948-f5f8-481b-953c-bc7992dc6a46 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:43.762024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e8170948-f5f8-481b-953c-bc7992dc6a46 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:43.768935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8170948-f5f8-481b-953c-bc7992dc6a46 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:43.769465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8170948-f5f8-481b-953c-bc7992dc6a46 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:43.769916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8170948-f5f8-481b-953c-bc7992dc6a46 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:43.770620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8170948-f5f8-481b-953c-bc7992dc6a46 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:43.771087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8170948-f5f8-481b-953c-bc7992dc6a46 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:43.771525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8170948-f5f8-481b-953c-bc7992dc6a46 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:43.907320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e8170948-f5f8-481b-953c-bc7992dc6a46 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:43.915261 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e8170948-f5f8-481b-953c-bc7992dc6a46 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.158647 Oct 18 14:13:43.915843 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3532/6859] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:43 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:44.938640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-01ff79aa-4f0d-4706-99dc-51ab7a35b07d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:44.939274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-01ff79aa-4f0d-4706-99dc-51ab7a35b07d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:44.946098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01ff79aa-4f0d-4706-99dc-51ab7a35b07d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:44.946571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01ff79aa-4f0d-4706-99dc-51ab7a35b07d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:44.947001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01ff79aa-4f0d-4706-99dc-51ab7a35b07d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:44.948028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01ff79aa-4f0d-4706-99dc-51ab7a35b07d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:44.948482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01ff79aa-4f0d-4706-99dc-51ab7a35b07d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:44.949209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01ff79aa-4f0d-4706-99dc-51ab7a35b07d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:45.082666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-01ff79aa-4f0d-4706-99dc-51ab7a35b07d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:45.091153 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-01ff79aa-4f0d-4706-99dc-51ab7a35b07d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.156525 Oct 18 14:13:45.091738 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3328/6860] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:44 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:46.115670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f5419f29-2fdf-4be5-bb4d-9dd5369230e1 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:46.116300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f5419f29-2fdf-4be5-bb4d-9dd5369230e1 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:46.123184 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5419f29-2fdf-4be5-bb4d-9dd5369230e1 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:46.123680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5419f29-2fdf-4be5-bb4d-9dd5369230e1 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:46.124128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5419f29-2fdf-4be5-bb4d-9dd5369230e1 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:46.124826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5419f29-2fdf-4be5-bb4d-9dd5369230e1 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:46.125332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5419f29-2fdf-4be5-bb4d-9dd5369230e1 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:46.125769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5419f29-2fdf-4be5-bb4d-9dd5369230e1 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:46.259059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f5419f29-2fdf-4be5-bb4d-9dd5369230e1 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:46.267494 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f5419f29-2fdf-4be5-bb4d-9dd5369230e1 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.155968 Oct 18 14:13:46.268078 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3533/6861] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:46 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:47.291374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-092da388-ce11-4a3c-a8d1-229e0bdac6e2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:47.292106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-092da388-ce11-4a3c-a8d1-229e0bdac6e2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:47.299475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-092da388-ce11-4a3c-a8d1-229e0bdac6e2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:47.299951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-092da388-ce11-4a3c-a8d1-229e0bdac6e2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:47.300480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-092da388-ce11-4a3c-a8d1-229e0bdac6e2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:47.301174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-092da388-ce11-4a3c-a8d1-229e0bdac6e2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:47.301648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-092da388-ce11-4a3c-a8d1-229e0bdac6e2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:47.302069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-092da388-ce11-4a3c-a8d1-229e0bdac6e2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:47.440435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-092da388-ce11-4a3c-a8d1-229e0bdac6e2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:47.448203 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-092da388-ce11-4a3c-a8d1-229e0bdac6e2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.160845 Oct 18 14:13:47.449585 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3329/6862] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:47 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:48.472167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ee270f4e-389d-4646-8498-881bf2fa386b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:48.472802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ee270f4e-389d-4646-8498-881bf2fa386b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:48.479825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee270f4e-389d-4646-8498-881bf2fa386b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:48.480677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee270f4e-389d-4646-8498-881bf2fa386b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:48.481135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee270f4e-389d-4646-8498-881bf2fa386b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:48.481968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee270f4e-389d-4646-8498-881bf2fa386b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:48.482793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee270f4e-389d-4646-8498-881bf2fa386b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:48.483569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee270f4e-389d-4646-8498-881bf2fa386b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:48.615624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ee270f4e-389d-4646-8498-881bf2fa386b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:48.624450 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ee270f4e-389d-4646-8498-881bf2fa386b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.156195 Oct 18 14:13:48.624979 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3534/6863] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:48 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:49.648446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-052ce030-1d4c-40a2-8256-7342cbad71b3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:49.649093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-052ce030-1d4c-40a2-8256-7342cbad71b3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:49.656624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-052ce030-1d4c-40a2-8256-7342cbad71b3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:49.657106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-052ce030-1d4c-40a2-8256-7342cbad71b3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:49.657580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-052ce030-1d4c-40a2-8256-7342cbad71b3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:49.658269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-052ce030-1d4c-40a2-8256-7342cbad71b3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:49.658720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-052ce030-1d4c-40a2-8256-7342cbad71b3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:49.659144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-052ce030-1d4c-40a2-8256-7342cbad71b3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:49.793095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-052ce030-1d4c-40a2-8256-7342cbad71b3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:49.800863 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-052ce030-1d4c-40a2-8256-7342cbad71b3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.156318 Oct 18 14:13:49.801470 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3330/6864] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:49 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:50.824542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c529e764-5550-4e48-a4e3-1aeba0ec1382 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:50.825257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c529e764-5550-4e48-a4e3-1aeba0ec1382 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:50.832524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c529e764-5550-4e48-a4e3-1aeba0ec1382 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:50.833006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c529e764-5550-4e48-a4e3-1aeba0ec1382 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:50.833485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c529e764-5550-4e48-a4e3-1aeba0ec1382 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:50.834198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c529e764-5550-4e48-a4e3-1aeba0ec1382 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:50.834670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c529e764-5550-4e48-a4e3-1aeba0ec1382 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:50.835113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c529e764-5550-4e48-a4e3-1aeba0ec1382 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:50.976066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c529e764-5550-4e48-a4e3-1aeba0ec1382 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:50.984857 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c529e764-5550-4e48-a4e3-1aeba0ec1382 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.164531 Oct 18 14:13:50.985490 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3535/6865] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:50 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:52.007988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5283ed86-8f34-4c74-b001-b16ae7368dd0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:52.008580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5283ed86-8f34-4c74-b001-b16ae7368dd0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:52.016455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5283ed86-8f34-4c74-b001-b16ae7368dd0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:52.016943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5283ed86-8f34-4c74-b001-b16ae7368dd0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:52.017426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5283ed86-8f34-4c74-b001-b16ae7368dd0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:52.018124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5283ed86-8f34-4c74-b001-b16ae7368dd0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:52.018581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5283ed86-8f34-4c74-b001-b16ae7368dd0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:52.019037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5283ed86-8f34-4c74-b001-b16ae7368dd0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:52.152003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5283ed86-8f34-4c74-b001-b16ae7368dd0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:52.160053 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5283ed86-8f34-4c74-b001-b16ae7368dd0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.155985 Oct 18 14:13:52.160637 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3331/6866] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:52 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:53.183979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f4cf2ad1-78c3-4b05-918f-24942d94fe53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:53.184608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f4cf2ad1-78c3-4b05-918f-24942d94fe53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:53.191640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4cf2ad1-78c3-4b05-918f-24942d94fe53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:53.192142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4cf2ad1-78c3-4b05-918f-24942d94fe53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:53.192598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4cf2ad1-78c3-4b05-918f-24942d94fe53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:53.193342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4cf2ad1-78c3-4b05-918f-24942d94fe53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:53.193820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4cf2ad1-78c3-4b05-918f-24942d94fe53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:53.194266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4cf2ad1-78c3-4b05-918f-24942d94fe53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:53.331446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f4cf2ad1-78c3-4b05-918f-24942d94fe53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:53.339823 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f4cf2ad1-78c3-4b05-918f-24942d94fe53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.159317 Oct 18 14:13:53.340412 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3536/6867] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:53 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:54.363119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9f9df0d3-068a-4b11-8389-629dd9acb71b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:54.363701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9f9df0d3-068a-4b11-8389-629dd9acb71b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:54.371069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f9df0d3-068a-4b11-8389-629dd9acb71b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:54.371634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f9df0d3-068a-4b11-8389-629dd9acb71b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:54.371966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f9df0d3-068a-4b11-8389-629dd9acb71b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:54.372653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f9df0d3-068a-4b11-8389-629dd9acb71b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:54.373098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f9df0d3-068a-4b11-8389-629dd9acb71b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:54.373545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f9df0d3-068a-4b11-8389-629dd9acb71b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:54.506637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9f9df0d3-068a-4b11-8389-629dd9acb71b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:54.516894 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9f9df0d3-068a-4b11-8389-629dd9acb71b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.157415 Oct 18 14:13:54.517625 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3332/6868] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:54 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:55.541547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f5e62a40-2a41-4a7c-9435-1b77a2a98865 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:55.542840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f5e62a40-2a41-4a7c-9435-1b77a2a98865 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:55.550085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5e62a40-2a41-4a7c-9435-1b77a2a98865 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:55.550584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5e62a40-2a41-4a7c-9435-1b77a2a98865 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:55.551037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5e62a40-2a41-4a7c-9435-1b77a2a98865 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:55.551744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5e62a40-2a41-4a7c-9435-1b77a2a98865 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:55.552216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5e62a40-2a41-4a7c-9435-1b77a2a98865 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:55.552660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5e62a40-2a41-4a7c-9435-1b77a2a98865 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:55.683086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f5e62a40-2a41-4a7c-9435-1b77a2a98865 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:55.690792 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f5e62a40-2a41-4a7c-9435-1b77a2a98865 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.153228 Oct 18 14:13:55.691396 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3537/6869] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:55 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:56.714472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3a355c0e-e19c-4872-88dd-2a4ea5deb454 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:56.715024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3a355c0e-e19c-4872-88dd-2a4ea5deb454 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:56.721849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a355c0e-e19c-4872-88dd-2a4ea5deb454 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:56.722331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a355c0e-e19c-4872-88dd-2a4ea5deb454 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:56.722760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a355c0e-e19c-4872-88dd-2a4ea5deb454 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:56.723454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a355c0e-e19c-4872-88dd-2a4ea5deb454 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:56.723900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a355c0e-e19c-4872-88dd-2a4ea5deb454 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:56.724319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a355c0e-e19c-4872-88dd-2a4ea5deb454 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:56.862449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3a355c0e-e19c-4872-88dd-2a4ea5deb454 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:56.871360 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3a355c0e-e19c-4872-88dd-2a4ea5deb454 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.159988 Oct 18 14:13:56.872032 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3333/6870] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:56 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:57.900183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0072b681-80de-4116-93d6-4e2187a410f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:57.900817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0072b681-80de-4116-93d6-4e2187a410f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:57.907761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0072b681-80de-4116-93d6-4e2187a410f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:57.908258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0072b681-80de-4116-93d6-4e2187a410f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:57.908709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0072b681-80de-4116-93d6-4e2187a410f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:57.909446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0072b681-80de-4116-93d6-4e2187a410f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:57.909921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0072b681-80de-4116-93d6-4e2187a410f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:57.910364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0072b681-80de-4116-93d6-4e2187a410f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:57.914437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:13:58.046458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0072b681-80de-4116-93d6-4e2187a410f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:58.054332 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0072b681-80de-4116-93d6-4e2187a410f9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.158108 Oct 18 14:13:58.054910 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3538/6871] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:57 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:13:59.079424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4fe2017d-2297-41f3-bfd2-78b5d726aa49 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:13:59.080036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4fe2017d-2297-41f3-bfd2-78b5d726aa49 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:13:59.087242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe2017d-2297-41f3-bfd2-78b5d726aa49 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:59.087722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe2017d-2297-41f3-bfd2-78b5d726aa49 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:59.088153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe2017d-2297-41f3-bfd2-78b5d726aa49 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:59.088848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe2017d-2297-41f3-bfd2-78b5d726aa49 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:13:59.089939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe2017d-2297-41f3-bfd2-78b5d726aa49 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:13:59.090368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4fe2017d-2297-41f3-bfd2-78b5d726aa49 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:13:59.327752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4fe2017d-2297-41f3-bfd2-78b5d726aa49 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:13:59.336305 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4fe2017d-2297-41f3-bfd2-78b5d726aa49 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.260428 Oct 18 14:13:59.336826 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3334/6872] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:13:59 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:00.360662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c9d6476e-be93-4b5f-9b93-453dee85d661 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:00.361264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c9d6476e-be93-4b5f-9b93-453dee85d661 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:00.368162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9d6476e-be93-4b5f-9b93-453dee85d661 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:00.368659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9d6476e-be93-4b5f-9b93-453dee85d661 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:00.369113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9d6476e-be93-4b5f-9b93-453dee85d661 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:00.369846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9d6476e-be93-4b5f-9b93-453dee85d661 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:00.371420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9d6476e-be93-4b5f-9b93-453dee85d661 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:00.371876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9d6476e-be93-4b5f-9b93-453dee85d661 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:00.503232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c9d6476e-be93-4b5f-9b93-453dee85d661 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:00.511658 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c9d6476e-be93-4b5f-9b93-453dee85d661 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.154584 Oct 18 14:14:00.512241 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3539/6873] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:00 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:01.535063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3b4fdcb1-abf1-45be-b671-e0e14017d6f8 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:01.535675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3b4fdcb1-abf1-45be-b671-e0e14017d6f8 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:01.542750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b4fdcb1-abf1-45be-b671-e0e14017d6f8 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:01.543232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b4fdcb1-abf1-45be-b671-e0e14017d6f8 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:01.543671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b4fdcb1-abf1-45be-b671-e0e14017d6f8 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:01.544360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b4fdcb1-abf1-45be-b671-e0e14017d6f8 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:01.544817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b4fdcb1-abf1-45be-b671-e0e14017d6f8 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:01.545274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3b4fdcb1-abf1-45be-b671-e0e14017d6f8 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:01.677492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3b4fdcb1-abf1-45be-b671-e0e14017d6f8 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:01.686410 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3b4fdcb1-abf1-45be-b671-e0e14017d6f8 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.155287 Oct 18 14:14:01.687003 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3335/6874] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:01 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:02.711368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2100bed5-523b-461a-95df-81c0f9ae0f1b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:02.711951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2100bed5-523b-461a-95df-81c0f9ae0f1b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:02.719149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2100bed5-523b-461a-95df-81c0f9ae0f1b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:02.719649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2100bed5-523b-461a-95df-81c0f9ae0f1b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:02.720109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2100bed5-523b-461a-95df-81c0f9ae0f1b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:02.720817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2100bed5-523b-461a-95df-81c0f9ae0f1b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:02.721318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2100bed5-523b-461a-95df-81c0f9ae0f1b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:02.721775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2100bed5-523b-461a-95df-81c0f9ae0f1b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:02.892151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2100bed5-523b-461a-95df-81c0f9ae0f1b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:02.899934 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2100bed5-523b-461a-95df-81c0f9ae0f1b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.192660 Oct 18 14:14:02.900512 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3540/6875] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:02 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:03.923970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-34d4595e-c499-45e0-a131-490380e290b4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:03.924590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-34d4595e-c499-45e0-a131-490380e290b4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:03.931621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34d4595e-c499-45e0-a131-490380e290b4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:03.932105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34d4595e-c499-45e0-a131-490380e290b4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:03.932586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34d4595e-c499-45e0-a131-490380e290b4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:03.933375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34d4595e-c499-45e0-a131-490380e290b4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:03.933853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34d4595e-c499-45e0-a131-490380e290b4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:03.934266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-34d4595e-c499-45e0-a131-490380e290b4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:04.152490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-34d4595e-c499-45e0-a131-490380e290b4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:04.160453 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-34d4595e-c499-45e0-a131-490380e290b4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.240584 Oct 18 14:14:04.161039 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3336/6876] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:03 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:05.184829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dd299f6f-ef89-48c3-9101-06c4bf54a273 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:05.185497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dd299f6f-ef89-48c3-9101-06c4bf54a273 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:05.192390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd299f6f-ef89-48c3-9101-06c4bf54a273 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:05.192888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd299f6f-ef89-48c3-9101-06c4bf54a273 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:05.193378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd299f6f-ef89-48c3-9101-06c4bf54a273 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:05.194086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd299f6f-ef89-48c3-9101-06c4bf54a273 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:05.194557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd299f6f-ef89-48c3-9101-06c4bf54a273 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:05.195004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd299f6f-ef89-48c3-9101-06c4bf54a273 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:05.329092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dd299f6f-ef89-48c3-9101-06c4bf54a273 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:05.337292 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dd299f6f-ef89-48c3-9101-06c4bf54a273 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.157284 Oct 18 14:14:05.337871 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3541/6877] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:05 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:06.361337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a1135d64-a710-4028-a671-19e843d84c6a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:06.361885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a1135d64-a710-4028-a671-19e843d84c6a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:06.364143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=32 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:06.369600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1135d64-a710-4028-a671-19e843d84c6a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:06.370249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1135d64-a710-4028-a671-19e843d84c6a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:06.371120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1135d64-a710-4028-a671-19e843d84c6a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:06.371809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1135d64-a710-4028-a671-19e843d84c6a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:06.372260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1135d64-a710-4028-a671-19e843d84c6a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:06.372682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a1135d64-a710-4028-a671-19e843d84c6a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:06.375477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:06.504322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a1135d64-a710-4028-a671-19e843d84c6a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:06.512213 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a1135d64-a710-4028-a671-19e843d84c6a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1522 microversion: 2.1 time: 0.155034 Oct 18 14:14:06.512802 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3337/6878] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:06 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:07.155904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-a0f008c5-913d-4c86-ae67-3f0de6c0854e req-74b1a954-eb6f-44c1-af31-6ac431e4598e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d9a3dc-2f99-4575-9c49-3a99c775fe64", "name": "network-vif-unplugged", "status": "completed", "tag": "1be59c69-5493-44b4-b0fe-587e287906c1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:07.161676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=34 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:07.168376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a0f008c5-913d-4c86-ae67-3f0de6c0854e req-74b1a954-eb6f-44c1-af31-6ac431e4598e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:07.168899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a0f008c5-913d-4c86-ae67-3f0de6c0854e req-74b1a954-eb6f-44c1-af31-6ac431e4598e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:07.169423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a0f008c5-913d-4c86-ae67-3f0de6c0854e req-74b1a954-eb6f-44c1-af31-6ac431e4598e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:07.184971 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-a0f008c5-913d-4c86-ae67-3f0de6c0854e req-74b1a954-eb6f-44c1-af31-6ac431e4598e service nova] Creating event network-vif-unplugged:1be59c69-5493-44b4-b0fe-587e287906c1 for instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 on n-h1-858384-13 Oct 18 14:14:07.190544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [req-a0f008c5-913d-4c86-ae67-3f0de6c0854e req-74b1a954-eb6f-44c1-af31-6ac431e4598e service nova] Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:14:07.203799 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-a0f008c5-913d-4c86-ae67-3f0de6c0854e req-74b1a954-eb6f-44c1-af31-6ac431e4598e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052546 Oct 18 14:14:07.204416 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3542/6879] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:07.536047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-39957164-802d-4f8c-9e11-9e0e75dd3e53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:07.536790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-39957164-802d-4f8c-9e11-9e0e75dd3e53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:07.543966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39957164-802d-4f8c-9e11-9e0e75dd3e53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:07.544467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39957164-802d-4f8c-9e11-9e0e75dd3e53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:07.544909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39957164-802d-4f8c-9e11-9e0e75dd3e53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:07.545655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39957164-802d-4f8c-9e11-9e0e75dd3e53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:07.546119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39957164-802d-4f8c-9e11-9e0e75dd3e53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:07.546558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-39957164-802d-4f8c-9e11-9e0e75dd3e53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:07.747754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-39957164-802d-4f8c-9e11-9e0e75dd3e53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:07.755967 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-39957164-802d-4f8c-9e11-9e0e75dd3e53 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1521 microversion: 2.1 time: 0.223869 Oct 18 14:14:07.756557 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3338/6880] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:07 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:08.781350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d3d894ec-1f0d-4f06-9a0b-40ea6c6839b2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:08.782069 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d3d894ec-1f0d-4f06-9a0b-40ea6c6839b2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:08.789074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d894ec-1f0d-4f06-9a0b-40ea6c6839b2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:08.789606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d894ec-1f0d-4f06-9a0b-40ea6c6839b2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:08.790052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d894ec-1f0d-4f06-9a0b-40ea6c6839b2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:08.790753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d894ec-1f0d-4f06-9a0b-40ea6c6839b2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:08.791220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d894ec-1f0d-4f06-9a0b-40ea6c6839b2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:08.791658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d894ec-1f0d-4f06-9a0b-40ea6c6839b2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:09.226596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-426eb7b6-2946-4314-83c3-304ff4c6dfa8 req-95baf52c-07c8-4bd1-bd5a-591ef79fd3ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d9a3dc-2f99-4575-9c49-3a99c775fe64", "tag": "1be59c69-5493-44b4-b0fe-587e287906c1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:09.238210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-426eb7b6-2946-4314-83c3-304ff4c6dfa8 req-95baf52c-07c8-4bd1-bd5a-591ef79fd3ac service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:09.238698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-426eb7b6-2946-4314-83c3-304ff4c6dfa8 req-95baf52c-07c8-4bd1-bd5a-591ef79fd3ac service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:09.239141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-426eb7b6-2946-4314-83c3-304ff4c6dfa8 req-95baf52c-07c8-4bd1-bd5a-591ef79fd3ac service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:09.252013 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-426eb7b6-2946-4314-83c3-304ff4c6dfa8 req-95baf52c-07c8-4bd1-bd5a-591ef79fd3ac service nova] Creating event network-changed:1be59c69-5493-44b4-b0fe-587e287906c1 for instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 on n-h1-858384-13 Oct 18 14:14:09.258039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-426eb7b6-2946-4314-83c3-304ff4c6dfa8 req-95baf52c-07c8-4bd1-bd5a-591ef79fd3ac service nova] Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:14:09.269815 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-426eb7b6-2946-4314-83c3-304ff4c6dfa8 req-95baf52c-07c8-4bd1-bd5a-591ef79fd3ac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046892 Oct 18 14:14:09.270432 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3339/6881] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:14:09.360579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d3d894ec-1f0d-4f06-9a0b-40ea6c6839b2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:09.368583 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d3d894ec-1f0d-4f06-9a0b-40ea6c6839b2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1519 microversion: 2.1 time: 0.592424 Oct 18 14:14:09.369489 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3543/6882] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:08 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1519 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:10.393486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-26927a61-2deb-41cd-a1bf-5362098cb6fa tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:10.394088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-26927a61-2deb-41cd-a1bf-5362098cb6fa tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:10.400258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26927a61-2deb-41cd-a1bf-5362098cb6fa tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:10.400732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26927a61-2deb-41cd-a1bf-5362098cb6fa tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:10.401169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26927a61-2deb-41cd-a1bf-5362098cb6fa tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:10.402386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26927a61-2deb-41cd-a1bf-5362098cb6fa tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:10.402868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26927a61-2deb-41cd-a1bf-5362098cb6fa tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:10.403288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-26927a61-2deb-41cd-a1bf-5362098cb6fa tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:10.536945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-26927a61-2deb-41cd-a1bf-5362098cb6fa tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:10.545421 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-26927a61-2deb-41cd-a1bf-5362098cb6fa tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1519 microversion: 2.1 time: 0.157092 Oct 18 14:14:10.546021 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3340/6883] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:10 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:11.568291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d998cab-2c88-4eaf-a08f-54ea3c8ed50a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:11.568946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d998cab-2c88-4eaf-a08f-54ea3c8ed50a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:11.576186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d998cab-2c88-4eaf-a08f-54ea3c8ed50a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:11.576682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d998cab-2c88-4eaf-a08f-54ea3c8ed50a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:11.577138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d998cab-2c88-4eaf-a08f-54ea3c8ed50a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:11.577863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d998cab-2c88-4eaf-a08f-54ea3c8ed50a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:11.578332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d998cab-2c88-4eaf-a08f-54ea3c8ed50a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:11.578788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d998cab-2c88-4eaf-a08f-54ea3c8ed50a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:11.709124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9d998cab-2c88-4eaf-a08f-54ea3c8ed50a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:11.717133 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d998cab-2c88-4eaf-a08f-54ea3c8ed50a tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1516 microversion: 2.1 time: 0.152822 Oct 18 14:14:11.717739 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3544/6884] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:11 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:11.739661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-180900a0-bb82-40b8-a0bc-fa01d0631b1d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:11.740214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-180900a0-bb82-40b8-a0bc-fa01d0631b1d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:11.747601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-180900a0-bb82-40b8-a0bc-fa01d0631b1d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:11.748073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-180900a0-bb82-40b8-a0bc-fa01d0631b1d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:11.748505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-180900a0-bb82-40b8-a0bc-fa01d0631b1d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:11.749208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-180900a0-bb82-40b8-a0bc-fa01d0631b1d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:11.749685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-180900a0-bb82-40b8-a0bc-fa01d0631b1d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:11.750104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-180900a0-bb82-40b8-a0bc-fa01d0631b1d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:11.805431 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-180900a0-bb82-40b8-a0bc-fa01d0631b1d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "POST /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64/action" status: 204 len: 0 microversion: 2.1 time: 0.069341 Oct 18 14:14:11.806055 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3341/6885] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:14:11 2022] POST /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:14:11.815423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc5b90fe-5de0-4977-a104-24ad660b83b5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:11.816066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc5b90fe-5de0-4977-a104-24ad660b83b5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:11.822559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc5b90fe-5de0-4977-a104-24ad660b83b5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:11.823000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc5b90fe-5de0-4977-a104-24ad660b83b5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:11.823503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc5b90fe-5de0-4977-a104-24ad660b83b5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:11.824401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc5b90fe-5de0-4977-a104-24ad660b83b5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:11.824916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc5b90fe-5de0-4977-a104-24ad660b83b5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:11.825409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc5b90fe-5de0-4977-a104-24ad660b83b5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:12.081767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc5b90fe-5de0-4977-a104-24ad660b83b5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:12.091776 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc5b90fe-5de0-4977-a104-24ad660b83b5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1516 microversion: 2.1 time: 0.280634 Oct 18 14:14:12.092583 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3545/6886] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:11 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1516 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:13.117551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d8eee8ba-02df-462e-b949-f761ae79c1af tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:13.118441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d8eee8ba-02df-462e-b949-f761ae79c1af tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:13.126972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8eee8ba-02df-462e-b949-f761ae79c1af tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:13.127472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8eee8ba-02df-462e-b949-f761ae79c1af tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:13.127914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8eee8ba-02df-462e-b949-f761ae79c1af tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:13.128623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8eee8ba-02df-462e-b949-f761ae79c1af tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:13.129080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8eee8ba-02df-462e-b949-f761ae79c1af tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:13.129545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d8eee8ba-02df-462e-b949-f761ae79c1af tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:13.265252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d8eee8ba-02df-462e-b949-f761ae79c1af tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:13.273011 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d8eee8ba-02df-462e-b949-f761ae79c1af tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1508 microversion: 2.1 time: 0.160959 Oct 18 14:14:13.273611 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3342/6887] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:13 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:13.297202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-222ce1b4-62df-4b75-a012-fa05383cadc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:13.297763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-222ce1b4-62df-4b75-a012-fa05383cadc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:13.304618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-222ce1b4-62df-4b75-a012-fa05383cadc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:13.305110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-222ce1b4-62df-4b75-a012-fa05383cadc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:13.305603 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-222ce1b4-62df-4b75-a012-fa05383cadc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:13.306305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-222ce1b4-62df-4b75-a012-fa05383cadc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:13.306774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-222ce1b4-62df-4b75-a012-fa05383cadc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:13.307213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-222ce1b4-62df-4b75-a012-fa05383cadc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:13.440315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-222ce1b4-62df-4b75-a012-fa05383cadc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:13.448050 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-222ce1b4-62df-4b75-a012-fa05383cadc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1508 microversion: 2.1 time: 0.155549 Oct 18 14:14:13.448645 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3546/6888] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:13 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:13.474149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-02d300b3-5433-47be-8730-32f1f8a58f54 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Action: 'create', calling method: .version_select at 0x7ff60e6f5700>, body: {"keypair": {"name": "tempest-keypair-966616001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDeuwXczPdc7YVQzOAf0fvh8Xw1FO1PppRkpRIg+rElf2nk4HuM8RPPeACMkpJKTa18zO5bVyl8exhoN7LN0M1hMLrRZ2djC+xxWs5rji4rO0SUtuRkwPzpNr1g+jxODg=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:13.490263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-02d300b3-5433-47be-8730-32f1f8a58f54 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Getting quotas for project cf6006fcbd1c4874b9996dde9da39e14. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:14:13.495454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-02d300b3-5433-47be-8730-32f1f8a58f54 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Getting quotas for user 9f8a9c9ba575492cbf67914c5f4bbabb and project cf6006fcbd1c4874b9996dde9da39e14. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:14:13.508552 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-02d300b3-5433-47be-8730-32f1f8a58f54 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:14:14.038611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c4cb8b39-7d08-46c7-9b6f-7b32f22ba5fa req-e9f54206-38f7-4848-80c3-06d4e4272e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d9a3dc-2f99-4575-9c49-3a99c775fe64", "name": "network-vif-plugged", "status": "completed", "tag": "1be59c69-5493-44b4-b0fe-587e287906c1"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:14.048721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c4cb8b39-7d08-46c7-9b6f-7b32f22ba5fa req-e9f54206-38f7-4848-80c3-06d4e4272e94 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:14.049241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c4cb8b39-7d08-46c7-9b6f-7b32f22ba5fa req-e9f54206-38f7-4848-80c3-06d4e4272e94 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:14.049693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c4cb8b39-7d08-46c7-9b6f-7b32f22ba5fa req-e9f54206-38f7-4848-80c3-06d4e4272e94 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:14.061082 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c4cb8b39-7d08-46c7-9b6f-7b32f22ba5fa req-e9f54206-38f7-4848-80c3-06d4e4272e94 service nova] Creating event network-vif-plugged:1be59c69-5493-44b4-b0fe-587e287906c1 for instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 on n-h1-858384-13 Oct 18 14:14:14.066175 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c4cb8b39-7d08-46c7-9b6f-7b32f22ba5fa req-e9f54206-38f7-4848-80c3-06d4e4272e94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031254 Oct 18 14:14:14.066969 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3547/6889] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:14:14.515770 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [None req-02d300b3-5433-47be-8730-32f1f8a58f54 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39976. Oct 18 14:14:14.532326 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-02d300b3-5433-47be-8730-32f1f8a58f54 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.062113 Oct 18 14:14:14.533140 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3343/6890] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:14:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:15.707769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32d19759-1aeb-4faa-aef2-17bbca1d06bb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:15.708488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-32d19759-1aeb-4faa-aef2-17bbca1d06bb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:15.715826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32d19759-1aeb-4faa-aef2-17bbca1d06bb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:15.716030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32d19759-1aeb-4faa-aef2-17bbca1d06bb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:15.716515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32d19759-1aeb-4faa-aef2-17bbca1d06bb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:15.717276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32d19759-1aeb-4faa-aef2-17bbca1d06bb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:15.717744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32d19759-1aeb-4faa-aef2-17bbca1d06bb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:15.718348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32d19759-1aeb-4faa-aef2-17bbca1d06bb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:15.853573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-32d19759-1aeb-4faa-aef2-17bbca1d06bb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:15.862238 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-32d19759-1aeb-4faa-aef2-17bbca1d06bb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 200 len: 1508 microversion: 2.1 time: 0.159822 Oct 18 14:14:15.862815 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3548/6891] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:15 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:15.885819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a2aa0a9f-cf7c-45cf-9df7-cc89dfefed6c tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:15.886303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a2aa0a9f-cf7c-45cf-9df7-cc89dfefed6c tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:15.892377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2aa0a9f-cf7c-45cf-9df7-cc89dfefed6c tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:15.892847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2aa0a9f-cf7c-45cf-9df7-cc89dfefed6c tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:15.893302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2aa0a9f-cf7c-45cf-9df7-cc89dfefed6c tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:15.893983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2aa0a9f-cf7c-45cf-9df7-cc89dfefed6c tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:15.894430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2aa0a9f-cf7c-45cf-9df7-cc89dfefed6c tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:15.894853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2aa0a9f-cf7c-45cf-9df7-cc89dfefed6c tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:15.921988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a2aa0a9f-cf7c-45cf-9df7-cc89dfefed6c tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:14:15.998681 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a2aa0a9f-cf7c-45cf-9df7-cc89dfefed6c tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "DELETE /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 204 len: 0 microversion: 2.1 time: 0.117244 Oct 18 14:14:15.999196 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3344/6892] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:14:15 2022] DELETE /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:14:16.058281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-123923027", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "281f7550-0f04-4d45-b670-d698744d9174"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:16.112885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] validate_networks() for [('281f7550-0f04-4d45-b670-d698744d9174', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:14:16.538819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:14:16.539266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:14:16.539796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:14:16.540279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:14:16.540680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:14:16.550451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:16.550982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:16.551437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:16.552472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:16.552939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:16.553415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:16.571320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Getting quotas for project cf6006fcbd1c4874b9996dde9da39e14. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:14:16.577510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Getting quotas for user 9f8a9c9ba575492cbf67914c5f4bbabb and project cf6006fcbd1c4874b9996dde9da39e14. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:14:16.590564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:14:16.592891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:14:16.638817 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5c850d71-5a1d-4ffe-9a0d-87fe9abd801b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584305 Oct 18 14:14:16.639482 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3549/6893] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:14:16.651295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-46cd1238-904a-4379-9aac-90a0a0594874 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:16.651993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-46cd1238-904a-4379-9aac-90a0a0594874 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:16.708310 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-46cd1238-904a-4379-9aac-90a0a0594874 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:16.715402 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-46cd1238-904a-4379-9aac-90a0a0594874 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1217 microversion: 2.1 time: 0.068498 Oct 18 14:14:16.715998 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3345/6894] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:16 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:17.738360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-11af3b01-833a-4ce8-9a0e-ebd1007d7467 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:17.738936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-11af3b01-833a-4ce8-9a0e-ebd1007d7467 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:17.749525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11af3b01-833a-4ce8-9a0e-ebd1007d7467 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:17.750055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11af3b01-833a-4ce8-9a0e-ebd1007d7467 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:17.750507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11af3b01-833a-4ce8-9a0e-ebd1007d7467 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:17.751230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11af3b01-833a-4ce8-9a0e-ebd1007d7467 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:17.751705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11af3b01-833a-4ce8-9a0e-ebd1007d7467 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:17.752135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11af3b01-833a-4ce8-9a0e-ebd1007d7467 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:17.815583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-11af3b01-833a-4ce8-9a0e-ebd1007d7467 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:17.823751 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-11af3b01-833a-4ce8-9a0e-ebd1007d7467 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1269 microversion: 2.1 time: 0.089416 Oct 18 14:14:17.825100 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3550/6895] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:17 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:18.175593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d2bd2c29-a06b-483b-913d-f87c548295dc req-611c6931-6478-4b14-a45b-e551d92a57b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d9a3dc-2f99-4575-9c49-3a99c775fe64", "name": "network-vif-deleted", "tag": "1be59c69-5493-44b4-b0fe-587e287906c1"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:18.190487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d2bd2c29-a06b-483b-913d-f87c548295dc req-611c6931-6478-4b14-a45b-e551d92a57b0 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:18.190964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d2bd2c29-a06b-483b-913d-f87c548295dc req-611c6931-6478-4b14-a45b-e551d92a57b0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:18.191392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d2bd2c29-a06b-483b-913d-f87c548295dc req-611c6931-6478-4b14-a45b-e551d92a57b0 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:18.202342 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d2bd2c29-a06b-483b-913d-f87c548295dc req-611c6931-6478-4b14-a45b-e551d92a57b0 service nova] Creating event network-vif-deleted:1be59c69-5493-44b4-b0fe-587e287906c1 for instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 on n-h1-858384-13 Oct 18 14:14:18.207174 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d2bd2c29-a06b-483b-913d-f87c548295dc req-611c6931-6478-4b14-a45b-e551d92a57b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087213 Oct 18 14:14:18.207948 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3346/6896] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:14:18.848550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d6c02f6f-bd84-493c-b607-1ceced192591 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:18.849855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d6c02f6f-bd84-493c-b607-1ceced192591 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:18.857955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6c02f6f-bd84-493c-b607-1ceced192591 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:18.858465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6c02f6f-bd84-493c-b607-1ceced192591 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:18.858971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6c02f6f-bd84-493c-b607-1ceced192591 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:18.859640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6c02f6f-bd84-493c-b607-1ceced192591 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:18.860110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6c02f6f-bd84-493c-b607-1ceced192591 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:18.860547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6c02f6f-bd84-493c-b607-1ceced192591 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:19.002865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d6c02f6f-bd84-493c-b607-1ceced192591 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:19.010583 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d6c02f6f-bd84-493c-b607-1ceced192591 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1317 microversion: 2.1 time: 0.166477 Oct 18 14:14:19.011913 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3551/6897] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:18 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:14:20.036247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f4f71f17-0a41-4f30-a542-40a107127cc9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:20.037157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f4f71f17-0a41-4f30-a542-40a107127cc9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:20.045602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4f71f17-0a41-4f30-a542-40a107127cc9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:20.046098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4f71f17-0a41-4f30-a542-40a107127cc9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:20.046541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4f71f17-0a41-4f30-a542-40a107127cc9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:20.047283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4f71f17-0a41-4f30-a542-40a107127cc9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:20.047742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4f71f17-0a41-4f30-a542-40a107127cc9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:20.048174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4f71f17-0a41-4f30-a542-40a107127cc9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:20.235202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ed73efe9-0a42-4b2f-80a9-4b7b981bf2bf req-aec630d2-9f8c-40e8-9a76-55ce6c9fc1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c897332-160f-40c4-a470-a0205b4ca7d0", "tag": "1d9a29d1-ad56-4964-9f32-686737227ef7"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:20.236545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f4f71f17-0a41-4f30-a542-40a107127cc9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:20.244492 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f4f71f17-0a41-4f30-a542-40a107127cc9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1317 microversion: 2.1 time: 0.212537 Oct 18 14:14:20.245067 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3347/6898] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:20 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:20.246292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ed73efe9-0a42-4b2f-80a9-4b7b981bf2bf req-aec630d2-9f8c-40e8-9a76-55ce6c9fc1a6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:20.246833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ed73efe9-0a42-4b2f-80a9-4b7b981bf2bf req-aec630d2-9f8c-40e8-9a76-55ce6c9fc1a6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:20.247290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ed73efe9-0a42-4b2f-80a9-4b7b981bf2bf req-aec630d2-9f8c-40e8-9a76-55ce6c9fc1a6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:20.258492 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ed73efe9-0a42-4b2f-80a9-4b7b981bf2bf req-aec630d2-9f8c-40e8-9a76-55ce6c9fc1a6 service nova] Creating event network-changed:1d9a29d1-ad56-4964-9f32-686737227ef7 for instance 6c897332-160f-40c4-a470-a0205b4ca7d0 on n-h1-858384-13 Oct 18 14:14:20.263755 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ed73efe9-0a42-4b2f-80a9-4b7b981bf2bf req-aec630d2-9f8c-40e8-9a76-55ce6c9fc1a6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033223 Oct 18 14:14:20.264352 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3552/6899] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:14:21.268049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b19adfc2-ad89-4c5b-9683-3581e51a40eb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:21.268684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b19adfc2-ad89-4c5b-9683-3581e51a40eb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:21.275611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b19adfc2-ad89-4c5b-9683-3581e51a40eb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:21.276084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b19adfc2-ad89-4c5b-9683-3581e51a40eb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:21.276514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b19adfc2-ad89-4c5b-9683-3581e51a40eb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:21.277240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b19adfc2-ad89-4c5b-9683-3581e51a40eb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:21.278196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b19adfc2-ad89-4c5b-9683-3581e51a40eb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:21.278621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b19adfc2-ad89-4c5b-9683-3581e51a40eb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:21.408046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b19adfc2-ad89-4c5b-9683-3581e51a40eb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:21.415696 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b19adfc2-ad89-4c5b-9683-3581e51a40eb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1317 microversion: 2.1 time: 0.151830 Oct 18 14:14:21.416351 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3348/6900] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:21 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:22.445312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f7b99602-5922-4c30-8af4-139ea8bc65bd tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:22.446067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f7b99602-5922-4c30-8af4-139ea8bc65bd tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:22.453599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7b99602-5922-4c30-8af4-139ea8bc65bd tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:22.454114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7b99602-5922-4c30-8af4-139ea8bc65bd tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:22.454572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7b99602-5922-4c30-8af4-139ea8bc65bd tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:22.455292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7b99602-5922-4c30-8af4-139ea8bc65bd tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:22.456017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7b99602-5922-4c30-8af4-139ea8bc65bd tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:22.456515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7b99602-5922-4c30-8af4-139ea8bc65bd tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:22.599883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f7b99602-5922-4c30-8af4-139ea8bc65bd tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:22.608829 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f7b99602-5922-4c30-8af4-139ea8bc65bd tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1317 microversion: 2.1 time: 0.168767 Oct 18 14:14:22.609542 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3553/6901] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:22 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:14:23.632285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-84f62bcf-5a65-4337-a208-13e1205b6edc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:23.632892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-84f62bcf-5a65-4337-a208-13e1205b6edc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:23.639815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84f62bcf-5a65-4337-a208-13e1205b6edc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:23.640276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84f62bcf-5a65-4337-a208-13e1205b6edc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:23.640708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84f62bcf-5a65-4337-a208-13e1205b6edc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:23.641418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84f62bcf-5a65-4337-a208-13e1205b6edc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:23.641874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84f62bcf-5a65-4337-a208-13e1205b6edc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:23.642294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-84f62bcf-5a65-4337-a208-13e1205b6edc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:23.778946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-84f62bcf-5a65-4337-a208-13e1205b6edc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:23.786625 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-84f62bcf-5a65-4337-a208-13e1205b6edc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1317 microversion: 2.1 time: 0.158330 Oct 18 14:14:23.787197 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3349/6902] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:23 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:24.810261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fa94c0f0-0778-4f71-a282-0b36b9bd1cde tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:24.810899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fa94c0f0-0778-4f71-a282-0b36b9bd1cde tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:24.817978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa94c0f0-0778-4f71-a282-0b36b9bd1cde tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:24.818480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa94c0f0-0778-4f71-a282-0b36b9bd1cde tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:24.818934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa94c0f0-0778-4f71-a282-0b36b9bd1cde tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:24.819647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa94c0f0-0778-4f71-a282-0b36b9bd1cde tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:24.820119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa94c0f0-0778-4f71-a282-0b36b9bd1cde tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:24.820563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fa94c0f0-0778-4f71-a282-0b36b9bd1cde tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:24.951536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fa94c0f0-0778-4f71-a282-0b36b9bd1cde tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:24.959608 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fa94c0f0-0778-4f71-a282-0b36b9bd1cde tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1317 microversion: 2.1 time: 0.154381 Oct 18 14:14:24.960186 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3554/6903] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:24 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:25.983603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-603e7db9-c983-4c58-a4f8-a98fa29786fe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:25.984286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-603e7db9-c983-4c58-a4f8-a98fa29786fe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:25.990672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-603e7db9-c983-4c58-a4f8-a98fa29786fe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:25.991146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-603e7db9-c983-4c58-a4f8-a98fa29786fe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:25.991576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-603e7db9-c983-4c58-a4f8-a98fa29786fe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:25.992272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-603e7db9-c983-4c58-a4f8-a98fa29786fe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:25.992717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-603e7db9-c983-4c58-a4f8-a98fa29786fe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:25.993147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-603e7db9-c983-4c58-a4f8-a98fa29786fe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:26.139893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-603e7db9-c983-4c58-a4f8-a98fa29786fe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:26.140447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-fbd0c161-eef0-41ed-8397-9209db7a434b req-2d8ab666-02e8-40cf-980d-673e1e9c019a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c897332-160f-40c4-a470-a0205b4ca7d0", "name": "network-vif-plugged", "status": "completed", "tag": "1d9a29d1-ad56-4964-9f32-686737227ef7"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:26.149562 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-603e7db9-c983-4c58-a4f8-a98fa29786fe tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1317 microversion: 2.1 time: 0.170705 Oct 18 14:14:26.150608 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3350/6904] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:25 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:26.151847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fbd0c161-eef0-41ed-8397-9209db7a434b req-2d8ab666-02e8-40cf-980d-673e1e9c019a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:26.153015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fbd0c161-eef0-41ed-8397-9209db7a434b req-2d8ab666-02e8-40cf-980d-673e1e9c019a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:26.153674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-fbd0c161-eef0-41ed-8397-9209db7a434b req-2d8ab666-02e8-40cf-980d-673e1e9c019a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:26.166183 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-fbd0c161-eef0-41ed-8397-9209db7a434b req-2d8ab666-02e8-40cf-980d-673e1e9c019a service nova] Creating event network-vif-plugged:1d9a29d1-ad56-4964-9f32-686737227ef7 for instance 6c897332-160f-40c4-a470-a0205b4ca7d0 on n-h1-858384-13 Oct 18 14:14:26.172728 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-fbd0c161-eef0-41ed-8397-9209db7a434b req-2d8ab666-02e8-40cf-980d-673e1e9c019a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038473 Oct 18 14:14:26.173866 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3555/6905] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:27.176399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9053ddea-cd25-4737-9787-926fda453d4e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:27.177011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9053ddea-cd25-4737-9787-926fda453d4e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:27.179040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:27.185723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9053ddea-cd25-4737-9787-926fda453d4e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:27.186209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9053ddea-cd25-4737-9787-926fda453d4e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:27.186651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9053ddea-cd25-4737-9787-926fda453d4e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:27.187348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9053ddea-cd25-4737-9787-926fda453d4e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:27.187804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9053ddea-cd25-4737-9787-926fda453d4e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:27.188233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9053ddea-cd25-4737-9787-926fda453d4e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:27.322402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9053ddea-cd25-4737-9787-926fda453d4e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:27.330049 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9053ddea-cd25-4737-9787-926fda453d4e tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1317 microversion: 2.1 time: 0.157626 Oct 18 14:14:27.330628 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3351/6906] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:27 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:28.350273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:28.351086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:28.357536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7f8e24b0-3039-4c76-a0f7-683ca44e95d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:28.358254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7f8e24b0-3039-4c76-a0f7-683ca44e95d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:28.365044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f8e24b0-3039-4c76-a0f7-683ca44e95d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:28.365587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f8e24b0-3039-4c76-a0f7-683ca44e95d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:28.366037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f8e24b0-3039-4c76-a0f7-683ca44e95d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:28.366737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f8e24b0-3039-4c76-a0f7-683ca44e95d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:28.367199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f8e24b0-3039-4c76-a0f7-683ca44e95d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:28.367635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7f8e24b0-3039-4c76-a0f7-683ca44e95d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:28.371760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=89 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:28.509223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7f8e24b0-3039-4c76-a0f7-683ca44e95d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:28.517653 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7f8e24b0-3039-4c76-a0f7-683ca44e95d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1507 microversion: 2.1 time: 0.168309 Oct 18 14:14:28.518240 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3556/6907] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:28 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:28.540189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c20dd146-c941-479d-b5a6-2bdf663cdf5b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:28.540844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c20dd146-c941-479d-b5a6-2bdf663cdf5b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:28.548233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c20dd146-c941-479d-b5a6-2bdf663cdf5b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:28.548778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c20dd146-c941-479d-b5a6-2bdf663cdf5b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:28.549141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c20dd146-c941-479d-b5a6-2bdf663cdf5b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:28.549850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c20dd146-c941-479d-b5a6-2bdf663cdf5b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:28.550294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c20dd146-c941-479d-b5a6-2bdf663cdf5b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:28.550714 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c20dd146-c941-479d-b5a6-2bdf663cdf5b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:28.686098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c20dd146-c941-479d-b5a6-2bdf663cdf5b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:28.694053 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c20dd146-c941-479d-b5a6-2bdf663cdf5b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1507 microversion: 2.1 time: 0.157690 Oct 18 14:14:28.694640 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3352/6908] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:28 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:28.717600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:28.720221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:28.726342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:28.726839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:28.727290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:28.727995 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:28.728461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:28.728901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:28.760870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:28.766911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Old instance type m1.heat2, new instance type m1.heat {{(pid=120611) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:14:28.773461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:14:28.773901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:14:28.774398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:14:28.774825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:14:28.775346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:14:28.839470 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-77f30dd6-5c67-4682-a5d8-f80588dcedc2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "POST /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0/action" status: 202 len: 0 microversion: 2.1 time: 0.126427 Oct 18 14:14:28.840488 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3557/6909] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:14:28 2022] POST /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:14:28.848218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-14d84acc-736b-450e-baf4-795e80585b57 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:28.848948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-14d84acc-736b-450e-baf4-795e80585b57 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:28.856427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14d84acc-736b-450e-baf4-795e80585b57 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:28.856989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14d84acc-736b-450e-baf4-795e80585b57 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:28.857620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14d84acc-736b-450e-baf4-795e80585b57 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:28.858385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14d84acc-736b-450e-baf4-795e80585b57 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:28.858944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14d84acc-736b-450e-baf4-795e80585b57 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:28.859368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14d84acc-736b-450e-baf4-795e80585b57 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:29.019469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-14d84acc-736b-450e-baf4-795e80585b57 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:29.022893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:29.027885 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-14d84acc-736b-450e-baf4-795e80585b57 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1514 microversion: 2.1 time: 0.183536 Oct 18 14:14:29.033751 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3353/6910] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:28 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:30.051914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5144e331-992e-4cf2-80e8-5da054f0392f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:30.052554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5144e331-992e-4cf2-80e8-5da054f0392f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:30.060164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5144e331-992e-4cf2-80e8-5da054f0392f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:30.060746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5144e331-992e-4cf2-80e8-5da054f0392f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:30.061401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5144e331-992e-4cf2-80e8-5da054f0392f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:30.062131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5144e331-992e-4cf2-80e8-5da054f0392f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:30.062758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5144e331-992e-4cf2-80e8-5da054f0392f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:30.063056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5144e331-992e-4cf2-80e8-5da054f0392f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:30.212250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5144e331-992e-4cf2-80e8-5da054f0392f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:30.222202 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5144e331-992e-4cf2-80e8-5da054f0392f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1514 microversion: 2.1 time: 0.174338 Oct 18 14:14:30.222202 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3558/6911] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:30 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:14:31.247328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0683e1f-3faa-4e78-beed-b9a0e4e7d73b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:31.248014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c0683e1f-3faa-4e78-beed-b9a0e4e7d73b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:31.256071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0683e1f-3faa-4e78-beed-b9a0e4e7d73b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:31.256558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0683e1f-3faa-4e78-beed-b9a0e4e7d73b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:31.257029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0683e1f-3faa-4e78-beed-b9a0e4e7d73b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:31.257759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0683e1f-3faa-4e78-beed-b9a0e4e7d73b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:31.258219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0683e1f-3faa-4e78-beed-b9a0e4e7d73b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:31.258647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0683e1f-3faa-4e78-beed-b9a0e4e7d73b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:31.392168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c0683e1f-3faa-4e78-beed-b9a0e4e7d73b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:31.399922 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c0683e1f-3faa-4e78-beed-b9a0e4e7d73b tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.157471 Oct 18 14:14:31.400644 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3354/6912] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:31 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:32.425228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fce85474-089a-4bf6-a294-457eebc7c561 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:32.425779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fce85474-089a-4bf6-a294-457eebc7c561 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:32.432805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce85474-089a-4bf6-a294-457eebc7c561 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:32.433340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce85474-089a-4bf6-a294-457eebc7c561 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:32.433791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce85474-089a-4bf6-a294-457eebc7c561 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:32.435141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce85474-089a-4bf6-a294-457eebc7c561 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:32.435584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce85474-089a-4bf6-a294-457eebc7c561 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:32.436022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fce85474-089a-4bf6-a294-457eebc7c561 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:32.568898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fce85474-089a-4bf6-a294-457eebc7c561 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:32.577245 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fce85474-089a-4bf6-a294-457eebc7c561 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.156582 Oct 18 14:14:32.577828 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3559/6913] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:32 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:33.600056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-edd8ab87-4562-4f20-8af7-4d5864c6a55f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:33.600826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-edd8ab87-4562-4f20-8af7-4d5864c6a55f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:33.608295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edd8ab87-4562-4f20-8af7-4d5864c6a55f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:33.608781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edd8ab87-4562-4f20-8af7-4d5864c6a55f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:33.609268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edd8ab87-4562-4f20-8af7-4d5864c6a55f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:33.609959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edd8ab87-4562-4f20-8af7-4d5864c6a55f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:33.610401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edd8ab87-4562-4f20-8af7-4d5864c6a55f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:33.610822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edd8ab87-4562-4f20-8af7-4d5864c6a55f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:33.759291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-edd8ab87-4562-4f20-8af7-4d5864c6a55f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:33.768305 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-edd8ab87-4562-4f20-8af7-4d5864c6a55f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.172138 Oct 18 14:14:33.768901 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3355/6914] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:33 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:34.792747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ebcaaa10-d7cd-4aab-8474-b765204e4d91 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:34.793586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ebcaaa10-d7cd-4aab-8474-b765204e4d91 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:34.800627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebcaaa10-d7cd-4aab-8474-b765204e4d91 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:34.801133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebcaaa10-d7cd-4aab-8474-b765204e4d91 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:34.801611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebcaaa10-d7cd-4aab-8474-b765204e4d91 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:34.802323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebcaaa10-d7cd-4aab-8474-b765204e4d91 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:34.802784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebcaaa10-d7cd-4aab-8474-b765204e4d91 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:34.803222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ebcaaa10-d7cd-4aab-8474-b765204e4d91 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:34.933364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ebcaaa10-d7cd-4aab-8474-b765204e4d91 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:34.941220 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ebcaaa10-d7cd-4aab-8474-b765204e4d91 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.152771 Oct 18 14:14:34.941808 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3560/6915] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:34 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:35.965589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2fae9939-a239-4e27-969c-5ed055ae4c09 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:35.966654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2fae9939-a239-4e27-969c-5ed055ae4c09 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:35.973403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fae9939-a239-4e27-969c-5ed055ae4c09 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:35.973902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fae9939-a239-4e27-969c-5ed055ae4c09 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:35.974327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fae9939-a239-4e27-969c-5ed055ae4c09 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:35.975039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fae9939-a239-4e27-969c-5ed055ae4c09 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:35.975489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fae9939-a239-4e27-969c-5ed055ae4c09 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:35.975918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2fae9939-a239-4e27-969c-5ed055ae4c09 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:36.109667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2fae9939-a239-4e27-969c-5ed055ae4c09 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:36.117398 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2fae9939-a239-4e27-969c-5ed055ae4c09 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.156463 Oct 18 14:14:36.117971 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3356/6916] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:35 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:37.141640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6e64c1f7-9ee5-4858-b01c-57677a6694ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:37.142282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6e64c1f7-9ee5-4858-b01c-57677a6694ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:37.149254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e64c1f7-9ee5-4858-b01c-57677a6694ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:37.149758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e64c1f7-9ee5-4858-b01c-57677a6694ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:37.150213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e64c1f7-9ee5-4858-b01c-57677a6694ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:37.150919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e64c1f7-9ee5-4858-b01c-57677a6694ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:37.151395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e64c1f7-9ee5-4858-b01c-57677a6694ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:37.151834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e64c1f7-9ee5-4858-b01c-57677a6694ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:37.286598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6e64c1f7-9ee5-4858-b01c-57677a6694ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:37.295419 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6e64c1f7-9ee5-4858-b01c-57677a6694ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.158238 Oct 18 14:14:37.296012 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3561/6917] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:37 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:38.318824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-42bdff45-9597-495e-9bb1-3de01bfa3002 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:38.319434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-42bdff45-9597-495e-9bb1-3de01bfa3002 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:38.322201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:38.328764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42bdff45-9597-495e-9bb1-3de01bfa3002 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:38.329273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42bdff45-9597-495e-9bb1-3de01bfa3002 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:38.329721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42bdff45-9597-495e-9bb1-3de01bfa3002 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:38.330425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42bdff45-9597-495e-9bb1-3de01bfa3002 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:38.331125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42bdff45-9597-495e-9bb1-3de01bfa3002 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:38.331598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-42bdff45-9597-495e-9bb1-3de01bfa3002 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:38.468441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-42bdff45-9597-495e-9bb1-3de01bfa3002 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:38.476296 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-42bdff45-9597-495e-9bb1-3de01bfa3002 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.161456 Oct 18 14:14:38.476877 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3357/6918] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:38 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:39.499584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c9af15ad-36ef-48a8-9435-718413983d8d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:39.500323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c9af15ad-36ef-48a8-9435-718413983d8d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:39.503557 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:14:39.503690 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:14:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 (ip 10.222.0.40) !!! Oct 18 14:14:39.505666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:39.515046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9af15ad-36ef-48a8-9435-718413983d8d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:39.515550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9af15ad-36ef-48a8-9435-718413983d8d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:39.516001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9af15ad-36ef-48a8-9435-718413983d8d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:39.516747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9af15ad-36ef-48a8-9435-718413983d8d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:39.517248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9af15ad-36ef-48a8-9435-718413983d8d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:39.517695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9af15ad-36ef-48a8-9435-718413983d8d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:39.653316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c9af15ad-36ef-48a8-9435-718413983d8d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:39.661321 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c9af15ad-36ef-48a8-9435-718413983d8d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.165665 Oct 18 14:14:39.661918 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3562/6919] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:39 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:40.684766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e2444572-ce05-4640-8a1b-9f8900aac5c5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:40.685419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e2444572-ce05-4640-8a1b-9f8900aac5c5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:40.692855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2444572-ce05-4640-8a1b-9f8900aac5c5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:40.693366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2444572-ce05-4640-8a1b-9f8900aac5c5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:40.693800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2444572-ce05-4640-8a1b-9f8900aac5c5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:40.694480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2444572-ce05-4640-8a1b-9f8900aac5c5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:40.694926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2444572-ce05-4640-8a1b-9f8900aac5c5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:40.695349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2444572-ce05-4640-8a1b-9f8900aac5c5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:40.826206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e2444572-ce05-4640-8a1b-9f8900aac5c5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:40.834376 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e2444572-ce05-4640-8a1b-9f8900aac5c5 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.153650 Oct 18 14:14:40.834964 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3358/6920] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:40 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:41.859082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04104c67-2304-4630-86f1-51b44a68093f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:41.859711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04104c67-2304-4630-86f1-51b44a68093f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:41.866608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04104c67-2304-4630-86f1-51b44a68093f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:41.867103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04104c67-2304-4630-86f1-51b44a68093f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:41.867552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04104c67-2304-4630-86f1-51b44a68093f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:41.868259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04104c67-2304-4630-86f1-51b44a68093f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:41.868721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04104c67-2304-4630-86f1-51b44a68093f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:41.869161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04104c67-2304-4630-86f1-51b44a68093f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:42.008323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04104c67-2304-4630-86f1-51b44a68093f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:42.017036 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04104c67-2304-4630-86f1-51b44a68093f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.162593 Oct 18 14:14:42.017662 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3563/6921] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:41 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:43.041140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6c0f392e-6216-4066-ba45-2fd742061329 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:43.041802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6c0f392e-6216-4066-ba45-2fd742061329 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:43.049559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c0f392e-6216-4066-ba45-2fd742061329 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:43.050046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c0f392e-6216-4066-ba45-2fd742061329 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:43.050486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c0f392e-6216-4066-ba45-2fd742061329 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:43.051182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c0f392e-6216-4066-ba45-2fd742061329 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:43.051638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c0f392e-6216-4066-ba45-2fd742061329 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:43.052070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c0f392e-6216-4066-ba45-2fd742061329 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:43.185621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6c0f392e-6216-4066-ba45-2fd742061329 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:43.193404 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6c0f392e-6216-4066-ba45-2fd742061329 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.156203 Oct 18 14:14:43.193987 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3359/6922] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:43 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:44.217261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b491fb17-50bf-45c3-a116-f2153f5f1b9f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:44.217897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b491fb17-50bf-45c3-a116-f2153f5f1b9f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:44.224866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b491fb17-50bf-45c3-a116-f2153f5f1b9f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:44.225392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b491fb17-50bf-45c3-a116-f2153f5f1b9f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:44.225844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b491fb17-50bf-45c3-a116-f2153f5f1b9f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:44.226549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b491fb17-50bf-45c3-a116-f2153f5f1b9f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:44.227020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b491fb17-50bf-45c3-a116-f2153f5f1b9f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:44.227463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b491fb17-50bf-45c3-a116-f2153f5f1b9f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:44.360316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b491fb17-50bf-45c3-a116-f2153f5f1b9f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:44.368298 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b491fb17-50bf-45c3-a116-f2153f5f1b9f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.155375 Oct 18 14:14:44.368882 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3564/6923] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:44 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:45.392921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6ed8db5a-4086-4a88-b461-31bc31a570c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:45.393507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6ed8db5a-4086-4a88-b461-31bc31a570c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:45.400338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ed8db5a-4086-4a88-b461-31bc31a570c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:45.400817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ed8db5a-4086-4a88-b461-31bc31a570c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:45.401311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ed8db5a-4086-4a88-b461-31bc31a570c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:45.402009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ed8db5a-4086-4a88-b461-31bc31a570c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:45.403074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ed8db5a-4086-4a88-b461-31bc31a570c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:45.403513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ed8db5a-4086-4a88-b461-31bc31a570c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:45.539366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6ed8db5a-4086-4a88-b461-31bc31a570c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:45.547345 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6ed8db5a-4086-4a88-b461-31bc31a570c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.158489 Oct 18 14:14:45.547936 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3360/6924] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:45 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:46.571425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6b0d2708-3705-4160-9a9d-63a3ceacd331 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:46.572065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6b0d2708-3705-4160-9a9d-63a3ceacd331 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:46.579060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b0d2708-3705-4160-9a9d-63a3ceacd331 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:46.579555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b0d2708-3705-4160-9a9d-63a3ceacd331 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:46.580001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b0d2708-3705-4160-9a9d-63a3ceacd331 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:46.580700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b0d2708-3705-4160-9a9d-63a3ceacd331 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:46.581451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b0d2708-3705-4160-9a9d-63a3ceacd331 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:46.581889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6b0d2708-3705-4160-9a9d-63a3ceacd331 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:46.715008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6b0d2708-3705-4160-9a9d-63a3ceacd331 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:46.723831 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6b0d2708-3705-4160-9a9d-63a3ceacd331 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.156507 Oct 18 14:14:46.724420 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3565/6925] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:46 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:47.747159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-36ce2bb8-2fb2-4e9e-ad91-19312c7ed8d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:47.747984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-36ce2bb8-2fb2-4e9e-ad91-19312c7ed8d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:47.756567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36ce2bb8-2fb2-4e9e-ad91-19312c7ed8d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:47.756985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36ce2bb8-2fb2-4e9e-ad91-19312c7ed8d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:47.757445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36ce2bb8-2fb2-4e9e-ad91-19312c7ed8d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:47.758150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36ce2bb8-2fb2-4e9e-ad91-19312c7ed8d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:47.758602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36ce2bb8-2fb2-4e9e-ad91-19312c7ed8d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:47.759035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36ce2bb8-2fb2-4e9e-ad91-19312c7ed8d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:47.893323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36ce2bb8-2fb2-4e9e-ad91-19312c7ed8d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:47.901306 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-36ce2bb8-2fb2-4e9e-ad91-19312c7ed8d6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.158035 Oct 18 14:14:47.901900 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3361/6926] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:47 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:48.926580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4d141e12-7d0d-491e-a3dd-d8bcd429fecc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:48.927210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4d141e12-7d0d-491e-a3dd-d8bcd429fecc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:48.934419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d141e12-7d0d-491e-a3dd-d8bcd429fecc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:48.934923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d141e12-7d0d-491e-a3dd-d8bcd429fecc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:48.935374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d141e12-7d0d-491e-a3dd-d8bcd429fecc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:48.936812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d141e12-7d0d-491e-a3dd-d8bcd429fecc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:48.937315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d141e12-7d0d-491e-a3dd-d8bcd429fecc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:48.937765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4d141e12-7d0d-491e-a3dd-d8bcd429fecc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:49.080025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4d141e12-7d0d-491e-a3dd-d8bcd429fecc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:49.088250 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4d141e12-7d0d-491e-a3dd-d8bcd429fecc tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.165637 Oct 18 14:14:49.088844 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3566/6927] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:48 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:50.112026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-89cd29b1-a545-4667-beaf-0c04d43fdbb4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:50.112640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-89cd29b1-a545-4667-beaf-0c04d43fdbb4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:50.119651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89cd29b1-a545-4667-beaf-0c04d43fdbb4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:50.120134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89cd29b1-a545-4667-beaf-0c04d43fdbb4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:50.120574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89cd29b1-a545-4667-beaf-0c04d43fdbb4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:50.121302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89cd29b1-a545-4667-beaf-0c04d43fdbb4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:50.121756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89cd29b1-a545-4667-beaf-0c04d43fdbb4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:50.122185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89cd29b1-a545-4667-beaf-0c04d43fdbb4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:50.260670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-89cd29b1-a545-4667-beaf-0c04d43fdbb4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:50.268693 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-89cd29b1-a545-4667-beaf-0c04d43fdbb4 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.161281 Oct 18 14:14:50.269311 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3362/6928] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:50 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:51.292609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0c8ef9c2-b66d-4ab2-bf10-0aacfd2dddb6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:51.293271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0c8ef9c2-b66d-4ab2-bf10-0aacfd2dddb6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:51.301083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c8ef9c2-b66d-4ab2-bf10-0aacfd2dddb6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:51.301612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c8ef9c2-b66d-4ab2-bf10-0aacfd2dddb6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:51.302063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c8ef9c2-b66d-4ab2-bf10-0aacfd2dddb6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:51.302775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c8ef9c2-b66d-4ab2-bf10-0aacfd2dddb6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:51.303240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c8ef9c2-b66d-4ab2-bf10-0aacfd2dddb6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:51.303677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0c8ef9c2-b66d-4ab2-bf10-0aacfd2dddb6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:51.443872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0c8ef9c2-b66d-4ab2-bf10-0aacfd2dddb6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:51.452026 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0c8ef9c2-b66d-4ab2-bf10-0aacfd2dddb6 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.163493 Oct 18 14:14:51.453294 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3567/6929] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:51 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:52.476122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0eed1e79-6384-47a5-87ed-46c4987ae6f3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:52.476664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0eed1e79-6384-47a5-87ed-46c4987ae6f3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:52.484338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0eed1e79-6384-47a5-87ed-46c4987ae6f3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:52.484900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0eed1e79-6384-47a5-87ed-46c4987ae6f3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:52.485380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0eed1e79-6384-47a5-87ed-46c4987ae6f3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:52.486080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0eed1e79-6384-47a5-87ed-46c4987ae6f3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:52.486538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0eed1e79-6384-47a5-87ed-46c4987ae6f3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:52.486969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0eed1e79-6384-47a5-87ed-46c4987ae6f3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:52.617087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0eed1e79-6384-47a5-87ed-46c4987ae6f3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:52.625019 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0eed1e79-6384-47a5-87ed-46c4987ae6f3 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.152906 Oct 18 14:14:52.625629 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3363/6930] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:52 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:53.649287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f4afbb1f-7ca8-4c77-b600-53f1e9351089 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:53.649950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f4afbb1f-7ca8-4c77-b600-53f1e9351089 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:53.657111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4afbb1f-7ca8-4c77-b600-53f1e9351089 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:53.657649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4afbb1f-7ca8-4c77-b600-53f1e9351089 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:53.658103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4afbb1f-7ca8-4c77-b600-53f1e9351089 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:53.658815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4afbb1f-7ca8-4c77-b600-53f1e9351089 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:53.659286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4afbb1f-7ca8-4c77-b600-53f1e9351089 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:53.659727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4afbb1f-7ca8-4c77-b600-53f1e9351089 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:53.795542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f4afbb1f-7ca8-4c77-b600-53f1e9351089 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:53.803861 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f4afbb1f-7ca8-4c77-b600-53f1e9351089 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.158622 Oct 18 14:14:53.804446 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3568/6931] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:53 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:54.827475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-be135159-bd40-49c3-89dd-99200281daf2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:54.828099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-be135159-bd40-49c3-89dd-99200281daf2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:54.835866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be135159-bd40-49c3-89dd-99200281daf2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:54.836349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be135159-bd40-49c3-89dd-99200281daf2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:54.836789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be135159-bd40-49c3-89dd-99200281daf2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:54.837515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be135159-bd40-49c3-89dd-99200281daf2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:54.837968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be135159-bd40-49c3-89dd-99200281daf2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:54.838401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-be135159-bd40-49c3-89dd-99200281daf2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:54.968184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-be135159-bd40-49c3-89dd-99200281daf2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:54.976558 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-be135159-bd40-49c3-89dd-99200281daf2 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.153049 Oct 18 14:14:54.977142 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3364/6932] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:54 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:56.000209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-de0065dd-3288-49fa-9b4c-2f40294873df tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:56.001735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-de0065dd-3288-49fa-9b4c-2f40294873df tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:56.008294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de0065dd-3288-49fa-9b4c-2f40294873df tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:56.008800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de0065dd-3288-49fa-9b4c-2f40294873df tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:56.009286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de0065dd-3288-49fa-9b4c-2f40294873df tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:56.010008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de0065dd-3288-49fa-9b4c-2f40294873df tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:56.010485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de0065dd-3288-49fa-9b4c-2f40294873df tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:56.010932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-de0065dd-3288-49fa-9b4c-2f40294873df tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:56.153254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-de0065dd-3288-49fa-9b4c-2f40294873df tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:56.161464 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-de0065dd-3288-49fa-9b4c-2f40294873df tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.165397 Oct 18 14:14:56.162056 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3569/6933] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:55 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:57.184802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e877222b-a1a7-44fe-ba7e-646b5e7963e0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:57.185444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e877222b-a1a7-44fe-ba7e-646b5e7963e0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:57.192717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e877222b-a1a7-44fe-ba7e-646b5e7963e0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:57.193221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e877222b-a1a7-44fe-ba7e-646b5e7963e0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:57.193665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e877222b-a1a7-44fe-ba7e-646b5e7963e0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:57.194367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e877222b-a1a7-44fe-ba7e-646b5e7963e0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:57.195047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e877222b-a1a7-44fe-ba7e-646b5e7963e0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:57.195478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e877222b-a1a7-44fe-ba7e-646b5e7963e0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:57.340490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e877222b-a1a7-44fe-ba7e-646b5e7963e0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:57.349020 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e877222b-a1a7-44fe-ba7e-646b5e7963e0 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1519 microversion: 2.1 time: 0.168162 Oct 18 14:14:57.349559 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3365/6934] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:57 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:58.372559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cf2c5988-789e-4700-9fd8-2c0a5e6ad77d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:58.374282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cf2c5988-789e-4700-9fd8-2c0a5e6ad77d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:58.381757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf2c5988-789e-4700-9fd8-2c0a5e6ad77d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:58.382353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf2c5988-789e-4700-9fd8-2c0a5e6ad77d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:58.382856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf2c5988-789e-4700-9fd8-2c0a5e6ad77d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:58.383639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf2c5988-789e-4700-9fd8-2c0a5e6ad77d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:58.384552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf2c5988-789e-4700-9fd8-2c0a5e6ad77d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:58.385208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf2c5988-789e-4700-9fd8-2c0a5e6ad77d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:58.402338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-62553252-2d59-4048-8bf3-0ee621b67cea req-bd0aa9b3-4c2d-404a-8c83-40a25347a2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c897332-160f-40c4-a470-a0205b4ca7d0", "name": "network-vif-unplugged", "status": "completed", "tag": "1d9a29d1-ad56-4964-9f32-686737227ef7"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:14:58.417371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-62553252-2d59-4048-8bf3-0ee621b67cea req-bd0aa9b3-4c2d-404a-8c83-40a25347a2e2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:58.420982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-62553252-2d59-4048-8bf3-0ee621b67cea req-bd0aa9b3-4c2d-404a-8c83-40a25347a2e2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:58.421610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-62553252-2d59-4048-8bf3-0ee621b67cea req-bd0aa9b3-4c2d-404a-8c83-40a25347a2e2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:58.432929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:14:58.436005 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-62553252-2d59-4048-8bf3-0ee621b67cea req-bd0aa9b3-4c2d-404a-8c83-40a25347a2e2 service nova] Creating event network-vif-unplugged:1d9a29d1-ad56-4964-9f32-686737227ef7 for instance 6c897332-160f-40c4-a470-a0205b4ca7d0 on n-h2-858384-13 Oct 18 14:14:58.442680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [req-62553252-2d59-4048-8bf3-0ee621b67cea req-bd0aa9b3-4c2d-404a-8c83-40a25347a2e2 service nova] Instance 6c897332-160f-40c4-a470-a0205b4ca7d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:14:58.454952 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-62553252-2d59-4048-8bf3-0ee621b67cea req-bd0aa9b3-4c2d-404a-8c83-40a25347a2e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108946 Oct 18 14:14:58.455584 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3570/6935] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:14:58.544815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cf2c5988-789e-4700-9fd8-2c0a5e6ad77d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:58.554007 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cf2c5988-789e-4700-9fd8-2c0a5e6ad77d tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1518 microversion: 2.1 time: 0.185546 Oct 18 14:14:58.554601 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3366/6936] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:58 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:14:59.578983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-893ca229-03fd-472a-a3f5-7f45b9eb02c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:14:59.579710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-893ca229-03fd-472a-a3f5-7f45b9eb02c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:14:59.586903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-893ca229-03fd-472a-a3f5-7f45b9eb02c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:59.587415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-893ca229-03fd-472a-a3f5-7f45b9eb02c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:59.587872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-893ca229-03fd-472a-a3f5-7f45b9eb02c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:59.588590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-893ca229-03fd-472a-a3f5-7f45b9eb02c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:14:59.589062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-893ca229-03fd-472a-a3f5-7f45b9eb02c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:14:59.589535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-893ca229-03fd-472a-a3f5-7f45b9eb02c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:14:59.724902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-893ca229-03fd-472a-a3f5-7f45b9eb02c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:14:59.732856 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-893ca229-03fd-472a-a3f5-7f45b9eb02c9 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1516 microversion: 2.1 time: 0.159294 Oct 18 14:14:59.733494 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3571/6937] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:14:59 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:00.472201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-73537d94-746d-44be-8d7a-80269b8c51d5 req-d50b76c0-1f2e-4996-b23b-df6165459ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c897332-160f-40c4-a470-a0205b4ca7d0", "tag": "1d9a29d1-ad56-4964-9f32-686737227ef7"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:00.482800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-73537d94-746d-44be-8d7a-80269b8c51d5 req-d50b76c0-1f2e-4996-b23b-df6165459ac5 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:00.483276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-73537d94-746d-44be-8d7a-80269b8c51d5 req-d50b76c0-1f2e-4996-b23b-df6165459ac5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:00.483712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-73537d94-746d-44be-8d7a-80269b8c51d5 req-d50b76c0-1f2e-4996-b23b-df6165459ac5 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:00.497024 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-73537d94-746d-44be-8d7a-80269b8c51d5 req-d50b76c0-1f2e-4996-b23b-df6165459ac5 service nova] Creating event network-changed:1d9a29d1-ad56-4964-9f32-686737227ef7 for instance 6c897332-160f-40c4-a470-a0205b4ca7d0 on n-h2-858384-13 Oct 18 14:15:00.504762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-73537d94-746d-44be-8d7a-80269b8c51d5 req-d50b76c0-1f2e-4996-b23b-df6165459ac5 service nova] Instance 6c897332-160f-40c4-a470-a0205b4ca7d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:15:00.515710 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-73537d94-746d-44be-8d7a-80269b8c51d5 req-d50b76c0-1f2e-4996-b23b-df6165459ac5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047258 Oct 18 14:15:00.517299 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3367/6938] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:15:00.758374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3ab12b3c-3bc9-4361-a547-9cc42c4eddeb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:00.759169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3ab12b3c-3bc9-4361-a547-9cc42c4eddeb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:00.767371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab12b3c-3bc9-4361-a547-9cc42c4eddeb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:00.768178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab12b3c-3bc9-4361-a547-9cc42c4eddeb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:00.768817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab12b3c-3bc9-4361-a547-9cc42c4eddeb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:00.769986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab12b3c-3bc9-4361-a547-9cc42c4eddeb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:00.770531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab12b3c-3bc9-4361-a547-9cc42c4eddeb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:00.771101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3ab12b3c-3bc9-4361-a547-9cc42c4eddeb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:00.975675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ab12b3c-3bc9-4361-a547-9cc42c4eddeb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:00.984007 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3ab12b3c-3bc9-4361-a547-9cc42c4eddeb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1513 microversion: 2.1 time: 0.229501 Oct 18 14:15:00.990313 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3572/6939] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:00 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:01.008134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d1e627ae-70cb-48ff-902a-41486d184ddb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:01.008775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d1e627ae-70cb-48ff-902a-41486d184ddb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:01.015181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1e627ae-70cb-48ff-902a-41486d184ddb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:01.015672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1e627ae-70cb-48ff-902a-41486d184ddb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:01.016633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1e627ae-70cb-48ff-902a-41486d184ddb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:01.017618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1e627ae-70cb-48ff-902a-41486d184ddb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:01.018240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1e627ae-70cb-48ff-902a-41486d184ddb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:01.018831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d1e627ae-70cb-48ff-902a-41486d184ddb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:01.083196 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d1e627ae-70cb-48ff-902a-41486d184ddb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "POST /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0/action" status: 204 len: 0 microversion: 2.1 time: 0.078878 Oct 18 14:15:01.084051 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3368/6940] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:15:01 2022] POST /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:15:01.092103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a77780d9-1f7c-42c4-9269-7eaed45660ad tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:01.092698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a77780d9-1f7c-42c4-9269-7eaed45660ad tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:01.099729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a77780d9-1f7c-42c4-9269-7eaed45660ad tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:01.100350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a77780d9-1f7c-42c4-9269-7eaed45660ad tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:01.100819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a77780d9-1f7c-42c4-9269-7eaed45660ad tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:01.101579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a77780d9-1f7c-42c4-9269-7eaed45660ad tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:01.111624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a77780d9-1f7c-42c4-9269-7eaed45660ad tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:01.112168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a77780d9-1f7c-42c4-9269-7eaed45660ad tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:01.264741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a77780d9-1f7c-42c4-9269-7eaed45660ad tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:01.276987 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a77780d9-1f7c-42c4-9269-7eaed45660ad tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1513 microversion: 2.1 time: 0.188444 Oct 18 14:15:01.278105 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3573/6941] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:01 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:02.303359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c9f30383-0355-475b-b143-21610ac55fd7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:02.304064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c9f30383-0355-475b-b143-21610ac55fd7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:02.310469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9f30383-0355-475b-b143-21610ac55fd7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:02.310953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9f30383-0355-475b-b143-21610ac55fd7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:02.311390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9f30383-0355-475b-b143-21610ac55fd7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:02.312086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9f30383-0355-475b-b143-21610ac55fd7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:02.312538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9f30383-0355-475b-b143-21610ac55fd7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:02.313003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9f30383-0355-475b-b143-21610ac55fd7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:02.317464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:02.458409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c9f30383-0355-475b-b143-21610ac55fd7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:02.466376 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c9f30383-0355-475b-b143-21610ac55fd7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1513 microversion: 2.1 time: 0.168765 Oct 18 14:15:02.466962 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3369/6942] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:02 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:03.490736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-92b889a2-5073-47fa-800b-51d4ae224913 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:03.491366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-92b889a2-5073-47fa-800b-51d4ae224913 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:03.498552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92b889a2-5073-47fa-800b-51d4ae224913 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:03.499045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92b889a2-5073-47fa-800b-51d4ae224913 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:03.499493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92b889a2-5073-47fa-800b-51d4ae224913 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:03.500221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92b889a2-5073-47fa-800b-51d4ae224913 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:03.501194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92b889a2-5073-47fa-800b-51d4ae224913 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:03.501636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-92b889a2-5073-47fa-800b-51d4ae224913 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:03.637240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-92b889a2-5073-47fa-800b-51d4ae224913 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:03.646198 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-92b889a2-5073-47fa-800b-51d4ae224913 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1505 microversion: 2.1 time: 0.159327 Oct 18 14:15:03.646789 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3574/6943] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:03 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:03.669628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9da41ec1-c9f7-4780-81fd-eff8fe42ff52 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:03.670895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9da41ec1-c9f7-4780-81fd-eff8fe42ff52 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:03.679667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9da41ec1-c9f7-4780-81fd-eff8fe42ff52 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:03.680320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9da41ec1-c9f7-4780-81fd-eff8fe42ff52 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:03.680766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9da41ec1-c9f7-4780-81fd-eff8fe42ff52 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:03.681496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9da41ec1-c9f7-4780-81fd-eff8fe42ff52 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:03.681949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9da41ec1-c9f7-4780-81fd-eff8fe42ff52 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:03.682428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9da41ec1-c9f7-4780-81fd-eff8fe42ff52 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:03.822425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9da41ec1-c9f7-4780-81fd-eff8fe42ff52 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:03.831779 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9da41ec1-c9f7-4780-81fd-eff8fe42ff52 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1505 microversion: 2.1 time: 0.166824 Oct 18 14:15:03.832361 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3370/6944] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:03 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:03.855600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1bf05c3-da0f-4034-8da0-ba1bf9cb7013 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:03.856271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1bf05c3-da0f-4034-8da0-ba1bf9cb7013 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:03.862940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1bf05c3-da0f-4034-8da0-ba1bf9cb7013 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:03.863439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1bf05c3-da0f-4034-8da0-ba1bf9cb7013 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:03.863887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1bf05c3-da0f-4034-8da0-ba1bf9cb7013 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:03.864601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1bf05c3-da0f-4034-8da0-ba1bf9cb7013 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:03.865118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1bf05c3-da0f-4034-8da0-ba1bf9cb7013 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:03.865555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1bf05c3-da0f-4034-8da0-ba1bf9cb7013 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:03.996037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d1bf05c3-da0f-4034-8da0-ba1bf9cb7013 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:04.004905 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d1bf05c3-da0f-4034-8da0-ba1bf9cb7013 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1505 microversion: 2.1 time: 0.153591 Oct 18 14:15:04.005519 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3575/6945] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:03 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:04.027325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a9b3b0eb-df03-4c37-a563-cc1e8aac0647 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:04.027782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a9b3b0eb-df03-4c37-a563-cc1e8aac0647 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:04.034426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9b3b0eb-df03-4c37-a563-cc1e8aac0647 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:04.034933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9b3b0eb-df03-4c37-a563-cc1e8aac0647 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:04.035379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9b3b0eb-df03-4c37-a563-cc1e8aac0647 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:04.036106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9b3b0eb-df03-4c37-a563-cc1e8aac0647 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:04.036565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9b3b0eb-df03-4c37-a563-cc1e8aac0647 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:04.037005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a9b3b0eb-df03-4c37-a563-cc1e8aac0647 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:04.065703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a9b3b0eb-df03-4c37-a563-cc1e8aac0647 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:15:04.148704 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a9b3b0eb-df03-4c37-a563-cc1e8aac0647 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 204 len: 0 microversion: 2.1 time: 0.125116 Oct 18 14:15:04.149679 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3371/6946] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:15:04 2022] DELETE /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:15:04.163456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5297b937-d80f-4415-96af-906abab72bcb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:04.163985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5297b937-d80f-4415-96af-906abab72bcb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:04.169960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5297b937-d80f-4415-96af-906abab72bcb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:04.170463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5297b937-d80f-4415-96af-906abab72bcb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:04.170952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5297b937-d80f-4415-96af-906abab72bcb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:04.171777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5297b937-d80f-4415-96af-906abab72bcb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:04.172531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5297b937-d80f-4415-96af-906abab72bcb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:04.173229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5297b937-d80f-4415-96af-906abab72bcb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:04.201699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5297b937-d80f-4415-96af-906abab72bcb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:15:04.247019 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.compute.api [None req-5297b937-d80f-4415-96af-906abab72bcb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Instance is already in deleting state, ignoring this request Oct 18 14:15:04.247857 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5297b937-d80f-4415-96af-906abab72bcb tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 204 len: 0 microversion: 2.1 time: 0.088435 Oct 18 14:15:04.248430 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3576/6947] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:15:04 2022] DELETE /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:15:04.257599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7b9027bf-d404-4240-a802-978f2a05b6a7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:04.258308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7b9027bf-d404-4240-a802-978f2a05b6a7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:04.264540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b9027bf-d404-4240-a802-978f2a05b6a7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:04.265232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b9027bf-d404-4240-a802-978f2a05b6a7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:04.265670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b9027bf-d404-4240-a802-978f2a05b6a7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:04.266993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b9027bf-d404-4240-a802-978f2a05b6a7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:04.267434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b9027bf-d404-4240-a802-978f2a05b6a7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:04.267857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b9027bf-d404-4240-a802-978f2a05b6a7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:04.398848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7b9027bf-d404-4240-a802-978f2a05b6a7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:04.407109 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7b9027bf-d404-4240-a802-978f2a05b6a7 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1511 microversion: 2.1 time: 0.153680 Oct 18 14:15:04.408142 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3372/6948] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:04 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:05.431702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dc995994-52b2-43c3-ba0e-e3cf57297917 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:05.432411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dc995994-52b2-43c3-ba0e-e3cf57297917 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:05.439959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc995994-52b2-43c3-ba0e-e3cf57297917 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:05.440458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc995994-52b2-43c3-ba0e-e3cf57297917 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:05.440906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc995994-52b2-43c3-ba0e-e3cf57297917 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:05.441651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc995994-52b2-43c3-ba0e-e3cf57297917 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:05.442123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc995994-52b2-43c3-ba0e-e3cf57297917 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:05.442563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dc995994-52b2-43c3-ba0e-e3cf57297917 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:05.675550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dc995994-52b2-43c3-ba0e-e3cf57297917 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8a9c9ba575492cbf67914c5f4bbabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6006fcbd1c4874b9996dde9da39e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:05.684393 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dc995994-52b2-43c3-ba0e-e3cf57297917 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 200 len: 1511 microversion: 2.1 time: 0.256560 Oct 18 14:15:05.684931 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3577/6949] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:05 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:05.912589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-015f55df-9f66-412b-be81-e8806920e56d req-e874b5fb-e47c-4806-b5ad-8b8f0eb5acef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c897332-160f-40c4-a470-a0205b4ca7d0", "name": "network-vif-plugged", "status": "completed", "tag": "1d9a29d1-ad56-4964-9f32-686737227ef7"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:05.935542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-015f55df-9f66-412b-be81-e8806920e56d req-e874b5fb-e47c-4806-b5ad-8b8f0eb5acef service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:05.936237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-015f55df-9f66-412b-be81-e8806920e56d req-e874b5fb-e47c-4806-b5ad-8b8f0eb5acef service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:05.936859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-015f55df-9f66-412b-be81-e8806920e56d req-e874b5fb-e47c-4806-b5ad-8b8f0eb5acef service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:05.952500 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-015f55df-9f66-412b-be81-e8806920e56d req-e874b5fb-e47c-4806-b5ad-8b8f0eb5acef service nova] Creating event network-vif-plugged:1d9a29d1-ad56-4964-9f32-686737227ef7 for instance 6c897332-160f-40c4-a470-a0205b4ca7d0 on n-h2-858384-13 Oct 18 14:15:05.961433 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-015f55df-9f66-412b-be81-e8806920e56d req-e874b5fb-e47c-4806-b5ad-8b8f0eb5acef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114523 Oct 18 14:15:05.962435 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3373/6950] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:15:05.990420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-86a0bd25-000b-4cc1-a361-5082c49ba64f req-23f9b47d-6286-4a39-a294-c2217c9c6fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c897332-160f-40c4-a470-a0205b4ca7d0", "name": "network-vif-deleted", "tag": "1d9a29d1-ad56-4964-9f32-686737227ef7"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:06.003238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-86a0bd25-000b-4cc1-a361-5082c49ba64f req-23f9b47d-6286-4a39-a294-c2217c9c6fb9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:06.004042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-86a0bd25-000b-4cc1-a361-5082c49ba64f req-23f9b47d-6286-4a39-a294-c2217c9c6fb9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:06.004675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-86a0bd25-000b-4cc1-a361-5082c49ba64f req-23f9b47d-6286-4a39-a294-c2217c9c6fb9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:06.024256 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-86a0bd25-000b-4cc1-a361-5082c49ba64f req-23f9b47d-6286-4a39-a294-c2217c9c6fb9 service nova] Creating event network-vif-deleted:1d9a29d1-ad56-4964-9f32-686737227ef7 for instance 6c897332-160f-40c4-a470-a0205b4ca7d0 on n-h2-858384-13 Oct 18 14:15:06.032185 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-86a0bd25-000b-4cc1-a361-5082c49ba64f req-23f9b47d-6286-4a39-a294-c2217c9c6fb9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044831 Oct 18 14:15:06.033588 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3578/6951] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:15:06.709565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-27c97444-7023-48ab-910a-9444d8276c2f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:06.710302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-27c97444-7023-48ab-910a-9444d8276c2f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 6c897332-160f-40c4-a470-a0205b4ca7d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:06.716717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c97444-7023-48ab-910a-9444d8276c2f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:06.717219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c97444-7023-48ab-910a-9444d8276c2f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:06.717661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c97444-7023-48ab-910a-9444d8276c2f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:06.718350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c97444-7023-48ab-910a-9444d8276c2f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:06.718806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c97444-7023-48ab-910a-9444d8276c2f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:06.719236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c97444-7023-48ab-910a-9444d8276c2f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:06.732439 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-27c97444-7023-48ab-910a-9444d8276c2f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] HTTP exception thrown: Instance 6c897332-160f-40c4-a470-a0205b4ca7d0 could not be found. Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-27c97444-7023-48ab-910a-9444d8276c2f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Request method failure captured: Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 HTTP/1.1 Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrSHtGMDPbM4kSvb3SCzDV2V9GVHP5lH7ozQdQ6bRPjtFJb6G9cU79rvkAhHAFO9DfN6fMmzDAsAG5gkmnZzhbtDz7brRT7M9vfZu0IOmFpm4jNEYImEHi52WOWy17M6A7RvRveIxg5p5Ikwf4Ggi5bIumlcYRTq_-w-ihceoiunn2o Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: cf6006fcbd1c4874b9996dde9da39e14 Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2144012098 Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf6006fcbd1c4874b9996dde9da39e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf6006fcbd1c4874b9996dde9da39e14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf6006fcbd1c4874b9996dde9da39e14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf6006fcbd1c4874b9996dde9da39e14"}]}] Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerDiskConfigTestJSON-2144012098 Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: cf6006fcbd1c4874b9996dde9da39e14 Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2144012098 Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerDiskConfigTestJSON-2144012098-project Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9f8a9c9ba575492cbf67914c5f4bbabb Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerDiskConfigTestJSON-2144012098-project Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 6c897332-160f-40c4-a470-a0205b4ca7d0 could not be found. Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '6c897332-160f-40c4-a470-a0205b4ca7d0'} Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c897332-160f-40c4-a470-a0205b4ca7d0 could not be found. Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c897332-160f-40c4-a470-a0205b4ca7d0 could not be found. Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:15:06.734184 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:15:06.738948 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:15:06.738948 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:15:06.738948 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:15:06.738948 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:15:06.738948 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:15:06.738948 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c897332-160f-40c4-a470-a0205b4ca7d0 could not be found. Oct 18 14:15:06.738948 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:15:06.738948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-27c97444-7023-48ab-910a-9444d8276c2f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Returning 404 to user: Instance 6c897332-160f-40c4-a470-a0205b4ca7d0 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:15:06.738948 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-27c97444-7023-48ab-910a-9444d8276c2f tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0" status: 404 len: 111 microversion: 2.1 time: 0.030592 Oct 18 14:15:06.738948 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3374/6952] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:06 2022] GET /compute/v2.1/servers/6c897332-160f-40c4-a470-a0205b4ca7d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:15:06.745040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ae3f86d5-a48b-4281-b047-6882457c90ca tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '.version_select at 0x7ff60ed5d280>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:06.778280 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ae3f86d5-a48b-4281-b047-6882457c90ca tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-966616001" status: 202 len: 0 microversion: 2.1 time: 0.037421 Oct 18 14:15:06.778897 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3579/6953] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 18 14:15:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-966616001 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:15:07.391971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b806b6b8-f096-4ab4-a801-14ef27dc51ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:07.392795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b806b6b8-f096-4ab4-a801-14ef27dc51ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:07.399883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b806b6b8-f096-4ab4-a801-14ef27dc51ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:07.400356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b806b6b8-f096-4ab4-a801-14ef27dc51ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:07.400790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b806b6b8-f096-4ab4-a801-14ef27dc51ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:07.401543 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b806b6b8-f096-4ab4-a801-14ef27dc51ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:07.401964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b806b6b8-f096-4ab4-a801-14ef27dc51ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:07.402391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b806b6b8-f096-4ab4-a801-14ef27dc51ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:07.416863 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-b806b6b8-f096-4ab4-a801-14ef27dc51ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] HTTP exception thrown: Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 could not be found. Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b806b6b8-f096-4ab4-a801-14ef27dc51ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Request method failure captured: Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 HTTP/1.1 Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrSHtGMDPbM4kSvb3SCzDV2V9GVHP5lH7ozQdQ6bRPjtFJb6G9cU79rvkAhHAFO9DfN6fMmzDAsAG5gkmnZzhbtDz7brRT7M9vfZu0IOmFpm4jNEYImEHi52WOWy17M6A7RvRveIxg5p5Ikwf4Ggi5bIumlcYRTq_-w-ihceoiunn2o Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: cf6006fcbd1c4874b9996dde9da39e14 Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2144012098 Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf6006fcbd1c4874b9996dde9da39e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf6006fcbd1c4874b9996dde9da39e14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf6006fcbd1c4874b9996dde9da39e14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf6006fcbd1c4874b9996dde9da39e14"}]}] Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerDiskConfigTestJSON-2144012098 Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: cf6006fcbd1c4874b9996dde9da39e14 Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2144012098 Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerDiskConfigTestJSON-2144012098-project Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9f8a9c9ba575492cbf67914c5f4bbabb Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerDiskConfigTestJSON-2144012098-project Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 could not be found. Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '79d9a3dc-2f99-4575-9c49-3a99c775fe64'} Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 could not be found. Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:15:07.418488 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 could not be found. Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 could not be found. Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b806b6b8-f096-4ab4-a801-14ef27dc51ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Returning 404 to user: Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b806b6b8-f096-4ab4-a801-14ef27dc51ab tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "DELETE /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 404 len: 111 microversion: 2.1 time: 0.032712 Oct 18 14:15:07.424179 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3375/6954] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:15:07 2022] DELETE /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:15:07.431159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-42719178-f7f6-4a12-b95f-b4a31457e637 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:07.431925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-42719178-f7f6-4a12-b95f-b4a31457e637 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] [instance: 79d9a3dc-2f99-4575-9c49-3a99c775fe64] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:07.439221 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42719178-f7f6-4a12-b95f-b4a31457e637 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:07.439728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42719178-f7f6-4a12-b95f-b4a31457e637 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:07.440213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42719178-f7f6-4a12-b95f-b4a31457e637 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:07.440925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42719178-f7f6-4a12-b95f-b4a31457e637 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:07.441461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42719178-f7f6-4a12-b95f-b4a31457e637 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:07.441909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-42719178-f7f6-4a12-b95f-b4a31457e637 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:07.455629 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-42719178-f7f6-4a12-b95f-b4a31457e637 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] HTTP exception thrown: Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 could not be found. Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-42719178-f7f6-4a12-b95f-b4a31457e637 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Request method failure captured: Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 HTTP/1.1 Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrSHtGMDPbM4kSvb3SCzDV2V9GVHP5lH7ozQdQ6bRPjtFJb6G9cU79rvkAhHAFO9DfN6fMmzDAsAG5gkmnZzhbtDz7brRT7M9vfZu0IOmFpm4jNEYImEHi52WOWy17M6A7RvRveIxg5p5Ikwf4Ggi5bIumlcYRTq_-w-ihceoiunn2o Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: cf6006fcbd1c4874b9996dde9da39e14 Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2144012098 Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf6006fcbd1c4874b9996dde9da39e14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf6006fcbd1c4874b9996dde9da39e14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf6006fcbd1c4874b9996dde9da39e14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf6006fcbd1c4874b9996dde9da39e14"}]}] Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerDiskConfigTestJSON-2144012098 Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: cf6006fcbd1c4874b9996dde9da39e14 Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2144012098 Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerDiskConfigTestJSON-2144012098-project Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 9f8a9c9ba575492cbf67914c5f4bbabb Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerDiskConfigTestJSON-2144012098-project Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 could not be found. Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '79d9a3dc-2f99-4575-9c49-3a99c775fe64'} Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 could not be found. Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 could not be found. Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:15:07.457580 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:15:07.461800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:15:07.461800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:15:07.461800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:15:07.461800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:15:07.461800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:15:07.461800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 could not be found. Oct 18 14:15:07.461800 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:15:07.461800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-42719178-f7f6-4a12-b95f-b4a31457e637 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] Returning 404 to user: Instance 79d9a3dc-2f99-4575-9c49-3a99c775fe64 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:15:07.461800 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-42719178-f7f6-4a12-b95f-b4a31457e637 tempest-ServerDiskConfigTestJSON-2144012098 tempest-ServerDiskConfigTestJSON-2144012098-project] 10.222.0.40 "GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64" status: 404 len: 111 microversion: 2.1 time: 0.032397 Oct 18 14:15:07.461800 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3580/6955] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:07 2022] GET /compute/v2.1/servers/79d9a3dc-2f99-4575-9c49-3a99c775fe64 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:15:16.493860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ffd7202c-1135-43cc-a07e-957a165f80d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'create', calling method: .version_select at 0x7ff60eb514c0>, body: {"keypair": {"name": "tempest-keypair-356831020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBZ/vMzd8bPLqoEWyperNRhC7X0X2cvucCOxiy4c7k11QjBDDJj/maeNXE3vVRy5O7ppYFnjviZ2SAVk/q2IlxH+fYhHhqC5d2oY9t0tmSL1cJS6iUUYNa8pTKdRX7fNw=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:16.500591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:16.513224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ffd7202c-1135-43cc-a07e-957a165f80d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:15:16.519564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ffd7202c-1135-43cc-a07e-957a165f80d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for user 7dbfce990e5248698b492af6c8b2ba85 and project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:15:16.546230 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ffd7202c-1135-43cc-a07e-957a165f80d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.189667 Oct 18 14:15:16.546972 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3376/6956] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:15:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:15:17.976228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1481492433", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ee6393f-1f96-4d8a-a8c7-9559f9047108"}], "security_groups": [{"name": "tempest-securitygroup--1102295394"}], "key_name": "tempest-keypair-356831020", "user_data": "}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:17.986291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:17.987520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:18.097060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] validate_networks() for [('9ee6393f-1f96-4d8a-a8c7-9559f9047108', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:15:18.590220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:15:18.590668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:15:18.591169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:15:18.591600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:15:18.592034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:15:18.602805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:18.603310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:18.603773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:18.604535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:18.605007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:18.605480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:18.632486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:15:18.639157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for user 7dbfce990e5248698b492af6c8b2ba85 and project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:15:18.658205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:15:18.660597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:15:18.711512 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c73eb7c-9923-4e49-9b25-057f38678327 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.739604 Oct 18 14:15:18.712436 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3581/6957] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:15:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:15:18.722151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:18.727712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f9a75bde-0c96-46ec-a1af-005a089b440b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:18.741562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f9a75bde-0c96-46ec-a1af-005a089b440b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:18.809640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f9a75bde-0c96-46ec-a1af-005a089b440b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:18.818686 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f9a75bde-0c96-46ec-a1af-005a089b440b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1238 microversion: 2.1 time: 0.098999 Oct 18 14:15:18.833484 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3377/6958] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:18 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1238 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:19.843799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2af5132a-be3f-45a5-b0b3-d07ecfb4e4a3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:19.845265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2af5132a-be3f-45a5-b0b3-d07ecfb4e4a3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:19.852862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2af5132a-be3f-45a5-b0b3-d07ecfb4e4a3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:19.853760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2af5132a-be3f-45a5-b0b3-d07ecfb4e4a3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:19.854377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2af5132a-be3f-45a5-b0b3-d07ecfb4e4a3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:19.855299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2af5132a-be3f-45a5-b0b3-d07ecfb4e4a3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:19.856015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2af5132a-be3f-45a5-b0b3-d07ecfb4e4a3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:19.856469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2af5132a-be3f-45a5-b0b3-d07ecfb4e4a3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:19.974877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2af5132a-be3f-45a5-b0b3-d07ecfb4e4a3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:19.987019 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2af5132a-be3f-45a5-b0b3-d07ecfb4e4a3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1298 microversion: 2.1 time: 0.146190 Oct 18 14:15:19.987972 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3582/6959] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:19 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1298 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:21.015706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e56ca66-2be4-4d17-b7f1-2d95a32b7a27 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:21.017071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0e56ca66-2be4-4d17-b7f1-2d95a32b7a27 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:21.024612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e56ca66-2be4-4d17-b7f1-2d95a32b7a27 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:21.025096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e56ca66-2be4-4d17-b7f1-2d95a32b7a27 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:21.025568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e56ca66-2be4-4d17-b7f1-2d95a32b7a27 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:21.026276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e56ca66-2be4-4d17-b7f1-2d95a32b7a27 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:21.026730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e56ca66-2be4-4d17-b7f1-2d95a32b7a27 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:21.027165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e56ca66-2be4-4d17-b7f1-2d95a32b7a27 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:21.277031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e56ca66-2be4-4d17-b7f1-2d95a32b7a27 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:21.291403 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e56ca66-2be4-4d17-b7f1-2d95a32b7a27 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1364 microversion: 2.1 time: 0.279610 Oct 18 14:15:21.291992 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3378/6960] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:21 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:21.521323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-14c42237-e7d9-4f52-a066-9fcc5405f3b0 req-e7f598ab-1e00-46b0-ac61-a0276c060ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471c1d54-bf27-4920-b629-022cb57259cb", "tag": "4ade8d6a-2035-423c-a35b-8cfe25d44392"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:21.532436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-14c42237-e7d9-4f52-a066-9fcc5405f3b0 req-e7f598ab-1e00-46b0-ac61-a0276c060ceb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:21.532945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-14c42237-e7d9-4f52-a066-9fcc5405f3b0 req-e7f598ab-1e00-46b0-ac61-a0276c060ceb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:21.534457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-14c42237-e7d9-4f52-a066-9fcc5405f3b0 req-e7f598ab-1e00-46b0-ac61-a0276c060ceb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:21.550746 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-14c42237-e7d9-4f52-a066-9fcc5405f3b0 req-e7f598ab-1e00-46b0-ac61-a0276c060ceb service nova] Creating event network-changed:4ade8d6a-2035-423c-a35b-8cfe25d44392 for instance 471c1d54-bf27-4920-b629-022cb57259cb on n-h1-858384-13 Oct 18 14:15:21.556359 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-14c42237-e7d9-4f52-a066-9fcc5405f3b0 req-e7f598ab-1e00-46b0-ac61-a0276c060ceb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038731 Oct 18 14:15:21.557017 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3583/6961] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:15:22.316007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e3d640d0-7970-49ad-b006-37317da9db82 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:22.316661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e3d640d0-7970-49ad-b006-37317da9db82 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:22.324931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3d640d0-7970-49ad-b006-37317da9db82 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:22.325449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3d640d0-7970-49ad-b006-37317da9db82 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:22.325896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3d640d0-7970-49ad-b006-37317da9db82 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:22.326602 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3d640d0-7970-49ad-b006-37317da9db82 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:22.327066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3d640d0-7970-49ad-b006-37317da9db82 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:22.327514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3d640d0-7970-49ad-b006-37317da9db82 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:22.463972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e3d640d0-7970-49ad-b006-37317da9db82 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:22.471758 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e3d640d0-7970-49ad-b006-37317da9db82 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1364 microversion: 2.1 time: 0.159826 Oct 18 14:15:22.472631 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3379/6962] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:22 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:23.496806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a572b7db-8b03-484f-9e82-a14e468dab8b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:23.497465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a572b7db-8b03-484f-9e82-a14e468dab8b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:23.504758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a572b7db-8b03-484f-9e82-a14e468dab8b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:23.505284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a572b7db-8b03-484f-9e82-a14e468dab8b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:23.505737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a572b7db-8b03-484f-9e82-a14e468dab8b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:23.506459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a572b7db-8b03-484f-9e82-a14e468dab8b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:23.506911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a572b7db-8b03-484f-9e82-a14e468dab8b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:23.507350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a572b7db-8b03-484f-9e82-a14e468dab8b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:23.652326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a572b7db-8b03-484f-9e82-a14e468dab8b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:23.660374 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a572b7db-8b03-484f-9e82-a14e468dab8b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1364 microversion: 2.1 time: 0.168453 Oct 18 14:15:23.660957 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3584/6963] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:23 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:24.685703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-00af54c4-20b9-4bc5-926b-da86eb283d8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:24.686103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-00af54c4-20b9-4bc5-926b-da86eb283d8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:24.694040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00af54c4-20b9-4bc5-926b-da86eb283d8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:24.694535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00af54c4-20b9-4bc5-926b-da86eb283d8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:24.694976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00af54c4-20b9-4bc5-926b-da86eb283d8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:24.695694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00af54c4-20b9-4bc5-926b-da86eb283d8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:24.696151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00af54c4-20b9-4bc5-926b-da86eb283d8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:24.696581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00af54c4-20b9-4bc5-926b-da86eb283d8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:24.879867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-00af54c4-20b9-4bc5-926b-da86eb283d8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:24.889099 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-00af54c4-20b9-4bc5-926b-da86eb283d8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1364 microversion: 2.1 time: 0.208837 Oct 18 14:15:24.892730 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3380/6964] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:24 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:25.912367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-61c94633-71b4-44fd-8bad-f0649db5c448 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:25.913025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-61c94633-71b4-44fd-8bad-f0649db5c448 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:25.919902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61c94633-71b4-44fd-8bad-f0649db5c448 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:25.920405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61c94633-71b4-44fd-8bad-f0649db5c448 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:25.920858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61c94633-71b4-44fd-8bad-f0649db5c448 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:25.921602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61c94633-71b4-44fd-8bad-f0649db5c448 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:25.922646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61c94633-71b4-44fd-8bad-f0649db5c448 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:25.923270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-61c94633-71b4-44fd-8bad-f0649db5c448 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:26.053747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-61c94633-71b4-44fd-8bad-f0649db5c448 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:26.061448 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-61c94633-71b4-44fd-8bad-f0649db5c448 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1364 microversion: 2.1 time: 0.153020 Oct 18 14:15:26.062022 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3585/6965] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:25 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:27.085014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-97615b29-0d7c-443f-965f-63202ce99f72 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:27.085721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-97615b29-0d7c-443f-965f-63202ce99f72 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:27.092833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97615b29-0d7c-443f-965f-63202ce99f72 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:27.093351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97615b29-0d7c-443f-965f-63202ce99f72 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:27.095659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97615b29-0d7c-443f-965f-63202ce99f72 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:27.095659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97615b29-0d7c-443f-965f-63202ce99f72 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:27.095871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97615b29-0d7c-443f-965f-63202ce99f72 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:27.096151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97615b29-0d7c-443f-965f-63202ce99f72 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:27.233976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-97615b29-0d7c-443f-965f-63202ce99f72 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:27.241946 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-97615b29-0d7c-443f-965f-63202ce99f72 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1364 microversion: 2.1 time: 0.161254 Oct 18 14:15:27.242530 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3381/6966] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:27 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:28.265138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-54e12146-bc00-4bf7-8d35-a463fb113935 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:28.265721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-54e12146-bc00-4bf7-8d35-a463fb113935 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:28.272606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54e12146-bc00-4bf7-8d35-a463fb113935 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:28.273100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54e12146-bc00-4bf7-8d35-a463fb113935 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:28.273647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54e12146-bc00-4bf7-8d35-a463fb113935 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:28.274355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54e12146-bc00-4bf7-8d35-a463fb113935 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:28.274819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54e12146-bc00-4bf7-8d35-a463fb113935 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:28.275257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-54e12146-bc00-4bf7-8d35-a463fb113935 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:28.409317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-54e12146-bc00-4bf7-8d35-a463fb113935 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:28.417571 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-54e12146-bc00-4bf7-8d35-a463fb113935 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1364 microversion: 2.1 time: 0.156458 Oct 18 14:15:28.418162 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3586/6967] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:28 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:28.458721 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-78e1dbb0-f6e3-425d-8eb5-337ca02de95e req-f8a828c1-8b5f-40e9-bcbc-319737d9ac3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471c1d54-bf27-4920-b629-022cb57259cb", "name": "network-vif-plugged", "status": "completed", "tag": "4ade8d6a-2035-423c-a35b-8cfe25d44392"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:28.469803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-78e1dbb0-f6e3-425d-8eb5-337ca02de95e req-f8a828c1-8b5f-40e9-bcbc-319737d9ac3c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:28.470282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-78e1dbb0-f6e3-425d-8eb5-337ca02de95e req-f8a828c1-8b5f-40e9-bcbc-319737d9ac3c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:28.470712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-78e1dbb0-f6e3-425d-8eb5-337ca02de95e req-f8a828c1-8b5f-40e9-bcbc-319737d9ac3c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:28.483068 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-78e1dbb0-f6e3-425d-8eb5-337ca02de95e req-f8a828c1-8b5f-40e9-bcbc-319737d9ac3c service nova] Creating event network-vif-plugged:4ade8d6a-2035-423c-a35b-8cfe25d44392 for instance 471c1d54-bf27-4920-b629-022cb57259cb on n-h1-858384-13 Oct 18 14:15:28.492439 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-78e1dbb0-f6e3-425d-8eb5-337ca02de95e req-f8a828c1-8b5f-40e9-bcbc-319737d9ac3c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036834 Oct 18 14:15:28.493032 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3382/6968] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:15:29.442552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2b685b06-c800-4baa-abdf-901e3b0bb2a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:29.443085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2b685b06-c800-4baa-abdf-901e3b0bb2a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:29.445111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:29.445851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:29.455378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b685b06-c800-4baa-abdf-901e3b0bb2a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:29.455930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b685b06-c800-4baa-abdf-901e3b0bb2a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:29.456675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b685b06-c800-4baa-abdf-901e3b0bb2a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:29.457422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b685b06-c800-4baa-abdf-901e3b0bb2a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:29.457890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b685b06-c800-4baa-abdf-901e3b0bb2a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:29.458330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b685b06-c800-4baa-abdf-901e3b0bb2a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:29.597612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2b685b06-c800-4baa-abdf-901e3b0bb2a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:29.605498 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2b685b06-c800-4baa-abdf-901e3b0bb2a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1364 microversion: 2.1 time: 0.166984 Oct 18 14:15:29.606089 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3587/6969] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:29 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:30.625568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:15:30.631052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7fe2a243-dbee-4b95-a73c-6ad7449f386a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:30.631788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7fe2a243-dbee-4b95-a73c-6ad7449f386a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:30.638883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fe2a243-dbee-4b95-a73c-6ad7449f386a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:30.639034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fe2a243-dbee-4b95-a73c-6ad7449f386a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:30.639368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fe2a243-dbee-4b95-a73c-6ad7449f386a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:30.640060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fe2a243-dbee-4b95-a73c-6ad7449f386a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:30.640511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fe2a243-dbee-4b95-a73c-6ad7449f386a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:30.640934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7fe2a243-dbee-4b95-a73c-6ad7449f386a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:30.781504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7fe2a243-dbee-4b95-a73c-6ad7449f386a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:15:30.790781 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7fe2a243-dbee-4b95-a73c-6ad7449f386a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1551 microversion: 2.1 time: 0.166193 Oct 18 14:15:30.791356 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3383/6970] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:15:30 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:15:30.814185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e3a1f30b-6008-4f42-aaab-bac81f4c3cfd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:15:30.814868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e3a1f30b-6008-4f42-aaab-bac81f4c3cfd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:15:30.822006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3a1f30b-6008-4f42-aaab-bac81f4c3cfd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:30.822547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3a1f30b-6008-4f42-aaab-bac81f4c3cfd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:30.823005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3a1f30b-6008-4f42-aaab-bac81f4c3cfd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:30.823737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3a1f30b-6008-4f42-aaab-bac81f4c3cfd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:30.824212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3a1f30b-6008-4f42-aaab-bac81f4c3cfd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:30.824663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3a1f30b-6008-4f42-aaab-bac81f4c3cfd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:30.905470 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e3a1f30b-6008-4f42-aaab-bac81f4c3cfd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095270 Oct 18 14:15:30.906081 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3588/6971] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 14:15:30 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:15:31.874499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-18b3e6be-2c84-46bf-bc3a-18a45882b2b2 req-448aa1e2-1423-4874-99e6-11d94124cc84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471c1d54-bf27-4920-b629-022cb57259cb", "tag": "4ade8d6a-2035-423c-a35b-8cfe25d44392"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:15:31.886308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-18b3e6be-2c84-46bf-bc3a-18a45882b2b2 req-448aa1e2-1423-4874-99e6-11d94124cc84 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:15:31.886786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-18b3e6be-2c84-46bf-bc3a-18a45882b2b2 req-448aa1e2-1423-4874-99e6-11d94124cc84 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:15:31.887216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-18b3e6be-2c84-46bf-bc3a-18a45882b2b2 req-448aa1e2-1423-4874-99e6-11d94124cc84 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:15:31.898932 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-18b3e6be-2c84-46bf-bc3a-18a45882b2b2 req-448aa1e2-1423-4874-99e6-11d94124cc84 service nova] Creating event network-changed:4ade8d6a-2035-423c-a35b-8cfe25d44392 for instance 471c1d54-bf27-4920-b629-022cb57259cb on n-h1-858384-13 Oct 18 14:15:31.903919 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-18b3e6be-2c84-46bf-bc3a-18a45882b2b2 req-448aa1e2-1423-4874-99e6-11d94124cc84 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033144 Oct 18 14:15:31.904528 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3384/6972] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:36.563648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:36.564517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=38 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:36.569449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5a90d233-3d98-46b9-a4b6-d0415c2f861a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:36.570088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5a90d233-3d98-46b9-a4b6-d0415c2f861a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:36.580964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a90d233-3d98-46b9-a4b6-d0415c2f861a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:36.581502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a90d233-3d98-46b9-a4b6-d0415c2f861a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:36.582215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a90d233-3d98-46b9-a4b6-d0415c2f861a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:36.582927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a90d233-3d98-46b9-a4b6-d0415c2f861a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:36.583395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a90d233-3d98-46b9-a4b6-d0415c2f861a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:36.583830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5a90d233-3d98-46b9-a4b6-d0415c2f861a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:36.732004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5a90d233-3d98-46b9-a4b6-d0415c2f861a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:36.740321 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5a90d233-3d98-46b9-a4b6-d0415c2f861a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1669 microversion: 2.1 time: 0.179229 Oct 18 14:16:36.740940 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3589/6973] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:36 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1669 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:36.763076 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d5b88c2f-79b6-477e-bcc2-8d31160b4455] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:16:36.764271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:36.765005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=34 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:36.766498 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:16:36.766635 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:16:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb (ip 10.222.0.40) !!! Oct 18 14:16:36.773511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-02305db6-60e9-4ffb-a98a-722be9e6bdc1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:36.775164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-02305db6-60e9-4ffb-a98a-722be9e6bdc1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:36.785014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02305db6-60e9-4ffb-a98a-722be9e6bdc1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:36.785546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02305db6-60e9-4ffb-a98a-722be9e6bdc1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:36.785984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02305db6-60e9-4ffb-a98a-722be9e6bdc1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:36.786687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02305db6-60e9-4ffb-a98a-722be9e6bdc1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:36.787138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02305db6-60e9-4ffb-a98a-722be9e6bdc1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:36.787569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02305db6-60e9-4ffb-a98a-722be9e6bdc1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:36.933252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-02305db6-60e9-4ffb-a98a-722be9e6bdc1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:36.941784 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-02305db6-60e9-4ffb-a98a-722be9e6bdc1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1669 microversion: 2.1 time: 0.180571 Oct 18 14:16:36.942375 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3385/6974] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:36 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1669 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:36.966969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-21283da3-3093-436b-8b00-43ac6b54ceb2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:36.968065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-21283da3-3093-436b-8b00-43ac6b54ceb2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:36.974949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21283da3-3093-436b-8b00-43ac6b54ceb2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:36.975457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21283da3-3093-436b-8b00-43ac6b54ceb2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:36.975906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21283da3-3093-436b-8b00-43ac6b54ceb2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:36.976617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21283da3-3093-436b-8b00-43ac6b54ceb2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:36.977524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21283da3-3093-436b-8b00-43ac6b54ceb2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:36.977963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-21283da3-3093-436b-8b00-43ac6b54ceb2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:37.122662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-21283da3-3093-436b-8b00-43ac6b54ceb2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:37.131071 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-21283da3-3093-436b-8b00-43ac6b54ceb2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1669 microversion: 2.1 time: 0.169820 Oct 18 14:16:37.131662 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3590/6975] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:36 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:16:37.155641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:37.157924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:37.166690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:37.167175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:37.167610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:37.168305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:37.168760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:37.169199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:37.249948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:37.255862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Old instance type m1.heat2, new instance type m1.heat {{(pid=120612) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:16:37.265136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:16:37.265761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:16:37.266294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:16:37.266712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:16:37.267136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:16:37.386472 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-56e5bcf7-56ba-4d87-a64b-5ad2bdf50d6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb/action" status: 202 len: 0 microversion: 2.1 time: 0.234650 Oct 18 14:16:37.387031 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3386/6976] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:16:37 2022] POST /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:16:37.395465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f9f22827-fe1e-4dba-b7e8-32216f773e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:37.396335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f9f22827-fe1e-4dba-b7e8-32216f773e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:37.408372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9f22827-fe1e-4dba-b7e8-32216f773e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:37.408891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9f22827-fe1e-4dba-b7e8-32216f773e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:37.409388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9f22827-fe1e-4dba-b7e8-32216f773e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:37.410140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9f22827-fe1e-4dba-b7e8-32216f773e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:37.410621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9f22827-fe1e-4dba-b7e8-32216f773e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:37.411060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9f22827-fe1e-4dba-b7e8-32216f773e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:37.569169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f9f22827-fe1e-4dba-b7e8-32216f773e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:37.578929 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f9f22827-fe1e-4dba-b7e8-32216f773e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1678 microversion: 2.1 time: 0.187375 Oct 18 14:16:37.579541 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3591/6977] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:37 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:16:38.605029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d13c7065-ca82-4c05-8ffa-4d8590e60c8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:38.605683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d13c7065-ca82-4c05-8ffa-4d8590e60c8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:38.614517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d13c7065-ca82-4c05-8ffa-4d8590e60c8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:38.615000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d13c7065-ca82-4c05-8ffa-4d8590e60c8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:38.615427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d13c7065-ca82-4c05-8ffa-4d8590e60c8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:38.616153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d13c7065-ca82-4c05-8ffa-4d8590e60c8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:38.616598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d13c7065-ca82-4c05-8ffa-4d8590e60c8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:38.617018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d13c7065-ca82-4c05-8ffa-4d8590e60c8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:38.623112 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] [d5b88c2f-79b6-477e-bcc2-8d31160b4455] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 40406. Oct 18 14:16:38.764170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d13c7065-ca82-4c05-8ffa-4d8590e60c8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:38.772548 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d13c7065-ca82-4c05-8ffa-4d8590e60c8d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1678 microversion: 2.1 time: 0.172690 Oct 18 14:16:38.773152 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3387/6978] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:38 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:39.799338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fd051bca-cbee-4bb2-8efc-e600dd6a4b6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:39.800432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fd051bca-cbee-4bb2-8efc-e600dd6a4b6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:39.808406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd051bca-cbee-4bb2-8efc-e600dd6a4b6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:39.808821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd051bca-cbee-4bb2-8efc-e600dd6a4b6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:39.809310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd051bca-cbee-4bb2-8efc-e600dd6a4b6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:39.810027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd051bca-cbee-4bb2-8efc-e600dd6a4b6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:39.810492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd051bca-cbee-4bb2-8efc-e600dd6a4b6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:39.810927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd051bca-cbee-4bb2-8efc-e600dd6a4b6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:39.947516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fd051bca-cbee-4bb2-8efc-e600dd6a4b6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:39.955743 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fd051bca-cbee-4bb2-8efc-e600dd6a4b6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1683 microversion: 2.1 time: 0.162865 Oct 18 14:16:39.956347 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3592/6979] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:39 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:40.981068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9016fc3a-0e5d-4efe-bf4b-c1cd2c8ad5ff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:40.981783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9016fc3a-0e5d-4efe-bf4b-c1cd2c8ad5ff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:40.989008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9016fc3a-0e5d-4efe-bf4b-c1cd2c8ad5ff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:40.989532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9016fc3a-0e5d-4efe-bf4b-c1cd2c8ad5ff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:40.989975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9016fc3a-0e5d-4efe-bf4b-c1cd2c8ad5ff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:40.990678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9016fc3a-0e5d-4efe-bf4b-c1cd2c8ad5ff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:40.991136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9016fc3a-0e5d-4efe-bf4b-c1cd2c8ad5ff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:40.991567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9016fc3a-0e5d-4efe-bf4b-c1cd2c8ad5ff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:41.122516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9016fc3a-0e5d-4efe-bf4b-c1cd2c8ad5ff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:41.130339 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9016fc3a-0e5d-4efe-bf4b-c1cd2c8ad5ff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1683 microversion: 2.1 time: 0.154224 Oct 18 14:16:41.131279 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3388/6980] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:40 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:42.156038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-002f72c3-336a-46a6-b3d6-d25f33379798 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:42.156573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-002f72c3-336a-46a6-b3d6-d25f33379798 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:42.166120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-002f72c3-336a-46a6-b3d6-d25f33379798 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:42.166615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-002f72c3-336a-46a6-b3d6-d25f33379798 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:42.167061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-002f72c3-336a-46a6-b3d6-d25f33379798 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:42.167761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-002f72c3-336a-46a6-b3d6-d25f33379798 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:42.168232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-002f72c3-336a-46a6-b3d6-d25f33379798 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:42.168667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-002f72c3-336a-46a6-b3d6-d25f33379798 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:42.299889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-002f72c3-336a-46a6-b3d6-d25f33379798 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:42.309589 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-002f72c3-336a-46a6-b3d6-d25f33379798 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1683 microversion: 2.1 time: 0.157573 Oct 18 14:16:42.310179 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3593/6981] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:42 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:43.333932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d52df80-15a9-4423-9cd0-90428015168f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:43.334546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4d52df80-15a9-4423-9cd0-90428015168f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:43.340889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d52df80-15a9-4423-9cd0-90428015168f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:43.341404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d52df80-15a9-4423-9cd0-90428015168f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:43.341832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d52df80-15a9-4423-9cd0-90428015168f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:43.342522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d52df80-15a9-4423-9cd0-90428015168f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:43.342972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d52df80-15a9-4423-9cd0-90428015168f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:43.343392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d52df80-15a9-4423-9cd0-90428015168f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:43.487409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4d52df80-15a9-4423-9cd0-90428015168f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:43.495807 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d52df80-15a9-4423-9cd0-90428015168f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1683 microversion: 2.1 time: 0.166984 Oct 18 14:16:43.496390 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3389/6982] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:43 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:44.521027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7b2f01ef-10dc-439a-be2b-8ed420a75c1a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:44.521684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7b2f01ef-10dc-439a-be2b-8ed420a75c1a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:44.528948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b2f01ef-10dc-439a-be2b-8ed420a75c1a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:44.529488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b2f01ef-10dc-439a-be2b-8ed420a75c1a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:44.529941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b2f01ef-10dc-439a-be2b-8ed420a75c1a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:44.530650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b2f01ef-10dc-439a-be2b-8ed420a75c1a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:44.531124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b2f01ef-10dc-439a-be2b-8ed420a75c1a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:44.531566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7b2f01ef-10dc-439a-be2b-8ed420a75c1a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:44.661163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7b2f01ef-10dc-439a-be2b-8ed420a75c1a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:44.669419 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7b2f01ef-10dc-439a-be2b-8ed420a75c1a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1683 microversion: 2.1 time: 0.152325 Oct 18 14:16:44.669998 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3594/6983] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:44 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:45.693452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dc793500-7b19-4c20-8b67-6a0b22ea9156 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:45.694061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dc793500-7b19-4c20-8b67-6a0b22ea9156 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:45.701492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc793500-7b19-4c20-8b67-6a0b22ea9156 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:45.702005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc793500-7b19-4c20-8b67-6a0b22ea9156 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:45.702440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc793500-7b19-4c20-8b67-6a0b22ea9156 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:45.703132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc793500-7b19-4c20-8b67-6a0b22ea9156 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:45.703582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc793500-7b19-4c20-8b67-6a0b22ea9156 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:45.704003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc793500-7b19-4c20-8b67-6a0b22ea9156 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:45.840940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dc793500-7b19-4c20-8b67-6a0b22ea9156 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:45.849054 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dc793500-7b19-4c20-8b67-6a0b22ea9156 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1683 microversion: 2.1 time: 0.159546 Oct 18 14:16:45.849685 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3390/6984] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:45 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:46.872373 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2ce803b9-4909-4ff9-bddd-b8f6632e6a6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:46.873035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2ce803b9-4909-4ff9-bddd-b8f6632e6a6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:46.879887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ce803b9-4909-4ff9-bddd-b8f6632e6a6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:46.880391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ce803b9-4909-4ff9-bddd-b8f6632e6a6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:46.880851 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ce803b9-4909-4ff9-bddd-b8f6632e6a6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:46.881612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ce803b9-4909-4ff9-bddd-b8f6632e6a6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:46.882093 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ce803b9-4909-4ff9-bddd-b8f6632e6a6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:46.882540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ce803b9-4909-4ff9-bddd-b8f6632e6a6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:47.020748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2ce803b9-4909-4ff9-bddd-b8f6632e6a6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:47.029377 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2ce803b9-4909-4ff9-bddd-b8f6632e6a6a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1683 microversion: 2.1 time: 0.160994 Oct 18 14:16:47.029955 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3595/6985] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:46 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:48.053490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9dcead9f-bede-41c5-8308-4543aec72e21 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:48.055514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9dcead9f-bede-41c5-8308-4543aec72e21 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:48.062316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dcead9f-bede-41c5-8308-4543aec72e21 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:48.062797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dcead9f-bede-41c5-8308-4543aec72e21 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:48.063230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dcead9f-bede-41c5-8308-4543aec72e21 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:48.063931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dcead9f-bede-41c5-8308-4543aec72e21 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:48.064370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dcead9f-bede-41c5-8308-4543aec72e21 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:48.064790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9dcead9f-bede-41c5-8308-4543aec72e21 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:48.207957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9dcead9f-bede-41c5-8308-4543aec72e21 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:48.217077 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9dcead9f-bede-41c5-8308-4543aec72e21 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1683 microversion: 2.1 time: 0.167572 Oct 18 14:16:48.217699 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3391/6986] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:48 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:49.240805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8d84f171-cf5c-4c96-89ee-154b2b4aa232 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:49.241457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8d84f171-cf5c-4c96-89ee-154b2b4aa232 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:49.249054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d84f171-cf5c-4c96-89ee-154b2b4aa232 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:49.249595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d84f171-cf5c-4c96-89ee-154b2b4aa232 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:49.250042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d84f171-cf5c-4c96-89ee-154b2b4aa232 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:49.250757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d84f171-cf5c-4c96-89ee-154b2b4aa232 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:49.251223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d84f171-cf5c-4c96-89ee-154b2b4aa232 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:49.251662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8d84f171-cf5c-4c96-89ee-154b2b4aa232 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:49.393697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8d84f171-cf5c-4c96-89ee-154b2b4aa232 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:49.402547 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8d84f171-cf5c-4c96-89ee-154b2b4aa232 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1683 microversion: 2.1 time: 0.165572 Oct 18 14:16:49.403491 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3596/6987] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:49 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:50.427364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8d2a6696-7355-4248-a6cb-eec0a501c7fb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:50.427963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8d2a6696-7355-4248-a6cb-eec0a501c7fb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:50.435338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d2a6696-7355-4248-a6cb-eec0a501c7fb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:50.436016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d2a6696-7355-4248-a6cb-eec0a501c7fb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:50.436567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d2a6696-7355-4248-a6cb-eec0a501c7fb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:50.437527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d2a6696-7355-4248-a6cb-eec0a501c7fb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:50.438139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d2a6696-7355-4248-a6cb-eec0a501c7fb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:50.438568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d2a6696-7355-4248-a6cb-eec0a501c7fb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:50.571743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8d2a6696-7355-4248-a6cb-eec0a501c7fb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:50.580198 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8d2a6696-7355-4248-a6cb-eec0a501c7fb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1683 microversion: 2.1 time: 0.156771 Oct 18 14:16:50.580782 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3392/6988] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:50 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:51.604973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-14e93a59-1917-4de5-88ed-b6cc6179907e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:51.605627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-14e93a59-1917-4de5-88ed-b6cc6179907e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:51.612557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14e93a59-1917-4de5-88ed-b6cc6179907e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:51.613050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14e93a59-1917-4de5-88ed-b6cc6179907e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:51.613531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14e93a59-1917-4de5-88ed-b6cc6179907e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:51.614232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14e93a59-1917-4de5-88ed-b6cc6179907e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:51.614693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14e93a59-1917-4de5-88ed-b6cc6179907e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:51.615130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14e93a59-1917-4de5-88ed-b6cc6179907e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:52.216145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-14e93a59-1917-4de5-88ed-b6cc6179907e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:52.224306 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-14e93a59-1917-4de5-88ed-b6cc6179907e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1682 microversion: 2.1 time: 0.624154 Oct 18 14:16:52.224912 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3597/6989] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:51 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1682 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:52.327278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-62fe5dab-2c2d-4022-acd3-2b9b8f339f84 req-e4183603-88b8-4e02-b19d-fc0d1b60a101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471c1d54-bf27-4920-b629-022cb57259cb", "name": "network-vif-unplugged", "status": "completed", "tag": "4ade8d6a-2035-423c-a35b-8cfe25d44392"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:52.339467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-62fe5dab-2c2d-4022-acd3-2b9b8f339f84 req-e4183603-88b8-4e02-b19d-fc0d1b60a101 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:52.339953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-62fe5dab-2c2d-4022-acd3-2b9b8f339f84 req-e4183603-88b8-4e02-b19d-fc0d1b60a101 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:52.340398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-62fe5dab-2c2d-4022-acd3-2b9b8f339f84 req-e4183603-88b8-4e02-b19d-fc0d1b60a101 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:52.354292 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-62fe5dab-2c2d-4022-acd3-2b9b8f339f84 req-e4183603-88b8-4e02-b19d-fc0d1b60a101 service nova] Creating event network-vif-unplugged:4ade8d6a-2035-423c-a35b-8cfe25d44392 for instance 471c1d54-bf27-4920-b629-022cb57259cb on n-h2-858384-13 Oct 18 14:16:52.360134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-62fe5dab-2c2d-4022-acd3-2b9b8f339f84 req-e4183603-88b8-4e02-b19d-fc0d1b60a101 service nova] Instance 471c1d54-bf27-4920-b629-022cb57259cb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:16:52.372181 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-62fe5dab-2c2d-4022-acd3-2b9b8f339f84 req-e4183603-88b8-4e02-b19d-fc0d1b60a101 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048678 Oct 18 14:16:52.372852 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3393/6990] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:53.250482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1d457d97-3774-45f1-901c-9f1b02e0a873 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:53.251112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1d457d97-3774-45f1-901c-9f1b02e0a873 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:53.258588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d457d97-3774-45f1-901c-9f1b02e0a873 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:53.259097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d457d97-3774-45f1-901c-9f1b02e0a873 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:53.259553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d457d97-3774-45f1-901c-9f1b02e0a873 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:53.260281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d457d97-3774-45f1-901c-9f1b02e0a873 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:53.260754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d457d97-3774-45f1-901c-9f1b02e0a873 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:53.261276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d457d97-3774-45f1-901c-9f1b02e0a873 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:53.402787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1d457d97-3774-45f1-901c-9f1b02e0a873 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:53.411667 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1d457d97-3774-45f1-901c-9f1b02e0a873 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1682 microversion: 2.1 time: 0.165147 Oct 18 14:16:53.412253 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3598/6991] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:53 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:54.413732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-f8cfb3ec-1640-45e1-be46-94e1e6ef3e9c req-ca053a19-d9f1-40ea-a3d3-3a7da6f85c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471c1d54-bf27-4920-b629-022cb57259cb", "tag": "4ade8d6a-2035-423c-a35b-8cfe25d44392"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:54.423698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f8cfb3ec-1640-45e1-be46-94e1e6ef3e9c req-ca053a19-d9f1-40ea-a3d3-3a7da6f85c74 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:54.424175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f8cfb3ec-1640-45e1-be46-94e1e6ef3e9c req-ca053a19-d9f1-40ea-a3d3-3a7da6f85c74 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:54.424609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f8cfb3ec-1640-45e1-be46-94e1e6ef3e9c req-ca053a19-d9f1-40ea-a3d3-3a7da6f85c74 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:54.436621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-672af396-1cca-482f-aa43-0f6bc15d6f0f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:54.437230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-672af396-1cca-482f-aa43-0f6bc15d6f0f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:54.437429 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f8cfb3ec-1640-45e1-be46-94e1e6ef3e9c req-ca053a19-d9f1-40ea-a3d3-3a7da6f85c74 service nova] Creating event network-changed:4ade8d6a-2035-423c-a35b-8cfe25d44392 for instance 471c1d54-bf27-4920-b629-022cb57259cb on n-h2-858384-13 Oct 18 14:16:54.443053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-f8cfb3ec-1640-45e1-be46-94e1e6ef3e9c req-ca053a19-d9f1-40ea-a3d3-3a7da6f85c74 service nova] Instance 471c1d54-bf27-4920-b629-022cb57259cb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:16:54.443919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-672af396-1cca-482f-aa43-0f6bc15d6f0f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:54.444417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-672af396-1cca-482f-aa43-0f6bc15d6f0f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:54.444870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-672af396-1cca-482f-aa43-0f6bc15d6f0f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:54.446386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-672af396-1cca-482f-aa43-0f6bc15d6f0f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:54.446856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-672af396-1cca-482f-aa43-0f6bc15d6f0f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:54.447298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-672af396-1cca-482f-aa43-0f6bc15d6f0f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:54.455086 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-f8cfb3ec-1640-45e1-be46-94e1e6ef3e9c req-ca053a19-d9f1-40ea-a3d3-3a7da6f85c74 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046179 Oct 18 14:16:54.455881 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3394/6992] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:16:54.685088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-672af396-1cca-482f-aa43-0f6bc15d6f0f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:54.696021 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-672af396-1cca-482f-aa43-0f6bc15d6f0f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1680 microversion: 2.1 time: 0.263241 Oct 18 14:16:54.697252 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3599/6993] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:54 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1680 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:16:55.722070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ce24bfcd-5c22-451a-b99f-763aa5f240b7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:55.723046 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ce24bfcd-5c22-451a-b99f-763aa5f240b7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:55.730225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce24bfcd-5c22-451a-b99f-763aa5f240b7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:55.730706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce24bfcd-5c22-451a-b99f-763aa5f240b7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:55.731141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce24bfcd-5c22-451a-b99f-763aa5f240b7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:55.731823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce24bfcd-5c22-451a-b99f-763aa5f240b7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:55.732269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce24bfcd-5c22-451a-b99f-763aa5f240b7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:55.732688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ce24bfcd-5c22-451a-b99f-763aa5f240b7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:55.865243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ce24bfcd-5c22-451a-b99f-763aa5f240b7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:55.873992 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ce24bfcd-5c22-451a-b99f-763aa5f240b7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1677 microversion: 2.1 time: 0.157209 Oct 18 14:16:55.874579 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3395/6994] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:55 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:55.898820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-865ef1fd-a9b7-4d21-8a3a-f9d79ac94ca5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:55.899421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-865ef1fd-a9b7-4d21-8a3a-f9d79ac94ca5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:55.906154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-865ef1fd-a9b7-4d21-8a3a-f9d79ac94ca5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:55.906661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-865ef1fd-a9b7-4d21-8a3a-f9d79ac94ca5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:55.907119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-865ef1fd-a9b7-4d21-8a3a-f9d79ac94ca5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:55.907830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-865ef1fd-a9b7-4d21-8a3a-f9d79ac94ca5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:55.908303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-865ef1fd-a9b7-4d21-8a3a-f9d79ac94ca5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:55.908746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-865ef1fd-a9b7-4d21-8a3a-f9d79ac94ca5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:55.968737 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-865ef1fd-a9b7-4d21-8a3a-f9d79ac94ca5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb/action" status: 204 len: 0 microversion: 2.1 time: 0.075133 Oct 18 14:16:55.969416 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3600/6995] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:16:55 2022] POST /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:16:55.978920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a8513382-a957-4de1-a6a7-482d78266bcf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:55.979675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a8513382-a957-4de1-a6a7-482d78266bcf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:55.985826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8513382-a957-4de1-a6a7-482d78266bcf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:55.986658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8513382-a957-4de1-a6a7-482d78266bcf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:55.987240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8513382-a957-4de1-a6a7-482d78266bcf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:55.988741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8513382-a957-4de1-a6a7-482d78266bcf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:55.989511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8513382-a957-4de1-a6a7-482d78266bcf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:55.990031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8513382-a957-4de1-a6a7-482d78266bcf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:56.213466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a8513382-a957-4de1-a6a7-482d78266bcf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:56.221109 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a8513382-a957-4de1-a6a7-482d78266bcf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1677 microversion: 2.1 time: 0.247341 Oct 18 14:16:56.221725 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3396/6996] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:55 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1677 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:57.247964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87c9735c-bb45-46e8-bea3-803b51f50dcd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:57.248815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-87c9735c-bb45-46e8-bea3-803b51f50dcd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:57.255145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87c9735c-bb45-46e8-bea3-803b51f50dcd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:57.255647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87c9735c-bb45-46e8-bea3-803b51f50dcd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:57.256120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87c9735c-bb45-46e8-bea3-803b51f50dcd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:57.257031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87c9735c-bb45-46e8-bea3-803b51f50dcd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:57.258722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87c9735c-bb45-46e8-bea3-803b51f50dcd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:57.259190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87c9735c-bb45-46e8-bea3-803b51f50dcd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:57.403587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-87c9735c-bb45-46e8-bea3-803b51f50dcd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:57.411681 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-87c9735c-bb45-46e8-bea3-803b51f50dcd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1677 microversion: 2.1 time: 0.170341 Oct 18 14:16:57.412606 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3601/6997] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:57 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:58.236286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-f78c32c4-f2bd-4bf0-a797-4d9762641030 req-84386ed4-b5fa-49b7-a93e-bdd4d673344f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471c1d54-bf27-4920-b629-022cb57259cb", "name": "network-vif-plugged", "status": "completed", "tag": "4ade8d6a-2035-423c-a35b-8cfe25d44392"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:16:58.251207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f78c32c4-f2bd-4bf0-a797-4d9762641030 req-84386ed4-b5fa-49b7-a93e-bdd4d673344f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:58.251881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f78c32c4-f2bd-4bf0-a797-4d9762641030 req-84386ed4-b5fa-49b7-a93e-bdd4d673344f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:58.252423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-f78c32c4-f2bd-4bf0-a797-4d9762641030 req-84386ed4-b5fa-49b7-a93e-bdd4d673344f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:58.265914 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-f78c32c4-f2bd-4bf0-a797-4d9762641030 req-84386ed4-b5fa-49b7-a93e-bdd4d673344f service nova] Creating event network-vif-plugged:4ade8d6a-2035-423c-a35b-8cfe25d44392 for instance 471c1d54-bf27-4920-b629-022cb57259cb on n-h2-858384-13 Oct 18 14:16:58.274665 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-f78c32c4-f2bd-4bf0-a797-4d9762641030 req-84386ed4-b5fa-49b7-a93e-bdd4d673344f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041856 Oct 18 14:16:58.275767 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3397/6998] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:16:58.435769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c64139d-db82-4728-9b3f-ff8445b4bf16 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:58.436528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c64139d-db82-4728-9b3f-ff8445b4bf16 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:58.443720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c64139d-db82-4728-9b3f-ff8445b4bf16 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:58.444225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c64139d-db82-4728-9b3f-ff8445b4bf16 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:58.444678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c64139d-db82-4728-9b3f-ff8445b4bf16 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:58.446260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c64139d-db82-4728-9b3f-ff8445b4bf16 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:58.446742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c64139d-db82-4728-9b3f-ff8445b4bf16 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:58.447195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c64139d-db82-4728-9b3f-ff8445b4bf16 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:58.580651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3c64139d-db82-4728-9b3f-ff8445b4bf16 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:58.589735 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c64139d-db82-4728-9b3f-ff8445b4bf16 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1669 microversion: 2.1 time: 0.157883 Oct 18 14:16:58.590326 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3602/6999] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:58 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:58.612719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-36326b1b-4524-402c-9a59-e8ea86ee2f68 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:58.613457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-36326b1b-4524-402c-9a59-e8ea86ee2f68 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:58.620059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36326b1b-4524-402c-9a59-e8ea86ee2f68 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:58.620542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36326b1b-4524-402c-9a59-e8ea86ee2f68 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:58.620979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36326b1b-4524-402c-9a59-e8ea86ee2f68 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:58.621703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36326b1b-4524-402c-9a59-e8ea86ee2f68 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:58.622154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36326b1b-4524-402c-9a59-e8ea86ee2f68 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:58.622577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36326b1b-4524-402c-9a59-e8ea86ee2f68 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:58.760082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36326b1b-4524-402c-9a59-e8ea86ee2f68 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:58.767983 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-36326b1b-4524-402c-9a59-e8ea86ee2f68 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1669 microversion: 2.1 time: 0.159461 Oct 18 14:16:58.768578 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3398/7000] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:58 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:58.790516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-600a1e43-b53b-4527-a5eb-ae20b8f328ce tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:58.791057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-600a1e43-b53b-4527-a5eb-ae20b8f328ce tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:58.797445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-600a1e43-b53b-4527-a5eb-ae20b8f328ce tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:58.797973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-600a1e43-b53b-4527-a5eb-ae20b8f328ce tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:58.798428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-600a1e43-b53b-4527-a5eb-ae20b8f328ce tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:58.799153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-600a1e43-b53b-4527-a5eb-ae20b8f328ce tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:58.799634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-600a1e43-b53b-4527-a5eb-ae20b8f328ce tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:58.800076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-600a1e43-b53b-4527-a5eb-ae20b8f328ce tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:58.941717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-600a1e43-b53b-4527-a5eb-ae20b8f328ce tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:58.950508 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-600a1e43-b53b-4527-a5eb-ae20b8f328ce tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1669 microversion: 2.1 time: 0.164175 Oct 18 14:16:58.951106 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3603/7001] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:58 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:16:58.973294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8cf7132b-af1b-484d-b861-21b61fef463b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:58.973793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8cf7132b-af1b-484d-b861-21b61fef463b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:58.980131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cf7132b-af1b-484d-b861-21b61fef463b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:58.980614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cf7132b-af1b-484d-b861-21b61fef463b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:58.981058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cf7132b-af1b-484d-b861-21b61fef463b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:58.981796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cf7132b-af1b-484d-b861-21b61fef463b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:58.982253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cf7132b-af1b-484d-b861-21b61fef463b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:58.982682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8cf7132b-af1b-484d-b861-21b61fef463b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:59.009001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8cf7132b-af1b-484d-b861-21b61fef463b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:16:59.061829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:59.095142 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8cf7132b-af1b-484d-b861-21b61fef463b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "DELETE /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 204 len: 0 microversion: 2.1 time: 0.125393 Oct 18 14:16:59.095947 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3399/7002] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:16:58 2022] DELETE /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:16:59.104710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-81471184-c2fc-42df-b940-7e8ece99f14b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:16:59.105368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-81471184-c2fc-42df-b940-7e8ece99f14b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:16:59.111478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81471184-c2fc-42df-b940-7e8ece99f14b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:59.111974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81471184-c2fc-42df-b940-7e8ece99f14b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:59.112423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81471184-c2fc-42df-b940-7e8ece99f14b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:59.113137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81471184-c2fc-42df-b940-7e8ece99f14b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:16:59.113642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81471184-c2fc-42df-b940-7e8ece99f14b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:16:59.114084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-81471184-c2fc-42df-b940-7e8ece99f14b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:16:59.130610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:16:59.255437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-81471184-c2fc-42df-b940-7e8ece99f14b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:16:59.265635 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-81471184-c2fc-42df-b940-7e8ece99f14b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1675 microversion: 2.1 time: 0.165405 Oct 18 14:16:59.266354 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3604/7003] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:16:59 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:00.290412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5987706b-dd54-410d-a8a3-ee816cce423b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:00.291183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5987706b-dd54-410d-a8a3-ee816cce423b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:00.298497 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5987706b-dd54-410d-a8a3-ee816cce423b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:00.298986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5987706b-dd54-410d-a8a3-ee816cce423b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:00.299451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5987706b-dd54-410d-a8a3-ee816cce423b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:00.300158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5987706b-dd54-410d-a8a3-ee816cce423b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:00.300615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5987706b-dd54-410d-a8a3-ee816cce423b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:00.301050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5987706b-dd54-410d-a8a3-ee816cce423b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:00.436924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5987706b-dd54-410d-a8a3-ee816cce423b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:00.446207 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5987706b-dd54-410d-a8a3-ee816cce423b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 200 len: 1675 microversion: 2.1 time: 0.160280 Oct 18 14:17:00.446811 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3400/7004] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:00 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:01.249800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f9e39a89-fec0-4b5c-897c-48b204d49360 req-ce831110-772f-40d3-ab64-80b9bd7b1abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471c1d54-bf27-4920-b629-022cb57259cb", "name": "network-vif-deleted", "tag": "4ade8d6a-2035-423c-a35b-8cfe25d44392"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:17:01.265090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f9e39a89-fec0-4b5c-897c-48b204d49360 req-ce831110-772f-40d3-ab64-80b9bd7b1abd service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:01.265623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f9e39a89-fec0-4b5c-897c-48b204d49360 req-ce831110-772f-40d3-ab64-80b9bd7b1abd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:01.266071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f9e39a89-fec0-4b5c-897c-48b204d49360 req-ce831110-772f-40d3-ab64-80b9bd7b1abd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:01.280176 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f9e39a89-fec0-4b5c-897c-48b204d49360 req-ce831110-772f-40d3-ab64-80b9bd7b1abd service nova] Creating event network-vif-deleted:4ade8d6a-2035-423c-a35b-8cfe25d44392 for instance 471c1d54-bf27-4920-b629-022cb57259cb on n-h2-858384-13 Oct 18 14:17:01.285555 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f9e39a89-fec0-4b5c-897c-48b204d49360 req-ce831110-772f-40d3-ab64-80b9bd7b1abd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039546 Oct 18 14:17:01.286437 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3605/7005] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:17:01.470168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6ecb926f-50c9-46f2-983d-448edc124701 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:01.470989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6ecb926f-50c9-46f2-983d-448edc124701 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:01.480279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ecb926f-50c9-46f2-983d-448edc124701 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:01.480763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ecb926f-50c9-46f2-983d-448edc124701 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:01.481210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ecb926f-50c9-46f2-983d-448edc124701 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:01.481913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ecb926f-50c9-46f2-983d-448edc124701 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:01.482365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ecb926f-50c9-46f2-983d-448edc124701 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:01.482791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ecb926f-50c9-46f2-983d-448edc124701 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:01.499738 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-6ecb926f-50c9-46f2-983d-448edc124701 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6ecb926f-50c9-46f2-983d-448edc124701 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb HTTP/1.1 Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '471c1d54-bf27-4920-b629-022cb57259cb'} Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:01.501452 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.506144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:01.506144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:01.506144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:01.506144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:01.506144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:01.506144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:17:01.506144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.506144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6ecb926f-50c9-46f2-983d-448edc124701 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:01.506144 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6ecb926f-50c9-46f2-983d-448edc124701 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 404 len: 111 microversion: 2.1 time: 0.037287 Oct 18 14:17:01.506841 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3401/7006] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:01 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:17:01.517948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ea3d43c8-d1ab-4fb2-b6a7-7af07a576749 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:01.518671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ea3d43c8-d1ab-4fb2-b6a7-7af07a576749 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:01.525561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea3d43c8-d1ab-4fb2-b6a7-7af07a576749 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:01.526067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea3d43c8-d1ab-4fb2-b6a7-7af07a576749 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:01.526511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea3d43c8-d1ab-4fb2-b6a7-7af07a576749 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:01.527227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea3d43c8-d1ab-4fb2-b6a7-7af07a576749 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:01.527756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea3d43c8-d1ab-4fb2-b6a7-7af07a576749 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:01.528194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea3d43c8-d1ab-4fb2-b6a7-7af07a576749 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:01.543069 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-ea3d43c8-d1ab-4fb2-b6a7-7af07a576749 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ea3d43c8-d1ab-4fb2-b6a7-7af07a576749 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb HTTP/1.1 Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '471c1d54-bf27-4920-b629-022cb57259cb'} Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:17:01.544778 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.556483 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:17:01.556483 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:17:01.556483 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:17:01.556483 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:17:01.556483 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:17:01.556483 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:17:01.556483 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:17:01.556483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ea3d43c8-d1ab-4fb2-b6a7-7af07a576749 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:17:01.556483 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ea3d43c8-d1ab-4fb2-b6a7-7af07a576749 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 404 len: 111 microversion: 2.1 time: 0.033143 Oct 18 14:17:01.556483 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3606/7007] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:01 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:17:01.598353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1502447901", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "9ee6393f-1f96-4d8a-a8c7-9559f9047108"}], "security_groups": [{"name": "tempest-securitygroup--1102295394"}], "key_name": "tempest-keypair-356831020", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:17:01.704928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] validate_networks() for [('9ee6393f-1f96-4d8a-a8c7-9559f9047108', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:17:02.188890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:17:02.189352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:17:02.189841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:17:02.190256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:17:02.190676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:17:02.200732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:02.201251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:02.201700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:02.202445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:02.202902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:02.203336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:02.223181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:17:02.229366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for user 7dbfce990e5248698b492af6c8b2ba85 and project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:17:02.242944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:17:02.245322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:17:02.297166 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4cfcdf16-4cad-45df-b2fd-f9f0a3cb3194 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.702712 Oct 18 14:17:02.298239 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3402/7008] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:17:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:17:02.310558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4a79641-bcdd-4e03-afa3-f06a85f08a55 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:02.311185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e4a79641-bcdd-4e03-afa3-f06a85f08a55 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:02.374205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e4a79641-bcdd-4e03-afa3-f06a85f08a55 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:02.384027 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e4a79641-bcdd-4e03-afa3-f06a85f08a55 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1238 microversion: 2.1 time: 0.077451 Oct 18 14:17:02.385372 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3607/7009] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:02 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:17:03.408958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-96d4597e-74a4-4754-86a9-21a6a3b0aee8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:03.409643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-96d4597e-74a4-4754-86a9-21a6a3b0aee8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:03.417841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96d4597e-74a4-4754-86a9-21a6a3b0aee8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:03.418377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96d4597e-74a4-4754-86a9-21a6a3b0aee8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:03.418819 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96d4597e-74a4-4754-86a9-21a6a3b0aee8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:03.419521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96d4597e-74a4-4754-86a9-21a6a3b0aee8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:03.419977 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96d4597e-74a4-4754-86a9-21a6a3b0aee8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:03.420399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-96d4597e-74a4-4754-86a9-21a6a3b0aee8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:03.810262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-96d4597e-74a4-4754-86a9-21a6a3b0aee8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:03.818308 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-96d4597e-74a4-4754-86a9-21a6a3b0aee8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1298 microversion: 2.1 time: 0.414273 Oct 18 14:17:03.818898 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3403/7010] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:03 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1298 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:04.843473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-80378188-4964-4fd6-b0f4-f85abebf5505 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:04.844119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-80378188-4964-4fd6-b0f4-f85abebf5505 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:04.851042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80378188-4964-4fd6-b0f4-f85abebf5505 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:04.851777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80378188-4964-4fd6-b0f4-f85abebf5505 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:04.852233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80378188-4964-4fd6-b0f4-f85abebf5505 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:04.852968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80378188-4964-4fd6-b0f4-f85abebf5505 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:04.854316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80378188-4964-4fd6-b0f4-f85abebf5505 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:04.854788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80378188-4964-4fd6-b0f4-f85abebf5505 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:04.989106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-80378188-4964-4fd6-b0f4-f85abebf5505 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:04.997346 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-80378188-4964-4fd6-b0f4-f85abebf5505 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1364 microversion: 2.1 time: 0.157773 Oct 18 14:17:04.997941 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3608/7011] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:04 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:05.212983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b941cd5e-b2c6-4fef-a266-837f3d31321e req-19e374df-df7c-4c92-843c-2c929fd06977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f9bcf1-9eb7-495b-9b9a-8a147d1428b0", "tag": "606f80f0-c9e4-4108-bbc4-911cc3f3306a"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:17:05.224874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b941cd5e-b2c6-4fef-a266-837f3d31321e req-19e374df-df7c-4c92-843c-2c929fd06977 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:05.225462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b941cd5e-b2c6-4fef-a266-837f3d31321e req-19e374df-df7c-4c92-843c-2c929fd06977 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:05.227078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b941cd5e-b2c6-4fef-a266-837f3d31321e req-19e374df-df7c-4c92-843c-2c929fd06977 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:05.241267 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b941cd5e-b2c6-4fef-a266-837f3d31321e req-19e374df-df7c-4c92-843c-2c929fd06977 service nova] Creating event network-changed:606f80f0-c9e4-4108-bbc4-911cc3f3306a for instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 on n-h1-858384-13 Oct 18 14:17:05.246691 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b941cd5e-b2c6-4fef-a266-837f3d31321e req-19e374df-df7c-4c92-843c-2c929fd06977 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038239 Oct 18 14:17:05.247499 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3404/7012] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:17:06.021997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-43baef50-708c-4260-a692-999500eca117 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:06.022628 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-43baef50-708c-4260-a692-999500eca117 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:06.029684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43baef50-708c-4260-a692-999500eca117 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:06.030181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43baef50-708c-4260-a692-999500eca117 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:06.030631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43baef50-708c-4260-a692-999500eca117 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:06.031334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43baef50-708c-4260-a692-999500eca117 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:06.031805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43baef50-708c-4260-a692-999500eca117 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:06.032244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-43baef50-708c-4260-a692-999500eca117 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:06.166359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-43baef50-708c-4260-a692-999500eca117 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:06.174072 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-43baef50-708c-4260-a692-999500eca117 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1364 microversion: 2.1 time: 0.156065 Oct 18 14:17:06.174654 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3609/7013] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:06 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:07.198969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-29cbb52d-8ccc-4ae8-93f9-69434565465b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:07.199672 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-29cbb52d-8ccc-4ae8-93f9-69434565465b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:07.202550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:07.209248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29cbb52d-8ccc-4ae8-93f9-69434565465b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:07.209743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29cbb52d-8ccc-4ae8-93f9-69434565465b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:07.211098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29cbb52d-8ccc-4ae8-93f9-69434565465b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:07.211937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29cbb52d-8ccc-4ae8-93f9-69434565465b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:07.212478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29cbb52d-8ccc-4ae8-93f9-69434565465b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:07.212984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29cbb52d-8ccc-4ae8-93f9-69434565465b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:07.348676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-29cbb52d-8ccc-4ae8-93f9-69434565465b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:07.357401 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-29cbb52d-8ccc-4ae8-93f9-69434565465b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1364 microversion: 2.1 time: 0.162647 Oct 18 14:17:07.357986 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3405/7014] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:07 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:08.380108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-45714ede-e9ba-401e-8173-2ad8506998f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:08.380740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-45714ede-e9ba-401e-8173-2ad8506998f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:08.383862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=45 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:08.390028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45714ede-e9ba-401e-8173-2ad8506998f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:08.390546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45714ede-e9ba-401e-8173-2ad8506998f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:08.391006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45714ede-e9ba-401e-8173-2ad8506998f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:08.391733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45714ede-e9ba-401e-8173-2ad8506998f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:08.392212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45714ede-e9ba-401e-8173-2ad8506998f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:08.392661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45714ede-e9ba-401e-8173-2ad8506998f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:08.529606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-45714ede-e9ba-401e-8173-2ad8506998f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:08.537595 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-45714ede-e9ba-401e-8173-2ad8506998f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1364 microversion: 2.1 time: 0.161394 Oct 18 14:17:08.538184 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3610/7015] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:08 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:09.567224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-58524019-8570-4f9a-9047-74dea1c02e6c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:09.567900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-58524019-8570-4f9a-9047-74dea1c02e6c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:09.575327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58524019-8570-4f9a-9047-74dea1c02e6c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:09.575807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58524019-8570-4f9a-9047-74dea1c02e6c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:09.576239 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58524019-8570-4f9a-9047-74dea1c02e6c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:09.576925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58524019-8570-4f9a-9047-74dea1c02e6c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:09.577407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58524019-8570-4f9a-9047-74dea1c02e6c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:09.577834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58524019-8570-4f9a-9047-74dea1c02e6c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:09.717844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-58524019-8570-4f9a-9047-74dea1c02e6c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:09.726543 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-58524019-8570-4f9a-9047-74dea1c02e6c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1364 microversion: 2.1 time: 0.162779 Oct 18 14:17:09.727140 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3406/7016] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:09 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:10.750966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c9cd5779-9b4e-404c-b24d-b752cf625919 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:10.751604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c9cd5779-9b4e-404c-b24d-b752cf625919 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:10.759956 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9cd5779-9b4e-404c-b24d-b752cf625919 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:10.760463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9cd5779-9b4e-404c-b24d-b752cf625919 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:10.760943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9cd5779-9b4e-404c-b24d-b752cf625919 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:10.761720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9cd5779-9b4e-404c-b24d-b752cf625919 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:10.762205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9cd5779-9b4e-404c-b24d-b752cf625919 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:10.762653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c9cd5779-9b4e-404c-b24d-b752cf625919 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:10.912604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c9cd5779-9b4e-404c-b24d-b752cf625919 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:10.921207 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c9cd5779-9b4e-404c-b24d-b752cf625919 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1364 microversion: 2.1 time: 0.174114 Oct 18 14:17:10.921842 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3611/7017] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:10 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:11.183808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-83d87198-74f3-4e8c-8200-922c93bffc35 req-98cc5bcb-a559-4f14-bac2-934543c9ae31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f9bcf1-9eb7-495b-9b9a-8a147d1428b0", "name": "network-vif-plugged", "status": "completed", "tag": "606f80f0-c9e4-4108-bbc4-911cc3f3306a"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:17:11.195185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-83d87198-74f3-4e8c-8200-922c93bffc35 req-98cc5bcb-a559-4f14-bac2-934543c9ae31 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:11.195185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-83d87198-74f3-4e8c-8200-922c93bffc35 req-98cc5bcb-a559-4f14-bac2-934543c9ae31 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:11.199250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-83d87198-74f3-4e8c-8200-922c93bffc35 req-98cc5bcb-a559-4f14-bac2-934543c9ae31 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:11.207717 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-83d87198-74f3-4e8c-8200-922c93bffc35 req-98cc5bcb-a559-4f14-bac2-934543c9ae31 service nova] Creating event network-vif-plugged:606f80f0-c9e4-4108-bbc4-911cc3f3306a for instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 on n-h1-858384-13 Oct 18 14:17:11.212889 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-83d87198-74f3-4e8c-8200-922c93bffc35 req-98cc5bcb-a559-4f14-bac2-934543c9ae31 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033463 Oct 18 14:17:11.213561 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3407/7018] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:17:11.946100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ff08ec59-26b1-4d82-b7c9-68101782e3bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:11.946656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ff08ec59-26b1-4d82-b7c9-68101782e3bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:11.953689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff08ec59-26b1-4d82-b7c9-68101782e3bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:11.954195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff08ec59-26b1-4d82-b7c9-68101782e3bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:11.954657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff08ec59-26b1-4d82-b7c9-68101782e3bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:11.955371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff08ec59-26b1-4d82-b7c9-68101782e3bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:11.955846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff08ec59-26b1-4d82-b7c9-68101782e3bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:11.956289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ff08ec59-26b1-4d82-b7c9-68101782e3bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:12.090541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ff08ec59-26b1-4d82-b7c9-68101782e3bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:12.098178 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ff08ec59-26b1-4d82-b7c9-68101782e3bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1364 microversion: 2.1 time: 0.156713 Oct 18 14:17:12.098769 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3612/7019] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:11 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:13.123152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4ac1ae57-4671-4685-80d7-b53942a634ec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:13.123771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4ac1ae57-4671-4685-80d7-b53942a634ec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:13.126653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:13.127344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:13.133456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ac1ae57-4671-4685-80d7-b53942a634ec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:13.133946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ac1ae57-4671-4685-80d7-b53942a634ec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:13.134382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ac1ae57-4671-4685-80d7-b53942a634ec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:13.135080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ac1ae57-4671-4685-80d7-b53942a634ec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:13.135541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ac1ae57-4671-4685-80d7-b53942a634ec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:13.135990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ac1ae57-4671-4685-80d7-b53942a634ec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:13.271461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4ac1ae57-4671-4685-80d7-b53942a634ec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:17:13.279878 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4ac1ae57-4671-4685-80d7-b53942a634ec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1550 microversion: 2.1 time: 0.160970 Oct 18 14:17:13.280462 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3408/7020] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:17:13 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:17:13.303598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a5bfafe5-0616-4bf2-98cd-bdf70b3a9f48 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:17:13.304336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a5bfafe5-0616-4bf2-98cd-bdf70b3a9f48 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:17:13.306080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:17:13.312185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5bfafe5-0616-4bf2-98cd-bdf70b3a9f48 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:13.312687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5bfafe5-0616-4bf2-98cd-bdf70b3a9f48 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:13.313141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5bfafe5-0616-4bf2-98cd-bdf70b3a9f48 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:13.313875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5bfafe5-0616-4bf2-98cd-bdf70b3a9f48 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:13.314347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5bfafe5-0616-4bf2-98cd-bdf70b3a9f48 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:13.314793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5bfafe5-0616-4bf2-98cd-bdf70b3a9f48 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:13.393507 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a5bfafe5-0616-4bf2-98cd-bdf70b3a9f48 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093697 Oct 18 14:17:13.394115 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3613/7021] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 14:17:13 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:17:14.337532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-41cb4837-877a-43b2-a452-83b1b51eaf30 req-6580a371-aba7-4fab-b585-683793531570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f9bcf1-9eb7-495b-9b9a-8a147d1428b0", "tag": "606f80f0-c9e4-4108-bbc4-911cc3f3306a"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:17:14.347733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-41cb4837-877a-43b2-a452-83b1b51eaf30 req-6580a371-aba7-4fab-b585-683793531570 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:17:14.348233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-41cb4837-877a-43b2-a452-83b1b51eaf30 req-6580a371-aba7-4fab-b585-683793531570 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:17:14.348652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-41cb4837-877a-43b2-a452-83b1b51eaf30 req-6580a371-aba7-4fab-b585-683793531570 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:17:14.360595 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-41cb4837-877a-43b2-a452-83b1b51eaf30 req-6580a371-aba7-4fab-b585-683793531570 service nova] Creating event network-changed:606f80f0-c9e4-4108-bbc4-911cc3f3306a for instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 on n-h1-858384-13 Oct 18 14:17:14.365564 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-41cb4837-877a-43b2-a452-83b1b51eaf30 req-6580a371-aba7-4fab-b585-683793531570 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031868 Oct 18 14:17:14.366926 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3409/7022] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:18:18.094702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=7 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:18.095534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=41 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:18.096333 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:18:18.096494 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:18:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0/action (ip 10.222.0.40) !!! Oct 18 14:18:18.102718 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:18:18.102863 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:18:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0/action (ip 10.222.0.40) !!! Oct 18 14:18:18.109155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c30b213-7112-4438-8ba5-9b65abb07975 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:18:18.118528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c30b213-7112-4438-8ba5-9b65abb07975 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:18.119036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c30b213-7112-4438-8ba5-9b65abb07975 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:18.119486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c30b213-7112-4438-8ba5-9b65abb07975 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:18.144553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c30b213-7112-4438-8ba5-9b65abb07975 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Going to try to stop instance {{(pid=120611) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 14:18:18.189537 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c30b213-7112-4438-8ba5-9b65abb07975 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0/action" status: 202 len: 0 microversion: 2.1 time: 0.096897 Oct 18 14:18:18.190155 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3614/7023] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:18:18 2022] POST /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:18:18.197633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=9 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:18.198718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=40 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:18.199599 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:18:18.199801 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:18:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 (ip 10.222.0.40) !!! Oct 18 14:18:18.207352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-51020a3a-1893-4a15-ad18-2df70cd7988a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:18.208959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-51020a3a-1893-4a15-ad18-2df70cd7988a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:18.216938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51020a3a-1893-4a15-ad18-2df70cd7988a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:18.217953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51020a3a-1893-4a15-ad18-2df70cd7988a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:18.218376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51020a3a-1893-4a15-ad18-2df70cd7988a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:18.219102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51020a3a-1893-4a15-ad18-2df70cd7988a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:18.219569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51020a3a-1893-4a15-ad18-2df70cd7988a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:18.220028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-51020a3a-1893-4a15-ad18-2df70cd7988a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:18.363361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-51020a3a-1893-4a15-ad18-2df70cd7988a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:18.372074 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-51020a3a-1893-4a15-ad18-2df70cd7988a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1678 microversion: 2.1 time: 0.177466 Oct 18 14:18:18.372643 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3410/7024] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:18 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:19.397061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-18bb2f49-6580-4a0a-b3ff-4fb551781f5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:19.397731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-18bb2f49-6580-4a0a-b3ff-4fb551781f5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:19.404809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18bb2f49-6580-4a0a-b3ff-4fb551781f5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:19.405415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18bb2f49-6580-4a0a-b3ff-4fb551781f5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:19.405869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18bb2f49-6580-4a0a-b3ff-4fb551781f5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:19.406580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18bb2f49-6580-4a0a-b3ff-4fb551781f5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:19.407054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18bb2f49-6580-4a0a-b3ff-4fb551781f5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:19.407500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-18bb2f49-6580-4a0a-b3ff-4fb551781f5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:19.541955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-18bb2f49-6580-4a0a-b3ff-4fb551781f5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:19.550397 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-18bb2f49-6580-4a0a-b3ff-4fb551781f5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1678 microversion: 2.1 time: 0.158551 Oct 18 14:18:19.551005 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3615/7025] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:19 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:20.576978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e3866dc5-f217-49b8-afa9-52549239bf41 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:20.577632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e3866dc5-f217-49b8-afa9-52549239bf41 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:20.585610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3866dc5-f217-49b8-afa9-52549239bf41 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:20.586102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3866dc5-f217-49b8-afa9-52549239bf41 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:20.586553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3866dc5-f217-49b8-afa9-52549239bf41 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:20.587241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3866dc5-f217-49b8-afa9-52549239bf41 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:20.587695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3866dc5-f217-49b8-afa9-52549239bf41 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:20.588124 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e3866dc5-f217-49b8-afa9-52549239bf41 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:20.725552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e3866dc5-f217-49b8-afa9-52549239bf41 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:20.733483 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e3866dc5-f217-49b8-afa9-52549239bf41 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1678 microversion: 2.1 time: 0.161211 Oct 18 14:18:20.734061 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3411/7026] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:20 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:21.759945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-97953e3a-6f82-40e1-b711-8a2efc5c76d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:21.760487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-97953e3a-6f82-40e1-b711-8a2efc5c76d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:21.767338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97953e3a-6f82-40e1-b711-8a2efc5c76d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:21.767863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97953e3a-6f82-40e1-b711-8a2efc5c76d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:21.768312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97953e3a-6f82-40e1-b711-8a2efc5c76d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:21.769012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97953e3a-6f82-40e1-b711-8a2efc5c76d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:21.769501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97953e3a-6f82-40e1-b711-8a2efc5c76d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:21.769940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97953e3a-6f82-40e1-b711-8a2efc5c76d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:21.903875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-97953e3a-6f82-40e1-b711-8a2efc5c76d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:21.911735 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-97953e3a-6f82-40e1-b711-8a2efc5c76d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1678 microversion: 2.1 time: 0.157596 Oct 18 14:18:21.912325 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3616/7027] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:21 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:22.935719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-70c98edc-b52e-46a7-893a-36a7d02ac378 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:22.936338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-70c98edc-b52e-46a7-893a-36a7d02ac378 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:22.943296 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70c98edc-b52e-46a7-893a-36a7d02ac378 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:22.943786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70c98edc-b52e-46a7-893a-36a7d02ac378 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:22.944257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70c98edc-b52e-46a7-893a-36a7d02ac378 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:22.944983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70c98edc-b52e-46a7-893a-36a7d02ac378 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:22.945470 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70c98edc-b52e-46a7-893a-36a7d02ac378 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:22.945902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70c98edc-b52e-46a7-893a-36a7d02ac378 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:23.080219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-70c98edc-b52e-46a7-893a-36a7d02ac378 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:23.088909 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-70c98edc-b52e-46a7-893a-36a7d02ac378 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1678 microversion: 2.1 time: 0.157692 Oct 18 14:18:23.089745 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3412/7028] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:22 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:24.112055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-768b01e1-d42a-48dd-8d10-de1865befaa8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:24.112935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-768b01e1-d42a-48dd-8d10-de1865befaa8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:24.121124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768b01e1-d42a-48dd-8d10-de1865befaa8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:24.121658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768b01e1-d42a-48dd-8d10-de1865befaa8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:24.122108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768b01e1-d42a-48dd-8d10-de1865befaa8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:24.122809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768b01e1-d42a-48dd-8d10-de1865befaa8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:24.123275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768b01e1-d42a-48dd-8d10-de1865befaa8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:24.123721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-768b01e1-d42a-48dd-8d10-de1865befaa8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:24.267279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-768b01e1-d42a-48dd-8d10-de1865befaa8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:24.275185 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-768b01e1-d42a-48dd-8d10-de1865befaa8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1678 microversion: 2.1 time: 0.167048 Oct 18 14:18:24.275765 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3617/7029] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:24 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:25.300337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-75a76a33-2bd4-45a7-80c1-7a1f0fb9e2c4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:25.301011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-75a76a33-2bd4-45a7-80c1-7a1f0fb9e2c4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:25.308144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75a76a33-2bd4-45a7-80c1-7a1f0fb9e2c4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:25.308553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75a76a33-2bd4-45a7-80c1-7a1f0fb9e2c4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:25.308984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75a76a33-2bd4-45a7-80c1-7a1f0fb9e2c4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:25.309722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75a76a33-2bd4-45a7-80c1-7a1f0fb9e2c4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:25.310201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75a76a33-2bd4-45a7-80c1-7a1f0fb9e2c4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:25.310651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-75a76a33-2bd4-45a7-80c1-7a1f0fb9e2c4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:25.453014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-75a76a33-2bd4-45a7-80c1-7a1f0fb9e2c4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:25.462464 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-75a76a33-2bd4-45a7-80c1-7a1f0fb9e2c4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1678 microversion: 2.1 time: 0.166192 Oct 18 14:18:25.463069 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3413/7030] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:25 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:26.486937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca16b505-1054-41e0-8950-6293c2fa699a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:26.487476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca16b505-1054-41e0-8950-6293c2fa699a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:26.493938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca16b505-1054-41e0-8950-6293c2fa699a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:26.494431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca16b505-1054-41e0-8950-6293c2fa699a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:26.494891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca16b505-1054-41e0-8950-6293c2fa699a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:26.496171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca16b505-1054-41e0-8950-6293c2fa699a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:26.496641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca16b505-1054-41e0-8950-6293c2fa699a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:26.497076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca16b505-1054-41e0-8950-6293c2fa699a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:26.632171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ca16b505-1054-41e0-8950-6293c2fa699a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:26.640079 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca16b505-1054-41e0-8950-6293c2fa699a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1678 microversion: 2.1 time: 0.157295 Oct 18 14:18:26.640670 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3618/7031] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:26 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:27.663246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6b486f53-3427-4203-9f9d-c2e2d0604563 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:27.663860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6b486f53-3427-4203-9f9d-c2e2d0604563 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:27.671051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b486f53-3427-4203-9f9d-c2e2d0604563 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:27.671536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b486f53-3427-4203-9f9d-c2e2d0604563 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:27.671971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b486f53-3427-4203-9f9d-c2e2d0604563 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:27.672664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b486f53-3427-4203-9f9d-c2e2d0604563 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:27.673123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b486f53-3427-4203-9f9d-c2e2d0604563 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:27.673573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6b486f53-3427-4203-9f9d-c2e2d0604563 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:27.811336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6b486f53-3427-4203-9f9d-c2e2d0604563 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:27.819468 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6b486f53-3427-4203-9f9d-c2e2d0604563 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1678 microversion: 2.1 time: 0.160079 Oct 18 14:18:27.820091 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3414/7032] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:27 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:28.846284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc0c5b34-2334-4702-a4f0-3018fc93328c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:28.846940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc0c5b34-2334-4702-a4f0-3018fc93328c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:28.853078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0c5b34-2334-4702-a4f0-3018fc93328c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:28.853597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0c5b34-2334-4702-a4f0-3018fc93328c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:28.854043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0c5b34-2334-4702-a4f0-3018fc93328c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:28.854907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0c5b34-2334-4702-a4f0-3018fc93328c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:28.855369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0c5b34-2334-4702-a4f0-3018fc93328c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:28.855802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc0c5b34-2334-4702-a4f0-3018fc93328c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:29.326509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc0c5b34-2334-4702-a4f0-3018fc93328c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:29.334956 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc0c5b34-2334-4702-a4f0-3018fc93328c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1655 microversion: 2.1 time: 0.494121 Oct 18 14:18:29.335553 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3619/7033] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:28 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1655 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:29.358860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:18:29.361025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:29.367997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:29.368477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:29.368938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:29.369661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:29.370828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:29.371423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:29.401121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:29.407265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Old instance type m1.heat2, new instance type m1.heat {{(pid=120612) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:18:29.413948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:18:29.414369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:18:29.414846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:18:29.415257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:18:29.415671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:18:29.482882 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb806f0e-d944-4a6c-8847-267fa886cbf3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0/action" status: 202 len: 0 microversion: 2.1 time: 0.128676 Oct 18 14:18:29.483684 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3415/7034] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:18:29 2022] POST /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:18:29.491906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f73ddd68-11e6-4b37-81e1-14bf2ede2123 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:29.492633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f73ddd68-11e6-4b37-81e1-14bf2ede2123 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:29.499801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f73ddd68-11e6-4b37-81e1-14bf2ede2123 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:29.500302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f73ddd68-11e6-4b37-81e1-14bf2ede2123 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:29.500760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f73ddd68-11e6-4b37-81e1-14bf2ede2123 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:29.501511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f73ddd68-11e6-4b37-81e1-14bf2ede2123 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:29.501987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f73ddd68-11e6-4b37-81e1-14bf2ede2123 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:29.502434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f73ddd68-11e6-4b37-81e1-14bf2ede2123 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:29.641213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f73ddd68-11e6-4b37-81e1-14bf2ede2123 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:29.649413 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f73ddd68-11e6-4b37-81e1-14bf2ede2123 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1678 microversion: 2.1 time: 0.161352 Oct 18 14:18:29.650426 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3620/7035] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:29 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:18:30.673879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5c52aa76-ab88-4071-9d7b-32c56d2aa897 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:30.674519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5c52aa76-ab88-4071-9d7b-32c56d2aa897 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:30.683034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c52aa76-ab88-4071-9d7b-32c56d2aa897 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:30.683547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c52aa76-ab88-4071-9d7b-32c56d2aa897 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:30.683989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c52aa76-ab88-4071-9d7b-32c56d2aa897 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:30.684810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c52aa76-ab88-4071-9d7b-32c56d2aa897 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:30.685305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c52aa76-ab88-4071-9d7b-32c56d2aa897 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:30.685747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5c52aa76-ab88-4071-9d7b-32c56d2aa897 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:30.838213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5c52aa76-ab88-4071-9d7b-32c56d2aa897 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:30.847095 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5c52aa76-ab88-4071-9d7b-32c56d2aa897 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1678 microversion: 2.1 time: 0.177187 Oct 18 14:18:30.847681 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3416/7036] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:30 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:31.877680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a5b2a31-be13-49ec-bc20-0208ffd89fb8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:31.878232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1a5b2a31-be13-49ec-bc20-0208ffd89fb8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:31.885415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a5b2a31-be13-49ec-bc20-0208ffd89fb8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:31.886306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a5b2a31-be13-49ec-bc20-0208ffd89fb8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:31.886769 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a5b2a31-be13-49ec-bc20-0208ffd89fb8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:31.888566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a5b2a31-be13-49ec-bc20-0208ffd89fb8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:31.889082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a5b2a31-be13-49ec-bc20-0208ffd89fb8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:31.889559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a5b2a31-be13-49ec-bc20-0208ffd89fb8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:32.024263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1a5b2a31-be13-49ec-bc20-0208ffd89fb8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:32.032684 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1a5b2a31-be13-49ec-bc20-0208ffd89fb8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1683 microversion: 2.1 time: 0.159050 Oct 18 14:18:32.033815 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3621/7037] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:31 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:18:33.059870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3c3dec4d-1287-4365-b08a-10e1ac39c3d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:33.060498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3c3dec4d-1287-4365-b08a-10e1ac39c3d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:33.067777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c3dec4d-1287-4365-b08a-10e1ac39c3d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:33.068264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c3dec4d-1287-4365-b08a-10e1ac39c3d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:33.068711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c3dec4d-1287-4365-b08a-10e1ac39c3d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:33.069521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c3dec4d-1287-4365-b08a-10e1ac39c3d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:33.069984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c3dec4d-1287-4365-b08a-10e1ac39c3d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:33.070412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3c3dec4d-1287-4365-b08a-10e1ac39c3d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:33.255292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3c3dec4d-1287-4365-b08a-10e1ac39c3d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:33.264385 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3c3dec4d-1287-4365-b08a-10e1ac39c3d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1683 microversion: 2.1 time: 0.209311 Oct 18 14:18:33.265761 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3417/7038] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:33 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1683 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:33.864337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-4259b762-eeac-42a3-a534-690543ecfb52 req-27823250-d8f7-4c43-b25b-47ee03edf1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f9bcf1-9eb7-495b-9b9a-8a147d1428b0", "name": "network-vif-unplugged", "status": "completed", "tag": "606f80f0-c9e4-4108-bbc4-911cc3f3306a"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:18:33.876707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4259b762-eeac-42a3-a534-690543ecfb52 req-27823250-d8f7-4c43-b25b-47ee03edf1ea service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:33.877319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4259b762-eeac-42a3-a534-690543ecfb52 req-27823250-d8f7-4c43-b25b-47ee03edf1ea service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:33.877847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4259b762-eeac-42a3-a534-690543ecfb52 req-27823250-d8f7-4c43-b25b-47ee03edf1ea service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:33.895209 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-4259b762-eeac-42a3-a534-690543ecfb52 req-27823250-d8f7-4c43-b25b-47ee03edf1ea service nova] Creating event network-vif-unplugged:606f80f0-c9e4-4108-bbc4-911cc3f3306a for instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 on n-h2-858384-13 Oct 18 14:18:33.919187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [req-4259b762-eeac-42a3-a534-690543ecfb52 req-27823250-d8f7-4c43-b25b-47ee03edf1ea service nova] Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:18:33.933065 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-4259b762-eeac-42a3-a534-690543ecfb52 req-27823250-d8f7-4c43-b25b-47ee03edf1ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071505 Oct 18 14:18:33.933831 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3622/7039] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:18:34.289084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-de1dde30-ef3d-43dc-ad7d-f89af5ebfeb3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:34.290419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-de1dde30-ef3d-43dc-ad7d-f89af5ebfeb3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:34.298505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de1dde30-ef3d-43dc-ad7d-f89af5ebfeb3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:34.298992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de1dde30-ef3d-43dc-ad7d-f89af5ebfeb3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:34.299454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de1dde30-ef3d-43dc-ad7d-f89af5ebfeb3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:34.300225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de1dde30-ef3d-43dc-ad7d-f89af5ebfeb3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:34.300854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de1dde30-ef3d-43dc-ad7d-f89af5ebfeb3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:34.301465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de1dde30-ef3d-43dc-ad7d-f89af5ebfeb3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:34.458820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-de1dde30-ef3d-43dc-ad7d-f89af5ebfeb3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:34.469516 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-de1dde30-ef3d-43dc-ad7d-f89af5ebfeb3 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1682 microversion: 2.1 time: 0.184173 Oct 18 14:18:34.470310 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3418/7040] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:34 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:35.497104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b34ff816-cb46-4138-a888-e4b844757ad9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:35.497863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b34ff816-cb46-4138-a888-e4b844757ad9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:35.504638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b34ff816-cb46-4138-a888-e4b844757ad9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:35.505168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b34ff816-cb46-4138-a888-e4b844757ad9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:35.505665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b34ff816-cb46-4138-a888-e4b844757ad9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:35.506369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b34ff816-cb46-4138-a888-e4b844757ad9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:35.506845 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b34ff816-cb46-4138-a888-e4b844757ad9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:35.507286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b34ff816-cb46-4138-a888-e4b844757ad9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:35.647109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b34ff816-cb46-4138-a888-e4b844757ad9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:35.655725 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b34ff816-cb46-4138-a888-e4b844757ad9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1680 microversion: 2.1 time: 0.164797 Oct 18 14:18:35.656306 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3623/7041] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:35 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:35.963097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-57e5abc3-5b59-4b7a-9f1a-2c40a2b356e6 req-4c6857ed-ae5b-444f-8e58-4c3f5e555132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f9bcf1-9eb7-495b-9b9a-8a147d1428b0", "tag": "606f80f0-c9e4-4108-bbc4-911cc3f3306a"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:18:35.974334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-57e5abc3-5b59-4b7a-9f1a-2c40a2b356e6 req-4c6857ed-ae5b-444f-8e58-4c3f5e555132 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:35.974818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-57e5abc3-5b59-4b7a-9f1a-2c40a2b356e6 req-4c6857ed-ae5b-444f-8e58-4c3f5e555132 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:35.975250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-57e5abc3-5b59-4b7a-9f1a-2c40a2b356e6 req-4c6857ed-ae5b-444f-8e58-4c3f5e555132 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:35.991613 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-57e5abc3-5b59-4b7a-9f1a-2c40a2b356e6 req-4c6857ed-ae5b-444f-8e58-4c3f5e555132 service nova] Creating event network-changed:606f80f0-c9e4-4108-bbc4-911cc3f3306a for instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 on n-h2-858384-13 Oct 18 14:18:35.997479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-57e5abc3-5b59-4b7a-9f1a-2c40a2b356e6 req-4c6857ed-ae5b-444f-8e58-4c3f5e555132 service nova] Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:18:36.008697 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-57e5abc3-5b59-4b7a-9f1a-2c40a2b356e6 req-4c6857ed-ae5b-444f-8e58-4c3f5e555132 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049287 Oct 18 14:18:36.009375 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3419/7042] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:18:36.680124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c427d7c0-ebcc-40f7-820c-f0ec1557baba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:36.680777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c427d7c0-ebcc-40f7-820c-f0ec1557baba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:36.687792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c427d7c0-ebcc-40f7-820c-f0ec1557baba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:36.688284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c427d7c0-ebcc-40f7-820c-f0ec1557baba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:36.688729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c427d7c0-ebcc-40f7-820c-f0ec1557baba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:36.689454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c427d7c0-ebcc-40f7-820c-f0ec1557baba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:36.689923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c427d7c0-ebcc-40f7-820c-f0ec1557baba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:36.690359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c427d7c0-ebcc-40f7-820c-f0ec1557baba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:36.825167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c427d7c0-ebcc-40f7-820c-f0ec1557baba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:36.833407 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c427d7c0-ebcc-40f7-820c-f0ec1557baba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1676 microversion: 2.1 time: 0.157181 Oct 18 14:18:36.833983 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3624/7043] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:36 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:36.857862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-629c5851-1f37-4e8d-9d27-0140f02c645f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:18:36.858505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-629c5851-1f37-4e8d-9d27-0140f02c645f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:36.864959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-629c5851-1f37-4e8d-9d27-0140f02c645f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:36.865499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-629c5851-1f37-4e8d-9d27-0140f02c645f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:36.865944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-629c5851-1f37-4e8d-9d27-0140f02c645f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:36.866643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-629c5851-1f37-4e8d-9d27-0140f02c645f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:36.867104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-629c5851-1f37-4e8d-9d27-0140f02c645f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:36.867560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-629c5851-1f37-4e8d-9d27-0140f02c645f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:36.927284 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-629c5851-1f37-4e8d-9d27-0140f02c645f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0/action" status: 204 len: 0 microversion: 2.1 time: 0.074175 Oct 18 14:18:36.927913 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3420/7044] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:18:36 2022] POST /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:18:36.936327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-32cfbc65-7069-45db-8cef-8ff47c2b29e1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:36.936960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-32cfbc65-7069-45db-8cef-8ff47c2b29e1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:36.943364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32cfbc65-7069-45db-8cef-8ff47c2b29e1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:36.943879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32cfbc65-7069-45db-8cef-8ff47c2b29e1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:36.944574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32cfbc65-7069-45db-8cef-8ff47c2b29e1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:36.945054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32cfbc65-7069-45db-8cef-8ff47c2b29e1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:36.945580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32cfbc65-7069-45db-8cef-8ff47c2b29e1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:36.946029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-32cfbc65-7069-45db-8cef-8ff47c2b29e1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:37.095305 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-32cfbc65-7069-45db-8cef-8ff47c2b29e1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:37.103764 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-32cfbc65-7069-45db-8cef-8ff47c2b29e1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1676 microversion: 2.1 time: 0.171355 Oct 18 14:18:37.104494 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3625/7045] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:36 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:38.130117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0ca4a0dc-0338-4bbf-a13c-d7a2761d8f5b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:38.130899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0ca4a0dc-0338-4bbf-a13c-d7a2761d8f5b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:38.139882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ca4a0dc-0338-4bbf-a13c-d7a2761d8f5b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:38.140507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ca4a0dc-0338-4bbf-a13c-d7a2761d8f5b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:38.140928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ca4a0dc-0338-4bbf-a13c-d7a2761d8f5b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:38.141695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ca4a0dc-0338-4bbf-a13c-d7a2761d8f5b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:38.142416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ca4a0dc-0338-4bbf-a13c-d7a2761d8f5b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:38.142614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ca4a0dc-0338-4bbf-a13c-d7a2761d8f5b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:38.290934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0ca4a0dc-0338-4bbf-a13c-d7a2761d8f5b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:38.299789 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0ca4a0dc-0338-4bbf-a13c-d7a2761d8f5b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1676 microversion: 2.1 time: 0.175475 Oct 18 14:18:38.300370 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3421/7046] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:38 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:18:39.324408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f8494c97-c849-47de-976b-e61a4fe57da5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:39.325143 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f8494c97-c849-47de-976b-e61a4fe57da5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:39.332861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8494c97-c849-47de-976b-e61a4fe57da5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:39.333423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8494c97-c849-47de-976b-e61a4fe57da5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:39.333966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8494c97-c849-47de-976b-e61a4fe57da5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:39.334694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8494c97-c849-47de-976b-e61a4fe57da5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:39.335161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8494c97-c849-47de-976b-e61a4fe57da5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:39.335687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f8494c97-c849-47de-976b-e61a4fe57da5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:39.473656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f8494c97-c849-47de-976b-e61a4fe57da5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:39.482738 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f8494c97-c849-47de-976b-e61a4fe57da5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1655 microversion: 2.1 time: 0.162748 Oct 18 14:18:39.483330 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3626/7047] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:39 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:39.505405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1d61659b-a763-4bc7-ac92-3ecd54158336 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:39.506013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1d61659b-a763-4bc7-ac92-3ecd54158336 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:39.512898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d61659b-a763-4bc7-ac92-3ecd54158336 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:39.513118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d61659b-a763-4bc7-ac92-3ecd54158336 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:39.513579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d61659b-a763-4bc7-ac92-3ecd54158336 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:39.514267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d61659b-a763-4bc7-ac92-3ecd54158336 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:39.514711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d61659b-a763-4bc7-ac92-3ecd54158336 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:39.515129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1d61659b-a763-4bc7-ac92-3ecd54158336 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:39.653094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1d61659b-a763-4bc7-ac92-3ecd54158336 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:39.662229 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1d61659b-a763-4bc7-ac92-3ecd54158336 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1655 microversion: 2.1 time: 0.160794 Oct 18 14:18:39.662825 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3422/7048] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:39 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1655 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:39.686277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-880f851f-0434-4b44-99fc-4329751a704c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:18:39.693023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-880f851f-0434-4b44-99fc-4329751a704c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:39.693729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-880f851f-0434-4b44-99fc-4329751a704c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:39.694227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-880f851f-0434-4b44-99fc-4329751a704c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:39.719428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-880f851f-0434-4b44-99fc-4329751a704c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Going to try to start instance {{(pid=120611) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 14:18:39.766878 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-880f851f-0434-4b44-99fc-4329751a704c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0/action" status: 202 len: 0 microversion: 2.1 time: 0.084799 Oct 18 14:18:39.767597 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3627/7049] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:18:39 2022] POST /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:18:39.779404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3a1f3674-5906-41c0-80f8-00c790b9733a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:39.780132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3a1f3674-5906-41c0-80f8-00c790b9733a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:39.786906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a1f3674-5906-41c0-80f8-00c790b9733a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:39.787584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a1f3674-5906-41c0-80f8-00c790b9733a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:39.788100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a1f3674-5906-41c0-80f8-00c790b9733a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:39.788891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a1f3674-5906-41c0-80f8-00c790b9733a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:39.789444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a1f3674-5906-41c0-80f8-00c790b9733a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:39.789864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a1f3674-5906-41c0-80f8-00c790b9733a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:39.938183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3a1f3674-5906-41c0-80f8-00c790b9733a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:39.947523 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3a1f3674-5906-41c0-80f8-00c790b9733a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1664 microversion: 2.1 time: 0.174418 Oct 18 14:18:39.948255 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3423/7050] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:39 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1664 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:40.699806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-2f6d603b-e4a3-4368-85b7-f8148f9ea2da req-79567f7b-3ea7-49fa-a5ae-d4af3c5f5135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f9bcf1-9eb7-495b-9b9a-8a147d1428b0", "name": "network-vif-plugged", "status": "completed", "tag": "606f80f0-c9e4-4108-bbc4-911cc3f3306a"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:18:40.711197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2f6d603b-e4a3-4368-85b7-f8148f9ea2da req-79567f7b-3ea7-49fa-a5ae-d4af3c5f5135 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:40.711701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2f6d603b-e4a3-4368-85b7-f8148f9ea2da req-79567f7b-3ea7-49fa-a5ae-d4af3c5f5135 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:40.712146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2f6d603b-e4a3-4368-85b7-f8148f9ea2da req-79567f7b-3ea7-49fa-a5ae-d4af3c5f5135 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:40.725322 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-2f6d603b-e4a3-4368-85b7-f8148f9ea2da req-79567f7b-3ea7-49fa-a5ae-d4af3c5f5135 service nova] Creating event network-vif-plugged:606f80f0-c9e4-4108-bbc4-911cc3f3306a for instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 on n-h2-858384-13 Oct 18 14:18:40.730413 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-2f6d603b-e4a3-4368-85b7-f8148f9ea2da req-79567f7b-3ea7-49fa-a5ae-d4af3c5f5135 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035917 Oct 18 14:18:40.731526 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3628/7051] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:18:40.976056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-71e53b88-fdd8-4c75-9a0a-3cb43b6aacff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:40.976694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-71e53b88-fdd8-4c75-9a0a-3cb43b6aacff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:40.984224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71e53b88-fdd8-4c75-9a0a-3cb43b6aacff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:40.984720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71e53b88-fdd8-4c75-9a0a-3cb43b6aacff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:40.985159 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71e53b88-fdd8-4c75-9a0a-3cb43b6aacff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:40.985877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71e53b88-fdd8-4c75-9a0a-3cb43b6aacff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:40.986331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71e53b88-fdd8-4c75-9a0a-3cb43b6aacff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:40.986756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-71e53b88-fdd8-4c75-9a0a-3cb43b6aacff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:41.003339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:41.128160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-71e53b88-fdd8-4c75-9a0a-3cb43b6aacff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:41.136394 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-71e53b88-fdd8-4c75-9a0a-3cb43b6aacff tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1668 microversion: 2.1 time: 0.164269 Oct 18 14:18:41.136988 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3424/7052] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:40 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:41.160301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f4c63bcf-43ef-4385-ba18-3460c5efb677 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:41.160902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f4c63bcf-43ef-4385-ba18-3460c5efb677 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:41.167293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4c63bcf-43ef-4385-ba18-3460c5efb677 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:41.167797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4c63bcf-43ef-4385-ba18-3460c5efb677 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:41.168241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4c63bcf-43ef-4385-ba18-3460c5efb677 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:41.169120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4c63bcf-43ef-4385-ba18-3460c5efb677 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:41.169623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4c63bcf-43ef-4385-ba18-3460c5efb677 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:41.170078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4c63bcf-43ef-4385-ba18-3460c5efb677 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:41.192136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:41.200882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f4c63bcf-43ef-4385-ba18-3460c5efb677 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:18:41.289463 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f4c63bcf-43ef-4385-ba18-3460c5efb677 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "DELETE /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 204 len: 0 microversion: 2.1 time: 0.133061 Oct 18 14:18:41.291074 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3629/7053] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:18:41 2022] DELETE /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:18:41.299724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-15ded884-fb50-40ce-80d7-b302df113932 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:41.300416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-15ded884-fb50-40ce-80d7-b302df113932 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:41.306664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15ded884-fb50-40ce-80d7-b302df113932 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:41.307155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15ded884-fb50-40ce-80d7-b302df113932 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:41.307656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15ded884-fb50-40ce-80d7-b302df113932 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:41.308443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15ded884-fb50-40ce-80d7-b302df113932 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:41.308958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15ded884-fb50-40ce-80d7-b302df113932 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:41.310108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15ded884-fb50-40ce-80d7-b302df113932 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:41.446704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-15ded884-fb50-40ce-80d7-b302df113932 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:41.454974 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-15ded884-fb50-40ce-80d7-b302df113932 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1674 microversion: 2.1 time: 0.159211 Oct 18 14:18:41.455561 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3425/7054] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:41 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:42.479586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a73df738-a453-4b0d-9719-f12a64fa8c4d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:42.480301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a73df738-a453-4b0d-9719-f12a64fa8c4d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:42.487888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a73df738-a453-4b0d-9719-f12a64fa8c4d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:42.488388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a73df738-a453-4b0d-9719-f12a64fa8c4d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:42.488850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a73df738-a453-4b0d-9719-f12a64fa8c4d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:42.489589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a73df738-a453-4b0d-9719-f12a64fa8c4d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:42.490060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a73df738-a453-4b0d-9719-f12a64fa8c4d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:42.490497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a73df738-a453-4b0d-9719-f12a64fa8c4d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:42.722032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a73df738-a453-4b0d-9719-f12a64fa8c4d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:42.731095 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a73df738-a453-4b0d-9719-f12a64fa8c4d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 200 len: 1674 microversion: 2.1 time: 0.255831 Oct 18 14:18:42.731715 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3630/7055] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:42 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 1674 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:43.453945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7ff5b7f6-3eb8-43f5-bef6-084f595518a3 req-8c5f7812-2500-46de-8698-4b525b4a4c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f9bcf1-9eb7-495b-9b9a-8a147d1428b0", "name": "network-vif-deleted", "tag": "606f80f0-c9e4-4108-bbc4-911cc3f3306a"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:18:43.467600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7ff5b7f6-3eb8-43f5-bef6-084f595518a3 req-8c5f7812-2500-46de-8698-4b525b4a4c51 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:43.468185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7ff5b7f6-3eb8-43f5-bef6-084f595518a3 req-8c5f7812-2500-46de-8698-4b525b4a4c51 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:43.468712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7ff5b7f6-3eb8-43f5-bef6-084f595518a3 req-8c5f7812-2500-46de-8698-4b525b4a4c51 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:43.482716 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7ff5b7f6-3eb8-43f5-bef6-084f595518a3 req-8c5f7812-2500-46de-8698-4b525b4a4c51 service nova] Creating event network-vif-deleted:606f80f0-c9e4-4108-bbc4-911cc3f3306a for instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 on n-h2-858384-13 Oct 18 14:18:43.487868 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7ff5b7f6-3eb8-43f5-bef6-084f595518a3 req-8c5f7812-2500-46de-8698-4b525b4a4c51 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038655 Oct 18 14:18:43.489889 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3426/7056] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:18:43.755872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-467a73ae-6806-4f80-9bed-5739f58027ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:43.757361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-467a73ae-6806-4f80-9bed-5739f58027ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:43.765153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-467a73ae-6806-4f80-9bed-5739f58027ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:43.765687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-467a73ae-6806-4f80-9bed-5739f58027ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:43.766139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-467a73ae-6806-4f80-9bed-5739f58027ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:43.766919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-467a73ae-6806-4f80-9bed-5739f58027ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:43.767384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-467a73ae-6806-4f80-9bed-5739f58027ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:43.767838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-467a73ae-6806-4f80-9bed-5739f58027ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:43.782877 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-467a73ae-6806-4f80-9bed-5739f58027ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-467a73ae-6806-4f80-9bed-5739f58027ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 HTTP/1.1 Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '98f9bcf1-9eb7-495b-9b9a-8a147d1428b0'} Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:18:43.784577 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:18:43.789100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:18:43.789100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:18:43.789100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:18:43.789100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:18:43.789100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:18:43.789100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:18:43.789100 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:18:43.789100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-467a73ae-6806-4f80-9bed-5739f58027ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:18:43.789100 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-467a73ae-6806-4f80-9bed-5739f58027ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 404 len: 111 microversion: 2.1 time: 0.034218 Oct 18 14:18:43.789100 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3631/7057] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:43 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:18:43.800462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e2296baa-9dcb-43cc-abe9-884bee599e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:43.801289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e2296baa-9dcb-43cc-abe9-884bee599e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:43.807680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2296baa-9dcb-43cc-abe9-884bee599e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:43.808238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2296baa-9dcb-43cc-abe9-884bee599e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:43.808737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2296baa-9dcb-43cc-abe9-884bee599e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:43.809600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2296baa-9dcb-43cc-abe9-884bee599e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:43.810110 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2296baa-9dcb-43cc-abe9-884bee599e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:43.810542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e2296baa-9dcb-43cc-abe9-884bee599e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:43.827592 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e2296baa-9dcb-43cc-abe9-884bee599e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e2296baa-9dcb-43cc-abe9-884bee599e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 HTTP/1.1 Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '98f9bcf1-9eb7-495b-9b9a-8a147d1428b0'} Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:18:43.829339 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:18:43.834235 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:18:43.834235 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:18:43.834235 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:18:43.834235 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:18:43.834235 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:18:43.834235 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:18:43.834235 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:18:43.834235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e2296baa-9dcb-43cc-abe9-884bee599e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:18:43.834235 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e2296baa-9dcb-43cc-abe9-884bee599e5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 404 len: 111 microversion: 2.1 time: 0.034821 Oct 18 14:18:43.834235 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3427/7058] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:43 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:18:43.882853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1825331886", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "9ee6393f-1f96-4d8a-a8c7-9559f9047108"}], "security_groups": [{"name": "tempest-securitygroup--1102295394"}], "key_name": "tempest-keypair-356831020", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:18:44.005981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] validate_networks() for [('9ee6393f-1f96-4d8a-a8c7-9559f9047108', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:18:44.407547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:18:44.408125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:18:44.408763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:18:44.409342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:18:44.409877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:18:44.420276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:44.420811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:44.421365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:44.422297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:44.422765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:44.423203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:44.443287 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:18:44.447697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for user 7dbfce990e5248698b492af6c8b2ba85 and project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:18:44.461922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:18:44.464482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:18:44.516953 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-078273a5-15ac-4678-96b6-0085beaf346a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.637743 Oct 18 14:18:44.518053 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3632/7059] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:18:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:18:44.529779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b012ab33-43b4-4cfb-bafd-762dc6614731 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:44.530400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b012ab33-43b4-4cfb-bafd-762dc6614731 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:44.592277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b012ab33-43b4-4cfb-bafd-762dc6614731 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:44.600628 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b012ab33-43b4-4cfb-bafd-762dc6614731 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1238 microversion: 2.1 time: 0.074927 Oct 18 14:18:44.601227 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3428/7060] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:44 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:45.626080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ccbc4689-c3ac-4fdc-b46e-cac345406bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:45.626751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ccbc4689-c3ac-4fdc-b46e-cac345406bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:45.634134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccbc4689-c3ac-4fdc-b46e-cac345406bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:45.634637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccbc4689-c3ac-4fdc-b46e-cac345406bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:45.635085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccbc4689-c3ac-4fdc-b46e-cac345406bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:45.635798 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccbc4689-c3ac-4fdc-b46e-cac345406bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:45.636293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccbc4689-c3ac-4fdc-b46e-cac345406bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:45.636734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ccbc4689-c3ac-4fdc-b46e-cac345406bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:45.704086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ccbc4689-c3ac-4fdc-b46e-cac345406bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:45.713211 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ccbc4689-c3ac-4fdc-b46e-cac345406bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1298 microversion: 2.1 time: 0.092679 Oct 18 14:18:45.713816 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3633/7061] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:45 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:46.738777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c9be8d1a-beef-4906-89a2-c8d7b4ff230f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:46.739534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c9be8d1a-beef-4906-89a2-c8d7b4ff230f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:46.747804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9be8d1a-beef-4906-89a2-c8d7b4ff230f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:46.748423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9be8d1a-beef-4906-89a2-c8d7b4ff230f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:46.749225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9be8d1a-beef-4906-89a2-c8d7b4ff230f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:46.749955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9be8d1a-beef-4906-89a2-c8d7b4ff230f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:46.750418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9be8d1a-beef-4906-89a2-c8d7b4ff230f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:46.750847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9be8d1a-beef-4906-89a2-c8d7b4ff230f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:46.985879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c9be8d1a-beef-4906-89a2-c8d7b4ff230f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:46.994398 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c9be8d1a-beef-4906-89a2-c8d7b4ff230f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1364 microversion: 2.1 time: 0.259470 Oct 18 14:18:46.994990 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3429/7062] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:46 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:47.247587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-a609ca7f-e748-4fb4-875a-389df1e86cd2 req-062a632f-fe41-4dc6-a642-e89365a8b063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d82844-ffbc-43d2-b221-24a5d4d9a32b", "tag": "623407fe-7f23-4c9f-b055-9167a09a5b1c"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:18:47.265352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a609ca7f-e748-4fb4-875a-389df1e86cd2 req-062a632f-fe41-4dc6-a642-e89365a8b063 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:47.265970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a609ca7f-e748-4fb4-875a-389df1e86cd2 req-062a632f-fe41-4dc6-a642-e89365a8b063 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:47.266488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a609ca7f-e748-4fb4-875a-389df1e86cd2 req-062a632f-fe41-4dc6-a642-e89365a8b063 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:47.287535 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-a609ca7f-e748-4fb4-875a-389df1e86cd2 req-062a632f-fe41-4dc6-a642-e89365a8b063 service nova] Creating event network-changed:623407fe-7f23-4c9f-b055-9167a09a5b1c for instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b on n-h1-858384-13 Oct 18 14:18:47.296562 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-a609ca7f-e748-4fb4-875a-389df1e86cd2 req-062a632f-fe41-4dc6-a642-e89365a8b063 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055587 Oct 18 14:18:47.297418 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3634/7063] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:18:48.020224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4dd70b2d-0cde-404f-9bb9-37e515c0b17d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:48.020758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4dd70b2d-0cde-404f-9bb9-37e515c0b17d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:48.027716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dd70b2d-0cde-404f-9bb9-37e515c0b17d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:48.028199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dd70b2d-0cde-404f-9bb9-37e515c0b17d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:48.028680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dd70b2d-0cde-404f-9bb9-37e515c0b17d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:48.029412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dd70b2d-0cde-404f-9bb9-37e515c0b17d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:48.029871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dd70b2d-0cde-404f-9bb9-37e515c0b17d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:48.030301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4dd70b2d-0cde-404f-9bb9-37e515c0b17d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:48.168178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4dd70b2d-0cde-404f-9bb9-37e515c0b17d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:48.176660 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4dd70b2d-0cde-404f-9bb9-37e515c0b17d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1364 microversion: 2.1 time: 0.160429 Oct 18 14:18:48.177272 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3430/7064] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:48 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:18:49.203630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-58083040-5aa0-49d6-a0dc-314bcf91e6d8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:49.204601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-58083040-5aa0-49d6-a0dc-314bcf91e6d8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:49.206623 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:49.212479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58083040-5aa0-49d6-a0dc-314bcf91e6d8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:49.212976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58083040-5aa0-49d6-a0dc-314bcf91e6d8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:49.213531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58083040-5aa0-49d6-a0dc-314bcf91e6d8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:49.214238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58083040-5aa0-49d6-a0dc-314bcf91e6d8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:49.214705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58083040-5aa0-49d6-a0dc-314bcf91e6d8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:49.215146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-58083040-5aa0-49d6-a0dc-314bcf91e6d8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:49.346827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-58083040-5aa0-49d6-a0dc-314bcf91e6d8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:49.355143 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-58083040-5aa0-49d6-a0dc-314bcf91e6d8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1364 microversion: 2.1 time: 0.157179 Oct 18 14:18:49.355677 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3635/7065] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:49 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:50.379695 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-20f93717-8ff9-4f4b-a482-66ab7ca17bd5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:50.380317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-20f93717-8ff9-4f4b-a482-66ab7ca17bd5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:50.383253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=49 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:50.388654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20f93717-8ff9-4f4b-a482-66ab7ca17bd5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:50.389142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20f93717-8ff9-4f4b-a482-66ab7ca17bd5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:50.389641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20f93717-8ff9-4f4b-a482-66ab7ca17bd5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:50.390859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20f93717-8ff9-4f4b-a482-66ab7ca17bd5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:50.391325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20f93717-8ff9-4f4b-a482-66ab7ca17bd5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:50.391759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-20f93717-8ff9-4f4b-a482-66ab7ca17bd5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:50.525512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-20f93717-8ff9-4f4b-a482-66ab7ca17bd5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:50.534073 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-20f93717-8ff9-4f4b-a482-66ab7ca17bd5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1364 microversion: 2.1 time: 0.158281 Oct 18 14:18:50.534670 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3431/7066] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:50 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:51.556938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-64bb71d4-1d50-405b-8dce-f5618d322e7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:51.557661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-64bb71d4-1d50-405b-8dce-f5618d322e7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:51.564930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64bb71d4-1d50-405b-8dce-f5618d322e7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:51.565461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64bb71d4-1d50-405b-8dce-f5618d322e7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:51.565907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64bb71d4-1d50-405b-8dce-f5618d322e7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:51.567640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64bb71d4-1d50-405b-8dce-f5618d322e7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:51.568118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64bb71d4-1d50-405b-8dce-f5618d322e7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:51.568553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-64bb71d4-1d50-405b-8dce-f5618d322e7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:51.723244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-64bb71d4-1d50-405b-8dce-f5618d322e7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:51.731168 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-64bb71d4-1d50-405b-8dce-f5618d322e7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1364 microversion: 2.1 time: 0.178147 Oct 18 14:18:51.731772 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3636/7067] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:51 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:52.755989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e97bb2bc-4c77-45d3-a021-41231aeef5a5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:52.756621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e97bb2bc-4c77-45d3-a021-41231aeef5a5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:52.763603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e97bb2bc-4c77-45d3-a021-41231aeef5a5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:52.764089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e97bb2bc-4c77-45d3-a021-41231aeef5a5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:52.764523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e97bb2bc-4c77-45d3-a021-41231aeef5a5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:52.765713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e97bb2bc-4c77-45d3-a021-41231aeef5a5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:52.766299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e97bb2bc-4c77-45d3-a021-41231aeef5a5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:52.766736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e97bb2bc-4c77-45d3-a021-41231aeef5a5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:52.902650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e97bb2bc-4c77-45d3-a021-41231aeef5a5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:52.910610 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e97bb2bc-4c77-45d3-a021-41231aeef5a5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1364 microversion: 2.1 time: 0.158561 Oct 18 14:18:52.911184 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3432/7068] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:52 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:53.770721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ebf284e6-96ee-47f5-b9e3-20f6f28c6884 req-00369ce9-f441-493f-9c29-13e0ac075926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d82844-ffbc-43d2-b221-24a5d4d9a32b", "name": "network-vif-plugged", "status": "completed", "tag": "623407fe-7f23-4c9f-b055-9167a09a5b1c"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:18:53.781805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ebf284e6-96ee-47f5-b9e3-20f6f28c6884 req-00369ce9-f441-493f-9c29-13e0ac075926 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:53.782444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ebf284e6-96ee-47f5-b9e3-20f6f28c6884 req-00369ce9-f441-493f-9c29-13e0ac075926 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:53.782944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ebf284e6-96ee-47f5-b9e3-20f6f28c6884 req-00369ce9-f441-493f-9c29-13e0ac075926 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:53.797614 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ebf284e6-96ee-47f5-b9e3-20f6f28c6884 req-00369ce9-f441-493f-9c29-13e0ac075926 service nova] Creating event network-vif-plugged:623407fe-7f23-4c9f-b055-9167a09a5b1c for instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b on n-h1-858384-13 Oct 18 14:18:53.803567 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ebf284e6-96ee-47f5-b9e3-20f6f28c6884 req-00369ce9-f441-493f-9c29-13e0ac075926 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036661 Oct 18 14:18:53.804363 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3637/7069] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:18:53.935271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f680d230-f7c0-4574-b3c0-3c6df40d314b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:53.935889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f680d230-f7c0-4574-b3c0-3c6df40d314b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:53.943682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f680d230-f7c0-4574-b3c0-3c6df40d314b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:53.944174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f680d230-f7c0-4574-b3c0-3c6df40d314b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:53.944611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f680d230-f7c0-4574-b3c0-3c6df40d314b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:53.945366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f680d230-f7c0-4574-b3c0-3c6df40d314b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:53.946067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f680d230-f7c0-4574-b3c0-3c6df40d314b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:53.946245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f680d230-f7c0-4574-b3c0-3c6df40d314b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:54.124902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f680d230-f7c0-4574-b3c0-3c6df40d314b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:54.133752 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f680d230-f7c0-4574-b3c0-3c6df40d314b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1364 microversion: 2.1 time: 0.201696 Oct 18 14:18:54.135012 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3433/7070] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:53 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:18:55.160752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:55.161558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:55.167160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-48cd83b1-8678-4b36-8a60-1125baac8490 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:55.167898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-48cd83b1-8678-4b36-8a60-1125baac8490 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:55.175644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48cd83b1-8678-4b36-8a60-1125baac8490 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:55.176149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48cd83b1-8678-4b36-8a60-1125baac8490 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:55.176606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48cd83b1-8678-4b36-8a60-1125baac8490 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:55.177399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48cd83b1-8678-4b36-8a60-1125baac8490 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:55.177829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48cd83b1-8678-4b36-8a60-1125baac8490 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:55.178275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-48cd83b1-8678-4b36-8a60-1125baac8490 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:55.313883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-48cd83b1-8678-4b36-8a60-1125baac8490 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:55.321700 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-48cd83b1-8678-4b36-8a60-1125baac8490 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1364 microversion: 2.1 time: 0.161943 Oct 18 14:18:55.322288 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3638/7071] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:55 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:56.346104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bf416363-c0ef-4846-bbef-19736af8f71a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:56.346680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bf416363-c0ef-4846-bbef-19736af8f71a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:56.348759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:18:56.354637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf416363-c0ef-4846-bbef-19736af8f71a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:56.355116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf416363-c0ef-4846-bbef-19736af8f71a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:56.355548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf416363-c0ef-4846-bbef-19736af8f71a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:56.356233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf416363-c0ef-4846-bbef-19736af8f71a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:56.356679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf416363-c0ef-4846-bbef-19736af8f71a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:56.357099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bf416363-c0ef-4846-bbef-19736af8f71a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:56.488591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bf416363-c0ef-4846-bbef-19736af8f71a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:18:56.496485 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bf416363-c0ef-4846-bbef-19736af8f71a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1550 microversion: 2.1 time: 0.154347 Oct 18 14:18:56.497054 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3434/7072] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:18:56 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:18:56.520359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2cb28769-3900-4730-9b54-bcaea2ecf0df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:18:56.520927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2cb28769-3900-4730-9b54-bcaea2ecf0df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:18:56.527925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2cb28769-3900-4730-9b54-bcaea2ecf0df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:56.528428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2cb28769-3900-4730-9b54-bcaea2ecf0df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:56.528883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2cb28769-3900-4730-9b54-bcaea2ecf0df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:56.529638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2cb28769-3900-4730-9b54-bcaea2ecf0df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:56.530112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2cb28769-3900-4730-9b54-bcaea2ecf0df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:56.530556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2cb28769-3900-4730-9b54-bcaea2ecf0df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:56.608711 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2cb28769-3900-4730-9b54-bcaea2ecf0df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092440 Oct 18 14:18:56.610279 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3639/7073] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 14:18:56 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:18:57.550893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-3a4a4ca2-31a9-477b-8fc5-1198b0735a1f req-ba011610-b9cb-486e-b387-f44c66bbe36e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d82844-ffbc-43d2-b221-24a5d4d9a32b", "tag": "623407fe-7f23-4c9f-b055-9167a09a5b1c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:18:57.560973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3a4a4ca2-31a9-477b-8fc5-1198b0735a1f req-ba011610-b9cb-486e-b387-f44c66bbe36e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:18:57.561476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3a4a4ca2-31a9-477b-8fc5-1198b0735a1f req-ba011610-b9cb-486e-b387-f44c66bbe36e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:18:57.561907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3a4a4ca2-31a9-477b-8fc5-1198b0735a1f req-ba011610-b9cb-486e-b387-f44c66bbe36e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:18:57.573978 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-3a4a4ca2-31a9-477b-8fc5-1198b0735a1f req-ba011610-b9cb-486e-b387-f44c66bbe36e service nova] Creating event network-changed:623407fe-7f23-4c9f-b055-9167a09a5b1c for instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b on n-h1-858384-13 Oct 18 14:18:57.579803 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-3a4a4ca2-31a9-477b-8fc5-1198b0735a1f req-ba011610-b9cb-486e-b387-f44c66bbe36e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032637 Oct 18 14:18:57.580413 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3435/7074] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:20:01.224448 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=9 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:01.225266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:01.231605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:20:01.233908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:01.245409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:01.246058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:01.246519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:01.247255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:01.247764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:01.248278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:01.279720 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:01.286259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Old instance type m1.heat2, new instance type m1.heat {{(pid=120611) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:20:01.293709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:20:01.294155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:20:01.294650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:20:01.295079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:20:01.295511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:20:01.363024 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-912aa0bd-36aa-4f43-99ed-718922ab6171 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b/action" status: 202 len: 0 microversion: 2.1 time: 0.141532 Oct 18 14:20:01.363579 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3640/7075] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:20:01 2022] POST /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:20:01.370902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=9 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:01.371956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=51 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:01.379205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f3eb6186-65dc-4f39-bd92-fb429310eb02 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:01.379900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f3eb6186-65dc-4f39-bd92-fb429310eb02 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:01.387284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f3eb6186-65dc-4f39-bd92-fb429310eb02 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:01.387793 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f3eb6186-65dc-4f39-bd92-fb429310eb02 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:01.388213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f3eb6186-65dc-4f39-bd92-fb429310eb02 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:01.389058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f3eb6186-65dc-4f39-bd92-fb429310eb02 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:01.389539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f3eb6186-65dc-4f39-bd92-fb429310eb02 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:01.389976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f3eb6186-65dc-4f39-bd92-fb429310eb02 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:01.933233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f3eb6186-65dc-4f39-bd92-fb429310eb02 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:01.941934 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f3eb6186-65dc-4f39-bd92-fb429310eb02 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1677 microversion: 2.1 time: 0.573789 Oct 18 14:20:01.942615 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3436/7076] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:01 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1677 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:02.966086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ab21a803-c79f-46f0-aa45-f05e870063cc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:02.966717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ab21a803-c79f-46f0-aa45-f05e870063cc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:02.974690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab21a803-c79f-46f0-aa45-f05e870063cc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:02.975188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab21a803-c79f-46f0-aa45-f05e870063cc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:02.975635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab21a803-c79f-46f0-aa45-f05e870063cc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:02.976352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab21a803-c79f-46f0-aa45-f05e870063cc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:02.976819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab21a803-c79f-46f0-aa45-f05e870063cc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:02.977285 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ab21a803-c79f-46f0-aa45-f05e870063cc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:03.180418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ab21a803-c79f-46f0-aa45-f05e870063cc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:03.188886 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ab21a803-c79f-46f0-aa45-f05e870063cc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1677 microversion: 2.1 time: 0.227706 Oct 18 14:20:03.189699 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3641/7077] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:02 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:04.215563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4d4a0e59-d7de-4ecd-8fad-f92df067338d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:04.216168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4d4a0e59-d7de-4ecd-8fad-f92df067338d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:04.223068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d4a0e59-d7de-4ecd-8fad-f92df067338d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:04.223545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d4a0e59-d7de-4ecd-8fad-f92df067338d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:04.223975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d4a0e59-d7de-4ecd-8fad-f92df067338d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:04.224659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d4a0e59-d7de-4ecd-8fad-f92df067338d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:04.225107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d4a0e59-d7de-4ecd-8fad-f92df067338d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:04.225553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4d4a0e59-d7de-4ecd-8fad-f92df067338d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:04.370226 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4d4a0e59-d7de-4ecd-8fad-f92df067338d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:04.378947 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4d4a0e59-d7de-4ecd-8fad-f92df067338d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1682 microversion: 2.1 time: 0.167746 Oct 18 14:20:04.379534 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3437/7078] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:04 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:05.403282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b7dee848-f3d7-425a-915a-e9a1de9187e2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:05.403891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7dee848-f3d7-425a-915a-e9a1de9187e2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:05.411734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7dee848-f3d7-425a-915a-e9a1de9187e2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:05.412237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7dee848-f3d7-425a-915a-e9a1de9187e2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:05.412692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7dee848-f3d7-425a-915a-e9a1de9187e2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:05.413428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7dee848-f3d7-425a-915a-e9a1de9187e2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:05.413902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7dee848-f3d7-425a-915a-e9a1de9187e2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:05.414342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7dee848-f3d7-425a-915a-e9a1de9187e2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:05.548633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7dee848-f3d7-425a-915a-e9a1de9187e2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:05.557141 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b7dee848-f3d7-425a-915a-e9a1de9187e2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1682 microversion: 2.1 time: 0.158017 Oct 18 14:20:05.557753 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3642/7079] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:05 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:06.581622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1875c1b9-d520-4a3f-9056-520a31b95d05 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:06.582218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1875c1b9-d520-4a3f-9056-520a31b95d05 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:06.589584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1875c1b9-d520-4a3f-9056-520a31b95d05 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:06.590070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1875c1b9-d520-4a3f-9056-520a31b95d05 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:06.590506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1875c1b9-d520-4a3f-9056-520a31b95d05 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:06.591192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1875c1b9-d520-4a3f-9056-520a31b95d05 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:06.591643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1875c1b9-d520-4a3f-9056-520a31b95d05 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:06.592067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1875c1b9-d520-4a3f-9056-520a31b95d05 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:06.729606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1875c1b9-d520-4a3f-9056-520a31b95d05 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:06.737568 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1875c1b9-d520-4a3f-9056-520a31b95d05 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1682 microversion: 2.1 time: 0.160118 Oct 18 14:20:06.738143 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3438/7080] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:06 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:07.761487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-14e76874-7e5b-409e-b2c4-3c76bccf7445 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:07.762142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-14e76874-7e5b-409e-b2c4-3c76bccf7445 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:07.770056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14e76874-7e5b-409e-b2c4-3c76bccf7445 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:07.770555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14e76874-7e5b-409e-b2c4-3c76bccf7445 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:07.771008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14e76874-7e5b-409e-b2c4-3c76bccf7445 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:07.771722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14e76874-7e5b-409e-b2c4-3c76bccf7445 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:07.772189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14e76874-7e5b-409e-b2c4-3c76bccf7445 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:07.772627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14e76874-7e5b-409e-b2c4-3c76bccf7445 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:07.909475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-14e76874-7e5b-409e-b2c4-3c76bccf7445 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:07.917481 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-14e76874-7e5b-409e-b2c4-3c76bccf7445 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1682 microversion: 2.1 time: 0.160058 Oct 18 14:20:07.918002 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3643/7081] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:07 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:08.945871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb5deba4-adf2-47b3-bf98-48391a70d22f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:08.946482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb5deba4-adf2-47b3-bf98-48391a70d22f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:08.953003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb5deba4-adf2-47b3-bf98-48391a70d22f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:08.953507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb5deba4-adf2-47b3-bf98-48391a70d22f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:08.953938 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb5deba4-adf2-47b3-bf98-48391a70d22f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:08.954651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb5deba4-adf2-47b3-bf98-48391a70d22f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:08.955098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb5deba4-adf2-47b3-bf98-48391a70d22f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:08.956145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb5deba4-adf2-47b3-bf98-48391a70d22f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:09.094399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fb5deba4-adf2-47b3-bf98-48391a70d22f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:09.103360 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb5deba4-adf2-47b3-bf98-48391a70d22f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1682 microversion: 2.1 time: 0.161492 Oct 18 14:20:09.103974 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3439/7082] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:08 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:10.126834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dd63d6c7-5dab-4fcf-925c-327db882ce09 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:10.128275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dd63d6c7-5dab-4fcf-925c-327db882ce09 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:10.135172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd63d6c7-5dab-4fcf-925c-327db882ce09 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:10.135670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd63d6c7-5dab-4fcf-925c-327db882ce09 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:10.136123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd63d6c7-5dab-4fcf-925c-327db882ce09 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:10.136832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd63d6c7-5dab-4fcf-925c-327db882ce09 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:10.137334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd63d6c7-5dab-4fcf-925c-327db882ce09 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:10.137777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dd63d6c7-5dab-4fcf-925c-327db882ce09 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:10.273547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dd63d6c7-5dab-4fcf-925c-327db882ce09 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:10.281966 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dd63d6c7-5dab-4fcf-925c-327db882ce09 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1682 microversion: 2.1 time: 0.158754 Oct 18 14:20:10.282573 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3644/7083] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:10 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:11.306195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f62c62b1-17f2-4507-b983-1121bc7b60f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:11.306828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f62c62b1-17f2-4507-b983-1121bc7b60f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:11.314051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f62c62b1-17f2-4507-b983-1121bc7b60f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:11.314527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f62c62b1-17f2-4507-b983-1121bc7b60f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:11.315276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f62c62b1-17f2-4507-b983-1121bc7b60f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:11.315659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f62c62b1-17f2-4507-b983-1121bc7b60f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:11.316106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f62c62b1-17f2-4507-b983-1121bc7b60f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:11.316525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f62c62b1-17f2-4507-b983-1121bc7b60f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:11.452030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f62c62b1-17f2-4507-b983-1121bc7b60f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:11.460960 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f62c62b1-17f2-4507-b983-1121bc7b60f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1682 microversion: 2.1 time: 0.158672 Oct 18 14:20:11.461576 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3440/7084] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:11 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:12.485520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6fb588fd-402a-47ba-a5a1-67e8f5204bec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:12.486078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6fb588fd-402a-47ba-a5a1-67e8f5204bec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:12.493715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fb588fd-402a-47ba-a5a1-67e8f5204bec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:12.494206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fb588fd-402a-47ba-a5a1-67e8f5204bec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:12.494650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fb588fd-402a-47ba-a5a1-67e8f5204bec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:12.495346 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fb588fd-402a-47ba-a5a1-67e8f5204bec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:12.495807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fb588fd-402a-47ba-a5a1-67e8f5204bec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:12.496242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6fb588fd-402a-47ba-a5a1-67e8f5204bec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:12.631745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6fb588fd-402a-47ba-a5a1-67e8f5204bec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:12.639460 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6fb588fd-402a-47ba-a5a1-67e8f5204bec tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1682 microversion: 2.1 time: 0.158070 Oct 18 14:20:12.640048 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3645/7085] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:12 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:13.663817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f4c1280e-b2e4-43e1-9f5d-528c64ad277d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:13.664494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f4c1280e-b2e4-43e1-9f5d-528c64ad277d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:13.671519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4c1280e-b2e4-43e1-9f5d-528c64ad277d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:13.672010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4c1280e-b2e4-43e1-9f5d-528c64ad277d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:13.672452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4c1280e-b2e4-43e1-9f5d-528c64ad277d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:13.673152 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4c1280e-b2e4-43e1-9f5d-528c64ad277d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:13.673638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4c1280e-b2e4-43e1-9f5d-528c64ad277d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:13.674554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f4c1280e-b2e4-43e1-9f5d-528c64ad277d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:13.811193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f4c1280e-b2e4-43e1-9f5d-528c64ad277d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:13.819313 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f4c1280e-b2e4-43e1-9f5d-528c64ad277d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1682 microversion: 2.1 time: 0.159491 Oct 18 14:20:13.819907 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3441/7086] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:13 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:20:14.843282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-66eef9af-c5e1-4522-a8ce-68271675947b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:14.843888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-66eef9af-c5e1-4522-a8ce-68271675947b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:14.850980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66eef9af-c5e1-4522-a8ce-68271675947b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:14.851477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66eef9af-c5e1-4522-a8ce-68271675947b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:14.851929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66eef9af-c5e1-4522-a8ce-68271675947b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:14.852631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66eef9af-c5e1-4522-a8ce-68271675947b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:14.853101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66eef9af-c5e1-4522-a8ce-68271675947b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:14.853570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66eef9af-c5e1-4522-a8ce-68271675947b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:14.983826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-66eef9af-c5e1-4522-a8ce-68271675947b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:14.992261 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-66eef9af-c5e1-4522-a8ce-68271675947b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1682 microversion: 2.1 time: 0.152915 Oct 18 14:20:14.992849 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3646/7087] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:14 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:15.851646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d5acb04e-ff26-4b9b-974b-584d40c146f0 req-a921341a-95f2-4077-abbc-fee6c9b012b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d82844-ffbc-43d2-b221-24a5d4d9a32b", "name": "network-vif-unplugged", "status": "completed", "tag": "623407fe-7f23-4c9f-b055-9167a09a5b1c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:20:15.861462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d5acb04e-ff26-4b9b-974b-584d40c146f0 req-a921341a-95f2-4077-abbc-fee6c9b012b1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:15.862371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d5acb04e-ff26-4b9b-974b-584d40c146f0 req-a921341a-95f2-4077-abbc-fee6c9b012b1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:15.862860 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d5acb04e-ff26-4b9b-974b-584d40c146f0 req-a921341a-95f2-4077-abbc-fee6c9b012b1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:15.877863 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d5acb04e-ff26-4b9b-974b-584d40c146f0 req-a921341a-95f2-4077-abbc-fee6c9b012b1 service nova] Creating event network-vif-unplugged:623407fe-7f23-4c9f-b055-9167a09a5b1c for instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b on n-h2-858384-13 Oct 18 14:20:15.882818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-d5acb04e-ff26-4b9b-974b-584d40c146f0 req-a921341a-95f2-4077-abbc-fee6c9b012b1 service nova] Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:20:15.895655 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d5acb04e-ff26-4b9b-974b-584d40c146f0 req-a921341a-95f2-4077-abbc-fee6c9b012b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108773 Oct 18 14:20:15.896784 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3442/7088] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:20:16.016428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e8673d97-d078-4da7-a73a-90ff5f6caaaf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:16.017051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e8673d97-d078-4da7-a73a-90ff5f6caaaf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:16.024645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8673d97-d078-4da7-a73a-90ff5f6caaaf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:16.025149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8673d97-d078-4da7-a73a-90ff5f6caaaf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:16.025779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8673d97-d078-4da7-a73a-90ff5f6caaaf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:16.026543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8673d97-d078-4da7-a73a-90ff5f6caaaf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:16.027016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8673d97-d078-4da7-a73a-90ff5f6caaaf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:16.027453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e8673d97-d078-4da7-a73a-90ff5f6caaaf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:16.246348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e8673d97-d078-4da7-a73a-90ff5f6caaaf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:16.254940 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e8673d97-d078-4da7-a73a-90ff5f6caaaf tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1681 microversion: 2.1 time: 0.242799 Oct 18 14:20:16.255546 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3647/7089] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:16 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1681 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:17.330624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c08341bb-01c3-4a43-af09-da815f8ee1f0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:17.332056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c08341bb-01c3-4a43-af09-da815f8ee1f0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:17.338582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c08341bb-01c3-4a43-af09-da815f8ee1f0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:17.339052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c08341bb-01c3-4a43-af09-da815f8ee1f0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:17.339506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c08341bb-01c3-4a43-af09-da815f8ee1f0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:17.340217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c08341bb-01c3-4a43-af09-da815f8ee1f0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:17.340664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c08341bb-01c3-4a43-af09-da815f8ee1f0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:17.341085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c08341bb-01c3-4a43-af09-da815f8ee1f0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:17.481307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c08341bb-01c3-4a43-af09-da815f8ee1f0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:17.489961 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c08341bb-01c3-4a43-af09-da815f8ee1f0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1679 microversion: 2.1 time: 0.213659 Oct 18 14:20:17.490548 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3443/7090] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:17 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1679 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:17.913053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-1414109a-4aa0-44b9-a3e5-1c8b1530d6f2 req-007475ee-ba4c-458f-b18e-b7ea87e73e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d82844-ffbc-43d2-b221-24a5d4d9a32b", "tag": "623407fe-7f23-4c9f-b055-9167a09a5b1c"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:20:17.925607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1414109a-4aa0-44b9-a3e5-1c8b1530d6f2 req-007475ee-ba4c-458f-b18e-b7ea87e73e4e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:17.926103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1414109a-4aa0-44b9-a3e5-1c8b1530d6f2 req-007475ee-ba4c-458f-b18e-b7ea87e73e4e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:17.926546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-1414109a-4aa0-44b9-a3e5-1c8b1530d6f2 req-007475ee-ba4c-458f-b18e-b7ea87e73e4e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:17.938527 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-1414109a-4aa0-44b9-a3e5-1c8b1530d6f2 req-007475ee-ba4c-458f-b18e-b7ea87e73e4e service nova] Creating event network-changed:623407fe-7f23-4c9f-b055-9167a09a5b1c for instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b on n-h2-858384-13 Oct 18 14:20:17.946605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [req-1414109a-4aa0-44b9-a3e5-1c8b1530d6f2 req-007475ee-ba4c-458f-b18e-b7ea87e73e4e service nova] Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:20:17.960298 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-1414109a-4aa0-44b9-a3e5-1c8b1530d6f2 req-007475ee-ba4c-458f-b18e-b7ea87e73e4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051541 Oct 18 14:20:17.960927 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3648/7091] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:20:18.513544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2392a905-ace2-4afb-977d-c11a671bd40e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:18.514330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2392a905-ace2-4afb-977d-c11a671bd40e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:18.523076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2392a905-ace2-4afb-977d-c11a671bd40e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:18.523571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2392a905-ace2-4afb-977d-c11a671bd40e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:18.524012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2392a905-ace2-4afb-977d-c11a671bd40e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:18.524786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2392a905-ace2-4afb-977d-c11a671bd40e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:18.525278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2392a905-ace2-4afb-977d-c11a671bd40e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:18.525711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2392a905-ace2-4afb-977d-c11a671bd40e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:18.697850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2392a905-ace2-4afb-977d-c11a671bd40e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:18.707921 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2392a905-ace2-4afb-977d-c11a671bd40e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1679 microversion: 2.1 time: 0.198113 Oct 18 14:20:18.709788 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3444/7092] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:18 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1679 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:19.732639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-68a415f5-b94d-4967-9cd0-ebab702e5cfb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:19.733453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-68a415f5-b94d-4967-9cd0-ebab702e5cfb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:19.741208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68a415f5-b94d-4967-9cd0-ebab702e5cfb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:19.741721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68a415f5-b94d-4967-9cd0-ebab702e5cfb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:19.742175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68a415f5-b94d-4967-9cd0-ebab702e5cfb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:19.742890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68a415f5-b94d-4967-9cd0-ebab702e5cfb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:19.743365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68a415f5-b94d-4967-9cd0-ebab702e5cfb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:19.743806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-68a415f5-b94d-4967-9cd0-ebab702e5cfb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:19.874856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-68a415f5-b94d-4967-9cd0-ebab702e5cfb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:19.883067 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-68a415f5-b94d-4967-9cd0-ebab702e5cfb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1676 microversion: 2.1 time: 0.154780 Oct 18 14:20:19.883722 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3649/7093] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:19 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:19.905851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:20:19.906405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:19.913973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:19.914447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:19.914907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:19.915593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:19.916041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:19.916460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:19.953836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:19.954233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:19.954661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:19.956292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:19.956742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:19.957484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:19.980070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'ram', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:20:19.985687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for user 7dbfce990e5248698b492af6c8b2ba85 and project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'ram', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:20:20.093312 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ab707c8a-4191-4217-999c-bdc00818f574 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b/action" status: 202 len: 0 microversion: 2.1 time: 0.191295 Oct 18 14:20:20.093955 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3445/7094] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:20:19 2022] POST /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:20:20.102377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e96cc0e2-6d7a-465d-a0fb-40a766ba0efd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:20.103115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e96cc0e2-6d7a-465d-a0fb-40a766ba0efd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:20.109924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e96cc0e2-6d7a-465d-a0fb-40a766ba0efd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:20.110389 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e96cc0e2-6d7a-465d-a0fb-40a766ba0efd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:20.110811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e96cc0e2-6d7a-465d-a0fb-40a766ba0efd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:20.112225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e96cc0e2-6d7a-465d-a0fb-40a766ba0efd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:20.112730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e96cc0e2-6d7a-465d-a0fb-40a766ba0efd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:20.113167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e96cc0e2-6d7a-465d-a0fb-40a766ba0efd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:20.325828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e96cc0e2-6d7a-465d-a0fb-40a766ba0efd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:20.334435 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e96cc0e2-6d7a-465d-a0fb-40a766ba0efd tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1675 microversion: 2.1 time: 0.235963 Oct 18 14:20:20.335118 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3650/7095] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:20 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1675 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:21.359425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b9070753-bbe2-4a11-8f7d-2e75edc46d44 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:21.360156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b9070753-bbe2-4a11-8f7d-2e75edc46d44 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:21.366667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9070753-bbe2-4a11-8f7d-2e75edc46d44 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:21.367195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9070753-bbe2-4a11-8f7d-2e75edc46d44 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:21.367635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9070753-bbe2-4a11-8f7d-2e75edc46d44 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:21.368331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9070753-bbe2-4a11-8f7d-2e75edc46d44 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:21.368787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9070753-bbe2-4a11-8f7d-2e75edc46d44 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:21.369229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b9070753-bbe2-4a11-8f7d-2e75edc46d44 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:21.512940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b9070753-bbe2-4a11-8f7d-2e75edc46d44 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:21.523058 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b9070753-bbe2-4a11-8f7d-2e75edc46d44 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1675 microversion: 2.1 time: 0.168755 Oct 18 14:20:21.523640 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3446/7096] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:21 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:22.546973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4e705fc4-384c-4f71-babc-3c63d5d1e86a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:22.547634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4e705fc4-384c-4f71-babc-3c63d5d1e86a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:22.555293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e705fc4-384c-4f71-babc-3c63d5d1e86a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:22.555797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e705fc4-384c-4f71-babc-3c63d5d1e86a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:22.556246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e705fc4-384c-4f71-babc-3c63d5d1e86a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:22.556957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e705fc4-384c-4f71-babc-3c63d5d1e86a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:22.557457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e705fc4-384c-4f71-babc-3c63d5d1e86a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:22.557898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4e705fc4-384c-4f71-babc-3c63d5d1e86a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:22.695534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4e705fc4-384c-4f71-babc-3c63d5d1e86a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:22.703658 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4e705fc4-384c-4f71-babc-3c63d5d1e86a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1675 microversion: 2.1 time: 0.160754 Oct 18 14:20:22.704341 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3651/7097] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:22 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:23.721397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e90d1160-cc96-4325-b1ea-ab7cd04ac955 req-9ac98a36-9fd3-42d2-aa76-ff41b8afa797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d82844-ffbc-43d2-b221-24a5d4d9a32b", "tag": "623407fe-7f23-4c9f-b055-9167a09a5b1c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:20:23.729874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8e47c9ca-7af0-4384-8cd5-f0fc5e52c6b5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:23.730529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8e47c9ca-7af0-4384-8cd5-f0fc5e52c6b5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:23.742229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e90d1160-cc96-4325-b1ea-ab7cd04ac955 req-9ac98a36-9fd3-42d2-aa76-ff41b8afa797 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:23.743140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e47c9ca-7af0-4384-8cd5-f0fc5e52c6b5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:23.743651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e47c9ca-7af0-4384-8cd5-f0fc5e52c6b5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:23.744115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e47c9ca-7af0-4384-8cd5-f0fc5e52c6b5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:23.744821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e47c9ca-7af0-4384-8cd5-f0fc5e52c6b5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:23.745329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e47c9ca-7af0-4384-8cd5-f0fc5e52c6b5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:23.745710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e90d1160-cc96-4325-b1ea-ab7cd04ac955 req-9ac98a36-9fd3-42d2-aa76-ff41b8afa797 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:23.745831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e47c9ca-7af0-4384-8cd5-f0fc5e52c6b5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:23.746182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e90d1160-cc96-4325-b1ea-ab7cd04ac955 req-9ac98a36-9fd3-42d2-aa76-ff41b8afa797 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:23.759913 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e90d1160-cc96-4325-b1ea-ab7cd04ac955 req-9ac98a36-9fd3-42d2-aa76-ff41b8afa797 service nova] Creating event network-changed:623407fe-7f23-4c9f-b055-9167a09a5b1c for instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b on n-h1-858384-13 Oct 18 14:20:23.765993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-e90d1160-cc96-4325-b1ea-ab7cd04ac955 req-9ac98a36-9fd3-42d2-aa76-ff41b8afa797 service nova] Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:20:23.779363 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e90d1160-cc96-4325-b1ea-ab7cd04ac955 req-9ac98a36-9fd3-42d2-aa76-ff41b8afa797 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122520 Oct 18 14:20:23.780616 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3447/7098] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:20:23.916104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-bf6a6f2a-9450-48f6-96a9-e2643851b9ac req-1d49b530-d81f-4eea-9100-390b88712fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d82844-ffbc-43d2-b221-24a5d4d9a32b", "name": "network-vif-plugged", "status": "completed", "tag": "623407fe-7f23-4c9f-b055-9167a09a5b1c"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:20:23.937954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bf6a6f2a-9450-48f6-96a9-e2643851b9ac req-1d49b530-d81f-4eea-9100-390b88712fac service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:23.938502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bf6a6f2a-9450-48f6-96a9-e2643851b9ac req-1d49b530-d81f-4eea-9100-390b88712fac service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:23.938872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-bf6a6f2a-9450-48f6-96a9-e2643851b9ac req-1d49b530-d81f-4eea-9100-390b88712fac service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:23.952299 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-bf6a6f2a-9450-48f6-96a9-e2643851b9ac req-1d49b530-d81f-4eea-9100-390b88712fac service nova] Creating event network-vif-plugged:623407fe-7f23-4c9f-b055-9167a09a5b1c for instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b on n-h1-858384-13 Oct 18 14:20:23.959175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-bf6a6f2a-9450-48f6-96a9-e2643851b9ac req-1d49b530-d81f-4eea-9100-390b88712fac service nova] Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:20:23.972695 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-bf6a6f2a-9450-48f6-96a9-e2643851b9ac req-1d49b530-d81f-4eea-9100-390b88712fac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132851 Oct 18 14:20:23.973974 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3448/7099] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:20:24.006748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8e47c9ca-7af0-4384-8cd5-f0fc5e52c6b5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:24.014849 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8e47c9ca-7af0-4384-8cd5-f0fc5e52c6b5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1675 microversion: 2.1 time: 0.290171 Oct 18 14:20:24.015544 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3652/7100] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:23 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1675 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:20:25.040780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9a969027-fa3f-45ed-8985-08eda07fa702 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:25.041513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9a969027-fa3f-45ed-8985-08eda07fa702 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:25.047818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a969027-fa3f-45ed-8985-08eda07fa702 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:25.048300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a969027-fa3f-45ed-8985-08eda07fa702 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:25.048847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a969027-fa3f-45ed-8985-08eda07fa702 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:25.049615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a969027-fa3f-45ed-8985-08eda07fa702 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:25.050067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a969027-fa3f-45ed-8985-08eda07fa702 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:25.050495 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a969027-fa3f-45ed-8985-08eda07fa702 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:25.196579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9a969027-fa3f-45ed-8985-08eda07fa702 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:25.204456 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9a969027-fa3f-45ed-8985-08eda07fa702 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1675 microversion: 2.1 time: 0.168843 Oct 18 14:20:25.205722 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3449/7101] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:25 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:26.229245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-733f2a5e-5763-4712-861e-cc0f45e78b4b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:26.230399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-733f2a5e-5763-4712-861e-cc0f45e78b4b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:26.237627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-733f2a5e-5763-4712-861e-cc0f45e78b4b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:26.238128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-733f2a5e-5763-4712-861e-cc0f45e78b4b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:26.238575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-733f2a5e-5763-4712-861e-cc0f45e78b4b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:26.239277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-733f2a5e-5763-4712-861e-cc0f45e78b4b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:26.239748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-733f2a5e-5763-4712-861e-cc0f45e78b4b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:26.240188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-733f2a5e-5763-4712-861e-cc0f45e78b4b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:26.374954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-733f2a5e-5763-4712-861e-cc0f45e78b4b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:26.383054 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-733f2a5e-5763-4712-861e-cc0f45e78b4b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1675 microversion: 2.1 time: 0.157745 Oct 18 14:20:26.383634 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3653/7102] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:26 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:27.407468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-437f5804-97d9-47d7-838c-ba5fc037c8db tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:27.408696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-437f5804-97d9-47d7-838c-ba5fc037c8db tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:27.415738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-437f5804-97d9-47d7-838c-ba5fc037c8db tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:27.416217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-437f5804-97d9-47d7-838c-ba5fc037c8db tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:27.416650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-437f5804-97d9-47d7-838c-ba5fc037c8db tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:27.417383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-437f5804-97d9-47d7-838c-ba5fc037c8db tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:27.417829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-437f5804-97d9-47d7-838c-ba5fc037c8db tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:27.418245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-437f5804-97d9-47d7-838c-ba5fc037c8db tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:27.437448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:27.566146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-437f5804-97d9-47d7-838c-ba5fc037c8db tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:27.576651 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-437f5804-97d9-47d7-838c-ba5fc037c8db tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1668 microversion: 2.1 time: 0.173262 Oct 18 14:20:27.577967 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3450/7103] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:27 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1668 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:27.601083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ea8b11aa-df9b-40f5-b0a0-e1b6fc555713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:27.601757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ea8b11aa-df9b-40f5-b0a0-e1b6fc555713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:27.608877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea8b11aa-df9b-40f5-b0a0-e1b6fc555713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:27.609410 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea8b11aa-df9b-40f5-b0a0-e1b6fc555713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:27.609854 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea8b11aa-df9b-40f5-b0a0-e1b6fc555713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:27.610565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea8b11aa-df9b-40f5-b0a0-e1b6fc555713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:27.611612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea8b11aa-df9b-40f5-b0a0-e1b6fc555713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:27.612055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea8b11aa-df9b-40f5-b0a0-e1b6fc555713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:27.757468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ea8b11aa-df9b-40f5-b0a0-e1b6fc555713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:27.765674 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ea8b11aa-df9b-40f5-b0a0-e1b6fc555713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1668 microversion: 2.1 time: 0.169194 Oct 18 14:20:27.766266 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3654/7104] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:27 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1668 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:27.789268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f23b6e4b-b1e3-48f7-a67a-6c3d33ae76e0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:27.789849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f23b6e4b-b1e3-48f7-a67a-6c3d33ae76e0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:27.795966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f23b6e4b-b1e3-48f7-a67a-6c3d33ae76e0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:27.797408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f23b6e4b-b1e3-48f7-a67a-6c3d33ae76e0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:27.797408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f23b6e4b-b1e3-48f7-a67a-6c3d33ae76e0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:27.797797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f23b6e4b-b1e3-48f7-a67a-6c3d33ae76e0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:27.798106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f23b6e4b-b1e3-48f7-a67a-6c3d33ae76e0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:27.799054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f23b6e4b-b1e3-48f7-a67a-6c3d33ae76e0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:27.933472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f23b6e4b-b1e3-48f7-a67a-6c3d33ae76e0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:27.942824 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f23b6e4b-b1e3-48f7-a67a-6c3d33ae76e0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1668 microversion: 2.1 time: 0.157336 Oct 18 14:20:27.943416 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3451/7105] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:27 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:27.965334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5e7b886a-955d-44c8-a807-ef33d93b5286 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:27.965846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e7b886a-955d-44c8-a807-ef33d93b5286 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:27.972754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e7b886a-955d-44c8-a807-ef33d93b5286 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:27.973288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e7b886a-955d-44c8-a807-ef33d93b5286 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:27.973739 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e7b886a-955d-44c8-a807-ef33d93b5286 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:27.974522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e7b886a-955d-44c8-a807-ef33d93b5286 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:27.974905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e7b886a-955d-44c8-a807-ef33d93b5286 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:27.975341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e7b886a-955d-44c8-a807-ef33d93b5286 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:27.997903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:28.006336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e7b886a-955d-44c8-a807-ef33d93b5286 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:20:28.102395 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5e7b886a-955d-44c8-a807-ef33d93b5286 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "DELETE /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 204 len: 0 microversion: 2.1 time: 0.140501 Oct 18 14:20:28.103098 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3655/7106] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:20:27 2022] DELETE /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:20:28.114377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d72091e1-e006-41ec-a984-7f67706231a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:28.114993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d72091e1-e006-41ec-a984-7f67706231a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:28.121594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d72091e1-e006-41ec-a984-7f67706231a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:28.122083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d72091e1-e006-41ec-a984-7f67706231a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:28.122521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d72091e1-e006-41ec-a984-7f67706231a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:28.123231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d72091e1-e006-41ec-a984-7f67706231a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:28.123682 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d72091e1-e006-41ec-a984-7f67706231a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:28.124107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d72091e1-e006-41ec-a984-7f67706231a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:28.277164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d72091e1-e006-41ec-a984-7f67706231a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:28.292120 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d72091e1-e006-41ec-a984-7f67706231a1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1674 microversion: 2.1 time: 0.182327 Oct 18 14:20:28.293415 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3452/7107] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:28 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:29.330668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0ccd209a-0949-4a63-a452-815d7acbb0d9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:29.331394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0ccd209a-0949-4a63-a452-815d7acbb0d9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:29.338772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ccd209a-0949-4a63-a452-815d7acbb0d9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:29.339271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ccd209a-0949-4a63-a452-815d7acbb0d9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:29.339723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ccd209a-0949-4a63-a452-815d7acbb0d9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:29.340457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ccd209a-0949-4a63-a452-815d7acbb0d9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:29.340926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ccd209a-0949-4a63-a452-815d7acbb0d9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:29.341403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ccd209a-0949-4a63-a452-815d7acbb0d9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:29.479759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0ccd209a-0949-4a63-a452-815d7acbb0d9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:29.488058 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0ccd209a-0949-4a63-a452-815d7acbb0d9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1674 microversion: 2.1 time: 0.162187 Oct 18 14:20:29.488653 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3656/7108] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:29 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:30.512481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9ac51573-b5de-4d7e-966d-6dac14473788 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:30.513100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9ac51573-b5de-4d7e-966d-6dac14473788 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:30.515924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:30.521864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ac51573-b5de-4d7e-966d-6dac14473788 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:30.522349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ac51573-b5de-4d7e-966d-6dac14473788 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:30.522784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ac51573-b5de-4d7e-966d-6dac14473788 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:30.523515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ac51573-b5de-4d7e-966d-6dac14473788 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:30.523965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ac51573-b5de-4d7e-966d-6dac14473788 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:30.524442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9ac51573-b5de-4d7e-966d-6dac14473788 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:30.617987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9ac51573-b5de-4d7e-966d-6dac14473788 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:30.625723 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9ac51573-b5de-4d7e-966d-6dac14473788 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 200 len: 1606 microversion: 2.1 time: 0.117276 Oct 18 14:20:30.626542 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3453/7109] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:30 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 1606 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:30.847652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8a1f63a7-9b25-4baf-9034-bc4bee6c8431 req-c6e45428-0864-4508-880e-f6cb51e3d108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d82844-ffbc-43d2-b221-24a5d4d9a32b", "name": "network-vif-deleted", "tag": "623407fe-7f23-4c9f-b055-9167a09a5b1c"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:20:30.860065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8a1f63a7-9b25-4baf-9034-bc4bee6c8431 req-c6e45428-0864-4508-880e-f6cb51e3d108 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:30.860652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8a1f63a7-9b25-4baf-9034-bc4bee6c8431 req-c6e45428-0864-4508-880e-f6cb51e3d108 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:30.861716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8a1f63a7-9b25-4baf-9034-bc4bee6c8431 req-c6e45428-0864-4508-880e-f6cb51e3d108 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:30.873782 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8a1f63a7-9b25-4baf-9034-bc4bee6c8431 req-c6e45428-0864-4508-880e-f6cb51e3d108 service nova] Creating event network-vif-deleted:623407fe-7f23-4c9f-b055-9167a09a5b1c for instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b on n-h1-858384-13 Oct 18 14:20:30.879696 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8a1f63a7-9b25-4baf-9034-bc4bee6c8431 req-c6e45428-0864-4508-880e-f6cb51e3d108 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036768 Oct 18 14:20:30.880842 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3657/7110] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:20:31.649646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3be81db4-9265-42ea-a2f2-e6e562fd99ee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:31.650269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3be81db4-9265-42ea-a2f2-e6e562fd99ee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:31.653209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:31.658725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3be81db4-9265-42ea-a2f2-e6e562fd99ee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:31.659213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3be81db4-9265-42ea-a2f2-e6e562fd99ee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:31.659655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3be81db4-9265-42ea-a2f2-e6e562fd99ee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:31.660365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3be81db4-9265-42ea-a2f2-e6e562fd99ee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:31.660822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3be81db4-9265-42ea-a2f2-e6e562fd99ee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:31.661325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3be81db4-9265-42ea-a2f2-e6e562fd99ee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:31.676770 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-3be81db4-9265-42ea-a2f2-e6e562fd99ee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3be81db4-9265-42ea-a2f2-e6e562fd99ee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b HTTP/1.1 Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '87d82844-ffbc-43d2-b221-24a5d4d9a32b'} Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:20:31.678608 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:20:31.687849 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:20:31.687849 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:20:31.687849 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:20:31.687849 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:20:31.687849 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:20:31.687849 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:20:31.687849 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:20:31.687849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3be81db4-9265-42ea-a2f2-e6e562fd99ee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:20:31.687849 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3be81db4-9265-42ea-a2f2-e6e562fd99ee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 404 len: 111 microversion: 2.1 time: 0.034195 Oct 18 14:20:31.687849 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3454/7111] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:31 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:20:31.700060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-424f443a-3230-4b0f-83b9-ec74c274dbfc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:31.700973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-424f443a-3230-4b0f-83b9-ec74c274dbfc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:31.703188 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:31.709442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-424f443a-3230-4b0f-83b9-ec74c274dbfc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:31.709954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-424f443a-3230-4b0f-83b9-ec74c274dbfc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:31.710407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-424f443a-3230-4b0f-83b9-ec74c274dbfc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:31.713887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-424f443a-3230-4b0f-83b9-ec74c274dbfc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:31.714378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-424f443a-3230-4b0f-83b9-ec74c274dbfc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:31.714834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-424f443a-3230-4b0f-83b9-ec74c274dbfc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:31.730719 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-424f443a-3230-4b0f-83b9-ec74c274dbfc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-424f443a-3230-4b0f-83b9-ec74c274dbfc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b HTTP/1.1 Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '87d82844-ffbc-43d2-b221-24a5d4d9a32b'} Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:20:31.732538 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:20:31.737467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:20:31.737467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:20:31.737467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:20:31.737467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:20:31.737467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:20:31.737467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:20:31.737467 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:20:31.737467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-424f443a-3230-4b0f-83b9-ec74c274dbfc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:20:31.737467 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-424f443a-3230-4b0f-83b9-ec74c274dbfc tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 404 len: 111 microversion: 2.1 time: 0.038288 Oct 18 14:20:31.737467 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3658/7112] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:31 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:20:31.786879 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-967590828", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "9ee6393f-1f96-4d8a-a8c7-9559f9047108"}], "security_groups": [{"name": "tempest-securitygroup--1102295394"}], "key_name": "tempest-keypair-356831020", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:20:31.899044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] validate_networks() for [('9ee6393f-1f96-4d8a-a8c7-9559f9047108', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:20:32.276903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:20:32.277357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:20:32.277833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:20:32.278237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:20:32.278642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:20:32.287612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:32.288086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:32.288516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:32.289266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:32.289713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:32.290133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:32.307267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:20:32.312380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for user 7dbfce990e5248698b492af6c8b2ba85 and project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:20:32.325311 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:20:32.327599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:20:32.375234 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-180ca775-a133-4158-bc28-33ca19e504e5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.592480 Oct 18 14:20:32.375921 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3455/7113] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:20:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:20:32.387738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b61119a3-0596-4dc0-8e32-c2fde8d777eb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:32.388450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b61119a3-0596-4dc0-8e32-c2fde8d777eb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:32.446795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b61119a3-0596-4dc0-8e32-c2fde8d777eb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:32.454620 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b61119a3-0596-4dc0-8e32-c2fde8d777eb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1237 microversion: 2.1 time: 0.070820 Oct 18 14:20:32.455902 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3659/7114] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:32 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:33.481706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2dc7d0fe-9db0-46dc-b6f8-36b4c8962645 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:33.483231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2dc7d0fe-9db0-46dc-b6f8-36b4c8962645 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:33.493743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dc7d0fe-9db0-46dc-b6f8-36b4c8962645 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:33.494597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dc7d0fe-9db0-46dc-b6f8-36b4c8962645 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:33.495352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dc7d0fe-9db0-46dc-b6f8-36b4c8962645 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:33.496186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dc7d0fe-9db0-46dc-b6f8-36b4c8962645 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:33.496823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dc7d0fe-9db0-46dc-b6f8-36b4c8962645 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:33.497284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dc7d0fe-9db0-46dc-b6f8-36b4c8962645 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:33.594177 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2dc7d0fe-9db0-46dc-b6f8-36b4c8962645 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:33.603261 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2dc7d0fe-9db0-46dc-b6f8-36b4c8962645 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1297 microversion: 2.1 time: 0.127117 Oct 18 14:20:33.604499 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3456/7115] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:33 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1297 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:34.628981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e6a78f85-d306-4106-99f4-fcbc116d78bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:34.629838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e6a78f85-d306-4106-99f4-fcbc116d78bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:34.637615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6a78f85-d306-4106-99f4-fcbc116d78bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:34.638227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6a78f85-d306-4106-99f4-fcbc116d78bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:34.638829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6a78f85-d306-4106-99f4-fcbc116d78bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:34.639767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6a78f85-d306-4106-99f4-fcbc116d78bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:34.640320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6a78f85-d306-4106-99f4-fcbc116d78bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:34.640829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e6a78f85-d306-4106-99f4-fcbc116d78bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:34.786904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e6a78f85-d306-4106-99f4-fcbc116d78bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:34.795015 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e6a78f85-d306-4106-99f4-fcbc116d78bb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1363 microversion: 2.1 time: 0.170852 Oct 18 14:20:34.795620 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3660/7116] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:34 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:35.051483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d4dab0a3-6d81-477b-8cc8-165404064d45 req-dc6d4204-c02c-4889-b06c-afc9d4593e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79e3d326-5d79-4532-ac7a-63b62a03f2ff", "tag": "10d96dc6-5242-403c-b03a-76d380b8af67"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:20:35.063568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d4dab0a3-6d81-477b-8cc8-165404064d45 req-dc6d4204-c02c-4889-b06c-afc9d4593e61 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:35.064442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d4dab0a3-6d81-477b-8cc8-165404064d45 req-dc6d4204-c02c-4889-b06c-afc9d4593e61 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:35.065379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d4dab0a3-6d81-477b-8cc8-165404064d45 req-dc6d4204-c02c-4889-b06c-afc9d4593e61 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:35.078262 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d4dab0a3-6d81-477b-8cc8-165404064d45 req-dc6d4204-c02c-4889-b06c-afc9d4593e61 service nova] Creating event network-changed:10d96dc6-5242-403c-b03a-76d380b8af67 for instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff on n-h1-858384-13 Oct 18 14:20:35.084221 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d4dab0a3-6d81-477b-8cc8-165404064d45 req-dc6d4204-c02c-4889-b06c-afc9d4593e61 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037408 Oct 18 14:20:35.085464 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3457/7117] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:20:35.820911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-93b3cdb3-7e17-4431-9846-8f9a6a94c00b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:35.821572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-93b3cdb3-7e17-4431-9846-8f9a6a94c00b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:35.828575 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93b3cdb3-7e17-4431-9846-8f9a6a94c00b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:35.829073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93b3cdb3-7e17-4431-9846-8f9a6a94c00b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:35.830640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93b3cdb3-7e17-4431-9846-8f9a6a94c00b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:35.831357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93b3cdb3-7e17-4431-9846-8f9a6a94c00b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:35.832120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93b3cdb3-7e17-4431-9846-8f9a6a94c00b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:35.832568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-93b3cdb3-7e17-4431-9846-8f9a6a94c00b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:35.967021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-93b3cdb3-7e17-4431-9846-8f9a6a94c00b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:35.975076 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-93b3cdb3-7e17-4431-9846-8f9a6a94c00b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1363 microversion: 2.1 time: 0.158240 Oct 18 14:20:35.975651 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3661/7118] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:35 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:36.999790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-000350fc-f11c-4659-8e49-4c9e73989a35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:37.000479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-000350fc-f11c-4659-8e49-4c9e73989a35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:37.008069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-000350fc-f11c-4659-8e49-4c9e73989a35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:37.008542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-000350fc-f11c-4659-8e49-4c9e73989a35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:37.008975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-000350fc-f11c-4659-8e49-4c9e73989a35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:37.009713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-000350fc-f11c-4659-8e49-4c9e73989a35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:37.010160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-000350fc-f11c-4659-8e49-4c9e73989a35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:37.010580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-000350fc-f11c-4659-8e49-4c9e73989a35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:37.143515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-000350fc-f11c-4659-8e49-4c9e73989a35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:37.152083 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-000350fc-f11c-4659-8e49-4c9e73989a35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1363 microversion: 2.1 time: 0.156776 Oct 18 14:20:37.152669 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3458/7119] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:36 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:38.175600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-db85d640-f28f-47d2-974e-72ec35a08e87 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:38.176235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-db85d640-f28f-47d2-974e-72ec35a08e87 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:38.183215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db85d640-f28f-47d2-974e-72ec35a08e87 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:38.183710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db85d640-f28f-47d2-974e-72ec35a08e87 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:38.184157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db85d640-f28f-47d2-974e-72ec35a08e87 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:38.184863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db85d640-f28f-47d2-974e-72ec35a08e87 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:38.185371 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db85d640-f28f-47d2-974e-72ec35a08e87 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:38.185960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-db85d640-f28f-47d2-974e-72ec35a08e87 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:38.320961 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-db85d640-f28f-47d2-974e-72ec35a08e87 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:38.328828 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-db85d640-f28f-47d2-974e-72ec35a08e87 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1363 microversion: 2.1 time: 0.157284 Oct 18 14:20:38.329592 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3662/7120] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:38 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:39.354116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e84295b-c13a-4898-9775-225cef46d58c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:39.354642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0e84295b-c13a-4898-9775-225cef46d58c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:39.361452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e84295b-c13a-4898-9775-225cef46d58c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:39.361937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e84295b-c13a-4898-9775-225cef46d58c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:39.362377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e84295b-c13a-4898-9775-225cef46d58c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:39.363726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e84295b-c13a-4898-9775-225cef46d58c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:39.364147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e84295b-c13a-4898-9775-225cef46d58c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:39.364580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e84295b-c13a-4898-9775-225cef46d58c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:39.494737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e84295b-c13a-4898-9775-225cef46d58c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:39.502842 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e84295b-c13a-4898-9775-225cef46d58c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1363 microversion: 2.1 time: 0.152673 Oct 18 14:20:39.503430 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3459/7121] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:39 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:40.215669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-4ff4f6db-7f1b-457a-b1e1-75039c6efd32 req-d5d8aa87-2ffa-4a56-b45f-b8f06a06c74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e3d326-5d79-4532-ac7a-63b62a03f2ff", "name": "network-vif-plugged", "status": "completed", "tag": "10d96dc6-5242-403c-b03a-76d380b8af67"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:20:40.228414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4ff4f6db-7f1b-457a-b1e1-75039c6efd32 req-d5d8aa87-2ffa-4a56-b45f-b8f06a06c74a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:40.228908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4ff4f6db-7f1b-457a-b1e1-75039c6efd32 req-d5d8aa87-2ffa-4a56-b45f-b8f06a06c74a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:40.229383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4ff4f6db-7f1b-457a-b1e1-75039c6efd32 req-d5d8aa87-2ffa-4a56-b45f-b8f06a06c74a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:40.241548 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-4ff4f6db-7f1b-457a-b1e1-75039c6efd32 req-d5d8aa87-2ffa-4a56-b45f-b8f06a06c74a service nova] Creating event network-vif-plugged:10d96dc6-5242-403c-b03a-76d380b8af67 for instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff on n-h1-858384-13 Oct 18 14:20:40.247909 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-4ff4f6db-7f1b-457a-b1e1-75039c6efd32 req-d5d8aa87-2ffa-4a56-b45f-b8f06a06c74a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037090 Oct 18 14:20:40.248699 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3663/7122] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:20:40.526571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2e5455fa-5c25-483f-a04b-cb11c386ccf1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:40.527176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2e5455fa-5c25-483f-a04b-cb11c386ccf1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:40.534150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e5455fa-5c25-483f-a04b-cb11c386ccf1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:40.534635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e5455fa-5c25-483f-a04b-cb11c386ccf1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:40.535121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e5455fa-5c25-483f-a04b-cb11c386ccf1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:40.535847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e5455fa-5c25-483f-a04b-cb11c386ccf1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:40.536297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e5455fa-5c25-483f-a04b-cb11c386ccf1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:40.536719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e5455fa-5c25-483f-a04b-cb11c386ccf1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:40.673261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2e5455fa-5c25-483f-a04b-cb11c386ccf1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:40.681983 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2e5455fa-5c25-483f-a04b-cb11c386ccf1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1363 microversion: 2.1 time: 0.159365 Oct 18 14:20:40.682566 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3460/7123] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:40 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:41.705634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2868039c-a150-4f6e-9bab-4121a0f5d8e4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:41.706355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2868039c-a150-4f6e-9bab-4121a0f5d8e4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:41.713984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2868039c-a150-4f6e-9bab-4121a0f5d8e4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:41.714484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2868039c-a150-4f6e-9bab-4121a0f5d8e4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:41.714935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2868039c-a150-4f6e-9bab-4121a0f5d8e4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:41.715636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2868039c-a150-4f6e-9bab-4121a0f5d8e4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:41.716131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2868039c-a150-4f6e-9bab-4121a0f5d8e4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:41.716571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2868039c-a150-4f6e-9bab-4121a0f5d8e4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:41.857781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2868039c-a150-4f6e-9bab-4121a0f5d8e4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:41.865869 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2868039c-a150-4f6e-9bab-4121a0f5d8e4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1363 microversion: 2.1 time: 0.164621 Oct 18 14:20:41.866459 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3664/7124] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:41 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:42.889319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-97471e5a-6f72-4261-98bb-430bf6ccf6e6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:42.889933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-97471e5a-6f72-4261-98bb-430bf6ccf6e6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:42.892676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:42.893520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:42.899098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97471e5a-6f72-4261-98bb-430bf6ccf6e6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:42.899575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97471e5a-6f72-4261-98bb-430bf6ccf6e6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:42.900006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97471e5a-6f72-4261-98bb-430bf6ccf6e6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:42.900690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97471e5a-6f72-4261-98bb-430bf6ccf6e6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:42.901135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97471e5a-6f72-4261-98bb-430bf6ccf6e6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:42.901581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-97471e5a-6f72-4261-98bb-430bf6ccf6e6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:43.039726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-97471e5a-6f72-4261-98bb-430bf6ccf6e6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:20:43.048191 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-97471e5a-6f72-4261-98bb-430bf6ccf6e6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1549 microversion: 2.1 time: 0.162719 Oct 18 14:20:43.048795 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3461/7125] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:20:42 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:20:43.073436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b759a36c-64c0-4079-92d4-d2ef9e13248e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:20:43.073998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b759a36c-64c0-4079-92d4-d2ef9e13248e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:20:43.075947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:20:43.082542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b759a36c-64c0-4079-92d4-d2ef9e13248e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:43.083049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b759a36c-64c0-4079-92d4-d2ef9e13248e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:43.083763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b759a36c-64c0-4079-92d4-d2ef9e13248e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:43.084483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b759a36c-64c0-4079-92d4-d2ef9e13248e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:43.084982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b759a36c-64c0-4079-92d4-d2ef9e13248e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:43.085435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b759a36c-64c0-4079-92d4-d2ef9e13248e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:43.168418 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b759a36c-64c0-4079-92d4-d2ef9e13248e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098962 Oct 18 14:20:43.169075 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3665/7126] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 14:20:43 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:20:44.125450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ce36a0d8-275b-4bf0-8f74-28520cfba2dd req-afa026b7-2b07-4699-9bb8-3015fcce0e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79e3d326-5d79-4532-ac7a-63b62a03f2ff", "tag": "10d96dc6-5242-403c-b03a-76d380b8af67"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:20:44.136024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ce36a0d8-275b-4bf0-8f74-28520cfba2dd req-afa026b7-2b07-4699-9bb8-3015fcce0e2a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:20:44.136505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ce36a0d8-275b-4bf0-8f74-28520cfba2dd req-afa026b7-2b07-4699-9bb8-3015fcce0e2a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:20:44.136940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ce36a0d8-275b-4bf0-8f74-28520cfba2dd req-afa026b7-2b07-4699-9bb8-3015fcce0e2a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:20:44.148699 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ce36a0d8-275b-4bf0-8f74-28520cfba2dd req-afa026b7-2b07-4699-9bb8-3015fcce0e2a service nova] Creating event network-changed:10d96dc6-5242-403c-b03a-76d380b8af67 for instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff on n-h1-858384-13 Oct 18 14:20:44.154740 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ce36a0d8-275b-4bf0-8f74-28520cfba2dd req-afa026b7-2b07-4699-9bb8-3015fcce0e2a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033143 Oct 18 14:20:44.155243 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3462/7127] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:21:56.210133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=17 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:56.210967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:56.212153 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:21:56.212369 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:21:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff (ip 10.222.0.40) !!! Oct 18 14:21:56.219799 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-afb2ba63-3c3c-4bd2-a674-29e244a3e9f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:21:56.220361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-afb2ba63-3c3c-4bd2-a674-29e244a3e9f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:56.230695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afb2ba63-3c3c-4bd2-a674-29e244a3e9f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:56.231592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afb2ba63-3c3c-4bd2-a674-29e244a3e9f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:56.231737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afb2ba63-3c3c-4bd2-a674-29e244a3e9f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:56.233027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afb2ba63-3c3c-4bd2-a674-29e244a3e9f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:56.233545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afb2ba63-3c3c-4bd2-a674-29e244a3e9f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:56.234001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-afb2ba63-3c3c-4bd2-a674-29e244a3e9f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:56.388966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-afb2ba63-3c3c-4bd2-a674-29e244a3e9f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:21:56.398598 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-afb2ba63-3c3c-4bd2-a674-29e244a3e9f1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1667 microversion: 2.1 time: 0.191187 Oct 18 14:21:56.399197 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3666/7128] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:21:56 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1667 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:21:56.423314 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:56.424060 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=58 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:21:56.425544 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:21:56.425695 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:21:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff/os-volume_attachments (ip 10.222.0.40) !!! Oct 18 14:21:56.438067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-497b86e3-5c0e-4f8c-84b0-7dd9764257ba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f2f2c85-f87a-4fa8-b709-8e60848a3a64"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:21:56.441308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-497b86e3-5c0e-4f8c-84b0-7dd9764257ba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:21:56.455993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-497b86e3-5c0e-4f8c-84b0-7dd9764257ba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:56.456475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-497b86e3-5c0e-4f8c-84b0-7dd9764257ba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:56.456910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-497b86e3-5c0e-4f8c-84b0-7dd9764257ba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:56.457643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-497b86e3-5c0e-4f8c-84b0-7dd9764257ba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:21:56.458093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-497b86e3-5c0e-4f8c-84b0-7dd9764257ba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:21:56.458515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-497b86e3-5c0e-4f8c-84b0-7dd9764257ba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:21:56.753289 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-497b86e3-5c0e-4f8c-84b0-7dd9764257ba tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331776 Oct 18 14:21:56.754008 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3463/7129] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 14:21:56 2022] POST /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:22:07.523993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:22:07.526349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:07.529252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:07.530050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:07.536086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:07.536590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:07.537044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:07.537788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:07.538262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:07.538705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:07.571587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:07.578167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Old instance type m1.heat2, new instance type m1.heat {{(pid=120611) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:22:07.585545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:22:07.585990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:22:07.586492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:22:07.586924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:22:07.587354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:22:07.651421 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9d4d2c6b-f097-4d36-a638-8780d53185d7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff/action" status: 202 len: 0 microversion: 2.1 time: 0.131265 Oct 18 14:22:07.651978 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3667/7130] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:22:07 2022] POST /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:22:07.661385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a8ba76ac-f8fd-40ac-ab70-379b810f8fe1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:07.667432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a8ba76ac-f8fd-40ac-ab70-379b810f8fe1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:07.670079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:07.670763 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:07.672902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8ba76ac-f8fd-40ac-ab70-379b810f8fe1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:07.673599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8ba76ac-f8fd-40ac-ab70-379b810f8fe1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:07.674073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8ba76ac-f8fd-40ac-ab70-379b810f8fe1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:07.674956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8ba76ac-f8fd-40ac-ab70-379b810f8fe1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:07.675590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8ba76ac-f8fd-40ac-ab70-379b810f8fe1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:07.676139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8ba76ac-f8fd-40ac-ab70-379b810f8fe1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:07.852482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a8ba76ac-f8fd-40ac-ab70-379b810f8fe1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:07.862496 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a8ba76ac-f8fd-40ac-ab70-379b810f8fe1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1722 microversion: 2.1 time: 0.205637 Oct 18 14:22:07.863255 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3464/7131] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:07 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:22:08.887349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b9384f43-0a89-4a5c-bb08-7b0bfa445730 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:08.888782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b9384f43-0a89-4a5c-bb08-7b0bfa445730 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:08.895482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9384f43-0a89-4a5c-bb08-7b0bfa445730 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:08.895982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9384f43-0a89-4a5c-bb08-7b0bfa445730 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:08.896437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9384f43-0a89-4a5c-bb08-7b0bfa445730 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:08.897149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9384f43-0a89-4a5c-bb08-7b0bfa445730 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:08.897643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9384f43-0a89-4a5c-bb08-7b0bfa445730 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:08.898085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b9384f43-0a89-4a5c-bb08-7b0bfa445730 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:09.031946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b9384f43-0a89-4a5c-bb08-7b0bfa445730 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:09.040645 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b9384f43-0a89-4a5c-bb08-7b0bfa445730 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1722 microversion: 2.1 time: 0.158087 Oct 18 14:22:09.041278 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3668/7132] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:08 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:10.066531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-47f115e6-e224-4ca9-a9a4-f2d5ed725126 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:10.067187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-47f115e6-e224-4ca9-a9a4-f2d5ed725126 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:10.074313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47f115e6-e224-4ca9-a9a4-f2d5ed725126 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:10.074795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47f115e6-e224-4ca9-a9a4-f2d5ed725126 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:10.075966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47f115e6-e224-4ca9-a9a4-f2d5ed725126 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:10.076681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47f115e6-e224-4ca9-a9a4-f2d5ed725126 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:10.077136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47f115e6-e224-4ca9-a9a4-f2d5ed725126 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:10.077587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47f115e6-e224-4ca9-a9a4-f2d5ed725126 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:10.214085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-47f115e6-e224-4ca9-a9a4-f2d5ed725126 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:10.222608 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-47f115e6-e224-4ca9-a9a4-f2d5ed725126 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1722 microversion: 2.1 time: 0.160844 Oct 18 14:22:10.223197 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3465/7133] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:10 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:11.246130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4a5fa406-286e-414d-a8ea-75007c4ec89c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:11.246823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4a5fa406-286e-414d-a8ea-75007c4ec89c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:11.253794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a5fa406-286e-414d-a8ea-75007c4ec89c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:11.254250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a5fa406-286e-414d-a8ea-75007c4ec89c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:11.254704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a5fa406-286e-414d-a8ea-75007c4ec89c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:11.255421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a5fa406-286e-414d-a8ea-75007c4ec89c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:11.255893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a5fa406-286e-414d-a8ea-75007c4ec89c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:11.256333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4a5fa406-286e-414d-a8ea-75007c4ec89c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:11.392102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4a5fa406-286e-414d-a8ea-75007c4ec89c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:11.400808 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4a5fa406-286e-414d-a8ea-75007c4ec89c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1722 microversion: 2.1 time: 0.158721 Oct 18 14:22:11.401435 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3669/7134] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:11 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:12.425566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9d76ac68-3a3c-4162-b2b5-d11ba70c1b96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:12.426095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9d76ac68-3a3c-4162-b2b5-d11ba70c1b96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:12.432931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d76ac68-3a3c-4162-b2b5-d11ba70c1b96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:12.433733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d76ac68-3a3c-4162-b2b5-d11ba70c1b96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:12.433980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d76ac68-3a3c-4162-b2b5-d11ba70c1b96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:12.435181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d76ac68-3a3c-4162-b2b5-d11ba70c1b96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:12.435635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d76ac68-3a3c-4162-b2b5-d11ba70c1b96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:12.436052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9d76ac68-3a3c-4162-b2b5-d11ba70c1b96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:12.567185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9d76ac68-3a3c-4162-b2b5-d11ba70c1b96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:12.576620 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9d76ac68-3a3c-4162-b2b5-d11ba70c1b96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1727 microversion: 2.1 time: 0.154950 Oct 18 14:22:12.577217 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3466/7135] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:12 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:13.600228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-73178a0b-a597-409a-9a21-0fdb0bb197f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:13.600858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-73178a0b-a597-409a-9a21-0fdb0bb197f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:13.610492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73178a0b-a597-409a-9a21-0fdb0bb197f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:13.611040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73178a0b-a597-409a-9a21-0fdb0bb197f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:13.611491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73178a0b-a597-409a-9a21-0fdb0bb197f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:13.612201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73178a0b-a597-409a-9a21-0fdb0bb197f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:13.612669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73178a0b-a597-409a-9a21-0fdb0bb197f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:13.613113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73178a0b-a597-409a-9a21-0fdb0bb197f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:13.744685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-73178a0b-a597-409a-9a21-0fdb0bb197f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:13.753865 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-73178a0b-a597-409a-9a21-0fdb0bb197f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1727 microversion: 2.1 time: 0.157765 Oct 18 14:22:13.754447 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3670/7136] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:13 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:14.777893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-15dc00bc-1853-4911-a25d-243a0de67bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:14.778605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-15dc00bc-1853-4911-a25d-243a0de67bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:14.786528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15dc00bc-1853-4911-a25d-243a0de67bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:14.787002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15dc00bc-1853-4911-a25d-243a0de67bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:14.787433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15dc00bc-1853-4911-a25d-243a0de67bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:14.788111 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15dc00bc-1853-4911-a25d-243a0de67bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:14.788590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15dc00bc-1853-4911-a25d-243a0de67bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:14.789013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15dc00bc-1853-4911-a25d-243a0de67bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:14.923866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-15dc00bc-1853-4911-a25d-243a0de67bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:14.932207 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-15dc00bc-1853-4911-a25d-243a0de67bd9 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1727 microversion: 2.1 time: 0.158280 Oct 18 14:22:14.932782 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3467/7137] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:14 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:15.958012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-754f505b-1ebf-432b-8270-43e118120641 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:15.958638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-754f505b-1ebf-432b-8270-43e118120641 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:15.966781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-754f505b-1ebf-432b-8270-43e118120641 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:15.967029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-754f505b-1ebf-432b-8270-43e118120641 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:15.967472 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-754f505b-1ebf-432b-8270-43e118120641 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:15.968206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-754f505b-1ebf-432b-8270-43e118120641 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:15.968677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-754f505b-1ebf-432b-8270-43e118120641 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:15.969144 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-754f505b-1ebf-432b-8270-43e118120641 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:16.111692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-754f505b-1ebf-432b-8270-43e118120641 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:16.120295 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-754f505b-1ebf-432b-8270-43e118120641 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1727 microversion: 2.1 time: 0.166945 Oct 18 14:22:16.120871 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3671/7138] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:15 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:17.144805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31e58a8b-e4d5-4625-9d16-eae944e9a42e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:17.145441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-31e58a8b-e4d5-4625-9d16-eae944e9a42e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:17.152409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31e58a8b-e4d5-4625-9d16-eae944e9a42e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:17.152878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31e58a8b-e4d5-4625-9d16-eae944e9a42e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:17.153932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31e58a8b-e4d5-4625-9d16-eae944e9a42e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:17.154607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31e58a8b-e4d5-4625-9d16-eae944e9a42e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:17.155054 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31e58a8b-e4d5-4625-9d16-eae944e9a42e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:17.155472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31e58a8b-e4d5-4625-9d16-eae944e9a42e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:17.290674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31e58a8b-e4d5-4625-9d16-eae944e9a42e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:17.299043 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31e58a8b-e4d5-4625-9d16-eae944e9a42e tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1727 microversion: 2.1 time: 0.158148 Oct 18 14:22:17.299613 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3468/7139] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:17 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:18.323109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca0cb564-13c2-440a-9cac-4cab82dcf663 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:18.323745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca0cb564-13c2-440a-9cac-4cab82dcf663 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:18.330811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0cb564-13c2-440a-9cac-4cab82dcf663 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:18.331312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0cb564-13c2-440a-9cac-4cab82dcf663 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:18.331765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0cb564-13c2-440a-9cac-4cab82dcf663 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:18.332476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0cb564-13c2-440a-9cac-4cab82dcf663 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:18.332952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0cb564-13c2-440a-9cac-4cab82dcf663 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:18.333420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca0cb564-13c2-440a-9cac-4cab82dcf663 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:18.466383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ca0cb564-13c2-440a-9cac-4cab82dcf663 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:18.475142 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca0cb564-13c2-440a-9cac-4cab82dcf663 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1727 microversion: 2.1 time: 0.156041 Oct 18 14:22:18.475740 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3672/7140] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:18 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:19.499664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5ada72fd-004e-4525-8b64-0045c3c64a5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:19.500220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5ada72fd-004e-4525-8b64-0045c3c64a5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:19.507331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ada72fd-004e-4525-8b64-0045c3c64a5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:19.507813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ada72fd-004e-4525-8b64-0045c3c64a5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:19.508248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ada72fd-004e-4525-8b64-0045c3c64a5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:19.508969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ada72fd-004e-4525-8b64-0045c3c64a5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:19.509446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ada72fd-004e-4525-8b64-0045c3c64a5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:19.509870 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ada72fd-004e-4525-8b64-0045c3c64a5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:19.643274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5ada72fd-004e-4525-8b64-0045c3c64a5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:19.651641 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5ada72fd-004e-4525-8b64-0045c3c64a5f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1727 microversion: 2.1 time: 0.157069 Oct 18 14:22:19.652216 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3469/7141] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:19 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:20.674620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-28d7bec6-babb-43ee-8502-6ed0b15601ed tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:20.675175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-28d7bec6-babb-43ee-8502-6ed0b15601ed tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:20.682155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28d7bec6-babb-43ee-8502-6ed0b15601ed tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:20.682657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28d7bec6-babb-43ee-8502-6ed0b15601ed tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:20.683112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28d7bec6-babb-43ee-8502-6ed0b15601ed tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:20.683821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28d7bec6-babb-43ee-8502-6ed0b15601ed tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:20.684295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28d7bec6-babb-43ee-8502-6ed0b15601ed tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:20.684738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28d7bec6-babb-43ee-8502-6ed0b15601ed tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:20.830451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-28d7bec6-babb-43ee-8502-6ed0b15601ed tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:20.839129 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-28d7bec6-babb-43ee-8502-6ed0b15601ed tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1727 microversion: 2.1 time: 0.168487 Oct 18 14:22:20.839727 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3673/7142] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:20 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:21.862391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0a2d9fbd-58df-4dee-b9d6-3b41e1848b77 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:21.862986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0a2d9fbd-58df-4dee-b9d6-3b41e1848b77 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:21.869903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a2d9fbd-58df-4dee-b9d6-3b41e1848b77 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:21.870374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a2d9fbd-58df-4dee-b9d6-3b41e1848b77 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:21.870825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a2d9fbd-58df-4dee-b9d6-3b41e1848b77 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:21.871508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a2d9fbd-58df-4dee-b9d6-3b41e1848b77 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:21.871952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a2d9fbd-58df-4dee-b9d6-3b41e1848b77 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:21.872367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a2d9fbd-58df-4dee-b9d6-3b41e1848b77 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:22.298580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0a2d9fbd-58df-4dee-b9d6-3b41e1848b77 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:22.307078 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0a2d9fbd-58df-4dee-b9d6-3b41e1848b77 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1727 microversion: 2.1 time: 0.448568 Oct 18 14:22:22.307666 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3470/7143] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:21 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1727 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:23.330901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-baa2d5ec-19d3-4826-b3cc-302b28d2e6a0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:23.331528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-baa2d5ec-19d3-4826-b3cc-302b28d2e6a0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:23.338715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baa2d5ec-19d3-4826-b3cc-302b28d2e6a0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:23.339215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baa2d5ec-19d3-4826-b3cc-302b28d2e6a0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:23.339666 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baa2d5ec-19d3-4826-b3cc-302b28d2e6a0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:23.340377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baa2d5ec-19d3-4826-b3cc-302b28d2e6a0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:23.340846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baa2d5ec-19d3-4826-b3cc-302b28d2e6a0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:23.341310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-baa2d5ec-19d3-4826-b3cc-302b28d2e6a0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:23.478622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-baa2d5ec-19d3-4826-b3cc-302b28d2e6a0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:23.487900 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-baa2d5ec-19d3-4826-b3cc-302b28d2e6a0 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1727 microversion: 2.1 time: 0.161016 Oct 18 14:22:23.488491 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3674/7144] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:23 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:24.511659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5bc8eff9-3e0d-45db-ae2f-3e9eb38a3747 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:24.512289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5bc8eff9-3e0d-45db-ae2f-3e9eb38a3747 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:24.519545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bc8eff9-3e0d-45db-ae2f-3e9eb38a3747 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:24.520035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bc8eff9-3e0d-45db-ae2f-3e9eb38a3747 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:24.520471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bc8eff9-3e0d-45db-ae2f-3e9eb38a3747 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:24.521233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bc8eff9-3e0d-45db-ae2f-3e9eb38a3747 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:24.521691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bc8eff9-3e0d-45db-ae2f-3e9eb38a3747 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:24.522118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bc8eff9-3e0d-45db-ae2f-3e9eb38a3747 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:24.666575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5bc8eff9-3e0d-45db-ae2f-3e9eb38a3747 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:24.676525 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5bc8eff9-3e0d-45db-ae2f-3e9eb38a3747 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1727 microversion: 2.1 time: 0.168876 Oct 18 14:22:24.677349 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3471/7145] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:24 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:25.703480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc4b2298-7b70-465a-a3f2-9dfca8156433 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:25.704118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc4b2298-7b70-465a-a3f2-9dfca8156433 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:25.711333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc4b2298-7b70-465a-a3f2-9dfca8156433 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:25.711835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc4b2298-7b70-465a-a3f2-9dfca8156433 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:25.712294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc4b2298-7b70-465a-a3f2-9dfca8156433 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:25.713026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc4b2298-7b70-465a-a3f2-9dfca8156433 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:25.713528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc4b2298-7b70-465a-a3f2-9dfca8156433 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:25.714002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc4b2298-7b70-465a-a3f2-9dfca8156433 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:25.908298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fc4b2298-7b70-465a-a3f2-9dfca8156433 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:25.917095 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc4b2298-7b70-465a-a3f2-9dfca8156433 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1727 microversion: 2.1 time: 0.218933 Oct 18 14:22:25.917700 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3675/7146] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:25 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:26.278299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d148d8ae-5fbd-4234-a987-fd9fc37b8cb5 req-08b519a2-60a1-4a73-b1de-8c6f6994a37f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e3d326-5d79-4532-ac7a-63b62a03f2ff", "name": "network-vif-unplugged", "status": "completed", "tag": "10d96dc6-5242-403c-b03a-76d380b8af67"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:22:26.289308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d148d8ae-5fbd-4234-a987-fd9fc37b8cb5 req-08b519a2-60a1-4a73-b1de-8c6f6994a37f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:26.289677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d148d8ae-5fbd-4234-a987-fd9fc37b8cb5 req-08b519a2-60a1-4a73-b1de-8c6f6994a37f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:26.290230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d148d8ae-5fbd-4234-a987-fd9fc37b8cb5 req-08b519a2-60a1-4a73-b1de-8c6f6994a37f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:26.304528 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d148d8ae-5fbd-4234-a987-fd9fc37b8cb5 req-08b519a2-60a1-4a73-b1de-8c6f6994a37f service nova] Creating event network-vif-unplugged:10d96dc6-5242-403c-b03a-76d380b8af67 for instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff on n-h2-858384-13 Oct 18 14:22:26.310848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-d148d8ae-5fbd-4234-a987-fd9fc37b8cb5 req-08b519a2-60a1-4a73-b1de-8c6f6994a37f service nova] Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:22:26.323003 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d148d8ae-5fbd-4234-a987-fd9fc37b8cb5 req-08b519a2-60a1-4a73-b1de-8c6f6994a37f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049135 Oct 18 14:22:26.323618 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3472/7147] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:22:26.941742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d64e91c3-61b8-45da-9960-b170278671df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:26.942382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d64e91c3-61b8-45da-9960-b170278671df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:26.949583 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d64e91c3-61b8-45da-9960-b170278671df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:26.950095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d64e91c3-61b8-45da-9960-b170278671df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:26.950554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d64e91c3-61b8-45da-9960-b170278671df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:26.952012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d64e91c3-61b8-45da-9960-b170278671df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:26.952452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d64e91c3-61b8-45da-9960-b170278671df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:26.952904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d64e91c3-61b8-45da-9960-b170278671df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:27.547638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d64e91c3-61b8-45da-9960-b170278671df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:27.557577 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d64e91c3-61b8-45da-9960-b170278671df tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1726 microversion: 2.1 time: 0.619698 Oct 18 14:22:27.558549 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3676/7148] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:26 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1726 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:28.361128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-cb27622f-e9ed-4cf1-ada4-5ddab3d05f61 req-fb5da360-04f7-4c55-a85f-29dd31cd2f1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79e3d326-5d79-4532-ac7a-63b62a03f2ff", "tag": "10d96dc6-5242-403c-b03a-76d380b8af67"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:22:28.372254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cb27622f-e9ed-4cf1-ada4-5ddab3d05f61 req-fb5da360-04f7-4c55-a85f-29dd31cd2f1c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:28.372935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cb27622f-e9ed-4cf1-ada4-5ddab3d05f61 req-fb5da360-04f7-4c55-a85f-29dd31cd2f1c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:28.373437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-cb27622f-e9ed-4cf1-ada4-5ddab3d05f61 req-fb5da360-04f7-4c55-a85f-29dd31cd2f1c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:28.385611 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-cb27622f-e9ed-4cf1-ada4-5ddab3d05f61 req-fb5da360-04f7-4c55-a85f-29dd31cd2f1c service nova] Creating event network-changed:10d96dc6-5242-403c-b03a-76d380b8af67 for instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff on n-h2-858384-13 Oct 18 14:22:28.392089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-cb27622f-e9ed-4cf1-ada4-5ddab3d05f61 req-fb5da360-04f7-4c55-a85f-29dd31cd2f1c service nova] Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:22:28.403534 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-cb27622f-e9ed-4cf1-ada4-5ddab3d05f61 req-fb5da360-04f7-4c55-a85f-29dd31cd2f1c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047287 Oct 18 14:22:28.405474 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3473/7149] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:22:28.585157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-65a506fe-9cde-4d31-b7f9-141e1d88eb35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:28.586241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-65a506fe-9cde-4d31-b7f9-141e1d88eb35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:28.595263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65a506fe-9cde-4d31-b7f9-141e1d88eb35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:28.596437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65a506fe-9cde-4d31-b7f9-141e1d88eb35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:28.597540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65a506fe-9cde-4d31-b7f9-141e1d88eb35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:28.598597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65a506fe-9cde-4d31-b7f9-141e1d88eb35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:28.599209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65a506fe-9cde-4d31-b7f9-141e1d88eb35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:28.599753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-65a506fe-9cde-4d31-b7f9-141e1d88eb35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:28.829708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-65a506fe-9cde-4d31-b7f9-141e1d88eb35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:28.840546 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-65a506fe-9cde-4d31-b7f9-141e1d88eb35 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1724 microversion: 2.1 time: 0.260457 Oct 18 14:22:28.853203 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3677/7150] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:28 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:29.871205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-66c3fbd6-301f-4c37-99ea-cc9f52448e7d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:29.871910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-66c3fbd6-301f-4c37-99ea-cc9f52448e7d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:29.880037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66c3fbd6-301f-4c37-99ea-cc9f52448e7d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:29.880524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66c3fbd6-301f-4c37-99ea-cc9f52448e7d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:29.880965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66c3fbd6-301f-4c37-99ea-cc9f52448e7d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:29.881750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66c3fbd6-301f-4c37-99ea-cc9f52448e7d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:29.882214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66c3fbd6-301f-4c37-99ea-cc9f52448e7d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:29.882686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-66c3fbd6-301f-4c37-99ea-cc9f52448e7d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:30.028042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-66c3fbd6-301f-4c37-99ea-cc9f52448e7d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:30.037719 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-66c3fbd6-301f-4c37-99ea-cc9f52448e7d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1724 microversion: 2.1 time: 0.171805 Oct 18 14:22:30.038445 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3474/7151] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:29 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:31.066847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5383ab06-e503-47e9-9f15-01231ede5a54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:31.067479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5383ab06-e503-47e9-9f15-01231ede5a54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:31.074394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5383ab06-e503-47e9-9f15-01231ede5a54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:31.074889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5383ab06-e503-47e9-9f15-01231ede5a54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:31.075333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5383ab06-e503-47e9-9f15-01231ede5a54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:31.076682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5383ab06-e503-47e9-9f15-01231ede5a54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:31.077150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5383ab06-e503-47e9-9f15-01231ede5a54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:31.077614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5383ab06-e503-47e9-9f15-01231ede5a54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:31.213827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5383ab06-e503-47e9-9f15-01231ede5a54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:31.222919 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5383ab06-e503-47e9-9f15-01231ede5a54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1724 microversion: 2.1 time: 0.160016 Oct 18 14:22:31.223516 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3678/7152] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:31 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:32.248737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-65d5475c-5b12-4e0b-a95f-1a20f24c2f7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:32.249403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-65d5475c-5b12-4e0b-a95f-1a20f24c2f7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:32.256234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65d5475c-5b12-4e0b-a95f-1a20f24c2f7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:32.256692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65d5475c-5b12-4e0b-a95f-1a20f24c2f7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:32.257121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65d5475c-5b12-4e0b-a95f-1a20f24c2f7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:32.257829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65d5475c-5b12-4e0b-a95f-1a20f24c2f7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:32.258281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65d5475c-5b12-4e0b-a95f-1a20f24c2f7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:32.258697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65d5475c-5b12-4e0b-a95f-1a20f24c2f7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:32.393280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-65d5475c-5b12-4e0b-a95f-1a20f24c2f7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:32.401868 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-65d5475c-5b12-4e0b-a95f-1a20f24c2f7a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1724 microversion: 2.1 time: 0.157700 Oct 18 14:22:32.402460 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3475/7153] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:32 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:33.426536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0879f4ed-8499-4176-95f2-508beeba7f54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:33.427152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0879f4ed-8499-4176-95f2-508beeba7f54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:33.434251 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0879f4ed-8499-4176-95f2-508beeba7f54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:33.434761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0879f4ed-8499-4176-95f2-508beeba7f54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:33.436169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0879f4ed-8499-4176-95f2-508beeba7f54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:33.436702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0879f4ed-8499-4176-95f2-508beeba7f54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:33.437210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0879f4ed-8499-4176-95f2-508beeba7f54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:33.437654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0879f4ed-8499-4176-95f2-508beeba7f54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:33.581092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0879f4ed-8499-4176-95f2-508beeba7f54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:33.590107 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0879f4ed-8499-4176-95f2-508beeba7f54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1724 microversion: 2.1 time: 0.167815 Oct 18 14:22:33.590710 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3679/7154] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:33 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:22:34.614087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4618f240-8d41-4eed-8cdc-89f4cda28cad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:34.614698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4618f240-8d41-4eed-8cdc-89f4cda28cad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:34.621587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4618f240-8d41-4eed-8cdc-89f4cda28cad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:34.622066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4618f240-8d41-4eed-8cdc-89f4cda28cad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:34.622554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4618f240-8d41-4eed-8cdc-89f4cda28cad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:34.623761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4618f240-8d41-4eed-8cdc-89f4cda28cad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:34.624208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4618f240-8d41-4eed-8cdc-89f4cda28cad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:34.624630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4618f240-8d41-4eed-8cdc-89f4cda28cad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:34.767102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4618f240-8d41-4eed-8cdc-89f4cda28cad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:34.775593 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4618f240-8d41-4eed-8cdc-89f4cda28cad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1724 microversion: 2.1 time: 0.165434 Oct 18 14:22:34.776177 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3476/7155] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:34 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:35.802502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3122eb3b-6fa3-4aec-8524-a36198d076c5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:35.803120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3122eb3b-6fa3-4aec-8524-a36198d076c5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:35.810123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3122eb3b-6fa3-4aec-8524-a36198d076c5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:35.810663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3122eb3b-6fa3-4aec-8524-a36198d076c5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:35.811156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3122eb3b-6fa3-4aec-8524-a36198d076c5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:35.811857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3122eb3b-6fa3-4aec-8524-a36198d076c5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:35.812327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3122eb3b-6fa3-4aec-8524-a36198d076c5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:35.812761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3122eb3b-6fa3-4aec-8524-a36198d076c5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:35.949474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3122eb3b-6fa3-4aec-8524-a36198d076c5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:35.958631 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3122eb3b-6fa3-4aec-8524-a36198d076c5 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1724 microversion: 2.1 time: 0.160703 Oct 18 14:22:35.959474 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3680/7156] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:35 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:36.984133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5fd76058-6288-4cbe-baf4-4c170a5c741a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:36.984753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5fd76058-6288-4cbe-baf4-4c170a5c741a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:36.992138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fd76058-6288-4cbe-baf4-4c170a5c741a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:36.992621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fd76058-6288-4cbe-baf4-4c170a5c741a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:36.993058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fd76058-6288-4cbe-baf4-4c170a5c741a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:36.993908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fd76058-6288-4cbe-baf4-4c170a5c741a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:36.994745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fd76058-6288-4cbe-baf4-4c170a5c741a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:36.994942 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fd76058-6288-4cbe-baf4-4c170a5c741a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:37.132338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5fd76058-6288-4cbe-baf4-4c170a5c741a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:37.141476 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5fd76058-6288-4cbe-baf4-4c170a5c741a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1724 microversion: 2.1 time: 0.161969 Oct 18 14:22:37.142364 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3477/7157] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:36 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:38.167036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9b63477d-31ee-4648-8f16-bedf2b0effc7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:38.167740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9b63477d-31ee-4648-8f16-bedf2b0effc7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:38.170682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=33 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:38.176482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b63477d-31ee-4648-8f16-bedf2b0effc7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:38.176977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b63477d-31ee-4648-8f16-bedf2b0effc7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:38.177455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b63477d-31ee-4648-8f16-bedf2b0effc7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:38.178155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b63477d-31ee-4648-8f16-bedf2b0effc7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:38.178619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b63477d-31ee-4648-8f16-bedf2b0effc7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:38.179048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b63477d-31ee-4648-8f16-bedf2b0effc7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:38.181713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:38.320536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b63477d-31ee-4648-8f16-bedf2b0effc7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:38.330101 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9b63477d-31ee-4648-8f16-bedf2b0effc7 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1724 microversion: 2.1 time: 0.166933 Oct 18 14:22:38.330681 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3681/7158] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:38 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:39.355643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5140fd8b-26bb-4158-a2ea-ebfc9bc7309f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:39.356175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5140fd8b-26bb-4158-a2ea-ebfc9bc7309f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:39.359817 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=29 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:39.365448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5140fd8b-26bb-4158-a2ea-ebfc9bc7309f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:39.366270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5140fd8b-26bb-4158-a2ea-ebfc9bc7309f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:39.366738 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5140fd8b-26bb-4158-a2ea-ebfc9bc7309f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:39.367445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5140fd8b-26bb-4158-a2ea-ebfc9bc7309f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:39.367897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5140fd8b-26bb-4158-a2ea-ebfc9bc7309f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:39.368331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5140fd8b-26bb-4158-a2ea-ebfc9bc7309f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:39.371188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=81 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:39.511029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5140fd8b-26bb-4158-a2ea-ebfc9bc7309f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:39.519728 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5140fd8b-26bb-4158-a2ea-ebfc9bc7309f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1724 microversion: 2.1 time: 0.168258 Oct 18 14:22:39.520331 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3478/7159] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:39 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:40.544614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-37d698fb-3335-474a-aced-87ef4cb10c5c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:40.545261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-37d698fb-3335-474a-aced-87ef4cb10c5c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:40.552271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d698fb-3335-474a-aced-87ef4cb10c5c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:40.552767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d698fb-3335-474a-aced-87ef4cb10c5c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:40.553234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d698fb-3335-474a-aced-87ef4cb10c5c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:40.553934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d698fb-3335-474a-aced-87ef4cb10c5c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:40.554398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d698fb-3335-474a-aced-87ef4cb10c5c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:40.554832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d698fb-3335-474a-aced-87ef4cb10c5c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:40.684594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-37d698fb-3335-474a-aced-87ef4cb10c5c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:40.693685 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-37d698fb-3335-474a-aced-87ef4cb10c5c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1721 microversion: 2.1 time: 0.153662 Oct 18 14:22:40.694270 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3682/7160] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:40 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:40.717614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:22:40.718175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:40.725144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:40.725652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:40.726090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:40.726780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:40.727254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:40.727666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:40.764729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:40.765220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:40.765655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:40.766375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:40.766825 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:40.767248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:40.788044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'ram', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:22:40.793257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Getting quotas for user 7dbfce990e5248698b492af6c8b2ba85 and project a42e6c3d6ade4cbeaa5675b7e554af17. Resources: {'ram', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:22:40.893564 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0d9d96eb-f92f-473d-a145-9dfcd545caa1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "POST /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff/action" status: 202 len: 0 microversion: 2.1 time: 0.180288 Oct 18 14:22:40.894474 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3479/7161] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:22:40 2022] POST /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:22:40.902727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b2ebbb86-8f69-42b4-ade0-d1dde789a403 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:40.903450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b2ebbb86-8f69-42b4-ade0-d1dde789a403 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:40.910097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2ebbb86-8f69-42b4-ade0-d1dde789a403 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:40.910297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2ebbb86-8f69-42b4-ade0-d1dde789a403 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:40.910658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2ebbb86-8f69-42b4-ade0-d1dde789a403 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:40.911499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2ebbb86-8f69-42b4-ade0-d1dde789a403 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:40.911954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2ebbb86-8f69-42b4-ade0-d1dde789a403 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:40.912396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b2ebbb86-8f69-42b4-ade0-d1dde789a403 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:41.120190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b2ebbb86-8f69-42b4-ade0-d1dde789a403 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:41.131912 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b2ebbb86-8f69-42b4-ade0-d1dde789a403 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.233098 Oct 18 14:22:41.132708 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3683/7162] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:40 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:42.156373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-65223f9a-afdf-4a3f-9251-1155f77ef593 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:42.157122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-65223f9a-afdf-4a3f-9251-1155f77ef593 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:42.169644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65223f9a-afdf-4a3f-9251-1155f77ef593 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:42.170146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65223f9a-afdf-4a3f-9251-1155f77ef593 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:42.170590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65223f9a-afdf-4a3f-9251-1155f77ef593 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:42.171999 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65223f9a-afdf-4a3f-9251-1155f77ef593 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:42.172520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65223f9a-afdf-4a3f-9251-1155f77ef593 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:42.172950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-65223f9a-afdf-4a3f-9251-1155f77ef593 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:42.309618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-65223f9a-afdf-4a3f-9251-1155f77ef593 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:42.318117 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-65223f9a-afdf-4a3f-9251-1155f77ef593 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.166365 Oct 18 14:22:42.318697 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3480/7163] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:42 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:43.341444 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7167c424-5274-4fff-bd53-c478703b6650 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:43.342118 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7167c424-5274-4fff-bd53-c478703b6650 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:43.349582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7167c424-5274-4fff-bd53-c478703b6650 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:43.350074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7167c424-5274-4fff-bd53-c478703b6650 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:43.350517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7167c424-5274-4fff-bd53-c478703b6650 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:43.351211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7167c424-5274-4fff-bd53-c478703b6650 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:43.351676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7167c424-5274-4fff-bd53-c478703b6650 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:43.352108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7167c424-5274-4fff-bd53-c478703b6650 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:43.506115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7167c424-5274-4fff-bd53-c478703b6650 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:43.516697 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7167c424-5274-4fff-bd53-c478703b6650 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.179111 Oct 18 14:22:43.517366 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3684/7164] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:43 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:43.882864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-3474c057-cdc7-44e6-98c0-3d37305d5842 req-381c6e6e-0ec6-4246-ba53-71d0f40d2247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e3d326-5d79-4532-ac7a-63b62a03f2ff", "name": "network-vif-plugged", "status": "completed", "tag": "10d96dc6-5242-403c-b03a-76d380b8af67"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:22:43.900993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3474c057-cdc7-44e6-98c0-3d37305d5842 req-381c6e6e-0ec6-4246-ba53-71d0f40d2247 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:43.901785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3474c057-cdc7-44e6-98c0-3d37305d5842 req-381c6e6e-0ec6-4246-ba53-71d0f40d2247 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:43.902378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-3474c057-cdc7-44e6-98c0-3d37305d5842 req-381c6e6e-0ec6-4246-ba53-71d0f40d2247 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:43.917955 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-3474c057-cdc7-44e6-98c0-3d37305d5842 req-381c6e6e-0ec6-4246-ba53-71d0f40d2247 service nova] Creating event network-vif-plugged:10d96dc6-5242-403c-b03a-76d380b8af67 for instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff on n-h2-858384-13 Oct 18 14:22:43.926118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-3474c057-cdc7-44e6-98c0-3d37305d5842 req-381c6e6e-0ec6-4246-ba53-71d0f40d2247 service nova] Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:22:43.940118 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-3474c057-cdc7-44e6-98c0-3d37305d5842 req-381c6e6e-0ec6-4246-ba53-71d0f40d2247 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061272 Oct 18 14:22:43.940866 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3481/7165] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:22:44.540505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d6c1539a-6741-4a7f-88c5-85b52299087a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:44.541142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d6c1539a-6741-4a7f-88c5-85b52299087a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:44.549043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6c1539a-6741-4a7f-88c5-85b52299087a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:44.549576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6c1539a-6741-4a7f-88c5-85b52299087a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:44.550032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6c1539a-6741-4a7f-88c5-85b52299087a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:44.550755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6c1539a-6741-4a7f-88c5-85b52299087a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:44.551238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6c1539a-6741-4a7f-88c5-85b52299087a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:44.551683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d6c1539a-6741-4a7f-88c5-85b52299087a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:44.689984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d6c1539a-6741-4a7f-88c5-85b52299087a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:44.698451 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d6c1539a-6741-4a7f-88c5-85b52299087a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.161918 Oct 18 14:22:44.699036 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3685/7166] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:44 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:45.724276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c23918fb-a993-4c81-800a-a3677b188aee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:45.724992 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c23918fb-a993-4c81-800a-a3677b188aee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:45.732771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c23918fb-a993-4c81-800a-a3677b188aee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:45.734064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c23918fb-a993-4c81-800a-a3677b188aee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:45.734598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c23918fb-a993-4c81-800a-a3677b188aee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:45.735377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c23918fb-a993-4c81-800a-a3677b188aee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:45.736053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c23918fb-a993-4c81-800a-a3677b188aee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:45.736688 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c23918fb-a993-4c81-800a-a3677b188aee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:45.892668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c23918fb-a993-4c81-800a-a3677b188aee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:45.903570 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c23918fb-a993-4c81-800a-a3677b188aee tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.183969 Oct 18 14:22:45.904640 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3482/7167] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:45 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:46.351973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-d28caf3f-6fe7-4806-aa60-ba2eb6e7a927 req-15702812-4040-4e21-a26f-ee52bb96312b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e3d326-5d79-4532-ac7a-63b62a03f2ff", "name": "network-vif-unplugged", "status": "completed", "tag": "10d96dc6-5242-403c-b03a-76d380b8af67"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:22:46.362551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d28caf3f-6fe7-4806-aa60-ba2eb6e7a927 req-15702812-4040-4e21-a26f-ee52bb96312b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:46.363052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d28caf3f-6fe7-4806-aa60-ba2eb6e7a927 req-15702812-4040-4e21-a26f-ee52bb96312b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:46.363503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-d28caf3f-6fe7-4806-aa60-ba2eb6e7a927 req-15702812-4040-4e21-a26f-ee52bb96312b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:46.376045 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-d28caf3f-6fe7-4806-aa60-ba2eb6e7a927 req-15702812-4040-4e21-a26f-ee52bb96312b service nova] Creating event network-vif-unplugged:10d96dc6-5242-403c-b03a-76d380b8af67 for instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff on n-h1-858384-13 Oct 18 14:22:46.381661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [req-d28caf3f-6fe7-4806-aa60-ba2eb6e7a927 req-15702812-4040-4e21-a26f-ee52bb96312b service nova] Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:22:46.393310 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-d28caf3f-6fe7-4806-aa60-ba2eb6e7a927 req-15702812-4040-4e21-a26f-ee52bb96312b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045137 Oct 18 14:22:46.393935 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3686/7168] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:22:46.928731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-80fb2ae2-ad68-44c8-99f7-0be51e4576d6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:46.929379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-80fb2ae2-ad68-44c8-99f7-0be51e4576d6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:46.936805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80fb2ae2-ad68-44c8-99f7-0be51e4576d6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:46.937406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80fb2ae2-ad68-44c8-99f7-0be51e4576d6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:46.937875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80fb2ae2-ad68-44c8-99f7-0be51e4576d6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:46.938558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80fb2ae2-ad68-44c8-99f7-0be51e4576d6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:46.939072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80fb2ae2-ad68-44c8-99f7-0be51e4576d6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:46.939505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-80fb2ae2-ad68-44c8-99f7-0be51e4576d6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:47.169154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-80fb2ae2-ad68-44c8-99f7-0be51e4576d6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:47.178346 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-80fb2ae2-ad68-44c8-99f7-0be51e4576d6 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.253495 Oct 18 14:22:47.178946 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3483/7169] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:46 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:48.207567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f9aa6ed2-da25-4b82-b95d-06e9434d752d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:48.208283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f9aa6ed2-da25-4b82-b95d-06e9434d752d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:48.214814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9aa6ed2-da25-4b82-b95d-06e9434d752d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:48.215312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9aa6ed2-da25-4b82-b95d-06e9434d752d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:48.215763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9aa6ed2-da25-4b82-b95d-06e9434d752d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:48.216469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9aa6ed2-da25-4b82-b95d-06e9434d752d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:48.216940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9aa6ed2-da25-4b82-b95d-06e9434d752d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:48.217897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9aa6ed2-da25-4b82-b95d-06e9434d752d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:48.352249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f9aa6ed2-da25-4b82-b95d-06e9434d752d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:48.361475 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f9aa6ed2-da25-4b82-b95d-06e9434d752d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.159148 Oct 18 14:22:48.362062 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3687/7170] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:48 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:48.431871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b81144da-b017-4836-a550-026597a4c0c6 req-22c703d5-a3db-44f7-8121-2afb6a1b3efb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79e3d326-5d79-4532-ac7a-63b62a03f2ff", "tag": "10d96dc6-5242-403c-b03a-76d380b8af67"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:22:48.442517 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b81144da-b017-4836-a550-026597a4c0c6 req-22c703d5-a3db-44f7-8121-2afb6a1b3efb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:48.443000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b81144da-b017-4836-a550-026597a4c0c6 req-22c703d5-a3db-44f7-8121-2afb6a1b3efb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:48.443432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b81144da-b017-4836-a550-026597a4c0c6 req-22c703d5-a3db-44f7-8121-2afb6a1b3efb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:48.456326 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b81144da-b017-4836-a550-026597a4c0c6 req-22c703d5-a3db-44f7-8121-2afb6a1b3efb service nova] Creating event network-changed:10d96dc6-5242-403c-b03a-76d380b8af67 for instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff on n-h1-858384-13 Oct 18 14:22:48.462211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-b81144da-b017-4836-a550-026597a4c0c6 req-22c703d5-a3db-44f7-8121-2afb6a1b3efb service nova] Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:22:48.473835 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b81144da-b017-4836-a550-026597a4c0c6 req-22c703d5-a3db-44f7-8121-2afb6a1b3efb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045529 Oct 18 14:22:48.474454 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3484/7171] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:22:49.385517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3bdc754d-dd3e-4bc5-b3bd-94a3e5a143d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:49.386150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3bdc754d-dd3e-4bc5-b3bd-94a3e5a143d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:49.393916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bdc754d-dd3e-4bc5-b3bd-94a3e5a143d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:49.394418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bdc754d-dd3e-4bc5-b3bd-94a3e5a143d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:49.394874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bdc754d-dd3e-4bc5-b3bd-94a3e5a143d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:49.395584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bdc754d-dd3e-4bc5-b3bd-94a3e5a143d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:49.396056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bdc754d-dd3e-4bc5-b3bd-94a3e5a143d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:49.396500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3bdc754d-dd3e-4bc5-b3bd-94a3e5a143d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:49.530561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3bdc754d-dd3e-4bc5-b3bd-94a3e5a143d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:49.539090 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3bdc754d-dd3e-4bc5-b3bd-94a3e5a143d1 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.157856 Oct 18 14:22:49.539679 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3688/7172] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:49 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:50.564062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-46032462-24e8-4523-b6b5-d7f8a8fd4495 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:50.564916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-46032462-24e8-4523-b6b5-d7f8a8fd4495 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:50.571812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46032462-24e8-4523-b6b5-d7f8a8fd4495 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:50.572323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46032462-24e8-4523-b6b5-d7f8a8fd4495 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:50.572754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46032462-24e8-4523-b6b5-d7f8a8fd4495 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:50.573549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46032462-24e8-4523-b6b5-d7f8a8fd4495 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:50.573997 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46032462-24e8-4523-b6b5-d7f8a8fd4495 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:50.574421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46032462-24e8-4523-b6b5-d7f8a8fd4495 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:50.710515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-46032462-24e8-4523-b6b5-d7f8a8fd4495 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:50.719285 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-46032462-24e8-4523-b6b5-d7f8a8fd4495 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.160371 Oct 18 14:22:50.719883 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3485/7173] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:50 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:51.743159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-484ef0b2-c227-4b25-996f-a4ed3cb7c113 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:51.743713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-484ef0b2-c227-4b25-996f-a4ed3cb7c113 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:51.750864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-484ef0b2-c227-4b25-996f-a4ed3cb7c113 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:51.751372 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-484ef0b2-c227-4b25-996f-a4ed3cb7c113 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:51.751826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-484ef0b2-c227-4b25-996f-a4ed3cb7c113 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:51.752537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-484ef0b2-c227-4b25-996f-a4ed3cb7c113 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:51.753014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-484ef0b2-c227-4b25-996f-a4ed3cb7c113 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:51.753482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-484ef0b2-c227-4b25-996f-a4ed3cb7c113 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:51.898137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-484ef0b2-c227-4b25-996f-a4ed3cb7c113 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:51.909595 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-484ef0b2-c227-4b25-996f-a4ed3cb7c113 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.170385 Oct 18 14:22:51.910195 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3689/7174] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:51 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:52.935371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-21afb795-626e-41d1-b758-b98018d4b53c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:52.938414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-21afb795-626e-41d1-b758-b98018d4b53c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:52.938529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:22:52.945321 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21afb795-626e-41d1-b758-b98018d4b53c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:52.945808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21afb795-626e-41d1-b758-b98018d4b53c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:52.946240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21afb795-626e-41d1-b758-b98018d4b53c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:52.947548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21afb795-626e-41d1-b758-b98018d4b53c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:52.947548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21afb795-626e-41d1-b758-b98018d4b53c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:52.947772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-21afb795-626e-41d1-b758-b98018d4b53c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:53.092851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-21afb795-626e-41d1-b758-b98018d4b53c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:53.101634 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-21afb795-626e-41d1-b758-b98018d4b53c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.170297 Oct 18 14:22:53.102236 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3486/7175] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:52 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:54.128743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2b903fc2-a5f7-4bbd-a9b3-63e4db1dee54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:54.129412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2b903fc2-a5f7-4bbd-a9b3-63e4db1dee54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:54.136453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b903fc2-a5f7-4bbd-a9b3-63e4db1dee54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:54.136959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b903fc2-a5f7-4bbd-a9b3-63e4db1dee54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:54.137467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b903fc2-a5f7-4bbd-a9b3-63e4db1dee54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:54.138201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b903fc2-a5f7-4bbd-a9b3-63e4db1dee54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:54.138713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b903fc2-a5f7-4bbd-a9b3-63e4db1dee54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:54.139747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2b903fc2-a5f7-4bbd-a9b3-63e4db1dee54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:54.273191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2b903fc2-a5f7-4bbd-a9b3-63e4db1dee54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:54.282291 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2b903fc2-a5f7-4bbd-a9b3-63e4db1dee54 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.157666 Oct 18 14:22:54.282881 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3690/7176] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:54 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:55.306232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5e78ae5e-daac-47ed-8739-3b42f6fdb07b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:55.306918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5e78ae5e-daac-47ed-8739-3b42f6fdb07b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:55.314360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e78ae5e-daac-47ed-8739-3b42f6fdb07b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:55.314841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e78ae5e-daac-47ed-8739-3b42f6fdb07b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:55.315279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e78ae5e-daac-47ed-8739-3b42f6fdb07b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:55.315970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e78ae5e-daac-47ed-8739-3b42f6fdb07b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:55.316427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e78ae5e-daac-47ed-8739-3b42f6fdb07b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:55.316854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5e78ae5e-daac-47ed-8739-3b42f6fdb07b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:55.454909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5e78ae5e-daac-47ed-8739-3b42f6fdb07b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:55.463511 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5e78ae5e-daac-47ed-8739-3b42f6fdb07b tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.161194 Oct 18 14:22:55.464102 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3487/7177] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:55 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:56.489275 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c16dc620-dda5-48f2-9651-a10243ff47c8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:56.489822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c16dc620-dda5-48f2-9651-a10243ff47c8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:56.496264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c16dc620-dda5-48f2-9651-a10243ff47c8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:56.496758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c16dc620-dda5-48f2-9651-a10243ff47c8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:56.497226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c16dc620-dda5-48f2-9651-a10243ff47c8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:56.497925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c16dc620-dda5-48f2-9651-a10243ff47c8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:56.498965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c16dc620-dda5-48f2-9651-a10243ff47c8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:56.499486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c16dc620-dda5-48f2-9651-a10243ff47c8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:56.633903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c16dc620-dda5-48f2-9651-a10243ff47c8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:56.641273 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c16dc620-dda5-48f2-9651-a10243ff47c8 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.156126 Oct 18 14:22:56.641868 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3691/7178] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:56 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:57.665199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8c896589-6347-4d6a-95a7-38b6149f0e8f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:57.665851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8c896589-6347-4d6a-95a7-38b6149f0e8f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:57.673916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c896589-6347-4d6a-95a7-38b6149f0e8f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:57.674402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c896589-6347-4d6a-95a7-38b6149f0e8f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:57.674836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c896589-6347-4d6a-95a7-38b6149f0e8f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:57.675528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c896589-6347-4d6a-95a7-38b6149f0e8f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:57.675986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c896589-6347-4d6a-95a7-38b6149f0e8f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:57.676400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c896589-6347-4d6a-95a7-38b6149f0e8f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:57.811277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8c896589-6347-4d6a-95a7-38b6149f0e8f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:57.820646 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8c896589-6347-4d6a-95a7-38b6149f0e8f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.159309 Oct 18 14:22:57.821164 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3488/7179] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:57 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:22:58.846308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-adb378ff-4b03-49c4-9711-46f83558ffa4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:22:58.846964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-adb378ff-4b03-49c4-9711-46f83558ffa4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:22:58.857366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adb378ff-4b03-49c4-9711-46f83558ffa4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:58.857885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adb378ff-4b03-49c4-9711-46f83558ffa4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:58.858674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adb378ff-4b03-49c4-9711-46f83558ffa4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:58.859680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adb378ff-4b03-49c4-9711-46f83558ffa4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:22:58.860568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adb378ff-4b03-49c4-9711-46f83558ffa4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:22:58.861085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adb378ff-4b03-49c4-9711-46f83558ffa4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:22:59.014824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-adb378ff-4b03-49c4-9711-46f83558ffa4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:22:59.024078 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-adb378ff-4b03-49c4-9711-46f83558ffa4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.183597 Oct 18 14:22:59.024681 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3692/7180] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:22:58 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:00.049309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7ffdd4c8-fef5-45b7-b36b-076d0d261713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:00.049926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7ffdd4c8-fef5-45b7-b36b-076d0d261713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:00.057307 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ffdd4c8-fef5-45b7-b36b-076d0d261713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:00.057788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ffdd4c8-fef5-45b7-b36b-076d0d261713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:00.058220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ffdd4c8-fef5-45b7-b36b-076d0d261713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:00.059074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ffdd4c8-fef5-45b7-b36b-076d0d261713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:00.059505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ffdd4c8-fef5-45b7-b36b-076d0d261713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:00.059927 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7ffdd4c8-fef5-45b7-b36b-076d0d261713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:00.198008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7ffdd4c8-fef5-45b7-b36b-076d0d261713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:00.208814 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7ffdd4c8-fef5-45b7-b36b-076d0d261713 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1720 microversion: 2.1 time: 0.164033 Oct 18 14:23:00.209714 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3489/7181] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:00 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:01.233511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-28602ad4-54ca-467a-8e0f-4b27ba6408f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:01.234227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-28602ad4-54ca-467a-8e0f-4b27ba6408f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:01.241204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28602ad4-54ca-467a-8e0f-4b27ba6408f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:01.241725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28602ad4-54ca-467a-8e0f-4b27ba6408f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:01.242182 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28602ad4-54ca-467a-8e0f-4b27ba6408f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:01.242893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28602ad4-54ca-467a-8e0f-4b27ba6408f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:01.243365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28602ad4-54ca-467a-8e0f-4b27ba6408f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:01.243809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-28602ad4-54ca-467a-8e0f-4b27ba6408f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:01.377475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-28602ad4-54ca-467a-8e0f-4b27ba6408f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:01.385842 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-28602ad4-54ca-467a-8e0f-4b27ba6408f4 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1713 microversion: 2.1 time: 0.156411 Oct 18 14:23:01.386428 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3693/7182] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:01 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1713 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:23:01.411409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a2f158e9-44f5-4045-8661-620901226e40 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:01.412026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a2f158e9-44f5-4045-8661-620901226e40 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:01.419232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f158e9-44f5-4045-8661-620901226e40 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:01.419726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f158e9-44f5-4045-8661-620901226e40 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:01.420166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f158e9-44f5-4045-8661-620901226e40 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:01.420877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f158e9-44f5-4045-8661-620901226e40 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:01.421456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f158e9-44f5-4045-8661-620901226e40 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:01.422441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a2f158e9-44f5-4045-8661-620901226e40 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:01.561872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a2f158e9-44f5-4045-8661-620901226e40 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:01.570433 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a2f158e9-44f5-4045-8661-620901226e40 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1713 microversion: 2.1 time: 0.162934 Oct 18 14:23:01.571011 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3490/7183] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:01 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1713 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:01.594242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d0c85307-c3cc-4ddc-9321-3a43a08c6d2f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:01.595070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d0c85307-c3cc-4ddc-9321-3a43a08c6d2f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:01.601242 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0c85307-c3cc-4ddc-9321-3a43a08c6d2f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:01.601738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0c85307-c3cc-4ddc-9321-3a43a08c6d2f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:01.602190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0c85307-c3cc-4ddc-9321-3a43a08c6d2f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:01.602895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0c85307-c3cc-4ddc-9321-3a43a08c6d2f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:01.603359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0c85307-c3cc-4ddc-9321-3a43a08c6d2f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:01.603793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d0c85307-c3cc-4ddc-9321-3a43a08c6d2f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:01.735708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d0c85307-c3cc-4ddc-9321-3a43a08c6d2f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:01.744023 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d0c85307-c3cc-4ddc-9321-3a43a08c6d2f tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1713 microversion: 2.1 time: 0.154448 Oct 18 14:23:01.744591 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3694/7184] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:01 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:01.766205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d3d04fa5-2c70-4b9d-99b5-f2cbf59dec38 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:01.766811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d3d04fa5-2c70-4b9d-99b5-f2cbf59dec38 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:01.773056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3d04fa5-2c70-4b9d-99b5-f2cbf59dec38 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:01.773593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3d04fa5-2c70-4b9d-99b5-f2cbf59dec38 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:01.774028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3d04fa5-2c70-4b9d-99b5-f2cbf59dec38 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:01.774719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3d04fa5-2c70-4b9d-99b5-f2cbf59dec38 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:01.775432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3d04fa5-2c70-4b9d-99b5-f2cbf59dec38 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:01.775691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d3d04fa5-2c70-4b9d-99b5-f2cbf59dec38 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:01.803257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d3d04fa5-2c70-4b9d-99b5-f2cbf59dec38 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:23:01.827436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:01.882641 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d3d04fa5-2c70-4b9d-99b5-f2cbf59dec38 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "DELETE /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 204 len: 0 microversion: 2.1 time: 0.120153 Oct 18 14:23:01.883243 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3491/7185] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:23:01 2022] DELETE /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:23:01.892142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-979e7ad7-fdee-47f4-bd81-8e34436c863a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:01.892495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-979e7ad7-fdee-47f4-bd81-8e34436c863a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:01.899495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-979e7ad7-fdee-47f4-bd81-8e34436c863a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:01.900068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-979e7ad7-fdee-47f4-bd81-8e34436c863a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:01.900527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-979e7ad7-fdee-47f4-bd81-8e34436c863a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:01.901284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-979e7ad7-fdee-47f4-bd81-8e34436c863a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:01.901760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-979e7ad7-fdee-47f4-bd81-8e34436c863a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:01.902203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-979e7ad7-fdee-47f4-bd81-8e34436c863a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:02.040201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-979e7ad7-fdee-47f4-bd81-8e34436c863a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:02.048596 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-979e7ad7-fdee-47f4-bd81-8e34436c863a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1719 microversion: 2.1 time: 0.161093 Oct 18 14:23:02.049213 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3695/7186] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:01 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:03.052372 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-de78d323-2415-4695-a1f8-a958ea9c051c req-38acc05b-7213-4b33-b280-080cfc40d349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e3d326-5d79-4532-ac7a-63b62a03f2ff", "name": "network-vif-plugged", "status": "completed", "tag": "10d96dc6-5242-403c-b03a-76d380b8af67"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:03.064486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-de78d323-2415-4695-a1f8-a958ea9c051c req-38acc05b-7213-4b33-b280-080cfc40d349 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:03.064967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-de78d323-2415-4695-a1f8-a958ea9c051c req-38acc05b-7213-4b33-b280-080cfc40d349 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:03.065925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-de78d323-2415-4695-a1f8-a958ea9c051c req-38acc05b-7213-4b33-b280-080cfc40d349 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:03.076382 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-de78d323-2415-4695-a1f8-a958ea9c051c req-38acc05b-7213-4b33-b280-080cfc40d349 service nova] Creating event network-vif-plugged:10d96dc6-5242-403c-b03a-76d380b8af67 for instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff on n-h1-858384-13 Oct 18 14:23:03.082057 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-de78d323-2415-4695-a1f8-a958ea9c051c req-38acc05b-7213-4b33-b280-080cfc40d349 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033830 Oct 18 14:23:03.083009 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3492/7187] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:03.128067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d459c037-3556-4522-bd8f-aab58f431133 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:03.128707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d459c037-3556-4522-bd8f-aab58f431133 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:03.135794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d459c037-3556-4522-bd8f-aab58f431133 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:03.136243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d459c037-3556-4522-bd8f-aab58f431133 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:03.136697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d459c037-3556-4522-bd8f-aab58f431133 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:03.137454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d459c037-3556-4522-bd8f-aab58f431133 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:03.137934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d459c037-3556-4522-bd8f-aab58f431133 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:03.138376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d459c037-3556-4522-bd8f-aab58f431133 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:03.272048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d459c037-3556-4522-bd8f-aab58f431133 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:03.280480 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d459c037-3556-4522-bd8f-aab58f431133 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1719 microversion: 2.1 time: 0.156382 Oct 18 14:23:03.282014 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3696/7188] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:03 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:04.306593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-59a75d05-a69c-470d-8b10-2abb48e9c022 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:04.307305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-59a75d05-a69c-470d-8b10-2abb48e9c022 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:04.314316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59a75d05-a69c-470d-8b10-2abb48e9c022 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:04.314807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59a75d05-a69c-470d-8b10-2abb48e9c022 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:04.315278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59a75d05-a69c-470d-8b10-2abb48e9c022 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:04.316001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59a75d05-a69c-470d-8b10-2abb48e9c022 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:04.316427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59a75d05-a69c-470d-8b10-2abb48e9c022 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:04.316902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59a75d05-a69c-470d-8b10-2abb48e9c022 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:04.510816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-59a75d05-a69c-470d-8b10-2abb48e9c022 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:04.520238 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-59a75d05-a69c-470d-8b10-2abb48e9c022 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1719 microversion: 2.1 time: 0.218739 Oct 18 14:23:04.520834 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3493/7189] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:04 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1719 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:04.856614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-70492433-59bc-423e-87b9-90b83b53a496 req-a283859e-dc27-4df9-8988-b1ba9d785443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79e3d326-5d79-4532-ac7a-63b62a03f2ff", "name": "network-vif-deleted", "tag": "10d96dc6-5242-403c-b03a-76d380b8af67"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:04.876687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-70492433-59bc-423e-87b9-90b83b53a496 req-a283859e-dc27-4df9-8988-b1ba9d785443 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:04.877912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-70492433-59bc-423e-87b9-90b83b53a496 req-a283859e-dc27-4df9-8988-b1ba9d785443 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:04.878636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-70492433-59bc-423e-87b9-90b83b53a496 req-a283859e-dc27-4df9-8988-b1ba9d785443 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:04.894610 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-70492433-59bc-423e-87b9-90b83b53a496 req-a283859e-dc27-4df9-8988-b1ba9d785443 service nova] Creating event network-vif-deleted:10d96dc6-5242-403c-b03a-76d380b8af67 for instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff on n-h1-858384-13 Oct 18 14:23:04.903138 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-70492433-59bc-423e-87b9-90b83b53a496 req-a283859e-dc27-4df9-8988-b1ba9d785443 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053742 Oct 18 14:23:04.904421 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3697/7190] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:23:05.544172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d7b62150-bf73-4b73-95cd-441c968a5c28 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:05.545606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d7b62150-bf73-4b73-95cd-441c968a5c28 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:05.553396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7b62150-bf73-4b73-95cd-441c968a5c28 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:05.553987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7b62150-bf73-4b73-95cd-441c968a5c28 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:05.554500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7b62150-bf73-4b73-95cd-441c968a5c28 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:05.555278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7b62150-bf73-4b73-95cd-441c968a5c28 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:05.555807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7b62150-bf73-4b73-95cd-441c968a5c28 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:05.556313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7b62150-bf73-4b73-95cd-441c968a5c28 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:05.625945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d7b62150-bf73-4b73-95cd-441c968a5c28 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:05.635260 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d7b62150-bf73-4b73-95cd-441c968a5c28 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1368 microversion: 2.1 time: 0.095080 Oct 18 14:23:05.636230 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3494/7191] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:05 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:06.661154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-edcdb5f4-b34b-4f14-a97b-45b82fbb8a96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:06.661920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-edcdb5f4-b34b-4f14-a97b-45b82fbb8a96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:06.669546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edcdb5f4-b34b-4f14-a97b-45b82fbb8a96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:06.670044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edcdb5f4-b34b-4f14-a97b-45b82fbb8a96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:06.670488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edcdb5f4-b34b-4f14-a97b-45b82fbb8a96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:06.671204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edcdb5f4-b34b-4f14-a97b-45b82fbb8a96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:06.671715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edcdb5f4-b34b-4f14-a97b-45b82fbb8a96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:06.672153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-edcdb5f4-b34b-4f14-a97b-45b82fbb8a96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:06.740377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-edcdb5f4-b34b-4f14-a97b-45b82fbb8a96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:06.742707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:06.750485 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-edcdb5f4-b34b-4f14-a97b-45b82fbb8a96 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1368 microversion: 2.1 time: 0.094209 Oct 18 14:23:06.751081 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3698/7192] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:06 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:07.776358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4b58c6c9-28a3-4e55-bbd8-ba5158121aaa tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:07.776358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4b58c6c9-28a3-4e55-bbd8-ba5158121aaa tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:07.782318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b58c6c9-28a3-4e55-bbd8-ba5158121aaa tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:07.782805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b58c6c9-28a3-4e55-bbd8-ba5158121aaa tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:07.783243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b58c6c9-28a3-4e55-bbd8-ba5158121aaa tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:07.783948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b58c6c9-28a3-4e55-bbd8-ba5158121aaa tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:07.784396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b58c6c9-28a3-4e55-bbd8-ba5158121aaa tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:07.784818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4b58c6c9-28a3-4e55-bbd8-ba5158121aaa tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:07.856439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4b58c6c9-28a3-4e55-bbd8-ba5158121aaa tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:07.865846 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4b58c6c9-28a3-4e55-bbd8-ba5158121aaa tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1368 microversion: 2.1 time: 0.095433 Oct 18 14:23:07.866433 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3495/7193] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:07 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:08.889607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2386c6dc-5022-411f-95bd-126d6be74690 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:08.890767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2386c6dc-5022-411f-95bd-126d6be74690 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:08.894218 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=36 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:08.901546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2386c6dc-5022-411f-95bd-126d6be74690 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:08.902085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2386c6dc-5022-411f-95bd-126d6be74690 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:08.902553 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2386c6dc-5022-411f-95bd-126d6be74690 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:08.903313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2386c6dc-5022-411f-95bd-126d6be74690 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:08.903796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2386c6dc-5022-411f-95bd-126d6be74690 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:08.904249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2386c6dc-5022-411f-95bd-126d6be74690 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:08.981103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2386c6dc-5022-411f-95bd-126d6be74690 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbfce990e5248698b492af6c8b2ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42e6c3d6ade4cbeaa5675b7e554af17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:08.990471 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2386c6dc-5022-411f-95bd-126d6be74690 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 200 len: 1368 microversion: 2.1 time: 0.104765 Oct 18 14:23:09.005226 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3699/7194] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:08 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:10.014891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b42c018a-e0b4-4fa4-a033-9c8366337522 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:10.015799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b42c018a-e0b4-4fa4-a033-9c8366337522 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:10.018486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:10.023912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b42c018a-e0b4-4fa4-a033-9c8366337522 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:10.024392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b42c018a-e0b4-4fa4-a033-9c8366337522 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:10.024829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b42c018a-e0b4-4fa4-a033-9c8366337522 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:10.025551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b42c018a-e0b4-4fa4-a033-9c8366337522 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:10.026002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b42c018a-e0b4-4fa4-a033-9c8366337522 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:10.026429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b42c018a-e0b4-4fa4-a033-9c8366337522 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:10.041024 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-b42c018a-e0b4-4fa4-a033-9c8366337522 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b42c018a-e0b4-4fa4-a033-9c8366337522 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff HTTP/1.1 Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '79e3d326-5d79-4532-ac7a-63b62a03f2ff'} Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:10.042676 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:10.048368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:10.048368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:10.048368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:10.048368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:10.048368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:10.048368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:10.048368 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:10.048368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b42c018a-e0b4-4fa4-a033-9c8366337522 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:10.048368 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b42c018a-e0b4-4fa4-a033-9c8366337522 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 404 len: 111 microversion: 2.1 time: 0.033141 Oct 18 14:23:10.048368 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3496/7195] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:10 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:10.107282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-783a107b-b362-43b4-870f-004876f06548 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:10.110193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-783a107b-b362-43b4-870f-004876f06548 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:10.117035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-783a107b-b362-43b4-870f-004876f06548 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:10.117563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-783a107b-b362-43b4-870f-004876f06548 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:10.118010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-783a107b-b362-43b4-870f-004876f06548 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:10.118714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-783a107b-b362-43b4-870f-004876f06548 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:10.119181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-783a107b-b362-43b4-870f-004876f06548 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:10.119616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-783a107b-b362-43b4-870f-004876f06548 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:10.132565 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-783a107b-b362-43b4-870f-004876f06548 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-783a107b-b362-43b4-870f-004876f06548 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff/os-volume_attachments HTTP/1.1 Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'server_id': '79e3d326-5d79-4532-ac7a-63b62a03f2ff'} Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:10.134267 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-783a107b-b362-43b4-870f-004876f06548 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-783a107b-b362-43b4-870f-004876f06548 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032581 Oct 18 14:23:10.138441 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3700/7196] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:23:10 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:13.471665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-59525cad-d01d-460b-8b10-83b291d9e25d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:13.472170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-59525cad-d01d-460b-8b10-83b291d9e25d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:13.479649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59525cad-d01d-460b-8b10-83b291d9e25d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.480125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59525cad-d01d-460b-8b10-83b291d9e25d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.480556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59525cad-d01d-460b-8b10-83b291d9e25d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.481290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59525cad-d01d-460b-8b10-83b291d9e25d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.481737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59525cad-d01d-460b-8b10-83b291d9e25d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.482157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59525cad-d01d-460b-8b10-83b291d9e25d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.496225 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-59525cad-d01d-460b-8b10-83b291d9e25d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-59525cad-d01d-460b-8b10-83b291d9e25d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff HTTP/1.1 Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '79e3d326-5d79-4532-ac7a-63b62a03f2ff'} Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:13.497811 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-59525cad-d01d-460b-8b10-83b291d9e25d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-59525cad-d01d-460b-8b10-83b291d9e25d tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "DELETE /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 404 len: 111 microversion: 2.1 time: 0.031696 Oct 18 14:23:13.502955 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3497/7197] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:23:13 2022] DELETE /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:13.508383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e22b7cbb-e1e3-4ca8-8816-b93c0fa5b6ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:13.509008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e22b7cbb-e1e3-4ca8-8816-b93c0fa5b6ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 79e3d326-5d79-4532-ac7a-63b62a03f2ff] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:13.516198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e22b7cbb-e1e3-4ca8-8816-b93c0fa5b6ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.516687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e22b7cbb-e1e3-4ca8-8816-b93c0fa5b6ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.517136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e22b7cbb-e1e3-4ca8-8816-b93c0fa5b6ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.517859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e22b7cbb-e1e3-4ca8-8816-b93c0fa5b6ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.518323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e22b7cbb-e1e3-4ca8-8816-b93c0fa5b6ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.518757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e22b7cbb-e1e3-4ca8-8816-b93c0fa5b6ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.533382 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-e22b7cbb-e1e3-4ca8-8816-b93c0fa5b6ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e22b7cbb-e1e3-4ca8-8816-b93c0fa5b6ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff HTTP/1.1 Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '79e3d326-5d79-4532-ac7a-63b62a03f2ff'} Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.534966 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.539745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.539745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.539745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.539745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:13.539745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:13.539745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. Oct 18 14:23:13.539745 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.539745 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e22b7cbb-e1e3-4ca8-8816-b93c0fa5b6ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 79e3d326-5d79-4532-ac7a-63b62a03f2ff could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:13.539745 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e22b7cbb-e1e3-4ca8-8816-b93c0fa5b6ad tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff" status: 404 len: 111 microversion: 2.1 time: 0.031938 Oct 18 14:23:13.539745 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3701/7198] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:13 2022] GET /compute/v2.1/servers/79e3d326-5d79-4532-ac7a-63b62a03f2ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:13.545320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0f1d2ed-e896-45e2-ad0e-38c7e87b3ef2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:13.545815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e0f1d2ed-e896-45e2-ad0e-38c7e87b3ef2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:13.553522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f1d2ed-e896-45e2-ad0e-38c7e87b3ef2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.554014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f1d2ed-e896-45e2-ad0e-38c7e87b3ef2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.554446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f1d2ed-e896-45e2-ad0e-38c7e87b3ef2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.555157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f1d2ed-e896-45e2-ad0e-38c7e87b3ef2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.555605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f1d2ed-e896-45e2-ad0e-38c7e87b3ef2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.556030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e0f1d2ed-e896-45e2-ad0e-38c7e87b3ef2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.571777 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e0f1d2ed-e896-45e2-ad0e-38c7e87b3ef2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0f1d2ed-e896-45e2-ad0e-38c7e87b3ef2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b HTTP/1.1 Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '87d82844-ffbc-43d2-b221-24a5d4d9a32b'} Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:13.573405 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e0f1d2ed-e896-45e2-ad0e-38c7e87b3ef2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e0f1d2ed-e896-45e2-ad0e-38c7e87b3ef2 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "DELETE /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 404 len: 111 microversion: 2.1 time: 0.033670 Oct 18 14:23:13.577915 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3498/7199] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:23:13 2022] DELETE /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:13.584793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c3c9ebe6-f47f-49ad-a7cc-99f40cd13b97 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:13.585449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c3c9ebe6-f47f-49ad-a7cc-99f40cd13b97 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 87d82844-ffbc-43d2-b221-24a5d4d9a32b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:13.591825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3c9ebe6-f47f-49ad-a7cc-99f40cd13b97 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.592324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3c9ebe6-f47f-49ad-a7cc-99f40cd13b97 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.592983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3c9ebe6-f47f-49ad-a7cc-99f40cd13b97 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.593939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3c9ebe6-f47f-49ad-a7cc-99f40cd13b97 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.594401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3c9ebe6-f47f-49ad-a7cc-99f40cd13b97 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.595264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c3c9ebe6-f47f-49ad-a7cc-99f40cd13b97 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.611698 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-c3c9ebe6-f47f-49ad-a7cc-99f40cd13b97 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c3c9ebe6-f47f-49ad-a7cc-99f40cd13b97 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b HTTP/1.1 Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '87d82844-ffbc-43d2-b221-24a5d4d9a32b'} Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.613296 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.617339 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.617339 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.617339 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.617339 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:13.617339 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:13.617339 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. Oct 18 14:23:13.617339 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.617339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c3c9ebe6-f47f-49ad-a7cc-99f40cd13b97 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 87d82844-ffbc-43d2-b221-24a5d4d9a32b could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:13.617339 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c3c9ebe6-f47f-49ad-a7cc-99f40cd13b97 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b" status: 404 len: 111 microversion: 2.1 time: 0.034203 Oct 18 14:23:13.617339 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3702/7200] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:13 2022] GET /compute/v2.1/servers/87d82844-ffbc-43d2-b221-24a5d4d9a32b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:13.623846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-93235bc8-2207-4454-8c78-a3565ca146ae tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:13.625597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-93235bc8-2207-4454-8c78-a3565ca146ae tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:13.631287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93235bc8-2207-4454-8c78-a3565ca146ae tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.631764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93235bc8-2207-4454-8c78-a3565ca146ae tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.632196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93235bc8-2207-4454-8c78-a3565ca146ae tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.632881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93235bc8-2207-4454-8c78-a3565ca146ae tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.633406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93235bc8-2207-4454-8c78-a3565ca146ae tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.633828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-93235bc8-2207-4454-8c78-a3565ca146ae tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.648902 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-93235bc8-2207-4454-8c78-a3565ca146ae tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-93235bc8-2207-4454-8c78-a3565ca146ae tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 HTTP/1.1 Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '98f9bcf1-9eb7-495b-9b9a-8a147d1428b0'} Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:13.650514 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-93235bc8-2207-4454-8c78-a3565ca146ae tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-93235bc8-2207-4454-8c78-a3565ca146ae tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "DELETE /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 404 len: 111 microversion: 2.1 time: 0.031991 Oct 18 14:23:13.654530 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3499/7201] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:23:13 2022] DELETE /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:13.661673 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4f9d4d1-3ac3-4578-91ce-516a97ad5551 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:13.662438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e4f9d4d1-3ac3-4578-91ce-516a97ad5551 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:13.668571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4f9d4d1-3ac3-4578-91ce-516a97ad5551 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.669141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4f9d4d1-3ac3-4578-91ce-516a97ad5551 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.669717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4f9d4d1-3ac3-4578-91ce-516a97ad5551 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.670507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4f9d4d1-3ac3-4578-91ce-516a97ad5551 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.671205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4f9d4d1-3ac3-4578-91ce-516a97ad5551 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.672022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e4f9d4d1-3ac3-4578-91ce-516a97ad5551 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.686177 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-e4f9d4d1-3ac3-4578-91ce-516a97ad5551 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4f9d4d1-3ac3-4578-91ce-516a97ad5551 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 HTTP/1.1 Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '98f9bcf1-9eb7-495b-9b9a-8a147d1428b0'} Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.688768 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.692913 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.692913 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.692913 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.692913 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:13.692913 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:13.692913 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. Oct 18 14:23:13.692913 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.692913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e4f9d4d1-3ac3-4578-91ce-516a97ad5551 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:13.692913 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e4f9d4d1-3ac3-4578-91ce-516a97ad5551 tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0" status: 404 len: 111 microversion: 2.1 time: 0.032678 Oct 18 14:23:13.692913 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3703/7202] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:13 2022] GET /compute/v2.1/servers/98f9bcf1-9eb7-495b-9b9a-8a147d1428b0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:13.699358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f5eb950e-58ac-4de1-908f-9bdb53f1f34c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:13.700059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f5eb950e-58ac-4de1-908f-9bdb53f1f34c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:13.707712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5eb950e-58ac-4de1-908f-9bdb53f1f34c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.708198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5eb950e-58ac-4de1-908f-9bdb53f1f34c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.709550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5eb950e-58ac-4de1-908f-9bdb53f1f34c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.710412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5eb950e-58ac-4de1-908f-9bdb53f1f34c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.710863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5eb950e-58ac-4de1-908f-9bdb53f1f34c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.711317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f5eb950e-58ac-4de1-908f-9bdb53f1f34c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.726354 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-f5eb950e-58ac-4de1-908f-9bdb53f1f34c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f5eb950e-58ac-4de1-908f-9bdb53f1f34c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb HTTP/1.1 Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '471c1d54-bf27-4920-b629-022cb57259cb'} Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:13.727892 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f5eb950e-58ac-4de1-908f-9bdb53f1f34c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f5eb950e-58ac-4de1-908f-9bdb53f1f34c tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "DELETE /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 404 len: 111 microversion: 2.1 time: 0.034290 Oct 18 14:23:13.731853 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3500/7203] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:23:13 2022] DELETE /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:13.739070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2f6ab588-9690-441f-9ef6-6dd757bc01cb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:13.739704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2f6ab588-9690-441f-9ef6-6dd757bc01cb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] [instance: 471c1d54-bf27-4920-b629-022cb57259cb] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:13.745866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f6ab588-9690-441f-9ef6-6dd757bc01cb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.746366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f6ab588-9690-441f-9ef6-6dd757bc01cb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.746820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f6ab588-9690-441f-9ef6-6dd757bc01cb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.747562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f6ab588-9690-441f-9ef6-6dd757bc01cb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:13.748033 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f6ab588-9690-441f-9ef6-6dd757bc01cb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:13.748471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f6ab588-9690-441f-9ef6-6dd757bc01cb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:13.762820 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-2f6ab588-9690-441f-9ef6-6dd757bc01cb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] HTTP exception thrown: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2f6ab588-9690-441f-9ef6-6dd757bc01cb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Request method failure captured: Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb HTTP/1.1 Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrT08js6ljkpjCBN-dr6j_KjmSxFTZCCd4g6pN6b9faIMAWlyW1-8qZSUaaxCCrDl6xpgE58n11gphmumG4aQhbew92RuQ29VG4NE53admGJv1IYc6Byl2Xq2Zvh1VqVIPa8KNW_EkwRlgcVMcY35s_c-bNs_X25miXh5KSGogR9hIs Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a42e6c3d6ade4cbeaa5675b7e554af17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a42e6c3d6ade4cbeaa5675b7e554af17"}]}] Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: a42e6c3d6ade4cbeaa5675b7e554af17 Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServerActionsTestJSON-1112211997 Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 7dbfce990e5248698b492af6c8b2ba85 Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServerActionsTestJSON-1112211997-project Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '471c1d54-bf27-4920-b629-022cb57259cb'} Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:13.764437 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.770176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:13.770176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:13.770176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:13.770176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:13.770176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:13.770176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. Oct 18 14:23:13.770176 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:13.770176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2f6ab588-9690-441f-9ef6-6dd757bc01cb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Returning 404 to user: Instance 471c1d54-bf27-4920-b629-022cb57259cb could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:13.770176 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2f6ab588-9690-441f-9ef6-6dd757bc01cb tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb" status: 404 len: 111 microversion: 2.1 time: 0.031430 Oct 18 14:23:13.770176 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3704/7204] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:13 2022] GET /compute/v2.1/servers/471c1d54-bf27-4920-b629-022cb57259cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:13.775035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2bd98b67-3042-4504-9129-7338c5b00f5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] Calling method '.version_select at 0x7ff60f80ae50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:13.801924 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2bd98b67-3042-4504-9129-7338c5b00f5a tempest-ServerActionsTestJSON-1112211997 tempest-ServerActionsTestJSON-1112211997-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-356831020" status: 202 len: 0 microversion: 2.1 time: 0.030740 Oct 18 14:23:13.802515 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3501/7205] 10.222.0.40 () {58 vars in 1218 bytes} [Tue Oct 18 14:23:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-356831020 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:23:23.743536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1683837034", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "eb247703-66ab-4cfa-b557-4530d802372c"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:23.752820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=11 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:23.753700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=17 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:23.810612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] validate_networks() for [('eb247703-66ab-4cfa-b557-4530d802372c', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:23:24.289939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:23:24.290403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:23:24.290916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:23:24.291939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:23:24.292381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:23:24.302975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:24.303482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:24.303937 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:24.304811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:24.305395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:24.305905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:24.328998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Getting quotas for project 37f8136931b54b60ac1e1ad11de19b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:23:24.334997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Getting quotas for user 68a781140eda4307a7846031a50b1fef and project 37f8136931b54b60ac1e1ad11de19b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:23:24.348963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:23:24.351352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:23:24.401688 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a9d66705-19f0-4281-910f-5380d1900102 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788746 Oct 18 14:23:24.402347 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3705/7206] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:23:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:23:24.411790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:24.413139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:24.418353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cad23f88-1cff-4e8b-86ed-7322e7935ffe tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:24.418982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cad23f88-1cff-4e8b-86ed-7322e7935ffe tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:24.494137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cad23f88-1cff-4e8b-86ed-7322e7935ffe tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:24.504148 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cad23f88-1cff-4e8b-86ed-7322e7935ffe tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1217 microversion: 2.1 time: 0.093978 Oct 18 14:23:24.505346 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3502/7207] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:24 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:25.530009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eacb5d5c-ace9-4657-b3d8-48e591c6ddf1 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:25.530699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eacb5d5c-ace9-4657-b3d8-48e591c6ddf1 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:25.538022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eacb5d5c-ace9-4657-b3d8-48e591c6ddf1 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:25.538608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eacb5d5c-ace9-4657-b3d8-48e591c6ddf1 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:25.539123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eacb5d5c-ace9-4657-b3d8-48e591c6ddf1 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:25.540044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eacb5d5c-ace9-4657-b3d8-48e591c6ddf1 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:25.540836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eacb5d5c-ace9-4657-b3d8-48e591c6ddf1 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:25.541384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eacb5d5c-ace9-4657-b3d8-48e591c6ddf1 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:25.646397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-eacb5d5c-ace9-4657-b3d8-48e591c6ddf1 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:25.656311 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eacb5d5c-ace9-4657-b3d8-48e591c6ddf1 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1277 microversion: 2.1 time: 0.132154 Oct 18 14:23:25.657116 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3706/7208] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:25 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1277 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:26.680341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea58106d-2fce-41eb-9389-9d9991f8c9dc tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:26.680969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ea58106d-2fce-41eb-9389-9d9991f8c9dc tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:26.692485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea58106d-2fce-41eb-9389-9d9991f8c9dc tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:26.692996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea58106d-2fce-41eb-9389-9d9991f8c9dc tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:26.693471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea58106d-2fce-41eb-9389-9d9991f8c9dc tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:26.694189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea58106d-2fce-41eb-9389-9d9991f8c9dc tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:26.695119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea58106d-2fce-41eb-9389-9d9991f8c9dc tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:26.695557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea58106d-2fce-41eb-9389-9d9991f8c9dc tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:26.910443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ea58106d-2fce-41eb-9389-9d9991f8c9dc tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:26.918860 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ea58106d-2fce-41eb-9389-9d9991f8c9dc tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1317 microversion: 2.1 time: 0.242470 Oct 18 14:23:26.919461 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3503/7209] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:26 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:27.293396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-b140c947-313e-41e2-847d-b97d121b2e6e req-39391b97-3a93-406c-b700-aebb0b4e713b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea1040c-b71c-471f-ba41-c4edb29b6157", "tag": "ecb01ba0-30e3-4117-aa11-3625ac24da91"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:27.306662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b140c947-313e-41e2-847d-b97d121b2e6e req-39391b97-3a93-406c-b700-aebb0b4e713b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:27.307785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b140c947-313e-41e2-847d-b97d121b2e6e req-39391b97-3a93-406c-b700-aebb0b4e713b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:27.308342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b140c947-313e-41e2-847d-b97d121b2e6e req-39391b97-3a93-406c-b700-aebb0b4e713b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:27.322568 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-b140c947-313e-41e2-847d-b97d121b2e6e req-39391b97-3a93-406c-b700-aebb0b4e713b service nova] Creating event network-changed:ecb01ba0-30e3-4117-aa11-3625ac24da91 for instance 7ea1040c-b71c-471f-ba41-c4edb29b6157 on n-h1-858384-13 Oct 18 14:23:27.331243 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-b140c947-313e-41e2-847d-b97d121b2e6e req-39391b97-3a93-406c-b700-aebb0b4e713b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041857 Oct 18 14:23:27.332140 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3707/7210] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:27.943746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f305111a-4fec-4627-9c03-ad3ff8072e37 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:27.944361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f305111a-4fec-4627-9c03-ad3ff8072e37 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:27.952551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f305111a-4fec-4627-9c03-ad3ff8072e37 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:27.953225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f305111a-4fec-4627-9c03-ad3ff8072e37 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:27.954240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f305111a-4fec-4627-9c03-ad3ff8072e37 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:27.954393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f305111a-4fec-4627-9c03-ad3ff8072e37 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:27.955234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f305111a-4fec-4627-9c03-ad3ff8072e37 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:27.955234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f305111a-4fec-4627-9c03-ad3ff8072e37 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:28.111777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f305111a-4fec-4627-9c03-ad3ff8072e37 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:28.119989 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f305111a-4fec-4627-9c03-ad3ff8072e37 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1317 microversion: 2.1 time: 0.180422 Oct 18 14:23:28.120574 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3504/7211] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:27 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:29.144613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-97e6d187-c8ea-4cb6-bd0c-6ebd9c53e35e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:29.145353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-97e6d187-c8ea-4cb6-bd0c-6ebd9c53e35e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:29.157265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97e6d187-c8ea-4cb6-bd0c-6ebd9c53e35e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:29.157776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97e6d187-c8ea-4cb6-bd0c-6ebd9c53e35e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:29.158229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97e6d187-c8ea-4cb6-bd0c-6ebd9c53e35e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:29.158947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97e6d187-c8ea-4cb6-bd0c-6ebd9c53e35e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:29.159406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97e6d187-c8ea-4cb6-bd0c-6ebd9c53e35e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:29.159841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-97e6d187-c8ea-4cb6-bd0c-6ebd9c53e35e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:29.294311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-97e6d187-c8ea-4cb6-bd0c-6ebd9c53e35e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:29.302318 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-97e6d187-c8ea-4cb6-bd0c-6ebd9c53e35e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1317 microversion: 2.1 time: 0.162785 Oct 18 14:23:29.302906 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3708/7212] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:29 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:23:30.324338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9a85eb1c-083b-4ad0-8e99-ff27260b50aa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:30.324862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9a85eb1c-083b-4ad0-8e99-ff27260b50aa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:30.332798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a85eb1c-083b-4ad0-8e99-ff27260b50aa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:30.333315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a85eb1c-083b-4ad0-8e99-ff27260b50aa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:30.333756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a85eb1c-083b-4ad0-8e99-ff27260b50aa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:30.334707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a85eb1c-083b-4ad0-8e99-ff27260b50aa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:30.335162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a85eb1c-083b-4ad0-8e99-ff27260b50aa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:30.335596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9a85eb1c-083b-4ad0-8e99-ff27260b50aa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:30.468838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9a85eb1c-083b-4ad0-8e99-ff27260b50aa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:30.476661 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9a85eb1c-083b-4ad0-8e99-ff27260b50aa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1317 microversion: 2.1 time: 0.156401 Oct 18 14:23:30.477267 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3505/7213] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:30 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:31.499939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2ef69666-8054-420a-aea5-f235a31227ac tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:31.500572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2ef69666-8054-420a-aea5-f235a31227ac tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:31.507496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ef69666-8054-420a-aea5-f235a31227ac tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:31.507994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ef69666-8054-420a-aea5-f235a31227ac tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:31.508447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ef69666-8054-420a-aea5-f235a31227ac tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:31.509152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ef69666-8054-420a-aea5-f235a31227ac tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:31.509646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ef69666-8054-420a-aea5-f235a31227ac tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:31.510085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2ef69666-8054-420a-aea5-f235a31227ac tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:31.651146 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2ef69666-8054-420a-aea5-f235a31227ac tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:31.659842 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2ef69666-8054-420a-aea5-f235a31227ac tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1317 microversion: 2.1 time: 0.164074 Oct 18 14:23:31.660457 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3709/7214] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:31 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:32.682620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0b1b28cb-1ba5-4096-a144-747e0f3d39fd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:32.683241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0b1b28cb-1ba5-4096-a144-747e0f3d39fd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:32.690165 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b1b28cb-1ba5-4096-a144-747e0f3d39fd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:32.690643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b1b28cb-1ba5-4096-a144-747e0f3d39fd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:32.691080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b1b28cb-1ba5-4096-a144-747e0f3d39fd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:32.691762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b1b28cb-1ba5-4096-a144-747e0f3d39fd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:32.692216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b1b28cb-1ba5-4096-a144-747e0f3d39fd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:32.692639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0b1b28cb-1ba5-4096-a144-747e0f3d39fd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:32.822581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0b1b28cb-1ba5-4096-a144-747e0f3d39fd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:32.831087 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0b1b28cb-1ba5-4096-a144-747e0f3d39fd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1317 microversion: 2.1 time: 0.152391 Oct 18 14:23:32.831668 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3506/7215] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:32 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:33.182914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-b1cb09fd-855d-4270-b0ea-0ea643d6ff83 req-ff3e86db-e5c0-4b6f-ac30-6d5247f38f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea1040c-b71c-471f-ba41-c4edb29b6157", "name": "network-vif-plugged", "status": "completed", "tag": "ecb01ba0-30e3-4117-aa11-3625ac24da91"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:33.196071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b1cb09fd-855d-4270-b0ea-0ea643d6ff83 req-ff3e86db-e5c0-4b6f-ac30-6d5247f38f2e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:33.196966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b1cb09fd-855d-4270-b0ea-0ea643d6ff83 req-ff3e86db-e5c0-4b6f-ac30-6d5247f38f2e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:33.197446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b1cb09fd-855d-4270-b0ea-0ea643d6ff83 req-ff3e86db-e5c0-4b6f-ac30-6d5247f38f2e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:33.210512 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-b1cb09fd-855d-4270-b0ea-0ea643d6ff83 req-ff3e86db-e5c0-4b6f-ac30-6d5247f38f2e service nova] Creating event network-vif-plugged:ecb01ba0-30e3-4117-aa11-3625ac24da91 for instance 7ea1040c-b71c-471f-ba41-c4edb29b6157 on n-h1-858384-13 Oct 18 14:23:33.215691 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-b1cb09fd-855d-4270-b0ea-0ea643d6ff83 req-ff3e86db-e5c0-4b6f-ac30-6d5247f38f2e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036511 Oct 18 14:23:33.216506 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3710/7216] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:33.855083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-68eb3088-6e8c-4840-9c9b-7de5ff62f269 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:33.855718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-68eb3088-6e8c-4840-9c9b-7de5ff62f269 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:33.863452 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68eb3088-6e8c-4840-9c9b-7de5ff62f269 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:33.863937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68eb3088-6e8c-4840-9c9b-7de5ff62f269 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:33.864366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68eb3088-6e8c-4840-9c9b-7de5ff62f269 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:33.865068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68eb3088-6e8c-4840-9c9b-7de5ff62f269 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:33.865548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68eb3088-6e8c-4840-9c9b-7de5ff62f269 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:33.865968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-68eb3088-6e8c-4840-9c9b-7de5ff62f269 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:34.006055 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-68eb3088-6e8c-4840-9c9b-7de5ff62f269 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:34.014683 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-68eb3088-6e8c-4840-9c9b-7de5ff62f269 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1317 microversion: 2.1 time: 0.163281 Oct 18 14:23:34.015296 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3507/7217] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:33 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:23:35.036363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:35.037191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:35.041640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-301a5783-a62e-42c5-a879-62913423817f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:35.042368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-301a5783-a62e-42c5-a879-62913423817f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:35.049580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-301a5783-a62e-42c5-a879-62913423817f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:35.050083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-301a5783-a62e-42c5-a879-62913423817f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:35.050538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-301a5783-a62e-42c5-a879-62913423817f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:35.051250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-301a5783-a62e-42c5-a879-62913423817f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:35.051722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-301a5783-a62e-42c5-a879-62913423817f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:35.052166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-301a5783-a62e-42c5-a879-62913423817f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:35.182294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-301a5783-a62e-42c5-a879-62913423817f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:35.190263 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-301a5783-a62e-42c5-a879-62913423817f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1505 microversion: 2.1 time: 0.155675 Oct 18 14:23:35.190851 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3711/7218] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:35 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:23:35.253750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1673351169", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "eb247703-66ab-4cfa-b557-4530d802372c"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:35.262108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:35.308800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] validate_networks() for [('eb247703-66ab-4cfa-b557-4530d802372c', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:23:35.736336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:23:35.736765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:23:35.737302 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:23:35.737717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:23:35.738131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:23:35.747148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:35.747626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:35.748068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:35.749624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:35.750007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:35.750446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:35.767877 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Getting quotas for project 37f8136931b54b60ac1e1ad11de19b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:23:35.773234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Getting quotas for user 68a781140eda4307a7846031a50b1fef and project 37f8136931b54b60ac1e1ad11de19b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:23:35.786189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:23:35.788531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:23:35.834115 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [60ac6d9d-e6de-429b-8381-d9cdcb802e9c] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:23:36.841858 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [60ac6d9d-e6de-429b-8381-d9cdcb802e9c] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 41332. Oct 18 14:23:36.846419 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b218f0e4-7ca5-4efc-af51-726fe5d958df tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.596561 Oct 18 14:23:36.847107 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3508/7219] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:23:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 18 14:23:36.858374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5879c024-0e6f-482e-9954-99f7c4d91b85 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:36.858929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5879c024-0e6f-482e-9954-99f7c4d91b85 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:36.918082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5879c024-0e6f-482e-9954-99f7c4d91b85 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:36.926023 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5879c024-0e6f-482e-9954-99f7c4d91b85 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 200 len: 1217 microversion: 2.1 time: 0.071697 Oct 18 14:23:36.926721 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3712/7220] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:36 2022] GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:37.951141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-448c728c-14e4-457b-a806-2c72be21a89e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:37.951781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-448c728c-14e4-457b-a806-2c72be21a89e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:37.958189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-448c728c-14e4-457b-a806-2c72be21a89e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:37.958668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-448c728c-14e4-457b-a806-2c72be21a89e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:37.960442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-448c728c-14e4-457b-a806-2c72be21a89e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:37.960442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-448c728c-14e4-457b-a806-2c72be21a89e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:37.960442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-448c728c-14e4-457b-a806-2c72be21a89e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:37.960874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-448c728c-14e4-457b-a806-2c72be21a89e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:38.040084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-448c728c-14e4-457b-a806-2c72be21a89e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:38.049055 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-448c728c-14e4-457b-a806-2c72be21a89e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 200 len: 1277 microversion: 2.1 time: 0.102817 Oct 18 14:23:38.049703 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3509/7221] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:37 2022] GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:39.072005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-096a0ca1-ea84-4ffa-b308-a47f0b689854 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:39.072756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-096a0ca1-ea84-4ffa-b308-a47f0b689854 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:39.080315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-096a0ca1-ea84-4ffa-b308-a47f0b689854 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:39.080742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-096a0ca1-ea84-4ffa-b308-a47f0b689854 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:39.081204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-096a0ca1-ea84-4ffa-b308-a47f0b689854 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:39.082341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-096a0ca1-ea84-4ffa-b308-a47f0b689854 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:39.082841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-096a0ca1-ea84-4ffa-b308-a47f0b689854 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:39.083274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-096a0ca1-ea84-4ffa-b308-a47f0b689854 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:39.286086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-096a0ca1-ea84-4ffa-b308-a47f0b689854 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:39.293822 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-096a0ca1-ea84-4ffa-b308-a47f0b689854 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 200 len: 1317 microversion: 2.1 time: 0.225766 Oct 18 14:23:39.294408 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3713/7222] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:39 2022] GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:39.408652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-aed122de-928b-42ed-a1fb-466895422823 req-d2dd495b-b9db-4632-9eec-22f5934535ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f28beb7-8631-4529-b48b-c823b97c8353", "tag": "33ae40ae-93c7-4fe3-8b9f-2be6eec8f0e3"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:39.419477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-aed122de-928b-42ed-a1fb-466895422823 req-d2dd495b-b9db-4632-9eec-22f5934535ae service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:39.419948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-aed122de-928b-42ed-a1fb-466895422823 req-d2dd495b-b9db-4632-9eec-22f5934535ae service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:39.420409 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-aed122de-928b-42ed-a1fb-466895422823 req-d2dd495b-b9db-4632-9eec-22f5934535ae service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:39.432781 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-aed122de-928b-42ed-a1fb-466895422823 req-d2dd495b-b9db-4632-9eec-22f5934535ae service nova] Creating event network-changed:33ae40ae-93c7-4fe3-8b9f-2be6eec8f0e3 for instance 4f28beb7-8631-4529-b48b-c823b97c8353 on n-h2-858384-13 Oct 18 14:23:39.438611 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-aed122de-928b-42ed-a1fb-466895422823 req-d2dd495b-b9db-4632-9eec-22f5934535ae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033875 Oct 18 14:23:39.439239 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3510/7223] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:40.316781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e45de5b4-c0b6-462f-968f-0bc8d0ded9e0 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:40.317515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e45de5b4-c0b6-462f-968f-0bc8d0ded9e0 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:40.324323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e45de5b4-c0b6-462f-968f-0bc8d0ded9e0 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:40.324830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e45de5b4-c0b6-462f-968f-0bc8d0ded9e0 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:40.325313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e45de5b4-c0b6-462f-968f-0bc8d0ded9e0 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:40.326029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e45de5b4-c0b6-462f-968f-0bc8d0ded9e0 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:40.326500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e45de5b4-c0b6-462f-968f-0bc8d0ded9e0 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:40.326945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e45de5b4-c0b6-462f-968f-0bc8d0ded9e0 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:40.463015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e45de5b4-c0b6-462f-968f-0bc8d0ded9e0 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:40.471436 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e45de5b4-c0b6-462f-968f-0bc8d0ded9e0 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 200 len: 1317 microversion: 2.1 time: 0.158559 Oct 18 14:23:40.472014 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3714/7224] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:40 2022] GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:41.494759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0ba952ed-c519-45ea-9361-261080b5eed3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:41.495371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0ba952ed-c519-45ea-9361-261080b5eed3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:41.503197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ba952ed-c519-45ea-9361-261080b5eed3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:41.503668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ba952ed-c519-45ea-9361-261080b5eed3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:41.504097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ba952ed-c519-45ea-9361-261080b5eed3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:41.504787 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ba952ed-c519-45ea-9361-261080b5eed3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:41.505265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ba952ed-c519-45ea-9361-261080b5eed3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:41.505684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0ba952ed-c519-45ea-9361-261080b5eed3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:41.636953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0ba952ed-c519-45ea-9361-261080b5eed3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:41.645653 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0ba952ed-c519-45ea-9361-261080b5eed3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 200 len: 1317 microversion: 2.1 time: 0.155238 Oct 18 14:23:41.646239 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3511/7225] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:41 2022] GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:42.668674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d2a0207c-de4a-4dc1-b110-75ca38d54b21 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:42.669235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d2a0207c-de4a-4dc1-b110-75ca38d54b21 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:42.676065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a0207c-de4a-4dc1-b110-75ca38d54b21 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:42.676552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a0207c-de4a-4dc1-b110-75ca38d54b21 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:42.677000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a0207c-de4a-4dc1-b110-75ca38d54b21 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:42.677715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a0207c-de4a-4dc1-b110-75ca38d54b21 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:42.678181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a0207c-de4a-4dc1-b110-75ca38d54b21 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:42.678612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a0207c-de4a-4dc1-b110-75ca38d54b21 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:42.808263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d2a0207c-de4a-4dc1-b110-75ca38d54b21 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:42.816578 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d2a0207c-de4a-4dc1-b110-75ca38d54b21 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 200 len: 1317 microversion: 2.1 time: 0.151868 Oct 18 14:23:42.817199 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3715/7226] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:42 2022] GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:43.840779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cb0211aa-e836-45ec-a65a-1175fc6f062f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:43.841951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cb0211aa-e836-45ec-a65a-1175fc6f062f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:43.850392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb0211aa-e836-45ec-a65a-1175fc6f062f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:43.850864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb0211aa-e836-45ec-a65a-1175fc6f062f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:43.851835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb0211aa-e836-45ec-a65a-1175fc6f062f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:43.852781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb0211aa-e836-45ec-a65a-1175fc6f062f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:43.853408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb0211aa-e836-45ec-a65a-1175fc6f062f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:43.853821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cb0211aa-e836-45ec-a65a-1175fc6f062f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:44.002429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cb0211aa-e836-45ec-a65a-1175fc6f062f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:44.011276 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cb0211aa-e836-45ec-a65a-1175fc6f062f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 200 len: 1317 microversion: 2.1 time: 0.174429 Oct 18 14:23:44.011889 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3512/7227] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:43 2022] GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:44.129690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f08fa612-5bc1-4132-9ede-73a18fc2d367 req-f1a84bbc-8489-496a-b20b-2aec658658e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f28beb7-8631-4529-b48b-c823b97c8353", "name": "network-vif-plugged", "status": "completed", "tag": "33ae40ae-93c7-4fe3-8b9f-2be6eec8f0e3"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:44.141678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f08fa612-5bc1-4132-9ede-73a18fc2d367 req-f1a84bbc-8489-496a-b20b-2aec658658e3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:44.142140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f08fa612-5bc1-4132-9ede-73a18fc2d367 req-f1a84bbc-8489-496a-b20b-2aec658658e3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:44.142632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f08fa612-5bc1-4132-9ede-73a18fc2d367 req-f1a84bbc-8489-496a-b20b-2aec658658e3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:44.159650 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f08fa612-5bc1-4132-9ede-73a18fc2d367 req-f1a84bbc-8489-496a-b20b-2aec658658e3 service nova] Creating event network-vif-plugged:33ae40ae-93c7-4fe3-8b9f-2be6eec8f0e3 for instance 4f28beb7-8631-4529-b48b-c823b97c8353 on n-h2-858384-13 Oct 18 14:23:44.164754 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f08fa612-5bc1-4132-9ede-73a18fc2d367 req-f1a84bbc-8489-496a-b20b-2aec658658e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039833 Oct 18 14:23:44.165529 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3716/7228] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:45.035016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6a878c23-172b-45e0-82ec-847c3c706ba2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:45.035653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6a878c23-172b-45e0-82ec-847c3c706ba2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:45.042656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a878c23-172b-45e0-82ec-847c3c706ba2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:45.043140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a878c23-172b-45e0-82ec-847c3c706ba2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:45.043581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a878c23-172b-45e0-82ec-847c3c706ba2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:45.044325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a878c23-172b-45e0-82ec-847c3c706ba2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:45.044779 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a878c23-172b-45e0-82ec-847c3c706ba2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:45.045230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6a878c23-172b-45e0-82ec-847c3c706ba2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:45.178901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6a878c23-172b-45e0-82ec-847c3c706ba2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:45.186973 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6a878c23-172b-45e0-82ec-847c3c706ba2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 200 len: 1317 microversion: 2.1 time: 0.156032 Oct 18 14:23:45.187550 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3513/7229] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:45 2022] GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:46.212661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5db6289b-97d1-4699-b19a-d05e45eb7d6c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:46.213417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5db6289b-97d1-4699-b19a-d05e45eb7d6c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:46.219640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5db6289b-97d1-4699-b19a-d05e45eb7d6c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:46.220659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5db6289b-97d1-4699-b19a-d05e45eb7d6c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:46.221098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5db6289b-97d1-4699-b19a-d05e45eb7d6c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:46.221832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5db6289b-97d1-4699-b19a-d05e45eb7d6c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:46.222293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5db6289b-97d1-4699-b19a-d05e45eb7d6c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:46.222761 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5db6289b-97d1-4699-b19a-d05e45eb7d6c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:46.355990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5db6289b-97d1-4699-b19a-d05e45eb7d6c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:46.364118 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5db6289b-97d1-4699-b19a-d05e45eb7d6c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 200 len: 1506 microversion: 2.1 time: 0.156977 Oct 18 14:23:46.364841 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3717/7230] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:46 2022] GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:46.386863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4e27414e-66cf-49ab-a875-8f242df7eb5b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:46.387371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4e27414e-66cf-49ab-a875-8f242df7eb5b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:46.389345 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:46.390157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:46.397597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e27414e-66cf-49ab-a875-8f242df7eb5b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:46.398083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e27414e-66cf-49ab-a875-8f242df7eb5b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:46.398524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e27414e-66cf-49ab-a875-8f242df7eb5b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:46.399218 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e27414e-66cf-49ab-a875-8f242df7eb5b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:46.399677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e27414e-66cf-49ab-a875-8f242df7eb5b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:46.400102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4e27414e-66cf-49ab-a875-8f242df7eb5b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:46.426414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4e27414e-66cf-49ab-a875-8f242df7eb5b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:23:46.505106 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4e27414e-66cf-49ab-a875-8f242df7eb5b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 204 len: 0 microversion: 2.1 time: 0.121766 Oct 18 14:23:46.505810 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3514/7231] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:23:46 2022] DELETE /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:23:46.513969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8558dd41-53ed-4268-bdb8-b4617c36b8b2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:46.514594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8558dd41-53ed-4268-bdb8-b4617c36b8b2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:46.521203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8558dd41-53ed-4268-bdb8-b4617c36b8b2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:46.521704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8558dd41-53ed-4268-bdb8-b4617c36b8b2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:46.522154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8558dd41-53ed-4268-bdb8-b4617c36b8b2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:46.522847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8558dd41-53ed-4268-bdb8-b4617c36b8b2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:46.523309 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8558dd41-53ed-4268-bdb8-b4617c36b8b2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:46.523742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8558dd41-53ed-4268-bdb8-b4617c36b8b2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:46.655174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8558dd41-53ed-4268-bdb8-b4617c36b8b2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:46.663350 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8558dd41-53ed-4268-bdb8-b4617c36b8b2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 200 len: 1512 microversion: 2.1 time: 0.153271 Oct 18 14:23:46.663937 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3718/7232] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:46 2022] GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:23:47.687336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bc48f5c6-8cfd-4516-ae3e-891e6d4223f7 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:47.688108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bc48f5c6-8cfd-4516-ae3e-891e6d4223f7 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:47.695394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc48f5c6-8cfd-4516-ae3e-891e6d4223f7 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:47.695885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc48f5c6-8cfd-4516-ae3e-891e6d4223f7 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:47.696325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc48f5c6-8cfd-4516-ae3e-891e6d4223f7 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:47.697033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc48f5c6-8cfd-4516-ae3e-891e6d4223f7 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:47.697520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc48f5c6-8cfd-4516-ae3e-891e6d4223f7 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:47.697954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc48f5c6-8cfd-4516-ae3e-891e6d4223f7 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:47.845914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bc48f5c6-8cfd-4516-ae3e-891e6d4223f7 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:47.854844 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bc48f5c6-8cfd-4516-ae3e-891e6d4223f7 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 200 len: 1512 microversion: 2.1 time: 0.171400 Oct 18 14:23:47.855463 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3515/7233] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:47 2022] GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:48.293792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8a29bfaf-01cd-4612-a0f8-30b1265fd727 req-867d924a-5d75-460f-89ef-79225b4ca909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f28beb7-8631-4529-b48b-c823b97c8353", "name": "network-vif-deleted", "tag": "33ae40ae-93c7-4fe3-8b9f-2be6eec8f0e3"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:48.300156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:48.312336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8a29bfaf-01cd-4612-a0f8-30b1265fd727 req-867d924a-5d75-460f-89ef-79225b4ca909 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:48.313670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8a29bfaf-01cd-4612-a0f8-30b1265fd727 req-867d924a-5d75-460f-89ef-79225b4ca909 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:48.314369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8a29bfaf-01cd-4612-a0f8-30b1265fd727 req-867d924a-5d75-460f-89ef-79225b4ca909 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:48.327727 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8a29bfaf-01cd-4612-a0f8-30b1265fd727 req-867d924a-5d75-460f-89ef-79225b4ca909 service nova] Creating event network-vif-deleted:33ae40ae-93c7-4fe3-8b9f-2be6eec8f0e3 for instance 4f28beb7-8631-4529-b48b-c823b97c8353 on n-h2-858384-13 Oct 18 14:23:48.334627 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8a29bfaf-01cd-4612-a0f8-30b1265fd727 req-867d924a-5d75-460f-89ef-79225b4ca909 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044782 Oct 18 14:23:48.335551 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3719/7234] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:48.879041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7a6fa559-5549-4fbb-9d9a-5d9eea4d719e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:48.879662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7a6fa559-5549-4fbb-9d9a-5d9eea4d719e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:48.886725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a6fa559-5549-4fbb-9d9a-5d9eea4d719e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:48.887213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a6fa559-5549-4fbb-9d9a-5d9eea4d719e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:48.887631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a6fa559-5549-4fbb-9d9a-5d9eea4d719e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:48.888328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a6fa559-5549-4fbb-9d9a-5d9eea4d719e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:48.888771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a6fa559-5549-4fbb-9d9a-5d9eea4d719e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:48.889209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a6fa559-5549-4fbb-9d9a-5d9eea4d719e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:48.904575 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-7a6fa559-5549-4fbb-9d9a-5d9eea4d719e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] HTTP exception thrown: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7a6fa559-5549-4fbb-9d9a-5d9eea4d719e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Request method failure captured: Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 HTTP/1.1 Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrbbzVSNxU6jdE5gLt_iwiy4q-As_9SzGQ-ta1n61spE-nUHjV5YH1yBIkQL2CLajOPhBjQQhVtFVSdsEQygc0fynHQkMvRGxN-Qi8tzJBToOChXAhezRLDsFwB3QmgSD3Y9QSXbSkNENy4J8DGfhKEchZHxW4e63j9aV-YX9BsuoCM Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f8136931b54b60ac1e1ad11de19b99"}]}] Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 68a781140eda4307a7846031a50b1fef Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '4f28beb7-8631-4529-b48b-c823b97c8353'} Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:48.906259 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:48.914128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:48.914128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:48.914128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:48.914128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:48.914128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:48.914128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:48.914128 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:48.914128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7a6fa559-5549-4fbb-9d9a-5d9eea4d719e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Returning 404 to user: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:48.914128 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7a6fa559-5549-4fbb-9d9a-5d9eea4d719e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 404 len: 111 microversion: 2.1 time: 0.033418 Oct 18 14:23:48.914128 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3516/7235] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:48 2022] GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 14:23:48.918813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-184807b4-503a-431b-b4a0-68401ec589dd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:48.919545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-184807b4-503a-431b-b4a0-68401ec589dd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:48.926911 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-184807b4-503a-431b-b4a0-68401ec589dd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:48.927417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-184807b4-503a-431b-b4a0-68401ec589dd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:48.927875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-184807b4-503a-431b-b4a0-68401ec589dd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:48.928600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-184807b4-503a-431b-b4a0-68401ec589dd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:48.929075 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-184807b4-503a-431b-b4a0-68401ec589dd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:48.929556 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-184807b4-503a-431b-b4a0-68401ec589dd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.068914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-184807b4-503a-431b-b4a0-68401ec589dd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:49.077196 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-184807b4-503a-431b-b4a0-68401ec589dd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1505 microversion: 2.1 time: 0.163013 Oct 18 14:23:49.077824 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3720/7236] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:48 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:23:49.101597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a26bfb1c-070f-4144-870e-c4c4a5ccbffa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:49.103830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a26bfb1c-070f-4144-870e-c4c4a5ccbffa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: e7b7a5e9-5635-4887-aa45-403d5e3943d8] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:49.110238 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-a26bfb1c-070f-4144-870e-c4c4a5ccbffa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] HTTP exception thrown: Instance e7b7a5e9-5635-4887-aa45-403d5e3943d8 could not be found. Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a26bfb1c-070f-4144-870e-c4c4a5ccbffa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Request method failure captured: Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/e7b7a5e9-5635-4887-aa45-403d5e3943d8/action HTTP/1.1 Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 32 Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrbbzVSNxU6jdE5gLt_iwiy4q-As_9SzGQ-ta1n61spE-nUHjV5YH1yBIkQL2CLajOPhBjQQhVtFVSdsEQygc0fynHQkMvRGxN-Qi8tzJBToOChXAhezRLDsFwB3QmgSD3Y9QSXbSkNENy4J8DGfhKEchZHxW4e63j9aV-YX9BsuoCM Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f8136931b54b60ac1e1ad11de19b99"}]}] Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 68a781140eda4307a7846031a50b1fef Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: {"resize": {"flavorRef": "452"}} Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance e7b7a5e9-5635-4887-aa45-403d5e3943d8 could not be found. Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'e7b7a5e9-5635-4887-aa45-403d5e3943d8', 'body': {'resize': {'flavorRef': '452'}}} Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7b7a5e9-5635-4887-aa45-403d5e3943d8 could not be found. Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:49.112144 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7b7a5e9-5635-4887-aa45-403d5e3943d8 could not be found. Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7b7a5e9-5635-4887-aa45-403d5e3943d8 could not be found. Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a26bfb1c-070f-4144-870e-c4c4a5ccbffa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Returning 404 to user: Instance e7b7a5e9-5635-4887-aa45-403d5e3943d8 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a26bfb1c-070f-4144-870e-c4c4a5ccbffa tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "POST /compute/v2.1/servers/e7b7a5e9-5635-4887-aa45-403d5e3943d8/action" status: 404 len: 111 microversion: 2.1 time: 0.016138 Oct 18 14:23:49.117008 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3517/7237] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:23:49 2022] POST /compute/v2.1/servers/e7b7a5e9-5635-4887-aa45-403d5e3943d8/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:49.123257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-991cb969-5daf-48f3-bb9c-450283585194 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:49.123962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-991cb969-5daf-48f3-bb9c-450283585194 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:49.131554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-991cb969-5daf-48f3-bb9c-450283585194 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.132175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-991cb969-5daf-48f3-bb9c-450283585194 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.132864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-991cb969-5daf-48f3-bb9c-450283585194 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.133853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-991cb969-5daf-48f3-bb9c-450283585194 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.134447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-991cb969-5daf-48f3-bb9c-450283585194 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.134963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-991cb969-5daf-48f3-bb9c-450283585194 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.286388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-991cb969-5daf-48f3-bb9c-450283585194 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:49.295241 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-991cb969-5daf-48f3-bb9c-450283585194 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1505 microversion: 2.1 time: 0.176547 Oct 18 14:23:49.295927 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3721/7238] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:49 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:49.320435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6cca466a-9f81-4d21-b03a-d3f0008c62be tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:49.321043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6cca466a-9f81-4d21-b03a-d3f0008c62be tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:49.327966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cca466a-9f81-4d21-b03a-d3f0008c62be tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.328474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cca466a-9f81-4d21-b03a-d3f0008c62be tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.328903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cca466a-9f81-4d21-b03a-d3f0008c62be tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.329604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cca466a-9f81-4d21-b03a-d3f0008c62be tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.330058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cca466a-9f81-4d21-b03a-d3f0008c62be tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.330522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cca466a-9f81-4d21-b03a-d3f0008c62be tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.464118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6cca466a-9f81-4d21-b03a-d3f0008c62be tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:49.472012 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6cca466a-9f81-4d21-b03a-d3f0008c62be tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1505 microversion: 2.1 time: 0.155523 Oct 18 14:23:49.472588 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3518/7239] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:49 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:49.497434 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d446fbe5-1b37-4f6b-a823-2aaed2f5df8f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "a0808e94-3202-4f29-b2da-9474a358ec36"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:49.499897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d446fbe5-1b37-4f6b-a823-2aaed2f5df8f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:49.510466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d446fbe5-1b37-4f6b-a823-2aaed2f5df8f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.510964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d446fbe5-1b37-4f6b-a823-2aaed2f5df8f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.511412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d446fbe5-1b37-4f6b-a823-2aaed2f5df8f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.512115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d446fbe5-1b37-4f6b-a823-2aaed2f5df8f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.512584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d446fbe5-1b37-4f6b-a823-2aaed2f5df8f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.513016 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d446fbe5-1b37-4f6b-a823-2aaed2f5df8f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.555529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d446fbe5-1b37-4f6b-a823-2aaed2f5df8f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:49.560993 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-d446fbe5-1b37-4f6b-a823-2aaed2f5df8f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] HTTP exception thrown: Flavor a0808e94-3202-4f29-b2da-9474a358ec36 could not be found. Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d446fbe5-1b37-4f6b-a823-2aaed2f5df8f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Request method failure captured: Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: request: POST /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157/action HTTP/1.1 Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 65 Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrbbzVSNxU6jdE5gLt_iwiy4q-As_9SzGQ-ta1n61spE-nUHjV5YH1yBIkQL2CLajOPhBjQQhVtFVSdsEQygc0fynHQkMvRGxN-Qi8tzJBToOChXAhezRLDsFwB3QmgSD3Y9QSXbSkNENy4J8DGfhKEchZHxW4e63j9aV-YX9BsuoCM Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f8136931b54b60ac1e1ad11de19b99"}]}] Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 68a781140eda4307a7846031a50b1fef Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: {"resize": {"flavorRef": "a0808e94-3202-4f29-b2da-9474a358ec36"}} Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: exception: Flavor a0808e94-3202-4f29-b2da-9474a358ec36 could not be found. Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '7ea1040c-b71c-471f-ba41-c4edb29b6157', 'body': {'resize': {'flavorRef': 'a0808e94-3202-4f29-b2da-9474a358ec36'}}} Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4202, in resize Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:49.572134 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor a0808e94-3202-4f29-b2da-9474a358ec36 could not be found. Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor a0808e94-3202-4f29-b2da-9474a358ec36 could not be found. Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor a0808e94-3202-4f29-b2da-9474a358ec36 could not be found. Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d446fbe5-1b37-4f6b-a823-2aaed2f5df8f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Returning 400 to user: Flavor a0808e94-3202-4f29-b2da-9474a358ec36 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d446fbe5-1b37-4f6b-a823-2aaed2f5df8f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "POST /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157/action" status: 400 len: 107 microversion: 2.1 time: 0.080492 Oct 18 14:23:49.576796 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3722/7240] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:23:49 2022] POST /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157/action => generated 107 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:23:49.582854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31c5bf2e-f8bd-4f5c-a52e-cf5f430d6dfd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:49.583463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-31c5bf2e-f8bd-4f5c-a52e-cf5f430d6dfd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:49.590075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c5bf2e-f8bd-4f5c-a52e-cf5f430d6dfd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.590550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c5bf2e-f8bd-4f5c-a52e-cf5f430d6dfd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.590981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c5bf2e-f8bd-4f5c-a52e-cf5f430d6dfd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.591661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c5bf2e-f8bd-4f5c-a52e-cf5f430d6dfd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.592106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c5bf2e-f8bd-4f5c-a52e-cf5f430d6dfd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.592529 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-31c5bf2e-f8bd-4f5c-a52e-cf5f430d6dfd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.722405 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-31c5bf2e-f8bd-4f5c-a52e-cf5f430d6dfd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:49.730107 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31c5bf2e-f8bd-4f5c-a52e-cf5f430d6dfd tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1505 microversion: 2.1 time: 0.151392 Oct 18 14:23:49.730677 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3519/7241] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:49 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:49.753907 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-77d73ec0-2917-4b68-8a72-408b72c499d3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:49.754529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-77d73ec0-2917-4b68-8a72-408b72c499d3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:49.760672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77d73ec0-2917-4b68-8a72-408b72c499d3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.761246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77d73ec0-2917-4b68-8a72-408b72c499d3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.761702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77d73ec0-2917-4b68-8a72-408b72c499d3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.762398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77d73ec0-2917-4b68-8a72-408b72c499d3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.762859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77d73ec0-2917-4b68-8a72-408b72c499d3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.763294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-77d73ec0-2917-4b68-8a72-408b72c499d3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.896248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-77d73ec0-2917-4b68-8a72-408b72c499d3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:49.904093 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-77d73ec0-2917-4b68-8a72-408b72c499d3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1505 microversion: 2.1 time: 0.154637 Oct 18 14:23:49.904672 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3723/7242] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:49 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:49.926673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c5c69c4a-af08-4641-afa7-d207c86c0d1b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c5c69c4a-af08-4641-afa7-d207c86c0d1b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Request method failure captured: Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: request: POST /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157/action HTTP/1.1 Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 29 Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrbbzVSNxU6jdE5gLt_iwiy4q-As_9SzGQ-ta1n61spE-nUHjV5YH1yBIkQL2CLajOPhBjQQhVtFVSdsEQygc0fynHQkMvRGxN-Qi8tzJBToOChXAhezRLDsFwB3QmgSD3Y9QSXbSkNENy4J8DGfhKEchZHxW4e63j9aV-YX9BsuoCM Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f8136931b54b60ac1e1ad11de19b99"}]}] Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 68a781140eda4307a7846031a50b1fef Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: {"resize": {"flavorRef": ""}} Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '7ea1040c-b71c-471f-ba41-c4edb29b6157', 'body': {'resize': {'flavorRef': ''}}} Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise error Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi '' Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.930371 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:49.936375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.936375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:49.936375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:49.936375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:49.936375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 18 14:23:49.936375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 18 14:23:49.936375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 18 14:23:49.936375 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:49.936375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c5c69c4a-af08-4641-afa7-d207c86c0d1b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:49.936375 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c5c69c4a-af08-4641-afa7-d207c86c0d1b tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "POST /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157/action" status: 400 len: 113 microversion: 2.1 time: 0.009399 Oct 18 14:23:49.936375 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3520/7243] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:23:49 2022] POST /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 18 14:23:49.940917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-82e71af3-b749-4ccf-867e-851c45fcaff2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:49.941612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-82e71af3-b749-4ccf-867e-851c45fcaff2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:49.947681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82e71af3-b749-4ccf-867e-851c45fcaff2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.948177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82e71af3-b749-4ccf-867e-851c45fcaff2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.948647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82e71af3-b749-4ccf-867e-851c45fcaff2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:49.949368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82e71af3-b749-4ccf-867e-851c45fcaff2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:49.949837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82e71af3-b749-4ccf-867e-851c45fcaff2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:49.950279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-82e71af3-b749-4ccf-867e-851c45fcaff2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:50.081823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-82e71af3-b749-4ccf-867e-851c45fcaff2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:50.090166 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-82e71af3-b749-4ccf-867e-851c45fcaff2 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1505 microversion: 2.1 time: 0.153700 Oct 18 14:23:50.090765 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3724/7244] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:49 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:23:50.117747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3fb2656d-54f5-44fd-bb72-b1f1166be680 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:50.118240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3fb2656d-54f5-44fd-bb72-b1f1166be680 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:50.125320 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb2656d-54f5-44fd-bb72-b1f1166be680 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:50.126328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb2656d-54f5-44fd-bb72-b1f1166be680 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:50.126828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb2656d-54f5-44fd-bb72-b1f1166be680 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:50.127515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb2656d-54f5-44fd-bb72-b1f1166be680 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:50.127963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb2656d-54f5-44fd-bb72-b1f1166be680 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:50.128384 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3fb2656d-54f5-44fd-bb72-b1f1166be680 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:50.142651 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-3fb2656d-54f5-44fd-bb72-b1f1166be680 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] HTTP exception thrown: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3fb2656d-54f5-44fd-bb72-b1f1166be680 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Request method failure captured: Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 HTTP/1.1 Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrbbzVSNxU6jdE5gLt_iwiy4q-As_9SzGQ-ta1n61spE-nUHjV5YH1yBIkQL2CLajOPhBjQQhVtFVSdsEQygc0fynHQkMvRGxN-Qi8tzJBToOChXAhezRLDsFwB3QmgSD3Y9QSXbSkNENy4J8DGfhKEchZHxW4e63j9aV-YX9BsuoCM Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f8136931b54b60ac1e1ad11de19b99"}]}] Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 68a781140eda4307a7846031a50b1fef Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '4f28beb7-8631-4529-b48b-c823b97c8353'} Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:50.144253 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3fb2656d-54f5-44fd-bb72-b1f1166be680 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Returning 404 to user: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3fb2656d-54f5-44fd-bb72-b1f1166be680 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 404 len: 111 microversion: 2.1 time: 0.032657 Oct 18 14:23:50.148650 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3521/7245] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:23:50 2022] DELETE /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:50.154768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d3d99968-471f-4e09-b7e6-0484856df5e3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:50.155403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d3d99968-471f-4e09-b7e6-0484856df5e3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 4f28beb7-8631-4529-b48b-c823b97c8353] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:50.161578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d99968-471f-4e09-b7e6-0484856df5e3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:50.162081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d99968-471f-4e09-b7e6-0484856df5e3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:50.162542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d99968-471f-4e09-b7e6-0484856df5e3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:50.163252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d99968-471f-4e09-b7e6-0484856df5e3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:50.163757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d99968-471f-4e09-b7e6-0484856df5e3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:50.164200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d99968-471f-4e09-b7e6-0484856df5e3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:50.178541 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-d3d99968-471f-4e09-b7e6-0484856df5e3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] HTTP exception thrown: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d3d99968-471f-4e09-b7e6-0484856df5e3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Request method failure captured: Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 HTTP/1.1 Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrbbzVSNxU6jdE5gLt_iwiy4q-As_9SzGQ-ta1n61spE-nUHjV5YH1yBIkQL2CLajOPhBjQQhVtFVSdsEQygc0fynHQkMvRGxN-Qi8tzJBToOChXAhezRLDsFwB3QmgSD3Y9QSXbSkNENy4J8DGfhKEchZHxW4e63j9aV-YX9BsuoCM Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f8136931b54b60ac1e1ad11de19b99"}]}] Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 68a781140eda4307a7846031a50b1fef Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '4f28beb7-8631-4529-b48b-c823b97c8353'} Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:50.180086 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:50.184684 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:50.184684 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:50.184684 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:50.184684 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:50.184684 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:50.184684 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. Oct 18 14:23:50.184684 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:23:50.184684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d3d99968-471f-4e09-b7e6-0484856df5e3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Returning 404 to user: Instance 4f28beb7-8631-4529-b48b-c823b97c8353 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:50.184684 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d3d99968-471f-4e09-b7e6-0484856df5e3 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353" status: 404 len: 111 microversion: 2.1 time: 0.030705 Oct 18 14:23:50.184684 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3725/7246] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:50 2022] GET /compute/v2.1/servers/4f28beb7-8631-4529-b48b-c823b97c8353 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:23:50.190750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-edacd3b9-0b11-4e81-925b-75a73fbc676c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:50.191254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-edacd3b9-0b11-4e81-925b-75a73fbc676c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:50.197388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edacd3b9-0b11-4e81-925b-75a73fbc676c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:50.197872 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edacd3b9-0b11-4e81-925b-75a73fbc676c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:50.198316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edacd3b9-0b11-4e81-925b-75a73fbc676c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:50.199011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edacd3b9-0b11-4e81-925b-75a73fbc676c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:50.199467 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edacd3b9-0b11-4e81-925b-75a73fbc676c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:50.199895 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-edacd3b9-0b11-4e81-925b-75a73fbc676c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:50.218647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:50.227561 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-edacd3b9-0b11-4e81-925b-75a73fbc676c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:23:50.309923 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-edacd3b9-0b11-4e81-925b-75a73fbc676c tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 204 len: 0 microversion: 2.1 time: 0.123479 Oct 18 14:23:50.310740 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3522/7247] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:23:50 2022] DELETE /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:23:50.320256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8ce88f6e-6f05-4e40-a781-46becc142e0e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:50.320897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8ce88f6e-6f05-4e40-a781-46becc142e0e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:50.327108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ce88f6e-6f05-4e40-a781-46becc142e0e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:50.327607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ce88f6e-6f05-4e40-a781-46becc142e0e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:50.328059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ce88f6e-6f05-4e40-a781-46becc142e0e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:50.328873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ce88f6e-6f05-4e40-a781-46becc142e0e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:50.329443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ce88f6e-6f05-4e40-a781-46becc142e0e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:50.329836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ce88f6e-6f05-4e40-a781-46becc142e0e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:50.464949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8ce88f6e-6f05-4e40-a781-46becc142e0e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:50.468646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=100 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:23:50.474509 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8ce88f6e-6f05-4e40-a781-46becc142e0e tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1511 microversion: 2.1 time: 0.158691 Oct 18 14:23:50.475156 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3726/7248] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:50 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:51.500106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb406407-79cf-44ba-b832-297b43d2810f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:51.501444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eb406407-79cf-44ba-b832-297b43d2810f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:51.508281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb406407-79cf-44ba-b832-297b43d2810f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:51.508754 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb406407-79cf-44ba-b832-297b43d2810f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:51.509205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb406407-79cf-44ba-b832-297b43d2810f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:51.509900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb406407-79cf-44ba-b832-297b43d2810f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:51.510349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb406407-79cf-44ba-b832-297b43d2810f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:51.510774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb406407-79cf-44ba-b832-297b43d2810f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:51.648571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eb406407-79cf-44ba-b832-297b43d2810f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:51.657121 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eb406407-79cf-44ba-b832-297b43d2810f tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1511 microversion: 2.1 time: 0.161300 Oct 18 14:23:51.657773 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3523/7249] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:51 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:52.684378 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2c12876a-6394-4f19-a7fb-dc8fcc9d6ba9 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:52.685101 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2c12876a-6394-4f19-a7fb-dc8fcc9d6ba9 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:52.690355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-91e51e11-8168-4c82-9e82-9b2e0f0f53c1 req-75db5cd8-4265-415f-acc6-57ad0b0be3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea1040c-b71c-471f-ba41-c4edb29b6157", "name": "network-vif-deleted", "tag": "ecb01ba0-30e3-4117-aa11-3625ac24da91"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:23:52.694166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c12876a-6394-4f19-a7fb-dc8fcc9d6ba9 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:52.694595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c12876a-6394-4f19-a7fb-dc8fcc9d6ba9 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:52.695058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c12876a-6394-4f19-a7fb-dc8fcc9d6ba9 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:52.695782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c12876a-6394-4f19-a7fb-dc8fcc9d6ba9 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:52.696256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c12876a-6394-4f19-a7fb-dc8fcc9d6ba9 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:52.696699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2c12876a-6394-4f19-a7fb-dc8fcc9d6ba9 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:52.716960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-91e51e11-8168-4c82-9e82-9b2e0f0f53c1 req-75db5cd8-4265-415f-acc6-57ad0b0be3b9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:52.720578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-91e51e11-8168-4c82-9e82-9b2e0f0f53c1 req-75db5cd8-4265-415f-acc6-57ad0b0be3b9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:52.721387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-91e51e11-8168-4c82-9e82-9b2e0f0f53c1 req-75db5cd8-4265-415f-acc6-57ad0b0be3b9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:52.756024 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-91e51e11-8168-4c82-9e82-9b2e0f0f53c1 req-75db5cd8-4265-415f-acc6-57ad0b0be3b9 service nova] Creating event network-vif-deleted:ecb01ba0-30e3-4117-aa11-3625ac24da91 for instance 7ea1040c-b71c-471f-ba41-c4edb29b6157 on n-h1-858384-13 Oct 18 14:23:52.764053 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-91e51e11-8168-4c82-9e82-9b2e0f0f53c1 req-75db5cd8-4265-415f-acc6-57ad0b0be3b9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079033 Oct 18 14:23:52.771510 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3524/7250] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:23:52.782810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2c12876a-6394-4f19-a7fb-dc8fcc9d6ba9 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a781140eda4307a7846031a50b1fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f8136931b54b60ac1e1ad11de19b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:23:52.791845 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2c12876a-6394-4f19-a7fb-dc8fcc9d6ba9 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 200 len: 1469 microversion: 2.1 time: 0.115384 Oct 18 14:23:52.792432 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3727/7251] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:52 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 1469 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:23:53.818947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0a68da99-59f9-4a82-a959-267f1815b104 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:23:53.819794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0a68da99-59f9-4a82-a959-267f1815b104 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] [instance: 7ea1040c-b71c-471f-ba41-c4edb29b6157] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:23:53.826116 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a68da99-59f9-4a82-a959-267f1815b104 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:53.826593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a68da99-59f9-4a82-a959-267f1815b104 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:53.827026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a68da99-59f9-4a82-a959-267f1815b104 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:53.827715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a68da99-59f9-4a82-a959-267f1815b104 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:23:53.828157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a68da99-59f9-4a82-a959-267f1815b104 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:23:53.828575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a68da99-59f9-4a82-a959-267f1815b104 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:23:53.844119 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-0a68da99-59f9-4a82-a959-267f1815b104 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] HTTP exception thrown: Instance 7ea1040c-b71c-471f-ba41-c4edb29b6157 could not be found. Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0a68da99-59f9-4a82-a959-267f1815b104 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Request method failure captured: Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 HTTP/1.1 Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrbbzVSNxU6jdE5gLt_iwiy4q-As_9SzGQ-ta1n61spE-nUHjV5YH1yBIkQL2CLajOPhBjQQhVtFVSdsEQygc0fynHQkMvRGxN-Qi8tzJBToOChXAhezRLDsFwB3QmgSD3Y9QSXbSkNENy4J8DGfhKEchZHxW4e63j9aV-YX9BsuoCM Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37f8136931b54b60ac1e1ad11de19b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37f8136931b54b60ac1e1ad11de19b99"}]}] Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 37f8136931b54b60ac1e1ad11de19b99 Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1331605314 Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 68a781140eda4307a7846031a50b1fef Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-ServersNegativeTestJSON-1331605314-project Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 7ea1040c-b71c-471f-ba41-c4edb29b6157 could not be found. Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '7ea1040c-b71c-471f-ba41-c4edb29b6157'} Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea1040c-b71c-471f-ba41-c4edb29b6157 could not be found. Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea1040c-b71c-471f-ba41-c4edb29b6157 could not be found. Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:23:53.846101 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:53.850391 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:23:53.850391 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:23:53.850391 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:23:53.850391 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:23:53.850391 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:23:53.850391 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea1040c-b71c-471f-ba41-c4edb29b6157 could not be found. Oct 18 14:23:53.850391 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:23:53.850391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0a68da99-59f9-4a82-a959-267f1815b104 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] Returning 404 to user: Instance 7ea1040c-b71c-471f-ba41-c4edb29b6157 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:23:53.850391 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0a68da99-59f9-4a82-a959-267f1815b104 tempest-ServersNegativeTestJSON-1331605314 tempest-ServersNegativeTestJSON-1331605314-project] 10.222.0.40 "GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157" status: 404 len: 111 microversion: 2.1 time: 0.036202 Oct 18 14:23:53.850391 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3525/7252] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:23:53 2022] GET /compute/v2.1/servers/7ea1040c-b71c-471f-ba41-c4edb29b6157 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:24:25.439316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:25.440549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:25.619752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-86d21471-921b-434c-8c4a-a357bd867a37 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Action: 'create', calling method: .version_select at 0x7ff60eef43a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1234667507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhJ7jNHZ0mH6VzD4Qv+RblQvtVODS+1zrSH90Uz0CHP4LTbEOjvdGJo5SkI/e8Mghw+3CjsN7TIR7OkhpogSFSDG8PGBFoZPFQJBAbFHgkSb/4PgQ9YUtNmJj2BucdI4g=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:25.636862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-86d21471-921b-434c-8c4a-a357bd867a37 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Getting quotas for project 053733f3ec1d41cc932057b4c61d18da. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:24:25.643137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-86d21471-921b-434c-8c4a-a357bd867a37 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Getting quotas for user 9ec8c194d52448479a1704d590ef4186 and project 053733f3ec1d41cc932057b4c61d18da. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:24:25.673761 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-86d21471-921b-434c-8c4a-a357bd867a37 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.239851 Oct 18 14:24:25.674384 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3728/7253] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:24:25 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:25.725549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-80124557", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1234667507", "networks": [{"uuid": "aab34363-4482-4ca9-987c-3a0a730423b4"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:25.735666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:25.736323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:25.784141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] validate_networks() for [('aab34363-4482-4ca9-987c-3a0a730423b4', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:24:26.194422 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:24:26.194843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:24:26.195338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:24:26.195749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:24:26.196158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:24:26.206694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:26.207185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:26.207655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:26.208530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:26.209208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:26.210068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:26.230009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Getting quotas for project 053733f3ec1d41cc932057b4c61d18da. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:24:26.235931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Getting quotas for user 9ec8c194d52448479a1704d590ef4186 and project 053733f3ec1d41cc932057b4c61d18da. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:24:26.249260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:24:26.252453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:24:26.301997 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fe9730ea-cc84-4c09-b7b2-88beba731a2b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580189 Oct 18 14:24:26.302574 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3526/7254] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:24:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:24:26.314557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3f77d60d-a64f-4d8c-ab84-e552803ca1ac tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:26.315161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3f77d60d-a64f-4d8c-ab84-e552803ca1ac tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:26.372841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3f77d60d-a64f-4d8c-ab84-e552803ca1ac tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:26.380181 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3f77d60d-a64f-4d8c-ab84-e552803ca1ac tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1261 microversion: 2.1 time: 0.070275 Oct 18 14:24:26.393378 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3729/7255] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:26 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:27.405684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-59986b55-6a80-4e08-8dd3-85a1005b29e7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:27.406365 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-59986b55-6a80-4e08-8dd3-85a1005b29e7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:27.412685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59986b55-6a80-4e08-8dd3-85a1005b29e7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:27.413171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59986b55-6a80-4e08-8dd3-85a1005b29e7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:27.413648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59986b55-6a80-4e08-8dd3-85a1005b29e7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:27.414347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59986b55-6a80-4e08-8dd3-85a1005b29e7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:27.414811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59986b55-6a80-4e08-8dd3-85a1005b29e7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:27.415242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-59986b55-6a80-4e08-8dd3-85a1005b29e7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:27.496618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-59986b55-6a80-4e08-8dd3-85a1005b29e7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:27.513371 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-59986b55-6a80-4e08-8dd3-85a1005b29e7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1313 microversion: 2.1 time: 0.112712 Oct 18 14:24:27.514023 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3527/7256] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:27 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1313 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:28.538584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6a41e40e-be93-4447-987e-3ad481ce2c29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:28.539926 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6a41e40e-be93-4447-987e-3ad481ce2c29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:28.554081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a41e40e-be93-4447-987e-3ad481ce2c29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:28.555737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a41e40e-be93-4447-987e-3ad481ce2c29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:28.556274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a41e40e-be93-4447-987e-3ad481ce2c29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:28.558377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a41e40e-be93-4447-987e-3ad481ce2c29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:28.559107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a41e40e-be93-4447-987e-3ad481ce2c29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:28.559793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a41e40e-be93-4447-987e-3ad481ce2c29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:28.728615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6a41e40e-be93-4447-987e-3ad481ce2c29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:28.744924 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6a41e40e-be93-4447-987e-3ad481ce2c29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1361 microversion: 2.1 time: 0.210395 Oct 18 14:24:28.745493 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3730/7257] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:28 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:29.124082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-727a9b91-3bf4-48ae-a79b-2e3f3d77470c req-3ba8805e-4723-4a18-a101-41c64600f19e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0", "tag": "24656dee-110e-4231-9678-86dcd92b1c7d"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:29.144499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-727a9b91-3bf4-48ae-a79b-2e3f3d77470c req-3ba8805e-4723-4a18-a101-41c64600f19e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:29.144978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-727a9b91-3bf4-48ae-a79b-2e3f3d77470c req-3ba8805e-4723-4a18-a101-41c64600f19e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:29.145648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-727a9b91-3bf4-48ae-a79b-2e3f3d77470c req-3ba8805e-4723-4a18-a101-41c64600f19e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:29.160412 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-727a9b91-3bf4-48ae-a79b-2e3f3d77470c req-3ba8805e-4723-4a18-a101-41c64600f19e service nova] Creating event network-changed:24656dee-110e-4231-9678-86dcd92b1c7d for instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 on n-h1-858384-13 Oct 18 14:24:29.168720 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-727a9b91-3bf4-48ae-a79b-2e3f3d77470c req-3ba8805e-4723-4a18-a101-41c64600f19e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050225 Oct 18 14:24:29.169468 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3528/7258] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:29.768480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f4e48425-060a-4392-927f-64292a3543f5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:29.769037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f4e48425-060a-4392-927f-64292a3543f5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:29.776030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4e48425-060a-4392-927f-64292a3543f5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:29.776524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4e48425-060a-4392-927f-64292a3543f5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:29.776969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4e48425-060a-4392-927f-64292a3543f5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:29.777690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4e48425-060a-4392-927f-64292a3543f5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:29.778153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4e48425-060a-4392-927f-64292a3543f5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:29.778588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4e48425-060a-4392-927f-64292a3543f5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:29.914804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f4e48425-060a-4392-927f-64292a3543f5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:29.926202 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f4e48425-060a-4392-927f-64292a3543f5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1361 microversion: 2.1 time: 0.158911 Oct 18 14:24:29.926202 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3731/7259] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:29 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:30.947594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-02024166-7cc3-41c2-b571-a459e2003dc2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:30.948215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-02024166-7cc3-41c2-b571-a459e2003dc2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:30.955454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02024166-7cc3-41c2-b571-a459e2003dc2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:30.955935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02024166-7cc3-41c2-b571-a459e2003dc2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:30.956375 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02024166-7cc3-41c2-b571-a459e2003dc2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:30.957064 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02024166-7cc3-41c2-b571-a459e2003dc2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:30.957552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02024166-7cc3-41c2-b571-a459e2003dc2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:30.957983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-02024166-7cc3-41c2-b571-a459e2003dc2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:31.093424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-02024166-7cc3-41c2-b571-a459e2003dc2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:31.102328 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-02024166-7cc3-41c2-b571-a459e2003dc2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1361 microversion: 2.1 time: 0.159902 Oct 18 14:24:31.102922 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3529/7260] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:30 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:32.125693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-adaf9cc9-c4ba-418d-aa9f-2554015bdf02 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:32.126883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-adaf9cc9-c4ba-418d-aa9f-2554015bdf02 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:32.134436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adaf9cc9-c4ba-418d-aa9f-2554015bdf02 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:32.135028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adaf9cc9-c4ba-418d-aa9f-2554015bdf02 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:32.135482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adaf9cc9-c4ba-418d-aa9f-2554015bdf02 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:32.136198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adaf9cc9-c4ba-418d-aa9f-2554015bdf02 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:32.136700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adaf9cc9-c4ba-418d-aa9f-2554015bdf02 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:32.137153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-adaf9cc9-c4ba-418d-aa9f-2554015bdf02 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:32.309007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-adaf9cc9-c4ba-418d-aa9f-2554015bdf02 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:32.318236 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-adaf9cc9-c4ba-418d-aa9f-2554015bdf02 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1361 microversion: 2.1 time: 0.197219 Oct 18 14:24:32.318839 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3732/7261] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:32 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:33.343275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-12135ba0-deaf-4c76-bd41-81254046b4a3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:33.344141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-12135ba0-deaf-4c76-bd41-81254046b4a3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:33.351603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12135ba0-deaf-4c76-bd41-81254046b4a3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:33.352035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12135ba0-deaf-4c76-bd41-81254046b4a3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:33.352439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12135ba0-deaf-4c76-bd41-81254046b4a3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:33.353141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12135ba0-deaf-4c76-bd41-81254046b4a3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:33.353633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12135ba0-deaf-4c76-bd41-81254046b4a3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:33.354059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12135ba0-deaf-4c76-bd41-81254046b4a3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:33.504402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-12135ba0-deaf-4c76-bd41-81254046b4a3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:33.513272 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-12135ba0-deaf-4c76-bd41-81254046b4a3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1361 microversion: 2.1 time: 0.173897 Oct 18 14:24:33.513862 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3530/7262] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:33 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:34.538812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0fafd4e9-76e6-4df3-b94c-50ec3344f8d2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:34.539438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0fafd4e9-76e6-4df3-b94c-50ec3344f8d2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:34.546289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fafd4e9-76e6-4df3-b94c-50ec3344f8d2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:34.547300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fafd4e9-76e6-4df3-b94c-50ec3344f8d2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:34.547960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fafd4e9-76e6-4df3-b94c-50ec3344f8d2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:34.548663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fafd4e9-76e6-4df3-b94c-50ec3344f8d2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:34.549127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fafd4e9-76e6-4df3-b94c-50ec3344f8d2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:34.549586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fafd4e9-76e6-4df3-b94c-50ec3344f8d2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:34.691884 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0fafd4e9-76e6-4df3-b94c-50ec3344f8d2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:34.700516 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0fafd4e9-76e6-4df3-b94c-50ec3344f8d2 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1361 microversion: 2.1 time: 0.165593 Oct 18 14:24:34.701125 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3733/7263] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:34 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:35.525476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-0489e315-7c19-444c-a86a-cf41c27b0801 req-12ce648b-5b42-4b7c-8860-9d75fdcd9b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0", "name": "network-vif-plugged", "status": "completed", "tag": "24656dee-110e-4231-9678-86dcd92b1c7d"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:35.536486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0489e315-7c19-444c-a86a-cf41c27b0801 req-12ce648b-5b42-4b7c-8860-9d75fdcd9b68 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:35.536968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0489e315-7c19-444c-a86a-cf41c27b0801 req-12ce648b-5b42-4b7c-8860-9d75fdcd9b68 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:35.537557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0489e315-7c19-444c-a86a-cf41c27b0801 req-12ce648b-5b42-4b7c-8860-9d75fdcd9b68 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:35.550104 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0489e315-7c19-444c-a86a-cf41c27b0801 req-12ce648b-5b42-4b7c-8860-9d75fdcd9b68 service nova] Creating event network-vif-plugged:24656dee-110e-4231-9678-86dcd92b1c7d for instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 on n-h1-858384-13 Oct 18 14:24:35.555633 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-0489e315-7c19-444c-a86a-cf41c27b0801 req-12ce648b-5b42-4b7c-8860-9d75fdcd9b68 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033686 Oct 18 14:24:35.556335 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3531/7264] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:35.724996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6ad077b9-11d9-4841-b452-c34b8f9329ce tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:35.725689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6ad077b9-11d9-4841-b452-c34b8f9329ce tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:35.735223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ad077b9-11d9-4841-b452-c34b8f9329ce tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:35.736398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ad077b9-11d9-4841-b452-c34b8f9329ce tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:35.738191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ad077b9-11d9-4841-b452-c34b8f9329ce tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:35.739529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ad077b9-11d9-4841-b452-c34b8f9329ce tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:35.739529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ad077b9-11d9-4841-b452-c34b8f9329ce tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:35.742547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6ad077b9-11d9-4841-b452-c34b8f9329ce tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:35.911397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6ad077b9-11d9-4841-b452-c34b8f9329ce tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:35.920946 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6ad077b9-11d9-4841-b452-c34b8f9329ce tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1361 microversion: 2.1 time: 0.200429 Oct 18 14:24:35.922116 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3734/7265] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:35 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1361 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:36.943004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:36.943841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:36.948994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-56e47d93-1998-4221-833a-702fdbb39af6 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:36.949740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-56e47d93-1998-4221-833a-702fdbb39af6 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:36.957749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56e47d93-1998-4221-833a-702fdbb39af6 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:36.958242 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56e47d93-1998-4221-833a-702fdbb39af6 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:36.958686 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56e47d93-1998-4221-833a-702fdbb39af6 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:36.959637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56e47d93-1998-4221-833a-702fdbb39af6 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:36.960099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56e47d93-1998-4221-833a-702fdbb39af6 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:36.960527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56e47d93-1998-4221-833a-702fdbb39af6 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:37.147017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-56e47d93-1998-4221-833a-702fdbb39af6 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:37.155548 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-56e47d93-1998-4221-833a-702fdbb39af6 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1361 microversion: 2.1 time: 0.213577 Oct 18 14:24:37.156776 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3532/7266] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:36 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:38.183073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aa353ea6-18ef-41eb-9c7b-da0d03e5ede9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:38.183706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aa353ea6-18ef-41eb-9c7b-da0d03e5ede9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:38.185707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:38.192495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa353ea6-18ef-41eb-9c7b-da0d03e5ede9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:38.192997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa353ea6-18ef-41eb-9c7b-da0d03e5ede9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:38.193469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa353ea6-18ef-41eb-9c7b-da0d03e5ede9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:38.194180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa353ea6-18ef-41eb-9c7b-da0d03e5ede9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:38.194645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa353ea6-18ef-41eb-9c7b-da0d03e5ede9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:38.195080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa353ea6-18ef-41eb-9c7b-da0d03e5ede9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:38.338324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aa353ea6-18ef-41eb-9c7b-da0d03e5ede9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:38.347573 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aa353ea6-18ef-41eb-9c7b-da0d03e5ede9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1553 microversion: 2.1 time: 0.169147 Oct 18 14:24:38.348162 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3735/7267] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:38 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:38.371960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-143c7daa-031f-47ac-94b6-d99eb17b218a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:38.372665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-143c7daa-031f-47ac-94b6-d99eb17b218a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:38.381427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-143c7daa-031f-47ac-94b6-d99eb17b218a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:38.382034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-143c7daa-031f-47ac-94b6-d99eb17b218a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:38.382582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-143c7daa-031f-47ac-94b6-d99eb17b218a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:38.383457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-143c7daa-031f-47ac-94b6-d99eb17b218a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:38.384029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-143c7daa-031f-47ac-94b6-d99eb17b218a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:38.384562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-143c7daa-031f-47ac-94b6-d99eb17b218a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:38.525010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-143c7daa-031f-47ac-94b6-d99eb17b218a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:24:38.533720 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-143c7daa-031f-47ac-94b6-d99eb17b218a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1553 microversion: 2.1 time: 0.167077 Oct 18 14:24:38.534358 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3533/7268] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:24:38 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:24:40.240836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c96edf1b-7cbb-429b-964a-33dbdd1eabd4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed325082-44d3-4d1e-b8b0-cda42c0b855f"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:24:40.243390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c96edf1b-7cbb-429b-964a-33dbdd1eabd4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:40.250716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c96edf1b-7cbb-429b-964a-33dbdd1eabd4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:40.251202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c96edf1b-7cbb-429b-964a-33dbdd1eabd4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:40.251658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c96edf1b-7cbb-429b-964a-33dbdd1eabd4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:40.252380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c96edf1b-7cbb-429b-964a-33dbdd1eabd4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:40.252853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c96edf1b-7cbb-429b-964a-33dbdd1eabd4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:40.253329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c96edf1b-7cbb-429b-964a-33dbdd1eabd4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:40.534679 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c96edf1b-7cbb-429b-964a-33dbdd1eabd4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "POST /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297537 Oct 18 14:24:40.535311 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3736/7269] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 14:24:40 2022] POST /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:51.272160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-339e26b8-5ced-427c-954d-9fd55647b5cc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:51.272701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-339e26b8-5ced-427c-954d-9fd55647b5cc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:51.275300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:51.275967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=36 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:51.282567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-339e26b8-5ced-427c-954d-9fd55647b5cc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:51.283049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-339e26b8-5ced-427c-954d-9fd55647b5cc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:51.283483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-339e26b8-5ced-427c-954d-9fd55647b5cc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:51.284194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-339e26b8-5ced-427c-954d-9fd55647b5cc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:51.285212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-339e26b8-5ced-427c-954d-9fd55647b5cc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:51.285628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-339e26b8-5ced-427c-954d-9fd55647b5cc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:51.365085 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-339e26b8-5ced-427c-954d-9fd55647b5cc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lazy-loading 'services' on Instance uuid 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:24:51.438677 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-339e26b8-5ced-427c-954d-9fd55647b5cc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments/ed325082-44d3-4d1e-b8b0-cda42c0b855f" status: 202 len: 0 microversion: 2.1 time: 0.170790 Oct 18 14:24:51.439279 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3534/7270] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 14:24:51 2022] DELETE /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments/ed325082-44d3-4d1e-b8b0-cda42c0b855f => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:24:51.449986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ecc26c83-3e6c-4b57-b932-e9a95f464a99 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:51.452367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ecc26c83-3e6c-4b57-b932-e9a95f464a99 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:51.455152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:51.456743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:24:51.463316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecc26c83-3e6c-4b57-b932-e9a95f464a99 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:51.463834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecc26c83-3e6c-4b57-b932-e9a95f464a99 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:51.464289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecc26c83-3e6c-4b57-b932-e9a95f464a99 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:51.465011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecc26c83-3e6c-4b57-b932-e9a95f464a99 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:51.465510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecc26c83-3e6c-4b57-b932-e9a95f464a99 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:51.465952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ecc26c83-3e6c-4b57-b932-e9a95f464a99 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:51.501612 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ecc26c83-3e6c-4b57-b932-e9a95f464a99 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057088 Oct 18 14:24:51.505382 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3737/7271] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:24:51 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:52.516145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-124c2c38-0cf4-44b0-bf89-3d5d8ea11769 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:52.518435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-124c2c38-0cf4-44b0-bf89-3d5d8ea11769 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:52.525266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-124c2c38-0cf4-44b0-bf89-3d5d8ea11769 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:52.525691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-124c2c38-0cf4-44b0-bf89-3d5d8ea11769 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:52.526129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-124c2c38-0cf4-44b0-bf89-3d5d8ea11769 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:52.526834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-124c2c38-0cf4-44b0-bf89-3d5d8ea11769 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:52.527284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-124c2c38-0cf4-44b0-bf89-3d5d8ea11769 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:52.527708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-124c2c38-0cf4-44b0-bf89-3d5d8ea11769 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:52.559814 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-124c2c38-0cf4-44b0-bf89-3d5d8ea11769 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049007 Oct 18 14:24:52.560388 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3535/7272] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:24:52 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:53.572225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-37d5a9b7-6c6b-4d4c-bfc8-df726d5e88ea tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:53.574548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-37d5a9b7-6c6b-4d4c-bfc8-df726d5e88ea tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:53.582696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d5a9b7-6c6b-4d4c-bfc8-df726d5e88ea tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:53.583220 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d5a9b7-6c6b-4d4c-bfc8-df726d5e88ea tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:53.583674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d5a9b7-6c6b-4d4c-bfc8-df726d5e88ea tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:53.584422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d5a9b7-6c6b-4d4c-bfc8-df726d5e88ea tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:53.585165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d5a9b7-6c6b-4d4c-bfc8-df726d5e88ea tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:53.585613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37d5a9b7-6c6b-4d4c-bfc8-df726d5e88ea tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:53.619876 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-37d5a9b7-6c6b-4d4c-bfc8-df726d5e88ea tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051739 Oct 18 14:24:53.620485 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3738/7273] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:24:53 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:54.632252 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9bae7028-2bee-4c06-a346-d8c98b62387a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:54.634453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9bae7028-2bee-4c06-a346-d8c98b62387a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:54.641494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9bae7028-2bee-4c06-a346-d8c98b62387a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:54.641974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9bae7028-2bee-4c06-a346-d8c98b62387a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:54.642408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9bae7028-2bee-4c06-a346-d8c98b62387a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:54.643106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9bae7028-2bee-4c06-a346-d8c98b62387a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:54.643587 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9bae7028-2bee-4c06-a346-d8c98b62387a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:54.644018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9bae7028-2bee-4c06-a346-d8c98b62387a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:54.675856 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9bae7028-2bee-4c06-a346-d8c98b62387a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046851 Oct 18 14:24:54.676534 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3536/7274] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:24:54 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:55.688130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6d73479f-d2bc-4537-a526-6c08b456eaac tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:55.691327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6d73479f-d2bc-4537-a526-6c08b456eaac tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:55.698376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d73479f-d2bc-4537-a526-6c08b456eaac tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:55.698869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d73479f-d2bc-4537-a526-6c08b456eaac tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:55.699314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d73479f-d2bc-4537-a526-6c08b456eaac tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:55.700019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d73479f-d2bc-4537-a526-6c08b456eaac tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:55.700486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d73479f-d2bc-4537-a526-6c08b456eaac tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:55.700925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6d73479f-d2bc-4537-a526-6c08b456eaac tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:55.732687 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6d73479f-d2bc-4537-a526-6c08b456eaac tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048491 Oct 18 14:24:55.733283 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3739/7275] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:24:55 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:24:56.746243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-50a3a670-b048-417f-b38e-537129141496 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:56.748407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-50a3a670-b048-417f-b38e-537129141496 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:56.755069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50a3a670-b048-417f-b38e-537129141496 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:56.755548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50a3a670-b048-417f-b38e-537129141496 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:56.755987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50a3a670-b048-417f-b38e-537129141496 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:56.756681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50a3a670-b048-417f-b38e-537129141496 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:56.757133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50a3a670-b048-417f-b38e-537129141496 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:56.757592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-50a3a670-b048-417f-b38e-537129141496 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:56.786933 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-50a3a670-b048-417f-b38e-537129141496 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045455 Oct 18 14:24:56.787500 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3537/7276] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:24:56 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:24:56.798295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1c78588b-a775-4aec-8068-ec06761e1b96 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:24:56.798839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1c78588b-a775-4aec-8068-ec06761e1b96 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:24:56.805900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c78588b-a775-4aec-8068-ec06761e1b96 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:56.806397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c78588b-a775-4aec-8068-ec06761e1b96 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:56.806850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c78588b-a775-4aec-8068-ec06761e1b96 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:56.807561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c78588b-a775-4aec-8068-ec06761e1b96 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:24:56.808030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c78588b-a775-4aec-8068-ec06761e1b96 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:24:56.808475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c78588b-a775-4aec-8068-ec06761e1b96 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:24:56.890043 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-1c78588b-a775-4aec-8068-ec06761e1b96 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] HTTP exception thrown: Instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 is not attached to volume ed325082-44d3-4d1e-b8b0-cda42c0b855f Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1c78588b-a775-4aec-8068-ec06761e1b96 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Request method failure captured: Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments/ed325082-44d3-4d1e-b8b0-cda42c0b855f HTTP/1.1 Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrcT_lJ3JjImyFr04yPFpBjPPjEr0tE4-MWpaoaMEyCnnGs1us_jm7WE5EmvhPgULX-lxZy5jFhuF3cTLJXxjbnqNsw_0xx2cHzmhKynnv2PmUzm_w36-yXJmSaYB7MqY6IqxsF7jKDeejR3rFEV9SwVTqQclfgkJpSmYHfLwCnWyts Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 053733f3ec1d41cc932057b4c61d18da Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_053733f3ec1d41cc932057b4c61d18da"}]}] Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 053733f3ec1d41cc932057b4c61d18da Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestEncryptedCinderVolumes-1957851883-project Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 9ec8c194d52448479a1704d590ef4186 Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestEncryptedCinderVolumes-1957851883-project Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 is not attached to volume ed325082-44d3-4d1e-b8b0-cda42c0b855f Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'server_id': '0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0', 'id': 'ed325082-44d3-4d1e-b8b0-cda42c0b855f'} Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ed325082-44d3-4d1e-b8b0-cda42c0b855f. Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 is not attached to volume ed325082-44d3-4d1e-b8b0-cda42c0b855f Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:24:56.900464 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:24:56.904609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:24:56.904609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:24:56.904609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 is not attached to volume ed325082-44d3-4d1e-b8b0-cda42c0b855f Oct 18 14:24:56.904609 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:24:56.904609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1c78588b-a775-4aec-8068-ec06761e1b96 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Returning 404 to user: Instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 is not attached to volume ed325082-44d3-4d1e-b8b0-cda42c0b855f {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:24:56.904609 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1c78588b-a775-4aec-8068-ec06761e1b96 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments/ed325082-44d3-4d1e-b8b0-cda42c0b855f" status: 404 len: 154 microversion: 2.1 time: 0.107912 Oct 18 14:24:56.904609 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3740/7277] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 14:24:56 2022] DELETE /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0/os-volume_attachments/ed325082-44d3-4d1e-b8b0-cda42c0b855f => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:25:00.261360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9155ac95-2b43-412f-8b66-875d39735e0c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:00.261937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9155ac95-2b43-412f-8b66-875d39735e0c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:00.268928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9155ac95-2b43-412f-8b66-875d39735e0c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:00.269461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9155ac95-2b43-412f-8b66-875d39735e0c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:00.269896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9155ac95-2b43-412f-8b66-875d39735e0c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:00.270604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9155ac95-2b43-412f-8b66-875d39735e0c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:00.271048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9155ac95-2b43-412f-8b66-875d39735e0c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:00.271469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9155ac95-2b43-412f-8b66-875d39735e0c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:00.307955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9155ac95-2b43-412f-8b66-875d39735e0c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:25:00.390332 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9155ac95-2b43-412f-8b66-875d39735e0c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 204 len: 0 microversion: 2.1 time: 0.132704 Oct 18 14:25:00.394379 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3538/7278] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:25:00 2022] DELETE /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:25:00.400758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-198da94f-6ca5-4f42-95dc-99ccb6d622f1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:00.401423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-198da94f-6ca5-4f42-95dc-99ccb6d622f1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:00.408426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-198da94f-6ca5-4f42-95dc-99ccb6d622f1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:00.409524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-198da94f-6ca5-4f42-95dc-99ccb6d622f1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:00.410054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-198da94f-6ca5-4f42-95dc-99ccb6d622f1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:00.410770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-198da94f-6ca5-4f42-95dc-99ccb6d622f1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:00.411252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-198da94f-6ca5-4f42-95dc-99ccb6d622f1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:00.411694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-198da94f-6ca5-4f42-95dc-99ccb6d622f1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:00.551712 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-198da94f-6ca5-4f42-95dc-99ccb6d622f1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:00.559732 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-198da94f-6ca5-4f42-95dc-99ccb6d622f1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1559 microversion: 2.1 time: 0.163864 Oct 18 14:25:00.560316 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3741/7279] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:00 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:01.584785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cccfcbd0-1c8b-4506-bc75-ac52a2ccf20b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:01.585784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cccfcbd0-1c8b-4506-bc75-ac52a2ccf20b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:01.592888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cccfcbd0-1c8b-4506-bc75-ac52a2ccf20b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:01.593520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cccfcbd0-1c8b-4506-bc75-ac52a2ccf20b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:01.593972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cccfcbd0-1c8b-4506-bc75-ac52a2ccf20b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:01.594674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cccfcbd0-1c8b-4506-bc75-ac52a2ccf20b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:01.595125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cccfcbd0-1c8b-4506-bc75-ac52a2ccf20b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:01.595546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cccfcbd0-1c8b-4506-bc75-ac52a2ccf20b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:01.731230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cccfcbd0-1c8b-4506-bc75-ac52a2ccf20b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:01.740328 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cccfcbd0-1c8b-4506-bc75-ac52a2ccf20b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1559 microversion: 2.1 time: 0.160120 Oct 18 14:25:01.740769 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3539/7280] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:01 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:02.763839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0d9b6b00-193a-422d-b96f-93016341c92b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:02.764467 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0d9b6b00-193a-422d-b96f-93016341c92b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:02.772701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d9b6b00-193a-422d-b96f-93016341c92b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:02.773230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d9b6b00-193a-422d-b96f-93016341c92b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:02.773754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d9b6b00-193a-422d-b96f-93016341c92b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:02.774480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d9b6b00-193a-422d-b96f-93016341c92b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:02.774947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d9b6b00-193a-422d-b96f-93016341c92b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:02.775384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0d9b6b00-193a-422d-b96f-93016341c92b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:02.865095 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a3271b3f-969d-4c70-9932-d629fdac7e21 req-c48e9258-db83-4eca-abd8-904559234e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0", "name": "network-vif-deleted", "tag": "24656dee-110e-4231-9678-86dcd92b1c7d"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:02.876732 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a3271b3f-969d-4c70-9932-d629fdac7e21 req-c48e9258-db83-4eca-abd8-904559234e8e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:02.877227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a3271b3f-969d-4c70-9932-d629fdac7e21 req-c48e9258-db83-4eca-abd8-904559234e8e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:02.878174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a3271b3f-969d-4c70-9932-d629fdac7e21 req-c48e9258-db83-4eca-abd8-904559234e8e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:02.891909 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a3271b3f-969d-4c70-9932-d629fdac7e21 req-c48e9258-db83-4eca-abd8-904559234e8e service nova] Creating event network-vif-deleted:24656dee-110e-4231-9678-86dcd92b1c7d for instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 on n-h1-858384-13 Oct 18 14:25:02.898492 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a3271b3f-969d-4c70-9932-d629fdac7e21 req-c48e9258-db83-4eca-abd8-904559234e8e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037337 Oct 18 14:25:02.903454 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3540/7281] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:25:02.978668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0d9b6b00-193a-422d-b96f-93016341c92b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:02.988324 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0d9b6b00-193a-422d-b96f-93016341c92b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 200 len: 1517 microversion: 2.1 time: 0.228338 Oct 18 14:25:02.989101 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3742/7282] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:02 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 1517 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:04.013781 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0fc7e89-90e2-4ef8-b88e-22538511ae01 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:04.014462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c0fc7e89-90e2-4ef8-b88e-22538511ae01 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:04.021295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fc7e89-90e2-4ef8-b88e-22538511ae01 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:04.021778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fc7e89-90e2-4ef8-b88e-22538511ae01 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:04.022212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fc7e89-90e2-4ef8-b88e-22538511ae01 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:04.022896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fc7e89-90e2-4ef8-b88e-22538511ae01 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:04.023373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fc7e89-90e2-4ef8-b88e-22538511ae01 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:04.023792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c0fc7e89-90e2-4ef8-b88e-22538511ae01 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:04.037911 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-c0fc7e89-90e2-4ef8-b88e-22538511ae01 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] HTTP exception thrown: Instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 could not be found. Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0fc7e89-90e2-4ef8-b88e-22538511ae01 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Request method failure captured: Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 HTTP/1.1 Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrcT_lJ3JjImyFr04yPFpBjPPjEr0tE4-MWpaoaMEyCnnGs1us_jm7WE5EmvhPgULX-lxZy5jFhuF3cTLJXxjbnqNsw_0xx2cHzmhKynnv2PmUzm_w36-yXJmSaYB7MqY6IqxsF7jKDeejR3rFEV9SwVTqQclfgkJpSmYHfLwCnWyts Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 053733f3ec1d41cc932057b4c61d18da Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_053733f3ec1d41cc932057b4c61d18da"}]}] Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 053733f3ec1d41cc932057b4c61d18da Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestEncryptedCinderVolumes-1957851883-project Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9ec8c194d52448479a1704d590ef4186 Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestEncryptedCinderVolumes-1957851883-project Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 could not be found. Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0'} Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 could not be found. Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 could not be found. Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:25:04.039534 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:25:04.044355 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:25:04.044355 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:25:04.044355 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:25:04.044355 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:25:04.044355 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:25:04.044355 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:25:04.044355 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 could not be found. Oct 18 14:25:04.044355 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:25:04.044355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c0fc7e89-90e2-4ef8-b88e-22538511ae01 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Returning 404 to user: Instance 0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:25:04.044355 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c0fc7e89-90e2-4ef8-b88e-22538511ae01 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0" status: 404 len: 111 microversion: 2.1 time: 0.032772 Oct 18 14:25:04.044355 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3541/7283] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:04 2022] GET /compute/v2.1/servers/0ff99c8a-fbe7-43a1-8b9c-a6afdc2d65d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:25:04.049722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-de6a76da-199d-41f2-a2b2-536aee3a04ec tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '.version_select at 0x7ff614276430>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:04.070608 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-de6a76da-199d-41f2-a2b2-536aee3a04ec tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1234667507" status: 202 len: 0 microversion: 2.1 time: 0.024719 Oct 18 14:25:04.071232 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3743/7284] 10.222.0.40 () {58 vars in 1278 bytes} [Tue Oct 18 14:25:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1234667507 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:25:04.089223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e9236b5d-3693-4dea-b487-204074401e4c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Action: 'create', calling method: .version_select at 0x7ff60f73b280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-933948318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQ0sfRIhO8JzLSkSAQfqzuF5iE+zR3GwSRJkCWYmJEl0KDfPN9Q8wpDQ1KIM8putdPUWHXCJWEkoh5PHdrhFj2W8KXinJyRnGEViJVWBzpM3prK8F7O4x6iKjBi4TZAdg=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:04.105510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e9236b5d-3693-4dea-b487-204074401e4c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Getting quotas for project 053733f3ec1d41cc932057b4c61d18da. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:25:04.110954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e9236b5d-3693-4dea-b487-204074401e4c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Getting quotas for user 9ec8c194d52448479a1704d590ef4186 and project 053733f3ec1d41cc932057b4c61d18da. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:25:04.134920 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e9236b5d-3693-4dea-b487-204074401e4c tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049903 Oct 18 14:25:04.135526 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3542/7285] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:25:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:04.186205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1285261156", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-933948318", "networks": [{"uuid": "aab34363-4482-4ca9-987c-3a0a730423b4"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:04.239913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] validate_networks() for [('aab34363-4482-4ca9-987c-3a0a730423b4', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:25:04.622080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:25:04.622552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:25:04.623050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:25:04.623479 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:25:04.623912 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:25:04.633784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:04.634277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:04.634722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:04.635453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:04.635914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:04.636349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:04.654642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Getting quotas for project 053733f3ec1d41cc932057b4c61d18da. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:25:04.660024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Getting quotas for user 9ec8c194d52448479a1704d590ef4186 and project 053733f3ec1d41cc932057b4c61d18da. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:25:04.672354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:25:04.675202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:25:04.722169 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6de7241e-7398-47d3-8639-c3ddc6fb416e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539780 Oct 18 14:25:04.722805 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3744/7286] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:25:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:25:04.734149 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f45bdeb3-540a-4286-8f48-b5fab5dbc4d9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:04.734823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f45bdeb3-540a-4286-8f48-b5fab5dbc4d9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:04.848520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f45bdeb3-540a-4286-8f48-b5fab5dbc4d9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:04.856519 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f45bdeb3-540a-4286-8f48-b5fab5dbc4d9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1262 microversion: 2.1 time: 0.126458 Oct 18 14:25:04.866018 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3543/7287] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:04 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1262 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:05.882039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ceb62397-361a-4da4-86e6-c98b0505b005 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:05.882909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ceb62397-361a-4da4-86e6-c98b0505b005 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:05.890176 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ceb62397-361a-4da4-86e6-c98b0505b005 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:05.890674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ceb62397-361a-4da4-86e6-c98b0505b005 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:05.891124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ceb62397-361a-4da4-86e6-c98b0505b005 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:05.891831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ceb62397-361a-4da4-86e6-c98b0505b005 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:05.892325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ceb62397-361a-4da4-86e6-c98b0505b005 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:05.892760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ceb62397-361a-4da4-86e6-c98b0505b005 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:05.959978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ceb62397-361a-4da4-86e6-c98b0505b005 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:05.968056 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ceb62397-361a-4da4-86e6-c98b0505b005 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1332 microversion: 2.1 time: 0.091872 Oct 18 14:25:05.968643 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3745/7288] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:05 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:06.991568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6c50455d-f804-464b-bc3b-0d13ce29b0fc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:06.992172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6c50455d-f804-464b-bc3b-0d13ce29b0fc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:06.999488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c50455d-f804-464b-bc3b-0d13ce29b0fc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:06.999978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c50455d-f804-464b-bc3b-0d13ce29b0fc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:07.000419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c50455d-f804-464b-bc3b-0d13ce29b0fc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:07.001129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c50455d-f804-464b-bc3b-0d13ce29b0fc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:07.001606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c50455d-f804-464b-bc3b-0d13ce29b0fc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:07.002034 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c50455d-f804-464b-bc3b-0d13ce29b0fc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:07.415153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6c50455d-f804-464b-bc3b-0d13ce29b0fc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:07.422924 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6c50455d-f804-464b-bc3b-0d13ce29b0fc tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1362 microversion: 2.1 time: 0.435470 Oct 18 14:25:07.423611 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3544/7289] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:06 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:07.568969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9fe11d8c-1431-4072-85b4-c0e9f018ade3 req-329050af-7ab7-4d9e-a35b-bc5d7402fb61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18104f7b-f5fb-4710-a8f1-d74be9961a17", "tag": "8f55097f-6266-466e-a151-d9267eafc55e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:07.581319 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9fe11d8c-1431-4072-85b4-c0e9f018ade3 req-329050af-7ab7-4d9e-a35b-bc5d7402fb61 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:07.581562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9fe11d8c-1431-4072-85b4-c0e9f018ade3 req-329050af-7ab7-4d9e-a35b-bc5d7402fb61 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:07.581942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9fe11d8c-1431-4072-85b4-c0e9f018ade3 req-329050af-7ab7-4d9e-a35b-bc5d7402fb61 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:07.593692 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9fe11d8c-1431-4072-85b4-c0e9f018ade3 req-329050af-7ab7-4d9e-a35b-bc5d7402fb61 service nova] Creating event network-changed:8f55097f-6266-466e-a151-d9267eafc55e for instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 on n-h1-858384-13 Oct 18 14:25:07.598570 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9fe11d8c-1431-4072-85b4-c0e9f018ade3 req-329050af-7ab7-4d9e-a35b-bc5d7402fb61 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034384 Oct 18 14:25:07.607157 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3746/7290] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:08.446494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-839c0f1f-cdfc-44f7-900e-26514d677b0b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:08.447051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-839c0f1f-cdfc-44f7-900e-26514d677b0b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:08.453893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-839c0f1f-cdfc-44f7-900e-26514d677b0b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:08.454376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-839c0f1f-cdfc-44f7-900e-26514d677b0b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:08.454823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-839c0f1f-cdfc-44f7-900e-26514d677b0b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:08.456053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-839c0f1f-cdfc-44f7-900e-26514d677b0b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:08.456612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-839c0f1f-cdfc-44f7-900e-26514d677b0b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:08.457045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-839c0f1f-cdfc-44f7-900e-26514d677b0b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:08.592423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-839c0f1f-cdfc-44f7-900e-26514d677b0b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:08.601496 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-839c0f1f-cdfc-44f7-900e-26514d677b0b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1362 microversion: 2.1 time: 0.158970 Oct 18 14:25:08.602074 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3545/7291] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:08 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:09.626524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3c89bc6f-a24f-41f9-a9b1-bf1448521557 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:09.627237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3c89bc6f-a24f-41f9-a9b1-bf1448521557 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:09.633584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c89bc6f-a24f-41f9-a9b1-bf1448521557 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:09.634074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c89bc6f-a24f-41f9-a9b1-bf1448521557 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:09.634521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c89bc6f-a24f-41f9-a9b1-bf1448521557 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:09.635223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c89bc6f-a24f-41f9-a9b1-bf1448521557 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:09.635685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c89bc6f-a24f-41f9-a9b1-bf1448521557 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:09.636122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-3c89bc6f-a24f-41f9-a9b1-bf1448521557 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:09.765036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3c89bc6f-a24f-41f9-a9b1-bf1448521557 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:09.773656 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3c89bc6f-a24f-41f9-a9b1-bf1448521557 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1362 microversion: 2.1 time: 0.152216 Oct 18 14:25:09.774241 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3747/7292] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:09 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:10.798257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-95f5166d-58cc-462f-b640-2b279b9d1e1f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:10.798869 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-95f5166d-58cc-462f-b640-2b279b9d1e1f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:10.806011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95f5166d-58cc-462f-b640-2b279b9d1e1f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:10.806487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95f5166d-58cc-462f-b640-2b279b9d1e1f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:10.806918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95f5166d-58cc-462f-b640-2b279b9d1e1f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:10.807601 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95f5166d-58cc-462f-b640-2b279b9d1e1f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:10.808045 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95f5166d-58cc-462f-b640-2b279b9d1e1f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:10.808465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-95f5166d-58cc-462f-b640-2b279b9d1e1f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:10.936836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-95f5166d-58cc-462f-b640-2b279b9d1e1f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:10.944621 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-95f5166d-58cc-462f-b640-2b279b9d1e1f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1362 microversion: 2.1 time: 0.150437 Oct 18 14:25:10.945214 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3546/7293] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:10 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:11.967579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0fa4997c-228a-4fd2-8a91-9dfc4fc4efa5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:11.968213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0fa4997c-228a-4fd2-8a91-9dfc4fc4efa5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:11.976045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa4997c-228a-4fd2-8a91-9dfc4fc4efa5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:11.976546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa4997c-228a-4fd2-8a91-9dfc4fc4efa5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:11.976999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa4997c-228a-4fd2-8a91-9dfc4fc4efa5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:11.977730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa4997c-228a-4fd2-8a91-9dfc4fc4efa5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:11.978201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa4997c-228a-4fd2-8a91-9dfc4fc4efa5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:11.978639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0fa4997c-228a-4fd2-8a91-9dfc4fc4efa5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:12.128326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0fa4997c-228a-4fd2-8a91-9dfc4fc4efa5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:12.136341 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0fa4997c-228a-4fd2-8a91-9dfc4fc4efa5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1362 microversion: 2.1 time: 0.172629 Oct 18 14:25:12.136947 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3748/7294] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:11 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:13.160039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5879bedc-ea54-49f6-8702-6cfac937dd6f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:13.160707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5879bedc-ea54-49f6-8702-6cfac937dd6f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:13.167550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5879bedc-ea54-49f6-8702-6cfac937dd6f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:13.168022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5879bedc-ea54-49f6-8702-6cfac937dd6f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:13.168450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5879bedc-ea54-49f6-8702-6cfac937dd6f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:13.169127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5879bedc-ea54-49f6-8702-6cfac937dd6f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:13.169599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5879bedc-ea54-49f6-8702-6cfac937dd6f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:13.170016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5879bedc-ea54-49f6-8702-6cfac937dd6f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:13.304878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5879bedc-ea54-49f6-8702-6cfac937dd6f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:13.312637 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5879bedc-ea54-49f6-8702-6cfac937dd6f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1362 microversion: 2.1 time: 0.156966 Oct 18 14:25:13.313236 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3547/7295] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:13 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:13.824267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-2bf5869e-b726-4107-8a68-f5431825afa7 req-46b20b07-d44a-4a8e-a354-4f1a2a66a801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18104f7b-f5fb-4710-a8f1-d74be9961a17", "name": "network-vif-plugged", "status": "completed", "tag": "8f55097f-6266-466e-a151-d9267eafc55e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:13.836597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2bf5869e-b726-4107-8a68-f5431825afa7 req-46b20b07-d44a-4a8e-a354-4f1a2a66a801 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:13.837217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2bf5869e-b726-4107-8a68-f5431825afa7 req-46b20b07-d44a-4a8e-a354-4f1a2a66a801 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:13.837672 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2bf5869e-b726-4107-8a68-f5431825afa7 req-46b20b07-d44a-4a8e-a354-4f1a2a66a801 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:13.850090 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-2bf5869e-b726-4107-8a68-f5431825afa7 req-46b20b07-d44a-4a8e-a354-4f1a2a66a801 service nova] Creating event network-vif-plugged:8f55097f-6266-466e-a151-d9267eafc55e for instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 on n-h1-858384-13 Oct 18 14:25:13.855254 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-2bf5869e-b726-4107-8a68-f5431825afa7 req-46b20b07-d44a-4a8e-a354-4f1a2a66a801 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034901 Oct 18 14:25:13.856230 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3749/7296] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:14.335347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4f50658a-3b63-4c23-b3e3-3ac6b5510af3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:14.335876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4f50658a-3b63-4c23-b3e3-3ac6b5510af3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:14.343084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f50658a-3b63-4c23-b3e3-3ac6b5510af3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:14.343563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f50658a-3b63-4c23-b3e3-3ac6b5510af3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:14.343993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f50658a-3b63-4c23-b3e3-3ac6b5510af3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:14.344676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f50658a-3b63-4c23-b3e3-3ac6b5510af3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:14.345122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f50658a-3b63-4c23-b3e3-3ac6b5510af3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:14.345563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4f50658a-3b63-4c23-b3e3-3ac6b5510af3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:14.477833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4f50658a-3b63-4c23-b3e3-3ac6b5510af3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:14.485964 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4f50658a-3b63-4c23-b3e3-3ac6b5510af3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1362 microversion: 2.1 time: 0.155044 Oct 18 14:25:14.486535 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3548/7297] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:14 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:15.507843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:15.508738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:15.514156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac625e20-bfe5-4994-9dd0-02a8b694c15a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:15.514959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ac625e20-bfe5-4994-9dd0-02a8b694c15a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:15.523084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac625e20-bfe5-4994-9dd0-02a8b694c15a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:15.523595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac625e20-bfe5-4994-9dd0-02a8b694c15a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:15.524051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac625e20-bfe5-4994-9dd0-02a8b694c15a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:15.524767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac625e20-bfe5-4994-9dd0-02a8b694c15a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:15.525281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac625e20-bfe5-4994-9dd0-02a8b694c15a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:15.525732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac625e20-bfe5-4994-9dd0-02a8b694c15a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:15.656939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ac625e20-bfe5-4994-9dd0-02a8b694c15a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:15.665406 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ac625e20-bfe5-4994-9dd0-02a8b694c15a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1554 microversion: 2.1 time: 0.158520 Oct 18 14:25:15.665995 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3750/7298] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:15 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:25:15.687849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-79b76662-6437-4bfd-be0a-af94364dfa29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:15.688391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-79b76662-6437-4bfd-be0a-af94364dfa29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:15.690377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:15.697308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79b76662-6437-4bfd-be0a-af94364dfa29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:15.697791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79b76662-6437-4bfd-be0a-af94364dfa29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:15.698228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79b76662-6437-4bfd-be0a-af94364dfa29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:15.698922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79b76662-6437-4bfd-be0a-af94364dfa29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:15.699373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79b76662-6437-4bfd-be0a-af94364dfa29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:15.699798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79b76662-6437-4bfd-be0a-af94364dfa29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:15.834358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-79b76662-6437-4bfd-be0a-af94364dfa29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:15.842467 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-79b76662-6437-4bfd-be0a-af94364dfa29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1554 microversion: 2.1 time: 0.158620 Oct 18 14:25:15.843042 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3549/7299] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:15 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:17.350295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-523f318b-c888-4ffd-b774-a1df7c20b5c4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f456d6fd-5bb4-4da2-a784-29a0b235d752"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:17.352690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-523f318b-c888-4ffd-b774-a1df7c20b5c4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:17.360405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-523f318b-c888-4ffd-b774-a1df7c20b5c4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:17.360909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-523f318b-c888-4ffd-b774-a1df7c20b5c4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:17.361396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-523f318b-c888-4ffd-b774-a1df7c20b5c4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:17.362131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-523f318b-c888-4ffd-b774-a1df7c20b5c4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:17.362582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-523f318b-c888-4ffd-b774-a1df7c20b5c4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:17.363021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-523f318b-c888-4ffd-b774-a1df7c20b5c4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:17.633004 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-523f318b-c888-4ffd-b774-a1df7c20b5c4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "POST /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287232 Oct 18 14:25:17.633744 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3751/7300] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 14:25:17 2022] POST /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:28.350862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-01f30c5a-050b-46ac-bb6f-03ab4bd60c47 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:28.351419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-01f30c5a-050b-46ac-bb6f-03ab4bd60c47 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:28.354472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:28.355176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:28.361504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01f30c5a-050b-46ac-bb6f-03ab4bd60c47 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:28.361979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01f30c5a-050b-46ac-bb6f-03ab4bd60c47 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:28.362419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01f30c5a-050b-46ac-bb6f-03ab4bd60c47 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:28.363098 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01f30c5a-050b-46ac-bb6f-03ab4bd60c47 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:28.363701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01f30c5a-050b-46ac-bb6f-03ab4bd60c47 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:28.364129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01f30c5a-050b-46ac-bb6f-03ab4bd60c47 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:28.448594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-01f30c5a-050b-46ac-bb6f-03ab4bd60c47 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lazy-loading 'services' on Instance uuid 18104f7b-f5fb-4710-a8f1-d74be9961a17 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:25:28.519242 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-01f30c5a-050b-46ac-bb6f-03ab4bd60c47 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "DELETE /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments/f456d6fd-5bb4-4da2-a784-29a0b235d752" status: 202 len: 0 microversion: 2.1 time: 0.173009 Oct 18 14:25:28.519982 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3550/7301] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 14:25:28 2022] DELETE /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments/f456d6fd-5bb4-4da2-a784-29a0b235d752 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:25:28.528847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:28.530281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:28.537625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5547e8d0-9040-46f2-a2ef-88591df68a8f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:28.541117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5547e8d0-9040-46f2-a2ef-88591df68a8f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:28.549674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5547e8d0-9040-46f2-a2ef-88591df68a8f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:28.550169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5547e8d0-9040-46f2-a2ef-88591df68a8f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:28.550616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5547e8d0-9040-46f2-a2ef-88591df68a8f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:28.551316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5547e8d0-9040-46f2-a2ef-88591df68a8f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:28.551779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5547e8d0-9040-46f2-a2ef-88591df68a8f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:28.552317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5547e8d0-9040-46f2-a2ef-88591df68a8f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:28.587885 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5547e8d0-9040-46f2-a2ef-88591df68a8f tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061239 Oct 18 14:25:28.588456 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3752/7302] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:25:28 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:29.600818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a925ba4e-932b-4b57-b0ef-6f8ed6dbae85 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:29.603319 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a925ba4e-932b-4b57-b0ef-6f8ed6dbae85 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:29.611175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a925ba4e-932b-4b57-b0ef-6f8ed6dbae85 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:29.611677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a925ba4e-932b-4b57-b0ef-6f8ed6dbae85 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:29.612104 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a925ba4e-932b-4b57-b0ef-6f8ed6dbae85 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:29.612798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a925ba4e-932b-4b57-b0ef-6f8ed6dbae85 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:29.613360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a925ba4e-932b-4b57-b0ef-6f8ed6dbae85 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:29.613810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a925ba4e-932b-4b57-b0ef-6f8ed6dbae85 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:29.646008 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a925ba4e-932b-4b57-b0ef-6f8ed6dbae85 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049527 Oct 18 14:25:29.647297 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3551/7303] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:25:29 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:25:30.659528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9324c677-bc72-44b6-8279-c64a4116a2e9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:30.661965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9324c677-bc72-44b6-8279-c64a4116a2e9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:30.669555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9324c677-bc72-44b6-8279-c64a4116a2e9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:30.670067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9324c677-bc72-44b6-8279-c64a4116a2e9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:30.670590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9324c677-bc72-44b6-8279-c64a4116a2e9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:30.671328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9324c677-bc72-44b6-8279-c64a4116a2e9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:30.671805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9324c677-bc72-44b6-8279-c64a4116a2e9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:30.672252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9324c677-bc72-44b6-8279-c64a4116a2e9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:30.705851 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9324c677-bc72-44b6-8279-c64a4116a2e9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050375 Oct 18 14:25:30.706608 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3753/7304] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:25:30 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:31.719730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16f994fc-6a4a-4391-9109-c22c2b112211 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:31.721946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-16f994fc-6a4a-4391-9109-c22c2b112211 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:31.729649 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16f994fc-6a4a-4391-9109-c22c2b112211 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:31.730049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16f994fc-6a4a-4391-9109-c22c2b112211 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:31.730482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16f994fc-6a4a-4391-9109-c22c2b112211 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:31.731283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16f994fc-6a4a-4391-9109-c22c2b112211 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:31.731638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16f994fc-6a4a-4391-9109-c22c2b112211 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:31.732059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16f994fc-6a4a-4391-9109-c22c2b112211 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:31.763720 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-16f994fc-6a4a-4391-9109-c22c2b112211 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047922 Oct 18 14:25:31.764308 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3552/7305] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:25:31 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:32.776246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aaac4bf7-9767-4e29-aa38-0e8ffc08c874 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:32.778585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aaac4bf7-9767-4e29-aa38-0e8ffc08c874 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:32.785841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aaac4bf7-9767-4e29-aa38-0e8ffc08c874 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:32.786368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aaac4bf7-9767-4e29-aa38-0e8ffc08c874 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:32.787179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aaac4bf7-9767-4e29-aa38-0e8ffc08c874 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:32.788061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aaac4bf7-9767-4e29-aa38-0e8ffc08c874 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:32.789519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aaac4bf7-9767-4e29-aa38-0e8ffc08c874 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:32.789519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aaac4bf7-9767-4e29-aa38-0e8ffc08c874 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:32.825538 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aaac4bf7-9767-4e29-aa38-0e8ffc08c874 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053366 Oct 18 14:25:32.826147 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3754/7306] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:25:32 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:25:33.838790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c571f71-82ed-4354-8ba5-80febdc11be8 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:33.841094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2c571f71-82ed-4354-8ba5-80febdc11be8 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:33.848244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c571f71-82ed-4354-8ba5-80febdc11be8 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:33.848731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c571f71-82ed-4354-8ba5-80febdc11be8 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:33.849786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c571f71-82ed-4354-8ba5-80febdc11be8 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:33.851024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c571f71-82ed-4354-8ba5-80febdc11be8 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:33.851024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c571f71-82ed-4354-8ba5-80febdc11be8 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:33.851367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c571f71-82ed-4354-8ba5-80febdc11be8 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:33.886370 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2c571f71-82ed-4354-8ba5-80febdc11be8 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051983 Oct 18 14:25:33.886958 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3553/7307] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:25:33 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:25:33.897938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-70c39e91-c4cf-4afd-bb89-73332eff7dd9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:33.898473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-70c39e91-c4cf-4afd-bb89-73332eff7dd9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:33.905368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70c39e91-c4cf-4afd-bb89-73332eff7dd9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:33.905873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70c39e91-c4cf-4afd-bb89-73332eff7dd9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:33.906328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70c39e91-c4cf-4afd-bb89-73332eff7dd9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:33.907041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70c39e91-c4cf-4afd-bb89-73332eff7dd9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:33.907513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70c39e91-c4cf-4afd-bb89-73332eff7dd9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:33.907957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70c39e91-c4cf-4afd-bb89-73332eff7dd9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:33.997988 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-70c39e91-c4cf-4afd-bb89-73332eff7dd9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] HTTP exception thrown: Instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 is not attached to volume f456d6fd-5bb4-4da2-a784-29a0b235d752 Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-70c39e91-c4cf-4afd-bb89-73332eff7dd9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Request method failure captured: Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments/f456d6fd-5bb4-4da2-a784-29a0b235d752 HTTP/1.1 Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrcT_lJ3JjImyFr04yPFpBjPPjEr0tE4-MWpaoaMEyCnnGs1us_jm7WE5EmvhPgULX-lxZy5jFhuF3cTLJXxjbnqNsw_0xx2cHzmhKynnv2PmUzm_w36-yXJmSaYB7MqY6IqxsF7jKDeejR3rFEV9SwVTqQclfgkJpSmYHfLwCnWyts Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 053733f3ec1d41cc932057b4c61d18da Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_053733f3ec1d41cc932057b4c61d18da"}]}] Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 053733f3ec1d41cc932057b4c61d18da Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestEncryptedCinderVolumes-1957851883-project Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 9ec8c194d52448479a1704d590ef4186 Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestEncryptedCinderVolumes-1957851883-project Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 is not attached to volume f456d6fd-5bb4-4da2-a784-29a0b235d752 Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'server_id': '18104f7b-f5fb-4710-a8f1-d74be9961a17', 'id': 'f456d6fd-5bb4-4da2-a784-29a0b235d752'} Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f456d6fd-5bb4-4da2-a784-29a0b235d752. Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 is not attached to volume f456d6fd-5bb4-4da2-a784-29a0b235d752 Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:25:33.999657 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:25:34.008111 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:25:34.008111 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:25:34.008111 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 is not attached to volume f456d6fd-5bb4-4da2-a784-29a0b235d752 Oct 18 14:25:34.008111 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:25:34.008111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-70c39e91-c4cf-4afd-bb89-73332eff7dd9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Returning 404 to user: Instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 is not attached to volume f456d6fd-5bb4-4da2-a784-29a0b235d752 {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:25:34.008111 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-70c39e91-c4cf-4afd-bb89-73332eff7dd9 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "DELETE /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments/f456d6fd-5bb4-4da2-a784-29a0b235d752" status: 404 len: 154 microversion: 2.1 time: 0.107543 Oct 18 14:25:34.008111 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3755/7308] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 14:25:33 2022] DELETE /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17/os-volume_attachments/f456d6fd-5bb4-4da2-a784-29a0b235d752 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:25:37.375229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-caf4fbc7-99b1-47c5-96ac-9df50c3ebc31 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:37.375791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-caf4fbc7-99b1-47c5-96ac-9df50c3ebc31 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:37.383836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caf4fbc7-99b1-47c5-96ac-9df50c3ebc31 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:37.384331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caf4fbc7-99b1-47c5-96ac-9df50c3ebc31 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:37.384765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caf4fbc7-99b1-47c5-96ac-9df50c3ebc31 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:37.385498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caf4fbc7-99b1-47c5-96ac-9df50c3ebc31 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:37.385951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caf4fbc7-99b1-47c5-96ac-9df50c3ebc31 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:37.386374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caf4fbc7-99b1-47c5-96ac-9df50c3ebc31 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:37.417109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-caf4fbc7-99b1-47c5-96ac-9df50c3ebc31 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:25:37.499731 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-caf4fbc7-99b1-47c5-96ac-9df50c3ebc31 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "DELETE /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 204 len: 0 microversion: 2.1 time: 0.128127 Oct 18 14:25:37.500539 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3554/7309] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:25:37 2022] DELETE /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:25:37.509156 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9b4ed8c5-ce90-49ef-bb10-0c9f12fe6495 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:37.509781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9b4ed8c5-ce90-49ef-bb10-0c9f12fe6495 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:37.518471 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b4ed8c5-ce90-49ef-bb10-0c9f12fe6495 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:37.518985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b4ed8c5-ce90-49ef-bb10-0c9f12fe6495 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:37.519446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b4ed8c5-ce90-49ef-bb10-0c9f12fe6495 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:37.520164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b4ed8c5-ce90-49ef-bb10-0c9f12fe6495 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:37.520636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b4ed8c5-ce90-49ef-bb10-0c9f12fe6495 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:37.521080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b4ed8c5-ce90-49ef-bb10-0c9f12fe6495 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:37.658179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b4ed8c5-ce90-49ef-bb10-0c9f12fe6495 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:37.666706 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9b4ed8c5-ce90-49ef-bb10-0c9f12fe6495 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1560 microversion: 2.1 time: 0.162129 Oct 18 14:25:37.667293 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3756/7310] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:37 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:25:38.691351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-58162c2e-75f5-4ce5-997d-dbcc8aa49f04 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:38.692047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-58162c2e-75f5-4ce5-997d-dbcc8aa49f04 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:38.699337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58162c2e-75f5-4ce5-997d-dbcc8aa49f04 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:38.699814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58162c2e-75f5-4ce5-997d-dbcc8aa49f04 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:38.700248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58162c2e-75f5-4ce5-997d-dbcc8aa49f04 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:38.700935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58162c2e-75f5-4ce5-997d-dbcc8aa49f04 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:38.701417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58162c2e-75f5-4ce5-997d-dbcc8aa49f04 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:38.701844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-58162c2e-75f5-4ce5-997d-dbcc8aa49f04 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:38.834247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-58162c2e-75f5-4ce5-997d-dbcc8aa49f04 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:38.842396 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-58162c2e-75f5-4ce5-997d-dbcc8aa49f04 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1560 microversion: 2.1 time: 0.155467 Oct 18 14:25:38.842979 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3555/7311] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:38 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:39.834460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-6a2f5c8c-2818-44b1-8232-eadb4e106a79 req-0777b8db-6e7a-4740-a560-0292e835c9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18104f7b-f5fb-4710-a8f1-d74be9961a17", "name": "network-vif-deleted", "tag": "8f55097f-6266-466e-a151-d9267eafc55e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:39.846304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6a2f5c8c-2818-44b1-8232-eadb4e106a79 req-0777b8db-6e7a-4740-a560-0292e835c9c8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:39.847120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6a2f5c8c-2818-44b1-8232-eadb4e106a79 req-0777b8db-6e7a-4740-a560-0292e835c9c8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:39.847677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6a2f5c8c-2818-44b1-8232-eadb4e106a79 req-0777b8db-6e7a-4740-a560-0292e835c9c8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:39.861735 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-6a2f5c8c-2818-44b1-8232-eadb4e106a79 req-0777b8db-6e7a-4740-a560-0292e835c9c8 service nova] Creating event network-vif-deleted:8f55097f-6266-466e-a151-d9267eafc55e for instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 on n-h1-858384-13 Oct 18 14:25:39.867511 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-6a2f5c8c-2818-44b1-8232-eadb4e106a79 req-0777b8db-6e7a-4740-a560-0292e835c9c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101348 Oct 18 14:25:39.868458 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3757/7312] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:25:39.873079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:39.877567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:39.886072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:39.886557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:39.887031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:39.887739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:39.888193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:39.888616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:39.922630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:39.923115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:39.923572 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:39.924167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lazy-loading 'fault' on Instance uuid 18104f7b-f5fb-4710-a8f1-d74be9961a17 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:25:39.967944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:39.976727 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7b1105f7-f9b8-4e40-b971-c3eaf0ab2e84 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 200 len: 1352 microversion: 2.1 time: 0.115480 Oct 18 14:25:39.977274 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3556/7313] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:39 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 1352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:41.001658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e893359d-b3cf-4d87-86eb-c024f1482b29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:41.002412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e893359d-b3cf-4d87-86eb-c024f1482b29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 18104f7b-f5fb-4710-a8f1-d74be9961a17] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:41.010295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e893359d-b3cf-4d87-86eb-c024f1482b29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:41.010802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e893359d-b3cf-4d87-86eb-c024f1482b29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:41.011259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e893359d-b3cf-4d87-86eb-c024f1482b29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:41.012440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e893359d-b3cf-4d87-86eb-c024f1482b29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:41.012919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e893359d-b3cf-4d87-86eb-c024f1482b29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:41.013401 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e893359d-b3cf-4d87-86eb-c024f1482b29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:41.027046 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-e893359d-b3cf-4d87-86eb-c024f1482b29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] HTTP exception thrown: Instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 could not be found. Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e893359d-b3cf-4d87-86eb-c024f1482b29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Request method failure captured: Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 HTTP/1.1 Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrcT_lJ3JjImyFr04yPFpBjPPjEr0tE4-MWpaoaMEyCnnGs1us_jm7WE5EmvhPgULX-lxZy5jFhuF3cTLJXxjbnqNsw_0xx2cHzmhKynnv2PmUzm_w36-yXJmSaYB7MqY6IqxsF7jKDeejR3rFEV9SwVTqQclfgkJpSmYHfLwCnWyts Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 053733f3ec1d41cc932057b4c61d18da Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_053733f3ec1d41cc932057b4c61d18da"}]}] Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 053733f3ec1d41cc932057b4c61d18da Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestEncryptedCinderVolumes-1957851883-project Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 9ec8c194d52448479a1704d590ef4186 Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestEncryptedCinderVolumes-1957851883-project Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 could not be found. Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '18104f7b-f5fb-4710-a8f1-d74be9961a17'} Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 could not be found. Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 could not be found. Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:25:41.028708 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:25:41.033494 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:25:41.033494 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:25:41.033494 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:25:41.033494 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:25:41.033494 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:25:41.033494 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:25:41.033494 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 could not be found. Oct 18 14:25:41.033494 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:25:41.033494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e893359d-b3cf-4d87-86eb-c024f1482b29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Returning 404 to user: Instance 18104f7b-f5fb-4710-a8f1-d74be9961a17 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:25:41.033494 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e893359d-b3cf-4d87-86eb-c024f1482b29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17" status: 404 len: 111 microversion: 2.1 time: 0.032862 Oct 18 14:25:41.033494 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3758/7314] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:40 2022] GET /compute/v2.1/servers/18104f7b-f5fb-4710-a8f1-d74be9961a17 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:25:41.039786 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-852cb078-61c7-45f7-bb0e-d26820efe7eb tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '.version_select at 0x7ff60efc98b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:41.061410 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-852cb078-61c7-45f7-bb0e-d26820efe7eb tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-933948318" status: 202 len: 0 microversion: 2.1 time: 0.026038 Oct 18 14:25:41.062003 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3557/7315] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 14:25:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-933948318 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:25:41.080365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-71ddd803-91ce-4d81-a297-0cec21042997 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Action: 'create', calling method: .version_select at 0x7ff60ec10a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-665954900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+mguXLduu9w7dKYXtc+vkdAYZn5vYItRmlHrH0o4bJNvXltRaoOBf0czqaW8zNQYYlLbA3OdS9Mtcts8XkaLVhj6ZxCWka3kC2smg6Ed3LBfPzhfQrkzXDJDdPyTS8tA=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:41.096718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-71ddd803-91ce-4d81-a297-0cec21042997 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Getting quotas for project 053733f3ec1d41cc932057b4c61d18da. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:25:41.102398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-71ddd803-91ce-4d81-a297-0cec21042997 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Getting quotas for user 9ec8c194d52448479a1704d590ef4186 and project 053733f3ec1d41cc932057b4c61d18da. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:25:41.127940 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-71ddd803-91ce-4d81-a297-0cec21042997 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051464 Oct 18 14:25:41.128558 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3759/7316] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:25:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:41.180947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1751672995", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-665954900", "networks": [{"uuid": "aab34363-4482-4ca9-987c-3a0a730423b4"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:41.235614 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] validate_networks() for [('aab34363-4482-4ca9-987c-3a0a730423b4', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:25:41.640241 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:25:41.640667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:25:41.641143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:25:41.641608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:25:41.642027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:25:41.652772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:41.653288 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:41.653729 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:41.654461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:41.654902 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:41.655327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:41.674666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Getting quotas for project 053733f3ec1d41cc932057b4c61d18da. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:25:41.680592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Getting quotas for user 9ec8c194d52448479a1704d590ef4186 and project 053733f3ec1d41cc932057b4c61d18da. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:25:41.694225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:25:41.696570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:25:41.746492 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e18dc2e7-eb00-4d7f-8ca4-705c3a5609f3 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570480 Oct 18 14:25:41.747157 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3558/7317] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:25:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:25:41.759395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7adeb621-2996-44cd-b27b-566e368ed426 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:41.760213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7adeb621-2996-44cd-b27b-566e368ed426 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:41.818999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7adeb621-2996-44cd-b27b-566e368ed426 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:41.826222 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7adeb621-2996-44cd-b27b-566e368ed426 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1262 microversion: 2.1 time: 0.071819 Oct 18 14:25:41.826818 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3760/7318] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:41 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:42.851717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c17636ad-1dda-421b-8eab-ae4e32ad6479 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:42.852351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c17636ad-1dda-421b-8eab-ae4e32ad6479 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:42.859592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c17636ad-1dda-421b-8eab-ae4e32ad6479 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:42.860203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c17636ad-1dda-421b-8eab-ae4e32ad6479 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:42.860849 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c17636ad-1dda-421b-8eab-ae4e32ad6479 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:42.861580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c17636ad-1dda-421b-8eab-ae4e32ad6479 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:42.862199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c17636ad-1dda-421b-8eab-ae4e32ad6479 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:42.862797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c17636ad-1dda-421b-8eab-ae4e32ad6479 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:42.942003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c17636ad-1dda-421b-8eab-ae4e32ad6479 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:42.951512 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c17636ad-1dda-421b-8eab-ae4e32ad6479 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1322 microversion: 2.1 time: 0.105376 Oct 18 14:25:42.952499 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3559/7319] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:42 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1322 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:43.977155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-22776ab6-48c6-40d2-8022-87f744459921 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:43.978491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-22776ab6-48c6-40d2-8022-87f744459921 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:43.985780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22776ab6-48c6-40d2-8022-87f744459921 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:43.986306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22776ab6-48c6-40d2-8022-87f744459921 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:43.986814 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22776ab6-48c6-40d2-8022-87f744459921 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:43.987570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22776ab6-48c6-40d2-8022-87f744459921 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:43.988041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22776ab6-48c6-40d2-8022-87f744459921 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:43.988482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-22776ab6-48c6-40d2-8022-87f744459921 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:44.136058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-22776ab6-48c6-40d2-8022-87f744459921 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:44.144069 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-22776ab6-48c6-40d2-8022-87f744459921 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1362 microversion: 2.1 time: 0.171913 Oct 18 14:25:44.144648 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3761/7320] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:43 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:25:44.311091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-17ebe9aa-c611-41f7-867e-87e156aa6093 req-fd994aea-e352-4e3b-8975-3cf67dacb35e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1f6777-0d9a-4439-9fff-edb6b1b397e2", "tag": "14fd2f83-f885-4d22-b986-b680785c22b6"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:44.322907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-17ebe9aa-c611-41f7-867e-87e156aa6093 req-fd994aea-e352-4e3b-8975-3cf67dacb35e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:44.323471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-17ebe9aa-c611-41f7-867e-87e156aa6093 req-fd994aea-e352-4e3b-8975-3cf67dacb35e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:44.323962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-17ebe9aa-c611-41f7-867e-87e156aa6093 req-fd994aea-e352-4e3b-8975-3cf67dacb35e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:44.336153 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-17ebe9aa-c611-41f7-867e-87e156aa6093 req-fd994aea-e352-4e3b-8975-3cf67dacb35e service nova] Creating event network-changed:14fd2f83-f885-4d22-b986-b680785c22b6 for instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 on n-h1-858384-13 Oct 18 14:25:44.342757 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-17ebe9aa-c611-41f7-867e-87e156aa6093 req-fd994aea-e352-4e3b-8975-3cf67dacb35e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035371 Oct 18 14:25:44.343383 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3560/7321] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:45.166818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04c3938e-1099-4406-9d9d-8e8c2f824034 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:45.167442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04c3938e-1099-4406-9d9d-8e8c2f824034 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:45.174321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04c3938e-1099-4406-9d9d-8e8c2f824034 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:45.174810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04c3938e-1099-4406-9d9d-8e8c2f824034 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:45.175255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04c3938e-1099-4406-9d9d-8e8c2f824034 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:45.175947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04c3938e-1099-4406-9d9d-8e8c2f824034 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:45.176408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04c3938e-1099-4406-9d9d-8e8c2f824034 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:45.176839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04c3938e-1099-4406-9d9d-8e8c2f824034 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:45.315068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04c3938e-1099-4406-9d9d-8e8c2f824034 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:45.324076 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04c3938e-1099-4406-9d9d-8e8c2f824034 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1362 microversion: 2.1 time: 0.161162 Oct 18 14:25:45.324658 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3762/7322] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:45 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:46.348071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b2d708ff-86f3-4585-b7c8-932eafe4339a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:46.348764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b2d708ff-86f3-4585-b7c8-932eafe4339a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:46.356115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2d708ff-86f3-4585-b7c8-932eafe4339a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:46.356586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2d708ff-86f3-4585-b7c8-932eafe4339a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:46.357014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2d708ff-86f3-4585-b7c8-932eafe4339a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:46.357720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2d708ff-86f3-4585-b7c8-932eafe4339a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:46.358261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2d708ff-86f3-4585-b7c8-932eafe4339a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:46.358677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b2d708ff-86f3-4585-b7c8-932eafe4339a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:46.499077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b2d708ff-86f3-4585-b7c8-932eafe4339a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:46.506874 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b2d708ff-86f3-4585-b7c8-932eafe4339a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1362 microversion: 2.1 time: 0.163060 Oct 18 14:25:46.507442 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3561/7323] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:46 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:47.530878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0ea81ee7-1dec-441d-a17a-cef0a6624888 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:47.531647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0ea81ee7-1dec-441d-a17a-cef0a6624888 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:47.539311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ea81ee7-1dec-441d-a17a-cef0a6624888 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:47.539815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ea81ee7-1dec-441d-a17a-cef0a6624888 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:47.540258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ea81ee7-1dec-441d-a17a-cef0a6624888 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:47.541009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ea81ee7-1dec-441d-a17a-cef0a6624888 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:47.541498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ea81ee7-1dec-441d-a17a-cef0a6624888 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:47.541934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0ea81ee7-1dec-441d-a17a-cef0a6624888 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:47.676960 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0ea81ee7-1dec-441d-a17a-cef0a6624888 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:47.685865 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0ea81ee7-1dec-441d-a17a-cef0a6624888 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1362 microversion: 2.1 time: 0.159482 Oct 18 14:25:47.686481 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3763/7324] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:47 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:48.709576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-943840d3-3347-43c7-9a75-9e021782b095 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:48.710474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-943840d3-3347-43c7-9a75-9e021782b095 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:48.717353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-943840d3-3347-43c7-9a75-9e021782b095 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:48.717823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-943840d3-3347-43c7-9a75-9e021782b095 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:48.718250 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-943840d3-3347-43c7-9a75-9e021782b095 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:48.718924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-943840d3-3347-43c7-9a75-9e021782b095 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:48.719363 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-943840d3-3347-43c7-9a75-9e021782b095 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:48.719777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-943840d3-3347-43c7-9a75-9e021782b095 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:48.861785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-943840d3-3347-43c7-9a75-9e021782b095 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:48.869971 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-943840d3-3347-43c7-9a75-9e021782b095 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1362 microversion: 2.1 time: 0.164862 Oct 18 14:25:48.870548 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3562/7325] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:48 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:49.894674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-b687f21c-6730-4863-9c36-d65e214addc5 req-71f2ee1f-0ea5-4d30-8e04-c6855e0f0a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1f6777-0d9a-4439-9fff-edb6b1b397e2", "name": "network-vif-plugged", "status": "completed", "tag": "14fd2f83-f885-4d22-b986-b680785c22b6"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:49.895340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-92a9d167-3592-4445-aa7a-be5bfa26250b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:49.896463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-92a9d167-3592-4445-aa7a-be5bfa26250b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:49.906684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b687f21c-6730-4863-9c36-d65e214addc5 req-71f2ee1f-0ea5-4d30-8e04-c6855e0f0a6e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:49.907121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b687f21c-6730-4863-9c36-d65e214addc5 req-71f2ee1f-0ea5-4d30-8e04-c6855e0f0a6e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:49.907574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-b687f21c-6730-4863-9c36-d65e214addc5 req-71f2ee1f-0ea5-4d30-8e04-c6855e0f0a6e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:49.910563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92a9d167-3592-4445-aa7a-be5bfa26250b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:49.911050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92a9d167-3592-4445-aa7a-be5bfa26250b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:49.911518 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92a9d167-3592-4445-aa7a-be5bfa26250b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:49.912746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92a9d167-3592-4445-aa7a-be5bfa26250b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:49.913221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92a9d167-3592-4445-aa7a-be5bfa26250b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:49.913657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-92a9d167-3592-4445-aa7a-be5bfa26250b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:49.920047 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-b687f21c-6730-4863-9c36-d65e214addc5 req-71f2ee1f-0ea5-4d30-8e04-c6855e0f0a6e service nova] Creating event network-vif-plugged:14fd2f83-f885-4d22-b986-b680785c22b6 for instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 on n-h1-858384-13 Oct 18 14:25:49.925635 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-b687f21c-6730-4863-9c36-d65e214addc5 req-71f2ee1f-0ea5-4d30-8e04-c6855e0f0a6e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093819 Oct 18 14:25:49.926730 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3764/7326] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:25:50.081725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-92a9d167-3592-4445-aa7a-be5bfa26250b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:50.090684 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-92a9d167-3592-4445-aa7a-be5bfa26250b tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1362 microversion: 2.1 time: 0.200155 Oct 18 14:25:50.091283 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3563/7327] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:49 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:25:51.114356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-430c6dd0-b89b-47d9-b917-4a3cda976351 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:51.115762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-430c6dd0-b89b-47d9-b917-4a3cda976351 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:51.122844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-430c6dd0-b89b-47d9-b917-4a3cda976351 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:51.123335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-430c6dd0-b89b-47d9-b917-4a3cda976351 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:51.123782 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-430c6dd0-b89b-47d9-b917-4a3cda976351 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:51.124485 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-430c6dd0-b89b-47d9-b917-4a3cda976351 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:51.124950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-430c6dd0-b89b-47d9-b917-4a3cda976351 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:51.125415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-430c6dd0-b89b-47d9-b917-4a3cda976351 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:51.257498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-430c6dd0-b89b-47d9-b917-4a3cda976351 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:51.265421 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-430c6dd0-b89b-47d9-b917-4a3cda976351 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1362 microversion: 2.1 time: 0.155305 Oct 18 14:25:51.265994 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3765/7328] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:51 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:52.290379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e6ea4173-d66b-4925-88e5-571b7c43ded1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:52.291005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e6ea4173-d66b-4925-88e5-571b7c43ded1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:52.293855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:52.294643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:52.300408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e6ea4173-d66b-4925-88e5-571b7c43ded1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:52.300905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e6ea4173-d66b-4925-88e5-571b7c43ded1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:52.301377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e6ea4173-d66b-4925-88e5-571b7c43ded1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:52.302148 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e6ea4173-d66b-4925-88e5-571b7c43ded1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:52.302737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e6ea4173-d66b-4925-88e5-571b7c43ded1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:52.303170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e6ea4173-d66b-4925-88e5-571b7c43ded1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:52.436950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e6ea4173-d66b-4925-88e5-571b7c43ded1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:52.445502 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e6ea4173-d66b-4925-88e5-571b7c43ded1 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1553 microversion: 2.1 time: 0.160379 Oct 18 14:25:52.446109 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3564/7329] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:52 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:52.469155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9cb88e3b-75d8-4bb1-9ae2-e67c08dd57b4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:25:52.469824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9cb88e3b-75d8-4bb1-9ae2-e67c08dd57b4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:52.471828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:52.478171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cb88e3b-75d8-4bb1-9ae2-e67c08dd57b4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:52.478685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cb88e3b-75d8-4bb1-9ae2-e67c08dd57b4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:52.479147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cb88e3b-75d8-4bb1-9ae2-e67c08dd57b4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:52.479880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cb88e3b-75d8-4bb1-9ae2-e67c08dd57b4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:52.480356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cb88e3b-75d8-4bb1-9ae2-e67c08dd57b4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:52.480827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9cb88e3b-75d8-4bb1-9ae2-e67c08dd57b4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:52.627562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9cb88e3b-75d8-4bb1-9ae2-e67c08dd57b4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:25:52.636598 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9cb88e3b-75d8-4bb1-9ae2-e67c08dd57b4 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1553 microversion: 2.1 time: 0.171376 Oct 18 14:25:52.637564 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3766/7330] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:25:52 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:25:54.154386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4c8f1e71-ba4b-4229-9a13-26fd28fba365 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f94b6c3-c915-4c82-866b-329030ea41f0"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:25:54.156683 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4c8f1e71-ba4b-4229-9a13-26fd28fba365 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:25:54.163568 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c8f1e71-ba4b-4229-9a13-26fd28fba365 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:54.164041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c8f1e71-ba4b-4229-9a13-26fd28fba365 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:54.164468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c8f1e71-ba4b-4229-9a13-26fd28fba365 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:54.165157 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c8f1e71-ba4b-4229-9a13-26fd28fba365 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:25:54.165647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c8f1e71-ba4b-4229-9a13-26fd28fba365 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:25:54.166068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4c8f1e71-ba4b-4229-9a13-26fd28fba365 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:25:54.313728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:25:54.432322 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4c8f1e71-ba4b-4229-9a13-26fd28fba365 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "POST /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281862 Oct 18 14:25:54.433013 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3565/7331] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 14:25:54 2022] POST /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:26:06.252295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b0f2c08c-1818-456f-98b4-465827196c86 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:06.252858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b0f2c08c-1818-456f-98b4-465827196c86 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:06.255436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:06.256198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=66 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:06.263230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0f2c08c-1818-456f-98b4-465827196c86 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:06.263751 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0f2c08c-1818-456f-98b4-465827196c86 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:06.264205 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0f2c08c-1818-456f-98b4-465827196c86 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:06.264928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0f2c08c-1818-456f-98b4-465827196c86 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:06.265427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0f2c08c-1818-456f-98b4-465827196c86 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:06.265874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0f2c08c-1818-456f-98b4-465827196c86 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:06.351958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-b0f2c08c-1818-456f-98b4-465827196c86 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lazy-loading 'services' on Instance uuid 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:26:06.425862 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b0f2c08c-1818-456f-98b4-465827196c86 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments/0f94b6c3-c915-4c82-866b-329030ea41f0" status: 202 len: 0 microversion: 2.1 time: 0.177646 Oct 18 14:26:06.426655 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3767/7332] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 14:26:06 2022] DELETE /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments/0f94b6c3-c915-4c82-866b-329030ea41f0 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:26:06.433844 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:06.434635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:06.439253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c8efa727-cbf0-404b-a9cd-feffe200a3c5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:06.441644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c8efa727-cbf0-404b-a9cd-feffe200a3c5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:06.450725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8efa727-cbf0-404b-a9cd-feffe200a3c5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:06.451253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8efa727-cbf0-404b-a9cd-feffe200a3c5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:06.451694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8efa727-cbf0-404b-a9cd-feffe200a3c5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:06.452401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8efa727-cbf0-404b-a9cd-feffe200a3c5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:06.452857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8efa727-cbf0-404b-a9cd-feffe200a3c5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:06.453376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c8efa727-cbf0-404b-a9cd-feffe200a3c5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:06.487916 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c8efa727-cbf0-404b-a9cd-feffe200a3c5 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055970 Oct 18 14:26:06.488569 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3566/7333] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:26:06 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:26:07.503527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-70a8463e-68be-4b4b-bbf9-ee32fabcf488 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:07.505909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-70a8463e-68be-4b4b-bbf9-ee32fabcf488 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:07.514236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70a8463e-68be-4b4b-bbf9-ee32fabcf488 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:07.515166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70a8463e-68be-4b4b-bbf9-ee32fabcf488 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:07.515634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70a8463e-68be-4b4b-bbf9-ee32fabcf488 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:07.516466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70a8463e-68be-4b4b-bbf9-ee32fabcf488 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:07.516958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70a8463e-68be-4b4b-bbf9-ee32fabcf488 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:07.517458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-70a8463e-68be-4b4b-bbf9-ee32fabcf488 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:07.556977 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-70a8463e-68be-4b4b-bbf9-ee32fabcf488 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058767 Oct 18 14:26:07.557860 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3768/7334] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:26:07 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:26:08.570003 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-87c6246f-e135-45be-866c-ef82f4f52569 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:08.572377 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-87c6246f-e135-45be-866c-ef82f4f52569 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:08.579934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87c6246f-e135-45be-866c-ef82f4f52569 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:08.580416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87c6246f-e135-45be-866c-ef82f4f52569 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:08.580964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87c6246f-e135-45be-866c-ef82f4f52569 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:08.582258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87c6246f-e135-45be-866c-ef82f4f52569 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:08.582258 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87c6246f-e135-45be-866c-ef82f4f52569 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:08.582605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-87c6246f-e135-45be-866c-ef82f4f52569 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:08.622018 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-87c6246f-e135-45be-866c-ef82f4f52569 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056312 Oct 18 14:26:08.622890 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3567/7335] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:26:08 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:26:09.635938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1440f571-f01d-41d0-91e9-abac7a94ba0e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:09.638481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1440f571-f01d-41d0-91e9-abac7a94ba0e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:09.646856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1440f571-f01d-41d0-91e9-abac7a94ba0e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:09.646856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1440f571-f01d-41d0-91e9-abac7a94ba0e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:09.649142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1440f571-f01d-41d0-91e9-abac7a94ba0e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:09.649142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1440f571-f01d-41d0-91e9-abac7a94ba0e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:09.649142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1440f571-f01d-41d0-91e9-abac7a94ba0e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:09.649142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1440f571-f01d-41d0-91e9-abac7a94ba0e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:09.684382 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1440f571-f01d-41d0-91e9-abac7a94ba0e tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053292 Oct 18 14:26:09.685008 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3769/7336] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:26:09 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:26:10.697331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2e77498b-24b8-4a5c-899c-966ca85c2e29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:10.699400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2e77498b-24b8-4a5c-899c-966ca85c2e29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:10.706489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e77498b-24b8-4a5c-899c-966ca85c2e29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:10.706972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e77498b-24b8-4a5c-899c-966ca85c2e29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:10.707403 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e77498b-24b8-4a5c-899c-966ca85c2e29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:10.708093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e77498b-24b8-4a5c-899c-966ca85c2e29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:10.708540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e77498b-24b8-4a5c-899c-966ca85c2e29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:10.708961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e77498b-24b8-4a5c-899c-966ca85c2e29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:10.742101 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2e77498b-24b8-4a5c-899c-966ca85c2e29 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049187 Oct 18 14:26:10.742677 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3568/7337] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:26:10 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:26:11.754889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f7242dc9-c5c9-48ff-8a5f-7dd646543ab7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:11.757049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f7242dc9-c5c9-48ff-8a5f-7dd646543ab7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:11.764395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7242dc9-c5c9-48ff-8a5f-7dd646543ab7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:11.764920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7242dc9-c5c9-48ff-8a5f-7dd646543ab7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:11.765394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7242dc9-c5c9-48ff-8a5f-7dd646543ab7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:11.766102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7242dc9-c5c9-48ff-8a5f-7dd646543ab7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:11.766565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7242dc9-c5c9-48ff-8a5f-7dd646543ab7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:11.767007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7242dc9-c5c9-48ff-8a5f-7dd646543ab7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:11.799240 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f7242dc9-c5c9-48ff-8a5f-7dd646543ab7 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048266 Oct 18 14:26:11.799731 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3770/7338] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:26:11 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:26:11.811504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22c5c2db-b893-4804-ae70-abbd5136cc0a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:11.812007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-22c5c2db-b893-4804-ae70-abbd5136cc0a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:11.818955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22c5c2db-b893-4804-ae70-abbd5136cc0a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:11.819436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22c5c2db-b893-4804-ae70-abbd5136cc0a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:11.819874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22c5c2db-b893-4804-ae70-abbd5136cc0a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:11.820564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22c5c2db-b893-4804-ae70-abbd5136cc0a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:11.821125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22c5c2db-b893-4804-ae70-abbd5136cc0a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:11.821578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22c5c2db-b893-4804-ae70-abbd5136cc0a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:11.897752 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-22c5c2db-b893-4804-ae70-abbd5136cc0a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] HTTP exception thrown: Instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 is not attached to volume 0f94b6c3-c915-4c82-866b-329030ea41f0 Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22c5c2db-b893-4804-ae70-abbd5136cc0a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Request method failure captured: Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments/0f94b6c3-c915-4c82-866b-329030ea41f0 HTTP/1.1 Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrcT_lJ3JjImyFr04yPFpBjPPjEr0tE4-MWpaoaMEyCnnGs1us_jm7WE5EmvhPgULX-lxZy5jFhuF3cTLJXxjbnqNsw_0xx2cHzmhKynnv2PmUzm_w36-yXJmSaYB7MqY6IqxsF7jKDeejR3rFEV9SwVTqQclfgkJpSmYHfLwCnWyts Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 053733f3ec1d41cc932057b4c61d18da Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_053733f3ec1d41cc932057b4c61d18da"}]}] Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 053733f3ec1d41cc932057b4c61d18da Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestEncryptedCinderVolumes-1957851883-project Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9ec8c194d52448479a1704d590ef4186 Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestEncryptedCinderVolumes-1957851883-project Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 is not attached to volume 0f94b6c3-c915-4c82-866b-329030ea41f0 Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'server_id': '4f1f6777-0d9a-4439-9fff-edb6b1b397e2', 'id': '0f94b6c3-c915-4c82-866b-329030ea41f0'} Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0f94b6c3-c915-4c82-866b-329030ea41f0. Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 is not attached to volume 0f94b6c3-c915-4c82-866b-329030ea41f0 Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:26:11.899798 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:26:11.904617 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:26:11.904617 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:26:11.904617 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 is not attached to volume 0f94b6c3-c915-4c82-866b-329030ea41f0 Oct 18 14:26:11.904617 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:26:11.904617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22c5c2db-b893-4804-ae70-abbd5136cc0a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Returning 404 to user: Instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 is not attached to volume 0f94b6c3-c915-4c82-866b-329030ea41f0 {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:26:11.904617 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-22c5c2db-b893-4804-ae70-abbd5136cc0a tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments/0f94b6c3-c915-4c82-866b-329030ea41f0" status: 404 len: 154 microversion: 2.1 time: 0.093900 Oct 18 14:26:11.904617 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3569/7339] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 14:26:11 2022] DELETE /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2/os-volume_attachments/0f94b6c3-c915-4c82-866b-329030ea41f0 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:26:15.261963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-87217117-0559-449f-a23a-b280b01a219d tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:15.262524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-87217117-0559-449f-a23a-b280b01a219d tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:15.270133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87217117-0559-449f-a23a-b280b01a219d tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:15.270645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87217117-0559-449f-a23a-b280b01a219d tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:15.271097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87217117-0559-449f-a23a-b280b01a219d tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:15.271882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87217117-0559-449f-a23a-b280b01a219d tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:15.272292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87217117-0559-449f-a23a-b280b01a219d tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:15.272731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-87217117-0559-449f-a23a-b280b01a219d tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:15.301972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-87217117-0559-449f-a23a-b280b01a219d tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:26:15.386054 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-87217117-0559-449f-a23a-b280b01a219d tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 204 len: 0 microversion: 2.1 time: 0.128535 Oct 18 14:26:15.386831 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3771/7340] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:26:15 2022] DELETE /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:26:15.395096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6ca1ce41-cd09-47b8-9c99-2f2c7c672d91 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:15.395712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6ca1ce41-cd09-47b8-9c99-2f2c7c672d91 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:15.406449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ca1ce41-cd09-47b8-9c99-2f2c7c672d91 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:15.407126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ca1ce41-cd09-47b8-9c99-2f2c7c672d91 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:15.407586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ca1ce41-cd09-47b8-9c99-2f2c7c672d91 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:15.408511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ca1ce41-cd09-47b8-9c99-2f2c7c672d91 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:15.409160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ca1ce41-cd09-47b8-9c99-2f2c7c672d91 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:15.409632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6ca1ce41-cd09-47b8-9c99-2f2c7c672d91 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:15.547417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6ca1ce41-cd09-47b8-9c99-2f2c7c672d91 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:15.555447 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6ca1ce41-cd09-47b8-9c99-2f2c7c672d91 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1559 microversion: 2.1 time: 0.164153 Oct 18 14:26:15.556489 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3570/7341] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:15 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:26:16.580318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8e86ba03-69a7-4806-80d7-fe43b16f0399 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:16.581029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8e86ba03-69a7-4806-80d7-fe43b16f0399 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:16.588502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e86ba03-69a7-4806-80d7-fe43b16f0399 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:16.588991 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e86ba03-69a7-4806-80d7-fe43b16f0399 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:16.589469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e86ba03-69a7-4806-80d7-fe43b16f0399 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:16.590161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e86ba03-69a7-4806-80d7-fe43b16f0399 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:16.590622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e86ba03-69a7-4806-80d7-fe43b16f0399 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:16.591054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e86ba03-69a7-4806-80d7-fe43b16f0399 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:16.724645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8e86ba03-69a7-4806-80d7-fe43b16f0399 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:16.733776 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8e86ba03-69a7-4806-80d7-fe43b16f0399 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1559 microversion: 2.1 time: 0.157862 Oct 18 14:26:16.734358 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3772/7342] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:16 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:26:17.638623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-679fcd1b-68f1-4505-aa05-d8ae2e4f3e42 req-3148c77d-a2ea-49e8-8105-e18ebd525705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1f6777-0d9a-4439-9fff-edb6b1b397e2", "name": "network-vif-deleted", "tag": "14fd2f83-f885-4d22-b986-b680785c22b6"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:26:17.653701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-679fcd1b-68f1-4505-aa05-d8ae2e4f3e42 req-3148c77d-a2ea-49e8-8105-e18ebd525705 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:17.654457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-679fcd1b-68f1-4505-aa05-d8ae2e4f3e42 req-3148c77d-a2ea-49e8-8105-e18ebd525705 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:17.654966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-679fcd1b-68f1-4505-aa05-d8ae2e4f3e42 req-3148c77d-a2ea-49e8-8105-e18ebd525705 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:17.669046 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-679fcd1b-68f1-4505-aa05-d8ae2e4f3e42 req-3148c77d-a2ea-49e8-8105-e18ebd525705 service nova] Creating event network-vif-deleted:14fd2f83-f885-4d22-b986-b680785c22b6 for instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 on n-h1-858384-13 Oct 18 14:26:17.674951 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-679fcd1b-68f1-4505-aa05-d8ae2e4f3e42 req-3148c77d-a2ea-49e8-8105-e18ebd525705 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040013 Oct 18 14:26:17.675773 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3571/7343] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:26:17.758059 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:17.760181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:17.767859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:17.768356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:17.768806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:17.769562 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:17.770036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:17.770477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:17.809433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:17.810340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:17.811169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:17.811657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lazy-loading 'fault' on Instance uuid 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:26:17.858643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ec8c194d52448479a1704d590ef4186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053733f3ec1d41cc932057b4c61d18da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:17.866717 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c226772e-0be6-4b39-a9d7-351f12873218 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 200 len: 1352 microversion: 2.1 time: 0.112812 Oct 18 14:26:17.867301 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3773/7344] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:17 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 1352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:26:18.892151 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-893dd826-49c5-4843-a09a-6822aa81b071 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:18.892760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-893dd826-49c5-4843-a09a-6822aa81b071 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] [instance: 4f1f6777-0d9a-4439-9fff-edb6b1b397e2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:18.898930 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-893dd826-49c5-4843-a09a-6822aa81b071 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:18.899404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-893dd826-49c5-4843-a09a-6822aa81b071 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:18.899856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-893dd826-49c5-4843-a09a-6822aa81b071 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:18.900784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-893dd826-49c5-4843-a09a-6822aa81b071 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:18.901260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-893dd826-49c5-4843-a09a-6822aa81b071 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:18.901691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-893dd826-49c5-4843-a09a-6822aa81b071 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:18.914932 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-893dd826-49c5-4843-a09a-6822aa81b071 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] HTTP exception thrown: Instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 could not be found. Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-893dd826-49c5-4843-a09a-6822aa81b071 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Request method failure captured: Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 HTTP/1.1 Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrcT_lJ3JjImyFr04yPFpBjPPjEr0tE4-MWpaoaMEyCnnGs1us_jm7WE5EmvhPgULX-lxZy5jFhuF3cTLJXxjbnqNsw_0xx2cHzmhKynnv2PmUzm_w36-yXJmSaYB7MqY6IqxsF7jKDeejR3rFEV9SwVTqQclfgkJpSmYHfLwCnWyts Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 053733f3ec1d41cc932057b4c61d18da Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/053733f3ec1d41cc932057b4c61d18da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_053733f3ec1d41cc932057b4c61d18da"}]}] Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 053733f3ec1d41cc932057b4c61d18da Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1957851883 Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestEncryptedCinderVolumes-1957851883-project Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 9ec8c194d52448479a1704d590ef4186 Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestEncryptedCinderVolumes-1957851883-project Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 could not be found. Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '4f1f6777-0d9a-4439-9fff-edb6b1b397e2'} Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 could not be found. Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 could not be found. Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:26:18.916807 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:26:18.921621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:26:18.921621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:26:18.921621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:26:18.921621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:26:18.921621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:26:18.921621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:26:18.921621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 could not be found. Oct 18 14:26:18.921621 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:26:18.921621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-893dd826-49c5-4843-a09a-6822aa81b071 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Returning 404 to user: Instance 4f1f6777-0d9a-4439-9fff-edb6b1b397e2 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:26:18.921621 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-893dd826-49c5-4843-a09a-6822aa81b071 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2" status: 404 len: 111 microversion: 2.1 time: 0.031319 Oct 18 14:26:18.921621 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3572/7345] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:18 2022] GET /compute/v2.1/servers/4f1f6777-0d9a-4439-9fff-edb6b1b397e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:26:18.927090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bfe4472e-d0a1-4bba-ad90-311c02218952 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] Calling method '.version_select at 0x7ff60e4501f0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:18.948538 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bfe4472e-d0a1-4bba-ad90-311c02218952 tempest-TestEncryptedCinderVolumes-1957851883 tempest-TestEncryptedCinderVolumes-1957851883-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-665954900" status: 202 len: 0 microversion: 2.1 time: 0.025233 Oct 18 14:26:18.949124 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3774/7346] 10.222.0.40 () {58 vars in 1275 bytes} [Tue Oct 18 14:26:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-665954900 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:26:46.614460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-73358e00-f672-454b-a2fd-43087acf307c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Action: 'create', calling method: .version_select at 0x7ff60e722790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1546195017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4S/ZxpWDctm//71o1Oj8Nj7ZYzKrO5G1OTXxhED8PZEIoFxTWqt661np1tf3nW2o9lE5bhNfG6RoSHQyGpsVaqfCRPWPQ8e0apx1Oh3DA9LmkyNJjEHrcYKtOQHYE70w=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:26:46.620976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=14 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:46.621613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=34 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:46.634413 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-73358e00-f672-454b-a2fd-43087acf307c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Getting quotas for project bc3d208b5a254f11bd78ca9c809fd40c. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:26:46.639658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-73358e00-f672-454b-a2fd-43087acf307c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Getting quotas for user 89067a43c4d34f1a9101d1078ccbc52e and project bc3d208b5a254f11bd78ca9c809fd40c. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:26:46.667715 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-73358e00-f672-454b-a2fd-43087acf307c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058307 Oct 18 14:26:46.668509 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3573/7347] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:26:46 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:26:46.720135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:46.720893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:46.725400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1733905472", "imageRef": "7a923b46-4953-4c9d-83bb-184b5e17ebf8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1546195017", "networks": [{"uuid": "0aa525fd-fae4-47f8-911a-1ec9613492d6"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:26:46.782585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] validate_networks() for [('0aa525fd-fae4-47f8-911a-1ec9613492d6', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:26:47.178569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:26:47.178569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:26:47.178569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:26:47.178569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:26:47.178569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:26:47.187764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:47.188266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:47.188826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:47.190013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:47.190138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:47.190545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:47.208972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Getting quotas for project bc3d208b5a254f11bd78ca9c809fd40c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:26:47.215366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Getting quotas for user 89067a43c4d34f1a9101d1078ccbc52e and project bc3d208b5a254f11bd78ca9c809fd40c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:26:47.229545 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:26:47.231823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a923b46-4953-4c9d-83bb-184b5e17ebf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:26:47.280752 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-df7cb077-c9d6-4bde-8504-4330b42480c4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562820 Oct 18 14:26:47.281455 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3775/7348] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:26:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:26:47.293507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-72f1d052-044f-4cf9-995c-b4fb2b215c5a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:47.294125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-72f1d052-044f-4cf9-995c-b4fb2b215c5a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:47.356249 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-72f1d052-044f-4cf9-995c-b4fb2b215c5a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:47.365614 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-72f1d052-044f-4cf9-995c-b4fb2b215c5a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1259 microversion: 2.1 time: 0.076556 Oct 18 14:26:47.366138 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3574/7349] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:47 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:48.389979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e593483a-2613-4436-b035-74f96d22060b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:48.390732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e593483a-2613-4436-b035-74f96d22060b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:48.397497 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e593483a-2613-4436-b035-74f96d22060b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:48.398025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e593483a-2613-4436-b035-74f96d22060b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:48.398481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e593483a-2613-4436-b035-74f96d22060b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:48.399190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e593483a-2613-4436-b035-74f96d22060b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:48.399648 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e593483a-2613-4436-b035-74f96d22060b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:48.400081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e593483a-2613-4436-b035-74f96d22060b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:48.467342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e593483a-2613-4436-b035-74f96d22060b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:48.476350 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e593483a-2613-4436-b035-74f96d22060b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1319 microversion: 2.1 time: 0.091211 Oct 18 14:26:48.477501 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3776/7350] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:48 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1319 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:26:49.502472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb41642b-b048-40f3-bd60-d07b1ef4514e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:49.503987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb41642b-b048-40f3-bd60-d07b1ef4514e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:49.516771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb41642b-b048-40f3-bd60-d07b1ef4514e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:49.517951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb41642b-b048-40f3-bd60-d07b1ef4514e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:49.518746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb41642b-b048-40f3-bd60-d07b1ef4514e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:49.519716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb41642b-b048-40f3-bd60-d07b1ef4514e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:49.520636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb41642b-b048-40f3-bd60-d07b1ef4514e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:49.521558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb41642b-b048-40f3-bd60-d07b1ef4514e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:49.682052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fb41642b-b048-40f3-bd60-d07b1ef4514e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:49.690962 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb41642b-b048-40f3-bd60-d07b1ef4514e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.193611 Oct 18 14:26:49.691503 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3575/7351] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:49 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:50.717559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-468d4708-4b44-438e-839c-56083b6cd24c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:50.718647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-468d4708-4b44-438e-839c-56083b6cd24c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:50.726057 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-468d4708-4b44-438e-839c-56083b6cd24c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:50.726586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-468d4708-4b44-438e-839c-56083b6cd24c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:50.728283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-468d4708-4b44-438e-839c-56083b6cd24c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:50.729203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-468d4708-4b44-438e-839c-56083b6cd24c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:50.729684 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-468d4708-4b44-438e-839c-56083b6cd24c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:50.730130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-468d4708-4b44-438e-839c-56083b6cd24c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:50.892478 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-468d4708-4b44-438e-839c-56083b6cd24c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:50.905227 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-468d4708-4b44-438e-839c-56083b6cd24c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.189172 Oct 18 14:26:50.905227 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3777/7352] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:50 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:51.927107 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-822085d5-5c06-43f4-8dac-af441903749c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:51.928631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-822085d5-5c06-43f4-8dac-af441903749c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:51.937698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-822085d5-5c06-43f4-8dac-af441903749c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:51.937925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-822085d5-5c06-43f4-8dac-af441903749c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:51.938334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-822085d5-5c06-43f4-8dac-af441903749c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:51.939207 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-822085d5-5c06-43f4-8dac-af441903749c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:51.939837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-822085d5-5c06-43f4-8dac-af441903749c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:51.940301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-822085d5-5c06-43f4-8dac-af441903749c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:52.120995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-822085d5-5c06-43f4-8dac-af441903749c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:52.130953 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-822085d5-5c06-43f4-8dac-af441903749c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.208048 Oct 18 14:26:52.131935 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3576/7353] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:51 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:53.158409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-59c9d95e-c4d0-4fed-ac8f-d1025a8e4d02 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:53.159570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-59c9d95e-c4d0-4fed-ac8f-d1025a8e4d02 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:53.169435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59c9d95e-c4d0-4fed-ac8f-d1025a8e4d02 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:53.169947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59c9d95e-c4d0-4fed-ac8f-d1025a8e4d02 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:53.170403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59c9d95e-c4d0-4fed-ac8f-d1025a8e4d02 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:53.171135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59c9d95e-c4d0-4fed-ac8f-d1025a8e4d02 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:53.171605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59c9d95e-c4d0-4fed-ac8f-d1025a8e4d02 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:53.172049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59c9d95e-c4d0-4fed-ac8f-d1025a8e4d02 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:53.327433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-59c9d95e-c4d0-4fed-ac8f-d1025a8e4d02 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:53.335883 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-59c9d95e-c4d0-4fed-ac8f-d1025a8e4d02 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.182277 Oct 18 14:26:53.337145 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3778/7354] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:53 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:54.362178 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb0357c6-85f1-4a7b-88ce-9a2596a7d09c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:54.362973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb0357c6-85f1-4a7b-88ce-9a2596a7d09c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:54.372563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb0357c6-85f1-4a7b-88ce-9a2596a7d09c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:54.373092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb0357c6-85f1-4a7b-88ce-9a2596a7d09c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:54.373560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb0357c6-85f1-4a7b-88ce-9a2596a7d09c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:54.374274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb0357c6-85f1-4a7b-88ce-9a2596a7d09c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:54.374733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb0357c6-85f1-4a7b-88ce-9a2596a7d09c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:54.375156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb0357c6-85f1-4a7b-88ce-9a2596a7d09c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:54.531988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fb0357c6-85f1-4a7b-88ce-9a2596a7d09c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:54.542498 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb0357c6-85f1-4a7b-88ce-9a2596a7d09c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.184765 Oct 18 14:26:54.543437 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3577/7355] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:54 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:55.566784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-78fb3f86-a921-4f90-8b78-d20c542797a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:55.567429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-78fb3f86-a921-4f90-8b78-d20c542797a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:55.574778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78fb3f86-a921-4f90-8b78-d20c542797a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:55.575360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78fb3f86-a921-4f90-8b78-d20c542797a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:55.575808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78fb3f86-a921-4f90-8b78-d20c542797a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:55.576524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78fb3f86-a921-4f90-8b78-d20c542797a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:55.576989 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78fb3f86-a921-4f90-8b78-d20c542797a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:55.577454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-78fb3f86-a921-4f90-8b78-d20c542797a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:55.729570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-78fb3f86-a921-4f90-8b78-d20c542797a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:55.737681 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-78fb3f86-a921-4f90-8b78-d20c542797a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.174911 Oct 18 14:26:55.744112 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3779/7356] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:55 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:56.760583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-03899a9e-a69c-4ea7-ad2d-1d184456bece tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:56.761232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-03899a9e-a69c-4ea7-ad2d-1d184456bece tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:56.767737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03899a9e-a69c-4ea7-ad2d-1d184456bece tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:56.768211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03899a9e-a69c-4ea7-ad2d-1d184456bece tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:56.768644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03899a9e-a69c-4ea7-ad2d-1d184456bece tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:56.769514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03899a9e-a69c-4ea7-ad2d-1d184456bece tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:56.769961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03899a9e-a69c-4ea7-ad2d-1d184456bece tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:56.770380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-03899a9e-a69c-4ea7-ad2d-1d184456bece tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:56.905803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-03899a9e-a69c-4ea7-ad2d-1d184456bece tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:56.913755 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-03899a9e-a69c-4ea7-ad2d-1d184456bece tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.157293 Oct 18 14:26:56.915044 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3578/7357] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:56 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:57.938633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-df077e24-9195-48f7-8955-7177934d2478 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:57.939197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-df077e24-9195-48f7-8955-7177934d2478 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:57.941903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:57.942688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:57.951121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df077e24-9195-48f7-8955-7177934d2478 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:57.951622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df077e24-9195-48f7-8955-7177934d2478 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:57.952074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df077e24-9195-48f7-8955-7177934d2478 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:57.952788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df077e24-9195-48f7-8955-7177934d2478 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:57.953290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df077e24-9195-48f7-8955-7177934d2478 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:57.953738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df077e24-9195-48f7-8955-7177934d2478 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:58.097103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-df077e24-9195-48f7-8955-7177934d2478 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:58.106460 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-df077e24-9195-48f7-8955-7177934d2478 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.172006 Oct 18 14:26:58.107062 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3780/7358] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:57 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:26:59.130144 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ad491b75-6e9c-454a-a037-769f5fd71f48 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:26:59.130757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ad491b75-6e9c-454a-a037-769f5fd71f48 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:26:59.132726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:26:59.140026 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad491b75-6e9c-454a-a037-769f5fd71f48 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:59.140510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad491b75-6e9c-454a-a037-769f5fd71f48 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:59.140960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad491b75-6e9c-454a-a037-769f5fd71f48 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:59.141684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad491b75-6e9c-454a-a037-769f5fd71f48 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:26:59.142137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad491b75-6e9c-454a-a037-769f5fd71f48 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:26:59.142563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ad491b75-6e9c-454a-a037-769f5fd71f48 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:26:59.276893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ad491b75-6e9c-454a-a037-769f5fd71f48 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:26:59.284752 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ad491b75-6e9c-454a-a037-769f5fd71f48 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.158658 Oct 18 14:26:59.285354 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3579/7359] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:26:59 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:00.310216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ad78a810-298a-419a-9d80-682f36db19ae tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:00.310873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ad78a810-298a-419a-9d80-682f36db19ae tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:00.318997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad78a810-298a-419a-9d80-682f36db19ae tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:00.319493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad78a810-298a-419a-9d80-682f36db19ae tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:00.319939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad78a810-298a-419a-9d80-682f36db19ae tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:00.320645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad78a810-298a-419a-9d80-682f36db19ae tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:00.321112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad78a810-298a-419a-9d80-682f36db19ae tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:00.321580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ad78a810-298a-419a-9d80-682f36db19ae tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:00.466602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ad78a810-298a-419a-9d80-682f36db19ae tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:00.475399 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ad78a810-298a-419a-9d80-682f36db19ae tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.169193 Oct 18 14:27:00.475987 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3781/7360] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:00 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:01.497516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-33ad3b84-59a1-4c0a-8726-8ac9a03dc088 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:01.498156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-33ad3b84-59a1-4c0a-8726-8ac9a03dc088 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:01.505093 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33ad3b84-59a1-4c0a-8726-8ac9a03dc088 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:01.505610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33ad3b84-59a1-4c0a-8726-8ac9a03dc088 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:01.506044 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33ad3b84-59a1-4c0a-8726-8ac9a03dc088 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:01.506737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33ad3b84-59a1-4c0a-8726-8ac9a03dc088 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:01.507184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33ad3b84-59a1-4c0a-8726-8ac9a03dc088 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:01.507608 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-33ad3b84-59a1-4c0a-8726-8ac9a03dc088 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:01.716623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-33ad3b84-59a1-4c0a-8726-8ac9a03dc088 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:01.724428 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-33ad3b84-59a1-4c0a-8726-8ac9a03dc088 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.230975 Oct 18 14:27:01.725004 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3580/7361] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:01 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:02.240890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-5de8ebff-97ce-4d26-8e5a-fc2865fc61f8 req-7c0f8b51-737b-464d-bbbf-7b9d737670e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f4e78d-4e61-4a87-b0c6-53199c188a03", "tag": "979105f9-39fb-4caf-8a56-e9ebb0beb728"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:27:02.253826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5de8ebff-97ce-4d26-8e5a-fc2865fc61f8 req-7c0f8b51-737b-464d-bbbf-7b9d737670e4 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:02.254325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5de8ebff-97ce-4d26-8e5a-fc2865fc61f8 req-7c0f8b51-737b-464d-bbbf-7b9d737670e4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:02.254776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5de8ebff-97ce-4d26-8e5a-fc2865fc61f8 req-7c0f8b51-737b-464d-bbbf-7b9d737670e4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:02.267408 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-5de8ebff-97ce-4d26-8e5a-fc2865fc61f8 req-7c0f8b51-737b-464d-bbbf-7b9d737670e4 service nova] Creating event network-changed:979105f9-39fb-4caf-8a56-e9ebb0beb728 for instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 on n-h1-858384-13 Oct 18 14:27:02.272368 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-5de8ebff-97ce-4d26-8e5a-fc2865fc61f8 req-7c0f8b51-737b-464d-bbbf-7b9d737670e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035425 Oct 18 14:27:02.273233 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3782/7362] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:27:02.748665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1f019d98-be7e-4c17-8bfd-9ce3c3a5e4cf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:02.749274 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1f019d98-be7e-4c17-8bfd-9ce3c3a5e4cf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:02.756455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f019d98-be7e-4c17-8bfd-9ce3c3a5e4cf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:02.756974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f019d98-be7e-4c17-8bfd-9ce3c3a5e4cf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:02.757458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f019d98-be7e-4c17-8bfd-9ce3c3a5e4cf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:02.758316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f019d98-be7e-4c17-8bfd-9ce3c3a5e4cf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:02.758809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f019d98-be7e-4c17-8bfd-9ce3c3a5e4cf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:02.759263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1f019d98-be7e-4c17-8bfd-9ce3c3a5e4cf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:02.895961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1f019d98-be7e-4c17-8bfd-9ce3c3a5e4cf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:02.905019 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1f019d98-be7e-4c17-8bfd-9ce3c3a5e4cf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.160790 Oct 18 14:27:02.906085 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3581/7363] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:02 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:03.931091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9b625d2e-11a2-4346-8a43-a139654426a9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:03.931873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9b625d2e-11a2-4346-8a43-a139654426a9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:03.939754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b625d2e-11a2-4346-8a43-a139654426a9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:03.940318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b625d2e-11a2-4346-8a43-a139654426a9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:03.940826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b625d2e-11a2-4346-8a43-a139654426a9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:03.941661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b625d2e-11a2-4346-8a43-a139654426a9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:03.942192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b625d2e-11a2-4346-8a43-a139654426a9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:03.942656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b625d2e-11a2-4346-8a43-a139654426a9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:04.090353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b625d2e-11a2-4346-8a43-a139654426a9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:04.100803 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9b625d2e-11a2-4346-8a43-a139654426a9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.174866 Oct 18 14:27:04.101432 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3783/7364] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:03 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:05.128740 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4a41a629-e44a-431c-b2de-5886c6272926 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:05.129408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4a41a629-e44a-431c-b2de-5886c6272926 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:05.136223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a41a629-e44a-431c-b2de-5886c6272926 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:05.136700 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a41a629-e44a-431c-b2de-5886c6272926 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:05.137139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a41a629-e44a-431c-b2de-5886c6272926 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:05.137848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a41a629-e44a-431c-b2de-5886c6272926 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:05.138295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a41a629-e44a-431c-b2de-5886c6272926 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:05.138715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4a41a629-e44a-431c-b2de-5886c6272926 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:05.355138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4a41a629-e44a-431c-b2de-5886c6272926 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:05.363595 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4a41a629-e44a-431c-b2de-5886c6272926 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.238874 Oct 18 14:27:05.364183 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3582/7365] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:05 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:06.387084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9c56e9f1-8f8c-4d37-a218-38b9403c94fc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:06.387714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9c56e9f1-8f8c-4d37-a218-38b9403c94fc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:06.395637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c56e9f1-8f8c-4d37-a218-38b9403c94fc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:06.396133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c56e9f1-8f8c-4d37-a218-38b9403c94fc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:06.396576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c56e9f1-8f8c-4d37-a218-38b9403c94fc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:06.397310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c56e9f1-8f8c-4d37-a218-38b9403c94fc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:06.397778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c56e9f1-8f8c-4d37-a218-38b9403c94fc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:06.398214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9c56e9f1-8f8c-4d37-a218-38b9403c94fc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:06.555307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9c56e9f1-8f8c-4d37-a218-38b9403c94fc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:06.563975 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9c56e9f1-8f8c-4d37-a218-38b9403c94fc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.180768 Oct 18 14:27:06.564592 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3784/7366] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:06 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:07.589394 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3a5a1e8c-9178-478c-9926-46394e20aa8b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:07.590006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3a5a1e8c-9178-478c-9926-46394e20aa8b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:07.597684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5a1e8c-9178-478c-9926-46394e20aa8b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:07.598163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5a1e8c-9178-478c-9926-46394e20aa8b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:07.598594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5a1e8c-9178-478c-9926-46394e20aa8b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:07.599277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5a1e8c-9178-478c-9926-46394e20aa8b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:07.599722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5a1e8c-9178-478c-9926-46394e20aa8b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:07.600147 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3a5a1e8c-9178-478c-9926-46394e20aa8b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:07.741491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3a5a1e8c-9178-478c-9926-46394e20aa8b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:07.749231 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3a5a1e8c-9178-478c-9926-46394e20aa8b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.164115 Oct 18 14:27:07.749844 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3583/7367] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:07 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:08.240726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-23f9bb46-1d42-4526-936d-25f4a8d5f85a req-04008111-3b7f-4bd8-91c7-f9f38e280fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f4e78d-4e61-4a87-b0c6-53199c188a03", "name": "network-vif-plugged", "status": "completed", "tag": "979105f9-39fb-4caf-8a56-e9ebb0beb728"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:27:08.254090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-23f9bb46-1d42-4526-936d-25f4a8d5f85a req-04008111-3b7f-4bd8-91c7-f9f38e280fe3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:08.254606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-23f9bb46-1d42-4526-936d-25f4a8d5f85a req-04008111-3b7f-4bd8-91c7-f9f38e280fe3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:08.255060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-23f9bb46-1d42-4526-936d-25f4a8d5f85a req-04008111-3b7f-4bd8-91c7-f9f38e280fe3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:08.268043 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-23f9bb46-1d42-4526-936d-25f4a8d5f85a req-04008111-3b7f-4bd8-91c7-f9f38e280fe3 service nova] Creating event network-vif-plugged:979105f9-39fb-4caf-8a56-e9ebb0beb728 for instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 on n-h1-858384-13 Oct 18 14:27:08.273032 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-23f9bb46-1d42-4526-936d-25f4a8d5f85a req-04008111-3b7f-4bd8-91c7-f9f38e280fe3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036259 Oct 18 14:27:08.274082 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3785/7368] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:27:08.772802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2bf134e3-8439-4209-bf3f-4b04a28af02a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:08.773444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2bf134e3-8439-4209-bf3f-4b04a28af02a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:08.781454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2bf134e3-8439-4209-bf3f-4b04a28af02a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:08.781937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2bf134e3-8439-4209-bf3f-4b04a28af02a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:08.782369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2bf134e3-8439-4209-bf3f-4b04a28af02a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:08.783058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2bf134e3-8439-4209-bf3f-4b04a28af02a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:08.783507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2bf134e3-8439-4209-bf3f-4b04a28af02a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:08.783935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2bf134e3-8439-4209-bf3f-4b04a28af02a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:08.916534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2bf134e3-8439-4209-bf3f-4b04a28af02a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:08.924809 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2bf134e3-8439-4209-bf3f-4b04a28af02a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1359 microversion: 2.1 time: 0.155956 Oct 18 14:27:08.925422 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3584/7369] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:08 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:09.948518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9be3130a-fa11-45a2-8b81-bbec1919f99a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:09.949256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9be3130a-fa11-45a2-8b81-bbec1919f99a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:09.956355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9be3130a-fa11-45a2-8b81-bbec1919f99a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:09.956883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9be3130a-fa11-45a2-8b81-bbec1919f99a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:09.957374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9be3130a-fa11-45a2-8b81-bbec1919f99a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:09.958076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9be3130a-fa11-45a2-8b81-bbec1919f99a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:09.958542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9be3130a-fa11-45a2-8b81-bbec1919f99a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:09.958974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9be3130a-fa11-45a2-8b81-bbec1919f99a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:10.089954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9be3130a-fa11-45a2-8b81-bbec1919f99a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:10.099320 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9be3130a-fa11-45a2-8b81-bbec1919f99a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1549 microversion: 2.1 time: 0.154375 Oct 18 14:27:10.099320 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3786/7370] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:09 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:10.120886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-70f672db-9958-4da2-bad5-bf47e7a77953 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:10.121526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-70f672db-9958-4da2-bad5-bf47e7a77953 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:10.128598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70f672db-9958-4da2-bad5-bf47e7a77953 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:10.129079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70f672db-9958-4da2-bad5-bf47e7a77953 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:10.129544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70f672db-9958-4da2-bad5-bf47e7a77953 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:10.130228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70f672db-9958-4da2-bad5-bf47e7a77953 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:10.130679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70f672db-9958-4da2-bad5-bf47e7a77953 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:10.131105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-70f672db-9958-4da2-bad5-bf47e7a77953 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:10.260176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-70f672db-9958-4da2-bad5-bf47e7a77953 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:10.268722 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-70f672db-9958-4da2-bad5-bf47e7a77953 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1549 microversion: 2.1 time: 0.151688 Oct 18 14:27:10.269331 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3585/7371] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:10 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:10.290861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e0c671b4-b7f9-4770-9fdd-ac7fb46882a0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:10.296204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e0c671b4-b7f9-4770-9fdd-ac7fb46882a0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:10.296893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e0c671b4-b7f9-4770-9fdd-ac7fb46882a0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Searching by: {'deleted': False, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 14:27:10.302398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0c671b4-b7f9-4770-9fdd-ac7fb46882a0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:10.302889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0c671b4-b7f9-4770-9fdd-ac7fb46882a0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:10.303347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0c671b4-b7f9-4770-9fdd-ac7fb46882a0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:10.304092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0c671b4-b7f9-4770-9fdd-ac7fb46882a0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:10.304532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0c671b4-b7f9-4770-9fdd-ac7fb46882a0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:10.305200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e0c671b4-b7f9-4770-9fdd-ac7fb46882a0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:10.329896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-e0c671b4-b7f9-4770-9fdd-ac7fb46882a0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 14:27:10.357439 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e0c671b4-b7f9-4770-9fdd-ac7fb46882a0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070331 Oct 18 14:27:10.358836 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3787/7372] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 14:27:10 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:27:10.370886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-902b651d-6598-4620-be50-47d9023a686c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:10.371508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-902b651d-6598-4620-be50-47d9023a686c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:10.377757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-902b651d-6598-4620-be50-47d9023a686c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:10.378244 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-902b651d-6598-4620-be50-47d9023a686c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:10.378681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-902b651d-6598-4620-be50-47d9023a686c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:10.379376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-902b651d-6598-4620-be50-47d9023a686c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:10.379830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-902b651d-6598-4620-be50-47d9023a686c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:10.380260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-902b651d-6598-4620-be50-47d9023a686c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:10.511900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-902b651d-6598-4620-be50-47d9023a686c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:10.519804 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-902b651d-6598-4620-be50-47d9023a686c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1549 microversion: 2.1 time: 0.152983 Oct 18 14:27:10.520381 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3586/7373] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:10 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:12.070317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ca70b43e-82e4-47ff-8b7d-012201dbecf6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9804844-d0ae-40bf-8590-7e77160cdae4"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:27:12.072843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ca70b43e-82e4-47ff-8b7d-012201dbecf6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:12.080437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca70b43e-82e4-47ff-8b7d-012201dbecf6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:12.080940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca70b43e-82e4-47ff-8b7d-012201dbecf6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:12.081442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca70b43e-82e4-47ff-8b7d-012201dbecf6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:12.082167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca70b43e-82e4-47ff-8b7d-012201dbecf6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:12.082643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca70b43e-82e4-47ff-8b7d-012201dbecf6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:12.083089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ca70b43e-82e4-47ff-8b7d-012201dbecf6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:12.352007 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ca70b43e-82e4-47ff-8b7d-012201dbecf6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "POST /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285528 Oct 18 14:27:12.352556 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3788/7374] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 14:27:12 2022] POST /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:27:25.442103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5fc9cb3f-9d75-421c-877d-f613fb2b10fe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:25.442723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5fc9cb3f-9d75-421c-877d-f613fb2b10fe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:25.445414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:27:25.446069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=72 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:27:25.452353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fc9cb3f-9d75-421c-877d-f613fb2b10fe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:25.452840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fc9cb3f-9d75-421c-877d-f613fb2b10fe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:25.453294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fc9cb3f-9d75-421c-877d-f613fb2b10fe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:25.454038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fc9cb3f-9d75-421c-877d-f613fb2b10fe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:25.454737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fc9cb3f-9d75-421c-877d-f613fb2b10fe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:25.454900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5fc9cb3f-9d75-421c-877d-f613fb2b10fe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:25.595973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5fc9cb3f-9d75-421c-877d-f613fb2b10fe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:25.604448 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5fc9cb3f-9d75-421c-877d-f613fb2b10fe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1595 microversion: 2.1 time: 0.166124 Oct 18 14:27:25.604949 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3587/7375] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:25 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1595 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:27:27.680092 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-098a75e8-66f1-4043-9145-f6e5ad77686a req-9897b694-d9bd-4ade-8e8f-6a372f726cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f4e78d-4e61-4a87-b0c6-53199c188a03", "tag": "979105f9-39fb-4caf-8a56-e9ebb0beb728"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:27:27.688226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:27:27.688927 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:27:27.689847 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:27:27.694873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-098a75e8-66f1-4043-9145-f6e5ad77686a req-9897b694-d9bd-4ade-8e8f-6a372f726cff service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:27.695355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-098a75e8-66f1-4043-9145-f6e5ad77686a req-9897b694-d9bd-4ade-8e8f-6a372f726cff service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:27.695811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-098a75e8-66f1-4043-9145-f6e5ad77686a req-9897b694-d9bd-4ade-8e8f-6a372f726cff service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:27.711556 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-098a75e8-66f1-4043-9145-f6e5ad77686a req-9897b694-d9bd-4ade-8e8f-6a372f726cff service nova] Creating event network-changed:979105f9-39fb-4caf-8a56-e9ebb0beb728 for instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 on n-h1-858384-13 Oct 18 14:27:27.717571 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-098a75e8-66f1-4043-9145-f6e5ad77686a req-9897b694-d9bd-4ade-8e8f-6a372f726cff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042575 Oct 18 14:27:27.718405 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3789/7376] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:27:28.782597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-00917936-9010-4f78-8870-a3afc126153c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2005281725"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:27:28.783172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-00917936-9010-4f78-8870-a3afc126153c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:28.790327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00917936-9010-4f78-8870-a3afc126153c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:28.790806 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00917936-9010-4f78-8870-a3afc126153c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:28.791266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00917936-9010-4f78-8870-a3afc126153c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:28.791967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00917936-9010-4f78-8870-a3afc126153c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:28.792410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00917936-9010-4f78-8870-a3afc126153c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:28.792835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-00917936-9010-4f78-8870-a3afc126153c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:28.934253 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.network.security_group_api [None req-00917936-9010-4f78-8870-a3afc126153c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Adding security group 18d70c6a-6de6-4f3f-a9f7-04f98f310ee6 to port 979105f9-39fb-4caf-8a56-e9ebb0beb728 Oct 18 14:27:29.267002 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-00917936-9010-4f78-8870-a3afc126153c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "POST /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/action" status: 202 len: 0 microversion: 2.1 time: 0.487856 Oct 18 14:27:29.267691 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3588/7377] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:27:28 2022] POST /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:27:29.278034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-53dbac1e-412f-4df0-9e9d-24e8916db4ff tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:27:29.278770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-53dbac1e-412f-4df0-9e9d-24e8916db4ff tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:27:29.286972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53dbac1e-412f-4df0-9e9d-24e8916db4ff tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:29.287481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53dbac1e-412f-4df0-9e9d-24e8916db4ff tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:29.287939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53dbac1e-412f-4df0-9e9d-24e8916db4ff tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:29.288664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53dbac1e-412f-4df0-9e9d-24e8916db4ff tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:29.289135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53dbac1e-412f-4df0-9e9d-24e8916db4ff tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:29.289670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-53dbac1e-412f-4df0-9e9d-24e8916db4ff tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:29.442608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-53dbac1e-412f-4df0-9e9d-24e8916db4ff tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:27:29.452280 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-53dbac1e-412f-4df0-9e9d-24e8916db4ff tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1760 microversion: 2.1 time: 0.179610 Oct 18 14:27:29.453032 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3790/7378] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:27:29 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1760 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:27:29.732720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-429d0309-e2c7-4248-a327-590156637d5c req-b6bbbda0-f72f-4813-979b-5bc571ed6841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f4e78d-4e61-4a87-b0c6-53199c188a03", "tag": "979105f9-39fb-4caf-8a56-e9ebb0beb728"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:27:29.742295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-429d0309-e2c7-4248-a327-590156637d5c req-b6bbbda0-f72f-4813-979b-5bc571ed6841 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:27:29.743236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-429d0309-e2c7-4248-a327-590156637d5c req-b6bbbda0-f72f-4813-979b-5bc571ed6841 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:27:29.743236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-429d0309-e2c7-4248-a327-590156637d5c req-b6bbbda0-f72f-4813-979b-5bc571ed6841 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:27:29.757251 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-429d0309-e2c7-4248-a327-590156637d5c req-b6bbbda0-f72f-4813-979b-5bc571ed6841 service nova] Creating event network-changed:979105f9-39fb-4caf-8a56-e9ebb0beb728 for instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 on n-h1-858384-13 Oct 18 14:27:29.762633 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-429d0309-e2c7-4248-a327-590156637d5c req-b6bbbda0-f72f-4813-979b-5bc571ed6841 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033714 Oct 18 14:27:29.763842 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3589/7379] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:29:51.733286 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8f8474d7-3472-4de9-9dba-6d0727c9399f] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:29:51.733810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:51.734528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=8 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:51.735755 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:29:51.735893 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:29:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/action (ip 10.222.0.40) !!! Oct 18 14:29:51.738130 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:29:51.738273 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:29:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/action (ip 10.222.0.40) !!! Oct 18 14:29:51.750286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2a298103-3c4e-4a6f-b143-2a7d8d637c50 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:29:51.752490 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2a298103-3c4e-4a6f-b143-2a7d8d637c50 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:51.765049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a298103-3c4e-4a6f-b143-2a7d8d637c50 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:51.765511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a298103-3c4e-4a6f-b143-2a7d8d637c50 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:51.765998 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a298103-3c4e-4a6f-b143-2a7d8d637c50 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:51.766711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a298103-3c4e-4a6f-b143-2a7d8d637c50 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:51.767183 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a298103-3c4e-4a6f-b143-2a7d8d637c50 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:51.767627 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2a298103-3c4e-4a6f-b143-2a7d8d637c50 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:51.840479 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2a298103-3c4e-4a6f-b143-2a7d8d637c50 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "POST /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/action" status: 202 len: 0 microversion: 2.1 time: 0.109243 Oct 18 14:29:51.843901 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3791/7380] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:29:51 2022] POST /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:29:51.847450 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4632368d-33e6-409b-9dc2-fb1f52b7b887] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:29:51.848264 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d5b88c2f-79b6-477e-bcc2-8d31160b4455] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:29:51.849654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:51.850448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=12 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:29:51.851788 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:29:51.852124 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:29:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 (ip 10.222.0.40) !!! Oct 18 14:29:51.852992 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:29:51.853768 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:29:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 (ip 10.222.0.40) !!! Oct 18 14:29:51.854892 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:29:51.855230 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:29:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 (ip 10.222.0.40) !!! Oct 18 14:29:51.865308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9feadb3f-d6b9-4711-bdbe-c28148bc7022 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:51.866616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9feadb3f-d6b9-4711-bdbe-c28148bc7022 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:51.875651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9feadb3f-d6b9-4711-bdbe-c28148bc7022 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:51.876135 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9feadb3f-d6b9-4711-bdbe-c28148bc7022 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:51.876576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9feadb3f-d6b9-4711-bdbe-c28148bc7022 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:51.877313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9feadb3f-d6b9-4711-bdbe-c28148bc7022 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:51.877774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9feadb3f-d6b9-4711-bdbe-c28148bc7022 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:51.878206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9feadb3f-d6b9-4711-bdbe-c28148bc7022 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:52.128023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9feadb3f-d6b9-4711-bdbe-c28148bc7022 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:52.137193 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9feadb3f-d6b9-4711-bdbe-c28148bc7022 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1762 microversion: 2.1 time: 0.291646 Oct 18 14:29:52.137869 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3590/7381] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:51 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1762 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:29:53.164694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6379870b-b454-42e6-98a5-47ded7d24d98 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:29:53.165474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6379870b-b454-42e6-98a5-47ded7d24d98 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:29:53.172941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6379870b-b454-42e6-98a5-47ded7d24d98 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:53.173474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6379870b-b454-42e6-98a5-47ded7d24d98 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:53.173928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6379870b-b454-42e6-98a5-47ded7d24d98 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:53.174635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6379870b-b454-42e6-98a5-47ded7d24d98 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:29:53.175104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6379870b-b454-42e6-98a5-47ded7d24d98 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:29:53.175541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6379870b-b454-42e6-98a5-47ded7d24d98 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:29:53.179430 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] [8f8474d7-3472-4de9-9dba-6d0727c9399f] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 42516. Oct 18 14:29:53.324936 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6379870b-b454-42e6-98a5-47ded7d24d98 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:29:53.333436 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6379870b-b454-42e6-98a5-47ded7d24d98 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1760 microversion: 2.1 time: 0.175236 Oct 18 14:29:53.334792 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3792/7382] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:29:53 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1760 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:33.391711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:33.392596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:33.398164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f7a61f35-348d-46b4-8b77-16049db6932d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2005281725"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:31:33.398564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f7a61f35-348d-46b4-8b77-16049db6932d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:33.409822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7a61f35-348d-46b4-8b77-16049db6932d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:33.410304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7a61f35-348d-46b4-8b77-16049db6932d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:33.410771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7a61f35-348d-46b4-8b77-16049db6932d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:33.411460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7a61f35-348d-46b4-8b77-16049db6932d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:33.411912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7a61f35-348d-46b4-8b77-16049db6932d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:33.412341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f7a61f35-348d-46b4-8b77-16049db6932d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:33.415932 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] [d5b88c2f-79b6-477e-bcc2-8d31160b4455] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 42566. Oct 18 14:31:33.430605 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] [4632368d-33e6-409b-9dc2-fb1f52b7b887] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 42564. Oct 18 14:31:33.689619 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.network.security_group_api [None req-f7a61f35-348d-46b4-8b77-16049db6932d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Removing security group 18d70c6a-6de6-4f3f-a9f7-04f98f310ee6 from port 979105f9-39fb-4caf-8a56-e9ebb0beb728 Oct 18 14:31:34.005709 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f7a61f35-348d-46b4-8b77-16049db6932d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "POST /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/action" status: 202 len: 0 microversion: 2.1 time: 0.616518 Oct 18 14:31:34.006585 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3591/7383] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:31:33 2022] POST /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:31:34.015810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:34.018510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:34.117899 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9714e7c7-2c13-4e02-a5e1-fb1a810f58fe req-0db61429-b491-4fc5-955d-5a8150b711b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f4e78d-4e61-4a87-b0c6-53199c188a03", "tag": "979105f9-39fb-4caf-8a56-e9ebb0beb728"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:31:34.129865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9714e7c7-2c13-4e02-a5e1-fb1a810f58fe req-0db61429-b491-4fc5-955d-5a8150b711b8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:34.130459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9714e7c7-2c13-4e02-a5e1-fb1a810f58fe req-0db61429-b491-4fc5-955d-5a8150b711b8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:34.130996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9714e7c7-2c13-4e02-a5e1-fb1a810f58fe req-0db61429-b491-4fc5-955d-5a8150b711b8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:34.147152 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9714e7c7-2c13-4e02-a5e1-fb1a810f58fe req-0db61429-b491-4fc5-955d-5a8150b711b8 service nova] Creating event network-changed:979105f9-39fb-4caf-8a56-e9ebb0beb728 for instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 on n-h1-858384-13 Oct 18 14:31:34.166076 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9714e7c7-2c13-4e02-a5e1-fb1a810f58fe req-0db61429-b491-4fc5-955d-5a8150b711b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153095 Oct 18 14:31:34.167244 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3793/7384] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:35.222417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a76d82fd-cbf7-4fb0-8acd-f19e37c6af0c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:35.223040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a76d82fd-cbf7-4fb0-8acd-f19e37c6af0c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:35.230513 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a76d82fd-cbf7-4fb0-8acd-f19e37c6af0c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:35.231228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a76d82fd-cbf7-4fb0-8acd-f19e37c6af0c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:35.231669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a76d82fd-cbf7-4fb0-8acd-f19e37c6af0c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:35.232568 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a76d82fd-cbf7-4fb0-8acd-f19e37c6af0c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:35.233141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a76d82fd-cbf7-4fb0-8acd-f19e37c6af0c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:35.233488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a76d82fd-cbf7-4fb0-8acd-f19e37c6af0c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:35.253792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7b63ef93-f233-4244-8469-1c93241f9878 req-3f0f9257-c8ee-488e-9866-85914be008f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f4e78d-4e61-4a87-b0c6-53199c188a03", "tag": "979105f9-39fb-4caf-8a56-e9ebb0beb728"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:31:35.263735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7b63ef93-f233-4244-8469-1c93241f9878 req-3f0f9257-c8ee-488e-9866-85914be008f7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:35.264639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7b63ef93-f233-4244-8469-1c93241f9878 req-3f0f9257-c8ee-488e-9866-85914be008f7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:35.265080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7b63ef93-f233-4244-8469-1c93241f9878 req-3f0f9257-c8ee-488e-9866-85914be008f7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:35.278959 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7b63ef93-f233-4244-8469-1c93241f9878 req-3f0f9257-c8ee-488e-9866-85914be008f7 service nova] Creating event network-changed:979105f9-39fb-4caf-8a56-e9ebb0beb728 for instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 on n-h1-858384-13 Oct 18 14:31:35.286675 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7b63ef93-f233-4244-8469-1c93241f9878 req-3f0f9257-c8ee-488e-9866-85914be008f7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114272 Oct 18 14:31:35.287378 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3592/7385] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:35.444819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-a76d82fd-cbf7-4fb0-8acd-f19e37c6af0c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lazy-loading 'services' on Instance uuid 69f4e78d-4e61-4a87-b0c6-53199c188a03 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:31:35.523975 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a76d82fd-cbf7-4fb0-8acd-f19e37c6af0c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "DELETE /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments/c9804844-d0ae-40bf-8590-7e77160cdae4" status: 202 len: 0 microversion: 2.1 time: 0.307482 Oct 18 14:31:35.524584 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3794/7386] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 14:31:35 2022] DELETE /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments/c9804844-d0ae-40bf-8590-7e77160cdae4 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:31:35.534742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-604c0d48-6956-4b6f-b2fd-e568baf2b8be tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:35.537312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-604c0d48-6956-4b6f-b2fd-e568baf2b8be tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:35.546990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-604c0d48-6956-4b6f-b2fd-e568baf2b8be tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:35.547489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-604c0d48-6956-4b6f-b2fd-e568baf2b8be tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:35.547906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-604c0d48-6956-4b6f-b2fd-e568baf2b8be tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:35.549255 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-604c0d48-6956-4b6f-b2fd-e568baf2b8be tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:35.549821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-604c0d48-6956-4b6f-b2fd-e568baf2b8be tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:35.550246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-604c0d48-6956-4b6f-b2fd-e568baf2b8be tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:35.583778 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-604c0d48-6956-4b6f-b2fd-e568baf2b8be tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054514 Oct 18 14:31:35.584410 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3593/7387] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:31:35 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:36.644823 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2d540c7c-bfd6-42eb-b33f-06bc37903a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:36.647166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2d540c7c-bfd6-42eb-b33f-06bc37903a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:36.653871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d540c7c-bfd6-42eb-b33f-06bc37903a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:36.654377 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d540c7c-bfd6-42eb-b33f-06bc37903a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:36.654829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d540c7c-bfd6-42eb-b33f-06bc37903a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:36.655537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d540c7c-bfd6-42eb-b33f-06bc37903a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:36.656007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d540c7c-bfd6-42eb-b33f-06bc37903a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:36.656453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d540c7c-bfd6-42eb-b33f-06bc37903a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:36.687403 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2d540c7c-bfd6-42eb-b33f-06bc37903a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094882 Oct 18 14:31:36.687988 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3795/7388] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:31:36 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:37.700379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-074b7d0d-b98d-4e3c-b70d-fba825d4acfc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:37.702664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-074b7d0d-b98d-4e3c-b70d-fba825d4acfc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:37.710580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-074b7d0d-b98d-4e3c-b70d-fba825d4acfc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:37.711327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-074b7d0d-b98d-4e3c-b70d-fba825d4acfc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:37.711767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-074b7d0d-b98d-4e3c-b70d-fba825d4acfc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:37.712482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-074b7d0d-b98d-4e3c-b70d-fba825d4acfc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:37.712939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-074b7d0d-b98d-4e3c-b70d-fba825d4acfc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:37.713399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-074b7d0d-b98d-4e3c-b70d-fba825d4acfc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:37.745945 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-074b7d0d-b98d-4e3c-b70d-fba825d4acfc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049592 Oct 18 14:31:37.746459 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3594/7389] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:31:37 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:38.758767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ea91e900-b6ca-4655-8907-161adeee0b1e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:38.760883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ea91e900-b6ca-4655-8907-161adeee0b1e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:38.767834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea91e900-b6ca-4655-8907-161adeee0b1e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:38.768330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea91e900-b6ca-4655-8907-161adeee0b1e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:38.768784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea91e900-b6ca-4655-8907-161adeee0b1e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:38.769548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea91e900-b6ca-4655-8907-161adeee0b1e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:38.770028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea91e900-b6ca-4655-8907-161adeee0b1e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:38.770493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea91e900-b6ca-4655-8907-161adeee0b1e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:38.804882 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ea91e900-b6ca-4655-8907-161adeee0b1e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050179 Oct 18 14:31:38.805497 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3796/7390] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:31:38 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:39.818969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9fccf538-5766-49b5-923e-78970563d06f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:39.821221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9fccf538-5766-49b5-923e-78970563d06f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:39.828073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fccf538-5766-49b5-923e-78970563d06f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:39.828548 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fccf538-5766-49b5-923e-78970563d06f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:39.828976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fccf538-5766-49b5-923e-78970563d06f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:39.829698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fccf538-5766-49b5-923e-78970563d06f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:39.830225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fccf538-5766-49b5-923e-78970563d06f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:39.830652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9fccf538-5766-49b5-923e-78970563d06f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:39.861490 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9fccf538-5766-49b5-923e-78970563d06f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046032 Oct 18 14:31:39.862180 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3595/7391] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:31:39 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:40.873670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-57bf1f3c-21e3-41fa-b2b2-0386a79d5214 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:40.875843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-57bf1f3c-21e3-41fa-b2b2-0386a79d5214 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:40.883397 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57bf1f3c-21e3-41fa-b2b2-0386a79d5214 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:40.883894 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57bf1f3c-21e3-41fa-b2b2-0386a79d5214 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:40.884343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57bf1f3c-21e3-41fa-b2b2-0386a79d5214 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:40.885048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57bf1f3c-21e3-41fa-b2b2-0386a79d5214 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:40.885543 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57bf1f3c-21e3-41fa-b2b2-0386a79d5214 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:40.885987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-57bf1f3c-21e3-41fa-b2b2-0386a79d5214 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:40.915636 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-57bf1f3c-21e3-41fa-b2b2-0386a79d5214 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045967 Oct 18 14:31:40.916199 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3797/7392] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:31:40 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:31:40.927181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-438d71fe-3183-476a-b380-4b083320ab9b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:40.927904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-438d71fe-3183-476a-b380-4b083320ab9b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:40.935033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-438d71fe-3183-476a-b380-4b083320ab9b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:40.935510 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-438d71fe-3183-476a-b380-4b083320ab9b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:40.935947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-438d71fe-3183-476a-b380-4b083320ab9b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:40.936626 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-438d71fe-3183-476a-b380-4b083320ab9b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:40.937077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-438d71fe-3183-476a-b380-4b083320ab9b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:40.937530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-438d71fe-3183-476a-b380-4b083320ab9b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:41.015196 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-438d71fe-3183-476a-b380-4b083320ab9b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] HTTP exception thrown: Instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 is not attached to volume c9804844-d0ae-40bf-8590-7e77160cdae4 Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-438d71fe-3183-476a-b380-4b083320ab9b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Request method failure captured: Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: request: DELETE /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments/c9804844-d0ae-40bf-8590-7e77160cdae4 HTTP/1.1 Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTreXYaGJ2ttpLCvxt6yD2LHjqYrjD6P5W4ucFnDSc1Qz12UwJ4EBqsRINiCANQ49_bM5HcnB-6uqcMPFgkEs3YeA4YSB3zRtR_VC_skgXMYI8iHz81DMU4y8M_QPh4ePn_7MOM6aJ2ZjSSLrOZ6vxpl6MSqae9_VOICIPtHZ6rKPhlk Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: bc3d208b5a254f11bd78ca9c809fd40c Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestMinimumBasicScenario-2064219333 Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc3d208b5a254f11bd78ca9c809fd40c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bc3d208b5a254f11bd78ca9c809fd40c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc3d208b5a254f11bd78ca9c809fd40c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bc3d208b5a254f11bd78ca9c809fd40c"}]}] Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestMinimumBasicScenario-2064219333 Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: bc3d208b5a254f11bd78ca9c809fd40c Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2064219333 Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestMinimumBasicScenario-2064219333-project Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 89067a43c4d34f1a9101d1078ccbc52e Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestMinimumBasicScenario-2064219333-project Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 is not attached to volume c9804844-d0ae-40bf-8590-7e77160cdae4 Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'server_id': '69f4e78d-4e61-4a87-b0c6-53199c188a03', 'id': 'c9804844-d0ae-40bf-8590-7e77160cdae4'} Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c9804844-d0ae-40bf-8590-7e77160cdae4. Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 is not attached to volume c9804844-d0ae-40bf-8590-7e77160cdae4 Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:31:41.016780 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:31:41.022943 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:31:41.022943 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:31:41.022943 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 is not attached to volume c9804844-d0ae-40bf-8590-7e77160cdae4 Oct 18 14:31:41.022943 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:31:41.022943 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-438d71fe-3183-476a-b380-4b083320ab9b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Returning 404 to user: Instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 is not attached to volume c9804844-d0ae-40bf-8590-7e77160cdae4 {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:31:41.022943 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-438d71fe-3183-476a-b380-4b083320ab9b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "DELETE /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments/c9804844-d0ae-40bf-8590-7e77160cdae4" status: 404 len: 154 microversion: 2.1 time: 0.095947 Oct 18 14:31:41.022943 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3596/7393] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 14:31:40 2022] DELETE /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03/os-volume_attachments/c9804844-d0ae-40bf-8590-7e77160cdae4 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:31:44.279683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-55e48f38-fecf-4e06-9f77-6513a3496ec9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:44.280223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-55e48f38-fecf-4e06-9f77-6513a3496ec9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:44.288155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55e48f38-fecf-4e06-9f77-6513a3496ec9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:44.288647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55e48f38-fecf-4e06-9f77-6513a3496ec9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:44.289091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55e48f38-fecf-4e06-9f77-6513a3496ec9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:44.289822 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55e48f38-fecf-4e06-9f77-6513a3496ec9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:44.290283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55e48f38-fecf-4e06-9f77-6513a3496ec9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:44.290721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55e48f38-fecf-4e06-9f77-6513a3496ec9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:44.316595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-55e48f38-fecf-4e06-9f77-6513a3496ec9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:31:44.397758 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-55e48f38-fecf-4e06-9f77-6513a3496ec9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "DELETE /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 204 len: 0 microversion: 2.1 time: 0.121771 Oct 18 14:31:44.398663 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3798/7394] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:31:44 2022] DELETE /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:31:44.410238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9e4f53fe-8f43-4c2d-92b0-b592ada5ba9a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:44.411168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9e4f53fe-8f43-4c2d-92b0-b592ada5ba9a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:44.418896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e4f53fe-8f43-4c2d-92b0-b592ada5ba9a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:44.419549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e4f53fe-8f43-4c2d-92b0-b592ada5ba9a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:44.420002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e4f53fe-8f43-4c2d-92b0-b592ada5ba9a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:44.420724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e4f53fe-8f43-4c2d-92b0-b592ada5ba9a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:44.421215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e4f53fe-8f43-4c2d-92b0-b592ada5ba9a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:44.421645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e4f53fe-8f43-4c2d-92b0-b592ada5ba9a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:44.559378 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9e4f53fe-8f43-4c2d-92b0-b592ada5ba9a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:44.568280 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9e4f53fe-8f43-4c2d-92b0-b592ada5ba9a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1555 microversion: 2.1 time: 0.164127 Oct 18 14:31:44.568798 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3597/7395] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:44 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:45.594795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-63752684-0f7c-4799-bbc3-2e26b5341c4b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:45.596128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-63752684-0f7c-4799-bbc3-2e26b5341c4b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:45.603469 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63752684-0f7c-4799-bbc3-2e26b5341c4b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:45.603996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63752684-0f7c-4799-bbc3-2e26b5341c4b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:45.604457 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63752684-0f7c-4799-bbc3-2e26b5341c4b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:45.605169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63752684-0f7c-4799-bbc3-2e26b5341c4b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:45.605657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63752684-0f7c-4799-bbc3-2e26b5341c4b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:45.606100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-63752684-0f7c-4799-bbc3-2e26b5341c4b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:45.742298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-63752684-0f7c-4799-bbc3-2e26b5341c4b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:45.750406 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-63752684-0f7c-4799-bbc3-2e26b5341c4b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1555 microversion: 2.1 time: 0.159993 Oct 18 14:31:45.750989 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3799/7396] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:45 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:46.774552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-033beec2-d2fb-458f-9cda-43302573fdc4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:46.775009 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-033beec2-d2fb-458f-9cda-43302573fdc4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:46.781908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-033beec2-d2fb-458f-9cda-43302573fdc4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:46.782398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-033beec2-d2fb-458f-9cda-43302573fdc4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:46.782947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-033beec2-d2fb-458f-9cda-43302573fdc4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:46.783681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-033beec2-d2fb-458f-9cda-43302573fdc4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:46.784167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-033beec2-d2fb-458f-9cda-43302573fdc4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:46.784591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-033beec2-d2fb-458f-9cda-43302573fdc4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:46.972932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-033beec2-d2fb-458f-9cda-43302573fdc4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:46.981931 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-033beec2-d2fb-458f-9cda-43302573fdc4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 200 len: 1555 microversion: 2.1 time: 0.211479 Oct 18 14:31:46.982973 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3598/7397] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:46 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:47.088043 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3b7beb47-7216-437d-8ee3-184927709c77 req-c6cf64d4-a4c5-416e-8fa7-ae22b7f9a8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f4e78d-4e61-4a87-b0c6-53199c188a03", "name": "network-vif-deleted", "tag": "979105f9-39fb-4caf-8a56-e9ebb0beb728"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:31:47.099632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3b7beb47-7216-437d-8ee3-184927709c77 req-c6cf64d4-a4c5-416e-8fa7-ae22b7f9a8f6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:47.100464 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3b7beb47-7216-437d-8ee3-184927709c77 req-c6cf64d4-a4c5-416e-8fa7-ae22b7f9a8f6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:47.100665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3b7beb47-7216-437d-8ee3-184927709c77 req-c6cf64d4-a4c5-416e-8fa7-ae22b7f9a8f6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:47.113521 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3b7beb47-7216-437d-8ee3-184927709c77 req-c6cf64d4-a4c5-416e-8fa7-ae22b7f9a8f6 service nova] Creating event network-vif-deleted:979105f9-39fb-4caf-8a56-e9ebb0beb728 for instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 on n-h1-858384-13 Oct 18 14:31:47.119079 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3b7beb47-7216-437d-8ee3-184927709c77 req-c6cf64d4-a4c5-416e-8fa7-ae22b7f9a8f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034995 Oct 18 14:31:47.119899 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3800/7398] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:48.007623 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f153f653-7520-4c5b-9f66-4dc2639bad1b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:48.008501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f153f653-7520-4c5b-9f66-4dc2639bad1b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: 69f4e78d-4e61-4a87-b0c6-53199c188a03] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:48.014514 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f153f653-7520-4c5b-9f66-4dc2639bad1b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:48.014984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f153f653-7520-4c5b-9f66-4dc2639bad1b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:48.015426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f153f653-7520-4c5b-9f66-4dc2639bad1b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:48.016112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f153f653-7520-4c5b-9f66-4dc2639bad1b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:48.016562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f153f653-7520-4c5b-9f66-4dc2639bad1b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:48.017019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f153f653-7520-4c5b-9f66-4dc2639bad1b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:48.030960 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-f153f653-7520-4c5b-9f66-4dc2639bad1b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] HTTP exception thrown: Instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 could not be found. Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f153f653-7520-4c5b-9f66-4dc2639bad1b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Request method failure captured: Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 HTTP/1.1 Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTreXYaGJ2ttpLCvxt6yD2LHjqYrjD6P5W4ucFnDSc1Qz12UwJ4EBqsRINiCANQ49_bM5HcnB-6uqcMPFgkEs3YeA4YSB3zRtR_VC_skgXMYI8iHz81DMU4y8M_QPh4ePn_7MOM6aJ2ZjSSLrOZ6vxpl6MSqae9_VOICIPtHZ6rKPhlk Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: bc3d208b5a254f11bd78ca9c809fd40c Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestMinimumBasicScenario-2064219333 Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc3d208b5a254f11bd78ca9c809fd40c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bc3d208b5a254f11bd78ca9c809fd40c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc3d208b5a254f11bd78ca9c809fd40c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bc3d208b5a254f11bd78ca9c809fd40c"}]}] Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestMinimumBasicScenario-2064219333 Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: bc3d208b5a254f11bd78ca9c809fd40c Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2064219333 Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestMinimumBasicScenario-2064219333-project Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 89067a43c4d34f1a9101d1078ccbc52e Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestMinimumBasicScenario-2064219333-project Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 could not be found. Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '69f4e78d-4e61-4a87-b0c6-53199c188a03'} Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 could not be found. Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 could not be found. Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:31:48.032539 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:31:48.039105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:31:48.039105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:31:48.039105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:31:48.039105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:31:48.039105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:31:48.039105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 could not be found. Oct 18 14:31:48.039105 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:31:48.039105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f153f653-7520-4c5b-9f66-4dc2639bad1b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Returning 404 to user: Instance 69f4e78d-4e61-4a87-b0c6-53199c188a03 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:31:48.039105 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f153f653-7520-4c5b-9f66-4dc2639bad1b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03" status: 404 len: 111 microversion: 2.1 time: 0.031254 Oct 18 14:31:48.039105 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3599/7399] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:48 2022] GET /compute/v2.1/servers/69f4e78d-4e61-4a87-b0c6-53199c188a03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:31:48.044046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a404ac99-cf0a-4a09-9254-bb890d3a317e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '.version_select at 0x7ff60e400820>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:48.068550 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a404ac99-cf0a-4a09-9254-bb890d3a317e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1546195017" status: 202 len: 0 microversion: 2.1 time: 0.028686 Oct 18 14:31:48.069205 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3801/7400] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 14:31:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1546195017 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:31:57.302347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-74c7375a-1e9f-440f-8fb0-5eb23a787ab1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Action: 'create', calling method: .version_select at 0x7ff60ea659d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2091896376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEBJtjZ5PRuXPUD0l9F9IC8M0wjmtRwdA8PMoNF9pc27+6TGdpHKmyFYHcle3bCBtYgSMBIq7YfAknopmlkQcG+zGfCmjNC35Y1DOsHSK0dpiXfHpGr/jRLQ85+DldHrw=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:31:57.320103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-74c7375a-1e9f-440f-8fb0-5eb23a787ab1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Getting quotas for project bc3d208b5a254f11bd78ca9c809fd40c. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:31:57.325964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-74c7375a-1e9f-440f-8fb0-5eb23a787ab1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Getting quotas for user 89067a43c4d34f1a9101d1078ccbc52e and project bc3d208b5a254f11bd78ca9c809fd40c. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:31:57.353580 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-74c7375a-1e9f-440f-8fb0-5eb23a787ab1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054975 Oct 18 14:31:57.354211 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3600/7401] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:31:57 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:31:57.403447 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2749d46-7aff-41c9-91de-55da262717f1] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:31:57.406722 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1060441828", "imageRef": "522cb1c9-060b-47c9-bf0b-c92b0b79e1cc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2091896376", "networks": [{"uuid": "0aa525fd-fae4-47f8-911a-1ec9613492d6"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:31:57.415968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:57.461763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] validate_networks() for [('0aa525fd-fae4-47f8-911a-1ec9613492d6', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:31:57.882336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:31:57.882784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:31:57.883286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:31:57.883719 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:31:57.884178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:31:57.893206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:57.893718 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:57.894175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:57.895697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:57.896172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:57.896621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:57.913654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Getting quotas for project bc3d208b5a254f11bd78ca9c809fd40c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:31:57.919094 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Getting quotas for user 89067a43c4d34f1a9101d1078ccbc52e and project bc3d208b5a254f11bd78ca9c809fd40c. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:31:57.931941 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:31:57.934315 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='522cb1c9-060b-47c9-bf0b-c92b0b79e1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:31:57.982400 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7c00e709-36f1-4dbb-b266-20cfc8e51fa6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580975 Oct 18 14:31:57.983055 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3802/7402] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:31:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:31:57.994396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9d39f770-8fdf-447c-93d4-0647a7dd1ac8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:57.995008 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9d39f770-8fdf-447c-93d4-0647a7dd1ac8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:58.022552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=44 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:31:58.053596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9d39f770-8fdf-447c-93d4-0647a7dd1ac8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:58.066043 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9d39f770-8fdf-447c-93d4-0647a7dd1ac8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1259 microversion: 2.1 time: 0.075002 Oct 18 14:31:58.067314 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3601/7403] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:57 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1259 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:31:59.094158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1023f72a-739e-4b12-b45a-00e99e612df8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:31:59.094819 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1023f72a-739e-4b12-b45a-00e99e612df8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:31:59.103025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1023f72a-739e-4b12-b45a-00e99e612df8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:59.103517 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1023f72a-739e-4b12-b45a-00e99e612df8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:59.103974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1023f72a-739e-4b12-b45a-00e99e612df8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:59.104690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1023f72a-739e-4b12-b45a-00e99e612df8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:31:59.105157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1023f72a-739e-4b12-b45a-00e99e612df8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:31:59.105621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1023f72a-739e-4b12-b45a-00e99e612df8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:31:59.111258 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2749d46-7aff-41c9-91de-55da262717f1] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 42760. Oct 18 14:31:59.176670 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1023f72a-739e-4b12-b45a-00e99e612df8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:31:59.187469 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1023f72a-739e-4b12-b45a-00e99e612df8 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1319 microversion: 2.1 time: 0.098270 Oct 18 14:31:59.188075 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3803/7404] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:31:59 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:00.214038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7552d4ea-3f65-48e7-a3eb-be59025fd418 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:00.214592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7552d4ea-3f65-48e7-a3eb-be59025fd418 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:00.222313 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7552d4ea-3f65-48e7-a3eb-be59025fd418 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:00.223383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7552d4ea-3f65-48e7-a3eb-be59025fd418 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:00.223824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7552d4ea-3f65-48e7-a3eb-be59025fd418 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:00.224673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7552d4ea-3f65-48e7-a3eb-be59025fd418 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:00.225130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7552d4ea-3f65-48e7-a3eb-be59025fd418 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:00.225584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7552d4ea-3f65-48e7-a3eb-be59025fd418 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:00.385794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7552d4ea-3f65-48e7-a3eb-be59025fd418 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:00.394267 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7552d4ea-3f65-48e7-a3eb-be59025fd418 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.184315 Oct 18 14:32:00.396533 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3602/7405] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:00 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:01.419240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-71cf1439-29e9-4891-9ccb-9ac089cb99bf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:01.419793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-71cf1439-29e9-4891-9ccb-9ac089cb99bf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:01.426918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71cf1439-29e9-4891-9ccb-9ac089cb99bf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:01.427418 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71cf1439-29e9-4891-9ccb-9ac089cb99bf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:01.427943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71cf1439-29e9-4891-9ccb-9ac089cb99bf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:01.428633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71cf1439-29e9-4891-9ccb-9ac089cb99bf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:01.429104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71cf1439-29e9-4891-9ccb-9ac089cb99bf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:01.429574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-71cf1439-29e9-4891-9ccb-9ac089cb99bf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:01.589924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-71cf1439-29e9-4891-9ccb-9ac089cb99bf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:01.598789 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-71cf1439-29e9-4891-9ccb-9ac089cb99bf tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.183604 Oct 18 14:32:01.599364 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3804/7406] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:01 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:02.623169 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ff569671-8da3-4f8a-8999-172ca5d50617 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:02.623758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ff569671-8da3-4f8a-8999-172ca5d50617 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:02.631757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff569671-8da3-4f8a-8999-172ca5d50617 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:02.632245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff569671-8da3-4f8a-8999-172ca5d50617 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:02.632676 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff569671-8da3-4f8a-8999-172ca5d50617 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:02.633629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff569671-8da3-4f8a-8999-172ca5d50617 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:02.634080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff569671-8da3-4f8a-8999-172ca5d50617 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:02.634501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ff569671-8da3-4f8a-8999-172ca5d50617 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:02.775803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ff569671-8da3-4f8a-8999-172ca5d50617 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:02.784399 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ff569671-8da3-4f8a-8999-172ca5d50617 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.165063 Oct 18 14:32:02.785004 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3603/7407] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:02 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:03.809402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dbdd71a1-5ec5-4d51-ae74-9adb7801f49c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:03.810025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dbdd71a1-5ec5-4d51-ae74-9adb7801f49c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:03.818018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbdd71a1-5ec5-4d51-ae74-9adb7801f49c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:03.818521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbdd71a1-5ec5-4d51-ae74-9adb7801f49c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:03.818972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbdd71a1-5ec5-4d51-ae74-9adb7801f49c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:03.819706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbdd71a1-5ec5-4d51-ae74-9adb7801f49c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:03.820160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbdd71a1-5ec5-4d51-ae74-9adb7801f49c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:03.820609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dbdd71a1-5ec5-4d51-ae74-9adb7801f49c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:03.962795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-dbdd71a1-5ec5-4d51-ae74-9adb7801f49c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:03.970781 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dbdd71a1-5ec5-4d51-ae74-9adb7801f49c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.165322 Oct 18 14:32:03.971783 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3805/7408] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:03 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:04.994360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f8ecabf1-2654-43ec-b325-69ca920593ca tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:04.995854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f8ecabf1-2654-43ec-b325-69ca920593ca tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:04.999418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:05.003903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8ecabf1-2654-43ec-b325-69ca920593ca tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:05.004669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8ecabf1-2654-43ec-b325-69ca920593ca tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:05.004976 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8ecabf1-2654-43ec-b325-69ca920593ca tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:05.005745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8ecabf1-2654-43ec-b325-69ca920593ca tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:05.006181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8ecabf1-2654-43ec-b325-69ca920593ca tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:05.006795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8ecabf1-2654-43ec-b325-69ca920593ca tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:05.152831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f8ecabf1-2654-43ec-b325-69ca920593ca tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:05.161953 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f8ecabf1-2654-43ec-b325-69ca920593ca tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.171947 Oct 18 14:32:05.162784 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3604/7409] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:04 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:32:06.185439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-455fbbe0-5953-47be-8f42-d86826c111b0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:06.186073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-455fbbe0-5953-47be-8f42-d86826c111b0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:06.188772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:06.194417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-455fbbe0-5953-47be-8f42-d86826c111b0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:06.194923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-455fbbe0-5953-47be-8f42-d86826c111b0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:06.195376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-455fbbe0-5953-47be-8f42-d86826c111b0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:06.196099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-455fbbe0-5953-47be-8f42-d86826c111b0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:06.196572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-455fbbe0-5953-47be-8f42-d86826c111b0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:06.197017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-455fbbe0-5953-47be-8f42-d86826c111b0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:06.357268 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-455fbbe0-5953-47be-8f42-d86826c111b0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:06.370316 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-455fbbe0-5953-47be-8f42-d86826c111b0 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.188710 Oct 18 14:32:06.371122 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3806/7410] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:06 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:07.396524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f83368da-0aad-47c8-9bd5-3ad0e8b69211 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:07.397103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f83368da-0aad-47c8-9bd5-3ad0e8b69211 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:07.404033 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f83368da-0aad-47c8-9bd5-3ad0e8b69211 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:07.404516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f83368da-0aad-47c8-9bd5-3ad0e8b69211 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:07.404948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f83368da-0aad-47c8-9bd5-3ad0e8b69211 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:07.405675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f83368da-0aad-47c8-9bd5-3ad0e8b69211 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:07.406125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f83368da-0aad-47c8-9bd5-3ad0e8b69211 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:07.406546 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f83368da-0aad-47c8-9bd5-3ad0e8b69211 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:07.567482 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f83368da-0aad-47c8-9bd5-3ad0e8b69211 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:07.575832 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f83368da-0aad-47c8-9bd5-3ad0e8b69211 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.183947 Oct 18 14:32:07.576424 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3605/7411] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:07 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:08.600303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7e042976-b850-42a2-9078-9ec3ce64380e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:08.600950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7e042976-b850-42a2-9078-9ec3ce64380e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:08.603635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:08.604310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:08.609982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e042976-b850-42a2-9078-9ec3ce64380e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:08.610475 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e042976-b850-42a2-9078-9ec3ce64380e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:08.610922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e042976-b850-42a2-9078-9ec3ce64380e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:08.611620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e042976-b850-42a2-9078-9ec3ce64380e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:08.612082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e042976-b850-42a2-9078-9ec3ce64380e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:08.612516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7e042976-b850-42a2-9078-9ec3ce64380e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:08.742928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7e042976-b850-42a2-9078-9ec3ce64380e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:08.750963 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7e042976-b850-42a2-9078-9ec3ce64380e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.155111 Oct 18 14:32:08.751519 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3807/7412] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:08 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:09.774322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9391839f-9c98-4d74-9509-91efc3e3cbe1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:09.774958 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9391839f-9c98-4d74-9509-91efc3e3cbe1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:09.776920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:09.782921 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9391839f-9c98-4d74-9509-91efc3e3cbe1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:09.783397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9391839f-9c98-4d74-9509-91efc3e3cbe1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:09.783826 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9391839f-9c98-4d74-9509-91efc3e3cbe1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:09.784578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9391839f-9c98-4d74-9509-91efc3e3cbe1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:09.785089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9391839f-9c98-4d74-9509-91efc3e3cbe1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:09.785530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9391839f-9c98-4d74-9509-91efc3e3cbe1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:09.918564 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9391839f-9c98-4d74-9509-91efc3e3cbe1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:09.926426 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9391839f-9c98-4d74-9509-91efc3e3cbe1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.155988 Oct 18 14:32:09.927107 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3606/7413] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:09 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:10.950380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5610f769-2b63-4d1a-bfd3-507c006c437f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:10.950988 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5610f769-2b63-4d1a-bfd3-507c006c437f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:10.958225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5610f769-2b63-4d1a-bfd3-507c006c437f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:10.958809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5610f769-2b63-4d1a-bfd3-507c006c437f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:10.959261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5610f769-2b63-4d1a-bfd3-507c006c437f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:10.959970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5610f769-2b63-4d1a-bfd3-507c006c437f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:10.960438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5610f769-2b63-4d1a-bfd3-507c006c437f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:10.960875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5610f769-2b63-4d1a-bfd3-507c006c437f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:11.092439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5610f769-2b63-4d1a-bfd3-507c006c437f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:11.101225 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5610f769-2b63-4d1a-bfd3-507c006c437f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.154682 Oct 18 14:32:11.101841 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3808/7414] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:10 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:11.699945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-763067f5-0d69-4506-af4a-bdf5f1f19b75 req-292cabd3-750d-4514-aaa9-79591ab0da91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab8e7c47-ccff-423e-90b9-77ac93afd8d3", "tag": "627985d3-e5c9-4ac1-84f0-35a371c2ebea"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:32:11.711636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-763067f5-0d69-4506-af4a-bdf5f1f19b75 req-292cabd3-750d-4514-aaa9-79591ab0da91 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:11.712137 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-763067f5-0d69-4506-af4a-bdf5f1f19b75 req-292cabd3-750d-4514-aaa9-79591ab0da91 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:11.712807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-763067f5-0d69-4506-af4a-bdf5f1f19b75 req-292cabd3-750d-4514-aaa9-79591ab0da91 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:11.724727 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-763067f5-0d69-4506-af4a-bdf5f1f19b75 req-292cabd3-750d-4514-aaa9-79591ab0da91 service nova] Creating event network-changed:627985d3-e5c9-4ac1-84f0-35a371c2ebea for instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 on n-h1-858384-13 Oct 18 14:32:11.732245 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-763067f5-0d69-4506-af4a-bdf5f1f19b75 req-292cabd3-750d-4514-aaa9-79591ab0da91 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035362 Oct 18 14:32:11.733234 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3607/7415] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:32:12.124344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a1f66aea-72a4-46ca-b6cd-f2b4a2f62cc9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:12.124976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a1f66aea-72a4-46ca-b6cd-f2b4a2f62cc9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:12.132637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1f66aea-72a4-46ca-b6cd-f2b4a2f62cc9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:12.133138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1f66aea-72a4-46ca-b6cd-f2b4a2f62cc9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:12.133617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1f66aea-72a4-46ca-b6cd-f2b4a2f62cc9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:12.134337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1f66aea-72a4-46ca-b6cd-f2b4a2f62cc9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:12.134807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1f66aea-72a4-46ca-b6cd-f2b4a2f62cc9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:12.135249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a1f66aea-72a4-46ca-b6cd-f2b4a2f62cc9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:12.270781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a1f66aea-72a4-46ca-b6cd-f2b4a2f62cc9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:12.278847 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a1f66aea-72a4-46ca-b6cd-f2b4a2f62cc9 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.158448 Oct 18 14:32:12.279427 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3809/7416] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:12 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:13.304994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b7b1fbff-99d0-4339-b1dc-d48fd94e815f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:13.305744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b7b1fbff-99d0-4339-b1dc-d48fd94e815f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:13.311964 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7b1fbff-99d0-4339-b1dc-d48fd94e815f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:13.312443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7b1fbff-99d0-4339-b1dc-d48fd94e815f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:13.312884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7b1fbff-99d0-4339-b1dc-d48fd94e815f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:13.313918 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7b1fbff-99d0-4339-b1dc-d48fd94e815f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:13.314368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7b1fbff-99d0-4339-b1dc-d48fd94e815f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:13.314792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b7b1fbff-99d0-4339-b1dc-d48fd94e815f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:13.445745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b7b1fbff-99d0-4339-b1dc-d48fd94e815f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:13.453459 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b7b1fbff-99d0-4339-b1dc-d48fd94e815f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.154721 Oct 18 14:32:13.454043 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3608/7417] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:13 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:14.477743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a4e3ee05-243a-4c1f-84c3-284df574a4e1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:14.478376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a4e3ee05-243a-4c1f-84c3-284df574a4e1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:14.485447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4e3ee05-243a-4c1f-84c3-284df574a4e1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:14.485948 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4e3ee05-243a-4c1f-84c3-284df574a4e1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:14.486398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4e3ee05-243a-4c1f-84c3-284df574a4e1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:14.487112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4e3ee05-243a-4c1f-84c3-284df574a4e1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:14.487608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4e3ee05-243a-4c1f-84c3-284df574a4e1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:14.488024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4e3ee05-243a-4c1f-84c3-284df574a4e1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:14.623942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a4e3ee05-243a-4c1f-84c3-284df574a4e1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:14.632449 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a4e3ee05-243a-4c1f-84c3-284df574a4e1 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.159379 Oct 18 14:32:14.633047 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3810/7418] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:14 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:15.655971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eddbf48d-92c6-4f0a-9ec1-346400089ea4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:15.656586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eddbf48d-92c6-4f0a-9ec1-346400089ea4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:15.664275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eddbf48d-92c6-4f0a-9ec1-346400089ea4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:15.664757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eddbf48d-92c6-4f0a-9ec1-346400089ea4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:15.665201 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eddbf48d-92c6-4f0a-9ec1-346400089ea4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:15.665903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eddbf48d-92c6-4f0a-9ec1-346400089ea4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:15.666352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eddbf48d-92c6-4f0a-9ec1-346400089ea4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:15.666774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eddbf48d-92c6-4f0a-9ec1-346400089ea4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:15.800484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eddbf48d-92c6-4f0a-9ec1-346400089ea4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:15.809715 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eddbf48d-92c6-4f0a-9ec1-346400089ea4 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.157659 Oct 18 14:32:15.810298 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3609/7419] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:15 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:16.834691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-14211273-1f58-43a1-bfb7-cb34678a972e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:16.835344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-14211273-1f58-43a1-bfb7-cb34678a972e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:16.842563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14211273-1f58-43a1-bfb7-cb34678a972e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:16.843058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14211273-1f58-43a1-bfb7-cb34678a972e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:16.843503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14211273-1f58-43a1-bfb7-cb34678a972e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:16.844283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14211273-1f58-43a1-bfb7-cb34678a972e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:16.844746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14211273-1f58-43a1-bfb7-cb34678a972e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:16.845198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-14211273-1f58-43a1-bfb7-cb34678a972e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:16.983898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-14211273-1f58-43a1-bfb7-cb34678a972e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:16.992425 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-14211273-1f58-43a1-bfb7-cb34678a972e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.162328 Oct 18 14:32:16.993020 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3811/7420] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:16 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:17.761342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-00f10ce8-87cf-484f-89ed-91e07ee91fe7 req-22887ba2-28a1-4940-b734-8493e31664cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab8e7c47-ccff-423e-90b9-77ac93afd8d3", "name": "network-vif-plugged", "status": "completed", "tag": "627985d3-e5c9-4ac1-84f0-35a371c2ebea"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:32:17.771420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-00f10ce8-87cf-484f-89ed-91e07ee91fe7 req-22887ba2-28a1-4940-b734-8493e31664cb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:17.772358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-00f10ce8-87cf-484f-89ed-91e07ee91fe7 req-22887ba2-28a1-4940-b734-8493e31664cb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:17.772358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-00f10ce8-87cf-484f-89ed-91e07ee91fe7 req-22887ba2-28a1-4940-b734-8493e31664cb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:17.784615 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-00f10ce8-87cf-484f-89ed-91e07ee91fe7 req-22887ba2-28a1-4940-b734-8493e31664cb service nova] Creating event network-vif-plugged:627985d3-e5c9-4ac1-84f0-35a371c2ebea for instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 on n-h1-858384-13 Oct 18 14:32:17.790989 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-00f10ce8-87cf-484f-89ed-91e07ee91fe7 req-22887ba2-28a1-4940-b734-8493e31664cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093609 Oct 18 14:32:17.791747 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3610/7421] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:32:18.016025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-76a93b81-cdd3-4c96-9e76-1f4cef1fcd92 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:18.016655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-76a93b81-cdd3-4c96-9e76-1f4cef1fcd92 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:18.024243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76a93b81-cdd3-4c96-9e76-1f4cef1fcd92 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:18.024744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76a93b81-cdd3-4c96-9e76-1f4cef1fcd92 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:18.025215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76a93b81-cdd3-4c96-9e76-1f4cef1fcd92 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:18.025918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76a93b81-cdd3-4c96-9e76-1f4cef1fcd92 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:18.026382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76a93b81-cdd3-4c96-9e76-1f4cef1fcd92 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:18.026816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-76a93b81-cdd3-4c96-9e76-1f4cef1fcd92 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:18.171671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-76a93b81-cdd3-4c96-9e76-1f4cef1fcd92 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:18.180248 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-76a93b81-cdd3-4c96-9e76-1f4cef1fcd92 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.168172 Oct 18 14:32:18.180821 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3812/7422] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:18 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:19.204680 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c62ea7e5-adee-4477-ae89-e2f8c8083be6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:19.205421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c62ea7e5-adee-4477-ae89-e2f8c8083be6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:19.212589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c62ea7e5-adee-4477-ae89-e2f8c8083be6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:19.213074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c62ea7e5-adee-4477-ae89-e2f8c8083be6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:19.213541 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c62ea7e5-adee-4477-ae89-e2f8c8083be6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:19.214238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c62ea7e5-adee-4477-ae89-e2f8c8083be6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:19.214694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c62ea7e5-adee-4477-ae89-e2f8c8083be6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:19.215122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c62ea7e5-adee-4477-ae89-e2f8c8083be6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:19.359848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c62ea7e5-adee-4477-ae89-e2f8c8083be6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:19.368802 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c62ea7e5-adee-4477-ae89-e2f8c8083be6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1359 microversion: 2.1 time: 0.169167 Oct 18 14:32:19.369598 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3611/7423] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:19 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:20.391659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c2c406d7-2b5e-4aaa-8177-c6b8981f107b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:20.392247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c2c406d7-2b5e-4aaa-8177-c6b8981f107b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:20.399292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2c406d7-2b5e-4aaa-8177-c6b8981f107b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:20.399787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2c406d7-2b5e-4aaa-8177-c6b8981f107b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:20.400235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2c406d7-2b5e-4aaa-8177-c6b8981f107b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:20.400932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2c406d7-2b5e-4aaa-8177-c6b8981f107b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:20.401425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2c406d7-2b5e-4aaa-8177-c6b8981f107b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:20.401859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c2c406d7-2b5e-4aaa-8177-c6b8981f107b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:20.537163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c2c406d7-2b5e-4aaa-8177-c6b8981f107b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:20.545309 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c2c406d7-2b5e-4aaa-8177-c6b8981f107b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1550 microversion: 2.1 time: 0.157737 Oct 18 14:32:20.545888 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3813/7424] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:20 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:20.568017 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-40b96641-7732-421b-b7a3-fe1098f96d2c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:20.568620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-40b96641-7732-421b-b7a3-fe1098f96d2c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:20.575524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40b96641-7732-421b-b7a3-fe1098f96d2c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:20.575996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40b96641-7732-421b-b7a3-fe1098f96d2c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:20.576424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40b96641-7732-421b-b7a3-fe1098f96d2c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:20.577102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40b96641-7732-421b-b7a3-fe1098f96d2c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:20.577576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40b96641-7732-421b-b7a3-fe1098f96d2c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:20.577996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-40b96641-7732-421b-b7a3-fe1098f96d2c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:20.712444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-40b96641-7732-421b-b7a3-fe1098f96d2c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:20.720368 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-40b96641-7732-421b-b7a3-fe1098f96d2c tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1550 microversion: 2.1 time: 0.156162 Oct 18 14:32:20.720950 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3612/7425] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:20 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:20.743560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1ee1b004-4d1d-481e-9ad0-d791a1478b61 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:20.748432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1ee1b004-4d1d-481e-9ad0-d791a1478b61 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:20.749257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1ee1b004-4d1d-481e-9ad0-d791a1478b61 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Searching by: {'deleted': False, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c'} {{(pid=120611) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 18 14:32:20.754781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ee1b004-4d1d-481e-9ad0-d791a1478b61 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:20.755779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ee1b004-4d1d-481e-9ad0-d791a1478b61 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:20.756260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ee1b004-4d1d-481e-9ad0-d791a1478b61 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:20.756997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ee1b004-4d1d-481e-9ad0-d791a1478b61 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:20.757502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ee1b004-4d1d-481e-9ad0-d791a1478b61 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:20.757945 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1ee1b004-4d1d-481e-9ad0-d791a1478b61 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:20.782733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.multi_cell_list [None req-1ee1b004-4d1d-481e-9ad0-d791a1478b61 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 18 14:32:20.810568 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1ee1b004-4d1d-481e-9ad0-d791a1478b61 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071184 Oct 18 14:32:20.811160 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3814/7426] 10.222.0.40 () {58 vars in 1125 bytes} [Tue Oct 18 14:32:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:32:20.822888 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-303eef9d-3856-4b61-8f3f-274727d75e2e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:20.823498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-303eef9d-3856-4b61-8f3f-274727d75e2e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:20.829565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-303eef9d-3856-4b61-8f3f-274727d75e2e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:20.830040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-303eef9d-3856-4b61-8f3f-274727d75e2e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:20.830466 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-303eef9d-3856-4b61-8f3f-274727d75e2e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:20.831145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-303eef9d-3856-4b61-8f3f-274727d75e2e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:20.831590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-303eef9d-3856-4b61-8f3f-274727d75e2e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:20.832010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-303eef9d-3856-4b61-8f3f-274727d75e2e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:20.967120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-303eef9d-3856-4b61-8f3f-274727d75e2e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:20.975084 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-303eef9d-3856-4b61-8f3f-274727d75e2e tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1550 microversion: 2.1 time: 0.156096 Oct 18 14:32:20.976067 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3613/7427] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:20 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:32:22.506099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c8383a6d-2a50-49d8-a65f-ffcd93b50988 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9295b1a-414c-4cef-9fac-14e230531217"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:32:22.508564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c8383a6d-2a50-49d8-a65f-ffcd93b50988 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:22.515711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8383a6d-2a50-49d8-a65f-ffcd93b50988 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:22.516210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8383a6d-2a50-49d8-a65f-ffcd93b50988 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:22.516664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8383a6d-2a50-49d8-a65f-ffcd93b50988 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:22.517403 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8383a6d-2a50-49d8-a65f-ffcd93b50988 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:22.517877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8383a6d-2a50-49d8-a65f-ffcd93b50988 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:22.518320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8383a6d-2a50-49d8-a65f-ffcd93b50988 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:22.785207 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c8383a6d-2a50-49d8-a65f-ffcd93b50988 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "POST /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282970 Oct 18 14:32:22.785835 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3815/7428] 10.222.0.40 () {60 vars in 1323 bytes} [Tue Oct 18 14:32:22 2022] POST /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:32:33.588328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9f837ab2-fa3d-426a-8adc-9e8cd4cbb7e6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:33.588934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9f837ab2-fa3d-426a-8adc-9e8cd4cbb7e6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:33.591286 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=19 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:33.592100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=64 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:33.598240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f837ab2-fa3d-426a-8adc-9e8cd4cbb7e6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:33.598720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f837ab2-fa3d-426a-8adc-9e8cd4cbb7e6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:33.599304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f837ab2-fa3d-426a-8adc-9e8cd4cbb7e6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:33.600001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f837ab2-fa3d-426a-8adc-9e8cd4cbb7e6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:33.600448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f837ab2-fa3d-426a-8adc-9e8cd4cbb7e6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:33.600867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f837ab2-fa3d-426a-8adc-9e8cd4cbb7e6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:33.736871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9f837ab2-fa3d-426a-8adc-9e8cd4cbb7e6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:33.746446 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9f837ab2-fa3d-426a-8adc-9e8cd4cbb7e6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1596 microversion: 2.1 time: 0.162361 Oct 18 14:32:33.747583 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3614/7429] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:33 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1596 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:32:35.764359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:35.765837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=19 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:35.766946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:32:35.772237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-2b63d66f-a405-4f0d-9472-835a9998736a req-d27b77aa-492d-4b31-a417-98604bb16e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab8e7c47-ccff-423e-90b9-77ac93afd8d3", "tag": "627985d3-e5c9-4ac1-84f0-35a371c2ebea"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:32:35.784875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2b63d66f-a405-4f0d-9472-835a9998736a req-d27b77aa-492d-4b31-a417-98604bb16e94 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:35.785380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2b63d66f-a405-4f0d-9472-835a9998736a req-d27b77aa-492d-4b31-a417-98604bb16e94 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:35.786514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-2b63d66f-a405-4f0d-9472-835a9998736a req-d27b77aa-492d-4b31-a417-98604bb16e94 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:35.802511 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-2b63d66f-a405-4f0d-9472-835a9998736a req-d27b77aa-492d-4b31-a417-98604bb16e94 service nova] Creating event network-changed:627985d3-e5c9-4ac1-84f0-35a371c2ebea for instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 on n-h1-858384-13 Oct 18 14:32:35.808363 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-2b63d66f-a405-4f0d-9472-835a9998736a req-d27b77aa-492d-4b31-a417-98604bb16e94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045382 Oct 18 14:32:35.809080 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3816/7430] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:32:36.831359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1965af32-4a4c-425e-8d01-1bea14a7ca09 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1918469773"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:32:36.832014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1965af32-4a4c-425e-8d01-1bea14a7ca09 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:36.840597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1965af32-4a4c-425e-8d01-1bea14a7ca09 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:36.841246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1965af32-4a4c-425e-8d01-1bea14a7ca09 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:36.841788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1965af32-4a4c-425e-8d01-1bea14a7ca09 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:36.842594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1965af32-4a4c-425e-8d01-1bea14a7ca09 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:36.843167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1965af32-4a4c-425e-8d01-1bea14a7ca09 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:36.843702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1965af32-4a4c-425e-8d01-1bea14a7ca09 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:36.985707 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.network.security_group_api [None req-1965af32-4a4c-425e-8d01-1bea14a7ca09 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Adding security group 19835aa0-d3d2-4781-8397-1bc228fe49ea to port 627985d3-e5c9-4ac1-84f0-35a371c2ebea Oct 18 14:32:37.326514 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1965af32-4a4c-425e-8d01-1bea14a7ca09 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "POST /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/action" status: 202 len: 0 microversion: 2.1 time: 0.499309 Oct 18 14:32:37.327437 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3615/7431] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:32:36 2022] POST /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:32:37.336954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fad0758b-c0aa-4e6a-89b7-7d15a2350371 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:32:37.337599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fad0758b-c0aa-4e6a-89b7-7d15a2350371 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:32:37.341512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-322b71bb-38a2-46b3-bdec-24a8208b813e req-b3c51856-066f-4e65-ad50-6f17e74bc45d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab8e7c47-ccff-423e-90b9-77ac93afd8d3", "tag": "627985d3-e5c9-4ac1-84f0-35a371c2ebea"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:32:37.350031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fad0758b-c0aa-4e6a-89b7-7d15a2350371 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:37.357582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fad0758b-c0aa-4e6a-89b7-7d15a2350371 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:37.358370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fad0758b-c0aa-4e6a-89b7-7d15a2350371 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:37.359125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fad0758b-c0aa-4e6a-89b7-7d15a2350371 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:37.359595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fad0758b-c0aa-4e6a-89b7-7d15a2350371 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:37.360031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fad0758b-c0aa-4e6a-89b7-7d15a2350371 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:37.361546 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-322b71bb-38a2-46b3-bdec-24a8208b813e req-b3c51856-066f-4e65-ad50-6f17e74bc45d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:32:37.362420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-322b71bb-38a2-46b3-bdec-24a8208b813e req-b3c51856-066f-4e65-ad50-6f17e74bc45d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:32:37.363463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-322b71bb-38a2-46b3-bdec-24a8208b813e req-b3c51856-066f-4e65-ad50-6f17e74bc45d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:32:37.382507 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-322b71bb-38a2-46b3-bdec-24a8208b813e req-b3c51856-066f-4e65-ad50-6f17e74bc45d service nova] Creating event network-changed:627985d3-e5c9-4ac1-84f0-35a371c2ebea for instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 on n-h1-858384-13 Oct 18 14:32:37.390493 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-322b71bb-38a2-46b3-bdec-24a8208b813e req-b3c51856-066f-4e65-ad50-6f17e74bc45d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059485 Oct 18 14:32:37.391121 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3817/7432] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:32:37.626782 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fad0758b-c0aa-4e6a-89b7-7d15a2350371 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:32:37.636081 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fad0758b-c0aa-4e6a-89b7-7d15a2350371 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1762 microversion: 2.1 time: 0.303480 Oct 18 14:32:37.636673 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3616/7433] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:32:37 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1762 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:33:35.157570 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a659e4a2-df24-4222-81c5-1f8b18b94392 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:33:35.159946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a659e4a2-df24-4222-81c5-1f8b18b94392 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:35.162971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:35.163644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:35.171019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a659e4a2-df24-4222-81c5-1f8b18b94392 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:35.171522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a659e4a2-df24-4222-81c5-1f8b18b94392 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:35.171977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a659e4a2-df24-4222-81c5-1f8b18b94392 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:35.172685 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a659e4a2-df24-4222-81c5-1f8b18b94392 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:35.173153 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a659e4a2-df24-4222-81c5-1f8b18b94392 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:35.173617 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a659e4a2-df24-4222-81c5-1f8b18b94392 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:35.247338 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a659e4a2-df24-4222-81c5-1f8b18b94392 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "POST /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/action" status: 202 len: 0 microversion: 2.1 time: 0.094149 Oct 18 14:33:35.248360 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3818/7434] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:33:35 2022] POST /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:33:35.258075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9f5eb2b1-acf8-4236-b860-f017b5ef6d88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:35.258661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9f5eb2b1-acf8-4236-b860-f017b5ef6d88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:35.262275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:35.262957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=16 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:33:35.264090 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:33:35.264268 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:33:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 (ip 10.222.0.40) !!! Oct 18 14:33:35.272399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f5eb2b1-acf8-4236-b860-f017b5ef6d88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:35.272891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f5eb2b1-acf8-4236-b860-f017b5ef6d88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:35.273358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f5eb2b1-acf8-4236-b860-f017b5ef6d88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:35.274094 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f5eb2b1-acf8-4236-b860-f017b5ef6d88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:35.274547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f5eb2b1-acf8-4236-b860-f017b5ef6d88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:35.275000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9f5eb2b1-acf8-4236-b860-f017b5ef6d88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:35.816118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9f5eb2b1-acf8-4236-b860-f017b5ef6d88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:35.824900 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9f5eb2b1-acf8-4236-b860-f017b5ef6d88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1754 microversion: 2.1 time: 0.571821 Oct 18 14:33:35.825597 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3617/7435] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:35 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1754 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:36.850008 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2f830a35-00c8-4ef8-bb31-2fe09ccf4f94 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:36.850744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2f830a35-00c8-4ef8-bb31-2fe09ccf4f94 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:36.858199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f830a35-00c8-4ef8-bb31-2fe09ccf4f94 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:36.858701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f830a35-00c8-4ef8-bb31-2fe09ccf4f94 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:36.859155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f830a35-00c8-4ef8-bb31-2fe09ccf4f94 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:36.859867 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f830a35-00c8-4ef8-bb31-2fe09ccf4f94 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:36.860339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f830a35-00c8-4ef8-bb31-2fe09ccf4f94 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:36.860784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2f830a35-00c8-4ef8-bb31-2fe09ccf4f94 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:37.016801 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2f830a35-00c8-4ef8-bb31-2fe09ccf4f94 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:37.025254 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2f830a35-00c8-4ef8-bb31-2fe09ccf4f94 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1759 microversion: 2.1 time: 0.180202 Oct 18 14:33:37.025831 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3819/7436] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:36 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1759 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:38.049909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8710b5a5-b06d-4aa8-a206-5a5e04de6468 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:38.050521 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8710b5a5-b06d-4aa8-a206-5a5e04de6468 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:38.057982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8710b5a5-b06d-4aa8-a206-5a5e04de6468 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:38.058490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8710b5a5-b06d-4aa8-a206-5a5e04de6468 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:38.058922 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8710b5a5-b06d-4aa8-a206-5a5e04de6468 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:38.059609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8710b5a5-b06d-4aa8-a206-5a5e04de6468 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:38.060053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8710b5a5-b06d-4aa8-a206-5a5e04de6468 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:38.060471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8710b5a5-b06d-4aa8-a206-5a5e04de6468 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:38.203764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8710b5a5-b06d-4aa8-a206-5a5e04de6468 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:38.212514 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8710b5a5-b06d-4aa8-a206-5a5e04de6468 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1759 microversion: 2.1 time: 0.166535 Oct 18 14:33:38.213425 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3618/7437] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:38 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:39.236687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5c913e35-8afe-402c-846c-ed7d8e55b71b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:39.237340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5c913e35-8afe-402c-846c-ed7d8e55b71b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:39.244438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c913e35-8afe-402c-846c-ed7d8e55b71b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:39.244932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c913e35-8afe-402c-846c-ed7d8e55b71b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:39.245399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c913e35-8afe-402c-846c-ed7d8e55b71b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:39.246097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c913e35-8afe-402c-846c-ed7d8e55b71b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:39.246560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c913e35-8afe-402c-846c-ed7d8e55b71b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:39.246994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5c913e35-8afe-402c-846c-ed7d8e55b71b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:39.398066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5c913e35-8afe-402c-846c-ed7d8e55b71b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:39.407266 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5c913e35-8afe-402c-846c-ed7d8e55b71b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1759 microversion: 2.1 time: 0.174577 Oct 18 14:33:39.407850 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3820/7438] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:39 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:40.431629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ea6eb426-063a-4821-b05a-5a03a9eeca88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:40.432222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ea6eb426-063a-4821-b05a-5a03a9eeca88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:40.439550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea6eb426-063a-4821-b05a-5a03a9eeca88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:40.440023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea6eb426-063a-4821-b05a-5a03a9eeca88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:40.440451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea6eb426-063a-4821-b05a-5a03a9eeca88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:40.441140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea6eb426-063a-4821-b05a-5a03a9eeca88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:40.441609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea6eb426-063a-4821-b05a-5a03a9eeca88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:40.442031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ea6eb426-063a-4821-b05a-5a03a9eeca88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:40.590796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ea6eb426-063a-4821-b05a-5a03a9eeca88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:40.599767 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ea6eb426-063a-4821-b05a-5a03a9eeca88 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1759 microversion: 2.1 time: 0.172734 Oct 18 14:33:40.600350 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3619/7439] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:40 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:41.624191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f4fc7bed-33c1-4b48-bd15-99644caa3e2b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:41.624832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f4fc7bed-33c1-4b48-bd15-99644caa3e2b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:41.632437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4fc7bed-33c1-4b48-bd15-99644caa3e2b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:41.632939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4fc7bed-33c1-4b48-bd15-99644caa3e2b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:41.633420 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4fc7bed-33c1-4b48-bd15-99644caa3e2b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:41.634140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4fc7bed-33c1-4b48-bd15-99644caa3e2b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:41.634609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4fc7bed-33c1-4b48-bd15-99644caa3e2b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:41.635047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f4fc7bed-33c1-4b48-bd15-99644caa3e2b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:41.782109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f4fc7bed-33c1-4b48-bd15-99644caa3e2b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:41.790788 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f4fc7bed-33c1-4b48-bd15-99644caa3e2b tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1759 microversion: 2.1 time: 0.170752 Oct 18 14:33:41.791372 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3821/7440] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:41 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:42.815599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-22f7b8a0-7e8c-4e86-a8d4-61dad0b44feb tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:42.816217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-22f7b8a0-7e8c-4e86-a8d4-61dad0b44feb tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:42.823722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22f7b8a0-7e8c-4e86-a8d4-61dad0b44feb tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:42.824196 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22f7b8a0-7e8c-4e86-a8d4-61dad0b44feb tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:42.824627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22f7b8a0-7e8c-4e86-a8d4-61dad0b44feb tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:42.825356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22f7b8a0-7e8c-4e86-a8d4-61dad0b44feb tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:42.825805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22f7b8a0-7e8c-4e86-a8d4-61dad0b44feb tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:42.826224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-22f7b8a0-7e8c-4e86-a8d4-61dad0b44feb tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:42.973762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-22f7b8a0-7e8c-4e86-a8d4-61dad0b44feb tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:42.982249 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-22f7b8a0-7e8c-4e86-a8d4-61dad0b44feb tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1759 microversion: 2.1 time: 0.170642 Oct 18 14:33:42.982838 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3620/7441] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:42 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:44.006647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a5cfd455-3c96-425d-a5a9-83f48c232a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:44.007356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a5cfd455-3c96-425d-a5a9-83f48c232a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:44.014460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5cfd455-3c96-425d-a5a9-83f48c232a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:44.014965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5cfd455-3c96-425d-a5a9-83f48c232a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:44.015412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5cfd455-3c96-425d-a5a9-83f48c232a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:44.016125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5cfd455-3c96-425d-a5a9-83f48c232a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:44.016594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5cfd455-3c96-425d-a5a9-83f48c232a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:44.017035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a5cfd455-3c96-425d-a5a9-83f48c232a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:44.182066 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a5cfd455-3c96-425d-a5a9-83f48c232a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:44.190533 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a5cfd455-3c96-425d-a5a9-83f48c232a84 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1759 microversion: 2.1 time: 0.187927 Oct 18 14:33:44.191125 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3822/7442] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:44 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1759 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:45.215199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4ec49095-97ad-42ca-aa32-8769caca4192 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:45.215841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4ec49095-97ad-42ca-aa32-8769caca4192 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:45.222972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ec49095-97ad-42ca-aa32-8769caca4192 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:45.224006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ec49095-97ad-42ca-aa32-8769caca4192 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:45.224679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ec49095-97ad-42ca-aa32-8769caca4192 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:45.225663 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ec49095-97ad-42ca-aa32-8769caca4192 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:45.226128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ec49095-97ad-42ca-aa32-8769caca4192 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:45.226555 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4ec49095-97ad-42ca-aa32-8769caca4192 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:45.380744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4ec49095-97ad-42ca-aa32-8769caca4192 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:45.394174 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4ec49095-97ad-42ca-aa32-8769caca4192 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1759 microversion: 2.1 time: 0.182861 Oct 18 14:33:45.395132 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3621/7443] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:45 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:46.428643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5e8daac5-8546-434a-bb00-6de36b4632f3 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:46.429228 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e8daac5-8546-434a-bb00-6de36b4632f3 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:46.437406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e8daac5-8546-434a-bb00-6de36b4632f3 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:46.437933 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e8daac5-8546-434a-bb00-6de36b4632f3 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:46.438503 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e8daac5-8546-434a-bb00-6de36b4632f3 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:46.439245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e8daac5-8546-434a-bb00-6de36b4632f3 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:46.439743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e8daac5-8546-434a-bb00-6de36b4632f3 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:46.440243 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e8daac5-8546-434a-bb00-6de36b4632f3 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:46.591185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5e8daac5-8546-434a-bb00-6de36b4632f3 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:46.599993 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5e8daac5-8546-434a-bb00-6de36b4632f3 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1759 microversion: 2.1 time: 0.175734 Oct 18 14:33:46.600583 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3823/7444] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:46 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:47.625086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9087d720-2473-4ad7-90c0-f43a6ab1e6da tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:47.625698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9087d720-2473-4ad7-90c0-f43a6ab1e6da tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:47.635370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9087d720-2473-4ad7-90c0-f43a6ab1e6da tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:47.636204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9087d720-2473-4ad7-90c0-f43a6ab1e6da tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:47.637113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9087d720-2473-4ad7-90c0-f43a6ab1e6da tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:47.638269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9087d720-2473-4ad7-90c0-f43a6ab1e6da tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:47.638924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9087d720-2473-4ad7-90c0-f43a6ab1e6da tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:47.639362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9087d720-2473-4ad7-90c0-f43a6ab1e6da tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:47.794526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9087d720-2473-4ad7-90c0-f43a6ab1e6da tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:47.804338 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9087d720-2473-4ad7-90c0-f43a6ab1e6da tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1759 microversion: 2.1 time: 0.183638 Oct 18 14:33:47.804926 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3622/7445] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:47 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:33:48.828281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fe858f1a-4af2-4f99-ad73-802266b00b95 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:48.828882 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fe858f1a-4af2-4f99-ad73-802266b00b95 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:48.836140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe858f1a-4af2-4f99-ad73-802266b00b95 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:48.836629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe858f1a-4af2-4f99-ad73-802266b00b95 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:48.837098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe858f1a-4af2-4f99-ad73-802266b00b95 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:48.837808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe858f1a-4af2-4f99-ad73-802266b00b95 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:48.838524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe858f1a-4af2-4f99-ad73-802266b00b95 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:48.838958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe858f1a-4af2-4f99-ad73-802266b00b95 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:48.991740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fe858f1a-4af2-4f99-ad73-802266b00b95 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:48.997830 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fe858f1a-4af2-4f99-ad73-802266b00b95 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1759 microversion: 2.1 time: 0.173442 Oct 18 14:33:48.998455 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3824/7446] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:48 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:50.022547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bdfa7989-fb7a-4a29-9763-f7e3f907b915 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:50.023228 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bdfa7989-fb7a-4a29-9763-f7e3f907b915 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:50.030322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdfa7989-fb7a-4a29-9763-f7e3f907b915 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:50.030801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdfa7989-fb7a-4a29-9763-f7e3f907b915 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:50.031243 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdfa7989-fb7a-4a29-9763-f7e3f907b915 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:50.032014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdfa7989-fb7a-4a29-9763-f7e3f907b915 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:50.032461 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdfa7989-fb7a-4a29-9763-f7e3f907b915 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:50.032884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdfa7989-fb7a-4a29-9763-f7e3f907b915 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:50.189271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bdfa7989-fb7a-4a29-9763-f7e3f907b915 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:50.198379 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bdfa7989-fb7a-4a29-9763-f7e3f907b915 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1759 microversion: 2.1 time: 0.180014 Oct 18 14:33:50.198967 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3623/7447] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:50 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:33:51.222223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4ff6fc2a-74a8-4cad-bed6-b908db77ef72 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:51.222982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4ff6fc2a-74a8-4cad-bed6-b908db77ef72 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:51.229811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ff6fc2a-74a8-4cad-bed6-b908db77ef72 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:51.230303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ff6fc2a-74a8-4cad-bed6-b908db77ef72 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:51.230746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ff6fc2a-74a8-4cad-bed6-b908db77ef72 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:51.231449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ff6fc2a-74a8-4cad-bed6-b908db77ef72 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:51.231914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ff6fc2a-74a8-4cad-bed6-b908db77ef72 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:51.232376 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4ff6fc2a-74a8-4cad-bed6-b908db77ef72 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:51.378878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4ff6fc2a-74a8-4cad-bed6-b908db77ef72 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:51.388079 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4ff6fc2a-74a8-4cad-bed6-b908db77ef72 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1759 microversion: 2.1 time: 0.169704 Oct 18 14:33:51.388675 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3825/7448] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:51 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:33:52.413069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-14df897b-2c70-4f01-a947-cff257f93097 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:33:52.413706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-14df897b-2c70-4f01-a947-cff257f93097 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:33:52.420654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14df897b-2c70-4f01-a947-cff257f93097 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:52.421132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14df897b-2c70-4f01-a947-cff257f93097 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:52.421591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14df897b-2c70-4f01-a947-cff257f93097 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:52.422308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14df897b-2c70-4f01-a947-cff257f93097 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:33:52.422753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14df897b-2c70-4f01-a947-cff257f93097 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:33:52.423174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-14df897b-2c70-4f01-a947-cff257f93097 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:33:52.572954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-14df897b-2c70-4f01-a947-cff257f93097 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:33:52.581341 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-14df897b-2c70-4f01-a947-cff257f93097 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1762 microversion: 2.1 time: 0.173254 Oct 18 14:33:52.581927 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3624/7449] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:33:52 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1762 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:34:55.876423 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8f8474d7-3472-4de9-9dba-6d0727c9399f] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:34:55.877206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=16 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:55.877962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:55.883090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2d39e4f9-2c94-44b9-96d9-148c0438e543 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1918469773"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:34:55.883649 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2d39e4f9-2c94-44b9-96d9-148c0438e543 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:55.891337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d39e4f9-2c94-44b9-96d9-148c0438e543 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:55.891828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d39e4f9-2c94-44b9-96d9-148c0438e543 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:55.892272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d39e4f9-2c94-44b9-96d9-148c0438e543 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:55.892979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d39e4f9-2c94-44b9-96d9-148c0438e543 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:55.893466 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d39e4f9-2c94-44b9-96d9-148c0438e543 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:55.893906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2d39e4f9-2c94-44b9-96d9-148c0438e543 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:56.030908 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.network.security_group_api [None req-2d39e4f9-2c94-44b9-96d9-148c0438e543 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Removing security group 19835aa0-d3d2-4781-8397-1bc228fe49ea from port 627985d3-e5c9-4ac1-84f0-35a371c2ebea Oct 18 14:34:56.346598 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2d39e4f9-2c94-44b9-96d9-148c0438e543 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "POST /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/action" status: 202 len: 0 microversion: 2.1 time: 0.472214 Oct 18 14:34:56.347257 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3826/7450] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:34:55 2022] POST /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:34:56.355898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=16 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:56.356736 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=48 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:34:56.361089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b1219401-188f-4d28-9254-593cd9df765a req-1c6df9d9-29ce-418c-81d6-4c16229389c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab8e7c47-ccff-423e-90b9-77ac93afd8d3", "tag": "627985d3-e5c9-4ac1-84f0-35a371c2ebea"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:34:56.395265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b1219401-188f-4d28-9254-593cd9df765a req-1c6df9d9-29ce-418c-81d6-4c16229389c1 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:56.395751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b1219401-188f-4d28-9254-593cd9df765a req-1c6df9d9-29ce-418c-81d6-4c16229389c1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:56.396183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b1219401-188f-4d28-9254-593cd9df765a req-1c6df9d9-29ce-418c-81d6-4c16229389c1 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:56.416772 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b1219401-188f-4d28-9254-593cd9df765a req-1c6df9d9-29ce-418c-81d6-4c16229389c1 service nova] Creating event network-changed:627985d3-e5c9-4ac1-84f0-35a371c2ebea for instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 on n-h1-858384-13 Oct 18 14:34:56.425602 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [req-b1219401-188f-4d28-9254-593cd9df765a req-1c6df9d9-29ce-418c-81d6-4c16229389c1 service nova] [31040728-2842-4815-aef5-070dc0645949] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:34:57.433061 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [req-b1219401-188f-4d28-9254-593cd9df765a req-1c6df9d9-29ce-418c-81d6-4c16229389c1 service nova] [31040728-2842-4815-aef5-070dc0645949] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43008. Oct 18 14:34:57.437805 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b1219401-188f-4d28-9254-593cd9df765a req-1c6df9d9-29ce-418c-81d6-4c16229389c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.083586 Oct 18 14:34:57.438786 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3625/7451] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:34:57.462006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8bb4b5c8-8df2-48ae-90ca-4dbc95b03807 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:57.462555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8bb4b5c8-8df2-48ae-90ca-4dbc95b03807 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:57.470834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bb4b5c8-8df2-48ae-90ca-4dbc95b03807 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:57.471344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bb4b5c8-8df2-48ae-90ca-4dbc95b03807 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:57.471803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bb4b5c8-8df2-48ae-90ca-4dbc95b03807 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:57.472539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bb4b5c8-8df2-48ae-90ca-4dbc95b03807 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:57.473015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bb4b5c8-8df2-48ae-90ca-4dbc95b03807 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:57.473486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8bb4b5c8-8df2-48ae-90ca-4dbc95b03807 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:57.479712 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] [8f8474d7-3472-4de9-9dba-6d0727c9399f] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43012. Oct 18 14:34:57.564890 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-8bb4b5c8-8df2-48ae-90ca-4dbc95b03807 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lazy-loading 'services' on Instance uuid ab8e7c47-ccff-423e-90b9-77ac93afd8d3 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:34:57.648405 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8bb4b5c8-8df2-48ae-90ca-4dbc95b03807 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments/c9295b1a-414c-4cef-9fac-14e230531217" status: 202 len: 0 microversion: 2.1 time: 0.191333 Oct 18 14:34:57.650414 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3827/7452] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 14:34:57 2022] DELETE /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments/c9295b1a-414c-4cef-9fac-14e230531217 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:34:57.660724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e32c69b-bf12-4016-8126-f0002cbdb124 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:57.663624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0e32c69b-bf12-4016-8126-f0002cbdb124 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:57.670651 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e32c69b-bf12-4016-8126-f0002cbdb124 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:57.671635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e32c69b-bf12-4016-8126-f0002cbdb124 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:57.672346 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e32c69b-bf12-4016-8126-f0002cbdb124 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:57.673389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e32c69b-bf12-4016-8126-f0002cbdb124 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:57.674099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e32c69b-bf12-4016-8126-f0002cbdb124 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:57.674756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e32c69b-bf12-4016-8126-f0002cbdb124 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:57.713596 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e32c69b-bf12-4016-8126-f0002cbdb124 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058337 Oct 18 14:34:57.714452 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3626/7453] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:34:57 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:34:58.728674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-dde0d273-906f-4bdf-916b-c56fdd34a9a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:58.731162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-dde0d273-906f-4bdf-916b-c56fdd34a9a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:58.739967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dde0d273-906f-4bdf-916b-c56fdd34a9a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:58.740470 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dde0d273-906f-4bdf-916b-c56fdd34a9a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:58.740916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dde0d273-906f-4bdf-916b-c56fdd34a9a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:58.741653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dde0d273-906f-4bdf-916b-c56fdd34a9a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:58.742339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dde0d273-906f-4bdf-916b-c56fdd34a9a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:58.742783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-dde0d273-906f-4bdf-916b-c56fdd34a9a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:58.778878 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-dde0d273-906f-4bdf-916b-c56fdd34a9a6 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055510 Oct 18 14:34:58.779453 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3828/7454] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:34:58 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:34:59.455468 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7da47535-a8a7-4491-a491-ea6cc931e6fe req-737578cb-2583-4a67-a81d-0661e209f340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab8e7c47-ccff-423e-90b9-77ac93afd8d3", "tag": "627985d3-e5c9-4ac1-84f0-35a371c2ebea"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:34:59.466066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7da47535-a8a7-4491-a491-ea6cc931e6fe req-737578cb-2583-4a67-a81d-0661e209f340 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:59.466536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7da47535-a8a7-4491-a491-ea6cc931e6fe req-737578cb-2583-4a67-a81d-0661e209f340 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:59.467082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7da47535-a8a7-4491-a491-ea6cc931e6fe req-737578cb-2583-4a67-a81d-0661e209f340 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:59.478787 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7da47535-a8a7-4491-a491-ea6cc931e6fe req-737578cb-2583-4a67-a81d-0661e209f340 service nova] Creating event network-changed:627985d3-e5c9-4ac1-84f0-35a371c2ebea for instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 on n-h1-858384-13 Oct 18 14:34:59.483767 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7da47535-a8a7-4491-a491-ea6cc931e6fe req-737578cb-2583-4a67-a81d-0661e209f340 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032986 Oct 18 14:34:59.484366 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3627/7455] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:34:59.792752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cc908ec9-6852-4a54-91b9-19cfd49b0e8d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:34:59.795409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cc908ec9-6852-4a54-91b9-19cfd49b0e8d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:34:59.803676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc908ec9-6852-4a54-91b9-19cfd49b0e8d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:59.804180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc908ec9-6852-4a54-91b9-19cfd49b0e8d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:59.804634 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc908ec9-6852-4a54-91b9-19cfd49b0e8d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:59.805425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc908ec9-6852-4a54-91b9-19cfd49b0e8d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:34:59.805923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc908ec9-6852-4a54-91b9-19cfd49b0e8d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:34:59.806363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cc908ec9-6852-4a54-91b9-19cfd49b0e8d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:34:59.839661 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cc908ec9-6852-4a54-91b9-19cfd49b0e8d tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050756 Oct 18 14:34:59.840578 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3829/7456] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:34:59 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:00.862906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-009181e7-c337-44f4-b49f-fcce7595d25f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:00.865063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-009181e7-c337-44f4-b49f-fcce7595d25f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:00.872565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-009181e7-c337-44f4-b49f-fcce7595d25f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:00.873051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-009181e7-c337-44f4-b49f-fcce7595d25f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:00.873668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-009181e7-c337-44f4-b49f-fcce7595d25f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:00.874187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-009181e7-c337-44f4-b49f-fcce7595d25f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:00.874637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-009181e7-c337-44f4-b49f-fcce7595d25f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:00.875058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-009181e7-c337-44f4-b49f-fcce7595d25f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:00.911361 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-009181e7-c337-44f4-b49f-fcce7595d25f tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061720 Oct 18 14:35:00.912059 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3628/7457] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:35:00 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:01.925137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0e07d776-e0e3-40ff-bc76-c60d5ab4ffbe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:01.930368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0e07d776-e0e3-40ff-bc76-c60d5ab4ffbe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:01.937749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0e07d776-e0e3-40ff-bc76-c60d5ab4ffbe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:01.938246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0e07d776-e0e3-40ff-bc76-c60d5ab4ffbe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:01.938792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0e07d776-e0e3-40ff-bc76-c60d5ab4ffbe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:01.939507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0e07d776-e0e3-40ff-bc76-c60d5ab4ffbe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:01.940227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0e07d776-e0e3-40ff-bc76-c60d5ab4ffbe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:01.940695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0e07d776-e0e3-40ff-bc76-c60d5ab4ffbe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:01.976236 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0e07d776-e0e3-40ff-bc76-c60d5ab4ffbe tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056522 Oct 18 14:35:01.977087 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3830/7458] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:35:01 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:02.988503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4525f37e-c195-4b93-b5af-bc619bb18100 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:02.990677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4525f37e-c195-4b93-b5af-bc619bb18100 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:02.997640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4525f37e-c195-4b93-b5af-bc619bb18100 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:02.998119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4525f37e-c195-4b93-b5af-bc619bb18100 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:02.998554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4525f37e-c195-4b93-b5af-bc619bb18100 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:02.999237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4525f37e-c195-4b93-b5af-bc619bb18100 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:02.999687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4525f37e-c195-4b93-b5af-bc619bb18100 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:03.000109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4525f37e-c195-4b93-b5af-bc619bb18100 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:03.029341 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4525f37e-c195-4b93-b5af-bc619bb18100 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045308 Oct 18 14:35:03.029918 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3629/7459] 10.222.0.40 () {58 vars in 1302 bytes} [Tue Oct 18 14:35:02 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 18 14:35:03.040901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-11a9c559-f62b-4e6b-9a9a-d2f6b279cd3a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:03.041460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-11a9c559-f62b-4e6b-9a9a-d2f6b279cd3a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:03.049190 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11a9c559-f62b-4e6b-9a9a-d2f6b279cd3a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:03.049703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11a9c559-f62b-4e6b-9a9a-d2f6b279cd3a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:03.050164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11a9c559-f62b-4e6b-9a9a-d2f6b279cd3a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:03.050875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11a9c559-f62b-4e6b-9a9a-d2f6b279cd3a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:03.051350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11a9c559-f62b-4e6b-9a9a-d2f6b279cd3a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:03.051791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-11a9c559-f62b-4e6b-9a9a-d2f6b279cd3a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:03.134792 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-11a9c559-f62b-4e6b-9a9a-d2f6b279cd3a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] HTTP exception thrown: Instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 is not attached to volume c9295b1a-414c-4cef-9fac-14e230531217 Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-11a9c559-f62b-4e6b-9a9a-d2f6b279cd3a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Request method failure captured: Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: request: DELETE /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments/c9295b1a-414c-4cef-9fac-14e230531217 HTTP/1.1 Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTreXYaGJ2ttpLCvxt6yD2LHjqYrjD6P5W4ucFnDSc1Qz12UwJ4EBqsRINiCANQ49_bM5HcnB-6uqcMPFgkEs3YeA4YSB3zRtR_VC_skgXMYI8iHz81DMU4y8M_QPh4ePn_7MOM6aJ2ZjSSLrOZ6vxpl6MSqae9_VOICIPtHZ6rKPhlk Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: bc3d208b5a254f11bd78ca9c809fd40c Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestMinimumBasicScenario-2064219333 Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc3d208b5a254f11bd78ca9c809fd40c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bc3d208b5a254f11bd78ca9c809fd40c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc3d208b5a254f11bd78ca9c809fd40c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bc3d208b5a254f11bd78ca9c809fd40c"}]}] Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestMinimumBasicScenario-2064219333 Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: bc3d208b5a254f11bd78ca9c809fd40c Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2064219333 Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestMinimumBasicScenario-2064219333-project Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 89067a43c4d34f1a9101d1078ccbc52e Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestMinimumBasicScenario-2064219333-project Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 is not attached to volume c9295b1a-414c-4cef-9fac-14e230531217 Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'server_id': 'ab8e7c47-ccff-423e-90b9-77ac93afd8d3', 'id': 'c9295b1a-414c-4cef-9fac-14e230531217'} Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c9295b1a-414c-4cef-9fac-14e230531217. Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 is not attached to volume c9295b1a-414c-4cef-9fac-14e230531217 Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:35:03.136430 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:35:03.140837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:35:03.140837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:35:03.140837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 is not attached to volume c9295b1a-414c-4cef-9fac-14e230531217 Oct 18 14:35:03.140837 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:35:03.140837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-11a9c559-f62b-4e6b-9a9a-d2f6b279cd3a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Returning 404 to user: Instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 is not attached to volume c9295b1a-414c-4cef-9fac-14e230531217 {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:35:03.140837 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-11a9c559-f62b-4e6b-9a9a-d2f6b279cd3a tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments/c9295b1a-414c-4cef-9fac-14e230531217" status: 404 len: 154 microversion: 2.1 time: 0.101090 Oct 18 14:35:03.140837 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3831/7460] 10.222.0.40 () {58 vars in 1416 bytes} [Tue Oct 18 14:35:03 2022] DELETE /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3/os-volume_attachments/c9295b1a-414c-4cef-9fac-14e230531217 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:35:06.436658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fe80842e-7b38-42ef-a066-78d5700e8a34 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:06.437291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe80842e-7b38-42ef-a066-78d5700e8a34 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:06.444955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe80842e-7b38-42ef-a066-78d5700e8a34 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:06.445472 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe80842e-7b38-42ef-a066-78d5700e8a34 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:06.445912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe80842e-7b38-42ef-a066-78d5700e8a34 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:06.446610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe80842e-7b38-42ef-a066-78d5700e8a34 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:06.447067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe80842e-7b38-42ef-a066-78d5700e8a34 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:06.447493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fe80842e-7b38-42ef-a066-78d5700e8a34 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:06.475402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fe80842e-7b38-42ef-a066-78d5700e8a34 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:35:06.565812 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fe80842e-7b38-42ef-a066-78d5700e8a34 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 204 len: 0 microversion: 2.1 time: 0.132822 Oct 18 14:35:06.567061 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3630/7461] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:35:06 2022] DELETE /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:35:06.575465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1d49d27b-794c-490b-932b-9c02a8503610 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:06.576196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1d49d27b-794c-490b-932b-9c02a8503610 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:06.585984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d49d27b-794c-490b-932b-9c02a8503610 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:06.586749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d49d27b-794c-490b-932b-9c02a8503610 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:06.587085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d49d27b-794c-490b-932b-9c02a8503610 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:06.587826 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d49d27b-794c-490b-932b-9c02a8503610 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:06.588296 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d49d27b-794c-490b-932b-9c02a8503610 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:06.588742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d49d27b-794c-490b-932b-9c02a8503610 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:06.730554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1d49d27b-794c-490b-932b-9c02a8503610 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:06.740659 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1d49d27b-794c-490b-932b-9c02a8503610 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1556 microversion: 2.1 time: 0.169173 Oct 18 14:35:06.741271 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3832/7462] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:06 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:07.766734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2c087ff5-a384-4482-803e-fd9b8f648865 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:07.767474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2c087ff5-a384-4482-803e-fd9b8f648865 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:07.774475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c087ff5-a384-4482-803e-fd9b8f648865 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:07.774955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c087ff5-a384-4482-803e-fd9b8f648865 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:07.775390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c087ff5-a384-4482-803e-fd9b8f648865 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:07.776089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c087ff5-a384-4482-803e-fd9b8f648865 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:07.776536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c087ff5-a384-4482-803e-fd9b8f648865 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:07.776961 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2c087ff5-a384-4482-803e-fd9b8f648865 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:07.910473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2c087ff5-a384-4482-803e-fd9b8f648865 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:07.918680 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2c087ff5-a384-4482-803e-fd9b8f648865 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1556 microversion: 2.1 time: 0.157115 Oct 18 14:35:07.919300 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3631/7463] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:07 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:08.897341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-04bfb6b0-ad8c-49c6-9908-80caba762795 req-78a4932b-e4fb-41e6-b23b-4ba8f77a8b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab8e7c47-ccff-423e-90b9-77ac93afd8d3", "name": "network-vif-deleted", "tag": "627985d3-e5c9-4ac1-84f0-35a371c2ebea"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:08.909038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-04bfb6b0-ad8c-49c6-9908-80caba762795 req-78a4932b-e4fb-41e6-b23b-4ba8f77a8b2f service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:08.909678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-04bfb6b0-ad8c-49c6-9908-80caba762795 req-78a4932b-e4fb-41e6-b23b-4ba8f77a8b2f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:08.910300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-04bfb6b0-ad8c-49c6-9908-80caba762795 req-78a4932b-e4fb-41e6-b23b-4ba8f77a8b2f service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:08.925854 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-04bfb6b0-ad8c-49c6-9908-80caba762795 req-78a4932b-e4fb-41e6-b23b-4ba8f77a8b2f service nova] Creating event network-vif-deleted:627985d3-e5c9-4ac1-84f0-35a371c2ebea for instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 on n-h1-858384-13 Oct 18 14:35:08.932215 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-04bfb6b0-ad8c-49c6-9908-80caba762795 req-78a4932b-e4fb-41e6-b23b-4ba8f77a8b2f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038697 Oct 18 14:35:08.932849 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3833/7464] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:08.945123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cd1ed1b7-bf9c-4951-b135-d199ba88c9d5 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:08.945755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cd1ed1b7-bf9c-4951-b135-d199ba88c9d5 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:08.952674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd1ed1b7-bf9c-4951-b135-d199ba88c9d5 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:08.953246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd1ed1b7-bf9c-4951-b135-d199ba88c9d5 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:08.953792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd1ed1b7-bf9c-4951-b135-d199ba88c9d5 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:08.954667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd1ed1b7-bf9c-4951-b135-d199ba88c9d5 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:08.955294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd1ed1b7-bf9c-4951-b135-d199ba88c9d5 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:08.955724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cd1ed1b7-bf9c-4951-b135-d199ba88c9d5 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:09.023118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cd1ed1b7-bf9c-4951-b135-d199ba88c9d5 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89067a43c4d34f1a9101d1078ccbc52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3d208b5a254f11bd78ca9c809fd40c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:09.031397 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cd1ed1b7-bf9c-4951-b135-d199ba88c9d5 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 200 len: 1344 microversion: 2.1 time: 0.090004 Oct 18 14:35:09.032044 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3632/7465] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:08 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 1344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:10.057409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1bc0a873-e26c-456e-8331-c57798388805 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:10.058283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1bc0a873-e26c-456e-8331-c57798388805 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [instance: ab8e7c47-ccff-423e-90b9-77ac93afd8d3] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:10.066083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bc0a873-e26c-456e-8331-c57798388805 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:10.066757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bc0a873-e26c-456e-8331-c57798388805 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:10.067498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bc0a873-e26c-456e-8331-c57798388805 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:10.068426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bc0a873-e26c-456e-8331-c57798388805 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:10.069098 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bc0a873-e26c-456e-8331-c57798388805 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:10.069802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1bc0a873-e26c-456e-8331-c57798388805 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:10.087952 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-1bc0a873-e26c-456e-8331-c57798388805 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] HTTP exception thrown: Instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 could not be found. Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1bc0a873-e26c-456e-8331-c57798388805 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Request method failure captured: Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 HTTP/1.1 Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTreXYaGJ2ttpLCvxt6yD2LHjqYrjD6P5W4ucFnDSc1Qz12UwJ4EBqsRINiCANQ49_bM5HcnB-6uqcMPFgkEs3YeA4YSB3zRtR_VC_skgXMYI8iHz81DMU4y8M_QPh4ePn_7MOM6aJ2ZjSSLrOZ6vxpl6MSqae9_VOICIPtHZ6rKPhlk Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: bc3d208b5a254f11bd78ca9c809fd40c Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestMinimumBasicScenario-2064219333 Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc3d208b5a254f11bd78ca9c809fd40c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bc3d208b5a254f11bd78ca9c809fd40c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc3d208b5a254f11bd78ca9c809fd40c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bc3d208b5a254f11bd78ca9c809fd40c"}]}] Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestMinimumBasicScenario-2064219333 Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: bc3d208b5a254f11bd78ca9c809fd40c Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2064219333 Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestMinimumBasicScenario-2064219333-project Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 89067a43c4d34f1a9101d1078ccbc52e Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestMinimumBasicScenario-2064219333-project Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 could not be found. Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': 'ab8e7c47-ccff-423e-90b9-77ac93afd8d3'} Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 could not be found. Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 could not be found. Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:35:10.089929 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:35:10.096558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:35:10.096558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:35:10.096558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:35:10.096558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:35:10.096558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:35:10.096558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 could not be found. Oct 18 14:35:10.096558 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:35:10.096558 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1bc0a873-e26c-456e-8331-c57798388805 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Returning 404 to user: Instance ab8e7c47-ccff-423e-90b9-77ac93afd8d3 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:35:10.096558 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1bc0a873-e26c-456e-8331-c57798388805 tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3" status: 404 len: 111 microversion: 2.1 time: 0.039060 Oct 18 14:35:10.096558 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3834/7466] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:10 2022] GET /compute/v2.1/servers/ab8e7c47-ccff-423e-90b9-77ac93afd8d3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:35:10.103445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3186a892-626f-487d-8948-6119fe096cfc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] Calling method '.version_select at 0x7ff60e6728b0>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:10.108504 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3186a892-626f-487d-8948-6119fe096cfc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:35:11.122515 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [None req-3186a892-626f-487d-8948-6119fe096cfc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] [9e1e68ac-857c-4fe2-8ce6-4e70686866b7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43064. Oct 18 14:35:11.145623 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3186a892-626f-487d-8948-6119fe096cfc tempest-TestMinimumBasicScenario-2064219333 tempest-TestMinimumBasicScenario-2064219333-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2091896376" status: 202 len: 0 microversion: 2.1 time: 1.048726 Oct 18 14:35:11.146425 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3633/7467] 10.222.0.40 () {58 vars in 1272 bytes} [Tue Oct 18 14:35:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2091896376 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:35:20.881972 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:35:20.882553 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:35:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.40) !!! Oct 18 14:35:20.883702 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:35:20.883827 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:35:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.40) !!! Oct 18 14:35:20.885559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=18 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:20.886322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:21.049416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d80bd85a-d33a-4fba-ba4c-287cb7cadfb5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'create', calling method: .version_select at 0x7ff60e4de160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1117817657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGtS4HWyqmcDmINqyGlDyh7hfKqAhl6ulJjZn2nB1r/NL0aVySc1LKOh3ahHdr5UPS29yphc1JNvlhYx7zTslmI9rxXfTh2Dfpwx4gsuIs4FF9xpWliSvA1jfDygBucig=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:21.065455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-d80bd85a-d33a-4fba-ba4c-287cb7cadfb5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:35:21.070686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-d80bd85a-d33a-4fba-ba4c-287cb7cadfb5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for user a59ca729767748089c293f1066cda564 and project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:35:21.103449 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d80bd85a-d33a-4fba-ba4c-287cb7cadfb5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.227111 Oct 18 14:35:21.104426 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3835/7468] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:35:20 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:35:26.948842 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:26.950134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:26.955351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-145600748", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "26ab2bdd-aab1-49b3-b5d4-fbf045a44534"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1117817657", "security_groups": [{"name": "tempest-secgroup-smoke-1660904328"}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:27.076234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] validate_networks() for [('26ab2bdd-aab1-49b3-b5d4-fbf045a44534', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:35:27.578948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:35:27.580431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:35:27.581305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:35:27.581727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:35:27.582140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:35:27.592959 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:27.594804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:27.595257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:27.596273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:27.596832 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:27.597361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:27.618926 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:35:27.626619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for user a59ca729767748089c293f1066cda564 and project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:35:27.643002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:35:27.647153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:35:27.714929 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6fed7872-b126-4294-87f2-33a6271c1f4c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.768092 Oct 18 14:35:27.716009 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3634/7469] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:35:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:35:27.730465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bf66ac62-f2da-42ed-ba4d-42536d3698f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:27.731540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bf66ac62-f2da-42ed-ba4d-42536d3698f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:27.814042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bf66ac62-f2da-42ed-ba4d-42536d3698f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:27.823526 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bf66ac62-f2da-42ed-ba4d-42536d3698f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1266 microversion: 2.1 time: 0.098464 Oct 18 14:35:27.824579 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3836/7470] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:27 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:28.850096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d34b3154-6e91-473e-8cbd-cf7b352be3a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:28.851665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d34b3154-6e91-473e-8cbd-cf7b352be3a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:28.868579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d34b3154-6e91-473e-8cbd-cf7b352be3a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:28.869063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d34b3154-6e91-473e-8cbd-cf7b352be3a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:28.869724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d34b3154-6e91-473e-8cbd-cf7b352be3a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:28.870644 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d34b3154-6e91-473e-8cbd-cf7b352be3a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:28.871102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d34b3154-6e91-473e-8cbd-cf7b352be3a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:28.871524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d34b3154-6e91-473e-8cbd-cf7b352be3a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:28.942459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d34b3154-6e91-473e-8cbd-cf7b352be3a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:28.950582 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d34b3154-6e91-473e-8cbd-cf7b352be3a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1318 microversion: 2.1 time: 0.104440 Oct 18 14:35:28.951173 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3635/7471] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:28 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1318 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:29.975705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-50c702ea-17c5-4715-adf6-ee8357f275df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:29.976955 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-50c702ea-17c5-4715-adf6-ee8357f275df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:29.984576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50c702ea-17c5-4715-adf6-ee8357f275df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:29.985100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50c702ea-17c5-4715-adf6-ee8357f275df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:29.985585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50c702ea-17c5-4715-adf6-ee8357f275df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:29.986616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50c702ea-17c5-4715-adf6-ee8357f275df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:29.987105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50c702ea-17c5-4715-adf6-ee8357f275df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:29.987596 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-50c702ea-17c5-4715-adf6-ee8357f275df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:30.216622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-50c702ea-17c5-4715-adf6-ee8357f275df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:30.233236 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-50c702ea-17c5-4715-adf6-ee8357f275df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1392 microversion: 2.1 time: 0.261619 Oct 18 14:35:30.235378 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3837/7472] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:29 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:30.932574 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-edd138dc-e7ab-477b-a1d0-5c96d343c36b req-4b0d9d61-2a2b-40cd-b246-5ee43c59a50c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90713e0a-7359-4cf1-bb70-0b3ef64cacf2", "tag": "d7230751-e060-46d2-812a-333e0487eb60"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:30.946412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-edd138dc-e7ab-477b-a1d0-5c96d343c36b req-4b0d9d61-2a2b-40cd-b246-5ee43c59a50c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:30.946805 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-edd138dc-e7ab-477b-a1d0-5c96d343c36b req-4b0d9d61-2a2b-40cd-b246-5ee43c59a50c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:30.947232 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-edd138dc-e7ab-477b-a1d0-5c96d343c36b req-4b0d9d61-2a2b-40cd-b246-5ee43c59a50c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:30.960639 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-edd138dc-e7ab-477b-a1d0-5c96d343c36b req-4b0d9d61-2a2b-40cd-b246-5ee43c59a50c service nova] Creating event network-changed:d7230751-e060-46d2-812a-333e0487eb60 for instance 90713e0a-7359-4cf1-bb70-0b3ef64cacf2 on n-h2-858384-13 Oct 18 14:35:30.966777 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-edd138dc-e7ab-477b-a1d0-5c96d343c36b req-4b0d9d61-2a2b-40cd-b246-5ee43c59a50c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038107 Oct 18 14:35:30.967397 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3636/7473] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:31.258861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ac2775db-a401-48c0-baa1-21142b99e12e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:31.259571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ac2775db-a401-48c0-baa1-21142b99e12e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:31.266083 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac2775db-a401-48c0-baa1-21142b99e12e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:31.266828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac2775db-a401-48c0-baa1-21142b99e12e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:31.267284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac2775db-a401-48c0-baa1-21142b99e12e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:31.268087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac2775db-a401-48c0-baa1-21142b99e12e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:31.268561 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac2775db-a401-48c0-baa1-21142b99e12e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:31.269001 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ac2775db-a401-48c0-baa1-21142b99e12e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:31.443155 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ac2775db-a401-48c0-baa1-21142b99e12e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:31.451207 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ac2775db-a401-48c0-baa1-21142b99e12e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1392 microversion: 2.1 time: 0.197229 Oct 18 14:35:31.451974 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3838/7474] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:31 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1392 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:32.476278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-db204a16-6226-4ce8-916b-ca6df38b0566 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:32.477127 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-db204a16-6226-4ce8-916b-ca6df38b0566 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:32.485592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db204a16-6226-4ce8-916b-ca6df38b0566 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:32.486078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db204a16-6226-4ce8-916b-ca6df38b0566 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:32.486516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db204a16-6226-4ce8-916b-ca6df38b0566 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:32.487205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db204a16-6226-4ce8-916b-ca6df38b0566 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:32.487656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db204a16-6226-4ce8-916b-ca6df38b0566 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:32.488080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-db204a16-6226-4ce8-916b-ca6df38b0566 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:32.628212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-db204a16-6226-4ce8-916b-ca6df38b0566 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:32.636152 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-db204a16-6226-4ce8-916b-ca6df38b0566 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1392 microversion: 2.1 time: 0.164158 Oct 18 14:35:32.636742 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3637/7475] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:32 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:33.659982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8ab4d3a-202a-49cf-8512-69906c1bc57f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:33.660542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8ab4d3a-202a-49cf-8512-69906c1bc57f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:33.667590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8ab4d3a-202a-49cf-8512-69906c1bc57f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:33.668091 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8ab4d3a-202a-49cf-8512-69906c1bc57f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:33.668542 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8ab4d3a-202a-49cf-8512-69906c1bc57f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:33.669278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8ab4d3a-202a-49cf-8512-69906c1bc57f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:33.669756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8ab4d3a-202a-49cf-8512-69906c1bc57f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:33.670192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8ab4d3a-202a-49cf-8512-69906c1bc57f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:33.823897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b8ab4d3a-202a-49cf-8512-69906c1bc57f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:33.832108 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8ab4d3a-202a-49cf-8512-69906c1bc57f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1392 microversion: 2.1 time: 0.176320 Oct 18 14:35:33.832700 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3839/7476] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:33 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:34.855759 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9caef055-98fa-4931-8106-40f24555966a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:34.856367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9caef055-98fa-4931-8106-40f24555966a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:34.863432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9caef055-98fa-4931-8106-40f24555966a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:34.863910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9caef055-98fa-4931-8106-40f24555966a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:34.865172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9caef055-98fa-4931-8106-40f24555966a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:34.865863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9caef055-98fa-4931-8106-40f24555966a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:34.866333 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9caef055-98fa-4931-8106-40f24555966a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:34.866773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9caef055-98fa-4931-8106-40f24555966a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:35.008356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9caef055-98fa-4931-8106-40f24555966a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:35.016767 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9caef055-98fa-4931-8106-40f24555966a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1392 microversion: 2.1 time: 0.164745 Oct 18 14:35:35.017537 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3638/7477] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:34 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:35.304611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-4d92d39b-b4dc-4ff0-8142-50096889fefd req-51140ec0-ccd1-4438-8003-9f60e9f8bf17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90713e0a-7359-4cf1-bb70-0b3ef64cacf2", "name": "network-vif-plugged", "status": "completed", "tag": "d7230751-e060-46d2-812a-333e0487eb60"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:35.315636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4d92d39b-b4dc-4ff0-8142-50096889fefd req-51140ec0-ccd1-4438-8003-9f60e9f8bf17 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:35.316132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4d92d39b-b4dc-4ff0-8142-50096889fefd req-51140ec0-ccd1-4438-8003-9f60e9f8bf17 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:35.316773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-4d92d39b-b4dc-4ff0-8142-50096889fefd req-51140ec0-ccd1-4438-8003-9f60e9f8bf17 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:35.329061 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-4d92d39b-b4dc-4ff0-8142-50096889fefd req-51140ec0-ccd1-4438-8003-9f60e9f8bf17 service nova] Creating event network-vif-plugged:d7230751-e060-46d2-812a-333e0487eb60 for instance 90713e0a-7359-4cf1-bb70-0b3ef64cacf2 on n-h2-858384-13 Oct 18 14:35:35.334161 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-4d92d39b-b4dc-4ff0-8142-50096889fefd req-51140ec0-ccd1-4438-8003-9f60e9f8bf17 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033247 Oct 18 14:35:35.334775 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3840/7478] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:35:36.039932 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c6abbcdd-7a0e-4fdb-b18d-29d6678e7583 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:36.040545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c6abbcdd-7a0e-4fdb-b18d-29d6678e7583 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:36.048028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6abbcdd-7a0e-4fdb-b18d-29d6678e7583 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:36.048531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6abbcdd-7a0e-4fdb-b18d-29d6678e7583 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:36.049001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6abbcdd-7a0e-4fdb-b18d-29d6678e7583 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:36.049723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6abbcdd-7a0e-4fdb-b18d-29d6678e7583 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:36.050203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6abbcdd-7a0e-4fdb-b18d-29d6678e7583 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:36.050631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c6abbcdd-7a0e-4fdb-b18d-29d6678e7583 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:36.188594 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c6abbcdd-7a0e-4fdb-b18d-29d6678e7583 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:36.196408 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c6abbcdd-7a0e-4fdb-b18d-29d6678e7583 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1392 microversion: 2.1 time: 0.160375 Oct 18 14:35:36.196981 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3639/7479] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:36 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:37.221496 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4559c6a7-bf06-43ca-9484-00ed0f87a847 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:37.222207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4559c6a7-bf06-43ca-9484-00ed0f87a847 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:37.228402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4559c6a7-bf06-43ca-9484-00ed0f87a847 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:37.228887 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4559c6a7-bf06-43ca-9484-00ed0f87a847 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:37.229363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4559c6a7-bf06-43ca-9484-00ed0f87a847 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:37.230061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4559c6a7-bf06-43ca-9484-00ed0f87a847 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:37.230523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4559c6a7-bf06-43ca-9484-00ed0f87a847 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:37.230959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4559c6a7-bf06-43ca-9484-00ed0f87a847 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:37.367447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4559c6a7-bf06-43ca-9484-00ed0f87a847 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:37.376269 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4559c6a7-bf06-43ca-9484-00ed0f87a847 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1564 microversion: 2.1 time: 0.160148 Oct 18 14:35:37.376852 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3841/7480] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:37 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:37.398376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d7fec3da-93e4-4176-842e-c3e27ab6ef3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:37.398995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d7fec3da-93e4-4176-842e-c3e27ab6ef3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:37.405878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7fec3da-93e4-4176-842e-c3e27ab6ef3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:37.406596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7fec3da-93e4-4176-842e-c3e27ab6ef3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:37.407038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7fec3da-93e4-4176-842e-c3e27ab6ef3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:37.407726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7fec3da-93e4-4176-842e-c3e27ab6ef3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:37.408185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7fec3da-93e4-4176-842e-c3e27ab6ef3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:37.408611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d7fec3da-93e4-4176-842e-c3e27ab6ef3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:37.546084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d7fec3da-93e4-4176-842e-c3e27ab6ef3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:37.554875 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d7fec3da-93e4-4176-842e-c3e27ab6ef3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1564 microversion: 2.1 time: 0.160330 Oct 18 14:35:37.555462 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3640/7481] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:37 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:35:39.443161 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e200b345-bb02-4fa1-92e4-f5f677a14d90 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:35:39.444039 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e200b345-bb02-4fa1-92e4-f5f677a14d90 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:35:39.445170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ae67968a-af5a-41ce-b25d-eba9600134b2 req-2b0bbd6f-096f-4aa2-b5a9-dd2bab00afe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90713e0a-7359-4cf1-bb70-0b3ef64cacf2", "tag": "d7230751-e060-46d2-812a-333e0487eb60"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:35:39.448335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:39.451953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:39.452684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:35:39.455598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e200b345-bb02-4fa1-92e4-f5f677a14d90 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:39.456473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e200b345-bb02-4fa1-92e4-f5f677a14d90 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:39.457087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e200b345-bb02-4fa1-92e4-f5f677a14d90 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:39.458064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e200b345-bb02-4fa1-92e4-f5f677a14d90 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:39.458793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e200b345-bb02-4fa1-92e4-f5f677a14d90 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:39.458957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ae67968a-af5a-41ce-b25d-eba9600134b2 req-2b0bbd6f-096f-4aa2-b5a9-dd2bab00afe2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:35:39.459326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e200b345-bb02-4fa1-92e4-f5f677a14d90 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:39.459544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ae67968a-af5a-41ce-b25d-eba9600134b2 req-2b0bbd6f-096f-4aa2-b5a9-dd2bab00afe2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:35:39.459971 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ae67968a-af5a-41ce-b25d-eba9600134b2 req-2b0bbd6f-096f-4aa2-b5a9-dd2bab00afe2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:35:39.473454 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ae67968a-af5a-41ce-b25d-eba9600134b2 req-2b0bbd6f-096f-4aa2-b5a9-dd2bab00afe2 service nova] Creating event network-changed:d7230751-e060-46d2-812a-333e0487eb60 for instance 90713e0a-7359-4cf1-bb70-0b3ef64cacf2 on n-h2-858384-13 Oct 18 14:35:39.478544 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ae67968a-af5a-41ce-b25d-eba9600134b2 req-2b0bbd6f-096f-4aa2-b5a9-dd2bab00afe2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037021 Oct 18 14:35:39.479237 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3641/7482] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:35:39.691795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e200b345-bb02-4fa1-92e4-f5f677a14d90 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:35:39.700463 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e200b345-bb02-4fa1-92e4-f5f677a14d90 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1564 microversion: 2.1 time: 0.262715 Oct 18 14:35:39.712066 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3842/7483] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:35:39 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1564 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:00.994908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:00.995764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=36 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:01.000340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3f1dae31-bb5f-4aa7-bfc0-53529dd85071 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:01.002974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3f1dae31-bb5f-4aa7-bfc0-53529dd85071 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:01.011284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f1dae31-bb5f-4aa7-bfc0-53529dd85071 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:01.011777 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f1dae31-bb5f-4aa7-bfc0-53529dd85071 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:01.012223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f1dae31-bb5f-4aa7-bfc0-53529dd85071 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:01.012934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f1dae31-bb5f-4aa7-bfc0-53529dd85071 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:01.013418 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f1dae31-bb5f-4aa7-bfc0-53529dd85071 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:01.013848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3f1dae31-bb5f-4aa7-bfc0-53529dd85071 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:01.071558 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3f1dae31-bb5f-4aa7-bfc0-53529dd85071 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2/action" status: 200 len: 24568 microversion: 2.1 time: 0.078583 Oct 18 14:36:01.072247 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3642/7484] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:36:00 2022] POST /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2/action => generated 24568 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:36:11.776215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b81c4e4d-cd19-4bc9-b307-955a73c1b980 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:11.776808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b81c4e4d-cd19-4bc9-b307-955a73c1b980 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:11.779119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:11.779844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=32 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:11.787086 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b81c4e4d-cd19-4bc9-b307-955a73c1b980 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:11.787584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b81c4e4d-cd19-4bc9-b307-955a73c1b980 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:11.788031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b81c4e4d-cd19-4bc9-b307-955a73c1b980 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:11.788736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b81c4e4d-cd19-4bc9-b307-955a73c1b980 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:11.789217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b81c4e4d-cd19-4bc9-b307-955a73c1b980 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:11.789656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b81c4e4d-cd19-4bc9-b307-955a73c1b980 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:11.862431 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b81c4e4d-cd19-4bc9-b307-955a73c1b980 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2/action" status: 202 len: 0 microversion: 2.1 time: 0.088940 Oct 18 14:36:11.862797 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3843/7485] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:36:11 2022] POST /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:36:11.871890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6cb5f53c-bbdb-40a7-823d-5a38fb0a2d1f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:11.872590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6cb5f53c-bbdb-40a7-823d-5a38fb0a2d1f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:11.876318 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:11.877627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:11.883020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cb5f53c-bbdb-40a7-823d-5a38fb0a2d1f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:11.883522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cb5f53c-bbdb-40a7-823d-5a38fb0a2d1f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:11.883963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cb5f53c-bbdb-40a7-823d-5a38fb0a2d1f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:11.884705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cb5f53c-bbdb-40a7-823d-5a38fb0a2d1f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:11.885166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cb5f53c-bbdb-40a7-823d-5a38fb0a2d1f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:11.885629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6cb5f53c-bbdb-40a7-823d-5a38fb0a2d1f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:12.025021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6cb5f53c-bbdb-40a7-823d-5a38fb0a2d1f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:12.034337 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6cb5f53c-bbdb-40a7-823d-5a38fb0a2d1f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1686 microversion: 2.1 time: 0.166112 Oct 18 14:36:12.035266 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3643/7486] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:11 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:13.062449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9b0292e9-1908-4184-9c1b-1e91570e1b70 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:13.063516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9b0292e9-1908-4184-9c1b-1e91570e1b70 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:13.072116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b0292e9-1908-4184-9c1b-1e91570e1b70 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:13.072607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b0292e9-1908-4184-9c1b-1e91570e1b70 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:13.073050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b0292e9-1908-4184-9c1b-1e91570e1b70 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:13.073866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b0292e9-1908-4184-9c1b-1e91570e1b70 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:13.074330 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b0292e9-1908-4184-9c1b-1e91570e1b70 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:13.074762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9b0292e9-1908-4184-9c1b-1e91570e1b70 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:13.214133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9b0292e9-1908-4184-9c1b-1e91570e1b70 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:13.222360 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9b0292e9-1908-4184-9c1b-1e91570e1b70 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1666 microversion: 2.1 time: 0.164486 Oct 18 14:36:13.222955 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3844/7487] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:13 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:14.317679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ee925d28-885a-4cb7-96f7-81251d605577 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:14.319889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ee925d28-885a-4cb7-96f7-81251d605577 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:14.327629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee925d28-885a-4cb7-96f7-81251d605577 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:14.328109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee925d28-885a-4cb7-96f7-81251d605577 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:14.328551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee925d28-885a-4cb7-96f7-81251d605577 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:14.329315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee925d28-885a-4cb7-96f7-81251d605577 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:14.329881 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee925d28-885a-4cb7-96f7-81251d605577 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:14.331563 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ee925d28-885a-4cb7-96f7-81251d605577 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:14.382770 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ee925d28-885a-4cb7-96f7-81251d605577 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2/action" status: 200 len: 32641 microversion: 2.1 time: 0.069496 Oct 18 14:36:14.383336 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3644/7488] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:36:14 2022] POST /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2/action => generated 32641 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:36:14.395865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2493316a-029d-47a9-b0f7-873893042831 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:14.396465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2493316a-029d-47a9-b0f7-873893042831 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:14.403381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2493316a-029d-47a9-b0f7-873893042831 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:14.403873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2493316a-029d-47a9-b0f7-873893042831 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:14.404342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2493316a-029d-47a9-b0f7-873893042831 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:14.405041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2493316a-029d-47a9-b0f7-873893042831 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:14.405538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2493316a-029d-47a9-b0f7-873893042831 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:14.405980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2493316a-029d-47a9-b0f7-873893042831 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:14.473886 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2493316a-029d-47a9-b0f7-873893042831 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2/action" status: 202 len: 0 microversion: 2.1 time: 0.082545 Oct 18 14:36:14.474704 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3845/7489] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:36:14 2022] POST /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:36:14.483350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ef77066a-cd87-4558-84aa-b9359245174d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:14.484042 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ef77066a-cd87-4558-84aa-b9359245174d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:14.491473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ef77066a-cd87-4558-84aa-b9359245174d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:14.491956 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ef77066a-cd87-4558-84aa-b9359245174d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:14.492395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ef77066a-cd87-4558-84aa-b9359245174d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:14.493130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ef77066a-cd87-4558-84aa-b9359245174d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:14.493600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ef77066a-cd87-4558-84aa-b9359245174d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:14.494019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ef77066a-cd87-4558-84aa-b9359245174d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:14.638526 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ef77066a-cd87-4558-84aa-b9359245174d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:14.647830 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ef77066a-cd87-4558-84aa-b9359245174d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1673 microversion: 2.1 time: 0.168741 Oct 18 14:36:14.648433 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3645/7490] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:14 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:36:15.674586 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-814bb3ab-5cd9-4eae-99a4-0676547a3bc3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:15.675291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-814bb3ab-5cd9-4eae-99a4-0676547a3bc3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:15.681706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-814bb3ab-5cd9-4eae-99a4-0676547a3bc3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:15.682198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-814bb3ab-5cd9-4eae-99a4-0676547a3bc3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:15.682642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-814bb3ab-5cd9-4eae-99a4-0676547a3bc3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:15.683351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-814bb3ab-5cd9-4eae-99a4-0676547a3bc3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:15.683812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-814bb3ab-5cd9-4eae-99a4-0676547a3bc3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:15.684249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-814bb3ab-5cd9-4eae-99a4-0676547a3bc3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:15.832515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-814bb3ab-5cd9-4eae-99a4-0676547a3bc3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:15.840920 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-814bb3ab-5cd9-4eae-99a4-0676547a3bc3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1681 microversion: 2.1 time: 0.171607 Oct 18 14:36:15.841550 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3846/7491] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:15 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:36:15.940582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-07980789-f0be-40a4-abe1-cf9eb9065a6f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:15.942785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-07980789-f0be-40a4-abe1-cf9eb9065a6f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:15.950597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07980789-f0be-40a4-abe1-cf9eb9065a6f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:15.951084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07980789-f0be-40a4-abe1-cf9eb9065a6f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:15.951525 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07980789-f0be-40a4-abe1-cf9eb9065a6f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:15.952231 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07980789-f0be-40a4-abe1-cf9eb9065a6f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:15.952689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07980789-f0be-40a4-abe1-cf9eb9065a6f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:15.953122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-07980789-f0be-40a4-abe1-cf9eb9065a6f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:16.004799 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-07980789-f0be-40a4-abe1-cf9eb9065a6f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2/action" status: 200 len: 38362 microversion: 2.1 time: 0.068814 Oct 18 14:36:16.005502 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3646/7492] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:36:15 2022] POST /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2/action => generated 38362 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:36:17.047859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1349677-5250-4e9b-a494-3156f20676af tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:17.048408 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1349677-5250-4e9b-a494-3156f20676af tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:17.055265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-afb17b21-7028-4496-99a5-d8d5bc3b630b req-5d81fc56-2e5a-4498-9e29-a5c14143f1fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90713e0a-7359-4cf1-bb70-0b3ef64cacf2", "tag": "d7230751-e060-46d2-812a-333e0487eb60"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:17.069367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1349677-5250-4e9b-a494-3156f20676af tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:17.069892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1349677-5250-4e9b-a494-3156f20676af tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:17.070345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1349677-5250-4e9b-a494-3156f20676af tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:17.071507 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1349677-5250-4e9b-a494-3156f20676af tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:17.071635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1349677-5250-4e9b-a494-3156f20676af tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:17.071997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1349677-5250-4e9b-a494-3156f20676af tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:17.083040 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-afb17b21-7028-4496-99a5-d8d5bc3b630b req-5d81fc56-2e5a-4498-9e29-a5c14143f1fb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:17.083814 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-afb17b21-7028-4496-99a5-d8d5bc3b630b req-5d81fc56-2e5a-4498-9e29-a5c14143f1fb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:17.084441 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-afb17b21-7028-4496-99a5-d8d5bc3b630b req-5d81fc56-2e5a-4498-9e29-a5c14143f1fb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:17.096434 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-afb17b21-7028-4496-99a5-d8d5bc3b630b req-5d81fc56-2e5a-4498-9e29-a5c14143f1fb service nova] Creating event network-changed:d7230751-e060-46d2-812a-333e0487eb60 for instance 90713e0a-7359-4cf1-bb70-0b3ef64cacf2 on n-h2-858384-13 Oct 18 14:36:17.102157 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-afb17b21-7028-4496-99a5-d8d5bc3b630b req-5d81fc56-2e5a-4498-9e29-a5c14143f1fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050859 Oct 18 14:36:17.102773 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3647/7493] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:17.107729 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1349677-5250-4e9b-a494-3156f20676af tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:36:17.208546 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d1349677-5250-4e9b-a494-3156f20676af tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "DELETE /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 204 len: 0 microversion: 2.1 time: 0.164591 Oct 18 14:36:17.212636 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3847/7494] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:36:17 2022] DELETE /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:36:17.220920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-35e63c5b-5a25-4d46-a461-58f0dc253ac7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:17.222101 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-35e63c5b-5a25-4d46-a461-58f0dc253ac7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:17.230436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35e63c5b-5a25-4d46-a461-58f0dc253ac7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:17.231430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35e63c5b-5a25-4d46-a461-58f0dc253ac7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:17.232146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35e63c5b-5a25-4d46-a461-58f0dc253ac7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:17.233121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35e63c5b-5a25-4d46-a461-58f0dc253ac7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:17.234268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35e63c5b-5a25-4d46-a461-58f0dc253ac7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:17.235011 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-35e63c5b-5a25-4d46-a461-58f0dc253ac7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:17.391646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-35e63c5b-5a25-4d46-a461-58f0dc253ac7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:17.399918 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-35e63c5b-5a25-4d46-a461-58f0dc253ac7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1687 microversion: 2.1 time: 0.184974 Oct 18 14:36:17.400515 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3648/7495] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:17 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:18.425481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc239bb0-a515-4b7d-afe0-a0f26b71e6d2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:18.426113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bc239bb0-a515-4b7d-afe0-a0f26b71e6d2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:18.433023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc239bb0-a515-4b7d-afe0-a0f26b71e6d2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:18.433559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc239bb0-a515-4b7d-afe0-a0f26b71e6d2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:18.434690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc239bb0-a515-4b7d-afe0-a0f26b71e6d2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:18.435626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc239bb0-a515-4b7d-afe0-a0f26b71e6d2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:18.436117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc239bb0-a515-4b7d-afe0-a0f26b71e6d2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:18.436567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc239bb0-a515-4b7d-afe0-a0f26b71e6d2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:18.630162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bc239bb0-a515-4b7d-afe0-a0f26b71e6d2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:18.638292 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bc239bb0-a515-4b7d-afe0-a0f26b71e6d2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1687 microversion: 2.1 time: 0.217921 Oct 18 14:36:18.638884 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3848/7496] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:18 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1687 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:19.218792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e6122b42-ac24-4192-8702-ae1bc0125527 req-63908407-f926-4036-b5b8-6b46829cbae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90713e0a-7359-4cf1-bb70-0b3ef64cacf2", "name": "network-vif-deleted", "tag": "d7230751-e060-46d2-812a-333e0487eb60"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:19.231538 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e6122b42-ac24-4192-8702-ae1bc0125527 req-63908407-f926-4036-b5b8-6b46829cbae2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:19.232024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e6122b42-ac24-4192-8702-ae1bc0125527 req-63908407-f926-4036-b5b8-6b46829cbae2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:19.232459 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e6122b42-ac24-4192-8702-ae1bc0125527 req-63908407-f926-4036-b5b8-6b46829cbae2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:19.248294 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e6122b42-ac24-4192-8702-ae1bc0125527 req-63908407-f926-4036-b5b8-6b46829cbae2 service nova] Creating event network-vif-deleted:d7230751-e060-46d2-812a-333e0487eb60 for instance 90713e0a-7359-4cf1-bb70-0b3ef64cacf2 on n-h2-858384-13 Oct 18 14:36:19.254215 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e6122b42-ac24-4192-8702-ae1bc0125527 req-63908407-f926-4036-b5b8-6b46829cbae2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039268 Oct 18 14:36:19.254839 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3649/7497] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:19.662692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:19.663323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:19.670263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:19.670762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:19.671213 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:19.671918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:19.672386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:19.672821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:19.710918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:19.711424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:19.711909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:19.712416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lazy-loading 'fault' on Instance uuid 90713e0a-7359-4cf1-bb70-0b3ef64cacf2 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:36:19.757901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:19.765237 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ec0a1256-20b6-43c4-a4ca-d8f12444d3ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 200 len: 1356 microversion: 2.1 time: 0.106843 Oct 18 14:36:19.765882 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3849/7498] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:19 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:20.790865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4647c6d-78e5-4a4f-a09e-816f10df00ae tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:20.791565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e4647c6d-78e5-4a4f-a09e-816f10df00ae tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 90713e0a-7359-4cf1-bb70-0b3ef64cacf2] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:20.797987 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4647c6d-78e5-4a4f-a09e-816f10df00ae tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:20.798841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4647c6d-78e5-4a4f-a09e-816f10df00ae tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:20.799366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4647c6d-78e5-4a4f-a09e-816f10df00ae tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:20.800076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4647c6d-78e5-4a4f-a09e-816f10df00ae tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:20.800531 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4647c6d-78e5-4a4f-a09e-816f10df00ae tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:20.800960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e4647c6d-78e5-4a4f-a09e-816f10df00ae tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:20.814806 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e4647c6d-78e5-4a4f-a09e-816f10df00ae tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] HTTP exception thrown: Instance 90713e0a-7359-4cf1-bb70-0b3ef64cacf2 could not be found. Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4647c6d-78e5-4a4f-a09e-816f10df00ae tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Request method failure captured: Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 HTTP/1.1 Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrmoJdJwsrKMFUaanrLJLt6LyEOQIjZ0f05fEpGBag1K6ul8d4SOC38ZEmojqeN-5Mr9W9Uihbdj5HrM7P4JhTSrrxqG0t2lF0wFzmrTNNFiotgT_nFwllBcbU5Dhub5ILl6o50Cn3W6DaWc6o8DCIPPy5pkj53OvF8nQyugmrrzfyI Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d2c5ebcb706b4f26903d0c30945bbcf0 Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d2c5ebcb706b4f26903d0c30945bbcf0"}]}] Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d2c5ebcb706b4f26903d0c30945bbcf0 Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestNetworkAdvancedServerOps-527964250-project Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a59ca729767748089c293f1066cda564 Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestNetworkAdvancedServerOps-527964250-project Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 90713e0a-7359-4cf1-bb70-0b3ef64cacf2 could not be found. Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '90713e0a-7359-4cf1-bb70-0b3ef64cacf2'} Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90713e0a-7359-4cf1-bb70-0b3ef64cacf2 could not be found. Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90713e0a-7359-4cf1-bb70-0b3ef64cacf2 could not be found. Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:36:20.816985 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:36:20.822156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:36:20.822156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:36:20.822156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:36:20.822156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:36:20.822156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:36:20.822156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:36:20.822156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90713e0a-7359-4cf1-bb70-0b3ef64cacf2 could not be found. Oct 18 14:36:20.822156 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:36:20.822156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e4647c6d-78e5-4a4f-a09e-816f10df00ae tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Returning 404 to user: Instance 90713e0a-7359-4cf1-bb70-0b3ef64cacf2 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:36:20.822156 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e4647c6d-78e5-4a4f-a09e-816f10df00ae tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2" status: 404 len: 111 microversion: 2.1 time: 0.032702 Oct 18 14:36:20.822156 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3650/7499] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:20 2022] GET /compute/v2.1/servers/90713e0a-7359-4cf1-bb70-0b3ef64cacf2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:36:24.398981 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a1a870a7-35f6-4737-a30e-124c5ecb002d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '.version_select at 0x7ff60e2f33a0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:24.425089 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a1a870a7-35f6-4737-a30e-124c5ecb002d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1117817657" status: 202 len: 0 microversion: 2.1 time: 0.029895 Oct 18 14:36:24.426819 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3850/7500] 10.222.0.40 () {58 vars in 1284 bytes} [Tue Oct 18 14:36:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1117817657 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:36:24.456573 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-93e4b8a4-ce63-4ace-b215-561bd8e06af0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'create', calling method: .version_select at 0x7ff60e717670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1929977907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3E8dMG0CBTlejIYMWZWxbcZT41JCEAF/p04XVjDxG2VfUmttZ2+IkfAlKtS8LGVmmn8oa7wz+BjQMEJPZyo2yJ/yo3D7LvyakQftpc0NKnsdgvmvVSK9otol5kQemtA=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:24.484140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-93e4b8a4-ce63-4ace-b215-561bd8e06af0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:36:24.490353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-93e4b8a4-ce63-4ace-b215-561bd8e06af0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for user a59ca729767748089c293f1066cda564 and project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:36:24.514376 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-93e4b8a4-ce63-4ace-b215-561bd8e06af0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.063300 Oct 18 14:36:24.515002 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3651/7501] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:36:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:30.029818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-409769579", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "29578068-1fe4-46d9-86ad-19672ec39c6d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1929977907", "security_groups": [{"name": "tempest-secgroup-smoke-1892291100"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:30.040868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:30.176015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] validate_networks() for [('29578068-1fe4-46d9-86ad-19672ec39c6d', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:36:30.705962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:36:30.706411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:36:30.706913 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:36:30.707348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:36:30.707784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:36:30.717306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:30.717812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:30.718269 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:30.719020 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:30.719495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:30.719944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:30.738735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:36:30.744524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for user a59ca729767748089c293f1066cda564 and project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:36:30.758491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:36:30.760865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:36:30.812539 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cfb0ef2a-637e-4d8d-bfb5-7a41506eb2e5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.786486 Oct 18 14:36:30.813349 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3851/7502] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:36:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:36:30.823349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=32 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:30.828713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-97bae612-a2b4-4353-8673-3a0c38f19dc1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:30.829854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-97bae612-a2b4-4353-8673-3a0c38f19dc1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:30.905005 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-97bae612-a2b4-4353-8673-3a0c38f19dc1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:30.912675 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-97bae612-a2b4-4353-8673-3a0c38f19dc1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1266 microversion: 2.1 time: 0.091105 Oct 18 14:36:30.913530 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3652/7503] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:30 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:31.940863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d087cb85-5c8e-47f7-b90a-024c5d2dd6e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:31.941674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d087cb85-5c8e-47f7-b90a-024c5d2dd6e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:31.953068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d087cb85-5c8e-47f7-b90a-024c5d2dd6e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:31.953935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d087cb85-5c8e-47f7-b90a-024c5d2dd6e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:31.955051 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d087cb85-5c8e-47f7-b90a-024c5d2dd6e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:31.956511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d087cb85-5c8e-47f7-b90a-024c5d2dd6e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:31.957050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d087cb85-5c8e-47f7-b90a-024c5d2dd6e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:31.957621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d087cb85-5c8e-47f7-b90a-024c5d2dd6e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:32.052381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d087cb85-5c8e-47f7-b90a-024c5d2dd6e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:32.062627 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d087cb85-5c8e-47f7-b90a-024c5d2dd6e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1326 microversion: 2.1 time: 0.129759 Oct 18 14:36:32.064654 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3852/7504] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:31 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:33.093447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-38b80c0f-d269-4a8f-849f-56717b23c93a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:33.094632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-38b80c0f-d269-4a8f-849f-56717b23c93a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:33.104440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38b80c0f-d269-4a8f-849f-56717b23c93a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:33.104986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38b80c0f-d269-4a8f-849f-56717b23c93a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:33.105404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38b80c0f-d269-4a8f-849f-56717b23c93a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:33.106114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38b80c0f-d269-4a8f-849f-56717b23c93a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:33.106565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38b80c0f-d269-4a8f-849f-56717b23c93a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:33.106991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-38b80c0f-d269-4a8f-849f-56717b23c93a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:33.349189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-38b80c0f-d269-4a8f-849f-56717b23c93a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:33.358420 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-38b80c0f-d269-4a8f-849f-56717b23c93a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1392 microversion: 2.1 time: 0.269403 Oct 18 14:36:33.359313 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3653/7505] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:33 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:33.878620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9122b856-d6b2-447b-9643-c09b04a6be6d req-c7d7a570-f9f6-4013-b297-292cf2e42ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32cced85-19b9-46aa-bc74-474f4630d6d5", "tag": "112388c7-c58c-4e15-8521-ec2e5193ea75"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:33.889699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9122b856-d6b2-447b-9643-c09b04a6be6d req-c7d7a570-f9f6-4013-b297-292cf2e42ecc service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:33.890041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9122b856-d6b2-447b-9643-c09b04a6be6d req-c7d7a570-f9f6-4013-b297-292cf2e42ecc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:33.890250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9122b856-d6b2-447b-9643-c09b04a6be6d req-c7d7a570-f9f6-4013-b297-292cf2e42ecc service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:33.905834 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9122b856-d6b2-447b-9643-c09b04a6be6d req-c7d7a570-f9f6-4013-b297-292cf2e42ecc service nova] Creating event network-changed:112388c7-c58c-4e15-8521-ec2e5193ea75 for instance 32cced85-19b9-46aa-bc74-474f4630d6d5 on n-h1-858384-13 Oct 18 14:36:33.911823 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9122b856-d6b2-447b-9643-c09b04a6be6d req-c7d7a570-f9f6-4013-b297-292cf2e42ecc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122627 Oct 18 14:36:33.912516 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3853/7506] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:36:34.391624 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-12a767f3-8109-4685-ab34-5f9952ecdbed tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:34.393621 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-12a767f3-8109-4685-ab34-5f9952ecdbed tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:34.404446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12a767f3-8109-4685-ab34-5f9952ecdbed tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:34.405703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12a767f3-8109-4685-ab34-5f9952ecdbed tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:34.406493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12a767f3-8109-4685-ab34-5f9952ecdbed tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:34.408483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12a767f3-8109-4685-ab34-5f9952ecdbed tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:34.409247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12a767f3-8109-4685-ab34-5f9952ecdbed tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:34.410297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-12a767f3-8109-4685-ab34-5f9952ecdbed tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:34.697282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-12a767f3-8109-4685-ab34-5f9952ecdbed tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:34.705464 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-12a767f3-8109-4685-ab34-5f9952ecdbed tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1392 microversion: 2.1 time: 0.323037 Oct 18 14:36:34.706058 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3654/7507] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:34 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1392 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:35.729950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b7548b2d-e8b2-4c84-b397-5057773af8f2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:35.730630 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b7548b2d-e8b2-4c84-b397-5057773af8f2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:35.737547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7548b2d-e8b2-4c84-b397-5057773af8f2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:35.738041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7548b2d-e8b2-4c84-b397-5057773af8f2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:35.738488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7548b2d-e8b2-4c84-b397-5057773af8f2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:35.739195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7548b2d-e8b2-4c84-b397-5057773af8f2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:35.739661 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7548b2d-e8b2-4c84-b397-5057773af8f2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:35.740100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b7548b2d-e8b2-4c84-b397-5057773af8f2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:35.931809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b7548b2d-e8b2-4c84-b397-5057773af8f2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:35.940522 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b7548b2d-e8b2-4c84-b397-5057773af8f2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1392 microversion: 2.1 time: 0.215873 Oct 18 14:36:35.941110 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3854/7508] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:35 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1392 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:36.964751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3dc2cc21-57a3-4831-85a4-59c4731e4d27 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:36.965371 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3dc2cc21-57a3-4831-85a4-59c4731e4d27 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:36.972693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dc2cc21-57a3-4831-85a4-59c4731e4d27 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:36.973171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dc2cc21-57a3-4831-85a4-59c4731e4d27 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:36.973703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dc2cc21-57a3-4831-85a4-59c4731e4d27 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:36.974396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dc2cc21-57a3-4831-85a4-59c4731e4d27 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:36.974845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dc2cc21-57a3-4831-85a4-59c4731e4d27 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:36.975264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3dc2cc21-57a3-4831-85a4-59c4731e4d27 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:37.191247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3dc2cc21-57a3-4831-85a4-59c4731e4d27 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:37.199083 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3dc2cc21-57a3-4831-85a4-59c4731e4d27 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1392 microversion: 2.1 time: 0.238291 Oct 18 14:36:37.199663 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3655/7509] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:36 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1392 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:38.221986 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04da3219-f138-490a-838b-2f16889b1384 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:38.222647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04da3219-f138-490a-838b-2f16889b1384 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:38.230034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04da3219-f138-490a-838b-2f16889b1384 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:38.230527 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04da3219-f138-490a-838b-2f16889b1384 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:38.230973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04da3219-f138-490a-838b-2f16889b1384 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:38.231701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04da3219-f138-490a-838b-2f16889b1384 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:38.232193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04da3219-f138-490a-838b-2f16889b1384 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:38.232654 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04da3219-f138-490a-838b-2f16889b1384 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:38.365064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04da3219-f138-490a-838b-2f16889b1384 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:38.373076 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04da3219-f138-490a-838b-2f16889b1384 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1392 microversion: 2.1 time: 0.155235 Oct 18 14:36:38.373689 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3855/7510] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:38 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:39.396829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b154ec79-c2a8-4983-bd1b-5544720aae7e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:39.397447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b154ec79-c2a8-4983-bd1b-5544720aae7e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:39.404440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b154ec79-c2a8-4983-bd1b-5544720aae7e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:39.404911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b154ec79-c2a8-4983-bd1b-5544720aae7e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:39.405400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b154ec79-c2a8-4983-bd1b-5544720aae7e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:39.406108 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b154ec79-c2a8-4983-bd1b-5544720aae7e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:39.406581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b154ec79-c2a8-4983-bd1b-5544720aae7e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:39.407031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b154ec79-c2a8-4983-bd1b-5544720aae7e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:39.540273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b154ec79-c2a8-4983-bd1b-5544720aae7e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:39.548120 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b154ec79-c2a8-4983-bd1b-5544720aae7e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1392 microversion: 2.1 time: 0.156092 Oct 18 14:36:39.548732 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3656/7511] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:39 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:40.573576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9fa62066-f625-479c-a686-c3bc2b5260d4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:40.574201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9fa62066-f625-479c-a686-c3bc2b5260d4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:40.581683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fa62066-f625-479c-a686-c3bc2b5260d4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:40.582175 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fa62066-f625-479c-a686-c3bc2b5260d4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:40.582619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fa62066-f625-479c-a686-c3bc2b5260d4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:40.583316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fa62066-f625-479c-a686-c3bc2b5260d4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:40.583783 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fa62066-f625-479c-a686-c3bc2b5260d4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:40.584219 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9fa62066-f625-479c-a686-c3bc2b5260d4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:40.718909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9fa62066-f625-479c-a686-c3bc2b5260d4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:40.726763 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9fa62066-f625-479c-a686-c3bc2b5260d4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1392 microversion: 2.1 time: 0.157127 Oct 18 14:36:40.727339 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3856/7512] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:40 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:41.168540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-14e273a3-ad1e-4616-a112-0bf379fca832 req-351a3248-0455-4e72-b021-f1c45df1a2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32cced85-19b9-46aa-bc74-474f4630d6d5", "name": "network-vif-plugged", "status": "completed", "tag": "112388c7-c58c-4e15-8521-ec2e5193ea75"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:41.175513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:41.183499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-14e273a3-ad1e-4616-a112-0bf379fca832 req-351a3248-0455-4e72-b021-f1c45df1a2b6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:41.183973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-14e273a3-ad1e-4616-a112-0bf379fca832 req-351a3248-0455-4e72-b021-f1c45df1a2b6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:41.184400 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-14e273a3-ad1e-4616-a112-0bf379fca832 req-351a3248-0455-4e72-b021-f1c45df1a2b6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:41.196316 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-14e273a3-ad1e-4616-a112-0bf379fca832 req-351a3248-0455-4e72-b021-f1c45df1a2b6 service nova] Creating event network-vif-plugged:112388c7-c58c-4e15-8521-ec2e5193ea75 for instance 32cced85-19b9-46aa-bc74-474f4630d6d5 on n-h1-858384-13 Oct 18 14:36:41.201613 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-14e273a3-ad1e-4616-a112-0bf379fca832 req-351a3248-0455-4e72-b021-f1c45df1a2b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037215 Oct 18 14:36:41.202213 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3657/7513] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:41.749621 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-90afeb52-5a17-47c4-af80-c20154288043 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:41.750400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-90afeb52-5a17-47c4-af80-c20154288043 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:41.752970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:41.753680 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:41.760324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90afeb52-5a17-47c4-af80-c20154288043 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:41.760815 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90afeb52-5a17-47c4-af80-c20154288043 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:41.761288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90afeb52-5a17-47c4-af80-c20154288043 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:41.761996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90afeb52-5a17-47c4-af80-c20154288043 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:41.762460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90afeb52-5a17-47c4-af80-c20154288043 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:41.762920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-90afeb52-5a17-47c4-af80-c20154288043 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:41.898360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-90afeb52-5a17-47c4-af80-c20154288043 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:41.910456 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-90afeb52-5a17-47c4-af80-c20154288043 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1392 microversion: 2.1 time: 0.164477 Oct 18 14:36:41.911319 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3857/7514] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:41 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:42.935248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1a607144-bce1-4cb4-beb6-06ae68165ff7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:42.935850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1a607144-bce1-4cb4-beb6-06ae68165ff7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:42.938687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:42.944605 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a607144-bce1-4cb4-beb6-06ae68165ff7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:42.945099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a607144-bce1-4cb4-beb6-06ae68165ff7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:42.945567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a607144-bce1-4cb4-beb6-06ae68165ff7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:42.946340 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a607144-bce1-4cb4-beb6-06ae68165ff7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:42.946734 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a607144-bce1-4cb4-beb6-06ae68165ff7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:42.947161 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1a607144-bce1-4cb4-beb6-06ae68165ff7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:43.103043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1a607144-bce1-4cb4-beb6-06ae68165ff7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:43.110963 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1a607144-bce1-4cb4-beb6-06ae68165ff7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1561 microversion: 2.1 time: 0.180085 Oct 18 14:36:43.112290 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3658/7515] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:42 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:43.134643 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8e9497a2-8b27-4b51-a93a-d2a82ecdc46e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:43.135274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8e9497a2-8b27-4b51-a93a-d2a82ecdc46e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:43.137979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:36:43.143839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e9497a2-8b27-4b51-a93a-d2a82ecdc46e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:43.144344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e9497a2-8b27-4b51-a93a-d2a82ecdc46e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:43.144797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e9497a2-8b27-4b51-a93a-d2a82ecdc46e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:43.145552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e9497a2-8b27-4b51-a93a-d2a82ecdc46e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:43.146022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e9497a2-8b27-4b51-a93a-d2a82ecdc46e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:43.146480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e9497a2-8b27-4b51-a93a-d2a82ecdc46e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:43.283879 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8e9497a2-8b27-4b51-a93a-d2a82ecdc46e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:43.291905 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8e9497a2-8b27-4b51-a93a-d2a82ecdc46e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1561 microversion: 2.1 time: 0.161169 Oct 18 14:36:43.292481 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3858/7516] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:43 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:36:45.284053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-799589f9-4de1-469b-8681-f7c9eac2717e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:36:45.285359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-799589f9-4de1-469b-8681-f7c9eac2717e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:36:45.293494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-799589f9-4de1-469b-8681-f7c9eac2717e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:45.293989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-799589f9-4de1-469b-8681-f7c9eac2717e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:45.294428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-799589f9-4de1-469b-8681-f7c9eac2717e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:45.295130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-799589f9-4de1-469b-8681-f7c9eac2717e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:45.295592 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-799589f9-4de1-469b-8681-f7c9eac2717e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:45.296016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-799589f9-4de1-469b-8681-f7c9eac2717e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:45.352050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-3e3d0f31-56ba-4a49-9696-830a103530a7 req-7ebd5ff1-2274-437b-8afc-8b145c936768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32cced85-19b9-46aa-bc74-474f4630d6d5", "tag": "112388c7-c58c-4e15-8521-ec2e5193ea75"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:36:45.363734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3e3d0f31-56ba-4a49-9696-830a103530a7 req-7ebd5ff1-2274-437b-8afc-8b145c936768 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:36:45.364247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3e3d0f31-56ba-4a49-9696-830a103530a7 req-7ebd5ff1-2274-437b-8afc-8b145c936768 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:36:45.364698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-3e3d0f31-56ba-4a49-9696-830a103530a7 req-7ebd5ff1-2274-437b-8afc-8b145c936768 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:36:45.376998 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-3e3d0f31-56ba-4a49-9696-830a103530a7 req-7ebd5ff1-2274-437b-8afc-8b145c936768 service nova] Creating event network-changed:112388c7-c58c-4e15-8521-ec2e5193ea75 for instance 32cced85-19b9-46aa-bc74-474f4630d6d5 on n-h1-858384-13 Oct 18 14:36:45.382561 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-3e3d0f31-56ba-4a49-9696-830a103530a7 req-7ebd5ff1-2274-437b-8afc-8b145c936768 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100511 Oct 18 14:36:45.386241 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3859/7517] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:36:45.487292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-799589f9-4de1-469b-8681-f7c9eac2717e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:36:45.495791 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-799589f9-4de1-469b-8681-f7c9eac2717e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1561 microversion: 2.1 time: 0.216149 Oct 18 14:36:45.496391 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3659/7518] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:36:45 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1561 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:18.793774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:18.794550 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=42 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:18.799928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7aab0c3d-860b-47bf-bc3d-ead35bed7e68 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:37:18.802302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7aab0c3d-860b-47bf-bc3d-ead35bed7e68 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:18.809816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7aab0c3d-860b-47bf-bc3d-ead35bed7e68 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:18.810323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7aab0c3d-860b-47bf-bc3d-ead35bed7e68 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:18.810774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7aab0c3d-860b-47bf-bc3d-ead35bed7e68 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:18.811492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7aab0c3d-860b-47bf-bc3d-ead35bed7e68 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:18.811965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7aab0c3d-860b-47bf-bc3d-ead35bed7e68 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:18.812412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7aab0c3d-860b-47bf-bc3d-ead35bed7e68 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:18.885918 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7aab0c3d-860b-47bf-bc3d-ead35bed7e68 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5/action" status: 200 len: 24565 microversion: 2.1 time: 0.094095 Oct 18 14:37:18.886603 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3860/7519] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:37:18 2022] POST /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5/action => generated 24565 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 14:37:49.273890 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:49.274635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=38 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:49.276117 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:37:49.276259 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:37:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5/action (ip 10.222.0.40) !!! Oct 18 14:37:49.284434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-093ba265-6281-45c9-bf45-9eea68dffaf2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:37:49.286766 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-093ba265-6281-45c9-bf45-9eea68dffaf2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:49.296866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-093ba265-6281-45c9-bf45-9eea68dffaf2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:49.297392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-093ba265-6281-45c9-bf45-9eea68dffaf2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:49.298558 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-093ba265-6281-45c9-bf45-9eea68dffaf2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:49.299271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-093ba265-6281-45c9-bf45-9eea68dffaf2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:49.299838 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-093ba265-6281-45c9-bf45-9eea68dffaf2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:49.300280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-093ba265-6281-45c9-bf45-9eea68dffaf2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:49.379288 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-093ba265-6281-45c9-bf45-9eea68dffaf2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5/action" status: 202 len: 0 microversion: 2.1 time: 0.106941 Oct 18 14:37:49.379890 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3660/7520] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:37:49 2022] POST /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:37:49.389027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-580d768c-6a09-459d-964a-df3297e7989f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:49.389959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-580d768c-6a09-459d-964a-df3297e7989f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:49.393011 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:49.393660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:37:49.401365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-580d768c-6a09-459d-964a-df3297e7989f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:49.402259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-580d768c-6a09-459d-964a-df3297e7989f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:49.403104 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-580d768c-6a09-459d-964a-df3297e7989f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:49.403835 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-580d768c-6a09-459d-964a-df3297e7989f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:49.404303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-580d768c-6a09-459d-964a-df3297e7989f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:49.404736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-580d768c-6a09-459d-964a-df3297e7989f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:49.552322 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-580d768c-6a09-459d-964a-df3297e7989f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:49.562685 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-580d768c-6a09-459d-964a-df3297e7989f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1672 microversion: 2.1 time: 0.177762 Oct 18 14:37:49.564267 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3861/7521] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:49 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:37:50.592615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8e72c09a-381c-46eb-aa69-611bcd4d566f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:50.593358 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8e72c09a-381c-46eb-aa69-611bcd4d566f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:50.600305 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e72c09a-381c-46eb-aa69-611bcd4d566f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:50.600788 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e72c09a-381c-46eb-aa69-611bcd4d566f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:50.601247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e72c09a-381c-46eb-aa69-611bcd4d566f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:50.601939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e72c09a-381c-46eb-aa69-611bcd4d566f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:50.602399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e72c09a-381c-46eb-aa69-611bcd4d566f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:50.602827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8e72c09a-381c-46eb-aa69-611bcd4d566f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:50.740448 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8e72c09a-381c-46eb-aa69-611bcd4d566f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:50.748201 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8e72c09a-381c-46eb-aa69-611bcd4d566f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1677 microversion: 2.1 time: 0.161191 Oct 18 14:37:50.748793 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3661/7522] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:50 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:51.772442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-31ee5cef-2dee-4612-a3f4-b13992eb45a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:51.773070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-31ee5cef-2dee-4612-a3f4-b13992eb45a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:51.780767 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31ee5cef-2dee-4612-a3f4-b13992eb45a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:51.781293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31ee5cef-2dee-4612-a3f4-b13992eb45a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:51.781853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31ee5cef-2dee-4612-a3f4-b13992eb45a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:51.783499 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31ee5cef-2dee-4612-a3f4-b13992eb45a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:51.783977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31ee5cef-2dee-4612-a3f4-b13992eb45a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:51.784428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-31ee5cef-2dee-4612-a3f4-b13992eb45a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:51.915145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-31ee5cef-2dee-4612-a3f4-b13992eb45a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:51.923513 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-31ee5cef-2dee-4612-a3f4-b13992eb45a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1677 microversion: 2.1 time: 0.154479 Oct 18 14:37:51.924101 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3862/7523] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:51 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:52.949063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-09b959d9-d254-466b-885c-a6bcfe6b099e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:52.949730 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-09b959d9-d254-466b-885c-a6bcfe6b099e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:52.957153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09b959d9-d254-466b-885c-a6bcfe6b099e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:52.957653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09b959d9-d254-466b-885c-a6bcfe6b099e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:52.958083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09b959d9-d254-466b-885c-a6bcfe6b099e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:52.958767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09b959d9-d254-466b-885c-a6bcfe6b099e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:52.959213 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09b959d9-d254-466b-885c-a6bcfe6b099e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:52.959632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-09b959d9-d254-466b-885c-a6bcfe6b099e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:53.094361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-09b959d9-d254-466b-885c-a6bcfe6b099e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:53.102640 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-09b959d9-d254-466b-885c-a6bcfe6b099e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1677 microversion: 2.1 time: 0.157487 Oct 18 14:37:53.103226 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3662/7524] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:52 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:54.128263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-73237445-1121-43b0-b89b-deb4c527c979 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:54.128895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-73237445-1121-43b0-b89b-deb4c527c979 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:54.135820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73237445-1121-43b0-b89b-deb4c527c979 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:54.136313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73237445-1121-43b0-b89b-deb4c527c979 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:54.136837 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73237445-1121-43b0-b89b-deb4c527c979 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:54.137662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73237445-1121-43b0-b89b-deb4c527c979 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:54.138130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73237445-1121-43b0-b89b-deb4c527c979 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:54.138574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73237445-1121-43b0-b89b-deb4c527c979 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:54.280780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-73237445-1121-43b0-b89b-deb4c527c979 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:54.289248 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-73237445-1121-43b0-b89b-deb4c527c979 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1677 microversion: 2.1 time: 0.165795 Oct 18 14:37:54.289883 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3863/7525] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:54 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:55.313800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5bd424e9-66b0-4fd0-9cd1-9d99b943307c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:55.314416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5bd424e9-66b0-4fd0-9cd1-9d99b943307c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:55.321300 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bd424e9-66b0-4fd0-9cd1-9d99b943307c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:55.321773 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bd424e9-66b0-4fd0-9cd1-9d99b943307c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:55.322203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bd424e9-66b0-4fd0-9cd1-9d99b943307c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:55.322884 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bd424e9-66b0-4fd0-9cd1-9d99b943307c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:55.323330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bd424e9-66b0-4fd0-9cd1-9d99b943307c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:55.323750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5bd424e9-66b0-4fd0-9cd1-9d99b943307c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:55.459509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5bd424e9-66b0-4fd0-9cd1-9d99b943307c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:55.467450 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5bd424e9-66b0-4fd0-9cd1-9d99b943307c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1677 microversion: 2.1 time: 0.157591 Oct 18 14:37:55.468022 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3663/7526] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:55 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:56.492273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1472be77-794e-44f4-8cf4-c198950329a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:56.492813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1472be77-794e-44f4-8cf4-c198950329a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:56.499764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1472be77-794e-44f4-8cf4-c198950329a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:56.500264 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1472be77-794e-44f4-8cf4-c198950329a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:56.501364 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1472be77-794e-44f4-8cf4-c198950329a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:56.502179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1472be77-794e-44f4-8cf4-c198950329a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:56.502653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1472be77-794e-44f4-8cf4-c198950329a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:56.503100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1472be77-794e-44f4-8cf4-c198950329a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:56.644508 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1472be77-794e-44f4-8cf4-c198950329a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:56.652330 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1472be77-794e-44f4-8cf4-c198950329a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1677 microversion: 2.1 time: 0.164138 Oct 18 14:37:56.652909 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3864/7527] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:56 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:57.677291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3008c366-81f6-4e68-aac9-b6c99ce965f6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:57.677899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3008c366-81f6-4e68-aac9-b6c99ce965f6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:57.684611 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3008c366-81f6-4e68-aac9-b6c99ce965f6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:57.685081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3008c366-81f6-4e68-aac9-b6c99ce965f6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:57.685539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3008c366-81f6-4e68-aac9-b6c99ce965f6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:57.686217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3008c366-81f6-4e68-aac9-b6c99ce965f6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:57.686659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3008c366-81f6-4e68-aac9-b6c99ce965f6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:57.687079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3008c366-81f6-4e68-aac9-b6c99ce965f6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:57.822670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3008c366-81f6-4e68-aac9-b6c99ce965f6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:57.831056 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3008c366-81f6-4e68-aac9-b6c99ce965f6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1677 microversion: 2.1 time: 0.157645 Oct 18 14:37:57.831634 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3664/7528] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:57 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:37:58.855030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d3d7f9f0-6501-4966-a90a-2c019e29adc4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:37:58.855658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d3d7f9f0-6501-4966-a90a-2c019e29adc4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:37:58.862489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d7f9f0-6501-4966-a90a-2c019e29adc4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:58.862990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d7f9f0-6501-4966-a90a-2c019e29adc4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:58.863443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d7f9f0-6501-4966-a90a-2c019e29adc4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:58.864149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d7f9f0-6501-4966-a90a-2c019e29adc4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:37:58.864620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d7f9f0-6501-4966-a90a-2c019e29adc4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:37:58.865060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d3d7f9f0-6501-4966-a90a-2c019e29adc4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:37:59.006060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d3d7f9f0-6501-4966-a90a-2c019e29adc4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:37:59.013929 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d3d7f9f0-6501-4966-a90a-2c019e29adc4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1677 microversion: 2.1 time: 0.162820 Oct 18 14:37:59.014509 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3865/7529] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:37:58 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:38:00.038087 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-591bd1ed-023c-4932-941b-5279cf88804d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:38:00.038708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-591bd1ed-023c-4932-941b-5279cf88804d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:38:00.045767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-591bd1ed-023c-4932-941b-5279cf88804d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:00.046246 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-591bd1ed-023c-4932-941b-5279cf88804d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:00.046684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-591bd1ed-023c-4932-941b-5279cf88804d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:00.047600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-591bd1ed-023c-4932-941b-5279cf88804d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:00.048097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-591bd1ed-023c-4932-941b-5279cf88804d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:00.048540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-591bd1ed-023c-4932-941b-5279cf88804d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:00.186043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-591bd1ed-023c-4932-941b-5279cf88804d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:38:00.194636 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-591bd1ed-023c-4932-941b-5279cf88804d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1677 microversion: 2.1 time: 0.160455 Oct 18 14:38:00.195244 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3665/7530] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:38:00 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:38:01.219886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-13bd7852-263f-4e6d-80bf-474bb0450550 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:38:01.220660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-13bd7852-263f-4e6d-80bf-474bb0450550 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:38:01.227392 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13bd7852-263f-4e6d-80bf-474bb0450550 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:01.227888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13bd7852-263f-4e6d-80bf-474bb0450550 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:01.228337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13bd7852-263f-4e6d-80bf-474bb0450550 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:01.229044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13bd7852-263f-4e6d-80bf-474bb0450550 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:01.229539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13bd7852-263f-4e6d-80bf-474bb0450550 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:01.229977 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-13bd7852-263f-4e6d-80bf-474bb0450550 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:01.367791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-13bd7852-263f-4e6d-80bf-474bb0450550 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:38:01.377067 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-13bd7852-263f-4e6d-80bf-474bb0450550 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1680 microversion: 2.1 time: 0.162113 Oct 18 14:38:01.377700 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3866/7531] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:38:01 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:38:33.601899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d17fa5d9-6758-4b87-b17e-b4e34bc88eef tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:38:33.604105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d17fa5d9-6758-4b87-b17e-b4e34bc88eef tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:38:33.606933 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=12 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:33.607822 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:33.614251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d17fa5d9-6758-4b87-b17e-b4e34bc88eef tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:33.614770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d17fa5d9-6758-4b87-b17e-b4e34bc88eef tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:33.615203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d17fa5d9-6758-4b87-b17e-b4e34bc88eef tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:33.615901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d17fa5d9-6758-4b87-b17e-b4e34bc88eef tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:33.616356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d17fa5d9-6758-4b87-b17e-b4e34bc88eef tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:33.616785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d17fa5d9-6758-4b87-b17e-b4e34bc88eef tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:33.752128 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d17fa5d9-6758-4b87-b17e-b4e34bc88eef tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5/action" status: 200 len: 69092 microversion: 2.1 time: 0.152898 Oct 18 14:38:33.752438 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3666/7532] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:38:33 2022] POST /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5/action => generated 69092 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:38:50.870547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f07d8948-29d2-4a88-b441-1417f04553bf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:38:50.871113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f07d8948-29d2-4a88-b441-1417f04553bf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:38:50.872298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-ae42298b-6484-484a-8c47-8a58ace406ca req-67a4e208-776e-4ecf-a1cd-7cb1de111eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32cced85-19b9-46aa-bc74-474f4630d6d5", "tag": "112388c7-c58c-4e15-8521-ec2e5193ea75"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:38:50.874915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=12 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:50.875689 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=36 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:50.880146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:50.881073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:38:50.881425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f07d8948-29d2-4a88-b441-1417f04553bf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:50.881873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f07d8948-29d2-4a88-b441-1417f04553bf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:50.882349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f07d8948-29d2-4a88-b441-1417f04553bf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:50.883374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f07d8948-29d2-4a88-b441-1417f04553bf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:50.884076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f07d8948-29d2-4a88-b441-1417f04553bf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:50.884699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f07d8948-29d2-4a88-b441-1417f04553bf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:50.885906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ae42298b-6484-484a-8c47-8a58ace406ca req-67a4e208-776e-4ecf-a1cd-7cb1de111eb4 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:50.886380 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ae42298b-6484-484a-8c47-8a58ace406ca req-67a4e208-776e-4ecf-a1cd-7cb1de111eb4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:50.886804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-ae42298b-6484-484a-8c47-8a58ace406ca req-67a4e208-776e-4ecf-a1cd-7cb1de111eb4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:50.900170 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-ae42298b-6484-484a-8c47-8a58ace406ca req-67a4e208-776e-4ecf-a1cd-7cb1de111eb4 service nova] Creating event network-changed:112388c7-c58c-4e15-8521-ec2e5193ea75 for instance 32cced85-19b9-46aa-bc74-474f4630d6d5 on n-h1-858384-13 Oct 18 14:38:50.905713 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-ae42298b-6484-484a-8c47-8a58ace406ca req-67a4e208-776e-4ecf-a1cd-7cb1de111eb4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037381 Oct 18 14:38:50.906324 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3667/7533] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:38:50.913683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f07d8948-29d2-4a88-b441-1417f04553bf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:38:51.013706 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f07d8948-29d2-4a88-b441-1417f04553bf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 204 len: 0 microversion: 2.1 time: 0.146750 Oct 18 14:38:51.014759 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3867/7534] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:38:50 2022] DELETE /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:38:51.024828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bdc00fc0-5781-4aa7-97e0-1101834eaf21 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:38:51.025615 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bdc00fc0-5781-4aa7-97e0-1101834eaf21 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:38:51.034175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdc00fc0-5781-4aa7-97e0-1101834eaf21 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:51.036909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdc00fc0-5781-4aa7-97e0-1101834eaf21 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:51.037591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdc00fc0-5781-4aa7-97e0-1101834eaf21 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:51.038430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdc00fc0-5781-4aa7-97e0-1101834eaf21 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:51.039004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdc00fc0-5781-4aa7-97e0-1101834eaf21 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:51.039435 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bdc00fc0-5781-4aa7-97e0-1101834eaf21 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:51.210954 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bdc00fc0-5781-4aa7-97e0-1101834eaf21 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:38:51.219180 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bdc00fc0-5781-4aa7-97e0-1101834eaf21 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1686 microversion: 2.1 time: 0.199302 Oct 18 14:38:51.219762 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3668/7535] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:38:51 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1686 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:38:52.245612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-df9f344a-ffb7-474b-8e2d-6163e0aa7116 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:38:52.246247 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-df9f344a-ffb7-474b-8e2d-6163e0aa7116 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:38:52.253655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df9f344a-ffb7-474b-8e2d-6163e0aa7116 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:52.254157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df9f344a-ffb7-474b-8e2d-6163e0aa7116 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:52.254609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df9f344a-ffb7-474b-8e2d-6163e0aa7116 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:52.255400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df9f344a-ffb7-474b-8e2d-6163e0aa7116 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:52.255938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df9f344a-ffb7-474b-8e2d-6163e0aa7116 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:52.256381 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-df9f344a-ffb7-474b-8e2d-6163e0aa7116 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:52.397944 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-df9f344a-ffb7-474b-8e2d-6163e0aa7116 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:38:52.406820 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-df9f344a-ffb7-474b-8e2d-6163e0aa7116 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1686 microversion: 2.1 time: 0.165483 Oct 18 14:38:52.407434 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3868/7536] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:38:52 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:38:53.343471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-d86f7eb4-7fda-4028-ad69-b43f30061517 req-1b757cb1-cc6b-4718-bbeb-4adf5b7deb1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32cced85-19b9-46aa-bc74-474f4630d6d5", "name": "network-vif-deleted", "tag": "112388c7-c58c-4e15-8521-ec2e5193ea75"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:38:53.354576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d86f7eb4-7fda-4028-ad69-b43f30061517 req-1b757cb1-cc6b-4718-bbeb-4adf5b7deb1a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:53.355052 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d86f7eb4-7fda-4028-ad69-b43f30061517 req-1b757cb1-cc6b-4718-bbeb-4adf5b7deb1a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:53.355486 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-d86f7eb4-7fda-4028-ad69-b43f30061517 req-1b757cb1-cc6b-4718-bbeb-4adf5b7deb1a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:53.367697 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-d86f7eb4-7fda-4028-ad69-b43f30061517 req-1b757cb1-cc6b-4718-bbeb-4adf5b7deb1a service nova] Creating event network-vif-deleted:112388c7-c58c-4e15-8521-ec2e5193ea75 for instance 32cced85-19b9-46aa-bc74-474f4630d6d5 on n-h1-858384-13 Oct 18 14:38:53.373414 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-d86f7eb4-7fda-4028-ad69-b43f30061517 req-1b757cb1-cc6b-4718-bbeb-4adf5b7deb1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033758 Oct 18 14:38:53.374343 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3669/7537] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:38:53.432538 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:38:53.433278 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:38:53.441982 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:53.442494 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:53.442951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:53.443678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:53.444149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:53.444600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:53.479345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:53.479849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:53.480307 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:53.480807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lazy-loading 'fault' on Instance uuid 32cced85-19b9-46aa-bc74-474f4630d6d5 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:38:53.527223 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:38:53.535794 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-46054590-78fb-41d0-aa68-2f1954c94098 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 200 len: 1356 microversion: 2.1 time: 0.107523 Oct 18 14:38:53.537395 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3869/7538] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:38:53 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 1356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:38:54.562677 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a4048e37-e835-434f-a159-3393278fdaa2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:38:54.563368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a4048e37-e835-434f-a159-3393278fdaa2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 32cced85-19b9-46aa-bc74-474f4630d6d5] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:38:54.569784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4048e37-e835-434f-a159-3393278fdaa2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:54.570263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4048e37-e835-434f-a159-3393278fdaa2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:54.570687 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4048e37-e835-434f-a159-3393278fdaa2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:54.571364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4048e37-e835-434f-a159-3393278fdaa2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:38:54.571808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4048e37-e835-434f-a159-3393278fdaa2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:38:54.572219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a4048e37-e835-434f-a159-3393278fdaa2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:38:54.586256 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-a4048e37-e835-434f-a159-3393278fdaa2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] HTTP exception thrown: Instance 32cced85-19b9-46aa-bc74-474f4630d6d5 could not be found. Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a4048e37-e835-434f-a159-3393278fdaa2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Request method failure captured: Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 HTTP/1.1 Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrmoJdJwsrKMFUaanrLJLt6LyEOQIjZ0f05fEpGBag1K6ul8d4SOC38ZEmojqeN-5Mr9W9Uihbdj5HrM7P4JhTSrrxqG0t2lF0wFzmrTNNFiotgT_nFwllBcbU5Dhub5ILl6o50Cn3W6DaWc6o8DCIPPy5pkj53OvF8nQyugmrrzfyI Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d2c5ebcb706b4f26903d0c30945bbcf0 Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d2c5ebcb706b4f26903d0c30945bbcf0"}]}] Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d2c5ebcb706b4f26903d0c30945bbcf0 Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestNetworkAdvancedServerOps-527964250-project Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a59ca729767748089c293f1066cda564 Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestNetworkAdvancedServerOps-527964250-project Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 32cced85-19b9-46aa-bc74-474f4630d6d5 could not be found. Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '32cced85-19b9-46aa-bc74-474f4630d6d5'} Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32cced85-19b9-46aa-bc74-474f4630d6d5 could not be found. Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32cced85-19b9-46aa-bc74-474f4630d6d5 could not be found. Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:38:54.587865 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:38:54.593071 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:38:54.593071 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:38:54.593071 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:38:54.593071 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:38:54.593071 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:38:54.593071 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:38:54.593071 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32cced85-19b9-46aa-bc74-474f4630d6d5 could not be found. Oct 18 14:38:54.593071 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:38:54.593071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a4048e37-e835-434f-a159-3393278fdaa2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Returning 404 to user: Instance 32cced85-19b9-46aa-bc74-474f4630d6d5 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:38:54.593071 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a4048e37-e835-434f-a159-3393278fdaa2 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5" status: 404 len: 111 microversion: 2.1 time: 0.032283 Oct 18 14:38:54.593071 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3670/7539] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:38:54 2022] GET /compute/v2.1/servers/32cced85-19b9-46aa-bc74-474f4630d6d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:38:58.209261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-61373a17-cf38-4d1e-b927-81a021eeb9d9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '.version_select at 0x7ff60e5b4940>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:38:58.234858 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-61373a17-cf38-4d1e-b927-81a021eeb9d9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1929977907" status: 202 len: 0 microversion: 2.1 time: 0.029473 Oct 18 14:38:58.236075 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3870/7540] 10.222.0.40 () {58 vars in 1284 bytes} [Tue Oct 18 14:38:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1929977907 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:38:58.269557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d4b6d8be-c513-4b96-9406-49d10c7023cb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'create', calling method: .version_select at 0x7ff60e55bdc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1716988980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaVLHhQWGhBO31W1HPmTr+l6Tau7OR5rTT/ZzXxJFb9ShJae2rKs95Ag4uRtO45/m6TRV5MkBKaq22u3dDeZ8sOAUlLRRV1kENnC184hKrEfkurhB4fjXA33QK+mG1WSw=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:38:58.286811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-d4b6d8be-c513-4b96-9406-49d10c7023cb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:38:58.292194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-d4b6d8be-c513-4b96-9406-49d10c7023cb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for user a59ca729767748089c293f1066cda564 and project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:38:58.320775 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d4b6d8be-c513-4b96-9406-49d10c7023cb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056969 Oct 18 14:38:58.321515 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3671/7541] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:38:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:39:04.401957 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:04.407391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-766216549", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "7ae8e01c-2c60-4931-ab92-5173425a508b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1716988980", "security_groups": [{"name": "tempest-secgroup-smoke-14573417"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:39:04.554710 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] validate_networks() for [('7ae8e01c-2c60-4931-ab92-5173425a508b', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:39:05.131230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:39:05.131711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:39:05.132363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:39:05.132793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:39:05.133245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:39:05.153313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:05.153810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:05.154451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:05.155359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:05.156029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:05.156635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:05.185038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:39:05.197365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for user a59ca729767748089c293f1066cda564 and project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:39:05.223141 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:39:05.228255 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:39:05.302309 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2dfacf85-7020-4204-bc5f-2bdb63b74545 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.902972 Oct 18 14:39:05.309137 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3871/7542] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:39:04 2022] POST /compute/v2.1/servers => generated 404 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:39:05.323913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8c2137ab-d8f3-42a0-9694-63c834aac1a1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:05.324660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8c2137ab-d8f3-42a0-9694-63c834aac1a1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:05.327794 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=12 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:05.410988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8c2137ab-d8f3-42a0-9694-63c834aac1a1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:05.419486 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8c2137ab-d8f3-42a0-9694-63c834aac1a1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1266 microversion: 2.1 time: 0.108389 Oct 18 14:39:05.420514 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3672/7543] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:05 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:06.447453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4607c3fb-e428-46a6-9dd9-9c62c82d3c9c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:06.449003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4607c3fb-e428-46a6-9dd9-9c62c82d3c9c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:06.465732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4607c3fb-e428-46a6-9dd9-9c62c82d3c9c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:06.466833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4607c3fb-e428-46a6-9dd9-9c62c82d3c9c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:06.468559 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4607c3fb-e428-46a6-9dd9-9c62c82d3c9c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:06.469417 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4607c3fb-e428-46a6-9dd9-9c62c82d3c9c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:06.471248 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4607c3fb-e428-46a6-9dd9-9c62c82d3c9c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:06.471713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4607c3fb-e428-46a6-9dd9-9c62c82d3c9c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:06.564592 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4607c3fb-e428-46a6-9dd9-9c62c82d3c9c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:06.582457 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4607c3fb-e428-46a6-9dd9-9c62c82d3c9c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1326 microversion: 2.1 time: 0.142631 Oct 18 14:39:06.585802 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3872/7544] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:06 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1326 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:07.612446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e9f7d6a3-d8f7-4851-9d00-48d398bec65f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:07.613075 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e9f7d6a3-d8f7-4851-9d00-48d398bec65f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:07.623590 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9f7d6a3-d8f7-4851-9d00-48d398bec65f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:07.624475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9f7d6a3-d8f7-4851-9d00-48d398bec65f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:07.625010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9f7d6a3-d8f7-4851-9d00-48d398bec65f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:07.625839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9f7d6a3-d8f7-4851-9d00-48d398bec65f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:07.626578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9f7d6a3-d8f7-4851-9d00-48d398bec65f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:07.627248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e9f7d6a3-d8f7-4851-9d00-48d398bec65f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:07.897912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e9f7d6a3-d8f7-4851-9d00-48d398bec65f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:07.906257 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e9f7d6a3-d8f7-4851-9d00-48d398bec65f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1390 microversion: 2.1 time: 0.298834 Oct 18 14:39:07.906862 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3673/7545] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:07 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1390 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:08.330905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-83044c04-d3fa-4a4b-9f25-e3077e1f0e2e req-64075d8d-516e-4120-9a1f-8f3233f2d16d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ab00f8-7b5e-4c62-9af1-702504d3a92b", "tag": "749eff52-ec72-4ebd-bf1b-e86574b6932d"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:39:08.363331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-83044c04-d3fa-4a4b-9f25-e3077e1f0e2e req-64075d8d-516e-4120-9a1f-8f3233f2d16d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:08.364133 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-83044c04-d3fa-4a4b-9f25-e3077e1f0e2e req-64075d8d-516e-4120-9a1f-8f3233f2d16d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:08.364690 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-83044c04-d3fa-4a4b-9f25-e3077e1f0e2e req-64075d8d-516e-4120-9a1f-8f3233f2d16d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:08.381244 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-83044c04-d3fa-4a4b-9f25-e3077e1f0e2e req-64075d8d-516e-4120-9a1f-8f3233f2d16d service nova] Creating event network-changed:749eff52-ec72-4ebd-bf1b-e86574b6932d for instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b on n-h2-858384-13 Oct 18 14:39:08.387584 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-83044c04-d3fa-4a4b-9f25-e3077e1f0e2e req-64075d8d-516e-4120-9a1f-8f3233f2d16d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061083 Oct 18 14:39:08.388436 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3873/7546] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:39:08.930171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-3382ce2d-259a-466c-b93a-8294a1791cf5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:08.930783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-3382ce2d-259a-466c-b93a-8294a1791cf5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:08.937988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3382ce2d-259a-466c-b93a-8294a1791cf5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:08.938389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3382ce2d-259a-466c-b93a-8294a1791cf5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:08.938988 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3382ce2d-259a-466c-b93a-8294a1791cf5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:08.939678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3382ce2d-259a-466c-b93a-8294a1791cf5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:08.940126 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3382ce2d-259a-466c-b93a-8294a1791cf5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:08.940545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-3382ce2d-259a-466c-b93a-8294a1791cf5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:09.076253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-3382ce2d-259a-466c-b93a-8294a1791cf5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:09.085097 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-3382ce2d-259a-466c-b93a-8294a1791cf5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1390 microversion: 2.1 time: 0.158818 Oct 18 14:39:09.085721 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3674/7547] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:08 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:10.109034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1d96be3b-76d9-43bf-8f86-f02432123cec tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:10.109852 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1d96be3b-76d9-43bf-8f86-f02432123cec tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:10.117795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d96be3b-76d9-43bf-8f86-f02432123cec tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:10.118288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d96be3b-76d9-43bf-8f86-f02432123cec tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:10.118734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d96be3b-76d9-43bf-8f86-f02432123cec tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:10.119441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d96be3b-76d9-43bf-8f86-f02432123cec tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:10.119906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d96be3b-76d9-43bf-8f86-f02432123cec tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:10.120347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1d96be3b-76d9-43bf-8f86-f02432123cec tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:10.264263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1d96be3b-76d9-43bf-8f86-f02432123cec tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:10.273620 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1d96be3b-76d9-43bf-8f86-f02432123cec tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1390 microversion: 2.1 time: 0.169043 Oct 18 14:39:10.274288 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3874/7548] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:10 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:11.298883 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dc887d34-478c-40b1-b727-32556bad00bb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:11.299515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dc887d34-478c-40b1-b727-32556bad00bb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:11.306724 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc887d34-478c-40b1-b727-32556bad00bb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:11.307199 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc887d34-478c-40b1-b727-32556bad00bb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:11.307629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc887d34-478c-40b1-b727-32556bad00bb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:11.308315 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc887d34-478c-40b1-b727-32556bad00bb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:11.308762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc887d34-478c-40b1-b727-32556bad00bb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:11.309194 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dc887d34-478c-40b1-b727-32556bad00bb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:11.450789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dc887d34-478c-40b1-b727-32556bad00bb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:11.460330 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dc887d34-478c-40b1-b727-32556bad00bb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1390 microversion: 2.1 time: 0.165921 Oct 18 14:39:11.460957 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3675/7549] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:11 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:12.484775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c397a9b7-103e-433b-ab41-62a79950380f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:12.486152 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c397a9b7-103e-433b-ab41-62a79950380f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:12.492842 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c397a9b7-103e-433b-ab41-62a79950380f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:12.493590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c397a9b7-103e-433b-ab41-62a79950380f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:12.494056 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c397a9b7-103e-433b-ab41-62a79950380f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:12.494786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c397a9b7-103e-433b-ab41-62a79950380f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:12.495261 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c397a9b7-103e-433b-ab41-62a79950380f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:12.495754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c397a9b7-103e-433b-ab41-62a79950380f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:12.632216 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c397a9b7-103e-433b-ab41-62a79950380f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:12.644197 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c397a9b7-103e-433b-ab41-62a79950380f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1390 microversion: 2.1 time: 0.163370 Oct 18 14:39:12.644809 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3875/7550] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:12 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:13.667689 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9e5733b1-ffaa-4b4d-8821-357cd6324c28 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:13.668369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9e5733b1-ffaa-4b4d-8821-357cd6324c28 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:13.676536 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e5733b1-ffaa-4b4d-8821-357cd6324c28 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:13.677023 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e5733b1-ffaa-4b4d-8821-357cd6324c28 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:13.677480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e5733b1-ffaa-4b4d-8821-357cd6324c28 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:13.678175 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e5733b1-ffaa-4b4d-8821-357cd6324c28 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:13.678628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e5733b1-ffaa-4b4d-8821-357cd6324c28 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:13.679051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9e5733b1-ffaa-4b4d-8821-357cd6324c28 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:13.818076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9e5733b1-ffaa-4b4d-8821-357cd6324c28 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:13.826054 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9e5733b1-ffaa-4b4d-8821-357cd6324c28 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1390 microversion: 2.1 time: 0.162231 Oct 18 14:39:13.826627 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3676/7551] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:13 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:14.278660 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-e4ea1605-220c-43f2-898a-e457d045ce73 req-88163456-3b09-4cd0-824b-8f24a9ae03e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ab00f8-7b5e-4c62-9af1-702504d3a92b", "name": "network-vif-plugged", "status": "completed", "tag": "749eff52-ec72-4ebd-bf1b-e86574b6932d"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:39:14.294289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e4ea1605-220c-43f2-898a-e457d045ce73 req-88163456-3b09-4cd0-824b-8f24a9ae03e9 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:14.294706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e4ea1605-220c-43f2-898a-e457d045ce73 req-88163456-3b09-4cd0-824b-8f24a9ae03e9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:14.295245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e4ea1605-220c-43f2-898a-e457d045ce73 req-88163456-3b09-4cd0-824b-8f24a9ae03e9 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:14.307397 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-e4ea1605-220c-43f2-898a-e457d045ce73 req-88163456-3b09-4cd0-824b-8f24a9ae03e9 service nova] Creating event network-vif-plugged:749eff52-ec72-4ebd-bf1b-e86574b6932d for instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b on n-h2-858384-13 Oct 18 14:39:14.312970 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-e4ea1605-220c-43f2-898a-e457d045ce73 req-88163456-3b09-4cd0-824b-8f24a9ae03e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101913 Oct 18 14:39:14.314196 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3876/7552] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:39:14.850051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-de20ffb9-d3b5-49cf-a39f-f63d6750a625 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:14.850789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-de20ffb9-d3b5-49cf-a39f-f63d6750a625 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:14.858271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de20ffb9-d3b5-49cf-a39f-f63d6750a625 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:14.858755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de20ffb9-d3b5-49cf-a39f-f63d6750a625 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:14.859191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de20ffb9-d3b5-49cf-a39f-f63d6750a625 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:14.859886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de20ffb9-d3b5-49cf-a39f-f63d6750a625 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:14.860948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de20ffb9-d3b5-49cf-a39f-f63d6750a625 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:14.861728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-de20ffb9-d3b5-49cf-a39f-f63d6750a625 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:15.012550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-de20ffb9-d3b5-49cf-a39f-f63d6750a625 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:15.020711 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-de20ffb9-d3b5-49cf-a39f-f63d6750a625 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1390 microversion: 2.1 time: 0.174777 Oct 18 14:39:15.021312 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3677/7553] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:14 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:16.042405 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:16.043624 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:16.050120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-37f9914b-e68b-4883-9596-d6781569cf5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:16.050832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-37f9914b-e68b-4883-9596-d6781569cf5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:16.057703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37f9914b-e68b-4883-9596-d6781569cf5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:16.058196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37f9914b-e68b-4883-9596-d6781569cf5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:16.058644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37f9914b-e68b-4883-9596-d6781569cf5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:16.059347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37f9914b-e68b-4883-9596-d6781569cf5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:16.059855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37f9914b-e68b-4883-9596-d6781569cf5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:16.060460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-37f9914b-e68b-4883-9596-d6781569cf5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:16.199839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-37f9914b-e68b-4883-9596-d6781569cf5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:16.208421 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-37f9914b-e68b-4883-9596-d6781569cf5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1562 microversion: 2.1 time: 0.167008 Oct 18 14:39:16.209004 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3877/7554] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:16 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:16.231733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8f5af3f1-c2d0-45a1-a8f3-cb0716941b6a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:16.232449 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8f5af3f1-c2d0-45a1-a8f3-cb0716941b6a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:16.235039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:16.242937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f5af3f1-c2d0-45a1-a8f3-cb0716941b6a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:16.243462 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f5af3f1-c2d0-45a1-a8f3-cb0716941b6a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:16.243952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f5af3f1-c2d0-45a1-a8f3-cb0716941b6a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:16.244791 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f5af3f1-c2d0-45a1-a8f3-cb0716941b6a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:16.245373 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f5af3f1-c2d0-45a1-a8f3-cb0716941b6a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:16.245891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f5af3f1-c2d0-45a1-a8f3-cb0716941b6a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:16.385693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8f5af3f1-c2d0-45a1-a8f3-cb0716941b6a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:16.394155 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8f5af3f1-c2d0-45a1-a8f3-cb0716941b6a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1562 microversion: 2.1 time: 0.166259 Oct 18 14:39:16.394744 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3678/7555] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:16 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:18.384519 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-06f4a67f-26aa-4dbd-bd53-908df994ad1c req-5098b6ea-129d-49af-a69f-ce1dab5e1868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ab00f8-7b5e-4c62-9af1-702504d3a92b", "tag": "749eff52-ec72-4ebd-bf1b-e86574b6932d"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:39:18.391196 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-59361eb4-cce5-4cbe-9694-a7a3bcac7b72 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:18.391860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-59361eb4-cce5-4cbe-9694-a7a3bcac7b72 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:18.403512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-06f4a67f-26aa-4dbd-bd53-908df994ad1c req-5098b6ea-129d-49af-a69f-ce1dab5e1868 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:18.404115 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-06f4a67f-26aa-4dbd-bd53-908df994ad1c req-5098b6ea-129d-49af-a69f-ce1dab5e1868 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:18.404437 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59361eb4-cce5-4cbe-9694-a7a3bcac7b72 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:18.404620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-06f4a67f-26aa-4dbd-bd53-908df994ad1c req-5098b6ea-129d-49af-a69f-ce1dab5e1868 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:18.405333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59361eb4-cce5-4cbe-9694-a7a3bcac7b72 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:18.405778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59361eb4-cce5-4cbe-9694-a7a3bcac7b72 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:18.406509 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59361eb4-cce5-4cbe-9694-a7a3bcac7b72 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:18.407271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59361eb4-cce5-4cbe-9694-a7a3bcac7b72 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:18.407904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-59361eb4-cce5-4cbe-9694-a7a3bcac7b72 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:18.420754 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-06f4a67f-26aa-4dbd-bd53-908df994ad1c req-5098b6ea-129d-49af-a69f-ce1dab5e1868 service nova] Creating event network-changed:749eff52-ec72-4ebd-bf1b-e86574b6932d for instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b on n-h2-858384-13 Oct 18 14:39:18.426516 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-06f4a67f-26aa-4dbd-bd53-908df994ad1c req-5098b6ea-129d-49af-a69f-ce1dab5e1868 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045572 Oct 18 14:39:18.427458 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3679/7556] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:39:18.584633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-59361eb4-cce5-4cbe-9694-a7a3bcac7b72 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:18.595752 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-59361eb4-cce5-4cbe-9694-a7a3bcac7b72 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1562 microversion: 2.1 time: 0.216313 Oct 18 14:39:18.603319 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3878/7557] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:18 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:39.847136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:39.847878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=38 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:39.852719 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-61304164-878a-47df-b736-ca44fcf3439f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:39:39.854950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-61304164-878a-47df-b736-ca44fcf3439f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:39.862446 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61304164-878a-47df-b736-ca44fcf3439f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:39.862919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61304164-878a-47df-b736-ca44fcf3439f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:39.863348 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61304164-878a-47df-b736-ca44fcf3439f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:39.864032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61304164-878a-47df-b736-ca44fcf3439f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:39.864478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61304164-878a-47df-b736-ca44fcf3439f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:39.864898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-61304164-878a-47df-b736-ca44fcf3439f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:39.916613 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-61304164-878a-47df-b736-ca44fcf3439f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b/action" status: 200 len: 24570 microversion: 2.1 time: 0.072154 Oct 18 14:39:39.917336 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3680/7558] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:39:39 2022] POST /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b/action => generated 24570 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:39:51.015870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:39:51.018778 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:51.021105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:51.021807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=36 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:51.028893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:51.029419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:51.029878 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:51.030578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:51.031046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:51.031482 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:51.073844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:51.080454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Old instance type m1.heat2, new instance type m1.heat {{(pid=120611) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 18 14:39:51.087303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:39:51.087740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:39:51.088234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:39:51.088656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:39:51.089078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:39:51.154241 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-15d0f625-f55f-4597-8a63-5f9f43de5af6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b/action" status: 202 len: 0 microversion: 2.1 time: 0.142297 Oct 18 14:39:51.154866 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3879/7559] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:39:51 2022] POST /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:39:51.163939 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cca98235-3122-420e-ad8e-f3fbad81e8e1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:51.164639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cca98235-3122-420e-ad8e-f3fbad81e8e1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:51.167511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:51.168198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:39:51.175696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cca98235-3122-420e-ad8e-f3fbad81e8e1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:51.176179 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cca98235-3122-420e-ad8e-f3fbad81e8e1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:51.176618 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cca98235-3122-420e-ad8e-f3fbad81e8e1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:51.177361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cca98235-3122-420e-ad8e-f3fbad81e8e1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:51.177813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cca98235-3122-420e-ad8e-f3fbad81e8e1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:51.178234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cca98235-3122-420e-ad8e-f3fbad81e8e1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:51.318336 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cca98235-3122-420e-ad8e-f3fbad81e8e1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:51.326176 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cca98235-3122-420e-ad8e-f3fbad81e8e1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1689 microversion: 2.1 time: 0.166561 Oct 18 14:39:51.326752 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3681/7560] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:51 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:52.356759 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-08d7eb72-d576-4ec6-bc6c-adf833d7eef1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:52.357427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-08d7eb72-d576-4ec6-bc6c-adf833d7eef1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:52.365458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08d7eb72-d576-4ec6-bc6c-adf833d7eef1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:52.365959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08d7eb72-d576-4ec6-bc6c-adf833d7eef1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:52.366414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08d7eb72-d576-4ec6-bc6c-adf833d7eef1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:52.367699 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08d7eb72-d576-4ec6-bc6c-adf833d7eef1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:52.368271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08d7eb72-d576-4ec6-bc6c-adf833d7eef1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:52.368723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08d7eb72-d576-4ec6-bc6c-adf833d7eef1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:52.507130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-08d7eb72-d576-4ec6-bc6c-adf833d7eef1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:52.515031 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-08d7eb72-d576-4ec6-bc6c-adf833d7eef1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1689 microversion: 2.1 time: 0.163529 Oct 18 14:39:52.515611 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3880/7561] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:52 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:53.539278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb417562-9654-4564-b102-52e00d7698de tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:53.539889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb417562-9654-4564-b102-52e00d7698de tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:53.546855 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb417562-9654-4564-b102-52e00d7698de tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:53.547334 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb417562-9654-4564-b102-52e00d7698de tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:53.548184 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb417562-9654-4564-b102-52e00d7698de tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:53.548808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb417562-9654-4564-b102-52e00d7698de tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:53.549291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb417562-9654-4564-b102-52e00d7698de tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:53.549720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb417562-9654-4564-b102-52e00d7698de tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:53.684854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fb417562-9654-4564-b102-52e00d7698de tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:53.693408 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb417562-9654-4564-b102-52e00d7698de tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.158021 Oct 18 14:39:53.693987 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3682/7562] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:53 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:54.717715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fe439f17-ce38-4887-9765-dcb94d8454f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:54.718607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fe439f17-ce38-4887-9765-dcb94d8454f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:54.725951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe439f17-ce38-4887-9765-dcb94d8454f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:54.726447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe439f17-ce38-4887-9765-dcb94d8454f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:54.726898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe439f17-ce38-4887-9765-dcb94d8454f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:54.727607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe439f17-ce38-4887-9765-dcb94d8454f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:54.728076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe439f17-ce38-4887-9765-dcb94d8454f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:54.728522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe439f17-ce38-4887-9765-dcb94d8454f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:54.873665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fe439f17-ce38-4887-9765-dcb94d8454f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:54.882206 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fe439f17-ce38-4887-9765-dcb94d8454f9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.168477 Oct 18 14:39:54.882788 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3881/7563] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:54 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:55.905894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16b638b4-d5bd-4e48-867f-e4df1228e164 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:55.906530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-16b638b4-d5bd-4e48-867f-e4df1228e164 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:55.913589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b638b4-d5bd-4e48-867f-e4df1228e164 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:55.914070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b638b4-d5bd-4e48-867f-e4df1228e164 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:55.914500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b638b4-d5bd-4e48-867f-e4df1228e164 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:55.915187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b638b4-d5bd-4e48-867f-e4df1228e164 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:55.915633 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b638b4-d5bd-4e48-867f-e4df1228e164 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:55.916058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b638b4-d5bd-4e48-867f-e4df1228e164 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:56.053195 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-16b638b4-d5bd-4e48-867f-e4df1228e164 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:56.061061 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-16b638b4-d5bd-4e48-867f-e4df1228e164 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.159138 Oct 18 14:39:56.061666 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3683/7564] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:55 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:39:57.085952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6e7e1a28-9bfe-4f68-bacc-97c5f8dcd268 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:57.086576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6e7e1a28-9bfe-4f68-bacc-97c5f8dcd268 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:57.093980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e7e1a28-9bfe-4f68-bacc-97c5f8dcd268 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:57.095291 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e7e1a28-9bfe-4f68-bacc-97c5f8dcd268 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:57.095917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e7e1a28-9bfe-4f68-bacc-97c5f8dcd268 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:57.096369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e7e1a28-9bfe-4f68-bacc-97c5f8dcd268 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:57.096834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e7e1a28-9bfe-4f68-bacc-97c5f8dcd268 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:57.097298 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e7e1a28-9bfe-4f68-bacc-97c5f8dcd268 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:57.233354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6e7e1a28-9bfe-4f68-bacc-97c5f8dcd268 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:57.241458 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6e7e1a28-9bfe-4f68-bacc-97c5f8dcd268 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.159397 Oct 18 14:39:57.242044 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3882/7565] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:57 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:58.265351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1b581cf6-7647-4450-89b8-10f07839d216 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:58.265937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1b581cf6-7647-4450-89b8-10f07839d216 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:58.274217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b581cf6-7647-4450-89b8-10f07839d216 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:58.274694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b581cf6-7647-4450-89b8-10f07839d216 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:58.275150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b581cf6-7647-4450-89b8-10f07839d216 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:58.275837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b581cf6-7647-4450-89b8-10f07839d216 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:58.276284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b581cf6-7647-4450-89b8-10f07839d216 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:58.276705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1b581cf6-7647-4450-89b8-10f07839d216 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:58.412589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1b581cf6-7647-4450-89b8-10f07839d216 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:58.420334 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1b581cf6-7647-4450-89b8-10f07839d216 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.158924 Oct 18 14:39:58.420910 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3684/7566] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:58 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:39:59.444743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-66c6f3f8-cf5f-47ad-998d-e19c525fd54b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:39:59.445331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-66c6f3f8-cf5f-47ad-998d-e19c525fd54b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:39:59.451587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66c6f3f8-cf5f-47ad-998d-e19c525fd54b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:59.452080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66c6f3f8-cf5f-47ad-998d-e19c525fd54b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:59.452552 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66c6f3f8-cf5f-47ad-998d-e19c525fd54b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:59.453258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66c6f3f8-cf5f-47ad-998d-e19c525fd54b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:39:59.453771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66c6f3f8-cf5f-47ad-998d-e19c525fd54b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:39:59.454383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-66c6f3f8-cf5f-47ad-998d-e19c525fd54b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:39:59.595510 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-66c6f3f8-cf5f-47ad-998d-e19c525fd54b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:39:59.603436 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-66c6f3f8-cf5f-47ad-998d-e19c525fd54b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.163029 Oct 18 14:39:59.604017 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3883/7567] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:39:59 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:00.628053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ac4abf9f-a81a-4762-847d-2001abc2e771 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:00.628656 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ac4abf9f-a81a-4762-847d-2001abc2e771 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:00.635588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac4abf9f-a81a-4762-847d-2001abc2e771 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:00.636068 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac4abf9f-a81a-4762-847d-2001abc2e771 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:00.636502 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac4abf9f-a81a-4762-847d-2001abc2e771 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:00.637208 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac4abf9f-a81a-4762-847d-2001abc2e771 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:00.637660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac4abf9f-a81a-4762-847d-2001abc2e771 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:00.638083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac4abf9f-a81a-4762-847d-2001abc2e771 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:00.774330 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ac4abf9f-a81a-4762-847d-2001abc2e771 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:00.782338 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ac4abf9f-a81a-4762-847d-2001abc2e771 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.158048 Oct 18 14:40:00.782923 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3685/7568] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:00 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:01.806354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fd6bdb95-83a9-4f2a-8899-7426f110f54c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:01.806974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fd6bdb95-83a9-4f2a-8899-7426f110f54c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:01.814526 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd6bdb95-83a9-4f2a-8899-7426f110f54c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:01.815012 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd6bdb95-83a9-4f2a-8899-7426f110f54c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:01.815455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd6bdb95-83a9-4f2a-8899-7426f110f54c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:01.816145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd6bdb95-83a9-4f2a-8899-7426f110f54c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:01.816607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd6bdb95-83a9-4f2a-8899-7426f110f54c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:01.817038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fd6bdb95-83a9-4f2a-8899-7426f110f54c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:01.953447 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fd6bdb95-83a9-4f2a-8899-7426f110f54c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:01.961943 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fd6bdb95-83a9-4f2a-8899-7426f110f54c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.159466 Oct 18 14:40:01.962520 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3884/7569] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:01 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:02.986037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-67196c69-9ff3-4738-ba7f-99539fde7de6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:02.986571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-67196c69-9ff3-4738-ba7f-99539fde7de6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:02.993708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67196c69-9ff3-4738-ba7f-99539fde7de6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:02.994187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67196c69-9ff3-4738-ba7f-99539fde7de6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:02.994620 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67196c69-9ff3-4738-ba7f-99539fde7de6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:02.995312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67196c69-9ff3-4738-ba7f-99539fde7de6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:02.995760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67196c69-9ff3-4738-ba7f-99539fde7de6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:02.996192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-67196c69-9ff3-4738-ba7f-99539fde7de6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:03.137027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-67196c69-9ff3-4738-ba7f-99539fde7de6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:03.145924 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-67196c69-9ff3-4738-ba7f-99539fde7de6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.164286 Oct 18 14:40:03.146518 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3686/7570] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:02 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:04.169427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c6806819-e49c-4573-8595-4eec3bc56ab7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:04.170166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c6806819-e49c-4573-8595-4eec3bc56ab7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:04.177807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6806819-e49c-4573-8595-4eec3bc56ab7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:04.178303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6806819-e49c-4573-8595-4eec3bc56ab7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:04.178747 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6806819-e49c-4573-8595-4eec3bc56ab7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:04.179453 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6806819-e49c-4573-8595-4eec3bc56ab7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:04.179917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6806819-e49c-4573-8595-4eec3bc56ab7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:04.180353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c6806819-e49c-4573-8595-4eec3bc56ab7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:04.325652 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c6806819-e49c-4573-8595-4eec3bc56ab7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:04.333848 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c6806819-e49c-4573-8595-4eec3bc56ab7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.168262 Oct 18 14:40:04.334445 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3885/7571] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:04 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:05.358919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fc2b7dae-f25e-4027-8f6e-ff86a9214af4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:05.359478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fc2b7dae-f25e-4027-8f6e-ff86a9214af4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:05.366437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc2b7dae-f25e-4027-8f6e-ff86a9214af4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:05.366925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc2b7dae-f25e-4027-8f6e-ff86a9214af4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:05.367357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc2b7dae-f25e-4027-8f6e-ff86a9214af4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:05.368051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc2b7dae-f25e-4027-8f6e-ff86a9214af4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:05.368506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc2b7dae-f25e-4027-8f6e-ff86a9214af4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:05.368929 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fc2b7dae-f25e-4027-8f6e-ff86a9214af4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:05.506494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fc2b7dae-f25e-4027-8f6e-ff86a9214af4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:05.514389 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fc2b7dae-f25e-4027-8f6e-ff86a9214af4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.159705 Oct 18 14:40:05.514968 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3687/7572] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:05 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:06.550160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f848a7a-8a5a-439a-b993-ebab91323b52 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:06.550832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9f848a7a-8a5a-439a-b993-ebab91323b52 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:06.557848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f848a7a-8a5a-439a-b993-ebab91323b52 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:06.558350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f848a7a-8a5a-439a-b993-ebab91323b52 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:06.558802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f848a7a-8a5a-439a-b993-ebab91323b52 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:06.559512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f848a7a-8a5a-439a-b993-ebab91323b52 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:06.560004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f848a7a-8a5a-439a-b993-ebab91323b52 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:06.560442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f848a7a-8a5a-439a-b993-ebab91323b52 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:06.697633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9f848a7a-8a5a-439a-b993-ebab91323b52 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:06.710019 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9f848a7a-8a5a-439a-b993-ebab91323b52 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.164516 Oct 18 14:40:06.710885 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3886/7573] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:06 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:07.736765 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-27ef6dec-3fff-4125-a065-b858464279f1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:07.737562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-27ef6dec-3fff-4125-a065-b858464279f1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:07.744423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27ef6dec-3fff-4125-a065-b858464279f1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:07.744915 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27ef6dec-3fff-4125-a065-b858464279f1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:07.745389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27ef6dec-3fff-4125-a065-b858464279f1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:07.746096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27ef6dec-3fff-4125-a065-b858464279f1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:07.746549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27ef6dec-3fff-4125-a065-b858464279f1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:07.746980 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27ef6dec-3fff-4125-a065-b858464279f1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:07.891941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-27ef6dec-3fff-4125-a065-b858464279f1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:07.900423 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-27ef6dec-3fff-4125-a065-b858464279f1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.168262 Oct 18 14:40:07.901012 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3688/7574] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:07 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:08.933658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4708b408-1dce-4836-b552-385e33ab1e98 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:08.934288 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4708b408-1dce-4836-b552-385e33ab1e98 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:08.941637 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4708b408-1dce-4836-b552-385e33ab1e98 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:08.942138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4708b408-1dce-4836-b552-385e33ab1e98 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:08.942590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4708b408-1dce-4836-b552-385e33ab1e98 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:08.943304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4708b408-1dce-4836-b552-385e33ab1e98 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:08.943775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4708b408-1dce-4836-b552-385e33ab1e98 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:08.944222 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4708b408-1dce-4836-b552-385e33ab1e98 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:09.083071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4708b408-1dce-4836-b552-385e33ab1e98 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:09.091246 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4708b408-1dce-4836-b552-385e33ab1e98 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.161656 Oct 18 14:40:09.092143 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3887/7575] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:08 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:10.117892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-695b77cb-7274-48ea-9e14-3a429994f24f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:10.118494 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-695b77cb-7274-48ea-9e14-3a429994f24f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:10.126171 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-695b77cb-7274-48ea-9e14-3a429994f24f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:10.126628 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-695b77cb-7274-48ea-9e14-3a429994f24f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:10.127086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-695b77cb-7274-48ea-9e14-3a429994f24f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:10.127896 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-695b77cb-7274-48ea-9e14-3a429994f24f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:10.128412 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-695b77cb-7274-48ea-9e14-3a429994f24f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:10.129233 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-695b77cb-7274-48ea-9e14-3a429994f24f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:10.280528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-695b77cb-7274-48ea-9e14-3a429994f24f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:10.288870 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-695b77cb-7274-48ea-9e14-3a429994f24f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1694 microversion: 2.1 time: 0.175030 Oct 18 14:40:10.289478 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3689/7576] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:10 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:10.837990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-6bac0a62-520a-4b87-8bfc-ec69d8c938ab req-6399a261-14dc-4b62-a95b-f6c8d9351c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ab00f8-7b5e-4c62-9af1-702504d3a92b", "name": "network-vif-unplugged", "status": "completed", "tag": "749eff52-ec72-4ebd-bf1b-e86574b6932d"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:40:10.849859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6bac0a62-520a-4b87-8bfc-ec69d8c938ab req-6399a261-14dc-4b62-a95b-f6c8d9351c47 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:10.850363 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6bac0a62-520a-4b87-8bfc-ec69d8c938ab req-6399a261-14dc-4b62-a95b-f6c8d9351c47 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:10.850846 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-6bac0a62-520a-4b87-8bfc-ec69d8c938ab req-6399a261-14dc-4b62-a95b-f6c8d9351c47 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:10.863887 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-6bac0a62-520a-4b87-8bfc-ec69d8c938ab req-6399a261-14dc-4b62-a95b-f6c8d9351c47 service nova] Creating event network-vif-unplugged:749eff52-ec72-4ebd-bf1b-e86574b6932d for instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b on n-h1-858384-13 Oct 18 14:40:10.869703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [req-6bac0a62-520a-4b87-8bfc-ec69d8c938ab req-6399a261-14dc-4b62-a95b-f6c8d9351c47 service nova] Instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120611) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:40:10.882277 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-6bac0a62-520a-4b87-8bfc-ec69d8c938ab req-6399a261-14dc-4b62-a95b-f6c8d9351c47 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047993 Oct 18 14:40:10.883294 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3888/7577] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:40:11.314770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7c69a559-c0f7-45ce-886b-3de6a728d947 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:11.315454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7c69a559-c0f7-45ce-886b-3de6a728d947 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:11.323818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c69a559-c0f7-45ce-886b-3de6a728d947 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:11.324361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c69a559-c0f7-45ce-886b-3de6a728d947 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:11.324802 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c69a559-c0f7-45ce-886b-3de6a728d947 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:11.325524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c69a559-c0f7-45ce-886b-3de6a728d947 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:11.326001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c69a559-c0f7-45ce-886b-3de6a728d947 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:11.326393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7c69a559-c0f7-45ce-886b-3de6a728d947 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:11.587664 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7c69a559-c0f7-45ce-886b-3de6a728d947 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:11.596831 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7c69a559-c0f7-45ce-886b-3de6a728d947 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1693 microversion: 2.1 time: 0.286814 Oct 18 14:40:11.597562 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3690/7578] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:11 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1693 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:12.627112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e481b4e7-cd84-4c50-8194-ff4d5f60fd35 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:12.627820 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e481b4e7-cd84-4c50-8194-ff4d5f60fd35 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:12.634018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e481b4e7-cd84-4c50-8194-ff4d5f60fd35 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:12.634505 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e481b4e7-cd84-4c50-8194-ff4d5f60fd35 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:12.634947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e481b4e7-cd84-4c50-8194-ff4d5f60fd35 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:12.635640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e481b4e7-cd84-4c50-8194-ff4d5f60fd35 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:12.636102 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e481b4e7-cd84-4c50-8194-ff4d5f60fd35 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:12.636530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e481b4e7-cd84-4c50-8194-ff4d5f60fd35 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:12.777584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e481b4e7-cd84-4c50-8194-ff4d5f60fd35 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:12.786167 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e481b4e7-cd84-4c50-8194-ff4d5f60fd35 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1691 microversion: 2.1 time: 0.164648 Oct 18 14:40:12.786754 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3889/7579] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:12 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:12.918924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-2866dfb1-e9d2-45b2-8ca0-139ef7cd0b86 req-bc70ce86-81f3-4cd4-9391-9d5725bfcb71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ab00f8-7b5e-4c62-9af1-702504d3a92b", "tag": "749eff52-ec72-4ebd-bf1b-e86574b6932d"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:40:12.929369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2866dfb1-e9d2-45b2-8ca0-139ef7cd0b86 req-bc70ce86-81f3-4cd4-9391-9d5725bfcb71 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:12.929839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2866dfb1-e9d2-45b2-8ca0-139ef7cd0b86 req-bc70ce86-81f3-4cd4-9391-9d5725bfcb71 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:12.930262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2866dfb1-e9d2-45b2-8ca0-139ef7cd0b86 req-bc70ce86-81f3-4cd4-9391-9d5725bfcb71 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:12.941743 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-2866dfb1-e9d2-45b2-8ca0-139ef7cd0b86 req-bc70ce86-81f3-4cd4-9391-9d5725bfcb71 service nova] Creating event network-changed:749eff52-ec72-4ebd-bf1b-e86574b6932d for instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b on n-h1-858384-13 Oct 18 14:40:12.947031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [req-2866dfb1-e9d2-45b2-8ca0-139ef7cd0b86 req-bc70ce86-81f3-4cd4-9391-9d5725bfcb71 service nova] Instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858384-13', 'n-h1-858384-13'} {{(pid=120612) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 18 14:40:12.958607 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-2866dfb1-e9d2-45b2-8ca0-139ef7cd0b86 req-bc70ce86-81f3-4cd4-9391-9d5725bfcb71 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043419 Oct 18 14:40:12.959191 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3691/7580] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:40:13.810194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e85f2224-a625-42a4-b6f6-47b285deeaf6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:13.810758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e85f2224-a625-42a4-b6f6-47b285deeaf6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:13.818359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85f2224-a625-42a4-b6f6-47b285deeaf6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:13.818863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85f2224-a625-42a4-b6f6-47b285deeaf6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:13.819313 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85f2224-a625-42a4-b6f6-47b285deeaf6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:13.820026 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85f2224-a625-42a4-b6f6-47b285deeaf6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:13.820492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85f2224-a625-42a4-b6f6-47b285deeaf6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:13.820997 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e85f2224-a625-42a4-b6f6-47b285deeaf6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:13.958158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e85f2224-a625-42a4-b6f6-47b285deeaf6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:13.971491 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e85f2224-a625-42a4-b6f6-47b285deeaf6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1691 microversion: 2.1 time: 0.165283 Oct 18 14:40:13.972095 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3890/7581] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:13 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:14.997569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b236e0c6-5e99-40fd-88ed-485d05d1c7fd tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:14.998189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b236e0c6-5e99-40fd-88ed-485d05d1c7fd tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:15.005434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b236e0c6-5e99-40fd-88ed-485d05d1c7fd tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:15.005924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b236e0c6-5e99-40fd-88ed-485d05d1c7fd tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:15.006368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b236e0c6-5e99-40fd-88ed-485d05d1c7fd tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:15.007070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b236e0c6-5e99-40fd-88ed-485d05d1c7fd tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:15.007527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b236e0c6-5e99-40fd-88ed-485d05d1c7fd tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:15.007953 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b236e0c6-5e99-40fd-88ed-485d05d1c7fd tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:15.239801 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b236e0c6-5e99-40fd-88ed-485d05d1c7fd tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:15.248148 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b236e0c6-5e99-40fd-88ed-485d05d1c7fd tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1691 microversion: 2.1 time: 0.255810 Oct 18 14:40:15.248926 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3692/7582] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:14 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1691 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:16.273310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f158e8ae-4d8e-404b-ac86-be3969153406 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:16.273976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f158e8ae-4d8e-404b-ac86-be3969153406 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:16.281334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f158e8ae-4d8e-404b-ac86-be3969153406 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:16.282005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f158e8ae-4d8e-404b-ac86-be3969153406 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:16.282612 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f158e8ae-4d8e-404b-ac86-be3969153406 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:16.283329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f158e8ae-4d8e-404b-ac86-be3969153406 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:16.283816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f158e8ae-4d8e-404b-ac86-be3969153406 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:16.284260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f158e8ae-4d8e-404b-ac86-be3969153406 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:16.431277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f158e8ae-4d8e-404b-ac86-be3969153406 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:16.441162 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f158e8ae-4d8e-404b-ac86-be3969153406 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1688 microversion: 2.1 time: 0.171734 Oct 18 14:40:16.441790 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3891/7583] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:16 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:40:16.469204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0faf9a26-6806-4ebf-992d-1552a9f563c5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:40:16.469757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0faf9a26-6806-4ebf-992d-1552a9f563c5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:16.476653 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0faf9a26-6806-4ebf-992d-1552a9f563c5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:16.477130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0faf9a26-6806-4ebf-992d-1552a9f563c5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:16.477597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0faf9a26-6806-4ebf-992d-1552a9f563c5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:16.478279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0faf9a26-6806-4ebf-992d-1552a9f563c5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:16.478725 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0faf9a26-6806-4ebf-992d-1552a9f563c5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:16.479142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0faf9a26-6806-4ebf-992d-1552a9f563c5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:16.548076 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0faf9a26-6806-4ebf-992d-1552a9f563c5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b/action" status: 204 len: 0 microversion: 2.1 time: 0.082669 Oct 18 14:40:16.548723 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3693/7584] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:40:16 2022] POST /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 18 14:40:16.557027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-45294985-3d91-4811-9a8f-2d26479da90d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:16.558208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-45294985-3d91-4811-9a8f-2d26479da90d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:16.565539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45294985-3d91-4811-9a8f-2d26479da90d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:16.566147 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45294985-3d91-4811-9a8f-2d26479da90d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:16.566631 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45294985-3d91-4811-9a8f-2d26479da90d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:16.567548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45294985-3d91-4811-9a8f-2d26479da90d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:16.568151 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45294985-3d91-4811-9a8f-2d26479da90d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:16.568748 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-45294985-3d91-4811-9a8f-2d26479da90d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:16.711789 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-45294985-3d91-4811-9a8f-2d26479da90d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:16.720030 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-45294985-3d91-4811-9a8f-2d26479da90d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1688 microversion: 2.1 time: 0.166906 Oct 18 14:40:16.720617 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3892/7585] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:16 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:16.743811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5b0c6814-fc18-49c5-bdc9-aa387a744360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:16.744512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5b0c6814-fc18-49c5-bdc9-aa387a744360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:16.752057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0c6814-fc18-49c5-bdc9-aa387a744360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:16.752544 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0c6814-fc18-49c5-bdc9-aa387a744360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:16.753010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0c6814-fc18-49c5-bdc9-aa387a744360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:16.753757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0c6814-fc18-49c5-bdc9-aa387a744360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:16.754238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0c6814-fc18-49c5-bdc9-aa387a744360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:16.755349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5b0c6814-fc18-49c5-bdc9-aa387a744360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:17.306014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5b0c6814-fc18-49c5-bdc9-aa387a744360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:17.314419 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5b0c6814-fc18-49c5-bdc9-aa387a744360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1688 microversion: 2.1 time: 0.574767 Oct 18 14:40:17.315027 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3694/7586] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:16 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1688 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:18.339423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d1b8dc2c-708b-4d83-83a3-47a0a57e3865 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:40:18.340284 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d1b8dc2c-708b-4d83-83a3-47a0a57e3865 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:18.348445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1b8dc2c-708b-4d83-83a3-47a0a57e3865 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:18.348866 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1b8dc2c-708b-4d83-83a3-47a0a57e3865 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:18.349429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1b8dc2c-708b-4d83-83a3-47a0a57e3865 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:18.350150 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1b8dc2c-708b-4d83-83a3-47a0a57e3865 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:18.350616 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1b8dc2c-708b-4d83-83a3-47a0a57e3865 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:18.351047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d1b8dc2c-708b-4d83-83a3-47a0a57e3865 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:18.369886 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-43c0e90b-a28e-4a7f-b062-09ea0e674274 req-fc892193-4bff-43ef-8385-24243c4adf99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ab00f8-7b5e-4c62-9af1-702504d3a92b", "name": "network-vif-plugged", "status": "completed", "tag": "749eff52-ec72-4ebd-bf1b-e86574b6932d"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:40:18.381907 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-43c0e90b-a28e-4a7f-b062-09ea0e674274 req-fc892193-4bff-43ef-8385-24243c4adf99 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:18.382454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-43c0e90b-a28e-4a7f-b062-09ea0e674274 req-fc892193-4bff-43ef-8385-24243c4adf99 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:18.382951 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-43c0e90b-a28e-4a7f-b062-09ea0e674274 req-fc892193-4bff-43ef-8385-24243c4adf99 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:18.404893 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-43c0e90b-a28e-4a7f-b062-09ea0e674274 req-fc892193-4bff-43ef-8385-24243c4adf99 service nova] Creating event network-vif-plugged:749eff52-ec72-4ebd-bf1b-e86574b6932d for instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b on n-h1-858384-13 Oct 18 14:40:18.411825 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-43c0e90b-a28e-4a7f-b062-09ea0e674274 req-fc892193-4bff-43ef-8385-24243c4adf99 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046529 Oct 18 14:40:18.412608 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3695/7587] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:40:18.505539 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d1b8dc2c-708b-4d83-83a3-47a0a57e3865 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:40:18.513453 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d1b8dc2c-708b-4d83-83a3-47a0a57e3865 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1680 microversion: 2.1 time: 0.177976 Oct 18 14:40:18.514041 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3893/7588] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:40:18 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:40:48.729562 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=30 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:40:48.730299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:40:48.786427 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-62d1300b-f690-4686-9d02-4033cb10674b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:40:48.788843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-62d1300b-f690-4686-9d02-4033cb10674b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:40:48.795134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62d1300b-f690-4686-9d02-4033cb10674b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:48.795556 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62d1300b-f690-4686-9d02-4033cb10674b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:48.795983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62d1300b-f690-4686-9d02-4033cb10674b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:48.796662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62d1300b-f690-4686-9d02-4033cb10674b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:40:48.797112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62d1300b-f690-4686-9d02-4033cb10674b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:40:48.797560 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-62d1300b-f690-4686-9d02-4033cb10674b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:40:48.865324 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-62d1300b-f690-4686-9d02-4033cb10674b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b/action" status: 200 len: 24576 microversion: 2.1 time: 0.137600 Oct 18 14:40:48.865954 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3696/7589] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:40:48 2022] POST /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b/action => generated 24576 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 18 14:41:12.771681 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1a31edf1-40d6-4920-bf7e-89bf69991aeb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:12.772440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1a31edf1-40d6-4920-bf7e-89bf69991aeb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:12.774247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b5684dbb-0ceb-4dd9-a597-2ffbe68de8bc req-c9996a3e-146b-45fa-974d-3cf1978c9fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ab00f8-7b5e-4c62-9af1-702504d3a92b", "tag": "749eff52-ec72-4ebd-bf1b-e86574b6932d"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:12.775063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=34 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:12.775818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:12.777162 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 18 14:41:12.783223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:12.784083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:12.785860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a31edf1-40d6-4920-bf7e-89bf69991aeb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:12.786365 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a31edf1-40d6-4920-bf7e-89bf69991aeb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:12.786816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a31edf1-40d6-4920-bf7e-89bf69991aeb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:12.787776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a31edf1-40d6-4920-bf7e-89bf69991aeb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:12.788290 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a31edf1-40d6-4920-bf7e-89bf69991aeb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:12.788787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1a31edf1-40d6-4920-bf7e-89bf69991aeb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:12.796398 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b5684dbb-0ceb-4dd9-a597-2ffbe68de8bc req-c9996a3e-146b-45fa-974d-3cf1978c9fee service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:12.797004 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b5684dbb-0ceb-4dd9-a597-2ffbe68de8bc req-c9996a3e-146b-45fa-974d-3cf1978c9fee service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:12.797709 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b5684dbb-0ceb-4dd9-a597-2ffbe68de8bc req-c9996a3e-146b-45fa-974d-3cf1978c9fee service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:12.809479 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b5684dbb-0ceb-4dd9-a597-2ffbe68de8bc req-c9996a3e-146b-45fa-974d-3cf1978c9fee service nova] Creating event network-changed:749eff52-ec72-4ebd-bf1b-e86574b6932d for instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b on n-h1-858384-13 Oct 18 14:41:12.815277 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b5684dbb-0ceb-4dd9-a597-2ffbe68de8bc req-c9996a3e-146b-45fa-974d-3cf1978c9fee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045660 Oct 18 14:41:12.816395 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3697/7590] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:41:12.817037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1a31edf1-40d6-4920-bf7e-89bf69991aeb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:41:12.901537 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1a31edf1-40d6-4920-bf7e-89bf69991aeb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "DELETE /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 204 len: 0 microversion: 2.1 time: 0.133887 Oct 18 14:41:12.902087 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3894/7591] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:41:12 2022] DELETE /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:41:12.915078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e19b299b-4335-44d9-924a-2f72c36935a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:12.915871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e19b299b-4335-44d9-924a-2f72c36935a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:12.924081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e19b299b-4335-44d9-924a-2f72c36935a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:12.924658 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e19b299b-4335-44d9-924a-2f72c36935a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:12.925164 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e19b299b-4335-44d9-924a-2f72c36935a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:12.926265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e19b299b-4335-44d9-924a-2f72c36935a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:12.926436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e19b299b-4335-44d9-924a-2f72c36935a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:12.926960 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e19b299b-4335-44d9-924a-2f72c36935a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:13.073837 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e19b299b-4335-44d9-924a-2f72c36935a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:13.083021 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e19b299b-4335-44d9-924a-2f72c36935a6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1686 microversion: 2.1 time: 0.174395 Oct 18 14:41:13.083895 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3698/7592] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:12 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:14.119985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-094f3fe8-7b5d-44d4-846d-2fd204d089a4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:14.120841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-094f3fe8-7b5d-44d4-846d-2fd204d089a4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:14.129774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-094f3fe8-7b5d-44d4-846d-2fd204d089a4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:14.130277 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-094f3fe8-7b5d-44d4-846d-2fd204d089a4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:14.130732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-094f3fe8-7b5d-44d4-846d-2fd204d089a4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:14.131451 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-094f3fe8-7b5d-44d4-846d-2fd204d089a4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:14.131917 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-094f3fe8-7b5d-44d4-846d-2fd204d089a4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:14.132353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-094f3fe8-7b5d-44d4-846d-2fd204d089a4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:14.299402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-094f3fe8-7b5d-44d4-846d-2fd204d089a4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:14.310010 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-094f3fe8-7b5d-44d4-846d-2fd204d089a4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1686 microversion: 2.1 time: 0.196772 Oct 18 14:41:14.310621 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3895/7593] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:14 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1686 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:15.023868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e0b701af-e458-4edf-a9e9-0651b5e9d06e req-bbb8f9ec-b750-4694-ae36-0461fd14d5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ab00f8-7b5e-4c62-9af1-702504d3a92b", "name": "network-vif-deleted", "tag": "749eff52-ec72-4ebd-bf1b-e86574b6932d"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:15.038145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e0b701af-e458-4edf-a9e9-0651b5e9d06e req-bbb8f9ec-b750-4694-ae36-0461fd14d5b6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:15.039067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e0b701af-e458-4edf-a9e9-0651b5e9d06e req-bbb8f9ec-b750-4694-ae36-0461fd14d5b6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:15.039571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e0b701af-e458-4edf-a9e9-0651b5e9d06e req-bbb8f9ec-b750-4694-ae36-0461fd14d5b6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:15.053460 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e0b701af-e458-4edf-a9e9-0651b5e9d06e req-bbb8f9ec-b750-4694-ae36-0461fd14d5b6 service nova] Creating event network-vif-deleted:749eff52-ec72-4ebd-bf1b-e86574b6932d for instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b on n-h1-858384-13 Oct 18 14:41:15.058550 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e0b701af-e458-4edf-a9e9-0651b5e9d06e req-bbb8f9ec-b750-4694-ae36-0461fd14d5b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038338 Oct 18 14:41:15.059165 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3699/7594] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:15.337540 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:15.338207 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:15.346125 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:15.346638 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:15.347097 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:15.347824 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:15.348300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:15.348741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:15.382321 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:15.382832 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:15.383289 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:15.383770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lazy-loading 'fault' on Instance uuid 96ab00f8-7b5e-4c62-9af1-702504d3a92b {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:41:15.426728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:15.435952 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-72359207-f7c4-4ac7-af5a-0efaefd3d0eb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 200 len: 1356 microversion: 2.1 time: 0.102262 Oct 18 14:41:15.436444 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3896/7595] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:15 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:16.460857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c2418c0e-533f-45c5-b2ca-c0471a8bdce7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:16.461604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c2418c0e-533f-45c5-b2ca-c0471a8bdce7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 96ab00f8-7b5e-4c62-9af1-702504d3a92b] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:16.467780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2418c0e-533f-45c5-b2ca-c0471a8bdce7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:16.468253 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2418c0e-533f-45c5-b2ca-c0471a8bdce7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:16.469460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2418c0e-533f-45c5-b2ca-c0471a8bdce7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:16.470140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2418c0e-533f-45c5-b2ca-c0471a8bdce7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:16.470583 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2418c0e-533f-45c5-b2ca-c0471a8bdce7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:16.471001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c2418c0e-533f-45c5-b2ca-c0471a8bdce7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:16.487002 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-c2418c0e-533f-45c5-b2ca-c0471a8bdce7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] HTTP exception thrown: Instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b could not be found. Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c2418c0e-533f-45c5-b2ca-c0471a8bdce7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Request method failure captured: Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b HTTP/1.1 Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrmoJdJwsrKMFUaanrLJLt6LyEOQIjZ0f05fEpGBag1K6ul8d4SOC38ZEmojqeN-5Mr9W9Uihbdj5HrM7P4JhTSrrxqG0t2lF0wFzmrTNNFiotgT_nFwllBcbU5Dhub5ILl6o50Cn3W6DaWc6o8DCIPPy5pkj53OvF8nQyugmrrzfyI Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d2c5ebcb706b4f26903d0c30945bbcf0 Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d2c5ebcb706b4f26903d0c30945bbcf0"}]}] Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d2c5ebcb706b4f26903d0c30945bbcf0 Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestNetworkAdvancedServerOps-527964250-project Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a59ca729767748089c293f1066cda564 Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestNetworkAdvancedServerOps-527964250-project Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b could not be found. Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '96ab00f8-7b5e-4c62-9af1-702504d3a92b'} Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b could not be found. Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b could not be found. Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:41:16.488606 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:41:16.493640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:41:16.493640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:41:16.493640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:41:16.493640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:41:16.493640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:41:16.493640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:41:16.493640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b could not be found. Oct 18 14:41:16.493640 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:41:16.493640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c2418c0e-533f-45c5-b2ca-c0471a8bdce7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Returning 404 to user: Instance 96ab00f8-7b5e-4c62-9af1-702504d3a92b could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:41:16.493640 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c2418c0e-533f-45c5-b2ca-c0471a8bdce7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b" status: 404 len: 111 microversion: 2.1 time: 0.034522 Oct 18 14:41:16.493640 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3700/7596] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:16 2022] GET /compute/v2.1/servers/96ab00f8-7b5e-4c62-9af1-702504d3a92b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:41:19.881334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4c10affd-be19-47b2-89f5-da220587aace tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '.version_select at 0x7ff60ebde9d0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:19.910835 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4c10affd-be19-47b2-89f5-da220587aace tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1716988980" status: 202 len: 0 microversion: 2.1 time: 0.033300 Oct 18 14:41:19.912419 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3897/7597] 10.222.0.40 () {58 vars in 1284 bytes} [Tue Oct 18 14:41:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1716988980 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:41:19.938125 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-37da180a-66fd-4e1c-9ecc-e94c13a3ab3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'create', calling method: .version_select at 0x7ff60feebc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-513850419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuUIMqZ0/xd9qn82UTixXSwCRRUbrRzk20jeCqv2XpLIo1Aq/Bs+unhRvtdSQR5mh88BJOoQb4XLGFKNQ3ZwO4ZUxv/BcPAIvToMacojJ/IeceL+ocX0rZOVfN8YY/7qw=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:19.944366 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:41:19.944527 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:41:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.40) !!! Oct 18 14:41:19.946439 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:41:19.946439 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:41:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.40) !!! Oct 18 14:41:19.967155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-37da180a-66fd-4e1c-9ecc-e94c13a3ab3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:41:19.973362 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-37da180a-66fd-4e1c-9ecc-e94c13a3ab3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for user a59ca729767748089c293f1066cda564 and project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:41:19.999822 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-37da180a-66fd-4e1c-9ecc-e94c13a3ab3f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.065477 Oct 18 14:41:20.000830 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3701/7598] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:41:19 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:25.636501 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:25.640897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-74391226", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "21121c32-ffa3-48c8-a56d-03ae572b4c9c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-513850419", "security_groups": [{"name": "tempest-secgroup-smoke-703047266"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:25.792611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] validate_networks() for [('21121c32-ffa3-48c8-a56d-03ae572b4c9c', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:41:26.201029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:41:26.201512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:41:26.202003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:41:26.202424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:41:26.203379 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:41:26.213131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:26.213669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:26.214123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:26.214860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:26.215511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:26.215950 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:26.239021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:41:26.244607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for user a59ca729767748089c293f1066cda564 and project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:41:26.258327 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:41:26.260668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:41:26.308792 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c5c8a897-3610-4c94-bdb3-b5efab50b9fb tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.673962 Oct 18 14:41:26.309491 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3898/7599] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:41:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:41:26.321679 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-989f9e44-e0a9-4bcf-8ed3-1af733a2ce2d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:26.322986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-989f9e44-e0a9-4bcf-8ed3-1af733a2ce2d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:26.401749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-989f9e44-e0a9-4bcf-8ed3-1af733a2ce2d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:26.409603 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-989f9e44-e0a9-4bcf-8ed3-1af733a2ce2d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1264 microversion: 2.1 time: 0.092171 Oct 18 14:41:26.410572 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3702/7600] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:26 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1264 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:27.434119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4f58d284-5004-4ac4-adf4-54e02d3fde25 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:27.435412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4f58d284-5004-4ac4-adf4-54e02d3fde25 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:27.442615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f58d284-5004-4ac4-adf4-54e02d3fde25 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:27.443120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f58d284-5004-4ac4-adf4-54e02d3fde25 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:27.443571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f58d284-5004-4ac4-adf4-54e02d3fde25 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:27.444293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f58d284-5004-4ac4-adf4-54e02d3fde25 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:27.444786 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f58d284-5004-4ac4-adf4-54e02d3fde25 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:27.445506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4f58d284-5004-4ac4-adf4-54e02d3fde25 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:27.525204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4f58d284-5004-4ac4-adf4-54e02d3fde25 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:27.536378 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4f58d284-5004-4ac4-adf4-54e02d3fde25 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1316 microversion: 2.1 time: 0.106746 Oct 18 14:41:27.538657 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3899/7601] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:27 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1316 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:28.564407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-1e5cbe28-b831-484a-96c6-4e5a79882838 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:28.565015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-1e5cbe28-b831-484a-96c6-4e5a79882838 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:28.571273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=12 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:28.574751 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e5cbe28-b831-484a-96c6-4e5a79882838 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:28.575696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e5cbe28-b831-484a-96c6-4e5a79882838 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:28.576131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e5cbe28-b831-484a-96c6-4e5a79882838 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:28.576839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e5cbe28-b831-484a-96c6-4e5a79882838 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:28.578006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e5cbe28-b831-484a-96c6-4e5a79882838 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:28.578444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-1e5cbe28-b831-484a-96c6-4e5a79882838 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:28.797251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-1e5cbe28-b831-484a-96c6-4e5a79882838 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:28.808675 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-1e5cbe28-b831-484a-96c6-4e5a79882838 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1389 microversion: 2.1 time: 0.248266 Oct 18 14:41:28.811981 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3703/7602] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:28 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1389 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:41:29.415160 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-e3ceb17c-0dbe-4721-a604-373df843e34a req-0d026392-55eb-4aac-9c62-e195826997ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664a2c25-b295-43b3-b4d2-da638c973415", "tag": "69f7ade4-bfa2-4f67-9363-3203a1b8ddbc"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:29.426920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e3ceb17c-0dbe-4721-a604-373df843e34a req-0d026392-55eb-4aac-9c62-e195826997ed service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:29.427865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e3ceb17c-0dbe-4721-a604-373df843e34a req-0d026392-55eb-4aac-9c62-e195826997ed service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:29.428230 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e3ceb17c-0dbe-4721-a604-373df843e34a req-0d026392-55eb-4aac-9c62-e195826997ed service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:29.440836 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-e3ceb17c-0dbe-4721-a604-373df843e34a req-0d026392-55eb-4aac-9c62-e195826997ed service nova] Creating event network-changed:69f7ade4-bfa2-4f67-9363-3203a1b8ddbc for instance 664a2c25-b295-43b3-b4d2-da638c973415 on n-h1-858384-13 Oct 18 14:41:29.446096 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-e3ceb17c-0dbe-4721-a604-373df843e34a req-0d026392-55eb-4aac-9c62-e195826997ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034906 Oct 18 14:41:29.446701 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3900/7603] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:29.836122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5aa0935e-ce45-437f-aa97-61aef7acbc2c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:29.836835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5aa0935e-ce45-437f-aa97-61aef7acbc2c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:29.844344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5aa0935e-ce45-437f-aa97-61aef7acbc2c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:29.844831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5aa0935e-ce45-437f-aa97-61aef7acbc2c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:29.845285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5aa0935e-ce45-437f-aa97-61aef7acbc2c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:29.845974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5aa0935e-ce45-437f-aa97-61aef7acbc2c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:29.846421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5aa0935e-ce45-437f-aa97-61aef7acbc2c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:29.846839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5aa0935e-ce45-437f-aa97-61aef7acbc2c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:29.990696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5aa0935e-ce45-437f-aa97-61aef7acbc2c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:29.999554 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5aa0935e-ce45-437f-aa97-61aef7acbc2c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1389 microversion: 2.1 time: 0.167144 Oct 18 14:41:29.999856 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3704/7604] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:29 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:31.024353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6a9f2a73-3bb3-4a5b-b767-01f45da44f9a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:31.025076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6a9f2a73-3bb3-4a5b-b767-01f45da44f9a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:31.032962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a9f2a73-3bb3-4a5b-b767-01f45da44f9a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:31.033423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a9f2a73-3bb3-4a5b-b767-01f45da44f9a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:31.033873 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a9f2a73-3bb3-4a5b-b767-01f45da44f9a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:31.034604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a9f2a73-3bb3-4a5b-b767-01f45da44f9a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:31.035089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a9f2a73-3bb3-4a5b-b767-01f45da44f9a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:31.035528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6a9f2a73-3bb3-4a5b-b767-01f45da44f9a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:31.170594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6a9f2a73-3bb3-4a5b-b767-01f45da44f9a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:31.179441 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6a9f2a73-3bb3-4a5b-b767-01f45da44f9a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1389 microversion: 2.1 time: 0.160271 Oct 18 14:41:31.180029 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3901/7605] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:31 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:32.204221 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2f364034-2e75-4bda-a6be-c95b87655708 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:32.204770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2f364034-2e75-4bda-a6be-c95b87655708 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:32.211657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f364034-2e75-4bda-a6be-c95b87655708 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:32.212139 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f364034-2e75-4bda-a6be-c95b87655708 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:32.212579 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f364034-2e75-4bda-a6be-c95b87655708 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:32.213303 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f364034-2e75-4bda-a6be-c95b87655708 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:32.213756 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f364034-2e75-4bda-a6be-c95b87655708 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:32.214181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2f364034-2e75-4bda-a6be-c95b87655708 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:32.352492 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2f364034-2e75-4bda-a6be-c95b87655708 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:32.360599 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2f364034-2e75-4bda-a6be-c95b87655708 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1389 microversion: 2.1 time: 0.161047 Oct 18 14:41:32.371664 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3705/7606] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:32 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1389 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:33.385484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-4923156c-dc14-4e4b-952f-7a7bfde9df2e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:33.386027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-4923156c-dc14-4e4b-952f-7a7bfde9df2e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:33.393445 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4923156c-dc14-4e4b-952f-7a7bfde9df2e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:33.393946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4923156c-dc14-4e4b-952f-7a7bfde9df2e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:33.394398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4923156c-dc14-4e4b-952f-7a7bfde9df2e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:33.395105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4923156c-dc14-4e4b-952f-7a7bfde9df2e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:33.395573 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4923156c-dc14-4e4b-952f-7a7bfde9df2e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:33.396014 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-4923156c-dc14-4e4b-952f-7a7bfde9df2e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:33.536065 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-4923156c-dc14-4e4b-952f-7a7bfde9df2e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:33.544000 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-4923156c-dc14-4e4b-952f-7a7bfde9df2e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1389 microversion: 2.1 time: 0.162585 Oct 18 14:41:33.544579 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3902/7607] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:33 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:34.567224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-760085c2-64d9-4c20-a271-718e7b2ee19c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:34.567799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-760085c2-64d9-4c20-a271-718e7b2ee19c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:34.575407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-760085c2-64d9-4c20-a271-718e7b2ee19c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:34.575885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-760085c2-64d9-4c20-a271-718e7b2ee19c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:34.576317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-760085c2-64d9-4c20-a271-718e7b2ee19c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:34.577007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-760085c2-64d9-4c20-a271-718e7b2ee19c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:34.578209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-760085c2-64d9-4c20-a271-718e7b2ee19c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:34.578823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-760085c2-64d9-4c20-a271-718e7b2ee19c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:34.774164 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9d493446-d68d-4db1-ace0-7205e89c6eba req-c70159f3-4465-4e1f-8973-d0a6b436e755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "664a2c25-b295-43b3-b4d2-da638c973415", "name": "network-vif-plugged", "status": "completed", "tag": "69f7ade4-bfa2-4f67-9363-3203a1b8ddbc"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:34.788071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9d493446-d68d-4db1-ace0-7205e89c6eba req-c70159f3-4465-4e1f-8973-d0a6b436e755 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:34.788691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9d493446-d68d-4db1-ace0-7205e89c6eba req-c70159f3-4465-4e1f-8973-d0a6b436e755 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:34.790239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9d493446-d68d-4db1-ace0-7205e89c6eba req-c70159f3-4465-4e1f-8973-d0a6b436e755 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:34.804602 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9d493446-d68d-4db1-ace0-7205e89c6eba req-c70159f3-4465-4e1f-8973-d0a6b436e755 service nova] Creating event network-vif-plugged:69f7ade4-bfa2-4f67-9363-3203a1b8ddbc for instance 664a2c25-b295-43b3-b4d2-da638c973415 on n-h1-858384-13 Oct 18 14:41:34.810500 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9d493446-d68d-4db1-ace0-7205e89c6eba req-c70159f3-4465-4e1f-8973-d0a6b436e755 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039901 Oct 18 14:41:34.811198 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3903/7608] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:41:34.834349 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-760085c2-64d9-4c20-a271-718e7b2ee19c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:34.845613 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-760085c2-64d9-4c20-a271-718e7b2ee19c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1389 microversion: 2.1 time: 0.282181 Oct 18 14:41:34.846276 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3706/7609] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:34 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1389 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:35.870708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e3da8ce5-d977-4ac6-8476-68c12e16d4d8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:35.871414 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e3da8ce5-d977-4ac6-8476-68c12e16d4d8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:35.878180 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3da8ce5-d977-4ac6-8476-68c12e16d4d8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:35.878669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3da8ce5-d977-4ac6-8476-68c12e16d4d8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:35.879110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3da8ce5-d977-4ac6-8476-68c12e16d4d8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:35.879802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3da8ce5-d977-4ac6-8476-68c12e16d4d8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:35.880263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3da8ce5-d977-4ac6-8476-68c12e16d4d8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:35.880694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e3da8ce5-d977-4ac6-8476-68c12e16d4d8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:36.065644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e3da8ce5-d977-4ac6-8476-68c12e16d4d8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:36.073520 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e3da8ce5-d977-4ac6-8476-68c12e16d4d8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1389 microversion: 2.1 time: 0.207871 Oct 18 14:41:36.074107 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3904/7610] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:35 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1389 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:37.099206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-36cb33b8-746f-467c-b164-1654a6961c03 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:37.099206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-36cb33b8-746f-467c-b164-1654a6961c03 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:37.102000 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:37.107455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36cb33b8-746f-467c-b164-1654a6961c03 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:37.107934 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36cb33b8-746f-467c-b164-1654a6961c03 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:37.108367 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36cb33b8-746f-467c-b164-1654a6961c03 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:37.109048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36cb33b8-746f-467c-b164-1654a6961c03 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:37.109528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36cb33b8-746f-467c-b164-1654a6961c03 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:37.110082 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-36cb33b8-746f-467c-b164-1654a6961c03 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:37.247727 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-36cb33b8-746f-467c-b164-1654a6961c03 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:37.255739 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-36cb33b8-746f-467c-b164-1654a6961c03 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1560 microversion: 2.1 time: 0.161826 Oct 18 14:41:37.256313 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3707/7611] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:37 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:37.278900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-08c1d2c7-2cbb-45a6-a843-a70dc1fdeb23 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:37.279551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-08c1d2c7-2cbb-45a6-a843-a70dc1fdeb23 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:37.281541 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:37.282862 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:41:37.289969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c1d2c7-2cbb-45a6-a843-a70dc1fdeb23 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:37.290407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c1d2c7-2cbb-45a6-a843-a70dc1fdeb23 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:37.290857 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c1d2c7-2cbb-45a6-a843-a70dc1fdeb23 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:37.291571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c1d2c7-2cbb-45a6-a843-a70dc1fdeb23 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:37.292036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c1d2c7-2cbb-45a6-a843-a70dc1fdeb23 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:37.292462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-08c1d2c7-2cbb-45a6-a843-a70dc1fdeb23 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:37.431212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-08c1d2c7-2cbb-45a6-a843-a70dc1fdeb23 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:37.439796 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-08c1d2c7-2cbb-45a6-a843-a70dc1fdeb23 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1560 microversion: 2.1 time: 0.164648 Oct 18 14:41:37.440390 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3905/7612] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:37 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:41:39.063383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8ff179bd-4547-4c4f-950b-8894b6ee7492 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:41:39.071627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8ff179bd-4547-4c4f-950b-8894b6ee7492 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:41:39.080220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ff179bd-4547-4c4f-950b-8894b6ee7492 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:39.080963 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ff179bd-4547-4c4f-950b-8894b6ee7492 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:39.082062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ff179bd-4547-4c4f-950b-8894b6ee7492 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:39.082789 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ff179bd-4547-4c4f-950b-8894b6ee7492 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:39.083534 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ff179bd-4547-4c4f-950b-8894b6ee7492 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:39.084067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ff179bd-4547-4c4f-950b-8894b6ee7492 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:39.138112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-61761ea1-7941-458d-8540-43c1f115c465 req-a610c32d-896b-45d1-b695-b55ae61cd42b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664a2c25-b295-43b3-b4d2-da638c973415", "tag": "69f7ade4-bfa2-4f67-9363-3203a1b8ddbc"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:41:39.149598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-61761ea1-7941-458d-8540-43c1f115c465 req-a610c32d-896b-45d1-b695-b55ae61cd42b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:41:39.150096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-61761ea1-7941-458d-8540-43c1f115c465 req-a610c32d-896b-45d1-b695-b55ae61cd42b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:41:39.150572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-61761ea1-7941-458d-8540-43c1f115c465 req-a610c32d-896b-45d1-b695-b55ae61cd42b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:41:39.163596 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-61761ea1-7941-458d-8540-43c1f115c465 req-a610c32d-896b-45d1-b695-b55ae61cd42b service nova] Creating event network-changed:69f7ade4-bfa2-4f67-9363-3203a1b8ddbc for instance 664a2c25-b295-43b3-b4d2-da638c973415 on n-h1-858384-13 Oct 18 14:41:39.168937 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-61761ea1-7941-458d-8540-43c1f115c465 req-a610c32d-896b-45d1-b695-b55ae61cd42b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103008 Oct 18 14:41:39.169965 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3906/7613] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:41:39.234647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8ff179bd-4547-4c4f-950b-8894b6ee7492 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:41:39.244017 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8ff179bd-4547-4c4f-950b-8894b6ee7492 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1560 microversion: 2.1 time: 0.184577 Oct 18 14:41:39.244780 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3708/7614] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:41:39 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:12.542578 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:12.543367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=38 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:12.547750 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ea0b2128-1b25-4453-a6b0-8867dbec2aee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:42:12.550061 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ea0b2128-1b25-4453-a6b0-8867dbec2aee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:12.558292 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea0b2128-1b25-4453-a6b0-8867dbec2aee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:12.558787 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea0b2128-1b25-4453-a6b0-8867dbec2aee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:12.559239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea0b2128-1b25-4453-a6b0-8867dbec2aee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:12.559946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea0b2128-1b25-4453-a6b0-8867dbec2aee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:12.560419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea0b2128-1b25-4453-a6b0-8867dbec2aee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:12.560859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ea0b2128-1b25-4453-a6b0-8867dbec2aee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:12.632784 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ea0b2128-1b25-4453-a6b0-8867dbec2aee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415/action" status: 200 len: 24575 microversion: 2.1 time: 0.091135 Oct 18 14:42:12.633387 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3907/7615] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:42:12 2022] POST /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415/action => generated 24575 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:42:43.130697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:43.131464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=36 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:43.136112 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-889d0bbf-a0b2-4c62-beee-6c4ebb2408b4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:42:43.143551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-889d0bbf-a0b2-4c62-beee-6c4ebb2408b4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:43.144024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-889d0bbf-a0b2-4c62-beee-6c4ebb2408b4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:43.144453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-889d0bbf-a0b2-4c62-beee-6c4ebb2408b4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:43.168603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-889d0bbf-a0b2-4c62-beee-6c4ebb2408b4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Going to try to stop instance {{(pid=120612) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 18 14:42:43.212158 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-889d0bbf-a0b2-4c62-beee-6c4ebb2408b4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415/action" status: 202 len: 0 microversion: 2.1 time: 0.082090 Oct 18 14:42:43.212783 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3709/7616] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:42:43 2022] POST /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:42:43.221939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b57d2aef-ae6c-4c50-ac1e-4cde571471e0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:43.222768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b57d2aef-ae6c-4c50-ac1e-4cde571471e0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:43.225618 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:43.226460 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:42:43.232966 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b57d2aef-ae6c-4c50-ac1e-4cde571471e0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:43.233491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b57d2aef-ae6c-4c50-ac1e-4cde571471e0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:43.234018 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b57d2aef-ae6c-4c50-ac1e-4cde571471e0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:43.234726 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b57d2aef-ae6c-4c50-ac1e-4cde571471e0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:43.235189 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b57d2aef-ae6c-4c50-ac1e-4cde571471e0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:43.235622 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b57d2aef-ae6c-4c50-ac1e-4cde571471e0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:43.378610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b57d2aef-ae6c-4c50-ac1e-4cde571471e0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:43.387416 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b57d2aef-ae6c-4c50-ac1e-4cde571471e0 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.170161 Oct 18 14:42:43.387991 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3908/7617] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:43 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:42:44.412406 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8ef9ce19-bf65-45ad-94ae-1baa840a7241 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:44.413123 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8ef9ce19-bf65-45ad-94ae-1baa840a7241 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:44.421138 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ef9ce19-bf65-45ad-94ae-1baa840a7241 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:44.421641 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ef9ce19-bf65-45ad-94ae-1baa840a7241 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:44.422069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ef9ce19-bf65-45ad-94ae-1baa840a7241 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:44.422745 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ef9ce19-bf65-45ad-94ae-1baa840a7241 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:44.423188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ef9ce19-bf65-45ad-94ae-1baa840a7241 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:44.423603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8ef9ce19-bf65-45ad-94ae-1baa840a7241 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:44.563778 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8ef9ce19-bf65-45ad-94ae-1baa840a7241 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:44.571699 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8ef9ce19-bf65-45ad-94ae-1baa840a7241 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.163518 Oct 18 14:42:44.572262 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3710/7618] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:44 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:45.597339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0b5388c3-a345-45bc-b82e-e8dffa65a927 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:45.597965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0b5388c3-a345-45bc-b82e-e8dffa65a927 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:45.605694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b5388c3-a345-45bc-b82e-e8dffa65a927 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:45.606197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b5388c3-a345-45bc-b82e-e8dffa65a927 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:45.606647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b5388c3-a345-45bc-b82e-e8dffa65a927 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:45.607383 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b5388c3-a345-45bc-b82e-e8dffa65a927 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:45.607856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b5388c3-a345-45bc-b82e-e8dffa65a927 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:45.608293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0b5388c3-a345-45bc-b82e-e8dffa65a927 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:45.741461 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0b5388c3-a345-45bc-b82e-e8dffa65a927 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:45.749869 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0b5388c3-a345-45bc-b82e-e8dffa65a927 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.156730 Oct 18 14:42:45.750454 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3909/7619] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:45 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:46.775029 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-89a4b07c-4a2b-4ef2-a0de-e2f9346413e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:46.775637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-89a4b07c-4a2b-4ef2-a0de-e2f9346413e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:46.782445 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89a4b07c-4a2b-4ef2-a0de-e2f9346413e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:46.782919 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89a4b07c-4a2b-4ef2-a0de-e2f9346413e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:46.783351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89a4b07c-4a2b-4ef2-a0de-e2f9346413e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:46.784032 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89a4b07c-4a2b-4ef2-a0de-e2f9346413e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:46.784483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89a4b07c-4a2b-4ef2-a0de-e2f9346413e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:46.784904 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-89a4b07c-4a2b-4ef2-a0de-e2f9346413e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:46.915498 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-89a4b07c-4a2b-4ef2-a0de-e2f9346413e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:46.923445 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-89a4b07c-4a2b-4ef2-a0de-e2f9346413e7 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.153133 Oct 18 14:42:46.924017 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3711/7620] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:46 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:47.947241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8a842d87-c47e-4e05-b83c-653108e7af1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:47.947870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8a842d87-c47e-4e05-b83c-653108e7af1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:47.954773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a842d87-c47e-4e05-b83c-653108e7af1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:47.955271 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a842d87-c47e-4e05-b83c-653108e7af1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:47.955716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a842d87-c47e-4e05-b83c-653108e7af1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:47.956421 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a842d87-c47e-4e05-b83c-653108e7af1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:47.956888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a842d87-c47e-4e05-b83c-653108e7af1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:47.957361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a842d87-c47e-4e05-b83c-653108e7af1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:48.093716 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8a842d87-c47e-4e05-b83c-653108e7af1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:48.102546 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8a842d87-c47e-4e05-b83c-653108e7af1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.158919 Oct 18 14:42:48.103132 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3910/7621] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:47 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:49.125616 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb39b6f1-061b-4052-b63a-174613b70aa6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:49.126262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb39b6f1-061b-4052-b63a-174613b70aa6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:49.133198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb39b6f1-061b-4052-b63a-174613b70aa6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:49.133699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb39b6f1-061b-4052-b63a-174613b70aa6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:49.134140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb39b6f1-061b-4052-b63a-174613b70aa6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:49.134828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb39b6f1-061b-4052-b63a-174613b70aa6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:49.135282 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb39b6f1-061b-4052-b63a-174613b70aa6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:49.135711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb39b6f1-061b-4052-b63a-174613b70aa6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:49.270235 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fb39b6f1-061b-4052-b63a-174613b70aa6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:49.278825 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb39b6f1-061b-4052-b63a-174613b70aa6 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.157134 Oct 18 14:42:49.279506 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3712/7622] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:49 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:50.303174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f7f541e4-1696-454a-b79b-07beac38f935 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:50.303811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f7f541e4-1696-454a-b79b-07beac38f935 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:50.311615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7f541e4-1696-454a-b79b-07beac38f935 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:50.312117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7f541e4-1696-454a-b79b-07beac38f935 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:50.312571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7f541e4-1696-454a-b79b-07beac38f935 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:50.313316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7f541e4-1696-454a-b79b-07beac38f935 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:50.313793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7f541e4-1696-454a-b79b-07beac38f935 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:50.314238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f7f541e4-1696-454a-b79b-07beac38f935 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:50.451790 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f7f541e4-1696-454a-b79b-07beac38f935 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:50.459633 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f7f541e4-1696-454a-b79b-07beac38f935 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.160418 Oct 18 14:42:50.460220 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3911/7623] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:50 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:51.483575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b058d2eb-361c-4287-bb6e-2071e3edd0b5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:51.484219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b058d2eb-361c-4287-bb6e-2071e3edd0b5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:51.490828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b058d2eb-361c-4287-bb6e-2071e3edd0b5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:51.491295 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b058d2eb-361c-4287-bb6e-2071e3edd0b5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:51.491723 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b058d2eb-361c-4287-bb6e-2071e3edd0b5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:51.492945 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b058d2eb-361c-4287-bb6e-2071e3edd0b5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:51.493421 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b058d2eb-361c-4287-bb6e-2071e3edd0b5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:51.493839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b058d2eb-361c-4287-bb6e-2071e3edd0b5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:51.629757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b058d2eb-361c-4287-bb6e-2071e3edd0b5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:51.637685 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b058d2eb-361c-4287-bb6e-2071e3edd0b5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.158066 Oct 18 14:42:51.638275 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3713/7624] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:51 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:52.661792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-89cb0a86-580c-4e9e-91aa-3b5e1b095360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:52.662380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-89cb0a86-580c-4e9e-91aa-3b5e1b095360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:52.669454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89cb0a86-580c-4e9e-91aa-3b5e1b095360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:52.669963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89cb0a86-580c-4e9e-91aa-3b5e1b095360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:52.670416 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89cb0a86-580c-4e9e-91aa-3b5e1b095360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:52.671145 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89cb0a86-580c-4e9e-91aa-3b5e1b095360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:52.671598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89cb0a86-580c-4e9e-91aa-3b5e1b095360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:52.672040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-89cb0a86-580c-4e9e-91aa-3b5e1b095360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:52.812701 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-89cb0a86-580c-4e9e-91aa-3b5e1b095360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:52.821331 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-89cb0a86-580c-4e9e-91aa-3b5e1b095360 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.163649 Oct 18 14:42:52.821806 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3912/7625] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:52 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:53.845542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-94bec9c8-7c20-4447-8b1d-bef92b05645f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:53.846154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-94bec9c8-7c20-4447-8b1d-bef92b05645f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:53.854037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94bec9c8-7c20-4447-8b1d-bef92b05645f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:53.854516 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94bec9c8-7c20-4447-8b1d-bef92b05645f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:53.854995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94bec9c8-7c20-4447-8b1d-bef92b05645f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:53.855691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94bec9c8-7c20-4447-8b1d-bef92b05645f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:53.856136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94bec9c8-7c20-4447-8b1d-bef92b05645f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:53.856557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-94bec9c8-7c20-4447-8b1d-bef92b05645f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:53.994768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-94bec9c8-7c20-4447-8b1d-bef92b05645f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:54.002629 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-94bec9c8-7c20-4447-8b1d-bef92b05645f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.161350 Oct 18 14:42:54.003217 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3714/7626] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:53 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:55.028772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b3dd7759-9ed4-4f4c-884f-50ea7b6d2aa9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:55.029427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b3dd7759-9ed4-4f4c-884f-50ea7b6d2aa9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:55.036521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3dd7759-9ed4-4f4c-884f-50ea7b6d2aa9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:55.037025 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3dd7759-9ed4-4f4c-884f-50ea7b6d2aa9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:55.037548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3dd7759-9ed4-4f4c-884f-50ea7b6d2aa9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:55.038263 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3dd7759-9ed4-4f4c-884f-50ea7b6d2aa9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:55.038737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3dd7759-9ed4-4f4c-884f-50ea7b6d2aa9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:55.039192 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b3dd7759-9ed4-4f4c-884f-50ea7b6d2aa9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:55.172959 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b3dd7759-9ed4-4f4c-884f-50ea7b6d2aa9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:55.180942 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b3dd7759-9ed4-4f4c-884f-50ea7b6d2aa9 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.156108 Oct 18 14:42:55.181549 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3913/7627] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:55 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:56.205096 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-162aad08-5711-4375-a529-f48d21ddb075 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:56.205722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-162aad08-5711-4375-a529-f48d21ddb075 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:56.213058 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-162aad08-5711-4375-a529-f48d21ddb075 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:56.213569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-162aad08-5711-4375-a529-f48d21ddb075 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:56.214006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-162aad08-5711-4375-a529-f48d21ddb075 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:56.214699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-162aad08-5711-4375-a529-f48d21ddb075 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:56.215155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-162aad08-5711-4375-a529-f48d21ddb075 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:56.215576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-162aad08-5711-4375-a529-f48d21ddb075 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:56.350197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-162aad08-5711-4375-a529-f48d21ddb075 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:56.358112 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-162aad08-5711-4375-a529-f48d21ddb075 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.156906 Oct 18 14:42:56.358695 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3715/7628] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:56 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:57.384302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8e6996e1-4af7-4f8e-9f2e-d6d4a4449276 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:57.384868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8e6996e1-4af7-4f8e-9f2e-d6d4a4449276 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:57.391802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e6996e1-4af7-4f8e-9f2e-d6d4a4449276 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:57.392308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e6996e1-4af7-4f8e-9f2e-d6d4a4449276 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:57.392760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e6996e1-4af7-4f8e-9f2e-d6d4a4449276 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:57.393493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e6996e1-4af7-4f8e-9f2e-d6d4a4449276 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:57.393965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e6996e1-4af7-4f8e-9f2e-d6d4a4449276 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:57.394407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8e6996e1-4af7-4f8e-9f2e-d6d4a4449276 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:57.525667 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8e6996e1-4af7-4f8e-9f2e-d6d4a4449276 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:57.533666 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8e6996e1-4af7-4f8e-9f2e-d6d4a4449276 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.153548 Oct 18 14:42:57.534280 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3914/7629] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:57 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:58.558899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-456c607c-ca9b-48d4-b354-3174a27e3649 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:58.559508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-456c607c-ca9b-48d4-b354-3174a27e3649 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:58.567182 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-456c607c-ca9b-48d4-b354-3174a27e3649 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:58.567681 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-456c607c-ca9b-48d4-b354-3174a27e3649 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:58.568121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-456c607c-ca9b-48d4-b354-3174a27e3649 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:58.568824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-456c607c-ca9b-48d4-b354-3174a27e3649 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:58.569328 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-456c607c-ca9b-48d4-b354-3174a27e3649 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:58.569901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-456c607c-ca9b-48d4-b354-3174a27e3649 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:58.710119 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-456c607c-ca9b-48d4-b354-3174a27e3649 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:58.718016 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-456c607c-ca9b-48d4-b354-3174a27e3649 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1689 microversion: 2.1 time: 0.163837 Oct 18 14:42:58.718629 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3716/7630] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:58 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:42:59.743877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-aa3c938c-8b54-4a86-b894-34e14bd8aebf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:42:59.744484 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-aa3c938c-8b54-4a86-b894-34e14bd8aebf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:42:59.751171 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa3c938c-8b54-4a86-b894-34e14bd8aebf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:59.751663 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa3c938c-8b54-4a86-b894-34e14bd8aebf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:59.752111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa3c938c-8b54-4a86-b894-34e14bd8aebf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:59.752802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa3c938c-8b54-4a86-b894-34e14bd8aebf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:42:59.753295 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa3c938c-8b54-4a86-b894-34e14bd8aebf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:42:59.753771 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-aa3c938c-8b54-4a86-b894-34e14bd8aebf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:42:59.889406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-aa3c938c-8b54-4a86-b894-34e14bd8aebf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:42:59.897195 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-aa3c938c-8b54-4a86-b894-34e14bd8aebf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1666 microversion: 2.1 time: 0.157838 Oct 18 14:42:59.897781 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3915/7631] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:42:59 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:43:00.990983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6c85cd33-5970-4012-9bfd-6504c5931364 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:43:00.993597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6c85cd33-5970-4012-9bfd-6504c5931364 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:01.001210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c85cd33-5970-4012-9bfd-6504c5931364 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:01.001705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c85cd33-5970-4012-9bfd-6504c5931364 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:01.002131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c85cd33-5970-4012-9bfd-6504c5931364 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:01.002818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c85cd33-5970-4012-9bfd-6504c5931364 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:01.003265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c85cd33-5970-4012-9bfd-6504c5931364 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:01.003684 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c85cd33-5970-4012-9bfd-6504c5931364 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:01.070623 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6c85cd33-5970-4012-9bfd-6504c5931364 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415/action" status: 200 len: 36418 microversion: 2.1 time: 0.082542 Oct 18 14:43:01.072324 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3717/7632] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:43:00 2022] POST /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415/action => generated 36418 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:43:01.086328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cb2165c5-3e69-42e7-922e-56ca298a0fd1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:43:01.093597 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb2165c5-3e69-42e7-922e-56ca298a0fd1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:01.094107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb2165c5-3e69-42e7-922e-56ca298a0fd1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:01.094813 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cb2165c5-3e69-42e7-922e-56ca298a0fd1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:01.118572 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cb2165c5-3e69-42e7-922e-56ca298a0fd1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Going to try to start instance {{(pid=120611) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 18 14:43:01.169509 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cb2165c5-3e69-42e7-922e-56ca298a0fd1 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415/action" status: 202 len: 0 microversion: 2.1 time: 0.087127 Oct 18 14:43:01.175215 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3916/7633] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:43:01 2022] POST /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:43:01.186622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2e4b1575-31c4-4ad2-829b-abe78140992c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:01.187876 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2e4b1575-31c4-4ad2-829b-abe78140992c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:01.199537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e4b1575-31c4-4ad2-829b-abe78140992c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:01.200067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e4b1575-31c4-4ad2-829b-abe78140992c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:01.200642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e4b1575-31c4-4ad2-829b-abe78140992c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:01.201393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e4b1575-31c4-4ad2-829b-abe78140992c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:01.201852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e4b1575-31c4-4ad2-829b-abe78140992c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:01.202279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2e4b1575-31c4-4ad2-829b-abe78140992c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:01.354804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2e4b1575-31c4-4ad2-829b-abe78140992c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:43:01.363537 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2e4b1575-31c4-4ad2-829b-abe78140992c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1675 microversion: 2.1 time: 0.185610 Oct 18 14:43:01.364126 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3718/7634] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:43:01 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:43:02.390901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-69680b61-bebe-4321-a7af-ae40e6eba473 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:02.391534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-69680b61-bebe-4321-a7af-ae40e6eba473 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:02.399046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69680b61-bebe-4321-a7af-ae40e6eba473 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:02.399606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69680b61-bebe-4321-a7af-ae40e6eba473 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:02.399925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69680b61-bebe-4321-a7af-ae40e6eba473 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:02.400645 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69680b61-bebe-4321-a7af-ae40e6eba473 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:02.401114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69680b61-bebe-4321-a7af-ae40e6eba473 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:02.401579 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-69680b61-bebe-4321-a7af-ae40e6eba473 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:02.540696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-69680b61-bebe-4321-a7af-ae40e6eba473 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:43:02.548647 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-69680b61-bebe-4321-a7af-ae40e6eba473 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1679 microversion: 2.1 time: 0.163746 Oct 18 14:43:02.549290 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3917/7635] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:43:02 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:43:36.779957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b40f1719-b81e-4484-8ab5-bda53c7b8062 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:43:36.782397 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b40f1719-b81e-4484-8ab5-bda53c7b8062 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:36.785264 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=20 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:36.785903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:36.792770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b40f1719-b81e-4484-8ab5-bda53c7b8062 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:36.793284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b40f1719-b81e-4484-8ab5-bda53c7b8062 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:36.793769 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b40f1719-b81e-4484-8ab5-bda53c7b8062 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:36.794554 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b40f1719-b81e-4484-8ab5-bda53c7b8062 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:36.795012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b40f1719-b81e-4484-8ab5-bda53c7b8062 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:36.795439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b40f1719-b81e-4484-8ab5-bda53c7b8062 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:36.870261 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b40f1719-b81e-4484-8ab5-bda53c7b8062 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415/action" status: 200 len: 60982 microversion: 2.1 time: 0.094254 Oct 18 14:43:36.870930 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3719/7636] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:43:36 2022] POST /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415/action => generated 60982 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:43:54.481138 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1c1b241e-c8a3-47cd-ab0f-e382e1f00eee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:54.481807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1c1b241e-c8a3-47cd-ab0f-e382e1f00eee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:54.484369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=20 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:54.484972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:54.485404 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:54.487262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=4 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:43:54.492994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c1b241e-c8a3-47cd-ab0f-e382e1f00eee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:54.493531 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c1b241e-c8a3-47cd-ab0f-e382e1f00eee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:54.493983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c1b241e-c8a3-47cd-ab0f-e382e1f00eee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:54.494695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c1b241e-c8a3-47cd-ab0f-e382e1f00eee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:54.495157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c1b241e-c8a3-47cd-ab0f-e382e1f00eee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:54.495920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1c1b241e-c8a3-47cd-ab0f-e382e1f00eee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:54.524896 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1c1b241e-c8a3-47cd-ab0f-e382e1f00eee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:43:54.543049 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-7c4fa454-7222-466e-9db3-b00881c1b602 req-aed6ad78-edc9-4c7c-ab53-a42be96d77a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664a2c25-b295-43b3-b4d2-da638c973415", "tag": "69f7ade4-bfa2-4f67-9363-3203a1b8ddbc"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:43:54.554444 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7c4fa454-7222-466e-9db3-b00881c1b602 req-aed6ad78-edc9-4c7c-ab53-a42be96d77a7 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:54.554920 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7c4fa454-7222-466e-9db3-b00881c1b602 req-aed6ad78-edc9-4c7c-ab53-a42be96d77a7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:54.555355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-7c4fa454-7222-466e-9db3-b00881c1b602 req-aed6ad78-edc9-4c7c-ab53-a42be96d77a7 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:54.567252 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-7c4fa454-7222-466e-9db3-b00881c1b602 req-aed6ad78-edc9-4c7c-ab53-a42be96d77a7 service nova] Creating event network-changed:69f7ade4-bfa2-4f67-9363-3203a1b8ddbc for instance 664a2c25-b295-43b3-b4d2-da638c973415 on n-h1-858384-13 Oct 18 14:43:54.573873 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-7c4fa454-7222-466e-9db3-b00881c1b602 req-aed6ad78-edc9-4c7c-ab53-a42be96d77a7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094475 Oct 18 14:43:54.574609 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3720/7637] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:43:54.611410 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1c1b241e-c8a3-47cd-ab0f-e382e1f00eee tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "DELETE /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 204 len: 0 microversion: 2.1 time: 0.133764 Oct 18 14:43:54.612378 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3918/7638] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:43:54 2022] DELETE /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:43:54.622850 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af1fb2f0-f8a4-4e08-972f-22834c9ea7f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:54.623595 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-af1fb2f0-f8a4-4e08-972f-22834c9ea7f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:54.630426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af1fb2f0-f8a4-4e08-972f-22834c9ea7f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:54.631646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af1fb2f0-f8a4-4e08-972f-22834c9ea7f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:54.631646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af1fb2f0-f8a4-4e08-972f-22834c9ea7f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:54.632292 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af1fb2f0-f8a4-4e08-972f-22834c9ea7f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:54.632749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af1fb2f0-f8a4-4e08-972f-22834c9ea7f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:54.633168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-af1fb2f0-f8a4-4e08-972f-22834c9ea7f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:54.779841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-af1fb2f0-f8a4-4e08-972f-22834c9ea7f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:43:54.789073 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-af1fb2f0-f8a4-4e08-972f-22834c9ea7f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1685 microversion: 2.1 time: 0.170231 Oct 18 14:43:54.790063 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3721/7639] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:43:54 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:43:55.815396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8a140edc-2d1b-49b6-aec5-3f77acce472c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:55.816167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8a140edc-2d1b-49b6-aec5-3f77acce472c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:55.824201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a140edc-2d1b-49b6-aec5-3f77acce472c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:55.824706 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a140edc-2d1b-49b6-aec5-3f77acce472c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:55.825159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a140edc-2d1b-49b6-aec5-3f77acce472c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:55.825883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a140edc-2d1b-49b6-aec5-3f77acce472c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:55.826354 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a140edc-2d1b-49b6-aec5-3f77acce472c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:55.826795 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8a140edc-2d1b-49b6-aec5-3f77acce472c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:56.059493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8a140edc-2d1b-49b6-aec5-3f77acce472c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:43:56.067526 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8a140edc-2d1b-49b6-aec5-3f77acce472c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1685 microversion: 2.1 time: 0.256389 Oct 18 14:43:56.068034 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3919/7640] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:43:55 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1685 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:43:56.929426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-e1d027bb-4b81-4c6a-a843-678c329122a7 req-e90beb0d-9c5d-4e5b-b527-13cd169e6300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "664a2c25-b295-43b3-b4d2-da638c973415", "name": "network-vif-deleted", "tag": "69f7ade4-bfa2-4f67-9363-3203a1b8ddbc"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:43:56.940236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e1d027bb-4b81-4c6a-a843-678c329122a7 req-e90beb0d-9c5d-4e5b-b527-13cd169e6300 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:56.940631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e1d027bb-4b81-4c6a-a843-678c329122a7 req-e90beb0d-9c5d-4e5b-b527-13cd169e6300 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:56.941063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-e1d027bb-4b81-4c6a-a843-678c329122a7 req-e90beb0d-9c5d-4e5b-b527-13cd169e6300 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:56.954234 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-e1d027bb-4b81-4c6a-a843-678c329122a7 req-e90beb0d-9c5d-4e5b-b527-13cd169e6300 service nova] Creating event network-vif-deleted:69f7ade4-bfa2-4f67-9363-3203a1b8ddbc for instance 664a2c25-b295-43b3-b4d2-da638c973415 on n-h1-858384-13 Oct 18 14:43:56.961082 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-e1d027bb-4b81-4c6a-a843-678c329122a7 req-e90beb0d-9c5d-4e5b-b527-13cd169e6300 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035840 Oct 18 14:43:56.961945 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3722/7641] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:43:57.091489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:57.092159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:57.101588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:57.102081 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:57.102536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:57.103262 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:57.103740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:57.104181 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:57.139127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:57.139743 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:57.140199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:57.140668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lazy-loading 'fault' on Instance uuid 664a2c25-b295-43b3-b4d2-da638c973415 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:43:57.187523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:43:57.196797 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5d955c49-de94-4ea9-9a32-ed791fcc067a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 200 len: 1354 microversion: 2.1 time: 0.109168 Oct 18 14:43:57.197151 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3920/7642] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:43:57 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 1354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:43:58.223130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-282627ef-950e-44bb-b86b-2eec9e13cf4f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:43:58.223833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-282627ef-950e-44bb-b86b-2eec9e13cf4f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: 664a2c25-b295-43b3-b4d2-da638c973415] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:43:58.230913 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-282627ef-950e-44bb-b86b-2eec9e13cf4f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:58.231395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-282627ef-950e-44bb-b86b-2eec9e13cf4f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:58.231840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-282627ef-950e-44bb-b86b-2eec9e13cf4f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:58.232527 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-282627ef-950e-44bb-b86b-2eec9e13cf4f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:43:58.232981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-282627ef-950e-44bb-b86b-2eec9e13cf4f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:43:58.233532 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-282627ef-950e-44bb-b86b-2eec9e13cf4f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:43:58.248292 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-282627ef-950e-44bb-b86b-2eec9e13cf4f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] HTTP exception thrown: Instance 664a2c25-b295-43b3-b4d2-da638c973415 could not be found. Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-282627ef-950e-44bb-b86b-2eec9e13cf4f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Request method failure captured: Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 HTTP/1.1 Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrmoJdJwsrKMFUaanrLJLt6LyEOQIjZ0f05fEpGBag1K6ul8d4SOC38ZEmojqeN-5Mr9W9Uihbdj5HrM7P4JhTSrrxqG0t2lF0wFzmrTNNFiotgT_nFwllBcbU5Dhub5ILl6o50Cn3W6DaWc6o8DCIPPy5pkj53OvF8nQyugmrrzfyI Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d2c5ebcb706b4f26903d0c30945bbcf0 Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d2c5ebcb706b4f26903d0c30945bbcf0"}]}] Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d2c5ebcb706b4f26903d0c30945bbcf0 Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestNetworkAdvancedServerOps-527964250-project Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a59ca729767748089c293f1066cda564 Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestNetworkAdvancedServerOps-527964250-project Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 664a2c25-b295-43b3-b4d2-da638c973415 could not be found. Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '664a2c25-b295-43b3-b4d2-da638c973415'} Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 664a2c25-b295-43b3-b4d2-da638c973415 could not be found. Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 664a2c25-b295-43b3-b4d2-da638c973415 could not be found. Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:43:58.249984 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:43:58.255643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:43:58.255643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:43:58.255643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:43:58.255643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:43:58.255643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:43:58.255643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:43:58.255643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 664a2c25-b295-43b3-b4d2-da638c973415 could not be found. Oct 18 14:43:58.255643 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:43:58.255643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-282627ef-950e-44bb-b86b-2eec9e13cf4f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Returning 404 to user: Instance 664a2c25-b295-43b3-b4d2-da638c973415 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:43:58.255643 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-282627ef-950e-44bb-b86b-2eec9e13cf4f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415" status: 404 len: 111 microversion: 2.1 time: 0.033874 Oct 18 14:43:58.255643 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3723/7643] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:43:58 2022] GET /compute/v2.1/servers/664a2c25-b295-43b3-b4d2-da638c973415 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:44:01.627886 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f6d0f6ac-4751-4b92-bcb0-b3dcd9c7088f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '.version_select at 0x7ff60e2f6c10>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:01.633858 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f6d0f6ac-4751-4b92-bcb0-b3dcd9c7088f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [0135da17-52a6-4f3f-bf9a-8d65ee41392a] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:44:02.641048 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [None req-f6d0f6ac-4751-4b92-bcb0-b3dcd9c7088f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [0135da17-52a6-4f3f-bf9a-8d65ee41392a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 44064. Oct 18 14:44:02.661839 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f6d0f6ac-4751-4b92-bcb0-b3dcd9c7088f tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-513850419" status: 202 len: 0 microversion: 2.1 time: 1.038148 Oct 18 14:44:02.662441 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3921/7644] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 18 14:44:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-513850419 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:44:02.701070 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-af99e7d3-f77c-454a-a1d6-129b0e66b91e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'create', calling method: .version_select at 0x7ff60e672ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-818054438", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2A66mMn8Zu0xfpLNZkIaKKgpKdeFNHxqNXRrwJEtJg21TdKDgl5TC5GuU+pwsnlJVGByUx5yw1j80l2m+7mxo7dL0ccXiZRWLoOwalL6S5ACZF676ZmY2Y7V6pxZR03g=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:02.718100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-af99e7d3-f77c-454a-a1d6-129b0e66b91e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:44:02.724143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-af99e7d3-f77c-454a-a1d6-129b0e66b91e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for user a59ca729767748089c293f1066cda564 and project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:44:02.747798 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-af99e7d3-f77c-454a-a1d6-129b0e66b91e tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050638 Oct 18 14:44:02.748396 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3724/7645] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:44:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:44:08.281827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:08.285985 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1444324949", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "networks": [{"uuid": "0d4bbca9-3620-4b51-9f4f-a32830f4c7f3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-818054438", "security_groups": [{"name": "tempest-secgroup-smoke-1120990192"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:08.408198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] validate_networks() for [('0d4bbca9-3620-4b51-9f4f-a32830f4c7f3', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:44:08.984353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:44:08.984900 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:44:08.986406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:44:08.987126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:44:08.987892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:44:08.999962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:09.001110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:09.001923 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:09.003000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:09.004111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:09.004914 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:09.036353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:44:09.049774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Getting quotas for user a59ca729767748089c293f1066cda564 and project d2c5ebcb706b4f26903d0c30945bbcf0. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:44:09.066340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:44:09.069032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:44:09.129330 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-80ed3258-2c9e-4574-a9e9-29a40ed5b3f4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.849153 Oct 18 14:44:09.130582 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3922/7646] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:44:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:44:09.142528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e908c4e8-76ef-4c96-9d49-a3f0e0476e54 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:09.143142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e908c4e8-76ef-4c96-9d49-a3f0e0476e54 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:09.149600 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=12 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:09.232416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-e908c4e8-76ef-4c96-9d49-a3f0e0476e54 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:09.240336 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e908c4e8-76ef-4c96-9d49-a3f0e0476e54 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1266 microversion: 2.1 time: 0.101580 Oct 18 14:44:09.254569 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3725/7647] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:09 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:10.273058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-514ec748-7e4d-47ce-a5aa-610febef547d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:10.274019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-514ec748-7e4d-47ce-a5aa-610febef547d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:10.293535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-514ec748-7e4d-47ce-a5aa-610febef547d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:10.294326 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-514ec748-7e4d-47ce-a5aa-610febef547d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:10.294839 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-514ec748-7e4d-47ce-a5aa-610febef547d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:10.295803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-514ec748-7e4d-47ce-a5aa-610febef547d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:10.296560 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-514ec748-7e4d-47ce-a5aa-610febef547d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:10.297103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-514ec748-7e4d-47ce-a5aa-610febef547d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:10.372969 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-514ec748-7e4d-47ce-a5aa-610febef547d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:10.383119 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-514ec748-7e4d-47ce-a5aa-610febef547d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1336 microversion: 2.1 time: 0.120616 Oct 18 14:44:10.384649 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3923/7648] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:10 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1336 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:11.408198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a0550b3a-51e3-417a-a13a-58047d628faf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:11.408874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a0550b3a-51e3-417a-a13a-58047d628faf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:11.420652 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0550b3a-51e3-417a-a13a-58047d628faf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:11.421145 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0550b3a-51e3-417a-a13a-58047d628faf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:11.421622 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0550b3a-51e3-417a-a13a-58047d628faf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:11.422331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0550b3a-51e3-417a-a13a-58047d628faf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:11.422784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0550b3a-51e3-417a-a13a-58047d628faf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:11.423240 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0550b3a-51e3-417a-a13a-58047d628faf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:11.645360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a0550b3a-51e3-417a-a13a-58047d628faf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:11.655040 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a0550b3a-51e3-417a-a13a-58047d628faf tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1392 microversion: 2.1 time: 0.250847 Oct 18 14:44:11.655638 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3726/7649] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:11 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1392 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:11.943422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ce94d1bb-94cd-4a5a-a047-8174437c892f req-25e34feb-6338-4ae1-bb39-3de087a880a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fbc5a6-9e20-4984-878b-3308182558dd", "tag": "7a617a32-1c91-4ee4-9775-b178a40e9062"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:11.955620 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ce94d1bb-94cd-4a5a-a047-8174437c892f req-25e34feb-6338-4ae1-bb39-3de087a880a4 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:11.956406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ce94d1bb-94cd-4a5a-a047-8174437c892f req-25e34feb-6338-4ae1-bb39-3de087a880a4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:11.957013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ce94d1bb-94cd-4a5a-a047-8174437c892f req-25e34feb-6338-4ae1-bb39-3de087a880a4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:11.969818 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ce94d1bb-94cd-4a5a-a047-8174437c892f req-25e34feb-6338-4ae1-bb39-3de087a880a4 service nova] Creating event network-changed:7a617a32-1c91-4ee4-9775-b178a40e9062 for instance f0fbc5a6-9e20-4984-878b-3308182558dd on n-h2-858384-13 Oct 18 14:44:11.975362 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ce94d1bb-94cd-4a5a-a047-8174437c892f req-25e34feb-6338-4ae1-bb39-3de087a880a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035465 Oct 18 14:44:11.976256 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3924/7650] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:44:12.681703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5d3baa71-ff7e-444d-bb04-b6607838803d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:12.682287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5d3baa71-ff7e-444d-bb04-b6607838803d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:12.689273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d3baa71-ff7e-444d-bb04-b6607838803d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:12.689746 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d3baa71-ff7e-444d-bb04-b6607838803d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:12.690174 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d3baa71-ff7e-444d-bb04-b6607838803d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:12.690847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d3baa71-ff7e-444d-bb04-b6607838803d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:12.691294 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d3baa71-ff7e-444d-bb04-b6607838803d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:12.691712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5d3baa71-ff7e-444d-bb04-b6607838803d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:12.829153 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5d3baa71-ff7e-444d-bb04-b6607838803d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:12.837518 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5d3baa71-ff7e-444d-bb04-b6607838803d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1392 microversion: 2.1 time: 0.159746 Oct 18 14:44:12.838093 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3727/7651] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:12 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:13.861974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0086df96-9809-4183-985b-ef5511a3e236 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:13.862693 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0086df96-9809-4183-985b-ef5511a3e236 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:13.869358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0086df96-9809-4183-985b-ef5511a3e236 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:13.869859 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0086df96-9809-4183-985b-ef5511a3e236 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:13.870314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0086df96-9809-4183-985b-ef5511a3e236 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:13.871019 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0086df96-9809-4183-985b-ef5511a3e236 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:13.871488 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0086df96-9809-4183-985b-ef5511a3e236 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:13.871928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0086df96-9809-4183-985b-ef5511a3e236 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:14.013260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0086df96-9809-4183-985b-ef5511a3e236 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:14.021025 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0086df96-9809-4183-985b-ef5511a3e236 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1392 microversion: 2.1 time: 0.164307 Oct 18 14:44:14.021640 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3925/7652] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:13 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:15.045260 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-5ce4ffd6-e545-4b11-b7f2-9054fe359d5d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:15.045823 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-5ce4ffd6-e545-4b11-b7f2-9054fe359d5d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:15.052637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ce4ffd6-e545-4b11-b7f2-9054fe359d5d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:15.053140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ce4ffd6-e545-4b11-b7f2-9054fe359d5d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:15.053668 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ce4ffd6-e545-4b11-b7f2-9054fe359d5d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:15.054364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ce4ffd6-e545-4b11-b7f2-9054fe359d5d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:15.054820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ce4ffd6-e545-4b11-b7f2-9054fe359d5d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:15.055251 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-5ce4ffd6-e545-4b11-b7f2-9054fe359d5d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:15.195356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-5ce4ffd6-e545-4b11-b7f2-9054fe359d5d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:15.202986 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-5ce4ffd6-e545-4b11-b7f2-9054fe359d5d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1392 microversion: 2.1 time: 0.161821 Oct 18 14:44:15.203561 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3728/7653] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:15 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:16.229415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f9cb6a53-2bc1-433f-a982-873165c0d5d3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:16.230041 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f9cb6a53-2bc1-433f-a982-873165c0d5d3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:16.237329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9cb6a53-2bc1-433f-a982-873165c0d5d3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:16.237844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9cb6a53-2bc1-433f-a982-873165c0d5d3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:16.238400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9cb6a53-2bc1-433f-a982-873165c0d5d3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:16.239107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9cb6a53-2bc1-433f-a982-873165c0d5d3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:16.239569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9cb6a53-2bc1-433f-a982-873165c0d5d3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:16.240002 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f9cb6a53-2bc1-433f-a982-873165c0d5d3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:16.670520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f9cb6a53-2bc1-433f-a982-873165c0d5d3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:16.678562 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f9cb6a53-2bc1-433f-a982-873165c0d5d3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1392 microversion: 2.1 time: 0.454925 Oct 18 14:44:16.679031 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3926/7654] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:16 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1392 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:17.556067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-0dae13b4-3388-441f-a89f-cfece973e02f req-f9a86898-5ae2-4968-ad3e-3c0190d140e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fbc5a6-9e20-4984-878b-3308182558dd", "name": "network-vif-plugged", "status": "completed", "tag": "7a617a32-1c91-4ee4-9775-b178a40e9062"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:17.566063 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0dae13b4-3388-441f-a89f-cfece973e02f req-f9a86898-5ae2-4968-ad3e-3c0190d140e3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:17.566537 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0dae13b4-3388-441f-a89f-cfece973e02f req-f9a86898-5ae2-4968-ad3e-3c0190d140e3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:17.566967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0dae13b4-3388-441f-a89f-cfece973e02f req-f9a86898-5ae2-4968-ad3e-3c0190d140e3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:17.579649 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0dae13b4-3388-441f-a89f-cfece973e02f req-f9a86898-5ae2-4968-ad3e-3c0190d140e3 service nova] Creating event network-vif-plugged:7a617a32-1c91-4ee4-9775-b178a40e9062 for instance f0fbc5a6-9e20-4984-878b-3308182558dd on n-h2-858384-13 Oct 18 14:44:17.585552 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-0dae13b4-3388-441f-a89f-cfece973e02f req-f9a86898-5ae2-4968-ad3e-3c0190d140e3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085700 Oct 18 14:44:17.586168 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3729/7655] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:44:17.701345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-675da747-2f70-4af9-b937-405438e3f776 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:17.701972 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-675da747-2f70-4af9-b937-405438e3f776 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:17.708695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-675da747-2f70-4af9-b937-405438e3f776 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:17.709201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-675da747-2f70-4af9-b937-405438e3f776 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:17.709807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-675da747-2f70-4af9-b937-405438e3f776 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:17.710528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-675da747-2f70-4af9-b937-405438e3f776 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:17.710996 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-675da747-2f70-4af9-b937-405438e3f776 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:17.711436 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-675da747-2f70-4af9-b937-405438e3f776 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:17.847350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-675da747-2f70-4af9-b937-405438e3f776 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:17.855312 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-675da747-2f70-4af9-b937-405438e3f776 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1392 microversion: 2.1 time: 0.157988 Oct 18 14:44:17.855876 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3927/7656] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:17 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:18.879764 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6c2d2053-330a-4159-879c-26cd7283849a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:18.880487 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6c2d2053-330a-4159-879c-26cd7283849a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:18.887476 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c2d2053-330a-4159-879c-26cd7283849a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:18.887969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c2d2053-330a-4159-879c-26cd7283849a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:18.888396 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c2d2053-330a-4159-879c-26cd7283849a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:18.889360 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c2d2053-330a-4159-879c-26cd7283849a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:18.889986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c2d2053-330a-4159-879c-26cd7283849a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:18.890420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6c2d2053-330a-4159-879c-26cd7283849a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:19.029281 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6c2d2053-330a-4159-879c-26cd7283849a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:19.036988 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6c2d2053-330a-4159-879c-26cd7283849a tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1563 microversion: 2.1 time: 0.162322 Oct 18 14:44:19.037614 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3730/7657] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:18 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:19.060106 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed3e6270-bba8-483f-abb4-0dddb0779b29 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:19.060731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ed3e6270-bba8-483f-abb4-0dddb0779b29 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:19.063576 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:19.064259 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:19.070735 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed3e6270-bba8-483f-abb4-0dddb0779b29 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:19.071233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed3e6270-bba8-483f-abb4-0dddb0779b29 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:19.071686 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed3e6270-bba8-483f-abb4-0dddb0779b29 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:19.072394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed3e6270-bba8-483f-abb4-0dddb0779b29 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:19.072864 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed3e6270-bba8-483f-abb4-0dddb0779b29 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:19.073339 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed3e6270-bba8-483f-abb4-0dddb0779b29 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:19.206535 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ed3e6270-bba8-483f-abb4-0dddb0779b29 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:19.215357 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ed3e6270-bba8-483f-abb4-0dddb0779b29 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1563 microversion: 2.1 time: 0.159169 Oct 18 14:44:19.215928 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3928/7658] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:19 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:21.116698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-27c651b9-a1b1-4e3e-bd3d-8bea0d4d0f5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:21.117322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-27c651b9-a1b1-4e3e-bd3d-8bea0d4d0f5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:21.119276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-5e6475f5-7762-48ed-adb2-71570f3c4d36 req-ff8cad8a-9111-4942-b1f4-31e9580e66d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fbc5a6-9e20-4984-878b-3308182558dd", "tag": "7a617a32-1c91-4ee4-9775-b178a40e9062"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:21.122428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:21.125520 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c651b9-a1b1-4e3e-bd3d-8bea0d4d0f5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:21.126010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c651b9-a1b1-4e3e-bd3d-8bea0d4d0f5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:21.126439 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c651b9-a1b1-4e3e-bd3d-8bea0d4d0f5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:21.127350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c651b9-a1b1-4e3e-bd3d-8bea0d4d0f5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:21.128030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c651b9-a1b1-4e3e-bd3d-8bea0d4d0f5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:21.128460 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-27c651b9-a1b1-4e3e-bd3d-8bea0d4d0f5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:21.132135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5e6475f5-7762-48ed-adb2-71570f3c4d36 req-ff8cad8a-9111-4942-b1f4-31e9580e66d4 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:21.132635 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5e6475f5-7762-48ed-adb2-71570f3c4d36 req-ff8cad8a-9111-4942-b1f4-31e9580e66d4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:21.133080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5e6475f5-7762-48ed-adb2-71570f3c4d36 req-ff8cad8a-9111-4942-b1f4-31e9580e66d4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:21.144891 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-5e6475f5-7762-48ed-adb2-71570f3c4d36 req-ff8cad8a-9111-4942-b1f4-31e9580e66d4 service nova] Creating event network-changed:7a617a32-1c91-4ee4-9775-b178a40e9062 for instance f0fbc5a6-9e20-4984-878b-3308182558dd on n-h2-858384-13 Oct 18 14:44:21.150960 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-5e6475f5-7762-48ed-adb2-71570f3c4d36 req-ff8cad8a-9111-4942-b1f4-31e9580e66d4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035537 Oct 18 14:44:21.151467 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3929/7659] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:44:21.351612 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-27c651b9-a1b1-4e3e-bd3d-8bea0d4d0f5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:21.359733 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-27c651b9-a1b1-4e3e-bd3d-8bea0d4d0f5b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1563 microversion: 2.1 time: 0.246881 Oct 18 14:44:21.360328 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3731/7660] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:21 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:44.618386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:44.619163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=36 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:44.624256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-caa3f64f-a465-4f72-9874-fee01639a362 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:44.626610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-caa3f64f-a465-4f72-9874-fee01639a362 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:44.634942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-caa3f64f-a465-4f72-9874-fee01639a362 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:44.635435 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-caa3f64f-a465-4f72-9874-fee01639a362 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:44.635885 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-caa3f64f-a465-4f72-9874-fee01639a362 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:44.636589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-caa3f64f-a465-4f72-9874-fee01639a362 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:44.637413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-caa3f64f-a465-4f72-9874-fee01639a362 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:44.638195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-caa3f64f-a465-4f72-9874-fee01639a362 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:44.693717 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-caa3f64f-a465-4f72-9874-fee01639a362 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd/action" status: 200 len: 24571 microversion: 2.1 time: 0.077587 Oct 18 14:44:44.694243 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3930/7661] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:44:44 2022] POST /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd/action => generated 24571 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:44:51.094631 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-167ac72e-59fe-4183-96cd-0c058325ff1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:51.095301 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-167ac72e-59fe-4183-96cd-0c058325ff1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:51.097465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:51.098542 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=32 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:44:51.099759 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:44:51.099920 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:44:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd/action (ip 10.222.0.40) !!! Oct 18 14:44:51.107146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-167ac72e-59fe-4183-96cd-0c058325ff1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:51.107670 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-167ac72e-59fe-4183-96cd-0c058325ff1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:51.108114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-167ac72e-59fe-4183-96cd-0c058325ff1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:51.108835 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-167ac72e-59fe-4183-96cd-0c058325ff1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:51.109317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-167ac72e-59fe-4183-96cd-0c058325ff1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:51.109744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-167ac72e-59fe-4183-96cd-0c058325ff1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:51.137833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-167ac72e-59fe-4183-96cd-0c058325ff1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lazy-loading 'flavor' on Instance uuid f0fbc5a6-9e20-4984-878b-3308182558dd {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:44:51.209392 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-167ac72e-59fe-4183-96cd-0c058325ff1b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd/action" status: 202 len: 0 microversion: 2.1 time: 0.118207 Oct 18 14:44:51.210037 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3732/7662] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:44:51 2022] POST /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:44:51.220047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e40710ec-94b4-4f7d-89b7-aa04794723f8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:51.220916 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e40710ec-94b4-4f7d-89b7-aa04794723f8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:51.231580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40710ec-94b4-4f7d-89b7-aa04794723f8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:51.232111 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40710ec-94b4-4f7d-89b7-aa04794723f8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:51.232810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40710ec-94b4-4f7d-89b7-aa04794723f8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:51.234898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40710ec-94b4-4f7d-89b7-aa04794723f8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:51.234898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40710ec-94b4-4f7d-89b7-aa04794723f8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:51.234898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e40710ec-94b4-4f7d-89b7-aa04794723f8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:51.375688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e40710ec-94b4-4f7d-89b7-aa04794723f8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:51.385342 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e40710ec-94b4-4f7d-89b7-aa04794723f8 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1689 microversion: 2.1 time: 0.170640 Oct 18 14:44:51.385935 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3931/7663] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:51 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:52.411771 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-79c66f5a-2500-43ec-99da-a423046ab9df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:52.412513 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-79c66f5a-2500-43ec-99da-a423046ab9df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:52.418610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79c66f5a-2500-43ec-99da-a423046ab9df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:52.419103 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79c66f5a-2500-43ec-99da-a423046ab9df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:52.419515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79c66f5a-2500-43ec-99da-a423046ab9df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:52.420188 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79c66f5a-2500-43ec-99da-a423046ab9df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:52.420635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79c66f5a-2500-43ec-99da-a423046ab9df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:52.421051 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-79c66f5a-2500-43ec-99da-a423046ab9df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:52.558278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-79c66f5a-2500-43ec-99da-a423046ab9df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:52.566122 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-79c66f5a-2500-43ec-99da-a423046ab9df tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1672 microversion: 2.1 time: 0.159655 Oct 18 14:44:52.566696 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3733/7664] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:52 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:53.661432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fc9d67d3-cc3b-4bcc-a5d3-ee0441bae2a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:53.663807 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fc9d67d3-cc3b-4bcc-a5d3-ee0441bae2a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:53.672084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc9d67d3-cc3b-4bcc-a5d3-ee0441bae2a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:53.672585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc9d67d3-cc3b-4bcc-a5d3-ee0441bae2a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:53.673034 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc9d67d3-cc3b-4bcc-a5d3-ee0441bae2a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:53.673770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc9d67d3-cc3b-4bcc-a5d3-ee0441bae2a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:53.674240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc9d67d3-cc3b-4bcc-a5d3-ee0441bae2a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:53.674677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fc9d67d3-cc3b-4bcc-a5d3-ee0441bae2a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:53.726415 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fc9d67d3-cc3b-4bcc-a5d3-ee0441bae2a3 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd/action" status: 200 len: 36384 microversion: 2.1 time: 0.068804 Oct 18 14:44:53.727049 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3932/7665] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:44:53 2022] POST /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd/action => generated 36384 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:44:53.738792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-df296cf9-4a20-4b14-9a19-75fd7366fa83 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:53.739352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-df296cf9-4a20-4b14-9a19-75fd7366fa83 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:53.746834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df296cf9-4a20-4b14-9a19-75fd7366fa83 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:53.747316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df296cf9-4a20-4b14-9a19-75fd7366fa83 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:53.747755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df296cf9-4a20-4b14-9a19-75fd7366fa83 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:53.748447 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df296cf9-4a20-4b14-9a19-75fd7366fa83 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:53.748937 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df296cf9-4a20-4b14-9a19-75fd7366fa83 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:53.749402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-df296cf9-4a20-4b14-9a19-75fd7366fa83 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:53.816320 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-df296cf9-4a20-4b14-9a19-75fd7366fa83 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd/action" status: 202 len: 0 microversion: 2.1 time: 0.081227 Oct 18 14:44:53.816961 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3734/7666] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:44:53 2022] POST /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:44:53.826871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e165b584-9cea-4490-a250-3a81429443e4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:53.827411 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e165b584-9cea-4490-a250-3a81429443e4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:53.835245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e165b584-9cea-4490-a250-3a81429443e4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:53.835821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e165b584-9cea-4490-a250-3a81429443e4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:53.836335 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e165b584-9cea-4490-a250-3a81429443e4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:53.837064 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e165b584-9cea-4490-a250-3a81429443e4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:53.837574 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e165b584-9cea-4490-a250-3a81429443e4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:53.838027 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e165b584-9cea-4490-a250-3a81429443e4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:53.979604 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e165b584-9cea-4490-a250-3a81429443e4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:53.987564 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e165b584-9cea-4490-a250-3a81429443e4 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1678 microversion: 2.1 time: 0.165234 Oct 18 14:44:53.988136 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3933/7667] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:53 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:55.014551 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bc6de8a4-a285-4dd1-8ad1-6f5a470d2b06 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:55.015275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bc6de8a4-a285-4dd1-8ad1-6f5a470d2b06 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:55.022120 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc6de8a4-a285-4dd1-8ad1-6f5a470d2b06 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:55.022604 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc6de8a4-a285-4dd1-8ad1-6f5a470d2b06 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:55.023050 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc6de8a4-a285-4dd1-8ad1-6f5a470d2b06 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:55.023735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc6de8a4-a285-4dd1-8ad1-6f5a470d2b06 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:55.024186 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc6de8a4-a285-4dd1-8ad1-6f5a470d2b06 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:55.024609 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bc6de8a4-a285-4dd1-8ad1-6f5a470d2b06 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:55.172812 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bc6de8a4-a285-4dd1-8ad1-6f5a470d2b06 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:55.182466 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bc6de8a4-a285-4dd1-8ad1-6f5a470d2b06 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1678 microversion: 2.1 time: 0.172828 Oct 18 14:44:55.197394 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3735/7668] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:55 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:56.208244 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-05675068-a804-4c45-948f-586a962644ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:56.209588 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-05675068-a804-4c45-948f-586a962644ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:56.216905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05675068-a804-4c45-948f-586a962644ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:56.217450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05675068-a804-4c45-948f-586a962644ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:56.217902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05675068-a804-4c45-948f-586a962644ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:56.218606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05675068-a804-4c45-948f-586a962644ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:56.219070 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05675068-a804-4c45-948f-586a962644ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:56.219506 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-05675068-a804-4c45-948f-586a962644ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:56.355241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-05675068-a804-4c45-948f-586a962644ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:56.363121 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-05675068-a804-4c45-948f-586a962644ce tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1681 microversion: 2.1 time: 0.159208 Oct 18 14:44:56.363703 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3934/7669] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:56 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:56.459669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b1d222a1-3f8d-4a84-a8cc-814e926651da tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:56.462061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b1d222a1-3f8d-4a84-a8cc-814e926651da tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:56.468984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1d222a1-3f8d-4a84-a8cc-814e926651da tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:56.469509 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1d222a1-3f8d-4a84-a8cc-814e926651da tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:56.469946 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1d222a1-3f8d-4a84-a8cc-814e926651da tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:56.470897 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1d222a1-3f8d-4a84-a8cc-814e926651da tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:56.471350 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1d222a1-3f8d-4a84-a8cc-814e926651da tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:56.471775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b1d222a1-3f8d-4a84-a8cc-814e926651da tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:56.515478 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b1d222a1-3f8d-4a84-a8cc-814e926651da tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "POST /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd/action" status: 200 len: 36384 microversion: 2.1 time: 0.060233 Oct 18 14:44:56.516117 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3736/7670] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:44:56 2022] POST /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd/action => generated 36384 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 18 14:44:57.575236 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-585e2ff0-44f1-4067-a373-c5aab0bddc4d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:57.575922 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-585e2ff0-44f1-4067-a373-c5aab0bddc4d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:57.577352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-30d77e6f-0198-49f3-96ae-d98c58fe16e5 req-8eaffe54-f9d7-4a08-b4bd-ed9ece0ee426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fbc5a6-9e20-4984-878b-3308182558dd", "tag": "7a617a32-1c91-4ee4-9775-b178a40e9062"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:57.583068 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-585e2ff0-44f1-4067-a373-c5aab0bddc4d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:57.584170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-585e2ff0-44f1-4067-a373-c5aab0bddc4d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:57.584919 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-585e2ff0-44f1-4067-a373-c5aab0bddc4d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:57.585705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-585e2ff0-44f1-4067-a373-c5aab0bddc4d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:57.586439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-585e2ff0-44f1-4067-a373-c5aab0bddc4d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:57.586883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-585e2ff0-44f1-4067-a373-c5aab0bddc4d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:57.590019 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-30d77e6f-0198-49f3-96ae-d98c58fe16e5 req-8eaffe54-f9d7-4a08-b4bd-ed9ece0ee426 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:57.590965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-30d77e6f-0198-49f3-96ae-d98c58fe16e5 req-8eaffe54-f9d7-4a08-b4bd-ed9ece0ee426 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:57.591457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-30d77e6f-0198-49f3-96ae-d98c58fe16e5 req-8eaffe54-f9d7-4a08-b4bd-ed9ece0ee426 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:57.605915 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-30d77e6f-0198-49f3-96ae-d98c58fe16e5 req-8eaffe54-f9d7-4a08-b4bd-ed9ece0ee426 service nova] Creating event network-changed:7a617a32-1c91-4ee4-9775-b178a40e9062 for instance f0fbc5a6-9e20-4984-878b-3308182558dd on n-h2-858384-13 Oct 18 14:44:57.611042 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-30d77e6f-0198-49f3-96ae-d98c58fe16e5 req-8eaffe54-f9d7-4a08-b4bd-ed9ece0ee426 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037905 Oct 18 14:44:57.612128 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3737/7671] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:44:57.618809 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-585e2ff0-44f1-4067-a373-c5aab0bddc4d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:44:57.721617 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-585e2ff0-44f1-4067-a373-c5aab0bddc4d tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 204 len: 0 microversion: 2.1 time: 0.149785 Oct 18 14:44:57.722507 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3935/7672] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:44:57 2022] DELETE /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:44:57.731671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-06bed237-3910-44f3-bb2c-6a8cb9c2c66c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:57.732440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-06bed237-3910-44f3-bb2c-6a8cb9c2c66c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:57.739317 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06bed237-3910-44f3-bb2c-6a8cb9c2c66c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:57.740388 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06bed237-3910-44f3-bb2c-6a8cb9c2c66c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:57.740978 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06bed237-3910-44f3-bb2c-6a8cb9c2c66c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:57.741948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06bed237-3910-44f3-bb2c-6a8cb9c2c66c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:57.742659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06bed237-3910-44f3-bb2c-6a8cb9c2c66c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:57.743141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-06bed237-3910-44f3-bb2c-6a8cb9c2c66c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:57.893827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-06bed237-3910-44f3-bb2c-6a8cb9c2c66c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:57.902588 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-06bed237-3910-44f3-bb2c-6a8cb9c2c66c tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1687 microversion: 2.1 time: 0.175494 Oct 18 14:44:57.903179 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3738/7673] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:57 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:58.928744 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8010dabb-4986-4097-9af8-bd805b77eb9b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:44:58.929489 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8010dabb-4986-4097-9af8-bd805b77eb9b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:44:58.936440 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8010dabb-4986-4097-9af8-bd805b77eb9b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:58.936942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8010dabb-4986-4097-9af8-bd805b77eb9b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:58.937423 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8010dabb-4986-4097-9af8-bd805b77eb9b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:58.938131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8010dabb-4986-4097-9af8-bd805b77eb9b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:58.938602 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8010dabb-4986-4097-9af8-bd805b77eb9b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:58.939049 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8010dabb-4986-4097-9af8-bd805b77eb9b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:59.082651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8010dabb-4986-4097-9af8-bd805b77eb9b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:44:59.091979 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8010dabb-4986-4097-9af8-bd805b77eb9b tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1687 microversion: 2.1 time: 0.168202 Oct 18 14:44:59.092586 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3936/7674] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:44:58 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:44:59.743834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-b1fca958-cfdd-438f-ac31-f569b5ea1d07 req-e1fc0c2a-521f-4219-954f-4e5019ffcd61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fbc5a6-9e20-4984-878b-3308182558dd", "name": "network-vif-deleted", "tag": "7a617a32-1c91-4ee4-9775-b178a40e9062"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:44:59.757117 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b1fca958-cfdd-438f-ac31-f569b5ea1d07 req-e1fc0c2a-521f-4219-954f-4e5019ffcd61 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:44:59.757816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b1fca958-cfdd-438f-ac31-f569b5ea1d07 req-e1fc0c2a-521f-4219-954f-4e5019ffcd61 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:44:59.758289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-b1fca958-cfdd-438f-ac31-f569b5ea1d07 req-e1fc0c2a-521f-4219-954f-4e5019ffcd61 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:44:59.770351 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-b1fca958-cfdd-438f-ac31-f569b5ea1d07 req-e1fc0c2a-521f-4219-954f-4e5019ffcd61 service nova] Creating event network-vif-deleted:7a617a32-1c91-4ee4-9775-b178a40e9062 for instance f0fbc5a6-9e20-4984-878b-3308182558dd on n-h2-858384-13 Oct 18 14:44:59.775319 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-b1fca958-cfdd-438f-ac31-f569b5ea1d07 req-e1fc0c2a-521f-4219-954f-4e5019ffcd61 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035842 Oct 18 14:44:59.776005 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3739/7675] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:45:00.119325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:00.119964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:00.126870 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:00.127728 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:00.128424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:00.129419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:00.130194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:00.131127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:00.170129 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:00.170918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:00.172304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:00.172797 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lazy-loading 'fault' on Instance uuid f0fbc5a6-9e20-4984-878b-3308182558dd {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:45:00.225253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59ca729767748089c293f1066cda564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c5ebcb706b4f26903d0c30945bbcf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:00.233490 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-07e82dd7-23a4-481b-9e04-8ae8f0b07a67 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 200 len: 1356 microversion: 2.1 time: 0.120006 Oct 18 14:45:00.234183 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3937/7676] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:00 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 1356 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:01.260728 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e8d985fe-3c5e-4945-a29e-c9d0788bd1a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:01.261523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-e8d985fe-3c5e-4945-a29e-c9d0788bd1a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] [instance: f0fbc5a6-9e20-4984-878b-3308182558dd] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:01.267815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8d985fe-3c5e-4945-a29e-c9d0788bd1a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:01.268293 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8d985fe-3c5e-4945-a29e-c9d0788bd1a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:01.268731 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8d985fe-3c5e-4945-a29e-c9d0788bd1a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:01.269457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8d985fe-3c5e-4945-a29e-c9d0788bd1a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:01.269914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8d985fe-3c5e-4945-a29e-c9d0788bd1a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:01.270339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-e8d985fe-3c5e-4945-a29e-c9d0788bd1a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:01.284004 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-e8d985fe-3c5e-4945-a29e-c9d0788bd1a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] HTTP exception thrown: Instance f0fbc5a6-9e20-4984-878b-3308182558dd could not be found. Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e8d985fe-3c5e-4945-a29e-c9d0788bd1a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Request method failure captured: Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd HTTP/1.1 Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrmoJdJwsrKMFUaanrLJLt6LyEOQIjZ0f05fEpGBag1K6ul8d4SOC38ZEmojqeN-5Mr9W9Uihbdj5HrM7P4JhTSrrxqG0t2lF0wFzmrTNNFiotgT_nFwllBcbU5Dhub5ILl6o50Cn3W6DaWc6o8DCIPPy5pkj53OvF8nQyugmrrzfyI Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: d2c5ebcb706b4f26903d0c30945bbcf0 Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d2c5ebcb706b4f26903d0c30945bbcf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d2c5ebcb706b4f26903d0c30945bbcf0"}]}] Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: d2c5ebcb706b4f26903d0c30945bbcf0 Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-527964250 Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestNetworkAdvancedServerOps-527964250-project Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: a59ca729767748089c293f1066cda564 Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestNetworkAdvancedServerOps-527964250-project Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance f0fbc5a6-9e20-4984-878b-3308182558dd could not be found. Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'f0fbc5a6-9e20-4984-878b-3308182558dd'} Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0fbc5a6-9e20-4984-878b-3308182558dd could not be found. Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0fbc5a6-9e20-4984-878b-3308182558dd could not be found. Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:45:01.285671 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:45:01.290935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:45:01.290935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:45:01.290935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:45:01.290935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:45:01.290935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:45:01.290935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:45:01.290935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0fbc5a6-9e20-4984-878b-3308182558dd could not be found. Oct 18 14:45:01.290935 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:45:01.290935 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e8d985fe-3c5e-4945-a29e-c9d0788bd1a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Returning 404 to user: Instance f0fbc5a6-9e20-4984-878b-3308182558dd could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:45:01.290935 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e8d985fe-3c5e-4945-a29e-c9d0788bd1a5 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd" status: 404 len: 111 microversion: 2.1 time: 0.032297 Oct 18 14:45:01.290935 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3740/7677] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:01 2022] GET /compute/v2.1/servers/f0fbc5a6-9e20-4984-878b-3308182558dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:45:04.785935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-48c8400a-235e-4a97-8a11-e75e2d9ee418 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] Calling method '.version_select at 0x7ff60ebe8f70>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:04.812803 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-48c8400a-235e-4a97-8a11-e75e2d9ee418 tempest-TestNetworkAdvancedServerOps-527964250 tempest-TestNetworkAdvancedServerOps-527964250-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-818054438" status: 202 len: 0 microversion: 2.1 time: 0.030634 Oct 18 14:45:04.813481 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3938/7678] 10.222.0.40 () {58 vars in 1281 bytes} [Tue Oct 18 14:45:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-818054438 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:45:16.562726 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=18 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:16.563596 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:16.830172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-e82ec1dd-aa4f-430d-9e42-c2bd04cce347 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Action: 'create', calling method: .version_select at 0x7ff60e4a0a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1979769310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFt5SUx3R94U2BdtnNXZP9i5B5Kpm/+YNZ0o1hopGFkDKFPZxlLrLoJy5xxW+HB83JaRjIXf/J2ng9VTEKYC21OMzL8TOTessGE4lP248t3s3n9tQvdqC6LopL9T75mTUA=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:45:16.868419 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e82ec1dd-aa4f-430d-9e42-c2bd04cce347 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Getting quotas for project c5722398932444338ab8ea5e0d1c0cc6. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:45:16.876359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-e82ec1dd-aa4f-430d-9e42-c2bd04cce347 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Getting quotas for user c9a09467003445b6abfee976c5230cd0 and project c5722398932444338ab8ea5e0d1c0cc6. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:45:16.922706 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-e82ec1dd-aa4f-430d-9e42-c2bd04cce347 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.365360 Oct 18 14:45:16.923951 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3741/7679] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:45:16 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:45:18.097301 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:18.099366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:18.103140 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1943926558", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1979769310", "security_groups": [{"name": "tempest-secgroup-smoke-272526840"}], "networks": [{"uuid": "9a8229a8-5737-4b29-bb71-c0b631a19379"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:45:18.219522 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] validate_networks() for [('9a8229a8-5737-4b29-bb71-c0b631a19379', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:45:18.623317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:45:18.623763 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:45:18.624294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:45:18.624784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:45:18.625246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:45:18.635114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:18.635611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:18.636062 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:18.636830 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:18.637333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:18.637772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:18.660191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Getting quotas for project c5722398932444338ab8ea5e0d1c0cc6. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:45:18.666341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Getting quotas for user c9a09467003445b6abfee976c5230cd0 and project c5722398932444338ab8ea5e0d1c0cc6. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:45:18.679978 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:45:18.682520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:45:18.732783 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-655be906-bf6b-4d78-ad03-3ddca1a358c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.637255 Oct 18 14:45:18.733867 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3939/7680] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:45:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:45:18.745735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4f59d7d1-18ef-4499-acd5-d3d019df1613 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:18.746332 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4f59d7d1-18ef-4499-acd5-d3d019df1613 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:18.805715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-4f59d7d1-18ef-4499-acd5-d3d019df1613 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:18.816349 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4f59d7d1-18ef-4499-acd5-d3d019df1613 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1247 microversion: 2.1 time: 0.075297 Oct 18 14:45:18.817922 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3742/7681] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:18 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1247 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:19.841214 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0994e36e-6e06-41cc-86c2-d2acf1535420 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:19.841877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0994e36e-6e06-41cc-86c2-d2acf1535420 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:19.850158 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0994e36e-6e06-41cc-86c2-d2acf1535420 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:19.850688 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0994e36e-6e06-41cc-86c2-d2acf1535420 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:19.851135 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0994e36e-6e06-41cc-86c2-d2acf1535420 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:19.852132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0994e36e-6e06-41cc-86c2-d2acf1535420 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:19.852746 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0994e36e-6e06-41cc-86c2-d2acf1535420 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:19.853281 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0994e36e-6e06-41cc-86c2-d2acf1535420 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:19.931632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0994e36e-6e06-41cc-86c2-d2acf1535420 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:19.943263 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0994e36e-6e06-41cc-86c2-d2acf1535420 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1307 microversion: 2.1 time: 0.106208 Oct 18 14:45:19.960718 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3940/7682] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:19 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:20.969833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0607c167-7b37-4856-9d1a-b856624c8f63 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:20.971102 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0607c167-7b37-4856-9d1a-b856624c8f63 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:20.980012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0607c167-7b37-4856-9d1a-b856624c8f63 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:20.980833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0607c167-7b37-4856-9d1a-b856624c8f63 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:20.981432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0607c167-7b37-4856-9d1a-b856624c8f63 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:20.982234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0607c167-7b37-4856-9d1a-b856624c8f63 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:20.983238 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0607c167-7b37-4856-9d1a-b856624c8f63 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:20.983775 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0607c167-7b37-4856-9d1a-b856624c8f63 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:21.196143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0607c167-7b37-4856-9d1a-b856624c8f63 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:21.203865 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0607c167-7b37-4856-9d1a-b856624c8f63 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1372 microversion: 2.1 time: 0.239694 Oct 18 14:45:21.204441 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3743/7683] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:20 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1372 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:21.563796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9848d98f-028e-4f85-baa3-3a79f8c2f122 req-3da18266-a61d-4139-bc3e-6ee632513305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ce1530-8177-40e1-bf88-5505dfec3c04", "tag": "13d56807-2159-40c6-8635-cd491e9a3b3e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:45:21.584802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9848d98f-028e-4f85-baa3-3a79f8c2f122 req-3da18266-a61d-4139-bc3e-6ee632513305 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:21.585656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9848d98f-028e-4f85-baa3-3a79f8c2f122 req-3da18266-a61d-4139-bc3e-6ee632513305 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:21.586099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9848d98f-028e-4f85-baa3-3a79f8c2f122 req-3da18266-a61d-4139-bc3e-6ee632513305 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:21.599310 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9848d98f-028e-4f85-baa3-3a79f8c2f122 req-3da18266-a61d-4139-bc3e-6ee632513305 service nova] Creating event network-changed:13d56807-2159-40c6-8635-cd491e9a3b3e for instance 29ce1530-8177-40e1-bf88-5505dfec3c04 on n-h1-858384-13 Oct 18 14:45:21.604918 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9848d98f-028e-4f85-baa3-3a79f8c2f122 req-3da18266-a61d-4139-bc3e-6ee632513305 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044894 Oct 18 14:45:21.605876 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3941/7684] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:45:22.227912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7a71a5a9-a025-41b9-8985-d45a275b348e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:22.228478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7a71a5a9-a025-41b9-8985-d45a275b348e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:22.235478 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a71a5a9-a025-41b9-8985-d45a275b348e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:22.235957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a71a5a9-a025-41b9-8985-d45a275b348e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:22.236390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a71a5a9-a025-41b9-8985-d45a275b348e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:22.237080 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a71a5a9-a025-41b9-8985-d45a275b348e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:22.237559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a71a5a9-a025-41b9-8985-d45a275b348e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:22.237981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7a71a5a9-a025-41b9-8985-d45a275b348e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:22.377506 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7a71a5a9-a025-41b9-8985-d45a275b348e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:22.386743 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7a71a5a9-a025-41b9-8985-d45a275b348e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1372 microversion: 2.1 time: 0.162764 Oct 18 14:45:22.387342 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3744/7685] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:22 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:23.411883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-1b877542-86e0-41d3-b473-d03e0f17305e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:23.412519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-1b877542-86e0-41d3-b473-d03e0f17305e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:23.418803 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b877542-86e0-41d3-b473-d03e0f17305e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:23.419303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b877542-86e0-41d3-b473-d03e0f17305e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:23.419754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b877542-86e0-41d3-b473-d03e0f17305e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:23.420463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b877542-86e0-41d3-b473-d03e0f17305e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:23.420935 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b877542-86e0-41d3-b473-d03e0f17305e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:23.421419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-1b877542-86e0-41d3-b473-d03e0f17305e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:23.560356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-1b877542-86e0-41d3-b473-d03e0f17305e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:23.569140 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-1b877542-86e0-41d3-b473-d03e0f17305e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1372 microversion: 2.1 time: 0.162876 Oct 18 14:45:23.569752 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3942/7686] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:23 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:24.591986 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-47e5430e-88c3-4887-a2fb-0315d07fee46 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:24.592797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-47e5430e-88c3-4887-a2fb-0315d07fee46 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:24.601718 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47e5430e-88c3-4887-a2fb-0315d07fee46 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:24.602203 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47e5430e-88c3-4887-a2fb-0315d07fee46 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:24.602636 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47e5430e-88c3-4887-a2fb-0315d07fee46 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:24.603335 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47e5430e-88c3-4887-a2fb-0315d07fee46 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:24.603807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47e5430e-88c3-4887-a2fb-0315d07fee46 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:24.604451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-47e5430e-88c3-4887-a2fb-0315d07fee46 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:24.745172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-47e5430e-88c3-4887-a2fb-0315d07fee46 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:24.753662 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-47e5430e-88c3-4887-a2fb-0315d07fee46 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1372 microversion: 2.1 time: 0.165506 Oct 18 14:45:24.754269 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3745/7687] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:24 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:25.777951 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-498a4359-b9ba-425f-871f-0a7cdc4d92ff tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:25.780600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-498a4359-b9ba-425f-871f-0a7cdc4d92ff tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:25.787979 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-498a4359-b9ba-425f-871f-0a7cdc4d92ff tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:25.788580 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-498a4359-b9ba-425f-871f-0a7cdc4d92ff tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:25.789046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-498a4359-b9ba-425f-871f-0a7cdc4d92ff tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:25.789817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-498a4359-b9ba-425f-871f-0a7cdc4d92ff tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:25.790382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-498a4359-b9ba-425f-871f-0a7cdc4d92ff tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:25.790791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-498a4359-b9ba-425f-871f-0a7cdc4d92ff tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:25.950256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-498a4359-b9ba-425f-871f-0a7cdc4d92ff tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:25.959844 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-498a4359-b9ba-425f-871f-0a7cdc4d92ff tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1372 microversion: 2.1 time: 0.185800 Oct 18 14:45:25.961704 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3943/7688] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:25 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:26.984374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c812af7c-023a-4078-af52-48ae4fbe4729 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:26.985036 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c812af7c-023a-4078-af52-48ae4fbe4729 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:26.994187 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c812af7c-023a-4078-af52-48ae4fbe4729 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:26.994698 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c812af7c-023a-4078-af52-48ae4fbe4729 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:26.995118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c812af7c-023a-4078-af52-48ae4fbe4729 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:26.995827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c812af7c-023a-4078-af52-48ae4fbe4729 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:26.996276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c812af7c-023a-4078-af52-48ae4fbe4729 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:26.996804 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c812af7c-023a-4078-af52-48ae4fbe4729 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:27.135463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c812af7c-023a-4078-af52-48ae4fbe4729 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:27.143854 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c812af7c-023a-4078-af52-48ae4fbe4729 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1372 microversion: 2.1 time: 0.163577 Oct 18 14:45:27.144449 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3746/7689] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:26 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:27.913962 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-7e89e70e-6854-460e-8e23-5448df753b45 req-853c748a-fa3e-4441-81d9-81d4670811f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ce1530-8177-40e1-bf88-5505dfec3c04", "name": "network-vif-plugged", "status": "completed", "tag": "13d56807-2159-40c6-8635-cd491e9a3b3e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:45:27.925040 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7e89e70e-6854-460e-8e23-5448df753b45 req-853c748a-fa3e-4441-81d9-81d4670811f3 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:27.925599 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7e89e70e-6854-460e-8e23-5448df753b45 req-853c748a-fa3e-4441-81d9-81d4670811f3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:27.926142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-7e89e70e-6854-460e-8e23-5448df753b45 req-853c748a-fa3e-4441-81d9-81d4670811f3 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:27.938062 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-7e89e70e-6854-460e-8e23-5448df753b45 req-853c748a-fa3e-4441-81d9-81d4670811f3 service nova] Creating event network-vif-plugged:13d56807-2159-40c6-8635-cd491e9a3b3e for instance 29ce1530-8177-40e1-bf88-5505dfec3c04 on n-h1-858384-13 Oct 18 14:45:27.943965 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-7e89e70e-6854-460e-8e23-5448df753b45 req-853c748a-fa3e-4441-81d9-81d4670811f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034287 Oct 18 14:45:27.944569 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3944/7690] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:45:28.168811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8c37d2bd-047a-4d49-95c1-6f7bb94f6323 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:28.169442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8c37d2bd-047a-4d49-95c1-6f7bb94f6323 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:28.177210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c37d2bd-047a-4d49-95c1-6f7bb94f6323 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:28.177701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c37d2bd-047a-4d49-95c1-6f7bb94f6323 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:28.178134 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c37d2bd-047a-4d49-95c1-6f7bb94f6323 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:28.178811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c37d2bd-047a-4d49-95c1-6f7bb94f6323 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:28.179256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c37d2bd-047a-4d49-95c1-6f7bb94f6323 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:28.179673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c37d2bd-047a-4d49-95c1-6f7bb94f6323 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:28.313471 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8c37d2bd-047a-4d49-95c1-6f7bb94f6323 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:28.321931 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8c37d2bd-047a-4d49-95c1-6f7bb94f6323 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1372 microversion: 2.1 time: 0.156966 Oct 18 14:45:28.322513 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3747/7691] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:28 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:29.341308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:29.342208 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:29.347768 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cfe3c9dc-0923-4adc-ad15-3c1258b4f4a4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:29.348930 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cfe3c9dc-0923-4adc-ad15-3c1258b4f4a4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:29.356023 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfe3c9dc-0923-4adc-ad15-3c1258b4f4a4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:29.356514 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfe3c9dc-0923-4adc-ad15-3c1258b4f4a4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:29.356963 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfe3c9dc-0923-4adc-ad15-3c1258b4f4a4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:29.357703 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfe3c9dc-0923-4adc-ad15-3c1258b4f4a4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:29.358170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfe3c9dc-0923-4adc-ad15-3c1258b4f4a4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:29.358606 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cfe3c9dc-0923-4adc-ad15-3c1258b4f4a4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:29.495491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cfe3c9dc-0923-4adc-ad15-3c1258b4f4a4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:29.503434 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cfe3c9dc-0923-4adc-ad15-3c1258b4f4a4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1372 microversion: 2.1 time: 0.163175 Oct 18 14:45:29.504029 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3945/7692] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:29 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:30.528339 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a8482853-bb99-4669-b080-9fb0eea29377 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:30.528975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a8482853-bb99-4669-b080-9fb0eea29377 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:30.530866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:45:30.537743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8482853-bb99-4669-b080-9fb0eea29377 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:30.538216 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8482853-bb99-4669-b080-9fb0eea29377 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:30.538639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8482853-bb99-4669-b080-9fb0eea29377 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:30.539316 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8482853-bb99-4669-b080-9fb0eea29377 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:30.539762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8482853-bb99-4669-b080-9fb0eea29377 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:30.540180 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a8482853-bb99-4669-b080-9fb0eea29377 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:30.674662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a8482853-bb99-4669-b080-9fb0eea29377 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:30.682592 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a8482853-bb99-4669-b080-9fb0eea29377 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1555 microversion: 2.1 time: 0.158125 Oct 18 14:45:30.683167 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3748/7693] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:30 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:45:30.704818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ee65c147-b162-4570-86d6-35b17cf23c13 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:45:30.705480 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ee65c147-b162-4570-86d6-35b17cf23c13 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:45:30.712664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee65c147-b162-4570-86d6-35b17cf23c13 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:30.713166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee65c147-b162-4570-86d6-35b17cf23c13 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:30.713644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee65c147-b162-4570-86d6-35b17cf23c13 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:30.714352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee65c147-b162-4570-86d6-35b17cf23c13 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:30.714853 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee65c147-b162-4570-86d6-35b17cf23c13 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:30.715300 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee65c147-b162-4570-86d6-35b17cf23c13 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:30.849030 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ee65c147-b162-4570-86d6-35b17cf23c13 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:45:30.857025 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ee65c147-b162-4570-86d6-35b17cf23c13 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1555 microversion: 2.1 time: 0.155969 Oct 18 14:45:30.857659 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3946/7694] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:45:30 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:45:32.568894 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-2689514d-1683-4cd1-9c66-4eb1adb98c39 req-717416f8-8f62-4f3e-aa0c-75e32b48fb58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ce1530-8177-40e1-bf88-5505dfec3c04", "tag": "13d56807-2159-40c6-8635-cd491e9a3b3e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:45:32.579276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2689514d-1683-4cd1-9c66-4eb1adb98c39 req-717416f8-8f62-4f3e-aa0c-75e32b48fb58 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:45:32.579722 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2689514d-1683-4cd1-9c66-4eb1adb98c39 req-717416f8-8f62-4f3e-aa0c-75e32b48fb58 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:45:32.580002 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2689514d-1683-4cd1-9c66-4eb1adb98c39 req-717416f8-8f62-4f3e-aa0c-75e32b48fb58 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:45:32.592493 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-2689514d-1683-4cd1-9c66-4eb1adb98c39 req-717416f8-8f62-4f3e-aa0c-75e32b48fb58 service nova] Creating event network-changed:13d56807-2159-40c6-8635-cd491e9a3b3e for instance 29ce1530-8177-40e1-bf88-5505dfec3c04 on n-h1-858384-13 Oct 18 14:45:32.600362 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-2689514d-1683-4cd1-9c66-4eb1adb98c39 req-717416f8-8f62-4f3e-aa0c-75e32b48fb58 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035406 Oct 18 14:45:32.600996 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3749/7695] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:47:59.419317 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8f8474d7-3472-4de9-9dba-6d0727c9399f] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:47:59.420097 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2749d46-7aff-41c9-91de-55da262717f1] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:47:59.420895 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:59.422334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=36 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:59.423713 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:47:59.423874 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:47:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04/action (ip 10.222.0.40) !!! Oct 18 14:47:59.429293 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-38d3305a-7399-423a-9f13-fd91c370fb4e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:47:59.429838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-38d3305a-7399-423a-9f13-fd91c370fb4e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:59.441089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38d3305a-7399-423a-9f13-fd91c370fb4e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:59.441674 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38d3305a-7399-423a-9f13-fd91c370fb4e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:59.442123 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38d3305a-7399-423a-9f13-fd91c370fb4e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:59.442831 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38d3305a-7399-423a-9f13-fd91c370fb4e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:59.443297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38d3305a-7399-423a-9f13-fd91c370fb4e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:59.443731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-38d3305a-7399-423a-9f13-fd91c370fb4e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:59.467704 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-38d3305a-7399-423a-9f13-fd91c370fb4e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lazy-loading 'flavor' on Instance uuid 29ce1530-8177-40e1-bf88-5505dfec3c04 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:47:59.777330 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-38d3305a-7399-423a-9f13-fd91c370fb4e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "POST /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04/action" status: 202 len: 0 microversion: 2.1 time: 0.359812 Oct 18 14:47:59.778239 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3947/7696] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:47:59 2022] POST /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:47:59.786056 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d5b88c2f-79b6-477e-bcc2-8d31160b4455] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:47:59.787008 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4632368d-33e6-409b-9dc2-fb1f52b7b887] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:47:59.787629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:59.788370 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=38 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:47:59.789304 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:47:59.789514 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:47:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 (ip 10.222.0.40) !!! Oct 18 14:47:59.791642 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:47:59.791778 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:47:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 (ip 10.222.0.40) !!! Oct 18 14:47:59.793054 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:47:59.793210 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:47:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 (ip 10.222.0.40) !!! Oct 18 14:47:59.800503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-56a998c8-86b4-41d3-9437-67c9a499e6bf tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:47:59.801230 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-56a998c8-86b4-41d3-9437-67c9a499e6bf tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:47:59.819437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56a998c8-86b4-41d3-9437-67c9a499e6bf tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:59.819916 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56a998c8-86b4-41d3-9437-67c9a499e6bf tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:59.820353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56a998c8-86b4-41d3-9437-67c9a499e6bf tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:47:59.821069 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56a998c8-86b4-41d3-9437-67c9a499e6bf tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:47:59.821635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56a998c8-86b4-41d3-9437-67c9a499e6bf tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:47:59.822061 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-56a998c8-86b4-41d3-9437-67c9a499e6bf tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:00.009547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-56a998c8-86b4-41d3-9437-67c9a499e6bf tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:00.018502 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-56a998c8-86b4-41d3-9437-67c9a499e6bf tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1680 microversion: 2.1 time: 0.234701 Oct 18 14:48:00.019081 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3750/7697] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:47:59 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:01.042632 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-94caff0f-b25c-4114-abb7-3892841c52a7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:01.043355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-94caff0f-b25c-4114-abb7-3892841c52a7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:01.057598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94caff0f-b25c-4114-abb7-3892841c52a7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:01.058107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94caff0f-b25c-4114-abb7-3892841c52a7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:01.058696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94caff0f-b25c-4114-abb7-3892841c52a7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:01.059428 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94caff0f-b25c-4114-abb7-3892841c52a7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:01.059897 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94caff0f-b25c-4114-abb7-3892841c52a7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:01.060342 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-94caff0f-b25c-4114-abb7-3892841c52a7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:01.065885 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] [8f8474d7-3472-4de9-9dba-6d0727c9399f] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 44466. Oct 18 14:48:01.069008 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2749d46-7aff-41c9-91de-55da262717f1] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 44468. Oct 18 14:48:01.205058 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-94caff0f-b25c-4114-abb7-3892841c52a7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:01.213302 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-94caff0f-b25c-4114-abb7-3892841c52a7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1680 microversion: 2.1 time: 0.174806 Oct 18 14:48:01.213885 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3948/7698] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:01 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:02.238272 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-49273e19-6eb3-4525-9e49-33afca3f50e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:02.238878 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-49273e19-6eb3-4525-9e49-33afca3f50e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:02.252015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49273e19-6eb3-4525-9e49-33afca3f50e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:02.252493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49273e19-6eb3-4525-9e49-33afca3f50e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:02.252947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49273e19-6eb3-4525-9e49-33afca3f50e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:02.253733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49273e19-6eb3-4525-9e49-33afca3f50e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:02.254160 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49273e19-6eb3-4525-9e49-33afca3f50e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:02.254575 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-49273e19-6eb3-4525-9e49-33afca3f50e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:02.261231 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] [4632368d-33e6-409b-9dc2-fb1f52b7b887] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 44476. Oct 18 14:48:02.264180 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] [d5b88c2f-79b6-477e-bcc2-8d31160b4455] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 44474. Oct 18 14:48:02.399067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-49273e19-6eb3-4525-9e49-33afca3f50e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:02.407484 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-49273e19-6eb3-4525-9e49-33afca3f50e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1680 microversion: 2.1 time: 0.173588 Oct 18 14:48:02.408072 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3751/7699] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:02 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:03.431626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d49534e3-2d96-4475-9205-2a02213f8e3e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:03.432201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d49534e3-2d96-4475-9205-2a02213f8e3e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:03.440237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d49534e3-2d96-4475-9205-2a02213f8e3e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:03.440740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d49534e3-2d96-4475-9205-2a02213f8e3e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:03.441211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d49534e3-2d96-4475-9205-2a02213f8e3e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:03.441925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d49534e3-2d96-4475-9205-2a02213f8e3e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:03.442400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d49534e3-2d96-4475-9205-2a02213f8e3e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:03.442844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d49534e3-2d96-4475-9205-2a02213f8e3e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:03.580441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d49534e3-2d96-4475-9205-2a02213f8e3e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:03.588322 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d49534e3-2d96-4475-9205-2a02213f8e3e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1680 microversion: 2.1 time: 0.160897 Oct 18 14:48:03.588899 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3949/7700] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:03 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:48:04.612864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7d8a4301-c668-4b32-83c8-973460d4ba0e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:04.613535 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7d8a4301-c668-4b32-83c8-973460d4ba0e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:04.620337 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d8a4301-c668-4b32-83c8-973460d4ba0e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:04.620809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d8a4301-c668-4b32-83c8-973460d4ba0e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:04.621268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d8a4301-c668-4b32-83c8-973460d4ba0e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:04.621970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d8a4301-c668-4b32-83c8-973460d4ba0e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:04.622417 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d8a4301-c668-4b32-83c8-973460d4ba0e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:04.622836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d8a4301-c668-4b32-83c8-973460d4ba0e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:04.759874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7d8a4301-c668-4b32-83c8-973460d4ba0e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:04.767974 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7d8a4301-c668-4b32-83c8-973460d4ba0e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1680 microversion: 2.1 time: 0.159606 Oct 18 14:48:04.768677 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3752/7701] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:04 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:05.792345 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a26abee7-a469-4c2a-a74d-0cf0ab0d82e4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:05.792964 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a26abee7-a469-4c2a-a74d-0cf0ab0d82e4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:05.800709 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a26abee7-a469-4c2a-a74d-0cf0ab0d82e4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:05.801237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a26abee7-a469-4c2a-a74d-0cf0ab0d82e4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:05.801694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a26abee7-a469-4c2a-a74d-0cf0ab0d82e4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:05.802398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a26abee7-a469-4c2a-a74d-0cf0ab0d82e4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:05.802871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a26abee7-a469-4c2a-a74d-0cf0ab0d82e4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:05.803325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a26abee7-a469-4c2a-a74d-0cf0ab0d82e4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:05.938036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a26abee7-a469-4c2a-a74d-0cf0ab0d82e4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:05.946066 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a26abee7-a469-4c2a-a74d-0cf0ab0d82e4 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1680 microversion: 2.1 time: 0.157605 Oct 18 14:48:05.946653 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3950/7702] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:05 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:48:06.970593 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cf3385da-40e2-4b78-ad99-192964c4f9ba tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:06.971166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cf3385da-40e2-4b78-ad99-192964c4f9ba tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:06.978989 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf3385da-40e2-4b78-ad99-192964c4f9ba tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:06.979464 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf3385da-40e2-4b78-ad99-192964c4f9ba tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:06.979905 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf3385da-40e2-4b78-ad99-192964c4f9ba tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:06.980591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf3385da-40e2-4b78-ad99-192964c4f9ba tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:06.981037 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf3385da-40e2-4b78-ad99-192964c4f9ba tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:06.981480 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cf3385da-40e2-4b78-ad99-192964c4f9ba tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:07.119711 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cf3385da-40e2-4b78-ad99-192964c4f9ba tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:07.127724 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cf3385da-40e2-4b78-ad99-192964c4f9ba tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1680 microversion: 2.1 time: 0.161136 Oct 18 14:48:07.128311 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3753/7703] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:06 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:08.151422 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cdf3e210-3d46-445a-99c6-b07891cfb3d5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:08.152028 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cdf3e210-3d46-445a-99c6-b07891cfb3d5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:08.159943 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf3e210-3d46-445a-99c6-b07891cfb3d5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:08.160442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf3e210-3d46-445a-99c6-b07891cfb3d5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:08.160888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf3e210-3d46-445a-99c6-b07891cfb3d5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:08.161619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf3e210-3d46-445a-99c6-b07891cfb3d5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:08.162085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf3e210-3d46-445a-99c6-b07891cfb3d5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:08.162523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cdf3e210-3d46-445a-99c6-b07891cfb3d5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:08.299924 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-cdf3e210-3d46-445a-99c6-b07891cfb3d5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:08.307785 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cdf3e210-3d46-445a-99c6-b07891cfb3d5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1680 microversion: 2.1 time: 0.160348 Oct 18 14:48:08.308404 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3951/7704] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:08 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:09.331967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ada8e698-ad2c-47ee-873e-33b873b78223 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:09.332578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ada8e698-ad2c-47ee-873e-33b873b78223 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:09.339591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ada8e698-ad2c-47ee-873e-33b873b78223 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:09.340071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ada8e698-ad2c-47ee-873e-33b873b78223 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:09.340503 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ada8e698-ad2c-47ee-873e-33b873b78223 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:09.341211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ada8e698-ad2c-47ee-873e-33b873b78223 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:09.341642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ada8e698-ad2c-47ee-873e-33b873b78223 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:09.342261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ada8e698-ad2c-47ee-873e-33b873b78223 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:09.481150 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ada8e698-ad2c-47ee-873e-33b873b78223 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:09.489852 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ada8e698-ad2c-47ee-873e-33b873b78223 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1680 microversion: 2.1 time: 0.161630 Oct 18 14:48:09.490445 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3754/7705] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:09 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:10.514608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a48d1c88-3e16-42ed-9dd7-1f7378a79e80 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:10.516781 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a48d1c88-3e16-42ed-9dd7-1f7378a79e80 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:10.524682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a48d1c88-3e16-42ed-9dd7-1f7378a79e80 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:10.525193 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a48d1c88-3e16-42ed-9dd7-1f7378a79e80 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:10.525653 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a48d1c88-3e16-42ed-9dd7-1f7378a79e80 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:10.526369 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a48d1c88-3e16-42ed-9dd7-1f7378a79e80 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:10.526838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a48d1c88-3e16-42ed-9dd7-1f7378a79e80 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:10.527279 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a48d1c88-3e16-42ed-9dd7-1f7378a79e80 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:10.667334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a48d1c88-3e16-42ed-9dd7-1f7378a79e80 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:10.676221 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a48d1c88-3e16-42ed-9dd7-1f7378a79e80 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1680 microversion: 2.1 time: 0.165668 Oct 18 14:48:10.676812 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3952/7706] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:10 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:11.700660 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-46e230f6-bfd8-484b-8132-15208816f215 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:11.701327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-46e230f6-bfd8-484b-8132-15208816f215 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:11.708767 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e230f6-bfd8-484b-8132-15208816f215 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:11.709270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e230f6-bfd8-484b-8132-15208816f215 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:11.709703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e230f6-bfd8-484b-8132-15208816f215 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:11.710393 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e230f6-bfd8-484b-8132-15208816f215 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:11.710843 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e230f6-bfd8-484b-8132-15208816f215 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:11.711265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-46e230f6-bfd8-484b-8132-15208816f215 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:11.846289 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-46e230f6-bfd8-484b-8132-15208816f215 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:11.854642 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-46e230f6-bfd8-484b-8132-15208816f215 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1701 microversion: 2.1 time: 0.157944 Oct 18 14:48:11.855289 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3755/7707] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:11 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1701 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:12.879633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d4bf79b7-f8e9-4316-896f-d44b5c79ad8b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:12.880211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d4bf79b7-f8e9-4316-896f-d44b5c79ad8b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:12.887413 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bf79b7-f8e9-4316-896f-d44b5c79ad8b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:12.887920 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bf79b7-f8e9-4316-896f-d44b5c79ad8b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:12.888380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bf79b7-f8e9-4316-896f-d44b5c79ad8b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:12.889105 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bf79b7-f8e9-4316-896f-d44b5c79ad8b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:12.889615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bf79b7-f8e9-4316-896f-d44b5c79ad8b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:12.890656 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4bf79b7-f8e9-4316-896f-d44b5c79ad8b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:13.037601 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d4bf79b7-f8e9-4316-896f-d44b5c79ad8b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:13.045688 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d4bf79b7-f8e9-4316-896f-d44b5c79ad8b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1701 microversion: 2.1 time: 0.170102 Oct 18 14:48:13.046447 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3953/7708] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:12 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1701 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:14.069014 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-347a4747-bc1f-41aa-9d11-c3d960bed300 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:14.069824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-347a4747-bc1f-41aa-9d11-c3d960bed300 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:14.076458 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-347a4747-bc1f-41aa-9d11-c3d960bed300 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:14.076862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-347a4747-bc1f-41aa-9d11-c3d960bed300 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:14.077950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-347a4747-bc1f-41aa-9d11-c3d960bed300 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:14.078639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-347a4747-bc1f-41aa-9d11-c3d960bed300 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:14.079089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-347a4747-bc1f-41aa-9d11-c3d960bed300 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:14.079505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-347a4747-bc1f-41aa-9d11-c3d960bed300 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:14.217465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-347a4747-bc1f-41aa-9d11-c3d960bed300 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:14.225919 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-347a4747-bc1f-41aa-9d11-c3d960bed300 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1701 microversion: 2.1 time: 0.160856 Oct 18 14:48:14.226495 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3756/7709] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:14 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:14.837432 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-ff29a3b6-dac3-41c0-9e99-a42852b1306e req-05f004b5-7d55-4815-8e82-5d014c1b00da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ce1530-8177-40e1-bf88-5505dfec3c04", "name": "network-vif-plugged", "status": "completed", "tag": "13d56807-2159-40c6-8635-cd491e9a3b3e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:48:14.849500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ff29a3b6-dac3-41c0-9e99-a42852b1306e req-05f004b5-7d55-4815-8e82-5d014c1b00da service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:14.850048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ff29a3b6-dac3-41c0-9e99-a42852b1306e req-05f004b5-7d55-4815-8e82-5d014c1b00da service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:14.850500 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-ff29a3b6-dac3-41c0-9e99-a42852b1306e req-05f004b5-7d55-4815-8e82-5d014c1b00da service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:14.862482 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-ff29a3b6-dac3-41c0-9e99-a42852b1306e req-05f004b5-7d55-4815-8e82-5d014c1b00da service nova] Creating event network-vif-plugged:13d56807-2159-40c6-8635-cd491e9a3b3e for instance 29ce1530-8177-40e1-bf88-5505dfec3c04 on n-h1-858384-13 Oct 18 14:48:14.867654 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-ff29a3b6-dac3-41c0-9e99-a42852b1306e req-05f004b5-7d55-4815-8e82-5d014c1b00da service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034039 Oct 18 14:48:14.868439 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3954/7710] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:48:15.251291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ac9e5c88-8707-47cb-bb0f-79b4625b630e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:15.251891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ac9e5c88-8707-47cb-bb0f-79b4625b630e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:15.259083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac9e5c88-8707-47cb-bb0f-79b4625b630e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:15.259557 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac9e5c88-8707-47cb-bb0f-79b4625b630e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:15.259981 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac9e5c88-8707-47cb-bb0f-79b4625b630e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:15.260665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac9e5c88-8707-47cb-bb0f-79b4625b630e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:15.261106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac9e5c88-8707-47cb-bb0f-79b4625b630e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:15.261697 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ac9e5c88-8707-47cb-bb0f-79b4625b630e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:15.400910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ac9e5c88-8707-47cb-bb0f-79b4625b630e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:15.409758 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ac9e5c88-8707-47cb-bb0f-79b4625b630e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1701 microversion: 2.1 time: 0.162880 Oct 18 14:48:15.410370 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3757/7711] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:15 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:16.437752 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-192d6c4b-0a50-4575-809a-7c52f9c2c15e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:16.438534 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-192d6c4b-0a50-4575-809a-7c52f9c2c15e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:16.446723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-192d6c4b-0a50-4575-809a-7c52f9c2c15e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:16.447299 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-192d6c4b-0a50-4575-809a-7c52f9c2c15e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:16.447990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-192d6c4b-0a50-4575-809a-7c52f9c2c15e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:16.448965 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-192d6c4b-0a50-4575-809a-7c52f9c2c15e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:16.449717 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-192d6c4b-0a50-4575-809a-7c52f9c2c15e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:16.450407 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-192d6c4b-0a50-4575-809a-7c52f9c2c15e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:16.632087 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-192d6c4b-0a50-4575-809a-7c52f9c2c15e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:16.641709 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-192d6c4b-0a50-4575-809a-7c52f9c2c15e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1696 microversion: 2.1 time: 0.210376 Oct 18 14:48:16.642998 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3955/7712] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:16 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1696 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:17.666491 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-912d2f16-97fe-4e87-a31a-336e68a2989f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:17.669475 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-912d2f16-97fe-4e87-a31a-336e68a2989f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:17.679215 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912d2f16-97fe-4e87-a31a-336e68a2989f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:17.679694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912d2f16-97fe-4e87-a31a-336e68a2989f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:17.680121 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912d2f16-97fe-4e87-a31a-336e68a2989f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:17.680887 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912d2f16-97fe-4e87-a31a-336e68a2989f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:17.681361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912d2f16-97fe-4e87-a31a-336e68a2989f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:17.681780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-912d2f16-97fe-4e87-a31a-336e68a2989f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:17.849038 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-912d2f16-97fe-4e87-a31a-336e68a2989f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:17.861498 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-912d2f16-97fe-4e87-a31a-336e68a2989f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1696 microversion: 2.1 time: 0.195109 Oct 18 14:48:17.861498 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3758/7713] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:17 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1696 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:18.886316 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ee37a1b6-131a-4b33-9125-90691a8a80b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:18.887165 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ee37a1b6-131a-4b33-9125-90691a8a80b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:18.898109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee37a1b6-131a-4b33-9125-90691a8a80b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:18.899038 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee37a1b6-131a-4b33-9125-90691a8a80b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:18.899520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee37a1b6-131a-4b33-9125-90691a8a80b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:18.900254 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee37a1b6-131a-4b33-9125-90691a8a80b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:18.900733 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee37a1b6-131a-4b33-9125-90691a8a80b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:18.901198 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ee37a1b6-131a-4b33-9125-90691a8a80b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:19.072615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-ee37a1b6-131a-4b33-9125-90691a8a80b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:19.086411 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ee37a1b6-131a-4b33-9125-90691a8a80b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1696 microversion: 2.1 time: 0.200712 Oct 18 14:48:19.086411 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3956/7714] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:18 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1696 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:20.118716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c9b5d7a3-0f7a-4fd3-9a00-13a40d8f7115 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:20.119454 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c9b5d7a3-0f7a-4fd3-9a00-13a40d8f7115 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:20.130720 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9b5d7a3-0f7a-4fd3-9a00-13a40d8f7115 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:20.131202 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9b5d7a3-0f7a-4fd3-9a00-13a40d8f7115 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:20.131691 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9b5d7a3-0f7a-4fd3-9a00-13a40d8f7115 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:20.132648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9b5d7a3-0f7a-4fd3-9a00-13a40d8f7115 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:20.133702 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9b5d7a3-0f7a-4fd3-9a00-13a40d8f7115 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:20.134234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c9b5d7a3-0f7a-4fd3-9a00-13a40d8f7115 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:20.291547 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c9b5d7a3-0f7a-4fd3-9a00-13a40d8f7115 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:20.300342 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c9b5d7a3-0f7a-4fd3-9a00-13a40d8f7115 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1696 microversion: 2.1 time: 0.185574 Oct 18 14:48:20.313229 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3759/7715] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:20 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:21.325032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-55dd3fe1-cef4-44b6-a74a-0b7170cd030c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:21.325942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-55dd3fe1-cef4-44b6-a74a-0b7170cd030c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:21.336010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55dd3fe1-cef4-44b6-a74a-0b7170cd030c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:21.336525 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55dd3fe1-cef4-44b6-a74a-0b7170cd030c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:21.336984 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55dd3fe1-cef4-44b6-a74a-0b7170cd030c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:21.337760 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55dd3fe1-cef4-44b6-a74a-0b7170cd030c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:21.338237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55dd3fe1-cef4-44b6-a74a-0b7170cd030c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:21.338683 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-55dd3fe1-cef4-44b6-a74a-0b7170cd030c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:21.492217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-55dd3fe1-cef4-44b6-a74a-0b7170cd030c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:21.504540 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-55dd3fe1-cef4-44b6-a74a-0b7170cd030c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1696 microversion: 2.1 time: 0.182891 Oct 18 14:48:21.505205 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3957/7716] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:21 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:22.532430 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-289fca4b-9ffe-4a1b-aa4a-30945b0a390c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:22.533277 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-289fca4b-9ffe-4a1b-aa4a-30945b0a390c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:22.541256 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-289fca4b-9ffe-4a1b-aa4a-30945b0a390c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:22.542132 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-289fca4b-9ffe-4a1b-aa4a-30945b0a390c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:22.542828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-289fca4b-9ffe-4a1b-aa4a-30945b0a390c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:22.543603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-289fca4b-9ffe-4a1b-aa4a-30945b0a390c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:22.544299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-289fca4b-9ffe-4a1b-aa4a-30945b0a390c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:22.545100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-289fca4b-9ffe-4a1b-aa4a-30945b0a390c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:22.756836 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-289fca4b-9ffe-4a1b-aa4a-30945b0a390c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:22.765648 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-289fca4b-9ffe-4a1b-aa4a-30945b0a390c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1696 microversion: 2.1 time: 0.238257 Oct 18 14:48:22.772609 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3760/7717] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:22 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1696 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:23.789356 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-0513429a-785a-43e1-95cd-d66eef26f64a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:23.790115 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-0513429a-785a-43e1-95cd-d66eef26f64a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:23.798004 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0513429a-785a-43e1-95cd-d66eef26f64a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:23.798519 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0513429a-785a-43e1-95cd-d66eef26f64a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:23.798976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0513429a-785a-43e1-95cd-d66eef26f64a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:23.799731 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0513429a-785a-43e1-95cd-d66eef26f64a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:23.800206 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0513429a-785a-43e1-95cd-d66eef26f64a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:23.800651 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-0513429a-785a-43e1-95cd-d66eef26f64a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:23.977646 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-0513429a-785a-43e1-95cd-d66eef26f64a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:23.987923 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-0513429a-785a-43e1-95cd-d66eef26f64a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1696 microversion: 2.1 time: 0.202544 Oct 18 14:48:23.988701 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3958/7718] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:23 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1696 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:48:25.012424 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-eb576bb7-ff6b-4df5-a3ce-f6d7d6bae7bc tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:25.013047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-eb576bb7-ff6b-4df5-a3ce-f6d7d6bae7bc tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:25.020829 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb576bb7-ff6b-4df5-a3ce-f6d7d6bae7bc tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:25.021420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb576bb7-ff6b-4df5-a3ce-f6d7d6bae7bc tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:25.021925 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb576bb7-ff6b-4df5-a3ce-f6d7d6bae7bc tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:25.022625 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb576bb7-ff6b-4df5-a3ce-f6d7d6bae7bc tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:25.023079 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb576bb7-ff6b-4df5-a3ce-f6d7d6bae7bc tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:25.023501 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-eb576bb7-ff6b-4df5-a3ce-f6d7d6bae7bc tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:25.167706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-eb576bb7-ff6b-4df5-a3ce-f6d7d6bae7bc tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:25.175621 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-eb576bb7-ff6b-4df5-a3ce-f6d7d6bae7bc tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1696 microversion: 2.1 time: 0.167093 Oct 18 14:48:25.176205 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3761/7719] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:25 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:26.199529 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f910053-4804-4988-b460-d5e67de53171 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:26.200187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9f910053-4804-4988-b460-d5e67de53171 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:26.207877 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f910053-4804-4988-b460-d5e67de53171 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:26.208374 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f910053-4804-4988-b460-d5e67de53171 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:26.208861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f910053-4804-4988-b460-d5e67de53171 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:26.209641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f910053-4804-4988-b460-d5e67de53171 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:26.210107 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f910053-4804-4988-b460-d5e67de53171 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:26.210544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f910053-4804-4988-b460-d5e67de53171 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:26.349776 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9f910053-4804-4988-b460-d5e67de53171 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:26.359252 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9f910053-4804-4988-b460-d5e67de53171 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1678 microversion: 2.1 time: 0.163630 Oct 18 14:48:26.359862 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3959/7720] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:26 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:27.382972 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-81136394-5289-48e4-8c28-11e93299731b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:27.383607 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-81136394-5289-48e4-8c28-11e93299731b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:27.390966 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81136394-5289-48e4-8c28-11e93299731b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:27.391437 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81136394-5289-48e4-8c28-11e93299731b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:27.391864 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81136394-5289-48e4-8c28-11e93299731b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:27.392540 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81136394-5289-48e4-8c28-11e93299731b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:27.392984 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81136394-5289-48e4-8c28-11e93299731b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:27.393425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-81136394-5289-48e4-8c28-11e93299731b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:27.525941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-81136394-5289-48e4-8c28-11e93299731b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:27.534307 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-81136394-5289-48e4-8c28-11e93299731b tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1678 microversion: 2.1 time: 0.155147 Oct 18 14:48:27.534905 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3762/7721] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:27 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:28.558548 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-67a008bb-2b03-4e86-8926-8cb1e1241fac tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:28.559178 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-67a008bb-2b03-4e86-8926-8cb1e1241fac tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:28.567528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67a008bb-2b03-4e86-8926-8cb1e1241fac tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.568029 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67a008bb-2b03-4e86-8926-8cb1e1241fac tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.568476 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67a008bb-2b03-4e86-8926-8cb1e1241fac tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.569204 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67a008bb-2b03-4e86-8926-8cb1e1241fac tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.569677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67a008bb-2b03-4e86-8926-8cb1e1241fac tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.570117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-67a008bb-2b03-4e86-8926-8cb1e1241fac tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.704491 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-67a008bb-2b03-4e86-8926-8cb1e1241fac tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:28.712312 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-67a008bb-2b03-4e86-8926-8cb1e1241fac tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1621 microversion: 2.1 time: 0.157744 Oct 18 14:48:28.712897 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3960/7722] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:28 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1621 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:28.736852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-01a20c2e-7e9f-4927-bc17-48db7214b8f0 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:48:28.737511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-01a20c2e-7e9f-4927-bc17-48db7214b8f0 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:28.744329 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01a20c2e-7e9f-4927-bc17-48db7214b8f0 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.744811 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01a20c2e-7e9f-4927-bc17-48db7214b8f0 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.745275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01a20c2e-7e9f-4927-bc17-48db7214b8f0 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.745968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01a20c2e-7e9f-4927-bc17-48db7214b8f0 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.746416 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01a20c2e-7e9f-4927-bc17-48db7214b8f0 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.746840 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-01a20c2e-7e9f-4927-bc17-48db7214b8f0 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.852821 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-01a20c2e-7e9f-4927-bc17-48db7214b8f0 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120612) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 14:48:28.866226 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c6880c4c-59eb-4cf3-8738-c1ae12efb4dd req-df9d32a7-e1d7-4813-8e00-8a199d3f51cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ce1530-8177-40e1-bf88-5505dfec3c04", "name": "network-vif-unplugged", "status": "completed", "tag": "13d56807-2159-40c6-8635-cd491e9a3b3e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:48:28.879391 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c6880c4c-59eb-4cf3-8738-c1ae12efb4dd req-df9d32a7-e1d7-4813-8e00-8a199d3f51cd service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.880191 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c6880c4c-59eb-4cf3-8738-c1ae12efb4dd req-df9d32a7-e1d7-4813-8e00-8a199d3f51cd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.881137 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c6880c4c-59eb-4cf3-8738-c1ae12efb4dd req-df9d32a7-e1d7-4813-8e00-8a199d3f51cd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.894351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.compute.server_external_events [req-c6880c4c-59eb-4cf3-8738-c1ae12efb4dd req-df9d32a7-e1d7-4813-8e00-8a199d3f51cd service nova] Unable to find a host for instance 29ce1530-8177-40e1-bf88-5505dfec3c04. Dropping event network-vif-unplugged {{(pid=120611) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 14:48:28.895426 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c6880c4c-59eb-4cf3-8738-c1ae12efb4dd req-df9d32a7-e1d7-4813-8e00-8a199d3f51cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034354 Oct 18 14:48:28.896421 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3961/7723] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 18 14:48:28.929057 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-01a20c2e-7e9f-4927-bc17-48db7214b8f0 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "POST /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04/action" status: 202 len: 0 microversion: 2.1 time: 0.197414 Oct 18 14:48:28.929723 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3763/7724] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:48:28 2022] POST /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:48:28.938072 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d7728ffc-a68e-4af3-b880-1839f7654c70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:28.938705 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d7728ffc-a68e-4af3-b880-1839f7654c70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:28.944732 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7728ffc-a68e-4af3-b880-1839f7654c70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.945267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7728ffc-a68e-4af3-b880-1839f7654c70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.945725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7728ffc-a68e-4af3-b880-1839f7654c70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:28.946433 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7728ffc-a68e-4af3-b880-1839f7654c70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:28.947231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7728ffc-a68e-4af3-b880-1839f7654c70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:28.947678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d7728ffc-a68e-4af3-b880-1839f7654c70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:29.099462 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d7728ffc-a68e-4af3-b880-1839f7654c70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:29.103099 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:29.108869 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d7728ffc-a68e-4af3-b880-1839f7654c70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1629 microversion: 2.1 time: 0.173993 Oct 18 14:48:29.109774 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3962/7725] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:28 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1629 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:30.134374 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-86e1ad73-ace9-487b-88fd-730d64a53060 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:30.134974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-86e1ad73-ace9-487b-88fd-730d64a53060 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:30.136818 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:30.142210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86e1ad73-ace9-487b-88fd-730d64a53060 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:30.142692 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86e1ad73-ace9-487b-88fd-730d64a53060 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:30.143136 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86e1ad73-ace9-487b-88fd-730d64a53060 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:30.143830 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86e1ad73-ace9-487b-88fd-730d64a53060 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:30.144304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86e1ad73-ace9-487b-88fd-730d64a53060 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:30.144735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-86e1ad73-ace9-487b-88fd-730d64a53060 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:30.149630 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:30.286795 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-86e1ad73-ace9-487b-88fd-730d64a53060 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:30.294680 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-86e1ad73-ace9-487b-88fd-730d64a53060 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.165169 Oct 18 14:48:30.296065 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3764/7726] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:30 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:31.032128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-8edc154e-58d6-4aa3-8f18-ebc0d3b3aa0c req-5bb1339c-2f6d-4737-9bd7-4bb4217913d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ce1530-8177-40e1-bf88-5505dfec3c04", "tag": "13d56807-2159-40c6-8635-cd491e9a3b3e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:48:31.042404 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=33 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:48:31.044903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8edc154e-58d6-4aa3-8f18-ebc0d3b3aa0c req-5bb1339c-2f6d-4737-9bd7-4bb4217913d8 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:31.045493 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8edc154e-58d6-4aa3-8f18-ebc0d3b3aa0c req-5bb1339c-2f6d-4737-9bd7-4bb4217913d8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:31.046050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-8edc154e-58d6-4aa3-8f18-ebc0d3b3aa0c req-5bb1339c-2f6d-4737-9bd7-4bb4217913d8 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:31.059911 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-8edc154e-58d6-4aa3-8f18-ebc0d3b3aa0c req-5bb1339c-2f6d-4737-9bd7-4bb4217913d8 service nova] Creating event network-changed:13d56807-2159-40c6-8635-cd491e9a3b3e for instance 29ce1530-8177-40e1-bf88-5505dfec3c04 on n-h2-858384-13 Oct 18 14:48:31.065687 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-8edc154e-58d6-4aa3-8f18-ebc0d3b3aa0c req-5bb1339c-2f6d-4737-9bd7-4bb4217913d8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037898 Oct 18 14:48:31.066225 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3963/7727] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:48:31.319473 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-462016cf-2cda-4d32-9793-c9e347798471 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:31.320429 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-462016cf-2cda-4d32-9793-c9e347798471 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:31.328263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-462016cf-2cda-4d32-9793-c9e347798471 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:31.328834 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-462016cf-2cda-4d32-9793-c9e347798471 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:31.329309 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-462016cf-2cda-4d32-9793-c9e347798471 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:31.330025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-462016cf-2cda-4d32-9793-c9e347798471 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:31.330477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-462016cf-2cda-4d32-9793-c9e347798471 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:31.330947 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-462016cf-2cda-4d32-9793-c9e347798471 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:31.466507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-462016cf-2cda-4d32-9793-c9e347798471 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:31.474765 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-462016cf-2cda-4d32-9793-c9e347798471 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.159159 Oct 18 14:48:31.475356 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3765/7728] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:31 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:32.501443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-6e45db6d-6144-40b8-bc22-0ccba295b245 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:32.502168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-6e45db6d-6144-40b8-bc22-0ccba295b245 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:32.508730 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e45db6d-6144-40b8-bc22-0ccba295b245 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:32.509257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e45db6d-6144-40b8-bc22-0ccba295b245 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:32.509715 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e45db6d-6144-40b8-bc22-0ccba295b245 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:32.510430 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e45db6d-6144-40b8-bc22-0ccba295b245 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:32.510904 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e45db6d-6144-40b8-bc22-0ccba295b245 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:32.511347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-6e45db6d-6144-40b8-bc22-0ccba295b245 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:32.666009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-6e45db6d-6144-40b8-bc22-0ccba295b245 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:32.675897 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-6e45db6d-6144-40b8-bc22-0ccba295b245 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.179917 Oct 18 14:48:32.677406 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3964/7729] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:32 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:33.704386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-d29b3a83-8b9a-4105-b3e5-33dfc2df702d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:33.705647 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-d29b3a83-8b9a-4105-b3e5-33dfc2df702d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:33.713524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d29b3a83-8b9a-4105-b3e5-33dfc2df702d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:33.714007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d29b3a83-8b9a-4105-b3e5-33dfc2df702d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:33.714438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d29b3a83-8b9a-4105-b3e5-33dfc2df702d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:33.715133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d29b3a83-8b9a-4105-b3e5-33dfc2df702d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:33.715577 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d29b3a83-8b9a-4105-b3e5-33dfc2df702d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:33.715994 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-d29b3a83-8b9a-4105-b3e5-33dfc2df702d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:33.893269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-d29b3a83-8b9a-4105-b3e5-33dfc2df702d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:33.901913 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-d29b3a83-8b9a-4105-b3e5-33dfc2df702d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.202907 Oct 18 14:48:33.917999 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3766/7730] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:33 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:34.940343 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-944451f8-a729-4631-aa93-d7960ca3c1e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:34.941085 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-944451f8-a729-4631-aa93-d7960ca3c1e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:34.950009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-944451f8-a729-4631-aa93-d7960ca3c1e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:34.950598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-944451f8-a729-4631-aa93-d7960ca3c1e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:34.951179 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-944451f8-a729-4631-aa93-d7960ca3c1e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:34.952082 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-944451f8-a729-4631-aa93-d7960ca3c1e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:34.952762 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-944451f8-a729-4631-aa93-d7960ca3c1e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:34.953302 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-944451f8-a729-4631-aa93-d7960ca3c1e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:35.102780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-944451f8-a729-4631-aa93-d7960ca3c1e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:35.111691 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-944451f8-a729-4631-aa93-d7960ca3c1e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.176774 Oct 18 14:48:35.112730 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3965/7731] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:34 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:36.136047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-2dea0a67-800b-49f7-ac0e-8eb5334e2ee8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:36.137351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-2dea0a67-800b-49f7-ac0e-8eb5334e2ee8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:36.146156 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dea0a67-800b-49f7-ac0e-8eb5334e2ee8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:36.146952 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dea0a67-800b-49f7-ac0e-8eb5334e2ee8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:36.147569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dea0a67-800b-49f7-ac0e-8eb5334e2ee8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:36.148500 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dea0a67-800b-49f7-ac0e-8eb5334e2ee8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:36.149381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dea0a67-800b-49f7-ac0e-8eb5334e2ee8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:36.150154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-2dea0a67-800b-49f7-ac0e-8eb5334e2ee8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:36.313515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-2dea0a67-800b-49f7-ac0e-8eb5334e2ee8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:36.323331 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-2dea0a67-800b-49f7-ac0e-8eb5334e2ee8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.190932 Oct 18 14:48:36.324240 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3767/7732] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:36 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:37.349571 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-73c5ca23-fa78-4b5b-a58b-41289ef2678d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:37.350237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-73c5ca23-fa78-4b5b-a58b-41289ef2678d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:37.357429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73c5ca23-fa78-4b5b-a58b-41289ef2678d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:37.358697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73c5ca23-fa78-4b5b-a58b-41289ef2678d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:37.359647 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73c5ca23-fa78-4b5b-a58b-41289ef2678d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:37.360468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73c5ca23-fa78-4b5b-a58b-41289ef2678d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:37.361010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73c5ca23-fa78-4b5b-a58b-41289ef2678d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:37.361818 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-73c5ca23-fa78-4b5b-a58b-41289ef2678d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:37.516754 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-73c5ca23-fa78-4b5b-a58b-41289ef2678d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:37.527331 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-73c5ca23-fa78-4b5b-a58b-41289ef2678d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.181498 Oct 18 14:48:37.531635 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3966/7733] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:37 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:38.559356 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-90c8cded-de84-4934-a4b7-f32933bd657e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:38.560344 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-90c8cded-de84-4934-a4b7-f32933bd657e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:38.577632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90c8cded-de84-4934-a4b7-f32933bd657e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:38.578432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90c8cded-de84-4934-a4b7-f32933bd657e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:38.579099 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90c8cded-de84-4934-a4b7-f32933bd657e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:38.580043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90c8cded-de84-4934-a4b7-f32933bd657e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:38.580712 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90c8cded-de84-4934-a4b7-f32933bd657e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:38.581401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90c8cded-de84-4934-a4b7-f32933bd657e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:38.731772 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-90c8cded-de84-4934-a4b7-f32933bd657e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:38.740837 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-90c8cded-de84-4934-a4b7-f32933bd657e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.185523 Oct 18 14:48:38.741444 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3768/7734] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:38 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:39.764821 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-fe0f967b-d467-42ef-a759-252f9fd83264 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:39.765528 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-fe0f967b-d467-42ef-a759-252f9fd83264 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:39.772700 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe0f967b-d467-42ef-a759-252f9fd83264 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:39.773239 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe0f967b-d467-42ef-a759-252f9fd83264 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:39.773698 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe0f967b-d467-42ef-a759-252f9fd83264 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:39.774426 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe0f967b-d467-42ef-a759-252f9fd83264 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:39.774901 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe0f967b-d467-42ef-a759-252f9fd83264 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:39.775348 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-fe0f967b-d467-42ef-a759-252f9fd83264 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:39.971052 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-fe0f967b-d467-42ef-a759-252f9fd83264 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:39.979136 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-fe0f967b-d467-42ef-a759-252f9fd83264 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.218856 Oct 18 14:48:39.979745 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3967/7735] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:39 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:41.002716 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-380563e0-d887-488c-9d14-d75f9c2953cd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:41.003323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-380563e0-d887-488c-9d14-d75f9c2953cd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:41.010225 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-380563e0-d887-488c-9d14-d75f9c2953cd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:41.010701 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-380563e0-d887-488c-9d14-d75f9c2953cd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:41.011133 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-380563e0-d887-488c-9d14-d75f9c2953cd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:41.011816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-380563e0-d887-488c-9d14-d75f9c2953cd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:41.012263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-380563e0-d887-488c-9d14-d75f9c2953cd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:41.012685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-380563e0-d887-488c-9d14-d75f9c2953cd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:41.149006 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-380563e0-d887-488c-9d14-d75f9c2953cd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:41.157319 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-380563e0-d887-488c-9d14-d75f9c2953cd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.159167 Oct 18 14:48:41.157909 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3769/7736] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:40 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:42.180399 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-be4cd8a4-1a72-426a-a1ba-6d4294466fe3 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:42.181032 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-be4cd8a4-1a72-426a-a1ba-6d4294466fe3 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:42.188148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be4cd8a4-1a72-426a-a1ba-6d4294466fe3 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:42.188594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be4cd8a4-1a72-426a-a1ba-6d4294466fe3 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:42.189053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be4cd8a4-1a72-426a-a1ba-6d4294466fe3 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:42.189881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be4cd8a4-1a72-426a-a1ba-6d4294466fe3 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:42.190357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be4cd8a4-1a72-426a-a1ba-6d4294466fe3 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:42.190825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-be4cd8a4-1a72-426a-a1ba-6d4294466fe3 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:42.327074 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-be4cd8a4-1a72-426a-a1ba-6d4294466fe3 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:42.334988 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-be4cd8a4-1a72-426a-a1ba-6d4294466fe3 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.158499 Oct 18 14:48:42.335581 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3968/7737] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:42 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:43.360402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-dbfb99cd-83a2-47a5-b709-5f5a292dc6ec tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:43.360973 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-dbfb99cd-83a2-47a5-b709-5f5a292dc6ec tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:43.367785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbfb99cd-83a2-47a5-b709-5f5a292dc6ec tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:43.368262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbfb99cd-83a2-47a5-b709-5f5a292dc6ec tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:43.368694 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbfb99cd-83a2-47a5-b709-5f5a292dc6ec tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:43.369414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbfb99cd-83a2-47a5-b709-5f5a292dc6ec tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:43.369866 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbfb99cd-83a2-47a5-b709-5f5a292dc6ec tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:43.370290 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-dbfb99cd-83a2-47a5-b709-5f5a292dc6ec tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:43.768091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-dbfb99cd-83a2-47a5-b709-5f5a292dc6ec tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:43.776563 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-dbfb99cd-83a2-47a5-b709-5f5a292dc6ec tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.420506 Oct 18 14:48:43.777252 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3770/7738] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:43 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:48:44.448438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-c810bd83-ce1c-44d7-8e1e-0badf62e907e req-139ef5f7-73a2-4151-9e7d-540dde81cad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ce1530-8177-40e1-bf88-5505dfec3c04", "name": "network-vif-plugged", "status": "completed", "tag": "13d56807-2159-40c6-8635-cd491e9a3b3e"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:48:44.460742 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c810bd83-ce1c-44d7-8e1e-0badf62e907e req-139ef5f7-73a2-4151-9e7d-540dde81cad2 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:44.461357 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c810bd83-ce1c-44d7-8e1e-0badf62e907e req-139ef5f7-73a2-4151-9e7d-540dde81cad2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:44.461869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-c810bd83-ce1c-44d7-8e1e-0badf62e907e req-139ef5f7-73a2-4151-9e7d-540dde81cad2 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:44.474686 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-c810bd83-ce1c-44d7-8e1e-0badf62e907e req-139ef5f7-73a2-4151-9e7d-540dde81cad2 service nova] Creating event network-vif-plugged:13d56807-2159-40c6-8635-cd491e9a3b3e for instance 29ce1530-8177-40e1-bf88-5505dfec3c04 on n-h2-858384-13 Oct 18 14:48:44.480246 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-c810bd83-ce1c-44d7-8e1e-0badf62e907e req-139ef5f7-73a2-4151-9e7d-540dde81cad2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035689 Oct 18 14:48:44.481115 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3969/7739] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:48:44.800489 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-703d656f-e283-4100-8eb7-6c2b1adf1ec8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:44.801122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-703d656f-e283-4100-8eb7-6c2b1adf1ec8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:44.807949 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-703d656f-e283-4100-8eb7-6c2b1adf1ec8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:44.808428 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-703d656f-e283-4100-8eb7-6c2b1adf1ec8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:44.808859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-703d656f-e283-4100-8eb7-6c2b1adf1ec8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:44.809598 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-703d656f-e283-4100-8eb7-6c2b1adf1ec8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:44.810053 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-703d656f-e283-4100-8eb7-6c2b1adf1ec8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:44.810477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-703d656f-e283-4100-8eb7-6c2b1adf1ec8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:44.945443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-703d656f-e283-4100-8eb7-6c2b1adf1ec8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:44.954091 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-703d656f-e283-4100-8eb7-6c2b1adf1ec8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.157424 Oct 18 14:48:44.954655 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3771/7740] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:44 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:45.979784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a4f2e9d8-6c8f-41c0-9ed3-39513b85b89c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:45.980512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a4f2e9d8-6c8f-41c0-9ed3-39513b85b89c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:45.988186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f2e9d8-6c8f-41c0-9ed3-39513b85b89c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:45.988692 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f2e9d8-6c8f-41c0-9ed3-39513b85b89c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:45.989149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f2e9d8-6c8f-41c0-9ed3-39513b85b89c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:45.989893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f2e9d8-6c8f-41c0-9ed3-39513b85b89c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:45.990366 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f2e9d8-6c8f-41c0-9ed3-39513b85b89c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:45.990811 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a4f2e9d8-6c8f-41c0-9ed3-39513b85b89c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:46.130231 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a4f2e9d8-6c8f-41c0-9ed3-39513b85b89c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:46.138664 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a4f2e9d8-6c8f-41c0-9ed3-39513b85b89c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1687 microversion: 2.1 time: 0.164165 Oct 18 14:48:46.139560 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3970/7741] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:45 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:48:47.163059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8c70472a-0d1f-44f8-af60-fa905ea5dbc7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:48:47.163666 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8c70472a-0d1f-44f8-af60-fa905ea5dbc7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:48:47.171262 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c70472a-0d1f-44f8-af60-fa905ea5dbc7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:47.171737 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c70472a-0d1f-44f8-af60-fa905ea5dbc7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:47.172170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c70472a-0d1f-44f8-af60-fa905ea5dbc7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:47.172851 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c70472a-0d1f-44f8-af60-fa905ea5dbc7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:48:47.173325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c70472a-0d1f-44f8-af60-fa905ea5dbc7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:48:47.173742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8c70472a-0d1f-44f8-af60-fa905ea5dbc7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:48:47.313483 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8c70472a-0d1f-44f8-af60-fa905ea5dbc7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:48:47.321279 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8c70472a-0d1f-44f8-af60-fa905ea5dbc7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1674 microversion: 2.1 time: 0.162474 Oct 18 14:48:47.321848 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3772/7742] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:48:47 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:01.012443 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-cbb0cae4-1c73-4fc9-988c-825528d0ea44 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:01.013582 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cbb0cae4-1c73-4fc9-988c-825528d0ea44 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:01.014287 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=17 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:01.015440 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=53 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:01.017089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=15 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:01.018202 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=40 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:01.019687 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:50:01.020216 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:50:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 (ip 10.222.0.40) !!! Oct 18 14:50:01.034201 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbb0cae4-1c73-4fc9-988c-825528d0ea44 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:01.035021 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbb0cae4-1c73-4fc9-988c-825528d0ea44 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:01.035664 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbb0cae4-1c73-4fc9-988c-825528d0ea44 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:01.036395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbb0cae4-1c73-4fc9-988c-825528d0ea44 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:01.036869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbb0cae4-1c73-4fc9-988c-825528d0ea44 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:01.037349 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-cbb0cae4-1c73-4fc9-988c-825528d0ea44 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:01.066780 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-cbb0cae4-1c73-4fc9-988c-825528d0ea44 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:50:01.087081 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-fb8aeb68-c9a0-49c0-8165-49ed8bd8d184 req-88069cba-8c27-4ab9-b6ad-bb6773392a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ce1530-8177-40e1-bf88-5505dfec3c04", "tag": "13d56807-2159-40c6-8635-cd491e9a3b3e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:01.102479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fb8aeb68-c9a0-49c0-8165-49ed8bd8d184 req-88069cba-8c27-4ab9-b6ad-bb6773392a0c service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:01.103077 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fb8aeb68-c9a0-49c0-8165-49ed8bd8d184 req-88069cba-8c27-4ab9-b6ad-bb6773392a0c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:01.103576 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fb8aeb68-c9a0-49c0-8165-49ed8bd8d184 req-88069cba-8c27-4ab9-b6ad-bb6773392a0c service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:01.117223 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-fb8aeb68-c9a0-49c0-8165-49ed8bd8d184 req-88069cba-8c27-4ab9-b6ad-bb6773392a0c service nova] Creating event network-changed:13d56807-2159-40c6-8635-cd491e9a3b3e for instance 29ce1530-8177-40e1-bf88-5505dfec3c04 on n-h2-858384-13 Oct 18 14:50:01.125801 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-fb8aeb68-c9a0-49c0-8165-49ed8bd8d184 req-88069cba-8c27-4ab9-b6ad-bb6773392a0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114861 Oct 18 14:50:01.129399 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3773/7743] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:50:01.159929 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-cbb0cae4-1c73-4fc9-988c-825528d0ea44 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "DELETE /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 204 len: 0 microversion: 2.1 time: 0.152213 Oct 18 14:50:01.161539 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3971/7744] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:50:01 2022] DELETE /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:50:01.177047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cc4d5ada-e100-4090-bab1-4b0c73df806a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:01.177891 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cc4d5ada-e100-4090-bab1-4b0c73df806a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:01.185338 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4d5ada-e100-4090-bab1-4b0c73df806a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:01.185839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4d5ada-e100-4090-bab1-4b0c73df806a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:01.187257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4d5ada-e100-4090-bab1-4b0c73df806a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:01.187983 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4d5ada-e100-4090-bab1-4b0c73df806a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:01.189028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4d5ada-e100-4090-bab1-4b0c73df806a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:01.189028 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc4d5ada-e100-4090-bab1-4b0c73df806a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:01.330284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cc4d5ada-e100-4090-bab1-4b0c73df806a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:01.338616 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cc4d5ada-e100-4090-bab1-4b0c73df806a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1680 microversion: 2.1 time: 0.172404 Oct 18 14:50:01.339349 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3774/7745] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:01 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:02.364865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f857c866-c9ac-4edc-a3b5-722c4ded2141 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:02.365613 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f857c866-c9ac-4edc-a3b5-722c4ded2141 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:02.373650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f857c866-c9ac-4edc-a3b5-722c4ded2141 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:02.374149 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f857c866-c9ac-4edc-a3b5-722c4ded2141 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:02.374600 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f857c866-c9ac-4edc-a3b5-722c4ded2141 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:02.375310 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f857c866-c9ac-4edc-a3b5-722c4ded2141 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:02.375774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f857c866-c9ac-4edc-a3b5-722c4ded2141 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:02.376215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f857c866-c9ac-4edc-a3b5-722c4ded2141 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:02.608005 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f857c866-c9ac-4edc-a3b5-722c4ded2141 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:02.617169 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f857c866-c9ac-4edc-a3b5-722c4ded2141 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 200 len: 1680 microversion: 2.1 time: 0.256842 Oct 18 14:50:02.619492 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3972/7746] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:02 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 1680 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:02.978635 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-83cad615-ff4c-4cb8-a464-f9940f4ab2fe req-1459881f-b7f7-4f91-88a8-3945bace7897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ce1530-8177-40e1-bf88-5505dfec3c04", "name": "network-vif-deleted", "tag": "13d56807-2159-40c6-8635-cd491e9a3b3e"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:02.989816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-83cad615-ff4c-4cb8-a464-f9940f4ab2fe req-1459881f-b7f7-4f91-88a8-3945bace7897 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:02.990298 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-83cad615-ff4c-4cb8-a464-f9940f4ab2fe req-1459881f-b7f7-4f91-88a8-3945bace7897 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:02.990733 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-83cad615-ff4c-4cb8-a464-f9940f4ab2fe req-1459881f-b7f7-4f91-88a8-3945bace7897 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:03.004177 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-83cad615-ff4c-4cb8-a464-f9940f4ab2fe req-1459881f-b7f7-4f91-88a8-3945bace7897 service nova] Creating event network-vif-deleted:13d56807-2159-40c6-8635-cd491e9a3b3e for instance 29ce1530-8177-40e1-bf88-5505dfec3c04 on n-h2-858384-13 Oct 18 14:50:03.010424 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-83cad615-ff4c-4cb8-a464-f9940f4ab2fe req-1459881f-b7f7-4f91-88a8-3945bace7897 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097864 Oct 18 14:50:03.011062 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3775/7747] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:50:03.643329 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7851a567-e2ae-4986-b70a-c94b1dfb647d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:03.643938 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7851a567-e2ae-4986-b70a-c94b1dfb647d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: 29ce1530-8177-40e1-bf88-5505dfec3c04] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:03.650880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7851a567-e2ae-4986-b70a-c94b1dfb647d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:03.651380 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7851a567-e2ae-4986-b70a-c94b1dfb647d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:03.652544 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7851a567-e2ae-4986-b70a-c94b1dfb647d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:03.653047 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7851a567-e2ae-4986-b70a-c94b1dfb647d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:03.653536 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7851a567-e2ae-4986-b70a-c94b1dfb647d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:03.653974 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7851a567-e2ae-4986-b70a-c94b1dfb647d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:03.667229 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-7851a567-e2ae-4986-b70a-c94b1dfb647d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] HTTP exception thrown: Instance 29ce1530-8177-40e1-bf88-5505dfec3c04 could not be found. Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7851a567-e2ae-4986-b70a-c94b1dfb647d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Request method failure captured: Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 HTTP/1.1 Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTrv28e2vY_wG1gsIMVSLrV3pWCKIYiNmfOJLOJC-yD3GNt2g3foTLxeE90yZrlJeSjI1dQIDVkNXWF0vfrRnozigJyTClZhMO_qhrhHOvp_cvgWL5h7xYCZtQYlKfObCYJmrdRBy8xPDO3vxmaBPUSJ4wv5G40JPL25PU2cRKuRbQfo Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: c5722398932444338ab8ea5e0d1c0cc6 Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestShelveInstance-492190882 Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5722398932444338ab8ea5e0d1c0cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5722398932444338ab8ea5e0d1c0cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5722398932444338ab8ea5e0d1c0cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5722398932444338ab8ea5e0d1c0cc6"}]}] Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestShelveInstance-492190882 Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: c5722398932444338ab8ea5e0d1c0cc6 Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestShelveInstance-492190882 Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestShelveInstance-492190882-project Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: c9a09467003445b6abfee976c5230cd0 Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestShelveInstance-492190882-project Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 29ce1530-8177-40e1-bf88-5505dfec3c04 could not be found. Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '29ce1530-8177-40e1-bf88-5505dfec3c04'} Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29ce1530-8177-40e1-bf88-5505dfec3c04 could not be found. Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29ce1530-8177-40e1-bf88-5505dfec3c04 could not be found. Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:50:03.669802 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:50:03.675741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:50:03.675741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:50:03.675741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:50:03.675741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:50:03.675741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:50:03.675741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29ce1530-8177-40e1-bf88-5505dfec3c04 could not be found. Oct 18 14:50:03.675741 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 14:50:03.675741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7851a567-e2ae-4986-b70a-c94b1dfb647d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Returning 404 to user: Instance 29ce1530-8177-40e1-bf88-5505dfec3c04 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:50:03.675741 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7851a567-e2ae-4986-b70a-c94b1dfb647d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04" status: 404 len: 111 microversion: 2.1 time: 0.031939 Oct 18 14:50:03.675741 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3973/7748] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:03 2022] GET /compute/v2.1/servers/29ce1530-8177-40e1-bf88-5505dfec3c04 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:50:03.836950 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-31156dfc-91d3-4698-91d2-01a577649087 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '.version_select at 0x7ff61449ee50>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:03.863637 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-31156dfc-91d3-4698-91d2-01a577649087 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1979769310" status: 202 len: 0 microversion: 2.1 time: 0.030593 Oct 18 14:50:03.864393 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3776/7749] 10.222.0.40 () {58 vars in 1254 bytes} [Tue Oct 18 14:50:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1979769310 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 18 14:50:03.882564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-59ccb841-3b38-40f2-b2f7-4a873a2ded60 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Action: 'create', calling method: .version_select at 0x7ff60e400f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-800680519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaXhBBP1jwzg8LrwgsvJ9nTyRGzRkhkAIncvvWYrKioxshgQgmHKZi7m5lYiFxUrAeRxRw5TjvExi7TVTwNuuMlUW10tXvZLMSdeiNd8GzJNSqnkA03lqlLZBNGvQiZTw=="}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:03.899036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-59ccb841-3b38-40f2-b2f7-4a873a2ded60 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Getting quotas for project c5722398932444338ab8ea5e0d1c0cc6. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:50:03.904968 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-59ccb841-3b38-40f2-b2f7-4a873a2ded60 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Getting quotas for user c9a09467003445b6abfee976c5230cd0 and project c5722398932444338ab8ea5e0d1c0cc6. Resources: {'key_pairs'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:50:03.931549 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-59ccb841-3b38-40f2-b2f7-4a873a2ded60 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.052937 Oct 18 14:50:03.932156 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3974/7750] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:50:03 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:50:20.310323 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1531061912", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-800680519", "security_groups": [{"name": "tempest-secgroup-smoke-1008919565"}], "networks": [{"uuid": "9a8229a8-5737-4b29-bb71-c0b631a19379"}], "block_device_mapping_v2": [{"uuid": "fc01c273-e60b-4067-a194-85d50c3254f9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:20.321875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=10 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:20.322456 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:20.426140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.network.neutron [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] validate_networks() for [('9a8229a8-5737-4b29-bb71-c0b631a19379', None, None, None, None, None)] {{(pid=120612) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:50:20.804889 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Flavor limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:50:20.805347 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Image limits 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:50:20.805863 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Flavor pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:50:20.806236 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Image pref 0:0:0 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:50:20.806645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.virt.hardware [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:50:20.815715 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:20.816192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:20.816629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:20.817392 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:20.817841 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:20.818268 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:20.837617 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Getting quotas for project c5722398932444338ab8ea5e0d1c0cc6. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:50:20.843425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Getting quotas for user c9a09467003445b6abfee976c5230cd0 and project c5722398932444338ab8ea5e0d1c0cc6. Resources: {'ram', 'instances', 'cores'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:50:20.900936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Going to run 1 instances... {{(pid=120612) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:50:20.904490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc01c273-e60b-4067-a194-85d50c3254f9',volume_size=None,volume_type=None)] {{(pid=120612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:50:21.032861 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-4115c377-fba1-4616-a405-98d03f2213fd tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.727004 Oct 18 14:50:21.033541 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3777/7751] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:50:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:50:21.042607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:21.043827 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=4 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:21.044569 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:21.049042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-3ab7b11c-acf3-4b67-b433-ac530a1a9d70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:21.049691 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-3ab7b11c-acf3-4b67-b433-ac530a1a9d70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:21.112587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-3ab7b11c-acf3-4b67-b433-ac530a1a9d70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:21.120274 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-3ab7b11c-acf3-4b67-b433-ac530a1a9d70 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1088 microversion: 2.1 time: 0.079286 Oct 18 14:50:21.121215 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3975/7752] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:21 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:22.146283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-735bcd0b-e1b1-4334-9d60-4205094835b1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:22.147391 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-735bcd0b-e1b1-4334-9d60-4205094835b1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:22.154792 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-735bcd0b-e1b1-4334-9d60-4205094835b1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:22.155269 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-735bcd0b-e1b1-4334-9d60-4205094835b1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:22.155696 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-735bcd0b-e1b1-4334-9d60-4205094835b1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:22.156382 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-735bcd0b-e1b1-4334-9d60-4205094835b1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:22.156833 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-735bcd0b-e1b1-4334-9d60-4205094835b1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:22.157283 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-735bcd0b-e1b1-4334-9d60-4205094835b1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:22.250122 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-735bcd0b-e1b1-4334-9d60-4205094835b1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:22.274736 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-735bcd0b-e1b1-4334-9d60-4205094835b1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1186 microversion: 2.1 time: 0.134103 Oct 18 14:50:22.275688 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3778/7753] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:22 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1186 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:50:23.308200 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-459182c4-b328-438f-bf63-0e7bd6eb8f2a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:23.309711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-459182c4-b328-438f-bf63-0e7bd6eb8f2a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:23.317736 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-459182c4-b328-438f-bf63-0e7bd6eb8f2a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:23.318344 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-459182c4-b328-438f-bf63-0e7bd6eb8f2a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:23.319116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-459182c4-b328-438f-bf63-0e7bd6eb8f2a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:23.320063 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-459182c4-b328-438f-bf63-0e7bd6eb8f2a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:23.320785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-459182c4-b328-438f-bf63-0e7bd6eb8f2a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:23.321449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-459182c4-b328-438f-bf63-0e7bd6eb8f2a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:23.504076 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-459182c4-b328-438f-bf63-0e7bd6eb8f2a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:23.513569 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-459182c4-b328-438f-bf63-0e7bd6eb8f2a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1272 microversion: 2.1 time: 0.209846 Oct 18 14:50:23.514406 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3976/7754] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:23 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:24.040163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-8bb0266f-654c-4ee2-8eac-57dcb7bb1b00 req-e4aa6e4f-37b7-45d6-b728-89191632a1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a199dc98-f207-43ff-a653-55cd6c1927e9", "tag": "dd35dfd0-d1d5-46b4-a288-bdc5d4d8a4e0"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:24.053257 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8bb0266f-654c-4ee2-8eac-57dcb7bb1b00 req-e4aa6e4f-37b7-45d6-b728-89191632a1e6 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:24.054074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8bb0266f-654c-4ee2-8eac-57dcb7bb1b00 req-e4aa6e4f-37b7-45d6-b728-89191632a1e6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:24.054741 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8bb0266f-654c-4ee2-8eac-57dcb7bb1b00 req-e4aa6e4f-37b7-45d6-b728-89191632a1e6 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:24.070368 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-8bb0266f-654c-4ee2-8eac-57dcb7bb1b00 req-e4aa6e4f-37b7-45d6-b728-89191632a1e6 service nova] Creating event network-changed:dd35dfd0-d1d5-46b4-a288-bdc5d4d8a4e0 for instance a199dc98-f207-43ff-a653-55cd6c1927e9 on n-h1-858384-13 Oct 18 14:50:24.085479 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-8bb0266f-654c-4ee2-8eac-57dcb7bb1b00 req-e4aa6e4f-37b7-45d6-b728-89191632a1e6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050001 Oct 18 14:50:24.086393 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3779/7755] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:50:24.537395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9f3a66a5-518f-4e52-88e8-095f8a976306 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:24.538174 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9f3a66a5-518f-4e52-88e8-095f8a976306 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:24.546050 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f3a66a5-518f-4e52-88e8-095f8a976306 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:24.546481 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f3a66a5-518f-4e52-88e8-095f8a976306 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:24.546931 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f3a66a5-518f-4e52-88e8-095f8a976306 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:24.548042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f3a66a5-518f-4e52-88e8-095f8a976306 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:24.548516 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f3a66a5-518f-4e52-88e8-095f8a976306 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:24.549053 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9f3a66a5-518f-4e52-88e8-095f8a976306 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:24.703980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9f3a66a5-518f-4e52-88e8-095f8a976306 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:24.713571 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9f3a66a5-518f-4e52-88e8-095f8a976306 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1272 microversion: 2.1 time: 0.180178 Oct 18 14:50:24.714326 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3977/7756] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:24 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:25.739066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-9eb556d6-cc62-458f-ab3d-def301ba831d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:25.739761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-9eb556d6-cc62-458f-ab3d-def301ba831d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:25.746957 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eb556d6-cc62-458f-ab3d-def301ba831d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:25.747443 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eb556d6-cc62-458f-ab3d-def301ba831d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:25.747882 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eb556d6-cc62-458f-ab3d-def301ba831d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:25.748581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eb556d6-cc62-458f-ab3d-def301ba831d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:25.749086 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eb556d6-cc62-458f-ab3d-def301ba831d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:25.749523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-9eb556d6-cc62-458f-ab3d-def301ba831d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:25.889571 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-9eb556d6-cc62-458f-ab3d-def301ba831d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:25.897740 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-9eb556d6-cc62-458f-ab3d-def301ba831d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1272 microversion: 2.1 time: 0.163807 Oct 18 14:50:25.898328 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3780/7757] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:25 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:26.921010 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-00eb79ad-15e1-4a74-ba40-6424a105fef5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:26.921903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-00eb79ad-15e1-4a74-ba40-6424a105fef5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:26.929483 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00eb79ad-15e1-4a74-ba40-6424a105fef5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:26.930088 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00eb79ad-15e1-4a74-ba40-6424a105fef5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:26.930629 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00eb79ad-15e1-4a74-ba40-6424a105fef5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:26.931441 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00eb79ad-15e1-4a74-ba40-6424a105fef5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:26.932227 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00eb79ad-15e1-4a74-ba40-6424a105fef5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:26.933257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-00eb79ad-15e1-4a74-ba40-6424a105fef5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:27.087741 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-00eb79ad-15e1-4a74-ba40-6424a105fef5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:27.098960 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-00eb79ad-15e1-4a74-ba40-6424a105fef5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1272 microversion: 2.1 time: 0.181352 Oct 18 14:50:27.099394 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3978/7758] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:26 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:28.124189 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-caf436ff-86fb-4120-8230-cdad4689cf58 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:28.124799 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-caf436ff-86fb-4120-8230-cdad4689cf58 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:28.131693 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caf436ff-86fb-4120-8230-cdad4689cf58 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:28.132173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caf436ff-86fb-4120-8230-cdad4689cf58 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:28.132610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caf436ff-86fb-4120-8230-cdad4689cf58 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:28.133331 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caf436ff-86fb-4120-8230-cdad4689cf58 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:28.133785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caf436ff-86fb-4120-8230-cdad4689cf58 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:28.134211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-caf436ff-86fb-4120-8230-cdad4689cf58 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:28.272893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-caf436ff-86fb-4120-8230-cdad4689cf58 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:28.281483 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-caf436ff-86fb-4120-8230-cdad4689cf58 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1260 microversion: 2.1 time: 0.161261 Oct 18 14:50:28.282069 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3781/7759] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:28 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:29.305949 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-04e7312a-db30-4fae-af56-9305bda7dd73 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:29.306584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-04e7312a-db30-4fae-af56-9305bda7dd73 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:29.314311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04e7312a-db30-4fae-af56-9305bda7dd73 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:29.314817 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04e7312a-db30-4fae-af56-9305bda7dd73 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:29.315274 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04e7312a-db30-4fae-af56-9305bda7dd73 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:29.315987 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04e7312a-db30-4fae-af56-9305bda7dd73 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:29.316463 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04e7312a-db30-4fae-af56-9305bda7dd73 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:29.316909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-04e7312a-db30-4fae-af56-9305bda7dd73 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:29.453037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-04e7312a-db30-4fae-af56-9305bda7dd73 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:29.460831 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-04e7312a-db30-4fae-af56-9305bda7dd73 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1260 microversion: 2.1 time: 0.158896 Oct 18 14:50:29.461444 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3979/7760] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:29 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:30.483245 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0e1a6d1a-21bc-4f25-910f-bcd5515610c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:30.483859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0e1a6d1a-21bc-4f25-910f-bcd5515610c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:30.490569 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e1a6d1a-21bc-4f25-910f-bcd5515610c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:30.491043 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e1a6d1a-21bc-4f25-910f-bcd5515610c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:30.491474 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e1a6d1a-21bc-4f25-910f-bcd5515610c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:30.492154 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e1a6d1a-21bc-4f25-910f-bcd5515610c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:30.492610 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e1a6d1a-21bc-4f25-910f-bcd5515610c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:30.493027 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0e1a6d1a-21bc-4f25-910f-bcd5515610c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:30.625072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0e1a6d1a-21bc-4f25-910f-bcd5515610c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:30.632873 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0e1a6d1a-21bc-4f25-910f-bcd5515610c8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1260 microversion: 2.1 time: 0.153762 Oct 18 14:50:30.633478 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3782/7761] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:30 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:31.657971 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-172eacc6-6a59-4431-b1dc-17be9f6eb0f5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:31.658595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-172eacc6-6a59-4431-b1dc-17be9f6eb0f5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:31.660566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:31.666249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-172eacc6-6a59-4431-b1dc-17be9f6eb0f5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:31.666888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-172eacc6-6a59-4431-b1dc-17be9f6eb0f5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:31.667498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-172eacc6-6a59-4431-b1dc-17be9f6eb0f5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:31.668211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-172eacc6-6a59-4431-b1dc-17be9f6eb0f5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:31.668676 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-172eacc6-6a59-4431-b1dc-17be9f6eb0f5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:31.669113 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-172eacc6-6a59-4431-b1dc-17be9f6eb0f5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:31.803939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-172eacc6-6a59-4431-b1dc-17be9f6eb0f5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:31.811898 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-172eacc6-6a59-4431-b1dc-17be9f6eb0f5 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1260 microversion: 2.1 time: 0.158199 Oct 18 14:50:31.812490 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3980/7762] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:31 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:32.836020 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b0405054-0c3a-448a-9b98-37ce8250be19 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:32.836665 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b0405054-0c3a-448a-9b98-37ce8250be19 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:32.839442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:32.840113 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:50:32.846639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0405054-0c3a-448a-9b98-37ce8250be19 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:32.846857 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0405054-0c3a-448a-9b98-37ce8250be19 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:32.847271 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0405054-0c3a-448a-9b98-37ce8250be19 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:32.848062 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0405054-0c3a-448a-9b98-37ce8250be19 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:32.849212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0405054-0c3a-448a-9b98-37ce8250be19 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:32.849212 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b0405054-0c3a-448a-9b98-37ce8250be19 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:32.992442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b0405054-0c3a-448a-9b98-37ce8250be19 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:33.001075 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b0405054-0c3a-448a-9b98-37ce8250be19 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1260 microversion: 2.1 time: 0.169120 Oct 18 14:50:33.001662 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3783/7763] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:32 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:34.024006 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b94e774f-ecab-49eb-9195-c07b77a7eb8d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:34.024723 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b94e774f-ecab-49eb-9195-c07b77a7eb8d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:34.032593 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b94e774f-ecab-49eb-9195-c07b77a7eb8d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:34.033095 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b94e774f-ecab-49eb-9195-c07b77a7eb8d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:34.033642 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b94e774f-ecab-49eb-9195-c07b77a7eb8d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:34.034367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b94e774f-ecab-49eb-9195-c07b77a7eb8d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:34.034841 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b94e774f-ecab-49eb-9195-c07b77a7eb8d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:34.035283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b94e774f-ecab-49eb-9195-c07b77a7eb8d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:34.175495 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b94e774f-ecab-49eb-9195-c07b77a7eb8d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:34.184223 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b94e774f-ecab-49eb-9195-c07b77a7eb8d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1260 microversion: 2.1 time: 0.164163 Oct 18 14:50:34.184813 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3981/7764] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:34 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:35.208025 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aaa41fff-8ec1-4245-b650-64d9a0b47417 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:35.208661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aaa41fff-8ec1-4245-b650-64d9a0b47417 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:35.216279 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaa41fff-8ec1-4245-b650-64d9a0b47417 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:35.216757 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaa41fff-8ec1-4245-b650-64d9a0b47417 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:35.217204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaa41fff-8ec1-4245-b650-64d9a0b47417 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:35.217892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaa41fff-8ec1-4245-b650-64d9a0b47417 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:35.218341 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaa41fff-8ec1-4245-b650-64d9a0b47417 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:35.218762 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaa41fff-8ec1-4245-b650-64d9a0b47417 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:35.354995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-aaa41fff-8ec1-4245-b650-64d9a0b47417 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:35.362694 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aaa41fff-8ec1-4245-b650-64d9a0b47417 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1260 microversion: 2.1 time: 0.158590 Oct 18 14:50:35.363268 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3784/7765] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:35 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:36.389272 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2496217f-4260-48fe-b90e-3031a4cd41f2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:36.389840 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2496217f-4260-48fe-b90e-3031a4cd41f2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:36.396687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2496217f-4260-48fe-b90e-3031a4cd41f2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:36.397267 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2496217f-4260-48fe-b90e-3031a4cd41f2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:36.397659 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2496217f-4260-48fe-b90e-3031a4cd41f2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:36.398360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2496217f-4260-48fe-b90e-3031a4cd41f2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:36.398825 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2496217f-4260-48fe-b90e-3031a4cd41f2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:36.399260 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2496217f-4260-48fe-b90e-3031a4cd41f2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:36.532235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2496217f-4260-48fe-b90e-3031a4cd41f2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:36.540067 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2496217f-4260-48fe-b90e-3031a4cd41f2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1260 microversion: 2.1 time: 0.154943 Oct 18 14:50:36.540650 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3982/7766] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:36 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:37.563118 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fcfc83a2-d7c3-45f5-9fa5-c0f0a16df25f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:37.563898 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fcfc83a2-d7c3-45f5-9fa5-c0f0a16df25f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:37.570667 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcfc83a2-d7c3-45f5-9fa5-c0f0a16df25f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:37.571146 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcfc83a2-d7c3-45f5-9fa5-c0f0a16df25f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:37.571581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcfc83a2-d7c3-45f5-9fa5-c0f0a16df25f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:37.572278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcfc83a2-d7c3-45f5-9fa5-c0f0a16df25f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:37.573266 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcfc83a2-d7c3-45f5-9fa5-c0f0a16df25f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:37.574016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fcfc83a2-d7c3-45f5-9fa5-c0f0a16df25f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:37.717041 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-fcfc83a2-d7c3-45f5-9fa5-c0f0a16df25f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:37.725910 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fcfc83a2-d7c3-45f5-9fa5-c0f0a16df25f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1260 microversion: 2.1 time: 0.166833 Oct 18 14:50:37.726844 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3785/7767] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:37 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:37.737340 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-5ac57f39-9e65-4c96-90e6-02ad3bd5f87d req-985b6bc7-fdf5-43d2-9582-2da379d38326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a199dc98-f207-43ff-a653-55cd6c1927e9", "name": "network-vif-plugged", "status": "completed", "tag": "dd35dfd0-d1d5-46b4-a288-bdc5d4d8a4e0"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:37.747906 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5ac57f39-9e65-4c96-90e6-02ad3bd5f87d req-985b6bc7-fdf5-43d2-9582-2da379d38326 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:37.748424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5ac57f39-9e65-4c96-90e6-02ad3bd5f87d req-985b6bc7-fdf5-43d2-9582-2da379d38326 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:37.748874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-5ac57f39-9e65-4c96-90e6-02ad3bd5f87d req-985b6bc7-fdf5-43d2-9582-2da379d38326 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:37.759964 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-5ac57f39-9e65-4c96-90e6-02ad3bd5f87d req-985b6bc7-fdf5-43d2-9582-2da379d38326 service nova] Creating event network-vif-plugged:dd35dfd0-d1d5-46b4-a288-bdc5d4d8a4e0 for instance a199dc98-f207-43ff-a653-55cd6c1927e9 on n-h1-858384-13 Oct 18 14:50:37.766114 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-5ac57f39-9e65-4c96-90e6-02ad3bd5f87d req-985b6bc7-fdf5-43d2-9582-2da379d38326 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096936 Oct 18 14:50:37.766771 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3983/7768] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:50:38.749584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cc8d9504-4bb2-4c79-8b3b-eb395114b4eb tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:38.750197 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cc8d9504-4bb2-4c79-8b3b-eb395114b4eb tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:38.757155 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc8d9504-4bb2-4c79-8b3b-eb395114b4eb tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:38.757655 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc8d9504-4bb2-4c79-8b3b-eb395114b4eb tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:38.758089 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc8d9504-4bb2-4c79-8b3b-eb395114b4eb tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:38.758770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc8d9504-4bb2-4c79-8b3b-eb395114b4eb tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:38.759219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc8d9504-4bb2-4c79-8b3b-eb395114b4eb tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:38.759640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cc8d9504-4bb2-4c79-8b3b-eb395114b4eb tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:38.892993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cc8d9504-4bb2-4c79-8b3b-eb395114b4eb tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:38.901420 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cc8d9504-4bb2-4c79-8b3b-eb395114b4eb tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1260 microversion: 2.1 time: 0.155229 Oct 18 14:50:38.902003 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3786/7769] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:38 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:39.926639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-02f16cdb-6a45-48a0-bb5a-c108260a9193 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:39.927351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-02f16cdb-6a45-48a0-bb5a-c108260a9193 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:39.934233 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02f16cdb-6a45-48a0-bb5a-c108260a9193 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:39.934725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02f16cdb-6a45-48a0-bb5a-c108260a9193 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:39.935172 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02f16cdb-6a45-48a0-bb5a-c108260a9193 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:39.935869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02f16cdb-6a45-48a0-bb5a-c108260a9193 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:39.936337 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02f16cdb-6a45-48a0-bb5a-c108260a9193 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:39.936774 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02f16cdb-6a45-48a0-bb5a-c108260a9193 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:40.071424 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-02f16cdb-6a45-48a0-bb5a-c108260a9193 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:40.079378 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-02f16cdb-6a45-48a0-bb5a-c108260a9193 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1443 microversion: 2.1 time: 0.157972 Oct 18 14:50:40.079961 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3984/7770] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:39 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:40.102975 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-177813fe-2e0d-402e-9a05-9bfefce42476 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:50:40.103584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-177813fe-2e0d-402e-9a05-9bfefce42476 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:50:40.111322 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-177813fe-2e0d-402e-9a05-9bfefce42476 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:40.111798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-177813fe-2e0d-402e-9a05-9bfefce42476 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:40.112229 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-177813fe-2e0d-402e-9a05-9bfefce42476 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:40.112910 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-177813fe-2e0d-402e-9a05-9bfefce42476 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:40.113385 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-177813fe-2e0d-402e-9a05-9bfefce42476 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:40.113809 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-177813fe-2e0d-402e-9a05-9bfefce42476 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:40.251327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-177813fe-2e0d-402e-9a05-9bfefce42476 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:50:40.259119 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-177813fe-2e0d-402e-9a05-9bfefce42476 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1443 microversion: 2.1 time: 0.160060 Oct 18 14:50:40.259703 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3787/7771] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:50:40 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:50:42.629117 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-e0d707b6-ceb8-4aca-b578-d5825c83460d req-b0549854-a52c-4541-b0e4-e872f5ec4561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a199dc98-f207-43ff-a653-55cd6c1927e9", "tag": "dd35dfd0-d1d5-46b4-a288-bdc5d4d8a4e0"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:50:42.640395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e0d707b6-ceb8-4aca-b578-d5825c83460d req-b0549854-a52c-4541-b0e4-e872f5ec4561 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:50:42.640889 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e0d707b6-ceb8-4aca-b578-d5825c83460d req-b0549854-a52c-4541-b0e4-e872f5ec4561 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:50:42.641361 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-e0d707b6-ceb8-4aca-b578-d5825c83460d req-b0549854-a52c-4541-b0e4-e872f5ec4561 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:50:42.653553 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-e0d707b6-ceb8-4aca-b578-d5825c83460d req-b0549854-a52c-4541-b0e4-e872f5ec4561 service nova] Creating event network-changed:dd35dfd0-d1d5-46b4-a288-bdc5d4d8a4e0 for instance a199dc98-f207-43ff-a653-55cd6c1927e9 on n-h1-858384-13 Oct 18 14:50:42.658697 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-e0d707b6-ceb8-4aca-b578-d5825c83460d req-b0549854-a52c-4541-b0e4-e872f5ec4561 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033302 Oct 18 14:50:42.659679 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3985/7772] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:52:36.725659 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:36.726399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=58 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:36.731410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-aaee8378-3c23-4e0c-9288-599dc2ab2619 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:52:36.731941 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-aaee8378-3c23-4e0c-9288-599dc2ab2619 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:36.739158 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaee8378-3c23-4e0c-9288-599dc2ab2619 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:36.739639 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaee8378-3c23-4e0c-9288-599dc2ab2619 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:36.740071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaee8378-3c23-4e0c-9288-599dc2ab2619 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:36.740755 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaee8378-3c23-4e0c-9288-599dc2ab2619 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:36.741220 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaee8378-3c23-4e0c-9288-599dc2ab2619 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:36.741646 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-aaee8378-3c23-4e0c-9288-599dc2ab2619 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:36.765007 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-aaee8378-3c23-4e0c-9288-599dc2ab2619 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lazy-loading 'flavor' on Instance uuid a199dc98-f207-43ff-a653-55cd6c1927e9 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:52:36.836327 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-aaee8378-3c23-4e0c-9288-599dc2ab2619 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "POST /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9/action" status: 202 len: 0 microversion: 2.1 time: 0.112635 Oct 18 14:52:36.836930 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3788/7773] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:52:36 2022] POST /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:52:36.844415 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=24 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:36.845333 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=52 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:52:36.846829 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:52:36.847033 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:52:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 (ip 10.222.0.40) !!! Oct 18 14:52:36.853000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8ae31e3e-b7f9-483b-b926-dcef6e695765 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:36.853740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8ae31e3e-b7f9-483b-b926-dcef6e695765 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:36.862784 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ae31e3e-b7f9-483b-b926-dcef6e695765 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:36.863283 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ae31e3e-b7f9-483b-b926-dcef6e695765 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:36.863737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ae31e3e-b7f9-483b-b926-dcef6e695765 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:36.864450 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ae31e3e-b7f9-483b-b926-dcef6e695765 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:36.864915 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ae31e3e-b7f9-483b-b926-dcef6e695765 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:36.865382 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8ae31e3e-b7f9-483b-b926-dcef6e695765 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:37.000017 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8ae31e3e-b7f9-483b-b926-dcef6e695765 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:37.007974 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8ae31e3e-b7f9-483b-b926-dcef6e695765 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.165786 Oct 18 14:52:37.008553 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3986/7774] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:36 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:52:38.034619 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6bfc1059-fc54-48b2-a22b-74ffda26241f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:38.035402 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6bfc1059-fc54-48b2-a22b-74ffda26241f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:38.042285 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bfc1059-fc54-48b2-a22b-74ffda26241f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:38.042774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bfc1059-fc54-48b2-a22b-74ffda26241f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:38.043219 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bfc1059-fc54-48b2-a22b-74ffda26241f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:38.043914 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bfc1059-fc54-48b2-a22b-74ffda26241f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:38.044369 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bfc1059-fc54-48b2-a22b-74ffda26241f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:38.044803 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6bfc1059-fc54-48b2-a22b-74ffda26241f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:38.188247 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6bfc1059-fc54-48b2-a22b-74ffda26241f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:38.196128 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6bfc1059-fc54-48b2-a22b-74ffda26241f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.166913 Oct 18 14:52:38.197267 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3789/7775] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:38 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:39.220880 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-5e18ddfd-4218-4dd0-b004-d3365e5b066d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:39.221518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-5e18ddfd-4218-4dd0-b004-d3365e5b066d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:39.229515 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e18ddfd-4218-4dd0-b004-d3365e5b066d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:39.230013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e18ddfd-4218-4dd0-b004-d3365e5b066d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:39.230465 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e18ddfd-4218-4dd0-b004-d3365e5b066d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:39.231168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e18ddfd-4218-4dd0-b004-d3365e5b066d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:39.231633 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e18ddfd-4218-4dd0-b004-d3365e5b066d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:39.232079 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-5e18ddfd-4218-4dd0-b004-d3365e5b066d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:39.365590 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-5e18ddfd-4218-4dd0-b004-d3365e5b066d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:39.373698 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-5e18ddfd-4218-4dd0-b004-d3365e5b066d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.156762 Oct 18 14:52:39.374297 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3987/7776] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:39 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:40.397237 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-efeb822d-c8af-444b-89d9-50dd949b45aa tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:40.397906 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-efeb822d-c8af-444b-89d9-50dd949b45aa tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:40.404993 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-efeb822d-c8af-444b-89d9-50dd949b45aa tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:40.405505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-efeb822d-c8af-444b-89d9-50dd949b45aa tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:40.405940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-efeb822d-c8af-444b-89d9-50dd949b45aa tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:40.406632 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-efeb822d-c8af-444b-89d9-50dd949b45aa tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:40.407130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-efeb822d-c8af-444b-89d9-50dd949b45aa tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:40.407550 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-efeb822d-c8af-444b-89d9-50dd949b45aa tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:40.545015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-efeb822d-c8af-444b-89d9-50dd949b45aa tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:40.553110 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-efeb822d-c8af-444b-89d9-50dd949b45aa tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.159966 Oct 18 14:52:40.553721 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3790/7777] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:40 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:41.577547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9536be17-9400-4a96-ad95-9a8adc8f903e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:41.578217 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9536be17-9400-4a96-ad95-9a8adc8f903e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:41.585266 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9536be17-9400-4a96-ad95-9a8adc8f903e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:41.585764 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9536be17-9400-4a96-ad95-9a8adc8f903e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:41.586215 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9536be17-9400-4a96-ad95-9a8adc8f903e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:41.586925 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9536be17-9400-4a96-ad95-9a8adc8f903e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:41.587940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9536be17-9400-4a96-ad95-9a8adc8f903e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:41.588384 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9536be17-9400-4a96-ad95-9a8adc8f903e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:41.739468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9536be17-9400-4a96-ad95-9a8adc8f903e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:41.747924 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9536be17-9400-4a96-ad95-9a8adc8f903e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.174297 Oct 18 14:52:41.748524 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3988/7778] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:41 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:42.772172 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7d0ce5fd-fdc7-46a8-a774-97543c6f995e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:42.772813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7d0ce5fd-fdc7-46a8-a774-97543c6f995e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:42.779599 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d0ce5fd-fdc7-46a8-a774-97543c6f995e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:42.780071 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d0ce5fd-fdc7-46a8-a774-97543c6f995e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:42.780504 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d0ce5fd-fdc7-46a8-a774-97543c6f995e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:42.781206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d0ce5fd-fdc7-46a8-a774-97543c6f995e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:42.781648 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d0ce5fd-fdc7-46a8-a774-97543c6f995e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:42.782067 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7d0ce5fd-fdc7-46a8-a774-97543c6f995e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:42.914530 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7d0ce5fd-fdc7-46a8-a774-97543c6f995e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:42.923033 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7d0ce5fd-fdc7-46a8-a774-97543c6f995e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.154784 Oct 18 14:52:42.923620 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3791/7779] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:42 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:43.948127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8de0db71-9f23-4cd1-b8cb-8eab26ad15ad tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:43.948697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8de0db71-9f23-4cd1-b8cb-8eab26ad15ad tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:43.956112 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8de0db71-9f23-4cd1-b8cb-8eab26ad15ad tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:43.956869 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8de0db71-9f23-4cd1-b8cb-8eab26ad15ad tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:43.957229 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8de0db71-9f23-4cd1-b8cb-8eab26ad15ad tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:43.958044 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8de0db71-9f23-4cd1-b8cb-8eab26ad15ad tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:43.958554 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8de0db71-9f23-4cd1-b8cb-8eab26ad15ad tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:43.959036 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8de0db71-9f23-4cd1-b8cb-8eab26ad15ad tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:44.091892 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8de0db71-9f23-4cd1-b8cb-8eab26ad15ad tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:44.100367 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8de0db71-9f23-4cd1-b8cb-8eab26ad15ad tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.157006 Oct 18 14:52:44.100969 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3989/7780] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:43 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:45.123744 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-812cacdf-0b9b-4742-9689-702f0baa885f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:45.124352 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-812cacdf-0b9b-4742-9689-702f0baa885f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:45.131261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-812cacdf-0b9b-4742-9689-702f0baa885f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:45.131739 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-812cacdf-0b9b-4742-9689-702f0baa885f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:45.132173 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-812cacdf-0b9b-4742-9689-702f0baa885f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:45.132854 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-812cacdf-0b9b-4742-9689-702f0baa885f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:45.133355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-812cacdf-0b9b-4742-9689-702f0baa885f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:45.133780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-812cacdf-0b9b-4742-9689-702f0baa885f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:45.268205 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-812cacdf-0b9b-4742-9689-702f0baa885f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:45.276879 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-812cacdf-0b9b-4742-9689-702f0baa885f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.157079 Oct 18 14:52:45.277501 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3792/7781] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:45 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:46.299812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-79b6e576-b588-4104-ae07-648f84507418 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:46.300439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-79b6e576-b588-4104-ae07-648f84507418 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:46.311498 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79b6e576-b588-4104-ae07-648f84507418 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:46.312035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79b6e576-b588-4104-ae07-648f84507418 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:46.314614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79b6e576-b588-4104-ae07-648f84507418 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:46.314614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79b6e576-b588-4104-ae07-648f84507418 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:46.314614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79b6e576-b588-4104-ae07-648f84507418 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:46.314614 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79b6e576-b588-4104-ae07-648f84507418 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:46.450195 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-79b6e576-b588-4104-ae07-648f84507418 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:46.458322 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-79b6e576-b588-4104-ae07-648f84507418 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.162460 Oct 18 14:52:46.458902 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3990/7782] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:46 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:47.482880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-c59bc7e0-4294-4978-9979-99e2240cdaf6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:47.483496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-c59bc7e0-4294-4978-9979-99e2240cdaf6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:47.490284 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c59bc7e0-4294-4978-9979-99e2240cdaf6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:47.490770 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c59bc7e0-4294-4978-9979-99e2240cdaf6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:47.491206 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c59bc7e0-4294-4978-9979-99e2240cdaf6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:47.491901 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c59bc7e0-4294-4978-9979-99e2240cdaf6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:47.492353 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c59bc7e0-4294-4978-9979-99e2240cdaf6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:47.492780 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-c59bc7e0-4294-4978-9979-99e2240cdaf6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:47.699758 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-c59bc7e0-4294-4978-9979-99e2240cdaf6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:47.707904 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-c59bc7e0-4294-4978-9979-99e2240cdaf6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.229264 Oct 18 14:52:47.708503 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3793/7783] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:47 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:48.732537 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-422df08f-b2bb-4d7a-b506-8d343084eb65 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:48.733170 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-422df08f-b2bb-4d7a-b506-8d343084eb65 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:48.740427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-422df08f-b2bb-4d7a-b506-8d343084eb65 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:48.740928 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-422df08f-b2bb-4d7a-b506-8d343084eb65 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:48.741419 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-422df08f-b2bb-4d7a-b506-8d343084eb65 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:48.742126 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-422df08f-b2bb-4d7a-b506-8d343084eb65 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:48.742595 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-422df08f-b2bb-4d7a-b506-8d343084eb65 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:48.743037 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-422df08f-b2bb-4d7a-b506-8d343084eb65 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:48.873412 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-422df08f-b2bb-4d7a-b506-8d343084eb65 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:48.881409 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-422df08f-b2bb-4d7a-b506-8d343084eb65 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.152853 Oct 18 14:52:48.881995 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3991/7784] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:48 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:49.904784 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8f54b7e4-e495-42e4-b213-576c564ae313 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:49.905685 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8f54b7e4-e495-42e4-b213-576c564ae313 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:49.913407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f54b7e4-e495-42e4-b213-576c564ae313 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:49.913967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f54b7e4-e495-42e4-b213-576c564ae313 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:49.914493 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f54b7e4-e495-42e4-b213-576c564ae313 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:49.915312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f54b7e4-e495-42e4-b213-576c564ae313 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:49.915867 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f54b7e4-e495-42e4-b213-576c564ae313 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:49.916357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8f54b7e4-e495-42e4-b213-576c564ae313 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:50.051813 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8f54b7e4-e495-42e4-b213-576c564ae313 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:50.060994 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8f54b7e4-e495-42e4-b213-576c564ae313 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.160083 Oct 18 14:52:50.061616 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3794/7785] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:49 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:51.083939 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-39c74f78-f76c-4648-89bc-539ef78a9195 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:51.084625 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-39c74f78-f76c-4648-89bc-539ef78a9195 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:51.093241 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39c74f78-f76c-4648-89bc-539ef78a9195 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:51.093755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39c74f78-f76c-4648-89bc-539ef78a9195 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:51.094211 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39c74f78-f76c-4648-89bc-539ef78a9195 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:51.094932 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39c74f78-f76c-4648-89bc-539ef78a9195 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:51.095409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39c74f78-f76c-4648-89bc-539ef78a9195 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:51.095849 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-39c74f78-f76c-4648-89bc-539ef78a9195 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:51.235640 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-39c74f78-f76c-4648-89bc-539ef78a9195 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:51.244076 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-39c74f78-f76c-4648-89bc-539ef78a9195 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.164091 Oct 18 14:52:51.244666 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3992/7786] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:51 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:52.267807 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0061ef39-db8a-4f1c-b6c3-d6febea46a83 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:52.268426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0061ef39-db8a-4f1c-b6c3-d6febea46a83 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:52.276223 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0061ef39-db8a-4f1c-b6c3-d6febea46a83 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:52.276708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0061ef39-db8a-4f1c-b6c3-d6febea46a83 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:52.277143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0061ef39-db8a-4f1c-b6c3-d6febea46a83 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:52.277871 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0061ef39-db8a-4f1c-b6c3-d6febea46a83 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:52.278342 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0061ef39-db8a-4f1c-b6c3-d6febea46a83 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:52.278796 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0061ef39-db8a-4f1c-b6c3-d6febea46a83 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:52.330954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-51082047-50d7-4015-98f3-4b63ddfd332a req-59f69cd5-4f8b-43c0-a413-43a76548635d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a199dc98-f207-43ff-a653-55cd6c1927e9", "name": "network-vif-unplugged", "status": "completed", "tag": "dd35dfd0-d1d5-46b4-a288-bdc5d4d8a4e0"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:52:52.342390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-51082047-50d7-4015-98f3-4b63ddfd332a req-59f69cd5-4f8b-43c0-a413-43a76548635d service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:52.342958 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-51082047-50d7-4015-98f3-4b63ddfd332a req-59f69cd5-4f8b-43c0-a413-43a76548635d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:52.344122 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-51082047-50d7-4015-98f3-4b63ddfd332a req-59f69cd5-4f8b-43c0-a413-43a76548635d service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:52.358089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.compute.server_external_events [req-51082047-50d7-4015-98f3-4b63ddfd332a req-59f69cd5-4f8b-43c0-a413-43a76548635d service nova] Unable to find a host for instance a199dc98-f207-43ff-a653-55cd6c1927e9. Dropping event network-vif-unplugged {{(pid=120611) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 18 14:52:52.358922 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-51082047-50d7-4015-98f3-4b63ddfd332a req-59f69cd5-4f8b-43c0-a413-43a76548635d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031890 Oct 18 14:52:52.361564 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3993/7787] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 18 14:52:52.413012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0061ef39-db8a-4f1c-b6c3-d6febea46a83 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:52.421742 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0061ef39-db8a-4f1c-b6c3-d6febea46a83 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1509 microversion: 2.1 time: 0.157798 Oct 18 14:52:52.422333 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3795/7788] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:52 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:52:52.445035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-51367903-7d3b-491d-8cc9-a3e6bb7dbe04 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:52:52.445721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-51367903-7d3b-491d-8cc9-a3e6bb7dbe04 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:52.452662 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51367903-7d3b-491d-8cc9-a3e6bb7dbe04 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:52.453166 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51367903-7d3b-491d-8cc9-a3e6bb7dbe04 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:52.453682 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51367903-7d3b-491d-8cc9-a3e6bb7dbe04 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:52.454394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51367903-7d3b-491d-8cc9-a3e6bb7dbe04 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:52.454871 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51367903-7d3b-491d-8cc9-a3e6bb7dbe04 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:52.455334 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-51367903-7d3b-491d-8cc9-a3e6bb7dbe04 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:52.543114 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-51367903-7d3b-491d-8cc9-a3e6bb7dbe04 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120611) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 18 14:52:52.610767 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-51367903-7d3b-491d-8cc9-a3e6bb7dbe04 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "POST /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9/action" status: 202 len: 0 microversion: 2.1 time: 0.169586 Oct 18 14:52:52.611492 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3994/7789] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:52:52 2022] POST /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:52:52.619570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-009d7be3-6338-472c-8620-ddaca67042e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:52.620185 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-009d7be3-6338-472c-8620-ddaca67042e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:52.626092 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-009d7be3-6338-472c-8620-ddaca67042e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:52.626567 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-009d7be3-6338-472c-8620-ddaca67042e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:52.627001 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-009d7be3-6338-472c-8620-ddaca67042e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:52.627875 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-009d7be3-6338-472c-8620-ddaca67042e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:52.628438 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-009d7be3-6338-472c-8620-ddaca67042e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:52.629039 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-009d7be3-6338-472c-8620-ddaca67042e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:52.809885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-009d7be3-6338-472c-8620-ddaca67042e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:52.817990 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-009d7be3-6338-472c-8620-ddaca67042e9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1517 microversion: 2.1 time: 0.202385 Oct 18 14:52:52.818585 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3796/7790] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:52 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1517 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:53.843116 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-62c52fdd-b3f0-4465-9b5f-dfefd557ae43 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:53.843749 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-62c52fdd-b3f0-4465-9b5f-dfefd557ae43 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:53.850224 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62c52fdd-b3f0-4465-9b5f-dfefd557ae43 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:53.850738 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62c52fdd-b3f0-4465-9b5f-dfefd557ae43 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:53.851197 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62c52fdd-b3f0-4465-9b5f-dfefd557ae43 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:53.851918 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62c52fdd-b3f0-4465-9b5f-dfefd557ae43 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:53.853046 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62c52fdd-b3f0-4465-9b5f-dfefd557ae43 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:53.853523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-62c52fdd-b3f0-4465-9b5f-dfefd557ae43 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:53.990838 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-62c52fdd-b3f0-4465-9b5f-dfefd557ae43 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:53.999106 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-62c52fdd-b3f0-4465-9b5f-dfefd557ae43 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1519 microversion: 2.1 time: 0.160788 Oct 18 14:52:53.999983 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3995/7791] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:53 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:55.023401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-0a6607ed-6ffb-475f-96fe-15c278036058 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:55.024013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-0a6607ed-6ffb-475f-96fe-15c278036058 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:55.031508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a6607ed-6ffb-475f-96fe-15c278036058 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:55.031990 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a6607ed-6ffb-475f-96fe-15c278036058 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:55.032425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a6607ed-6ffb-475f-96fe-15c278036058 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:55.033114 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a6607ed-6ffb-475f-96fe-15c278036058 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:55.033597 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a6607ed-6ffb-475f-96fe-15c278036058 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:55.034021 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-0a6607ed-6ffb-475f-96fe-15c278036058 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:55.179084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-0a6607ed-6ffb-475f-96fe-15c278036058 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:55.187905 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-0a6607ed-6ffb-475f-96fe-15c278036058 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1519 microversion: 2.1 time: 0.168502 Oct 18 14:52:55.188485 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3797/7792] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:55 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:56.212368 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-98c484d7-530b-4f31-a969-c614c97638b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:56.213089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-98c484d7-530b-4f31-a969-c614c97638b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:56.221816 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98c484d7-530b-4f31-a969-c614c97638b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:56.222331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98c484d7-530b-4f31-a969-c614c97638b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:56.222788 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98c484d7-530b-4f31-a969-c614c97638b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:56.223785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98c484d7-530b-4f31-a969-c614c97638b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:56.224250 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98c484d7-530b-4f31-a969-c614c97638b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:56.224696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-98c484d7-530b-4f31-a969-c614c97638b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:56.368772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-98c484d7-530b-4f31-a969-c614c97638b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:56.376893 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-98c484d7-530b-4f31-a969-c614c97638b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1519 microversion: 2.1 time: 0.168782 Oct 18 14:52:56.377513 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3996/7793] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:56 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:57.401515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b144e3e2-f2c6-47ea-a393-0c5fc120c13d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:57.402129 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b144e3e2-f2c6-47ea-a393-0c5fc120c13d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:57.408893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b144e3e2-f2c6-47ea-a393-0c5fc120c13d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:57.409408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b144e3e2-f2c6-47ea-a393-0c5fc120c13d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:57.409839 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b144e3e2-f2c6-47ea-a393-0c5fc120c13d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:57.410523 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b144e3e2-f2c6-47ea-a393-0c5fc120c13d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:57.410969 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b144e3e2-f2c6-47ea-a393-0c5fc120c13d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:57.411390 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-b144e3e2-f2c6-47ea-a393-0c5fc120c13d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:57.547354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b144e3e2-f2c6-47ea-a393-0c5fc120c13d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:57.555398 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b144e3e2-f2c6-47ea-a393-0c5fc120c13d tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1519 microversion: 2.1 time: 0.158284 Oct 18 14:52:57.556325 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3798/7794] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:57 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:58.578848 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b48d6f4c-76eb-4d34-adb7-78a26765774c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:58.579477 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b48d6f4c-76eb-4d34-adb7-78a26765774c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:58.586594 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b48d6f4c-76eb-4d34-adb7-78a26765774c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:58.587168 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b48d6f4c-76eb-4d34-adb7-78a26765774c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:58.587609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b48d6f4c-76eb-4d34-adb7-78a26765774c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:58.588317 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b48d6f4c-76eb-4d34-adb7-78a26765774c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:58.588779 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b48d6f4c-76eb-4d34-adb7-78a26765774c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:58.589237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b48d6f4c-76eb-4d34-adb7-78a26765774c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:58.730297 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b48d6f4c-76eb-4d34-adb7-78a26765774c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:58.738494 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b48d6f4c-76eb-4d34-adb7-78a26765774c tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1575 microversion: 2.1 time: 0.163582 Oct 18 14:52:58.739096 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3997/7795] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:58 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:52:59.763442 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-29553e37-3bb9-45b2-aea1-a332f306fead tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:52:59.764056 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-29553e37-3bb9-45b2-aea1-a332f306fead tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:52:59.770909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29553e37-3bb9-45b2-aea1-a332f306fead tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:59.771389 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29553e37-3bb9-45b2-aea1-a332f306fead tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:59.771824 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29553e37-3bb9-45b2-aea1-a332f306fead tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:59.772512 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29553e37-3bb9-45b2-aea1-a332f306fead tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:52:59.772965 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29553e37-3bb9-45b2-aea1-a332f306fead tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:52:59.773420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-29553e37-3bb9-45b2-aea1-a332f306fead tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:52:59.971261 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-29553e37-3bb9-45b2-aea1-a332f306fead tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:52:59.979805 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-29553e37-3bb9-45b2-aea1-a332f306fead tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1575 microversion: 2.1 time: 0.221206 Oct 18 14:52:59.980370 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3799/7796] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:52:59 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:53:01.004252 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-8afc3efc-2016-40d8-8e4e-915ee90e5761 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:53:01.004806 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-8afc3efc-2016-40d8-8e4e-915ee90e5761 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:53:01.012587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8afc3efc-2016-40d8-8e4e-915ee90e5761 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:01.013100 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8afc3efc-2016-40d8-8e4e-915ee90e5761 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:01.013584 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8afc3efc-2016-40d8-8e4e-915ee90e5761 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:01.014314 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8afc3efc-2016-40d8-8e4e-915ee90e5761 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:01.014777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8afc3efc-2016-40d8-8e4e-915ee90e5761 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:01.015225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-8afc3efc-2016-40d8-8e4e-915ee90e5761 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:01.196721 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-8afc3efc-2016-40d8-8e4e-915ee90e5761 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:53:01.205363 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-8afc3efc-2016-40d8-8e4e-915ee90e5761 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1575 microversion: 2.1 time: 0.205155 Oct 18 14:53:01.205948 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3998/7797] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:53:00 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:53:02.230192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-568ede80-6d74-4dd4-965b-fad68da2bd53 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:53:02.230797 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-568ede80-6d74-4dd4-965b-fad68da2bd53 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:53:02.237735 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-568ede80-6d74-4dd4-965b-fad68da2bd53 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:02.238209 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-568ede80-6d74-4dd4-965b-fad68da2bd53 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:02.238638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-568ede80-6d74-4dd4-965b-fad68da2bd53 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:02.239325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-568ede80-6d74-4dd4-965b-fad68da2bd53 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:02.239774 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-568ede80-6d74-4dd4-965b-fad68da2bd53 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:02.240193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-568ede80-6d74-4dd4-965b-fad68da2bd53 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:02.372580 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-568ede80-6d74-4dd4-965b-fad68da2bd53 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:53:02.380490 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-568ede80-6d74-4dd4-965b-fad68da2bd53 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1575 microversion: 2.1 time: 0.154741 Oct 18 14:53:02.381073 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3800/7798] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:53:02 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:53:03.404089 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e1e6fca3-3e95-487b-9d74-96dbbb475518 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:53:03.404668 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e1e6fca3-3e95-487b-9d74-96dbbb475518 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:53:03.411695 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1e6fca3-3e95-487b-9d74-96dbbb475518 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:03.412194 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1e6fca3-3e95-487b-9d74-96dbbb475518 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:03.412644 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1e6fca3-3e95-487b-9d74-96dbbb475518 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:03.413398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1e6fca3-3e95-487b-9d74-96dbbb475518 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:03.413868 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1e6fca3-3e95-487b-9d74-96dbbb475518 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:03.414308 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e1e6fca3-3e95-487b-9d74-96dbbb475518 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:03.551675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e1e6fca3-3e95-487b-9d74-96dbbb475518 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:53:03.560600 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e1e6fca3-3e95-487b-9d74-96dbbb475518 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1575 microversion: 2.1 time: 0.160508 Oct 18 14:53:03.561207 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 3999/7799] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:53:03 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:53:04.584450 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-435919f5-2877-4525-ac3b-68499317d5d8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:53:04.585057 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-435919f5-2877-4525-ac3b-68499317d5d8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:53:04.592588 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-435919f5-2877-4525-ac3b-68499317d5d8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:04.593066 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-435919f5-2877-4525-ac3b-68499317d5d8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:04.593528 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-435919f5-2877-4525-ac3b-68499317d5d8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:04.594214 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-435919f5-2877-4525-ac3b-68499317d5d8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:04.594662 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-435919f5-2877-4525-ac3b-68499317d5d8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:04.595083 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-435919f5-2877-4525-ac3b-68499317d5d8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:04.725463 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-435919f5-2877-4525-ac3b-68499317d5d8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:53:04.734192 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-435919f5-2877-4525-ac3b-68499317d5d8 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1575 microversion: 2.1 time: 0.153660 Oct 18 14:53:04.734772 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3801/7800] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:53:04 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:53:05.758565 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a6528fcf-ea61-4d3d-a10b-c3846c88eee1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:53:05.759225 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a6528fcf-ea61-4d3d-a10b-c3846c88eee1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:53:05.766055 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6528fcf-ea61-4d3d-a10b-c3846c88eee1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:05.766549 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6528fcf-ea61-4d3d-a10b-c3846c88eee1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:05.767003 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6528fcf-ea61-4d3d-a10b-c3846c88eee1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:05.767702 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6528fcf-ea61-4d3d-a10b-c3846c88eee1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:05.768169 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6528fcf-ea61-4d3d-a10b-c3846c88eee1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:05.768605 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a6528fcf-ea61-4d3d-a10b-c3846c88eee1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:05.903843 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a6528fcf-ea61-4d3d-a10b-c3846c88eee1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:53:05.911809 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a6528fcf-ea61-4d3d-a10b-c3846c88eee1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1575 microversion: 2.1 time: 0.157323 Oct 18 14:53:05.912400 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4000/7801] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:53:05 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:53:06.936410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-212820b5-aced-49ed-8e7e-1c88c2db5b67 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:53:06.937128 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-212820b5-aced-49ed-8e7e-1c88c2db5b67 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:53:06.939940 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=29 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:53:06.945785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-212820b5-aced-49ed-8e7e-1c88c2db5b67 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:06.946273 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-212820b5-aced-49ed-8e7e-1c88c2db5b67 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:06.946704 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-212820b5-aced-49ed-8e7e-1c88c2db5b67 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:06.947399 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-212820b5-aced-49ed-8e7e-1c88c2db5b67 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:06.947848 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-212820b5-aced-49ed-8e7e-1c88c2db5b67 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:06.948267 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-212820b5-aced-49ed-8e7e-1c88c2db5b67 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:06.952798 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:53:07.099276 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-212820b5-aced-49ed-8e7e-1c88c2db5b67 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:53:07.108470 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-212820b5-aced-49ed-8e7e-1c88c2db5b67 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1575 microversion: 2.1 time: 0.176177 Oct 18 14:53:07.109087 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3802/7802] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:53:06 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:53:08.132449 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-16e20a60-2b1f-4d44-a976-3318d8dcb6ee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:53:08.133131 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-16e20a60-2b1f-4d44-a976-3318d8dcb6ee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:53:08.136468 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:53:08.142084 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16e20a60-2b1f-4d44-a976-3318d8dcb6ee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:08.142533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16e20a60-2b1f-4d44-a976-3318d8dcb6ee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:08.142992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16e20a60-2b1f-4d44-a976-3318d8dcb6ee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:08.143708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16e20a60-2b1f-4d44-a976-3318d8dcb6ee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:08.144185 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16e20a60-2b1f-4d44-a976-3318d8dcb6ee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:08.144641 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-16e20a60-2b1f-4d44-a976-3318d8dcb6ee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:08.149658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:53:08.282073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-16e20a60-2b1f-4d44-a976-3318d8dcb6ee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:53:08.291480 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-16e20a60-2b1f-4d44-a976-3318d8dcb6ee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1575 microversion: 2.1 time: 0.163024 Oct 18 14:53:08.292096 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4001/7803] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:53:08 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:53:08.461357 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-2b0b0977-f100-478a-9885-05babc72ebff req-1592b568-df70-4136-ab19-4ff31a2f6f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a199dc98-f207-43ff-a653-55cd6c1927e9", "name": "network-vif-plugged", "status": "completed", "tag": "dd35dfd0-d1d5-46b4-a288-bdc5d4d8a4e0"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:53:08.471885 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2b0b0977-f100-478a-9885-05babc72ebff req-1592b568-df70-4136-ab19-4ff31a2f6f12 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:08.472359 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2b0b0977-f100-478a-9885-05babc72ebff req-1592b568-df70-4136-ab19-4ff31a2f6f12 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:08.472783 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-2b0b0977-f100-478a-9885-05babc72ebff req-1592b568-df70-4136-ab19-4ff31a2f6f12 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:08.484688 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-2b0b0977-f100-478a-9885-05babc72ebff req-1592b568-df70-4136-ab19-4ff31a2f6f12 service nova] Creating event network-vif-plugged:dd35dfd0-d1d5-46b4-a288-bdc5d4d8a4e0 for instance a199dc98-f207-43ff-a653-55cd6c1927e9 on n-h1-858384-13 Oct 18 14:53:08.489764 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-2b0b0977-f100-478a-9885-05babc72ebff req-1592b568-df70-4136-ab19-4ff31a2f6f12 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032114 Oct 18 14:53:08.490364 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3803/7804] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:53:09.316035 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b0c498ce-1b86-4db9-be4f-c6b07f1a971f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:53:09.316665 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b0c498ce-1b86-4db9-be4f-c6b07f1a971f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:53:09.324564 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0c498ce-1b86-4db9-be4f-c6b07f1a971f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:09.325060 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0c498ce-1b86-4db9-be4f-c6b07f1a971f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:09.325530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0c498ce-1b86-4db9-be4f-c6b07f1a971f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:09.326232 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0c498ce-1b86-4db9-be4f-c6b07f1a971f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:09.326694 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0c498ce-1b86-4db9-be4f-c6b07f1a971f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:09.327127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b0c498ce-1b86-4db9-be4f-c6b07f1a971f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:09.461757 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b0c498ce-1b86-4db9-be4f-c6b07f1a971f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:53:09.469576 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b0c498ce-1b86-4db9-be4f-c6b07f1a971f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1575 microversion: 2.1 time: 0.157538 Oct 18 14:53:09.470154 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4002/7805] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:53:09 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:53:10.495022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f8c320e9-edd2-4d69-a54d-5e9c69d5a0d7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:53:10.495743 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f8c320e9-edd2-4d69-a54d-5e9c69d5a0d7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:53:10.501874 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8c320e9-edd2-4d69-a54d-5e9c69d5a0d7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:10.502355 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8c320e9-edd2-4d69-a54d-5e9c69d5a0d7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:10.502785 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8c320e9-edd2-4d69-a54d-5e9c69d5a0d7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:10.503465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8c320e9-edd2-4d69-a54d-5e9c69d5a0d7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:53:10.503909 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8c320e9-edd2-4d69-a54d-5e9c69d5a0d7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:53:10.504327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f8c320e9-edd2-4d69-a54d-5e9c69d5a0d7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:53:10.640862 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f8c320e9-edd2-4d69-a54d-5e9c69d5a0d7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:53:10.649300 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f8c320e9-edd2-4d69-a54d-5e9c69d5a0d7 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1562 microversion: 2.1 time: 0.159096 Oct 18 14:53:10.650312 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3804/7806] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:53:10 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:25.100747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=5 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:25.101521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:25.102675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=11 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:25.103036 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:54:25.103240 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:54:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 (ip 10.222.0.40) !!! Oct 18 14:54:25.104273 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:54:25.106248 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=13 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:25.107393 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:54:25.107597 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:54:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 18 14:54:25.108899 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 18 14:54:25.109421 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:54:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 (ip 10.222.0.40) !!! Oct 18 14:54:25.114990 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a8eed24e-63ac-4fa3-9a8e-0f537fd3fe6f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:25.115512 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a8eed24e-63ac-4fa3-9a8e-0f537fd3fe6f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:25.119297 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:54:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 18 14:54:25.125030 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-0830b5e8-5857-4223-8fc4-0b4f7bddd961 req-dcde2b0c-bd68-4495-81e7-eaab19d387fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a199dc98-f207-43ff-a653-55cd6c1927e9", "tag": "dd35dfd0-d1d5-46b4-a288-bdc5d4d8a4e0"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:54:25.143486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8eed24e-63ac-4fa3-9a8e-0f537fd3fe6f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:25.143999 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8eed24e-63ac-4fa3-9a8e-0f537fd3fe6f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:25.144454 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8eed24e-63ac-4fa3-9a8e-0f537fd3fe6f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:25.145209 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8eed24e-63ac-4fa3-9a8e-0f537fd3fe6f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:25.145678 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8eed24e-63ac-4fa3-9a8e-0f537fd3fe6f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:25.146121 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a8eed24e-63ac-4fa3-9a8e-0f537fd3fe6f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:25.149072 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0830b5e8-5857-4223-8fc4-0b4f7bddd961 req-dcde2b0c-bd68-4495-81e7-eaab19d387fd service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:25.149582 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0830b5e8-5857-4223-8fc4-0b4f7bddd961 req-dcde2b0c-bd68-4495-81e7-eaab19d387fd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:25.150013 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0830b5e8-5857-4223-8fc4-0b4f7bddd961 req-dcde2b0c-bd68-4495-81e7-eaab19d387fd service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:25.170272 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0830b5e8-5857-4223-8fc4-0b4f7bddd961 req-dcde2b0c-bd68-4495-81e7-eaab19d387fd service nova] Creating event network-changed:dd35dfd0-d1d5-46b4-a288-bdc5d4d8a4e0 for instance a199dc98-f207-43ff-a653-55cd6c1927e9 on n-h1-858384-13 Oct 18 14:54:25.176010 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-0830b5e8-5857-4223-8fc4-0b4f7bddd961 req-dcde2b0c-bd68-4495-81e7-eaab19d387fd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077276 Oct 18 14:54:25.176737 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3805/7807] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:54:25.185492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a8eed24e-63ac-4fa3-9a8e-0f537fd3fe6f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:54:25.291126 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a8eed24e-63ac-4fa3-9a8e-0f537fd3fe6f tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 204 len: 0 microversion: 2.1 time: 0.195392 Oct 18 14:54:25.291741 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4003/7808] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:54:25 2022] DELETE /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:54:25.300808 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-85352e0f-1c42-47a1-9632-b369e5c645e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:25.301553 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-85352e0f-1c42-47a1-9632-b369e5c645e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:25.308713 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85352e0f-1c42-47a1-9632-b369e5c645e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:25.309515 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85352e0f-1c42-47a1-9632-b369e5c645e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:25.310170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85352e0f-1c42-47a1-9632-b369e5c645e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:25.311198 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85352e0f-1c42-47a1-9632-b369e5c645e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:25.311845 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85352e0f-1c42-47a1-9632-b369e5c645e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:25.312465 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-85352e0f-1c42-47a1-9632-b369e5c645e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:25.473211 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-85352e0f-1c42-47a1-9632-b369e5c645e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:25.481843 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-85352e0f-1c42-47a1-9632-b369e5c645e1 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.185451 Oct 18 14:54:25.482422 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3806/7809] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:25 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:26.506294 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d2a94b30-deee-4649-94e6-026df957cbee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:26.507120 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d2a94b30-deee-4649-94e6-026df957cbee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:26.514794 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a94b30-deee-4649-94e6-026df957cbee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:26.515303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a94b30-deee-4649-94e6-026df957cbee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:26.515792 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a94b30-deee-4649-94e6-026df957cbee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:26.516874 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a94b30-deee-4649-94e6-026df957cbee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:26.517394 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a94b30-deee-4649-94e6-026df957cbee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:26.517850 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d2a94b30-deee-4649-94e6-026df957cbee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:26.659557 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d2a94b30-deee-4649-94e6-026df957cbee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:26.668498 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d2a94b30-deee-4649-94e6-026df957cbee tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1568 microversion: 2.1 time: 0.166537 Oct 18 14:54:26.669084 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4004/7810] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:26 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:27.498204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-0f12cdd6-1606-4290-831c-10ef6d1c4b8f req-02187a9d-bc19-4953-856f-17e80f36f187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a199dc98-f207-43ff-a653-55cd6c1927e9", "name": "network-vif-deleted", "tag": "dd35dfd0-d1d5-46b4-a288-bdc5d4d8a4e0"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:54:27.511263 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0f12cdd6-1606-4290-831c-10ef6d1c4b8f req-02187a9d-bc19-4953-856f-17e80f36f187 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:27.512436 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0f12cdd6-1606-4290-831c-10ef6d1c4b8f req-02187a9d-bc19-4953-856f-17e80f36f187 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:27.513366 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-0f12cdd6-1606-4290-831c-10ef6d1c4b8f req-02187a9d-bc19-4953-856f-17e80f36f187 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:27.525707 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-0f12cdd6-1606-4290-831c-10ef6d1c4b8f req-02187a9d-bc19-4953-856f-17e80f36f187 service nova] Creating event network-vif-deleted:dd35dfd0-d1d5-46b4-a288-bdc5d4d8a4e0 for instance a199dc98-f207-43ff-a653-55cd6c1927e9 on n-h1-858384-13 Oct 18 14:54:27.531536 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-0f12cdd6-1606-4290-831c-10ef6d1c4b8f req-02187a9d-bc19-4953-856f-17e80f36f187 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037051 Oct 18 14:54:27.532141 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3807/7811] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:54:27.691024 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d02d97ae-1ade-4425-bca1-b0e553823ce9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:27.691697 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d02d97ae-1ade-4425-bca1-b0e553823ce9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:27.700908 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d02d97ae-1ade-4425-bca1-b0e553823ce9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:27.701459 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d02d97ae-1ade-4425-bca1-b0e553823ce9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:27.701946 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d02d97ae-1ade-4425-bca1-b0e553823ce9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:27.702737 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d02d97ae-1ade-4425-bca1-b0e553823ce9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:27.703212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d02d97ae-1ade-4425-bca1-b0e553823ce9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:27.703658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d02d97ae-1ade-4425-bca1-b0e553823ce9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:27.780775 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d02d97ae-1ade-4425-bca1-b0e553823ce9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:27.789786 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d02d97ae-1ade-4425-bca1-b0e553823ce9 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1219 microversion: 2.1 time: 0.102568 Oct 18 14:54:27.790666 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4005/7812] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:27 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:28.813856 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bcca0078-d0cd-4c86-ab1a-bb951438f137 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:28.814657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bcca0078-d0cd-4c86-ab1a-bb951438f137 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:28.821967 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcca0078-d0cd-4c86-ab1a-bb951438f137 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:28.822453 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcca0078-d0cd-4c86-ab1a-bb951438f137 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:28.822892 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcca0078-d0cd-4c86-ab1a-bb951438f137 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:28.823586 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcca0078-d0cd-4c86-ab1a-bb951438f137 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:28.824048 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcca0078-d0cd-4c86-ab1a-bb951438f137 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:28.824477 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bcca0078-d0cd-4c86-ab1a-bb951438f137 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:28.894847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bcca0078-d0cd-4c86-ab1a-bb951438f137 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:28.903525 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bcca0078-d0cd-4c86-ab1a-bb951438f137 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1219 microversion: 2.1 time: 0.094037 Oct 18 14:54:28.904270 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3808/7813] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:28 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:29.927524 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-e44446b0-6f07-4e79-a97f-5aefaaed9534 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:29.928765 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-e44446b0-6f07-4e79-a97f-5aefaaed9534 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:29.936132 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e44446b0-6f07-4e79-a97f-5aefaaed9534 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:29.936639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e44446b0-6f07-4e79-a97f-5aefaaed9534 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:29.937090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e44446b0-6f07-4e79-a97f-5aefaaed9534 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:29.937883 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e44446b0-6f07-4e79-a97f-5aefaaed9534 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:29.938353 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e44446b0-6f07-4e79-a97f-5aefaaed9534 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:29.938796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-e44446b0-6f07-4e79-a97f-5aefaaed9534 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:30.008276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-e44446b0-6f07-4e79-a97f-5aefaaed9534 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:30.016652 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-e44446b0-6f07-4e79-a97f-5aefaaed9534 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1219 microversion: 2.1 time: 0.093099 Oct 18 14:54:30.017363 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4006/7814] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:29 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:31.040578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-90214701-626b-4355-aff3-794953edbc6e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:31.041508 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-90214701-626b-4355-aff3-794953edbc6e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:31.049024 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90214701-626b-4355-aff3-794953edbc6e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:31.049545 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90214701-626b-4355-aff3-794953edbc6e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:31.049982 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90214701-626b-4355-aff3-794953edbc6e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:31.050678 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90214701-626b-4355-aff3-794953edbc6e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:31.051131 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90214701-626b-4355-aff3-794953edbc6e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:31.051559 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-90214701-626b-4355-aff3-794953edbc6e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:31.116361 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-90214701-626b-4355-aff3-794953edbc6e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:31.124789 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-90214701-626b-4355-aff3-794953edbc6e tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1219 microversion: 2.1 time: 0.088667 Oct 18 14:54:31.125625 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3809/7815] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:31 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:32.148311 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:32.148970 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:32.155585 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:32.156096 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:32.156758 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:32.157687 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:32.158341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:32.158791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:32.191650 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:32.192154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:32.192609 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:32.193078 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.objects.instance [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lazy-loading 'fault' on Instance uuid a199dc98-f207-43ff-a653-55cd6c1927e9 {{(pid=120611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:54:32.239124 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a09467003445b6abfee976c5230cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5722398932444338ab8ea5e0d1c0cc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:32.247803 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b8632c88-ec8c-4e51-85b4-f69b177e93d2 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 200 len: 1178 microversion: 2.1 time: 0.104612 Oct 18 14:54:32.248403 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4007/7816] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:32 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 1178 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:33.271505 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7109ff41-87bf-4487-b543-b8e9785eb5b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:33.273074 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7109ff41-87bf-4487-b543-b8e9785eb5b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] [instance: a199dc98-f207-43ff-a653-55cd6c1927e9] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:33.278962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7109ff41-87bf-4487-b543-b8e9785eb5b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:33.279451 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7109ff41-87bf-4487-b543-b8e9785eb5b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:33.279868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7109ff41-87bf-4487-b543-b8e9785eb5b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:33.280642 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7109ff41-87bf-4487-b543-b8e9785eb5b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:33.281100 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7109ff41-87bf-4487-b543-b8e9785eb5b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:33.281549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7109ff41-87bf-4487-b543-b8e9785eb5b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:33.298845 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-7109ff41-87bf-4487-b543-b8e9785eb5b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] HTTP exception thrown: Instance a199dc98-f207-43ff-a653-55cd6c1927e9 could not be found. Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7109ff41-87bf-4487-b543-b8e9785eb5b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Request method failure captured: Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 HTTP/1.1 Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTrv28e2vY_wG1gsIMVSLrV3pWCKIYiNmfOJLOJC-yD3GNt2g3foTLxeE90yZrlJeSjI1dQIDVkNXWF0vfrRnozigJyTClZhMO_qhrhHOvp_cvgWL5h7xYCZtQYlKfObCYJmrdRBy8xPDO3vxmaBPUSJ4wv5G40JPL25PU2cRKuRbQfo Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: c5722398932444338ab8ea5e0d1c0cc6 Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestShelveInstance-492190882 Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5722398932444338ab8ea5e0d1c0cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5722398932444338ab8ea5e0d1c0cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5722398932444338ab8ea5e0d1c0cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5722398932444338ab8ea5e0d1c0cc6"}]}] Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestShelveInstance-492190882 Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: c5722398932444338ab8ea5e0d1c0cc6 Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestShelveInstance-492190882 Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestShelveInstance-492190882-project Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: c9a09467003445b6abfee976c5230cd0 Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestShelveInstance-492190882-project Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance a199dc98-f207-43ff-a653-55cd6c1927e9 could not be found. Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': 'a199dc98-f207-43ff-a653-55cd6c1927e9'} Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a199dc98-f207-43ff-a653-55cd6c1927e9 could not be found. Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a199dc98-f207-43ff-a653-55cd6c1927e9 could not be found. Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 14:54:33.300499 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:54:33.307217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 14:54:33.307217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 14:54:33.307217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 14:54:33.307217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 14:54:33.307217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 14:54:33.307217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a199dc98-f207-43ff-a653-55cd6c1927e9 could not be found. Oct 18 14:54:33.307217 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 14:54:33.307217 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7109ff41-87bf-4487-b543-b8e9785eb5b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Returning 404 to user: Instance a199dc98-f207-43ff-a653-55cd6c1927e9 could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 14:54:33.307217 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7109ff41-87bf-4487-b543-b8e9785eb5b6 tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9" status: 404 len: 111 microversion: 2.1 time: 0.034490 Oct 18 14:54:33.307217 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3810/7817] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:33 2022] GET /compute/v2.1/servers/a199dc98-f207-43ff-a653-55cd6c1927e9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 14:54:33.477610 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b528779d-8adc-4cb1-b6cf-ed6dbcffb61a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] Calling method '.version_select at 0x7ff61412c1f0>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:33.509637 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b528779d-8adc-4cb1-b6cf-ed6dbcffb61a tempest-TestShelveInstance-492190882 tempest-TestShelveInstance-492190882-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-800680519" status: 202 len: 0 microversion: 2.1 time: 0.037296 Oct 18 14:54:33.510842 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4008/7818] 10.222.0.40 () {58 vars in 1251 bytes} [Tue Oct 18 14:54:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-800680519 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 18 14:54:51.150091 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=12 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:51.151747 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=24 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:51.344761 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-662cf326-0bc2-4ab6-b159-fac6c80f80cd tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Action: 'create', calling method: .version_select at 0x7ff60e6ef8b0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1153970442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVZXlZPK/aNd9rhVawJpVLw1ZW0k03qx5VrYFca+i9gA6WIiE5BkWStlwwl9C4NEG4TRj/STgD4HyyVOFu8v/twlqSYUYVfT4WXty7mEFoerBmrc7zuKeTexSXE5lPtsA=="}} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:54:51.362979 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-662cf326-0bc2-4ab6-b159-fac6c80f80cd tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Getting quotas for project 71d5f82cf2b446f5bfacea3b7c8796c2. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:54:51.371204 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.quota [None req-662cf326-0bc2-4ab6-b159-fac6c80f80cd tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Getting quotas for user 74e09a7b20964a75b793d117e05eaf09 and project 71d5f82cf2b446f5bfacea3b7c8796c2. Resources: {'key_pairs'} {{(pid=120612) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:54:51.407735 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-662cf326-0bc2-4ab6-b159-fac6c80f80cd tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.265784 Oct 18 14:54:51.408536 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3811/7819] 10.222.0.40 () {60 vars in 1159 bytes} [Tue Oct 18 14:54:51 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:54:52.399591 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:52.400523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:54:52.405566 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1096255138", "imageRef": "c5f2027d-2f76-420c-95a8-7bb70182af23", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1153970442", "security_groups": [{"name": "tempest-secgroup-smoke-1622909246"}], "networks": [{"uuid": "dd670de4-eb04-4a69-ba23-fec8d1a80680"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:54:52.522148 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] validate_networks() for [('dd670de4-eb04-4a69-ba23-fec8d1a80680', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:54:52.938940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:54:52.939409 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:54:52.939973 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:54:52.940402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:54:52.940828 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:54:52.950350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:52.950905 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:52.951358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:52.952109 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:52.952567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:52.953000 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:52.971876 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Getting quotas for project 71d5f82cf2b446f5bfacea3b7c8796c2. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:54:52.977833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Getting quotas for user 74e09a7b20964a75b793d117e05eaf09 and project 71d5f82cf2b446f5bfacea3b7c8796c2. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:54:52.990598 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:54:52.992863 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c5f2027d-2f76-420c-95a8-7bb70182af23',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:54:53.044197 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-79ac6102-f727-4ceb-b569-a0747071daa8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.645980 Oct 18 14:54:53.044940 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4009/7820] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:54:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:54:53.058661 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-b046fc51-cb2d-46eb-9f87-917555f6ca51 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:53.060638 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-b046fc51-cb2d-46eb-9f87-917555f6ca51 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:53.134455 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-b046fc51-cb2d-46eb-9f87-917555f6ca51 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:53.143148 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-b046fc51-cb2d-46eb-9f87-917555f6ca51 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 200 len: 1249 microversion: 2.1 time: 0.090980 Oct 18 14:54:53.144151 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3812/7821] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:53 2022] GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:54.167756 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-bc1e0585-433b-4cd3-9db7-842bc6246ae5 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:54.168336 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-bc1e0585-433b-4cd3-9db7-842bc6246ae5 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:54.175022 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc1e0585-433b-4cd3-9db7-842bc6246ae5 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:54.175533 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc1e0585-433b-4cd3-9db7-842bc6246ae5 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:54.175993 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc1e0585-433b-4cd3-9db7-842bc6246ae5 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:54.176725 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc1e0585-433b-4cd3-9db7-842bc6246ae5 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:54.177836 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc1e0585-433b-4cd3-9db7-842bc6246ae5 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:54.178523 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-bc1e0585-433b-4cd3-9db7-842bc6246ae5 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:54.248286 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-bc1e0585-433b-4cd3-9db7-842bc6246ae5 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:54.257404 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-bc1e0585-433b-4cd3-9db7-842bc6246ae5 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 200 len: 1301 microversion: 2.1 time: 0.094413 Oct 18 14:54:54.258014 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4010/7822] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:54 2022] GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:55.282484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-409874fc-b2a5-41a6-8ff1-f4c661e3db52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:55.283078 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-409874fc-b2a5-41a6-8ff1-f4c661e3db52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:55.298270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-409874fc-b2a5-41a6-8ff1-f4c661e3db52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:55.298760 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-409874fc-b2a5-41a6-8ff1-f4c661e3db52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:55.299589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-409874fc-b2a5-41a6-8ff1-f4c661e3db52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:55.301810 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-409874fc-b2a5-41a6-8ff1-f4c661e3db52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:55.302955 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-409874fc-b2a5-41a6-8ff1-f4c661e3db52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:55.303669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-409874fc-b2a5-41a6-8ff1-f4c661e3db52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:55.560706 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-409874fc-b2a5-41a6-8ff1-f4c661e3db52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:55.568819 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-409874fc-b2a5-41a6-8ff1-f4c661e3db52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 200 len: 1375 microversion: 2.1 time: 0.290464 Oct 18 14:54:55.569438 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3813/7823] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:55 2022] GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 1375 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:55.982438 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-a9ec469e-bca3-4344-aef3-604a3571e4ca req-8997a3cb-aea9-4009-9b4e-74c736567ecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be342df-20b6-4f8c-baa6-92f51ba203cf", "tag": "c5f1a471-592e-41a3-b0a9-720b55f1feb4"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:54:55.995487 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a9ec469e-bca3-4344-aef3-604a3571e4ca req-8997a3cb-aea9-4009-9b4e-74c736567ecb service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:55.995903 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a9ec469e-bca3-4344-aef3-604a3571e4ca req-8997a3cb-aea9-4009-9b4e-74c736567ecb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:55.996350 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-a9ec469e-bca3-4344-aef3-604a3571e4ca req-8997a3cb-aea9-4009-9b4e-74c736567ecb service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:56.008558 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-a9ec469e-bca3-4344-aef3-604a3571e4ca req-8997a3cb-aea9-4009-9b4e-74c736567ecb service nova] Creating event network-changed:c5f1a471-592e-41a3-b0a9-720b55f1feb4 for instance 1be342df-20b6-4f8c-baa6-92f51ba203cf on n-h1-858384-13 Oct 18 14:54:56.014872 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-a9ec469e-bca3-4344-aef3-604a3571e4ca req-8997a3cb-aea9-4009-9b4e-74c736567ecb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038090 Oct 18 14:54:56.015494 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4011/7824] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:54:56.592143 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-82c3420d-3c33-4ef6-a545-87e3b5eccbd9 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:56.592749 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-82c3420d-3c33-4ef6-a545-87e3b5eccbd9 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:56.600753 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82c3420d-3c33-4ef6-a545-87e3b5eccbd9 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:56.601280 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82c3420d-3c33-4ef6-a545-87e3b5eccbd9 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:56.601717 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82c3420d-3c33-4ef6-a545-87e3b5eccbd9 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:56.602434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82c3420d-3c33-4ef6-a545-87e3b5eccbd9 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:56.602948 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82c3420d-3c33-4ef6-a545-87e3b5eccbd9 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:56.603381 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-82c3420d-3c33-4ef6-a545-87e3b5eccbd9 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:56.746192 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-82c3420d-3c33-4ef6-a545-87e3b5eccbd9 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:56.754590 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-82c3420d-3c33-4ef6-a545-87e3b5eccbd9 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 200 len: 1375 microversion: 2.1 time: 0.166314 Oct 18 14:54:56.755222 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3814/7825] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:56 2022] GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:57.780332 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d4519257-0b76-45e3-b370-b0ff7568f955 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:57.781042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d4519257-0b76-45e3-b370-b0ff7568f955 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:57.787520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4519257-0b76-45e3-b370-b0ff7568f955 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:57.787992 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4519257-0b76-45e3-b370-b0ff7568f955 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:57.788439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4519257-0b76-45e3-b370-b0ff7568f955 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:57.789367 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4519257-0b76-45e3-b370-b0ff7568f955 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:57.789636 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4519257-0b76-45e3-b370-b0ff7568f955 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:57.790071 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d4519257-0b76-45e3-b370-b0ff7568f955 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:57.927388 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d4519257-0b76-45e3-b370-b0ff7568f955 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:57.935420 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d4519257-0b76-45e3-b370-b0ff7568f955 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 200 len: 1375 microversion: 2.1 time: 0.160228 Oct 18 14:54:57.936013 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4012/7826] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:57 2022] GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:54:58.959407 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-15286ef9-ad6f-4683-b9b8-4180fbca1535 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:54:58.960031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-15286ef9-ad6f-4683-b9b8-4180fbca1535 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:54:58.966991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15286ef9-ad6f-4683-b9b8-4180fbca1535 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:58.967485 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15286ef9-ad6f-4683-b9b8-4180fbca1535 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:58.967928 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15286ef9-ad6f-4683-b9b8-4180fbca1535 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:58.968637 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15286ef9-ad6f-4683-b9b8-4180fbca1535 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:54:58.969088 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15286ef9-ad6f-4683-b9b8-4180fbca1535 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:54:58.969591 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-15286ef9-ad6f-4683-b9b8-4180fbca1535 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:54:59.109996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-15286ef9-ad6f-4683-b9b8-4180fbca1535 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:54:59.118569 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-15286ef9-ad6f-4683-b9b8-4180fbca1535 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 200 len: 1375 microversion: 2.1 time: 0.163214 Oct 18 14:54:59.119149 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3815/7827] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:54:58 2022] GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:00.141127 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a0013cdb-670b-445d-8829-fea7d1b28078 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:00.141791 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a0013cdb-670b-445d-8829-fea7d1b28078 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:00.149359 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0013cdb-670b-445d-8829-fea7d1b28078 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:00.149860 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0013cdb-670b-445d-8829-fea7d1b28078 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:00.150306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0013cdb-670b-445d-8829-fea7d1b28078 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:00.151007 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0013cdb-670b-445d-8829-fea7d1b28078 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:00.151473 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0013cdb-670b-445d-8829-fea7d1b28078 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:00.151909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a0013cdb-670b-445d-8829-fea7d1b28078 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:00.286177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a0013cdb-670b-445d-8829-fea7d1b28078 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:00.294106 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a0013cdb-670b-445d-8829-fea7d1b28078 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 200 len: 1375 microversion: 2.1 time: 0.156877 Oct 18 14:55:00.295134 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4013/7828] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:00 2022] GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:00.960354 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-8c924296-deac-4adb-bc6d-b46bfdb6d61f req-08552033-d70e-409c-9553-fc1806c34a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be342df-20b6-4f8c-baa6-92f51ba203cf", "name": "network-vif-plugged", "status": "completed", "tag": "c5f1a471-592e-41a3-b0a9-720b55f1feb4"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:55:00.973584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8c924296-deac-4adb-bc6d-b46bfdb6d61f req-08552033-d70e-409c-9553-fc1806c34a34 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:00.974800 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8c924296-deac-4adb-bc6d-b46bfdb6d61f req-08552033-d70e-409c-9553-fc1806c34a34 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:00.975227 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-8c924296-deac-4adb-bc6d-b46bfdb6d61f req-08552033-d70e-409c-9553-fc1806c34a34 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:00.986722 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-8c924296-deac-4adb-bc6d-b46bfdb6d61f req-08552033-d70e-409c-9553-fc1806c34a34 service nova] Creating event network-vif-plugged:c5f1a471-592e-41a3-b0a9-720b55f1feb4 for instance 1be342df-20b6-4f8c-baa6-92f51ba203cf on n-h1-858384-13 Oct 18 14:55:00.992844 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-8c924296-deac-4adb-bc6d-b46bfdb6d61f req-08552033-d70e-409c-9553-fc1806c34a34 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036266 Oct 18 14:55:00.993472 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3816/7829] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:55:01.317157 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9786fc5c-9ddb-4776-8e46-4b13ecd30fec tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:01.317898 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9786fc5c-9ddb-4776-8e46-4b13ecd30fec tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:01.324128 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9786fc5c-9ddb-4776-8e46-4b13ecd30fec tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:01.324626 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9786fc5c-9ddb-4776-8e46-4b13ecd30fec tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:01.325080 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9786fc5c-9ddb-4776-8e46-4b13ecd30fec tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:01.325805 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9786fc5c-9ddb-4776-8e46-4b13ecd30fec tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:01.326273 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9786fc5c-9ddb-4776-8e46-4b13ecd30fec tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:01.326724 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9786fc5c-9ddb-4776-8e46-4b13ecd30fec tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:01.463306 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9786fc5c-9ddb-4776-8e46-4b13ecd30fec tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:01.471079 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9786fc5c-9ddb-4776-8e46-4b13ecd30fec tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 200 len: 1375 microversion: 2.1 time: 0.158139 Oct 18 14:55:01.471676 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4014/7830] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:01 2022] GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:02.495010 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-bd093724-d058-469e-9a4f-085573ea453a tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:02.495703 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-bd093724-d058-469e-9a4f-085573ea453a tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:02.502457 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd093724-d058-469e-9a4f-085573ea453a tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:02.502936 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd093724-d058-469e-9a4f-085573ea453a tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:02.503368 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd093724-d058-469e-9a4f-085573ea453a tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:02.504047 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd093724-d058-469e-9a4f-085573ea453a tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:02.504490 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd093724-d058-469e-9a4f-085573ea453a tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:02.504911 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-bd093724-d058-469e-9a4f-085573ea453a tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:02.642275 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-bd093724-d058-469e-9a4f-085573ea453a tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:02.650114 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-bd093724-d058-469e-9a4f-085573ea453a tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 200 len: 1560 microversion: 2.1 time: 0.159506 Oct 18 14:55:02.650696 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3817/7831] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:02 2022] GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:02.672734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-d8adf87a-6e82-4f85-b71a-fa8e88bde343 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:55:02.673486 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-d8adf87a-6e82-4f85-b71a-fa8e88bde343 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:55:02.681902 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8adf87a-6e82-4f85-b71a-fa8e88bde343 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:02.682400 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8adf87a-6e82-4f85-b71a-fa8e88bde343 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:02.682844 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8adf87a-6e82-4f85-b71a-fa8e88bde343 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:02.683547 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8adf87a-6e82-4f85-b71a-fa8e88bde343 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:02.684009 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8adf87a-6e82-4f85-b71a-fa8e88bde343 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:02.684442 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-d8adf87a-6e82-4f85-b71a-fa8e88bde343 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:02.820318 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-d8adf87a-6e82-4f85-b71a-fa8e88bde343 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:55:02.828217 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-d8adf87a-6e82-4f85-b71a-fa8e88bde343 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 200 len: 1560 microversion: 2.1 time: 0.159377 Oct 18 14:55:02.828798 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4015/7832] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:55:02 2022] GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:55:04.927254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=6 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:55:04.999673 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-01008a37-6270-4b6e-b758-fc5fc090446a req-d6317aed-c6b3-40e3-b639-54e77d46f985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be342df-20b6-4f8c-baa6-92f51ba203cf", "tag": "c5f1a471-592e-41a3-b0a9-720b55f1feb4"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:55:05.011035 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-01008a37-6270-4b6e-b758-fc5fc090446a req-d6317aed-c6b3-40e3-b639-54e77d46f985 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:55:05.011606 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-01008a37-6270-4b6e-b758-fc5fc090446a req-d6317aed-c6b3-40e3-b639-54e77d46f985 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:55:05.012106 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-01008a37-6270-4b6e-b758-fc5fc090446a req-d6317aed-c6b3-40e3-b639-54e77d46f985 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:55:05.024746 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-01008a37-6270-4b6e-b758-fc5fc090446a req-d6317aed-c6b3-40e3-b639-54e77d46f985 service nova] Creating event network-changed:c5f1a471-592e-41a3-b0a9-720b55f1feb4 for instance 1be342df-20b6-4f8c-baa6-92f51ba203cf on n-h1-858384-13 Oct 18 14:55:05.030234 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-01008a37-6270-4b6e-b758-fc5fc090446a req-d6317aed-c6b3-40e3-b639-54e77d46f985 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107507 Oct 18 14:55:05.030999 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3818/7833] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 14:57:32.026248 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8f8474d7-3472-4de9-9dba-6d0727c9399f] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:57:32.027183 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2749d46-7aff-41c9-91de-55da262717f1] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 18 14:57:32.027833 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:32.028608 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:32.029511 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:32.030199 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=34 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:32.031730 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:57:32.031872 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:57:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf/action (ip 10.222.0.40) !!! Oct 18 14:57:32.033369 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:57:32.033540 n-d-858384-13 devstack@n-api.service[120611]: Tue Oct 18 14:57:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf/action (ip 10.222.0.40) !!! Oct 18 14:57:32.040013 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-60e19f7e-a2e7-4580-819d-0308781475e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-466866715"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:57:32.042431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-60e19f7e-a2e7-4580-819d-0308781475e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:32.058167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60e19f7e-a2e7-4580-819d-0308781475e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:32.058677 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60e19f7e-a2e7-4580-819d-0308781475e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:32.059136 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60e19f7e-a2e7-4580-819d-0308781475e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:32.059855 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60e19f7e-a2e7-4580-819d-0308781475e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:32.060328 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60e19f7e-a2e7-4580-819d-0308781475e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:32.060770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-60e19f7e-a2e7-4580-819d-0308781475e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:32.266250 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-60e19f7e-a2e7-4580-819d-0308781475e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "POST /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf/action" status: 202 len: 0 microversion: 2.1 time: 0.241760 Oct 18 14:57:32.266906 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4016/7834] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:57:32 2022] POST /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 14:57:39.787211 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4632368d-33e6-409b-9dc2-fb1f52b7b887] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:57:39.788029 n-d-858384-13 devstack@n-api.service[120612]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d5b88c2f-79b6-477e-bcc2-8d31160b4455] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:57:39.788627 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:39.789496 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=28 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:39.791081 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:57:39.791806 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:57:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 18 14:57:39.793909 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 18 14:57:39.794122 n-d-858384-13 devstack@n-api.service[120612]: Tue Oct 18 14:57:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 18 14:57:39.907581 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-a0d73b60-70a9-49ae-8f66-9b0664bb3de1 req-4eb78832-f121-499a-a8fa-bbd0832d8a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be342df-20b6-4f8c-baa6-92f51ba203cf", "name": "network-vif-plugged", "status": "completed", "tag": "c5f1a471-592e-41a3-b0a9-720b55f1feb4"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:57:39.921291 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a0d73b60-70a9-49ae-8f66-9b0664bb3de1 req-4eb78832-f121-499a-a8fa-bbd0832d8a50 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:39.921776 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a0d73b60-70a9-49ae-8f66-9b0664bb3de1 req-4eb78832-f121-499a-a8fa-bbd0832d8a50 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:39.922210 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-a0d73b60-70a9-49ae-8f66-9b0664bb3de1 req-4eb78832-f121-499a-a8fa-bbd0832d8a50 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:39.933516 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-a0d73b60-70a9-49ae-8f66-9b0664bb3de1 req-4eb78832-f121-499a-a8fa-bbd0832d8a50 service nova] Creating event network-vif-plugged:c5f1a471-592e-41a3-b0a9-720b55f1feb4 for instance 1be342df-20b6-4f8c-baa6-92f51ba203cf on n-h1-858384-13 Oct 18 14:57:39.938960 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-a0d73b60-70a9-49ae-8f66-9b0664bb3de1 req-4eb78832-f121-499a-a8fa-bbd0832d8a50 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153533 Oct 18 14:57:39.939589 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3819/7835] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:57:53.032187 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1021029691", "imageRef": "3430f8de-4a74-4543-8b0b-549b336d628a", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1153970442", "security_groups": [{"name": "tempest-secgroup-smoke-1622909246"}], "networks": [{"uuid": "dd670de4-eb04-4a69-ba23-fec8d1a80680"}]}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:57:53.042474 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:53.043235 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:53.063545 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2749d46-7aff-41c9-91de-55da262717f1] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 45554. Oct 18 14:57:53.064277 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [-] [8f8474d7-3472-4de9-9dba-6d0727c9399f] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 45552. Oct 18 14:57:53.157347 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.network.neutron [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] validate_networks() for [('dd670de4-eb04-4a69-ba23-fec8d1a80680', None, None, None, None, None)] {{(pid=120611) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 18 14:57:53.600530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Flavor limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 18 14:57:53.600976 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Image limits 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 18 14:57:53.601504 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Flavor pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 18 14:57:53.602237 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Image pref 0:0:0 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 18 14:57:53.602711 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.virt.hardware [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 18 14:57:53.612530 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:53.613031 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:53.613589 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:53.614341 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:53.614812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:53.615253 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:53.636355 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Getting quotas for project 71d5f82cf2b446f5bfacea3b7c8796c2. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 18 14:57:53.644103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.quota [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Getting quotas for user 74e09a7b20964a75b793d117e05eaf09 and project 71d5f82cf2b446f5bfacea3b7c8796c2. Resources: {'ram', 'instances', 'cores'} {{(pid=120611) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 18 14:57:53.662563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Going to run 1 instances... {{(pid=120611) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 18 14:57:53.665139 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3430f8de-4a74-4543-8b0b-549b336d628a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 18 14:57:53.718052 n-d-858384-13 devstack@n-api.service[120611]: ERROR oslo.messaging._drivers.impl_rabbit [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [1585c77b-6861-4342-a4a8-67f84b39fbd1] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 18 14:57:54.725824 n-d-858384-13 devstack@n-api.service[120611]: INFO oslo.messaging._drivers.impl_rabbit [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [1585c77b-6861-4342-a4a8-67f84b39fbd1] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 45568. Oct 18 14:57:54.730463 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-240eccc7-2858-4019-9bdd-72b7c21fdf2b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.703634 Oct 18 14:57:54.731125 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4017/7836] 10.222.0.40 () {60 vars in 1147 bytes} [Tue Oct 18 14:57:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 18 14:57:54.741386 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:54.742130 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:57:54.746162 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7736dfe3-481e-4b71-8d72-d3b4f05656c6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:54.747076 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7736dfe3-481e-4b71-8d72-d3b4f05656c6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:54.763845 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] [d5b88c2f-79b6-477e-bcc2-8d31160b4455] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 45574. Oct 18 14:57:54.764807 n-d-858384-13 devstack@n-api.service[120612]: INFO oslo.messaging._drivers.impl_rabbit [-] [4632368d-33e6-409b-9dc2-fb1f52b7b887] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 45572. Oct 18 14:57:54.812433 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7736dfe3-481e-4b71-8d72-d3b4f05656c6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:54.819683 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7736dfe3-481e-4b71-8d72-d3b4f05656c6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1249 microversion: 2.1 time: 0.080477 Oct 18 14:57:54.820301 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3820/7837] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:54 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:55.844431 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-02e7438d-4fea-4fac-ada8-067637b40033 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:55.845429 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-02e7438d-4fea-4fac-ada8-067637b40033 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:55.855567 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e7438d-4fea-4fac-ada8-067637b40033 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:55.856395 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e7438d-4fea-4fac-ada8-067637b40033 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:55.857607 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e7438d-4fea-4fac-ada8-067637b40033 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:55.858386 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e7438d-4fea-4fac-ada8-067637b40033 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:55.858858 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e7438d-4fea-4fac-ada8-067637b40033 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:55.859520 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-02e7438d-4fea-4fac-ada8-067637b40033 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:55.933518 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-02e7438d-4fea-4fac-ada8-067637b40033 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:55.941907 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-02e7438d-4fea-4fac-ada8-067637b40033 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1309 microversion: 2.1 time: 0.103656 Oct 18 14:57:55.943524 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4018/7838] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:55 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:57:56.967768 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-a0558048-b7e5-4124-8434-f1e8f0ed4e1b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:56.969142 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-a0558048-b7e5-4124-8434-f1e8f0ed4e1b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:56.978549 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0558048-b7e5-4124-8434-f1e8f0ed4e1b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:56.979167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0558048-b7e5-4124-8434-f1e8f0ed4e1b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:56.979674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0558048-b7e5-4124-8434-f1e8f0ed4e1b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:56.980479 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0558048-b7e5-4124-8434-f1e8f0ed4e1b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:56.981018 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0558048-b7e5-4124-8434-f1e8f0ed4e1b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:56.981578 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-a0558048-b7e5-4124-8434-f1e8f0ed4e1b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:57.183613 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-a0558048-b7e5-4124-8434-f1e8f0ed4e1b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:57.195752 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-a0558048-b7e5-4124-8434-f1e8f0ed4e1b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1375 microversion: 2.1 time: 0.232785 Oct 18 14:57:57.196452 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3821/7839] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:56 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1375 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:57.836048 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-0f1b3b9d-c848-40ed-b9c9-4dc7ec4e956f req-3fa00268-74ad-45ca-9810-61c55bc9429a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be342df-20b6-4f8c-baa6-92f51ba203cf", "name": "network-vif-unplugged", "status": "completed", "tag": "c5f1a471-592e-41a3-b0a9-720b55f1feb4"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:57:57.861402 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0f1b3b9d-c848-40ed-b9c9-4dc7ec4e956f req-3fa00268-74ad-45ca-9810-61c55bc9429a service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:57.862142 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0f1b3b9d-c848-40ed-b9c9-4dc7ec4e956f req-3fa00268-74ad-45ca-9810-61c55bc9429a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:57.862669 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-0f1b3b9d-c848-40ed-b9c9-4dc7ec4e956f req-3fa00268-74ad-45ca-9810-61c55bc9429a service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:57.879103 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-0f1b3b9d-c848-40ed-b9c9-4dc7ec4e956f req-3fa00268-74ad-45ca-9810-61c55bc9429a service nova] Creating event network-vif-unplugged:c5f1a471-592e-41a3-b0a9-720b55f1feb4 for instance 1be342df-20b6-4f8c-baa6-92f51ba203cf on n-h1-858384-13 Oct 18 14:57:57.885427 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-0f1b3b9d-c848-40ed-b9c9-4dc7ec4e956f req-3fa00268-74ad-45ca-9810-61c55bc9429a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054050 Oct 18 14:57:57.887008 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4019/7840] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:57:58.220893 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-6027929c-f83f-456a-87b5-e41c83008618 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:58.222297 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-6027929c-f83f-456a-87b5-e41c83008618 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:58.229585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6027929c-f83f-456a-87b5-e41c83008618 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:58.230140 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6027929c-f83f-456a-87b5-e41c83008618 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:58.230640 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6027929c-f83f-456a-87b5-e41c83008618 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:58.231426 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6027929c-f83f-456a-87b5-e41c83008618 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:58.232481 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6027929c-f83f-456a-87b5-e41c83008618 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:58.233191 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-6027929c-f83f-456a-87b5-e41c83008618 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:58.388900 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-6027929c-f83f-456a-87b5-e41c83008618 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:58.396993 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-6027929c-f83f-456a-87b5-e41c83008618 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1375 microversion: 2.1 time: 0.179914 Oct 18 14:57:58.397623 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3822/7841] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:58 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:57:59.421619 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-7305b2d3-58c6-48c0-9bb7-fda4a3cd5319 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:57:59.422856 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-7305b2d3-58c6-48c0-9bb7-fda4a3cd5319 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:57:59.430727 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7305b2d3-58c6-48c0-9bb7-fda4a3cd5319 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:59.431502 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7305b2d3-58c6-48c0-9bb7-fda4a3cd5319 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:59.432045 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7305b2d3-58c6-48c0-9bb7-fda4a3cd5319 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:59.432872 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7305b2d3-58c6-48c0-9bb7-fda4a3cd5319 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:57:59.433492 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7305b2d3-58c6-48c0-9bb7-fda4a3cd5319 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:57:59.434210 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-7305b2d3-58c6-48c0-9bb7-fda4a3cd5319 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:57:59.599708 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-7305b2d3-58c6-48c0-9bb7-fda4a3cd5319 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:57:59.608753 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-7305b2d3-58c6-48c0-9bb7-fda4a3cd5319 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1375 microversion: 2.1 time: 0.192383 Oct 18 14:57:59.610005 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4020/7842] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:57:59 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1375 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:58:00.633962 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-056f32b9-f74e-48f4-b0ba-dafa8a31c0ed tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:58:00.635469 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-056f32b9-f74e-48f4-b0ba-dafa8a31c0ed tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:58:00.643645 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-056f32b9-f74e-48f4-b0ba-dafa8a31c0ed tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:00.644222 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-056f32b9-f74e-48f4-b0ba-dafa8a31c0ed tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:00.644908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-056f32b9-f74e-48f4-b0ba-dafa8a31c0ed tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:00.645707 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-056f32b9-f74e-48f4-b0ba-dafa8a31c0ed tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:00.646415 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-056f32b9-f74e-48f4-b0ba-dafa8a31c0ed tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:00.647031 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-056f32b9-f74e-48f4-b0ba-dafa8a31c0ed tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:00.862750 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-056f32b9-f74e-48f4-b0ba-dafa8a31c0ed tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:58:00.870919 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-056f32b9-f74e-48f4-b0ba-dafa8a31c0ed tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1375 microversion: 2.1 time: 0.241938 Oct 18 14:58:00.871506 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3823/7843] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:58:00 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1375 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:58:01.895015 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9bc1e203-e12a-4163-af51-aa41b6bd861c tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:58:01.895714 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9bc1e203-e12a-4163-af51-aa41b6bd861c tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:58:01.902952 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bc1e203-e12a-4163-af51-aa41b6bd861c tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:01.903671 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bc1e203-e12a-4163-af51-aa41b6bd861c tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:01.904234 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bc1e203-e12a-4163-af51-aa41b6bd861c tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:01.913256 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bc1e203-e12a-4163-af51-aa41b6bd861c tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:01.913777 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bc1e203-e12a-4163-af51-aa41b6bd861c tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:01.914238 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9bc1e203-e12a-4163-af51-aa41b6bd861c tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:02.127753 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9bc1e203-e12a-4163-af51-aa41b6bd861c tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:58:02.135743 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9bc1e203-e12a-4163-af51-aa41b6bd861c tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1375 microversion: 2.1 time: 0.244595 Oct 18 14:58:02.136431 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4021/7844] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:58:01 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1375 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:58:03.158699 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-621bd82c-cd91-4949-af64-8241ee04b359 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:58:03.159408 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-621bd82c-cd91-4949-af64-8241ee04b359 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:58:03.166584 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-621bd82c-cd91-4949-af64-8241ee04b359 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:03.167167 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-621bd82c-cd91-4949-af64-8241ee04b359 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:03.167868 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-621bd82c-cd91-4949-af64-8241ee04b359 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:03.168816 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-621bd82c-cd91-4949-af64-8241ee04b359 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:03.169522 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-621bd82c-cd91-4949-af64-8241ee04b359 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:03.170193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-621bd82c-cd91-4949-af64-8241ee04b359 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:03.317308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-621bd82c-cd91-4949-af64-8241ee04b359 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:58:03.325298 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-621bd82c-cd91-4949-af64-8241ee04b359 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1375 microversion: 2.1 time: 0.170538 Oct 18 14:58:03.325915 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3824/7845] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:58:03 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:58:04.348804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b66456bd-bf9f-4d86-b834-4005a68713e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:58:04.349427 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b66456bd-bf9f-4d86-b834-4005a68713e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:58:04.352555 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:58:04.353167 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell0:SELECT=6 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:58:04.359325 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b66456bd-bf9f-4d86-b834-4005a68713e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:04.359942 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b66456bd-bf9f-4d86-b834-4005a68713e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:04.360406 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b66456bd-bf9f-4d86-b834-4005a68713e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:04.361130 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b66456bd-bf9f-4d86-b834-4005a68713e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:04.361655 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b66456bd-bf9f-4d86-b834-4005a68713e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:04.362103 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b66456bd-bf9f-4d86-b834-4005a68713e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:04.509975 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-b66456bd-bf9f-4d86-b834-4005a68713e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:58:04.519095 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b66456bd-bf9f-4d86-b834-4005a68713e7 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1375 microversion: 2.1 time: 0.174297 Oct 18 14:58:04.519700 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4022/7846] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:58:04 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:58:04.817414 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell0:SELECT=2 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:58:04.876674 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-726fbf85-d9a1-48e5-8522-ceab12ff36e1 req-866f6304-37f0-4f07-8f57-093ed7278924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1948061c-9688-47ff-af98-2078d687ac10", "tag": "468ea17f-bfc8-4719-8320-f7c7c37606ee"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:58:04.907224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-726fbf85-d9a1-48e5-8522-ceab12ff36e1 req-866f6304-37f0-4f07-8f57-093ed7278924 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:04.907820 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-726fbf85-d9a1-48e5-8522-ceab12ff36e1 req-866f6304-37f0-4f07-8f57-093ed7278924 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:04.908484 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-726fbf85-d9a1-48e5-8522-ceab12ff36e1 req-866f6304-37f0-4f07-8f57-093ed7278924 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:04.926033 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-726fbf85-d9a1-48e5-8522-ceab12ff36e1 req-866f6304-37f0-4f07-8f57-093ed7278924 service nova] Creating event network-changed:468ea17f-bfc8-4719-8320-f7c7c37606ee for instance 1948061c-9688-47ff-af98-2078d687ac10 on n-h2-858384-13 Oct 18 14:58:04.933409 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-726fbf85-d9a1-48e5-8522-ceab12ff36e1 req-866f6304-37f0-4f07-8f57-093ed7278924 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132028 Oct 18 14:58:04.934680 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3825/7847] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:58:05.544249 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-a08b0d88-aa47-44ab-9612-40fc6cdeb288 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:58:05.544875 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-a08b0d88-aa47-44ab-9612-40fc6cdeb288 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:58:05.552563 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a08b0d88-aa47-44ab-9612-40fc6cdeb288 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:05.553067 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a08b0d88-aa47-44ab-9612-40fc6cdeb288 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:05.553551 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a08b0d88-aa47-44ab-9612-40fc6cdeb288 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:05.554265 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a08b0d88-aa47-44ab-9612-40fc6cdeb288 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:05.554740 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a08b0d88-aa47-44ab-9612-40fc6cdeb288 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:05.555186 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-a08b0d88-aa47-44ab-9612-40fc6cdeb288 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:05.690073 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-a08b0d88-aa47-44ab-9612-40fc6cdeb288 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:58:05.698146 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-a08b0d88-aa47-44ab-9612-40fc6cdeb288 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1375 microversion: 2.1 time: 0.157817 Oct 18 14:58:05.698734 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4023/7848] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:58:05 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:58:06.724570 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-ed106d56-197e-4581-9c04-4ebfee3226b8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:58:06.726193 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-ed106d56-197e-4581-9c04-4ebfee3226b8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:58:06.732690 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed106d56-197e-4581-9c04-4ebfee3226b8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:06.733168 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed106d56-197e-4581-9c04-4ebfee3226b8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:06.733629 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed106d56-197e-4581-9c04-4ebfee3226b8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:06.734539 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed106d56-197e-4581-9c04-4ebfee3226b8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:06.734996 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed106d56-197e-4581-9c04-4ebfee3226b8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:06.735420 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-ed106d56-197e-4581-9c04-4ebfee3226b8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:06.869012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-ed106d56-197e-4581-9c04-4ebfee3226b8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:58:06.877480 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-ed106d56-197e-4581-9c04-4ebfee3226b8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1375 microversion: 2.1 time: 0.160076 Oct 18 14:58:06.878049 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3826/7849] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:58:06 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:58:07.901054 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-f5aefd55-fbc5-4f49-a055-a29422969c9b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:58:07.901707 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-f5aefd55-fbc5-4f49-a055-a29422969c9b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:58:07.909425 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5aefd55-fbc5-4f49-a055-a29422969c9b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:07.909934 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5aefd55-fbc5-4f49-a055-a29422969c9b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:07.910396 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5aefd55-fbc5-4f49-a055-a29422969c9b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:07.911110 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5aefd55-fbc5-4f49-a055-a29422969c9b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:07.911587 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5aefd55-fbc5-4f49-a055-a29422969c9b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:07.912042 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-f5aefd55-fbc5-4f49-a055-a29422969c9b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:08.046770 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-f5aefd55-fbc5-4f49-a055-a29422969c9b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:58:08.054564 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-f5aefd55-fbc5-4f49-a055-a29422969c9b tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1375 microversion: 2.1 time: 0.157484 Oct 18 14:58:08.055141 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4024/7850] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:58:07 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:58:09.078708 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-f633999b-69fe-40f2-ac20-2d9fa7dfa8c8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:58:09.079278 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-f633999b-69fe-40f2-ac20-2d9fa7dfa8c8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:58:09.086343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f633999b-69fe-40f2-ac20-2d9fa7dfa8c8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:09.086831 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f633999b-69fe-40f2-ac20-2d9fa7dfa8c8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:09.087265 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f633999b-69fe-40f2-ac20-2d9fa7dfa8c8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:09.087968 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f633999b-69fe-40f2-ac20-2d9fa7dfa8c8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:09.088425 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f633999b-69fe-40f2-ac20-2d9fa7dfa8c8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:09.088852 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-f633999b-69fe-40f2-ac20-2d9fa7dfa8c8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:09.228908 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-f633999b-69fe-40f2-ac20-2d9fa7dfa8c8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:58:09.238553 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-f633999b-69fe-40f2-ac20-2d9fa7dfa8c8 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1375 microversion: 2.1 time: 0.164177 Oct 18 14:58:09.239166 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3827/7851] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:58:09 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:58:10.261119 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-c8712010-1c69-4668-9ad4-a57ede806e52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:58:10.261773 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-c8712010-1c69-4668-9ad4-a57ede806e52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:58:10.269303 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8712010-1c69-4668-9ad4-a57ede806e52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:10.269804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8712010-1c69-4668-9ad4-a57ede806e52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:10.270257 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8712010-1c69-4668-9ad4-a57ede806e52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:10.270967 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8712010-1c69-4668-9ad4-a57ede806e52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:10.271439 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8712010-1c69-4668-9ad4-a57ede806e52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:10.271881 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-c8712010-1c69-4668-9ad4-a57ede806e52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:10.410947 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-c8712010-1c69-4668-9ad4-a57ede806e52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:58:10.418768 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-c8712010-1c69-4668-9ad4-a57ede806e52 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1375 microversion: 2.1 time: 0.161638 Oct 18 14:58:10.419343 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4025/7852] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:58:10 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:58:10.936431 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-9f6239e0-a486-4cf2-944b-dacf32475147 req-e8d95874-5881-4986-8cb3-0986615da1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1948061c-9688-47ff-af98-2078d687ac10", "name": "network-vif-plugged", "status": "completed", "tag": "468ea17f-bfc8-4719-8320-f7c7c37606ee"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:58:10.947903 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9f6239e0-a486-4cf2-944b-dacf32475147 req-e8d95874-5881-4986-8cb3-0986615da1b4 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:10.948410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9f6239e0-a486-4cf2-944b-dacf32475147 req-e8d95874-5881-4986-8cb3-0986615da1b4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:10.948931 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-9f6239e0-a486-4cf2-944b-dacf32475147 req-e8d95874-5881-4986-8cb3-0986615da1b4 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:10.962268 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-9f6239e0-a486-4cf2-944b-dacf32475147 req-e8d95874-5881-4986-8cb3-0986615da1b4 service nova] Creating event network-vif-plugged:468ea17f-bfc8-4719-8320-f7c7c37606ee for instance 1948061c-9688-47ff-af98-2078d687ac10 on n-h2-858384-13 Oct 18 14:58:10.967234 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-9f6239e0-a486-4cf2-944b-dacf32475147 req-e8d95874-5881-4986-8cb3-0986615da1b4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034684 Oct 18 14:58:10.967846 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3828/7853] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:58:11.441810 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-763b927b-da1b-4b67-a523-b1a7ebfc66f4 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:58:11.442375 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-763b927b-da1b-4b67-a523-b1a7ebfc66f4 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:58:11.449657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-763b927b-da1b-4b67-a523-b1a7ebfc66f4 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:11.450159 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-763b927b-da1b-4b67-a523-b1a7ebfc66f4 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:11.450611 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-763b927b-da1b-4b67-a523-b1a7ebfc66f4 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:11.451323 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-763b927b-da1b-4b67-a523-b1a7ebfc66f4 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:11.451796 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-763b927b-da1b-4b67-a523-b1a7ebfc66f4 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:11.452240 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-763b927b-da1b-4b67-a523-b1a7ebfc66f4 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:11.589258 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-763b927b-da1b-4b67-a523-b1a7ebfc66f4 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:58:11.597985 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-763b927b-da1b-4b67-a523-b1a7ebfc66f4 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1375 microversion: 2.1 time: 0.160372 Oct 18 14:58:11.598583 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4026/7854] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:58:11 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:58:12.622387 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-16b198ee-df89-4d5b-9958-8f117e8e5aaf tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:58:12.623090 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-16b198ee-df89-4d5b-9958-8f117e8e5aaf tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:58:12.630105 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b198ee-df89-4d5b-9958-8f117e8e5aaf tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:12.630585 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b198ee-df89-4d5b-9958-8f117e8e5aaf tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:12.631022 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b198ee-df89-4d5b-9958-8f117e8e5aaf tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:12.631710 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b198ee-df89-4d5b-9958-8f117e8e5aaf tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:12.632166 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b198ee-df89-4d5b-9958-8f117e8e5aaf tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:12.632589 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-16b198ee-df89-4d5b-9958-8f117e8e5aaf tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:12.765859 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-16b198ee-df89-4d5b-9958-8f117e8e5aaf tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:58:12.773929 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-16b198ee-df89-4d5b-9958-8f117e8e5aaf tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1560 microversion: 2.1 time: 0.156528 Oct 18 14:58:12.774351 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3829/7855] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:58:12 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:58:12.797270 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-9032218f-b5f6-4304-aeee-216ad31189bb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:58:12.797861 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-9032218f-b5f6-4304-aeee-216ad31189bb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:58:12.804245 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9032218f-b5f6-4304-aeee-216ad31189bb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:12.804734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9032218f-b5f6-4304-aeee-216ad31189bb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:12.805203 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9032218f-b5f6-4304-aeee-216ad31189bb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:12.805893 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9032218f-b5f6-4304-aeee-216ad31189bb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:12.806360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9032218f-b5f6-4304-aeee-216ad31189bb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:12.806793 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-9032218f-b5f6-4304-aeee-216ad31189bb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:12.946338 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-9032218f-b5f6-4304-aeee-216ad31189bb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:58:12.954749 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-9032218f-b5f6-4304-aeee-216ad31189bb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1560 microversion: 2.1 time: 0.162097 Oct 18 14:58:12.955324 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4027/7856] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:58:12 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:58:14.550308 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-484c28e7-5462-4243-a53c-af31b37da98f req-9d391e78-6ee3-4435-9ce9-731f0016e7df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1948061c-9688-47ff-af98-2078d687ac10", "tag": "468ea17f-bfc8-4719-8320-f7c7c37606ee"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:58:14.560524 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-484c28e7-5462-4243-a53c-af31b37da98f req-9d391e78-6ee3-4435-9ce9-731f0016e7df service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:58:14.561015 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-484c28e7-5462-4243-a53c-af31b37da98f req-9d391e78-6ee3-4435-9ce9-731f0016e7df service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:58:14.561488 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-484c28e7-5462-4243-a53c-af31b37da98f req-9d391e78-6ee3-4435-9ce9-731f0016e7df service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:58:14.574110 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-484c28e7-5462-4243-a53c-af31b37da98f req-9d391e78-6ee3-4435-9ce9-731f0016e7df service nova] Creating event network-changed:468ea17f-bfc8-4719-8320-f7c7c37606ee for instance 1948061c-9688-47ff-af98-2078d687ac10 on n-h2-858384-13 Oct 18 14:58:14.579334 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-484c28e7-5462-4243-a53c-af31b37da98f req-9d391e78-6ee3-4435-9ce9-731f0016e7df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034163 Oct 18 14:58:14.579941 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3830/7857] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:59:42.036090 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:59:42.036888 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=58 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:59:42.042324 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-eb6dba5e-e04c-4de8-b41a-898b229f66b0 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1376406509"}} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:59:42.044804 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-eb6dba5e-e04c-4de8-b41a-898b229f66b0 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:59:42.052696 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb6dba5e-e04c-4de8-b41a-898b229f66b0 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:42.053212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb6dba5e-e04c-4de8-b41a-898b229f66b0 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:42.053675 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb6dba5e-e04c-4de8-b41a-898b229f66b0 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:42.054390 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb6dba5e-e04c-4de8-b41a-898b229f66b0 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:42.054865 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb6dba5e-e04c-4de8-b41a-898b229f66b0 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:42.055312 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-eb6dba5e-e04c-4de8-b41a-898b229f66b0 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:42.263637 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-eb6dba5e-e04c-4de8-b41a-898b229f66b0 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "POST /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10/action" status: 202 len: 0 microversion: 2.1 time: 0.229674 Oct 18 14:59:42.264296 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4028/7858] 10.222.0.40 () {60 vars in 1278 bytes} [Tue Oct 18 14:59:42 2022] POST /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 18 14:59:47.451383 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-73e77d1c-cf4f-4670-887d-1fcd2814fc27 req-ca815665-5782-4ee7-b7df-f5e1ee11fbef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1948061c-9688-47ff-af98-2078d687ac10", "name": "network-vif-plugged", "status": "completed", "tag": "468ea17f-bfc8-4719-8320-f7c7c37606ee"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:59:47.467566 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_api:SELECT=24 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:59:47.468899 n-d-858384-13 devstack@n-api.service[120612]: DEBUG dbcounter [-] [120612] Writing DB stats nova_cell1:SELECT=48 {{(pid=120612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:59:47.475097 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-73e77d1c-cf4f-4670-887d-1fcd2814fc27 req-ca815665-5782-4ee7-b7df-f5e1ee11fbef service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:47.476395 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-73e77d1c-cf4f-4670-887d-1fcd2814fc27 req-ca815665-5782-4ee7-b7df-f5e1ee11fbef service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:47.477084 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-73e77d1c-cf4f-4670-887d-1fcd2814fc27 req-ca815665-5782-4ee7-b7df-f5e1ee11fbef service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:47.492312 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-73e77d1c-cf4f-4670-887d-1fcd2814fc27 req-ca815665-5782-4ee7-b7df-f5e1ee11fbef service nova] Creating event network-vif-plugged:468ea17f-bfc8-4719-8320-f7c7c37606ee for instance 1948061c-9688-47ff-af98-2078d687ac10 on n-h2-858384-13 Oct 18 14:59:47.498779 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-73e77d1c-cf4f-4670-887d-1fcd2814fc27 req-ca815665-5782-4ee7-b7df-f5e1ee11fbef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053932 Oct 18 14:59:47.499789 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3831/7859] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:59:56.397398 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_api:SELECT=2 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:59:56.398276 n-d-858384-13 devstack@n-api.service[120611]: DEBUG dbcounter [-] [120611] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 14:59:56.401634 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [req-fd0dbd27-85e7-4a76-831b-c7003ecc7b3a req-c0574b53-46e8-49a9-9fcc-c9af7c8a6894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1948061c-9688-47ff-af98-2078d687ac10", "tag": "468ea17f-bfc8-4719-8320-f7c7c37606ee"}]} {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:59:56.405246 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-ed33db58-6f92-4924-9db4-dc692f9166d6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:59:56.405891 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ed33db58-6f92-4924-9db4-dc692f9166d6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:59:56.413170 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fd0dbd27-85e7-4a76-831b-c7003ecc7b3a req-c0574b53-46e8-49a9-9fcc-c9af7c8a6894 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:56.413974 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fd0dbd27-85e7-4a76-831b-c7003ecc7b3a req-c0574b53-46e8-49a9-9fcc-c9af7c8a6894 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:56.414658 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed33db58-6f92-4924-9db4-dc692f9166d6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:56.414815 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [req-fd0dbd27-85e7-4a76-831b-c7003ecc7b3a req-c0574b53-46e8-49a9-9fcc-c9af7c8a6894 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:56.415162 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed33db58-6f92-4924-9db4-dc692f9166d6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:56.415615 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed33db58-6f92-4924-9db4-dc692f9166d6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:56.416331 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed33db58-6f92-4924-9db4-dc692f9166d6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:56.416800 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed33db58-6f92-4924-9db4-dc692f9166d6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:56.417446 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-ed33db58-6f92-4924-9db4-dc692f9166d6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:56.427657 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.compute.server_external_events [req-fd0dbd27-85e7-4a76-831b-c7003ecc7b3a req-c0574b53-46e8-49a9-9fcc-c9af7c8a6894 service nova] Creating event network-changed:468ea17f-bfc8-4719-8320-f7c7c37606ee for instance 1948061c-9688-47ff-af98-2078d687ac10 on n-h2-858384-13 Oct 18 14:59:56.432849 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [req-fd0dbd27-85e7-4a76-831b-c7003ecc7b3a req-c0574b53-46e8-49a9-9fcc-c9af7c8a6894 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035468 Oct 18 14:59:56.433779 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3832/7860] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:59:56.452532 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-ed33db58-6f92-4924-9db4-dc692f9166d6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Going to try to terminate instance {{(pid=120611) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 14:59:56.543171 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-ed33db58-6f92-4924-9db4-dc692f9166d6 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 204 len: 0 microversion: 2.1 time: 0.147596 Oct 18 14:59:56.544739 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4029/7861] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 14:59:56 2022] DELETE /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 14:59:56.555304 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-7194c6bc-4ef1-483d-99a6-81f7df8179eb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:59:56.556411 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-7194c6bc-4ef1-483d-99a6-81f7df8179eb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:59:56.563434 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7194c6bc-4ef1-483d-99a6-81f7df8179eb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:56.564059 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7194c6bc-4ef1-483d-99a6-81f7df8179eb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:56.564705 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7194c6bc-4ef1-483d-99a6-81f7df8179eb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:56.565511 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7194c6bc-4ef1-483d-99a6-81f7df8179eb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:56.566181 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7194c6bc-4ef1-483d-99a6-81f7df8179eb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:56.566669 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-7194c6bc-4ef1-483d-99a6-81f7df8179eb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:56.716141 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-7194c6bc-4ef1-483d-99a6-81f7df8179eb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:59:56.724576 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-7194c6bc-4ef1-483d-99a6-81f7df8179eb tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1684 microversion: 2.1 time: 0.174279 Oct 18 14:59:56.725165 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3833/7862] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:59:56 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 18 14:59:57.455639 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-bd3480ec-6ebe-4fa6-9b38-f5fab9b86a0f req-d604bdfe-55c5-47b1-a31e-2384d569c022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1948061c-9688-47ff-af98-2078d687ac10", "name": "network-vif-unplugged", "status": "completed", "tag": "468ea17f-bfc8-4719-8320-f7c7c37606ee"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:59:57.471352 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bd3480ec-6ebe-4fa6-9b38-f5fab9b86a0f req-d604bdfe-55c5-47b1-a31e-2384d569c022 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:57.472177 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bd3480ec-6ebe-4fa6-9b38-f5fab9b86a0f req-d604bdfe-55c5-47b1-a31e-2384d569c022 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:57.472812 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-bd3480ec-6ebe-4fa6-9b38-f5fab9b86a0f req-d604bdfe-55c5-47b1-a31e-2384d569c022 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:57.485706 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-bd3480ec-6ebe-4fa6-9b38-f5fab9b86a0f req-d604bdfe-55c5-47b1-a31e-2384d569c022 service nova] Creating event network-vif-unplugged:468ea17f-bfc8-4719-8320-f7c7c37606ee for instance 1948061c-9688-47ff-af98-2078d687ac10 on n-h2-858384-13 Oct 18 14:59:57.490913 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-bd3480ec-6ebe-4fa6-9b38-f5fab9b86a0f req-d604bdfe-55c5-47b1-a31e-2384d569c022 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045916 Oct 18 14:59:57.491527 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4030/7863] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:59:57.748657 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-8d4bad64-2836-411e-bb7a-ad6bc964ec81 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:59:57.749306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-8d4bad64-2836-411e-bb7a-ad6bc964ec81 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:59:57.757507 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d4bad64-2836-411e-bb7a-ad6bc964ec81 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:57.757995 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d4bad64-2836-411e-bb7a-ad6bc964ec81 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:57.758423 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d4bad64-2836-411e-bb7a-ad6bc964ec81 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:57.759109 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d4bad64-2836-411e-bb7a-ad6bc964ec81 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:57.759565 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d4bad64-2836-411e-bb7a-ad6bc964ec81 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:57.759970 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-8d4bad64-2836-411e-bb7a-ad6bc964ec81 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:57.942742 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-8d4bad64-2836-411e-bb7a-ad6bc964ec81 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:59:57.950883 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-8d4bad64-2836-411e-bb7a-ad6bc964ec81 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1684 microversion: 2.1 time: 0.206135 Oct 18 14:59:57.951660 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3834/7864] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:59:57 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1684 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 14:59:58.526108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9a66ae5a-093d-426f-9cfa-1b0abb497237 req-c753e3d2-d682-487b-9f30-e47c5c570800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1948061c-9688-47ff-af98-2078d687ac10", "name": "network-vif-deleted", "tag": "468ea17f-bfc8-4719-8320-f7c7c37606ee"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 14:59:58.537785 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9a66ae5a-093d-426f-9cfa-1b0abb497237 req-c753e3d2-d682-487b-9f30-e47c5c570800 service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:58.538282 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9a66ae5a-093d-426f-9cfa-1b0abb497237 req-c753e3d2-d682-487b-9f30-e47c5c570800 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:58.538734 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9a66ae5a-093d-426f-9cfa-1b0abb497237 req-c753e3d2-d682-487b-9f30-e47c5c570800 service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:58.550798 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9a66ae5a-093d-426f-9cfa-1b0abb497237 req-c753e3d2-d682-487b-9f30-e47c5c570800 service nova] Creating event network-vif-deleted:468ea17f-bfc8-4719-8320-f7c7c37606ee for instance 1948061c-9688-47ff-af98-2078d687ac10 on n-h2-858384-13 Oct 18 14:59:58.555824 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9a66ae5a-093d-426f-9cfa-1b0abb497237 req-c753e3d2-d682-487b-9f30-e47c5c570800 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035998 Oct 18 14:59:58.556510 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4031/7865] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 14:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 14:59:58.975325 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 14:59:58.976176 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 14:59:58.983343 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:58.983828 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:58.984254 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:58.985675 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:58.986306 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:58.987234 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:59.024432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 14:59:59.024912 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 14:59:59.025376 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 14:59:59.025827 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.objects.instance [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lazy-loading 'fault' on Instance uuid 1948061c-9688-47ff-af98-2078d687ac10 {{(pid=120612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 18 14:59:59.074224 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 14:59:59.081892 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-cabf5b87-dc44-488b-b7a1-95b50c88c579 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 200 len: 1339 microversion: 2.1 time: 0.110459 Oct 18 14:59:59.090825 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3835/7866] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 14:59:58 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 1339 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:00.108983 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b583bdca-712e-4a07-ac19-9db31d257fad tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:00.109909 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-b583bdca-712e-4a07-ac19-9db31d257fad tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1948061c-9688-47ff-af98-2078d687ac10] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:00.116772 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b583bdca-712e-4a07-ac19-9db31d257fad tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:00.117304 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b583bdca-712e-4a07-ac19-9db31d257fad tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:00.117755 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b583bdca-712e-4a07-ac19-9db31d257fad tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:00.118456 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b583bdca-712e-4a07-ac19-9db31d257fad tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:00.118921 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b583bdca-712e-4a07-ac19-9db31d257fad tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:00.119358 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-b583bdca-712e-4a07-ac19-9db31d257fad tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:00.132651 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.wsgi [None req-b583bdca-712e-4a07-ac19-9db31d257fad tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] HTTP exception thrown: Instance 1948061c-9688-47ff-af98-2078d687ac10 could not be found. Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b583bdca-712e-4a07-ac19-9db31d257fad tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Request method failure captured: Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: request: GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 HTTP/1.1 Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: Accept: application/json Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: Accept-Encoding: identity Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: Connection: close Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: Content-Length: 0 Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: Content-Type: application/json Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: Host: 10.222.0.40 Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: Openstack-System-Scope: None Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: User-Agent: python-urllib3/1.26.12 Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Auth-Token: gAAAAABjTr41_ZHggfBxk9hy8gKfgnnRs31PiCLE4rfWQYj-I7g-amo3XSWCFpKYSHgoqHqN88wgotTaA5L1FTSWJhmhgurkPpl_VLTKla_COiWeZaP_2JUAyXxgIGX-S_fpD0re7fSuWKx3BXgaVoUMt178j-lTPC76V0upQvq732oRhMwQG04 Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Id: None Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Domain-Name: None Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Identity-Status: Confirmed Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Is-Admin-Project: True Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Id: default Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Domain-Name: Default Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Id: 71d5f82cf2b446f5bfacea3b7c8796c2 Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Project-Name: tempest-TestSnapshotPattern-1568810168 Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Role: member,reader Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Roles: member,reader Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/71d5f82cf2b446f5bfacea3b7c8796c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/71d5f82cf2b446f5bfacea3b7c8796c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/71d5f82cf2b446f5bfacea3b7c8796c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_71d5f82cf2b446f5bfacea3b7c8796c2"}]}] Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant: tempest-TestSnapshotPattern-1568810168 Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Id: 71d5f82cf2b446f5bfacea3b7c8796c2 Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-Tenant-Name: tempest-TestSnapshotPattern-1568810168 Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-User: tempest-TestSnapshotPattern-1568810168-project Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Id: default Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-User-Domain-Name: Default Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-User-Id: 74e09a7b20964a75b793d117e05eaf09 Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: X-User-Name: tempest-TestSnapshotPattern-1568810168-project Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: method: > Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: exception: Instance 1948061c-9688-47ff-af98-2078d687ac10 could not be found. Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: action_args: {'id': '1948061c-9688-47ff-af98-2078d687ac10'} Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1948061c-9688-47ff-af98-2078d687ac10 could not be found. Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1948061c-9688-47ff-af98-2078d687ac10 could not be found. Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:00:00.134320 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 15:00:00.139940 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:00:00.139940 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:00:00.139940 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:00:00.139940 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:00:00.139940 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:00:00.139940 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1948061c-9688-47ff-af98-2078d687ac10 could not be found. Oct 18 15:00:00.139940 n-d-858384-13 devstack@n-api.service[120611]: ERROR nova.api.openstack.wsgi Oct 18 15:00:00.139940 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b583bdca-712e-4a07-ac19-9db31d257fad tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Returning 404 to user: Instance 1948061c-9688-47ff-af98-2078d687ac10 could not be found. {{(pid=120611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:00:00.139940 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b583bdca-712e-4a07-ac19-9db31d257fad tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10" status: 404 len: 111 microversion: 2.1 time: 0.032124 Oct 18 15:00:00.139940 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4032/7867] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:00 2022] GET /compute/v2.1/servers/1948061c-9688-47ff-af98-2078d687ac10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 18 15:00:01.503379 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-fb591739-bafb-4ee3-ac1a-5c98804d6501 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:01.503944 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb591739-bafb-4ee3-ac1a-5c98804d6501 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:01.505954 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-f001752b-99ed-42d6-a832-fb6feba9e65d req-58e82405-282c-4038-b026-7dc14f95a96e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be342df-20b6-4f8c-baa6-92f51ba203cf", "tag": "c5f1a471-592e-41a3-b0a9-720b55f1feb4"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:00:01.510924 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb591739-bafb-4ee3-ac1a-5c98804d6501 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:01.511410 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb591739-bafb-4ee3-ac1a-5c98804d6501 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:01.511847 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb591739-bafb-4ee3-ac1a-5c98804d6501 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:01.512552 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb591739-bafb-4ee3-ac1a-5c98804d6501 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:01.512991 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb591739-bafb-4ee3-ac1a-5c98804d6501 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:01.513654 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-fb591739-bafb-4ee3-ac1a-5c98804d6501 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:01.520834 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f001752b-99ed-42d6-a832-fb6feba9e65d req-58e82405-282c-4038-b026-7dc14f95a96e service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:01.521360 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f001752b-99ed-42d6-a832-fb6feba9e65d req-58e82405-282c-4038-b026-7dc14f95a96e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:01.521808 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-f001752b-99ed-42d6-a832-fb6feba9e65d req-58e82405-282c-4038-b026-7dc14f95a96e service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:01.533216 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-f001752b-99ed-42d6-a832-fb6feba9e65d req-58e82405-282c-4038-b026-7dc14f95a96e service nova] Creating event network-changed:c5f1a471-592e-41a3-b0a9-720b55f1feb4 for instance 1be342df-20b6-4f8c-baa6-92f51ba203cf on n-h1-858384-13 Oct 18 15:00:01.538997 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-f001752b-99ed-42d6-a832-fb6feba9e65d req-58e82405-282c-4038-b026-7dc14f95a96e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036813 Oct 18 15:00:01.539969 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4033/7868] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 15:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 18 15:00:01.541401 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-fb591739-bafb-4ee3-ac1a-5c98804d6501 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Going to try to terminate instance {{(pid=120612) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 18 15:00:01.625797 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-fb591739-bafb-4ee3-ac1a-5c98804d6501 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 204 len: 0 microversion: 2.1 time: 0.125635 Oct 18 15:00:01.626611 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3836/7869] 10.222.0.40 () {58 vars in 1239 bytes} [Tue Oct 18 15:00:01 2022] DELETE /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 18 15:00:01.637455 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-2be7c0f2-527c-42e6-a414-162b5cb0fd9f tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:01.638212 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.compute.api [None req-2be7c0f2-527c-42e6-a414-162b5cb0fd9f tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120611) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:01.647713 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2be7c0f2-527c-42e6-a414-162b5cb0fd9f tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:01.648351 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2be7c0f2-527c-42e6-a414-162b5cb0fd9f tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:01.648829 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2be7c0f2-527c-42e6-a414-162b5cb0fd9f tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:01.649980 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2be7c0f2-527c-42e6-a414-162b5cb0fd9f tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:01.650458 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2be7c0f2-527c-42e6-a414-162b5cb0fd9f tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:01.651452 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [None req-2be7c0f2-527c-42e6-a414-162b5cb0fd9f tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:01.799994 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.policy [None req-2be7c0f2-527c-42e6-a414-162b5cb0fd9f tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120611) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:01.808208 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-2be7c0f2-527c-42e6-a414-162b5cb0fd9f tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 200 len: 1684 microversion: 2.1 time: 0.176413 Oct 18 15:00:01.808787 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4034/7870] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:01 2022] GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:02.834312 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-436f752f-a457-46ea-98ce-d2d4d8033740 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:02.835016 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-436f752f-a457-46ea-98ce-d2d4d8033740 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:02.841270 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-436f752f-a457-46ea-98ce-d2d4d8033740 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:02.841752 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-436f752f-a457-46ea-98ce-d2d4d8033740 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:02.842183 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-436f752f-a457-46ea-98ce-d2d4d8033740 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:02.842880 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-436f752f-a457-46ea-98ce-d2d4d8033740 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:02.843327 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-436f752f-a457-46ea-98ce-d2d4d8033740 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:02.843748 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-436f752f-a457-46ea-98ce-d2d4d8033740 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:02.990012 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.policy [None req-436f752f-a457-46ea-98ce-d2d4d8033740 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74e09a7b20964a75b793d117e05eaf09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d5f82cf2b446f5bfacea3b7c8796c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120612) authorize /opt/stack/nova/nova/policy.py:199}} Oct 18 15:00:02.998608 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-436f752f-a457-46ea-98ce-d2d4d8033740 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 200 len: 1684 microversion: 2.1 time: 0.169777 Oct 18 15:00:02.999314 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3837/7871] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:02 2022] GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 18 15:00:03.554521 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [req-9cda8731-aed8-4449-af25-a7cec2e14fe9 req-fc8edd36-34d4-4483-8933-640733ab621b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be342df-20b6-4f8c-baa6-92f51ba203cf", "name": "network-vif-deleted", "tag": "c5f1a471-592e-41a3-b0a9-720b55f1feb4"}]} {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 18 15:00:03.566154 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9cda8731-aed8-4449-af25-a7cec2e14fe9 req-fc8edd36-34d4-4483-8933-640733ab621b service nova] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:03.566657 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9cda8731-aed8-4449-af25-a7cec2e14fe9 req-fc8edd36-34d4-4483-8933-640733ab621b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:03.567108 n-d-858384-13 devstack@n-api.service[120611]: DEBUG oslo_concurrency.lockutils [req-9cda8731-aed8-4449-af25-a7cec2e14fe9 req-fc8edd36-34d4-4483-8933-640733ab621b service nova] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:03.579520 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.compute.server_external_events [req-9cda8731-aed8-4449-af25-a7cec2e14fe9 req-fc8edd36-34d4-4483-8933-640733ab621b service nova] Creating event network-vif-deleted:c5f1a471-592e-41a3-b0a9-720b55f1feb4 for instance 1be342df-20b6-4f8c-baa6-92f51ba203cf on n-h1-858384-13 Oct 18 15:00:03.584387 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [req-9cda8731-aed8-4449-af25-a7cec2e14fe9 req-fc8edd36-34d4-4483-8933-640733ab621b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033806 Oct 18 15:00:03.585216 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4035/7872] 10.222.0.40 () {64 vars in 1317 bytes} [Tue Oct 18 15:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 18 15:00:04.022790 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-059910e4-50e1-4005-bd5d-aac0160e9064 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '>' {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:04.023364 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.compute.api [None req-059910e4-50e1-4005-bd5d-aac0160e9064 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] [instance: 1be342df-20b6-4f8c-baa6-92f51ba203cf] Fetching instance by UUID {{(pid=120612) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 18 15:00:04.030163 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-059910e4-50e1-4005-bd5d-aac0160e9064 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:04.030643 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-059910e4-50e1-4005-bd5d-aac0160e9064 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:04.031073 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-059910e4-50e1-4005-bd5d-aac0160e9064 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:04.032351 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-059910e4-50e1-4005-bd5d-aac0160e9064 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Acquiring lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 18 15:00:04.032846 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-059910e4-50e1-4005-bd5d-aac0160e9064 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 18 15:00:04.033299 n-d-858384-13 devstack@n-api.service[120612]: DEBUG oslo_concurrency.lockutils [None req-059910e4-50e1-4005-bd5d-aac0160e9064 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Lock "a8e216eb-ce73-4101-a62e-f9159a9c2bcf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 18 15:00:04.046961 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.wsgi [None req-059910e4-50e1-4005-bd5d-aac0160e9064 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] HTTP exception thrown: Instance 1be342df-20b6-4f8c-baa6-92f51ba203cf could not be found. Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-059910e4-50e1-4005-bd5d-aac0160e9064 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Request method failure captured: Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: request: GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf HTTP/1.1 Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: Accept: application/json Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: Accept-Encoding: identity Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: Connection: close Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: Content-Length: 0 Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: Content-Type: application/json Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: Host: 10.222.0.40 Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: Openstack-System-Scope: None Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: User-Agent: python-urllib3/1.26.12 Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Auth-Token: gAAAAABjTr41_ZHggfBxk9hy8gKfgnnRs31PiCLE4rfWQYj-I7g-amo3XSWCFpKYSHgoqHqN88wgotTaA5L1FTSWJhmhgurkPpl_VLTKla_COiWeZaP_2JUAyXxgIGX-S_fpD0re7fSuWKx3BXgaVoUMt178j-lTPC76V0upQvq732oRhMwQG04 Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Id: None Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Domain-Name: None Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Identity-Status: Confirmed Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Is-Admin-Project: True Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Id: default Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Domain-Name: Default Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Id: 71d5f82cf2b446f5bfacea3b7c8796c2 Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Project-Name: tempest-TestSnapshotPattern-1568810168 Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Role: member,reader Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Roles: member,reader Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/71d5f82cf2b446f5bfacea3b7c8796c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/71d5f82cf2b446f5bfacea3b7c8796c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/71d5f82cf2b446f5bfacea3b7c8796c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_71d5f82cf2b446f5bfacea3b7c8796c2"}]}] Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant: tempest-TestSnapshotPattern-1568810168 Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Id: 71d5f82cf2b446f5bfacea3b7c8796c2 Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-Tenant-Name: tempest-TestSnapshotPattern-1568810168 Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-User: tempest-TestSnapshotPattern-1568810168-project Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Id: default Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-User-Domain-Name: Default Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-User-Id: 74e09a7b20964a75b793d117e05eaf09 Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: X-User-Name: tempest-TestSnapshotPattern-1568810168-project Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: method: > Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: exception: Instance 1be342df-20b6-4f8c-baa6-92f51ba203cf could not be found. Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: action_args: {'id': '1be342df-20b6-4f8c-baa6-92f51ba203cf'} Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: {{(pid=120612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be342df-20b6-4f8c-baa6-92f51ba203cf could not be found. Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be342df-20b6-4f8c-baa6-92f51ba203cf could not be found. Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 18 15:00:04.048603 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 15:00:04.054432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 18 15:00:04.054432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 18 15:00:04.054432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 18 15:00:04.054432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 18 15:00:04.054432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 18 15:00:04.054432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be342df-20b6-4f8c-baa6-92f51ba203cf could not be found. Oct 18 15:00:04.054432 n-d-858384-13 devstack@n-api.service[120612]: ERROR nova.api.openstack.wsgi Oct 18 15:00:04.054432 n-d-858384-13 devstack@n-api.service[120612]: DEBUG nova.api.openstack.wsgi [None req-059910e4-50e1-4005-bd5d-aac0160e9064 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Returning 404 to user: Instance 1be342df-20b6-4f8c-baa6-92f51ba203cf could not be found. {{(pid=120612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 18 15:00:04.054432 n-d-858384-13 devstack@n-api.service[120612]: INFO nova.api.openstack.requestlog [None req-059910e4-50e1-4005-bd5d-aac0160e9064 tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf" status: 404 len: 111 microversion: 2.1 time: 0.031291 Oct 18 15:00:04.054432 n-d-858384-13 devstack@n-api.service[120612]: [pid: 120612|app: 0|req: 3838/7873] 10.222.0.40 () {58 vars in 1236 bytes} [Tue Oct 18 15:00:04 2022] GET /compute/v2.1/servers/1be342df-20b6-4f8c-baa6-92f51ba203cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 18 15:00:04.222163 n-d-858384-13 devstack@n-api.service[120611]: DEBUG nova.api.openstack.wsgi [None req-b6c19a6e-08d8-4e39-a9dc-ce895c7667cc tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] Calling method '.version_select at 0x7ff60f1e9670>' {{(pid=120611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 18 15:00:04.250955 n-d-858384-13 devstack@n-api.service[120611]: INFO nova.api.openstack.requestlog [None req-b6c19a6e-08d8-4e39-a9dc-ce895c7667cc tempest-TestSnapshotPattern-1568810168 tempest-TestSnapshotPattern-1568810168-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1153970442" status: 202 len: 0 microversion: 2.1 time: 0.033141 Oct 18 15:00:04.251858 n-d-858384-13 devstack@n-api.service[120611]: [pid: 120611|app: 0|req: 4036/7874] 10.222.0.40 () {58 vars in 1257 bytes} [Tue Oct 18 15:00:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1153970442 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)